GENERIC from Sat Dec 22 13:09:28 2012 +0200, r244441+vm1 6e3287b, vmcore.17 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2012 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #0 r244441+6e3287b: Sat Dec 22 13:15:56 CET 2012 pho@x4.osted.lan:/var/tmp/deviant2/sys/amd64/compile/PHO amd64 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz K8-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 0x10 Model = 0x2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 4294967296 (4096 MB) avail memory = 3949080576 (3766 MB) : Trying to mount root from ufs:/dev/ufs/root [rw]... Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/ufs/root: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ufs/root: clean, 451846 free (942 frags, 56363 blocks, 0.1% fragmentation) /dev/ufs/home: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ufs/home: clean, 139111 free (5391 frags, 16715 blocks, 0.5% fragmentation) /dev/ufs/usr: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ufs/usr: clean, 4327503 free (164367 frags, 520392 blocks, 1.6% fragmentation) /dev/ufs/var: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ufs/var: clean, 18285188 free (43500 frags, 2280211 blocks, 0.2% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 64147951 free (8487 frags, 8017433 blocks, 0.0% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN Starting Network: lo0 re0 fwe0 fwip0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet 127.0.0.1 netmask 0xff000000 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x4 nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 tentative scopeid 0x1 nd6 options=29 media: Ethernet autoselect (none) status: no carrier fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 Starting devd. Starting Network: fwe0. fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 Starting Network: fwip0. fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 re0: link state changed to UP ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/kde4/lib /usr/local/lib/compat/pkg /usr/local/lib/qt4 32-bit compatibility ldconfig path: /usr/lib32 Creating and/or trimming log files. Starting syslogd. savecore: couldn't find media and/or sector size of /var/crash: Inappropriate ioctl for device Dec 22 16:21:54 x4 savecore: couldn't find media and/or sector size of /var/crash: Inappropriate ioctl for device No core dumps found. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered lock order reversal: 1st 0xffffff80ef05b100 bufwait (bufwait) @ kern/vfs_bio.c:2743 2nd 0xfffffe0008a06a00 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a/frame 0xffffff8125625400 kdb_backtrace() at kdb_backtrace+0x37/frame 0xffffff81256254c0 _witness_debugger() at _witness_debugger+0x2c/frame 0xffffff81256254e0 witness_checkorder() at witness_checkorder+0x82d/frame 0xffffff8125625590 _sx_xlock() at _sx_xlock+0x6d/frame 0xffffff81256255c0 ufsdirhash_acquire() at ufsdirhash_acquire+0x44/frame 0xffffff81256255e0 ufsdirhash_add() at ufsdirhash_add+0x19/frame 0xffffff8125625610 ufs_direnter() at ufs_direnter+0x6c1/frame 0xffffff81256256e0 ufs_mkdir() at ufs_mkdir+0x50a/frame 0xffffff81256258d0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0xaa/frame 0xffffff81256258f0 kern_mkdirat() at kern_mkdirat+0x212/frame 0xffffff8125625ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8125625bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8125625bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x800924bfa, rsp = 0x7fffffffd788, rbp = 0x801006050 --- Clearing /tmp (X related). Starting mountd. Starting nfsd. Recovering vi editor sessions:. Updating motd:. Starting ntpd. Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Starting default moused. Starting inetd. Sat Dec 22 16:21:59 CET 2012 FreeBSD/amd64 (x4.osted.lan) (console) login: Dec 22 16:22:57 x4 su: pho to root on /dev/pts/1 lock order reversal: 1st 0xfffffe011631c320 ufs (ufs) @ ufs/ufs/ufs_vnops.c:1194 2nd 0xffffff80ef124400 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:261 3rd 0xfffffe00bd266098 ufs (ufs) @ kern/vfs_subr.c:2162 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a/frame 0xffffff8125598e70 kdb_backtrace() at kdb_backtrace+0x37/frame 0xffffff8125598f30 _witness_debugger() at _witness_debugger+0x2c/frame 0xffffff8125598f50 witness_checkorder() at witness_checkorder+0x82d/frame 0xffffff8125599000 __lockmgr_args() at __lockmgr_args+0x10ef/frame 0xffffff81255990e0 ffs_lock() at ffs_lock+0x9b/frame 0xffffff8125599130 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x88/frame 0xffffff8125599150 _vn_lock() at _vn_lock+0x8d/frame 0xffffff81255991d0 vget() at vget+0x63/frame 0xffffff8125599220 vfs_hash_get() at vfs_hash_get+0xd5/frame 0xffffff8125599270 ffs_vgetf() at ffs_vgetf+0x48/frame 0xffffff8125599300 softdep_sync_buf() at softdep_sync_buf+0x5c3/frame 0xffffff81255993e0 ffs_syncvnode() at ffs_syncvnode+0x307/frame 0xffffff8125599460 ffs_truncate() at ffs_truncate+0x10bc/frame 0xffffff81255996b0 ufs_rename() at ufs_rename+0x873/frame 0xffffff81255998b0 VOP_RENAME_APV() at VOP_RENAME_APV+0x88/frame 0xffffff81255998d0 kern_renameat() at kern_renameat+0x42e/frame 0xffffff8125599ad0 ia32_syscall() at ia32_syscall+0x35f/frame 0xffffff8125599bf0 Xint0x80_syscall() at Xint0x80_syscall+0x91/frame 0xffffff8125599bf0 --- syscall (128, FreeBSD ELF32, sys_rename), rip = 0x280d6edf, rsp = 0xffffc548, rbp = 0xffffc680 --- Expensive timeout(9) function: 0xffffffff809299e0(0) 0.015027924 s Expensive timeout(9) function: 0xffffffff8077c430(0xffffff8002644320) 0.020655621 s Dec 22 17:17:35 x4 su: pho to root on /dev/pts/1 20121222 17:17:47 all: rename2.sh 20121222 17:53:02 all: umountf6.sh lock order reversal: 1st 0xfffffe0037509ab8 ufs (ufs) @ kern/vfs_mount.c:1236 2nd 0xfffffe0033094ab8 syncer (syncer) @ kern/vfs_subr.c:2273 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a/frame 0xffffff8125af85e0 kdb_backtrace() at kdb_backtrace+0x37/frame 0xffffff8125af86a0 _witness_debugger() at _witness_debugger+0x2c/frame 0xffffff8125af86c0 witness_checkorder() at witness_checkorder+0x82d/frame 0xffffff8125af8770 __lockmgr_args() at __lockmgr_args+0x10ef/frame 0xffffff8125af8850 vop_stdlock() at vop_stdlock+0x39/frame 0xffffff8125af8870 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x88/frame 0xffffff8125af8890 _vn_lock() at _vn_lock+0x8d/frame 0xffffff8125af8910 vputx() at vputx+0x2e8/frame 0xffffff8125af8970 dounmount() at dounmount+0x288/frame 0xffffff8125af89e0 sys_unmount() at sys_unmount+0x38e/frame 0xffffff8125af8ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8125af8bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8125af8bf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8008842ca, rsp = 0x7fffffffcec8, rbp = 0x801006b10 --- lock order reversal: 1st 0xfffffe0037509ab8 ufs (ufs) @ kern/vfs_mount.c:1236 2nd 0xfffffe003726a5a8 devfs (devfs) @ ufs/ffs/ffs_vfsops.c:1395 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a/frame 0xffffff8125af8510 kdb_backtrace() at kdb_backtrace+0x37/frame 0xffffff8125af85d0 _witness_debugger() at _witness_debugger+0x2c/frame 0xffffff8125af85f0 witness_checkorder() at witness_checkorder+0x82d/frame 0xffffff8125af86a0 __lockmgr_args() at __lockmgr_args+0x10ef/frame 0xffffff8125af8780 vop_stdlock() at vop_stdlock+0x39/frame 0xffffff8125af87a0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x88/frame 0xffffff8125af87c0 _vn_lock() at _vn_lock+0x8d/frame 0xffffff8125af8840 ffs_flushfiles() at ffs_flushfiles+0x109/frame 0xffffff8125af88a0 softdep_flushfiles() at softdep_flushfiles+0x64/frame 0xffffff8125af8900 ffs_unmount() at ffs_unmount+0x1dc/frame 0xffffff8125af8970 dounmount() at dounmount+0x2c9/frame 0xffffff8125af89e0 sys_unmount() at sys_unmount+0x38e/frame 0xffffff8125af8ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8125af8bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8125af8bf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8008842ca, rsp = 0x7fffffffcec8, rbp = 0x801006b10 --- Dec 22 17:53:15 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 17:53:23 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 17:53:29 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 17:53:29 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 17:53:29 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 17:53:29 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 17:53:29 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 17:53:30 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 17:53:33 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 17:53:33 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 17:53:33 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 17:53:33 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 17:53:33 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 17:53:33 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 17:53:36 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 17:53:36 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 17:53:39 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 17:53:39 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 17:53:39 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 17:53:39 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 17:53:39 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 17:53:40 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 17:53:43 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 17:53:45 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 17:53:45 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 17:53:45 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 17:54:16 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 17:54:16 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 17:54:16 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 17:54:16 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 17:54:16 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 17:54:16 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 17:55:02 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 17:55:02 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 17:55:26 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 17:55:26 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 17:55:26 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 17:55:26 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 17:55:26 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 17:55:26 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 17:55:26 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 17:55:26 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 17:55:26 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 17:55:26 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 17:55:26 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 17:55:26 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 17:55:44 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument 20121222 17:56:17 all: suj15.sh Dec 22 17:56:18 x4 su: _secure_path: cannot stat /home/stress/.login_conf: Permission denied 20121222 18:26:53 all: nfs6.sh 20121222 18:33:11 all: quota4.sh 20121222 18:35:14 all: snap2.sh lock order reversal: 1st 0xffffff80ef28f100 bufwait (bufwait) @ kern/vfs_bio.c:2743 2nd 0xfffffe0059097c30 snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:2299 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a/frame 0xffffff811c2f4630 kdb_backtrace() at kdb_backtrace+0x37/frame 0xffffff811c2f46f0 _witness_debugger() at _witness_debugger+0x2c/frame 0xffffff811c2f4710 witness_checkorder() at witness_checkorder+0x82d/frame 0xffffff811c2f47c0 __lockmgr_args() at __lockmgr_args+0x10ef/frame 0xffffff811c2f48a0 ffs_copyonwrite() at ffs_copyonwrite+0x199/frame 0xffffff811c2f4940 ffs_geom_strategy() at ffs_geom_strategy+0x1ba/frame 0xffffff811c2f4970 bufwrite() at bufwrite+0x106/frame 0xffffff811c2f49a0 ffs_sbupdate() at ffs_sbupdate+0x9d/frame 0xffffff811c2f4a00 ffs_sync() at ffs_sync+0x4c6/frame 0xffffff811c2f4ac0 sync_fsync() at sync_fsync+0x136/frame 0xffffff811c2f4af0 VOP_FSYNC_APV() at VOP_FSYNC_APV+0xa6/frame 0xffffff811c2f4b10 sched_sync() at sched_sync+0x362/frame 0xffffff811c2f4ba0 fork_exit() at fork_exit+0x139/frame 0xffffff811c2f4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811c2f4bf0 --- trap 0, rip = 0, rsp = 0xffffff811c2f4cb0, rbp = 0 --- lock order reversal: 1st 0xfffffe0059097c30 snaplk (snaplk) @ ufs/ufs/ufs_vnops.c:968 2nd 0xfffffe0045680320 ufs (ufs) @ ufs/ffs/ffs_snapshot.c:1628 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a/frame 0xffffff812573d2b0 kdb_backtrace() at kdb_backtrace+0x37/frame 0xffffff812573d370 _witness_debugger() at _witness_debugger+0x2c/frame 0xffffff812573d390 witness_checkorder() at witness_checkorder+0x82d/frame 0xffffff812573d440 __lockmgr_args() at __lockmgr_args+0x10ef/frame 0xffffff812573d520 ffs_snapremove() at ffs_snapremove+0xe5/frame 0xffffff812573d5a0 ffs_truncate() at ffs_truncate+0xd2a/frame 0xffffff812573d7f0 ufs_inactive() at ufs_inactive+0x28c/frame 0xffffff812573d830 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0xa6/frame 0xffffff812573d850 vinactive() at vinactive+0xb2/frame 0xffffff812573d8b0 vputx() at vputx+0x3b9/frame 0xffffff812573d910 kern_unlinkat() at kern_unlinkat+0x198/frame 0xffffff812573dad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff812573dbf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff812573dbf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x8009242aa, rsp = 0x7fffffffd608, rbp = 0 --- 20121222 18:37:26 all: rdwr.sh 20121222 18:37:31 all: snap2-1.sh lock order reversal: 1st 0xfffffe0054c10ab8 ufs (ufs) @ kern/vfs_subr.c:2162 2nd 0xffffffff81367700 allproc (allproc) @ kern/kern_descrip.c:2679 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a/frame 0xffffff8125dd7770 kdb_backtrace() at kdb_backtrace+0x37/frame 0xffffff8125dd7830 _witness_debugger() at _witness_debugger+0x2c/frame 0xffffff8125dd7850 witness_checkorder() at witness_checkorder+0x82d/frame 0xffffff8125dd7900 _sx_slock() at _sx_slock+0x71/frame 0xffffff8125dd7930 mountcheckdirs() at mountcheckdirs+0x3f/frame 0xffffff8125dd7970 dounmount() at dounmount+0x4a8/frame 0xffffff8125dd79e0 sys_unmount() at sys_unmount+0x38e/frame 0xffffff8125dd7ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8125dd7bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8125dd7bf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8008842ca, rsp = 0x7fffffffcec8, rbp = 0x801006b10 --- 20121222 18:40:13 all: procfs2.sh 20121222 18:40:14 all: kinfo3.sh 20121222 18:55:33 all: statfs.sh 20121222 18:55:49 all: jail.sh 20121222 18:55:51 all: kinfo2.sh 20121222 19:25:55 all: umountf4.sh Dec 22 19:26:07 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 19:26:07 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 19:26:07 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 19:26:07 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 19:26:07 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 19:26:07 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 19:26:07 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 19:26:07 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 19:26:07 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 19:26:07 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 19:26:11 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 19:26:21 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 19:26:21 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 19:26:21 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 19:26:21 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 19:26:21 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 19:26:21 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 19:26:21 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 19:26:21 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 19:26:21 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 19:26:21 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 19:26:22 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 19:26:28 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 19:26:28 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 19:26:28 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 19:26:28 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 19:26:28 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 19:26:28 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 19:26:28 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 19:26:28 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 19:26:28 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 19:26:28 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 19:26:28 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 19:26:28 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 19:26:28 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 19:26:32 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 19:26:32 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 19:26:32 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 19:26:32 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 19:26:32 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 19:26:32 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 19:26:32 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 19:26:32 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 19:26:32 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 19:26:32 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 19:26:37 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 19:26:37 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 19:26:39 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 19:26:39 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 19:26:39 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 19:26:39 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 19:26:39 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 19:26:39 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 19:26:39 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 19:26:39 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 19:27:12 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 19:27:12 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 19:27:13 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 19:27:13 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 19:27:13 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 19:27:13 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 19:27:13 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 19:27:13 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 19:27:13 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 19:27:13 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument 20121222 19:29:00 all: ffs_blkfree.sh 20121222 19:29:46 all: suj17.sh Dec 22 19:29:47 x4 su: _secure_path: cannot stat /home/stress/.login_conf: Permission denied 20121222 19:42:55 all: quota10.sh Dec 22 19:43:51 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 19:43:51 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 19:44:26 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 19:44:58 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 19:45:10 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 19:47:12 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 19:48:45 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 19:48:53 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 19:48:59 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 19:49:13 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 19:50:20 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 19:50:27 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 19:51:36 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 19:51:41 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 19:52:08 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 19:52:35 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 19:53:19 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 19:53:45 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 19:54:04 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 19:54:14 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 19:55:02 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 19:56:03 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 19:57:09 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 19:57:19 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 19:57:45 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 19:58:01 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 19:58:45 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 19:59:27 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 19:59:40 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 20:01:20 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 20:01:20 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 20:02:57 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 20:03:00 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 20:03:27 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 20:04:19 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 20:05:32 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 20:05:32 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 20:06:57 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 20:07:53 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 20:08:14 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 20:08:20 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 20:08:27 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 20:09:42 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 20:10:28 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 20:10:31 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 20:13:02 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 20:14:32 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 20:14:43 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 20:15:05 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 20:15:24 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 20:15:34 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 20:15:45 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 20:16:03 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 20:19:31 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 20:19:33 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 20:20:44 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 20:21:30 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 20:22:40 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 20:23:22 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 20:23:48 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 20:23:53 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 20:23:53 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 20:24:17 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 20:24:46 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument 20121222 20:26:02 all: extattrctl.sh lock order reversal: 1st 0xfffffe00bbdeea38 ufs_extattr_sx (ufs_extattr_sx) @ ufs/ufs/ufs_extattr.c:114 2nd 0xfffffe003cfc6320 ufs (ufs) @ ufs/ffs/ffs_vfsops.c:1694 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a/frame 0xffffff8125bde210 kdb_backtrace() at kdb_backtrace+0x37/frame 0xffffff8125bde2d0 _witness_debugger() at _witness_debugger+0x2c/frame 0xffffff8125bde2f0 witness_checkorder() at witness_checkorder+0x82d/frame 0xffffff8125bde3a0 __lockmgr_args() at __lockmgr_args+0x10ef/frame 0xffffff8125bde480 ffs_vgetf() at ffs_vgetf+0x163/frame 0xffffff8125bde510 ufs_root() at ufs_root+0x1e/frame 0xffffff8125bde540 ufs_extattr_autostart() at ufs_extattr_autostart+0x77/frame 0xffffff8125bde5a0 ffs_mount() at ffs_mount+0x21b3/frame 0xffffff8125bde790 vfs_donmount() at vfs_donmount+0x9b1/frame 0xffffff8125bdea90 sys_nmount() at sys_nmount+0x66/frame 0xffffff8125bdead0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8125bdebf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8125bdebf0 --- syscall (378, FreeBSD ELF64, sys_nmount), rip = 0x800a97eca, rsp = 0x7fffffffc6b8, rbp = 0x7fffffffc6d0 --- 20121222 20:26:05 all: truncate.sh 20121222 20:38:56 all: lockf3.sh 20121222 20:43:48 all: jail2.sh 20121222 20:43:50 all: nullfs2.sh 20121222 20:54:45 all: lookup_shared.sh 20121222 21:16:35 all: zfs3.sh ZFS NOTICE: Prefetch is disabled by default if less than 4GB of RAM is present; to enable, add "vfs.zfs.prefetch_disable=0" to /boot/loader.conf. ZFS filesystem version: 5 ZFS storage pool version: features support (5000) lock order reversal: 1st 0xfffffe010ea96320 zfs (zfs) @ kern/vfs_mount.c:1236 2nd 0xfffffe0104c24830 syncer (syncer) @ kern/vfs_subr.c:2273 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a/frame 0xffffff81258235e0 kdb_backtrace() at kdb_backtrace+0x37/frame 0xffffff81258236a0 _witness_debugger() at _witness_debugger+0x2c/frame 0xffffff81258236c0 witness_checkorder() at witness_checkorder+0x82d/frame 0xffffff8125823770 __lockmgr_args() at __lockmgr_args+0x10ef/frame 0xffffff8125823850 vop_stdlock() at vop_stdlock+0x39/frame 0xffffff8125823870 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x88/frame 0xffffff8125823890 _vn_lock() at _vn_lock+0x8d/frame 0xffffff8125823910 vputx() at vputx+0x2e8/frame 0xffffff8125823970 dounmount() at dounmount+0x288/frame 0xffffff81258239e0 sys_unmount() at sys_unmount+0x38e/frame 0xffffff8125823ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8125823bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8125823bf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8017152ca, rsp = 0x7fffffffb678, rbp = 0x802c1c200 --- 20121222 21:28:23 all: quota5.sh 20121222 21:28:25 all: procfs.sh lock order reversal: 1st 0xfffffe0117895d40 pseudofs (pseudofs) @ kern/vfs_syscalls.c:4019 2nd 0xffffffff81367700 allproc (allproc) @ fs/pseudofs/pseudofs_vnops.c:793 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a/frame 0xffffff8125a80730 kdb_backtrace() at kdb_backtrace+0x37/frame 0xffffff8125a807f0 _witness_debugger() at _witness_debugger+0x2c/frame 0xffffff8125a80810 witness_checkorder() at witness_checkorder+0x82d/frame 0xffffff8125a808c0 _sx_slock() at _sx_slock+0x71/frame 0xffffff8125a808f0 pfs_readdir() at pfs_readdir+0x11c/frame 0xffffff8125a80980 VOP_READDIR_APV() at VOP_READDIR_APV+0xa6/frame 0xffffff8125a809a0 kern_getdirentries() at kern_getdirentries+0x195/frame 0xffffff8125a80a90 sys_getdirentries() at sys_getdirentries+0x2d/frame 0xffffff8125a80ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8125a80bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8125a80bf0 --- syscall (196, FreeBSD ELF64, sys_getdirentries), rip = 0x800d024ca, rsp = 0x7fffffffce48, rbp = 0x1 --- Dec 22 21:28:29 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 21:28:29 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 21:28:35 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:28:39 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:28:41 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:28:43 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:28:43 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:28:47 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:28:49 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 21:28:49 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:28:49 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:28:51 x4 mountd[1164]: can't delete exports for /mnt7: Device busy Dec 22 21:28:54 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 21:28:55 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:28:55 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:28:55 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:29:00 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:29:01 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:29:02 x4 mountd[1164]: can't delete exports for /mnt12: Device busy Dec 22 21:29:04 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:29:05 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:29:07 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:29:07 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:29:08 x4 mountd[1164]: can't delete exports for /mnt15: Device busy Dec 22 21:29:09 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 21:29:10 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:29:10 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 21:29:17 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:29:17 x4 mountd[1164]: can't delete exports for /mnt17: Device busy Dec 22 21:29:17 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:29:21 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 21:29:24 x4 mountd[1164]: can't delete exports for /mnt17: Device busy Dec 22 21:29:24 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 21:29:33 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:29:38 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 21:29:39 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:29:41 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:29:42 x4 mountd[1164]: can't delete exports for /mnt15: Device busy Dec 22 21:29:42 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:29:54 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:29:54 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:29:54 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:29:54 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 21:29:55 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 21:30:11 x4 mountd[1164]: can't delete exports for /mnt12: Device busy Dec 22 21:30:12 x4 mountd[1164]: can't delete exports for /mnt14: Device busy Dec 22 21:30:12 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:30:14 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:30:15 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 21:30:15 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:30:16 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 21:30:16 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 21:30:21 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:30:27 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:30:27 x4 mountd[1164]: can't delete exports for /mnt14: Device busy Dec 22 21:30:32 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:30:36 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:30:41 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument lock order reversal: 1st 0xfffffe00a1dc9320 pseudofs (pseudofs) @ kern/vfs_subr.c:2162 2nd 0xfffffe002fcc9c48 filedesc structure (filedesc structure) @ kern/kern_descrip.c:2684 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a/frame 0xffffff8125a7b770 kdb_backtrace() at kdb_backtrace+0x37/frame 0xffffff8125a7b830 _witness_debugger() at _witness_debugger+0x2c/frame 0xffffff8125a7b850 witness_checkorder() at witness_checkorder+0x82d/frame 0xffffff8125a7b900 _sx_xlock() at _sx_xlock+0x6d/frame 0xffffff8125a7b930 mountcheckdirs() at mountcheckdirs+0x7c/frame 0xffffff8125a7b970 dounmount() at dounmount+0x4a8/frame 0xffffff8125a7b9e0 sys_unmount() at sys_unmount+0x38e/frame 0xffffff8125a7bad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8125a7bbf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8125a7bbf0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8008842ca, rsp = 0x7fffffffcec8, rbp = 0x801006ce8 --- Dec 22 21:30:43 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 21:30:43 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:30:43 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 21:30:45 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:30:47 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:30:47 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:30:48 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:30:49 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 21:30:49 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:30:50 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:30:55 x4 mountd[1164]: can't delete exports for /mnt19: Device busy Dec 22 21:30:55 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:30:57 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:31:01 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:31:05 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:31:05 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:31:16 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 21:31:25 x4 mountd[1164]: can't delete exports for /mnt12: Device busy Dec 22 21:31:29 x4 mountd[1164]: can't delete exports for /mnt14: Device busy Dec 22 21:31:35 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:31:41 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:31:46 x4 mountd[1164]: can't delete exports for /mnt14: Device busy Dec 22 21:31:46 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:31:46 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:31:46 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:31:49 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:31:51 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 21:31:58 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:31:59 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:32:02 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:32:06 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:32:07 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 21:32:08 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:32:12 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:32:15 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 21:32:15 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:32:19 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 21:32:26 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:32:26 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:32:27 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:32:28 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 21:32:28 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:32:30 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:32:30 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:32:31 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:32:32 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:32:33 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:32:37 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 21:32:42 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:32:46 x4 mountd[1164]: can't delete exports for /mnt14: Device busy Dec 22 21:32:48 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:32:49 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:32:50 x4 mountd[1164]: can't delete exports for /mnt16: Device busy Dec 22 21:32:55 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:32:55 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:33:01 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:33:06 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 21:33:08 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:33:09 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 21:33:13 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:33:13 x4 mountd[1164]: can't delete exports for /mnt15: Device busy Dec 22 21:33:13 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 21:33:21 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 21:33:33 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:33:34 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:33:34 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 21:33:35 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 21:33:37 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:33:56 x4 mountd[1164]: can't delete exports for /mnt18: Device busy Dec 22 21:33:56 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:33:57 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:33:59 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 21:33:59 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:33:59 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:34:01 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:34:03 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 21:34:04 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:34:05 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 21:34:09 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:34:10 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:34:12 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:34:12 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:34:13 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:34:19 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 21:34:24 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:34:30 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:34:31 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 21:34:32 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:34:33 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:34:44 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:34:48 x4 mountd[1164]: can't delete exports for /mnt15: Device busy Dec 22 21:34:52 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:34:59 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:35:01 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:35:01 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:35:14 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:35:17 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:35:19 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:35:20 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:35:25 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:35:26 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 21:35:26 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:35:28 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:35:31 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:35:32 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:35:33 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:35:37 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:35:38 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:35:42 x4 mountd[1164]: can't delete exports for /mnt8: Device busy Dec 22 21:35:42 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:35:43 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:35:46 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:35:47 x4 mountd[1164]: can't delete exports for /mnt18: Device busy Dec 22 21:35:52 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:35:52 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:35:59 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:36:00 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:36:01 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:36:01 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:36:01 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:36:01 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:36:02 x4 mountd[1164]: can't delete exports for /mnt15: Device busy Dec 22 21:36:02 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:36:04 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:36:04 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:36:05 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:36:10 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 21:36:16 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:36:17 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:36:24 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:36:35 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 21:36:42 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:36:47 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:36:50 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 21:36:50 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:36:50 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:36:51 x4 mountd[1164]: can't delete exports for /mnt16: Device busy Dec 22 21:36:51 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 21:36:52 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 21:36:52 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:36:57 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:37:03 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:37:11 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:37:20 x4 mountd[1164]: can't delete exports for /mnt5: Device busy Dec 22 21:37:23 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 21:37:23 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:37:29 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:37:36 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 21:37:38 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:37:41 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:37:43 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:37:45 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:37:45 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 21:37:45 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 21:37:46 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:37:47 x4 mountd[1164]: can't delete exports for /mnt10: Device busy Dec 22 21:37:49 x4 mountd[1164]: can't delete exports for /mnt10: Device busy Dec 22 21:37:49 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 21:37:49 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:37:53 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:38:00 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:38:02 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:38:04 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:38:04 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:38:05 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:38:13 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:38:15 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 21:38:23 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:38:35 x4 mountd[1164]: can't delete exports for /mnt5: Device busy Dec 22 21:38:38 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 21:38:43 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:38:51 x4 mountd[1164]: can't delete exports for /mnt14: Device busy Dec 22 21:38:52 x4 mountd[1164]: can't delete exports for /mnt10: Device busy Dec 22 21:38:53 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 21:38:55 x4 mountd[1164]: can't delete exports for /mnt6: Device busy Dec 22 21:38:56 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:38:57 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:38:59 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:39:00 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:39:04 x4 mountd[1164]: can't delete exports for /mnt12: Device busy Dec 22 21:39:04 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:39:04 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:39:05 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 21:39:08 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 21:39:10 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:39:14 x4 mountd[1164]: can't delete exports for /mnt11: Device busy Dec 22 21:39:16 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:39:16 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:39:21 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:39:22 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:39:26 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:39:31 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 21:39:41 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 21:39:43 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:39:50 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:39:59 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:40:07 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:40:07 x4 mountd[1164]: can't delete exports for /mnt18: Device busy Dec 22 21:40:10 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:40:10 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:40:10 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:40:12 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:40:15 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:40:16 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 21:40:17 x4 mountd[1164]: can't delete exports for /mnt18: Device busy Dec 22 21:40:17 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:40:20 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:40:23 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:40:34 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:40:36 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:40:54 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 21:40:57 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:40:59 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:41:02 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:41:13 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:41:15 x4 mountd[1164]: can't delete exports for /mnt10: Device busy Dec 22 21:41:19 x4 mountd[1164]: can't delete exports for /mnt19: Device busy Dec 22 21:41:20 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:41:20 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:41:24 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 21:41:29 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 21:41:33 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 21:41:42 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:41:44 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:41:44 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:41:44 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:41:45 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:41:46 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:41:46 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 21:41:47 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:41:49 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:41:54 x4 mountd[1164]: can't delete exports for /mnt12: Device busy Dec 22 21:41:55 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:41:58 x4 mountd[1164]: can't delete exports for /mnt11: Device busy Dec 22 21:42:06 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:42:09 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 21:42:10 x4 mountd[1164]: can't delete exports for /mnt12: Device busy Dec 22 21:42:12 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:42:12 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:42:16 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:42:18 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:42:31 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:42:31 x4 mountd[1164]: can't delete exports for /mnt11: Device busy Dec 22 21:42:35 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:42:36 x4 mountd[1164]: can't delete exports for /mnt12: Device busy Dec 22 21:42:37 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:42:39 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 21:42:39 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 21:42:39 x4 mountd[1164]: can't delete exports for /mnt15: Device busy Dec 22 21:42:41 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:42:43 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:42:50 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:42:51 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:43:00 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:43:03 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:43:05 x4 mountd[1164]: can't delete exports for /mnt10: Device busy Dec 22 21:43:14 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:43:17 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 21:43:17 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:43:20 x4 mountd[1164]: can't delete exports for /mnt7: Device busy Dec 22 21:43:21 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:43:30 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:43:30 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 21:43:36 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:43:36 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:43:37 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:43:38 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 21:43:38 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 21:43:40 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:43:44 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:43:49 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 21:43:49 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:43:59 x4 mountd[1164]: can't delete exports for /mnt15: Device busy Dec 22 21:44:01 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:44:01 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:44:02 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 21:44:03 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:44:08 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:44:09 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:44:14 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:44:17 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:44:25 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 21:44:25 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:44:31 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 21:44:49 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:44:50 x4 mountd[1164]: can't delete exports for /mnt10: Device busy Dec 22 21:44:51 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:44:53 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:45:00 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 21:45:09 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:45:10 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Expensive timeout(9) function: 0xffffffff8077c430(0xffffff8002644320) 0.086017490 s Dec 22 21:45:20 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:45:22 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 21:45:22 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:45:22 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:45:22 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:45:22 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:45:26 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:45:31 x4 mountd[1164]: can't delete exports for /mnt14: Device busy Dec 22 21:45:36 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:45:37 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 21:45:38 x4 mountd[1164]: can't delete exports for /mnt19: Device busy Dec 22 21:45:40 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:45:43 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 21:45:44 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:45:45 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:45:45 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:45:45 x4 mountd[1164]: can't delete exports for /mnt15: Device busy Dec 22 21:45:45 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:45:48 x4 mountd[1164]: can't delete exports for /mnt10: Device busy Dec 22 21:45:54 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:45:55 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 21:45:55 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:46:00 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:46:02 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:46:03 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 21:46:05 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:46:08 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:46:11 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 21:46:12 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:46:29 x4 mountd[1164]: can't delete exports for /mnt8: Device busy Dec 22 21:46:29 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:46:32 x4 mountd[1164]: can't delete exports for /mnt15: Device busy Dec 22 21:46:32 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:46:43 x4 mountd[1164]: can't delete exports for /mnt12: Device busy Dec 22 21:46:54 x4 mountd[1164]: can't delete exports for /mnt17: Device busy Dec 22 21:46:57 x4 mountd[1164]: can't delete exports for /mnt5: Device busy Dec 22 21:46:58 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 21:47:03 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:47:05 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:47:05 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:47:05 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:47:09 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:47:17 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 21:47:17 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:47:18 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:47:19 x4 mountd[1164]: can't delete exports for /mnt18: Device busy Dec 22 21:47:23 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:47:29 x4 mountd[1164]: can't delete exports for /mnt16: Device busy Dec 22 21:47:30 x4 mountd[1164]: can't delete exports for /mnt5: Device busy Dec 22 21:47:30 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 21:47:30 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:47:30 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:47:31 x4 mountd[1164]: can't delete exports for /mnt17: Device busy Dec 22 21:47:31 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:47:31 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 21:47:41 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 21:47:42 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:47:42 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:47:42 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:47:43 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:47:45 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 21:47:46 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:47:47 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 21:47:47 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:47:48 x4 mountd[1164]: can't delete exports for /mnt10: Device busy Dec 22 21:47:49 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:47:55 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 21:48:16 x4 mountd[1164]: can't delete exports for /mnt9: Device busy Dec 22 21:48:18 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:48:19 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:48:24 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:48:35 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:48:39 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:48:42 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:48:42 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:48:45 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 21:48:46 x4 mountd[1164]: can't delete exports for /mnt14: Device busy Dec 22 21:48:46 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:48:46 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 21:48:48 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:48:49 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:48:49 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:48:50 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 21:48:50 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:48:51 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:49:00 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:49:02 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:49:02 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 21:49:04 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:49:05 x4 mountd[1164]: can't delete exports for /mnt10: Device busy Dec 22 21:49:06 x4 mountd[1164]: can't delete exports for /mnt12: Device busy Dec 22 21:49:06 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:49:07 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:49:07 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 21:49:09 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:49:09 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:49:09 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:49:10 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:49:17 x4 mountd[1164]: can't delete exports for /mnt6: Device busy Dec 22 21:49:27 x4 mountd[1164]: can't delete exports for /mnt11: Device busy Dec 22 21:49:32 x4 mountd[1164]: can't delete exports for /mnt14: Device busy Dec 22 21:49:32 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 21:49:32 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:49:34 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:49:34 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:49:41 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:49:41 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:49:42 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:49:42 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:49:42 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 21:49:42 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:49:43 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:49:44 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 21:49:45 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:49:45 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 21:49:46 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:49:46 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:49:50 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:49:50 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:49:50 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:49:50 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 21:49:53 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:49:54 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:50:00 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:50:02 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:50:08 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 21:50:08 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:50:10 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:50:12 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:50:17 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:50:22 x4 mountd[1164]: can't delete exports for /mnt15: Device busy Dec 22 21:50:28 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:50:31 x4 mountd[1164]: can't delete exports for /mnt18: Device busy Dec 22 21:50:38 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:50:44 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:50:45 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:50:45 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:50:49 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:50:56 x4 mountd[1164]: can't delete exports for /mnt11: Device busy Dec 22 21:50:59 x4 mountd[1164]: can't delete exports for /mnt12: Device busy Dec 22 21:50:59 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:51:03 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:51:10 x4 mountd[1164]: can't delete exports for /mnt5: Device busy Dec 22 21:51:14 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:51:18 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 21:51:20 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 21:51:22 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:51:24 x4 mountd[1164]: can't delete exports for /mnt12: Device busy Dec 22 21:51:28 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 21:51:30 x4 mountd[1164]: can't delete exports for /mnt15: Device busy Dec 22 21:51:31 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:51:39 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:51:39 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:51:41 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:51:48 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:52:00 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:52:04 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:52:06 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:52:10 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 21:52:10 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:52:12 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 21:52:12 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:52:12 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:52:12 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:52:12 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 21:52:12 x4 mountd[1164]: can't delete exports for /mnt7: Device busy Dec 22 21:52:24 x4 mountd[1164]: can't delete exports for /mnt10: Device busy Dec 22 21:52:28 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:52:34 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:52:36 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:52:36 x4 mountd[1164]: can't delete exports for /mnt10: Device busy Dec 22 21:52:38 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 21:52:40 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:52:45 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 21:52:46 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:53:00 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:53:09 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:53:09 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 21:53:11 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:53:14 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:53:14 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:53:15 x4 mountd[1164]: can't delete exports for /mnt14: Device busy Dec 22 21:53:15 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 21:53:17 x4 mountd[1164]: can't delete exports for /mnt9: Device busy Dec 22 21:53:20 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:53:20 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 21:53:24 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:53:27 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 21:53:27 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:53:27 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:53:32 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:53:37 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:53:38 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:53:38 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 21:53:41 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:53:42 x4 mountd[1164]: can't delete exports for /mnt19: Device busy Dec 22 21:53:46 x4 mountd[1164]: can't delete exports for /mnt14: Device busy Dec 22 21:53:46 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:53:48 x4 mountd[1164]: can't delete exports for /mnt15: Device busy Dec 22 21:53:50 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:53:52 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:53:57 x4 mountd[1164]: can't delete exports for /mnt8: Device busy Dec 22 21:53:57 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 21:53:57 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 21:53:57 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 21:53:58 x4 mountd[1164]: can't delete exports for /mnt18: Device busy Dec 22 21:54:00 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 21:54:03 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 21:54:04 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:54:07 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:54:14 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:54:18 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:54:19 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:54:22 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:54:31 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:54:32 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:54:37 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 21:54:37 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:54:44 x4 mountd[1164]: can't delete exports for /mnt5: Device busy Dec 22 21:54:55 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:54:57 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:54:57 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:55:00 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:55:05 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 21:55:05 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:55:05 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 21:55:14 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 21:55:14 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:55:14 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 21:55:14 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:55:18 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:55:21 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:55:22 x4 mountd[1164]: can't delete exports for /mnt16: Device busy Dec 22 21:55:22 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:55:23 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:55:24 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:55:26 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:55:31 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 21:55:48 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:55:49 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 21:55:53 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:55:55 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:56:02 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:56:02 x4 mountd[1164]: can't delete exports for /mnt9: Device busy Dec 22 21:56:02 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 21:56:02 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 21:56:07 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:56:09 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:56:17 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 21:56:19 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 21:56:19 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:56:22 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:56:23 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:56:24 x4 mountd[1164]: can't delete exports for /mnt11: Device busy Dec 22 21:56:24 x4 mountd[1164]: can't delete exports for /mnt12: Device busy Dec 22 21:56:29 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:56:33 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 21:56:34 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:56:36 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:56:43 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:56:46 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:56:52 x4 mountd[1164]: can't delete exports for /mnt15: Device busy Dec 22 21:56:52 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:56:52 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:56:56 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:56:59 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:57:04 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:57:06 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:57:19 x4 mountd[1164]: can't delete exports for /mnt18: Device busy Dec 22 21:57:19 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 21:57:19 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:57:21 x4 mountd[1164]: can't delete exports for /mnt14: Device busy Dec 22 21:57:30 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:57:32 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 21:57:35 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 21:57:35 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 21:57:41 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:57:41 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:57:41 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 21:57:45 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:57:47 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:57:47 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:57:47 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 21:57:57 x4 mountd[1164]: can't delete exports for /mnt10: Device busy Dec 22 21:57:57 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:58:03 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:58:04 x4 mountd[1164]: can't delete exports for /mnt14: Device busy Dec 22 21:58:06 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:58:09 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:58:11 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:58:12 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:58:15 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:58:24 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:58:25 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:58:26 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:58:26 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:58:27 x4 mountd[1164]: can't delete exports for /mnt14: Device busy Dec 22 21:58:27 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:58:33 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:58:33 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 21:58:40 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:58:40 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:58:40 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 21:58:41 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:58:51 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:58:51 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:58:52 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:58:54 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 21:58:56 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 21:59:02 x4 mountd[1164]: can't delete exports for /mnt6: Device busy Dec 22 21:59:07 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 21:59:08 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 21:59:08 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 21:59:11 x4 mountd[1164]: can't delete exports for /mnt9: Device busy Dec 22 21:59:18 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 21:59:26 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 21:59:32 x4 mountd[1164]: can't delete exports for /mnt12: Device busy Dec 22 21:59:36 x4 mountd[1164]: can't delete exports for /mnt12: Device busy Dec 22 21:59:44 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:59:45 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 21:59:45 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 21:59:48 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 21:59:49 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:59:51 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 21:59:55 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 21:59:56 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 22:00:00 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 22:00:02 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 22:00:11 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 22:00:16 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 22:00:18 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 22:00:22 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 22:00:24 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 22:00:39 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 22:00:41 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 22:00:41 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 22:00:43 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 22:00:44 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:00:45 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 22:00:47 x4 mountd[1164]: can't delete exports for /mnt10: Device busy Dec 22 22:00:48 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 22:00:49 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:00:51 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:00:53 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 22:00:53 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 22:00:56 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 22:00:56 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 22:00:57 x4 mountd[1164]: can't delete exports for /mnt7: Device busy Dec 22 22:00:57 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 22:00:57 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 22:01:02 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:01:04 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 22:01:05 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 22:01:05 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:01:06 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:01:08 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:01:09 x4 mountd[1164]: can't delete exports for /mnt11: Device busy Dec 22 22:01:13 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 22:01:14 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:01:18 x4 mountd[1164]: can't delete exports for /mnt14: Device busy Dec 22 22:01:21 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 22:01:21 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 22:01:21 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:01:23 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 22:01:25 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 22:01:29 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 22:01:29 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 22:01:29 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 22:01:33 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 22:01:37 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 22:01:38 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:01:42 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 22:01:43 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 22:01:46 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 22:01:50 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 22:02:03 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:02:03 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 22:02:07 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 22:02:17 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 22:02:25 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 22:02:25 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 22:02:26 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 22:02:26 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:02:28 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 22:02:28 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:02:28 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 22:02:29 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 22:02:30 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 22:02:30 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 22:02:31 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 22:02:33 x4 mountd[1164]: can't delete exports for /mnt12: Device busy Dec 22 22:02:44 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 22:02:44 x4 mountd[1164]: can't delete exports for /mnt10: Device busy Dec 22 22:02:51 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 22:02:56 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 22:02:56 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:02:56 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:03:03 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:03:11 x4 mountd[1164]: can't delete exports for /mnt19: Device busy Dec 22 22:03:11 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 22:03:13 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 22:03:14 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:03:15 x4 mountd[1164]: can't delete exports for /mnt10: Device busy Dec 22 22:03:23 x4 mountd[1164]: can't delete exports for /mnt7: Device busy Dec 22 22:03:25 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 22:03:28 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:03:32 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 22:03:34 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 22:03:46 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 22:03:46 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 22:03:50 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 22:03:51 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 22:04:05 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 22:04:05 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 22:04:12 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 22:04:22 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 22:04:26 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:04:29 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 22:04:34 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 22:04:35 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 22:04:36 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 22:04:38 x4 mountd[1164]: can't delete exports for /mnt5: Device busy Dec 22 22:04:46 x4 mountd[1164]: can't delete exports for /mnt17: Device busy Dec 22 22:04:47 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 22:04:48 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 22:04:48 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 22:04:52 x4 mountd[1164]: can't delete exports for /mnt18: Device busy Dec 22 22:04:55 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 22:04:59 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 22:04:59 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:05:07 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:05:08 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 22:05:11 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 22:05:11 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 22:05:11 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 22:05:16 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 22:05:17 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 22:05:18 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 22:05:18 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 22:05:21 x4 mountd[1164]: can't delete exports for /mnt10: Device busy Dec 22 22:05:28 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 22:05:28 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 22:05:29 x4 mountd[1164]: can't delete exports for /mnt8: Device busy Dec 22 22:05:29 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 22:05:29 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:05:31 x4 mountd[1164]: can't delete exports for /mnt14: Device busy Dec 22 22:05:32 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 22:05:34 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 22:05:37 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 22:05:43 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 22:05:45 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 22:05:45 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:05:51 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 22:05:53 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 22:05:53 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:05:54 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 22:05:54 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 22:05:57 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 22:06:03 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 22:06:09 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 22:06:10 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 22:06:21 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 22:06:21 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 22:06:21 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 22:06:22 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 22:06:23 x4 mountd[1164]: can't delete exports for /mnt10: Device busy Dec 22 22:06:23 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 22:06:28 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 22:06:28 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:06:28 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 22:06:30 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 22:06:31 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 22:06:32 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 22:06:37 x4 mountd[1164]: can't delete exports for /mnt10: Device busy Dec 22 22:06:43 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:06:43 x4 mountd[1164]: can't delete exports for /mnt10: Device busy Dec 22 22:06:44 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:06:46 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 22:06:46 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 22:06:47 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 22:06:48 x4 mountd[1164]: can't delete exports for /mnt19: Device busy Dec 22 22:06:52 x4 mountd[1164]: can't delete exports for /mnt14: Device busy Dec 22 22:06:53 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 22:06:54 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 22:06:54 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 22:06:54 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 22:07:02 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:07:09 x4 mountd[1164]: can't delete exports for /mnt16: Device busy Dec 22 22:07:13 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 22:07:16 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 22:07:17 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 22:07:17 x4 mountd[1164]: can't delete exports for /mnt5: Device busy Dec 22 22:07:17 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:07:17 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 22:07:17 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 22:07:18 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 22:07:23 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 22:07:23 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 22:07:24 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 22:07:32 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 22:07:37 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:07:42 x4 mountd[1164]: can't delete exports for /mnt15: Device busy Dec 22 22:07:42 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 22:07:42 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 22:07:44 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 22:07:49 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 22:07:51 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:07:54 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 22:07:54 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 22:07:58 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 22:08:01 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 22:08:04 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 22:08:09 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:08:10 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 22:08:14 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 22:08:18 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 22:08:18 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:08:20 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 22:08:28 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:08:28 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 22:08:28 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 22:08:29 x4 mountd[1164]: can't delete exports for /mnt17: Device busy Dec 22 22:08:33 x4 mountd[1164]: can't delete exports for /mnt12: Device busy Dec 22 22:08:40 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:08:41 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 22:08:44 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:08:55 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:08:57 x4 mountd[1164]: can't delete exports for /mnt7: Device busy Dec 22 22:09:06 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 22:09:12 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 22:09:13 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:09:13 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:09:13 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 22:09:14 x4 mountd[1164]: can't delete exports for /mnt5: Device busy Dec 22 22:09:14 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 22:09:15 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 22:09:15 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 22:09:24 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 22:09:26 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 22:09:27 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 22:09:31 x4 mountd[1164]: can't delete exports for /mnt8: Device busy Dec 22 22:09:31 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 22:09:34 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 22:09:34 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:09:40 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 22:09:43 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 22:09:45 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:09:47 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 22:09:53 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 22:09:54 x4 mountd[1164]: can't delete exports for /mnt18: Device busy Dec 22 22:09:54 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 22:09:54 x4 mountd[1164]: can't delete exports for /mnt16: Device busy Dec 22 22:09:56 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 22:09:57 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 22:09:57 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 22:09:58 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:09:59 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 22:10:02 x4 mountd[1164]: can't delete exports for /mnt12: Device busy Dec 22 22:10:03 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:10:05 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 22:10:05 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 22:10:14 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 22:10:18 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 22:10:19 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 22:10:22 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 22:10:24 x4 mountd[1164]: can't delete exports for /mnt5: Device busy Dec 22 22:10:26 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 22:10:26 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 22:10:29 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 22:10:33 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 22:10:34 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 22:10:37 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 22:10:37 x4 mountd[1164]: can't delete exports for /mnt7: Device busy Dec 22 22:10:37 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 22:10:37 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 22:10:40 x4 mountd[1164]: can't delete exports for /mnt15: Device busy Dec 22 22:10:42 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:10:44 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 22:10:44 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 22:10:44 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 22:10:44 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 22:10:49 x4 mountd[1164]: can't delete exports for /mnt10: Device busy Dec 22 22:10:49 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 22:10:49 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 22:10:49 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 22:10:54 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:10:55 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 22:10:55 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:10:59 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 22:11:05 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 22:11:06 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:11:09 x4 mountd[1164]: can't delete exports for /mnt12: Device busy Dec 22 22:11:18 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 22:11:19 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 22:11:19 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 22:11:19 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:11:21 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 22:11:28 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 22:11:30 x4 mountd[1164]: can't delete exports for /mnt10: Device busy Dec 22 22:11:32 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 22:11:37 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 22:11:43 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 22:11:46 x4 mountd[1164]: can't delete exports for /mnt19: Device busy Dec 22 22:11:48 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:11:56 x4 mountd[1164]: can't delete exports for /mnt6: Device busy Dec 22 22:11:58 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 22:12:00 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 22:12:00 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 22:12:02 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 22:12:03 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:12:05 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 22:12:08 x4 mountd[1164]: can't delete exports for /mnt12: Device busy Dec 22 22:12:10 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 22:12:10 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 22:12:11 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:12:14 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 22:12:17 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 22:12:19 x4 mountd[1164]: can't delete exports for /mnt12: Device busy Dec 22 22:12:28 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 22:12:30 x4 mountd[1164]: can't delete exports for /mnt16: Device busy Dec 22 22:12:38 x4 mountd[1164]: can't delete exports for /mnt15: Device busy Dec 22 22:12:46 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 22:12:51 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 22:12:57 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 22:13:04 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 22:13:04 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 22:13:09 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 22:13:10 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 22:13:12 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 22:13:12 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 22:13:16 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 22:13:20 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:13:20 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 22:13:24 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 22:13:25 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 22:13:28 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:13:28 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 22:13:28 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 22:13:29 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 22:13:30 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 22:13:32 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:13:40 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 22:13:40 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 22:13:41 x4 mountd[1164]: can't delete exports for /mnt18: Device busy Dec 22 22:13:43 x4 mountd[1164]: can't delete exports for /mnt16: Device busy Dec 22 22:13:46 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 22:13:52 x4 mountd[1164]: can't delete exports for /mnt10: Device busy Dec 22 22:13:55 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 22:13:56 x4 mountd[1164]: can't delete exports for /mnt14: Device busy Dec 22 22:14:03 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:14:04 x4 mountd[1164]: can't delete exports for /mnt11: Device busy Dec 22 22:14:04 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 22:14:07 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:14:09 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 22:14:10 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 22:14:12 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:14:13 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 22:14:14 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 22:14:15 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 22:14:20 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 22:14:37 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 22:14:38 x4 mountd[1164]: can't delete exports for /mnt19: Device busy Dec 22 22:14:42 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 22:14:46 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 22:14:51 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 22:14:52 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 22:14:52 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 22:14:53 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 22:14:53 x4 mountd[1164]: can't delete exports for /mnt12: Device busy Dec 22 22:14:57 x4 mountd[1164]: can't delete exports for /mnt13: Device busy Dec 22 22:14:57 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 22:14:57 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 22:14:57 x4 mountd[1164]: can't delete exports for /mnt9: Device busy Dec 22 22:14:58 x4 mountd[1164]: can't delete exports for /mnt12: Device busy Dec 22 22:14:58 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 22:14:58 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 22:15:05 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 22:15:05 x4 mountd[1164]: can't delete exports for /mnt15: Device busy Dec 22 22:15:07 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 22:15:10 x4 mountd[1164]: can't delete exports for /mnt16: Device busy Dec 22 22:15:15 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 22:15:15 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 22:15:25 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 22:15:25 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 22:15:26 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:15:27 x4 mountd[1164]: can't delete exports for /mnt6: Device busy Dec 22 22:15:28 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:15:30 x4 mountd[1164]: can't delete exports for /mnt12: Device busy Dec 22 22:15:36 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 22:15:38 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 22:15:43 x4 mountd[1164]: can't delete exports for /mnt11: Device busy Dec 22 22:15:46 x4 mountd[1164]: can't delete exports for /mnt11: Device busy Dec 22 22:15:48 x4 mountd[1164]: can't delete exports for /mnt15: Device busy Dec 22 22:15:48 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:15:48 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 22:15:50 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 22:15:53 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 22:15:55 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 22:15:56 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 22:16:04 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 22:16:05 x4 mountd[1164]: can't delete exports for /mnt9: Device busy Dec 22 22:16:12 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 22:16:16 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 22:16:16 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:16:19 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:16:24 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 22:16:24 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 22:16:27 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 22:16:30 x4 mountd[1164]: can't delete exports for /mnt9: Device busy Dec 22 22:16:33 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 22:16:42 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 22:16:43 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:16:44 x4 mountd[1164]: can't delete exports for /mnt14: Device busy Dec 22 22:16:44 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 22:16:44 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 22:16:44 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 22:16:44 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 22:16:45 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:16:49 x4 mountd[1164]: can't delete exports for /mnt12: Device busy Dec 22 22:16:52 x4 mountd[1164]: can't delete exports for /mnt7: Device busy Dec 22 22:16:54 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 22:16:54 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 22:16:59 x4 mountd[1164]: can't delete exports for /mnt12: Invalid argument Dec 22 22:17:03 x4 mountd[1164]: can't delete exports for /mnt15: Device busy Dec 22 22:17:08 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 22:17:12 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 22:17:15 x4 mountd[1164]: can't delete exports for /mnt8: Device busy Dec 22 22:17:17 x4 mountd[1164]: can't delete exports for /mnt6: Device busy Dec 22 22:17:17 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 22:17:17 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 22:17:19 x4 mountd[1164]: can't delete exports for /mnt12: Device busy Dec 22 22:17:22 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 22:17:23 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 22:17:27 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 22:17:32 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 22:17:36 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 22:17:36 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 22:17:45 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 22:17:47 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 22:17:50 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 22:17:57 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 22:17:57 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 22:18:06 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 22:18:10 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 22:18:12 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 22:18:12 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 22:18:16 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 22:18:19 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 22:18:27 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 22:18:29 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 22:18:42 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 22:18:43 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 22:18:50 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 22:18:51 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:18:53 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 22:18:55 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 22:18:55 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 22:18:55 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 22:19:02 x4 mountd[1164]: can't delete exports for /mnt17: Invalid argument Dec 22 22:19:34 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 22:19:36 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 22:19:37 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 22:20:03 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 22:20:19 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 22:20:29 x4 last message repeated 4 times Dec 22 22:20:32 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument 20121222 22:20:41 all: nullfs5.sh Dec 22 22:20:34 x4 last message repeated 9 times 20121222 22:32:31 all: suj6.sh Dec 22 22:32:34 x4 su: _secure_path: cannot stat /home/stress/.login_conf: Permission denied 20121222 22:33:49 all: sndstat.sh 20121222 22:33:51 all: crossmp.sh Dec 22 22:34:01 x4 mountd[1164]: can't delete exports for /mnt10: Invalid argument Dec 22 22:38:29 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 22:39:04 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 22:39:56 x4 mountd[1164]: can't delete exports for /mnt16: Invalid argument Dec 22 22:44:01 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 22:46:08 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 22:47:33 x4 mountd[1164]: can't delete exports for /mnt19: Invalid argument Dec 22 22:47:33 x4 mountd[1164]: can't delete exports for /mnt6: Invalid argument Dec 22 22:48:13 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 22:48:19 x4 mountd[1164]: can't delete exports for /mnt8: Invalid argument Dec 22 22:48:21 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 22:51:33 x4 mountd[1164]: can't delete exports for /mnt9: Invalid argument Dec 22 22:52:13 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 22:56:12 x4 mountd[1164]: can't delete exports for /mnt13: Invalid argument Dec 22 22:57:33 x4 mountd[1164]: can't delete exports for /mnt5: Invalid argument Dec 22 23:00:15 x4 mountd[1164]: can't delete exports for /mnt11: Invalid argument Dec 22 23:00:27 x4 mountd[1164]: can't delete exports for /mnt7: Invalid argument Dec 22 23:01:04 x4 mountd[1164]: can't delete exports for /mnt18: Invalid argument Dec 22 23:01:40 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 23:01:44 x4 mountd[1164]: can't delete exports for /mnt15: Invalid argument Dec 22 23:02:28 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument Dec 22 23:03:41 x4 mountd[1164]: can't delete exports for /mnt14: Invalid argument 20121222 23:04:49 all: snap7.sh 20121222 23:37:34 all: fuse.sh fuse-freebsd: version 0.4.4, FUSE ABI 7.8 Dec 23 00:03:47 x4 kernel: pid 71511 (lockf), uid 0, was killed: exceeded maximum CPU limit Dec 23 00:03:48 x4 kernel: pid 71515 (lockf), uid 0, was killed: exceeded maximum CPU limit Dec 23 00:03:50 x4 kernel: pid 71608 (lockf), uid 0, was killed: exceeded maximum CPU limit Dec 23 00:03:52 x4 kernel: pid 71606 (lockf), uid 0, was killed: exceeded maximum CPU limit Dec 23 00:03:53 x4 kernel: pid 71518 (lockf), uid 0, was killed: exceeded maximum CPU limit Dec 23 00:03:53 x4 kernel: pid 71609 (lockf), uid 0, was killed: exceeded maximum CPU limit Dec 23 00:03:54 x4 kernel: pid 71612 (lockf), uid 0, was killed: exceeded maximum CPU limit 20121223 00:04:10 all: suj12.sh GEOM_NOP: Device md5.nop created. Dec 23 00:04:11 x4 su: _secure_path: cannot stat /home/stress/.login_conf: Permission denied GEOM_NOP: Device md5.nop removed. 20121223 00:24:53 all: zfs4.sh 20121223 00:36:50 all: umountf5.sh 20121223 00:38:31 all: umountf.sh 20121223 00:40:12 all: tmpfs7.sh 20121223 00:40:17 all: msdos3.sh 20121223 00:40:19 all: md.sh lock order reversal: 1st 0xfffffe006772c5a8 ufs (ufs) @ kern/vfs_subr.c:2162 2nd 0xffffffff81367720 proctree (proctree) @ kern/subr_prf.c:149 KDB: stack backtrace: Dec 23 00:40:21 x4 kernel: pid 79876 (rw), uid 0 inumber 141 on /mnt: filesystem full db_trace_self_wrapper() at db_trace_self_wrapper+0x2a/frame 0xffffff81259c7170 kdb_backtrace() at kdb_backtrace+0x37/frame 0xffffff81259c7230 _witness_debugger() at _witness_debugger+0x2c/frame 0xffffff81259c7250 witness_checkorder() at witness_checkorder+0x82d/frame 0xffffff81259c7300 _sx_slock() at _sx_slock+0x71/frame 0xffffff81259c7330 uprintf() at uprintf+0x7d/frame 0xffffff81259c7460 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x183e/frame 0xffffff81259c7630 ffs_write() at ffs_write+0x224/frame 0xffffff81259c76d0 VOP_WRITE_APV() at VOP_WRITE_APV+0x114/frame 0xffffff81259c77d0 vn_write() at vn_write+0x271/frame 0xffffff81259c7860 vn_io_fault() at vn_io_fault+0x18e/frame 0xffffff81259c79f0 dofilewrite() at dofilewrite+0x85/frame 0xffffff81259c7a40 kern_writev() at kern_writev+0x6c/frame 0xffffff81259c7a80 sys_write() at sys_write+0x64/frame 0xffffff81259c7ad0 ia32_syscall() at ia32_syscall+0x35f/frame 0xffffff81259c7bf0 Xint0x80_syscall() at Xint0x80_syscall+0x91/frame 0xffffff81259c7bf0 --- syscall (4, FreeBSD ELF32, sys_write), rip = 0x281915bf, rsp = 0xffffb688, rbp = 0xffffc730 --- Dec 23 00:40:22 x4 kernel: pid 79877 (rw), uid 0 inumber 132 on /mnt: filesystem full Dec 23 00:40:23 x4 kernel: pid 79874 (rw), uid 0 inumber 132 on /mnt: filesystem full Dec 23 00:40:24 x4 kernel: pid 79887 (rw), uid 0 inumber 4 on /mnt: filesystem full Dec 23 00:40:24 x4 kernel: pid 79890 (rw), uid 0 inumber 132 on /mnt: filesystem full Dec 23 00:40:26 x4 kernel: pid 79880 (rw), uid 0 inumber 130 on /mnt: filesystem full Dec 23 00:40:26 x4 kernel: pid 79875 (rw), uid 0 inumber 133 on /mnt: filesystem full Dec 23 00:40:27 x4 kernel: pid 79882 (rw), uid 0 inumber 129 on /mnt: filesystem full Dec 23 00:40:29 x4 kernel: pid 79886 (rw), uid 0 inumber 130 on /mnt: filesystem full Dec 23 00:40:29 x4 kernel: pid 79889 (rw), uid 0 inumber 4 on /mnt: filesystem full Dec 23 00:42:26 x4 kernel: pid 80080 (rw), uid 0 inumber 133 on /mnt: filesystem full Dec 23 00:42:27 x4 kernel: pid 80078 (rw), uid 0 inumber 5 on /mnt: filesystem full Dec 23 00:44:21 x4 kernel: pid 80282 (rw), uid 0 inumber 134 on /mnt: filesystem full Dec 23 00:44:26 x4 kernel: pid 80278 (rw), uid 0 inumber 132 on /mnt: filesystem full Dec 23 00:44:28 x4 kernel: pid 80281 (rw), uid 0 inumber 129 on /mnt: filesystem full Dec 23 00:46:23 x4 kernel: pid 80474 (rw), uid 0 inumber 130 on /mnt: filesystem full Dec 23 00:50:24 x4 kernel: pid 80860 (rw), uid 0 inumber 12 on /mnt: filesystem full Dec 23 00:50:26 x4 kernel: pid 80869 (rw), uid 0 inumber 140 on /mnt: filesystem full Dec 23 00:50:28 x4 kernel: pid 80855 (rw), uid 0 inumber 142 on /mnt: filesystem full Dec 23 00:52:24 x4 kernel: pid 81077 (rw), uid 0 inumber 138 on /mnt: filesystem full Dec 23 00:52:24 x4 kernel: pid 81078 (rw), uid 0 inumber 140 on /mnt: filesystem full Dec 23 00:52:26 x4 kernel: pid 81075 (rw), uid 0 inumber 129 on /mnt: filesystem full Dec 23 00:52:26 x4 kernel: pid 81082 (rw), uid 0 inumber 9 on /mnt: filesystem full Dec 23 00:52:28 x4 kernel: pid 81081 (rw), uid 0 inumber 129 on /mnt: filesystem full Dec 23 00:52:28 x4 kernel: pid 81084 (rw), uid 0 inumber 6 on /mnt: filesystem full Dec 23 00:52:30 x4 kernel: pid 81074 (rw), uid 0 inumber 6 on /mnt: filesystem full Dec 23 00:52:30 x4 kernel: pid 81080 (rw), uid 0 inumber 7 on /mnt: filesystem full Dec 23 00:54:21 x4 kernel: pid 81267 (rw), uid 0 inumber 131 on /mnt: filesystem full Dec 23 00:54:22 x4 kernel: pid 81269 (rw), uid 0 inumber 129 on /mnt: filesystem full Dec 23 00:56:26 x4 kernel: pid 81472 (rw), uid 0 inumber 131 on /mnt: filesystem full Dec 23 00:58:25 x4 kernel: pid 81658 (rw), uid 0 inumber 134 on /mnt: filesystem full Dec 23 00:58:26 x4 kernel: pid 81659 (rw), uid 0 inumber 5 on /mnt: filesystem full Dec 23 00:58:28 x4 kernel: pid 81660 (rw), uid 0 inumber 133 on /mnt: filesystem full Dec 23 00:58:31 x4 kernel: pid 81662 (rw), uid 0 inumber 130 on /mnt: filesystem full Dec 23 01:00:22 x4 kernel: pid 81857 (rw), uid 0 inumber 137 on /mnt: filesystem full Dec 23 01:00:23 x4 kernel: pid 81861 (rw), uid 0 inumber 9 on /mnt: filesystem full Dec 23 01:00:23 x4 kernel: pid 81859 (rw), uid 0 inumber 8 on /mnt: filesystem full Dec 23 01:00:24 x4 kernel: pid 81856 (rw), uid 0 inumber 137 on /mnt: filesystem full Dec 23 01:00:27 x4 kernel: pid 81860 (rw), uid 0 inumber 129 on /mnt: filesystem full Dec 23 01:00:29 x4 kernel: pid 81854 (rw), uid 0 inumber 129 on /mnt: filesystem full Dec 23 01:00:31 x4 kernel: pid 81858 (rw), uid 0 inumber 129 on /mnt: filesystem full Dec 23 01:02:27 x4 kernel: pid 82066 (rw), uid 0 inumber 140 on /mnt: filesystem full Dec 23 01:02:29 x4 kernel: pid 82068 (rw), uid 0 inumber 134 on /mnt: filesystem full Dec 23 01:04:24 x4 kernel: pid 82267 (rw), uid 0 inumber 138 on /mnt: filesystem full Dec 23 01:04:24 x4 kernel: pid 82270 (rw), uid 0 inumber 140 on /mnt: filesystem full Dec 23 01:04:28 x4 kernel: pid 82274 (rw), uid 0 inumber 5 on /mnt: filesystem full Dec 23 01:04:28 x4 kernel: pid 82266 (rw), uid 0 inumber 9 on /mnt: filesystem full Dec 23 01:04:30 x4 kernel: pid 82265 (rw), uid 0 inumber 132 on /mnt: filesystem full Dec 23 01:04:30 x4 kernel: pid 82271 (rw), uid 0 inumber 133 on /mnt: filesystem full Dec 23 01:06:22 x4 kernel: pid 82463 (rw), uid 0 inumber 139 on /mnt: filesystem full Dec 23 01:06:23 x4 kernel: pid 82468 (rw), uid 0 inumber 135 on /mnt: filesystem full Dec 23 01:06:24 x4 kernel: pid 82465 (rw), uid 0 inumber 133 on /mnt: filesystem full Dec 23 01:06:24 x4 kernel: pid 82473 (rw), uid 0 inumber 135 on /mnt: filesystem full Dec 23 01:06:27 x4 kernel: pid 82477 (rw), uid 0 inumber 130 on /mnt: filesystem full Dec 23 01:06:29 x4 kernel: pid 82475 (rw), uid 0 inumber 129 on /mnt: filesystem full Dec 23 01:06:29 x4 kernel: pid 82469 (rw), uid 0 inumber 130 on /mnt: filesystem full Dec 23 01:06:31 x4 kernel: pid 82478 (rw), uid 0 inumber 4 on /mnt: filesystem full Dec 23 01:06:31 x4 kernel: pid 82466 (rw), uid 0 inumber 129 on /mnt: filesystem full Dec 23 01:08:24 x4 kernel: pid 82677 (rw), uid 0 inumber 140 on /mnt: filesystem full Dec 23 01:08:25 x4 kernel: pid 82683 (rw), uid 0 inumber 140 on /mnt: filesystem full Dec 23 01:08:25 x4 kernel: pid 82682 (rw), uid 0 inumber 129 on /mnt: filesystem full Dec 23 01:08:26 x4 kernel: pid 82684 (rw), uid 0 inumber 9 on /mnt: filesystem full Dec 23 01:08:27 x4 kernel: pid 82691 (rw), uid 0 inumber 133 on /mnt: filesystem full Dec 23 01:08:30 x4 kernel: pid 82680 (rw), uid 0 inumber 129 on /mnt: filesystem full Dec 23 01:08:31 x4 kernel: pid 82686 (rw), uid 0 inumber 10 on /mnt: filesystem full Dec 23 01:08:31 x4 kernel: pid 82688 (rw), uid 0 inumber 5 on /mnt: filesystem full Dec 23 01:08:32 x4 kernel: pid 82681 (rw), uid 0 inumber 129 on /mnt: filesystem full Dec 23 01:08:32 x4 kernel: pid 82690 (rw), uid 0 inumber 4 on /mnt: filesystem full 20121223 01:10:23 all: mountu.sh lock order reversal: 1st 0xfffffe00938a9830 ufs (ufs) @ kern/vfs_mount.c:851 2nd 0xfffffe004c402d40 newnfs (newnfs) @ kern/vfs_subr.c:2162 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a/frame 0xffffff8125a2b2b0 kdb_backtrace() at kdb_backtrace+0x37/frame 0xffffff8125a2b370 _witness_debugger() at _witness_debugger+0x2c/frame 0xffffff8125a2b390 witness_checkorder() at witness_checkorder+0x82d/frame 0xffffff8125a2b440 __lockmgr_args() at __lockmgr_args+0x10ef/frame 0xffffff8125a2b520 nfs_lock1() at nfs_lock1+0x4a/frame 0xffffff8125a2b550 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x88/frame 0xffffff8125a2b570 _vn_lock() at _vn_lock+0x8d/frame 0xffffff8125a2b5f0 vget() at vget+0x63/frame 0xffffff8125a2b640 vfs_hash_get() at vfs_hash_get+0xd5/frame 0xffffff8125a2b690 ncl_nget() at ncl_nget+0xd5/frame 0xffffff8125a2b740 nfs_root() at nfs_root+0x41/frame 0xffffff8125a2b790 vfs_donmount() at vfs_donmount+0xb65/frame 0xffffff8125a2ba90 sys_nmount() at sys_nmount+0x66/frame 0xffffff8125a2bad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8125a2bbf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8125a2bbf0 --- syscall (378, FreeBSD ELF64, sys_nmount), rip = 0x800885eca, rsp = 0x7fffffffcde8, rbp = 0x7fffffffce9c --- lock order reversal: 1st 0xffffff80eeffa800 bufwait (bufwait) @ vm/vm_pager.c:311 2nd 0xfffffe00a1b4e1e8 so_snd_sx (so_snd_sx) @ kern/uipc_sockbuf.c:148 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a/frame 0xffffff8125cc8bd0 kdb_backtrace() at kdb_backtrace+0x37/frame 0xffffff8125cc8c90 _witness_debugger() at _witness_debugger+0x2c/frame 0xffffff8125cc8cb0 witness_checkorder() at witness_checkorder+0x82d/frame 0xffffff8125cc8d60 _sx_xlock() at _sx_xlock+0x6d/frame 0xffffff8125cc8d90 sosend_generic() at sosend_generic+0x108/frame 0xffffff8125cc8e40 clnt_vc_call() at clnt_vc_call+0x3d5/frame 0xffffff8125cc8f90 clnt_reconnect_call() at clnt_reconnect_call+0xf5/frame 0xffffff8125cc9050 newnfs_request() at newnfs_request+0xca7/frame 0xffffff8125cc9180 nfscl_request() at nfscl_request+0x7b/frame 0xffffff8125cc91d0 nfsrpc_read() at nfsrpc_read+0x4f1/frame 0xffffff8125cc93a0 ncl_readrpc() at ncl_readrpc+0xfc/frame 0xffffff8125cc94c0 ncl_getpages() at ncl_getpages+0x3a3/frame 0xffffff8125cc95b0 VOP_GETPAGES_APV() at VOP_GETPAGES_APV+0xa6/frame 0xffffff8125cc95d0 vnode_pager_getpages() at vnode_pager_getpages+0x75/frame 0xffffff8125cc9640 vm_fault_hold() at vm_fault_hold+0x594/frame 0xffffff8125cc9920 vm_fault() at vm_fault+0x73/frame 0xffffff8125cc9960 trap_pfault() at trap_pfault+0x1b4/frame 0xffffff8125cc99f0 trap() at trap+0x5f4/frame 0xffffff8125cc9bf0 calltrap() at calltrap+0x8/frame 0xffffff8125cc9bf0 --- trap 0xc, rip = 0x400ca2, rsp = 0x7fffffffd6b0, rbp = 0x801a40000 --- 20121223 01:10:43 all: linger3.sh Dec 23 01:10:44 x4 su: _secure_path: cannot stat /home/stress/.login_conf: Permission denied Fatal trap 12: page fault while in kernel mode cpuid = 3; apic id = 03 fault virtual address = 0xffff800000000000 fault code = supervisor read data, page not present instruction pointer = 0x20:0xffffffff80c85ca9 stack pointer = 0x28:0xffffff81259d12d0 frame pointer = 0x28:0xffffff81259d1320 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 83185 (linger3) [ thread pid 83185 tid 100300 ] Stopped at pmap_qenter+0x49: movq (%r12),%rcx db> run pho db:0:pho> bt Tracing pid 83185 tid 100300 td 0xfffffe002259e000 pmap_qenter() at pmap_qenter+0x49/frame 0xffffff81259d1320 bpmap_qenter() at bpmap_qenter+0x55/frame 0xffffff81259d1340 getblk() at getblk+0x3fd/frame 0xffffff81259d13f0 breadn_flags() at breadn_flags+0x40/frame 0xffffff81259d1440 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xc76/frame 0xffffff81259d1610 ufs_direnter() at ufs_direnter+0x318/frame 0xffffff81259d16e0 ufs_mkdir() at ufs_mkdir+0x50a/frame 0xffffff81259d18d0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0xaa/frame 0xffffff81259d18f0 kern_mkdirat() at kern_mkdirat+0x212/frame 0xffffff81259d1ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff81259d1bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff81259d1bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x800923bfa, rsp = 0x7fffffffd618, rbp = 0 --- db:0:bt> show allpcpu Current CPU: 3 cpuid = 0 dynamic pcpu = 0x5db100 curthread = 0xfffffe0002955480: pid 11 "idle: cpu0" curpcb = 0xffffff8000252cc0 fpcurthread = none idlethread = 0xfffffe0002955480: tid 100003 "idle: cpu0" curpmap = 0xffffffff81361c70 tssp = 0xffffffff81571780 commontssp = 0xffffffff81571780 rsp0 = 0xffffff8000252cc0 gs32p = 0xffffffff8156f8b8 ldt = 0xffffffff8156f8f8 tss = 0xffffffff8156f8e8 spin locks held: cpuid = 1 dynamic pcpu = 0xffffff807ef13100 curthread = 0xfffffe0002955000: pid 11 "idle: cpu1" curpcb = 0xffffff8000257cc0 fpcurthread = none idlethread = 0xfffffe0002955000: tid 100004 "idle: cpu1" curpmap = 0xffffffff81361c70 tssp = 0xffffffff815717e8 commontssp = 0xffffffff815717e8 rsp0 = 0xffffff8000257cc0 gs32p = 0xffffffff8156f920 ldt = 0xffffffff8156f960 tss = 0xffffffff8156f950 spin locks held: cpuid = 2 dynamic pcpu = 0xffffff807ef1a100 curthread = 0xfffffe0002960900: pid 11 "idle: cpu2" curpcb = 0xffffff800025ccc0 fpcurthread = none idlethread = 0xfffffe0002960900: tid 100005 "idle: cpu2" curpmap = 0xffffffff81361c70 tssp = 0xffffffff81571850 commontssp = 0xffffffff81571850 rsp0 = 0xffffff800025ccc0 gs32p = 0xffffffff8156f988 ldt = 0xffffffff8156f9c8 tss = 0xffffffff8156f9b8 spin locks held: cpuid = 3 dynamic pcpu = 0xffffff807ef21100 curthread = 0xfffffe002259e000: pid 83185 "linger3" curpcb = 0xffffff81259d1cc0 fpcurthread = none idlethread = 0xfffffe0002960480: tid 100006 "idle: cpu3" curpmap = 0xfffffe005970cbe8 tssp = 0xffffffff815718b8 commontssp = 0xffffffff815718b8 rsp0 = 0xffffff81259d1cc0 gs32p = 0xffffffff8156f9f0 ldt = 0xffffffff8156fa30 tss = 0xffffffff8156fa20 spin locks held: db:0:allpcpu> show alllocks Process 83185 (linger3) thread 0xfffffe002259e000 (100300) exclusive lockmgr bufwait (bufwait) r = 0 (0xffffff80efc91100) locked @ kern/vfs_bio.c:2743 exclusive lockmgr bufwait (bufwait) r = 0 (0xffffff80ef35de00) locked @ kern/vfs_bio.c:1978 exclusive lockmgr ufs (ufs) r = 0 (0xfffffe010a1f3830) locked @ ufs/ffs/ffs_vfsops.c:1694 exclusive lockmgr ufs (ufs) r = 0 (0xfffffe004ddfa5a8) locked @ kern/vfs_lookup.c:516 db:0:alllocks> show lockedvnods Locked vnodes 0xfffffe004ddfa510: tag ufs, type VDIR usecount 11, writecount 0, refcount 25 mountedhere 0 flags (VV_ROOT|VI_ACTIVE) v_object 0xfffffe0088f8f3a0 ref 0 pages 104 lock type ufs: EXCL by thread 0xfffffe002259e000 (pid 83185, linger3, tid 100300) with shared waiters pending #0 0xffffffff808d2a19 at __lockmgr_args+0x909 #1 0xffffffff80b45c0b at ffs_lock+0x9b #2 0xffffffff80d229f8 at VOP_LOCK1_APV+0x88 #3 0xffffffff809a1dbd at _vn_lock+0x8d #4 0xffffffff80986ac7 at lookup+0xc7 #5 0xffffffff80987a50 at namei+0x400 #6 0xffffffff80999447 at kern_mkdirat+0xb7 #7 0xffffffff80c902c3 at amd64_syscall+0x2d3 #8 0xffffffff80c7a547 at Xfast_syscall+0xf7 ino 2, on dev md5a 0xfffffe010a1f3798: tag ufs, type VDIR usecount 1, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type ufs: EXCL by thread 0xfffffe002259e000 (pid 83185, linger3, tid 100300) #0 0xffffffff808d27b1 at __lockmgr_args+0x6a1 #1 0xffffffff80b3fcf3 at ffs_vgetf+0x163 #2 0xffffffff80b17561 at ffs_valloc+0x461 #3 0xffffffff80b57915 at ufs_mkdir+0xc5 #4 0xffffffff80d22f0a at VOP_MKDIR_APV+0xaa #5 0xffffffff809995a2 at kern_mkdirat+0x212 #6 0xffffffff80c902c3 at amd64_syscall+0x2d3 #7 0xffffffff80c7a547 at Xfast_syscall+0xf7 ino 135281, on dev md5a db:0:lockedvnods> show mount 0xfffffe0008d1ab58 /dev/ufs/root on / (ufs) 0xfffffe0008d1b000 devfs on /dev (devfs) 0xfffffe0008eb3790 /dev/ufs/home on /home (ufs) 0xfffffe0008eb33c8 /dev/label/tmp on /tmp (ufs) 0xfffffe0008eb3000 /dev/ufs/usr on /usr (ufs) 0xfffffe0008d1bb58 /dev/ufs/var on /var (ufs) 0xfffffe0008d1b3c8 /dev/md5a on /mnt (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 83187 83183 83183 1003 D+ ufs 0xfffffe004ddfa5a8 linger3 83186 83183 83183 1003 D+ ufs 0xfffffe004ddfa5a8 linger3 83185 83183 83183 1003 R+ CPU 3 linger3 83184 83183 83183 1003 D+ ufs 0xfffffe004ddfa5a8 linger3 83183 83182 83183 1003 S+ wait 0xfffffe0012e3d000 linger3 83182 83158 7635 0 S+ wait 0xfffffe0072453000 su 83177 0 0 0 DL mdwait 0xfffffe0008ed1800 [md5] 83158 7635 7635 0 S+ wait 0xfffffe0012e3f4a8 sh 83137 1504 1502 1001 S nanslp 0xffffffff813691e8 sleep 23116 0 0 0 DL (threaded) [zfskern] 100743 D l2arc_fe 0xffffffff81bcefc0 [l2arc_feed_thread] 100250 D arc_recl 0xffffffff81bbf120 [arc_reclaim_thread] 7635 7616 7635 0 S+ wait 0xfffffe011600b950 sh 7616 7613 7616 0 SW+ wait 0xfffffe0067dae4a8 bash 7613 7612 7613 0 SW+ pause 0xfffffe0067a2b548 csh 7612 1524 7612 1001 SW+ wait 0xfffffe0067e60950 su 1524 1523 1524 1001 SWs+ wait 0xfffffe006779d4a8 bash 1523 1521 1521 1001 S select 0xfffffe0008d1e640 sshd 1521 1357 1521 0 Ss select 0xfffffe0008f948c0 sshd 1505 1502 1502 1001 S piperd 0xfffffe0008fa22e8 awk 1504 1502 1502 1001 S wait 0xfffffe00676614a8 sh 1503 1500 1503 1001 Ss+ select 0xfffffe0008b8f3c0 top 1502 1499 1502 1001 SWs wait 0xfffffe0008db0000 sh 1501 1498 1501 1001 Ss kqread 0xfffffe0008cae600 tail 1500 1492 1492 1001 S select 0xfffffe0008b8f740 sshd 1499 1493 1493 1001 S select 0xfffffe0008f94040 sshd 1498 1494 1494 1001 S select 0xfffffe0008f94940 sshd 1494 1357 1494 0 Ss select 0xfffffe0008d1e740 sshd 1493 1357 1493 0 Ss select 0xfffffe0008b8f7c0 sshd 1492 1357 1492 0 Ss select 0xfffffe0008f94a40 sshd 1480 1 1480 0 Ss+ ttyin 0xfffffe0002d268a8 getty 1479 1 1479 0 Ss+ ttyin 0xfffffe0002fd40a8 getty 1478 1 1478 0 Ss+ ttyin 0xfffffe0002fd48a8 getty 1477 1 1477 0 Ss+ ttyin 0xfffffe0002d26ca8 getty 1476 1 1476 0 Ss+ ttyin 0xfffffe0002fd50a8 getty 1475 1 1475 0 Ss+ ttyin 0xfffffe0002fd54a8 getty 1474 1 1474 0 Ss+ ttyin 0xfffffe0002fd44a8 getty 1473 1 1473 0 Ss+ ttyin 0xfffffe0002d264a8 getty 1472 1 1472 0 Ss+ ttyin 0xfffffe00029d24a8 getty 1433 1 1433 0 Ss select 0xfffffe0008a269c0 inetd 1400 1 1400 0 Ss select 0xfffffe0008d1ea40 moused 1376 1 1376 0 Ss nanslp 0xffffffff813691e8 cron 1369 1 1369 25 Ss pause 0xfffffe0008b2a548 sendmail 1365 1 1365 0 Ss select 0xfffffe0008d1edc0 sendmail 1357 1 1357 0 Ss select 0xfffffe0008f942c0 sshd 1311 1 1311 0 Ss select 0xfffffe0008d1f140 ntpd 1179 1173 1173 0 S (threaded) nfsd 100122 S rpcsvc 0xfffffe0008d144a0 nfsd: service 100121 S rpcsvc 0xfffffe0008d14520 nfsd: service 100120 S rpcsvc 0xfffffe0008d145a0 nfsd: service 100100 S rpcsvc 0xfffffe0008f0aaa0 nfsd: master 1173 1 1173 0 Ss select 0xfffffe0008f94b40 nfsd 1164 1 1164 0 Ss select 0xfffffe0008f94bc0 mountd 1065 1 1065 0 Ss select 0xfffffe0008b8fd40 rpcbind 1039 1 1039 0 Ss select 0xfffffe006721a840 syslogd 831 1 831 0 Ss select 0xfffffe0008f94640 devd 19 0 0 0 DL sdflush 0xffffffff81564738 [softdepflush] 18 0 0 0 DL vlruwt 0xfffffe0008b2b4a8 [vnlru] 17 0 0 0 DL syncer 0xffffffff81558da0 [syncer] 16 0 0 0 DL psleep 0xffffffff81558800 [bufdaemon] 9 0 0 0 DL pgzero 0xffffffff8156e73c [pagezero] 8 0 0 0 DL psleep 0xffffffff8156d908 [vmdaemon] 7 0 0 0 DL psleep 0xffffffff8156d8cc [pagedaemon] 6 0 0 0 DL ccb_scan 0xffffffff81322de0 [xpt_thrd] 5 0 0 0 DL waiting_ 0xffffffff8155ea80 [sctp_iterator] 4 0 0 0 DL - 0xfffffe0002d50848 [fdc0] 3 0 0 0 SL - 0xffffff8002658000 [fw0_probe] 15 0 0 0 DL (threaded) [usb] 100059 D - 0xffffff8002655e18 [usbus5] 100058 D - 0xffffff8002655dc0 [usbus5] 100057 D - 0xffffff8002655d68 [usbus5] 100056 D - 0xffffff8002655d10 [usbus5] 100054 D - 0xffffff800264d460 [usbus4] 100053 D - 0xffffff800264d408 [usbus4] 100052 D - 0xffffff800264d3b0 [usbus4] 100051 D - 0xffffff800264d358 [usbus4] 100050 D - 0xffffff800264a460 [usbus3] 100049 D - 0xffffff800264a408 [usbus3] 100048 D - 0xffffff800264a3b0 [usbus3] 100047 D - 0xffffff800264a358 [usbus3] 100046 D - 0xffffff8002647460 [usbus2] 100045 D - 0xffffff8002647408 [usbus2] 100044 D - 0xffffff80026473b0 [usbus2] 100043 D - 0xffffff8002647358 [usbus2] 100041 D - 0xffffff8002644460 [usbus1] 100040 D - 0xffffff8002644408 [usbus1] 100039 D - 0xffffff80026443b0 [usbus1] 100038 D - 0xffffff8002644358 [usbus1] 100036 D - 0xffffff8002641460 [usbus0] 100035 D - 0xffffff8002641408 [usbus0] 100034 D - 0xffffff80026413b0 [usbus0] 100033 D - 0xffffff8002641358 [usbus0] 2 0 0 0 DL ctl_work 0xffffff8001310000 [ctl_thrd] 14 0 0 0 DL - 0xffffffff81367e84 [yarrow] 13 0 0 0 DL (threaded) [geom] 100015 D - 0xffffffff81360f10 [g_down] 100014 D - 0xffffffff81360f08 [g_up] 100013 D - 0xffffffff81360ef8 [g_event] 12 0 0 0 WL (threaded) [intr] 100067 I [irq12: psm0] 100066 I [irq1: atkbd0] 100064 I [swi0: uart] 100061 I [irq20: fwohci0] 100060 I [irq14: ata0] 100055 I [irq19: ehci0] 100042 I [irq18: ohci2 ohci4] 100037 I [irq17: ohci1 ohci3] 100032 I [irq16: hdac1 ohci0] 100031 I [irq22: ahci0] 100030 I [irq257: re0] 100029 I [irq256: hdac0] 100027 I [swi6: task queue] 100026 I [swi6: Giant taskq] 100023 I [swi5: fast taskq] 100022 I [swi2: cambio] 100012 I [swi3: vm] 100011 I [swi4: clock] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 I [swi4: clock] 100007 I [swi1: netisr 0] 11 0 0 0 RL (threaded) [idle] 100006 CanRun [idle: cpu3] 100005 Run CPU 2 [idle: cpu2] 100004 Run CPU 1 [idle: cpu1] 100003 Run CPU 0 [idle: cpu0] 1 0 1 0 SLs wait 0xfffffe0002953950 [init] 10 0 0 0 DL audit_wo 0xffffffff815636b0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100741 D - 0xfffffe011cc50400 [system_taskq_3] 100729 D - 0xfffffe011cc50400 [system_taskq_2] 100575 D - 0xfffffe011cc50400 [system_taskq_1] 100547 D - 0xfffffe011cc50400 [system_taskq_0] 100069 D - 0xffffffff81367e84 [deadlkres] 100068 D - 0xfffffe0002fa3000 [mca taskq] 100062 D - 0xfffffe0002fa3880 [fw0_taskq] 100025 D - 0xfffffe0002984280 [thread taskq] 100024 D - 0xfffffe0002984300 [ffs_trim taskq] 100021 D - 0xfffffe0002984a00 [acpi_task_2] 100020 D - 0xfffffe0002984a00 [acpi_task_1] 100019 D - 0xfffffe0002984a00 [acpi_task_0] 100018 D - 0xfffffe0002984a80 [kqueue taskq] 100016 D - 0xfffffe0002961500 [firmware taskq] 100000 D sched 0xffffffff81361220 [swapper] db:0:ps> allt Tracing command linger3 pid 83187 tid 101499 td 0xfffffe006164c480 sched_switch() at sched_switch+0x1b4/frame 0xffffff8125d41520 mi_switch() at mi_switch+0x238/frame 0xffffff8125d41570 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8125d415b0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8125d415e0 __lockmgr_args() at __lockmgr_args+0xc0b/frame 0xffffff8125d416c0 ffs_lock() at ffs_lock+0x9b/frame 0xffffff8125d41710 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x88/frame 0xffffff8125d41730 _vn_lock() at _vn_lock+0x8d/frame 0xffffff8125d417b0 lookup() at lookup+0xc7/frame 0xffffff8125d41840 namei() at namei+0x400/frame 0xffffff8125d418f0 kern_mkdirat() at kern_mkdirat+0xb7/frame 0xffffff8125d41ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8125d41bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8125d41bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x800923bfa, rsp = 0x7fffffffd618, rbp = 0 --- Tracing command linger3 pid 83186 tid 100128 td 0xfffffe0070cdb000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8125a1c520 mi_switch() at mi_switch+0x238/frame 0xffffff8125a1c570 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8125a1c5b0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8125a1c5e0 __lockmgr_args() at __lockmgr_args+0xc0b/frame 0xffffff8125a1c6c0 ffs_lock() at ffs_lock+0x9b/frame 0xffffff8125a1c710 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x88/frame 0xffffff8125a1c730 _vn_lock() at _vn_lock+0x8d/frame 0xffffff8125a1c7b0 lookup() at lookup+0xc7/frame 0xffffff8125a1c840 namei() at namei+0x400/frame 0xffffff8125a1c8f0 kern_mkdirat() at kern_mkdirat+0xb7/frame 0xffffff8125a1cad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8125a1cbf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8125a1cbf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x800923bfa, rsp = 0x7fffffffd618, rbp = 0 --- Tracing command linger3 pid 83185 tid 100300 td 0xfffffe002259e000 pmap_qenter() at pmap_qenter+0x49/frame 0xffffff81259d1320 bpmap_qenter() at bpmap_qenter+0x55/frame 0xffffff81259d1340 getblk() at getblk+0x3fd/frame 0xffffff81259d13f0 breadn_flags() at breadn_flags+0x40/frame 0xffffff81259d1440 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xc76/frame 0xffffff81259d1610 ufs_direnter() at ufs_direnter+0x318/frame 0xffffff81259d16e0 ufs_mkdir() at ufs_mkdir+0x50a/frame 0xffffff81259d18d0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0xaa/frame 0xffffff81259d18f0 kern_mkdirat() at kern_mkdirat+0x212/frame 0xffffff81259d1ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff81259d1bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff81259d1bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x800923bfa, rsp = 0x7fffffffd618, rbp = 0 --- Tracing command linger3 pid 83184 tid 100205 td 0xfffffe0094ba8480 sched_switch() at sched_switch+0x1b4/frame 0xffffff812571a520 mi_switch() at mi_switch+0x238/frame 0xffffff812571a570 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff812571a5b0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff812571a5e0 __lockmgr_args() at __lockmgr_args+0xc0b/frame 0xffffff812571a6c0 ffs_lock() at ffs_lock+0x9b/frame 0xffffff812571a710 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x88/frame 0xffffff812571a730 _vn_lock() at _vn_lock+0x8d/frame 0xffffff812571a7b0 lookup() at lookup+0xc7/frame 0xffffff812571a840 namei() at namei+0x400/frame 0xffffff812571a8f0 kern_mkdirat() at kern_mkdirat+0xb7/frame 0xffffff812571aad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff812571abf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff812571abf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x800923bfa, rsp = 0x7fffffffd618, rbp = 0 --- Tracing command linger3 pid 83183 tid 101094 td 0xfffffe004273c000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8125dbe650 mi_switch() at mi_switch+0x238/frame 0xffffff8125dbe6a0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8125dbe6e0 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff8125dbe740 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff8125dbe760 _sleep() at _sleep+0x37d/frame 0xffffff8125dbe7f0 kern_wait6() at kern_wait6+0x5b3/frame 0xffffff8125dbe890 kern_wait() at kern_wait+0x12d/frame 0xffffff8125dbea10 sys_wait4() at sys_wait4+0x35/frame 0xffffff8125dbead0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8125dbebf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8125dbebf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800898d0a, rsp = 0x7fffffffd6b8, rbp = 0 --- Tracing command su pid 83182 tid 100530 td 0xfffffe00c9ed2480 sched_switch() at sched_switch+0x1b4/frame 0xffffff8125ba2650 mi_switch() at mi_switch+0x238/frame 0xffffff8125ba26a0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8125ba26e0 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff8125ba2740 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff8125ba2760 _sleep() at _sleep+0x37d/frame 0xffffff8125ba27f0 kern_wait6() at kern_wait6+0x5b3/frame 0xffffff8125ba2890 kern_wait() at kern_wait+0x12d/frame 0xffffff8125ba2a10 sys_wait4() at sys_wait4+0x35/frame 0xffffff8125ba2ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8125ba2bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8125ba2bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800ed3d0a, rsp = 0x7fffffffd158, rbp = 0x144ef --- Tracing command md5 pid 83177 tid 100327 td 0xfffffe00c1b0b900 sched_switch() at sched_switch+0x1b4/frame 0xffffff81256aca10 mi_switch() at mi_switch+0x238/frame 0xffffff81256aca60 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81256acaa0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff81256acad0 _sleep() at _sleep+0x3e9/frame 0xffffff81256acb60 md_kthread() at md_kthread+0x17b/frame 0xffffff81256acba0 fork_exit() at fork_exit+0x139/frame 0xffffff81256acbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff81256acbf0 --- trap 0, rip = 0, rsp = 0xffffff81256accb0, rbp = 0 --- Tracing command sh pid 83158 tid 100927 td 0xfffffe00b39ca900 sched_switch() at sched_switch+0x1b4/frame 0xffffff8125a17650 mi_switch() at mi_switch+0x238/frame 0xffffff8125a176a0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8125a176e0 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff8125a17740 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff8125a17760 _sleep() at _sleep+0x37d/frame 0xffffff8125a177f0 kern_wait6() at kern_wait6+0x5b3/frame 0xffffff8125a17890 kern_wait() at kern_wait+0x12d/frame 0xffffff8125a17a10 sys_wait4() at sys_wait4+0x35/frame 0xffffff8125a17ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8125a17bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8125a17bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800d2fd0a, rsp = 0x7fffffffd538, rbp = 0x1 --- Tracing command sleep pid 83137 tid 100824 td 0xfffffe0024445480 sched_switch() at sched_switch+0x1b4/frame 0xffffff8125b93850 mi_switch() at mi_switch+0x238/frame 0xffffff8125b938a0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8125b938e0 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff8125b93940 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19/frame 0xffffff8125b93970 _sleep() at _sleep+0x3c3/frame 0xffffff8125b93a00 kern_nanosleep() at kern_nanosleep+0x118/frame 0xffffff8125b93a70 sys_nanosleep() at sys_nanosleep+0x6e/frame 0xffffff8125b93ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8125b93bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8125b93bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x80091342a, rsp = 0x7fffffffdb48, rbp = 0x7fffffffdbd0 --- Tracing command zfskern pid 23116 tid 100743 td 0xfffffe0008f5c480 sched_switch() at sched_switch+0x1b4/frame 0xffffff8125c0b920 mi_switch() at mi_switch+0x238/frame 0xffffff8125c0b970 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8125c0b9b0 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff8125c0b9e0 _cv_timedwait() at _cv_timedwait+0x18f/frame 0xffffff8125c0ba40 l2arc_feed_thread() at l2arc_feed_thread+0x198/frame 0xffffff8125c0bba0 fork_exit() at fork_exit+0x139/frame 0xffffff8125c0bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8125c0bbf0 --- trap 0, rip = 0, rsp = 0xffffff8125c0bcb0, rbp = 0 --- Tracing command zfskern pid 23116 tid 100250 td 0xfffffe0067d48000 sched_switch() at sched_switch+0x1b4/frame 0xffffff81258d79c0 mi_switch() at mi_switch+0x238/frame 0xffffff81258d7a10 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81258d7a50 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff81258d7a80 _cv_timedwait() at _cv_timedwait+0x18f/frame 0xffffff81258d7ae0 arc_reclaim_thread() at arc_reclaim_thread+0x29d/frame 0xffffff81258d7ba0 fork_exit() at fork_exit+0x139/frame 0xffffff81258d7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff81258d7bf0 --- trap 0, rip = 0, rsp = 0xffffff81258d7cb0, rbp = 0 --- Tracing command sh pid 7635 tid 100231 td 0xfffffe0116160900 sched_switch() at sched_switch+0x1b4/frame 0xffffff8125878650 mi_switch() at mi_switch+0x238/frame 0xffffff81258786a0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81258786e0 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff8125878740 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff8125878760 _sleep() at _sleep+0x37d/frame 0xffffff81258787f0 kern_wait6() at kern_wait6+0x5b3/frame 0xffffff8125878890 kern_wait() at kern_wait+0x12d/frame 0xffffff8125878a10 sys_wait4() at sys_wait4+0x35/frame 0xffffff8125878ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8125878bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8125878bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800d2fd0a, rsp = 0x7fffffffd3f8, rbp = 0x1 --- Tracing command bash pid 7616 tid 100287 td 0xfffffe001bbcc900 Tracing command csh pid 7613 tid 100175 td 0xfffffe0067a49480 Tracing command su pid 7612 tid 100207 td 0xfffffe0067f06000 Tracing command bash pid 1524 tid 100141 td 0xfffffe0008b28900 Tracing command sshd pid 1523 tid 100140 td 0xfffffe00676c2480 sched_switch() at sched_switch+0x1b4/frame 0xffffff81256b1690 mi_switch() at mi_switch+0x238/frame 0xffffff81256b16e0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81256b1720 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff81256b1780 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff81256b17a0 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff81256b1800 seltdwait() at seltdwait+0xad/frame 0xffffff81256b1830 kern_select() at kern_select+0x79f/frame 0xffffff81256b1a80 sys_select() at sys_select+0x5d/frame 0xffffff81256b1ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff81256b1bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff81256b1bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80255deda, rsp = 0x7fffffffcc58, rbp = 0x7fffffffcce0 --- Tracing command sshd pid 1521 tid 100138 td 0xfffffe0008d61000 sched_switch() at sched_switch+0x1b4/frame 0xffffff81256a7760 mi_switch() at mi_switch+0x238/frame 0xffffff81256a77b0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81256a77f0 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff81256a7850 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff81256a7870 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff81256a78d0 seltdwait() at seltdwait+0xad/frame 0xffffff81256a7900 sys_poll() at sys_poll+0x3e6/frame 0xffffff81256a7ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff81256a7bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff81256a7bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8024f7e1a, rsp = 0x7fffffffccf8, rbp = 0x803c22190 --- Tracing command awk pid 1505 tid 100133 td 0xfffffe0008f5e000 sched_switch() at sched_switch+0x1b4/frame 0xffffff812568e800 mi_switch() at mi_switch+0x238/frame 0xffffff812568e850 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff812568e890 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff812568e8f0 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff812568e910 _sleep() at _sleep+0x37d/frame 0xffffff812568e9a0 pipe_read() at pipe_read+0x432/frame 0xffffff812568e9f0 dofileread() at dofileread+0xa1/frame 0xffffff812568ea40 kern_readv() at kern_readv+0x6c/frame 0xffffff812568ea80 sys_read() at sys_read+0x64/frame 0xffffff812568ead0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff812568ebf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff812568ebf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b76f5a, rsp = 0x7fffffffd848, rbp = 0x800db4d60 --- Tracing command sh pid 1504 tid 100132 td 0xfffffe0008f5e480 sched_switch() at sched_switch+0x1b4/frame 0xffffff8125689650 mi_switch() at mi_switch+0x238/frame 0xffffff81256896a0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81256896e0 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff8125689740 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff8125689760 _sleep() at _sleep+0x37d/frame 0xffffff81256897f0 kern_wait6() at kern_wait6+0x5b3/frame 0xffffff8125689890 kern_wait() at kern_wait+0x12d/frame 0xffffff8125689a10 sys_wait4() at sys_wait4+0x35/frame 0xffffff8125689ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8125689bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8125689bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800d2fd0a, rsp = 0x7fffffffd658, rbp = 0x1 --- Tracing command top pid 1503 tid 100108 td 0xfffffe0008e75000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8125611680 mi_switch() at mi_switch+0x238/frame 0xffffff81256116d0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8125611710 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff8125611770 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19/frame 0xffffff81256117a0 _cv_timedwait_sig() at _cv_timedwait_sig+0x18f/frame 0xffffff8125611800 seltdwait() at seltdwait+0x57/frame 0xffffff8125611830 kern_select() at kern_select+0x79f/frame 0xffffff8125611a80 sys_select() at sys_select+0x5d/frame 0xffffff8125611ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8125611bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8125611bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800fb8eda, rsp = 0x7fffffffd988, rbp = 0xe --- Tracing command sh pid 1502 tid 100085 td 0xfffffe0008db8000 Tracing command tail pid 1501 tid 100131 td 0xfffffe0008f5e900 sched_switch() at sched_switch+0x1b4/frame 0xffffff8125684680 mi_switch() at mi_switch+0x238/frame 0xffffff81256846d0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8125684710 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff8125684770 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19/frame 0xffffff81256847a0 _sleep() at _sleep+0x3c3/frame 0xffffff8125684830 kern_kevent() at kern_kevent+0x33a/frame 0xffffff8125684a10 sys_kevent() at sys_kevent+0x90/frame 0xffffff8125684ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8125684bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8125684bf0 --- syscall (363, FreeBSD ELF64, sys_kevent), rip = 0x8009183ba, rsp = 0x7fffffffd9e8, rbp = 0x8010060a8 --- Tracing command sshd pid 1500 tid 100114 td 0xfffffe0008f84000 sched_switch() at sched_switch+0x1b4/frame 0xffffff812562f690 mi_switch() at mi_switch+0x238/frame 0xffffff812562f6e0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff812562f720 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff812562f780 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff812562f7a0 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff812562f800 seltdwait() at seltdwait+0xad/frame 0xffffff812562f830 kern_select() at kern_select+0x79f/frame 0xffffff812562fa80 sys_select() at sys_select+0x5d/frame 0xffffff812562fad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff812562fbf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff812562fbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80255deda, rsp = 0x7fffffffcc58, rbp = 0x7fffffffcce0 --- Tracing command sshd pid 1499 tid 100130 td 0xfffffe00676c2900 sched_switch() at sched_switch+0x1b4/frame 0xffffff812567f690 mi_switch() at mi_switch+0x238/frame 0xffffff812567f6e0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff812567f720 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff812567f780 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff812567f7a0 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff812567f800 seltdwait() at seltdwait+0xad/frame 0xffffff812567f830 kern_select() at kern_select+0x79f/frame 0xffffff812567fa80 sys_select() at sys_select+0x5d/frame 0xffffff812567fad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff812567fbf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff812567fbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80255deda, rsp = 0x7fffffffcc58, rbp = 0x7fffffffcce0 --- Tracing command sshd pid 1498 tid 100083 td 0xfffffe0008db8900 sched_switch() at sched_switch+0x1b4/frame 0xffffff8125594690 mi_switch() at mi_switch+0x238/frame 0xffffff81255946e0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8125594720 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff8125594780 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff81255947a0 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff8125594800 seltdwait() at seltdwait+0xad/frame 0xffffff8125594830 kern_select() at kern_select+0x79f/frame 0xffffff8125594a80 sys_select() at sys_select+0x5d/frame 0xffffff8125594ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8125594bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8125594bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80255deda, rsp = 0x7fffffffcc58, rbp = 0x7fffffffcce0 --- Tracing command sshd pid 1494 tid 100099 td 0xfffffe0008d65000 sched_switch() at sched_switch+0x1b4/frame 0xffffff81255e4760 mi_switch() at mi_switch+0x238/frame 0xffffff81255e47b0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81255e47f0 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff81255e4850 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff81255e4870 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff81255e48d0 seltdwait() at seltdwait+0xad/frame 0xffffff81255e4900 sys_poll() at sys_poll+0x3e6/frame 0xffffff81255e4ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff81255e4bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff81255e4bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8024f7e1a, rsp = 0x7fffffffccf8, rbp = 0x803c22190 --- Tracing command sshd pid 1493 tid 100101 td 0xfffffe0008e3e000 sched_switch() at sched_switch+0x1b4/frame 0xffffff81255ee760 mi_switch() at mi_switch+0x238/frame 0xffffff81255ee7b0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81255ee7f0 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff81255ee850 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff81255ee870 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff81255ee8d0 seltdwait() at seltdwait+0xad/frame 0xffffff81255ee900 sys_poll() at sys_poll+0x3e6/frame 0xffffff81255eead0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff81255eebf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff81255eebf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8024f7e1a, rsp = 0x7fffffffccf8, rbp = 0x803c22190 --- Tracing command sshd pid 1492 tid 100082 td 0xfffffe0008db9000 sched_switch() at sched_switch+0x1b4/frame 0xffffff812558f760 mi_switch() at mi_switch+0x238/frame 0xffffff812558f7b0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff812558f7f0 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff812558f850 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff812558f870 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff812558f8d0 seltdwait() at seltdwait+0xad/frame 0xffffff812558f900 sys_poll() at sys_poll+0x3e6/frame 0xffffff812558fad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff812558fbf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff812558fbf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8024f7e1a, rsp = 0x7fffffffccf8, rbp = 0x803c22190 --- Tracing command getty pid 1480 tid 100124 td 0xfffffe0008e74480 sched_switch() at sched_switch+0x1b4/frame 0xffffff8125661710 mi_switch() at mi_switch+0x238/frame 0xffffff8125661760 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81256617a0 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff8125661800 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff8125661820 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff8125661880 tty_wait() at tty_wait+0x4c/frame 0xffffff81256618b0 ttydisc_read() at ttydisc_read+0x38e/frame 0xffffff8125661950 ttydev_read() at ttydev_read+0x95/frame 0xffffff8125661980 devfs_read_f() at devfs_read_f+0x90/frame 0xffffff81256619f0 dofileread() at dofileread+0xa1/frame 0xffffff8125661a40 kern_readv() at kern_readv+0x6c/frame 0xffffff8125661a80 sys_read() at sys_read+0x64/frame 0xffffff8125661ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8125661bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8125661bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b4af5a, rsp = 0x7fffffffdc98, rbp = 0 --- Tracing command getty pid 1479 tid 100123 td 0xfffffe0008e74900 sched_switch() at sched_switch+0x1b4/frame 0xffffff812565c710 mi_switch() at mi_switch+0x238/frame 0xffffff812565c760 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff812565c7a0 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff812565c800 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff812565c820 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff812565c880 tty_wait() at tty_wait+0x4c/frame 0xffffff812565c8b0 ttydisc_read() at ttydisc_read+0x38e/frame 0xffffff812565c950 ttydev_read() at ttydev_read+0x95/frame 0xffffff812565c980 devfs_read_f() at devfs_read_f+0x90/frame 0xffffff812565c9f0 dofileread() at dofileread+0xa1/frame 0xffffff812565ca40 kern_readv() at kern_readv+0x6c/frame 0xffffff812565ca80 sys_read() at sys_read+0x64/frame 0xffffff812565cad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff812565cbf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff812565cbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b4af5a, rsp = 0x7fffffffdc98, rbp = 0 --- Tracing command getty pid 1478 tid 100106 td 0xfffffe0008e75900 sched_switch() at sched_switch+0x1b4/frame 0xffffff8125607710 mi_switch() at mi_switch+0x238/frame 0xffffff8125607760 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81256077a0 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff8125607800 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff8125607820 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff8125607880 tty_wait() at tty_wait+0x4c/frame 0xffffff81256078b0 ttydisc_read() at ttydisc_read+0x38e/frame 0xffffff8125607950 ttydev_read() at ttydev_read+0x95/frame 0xffffff8125607980 devfs_read_f() at devfs_read_f+0x90/frame 0xffffff81256079f0 dofileread() at dofileread+0xa1/frame 0xffffff8125607a40 kern_readv() at kern_readv+0x6c/frame 0xffffff8125607a80 sys_read() at sys_read+0x64/frame 0xffffff8125607ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8125607bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8125607bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b4af5a, rsp = 0x7fffffffdc98, rbp = 0 --- Tracing command getty pid 1477 tid 100091 td 0xfffffe0008d66000 sched_switch() at sched_switch+0x1b4/frame 0xffffff81255bc710 mi_switch() at mi_switch+0x238/frame 0xffffff81255bc760 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81255bc7a0 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff81255bc800 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff81255bc820 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff81255bc880 tty_wait() at tty_wait+0x4c/frame 0xffffff81255bc8b0 ttydisc_read() at ttydisc_read+0x38e/frame 0xffffff81255bc950 ttydev_read() at ttydev_read+0x95/frame 0xffffff81255bc980 devfs_read_f() at devfs_read_f+0x90/frame 0xffffff81255bc9f0 dofileread() at dofileread+0xa1/frame 0xffffff81255bca40 kern_readv() at kern_readv+0x6c/frame 0xffffff81255bca80 sys_read() at sys_read+0x64/frame 0xffffff81255bcad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff81255bcbf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff81255bcbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b4af5a, rsp = 0x7fffffffdc98, rbp = 0 --- Tracing command getty pid 1476 tid 100092 td 0xfffffe0008e5c000 sched_switch() at sched_switch+0x1b4/frame 0xffffff81255c1710 mi_switch() at mi_switch+0x238/frame 0xffffff81255c1760 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81255c17a0 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff81255c1800 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff81255c1820 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff81255c1880 tty_wait() at tty_wait+0x4c/frame 0xffffff81255c18b0 ttydisc_read() at ttydisc_read+0x38e/frame 0xffffff81255c1950 ttydev_read() at ttydev_read+0x95/frame 0xffffff81255c1980 devfs_read_f() at devfs_read_f+0x90/frame 0xffffff81255c19f0 dofileread() at dofileread+0xa1/frame 0xffffff81255c1a40 kern_readv() at kern_readv+0x6c/frame 0xffffff81255c1a80 sys_read() at sys_read+0x64/frame 0xffffff81255c1ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff81255c1bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff81255c1bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b4af5a, rsp = 0x7fffffffdc98, rbp = 0 --- Tracing command getty pid 1475 tid 100103 td 0xfffffe0008d64480 sched_switch() at sched_switch+0x1b4/frame 0xffffff81255f8710 mi_switch() at mi_switch+0x238/frame 0xffffff81255f8760 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81255f87a0 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff81255f8800 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff81255f8820 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff81255f8880 tty_wait() at tty_wait+0x4c/frame 0xffffff81255f88b0 ttydisc_read() at ttydisc_read+0x38e/frame 0xffffff81255f8950 ttydev_read() at ttydev_read+0x95/frame 0xffffff81255f8980 devfs_read_f() at devfs_read_f+0x90/frame 0xffffff81255f89f0 dofileread() at dofileread+0xa1/frame 0xffffff81255f8a40 kern_readv() at kern_readv+0x6c/frame 0xffffff81255f8a80 sys_read() at sys_read+0x64/frame 0xffffff81255f8ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff81255f8bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff81255f8bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b4af5a, rsp = 0x7fffffffdc98, rbp = 0 --- Tracing command getty pid 1474 tid 100094 td 0xfffffe0008e3f480 sched_switch() at sched_switch+0x1b4/frame 0xffffff81255cb710 mi_switch() at mi_switch+0x238/frame 0xffffff81255cb760 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81255cb7a0 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff81255cb800 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff81255cb820 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff81255cb880 tty_wait() at tty_wait+0x4c/frame 0xffffff81255cb8b0 ttydisc_read() at ttydisc_read+0x38e/frame 0xffffff81255cb950 ttydev_read() at ttydev_read+0x95/frame 0xffffff81255cb980 devfs_read_f() at devfs_read_f+0x90/frame 0xffffff81255cb9f0 dofileread() at dofileread+0xa1/frame 0xffffff81255cba40 kern_readv() at kern_readv+0x6c/frame 0xffffff81255cba80 sys_read() at sys_read+0x64/frame 0xffffff81255cbad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff81255cbbf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff81255cbbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b4af5a, rsp = 0x7fffffffdc98, rbp = 0 --- Tracing command getty pid 1473 tid 100116 td 0xfffffe0008ed5480 sched_switch() at sched_switch+0x1b4/frame 0xffffff8125639710 mi_switch() at mi_switch+0x238/frame 0xffffff8125639760 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81256397a0 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff8125639800 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff8125639820 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff8125639880 tty_wait() at tty_wait+0x4c/frame 0xffffff81256398b0 ttydisc_read() at ttydisc_read+0x38e/frame 0xffffff8125639950 ttydev_read() at ttydev_read+0x95/frame 0xffffff8125639980 devfs_read_f() at devfs_read_f+0x90/frame 0xffffff81256399f0 dofileread() at dofileread+0xa1/frame 0xffffff8125639a40 kern_readv() at kern_readv+0x6c/frame 0xffffff8125639a80 sys_read() at sys_read+0x64/frame 0xffffff8125639ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8125639bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8125639bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b4af5a, rsp = 0x7fffffffdc98, rbp = 0 --- Tracing command getty pid 1472 tid 100079 td 0xfffffe0008d66900 sched_switch() at sched_switch+0x1b4/frame 0xffffff8125580710 mi_switch() at mi_switch+0x238/frame 0xffffff8125580760 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81255807a0 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff8125580800 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff8125580820 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff8125580880 tty_wait() at tty_wait+0x4c/frame 0xffffff81255808b0 ttydisc_read() at ttydisc_read+0x38e/frame 0xffffff8125580950 ttydev_read() at ttydev_read+0x95/frame 0xffffff8125580980 devfs_read_f() at devfs_read_f+0x90/frame 0xffffff81255809f0 dofileread() at dofileread+0xa1/frame 0xffffff8125580a40 kern_readv() at kern_readv+0x6c/frame 0xffffff8125580a80 sys_read() at sys_read+0x64/frame 0xffffff8125580ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8125580bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8125580bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b4af5a, rsp = 0x7fffffffdc98, rbp = 0 --- Tracing command inetd pid 1433 tid 100107 td 0xfffffe0008e75480 sched_switch() at sched_switch+0x1b4/frame 0xffffff812560c690 mi_switch() at mi_switch+0x238/frame 0xffffff812560c6e0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff812560c720 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff812560c780 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff812560c7a0 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff812560c800 seltdwait() at seltdwait+0xad/frame 0xffffff812560c830 kern_select() at kern_select+0x79f/frame 0xffffff812560ca80 sys_select() at sys_select+0x5d/frame 0xffffff812560cad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff812560cbf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff812560cbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800f5feda, rsp = 0x7fffffffcd68, rbp = 0x1 --- Tracing command moused pid 1400 tid 100080 td 0xfffffe0008db9900 sched_switch() at sched_switch+0x1b4/frame 0xffffff8125585690 mi_switch() at mi_switch+0x238/frame 0xffffff81255856e0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8125585720 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff8125585780 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff81255857a0 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff8125585800 seltdwait() at seltdwait+0xad/frame 0xffffff8125585830 kern_select() at kern_select+0x79f/frame 0xffffff8125585a80 sys_select() at sys_select+0x5d/frame 0xffffff8125585ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8125585bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8125585bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800d71eda, rsp = 0x7fffffffd858, rbp = 0 --- Tracing command cron pid 1376 tid 100097 td 0xfffffe0008d65900 sched_switch() at sched_switch+0x1b4/frame 0xffffff81255da850 mi_switch() at mi_switch+0x238/frame 0xffffff81255da8a0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81255da8e0 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff81255da940 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19/frame 0xffffff81255da970 _sleep() at _sleep+0x3c3/frame 0xffffff81255daa00 kern_nanosleep() at kern_nanosleep+0x118/frame 0xffffff81255daa70 sys_nanosleep() at sys_nanosleep+0x6e/frame 0xffffff81255daad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff81255dabf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff81255dabf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800d3942a, rsp = 0x7fffffffdac8, rbp = 0x3c --- Tracing command sendmail pid 1369 tid 100104 td 0xfffffe0008b24900 sched_switch() at sched_switch+0x1b4/frame 0xffffff81255fd8b0 mi_switch() at mi_switch+0x238/frame 0xffffff81255fd900 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81255fd940 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff81255fd9a0 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff81255fd9c0 _sleep() at _sleep+0x37d/frame 0xffffff81255fda50 kern_sigsuspend() at kern_sigsuspend+0xaa/frame 0xffffff81255fdaa0 sys_sigsuspend() at sys_sigsuspend+0x34/frame 0xffffff81255fdad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff81255fdbf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff81255fdbf0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x80139516a, rsp = 0x7fffffffbda8, rbp = 0x1 --- Tracing command sendmail pid 1365 tid 100089 td 0xfffffe0008db7000 sched_switch() at sched_switch+0x1b4/frame 0xffffff81255b2680 mi_switch() at mi_switch+0x238/frame 0xffffff81255b26d0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81255b2710 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff81255b2770 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19/frame 0xffffff81255b27a0 _cv_timedwait_sig() at _cv_timedwait_sig+0x18f/frame 0xffffff81255b2800 seltdwait() at seltdwait+0x57/frame 0xffffff81255b2830 kern_select() at kern_select+0x79f/frame 0xffffff81255b2a80 sys_select() at sys_select+0x5d/frame 0xffffff81255b2ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff81255b2bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff81255b2bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x801447eda, rsp = 0x7fffffffb218, rbp = 0x7fffffffb2b0 --- Tracing command sshd pid 1357 tid 100119 td 0xfffffe0008ed4480 sched_switch() at sched_switch+0x1b4/frame 0xffffff8125648690 mi_switch() at mi_switch+0x238/frame 0xffffff81256486e0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8125648720 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff8125648780 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff81256487a0 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff8125648800 seltdwait() at seltdwait+0xad/frame 0xffffff8125648830 kern_select() at kern_select+0x79f/frame 0xffffff8125648a80 sys_select() at sys_select+0x5d/frame 0xffffff8125648ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8125648bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8125648bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80255deda, rsp = 0x7fffffffcd78, rbp = 0x2 --- Tracing command ntpd pid 1311 tid 100111 td 0xfffffe0008b23480 sched_switch() at sched_switch+0x1b4/frame 0xffffff8125620690 mi_switch() at mi_switch+0x238/frame 0xffffff81256206e0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8125620720 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff8125620780 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff81256207a0 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff8125620800 seltdwait() at seltdwait+0xad/frame 0xffffff8125620830 kern_select() at kern_select+0x79f/frame 0xffffff8125620a80 sys_select() at sys_select+0x5d/frame 0xffffff8125620ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8125620bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8125620bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8013a7eda, rsp = 0x7fffffffdbc8, rbp = 0x7fffffffdd08 --- Tracing command nfsd pid 1179 tid 100122 td 0xfffffe0008db6000 sched_switch() at sched_switch+0x1b4/frame 0xffffff81256578e0 mi_switch() at mi_switch+0x238/frame 0xffffff8125657930 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8125657970 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff81256579d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19/frame 0xffffff8125657a00 _cv_timedwait_sig() at _cv_timedwait_sig+0x18f/frame 0xffffff8125657a60 svc_run_internal() at svc_run_internal+0x87e/frame 0xffffff8125657b90 svc_thread_start() at svc_thread_start+0xb/frame 0xffffff8125657ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8125657bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8125657bf0 --- trap 0xc, rip = 0x800885dca, rsp = 0x7fffffffd678, rbp = 0x5 --- Tracing command nfsd pid 1179 tid 100121 td 0xfffffe0008db6480 sched_switch() at sched_switch+0x1b4/frame 0xffffff81256528e0 mi_switch() at mi_switch+0x238/frame 0xffffff8125652930 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8125652970 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff81256529d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19/frame 0xffffff8125652a00 _cv_timedwait_sig() at _cv_timedwait_sig+0x18f/frame 0xffffff8125652a60 svc_run_internal() at svc_run_internal+0x87e/frame 0xffffff8125652b90 svc_thread_start() at svc_thread_start+0xb/frame 0xffffff8125652ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8125652bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8125652bf0 --- trap 0xc, rip = 0x800885dca, rsp = 0x7fffffffd678, rbp = 0x5 --- Tracing command nfsd pid 1179 tid 100120 td 0xfffffe0008db6900 sched_switch() at sched_switch+0x1b4/frame 0xffffff812564d8e0 mi_switch() at mi_switch+0x238/frame 0xffffff812564d930 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff812564d970 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff812564d9d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19/frame 0xffffff812564da00 _cv_timedwait_sig() at _cv_timedwait_sig+0x18f/frame 0xffffff812564da60 svc_run_internal() at svc_run_internal+0x87e/frame 0xffffff812564db90 svc_thread_start() at svc_thread_start+0xb/frame 0xffffff812564dba0 fork_exit() at fork_exit+0x139/frame 0xffffff812564dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff812564dbf0 --- trap 0xc, rip = 0x800885dca, rsp = 0x7fffffffd678, rbp = 0x5 --- Tracing command nfsd pid 1179 tid 100100 td 0xfffffe0008e3e480 sched_switch() at sched_switch+0x1b4/frame 0xffffff81255e9070 mi_switch() at mi_switch+0x238/frame 0xffffff81255e90c0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81255e9100 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff81255e9160 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19/frame 0xffffff81255e9190 _cv_timedwait_sig() at _cv_timedwait_sig+0x18f/frame 0xffffff81255e91f0 svc_run_internal() at svc_run_internal+0x87e/frame 0xffffff81255e9320 svc_run() at svc_run+0x94/frame 0xffffff81255e9340 nfsrvd_nfsd() at nfsrvd_nfsd+0x1c7/frame 0xffffff81255e9490 nfssvc_nfsd() at nfssvc_nfsd+0x9b/frame 0xffffff81255e9ab0 sys_nfssvc() at sys_nfssvc+0xb0/frame 0xffffff81255e9ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff81255e9bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff81255e9bf0 --- syscall (155, FreeBSD ELF64, sys_nfssvc), rip = 0x800885dca, rsp = 0x7fffffffd678, rbp = 0x5 --- Tracing command nfsd pid 1173 tid 100109 td 0xfffffe0008b24000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8125616690 mi_switch() at mi_switch+0x238/frame 0xffffff81256166e0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8125616720 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff8125616780 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff81256167a0 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff8125616800 seltdwait() at seltdwait+0xad/frame 0xffffff8125616830 kern_select() at kern_select+0x79f/frame 0xffffff8125616a80 sys_select() at sys_select+0x5d/frame 0xffffff8125616ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8125616bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8125616bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800937eda, rsp = 0x7fffffffd928, rbp = 0x7 --- Tracing command mountd pid 1164 tid 100087 td 0xfffffe0008b25000 sched_switch() at sched_switch+0x1b4/frame 0xffffff81255a8690 mi_switch() at mi_switch+0x238/frame 0xffffff81255a86e0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81255a8720 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff81255a8780 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff81255a87a0 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff81255a8800 seltdwait() at seltdwait+0xad/frame 0xffffff81255a8830 kern_select() at kern_select+0x79f/frame 0xffffff81255a8a80 sys_select() at sys_select+0x5d/frame 0xffffff81255a8ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff81255a8bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff81255a8bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800b4feda, rsp = 0x7fffffffdb78, rbp = 0x80143b060 --- Tracing command rpcbind pid 1065 tid 100098 td 0xfffffe0008d65480 sched_switch() at sched_switch+0x1b4/frame 0xffffff81255df750 mi_switch() at mi_switch+0x238/frame 0xffffff81255df7a0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81255df7e0 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff81255df840 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19/frame 0xffffff81255df870 _cv_timedwait_sig() at _cv_timedwait_sig+0x18f/frame 0xffffff81255df8d0 seltdwait() at seltdwait+0x57/frame 0xffffff81255df900 sys_poll() at sys_poll+0x3e6/frame 0xffffff81255dfad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff81255dfbf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff81255dfbf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x800cf2e1a, rsp = 0x7fffffffba48, rbp = 0x80141b020 --- Tracing command syslogd pid 1039 tid 100113 td 0xfffffe0008f84480 sched_switch() at sched_switch+0x1b4/frame 0xffffff812562a690 mi_switch() at mi_switch+0x238/frame 0xffffff812562a6e0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff812562a720 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff812562a780 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff812562a7a0 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff812562a800 seltdwait() at seltdwait+0xad/frame 0xffffff812562a830 kern_select() at kern_select+0x79f/frame 0xffffff812562aa80 sys_select() at sys_select+0x5d/frame 0xffffff812562aad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff812562abf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff812562abf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800b4deda, rsp = 0x7fffffffd118, rbp = 0x80142c108 --- Tracing command devd pid 831 tid 100095 td 0xfffffe0008e3f000 sched_switch() at sched_switch+0x1b4/frame 0xffffff81255d0690 mi_switch() at mi_switch+0x238/frame 0xffffff81255d06e0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81255d0720 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff81255d0780 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff81255d07a0 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff81255d0800 seltdwait() at seltdwait+0xad/frame 0xffffff81255d0830 kern_select() at kern_select+0x79f/frame 0xffffff81255d0a80 sys_select() at sys_select+0x5d/frame 0xffffff81255d0ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff81255d0bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff81255d0bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x442baa, rsp = 0x7fffffffd828, rbp = 0x7fffffffd840 --- Tracing command softdepflush pid 19 tid 100078 td 0xfffffe0008b25480 sched_switch() at sched_switch+0x1b4/frame 0xffffff811c2fea10 mi_switch() at mi_switch+0x238/frame 0xffffff811c2fea60 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811c2feaa0 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff811c2fead0 _sleep() at _sleep+0x29a/frame 0xffffff811c2feb60 softdep_flush() at softdep_flush+0x20d/frame 0xffffff811c2feba0 fork_exit() at fork_exit+0x139/frame 0xffffff811c2febf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811c2febf0 --- trap 0, rip = 0, rsp = 0xffffff811c2fecb0, rbp = 0 --- Tracing command vnlru pid 18 tid 100077 td 0xfffffe0008b25900 sched_switch() at sched_switch+0x1b4/frame 0xffffff811c2f99d0 mi_switch() at mi_switch+0x238/frame 0xffffff811c2f9a20 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811c2f9a60 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff811c2f9a90 _sleep() at _sleep+0x29a/frame 0xffffff811c2f9b20 vnlru_proc() at vnlru_proc+0x537/frame 0xffffff811c2f9ba0 fork_exit() at fork_exit+0x139/frame 0xffffff811c2f9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811c2f9bf0 --- trap 0, rip = 0, rsp = 0xffffff811c2f9cb0, rbp = 0 --- Tracing command syncer pid 17 tid 100076 td 0xfffffe0008b26000 sched_switch() at sched_switch+0x1b4/frame 0xffffff811c2f49f0 mi_switch() at mi_switch+0x238/frame 0xffffff811c2f4a40 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811c2f4a80 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff811c2f4ab0 _cv_timedwait() at _cv_timedwait+0x18f/frame 0xffffff811c2f4b10 sched_sync() at sched_sync+0x568/frame 0xffffff811c2f4ba0 fork_exit() at fork_exit+0x139/frame 0xffffff811c2f4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811c2f4bf0 --- trap 0, rip = 0, rsp = 0xffffff811c2f4cb0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100075 td 0xfffffe0008b26480 sched_switch() at sched_switch+0x1b4/frame 0xffffff811c2efa30 mi_switch() at mi_switch+0x238/frame 0xffffff811c2efa80 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811c2efac0 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff811c2efaf0 _sleep() at _sleep+0x29a/frame 0xffffff811c2efb80 buf_daemon() at buf_daemon+0x192/frame 0xffffff811c2efba0 fork_exit() at fork_exit+0x139/frame 0xffffff811c2efbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811c2efbf0 --- trap 0, rip = 0, rsp = 0xffffff811c2efcb0, rbp = 0 --- Tracing command pagezero pid 9 tid 100074 td 0xfffffe0008b26900 sched_switch() at sched_switch+0x1b4/frame 0xffffff811c2eaa30 mi_switch() at mi_switch+0x238/frame 0xffffff811c2eaa80 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811c2eaac0 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff811c2eaaf0 _sleep() at _sleep+0x29a/frame 0xffffff811c2eab80 vm_pagezero() at vm_pagezero+0x73/frame 0xffffff811c2eaba0 fork_exit() at fork_exit+0x139/frame 0xffffff811c2eabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811c2eabf0 --- trap 0, rip = 0, rsp = 0xffffff811c2eacb0, rbp = 0 --- Tracing command vmdaemon pid 8 tid 100073 td 0xfffffe0008b28000 sched_switch() at sched_switch+0x1b4/frame 0xffffff811c2e59e0 mi_switch() at mi_switch+0x238/frame 0xffffff811c2e5a30 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811c2e5a70 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811c2e5aa0 _sleep() at _sleep+0x3e9/frame 0xffffff811c2e5b30 vm_daemon() at vm_daemon+0x4d/frame 0xffffff811c2e5ba0 fork_exit() at fork_exit+0x139/frame 0xffffff811c2e5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811c2e5bf0 --- trap 0, rip = 0, rsp = 0xffffff811c2e5cb0, rbp = 0 --- Tracing command pagedaemon pid 7 tid 100072 td 0xfffffe0002fa1000 sched_switch() at sched_switch+0x1b4/frame 0xffffff811c2e0940 mi_switch() at mi_switch+0x238/frame 0xffffff811c2e0990 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811c2e09d0 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff811c2e0a00 _sleep() at _sleep+0x29a/frame 0xffffff811c2e0a90 vm_pageout() at vm_pageout+0xb8e/frame 0xffffff811c2e0ba0 fork_exit() at fork_exit+0x139/frame 0xffffff811c2e0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811c2e0bf0 --- trap 0, rip = 0, rsp = 0xffffff811c2e0cb0, rbp = 0 --- Tracing command xpt_thrd pid 6 tid 100071 td 0xfffffe0002fa1480 sched_switch() at sched_switch+0x1b4/frame 0xffffff811c15ba30 mi_switch() at mi_switch+0x238/frame 0xffffff811c15ba80 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811c15bac0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811c15baf0 _sleep() at _sleep+0x3e9/frame 0xffffff811c15bb80 xpt_scanner_thread() at xpt_scanner_thread+0xdd/frame 0xffffff811c15bba0 fork_exit() at fork_exit+0x139/frame 0xffffff811c15bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811c15bbf0 --- trap 0, rip = 0, rsp = 0xffffff811c15bcb0, rbp = 0 --- Tracing command sctp_iterator pid 5 tid 100070 td 0xfffffe0002fa1900 sched_switch() at sched_switch+0x1b4/frame 0xffffff811c156a40 mi_switch() at mi_switch+0x238/frame 0xffffff811c156a90 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811c156ad0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811c156b00 _sleep() at _sleep+0x3e9/frame 0xffffff811c156b90 sctp_iterator_thread() at sctp_iterator_thread+0x3f/frame 0xffffff811c156ba0 fork_exit() at fork_exit+0x139/frame 0xffffff811c156bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811c156bf0 --- trap 0, rip = 0, rsp = 0xffffff811c156cb0, rbp = 0 --- Tracing command fdc0 pid 4 tid 100065 td 0xfffffe0002fa7480 sched_switch() at sched_switch+0x1b4/frame 0xffffff811c138990 mi_switch() at mi_switch+0x238/frame 0xffffff811c1389e0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811c138a20 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff811c138a50 _sleep() at _sleep+0x29a/frame 0xffffff811c138ae0 fdc_thread() at fdc_thread+0x7f4/frame 0xffffff811c138ba0 fork_exit() at fork_exit+0x139/frame 0xffffff811c138bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811c138bf0 --- trap 0, rip = 0, rsp = 0xffffff811c138cb0, rbp = 0 --- Tracing command fw0_probe pid 3 tid 100063 td 0xfffffe0002fa8000 sched_switch() at sched_switch+0x1b4/frame 0xffffff811c120480 mi_switch() at mi_switch+0x238/frame 0xffffff811c1204d0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811c120510 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff811c120570 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff811c120590 _sleep() at _sleep+0x37d/frame 0xffffff811c120620 fw_bus_probe_thread() at fw_bus_probe_thread+0xca/frame 0xffffff811c120ba0 fork_exit() at fork_exit+0x139/frame 0xffffff811c120bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811c120bf0 --- trap 0, rip = 0, rsp = 0xffffff811c120cb0, rbp = 0 --- Tracing command usb pid 15 tid 100059 td 0xfffffe0002f80900 sched_switch() at sched_switch+0x1b4/frame 0xffffff811bdb5a50 mi_switch() at mi_switch+0x238/frame 0xffffff811bdb5aa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811bdb5ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811bdb5b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff811bdb5b70 usb_process() at usb_process+0x172/frame 0xffffff811bdb5ba0 fork_exit() at fork_exit+0x139/frame 0xffffff811bdb5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811bdb5bf0 --- trap 0, rip = 0, rsp = 0xffffff811bdb5cb0, rbp = 0 --- Tracing command usb pid 15 tid 100058 td 0xfffffe0002f87000 sched_switch() at sched_switch+0x1b4/frame 0xffffff811bdb0a50 mi_switch() at mi_switch+0x238/frame 0xffffff811bdb0aa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811bdb0ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811bdb0b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff811bdb0b70 usb_process() at usb_process+0x172/frame 0xffffff811bdb0ba0 fork_exit() at fork_exit+0x139/frame 0xffffff811bdb0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811bdb0bf0 --- trap 0, rip = 0, rsp = 0xffffff811bdb0cb0, rbp = 0 --- Tracing command usb pid 15 tid 100057 td 0xfffffe0002f87480 sched_switch() at sched_switch+0x1b4/frame 0xffffff811bdaba50 mi_switch() at mi_switch+0x238/frame 0xffffff811bdabaa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811bdabae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811bdabb10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff811bdabb70 usb_process() at usb_process+0x172/frame 0xffffff811bdabba0 fork_exit() at fork_exit+0x139/frame 0xffffff811bdabbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811bdabbf0 --- trap 0, rip = 0, rsp = 0xffffff811bdabcb0, rbp = 0 --- Tracing command usb pid 15 tid 100056 td 0xfffffe0002f87900 sched_switch() at sched_switch+0x1b4/frame 0xffffff811bda6a50 mi_switch() at mi_switch+0x238/frame 0xffffff811bda6aa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811bda6ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811bda6b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff811bda6b70 usb_process() at usb_process+0x172/frame 0xffffff811bda6ba0 fork_exit() at fork_exit+0x139/frame 0xffffff811bda6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811bda6bf0 --- trap 0, rip = 0, rsp = 0xffffff811bda6cb0, rbp = 0 --- Tracing command usb pid 15 tid 100054 td 0xfffffe0002f88480 sched_switch() at sched_switch+0x1b4/frame 0xffffff811bc19a50 mi_switch() at mi_switch+0x238/frame 0xffffff811bc19aa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811bc19ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811bc19b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff811bc19b70 usb_process() at usb_process+0x172/frame 0xffffff811bc19ba0 fork_exit() at fork_exit+0x139/frame 0xffffff811bc19bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811bc19bf0 --- trap 0, rip = 0, rsp = 0xffffff811bc19cb0, rbp = 0 --- Tracing command usb pid 15 tid 100053 td 0xfffffe0002f88900 sched_switch() at sched_switch+0x1b4/frame 0xffffff811bc14a50 mi_switch() at mi_switch+0x238/frame 0xffffff811bc14aa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811bc14ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811bc14b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff811bc14b70 usb_process() at usb_process+0x172/frame 0xffffff811bc14ba0 fork_exit() at fork_exit+0x139/frame 0xffffff811bc14bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811bc14bf0 --- trap 0, rip = 0, rsp = 0xffffff811bc14cb0, rbp = 0 --- Tracing command usb pid 15 tid 100052 td 0xfffffe0002f89000 sched_switch() at sched_switch+0x1b4/frame 0xffffff811bc0fa50 mi_switch() at mi_switch+0x238/frame 0xffffff811bc0faa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811bc0fae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811bc0fb10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff811bc0fb70 usb_process() at usb_process+0x172/frame 0xffffff811bc0fba0 fork_exit() at fork_exit+0x139/frame 0xffffff811bc0fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811bc0fbf0 --- trap 0, rip = 0, rsp = 0xffffff811bc0fcb0, rbp = 0 --- Tracing command usb pid 15 tid 100051 td 0xfffffe0002f89480 sched_switch() at sched_switch+0x1b4/frame 0xffffff811bc0aa50 mi_switch() at mi_switch+0x238/frame 0xffffff811bc0aaa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811bc0aae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811bc0ab10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff811bc0ab70 usb_process() at usb_process+0x172/frame 0xffffff811bc0aba0 fork_exit() at fork_exit+0x139/frame 0xffffff811bc0abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811bc0abf0 --- trap 0, rip = 0, rsp = 0xffffff811bc0acb0, rbp = 0 --- Tracing command usb pid 15 tid 100050 td 0xfffffe0002f89900 sched_switch() at sched_switch+0x1b4/frame 0xffffff811bbc1a50 mi_switch() at mi_switch+0x238/frame 0xffffff811bbc1aa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811bbc1ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811bbc1b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff811bbc1b70 usb_process() at usb_process+0x172/frame 0xffffff811bbc1ba0 fork_exit() at fork_exit+0x139/frame 0xffffff811bbc1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811bbc1bf0 --- trap 0, rip = 0, rsp = 0xffffff811bbc1cb0, rbp = 0 --- Tracing command usb pid 15 tid 100049 td 0xfffffe0002f7a000 sched_switch() at sched_switch+0x1b4/frame 0xffffff811bbbca50 mi_switch() at mi_switch+0x238/frame 0xffffff811bbbcaa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811bbbcae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811bbbcb10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff811bbbcb70 usb_process() at usb_process+0x172/frame 0xffffff811bbbcba0 fork_exit() at fork_exit+0x139/frame 0xffffff811bbbcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811bbbcbf0 --- trap 0, rip = 0, rsp = 0xffffff811bbbccb0, rbp = 0 --- Tracing command usb pid 15 tid 100048 td 0xfffffe0002f7a480 sched_switch() at sched_switch+0x1b4/frame 0xffffff811bbb7a50 mi_switch() at mi_switch+0x238/frame 0xffffff811bbb7aa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811bbb7ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811bbb7b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff811bbb7b70 usb_process() at usb_process+0x172/frame 0xffffff811bbb7ba0 fork_exit() at fork_exit+0x139/frame 0xffffff811bbb7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811bbb7bf0 --- trap 0, rip = 0, rsp = 0xffffff811bbb7cb0, rbp = 0 --- Tracing command usb pid 15 tid 100047 td 0xfffffe0002f7a900 sched_switch() at sched_switch+0x1b4/frame 0xffffff811bbb2a50 mi_switch() at mi_switch+0x238/frame 0xffffff811bbb2aa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811bbb2ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811bbb2b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff811bbb2b70 usb_process() at usb_process+0x172/frame 0xffffff811bbb2ba0 fork_exit() at fork_exit+0x139/frame 0xffffff811bbb2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811bbb2bf0 --- trap 0, rip = 0, rsp = 0xffffff811bbb2cb0, rbp = 0 --- Tracing command usb pid 15 tid 100046 td 0xfffffe0002f7d000 sched_switch() at sched_switch+0x1b4/frame 0xffffff811bb69a50 mi_switch() at mi_switch+0x238/frame 0xffffff811bb69aa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811bb69ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811bb69b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff811bb69b70 usb_process() at usb_process+0x172/frame 0xffffff811bb69ba0 fork_exit() at fork_exit+0x139/frame 0xffffff811bb69bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811bb69bf0 --- trap 0, rip = 0, rsp = 0xffffff811bb69cb0, rbp = 0 --- Tracing command usb pid 15 tid 100045 td 0xfffffe0002f7d480 sched_switch() at sched_switch+0x1b4/frame 0xffffff811bb64a50 mi_switch() at mi_switch+0x238/frame 0xffffff811bb64aa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811bb64ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811bb64b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff811bb64b70 usb_process() at usb_process+0x172/frame 0xffffff811bb64ba0 fork_exit() at fork_exit+0x139/frame 0xffffff811bb64bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811bb64bf0 --- trap 0, rip = 0, rsp = 0xffffff811bb64cb0, rbp = 0 --- Tracing command usb pid 15 tid 100044 td 0xfffffe0002f7d900 sched_switch() at sched_switch+0x1b4/frame 0xffffff811bb5fa50 mi_switch() at mi_switch+0x238/frame 0xffffff811bb5faa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811bb5fae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811bb5fb10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff811bb5fb70 usb_process() at usb_process+0x172/frame 0xffffff811bb5fba0 fork_exit() at fork_exit+0x139/frame 0xffffff811bb5fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811bb5fbf0 --- trap 0, rip = 0, rsp = 0xffffff811bb5fcb0, rbp = 0 --- Tracing command usb pid 15 tid 100043 td 0xfffffe0002f7f000 sched_switch() at sched_switch+0x1b4/frame 0xffffff811bb5aa50 mi_switch() at mi_switch+0x238/frame 0xffffff811bb5aaa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811bb5aae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811bb5ab10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff811bb5ab70 usb_process() at usb_process+0x172/frame 0xffffff811bb5aba0 fork_exit() at fork_exit+0x139/frame 0xffffff811bb5abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811bb5abf0 --- trap 0, rip = 0, rsp = 0xffffff811bb5acb0, rbp = 0 --- Tracing command usb pid 15 tid 100041 td 0xfffffe0002f7f900 sched_switch() at sched_switch+0x1b4/frame 0xffffff811bb0ca50 mi_switch() at mi_switch+0x238/frame 0xffffff811bb0caa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811bb0cae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811bb0cb10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff811bb0cb70 usb_process() at usb_process+0x172/frame 0xffffff811bb0cba0 fork_exit() at fork_exit+0x139/frame 0xffffff811bb0cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811bb0cbf0 --- trap 0, rip = 0, rsp = 0xffffff811bb0ccb0, rbp = 0 --- Tracing command usb pid 15 tid 100040 td 0xfffffe0002f80000 sched_switch() at sched_switch+0x1b4/frame 0xffffff811bb07a50 mi_switch() at mi_switch+0x238/frame 0xffffff811bb07aa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811bb07ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811bb07b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff811bb07b70 usb_process() at usb_process+0x172/frame 0xffffff811bb07ba0 fork_exit() at fork_exit+0x139/frame 0xffffff811bb07bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811bb07bf0 --- trap 0, rip = 0, rsp = 0xffffff811bb07cb0, rbp = 0 --- Tracing command usb pid 15 tid 100039 td 0xfffffe0002e8d000 sched_switch() at sched_switch+0x1b4/frame 0xffffff811bb02a50 mi_switch() at mi_switch+0x238/frame 0xffffff811bb02aa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811bb02ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811bb02b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff811bb02b70 usb_process() at usb_process+0x172/frame 0xffffff811bb02ba0 fork_exit() at fork_exit+0x139/frame 0xffffff811bb02bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811bb02bf0 --- trap 0, rip = 0, rsp = 0xffffff811bb02cb0, rbp = 0 --- Tracing command usb pid 15 tid 100038 td 0xfffffe0002e8d480 sched_switch() at sched_switch+0x1b4/frame 0xffffff811bafda50 mi_switch() at mi_switch+0x238/frame 0xffffff811bafdaa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811bafdae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811bafdb10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff811bafdb70 usb_process() at usb_process+0x172/frame 0xffffff811bafdba0 fork_exit() at fork_exit+0x139/frame 0xffffff811bafdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811bafdbf0 --- trap 0, rip = 0, rsp = 0xffffff811bafdcb0, rbp = 0 --- Tracing command usb pid 15 tid 100036 td 0xfffffe0002e8e000 sched_switch() at sched_switch+0x1b4/frame 0xffffff811baafa50 mi_switch() at mi_switch+0x238/frame 0xffffff811baafaa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811baafae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811baafb10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff811baafb70 usb_process() at usb_process+0x172/frame 0xffffff811baafba0 fork_exit() at fork_exit+0x139/frame 0xffffff811baafbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811baafbf0 --- trap 0, rip = 0, rsp = 0xffffff811baafcb0, rbp = 0 --- Tracing command usb pid 15 tid 100035 td 0xfffffe0002e8e480 sched_switch() at sched_switch+0x1b4/frame 0xffffff811baaaa50 mi_switch() at mi_switch+0x238/frame 0xffffff811baaaaa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811baaaae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811baaab10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff811baaab70 usb_process() at usb_process+0x172/frame 0xffffff811baaaba0 fork_exit() at fork_exit+0x139/frame 0xffffff811baaabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811baaabf0 --- trap 0, rip = 0, rsp = 0xffffff811baaacb0, rbp = 0 --- Tracing command usb pid 15 tid 100034 td 0xfffffe0002e8e900 sched_switch() at sched_switch+0x1b4/frame 0xffffff811baa5a50 mi_switch() at mi_switch+0x238/frame 0xffffff811baa5aa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811baa5ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811baa5b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff811baa5b70 usb_process() at usb_process+0x172/frame 0xffffff811baa5ba0 fork_exit() at fork_exit+0x139/frame 0xffffff811baa5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811baa5bf0 --- trap 0, rip = 0, rsp = 0xffffff811baa5cb0, rbp = 0 --- Tracing command usb pid 15 tid 100033 td 0xfffffe0002e8f000 sched_switch() at sched_switch+0x1b4/frame 0xffffff811baa0a50 mi_switch() at mi_switch+0x238/frame 0xffffff811baa0aa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811baa0ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811baa0b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff811baa0b70 usb_process() at usb_process+0x172/frame 0xffffff811baa0ba0 fork_exit() at fork_exit+0x139/frame 0xffffff811baa0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811baa0bf0 --- trap 0, rip = 0, rsp = 0xffffff811baa0cb0, rbp = 0 --- Tracing command ctl_thrd pid 2 tid 100028 td 0xfffffe0002b19000 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002d03f0 mi_switch() at mi_switch+0x238/frame 0xffffff80002d0440 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff80002d0480 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff80002d04b0 _sleep() at _sleep+0x3e9/frame 0xffffff80002d0540 ctl_work_thread() at ctl_work_thread+0x1ce8/frame 0xffffff80002d0ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002d0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002d0bf0 --- trap 0, rip = 0, rsp = 0xffffff80002d0cb0, rbp = 0 --- Tracing command yarrow pid 14 tid 100017 td 0xfffffe0002981900 sched_switch() at sched_switch+0x1b4/frame 0xffffff8000298a10 mi_switch() at mi_switch+0x238/frame 0xffffff8000298a60 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8000298aa0 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff8000298ad0 _sleep() at _sleep+0x29a/frame 0xffffff8000298b60 random_kthread() at random_kthread+0x1ad/frame 0xffffff8000298ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000298bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000298bf0 --- trap 0, rip = 0, rsp = 0xffffff8000298cb0, rbp = 0 --- Tracing command geom pid 13 tid 100015 td 0xfffffe000296e000 sched_switch() at sched_switch+0x1b4/frame 0xffffff800028e9f0 mi_switch() at mi_switch+0x238/frame 0xffffff800028ea40 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff800028ea80 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff800028eab0 _sleep() at _sleep+0x3e9/frame 0xffffff800028eb40 g_io_schedule_down() at g_io_schedule_down+0x26d/frame 0xffffff800028eb90 g_down_procbody() at g_down_procbody+0x7c/frame 0xffffff800028eba0 fork_exit() at fork_exit+0x139/frame 0xffffff800028ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800028ebf0 --- trap 0, rip = 0, rsp = 0xffffff800028ecb0, rbp = 0 --- Tracing command geom pid 13 tid 100014 td 0xfffffe000296e480 sched_switch() at sched_switch+0x1b4/frame 0xffffff8000289a20 mi_switch() at mi_switch+0x238/frame 0xffffff8000289a70 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8000289ab0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8000289ae0 _sleep() at _sleep+0x3e9/frame 0xffffff8000289b70 g_io_schedule_up() at g_io_schedule_up+0x138/frame 0xffffff8000289b90 g_up_procbody() at g_up_procbody+0x7c/frame 0xffffff8000289ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000289bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000289bf0 --- trap 0, rip = 0, rsp = 0xffffff8000289cb0, rbp = 0 --- Tracing command geom pid 13 tid 100013 td 0xfffffe000296e900 sched_switch() at sched_switch+0x1b4/frame 0xffffff8000284a20 mi_switch() at mi_switch+0x238/frame 0xffffff8000284a70 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8000284ab0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8000284ae0 _sleep() at _sleep+0x3e9/frame 0xffffff8000284b70 g_run_events() at g_run_events+0x449/frame 0xffffff8000284ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000284bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000284bf0 --- trap 0, rip = 0, rsp = 0xffffff8000284cb0, rbp = 0 --- Tracing command intr pid 12 tid 100067 td 0xfffffe0002fa5900 sched_switch() at sched_switch+0x1b4/frame 0xffffff811c142b00 mi_switch() at mi_switch+0x238/frame 0xffffff811c142b50 ithread_loop() at ithread_loop+0x273/frame 0xffffff811c142ba0 fork_exit() at fork_exit+0x139/frame 0xffffff811c142bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811c142bf0 --- trap 0, rip = 0, rsp = 0xffffff811c142cb0, rbp = 0 --- Tracing command intr pid 12 tid 100066 td 0xfffffe0002fa7000 sched_switch() at sched_switch+0x1b4/frame 0xffffff811c13db00 mi_switch() at mi_switch+0x238/frame 0xffffff811c13db50 ithread_loop() at ithread_loop+0x273/frame 0xffffff811c13dba0 fork_exit() at fork_exit+0x139/frame 0xffffff811c13dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811c13dbf0 --- trap 0, rip = 0, rsp = 0xffffff811c13dcb0, rbp = 0 --- Tracing command intr pid 12 tid 100064 td 0xfffffe0002fa7900 sched_switch() at sched_switch+0x1b4/frame 0xffffff811c129b00 mi_switch() at mi_switch+0x238/frame 0xffffff811c129b50 ithread_loop() at ithread_loop+0x273/frame 0xffffff811c129ba0 fork_exit() at fork_exit+0x139/frame 0xffffff811c129bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811c129bf0 --- trap 0, rip = 0, rsp = 0xffffff811c129cb0, rbp = 0 --- Tracing command intr pid 12 tid 100061 td 0xfffffe0002fa8900 sched_switch() at sched_switch+0x1b4/frame 0xffffff811bdecb00 mi_switch() at mi_switch+0x238/frame 0xffffff811bdecb50 ithread_loop() at ithread_loop+0x273/frame 0xffffff811bdecba0 fork_exit() at fork_exit+0x139/frame 0xffffff811bdecbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811bdecbf0 --- trap 0, rip = 0, rsp = 0xffffff811bdeccb0, rbp = 0 --- Tracing command intr pid 12 tid 100060 td 0xfffffe0002f80480 sched_switch() at sched_switch+0x1b4/frame 0xffffff811bdddb00 mi_switch() at mi_switch+0x238/frame 0xffffff811bdddb50 ithread_loop() at ithread_loop+0x273/frame 0xffffff811bdddba0 fork_exit() at fork_exit+0x139/frame 0xffffff811bdddbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811bdddbf0 --- trap 0, rip = 0, rsp = 0xffffff811bdddcb0, rbp = 0 --- Tracing command intr pid 12 tid 100055 td 0xfffffe0002f88000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100042 td 0xfffffe0002f7f480 sched_switch() at sched_switch+0x1b4/frame 0xffffff811bb55b00 mi_switch() at mi_switch+0x238/frame 0xffffff811bb55b50 ithread_loop() at ithread_loop+0x273/frame 0xffffff811bb55ba0 fork_exit() at fork_exit+0x139/frame 0xffffff811bb55bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811bb55bf0 --- trap 0, rip = 0, rsp = 0xffffff811bb55cb0, rbp = 0 --- Tracing command intr pid 12 tid 100037 td 0xfffffe0002e8d900 sched_switch() at sched_switch+0x1b4/frame 0xffffff811baf8b00 mi_switch() at mi_switch+0x238/frame 0xffffff811baf8b50 ithread_loop() at ithread_loop+0x273/frame 0xffffff811baf8ba0 fork_exit() at fork_exit+0x139/frame 0xffffff811baf8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811baf8bf0 --- trap 0, rip = 0, rsp = 0xffffff811baf8cb0, rbp = 0 --- Tracing command intr pid 12 tid 100032 td 0xfffffe0002e8f480 sched_switch() at sched_switch+0x1b4/frame 0xffffff811ba9bb00 mi_switch() at mi_switch+0x238/frame 0xffffff811ba9bb50 ithread_loop() at ithread_loop+0x273/frame 0xffffff811ba9bba0 fork_exit() at fork_exit+0x139/frame 0xffffff811ba9bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811ba9bbf0 --- trap 0, rip = 0, rsp = 0xffffff811ba9bcb0, rbp = 0 --- Tracing command intr pid 12 tid 100031 td 0xfffffe0002e8f900 sched_switch() at sched_switch+0x1b4/frame 0xffffff80003e6b00 mi_switch() at mi_switch+0x238/frame 0xffffff80003e6b50 ithread_loop() at ithread_loop+0x273/frame 0xffffff80003e6ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80003e6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80003e6bf0 --- trap 0, rip = 0, rsp = 0xffffff80003e6cb0, rbp = 0 --- Tracing command intr pid 12 tid 100030 td 0xfffffe0002983480 sched_switch() at sched_switch+0x1b4/frame 0xffffff80003e1b00 mi_switch() at mi_switch+0x238/frame 0xffffff80003e1b50 ithread_loop() at ithread_loop+0x273/frame 0xffffff80003e1ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80003e1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80003e1bf0 --- trap 0, rip = 0, rsp = 0xffffff80003e1cb0, rbp = 0 --- Tracing command intr pid 12 tid 100029 td 0xfffffe0002983900 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002d5b00 mi_switch() at mi_switch+0x238/frame 0xffffff80002d5b50 ithread_loop() at ithread_loop+0x273/frame 0xffffff80002d5ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002d5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002d5bf0 --- trap 0, rip = 0, rsp = 0xffffff80002d5cb0, rbp = 0 --- Tracing command intr pid 12 tid 100027 td 0xfffffe0002b19480 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002cbb00 mi_switch() at mi_switch+0x238/frame 0xffffff80002cbb50 ithread_loop() at ithread_loop+0x273/frame 0xffffff80002cbba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002cbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002cbbf0 --- trap 0, rip = 0, rsp = 0xffffff80002cbcb0, rbp = 0 --- Tracing command intr pid 12 tid 100026 td 0xfffffe0002b19900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100023 td 0xfffffe0002b1a900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100022 td 0xfffffe0002980000 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002b2b00 mi_switch() at mi_switch+0x238/frame 0xffffff80002b2b50 ithread_loop() at ithread_loop+0x273/frame 0xffffff80002b2ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002b2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002b2bf0 --- trap 0, rip = 0, rsp = 0xffffff80002b2cb0, rbp = 0 --- Tracing command intr pid 12 tid 100012 td 0xfffffe000296f000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100011 td 0xfffffe000296f480 sched_switch() at sched_switch+0x1b4/frame 0xffffff800027ab00 mi_switch() at mi_switch+0x238/frame 0xffffff800027ab50 ithread_loop() at ithread_loop+0x273/frame 0xffffff800027aba0 fork_exit() at fork_exit+0x139/frame 0xffffff800027abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800027abf0 --- trap 0, rip = 0, rsp = 0xffffff800027acb0, rbp = 0 --- Tracing command intr pid 12 tid 100010 td 0xfffffe000296f900 sched_switch() at sched_switch+0x1b4/frame 0xffffff8000275b00 mi_switch() at mi_switch+0x238/frame 0xffffff8000275b50 ithread_loop() at ithread_loop+0x273/frame 0xffffff8000275ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000275bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000275bf0 --- trap 0, rip = 0, rsp = 0xffffff8000275cb0, rbp = 0 --- Tracing command intr pid 12 tid 100009 td 0xfffffe0002956480 sched_switch() at sched_switch+0x1b4/frame 0xffffff8000270b00 mi_switch() at mi_switch+0x238/frame 0xffffff8000270b50 ithread_loop() at ithread_loop+0x273/frame 0xffffff8000270ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000270bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000270bf0 --- trap 0, rip = 0, rsp = 0xffffff8000270cb0, rbp = 0 --- Tracing command intr pid 12 tid 100008 td 0xfffffe0002956900 sched_switch() at sched_switch+0x1b4/frame 0xffffff800026bb00 mi_switch() at mi_switch+0x238/frame 0xffffff800026bb50 ithread_loop() at ithread_loop+0x273/frame 0xffffff800026bba0 fork_exit() at fork_exit+0x139/frame 0xffffff800026bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800026bbf0 --- trap 0, rip = 0, rsp = 0xffffff800026bcb0, rbp = 0 --- Tracing command intr pid 12 tid 100007 td 0xfffffe0002960000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8000266b00 mi_switch() at mi_switch+0x238/frame 0xffffff8000266b50 ithread_loop() at ithread_loop+0x273/frame 0xffffff8000266ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000266bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000266bf0 --- trap 0, rip = 0, rsp = 0xffffff8000266cb0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe0002960480 sched_switch() at sched_switch+0x1b4/frame 0xffffff8000261ac0 mi_switch() at mi_switch+0x238/frame 0xffffff8000261b10 sched_idletd() at sched_idletd+0x1f5/frame 0xffffff8000261ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000261bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000261bf0 --- trap 0, rip = 0, rsp = 0xffffff8000261cb0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe0002960900 cpustop_handler() at cpustop_handler+0x2c/frame 0xffffff800023ad00 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xffffff800023ad20 trap() at trap+0x325/frame 0xffffff800023af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff800023af20 --- trap 0x13, rip = 0xffffffff80c75666, rsp = 0xffffff800023afe0, rbp = 0xffffff800025ca90 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff800025ca90 acpi_cpu_idle() at acpi_cpu_idle+0x2ac/frame 0xffffff800025cad0 cpu_idle_acpi() at cpu_idle_acpi+0x45/frame 0xffffff800025caf0 cpu_idle() at cpu_idle+0x78/frame 0xffffff800025cb10 sched_idletd() at sched_idletd+0x186/frame 0xffffff800025cba0 fork_exit() at fork_exit+0x139/frame 0xffffff800025cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800025cbf0 --- trap 0, rip = 0, rsp = 0xffffff800025ccb0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe0002955000 cpustop_handler() at cpustop_handler+0x2c/frame 0xffffff8000233d00 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xffffff8000233d20 trap() at trap+0x325/frame 0xffffff8000233f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff8000233f20 --- trap 0x13, rip = 0xffffffff80c75666, rsp = 0xffffff8000233fe0, rbp = 0xffffff8000257a90 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000257a90 acpi_cpu_idle() at acpi_cpu_idle+0x2ac/frame 0xffffff8000257ad0 cpu_idle_acpi() at cpu_idle_acpi+0x45/frame 0xffffff8000257af0 cpu_idle() at cpu_idle+0x78/frame 0xffffff8000257b10 sched_idletd() at sched_idletd+0x186/frame 0xffffff8000257ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000257bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000257bf0 --- trap 0, rip = 0, rsp = 0xffffff8000257cb0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffffe0002955480 cpustop_handler() at cpustop_handler+0x2c/frame 0xffffffff8157ef60 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xffffffff8157ef80 trap() at trap+0x325/frame 0xffffffff8157f180 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff8157f180 --- trap 0x13, rip = 0xffffffff80c75666, rsp = 0xffffffff8157f240, rbp = 0xffffff8000252a90 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000252a90 acpi_cpu_idle() at acpi_cpu_idle+0x2ac/frame 0xffffff8000252ad0 cpu_idle_acpi() at cpu_idle_acpi+0x45/frame 0xffffff8000252af0 cpu_idle() at cpu_idle+0x78/frame 0xffffff8000252b10 sched_idletd() at sched_idletd+0x186/frame 0xffffff8000252ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000252bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000252bf0 --- trap 0, rip = 0, rsp = 0xffffff8000252cb0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffffe0002955900 sched_switch() at sched_switch+0x1b4/frame 0xffffff800024d650 mi_switch() at mi_switch+0x238/frame 0xffffff800024d6a0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff800024d6e0 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff800024d740 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff800024d760 _sleep() at _sleep+0x37d/frame 0xffffff800024d7f0 kern_wait6() at kern_wait6+0x5b3/frame 0xffffff800024d890 kern_wait() at kern_wait+0x12d/frame 0xffffff800024da10 sys_wait4() at sys_wait4+0x35/frame 0xffffff800024dad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff800024dbf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff800024dbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x41241a, rsp = 0x7fffffffd798, rbp = 0x91 --- Tracing command audit pid 10 tid 100001 td 0xfffffe0002956000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8000248a00 mi_switch() at mi_switch+0x238/frame 0xffffff8000248a50 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8000248a90 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8000248ac0 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8000248b20 audit_worker() at audit_worker+0x77/frame 0xffffff8000248ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000248bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000248bf0 --- trap 0, rip = 0, rsp = 0xffffff8000248cb0, rbp = 0 --- Tracing command kernel pid 0 tid 100741 td 0xfffffe00bd53f900 sched_switch() at sched_switch+0x1b4/frame 0xffffff8125adaa20 mi_switch() at mi_switch+0x238/frame 0xffffff8125adaa70 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8125adaab0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8125adaae0 _sleep() at _sleep+0x3e9/frame 0xffffff8125adab70 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xffffff8125adaba0 fork_exit() at fork_exit+0x139/frame 0xffffff8125adabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8125adabf0 --- trap 0, rip = 0, rsp = 0xffffff8125adacb0, rbp = 0 --- Tracing command kernel pid 0 tid 100729 td 0xfffffe002d6b1000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8125a53a20 mi_switch() at mi_switch+0x238/frame 0xffffff8125a53a70 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8125a53ab0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8125a53ae0 _sleep() at _sleep+0x3e9/frame 0xffffff8125a53b70 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xffffff8125a53ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8125a53bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8125a53bf0 --- trap 0, rip = 0, rsp = 0xffffff8125a53cb0, rbp = 0 --- Tracing command kernel pid 0 tid 100575 td 0xfffffe00664e5900 sched_switch() at sched_switch+0x1b4/frame 0xffffff81259fea20 mi_switch() at mi_switch+0x238/frame 0xffffff81259fea70 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81259feab0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff81259feae0 _sleep() at _sleep+0x3e9/frame 0xffffff81259feb70 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xffffff81259feba0 fork_exit() at fork_exit+0x139/frame 0xffffff81259febf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff81259febf0 --- trap 0, rip = 0, rsp = 0xffffff81259fecb0, rbp = 0 --- Tracing command kernel pid 0 tid 100547 td 0xfffffe00777e7000 sched_switch() at sched_switch+0x1b4/frame 0xffffff81259bda20 mi_switch() at mi_switch+0x238/frame 0xffffff81259bda70 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81259bdab0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff81259bdae0 _sleep() at _sleep+0x3e9/frame 0xffffff81259bdb70 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xffffff81259bdba0 fork_exit() at fork_exit+0x139/frame 0xffffff81259bdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff81259bdbf0 --- trap 0, rip = 0, rsp = 0xffffff81259bdcb0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffffe0002fa5000 sched_switch() at sched_switch+0x1b4/frame 0xffffff811c150a10 mi_switch() at mi_switch+0x238/frame 0xffffff811c150a60 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811c150aa0 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff811c150ad0 _sleep() at _sleep+0x29a/frame 0xffffff811c150b60 deadlkres() at deadlkres+0x2b7/frame 0xffffff811c150ba0 fork_exit() at fork_exit+0x139/frame 0xffffff811c150bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811c150bf0 --- trap 0, rip = 0, rsp = 0xffffff811c150cb0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffffe0002fa5480 sched_switch() at sched_switch+0x1b4/frame 0xffffff811c14ba40 mi_switch() at mi_switch+0x238/frame 0xffffff811c14ba90 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811c14bad0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811c14bb00 msleep_spin() at msleep_spin+0x22d/frame 0xffffff811c14bb70 taskqueue_thread_loop() at taskqueue_thread_loop+0x6f/frame 0xffffff811c14bba0 fork_exit() at fork_exit+0x139/frame 0xffffff811c14bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811c14bbf0 --- trap 0, rip = 0, rsp = 0xffffff811c14bcb0, rbp = 0 --- Tracing command kernel pid 0 tid 100062 td 0xfffffe0002fa8480 sched_switch() at sched_switch+0x1b4/frame 0xffffff811c05ba40 mi_switch() at mi_switch+0x238/frame 0xffffff811c05ba90 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811c05bad0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811c05bb00 msleep_spin() at msleep_spin+0x22d/frame 0xffffff811c05bb70 taskqueue_thread_loop() at taskqueue_thread_loop+0x6f/frame 0xffffff811c05bba0 fork_exit() at fork_exit+0x139/frame 0xffffff811c05bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811c05bbf0 --- trap 0, rip = 0, rsp = 0xffffff811c05bcb0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffffe0002b1a000 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002c1a20 mi_switch() at mi_switch+0x238/frame 0xffffff80002c1a70 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff80002c1ab0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff80002c1ae0 _sleep() at _sleep+0x3e9/frame 0xffffff80002c1b70 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xffffff80002c1ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002c1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002c1bf0 --- trap 0, rip = 0, rsp = 0xffffff80002c1cb0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffffe0002b1a480 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002bca20 mi_switch() at mi_switch+0x238/frame 0xffffff80002bca70 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff80002bcab0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff80002bcae0 _sleep() at _sleep+0x3e9/frame 0xffffff80002bcb70 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xffffff80002bcba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002bcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002bcbf0 --- trap 0, rip = 0, rsp = 0xffffff80002bccb0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffffe0002980480 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002ada40 mi_switch() at mi_switch+0x238/frame 0xffffff80002ada90 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff80002adad0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff80002adb00 msleep_spin() at msleep_spin+0x22d/frame 0xffffff80002adb70 taskqueue_thread_loop() at taskqueue_thread_loop+0x6f/frame 0xffffff80002adba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002adbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002adbf0 --- trap 0, rip = 0, rsp = 0xffffff80002adcb0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffffe0002980900 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002a8a40 mi_switch() at mi_switch+0x238/frame 0xffffff80002a8a90 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff80002a8ad0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff80002a8b00 msleep_spin() at msleep_spin+0x22d/frame 0xffffff80002a8b70 taskqueue_thread_loop() at taskqueue_thread_loop+0x6f/frame 0xffffff80002a8ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002a8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002a8bf0 --- trap 0, rip = 0, rsp = 0xffffff80002a8cb0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffffe0002981000 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002a3a40 mi_switch() at mi_switch+0x238/frame 0xffffff80002a3a90 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff80002a3ad0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff80002a3b00 msleep_spin() at msleep_spin+0x22d/frame 0xffffff80002a3b70 taskqueue_thread_loop() at taskqueue_thread_loop+0x6f/frame 0xffffff80002a3ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002a3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002a3bf0 --- trap 0, rip = 0, rsp = 0xffffff80002a3cb0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffffe0002981480 sched_switch() at sched_switch+0x1b4/frame 0xffffff800029ea20 mi_switch() at mi_switch+0x238/frame 0xffffff800029ea70 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff800029eab0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff800029eae0 _sleep() at _sleep+0x3e9/frame 0xffffff800029eb70 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xffffff800029eba0 fork_exit() at fork_exit+0x139/frame 0xffffff800029ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800029ebf0 --- trap 0, rip = 0, rsp = 0xffffff800029ecb0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffffe0002983000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8000293a20 mi_switch() at mi_switch+0x238/frame 0xffffff8000293a70 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8000293ab0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8000293ae0 _sleep() at _sleep+0x3e9/frame 0xffffff8000293b70 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xffffff8000293ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000293bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000293bf0 --- trap 0, rip = 0, rsp = 0xffffff8000293cb0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff813616d0 sched_switch() at sched_switch+0x1b4/frame 0xffffffff818fbb00 mi_switch() at mi_switch+0x238/frame 0xffffffff818fbb50 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffffff818fbb90 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffffff818fbbc0 _sleep() at _sleep+0x29a/frame 0xffffffff818fbc50 scheduler() at scheduler+0x2b0/frame 0xffffffff818fbc90 mi_startup() at mi_startup+0x77/frame 0xffffffff818fbcb0 btext() at btext+0x2c db:0:allt> call doadump Dumping 495 out of 3944 MB:..4%..13%..23%..33%..42%..52%..62%..72%..81%..91% Dump complete = 0 db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 3 (kgdb) bt #0 doadump (textdump=0x2954000) at ../../../kern/kern_shutdown.c:263 #1 0xffffffff8034254c in db_fncall (dummy1=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:578 #2 0xffffffff803427fd in db_command (last_cmdp=0xffffffff813249e0, cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:449 #3 0xffffffff80347393 in db_script_exec (scriptname=0xffffffff81325280 "doadump", warnifnotfound=0x1) at ../../../ddb/db_script.c:302 #4 0xffffffff80342881 in db_command (last_cmdp=0xffffffff813249e0, cmd_table=, dopager=0x1) at ../../../ddb/db_command.c:449 #5 0xffffffff80342ad0 in db_command_loop () at ../../../ddb/db_command.c:502 #6 0xffffffff80344c49 in db_trap (type=, code=) at ../../../ddb/db_main.c:231 #7 0xffffffff80928ba8 in kdb_trap (type=0xc, code=0x0, tf=0xffffff81259d1220) at ../../../kern/subr_kdb.c:654 #8 0xffffffff80c90c9d in trap_fatal (frame=0xffffff81259d1220, eva=) at ../../../amd64/amd64/trap.c:867 #9 0xffffffff80c90e5a in trap_pfault (frame=0xffffff81259d1220, usermode=0x0) at ../../../amd64/amd64/trap.c:789 #10 0xffffffff80c9159a in trap (frame=0xffffff81259d1220) at ../../../amd64/amd64/trap.c:463 #11 0xffffffff80c7a263 in calltrap () at ../../../amd64/amd64/exception.S:228 #12 0xffffffff80c85ca9 in pmap_qenter (sva=0x0, ma=0xffffff80efc91240, count=) at ../../../amd64/amd64/pmap.c:1403 #13 0xffffffff809778d5 in bpmap_qenter (bp=0xffffff80efc91068) at ../../../kern/vfs_bio.c:729 #14 0xffffffff8097c49d in getblk (vp=0xfffffe004ddfa510, blkno=0xfffffffffffffff4, size=0x8000, slpflag=0x0, slptimeo=0x0, flags=0x0) at ../../../kern/vfs_bio.c:2877 #15 0xffffffff8097ce30 in breadn_flags (vp=0xfffffe004ddfa510, blkno=, size=, rablkno=0x0, rabsize=0x0, cnt=0x0, cred=0x0, flags=0x0, bpp=0xffffff81259d15d0) at ../../../kern/vfs_bio.c:909 #16 0xffffffff80b1c8a6 in ffs_balloc_ufs2 (vp=0xfffffe004ddfa510, startoffset=, size=, cred=0xfffffe0010324d00, flags=0x10000, bpp=0xffffff81259d16a8) at ../../../ufs/ffs/ffs_balloc.c:834 #17 0xffffffff80b4ecd8 in ufs_direnter (dvp=0xfffffe004ddfa510, tvp=0xfffffe010a1f3798, dirp=0xffffff81259d1790, cnp=, newdirbp=0xffffff80ef35dd68, isrename=0x0) at ../../../ufs/ufs/ufs_lookup.c:912 #18 0xffffffff80b57d5a in ufs_mkdir (ap=0xffffff81259d1a70) at ../../../ufs/ufs/ufs_vnops.c:1999 #19 0xffffffff80d22f0a in VOP_MKDIR_APV (vop=0xffffffff812f4f60, a=0xffffff81259d1a70) at vnode_if.c:1536 #20 0xffffffff809995a2 in kern_mkdirat (td=0xfffffe002259e000, fd=0xffffff9c, path=0x7fffffffd620
, segflg=, mode=) at vnode_if.h:665 #21 0xffffffff80c902c3 in amd64_syscall (td=0xfffffe002259e000, traced=0x0) at subr_syscall.c:135 #22 0xffffffff80c7a547 in Xfast_syscall () at ../../../amd64/amd64/exception.S:387 #23 0x0000000800923bfa in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb) f 12 #12 0xffffffff80c85ca9 in pmap_qenter (sva=0x0, ma=0xffffff80efc91240, count=) at ../../../amd64/amd64/pmap.c:1403 1403 pa = VM_PAGE_TO_PHYS(m) | pmap_cache_bits(m->md.pat_mode, 0); (kgdb) l 1398 oldpte = 0; 1399 pte = vtopte(sva); 1400 endpte = pte + count; 1401 while (pte < endpte) { 1402 m = *ma++; 1403 pa = VM_PAGE_TO_PHYS(m) | pmap_cache_bits(m->md.pat_mode, 0); 1404 if ((*pte & (PG_FRAME | PG_PTE_CACHE)) != pa) { 1405 oldpte |= *pte; 1406 pte_store(pte, pa | PG_G | PG_RW | PG_V); 1407 } (kgdb) info loc endpte = (pt_entry_t *) 0xffff800000000040 oldpte = 0x0 pa = pte = (pt_entry_t *) 0xffff800000000000 m = (kgdb) f 13 #13 0xffffffff809778d5 in bpmap_qenter (bp=0xffffff80efc91068) at ../../../kern/vfs_bio.c:729 729 pmap_qenter((vm_offset_t)bp->b_data, bp->b_pages, bp->b_npages); (kgdb) info loc No locals. (kgdb) p *bp $1 = {b_bufobj = 0xfffffe004ddfa6c0, b_bcount = 0x8000, b_caller1 = 0x0, b_data = 0x0, b_error = 0x0, b_iocmd = 0x2, b_ioflags = 0x0, b_iooffset = 0x589da0000, b_resid = 0x0, b_iodone = 0, b_blkno = 0x10600, b_offset = 0xfffffffffffa0000, b_bobufs = { tqe_next = 0xffffff80efd0f668, tqe_prev = 0xfffffe004ddfa700}, b_left = 0x0, b_right = 0xffffff80efd0f668, b_vflags = 0x0, b_freelist = {tqe_next = 0x0, tqe_prev = 0xffffff80ef73eae0}, b_qindex = 0x2, b_flags = 0xa00000a0, b_xflags = 0x1, b_lock = {lock_object = {lo_name = 0xffffffff80f084ad "bufwait", lo_flags = 0x5730000, lo_data = 0x0, lo_witness = 0xffffff80006cd380}, lk_lock = 0xfffffe002259e000, lk_exslpfail = 0x0, lk_timo = 0x0, lk_pri = 0x60, lk_stack = {depth = 0xa, pcs = { 0xffffffff808d27b1, 0xffffffff8097c1bb, 0xffffffff8097ce30, 0xffffffff80b1c8a6, 0xffffffff80b4ecd8, 0xffffffff80b57d5a, 0xffffffff80d22f0a, 0xffffffff809995a2, 0xffffffff80c902c3, 0xffffffff80c7a547, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}}}, b_bufsize = 0x8000, b_runningbufspace = 0x0, b_kvabase = 0x0, b_kvaalloc = 0x0, b_kvasize = 0x8000, b_lblkno = 0xfffffffffffffff4, b_vp = 0xfffffe004ddfa510, b_dirtyoff = 0x0, b_dirtyend = 0x0, b_rcred = 0x0, b_wcred = 0x0, b_saveaddr = 0x0, b_pager = {pg_reqpage = 0x0}, b_cluster = {cluster_head = {tqh_first = 0xffffff80f0150068, tqh_last = 0xffffff80ef0e3128}, cluster_entry = {tqe_next = 0xffffff80f0150068, tqe_prev = 0xffffff80ef0e3128}}, b_pages = {0xfffffe00d57b6e58, 0xfffffe00d7971f20, 0xfffffe00d7971f98, 0xfffffe00d25f31f0, 0xfffffe00d25f3268, 0xfffffe00d06d9ee0, 0xfffffe00d06d9f58, 0xfffffe00d1186eb0, 0x0 }, b_npages = 0x8, b_dep = {lh_first = 0xfffffe0026926100}, b_fsprivate1 = 0x0, b_fsprivate2 = 0x0, b_fsprivate3 = 0x0, b_pin_count = 0x0} (kgdb) git diff master diff --git a/sys/amd64/amd64/pmap.c b/sys/amd64/amd64/pmap.c index 8e06ff9..e432d84 100644 --- a/sys/amd64/amd64/pmap.c +++ b/sys/amd64/amd64/pmap.c @@ -4216,6 +4216,30 @@ pmap_copy_page(vm_page_t msrc, vm_page_t mdst) pagecopy((void *)src, (void *)dst); } +void +pmap_copy_pages(vm_page_t ma[], vm_offset_t a_offset, vm_page_t mb[], + vm_offset_t b_offset, int xfersize) +{ + void *a_cp, *b_cp; + vm_offset_t a_pg_offset, b_pg_offset; + int cnt; + + while (xfersize > 0) { + a_pg_offset = a_offset & PAGE_MASK; + cnt = min(xfersize, PAGE_SIZE - a_pg_offset); + a_cp = (char *)PHYS_TO_DMAP(ma[a_offset >> PAGE_SHIFT]-> + phys_addr) + a_pg_offset; + b_pg_offset = b_offset & PAGE_MASK; + cnt = min(cnt, PAGE_SIZE - b_pg_offset); + b_cp = (char *)PHYS_TO_DMAP(mb[b_offset >> PAGE_SHIFT]-> + phys_addr) + b_pg_offset; + bcopy(a_cp, b_cp, cnt); + a_offset += cnt; + b_offset += cnt; + xfersize -= cnt; + } +} + /* * Returns true if the pmap's pv is one of the first * 16 pvs linked to from this page. This count may diff --git a/sys/cam/ata/ata_da.c b/sys/cam/ata/ata_da.c index 4252197..eef0a43 100644 --- a/sys/cam/ata/ata_da.c +++ b/sys/cam/ata/ata_da.c @@ -1167,6 +1167,7 @@ adaregister(struct cam_periph *periph, void *arg) ((softc->flags & ADA_FLAG_CAN_CFA) && !(softc->flags & ADA_FLAG_CAN_48BIT))) softc->disk->d_flags |= DISKFLAG_CANDELETE; + softc->disk->d_flags |= DISKFLAG_NOTMAPPED_BIO; strlcpy(softc->disk->d_descr, cgd->ident_data.model, MIN(sizeof(softc->disk->d_descr), sizeof(cgd->ident_data.model))); strlcpy(softc->disk->d_ident, cgd->ident_data.serial, @@ -1431,14 +1432,16 @@ adastart(struct cam_periph *periph, union ccb *start_ccb) return; } #endif - cam_fill_ataio(ataio, + cam_fill_ataio_U(ataio, ada_retry_count, adadone, bp->bio_cmd == BIO_READ ? CAM_DIR_IN : CAM_DIR_OUT, tag_code, bp->bio_data, + (bp->bio_flags & BIO_NOTMAPPED) ? bp->bio_ma : NULL, bp->bio_bcount, + bp->bio_ma_offset, ada_default_timeout*1000); if ((softc->flags & ADA_FLAG_CAN_NCQ) && tag_code) { diff --git a/sys/cam/cam_ccb.h b/sys/cam/cam_ccb.h index 1f12d91..6b9ca9f 100644 --- a/sys/cam/cam_ccb.h +++ b/sys/cam/cam_ccb.h @@ -42,6 +42,7 @@ #include #include +struct vm_page; /* General allocation length definitions for CCB structures */ #define IOCDBLEN CAM_MAX_CDBLEN /* Space for CDB bytes/pointer */ @@ -713,7 +714,9 @@ struct ccb_ataio { struct ata_cmd cmd; /* ATA command register set */ struct ata_res res; /* ATA result register set */ u_int8_t *data_ptr; /* Ptr to the data buf/SG list */ + struct vm_page **ma; u_int32_t dxfer_len; /* Data transfer length */ + int ma_offset; u_int32_t resid; /* Transfer residual length: 2's comp */ u_int8_t tag_action; /* What to do for tag queueing */ /* @@ -1201,6 +1204,13 @@ cam_fill_ataio(struct ccb_ataio *ataio, u_int32_t retries, u_int32_t timeout); static __inline void +cam_fill_ataio_U(struct ccb_ataio *ataio, u_int32_t retries, + void (*cbfcnp)(struct cam_periph *, union ccb *), + u_int32_t flags, u_int tag_action, + u_int8_t *data_ptr, struct vm_page **ma, u_int32_t dxfer_len, + int ma_offset, u_int32_t timeout); + +static __inline void cam_fill_smpio(struct ccb_smpio *smpio, uint32_t retries, void (*cbfcnp)(struct cam_periph *, union ccb *), uint32_t flags, uint8_t *smp_request, int smp_request_len, @@ -1248,6 +1258,25 @@ cam_fill_ctio(struct ccb_scsiio *csio, u_int32_t retries, } static __inline void +cam_fill_ataio_U(struct ccb_ataio *ataio, u_int32_t retries, + void (*cbfcnp)(struct cam_periph *, union ccb *), + u_int32_t flags, u_int tag_action, + u_int8_t *data_ptr, struct vm_page **ma, u_int32_t dxfer_len, + int ma_offset, u_int32_t timeout) +{ + ataio->ccb_h.func_code = XPT_ATA_IO; + ataio->ccb_h.flags = flags; + ataio->ccb_h.retry_count = retries; + ataio->ccb_h.cbfcnp = cbfcnp; + ataio->ccb_h.timeout = timeout; + ataio->data_ptr = data_ptr; + ataio->ma = ma; + ataio->ma_offset = ma_offset; + ataio->dxfer_len = dxfer_len; + ataio->tag_action = tag_action; +} + +static __inline void cam_fill_ataio(struct ccb_ataio *ataio, u_int32_t retries, void (*cbfcnp)(struct cam_periph *, union ccb *), u_int32_t flags, u_int tag_action, @@ -1260,6 +1289,7 @@ cam_fill_ataio(struct ccb_ataio *ataio, u_int32_t retries, ataio->ccb_h.cbfcnp = cbfcnp; ataio->ccb_h.timeout = timeout; ataio->data_ptr = data_ptr; + ataio->ma = NULL; ataio->dxfer_len = dxfer_len; ataio->tag_action = tag_action; } diff --git a/sys/dev/ahci/ahci.c b/sys/dev/ahci/ahci.c index 43ec254..787f0f4 100644 --- a/sys/dev/ahci/ahci.c +++ b/sys/dev/ahci/ahci.c @@ -37,6 +37,7 @@ __FBSDID("$FreeBSD$"); #include #include #include +#include #include #include #include @@ -51,6 +52,14 @@ __FBSDID("$FreeBSD$"); #include #include +#include +#include + +static int ahci_unmapped; +SYSCTL_INT(_debug, OID_AUTO, ahci_unmapped, CTLFLAG_RD, + &ahci_unmapped, 0, + ""); + /* local prototypes */ static int ahci_setup_interrupt(device_t dev); static void ahci_intr(void *data); @@ -95,6 +104,10 @@ static void ahci_process_request_sense(device_t dev, union ccb *ccb); static void ahciaction(struct cam_sim *sim, union ccb *ccb); static void ahcipoll(struct cam_sim *sim); +struct vm_page; +static void ahci_unmappedprd(struct ahci_slot *slot, struct vm_page **ma, + int ma_offset, bus_size_t size); + static MALLOC_DEFINE(M_AHCI, "AHCI driver", "AHCI driver data buffers"); static struct { @@ -1675,12 +1688,19 @@ ahci_begin_transaction(device_t dev, union ccb *ccb) /* If request moves data, setup and load SG list */ if ((ccb->ccb_h.flags & CAM_DIR_MASK) != CAM_DIR_NONE) { void *buf; + struct vm_page **ma; bus_size_t size; slot->state = AHCI_SLOT_LOADING; if (ccb->ccb_h.func_code == XPT_ATA_IO) { - buf = ccb->ataio.data_ptr; + ma = ccb->ataio.ma; size = ccb->ataio.dxfer_len; + if (ma != NULL) { + ahci_unmappedprd(slot, ma, ccb->ataio.ma_offset, + size); + return; + } + buf = ccb->ataio.data_ptr; } else { buf = ccb->csio.data_ptr; size = ccb->csio.dxfer_len; @@ -1691,6 +1711,37 @@ ahci_begin_transaction(device_t dev, union ccb *ccb) ahci_execute_transaction(slot); } +static void +ahci_unmappedprd(struct ahci_slot *slot, struct vm_page **ma, int ma_offset, + bus_size_t size) +{ + struct ahci_channel *ch = device_get_softc(slot->dev); + struct ahci_cmd_tab *ctp; + struct ahci_dma_prd *prd; + bus_size_t left, c; + int i, npages; + + npages = (ma_offset + size + PAGE_SIZE - 1) / PAGE_SIZE; + KASSERT(npages <= AHCI_SG_ENTRIES, ("too many DMA segment entries")); + ctp = (struct ahci_cmd_tab *) + (ch->dma.work + AHCI_CT_OFFSET + (AHCI_CT_SIZE * slot->slot)); + prd = &ctp->prd_tab[0]; + for (i = 0, left = size; i < npages; i++, left -= PAGE_SIZE) { + prd[i].dba = htole64(VM_PAGE_TO_PHYS(ma[i]) + ma_offset); + c = min(PAGE_SIZE - ma_offset, left); + ma_offset = 0; + prd[i].dbc = htole32((c - 1) & AHCI_PRD_MASK); + } + slot->dma.nsegs = npages; +#if 0 + bus_dmamap_sync(ch->dma.data_tag, slot->dma.data_map, + ((slot->ccb->ccb_h.flags & CAM_DIR_IN) ? + BUS_DMASYNC_PREREAD : BUS_DMASYNC_PREWRITE)); +#endif + atomic_add_int(&ahci_unmapped, 1); + ahci_execute_transaction(slot); +} + /* Locked by busdma engine. */ static void ahci_dmasetprd(void *arg, bus_dma_segment_t *segs, int nsegs, int error) diff --git a/sys/dev/md/md.c b/sys/dev/md/md.c index b72f294..9918564 100644 --- a/sys/dev/md/md.c +++ b/sys/dev/md/md.c @@ -110,6 +110,19 @@ static int md_malloc_wait; SYSCTL_INT(_vm, OID_AUTO, md_malloc_wait, CTLFLAG_RW, &md_malloc_wait, 0, "Allow malloc to wait for memory allocations"); +static int md_unmapped_swap; +SYSCTL_INT(_debug, OID_AUTO, md_unmapped_swap, CTLFLAG_RD, + &md_unmapped_swap, 0, + ""); +static int md_unmapped_vnode; +SYSCTL_INT(_debug, OID_AUTO, md_unmapped_vnode, CTLFLAG_RD, + &md_unmapped_vnode, 0, + ""); +static int md_unmapped_malloc; +SYSCTL_INT(_debug, OID_AUTO, md_unmapped_malloc, CTLFLAG_RD, + &md_unmapped_malloc, 0, + ""); + #if defined(MD_ROOT) && !defined(MD_ROOT_FSTYPE) #define MD_ROOT_FSTYPE "ufs" #endif @@ -414,13 +427,103 @@ g_md_start(struct bio *bp) wakeup(sc); } +#define MD_MALLOC_MOVE_ZERO 1 +#define MD_MALLOC_MOVE_FILL 2 +#define MD_MALLOC_MOVE_READ 3 +#define MD_MALLOC_MOVE_WRITE 4 +#define MD_MALLOC_MOVE_CMP 5 + +static int +md_malloc_move(vm_page_t **mp, vm_offset_t *ma_offs, unsigned sectorsize, + void *ptr, u_char fill, int op) +{ + struct sf_buf *sf; + vm_page_t m, *mp1; + char *p, first; + vm_offset_t ma_offs1; + off_t *uc; + unsigned n; + int error, i, sz, first_read; + + m = NULL; + error = 0; + sf = NULL; + /* if (op == MD_MALLOC_MOVE_CMP) { gcc */ + first = 0; + first_read = 0; + uc = ptr; + mp1 = *mp; + ma_offs1 = *ma_offs; + /* } */ + sched_pin(); + for (n = sectorsize; n != 0; n -= sz) { + sz = imin(PAGE_SIZE - *ma_offs, n); + if (m != **mp) { + if (sf != NULL) + sf_buf_free(sf); + m = **mp; + sf = sf_buf_alloc(m, SFB_CPUPRIVATE | + (md_malloc_wait ? 0 : SFB_NOWAIT)); + if (sf == NULL) { + error = ENOMEM; + break; + } + } + p = (char *)sf_buf_kva(sf) + *ma_offs; + switch (op) { + case MD_MALLOC_MOVE_ZERO: + bzero(p, sz); + break; + case MD_MALLOC_MOVE_FILL: + memset(p, fill, sz); + break; + case MD_MALLOC_MOVE_READ: + bcopy(ptr, p, sz); + cpu_flush_dcache(p, sz); + break; + case MD_MALLOC_MOVE_WRITE: + bcopy(p, ptr, sz); + break; + case MD_MALLOC_MOVE_CMP: + for (i = 0; i < sz; i++, p++) { + if (!first_read) { + *uc = *p; + first = *p; + first_read = 1; + } else if (*p != first) { + error = EDOOFUS; + break; + } + } + break; + } + if (error != 0) + break; + *ma_offs += sz; + *ma_offs %= PAGE_SIZE; + if (*ma_offs == 0) + (*mp)++; + } + + if (sf != NULL) + sf_buf_free(sf); + sched_unpin(); + if (op == MD_MALLOC_MOVE_CMP) { + *mp = mp1; + *ma_offs = ma_offs1; + } + return (error); +} + static int mdstart_malloc(struct md_s *sc, struct bio *bp) { - int i, error; u_char *dst; + vm_page_t *m; + int i, error, error1, notmapped; off_t secno, nsec, uc; uintptr_t sp, osp; + vm_offset_t ma_offs; switch (bp->bio_cmd) { case BIO_READ: @@ -431,9 +534,17 @@ mdstart_malloc(struct md_s *sc, struct bio *bp) return (EOPNOTSUPP); } + notmapped = (bp->bio_flags & BIO_NOTMAPPED) != 0; + if (notmapped) { + m = bp->bio_ma; + ma_offs = bp->bio_ma_offset; + dst = NULL; + } else { + dst = bp->bio_data; + } + nsec = bp->bio_length / sc->sectorsize; secno = bp->bio_offset / sc->sectorsize; - dst = bp->bio_data; error = 0; while (nsec--) { osp = s_read(sc->indir, secno); @@ -441,21 +552,45 @@ mdstart_malloc(struct md_s *sc, struct bio *bp) if (osp != 0) error = s_write(sc->indir, secno, 0); } else if (bp->bio_cmd == BIO_READ) { - if (osp == 0) - bzero(dst, sc->sectorsize); - else if (osp <= 255) - memset(dst, osp, sc->sectorsize); - else { - bcopy((void *)osp, dst, sc->sectorsize); - cpu_flush_dcache(dst, sc->sectorsize); + if (osp == 0) { + if (notmapped) { + error = md_malloc_move(&m, &ma_offs, + sc->sectorsize, NULL, 0, + MD_MALLOC_MOVE_ZERO); + } else + bzero(dst, sc->sectorsize); + } else if (osp <= 255) { + if (notmapped) { + error = md_malloc_move(&m, &ma_offs, + sc->sectorsize, NULL, osp, + MD_MALLOC_MOVE_FILL); + } else + memset(dst, osp, sc->sectorsize); + } else { + if (notmapped) { + error = md_malloc_move(&m, &ma_offs, + sc->sectorsize, (void *)osp, 0, + MD_MALLOC_MOVE_READ); + } else { + bcopy((void *)osp, dst, sc->sectorsize); + cpu_flush_dcache(dst, sc->sectorsize); + } } osp = 0; } else if (bp->bio_cmd == BIO_WRITE) { if (sc->flags & MD_COMPRESS) { - uc = dst[0]; - for (i = 1; i < sc->sectorsize; i++) - if (dst[i] != uc) - break; + if (notmapped) { + error1 = md_malloc_move(&m, &ma_offs, + sc->sectorsize, &uc, 0, + MD_MALLOC_MOVE_CMP); + i = error1 == 0 ? sc->sectorsize : 0; + } else { + uc = dst[0]; + for (i = 1; i < sc->sectorsize; i++) { + if (dst[i] != uc) + break; + } + } } else { i = 0; uc = 0; @@ -472,10 +607,26 @@ mdstart_malloc(struct md_s *sc, struct bio *bp) error = ENOSPC; break; } - bcopy(dst, (void *)sp, sc->sectorsize); + if (notmapped) { + error = md_malloc_move(&m, + &ma_offs, sc->sectorsize, + (void *)sp, 0, + MD_MALLOC_MOVE_WRITE); + } else { + bcopy(dst, (void *)sp, + sc->sectorsize); + } error = s_write(sc->indir, secno, sp); } else { - bcopy(dst, (void *)osp, sc->sectorsize); + if (notmapped) { + error = md_malloc_move(&m, + &ma_offs, sc->sectorsize, + (void *)osp, 0, + MD_MALLOC_MOVE_WRITE); + } else { + bcopy(dst, (void *)osp, + sc->sectorsize); + } osp = 0; } } @@ -487,7 +638,8 @@ mdstart_malloc(struct md_s *sc, struct bio *bp) if (error != 0) break; secno++; - dst += sc->sectorsize; + if (!notmapped) + dst += sc->sectorsize; } bp->bio_resid = 0; return (error); @@ -628,11 +780,12 @@ mdstart_vnode(struct md_s *sc, struct bio *bp) static int mdstart_swap(struct md_s *sc, struct bio *bp) { - struct sf_buf *sf; - int rv, offs, len, lastend; - vm_pindex_t i, lastp; vm_page_t m; u_char *p; + struct uio uio; + struct iovec iov[1]; + vm_pindex_t i, lastp; + int rv, ma_offs, offs, len, lastend, j; switch (bp->bio_cmd) { case BIO_READ: @@ -644,6 +797,17 @@ mdstart_swap(struct md_s *sc, struct bio *bp) } p = bp->bio_data; + if ((bp->bio_flags & BIO_NOTMAPPED) == 0) { + uio.uio_segflg = UIO_SYSSPACE; + uio.uio_rw = bp->bio_cmd == BIO_READ ? UIO_READ : UIO_WRITE; + uio.uio_td = curthread; + uio.uio_iov = iov; + uio.uio_iovcnt = 1; + ma_offs = 0; + } else { + atomic_add_int(&md_unmapped_swap, 1); + ma_offs = bp->bio_ma_offset; + } /* * offs is the offset at which to start operating on the @@ -659,21 +823,14 @@ mdstart_swap(struct md_s *sc, struct bio *bp) rv = VM_PAGER_OK; VM_OBJECT_LOCK(sc->object); vm_object_pip_add(sc->object, 1); - for (i = bp->bio_offset / PAGE_SIZE; i <= lastp; i++) { + for (i = bp->bio_offset / PAGE_SIZE, j = 0; i <= lastp; i++, j++) { len = ((i == lastp) ? lastend : PAGE_SIZE) - offs; - - m = vm_page_grab(sc->object, i, - VM_ALLOC_NORMAL|VM_ALLOC_RETRY); - VM_OBJECT_UNLOCK(sc->object); - sched_pin(); - sf = sf_buf_alloc(m, SFB_CPUPRIVATE); - VM_OBJECT_LOCK(sc->object); + m = vm_page_grab(sc->object, i, VM_ALLOC_NORMAL | + VM_ALLOC_RETRY); if (bp->bio_cmd == BIO_READ) { if (m->valid != VM_PAGE_BITS_ALL) rv = vm_pager_get_pages(sc->object, &m, 1, 0); if (rv == VM_PAGER_ERROR) { - sf_buf_free(sf); - sched_unpin(); vm_page_wakeup(m); break; } else if (rv == VM_PAGER_FAIL) { @@ -683,40 +840,52 @@ mdstart_swap(struct md_s *sc, struct bio *bp) * valid. Do not set dirty, the page * can be recreated if thrown out. */ - bzero((void *)sf_buf_kva(sf), PAGE_SIZE); + pmap_zero_page(m); m->valid = VM_PAGE_BITS_ALL; } - bcopy((void *)(sf_buf_kva(sf) + offs), p, len); - cpu_flush_dcache(p, len); + if ((bp->bio_flags & BIO_NOTMAPPED) != 0) { + pmap_copy_pages(&m, offs, &bp->bio_ma[j], + ma_offs, len); + } else { + uio.uio_resid = len; + uio.uio_offset = offs; + iov[0].iov_base = p; + iov[0].iov_len = len; + uiomove_fromphys(&m, offs, len, &uio); + cpu_flush_dcache(p, len); + } } else if (bp->bio_cmd == BIO_WRITE) { if (len != PAGE_SIZE && m->valid != VM_PAGE_BITS_ALL) rv = vm_pager_get_pages(sc->object, &m, 1, 0); if (rv == VM_PAGER_ERROR) { - sf_buf_free(sf); - sched_unpin(); vm_page_wakeup(m); break; } - bcopy(p, (void *)(sf_buf_kva(sf) + offs), len); + if ((bp->bio_flags & BIO_NOTMAPPED) != 0) { + pmap_copy_pages(&bp->bio_ma[j], ma_offs, &m, + offs, len); + } else { + uio.uio_resid = len; + uio.uio_offset = offs; + iov[0].iov_base = p; + iov[0].iov_len = len; + uiomove_fromphys(&m, offs, len, &uio); + } m->valid = VM_PAGE_BITS_ALL; } else if (bp->bio_cmd == BIO_DELETE) { if (len != PAGE_SIZE && m->valid != VM_PAGE_BITS_ALL) rv = vm_pager_get_pages(sc->object, &m, 1, 0); if (rv == VM_PAGER_ERROR) { - sf_buf_free(sf); - sched_unpin(); vm_page_wakeup(m); break; } if (len != PAGE_SIZE) { - bzero((void *)(sf_buf_kva(sf) + offs), len); + pmap_zero_page_area(m, offs, len); vm_page_clear_dirty(m, offs, len); m->valid = VM_PAGE_BITS_ALL; } else vm_pager_page_unswapped(m); } - sf_buf_free(sf); - sched_unpin(); vm_page_wakeup(m); vm_page_lock(m); if (bp->bio_cmd == BIO_DELETE && len == PAGE_SIZE) @@ -730,6 +899,7 @@ mdstart_swap(struct md_s *sc, struct bio *bp) /* Actions on further pages start at offset 0 */ p += PAGE_SIZE - offs; offs = 0; + ma_offs = 0; } vm_object_pip_subtract(sc->object, 1); VM_OBJECT_UNLOCK(sc->object); @@ -845,6 +1015,14 @@ mdinit(struct md_s *sc) pp = g_new_providerf(gp, "md%d", sc->unit); pp->mediasize = sc->mediasize; pp->sectorsize = sc->sectorsize; + switch (sc->type) { + case MD_SWAP: + case MD_MALLOC: + pp->flags |= G_PF_ACCEPT_UNMAPPED; + break; + default: + break; + } sc->gp = gp; sc->pp = pp; g_error_provider(pp, 0); diff --git a/sys/fs/cd9660/cd9660_vnops.c b/sys/fs/cd9660/cd9660_vnops.c index 21ee0fc..47d4f75 100644 --- a/sys/fs/cd9660/cd9660_vnops.c +++ b/sys/fs/cd9660/cd9660_vnops.c @@ -329,7 +329,7 @@ cd9660_read(ap) if (lblktosize(imp, rablock) < ip->i_size) error = cluster_read(vp, (off_t)ip->i_size, lbn, size, NOCRED, uio->uio_resid, - (ap->a_ioflag >> 16), &bp); + (ap->a_ioflag >> 16), 0, &bp); else error = bread(vp, lbn, size, NOCRED, &bp); } else { diff --git a/sys/fs/ext2fs/ext2_balloc.c b/sys/fs/ext2fs/ext2_balloc.c index 6e60c6e..ba91ac5 100644 --- a/sys/fs/ext2fs/ext2_balloc.c +++ b/sys/fs/ext2fs/ext2_balloc.c @@ -281,7 +281,7 @@ ext2_balloc(ip, lbn, size, cred, bpp, flags) if (seqcount && (vp->v_mount->mnt_flag & MNT_NOCLUSTERR) == 0) { error = cluster_read(vp, ip->i_size, lbn, (int)fs->e2fs_bsize, NOCRED, - MAXBSIZE, seqcount, &nbp); + MAXBSIZE, seqcount, 0, &nbp); } else { error = bread(vp, lbn, (int)fs->e2fs_bsize, NOCRED, &nbp); } diff --git a/sys/fs/ext2fs/ext2_vnops.c b/sys/fs/ext2fs/ext2_vnops.c index 4f8f6a9..5d3d279 100644 --- a/sys/fs/ext2fs/ext2_vnops.c +++ b/sys/fs/ext2fs/ext2_vnops.c @@ -1748,10 +1748,11 @@ ext2_read(ap) if (lblktosize(fs, nextlbn) >= ip->i_size) error = bread(vp, lbn, size, NOCRED, &bp); - else if ((vp->v_mount->mnt_flag & MNT_NOCLUSTERR) == 0) + else if ((vp->v_mount->mnt_flag & MNT_NOCLUSTERR) == 0) { error = cluster_read(vp, ip->i_size, lbn, size, - NOCRED, blkoffset + uio->uio_resid, seqcount, &bp); - else if (seqcount > 1) { + NOCRED, blkoffset + uio->uio_resid, seqcount, + 0, &bp); + } else if (seqcount > 1) { int nextsize = blksize(fs, ip, nextlbn); error = breadn(vp, lbn, size, &nextlbn, &nextsize, 1, NOCRED, &bp); @@ -1967,7 +1968,7 @@ ext2_write(ap) } else if (xfersize + blkoffset == fs->e2fs_fsize) { if ((vp->v_mount->mnt_flag & MNT_NOCLUSTERW) == 0) { bp->b_flags |= B_CLUSTEROK; - cluster_write(vp, bp, ip->i_size, seqcount); + cluster_write(vp, bp, ip->i_size, seqcount, 0); } else { bawrite(bp); } diff --git a/sys/fs/msdosfs/msdosfs_vnops.c b/sys/fs/msdosfs/msdosfs_vnops.c index a90ee8d..e18d0b1 100644 --- a/sys/fs/msdosfs/msdosfs_vnops.c +++ b/sys/fs/msdosfs/msdosfs_vnops.c @@ -600,7 +600,7 @@ msdosfs_read(ap) error = bread(vp, lbn, blsize, NOCRED, &bp); } else if ((vp->v_mount->mnt_flag & MNT_NOCLUSTERR) == 0) { error = cluster_read(vp, dep->de_FileSize, lbn, blsize, - NOCRED, on + uio->uio_resid, seqcount, &bp); + NOCRED, on + uio->uio_resid, seqcount, 0, &bp); } else if (seqcount > 1) { rasize = blsize; error = breadn(vp, lbn, @@ -820,7 +820,7 @@ msdosfs_write(ap) else if (n + croffset == pmp->pm_bpcluster) { if ((vp->v_mount->mnt_flag & MNT_NOCLUSTERW) == 0) cluster_write(vp, bp, dep->de_FileSize, - seqcount); + seqcount, 0); else bawrite(bp); } else diff --git a/sys/fs/udf/udf_vnops.c b/sys/fs/udf/udf_vnops.c index b1a3b1d..abe073e 100644 --- a/sys/fs/udf/udf_vnops.c +++ b/sys/fs/udf/udf_vnops.c @@ -478,8 +478,9 @@ udf_read(struct vop_read_args *ap) rablock = lbn + 1; if ((vp->v_mount->mnt_flag & MNT_NOCLUSTERR) == 0) { if (lblktosize(udfmp, rablock) < fsize) { - error = cluster_read(vp, fsize, lbn, size, NOCRED, - uio->uio_resid, (ap->a_ioflag >> 16), &bp); + error = cluster_read(vp, fsize, lbn, size, + NOCRED, uio->uio_resid, + (ap->a_ioflag >> 16), 0, &bp); } else { error = bread(vp, lbn, size, NOCRED, &bp); } diff --git a/sys/geom/geom.h b/sys/geom/geom.h index 351b05d..660bf6e 100644 --- a/sys/geom/geom.h +++ b/sys/geom/geom.h @@ -205,6 +205,7 @@ struct g_provider { u_int flags; #define G_PF_WITHER 0x2 #define G_PF_ORPHAN 0x4 +#define G_PF_ACCEPT_UNMAPPED 0x8 /* Two fields for the implementing class to use */ void *private; diff --git a/sys/geom/geom_disk.c b/sys/geom/geom_disk.c index 72e9162..cfe2ef8 100644 --- a/sys/geom/geom_disk.c +++ b/sys/geom/geom_disk.c @@ -320,7 +320,17 @@ g_disk_start(struct bio *bp) do { bp2->bio_offset += off; bp2->bio_length -= off; - bp2->bio_data += off; + if ((bp->bio_flags & BIO_NOTMAPPED) == 0) { + bp2->bio_data += off; + } else { + KASSERT((dp->d_flags & DISKFLAG_NOTMAPPED_BIO) + != 0, + ("unmapped bio not supported by disk %s", + dp->d_name)); + bp2->bio_ma += off / PAGE_SIZE; + bp2->bio_ma_offset += off; + bp2->bio_ma_offset %= PAGE_SIZE; + } if (bp2->bio_length > dp->d_maxsize) { /* * XXX: If we have a stripesize we should really @@ -488,6 +498,8 @@ g_disk_create(void *arg, int flag) pp->sectorsize = dp->d_sectorsize; pp->stripeoffset = dp->d_stripeoffset; pp->stripesize = dp->d_stripesize; + if ((dp->d_flags & DISKFLAG_NOTMAPPED_BIO) != 0) + pp->flags |= G_PF_ACCEPT_UNMAPPED; if (bootverbose) printf("GEOM: new disk %s\n", gp->name); sysctl_ctx_init(&sc->sysctl_ctx); diff --git a/sys/geom/geom_disk.h b/sys/geom/geom_disk.h index 33d8eb2..cb81883 100644 --- a/sys/geom/geom_disk.h +++ b/sys/geom/geom_disk.h @@ -103,6 +103,7 @@ struct disk { #define DISKFLAG_OPEN 0x2 #define DISKFLAG_CANDELETE 0x4 #define DISKFLAG_CANFLUSHCACHE 0x8 +#define DISKFLAG_NOTMAPPED_BIO 0x10 struct disk *disk_alloc(void); void disk_create(struct disk *disk, int version); diff --git a/sys/geom/geom_io.c b/sys/geom/geom_io.c index 0294887..7d214b4 100644 --- a/sys/geom/geom_io.c +++ b/sys/geom/geom_io.c @@ -44,6 +44,7 @@ __FBSDID("$FreeBSD$"); #include #include #include +#include #include #include @@ -51,6 +52,13 @@ __FBSDID("$FreeBSD$"); #include #include +#include +#include +#include +#include +#include +#include +#include static struct g_bioq g_bio_run_down; static struct g_bioq g_bio_run_up; @@ -180,12 +188,16 @@ g_clone_bio(struct bio *bp) /* * BIO_ORDERED flag may be used by disk drivers to enforce * ordering restrictions, so this flag needs to be cloned. + * BIO_NOTMAPPED should be inherited, to properly indicate + * which way the buffer is passed. * Other bio flags are not suitable for cloning. */ - bp2->bio_flags = bp->bio_flags & BIO_ORDERED; + bp2->bio_flags = bp->bio_flags & (BIO_ORDERED | BIO_NOTMAPPED); bp2->bio_length = bp->bio_length; bp2->bio_offset = bp->bio_offset; bp2->bio_data = bp->bio_data; + bp2->bio_ma = bp->bio_ma; + bp2->bio_ma_offset = bp->bio_ma_offset; bp2->bio_attribute = bp->bio_attribute; /* Inherit classification info from the parent */ bp2->bio_classifier1 = bp->bio_classifier1; @@ -210,11 +222,14 @@ g_duplicate_bio(struct bio *bp) struct bio *bp2; bp2 = uma_zalloc(biozone, M_WAITOK | M_ZERO); + bp2->bio_flags = bp->bio_flags & BIO_NOTMAPPED; bp2->bio_parent = bp; bp2->bio_cmd = bp->bio_cmd; bp2->bio_length = bp->bio_length; bp2->bio_offset = bp->bio_offset; bp2->bio_data = bp->bio_data; + bp2->bio_ma = bp->bio_ma; + bp2->bio_ma_offset = bp->bio_ma_offset; bp2->bio_attribute = bp->bio_attribute; bp->bio_children++; #ifdef KTR @@ -572,12 +587,33 @@ g_io_deliver(struct bio *bp, int error) return; } +SYSCTL_DECL(_kern_geom); + +static long transient_maps; +SYSCTL_LONG(_kern_geom, OID_AUTO, transient_maps, CTLFLAG_RD, + &transient_maps, 0, + ""); +int transient_map_retries; +SYSCTL_INT(_kern_geom, OID_AUTO, transient_map_retries, CTLFLAG_RD, + &transient_map_retries, 0, + ""); +int transient_map_failures; +SYSCTL_INT(_kern_geom, OID_AUTO, transient_map_failures, CTLFLAG_RD, + &transient_map_failures, 0, + ""); +int inflight_transient_maps; +SYSCTL_INT(_kern_geom, OID_AUTO, inflight_transient_maps, CTLFLAG_RD, + &inflight_transient_maps, 0, + ""); + void g_io_schedule_down(struct thread *tp __unused) { struct bio *bp; off_t excess; - int error; + vm_offset_t addr; + long size; + int error, retried, rv; for(;;) { g_bioq_lock(&g_bio_run_down); @@ -633,6 +669,56 @@ g_io_schedule_down(struct thread *tp __unused) default: break; } + if ((bp->bio_flags & BIO_NOTMAPPED) != 0 && + (bp->bio_to->flags & G_PF_ACCEPT_UNMAPPED) == 0 && + (bp->bio_cmd == BIO_READ || bp->bio_cmd == BIO_WRITE)) { + size = round_page(bp->bio_ma_offset + bp->bio_length); + addr = 0; + retried = 0; + atomic_add_long(&transient_maps, 1); +retry: + vm_map_lock(bio_transient_map); + if (vm_map_findspace(bio_transient_map, + vm_map_min(bio_transient_map), size, &addr)) { + vm_map_unlock(bio_transient_map); + if (retried >= 3) { + g_io_deliver(bp, EDEADLK/* XXXKIB */); + CTR2(KTR_GEOM, "g_down cannot map " + "bp %p provider %s", bp, + bp->bio_to->name); + atomic_add_int(&transient_map_failures, + 1); + continue; + } else { + /* + * Naive attempt to quisce the + * I/O to get more in-flight + * requests completed and + * defragment the bio_transient_map. + */ + CTR3(KTR_GEOM, "g_down retry map " + "bp %p provider %s r %d", bp, + bp->bio_to->name, retried); + pause("g_d_tra", hz / 10); + retried++; + atomic_add_int(&transient_map_retries, + 1); + goto retry; + } + } + rv = vm_map_insert(bio_transient_map, NULL, 0, addr, + addr + size, VM_PROT_RW, VM_PROT_RW, MAP_NOFAULT); + KASSERT(rv == KERN_SUCCESS, + ("vm_map_insert(bio_transient_map) rv %d %jx %lx", + rv, (uintmax_t)addr, size)); + vm_map_unlock(bio_transient_map); + atomic_add_int(&inflight_transient_maps, 1); + pmap_qenter((vm_offset_t)addr, bp->bio_ma, + OFF_TO_IDX(size)); + bp->bio_data = (caddr_t)addr + bp->bio_ma_offset; + bp->bio_flags |= BIO_TRANSIENT_MAPPING; + bp->bio_flags &= ~BIO_NOTMAPPED; + } THREAD_NO_SLEEPING(); CTR4(KTR_GEOM, "g_down starting bp %p provider %s off %ld " "len %ld", bp, bp->bio_to->name, bp->bio_offset, diff --git a/sys/geom/geom_vfs.c b/sys/geom/geom_vfs.c index afc6549..c8fa189 100644 --- a/sys/geom/geom_vfs.c +++ b/sys/geom/geom_vfs.c @@ -188,7 +188,15 @@ g_vfs_strategy(struct bufobj *bo, struct buf *bp) bip = g_alloc_bio(); bip->bio_cmd = bp->b_iocmd; bip->bio_offset = bp->b_iooffset; - bip->bio_data = bp->b_data; + if ((bp->b_flags & B_NOTMAPPED) != 0) { + bip->bio_ma = bp->b_pages; + bip->bio_data = unmapped_buf; + bip->bio_ma_offset = (vm_offset_t)bp->b_offset & PAGE_MASK; + bip->bio_flags |= BIO_NOTMAPPED; + } else { + bip->bio_data = bp->b_data; + bip->bio_ma = NULL; + } bip->bio_done = g_vfs_done; bip->bio_caller2 = bp; bip->bio_length = bp->b_bcount; diff --git a/sys/geom/part/g_part.c b/sys/geom/part/g_part.c index e2ba79e..7650499 100644 --- a/sys/geom/part/g_part.c +++ b/sys/geom/part/g_part.c @@ -427,6 +427,7 @@ g_part_new_provider(struct g_geom *gp, struct g_part_table *table, entry->gpe_pp->stripeoffset = pp->stripeoffset + entry->gpe_offset; if (pp->stripesize > 0) entry->gpe_pp->stripeoffset %= pp->stripesize; + entry->gpe_pp->flags |= pp->flags & G_PF_ACCEPT_UNMAPPED; g_error_provider(entry->gpe_pp, 0); } diff --git a/sys/i386/conf/X b/sys/i386/conf/X index 6228920..cc12173 100644 --- a/sys/i386/conf/X +++ b/sys/i386/conf/X @@ -79,3 +79,5 @@ device io device bpf device uart device em + +options ATA_CAM diff --git a/sys/i386/i386/pmap.c b/sys/i386/i386/pmap.c index f14f215..a7f6520 100644 --- a/sys/i386/i386/pmap.c +++ b/sys/i386/i386/pmap.c @@ -4224,6 +4224,49 @@ pmap_copy_page(vm_page_t src, vm_page_t dst) mtx_unlock(&sysmaps->lock); } +void +pmap_copy_pages(vm_page_t ma[], vm_offset_t a_offset, vm_page_t mb[], + vm_offset_t b_offset, int xfersize) +{ + struct sysmaps *sysmaps; + vm_page_t a_pg, b_pg; + char *a_cp, *b_cp; + vm_offset_t a_pg_offset, b_pg_offset; + int cnt; + + sysmaps = &sysmaps_pcpu[PCPU_GET(cpuid)]; + mtx_lock(&sysmaps->lock); + if (*sysmaps->CMAP1 != 0) + panic("pmap_copy_pages: CMAP1 busy"); + if (*sysmaps->CMAP2 != 0) + panic("pmap_copy_pages: CMAP2 busy"); + sched_pin(); + while (xfersize > 0) { + invlpg((u_int)sysmaps->CADDR1); + invlpg((u_int)sysmaps->CADDR2); + a_pg = ma[a_offset >> PAGE_SHIFT]; + a_pg_offset = a_offset & PAGE_MASK; + cnt = min(xfersize, PAGE_SIZE - a_pg_offset); + b_pg = mb[b_offset >> PAGE_SHIFT]; + b_pg_offset = b_offset & PAGE_MASK; + cnt = min(cnt, PAGE_SIZE - b_pg_offset); + *sysmaps->CMAP1 = PG_V | VM_PAGE_TO_PHYS(a_pg) | PG_A | + pmap_cache_bits(b_pg->md.pat_mode, 0); + *sysmaps->CMAP2 = PG_V | PG_RW | VM_PAGE_TO_PHYS(b_pg) | PG_A | + PG_M | pmap_cache_bits(b_pg->md.pat_mode, 0); + a_cp = sysmaps->CADDR1 + a_pg_offset; + b_cp = sysmaps->CADDR2 + b_pg_offset; + bcopy(a_cp, b_cp, cnt); + a_offset += cnt; + b_offset += cnt; + xfersize -= cnt; + } + *sysmaps->CMAP1 = 0; + *sysmaps->CMAP2 = 0; + sched_unpin(); + mtx_unlock(&sysmaps->lock); +} + /* * Returns true if the pmap's pv is one of the first * 16 pvs linked to from this page. This count may diff --git a/sys/kern/vfs_bio.c b/sys/kern/vfs_bio.c index 32a1089..2ee3e94 100644 --- a/sys/kern/vfs_bio.c +++ b/sys/kern/vfs_bio.c @@ -91,6 +91,7 @@ struct buf_ops buf_ops_bio = { * carnal knowledge of buffers. This knowledge should be moved to vfs_bio.c. */ struct buf *buf; /* buffer header pool */ +caddr_t unmapped_buf; static struct proc *bufdaemonproc; @@ -131,6 +132,10 @@ SYSCTL_PROC(_vfs, OID_AUTO, bufspace, CTLTYPE_LONG|CTLFLAG_MPSAFE|CTLFLAG_RD, SYSCTL_LONG(_vfs, OID_AUTO, bufspace, CTLFLAG_RD, &bufspace, 0, "Virtual memory used for buffers"); #endif +static long unmapped_bufspace; +SYSCTL_LONG(_vfs, OID_AUTO, unmapped_bufspace, CTLFLAG_RD, + &unmapped_bufspace, 0, + "Amount of unmapped buffers, inclusive in the bufspace"); static long maxbufspace; SYSCTL_LONG(_vfs, OID_AUTO, maxbufspace, CTLFLAG_RD, &maxbufspace, 0, "Maximum allowed value of bufspace (including buf_daemon)"); @@ -200,6 +205,10 @@ SYSCTL_INT(_vfs, OID_AUTO, getnewbufcalls, CTLFLAG_RW, &getnewbufcalls, 0, static int getnewbufrestarts; SYSCTL_INT(_vfs, OID_AUTO, getnewbufrestarts, CTLFLAG_RW, &getnewbufrestarts, 0, "Number of times getnewbuf has had to restart a buffer aquisition"); +static int mappingrestarts; +SYSCTL_INT(_vfs, OID_AUTO, mappingrestarts, CTLFLAG_RW, &mappingrestarts, 0, + "Number of times getblk has had to restart a buffer mapping for " + "unmapped buffer"); static int flushbufqtarget = 100; SYSCTL_INT(_vfs, OID_AUTO, flushbufqtarget, CTLFLAG_RW, &flushbufqtarget, 0, "Amount of work to do in flushbufqueues when helping bufdaemon"); @@ -671,6 +680,55 @@ bufinit(void) bogus_page = vm_page_alloc(NULL, 0, VM_ALLOC_NOOBJ | VM_ALLOC_NORMAL | VM_ALLOC_WIRED); + unmapped_buf = (caddr_t)kmem_alloc_nofault(kernel_map, MAXPHYS); +} + +#ifdef INVARIANTS +static inline void +vfs_buf_check_mapped(struct buf *bp) +{ + + KASSERT((bp->b_flags & B_NOTMAPPED) == 0, + ("mapped buf %p %x", bp, bp->b_flags)); + KASSERT(bp->b_kvabase != unmapped_buf, + ("mapped buf: b_kvabase was not updated %p", bp)); + KASSERT(bp->b_data != unmapped_buf, + ("mapped buf: b_data was not updated %p", bp)); +} + +static inline void +vfs_buf_check_unmapped(struct buf *bp) +{ + + KASSERT((bp->b_flags & B_NOTMAPPED) == B_NOTMAPPED, + ("unmapped buf %p %x", bp, bp->b_flags)); + KASSERT(bp->b_kvabase == unmapped_buf, + ("unmapped buf: corrupted b_kvabase %p", bp)); + KASSERT(bp->b_data == unmapped_buf, + ("unmapped buf: corrupted b_data %p", bp)); +} + +#define BUF_CHECK_MAPPED(bp) vfs_buf_check_mapped(bp) +#define BUF_CHECK_UNMAPPED(bp) vfs_buf_check_unmapped(bp) +#else +#define BUF_CHECK_MAPPED(bp) do {} while (0) +#define BUF_CHECK_UNMAPPED(bp) do {} while (0) +#endif + +static void +bpmap_qenter(struct buf *bp) +{ + + BUF_CHECK_MAPPED(bp); + + /* + * bp->b_data is relative to bp->b_offset, but + * bp->b_offset may be offset into the first page. + */ + bp->b_data = (caddr_t)trunc_page((vm_offset_t)bp->b_data); + pmap_qenter((vm_offset_t)bp->b_data, bp->b_pages, bp->b_npages); + bp->b_data = (caddr_t)((vm_offset_t)bp->b_data | + (vm_offset_t)(bp->b_offset & PAGE_MASK)); } /* @@ -682,14 +740,26 @@ static void bfreekva(struct buf *bp) { - if (bp->b_kvasize) { - atomic_add_int(&buffreekvacnt, 1); - atomic_subtract_long(&bufspace, bp->b_kvasize); - vm_map_remove(buffer_map, (vm_offset_t) bp->b_kvabase, - (vm_offset_t) bp->b_kvabase + bp->b_kvasize); - bp->b_kvasize = 0; - bufspacewakeup(); + if (bp->b_kvasize == 0) + return; + + atomic_add_int(&buffreekvacnt, 1); + atomic_subtract_long(&bufspace, bp->b_kvasize); + if ((bp->b_flags & B_NOTMAPPED) == 0) { + BUF_CHECK_MAPPED(bp); + vm_map_remove(buffer_map, (vm_offset_t)bp->b_kvabase, + (vm_offset_t)bp->b_kvabase + bp->b_kvasize); + } else { + BUF_CHECK_UNMAPPED(bp); + if ((bp->b_flags & B_KVAALLOC) != 0) { + vm_map_remove(buffer_map, (vm_offset_t)bp->b_kvaalloc, + (vm_offset_t)bp->b_kvaalloc + bp->b_kvasize); + } + atomic_subtract_long(&unmapped_bufspace, bp->b_kvasize); + bp->b_flags &= ~(B_NOTMAPPED | B_KVAALLOC); } + bp->b_kvasize = 0; + bufspacewakeup(); } /* @@ -826,9 +896,8 @@ breada(struct vnode * vp, daddr_t * rablkno, int * rabsize, * getblk(). Also starts asynchronous I/O on read-ahead blocks. */ int -breadn_flags(struct vnode * vp, daddr_t blkno, int size, - daddr_t * rablkno, int *rabsize, int cnt, - struct ucred * cred, int flags, struct buf **bpp) +breadn_flags(struct vnode *vp, daddr_t blkno, int size, daddr_t *rablkno, + int *rabsize, int cnt, struct ucred *cred, int flags, struct buf **bpp) { struct buf *bp; int rv = 0, readwait = 0; @@ -1363,7 +1432,8 @@ brelse(struct buf *bp) } } - if ((bp->b_flags & B_INVAL) == 0) { + if ((bp->b_flags & (B_INVAL | B_NOTMAPPED)) == 0) { + BUF_CHECK_MAPPED(bp); pmap_qenter( trunc_page((vm_offset_t)bp->b_data), bp->b_pages, bp->b_npages); @@ -1612,7 +1682,11 @@ vfs_vmio_release(struct buf *bp) int i; vm_page_t m; - pmap_qremove(trunc_page((vm_offset_t)bp->b_data), bp->b_npages); + if ((bp->b_flags & B_NOTMAPPED) == 0) { + BUF_CHECK_MAPPED(bp); + pmap_qremove(trunc_page((vm_offset_t)bp->b_data), bp->b_npages); + } else + BUF_CHECK_UNMAPPED(bp); VM_OBJECT_LOCK(bp->b_bufobj->bo_object); for (i = 0; i < bp->b_npages; i++) { m = bp->b_pages[i]; @@ -1716,8 +1790,10 @@ vfs_bio_awrite(struct buf *bp) int nwritten; int size; int maxcl; + int gbflags; bo = &vp->v_bufobj; + gbflags = (bp->b_flags & B_NOTMAPPED) != 0 ? GB_NOTMAPPED : 0; /* * right now we support clustered writing only to regular files. If * we find a clusterable block we could be in the middle of a cluster @@ -1748,8 +1824,9 @@ vfs_bio_awrite(struct buf *bp) */ if (ncl != 1) { BUF_UNLOCK(bp); - nwritten = cluster_wbuild(vp, size, lblkno - j, ncl); - return nwritten; + nwritten = cluster_wbuild(vp, size, lblkno - j, ncl, + gbflags); + return (nwritten); } } bremfree(bp); @@ -1796,6 +1873,9 @@ getnewbuf(struct vnode *vp, int slpflag, int slptimeo, int size, int maxsize, int nqindex; static int flushingbufs; + KASSERT((gbflags & (GB_NOTMAPPED | GB_KVAALLOC)) != GB_KVAALLOC, + ("GB_KVAALLOC only makes sense with GB_NOTMAPPED")); + td = curthread; /* * We can't afford to block since we might be holding a vnode lock, @@ -1969,7 +2049,7 @@ restart: if (bp->b_bufsize) allocbuf(bp, 0); - bp->b_flags = 0; + bp->b_flags &= B_NOTMAPPED; bp->b_ioflags = 0; bp->b_xflags = 0; KASSERT((bp->b_vflags & BV_INFREECNT) == 0, @@ -2096,6 +2176,14 @@ restart: } } mtx_unlock(&nblock); + } else if ((gbflags & (GB_NOTMAPPED | GB_KVAALLOC)) == GB_NOTMAPPED) { + bfreekva(bp); + bp->b_flags |= B_NOTMAPPED; + bp->b_kvabase = bp->b_data = unmapped_buf; + bp->b_kvasize = maxsize; + atomic_add_long(&bufspace, bp->b_kvasize); + atomic_add_long(&unmapped_bufspace, bp->b_kvasize); + atomic_add_int(&bufreusecnt, 1); } else { /* * We finally have a valid bp. We aren't quite out of the @@ -2105,7 +2193,8 @@ restart: */ maxsize = (maxsize + BKVAMASK) & ~BKVAMASK; - if (maxsize != bp->b_kvasize) { + if (maxsize != bp->b_kvasize || + (bp->b_flags & (B_NOTMAPPED | B_KVAALLOC)) == B_NOTMAPPED) { vm_offset_t addr = 0; int rv; @@ -2126,18 +2215,37 @@ restart: goto restart; } rv = vm_map_insert(buffer_map, NULL, 0, addr, - addr + maxsize, VM_PROT_ALL, VM_PROT_ALL, + addr + maxsize, VM_PROT_RW, VM_PROT_RW, MAP_NOFAULT); KASSERT(rv == KERN_SUCCESS, ("vm_map_insert(buffer_map) rv %d", rv)); vm_map_unlock(buffer_map); - bp->b_kvabase = (caddr_t)addr; + if ((gbflags & GB_NOTMAPPED) == 0) { + bp->b_kvabase = (caddr_t)addr; + } else if ((gbflags & GB_KVAALLOC) != 0) { + KASSERT((gbflags & GB_NOTMAPPED) != 0, + ("GB_KVAALLOC without GB_NOTMAPPED")); + bp->b_kvaalloc = (caddr_t)addr; + bp->b_flags |= B_KVAALLOC; + atomic_add_long(&unmapped_bufspace, + bp->b_kvasize); + } bp->b_kvasize = maxsize; atomic_add_long(&bufspace, bp->b_kvasize); atomic_add_int(&bufreusecnt, 1); + } else if ((bp->b_flags & B_KVAALLOC) != 0 && + (gbflags & (GB_NOTMAPPED | GB_KVAALLOC)) == 0) { + bp->b_kvabase = bp->b_kvaalloc; + bp->b_flags &= ~B_KVAALLOC; + atomic_subtract_long(&unmapped_bufspace, + bp->b_kvasize); + } + if ((gbflags & GB_NOTMAPPED) == 0) { + bp->b_saveaddr = bp->b_kvabase; + bp->b_data = bp->b_saveaddr; + bp->b_flags &= ~B_NOTMAPPED; + BUF_CHECK_MAPPED(bp); } - bp->b_saveaddr = bp->b_kvabase; - bp->b_data = bp->b_saveaddr; } return (bp); } @@ -2584,14 +2692,18 @@ vfs_setdirty_locked_object(struct buf *bp) * prior to issuing the READ. biodone() will *not* clear B_INVAL. */ struct buf * -getblk(struct vnode * vp, daddr_t blkno, int size, int slpflag, int slptimeo, +getblk(struct vnode *vp, daddr_t blkno, int size, int slpflag, int slptimeo, int flags) { - struct buf *bp; + struct buf *bp, *scratch_bp; struct bufobj *bo; - int error; + vm_offset_t addr; + int bsize, error, maxsize, need_mapping, need_kva, vmio; + off_t offset; CTR3(KTR_BUF, "getblk(%p, %ld, %d)", vp, (long)blkno, size); + KASSERT((flags & (GB_NOTMAPPED | GB_KVAALLOC)) != GB_KVAALLOC, + ("GB_KVAALLOC only makes sense with GB_NOTMAPPED")); ASSERT_VOP_LOCKED(vp, "getblk"); if (size > MAXBSIZE) panic("getblk: size(%d) > MAXBSIZE(%d)\n", size, MAXBSIZE); @@ -2659,9 +2771,8 @@ loop: } /* - * check for size inconsistancies for non-VMIO case. + * check for size inconsistencies for non-VMIO case. */ - if (bp->b_bcount != size) { if ((bp->b_flags & B_VMIO) == 0 || (size > bp->b_kvasize)) { @@ -2694,13 +2805,85 @@ loop: } } + need_mapping = (bp->b_flags & B_NOTMAPPED) != 0 && + (flags & GB_NOTMAPPED) == 0; + need_kva = (bp->b_flags & (B_KVAALLOC | B_NOTMAPPED)) == + B_NOTMAPPED && (flags & GB_KVAALLOC) != 0; + if (need_mapping || need_kva) { + BUF_CHECK_UNMAPPED(bp); + + if (need_mapping && (bp->b_flags & B_KVAALLOC) != 0) { + bp->b_flags &= ~B_KVAALLOC; + bp->b_kvabase = bp->b_kvaalloc; + atomic_subtract_long(&unmapped_bufspace, + bp->b_kvasize); + goto has_addr; + } + + bsize = vn_isdisk(vp, NULL) ? DEV_BSIZE : bo->bo_bsize; + offset = blkno * bsize; + maxsize = size + (offset & PAGE_MASK); + maxsize = imax(maxsize, bsize); +mapping_loop: + vm_map_lock(buffer_map); + if (vm_map_findspace(buffer_map, + vm_map_min(buffer_map), maxsize, &addr)) { + vm_map_unlock(buffer_map); + scratch_bp = getnewbuf(vp, 0, 0, size, + maxsize, flags | (GB_NOTMAPPED | + GB_KVAALLOC)); + if (scratch_bp == NULL) { + if ((flags & GB_NOWAIT_BD) != 0) { + /* + * XXXKIB: not sure + * what else to do. + */ + panic("GB_NOWAIT_BD and " + "B_NOTMAPPED %p", bp); + } + atomic_add_int(&mappingrestarts, 1); + goto mapping_loop; + } + atomic_subtract_long(&bufspace, bp->b_kvasize); + bufspacewakeup(); + addr = (vm_offset_t)scratch_bp->b_kvaalloc; + maxsize = scratch_bp->b_kvasize; + scratch_bp->b_kvasize = 0; + scratch_bp->b_flags |= B_INVAL | B_NOTMAPPED; + brelse(scratch_bp); + } else { + KASSERT(addr != 0, ("addr == 0")); + vm_map_insert(buffer_map, NULL, 0, addr, + addr + maxsize, VM_PROT_ALL, VM_PROT_ALL, + MAP_NOFAULT); + vm_map_unlock(buffer_map); + } + if (need_mapping) { + bp->b_kvabase = (caddr_t)addr; + bp->b_flags &= ~B_KVAALLOC; + atomic_subtract_long(&unmapped_bufspace, + bp->b_kvasize); + } else /* if (need_kva) */ { + bp->b_kvaalloc = (caddr_t)addr; + bp->b_flags |= B_KVAALLOC; + } + bp->b_kvasize = maxsize; + if (need_mapping) { +has_addr: + bp->b_saveaddr = bp->b_kvabase; + bp->b_data = bp->b_saveaddr; + bp->b_flags &= ~B_NOTMAPPED; + BUF_CHECK_MAPPED(bp); + bpmap_qenter(bp); + } + } + /* * If the size is inconsistant in the VMIO case, we can resize * the buffer. This might lead to B_CACHE getting set or * cleared. If the size has not changed, B_CACHE remains * unchanged from its previous state. */ - if (bp->b_bcount != size) allocbuf(bp, size); @@ -2741,9 +2924,6 @@ loop: } bp->b_flags &= ~B_DONE; } else { - int bsize, maxsize, vmio; - off_t offset; - /* * Buffer is not in-core, create new buffer. The buffer * returned by getnewbuf() is locked. Note that the returned @@ -2759,7 +2939,13 @@ loop: bsize = vn_isdisk(vp, NULL) ? DEV_BSIZE : bo->bo_bsize; offset = blkno * bsize; vmio = vp->v_object != NULL; - maxsize = vmio ? size + (offset & PAGE_MASK) : size; + if (vmio) { + maxsize = size + (offset & PAGE_MASK); + } else { + maxsize = size; + /* Do not allow non-VMIO notmapped buffers. */ + flags &= ~GB_NOTMAPPED; + } maxsize = imax(maxsize, bsize); bp = getnewbuf(vp, slpflag, slptimeo, size, maxsize, flags); @@ -2815,6 +3001,7 @@ loop: KASSERT(bp->b_bufobj->bo_object == NULL, ("ARGH! has b_bufobj->bo_object %p %p\n", bp, bp->b_bufobj->bo_object)); + BUF_CHECK_MAPPED(bp); } allocbuf(bp, size); @@ -2989,10 +3176,14 @@ allocbuf(struct buf *bp, int size) if (desiredpages < bp->b_npages) { vm_page_t m; - pmap_qremove((vm_offset_t)trunc_page( - (vm_offset_t)bp->b_data) + - (desiredpages << PAGE_SHIFT), - (bp->b_npages - desiredpages)); + if ((bp->b_flags & B_NOTMAPPED) == 0) { + BUF_CHECK_MAPPED(bp); + pmap_qremove((vm_offset_t)trunc_page( + (vm_offset_t)bp->b_data) + + (desiredpages << PAGE_SHIFT), + (bp->b_npages - desiredpages)); + } else + BUF_CHECK_UNMAPPED(bp); VM_OBJECT_LOCK(bp->b_bufobj->bo_object); for (i = desiredpages; i < bp->b_npages; i++) { /* @@ -3098,21 +3289,12 @@ allocbuf(struct buf *bp, int size) VM_OBJECT_UNLOCK(obj); /* - * Step 3, fixup the KVM pmap. Remember that - * bp->b_data is relative to bp->b_offset, but - * bp->b_offset may be offset into the first page. + * Step 3, fixup the KVM pmap. */ - - bp->b_data = (caddr_t) - trunc_page((vm_offset_t)bp->b_data); - pmap_qenter( - (vm_offset_t)bp->b_data, - bp->b_pages, - bp->b_npages - ); - - bp->b_data = (caddr_t)((vm_offset_t)bp->b_data | - (vm_offset_t)(bp->b_offset & PAGE_MASK)); + if ((bp->b_flags & B_NOTMAPPED) == 0) + bpmap_qenter(bp); + else + BUF_CHECK_UNMAPPED(bp); } } if (newbsize < bp->b_bufsize) @@ -3122,21 +3304,38 @@ allocbuf(struct buf *bp, int size) return 1; } +extern int inflight_transient_maps; + void biodone(struct bio *bp) { struct mtx *mtxp; void (*done)(struct bio *); + vm_offset_t start, end; + int transient; mtxp = mtx_pool_find(mtxpool_sleep, bp); mtx_lock(mtxp); bp->bio_flags |= BIO_DONE; + if ((bp->bio_flags & BIO_TRANSIENT_MAPPING) != 0) { + start = trunc_page((vm_offset_t)bp->bio_data); + end = round_page((vm_offset_t)bp->bio_data + bp->bio_length); + transient = 1; + } else { + transient = 0; + start = end = 0; + } done = bp->bio_done; if (done == NULL) wakeup(bp); mtx_unlock(mtxp); if (done != NULL) done(bp); + if (transient) { + pmap_qremove(start, OFF_TO_IDX(end - start)); + vm_map_remove(bio_transient_map, start, end); + atomic_add_int(&inflight_transient_maps, -1); + } } /* @@ -3393,9 +3592,11 @@ bufdone_finish(struct buf *bp) } vm_object_pip_wakeupn(obj, 0); VM_OBJECT_UNLOCK(obj); - if (bogus) + if (bogus && (bp->b_flags & B_NOTMAPPED) == 0) { + BUF_CHECK_MAPPED(bp); pmap_qenter(trunc_page((vm_offset_t)bp->b_data), bp->b_pages, bp->b_npages); + } } /* @@ -3438,8 +3639,12 @@ vfs_unbusy_pages(struct buf *bp) if (!m) panic("vfs_unbusy_pages: page missing\n"); bp->b_pages[i] = m; - pmap_qenter(trunc_page((vm_offset_t)bp->b_data), - bp->b_pages, bp->b_npages); + if ((bp->b_flags & B_NOTMAPPED) == 0) { + BUF_CHECK_MAPPED(bp); + pmap_qenter(trunc_page((vm_offset_t)bp->b_data), + bp->b_pages, bp->b_npages); + } else + BUF_CHECK_UNMAPPED(bp); } vm_object_pip_subtract(obj, 1); vm_page_io_finish(m); @@ -3604,9 +3809,11 @@ vfs_busy_pages(struct buf *bp, int clear_modify) foff = (foff + PAGE_SIZE) & ~(off_t)PAGE_MASK; } VM_OBJECT_UNLOCK(obj); - if (bogus) + if (bogus && (bp->b_flags & B_NOTMAPPED) == 0) { + BUF_CHECK_MAPPED(bp); pmap_qenter(trunc_page((vm_offset_t)bp->b_data), bp->b_pages, bp->b_npages); + } } /* @@ -3662,8 +3869,7 @@ vfs_bio_set_valid(struct buf *bp, int base, int size) void vfs_bio_clrbuf(struct buf *bp) { - int i, j, mask; - caddr_t sa, ea; + int i, j, mask, sa, ea, slide; if ((bp->b_flags & (B_VMIO | B_MALLOC)) != B_VMIO) { clrbuf(bp); @@ -3681,39 +3887,69 @@ vfs_bio_clrbuf(struct buf *bp) if ((bp->b_pages[0]->valid & mask) == mask) goto unlock; if ((bp->b_pages[0]->valid & mask) == 0) { - bzero(bp->b_data, bp->b_bufsize); + pmap_zero_page_area(bp->b_pages[0], 0, bp->b_bufsize); bp->b_pages[0]->valid |= mask; goto unlock; } } - ea = sa = bp->b_data; - for(i = 0; i < bp->b_npages; i++, sa = ea) { - ea = (caddr_t)trunc_page((vm_offset_t)sa + PAGE_SIZE); - ea = (caddr_t)(vm_offset_t)ulmin( - (u_long)(vm_offset_t)ea, - (u_long)(vm_offset_t)bp->b_data + bp->b_bufsize); + sa = bp->b_offset & PAGE_MASK; + slide = 0; + for (i = 0; i < bp->b_npages; i++) { + slide = imin(slide + PAGE_SIZE, bp->b_bufsize + sa); + ea = slide & PAGE_MASK; + if (ea == 0) + ea = PAGE_SIZE; if (bp->b_pages[i] == bogus_page) continue; - j = ((vm_offset_t)sa & PAGE_MASK) / DEV_BSIZE; + j = sa / DEV_BSIZE; mask = ((1 << ((ea - sa) / DEV_BSIZE)) - 1) << j; VM_OBJECT_LOCK_ASSERT(bp->b_pages[i]->object, MA_OWNED); if ((bp->b_pages[i]->valid & mask) == mask) continue; if ((bp->b_pages[i]->valid & mask) == 0) - bzero(sa, ea - sa); + pmap_zero_page_area(bp->b_pages[i], sa, ea - sa); else { for (; sa < ea; sa += DEV_BSIZE, j++) { - if ((bp->b_pages[i]->valid & (1 << j)) == 0) - bzero(sa, DEV_BSIZE); + if ((bp->b_pages[i]->valid & (1 << j)) == 0) { + pmap_zero_page_area(bp->b_pages[i], + sa, DEV_BSIZE); + } } } bp->b_pages[i]->valid |= mask; + sa = 0; } unlock: VM_OBJECT_UNLOCK(bp->b_bufobj->bo_object); bp->b_resid = 0; } +void +vfs_bio_bzero_buf(struct buf *bp, int base, int size) +{ + vm_page_t m; + int i, n; + + if ((bp->b_flags & B_NOTMAPPED) == 0) { + BUF_CHECK_MAPPED(bp); + bzero(bp->b_data + base, size); + } else { + BUF_CHECK_UNMAPPED(bp); + n = PAGE_SIZE - (base & PAGE_MASK); + VM_OBJECT_LOCK(bp->b_bufobj->bo_object); + for (i = base / PAGE_SIZE; size > 0 && i < bp->b_npages; ++i) { + m = bp->b_pages[i]; + if (n > size) + n = size; + pmap_zero_page_area(m, base & PAGE_MASK, n); + base += n; + size -= n; + n = PAGE_SIZE; + } + VM_OBJECT_UNLOCK(bp->b_bufobj->bo_object); + } +} + /* * vm_hold_load_pages and vm_hold_free_pages get pages into * a buffers address space. The pages are anonymous and are @@ -3726,6 +3962,8 @@ vm_hold_load_pages(struct buf *bp, vm_offset_t from, vm_offset_t to) vm_page_t p; int index; + BUF_CHECK_MAPPED(bp); + to = round_page(to); from = round_page(from); index = (from - trunc_page((vm_offset_t)bp->b_data)) >> PAGE_SHIFT; @@ -3757,6 +3995,8 @@ vm_hold_free_pages(struct buf *bp, int newbsize) vm_page_t p; int index, newnpages; + BUF_CHECK_MAPPED(bp); + from = round_page((vm_offset_t)bp->b_data + newbsize); newnpages = (from - trunc_page((vm_offset_t)bp->b_data)) >> PAGE_SHIFT; if (bp->b_npages > newnpages) diff --git a/sys/kern/vfs_cluster.c b/sys/kern/vfs_cluster.c index 19ee05f..9aa5ba0 100644 --- a/sys/kern/vfs_cluster.c +++ b/sys/kern/vfs_cluster.c @@ -60,11 +60,11 @@ SYSCTL_INT(_debug, OID_AUTO, rcluster, CTLFLAG_RW, &rcluster, 0, static MALLOC_DEFINE(M_SEGMENT, "cl_savebuf", "cluster_save buffer"); -static struct cluster_save * - cluster_collectbufs(struct vnode *vp, struct buf *last_bp); -static struct buf * - cluster_rbuild(struct vnode *vp, u_quad_t filesize, daddr_t lbn, - daddr_t blkno, long size, int run, struct buf *fbp); +static struct cluster_save *cluster_collectbufs(struct vnode *vp, + struct buf *last_bp, int gbflags); +static struct buf *cluster_rbuild(struct vnode *vp, u_quad_t filesize, + daddr_t lbn, daddr_t blkno, long size, int run, int gbflags, + struct buf *fbp); static void cluster_callback(struct buf *); static int write_behind = 1; @@ -83,15 +83,9 @@ extern vm_page_t bogus_page; * cluster_read replaces bread. */ int -cluster_read(vp, filesize, lblkno, size, cred, totread, seqcount, bpp) - struct vnode *vp; - u_quad_t filesize; - daddr_t lblkno; - long size; - struct ucred *cred; - long totread; - int seqcount; - struct buf **bpp; +cluster_read(struct vnode *vp, u_quad_t filesize, daddr_t lblkno, long size, + struct ucred *cred, long totread, int seqcount, int gbflags, + struct buf **bpp) { struct buf *bp, *rbp, *reqbp; struct bufobj *bo; @@ -117,7 +111,7 @@ cluster_read(vp, filesize, lblkno, size, cred, totread, seqcount, bpp) /* * get the requested block */ - *bpp = reqbp = bp = getblk(vp, lblkno, size, 0, 0, 0); + *bpp = reqbp = bp = getblk(vp, lblkno, size, 0, 0, gbflags); origblkno = lblkno; /* @@ -208,7 +202,7 @@ cluster_read(vp, filesize, lblkno, size, cred, totread, seqcount, bpp) if (ncontig < nblks) nblks = ncontig; bp = cluster_rbuild(vp, filesize, lblkno, - blkno, size, nblks, bp); + blkno, size, nblks, gbflags, bp); lblkno += (bp->b_bufsize / size); } else { bp->b_flags |= B_RAM; @@ -252,14 +246,14 @@ cluster_read(vp, filesize, lblkno, size, cred, totread, seqcount, bpp) if (ncontig) { ncontig = min(ncontig + 1, racluster); rbp = cluster_rbuild(vp, filesize, lblkno, blkno, - size, ncontig, NULL); + size, ncontig, gbflags, NULL); lblkno += (rbp->b_bufsize / size); if (rbp->b_flags & B_DELWRI) { bqrelse(rbp); continue; } } else { - rbp = getblk(vp, lblkno, size, 0, 0, 0); + rbp = getblk(vp, lblkno, size, 0, 0, gbflags); lblkno += 1; if (rbp->b_flags & B_DELWRI) { bqrelse(rbp); @@ -298,14 +292,8 @@ cluster_read(vp, filesize, lblkno, size, cred, totread, seqcount, bpp) * and then parcel them up into logical blocks in the buffer hash table. */ static struct buf * -cluster_rbuild(vp, filesize, lbn, blkno, size, run, fbp) - struct vnode *vp; - u_quad_t filesize; - daddr_t lbn; - daddr_t blkno; - long size; - int run; - struct buf *fbp; +cluster_rbuild(struct vnode *vp, u_quad_t filesize, daddr_t lbn, + daddr_t blkno, long size, int run, int gbflags, struct buf *fbp) { struct bufobj *bo; struct buf *bp, *tbp; @@ -329,7 +317,7 @@ cluster_rbuild(vp, filesize, lbn, blkno, size, run, fbp) tbp = fbp; tbp->b_iocmd = BIO_READ; } else { - tbp = getblk(vp, lbn, size, 0, 0, 0); + tbp = getblk(vp, lbn, size, 0, 0, gbflags); if (tbp->b_flags & B_CACHE) return tbp; tbp->b_flags |= B_ASYNC | B_RAM; @@ -350,9 +338,14 @@ cluster_rbuild(vp, filesize, lbn, blkno, size, run, fbp) * address may not be either. Inherit the b_data offset * from the original buffer. */ - bp->b_data = (char *)((vm_offset_t)bp->b_data | - ((vm_offset_t)tbp->b_data & PAGE_MASK)); bp->b_flags = B_ASYNC | B_CLUSTER | B_VMIO; + if ((gbflags & GB_NOTMAPPED) != 0) { + bp->b_flags |= B_NOTMAPPED; + bp->b_data = unmapped_buf; + } else { + bp->b_data = (char *)((vm_offset_t)bp->b_data | + ((vm_offset_t)tbp->b_data & PAGE_MASK)); + } bp->b_iocmd = BIO_READ; bp->b_iodone = cluster_callback; bp->b_blkno = blkno; @@ -499,8 +492,10 @@ cluster_rbuild(vp, filesize, lbn, blkno, size, run, fbp) bp->b_bufsize, bp->b_kvasize); bp->b_kvasize = bp->b_bufsize; - pmap_qenter(trunc_page((vm_offset_t) bp->b_data), - (vm_page_t *)bp->b_pages, bp->b_npages); + if ((bp->b_flags & B_NOTMAPPED) == 0) { + pmap_qenter(trunc_page((vm_offset_t) bp->b_data), + (vm_page_t *)bp->b_pages, bp->b_npages); + } return (bp); } @@ -523,7 +518,10 @@ cluster_callback(bp) if (bp->b_ioflags & BIO_ERROR) error = bp->b_error; - pmap_qremove(trunc_page((vm_offset_t) bp->b_data), bp->b_npages); + if ((bp->b_flags & B_NOTMAPPED) == 0) { + pmap_qremove(trunc_page((vm_offset_t) bp->b_data), + bp->b_npages); + } /* * Move memory from the large cluster buffer into the component * buffers and mark IO as done on these. @@ -565,18 +563,19 @@ cluster_callback(bp) */ static __inline int -cluster_wbuild_wb(struct vnode *vp, long size, daddr_t start_lbn, int len) +cluster_wbuild_wb(struct vnode *vp, long size, daddr_t start_lbn, int len, + int gbflags) { int r = 0; - switch(write_behind) { + switch (write_behind) { case 2: if (start_lbn < len) break; start_lbn -= len; /* FALLTHROUGH */ case 1: - r = cluster_wbuild(vp, size, start_lbn, len); + r = cluster_wbuild(vp, size, start_lbn, len, gbflags); /* FALLTHROUGH */ default: /* FALLTHROUGH */ @@ -596,7 +595,8 @@ cluster_wbuild_wb(struct vnode *vp, long size, daddr_t start_lbn, int len) * 4. end of a cluster - asynchronously write cluster */ void -cluster_write(struct vnode *vp, struct buf *bp, u_quad_t filesize, int seqcount) +cluster_write(struct vnode *vp, struct buf *bp, u_quad_t filesize, int seqcount, + int gbflags) { daddr_t lbn; int maxclen, cursize; @@ -642,13 +642,13 @@ cluster_write(struct vnode *vp, struct buf *bp, u_quad_t filesize, int seqcount) lbn != vp->v_lastw + 1 || vp->v_clen <= cursize) { if (!async && seqcount > 0) { cluster_wbuild_wb(vp, lblocksize, - vp->v_cstart, cursize); + vp->v_cstart, cursize, gbflags); } } else { struct buf **bpp, **endbp; struct cluster_save *buflist; - buflist = cluster_collectbufs(vp, bp); + buflist = cluster_collectbufs(vp, bp, gbflags); endbp = &buflist->bs_children [buflist->bs_nchildren - 1]; if (VOP_REALLOCBLKS(vp, buflist)) { @@ -667,7 +667,7 @@ cluster_write(struct vnode *vp, struct buf *bp, u_quad_t filesize, int seqcount) if (seqcount > 1) { cluster_wbuild_wb(vp, lblocksize, vp->v_cstart, - cursize); + cursize, gbflags); } } else { /* @@ -715,8 +715,10 @@ cluster_write(struct vnode *vp, struct buf *bp, u_quad_t filesize, int seqcount) * update daemon handle it. */ bdwrite(bp); - if (seqcount > 1) - cluster_wbuild_wb(vp, lblocksize, vp->v_cstart, vp->v_clen + 1); + if (seqcount > 1) { + cluster_wbuild_wb(vp, lblocksize, vp->v_cstart, + vp->v_clen + 1, gbflags); + } vp->v_clen = 0; vp->v_cstart = lbn + 1; } else if (vm_page_count_severe()) { @@ -742,11 +744,8 @@ cluster_write(struct vnode *vp, struct buf *bp, u_quad_t filesize, int seqcount) * the current block (if last_bp == NULL). */ int -cluster_wbuild(vp, size, start_lbn, len) - struct vnode *vp; - long size; - daddr_t start_lbn; - int len; +cluster_wbuild(struct vnode *vp, long size, daddr_t start_lbn, int len, + int gbflags) { struct buf *bp, *tbp; struct bufobj *bo; @@ -832,10 +831,16 @@ cluster_wbuild(vp, size, start_lbn, len) * address may not be either. Inherit the b_data offset * from the original buffer. */ - bp->b_data = (char *)((vm_offset_t)bp->b_data | - ((vm_offset_t)tbp->b_data & PAGE_MASK)); - bp->b_flags |= B_CLUSTER | - (tbp->b_flags & (B_VMIO | B_NEEDCOMMIT)); + if ((gbflags & GB_NOTMAPPED) == 0 || + (tbp->b_flags & B_VMIO) == 0) { + bp->b_data = (char *)((vm_offset_t)bp->b_data | + ((vm_offset_t)tbp->b_data & PAGE_MASK)); + } else { + bp->b_flags |= B_NOTMAPPED; + bp->b_data = unmapped_buf; + } + bp->b_flags |= B_CLUSTER | (tbp->b_flags & (B_VMIO | + B_NEEDCOMMIT)); bp->b_iodone = cluster_callback; pbgetvp(vp, bp); /* @@ -956,8 +961,10 @@ cluster_wbuild(vp, size, start_lbn, len) tbp, b_cluster.cluster_entry); } finishcluster: - pmap_qenter(trunc_page((vm_offset_t) bp->b_data), - (vm_page_t *) bp->b_pages, bp->b_npages); + if ((bp->b_flags & B_NOTMAPPED) == 0) { + pmap_qenter(trunc_page((vm_offset_t) bp->b_data), + (vm_page_t *)bp->b_pages, bp->b_npages); + } if (bp->b_bufsize > bp->b_kvasize) panic( "cluster_wbuild: b_bufsize(%ld) > b_kvasize(%d)\n", @@ -978,9 +985,7 @@ cluster_wbuild(vp, size, start_lbn, len) * Plus add one additional buffer. */ static struct cluster_save * -cluster_collectbufs(vp, last_bp) - struct vnode *vp; - struct buf *last_bp; +cluster_collectbufs(struct vnode *vp, struct buf *last_bp, int gbflags) { struct cluster_save *buflist; struct buf *bp; @@ -993,7 +998,8 @@ cluster_collectbufs(vp, last_bp) buflist->bs_nchildren = 0; buflist->bs_children = (struct buf **) (buflist + 1); for (lbn = vp->v_cstart, i = 0; i < len; lbn++, i++) { - (void) bread(vp, lbn, last_bp->b_bcount, NOCRED, &bp); + (void)bread_gb(vp, lbn, last_bp->b_bcount, NOCRED, + gbflags, &bp); buflist->bs_children[i] = bp; if (bp->b_blkno == bp->b_lblkno) VOP_BMAP(vp, bp->b_lblkno, NULL, &bp->b_blkno, diff --git a/sys/kern/vfs_vnops.c b/sys/kern/vfs_vnops.c index 3f65b05..97db8ab 100644 --- a/sys/kern/vfs_vnops.c +++ b/sys/kern/vfs_vnops.c @@ -1121,6 +1121,45 @@ vn_io_fault_uiomove(char *data, int xfersize, struct uio *uio) return (error); } +int +vn_io_fault_pgmove(vm_page_t ma[], vm_offset_t offset, int xfersize, + struct uio *uio) +{ + struct thread *td; + vm_offset_t iov_base; + int cnt, pgadv; + + td = curthread; + if ((td->td_pflags & TDP_UIOHELD) == 0 || + uio->uio_segflg != UIO_USERSPACE) + return (uiomove_fromphys(ma, offset, xfersize, uio)); + + KASSERT(uio->uio_iovcnt == 1, ("uio_iovcnt %d", uio->uio_iovcnt)); + cnt = xfersize > uio->uio_resid ? uio->uio_resid : xfersize; + iov_base = (vm_offset_t)uio->uio_iov->iov_base; + switch (uio->uio_rw) { + case UIO_WRITE: + pmap_copy_pages(td->td_ma, iov_base & PAGE_MASK, ma, + offset, cnt); + break; + case UIO_READ: + pmap_copy_pages(ma, offset, td->td_ma, iov_base & PAGE_MASK, + cnt); + break; + } + pgadv = ((iov_base + cnt) >> PAGE_SHIFT) - (iov_base >> PAGE_SHIFT); + td->td_ma += pgadv; + KASSERT(td->td_ma_cnt >= pgadv, ("consumed pages %d %d", td->td_ma_cnt, + pgadv)); + td->td_ma_cnt -= pgadv; + uio->uio_iov->iov_base = (char *)(iov_base + cnt); + uio->uio_iov->iov_len -= cnt; + uio->uio_resid -= cnt; + uio->uio_offset += cnt; + return (0); +} + + /* * File table truncate routine. */ diff --git a/sys/sys/bio.h b/sys/sys/bio.h index c016ee6..d121e9a 100644 --- a/sys/sys/bio.h +++ b/sys/sys/bio.h @@ -55,10 +55,13 @@ #define BIO_DONE 0x02 #define BIO_ONQUEUE 0x04 #define BIO_ORDERED 0x08 +#define BIO_NOTMAPPED 0x10 +#define BIO_TRANSIENT_MAPPING 0x20 #ifdef _KERNEL struct disk; struct bio; +struct vm_map; /* Empty classifier tag, to prevent further classification. */ #define BIO_NOTCLASSIFIED (void *)(~0UL) @@ -78,6 +81,8 @@ struct bio { off_t bio_offset; /* Offset into file. */ long bio_bcount; /* Valid bytes in buffer. */ caddr_t bio_data; /* Memory, superblocks, indirect etc. */ + struct vm_page **bio_ma; /* Or unmapped. */ + int bio_ma_offset; /* Offset in the first page of bio_ma. */ int bio_error; /* Errno for BIO_ERROR. */ long bio_resid; /* Remaining I/O in bytes. */ void (*bio_done)(struct bio *); @@ -121,6 +126,8 @@ struct bio_queue_head { struct bio *insert_point; }; +extern struct vm_map *bio_transient_map; + void biodone(struct bio *bp); void biofinish(struct bio *bp, struct devstat *stat, int error); int biowait(struct bio *bp, const char *wchan); diff --git a/sys/sys/buf.h b/sys/sys/buf.h index 418d6c5..792f2b5 100644 --- a/sys/sys/buf.h +++ b/sys/sys/buf.h @@ -117,6 +117,7 @@ struct buf { long b_bufsize; /* Allocated buffer size. */ long b_runningbufspace; /* when I/O is running, pipelining */ caddr_t b_kvabase; /* base kva for buffer */ + caddr_t b_kvaalloc; /* allocated kva for B_KVAALLOC */ int b_kvasize; /* size of kva for buffer */ daddr_t b_lblkno; /* Logical block number. */ struct vnode *b_vp; /* Device vnode. */ @@ -202,8 +203,8 @@ struct buf { #define B_PERSISTENT 0x00000100 /* Perm. ref'ed while EXT2FS mounted. */ #define B_DONE 0x00000200 /* I/O completed. */ #define B_EINTR 0x00000400 /* I/O was interrupted */ -#define B_00000800 0x00000800 /* Available flag. */ -#define B_00001000 0x00001000 /* Available flag. */ +#define B_NOTMAPPED 0x00000800 /* KVA is not mapped. */ +#define B_KVAALLOC 0x00001000 /* But allocated. */ #define B_INVAL 0x00002000 /* Does not contain valid info. */ #define B_00004000 0x00004000 /* Available flag. */ #define B_NOCACHE 0x00008000 /* Do not cache block after use. */ @@ -453,7 +454,9 @@ buf_countdeps(struct buf *bp, int i) */ #define GB_LOCK_NOWAIT 0x0001 /* Fail if we block on a buf lock. */ #define GB_NOCREAT 0x0002 /* Don't create a buf if not found. */ -#define GB_NOWAIT_BD 0x0004 /* Do not wait for bufdaemon */ +#define GB_NOWAIT_BD 0x0004 /* Do not wait for bufdaemon. */ +#define GB_NOTMAPPED 0x0008 /* Do not mmap buffer pages. */ +#define GB_KVAALLOC 0x0010 /* But allocate KVA. */ #ifdef _KERNEL extern int nbuf; /* The number of buffer headers */ @@ -470,6 +473,7 @@ extern struct buf *swbuf; /* Swap I/O buffer headers. */ extern int nswbuf; /* Number of swap I/O buffer headers. */ extern int cluster_pbuf_freecnt; /* Number of pbufs for clusters */ extern int vnode_pbuf_freecnt; /* Number of pbufs for vnode pager */ +extern caddr_t unmapped_buf; void runningbufwakeup(struct buf *); void waitrunningbufspace(void); @@ -480,7 +484,10 @@ int buf_dirty_count_severe(void); void bremfree(struct buf *); void bremfreef(struct buf *); /* XXX Force bremfree, only for nfs. */ #define bread(vp, blkno, size, cred, bpp) \ - breadn_flags(vp, blkno, size, 0, 0, 0, cred, 0, bpp) + breadn_flags(vp, blkno, size, NULL, NULL, 0, cred, 0, bpp) +#define bread_gb(vp, blkno, size, cred, gbflags, bpp) \ + breadn_flags(vp, blkno, size, NULL, NULL, 0, cred, \ + gbflags, bpp) #define breadn(vp, blkno, size, rablkno, rabsize, cnt, cred, bpp) \ breadn_flags(vp, blkno, size, rablkno, rabsize, cnt, cred, 0, bpp) int breadn_flags(struct vnode *, daddr_t, int, daddr_t *, int *, int, @@ -506,9 +513,10 @@ void bufdone_finish(struct buf *); void bd_speedup(void); int cluster_read(struct vnode *, u_quad_t, daddr_t, long, - struct ucred *, long, int, struct buf **); -int cluster_wbuild(struct vnode *, long, daddr_t, int); -void cluster_write(struct vnode *, struct buf *, u_quad_t, int); + struct ucred *, long, int, int, struct buf **); +int cluster_wbuild(struct vnode *, long, daddr_t, int, int); +void cluster_write(struct vnode *, struct buf *, u_quad_t, int, int); +void vfs_bio_bzero_buf(struct buf *bp, int base, int size); void vfs_bio_set_valid(struct buf *, int base, int size); void vfs_bio_clrbuf(struct buf *); void vfs_busy_pages(struct buf *, int clear_modify); diff --git a/sys/sys/mount.h b/sys/sys/mount.h index ed2b002..fceaa10 100644 --- a/sys/sys/mount.h +++ b/sys/sys/mount.h @@ -374,6 +374,7 @@ void __mnt_vnode_markerfree(struct vnode **mvp, struct mount *mp); #define MNTK_VGONE_WAITER 0x00000400 #define MNTK_LOOKUP_EXCL_DOTDOT 0x00000800 #define MNTK_MARKER 0x00001000 +#define MNTK_UNMAPPED_BUFS 0x00002000 #define MNTK_NOASYNC 0x00800000 /* disable async */ #define MNTK_UNMOUNT 0x01000000 /* unmount in progress */ #define MNTK_MWAIT 0x02000000 /* waiting for unmount to finish */ diff --git a/sys/sys/vnode.h b/sys/sys/vnode.h index 42f9e5f..032a7fa 100644 --- a/sys/sys/vnode.h +++ b/sys/sys/vnode.h @@ -687,6 +687,8 @@ int vn_vget_ino(struct vnode *vp, ino_t ino, int lkflags, struct vnode **rvp); int vn_io_fault_uiomove(char *data, int xfersize, struct uio *uio); +int vn_io_fault_pgmove(vm_page_t ma[], vm_offset_t offset, int xfersize, + struct uio *uio); #define vn_rangelock_unlock(vp, cookie) \ rangelock_unlock(&(vp)->v_rl, (cookie), VI_MTX(vp)) diff --git a/sys/ufs/ffs/ffs_alloc.c b/sys/ufs/ffs/ffs_alloc.c index 5ad5775..f5a5253 100644 --- a/sys/ufs/ffs/ffs_alloc.c +++ b/sys/ufs/ffs/ffs_alloc.c @@ -254,7 +254,7 @@ ffs_realloccg(ip, lbprev, bprev, bpref, osize, nsize, flags, cred, bpp) struct buf *bp; struct ufsmount *ump; u_int cg, request, reclaimed; - int error; + int error, gbflags; ufs2_daddr_t bno; static struct timeval lastfail; static int curfail; @@ -265,6 +265,8 @@ ffs_realloccg(ip, lbprev, bprev, bpref, osize, nsize, flags, cred, bpp) fs = ip->i_fs; bp = NULL; ump = ip->i_ump; + gbflags = (flags & BA_NOTMAPPED) != 0 ? GB_NOTMAPPED : 0; + mtx_assert(UFS_MTX(ump), MA_OWNED); #ifdef INVARIANTS if (vp->v_mount->mnt_kern_flag & MNTK_SUSPENDED) @@ -296,7 +298,7 @@ retry: /* * Allocate the extra space in the buffer. */ - error = bread(vp, lbprev, osize, NOCRED, &bp); + error = bread_gb(vp, lbprev, osize, NOCRED, gbflags, &bp); if (error) { brelse(bp); return (error); @@ -332,7 +334,7 @@ retry: ip->i_flag |= IN_CHANGE | IN_UPDATE; allocbuf(bp, nsize); bp->b_flags |= B_DONE; - bzero(bp->b_data + osize, nsize - osize); + vfs_bio_bzero_buf(bp, osize, nsize - osize); if ((bp->b_flags & (B_MALLOC | B_VMIO)) == B_VMIO) vfs_bio_set_valid(bp, osize, nsize - osize); *bpp = bp; @@ -400,7 +402,7 @@ retry: ip->i_flag |= IN_CHANGE | IN_UPDATE; allocbuf(bp, nsize); bp->b_flags |= B_DONE; - bzero(bp->b_data + osize, nsize - osize); + vfs_bio_bzero_buf(bp, osize, nsize - osize); if ((bp->b_flags & (B_MALLOC | B_VMIO)) == B_VMIO) vfs_bio_set_valid(bp, osize, nsize - osize); *bpp = bp; diff --git a/sys/ufs/ffs/ffs_balloc.c b/sys/ufs/ffs/ffs_balloc.c index 0e29be87f..667e101 100644 --- a/sys/ufs/ffs/ffs_balloc.c +++ b/sys/ufs/ffs/ffs_balloc.c @@ -107,7 +107,7 @@ ffs_balloc_ufs1(struct vnode *vp, off_t startoffset, int size, int saved_inbdflush; static struct timeval lastfail; static int curfail; - int reclaimed; + int gbflags, reclaimed; ip = VTOI(vp); dp = ip->i_din1; @@ -123,6 +123,7 @@ ffs_balloc_ufs1(struct vnode *vp, off_t startoffset, int size, return (EOPNOTSUPP); if (lbn < 0) return (EFBIG); + gbflags = (flags & BA_NOTMAPPED) != 0 ? GB_NOTMAPPED : 0; if (DOINGSOFTDEP(vp)) softdep_prealloc(vp, MNT_WAIT); @@ -211,7 +212,7 @@ ffs_balloc_ufs1(struct vnode *vp, off_t startoffset, int size, nsize, flags, cred, &newb); if (error) return (error); - bp = getblk(vp, lbn, nsize, 0, 0, 0); + bp = getblk(vp, lbn, nsize, 0, 0, gbflags); bp->b_blkno = fsbtodb(fs, newb); if (flags & BA_CLRBUF) vfs_bio_clrbuf(bp); @@ -255,7 +256,7 @@ ffs_balloc_ufs1(struct vnode *vp, off_t startoffset, int size, nb = newb; *allocblk++ = nb; *lbns_remfree++ = indirs[1].in_lbn; - bp = getblk(vp, indirs[1].in_lbn, fs->fs_bsize, 0, 0, 0); + bp = getblk(vp, indirs[1].in_lbn, fs->fs_bsize, 0, 0, gbflags); bp->b_blkno = fsbtodb(fs, nb); vfs_bio_clrbuf(bp); if (DOINGSOFTDEP(vp)) { @@ -389,7 +390,7 @@ retry: nb = newb; *allocblk++ = nb; *lbns_remfree++ = lbn; - nbp = getblk(vp, lbn, fs->fs_bsize, 0, 0, 0); + nbp = getblk(vp, lbn, fs->fs_bsize, 0, 0, gbflags); nbp->b_blkno = fsbtodb(fs, nb); if (flags & BA_CLRBUF) vfs_bio_clrbuf(nbp); @@ -418,16 +419,17 @@ retry: if (seqcount && (vp->v_mount->mnt_flag & MNT_NOCLUSTERR) == 0) { error = cluster_read(vp, ip->i_size, lbn, (int)fs->fs_bsize, NOCRED, - MAXBSIZE, seqcount, &nbp); + MAXBSIZE, seqcount, gbflags, &nbp); } else { - error = bread(vp, lbn, (int)fs->fs_bsize, NOCRED, &nbp); + error = bread_gb(vp, lbn, (int)fs->fs_bsize, NOCRED, + gbflags, &nbp); } if (error) { brelse(nbp); goto fail; } } else { - nbp = getblk(vp, lbn, fs->fs_bsize, 0, 0, 0); + nbp = getblk(vp, lbn, fs->fs_bsize, 0, 0, gbflags); nbp->b_blkno = fsbtodb(fs, nb); } curthread_pflags_restore(saved_inbdflush); @@ -539,7 +541,7 @@ ffs_balloc_ufs2(struct vnode *vp, off_t startoffset, int size, int saved_inbdflush; static struct timeval lastfail; static int curfail; - int reclaimed; + int gbflags, reclaimed; ip = VTOI(vp); dp = ip->i_din2; @@ -553,6 +555,7 @@ ffs_balloc_ufs2(struct vnode *vp, off_t startoffset, int size, *bpp = NULL; if (lbn < 0) return (EFBIG); + gbflags = (flags & BA_NOTMAPPED) != 0 ? GB_NOTMAPPED : 0; if (DOINGSOFTDEP(vp)) softdep_prealloc(vp, MNT_WAIT); @@ -603,7 +606,8 @@ ffs_balloc_ufs2(struct vnode *vp, off_t startoffset, int size, panic("ffs_balloc_ufs2: BA_METAONLY for ext block"); nb = dp->di_extb[lbn]; if (nb != 0 && dp->di_extsize >= smalllblktosize(fs, lbn + 1)) { - error = bread(vp, -1 - lbn, fs->fs_bsize, NOCRED, &bp); + error = bread_gb(vp, -1 - lbn, fs->fs_bsize, NOCRED, + gbflags, &bp); if (error) { brelse(bp); return (error); @@ -620,7 +624,8 @@ ffs_balloc_ufs2(struct vnode *vp, off_t startoffset, int size, osize = fragroundup(fs, blkoff(fs, dp->di_extsize)); nsize = fragroundup(fs, size); if (nsize <= osize) { - error = bread(vp, -1 - lbn, osize, NOCRED, &bp); + error = bread_gb(vp, -1 - lbn, osize, NOCRED, + gbflags, &bp); if (error) { brelse(bp); return (error); @@ -653,7 +658,7 @@ ffs_balloc_ufs2(struct vnode *vp, off_t startoffset, int size, nsize, flags, cred, &newb); if (error) return (error); - bp = getblk(vp, -1 - lbn, nsize, 0, 0, 0); + bp = getblk(vp, -1 - lbn, nsize, 0, 0, gbflags); bp->b_blkno = fsbtodb(fs, newb); bp->b_xflags |= BX_ALTDATA; if (flags & BA_CLRBUF) @@ -679,9 +684,9 @@ ffs_balloc_ufs2(struct vnode *vp, off_t startoffset, int size, if (osize < fs->fs_bsize && osize > 0) { UFS_LOCK(ump); error = ffs_realloccg(ip, nb, dp->di_db[nb], - ffs_blkpref_ufs2(ip, lastlbn, (int)nb, - &dp->di_db[0]), osize, (int)fs->fs_bsize, - flags, cred, &bp); + ffs_blkpref_ufs2(ip, lastlbn, (int)nb, + &dp->di_db[0]), osize, (int)fs->fs_bsize, + flags, cred, &bp); if (error) return (error); if (DOINGSOFTDEP(vp)) @@ -707,7 +712,8 @@ ffs_balloc_ufs2(struct vnode *vp, off_t startoffset, int size, panic("ffs_balloc_ufs2: BA_METAONLY for direct block"); nb = dp->di_db[lbn]; if (nb != 0 && ip->i_size >= smalllblktosize(fs, lbn + 1)) { - error = bread(vp, lbn, fs->fs_bsize, NOCRED, &bp); + error = bread_gb(vp, lbn, fs->fs_bsize, NOCRED, + gbflags, &bp); if (error) { brelse(bp); return (error); @@ -723,7 +729,8 @@ ffs_balloc_ufs2(struct vnode *vp, off_t startoffset, int size, osize = fragroundup(fs, blkoff(fs, ip->i_size)); nsize = fragroundup(fs, size); if (nsize <= osize) { - error = bread(vp, lbn, osize, NOCRED, &bp); + error = bread_gb(vp, lbn, osize, NOCRED, + gbflags, &bp); if (error) { brelse(bp); return (error); @@ -733,7 +740,7 @@ ffs_balloc_ufs2(struct vnode *vp, off_t startoffset, int size, UFS_LOCK(ump); error = ffs_realloccg(ip, lbn, dp->di_db[lbn], ffs_blkpref_ufs2(ip, lbn, (int)lbn, - &dp->di_db[0]), osize, nsize, flags, + &dp->di_db[0]), osize, nsize, flags, cred, &bp); if (error) return (error); @@ -753,7 +760,7 @@ ffs_balloc_ufs2(struct vnode *vp, off_t startoffset, int size, &dp->di_db[0]), nsize, flags, cred, &newb); if (error) return (error); - bp = getblk(vp, lbn, nsize, 0, 0, 0); + bp = getblk(vp, lbn, nsize, 0, 0, gbflags); bp->b_blkno = fsbtodb(fs, newb); if (flags & BA_CLRBUF) vfs_bio_clrbuf(bp); @@ -797,7 +804,8 @@ ffs_balloc_ufs2(struct vnode *vp, off_t startoffset, int size, nb = newb; *allocblk++ = nb; *lbns_remfree++ = indirs[1].in_lbn; - bp = getblk(vp, indirs[1].in_lbn, fs->fs_bsize, 0, 0, 0); + bp = getblk(vp, indirs[1].in_lbn, fs->fs_bsize, 0, 0, + GB_NOTMAPPED); bp->b_blkno = fsbtodb(fs, nb); vfs_bio_clrbuf(bp); if (DOINGSOFTDEP(vp)) { @@ -862,7 +870,8 @@ retry: nb = newb; *allocblk++ = nb; *lbns_remfree++ = indirs[i].in_lbn; - nbp = getblk(vp, indirs[i].in_lbn, fs->fs_bsize, 0, 0, 0); + nbp = getblk(vp, indirs[i].in_lbn, fs->fs_bsize, 0, 0, + GB_NOTMAPPED); nbp->b_blkno = fsbtodb(fs, nb); vfs_bio_clrbuf(nbp); if (DOINGSOFTDEP(vp)) { @@ -931,7 +940,7 @@ retry: nb = newb; *allocblk++ = nb; *lbns_remfree++ = lbn; - nbp = getblk(vp, lbn, fs->fs_bsize, 0, 0, 0); + nbp = getblk(vp, lbn, fs->fs_bsize, 0, 0, gbflags); nbp->b_blkno = fsbtodb(fs, nb); if (flags & BA_CLRBUF) vfs_bio_clrbuf(nbp); @@ -966,16 +975,17 @@ retry: if (seqcount && (vp->v_mount->mnt_flag & MNT_NOCLUSTERR) == 0) { error = cluster_read(vp, ip->i_size, lbn, (int)fs->fs_bsize, NOCRED, - MAXBSIZE, seqcount, &nbp); + MAXBSIZE, seqcount, gbflags, &nbp); } else { - error = bread(vp, lbn, (int)fs->fs_bsize, NOCRED, &nbp); + error = bread_gb(vp, lbn, (int)fs->fs_bsize, + NOCRED, gbflags, &nbp); } if (error) { brelse(nbp); goto fail; } } else { - nbp = getblk(vp, lbn, fs->fs_bsize, 0, 0, 0); + nbp = getblk(vp, lbn, fs->fs_bsize, 0, 0, gbflags); nbp->b_blkno = fsbtodb(fs, nb); } curthread_pflags_restore(saved_inbdflush); diff --git a/sys/ufs/ffs/ffs_vfsops.c b/sys/ufs/ffs/ffs_vfsops.c index 83ae202..54dd140 100644 --- a/sys/ufs/ffs/ffs_vfsops.c +++ b/sys/ufs/ffs/ffs_vfsops.c @@ -1076,7 +1076,7 @@ ffs_mountfs(devvp, mp, td) */ MNT_ILOCK(mp); mp->mnt_kern_flag |= MNTK_LOOKUP_SHARED | MNTK_EXTENDED_SHARED | - MNTK_NO_IOPF; + MNTK_NO_IOPF | MNTK_UNMAPPED_BUFS; MNT_IUNLOCK(mp); #ifdef UFS_EXTATTR #ifdef UFS_EXTATTR_AUTOSTART @@ -2095,6 +2095,7 @@ ffs_bufwrite(struct buf *bp) * set b_lblkno and BKGRDMARKER before calling bgetvp() * to avoid confusing the splay tree and gbincore(). */ + KASSERT((bp->b_flags & B_NOTMAPPED) == 0, ("Unmapped cg")); memcpy(newbp->b_data, bp->b_data, bp->b_bufsize); newbp->b_lblkno = bp->b_lblkno; newbp->b_xflags |= BX_BKGRDMARKER; diff --git a/sys/ufs/ffs/ffs_vnops.c b/sys/ufs/ffs/ffs_vnops.c index 5c99d5b..42d5263 100644 --- a/sys/ufs/ffs/ffs_vnops.c +++ b/sys/ufs/ffs/ffs_vnops.c @@ -508,7 +508,8 @@ ffs_read(ap) /* * Don't do readahead if this is the end of the file. */ - error = bread(vp, lbn, size, NOCRED, &bp); + error = bread_gb(vp, lbn, size, NOCRED, + GB_NOTMAPPED, &bp); } else if ((vp->v_mount->mnt_flag & MNT_NOCLUSTERR) == 0) { /* * Otherwise if we are allowed to cluster, @@ -518,7 +519,8 @@ ffs_read(ap) * doing sequential access. */ error = cluster_read(vp, ip->i_size, lbn, - size, NOCRED, blkoffset + uio->uio_resid, seqcount, &bp); + size, NOCRED, blkoffset + uio->uio_resid, + seqcount, GB_NOTMAPPED, &bp); } else if (seqcount > 1) { /* * If we are NOT allowed to cluster, then @@ -529,15 +531,16 @@ ffs_read(ap) * the 6th argument. */ int nextsize = blksize(fs, ip, nextlbn); - error = breadn(vp, lbn, - size, &nextlbn, &nextsize, 1, NOCRED, &bp); + error = breadn_flags(vp, lbn, size, &nextlbn, + &nextsize, 1, NOCRED, GB_NOTMAPPED, &bp); } else { /* * Failing all of the above, just read what the * user asked for. Interestingly, the same as * the first option above. */ - error = bread(vp, lbn, size, NOCRED, &bp); + error = bread_gb(vp, lbn, size, NOCRED, + GB_NOTMAPPED, &bp); } if (error) { brelse(bp); @@ -568,8 +571,13 @@ ffs_read(ap) xfersize = size; } - error = vn_io_fault_uiomove((char *)bp->b_data + blkoffset, - (int)xfersize, uio); + if ((bp->b_flags & B_NOTMAPPED) == 0) { + error = vn_io_fault_uiomove((char *)bp->b_data + + blkoffset, (int)xfersize, uio); + } else { + error = vn_io_fault_pgmove(bp->b_pages, blkoffset, + (int)xfersize, uio); + } if (error) break; @@ -700,6 +708,7 @@ ffs_write(ap) flags = seqcount << BA_SEQSHIFT; if ((ioflag & IO_SYNC) && !DOINGASYNC(vp)) flags |= IO_SYNC; + flags |= BA_NOTMAPPED; for (error = 0; uio->uio_resid > 0;) { lbn = lblkno(fs, uio->uio_offset); @@ -739,8 +748,13 @@ ffs_write(ap) if (size < xfersize) xfersize = size; - error = vn_io_fault_uiomove((char *)bp->b_data + blkoffset, - (int)xfersize, uio); + if ((bp->b_flags & B_NOTMAPPED) == 0) { + error = vn_io_fault_uiomove((char *)bp->b_data + + blkoffset, (int)xfersize, uio); + } else { + error = vn_io_fault_pgmove(bp->b_pages, blkoffset, + (int)xfersize, uio); + } /* * If the buffer is not already filled and we encounter an * error while trying to fill it, we have to clear out any @@ -783,7 +797,8 @@ ffs_write(ap) } else if (xfersize + blkoffset == fs->fs_bsize) { if ((vp->v_mount->mnt_flag & MNT_NOCLUSTERW) == 0) { bp->b_flags |= B_CLUSTEROK; - cluster_write(vp, bp, ip->i_size, seqcount); + cluster_write(vp, bp, ip->i_size, seqcount, + GB_NOTMAPPED); } else { bawrite(bp); } diff --git a/sys/ufs/ufs/ufs_extern.h b/sys/ufs/ufs/ufs_extern.h index c590748..82973a2 100644 --- a/sys/ufs/ufs/ufs_extern.h +++ b/sys/ufs/ufs/ufs_extern.h @@ -121,6 +121,7 @@ void softdep_revert_rmdir(struct inode *, struct inode *); */ #define BA_CLRBUF 0x00010000 /* Clear invalid areas of buffer. */ #define BA_METAONLY 0x00020000 /* Return indirect block buffer. */ +#define BA_NOTMAPPED 0x00040000 /* Do not mmap resulted buffer. */ #define BA_SEQMASK 0x7F000000 /* Bits holding seq heuristic. */ #define BA_SEQSHIFT 24 #define BA_SEQMAX 0x7F diff --git a/sys/vm/pmap.h b/sys/vm/pmap.h index d06c22b..c64a549 100644 --- a/sys/vm/pmap.h +++ b/sys/vm/pmap.h @@ -108,6 +108,8 @@ void pmap_clear_modify(vm_page_t m); void pmap_clear_reference(vm_page_t m); void pmap_copy(pmap_t, pmap_t, vm_offset_t, vm_size_t, vm_offset_t); void pmap_copy_page(vm_page_t, vm_page_t); +void pmap_copy_pages(vm_page_t ma[], vm_offset_t a_offset, + vm_page_t mb[], vm_offset_t b_offset, int xfersize); void pmap_enter(pmap_t, vm_offset_t, vm_prot_t, vm_page_t, vm_prot_t, boolean_t); void pmap_enter_object(pmap_t pmap, vm_offset_t start, diff --git a/sys/vm/swap_pager.c b/sys/vm/swap_pager.c index 44bff25..95f4707 100644 --- a/sys/vm/swap_pager.c +++ b/sys/vm/swap_pager.c @@ -758,6 +758,16 @@ swp_pager_strategy(struct buf *bp) TAILQ_FOREACH(sp, &swtailq, sw_list) { if (bp->b_blkno >= sp->sw_first && bp->b_blkno < sp->sw_end) { mtx_unlock(&sw_dev_mtx); + if ((sp->sw_flags & SW_NOTMAPPED) != 0) { + bp->b_kvaalloc = bp->b_data; + bp->b_data = unmapped_buf; + bp->b_kvabase = unmapped_buf; + bp->b_offset = 0; + bp->b_flags |= B_NOTMAPPED; + } else { + pmap_qenter((vm_offset_t)bp->b_data, + &bp->b_pages[0], bp->b_bcount / PAGE_SIZE); + } sp->sw_strategy(bp, sp); return; } @@ -1155,11 +1165,6 @@ swap_pager_getpages(vm_object_t object, vm_page_t *m, int count, int reqpage) bp = getpbuf(&nsw_rcount); bp->b_flags |= B_PAGING; - /* - * map our page(s) into kva for input - */ - pmap_qenter((vm_offset_t)bp->b_data, m + i, j - i); - bp->b_iocmd = BIO_READ; bp->b_iodone = swp_pager_async_iodone; bp->b_rcred = crhold(thread0.td_ucred); @@ -1371,8 +1376,6 @@ swap_pager_putpages(vm_object_t object, vm_page_t *m, int count, bp->b_flags |= B_PAGING; bp->b_iocmd = BIO_WRITE; - pmap_qenter((vm_offset_t)bp->b_data, &m[i], n); - bp->b_rcred = crhold(thread0.td_ucred); bp->b_wcred = crhold(thread0.td_ucred); bp->b_bcount = PAGE_SIZE * n; @@ -1484,7 +1487,12 @@ swp_pager_async_iodone(struct buf *bp) /* * remove the mapping for kernel virtual */ - pmap_qremove((vm_offset_t)bp->b_data, bp->b_npages); + if ((bp->b_flags & B_NOTMAPPED) != 0) { + bp->b_data = bp->b_kvaalloc; + bp->b_kvabase = bp->b_kvaalloc; + bp->b_flags &= ~B_NOTMAPPED; + } else + pmap_qremove((vm_offset_t)bp->b_data, bp->b_npages); if (bp->b_npages) { object = bp->b_pages[0]->object; @@ -2144,7 +2152,8 @@ swapon_check_swzone(unsigned long npages) } static void -swaponsomething(struct vnode *vp, void *id, u_long nblks, sw_strategy_t *strategy, sw_close_t *close, dev_t dev) +swaponsomething(struct vnode *vp, void *id, u_long nblks, + sw_strategy_t *strategy, sw_close_t *close, dev_t dev, int flags) { struct swdevt *sp, *tsp; swblk_t dvbase; @@ -2180,6 +2189,7 @@ swaponsomething(struct vnode *vp, void *id, u_long nblks, sw_strategy_t *strateg sp->sw_used = 0; sp->sw_strategy = strategy; sp->sw_close = close; + sp->sw_flags = flags; sp->sw_blist = blist_create(nblks, M_WAITOK); /* @@ -2537,10 +2547,18 @@ swapgeom_strategy(struct buf *bp, struct swdevt *sp) bio->bio_caller2 = bp; bio->bio_cmd = bp->b_iocmd; - bio->bio_data = bp->b_data; bio->bio_offset = (bp->b_blkno - sp->sw_first) * PAGE_SIZE; bio->bio_length = bp->b_bcount; bio->bio_done = swapgeom_done; + if ((bp->b_flags & B_NOTMAPPED) != 0) { + bio->bio_ma = bp->b_pages; + bio->bio_data = unmapped_buf; + bio->bio_ma_offset = (vm_offset_t)bp->b_offset & PAGE_MASK; + bio->bio_flags |= BIO_NOTMAPPED; + } else { + bio->bio_data = bp->b_data; + bio->bio_ma = NULL; + } g_io_request(bio, cp); return; } @@ -2630,9 +2648,9 @@ swapongeom_ev(void *arg, int flags) } nblks = pp->mediasize / DEV_BSIZE; swaponsomething(swh->vp, cp, nblks, swapgeom_strategy, - swapgeom_close, dev2udev(swh->dev)); + swapgeom_close, dev2udev(swh->dev), + (pp->flags & G_PF_ACCEPT_UNMAPPED) != 0 ? SW_NOTMAPPED : 0); swh->error = 0; - return; } static int @@ -2721,6 +2739,6 @@ swaponvp(struct thread *td, struct vnode *vp, u_long nblks) return (error); swaponsomething(vp, vp, nblks, swapdev_strategy, swapdev_close, - NODEV); + NODEV, 0); return (0); } diff --git a/sys/vm/swap_pager.h b/sys/vm/swap_pager.h index 5c716d9..bd6d8e3 100644 --- a/sys/vm/swap_pager.h +++ b/sys/vm/swap_pager.h @@ -68,6 +68,7 @@ struct swdevt { sw_close_t *sw_close; }; +#define SW_NOTMAPPED 0x01 #define SW_CLOSING 0x04 #ifdef _KERNEL diff --git a/sys/vm/vm.h b/sys/vm/vm.h index 132c10e..106c510 100644 --- a/sys/vm/vm.h +++ b/sys/vm/vm.h @@ -136,6 +136,8 @@ struct kva_md_info { vm_offset_t clean_eva; vm_offset_t pager_sva; vm_offset_t pager_eva; + vm_offset_t bio_transient_sva; + vm_offset_t bio_transient_eva; }; extern struct kva_md_info kmi; diff --git a/sys/vm/vm_init.c b/sys/vm/vm_init.c index c507691..c571d4e 100644 --- a/sys/vm/vm_init.c +++ b/sys/vm/vm_init.c @@ -186,10 +186,14 @@ again: panic("startup: table size inconsistency"); clean_map = kmem_suballoc(kernel_map, &kmi->clean_sva, &kmi->clean_eva, - (long)nbuf * BKVASIZE + (long)nswbuf * MAXPHYS, TRUE); + (long)nbuf * BKVASIZE + (long)nswbuf * MAXPHYS + + (long)/*XXXKIB*/1024 * MAXPHYS, TRUE); buffer_map = kmem_suballoc(clean_map, &kmi->buffer_sva, &kmi->buffer_eva, (long)nbuf * BKVASIZE, FALSE); buffer_map->system_map = 1; + bio_transient_map = kmem_suballoc(clean_map, &kmi->bio_transient_sva, + &kmi->bio_transient_eva, /*XXXKIB*/1024 * MAXPHYS, FALSE); + bio_transient_map->system_map = 1; pager_map = kmem_suballoc(clean_map, &kmi->pager_sva, &kmi->pager_eva, (long)nswbuf * MAXPHYS, FALSE); pager_map->system_map = 1; diff --git a/sys/vm/vm_kern.c b/sys/vm/vm_kern.c index f731895..1d78a7d 100644 --- a/sys/vm/vm_kern.c +++ b/sys/vm/vm_kern.c @@ -85,11 +85,12 @@ __FBSDID("$FreeBSD$"); #include #include -vm_map_t kernel_map=0; -vm_map_t kmem_map=0; -vm_map_t exec_map=0; +vm_map_t kernel_map; +vm_map_t kmem_map; +vm_map_t exec_map; vm_map_t pipe_map; -vm_map_t buffer_map=0; +vm_map_t buffer_map; +vm_map_t bio_transient_map; const void *zero_region; CTASSERT((ZERO_REGION_SIZE & PAGE_MASK) == 0); diff --git a/sys/vm/vnode_pager.c b/sys/vm/vnode_pager.c index a6d78f4..0031b9f 100644 --- a/sys/vm/vnode_pager.c +++ b/sys/vm/vnode_pager.c @@ -697,6 +697,7 @@ vnode_pager_generic_getpages(vp, m, bytecount, reqpage) int runpg; int runend; struct buf *bp; + struct mount *mp; int count; int error; @@ -899,12 +900,22 @@ vnode_pager_generic_getpages(vp, m, bytecount, reqpage) } bp = getpbuf(&vnode_pbuf_freecnt); - kva = (vm_offset_t) bp->b_data; + kva = (vm_offset_t)bp->b_data; /* - * and map the pages to be read into the kva + * and map the pages to be read into the kva, if the filesystem + * requires mapped buffers. */ - pmap_qenter(kva, m, count); + mp = vp->v_mount; + if (mp != NULL && (mp->mnt_kern_flag & MNTK_UNMAPPED_BUFS) != 0) { + bp->b_data = unmapped_buf; + bp->b_kvabase = unmapped_buf; + bp->b_offset = 0; + bp->b_flags |= B_NOTMAPPED; + for (i = 0; i < count; i++) + bp->b_pages[i] = m[i]; + } else + pmap_qenter(kva, m, count); /* build a minimal buffer header */ bp->b_iocmd = BIO_READ; @@ -933,11 +944,17 @@ vnode_pager_generic_getpages(vp, m, bytecount, reqpage) if ((bp->b_ioflags & BIO_ERROR) != 0) error = EIO; - if (!error) { - if (size != count * PAGE_SIZE) - bzero((caddr_t) kva + size, PAGE_SIZE * count - size); + if (mp != NULL && (mp->mnt_kern_flag & MNTK_UNMAPPED_BUFS) != 0) { + bp->b_data = (caddr_t)kva; + bp->b_kvabase = (caddr_t)kva; + bp->b_flags &= ~B_NOTMAPPED; + for (i = 0; i < count; i++) + bp->b_pages[i] = NULL; + } else { + if (error != 0 && size != count * PAGE_SIZE) + bzero((caddr_t)kva + size, PAGE_SIZE * count - size); + pmap_qremove(kva, count); } - pmap_qremove(kva, count); /* * free the buffer header back to the swap buffer pool -- Test scenario: linger3.sh