GENERIC HEAD from 2018-04-19 05:06:56 UTC, r332760M, vmcore.1090 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb MP Table Default Configuration 173 is unsupported Copyright (c) 1992-2018 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 12.0-CURRENT #0 r332760M: Thu Apr 19 10:34:18 CEST 2018 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 FreeBSD clang version 6.0.0 (tags/RELEASE_600/final 326565) (based on LLVM 6.0.0) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Entering uma_startup with 10 boot pages configured startup_alloc from "UMA Kegs", 9 boot pages left startup_alloc from "UMA Zones", 8 boot pages left startup_alloc from "UMA Hash", 7 boot pages left startup_alloc from "UMA Zones", 6 boot pages left startup_alloc from "vmem btag", 5 boot pages left startup_alloc from "MAP", 4 boot pages left startup_alloc from "UMA Kegs", 3 boot pages left startup_alloc from "KMAP ENTRY", 2 boot pages left startup_alloc from "vmem", 1 boot pages left Entering uma_startup2 with 0 boot pages left VT(vga): resolution 640x480 CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin="AuthenticAMD" Id=0x100f23 Family=0x10 Model=0x2 Stepping=3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff SVM: NP,NAsids=64 TSC: P-state invariant real memory = 8589934592 (8192 MB) avail memory = 3526582272 (3363 MB) : Trying to mount root from ufs:/dev/ada0s1a [rw]... WARNING: DIAGNOSTIC option enabled, expect reduced performance. uhub2: 2 ports with 2 removable, self powered uhub3: 2 ports with 2 removable, self powered uhub1: 2 ports with 2 removable, self powered uhub0: 2 ports with 2 removable, self powered uhub4: 2 ports with 2 removable, self powered Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. eval: limits: not found /etc/rc: WARNING: failed to start ddb warning: total configured swap (4194304 pages) exceeds maximum recommended amount (1724580 pages). warning: increase kern.maxswzone or reduce amount of swap. Starting file system checks: /dev/ada0s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1a: clean, 648190 free (3566 frags, 80578 blocks, 0.4% fragmentation) /dev/ada0s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1f: clean, 834552 free (11168 frags, 102923 blocks, 1.1% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 45002722 free (43090 frags, 5619954 blocks, 0.0% fragmentation) /dev/ada0s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1d: clean, 2073484 free (324628 frags, 218607 blocks, 3.2% fragmentation) /dev/ada0s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1e: clean, 3113502 free (155342 frags, 369770 blocks, 0.6% fragmentation) Mounting local filesystems:. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/arduino/lib /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/gcc49 /usr/local/lib/mysql /usr/local/lib/nss /usr/local/lib/perl5/5.24/mach/CORE /usr/local/lib/pth /usr/local/lib/qt4 /usr/local/llvm37/lib /usr/local/llvm39/lib a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Setting hostname: x4.osted.lan. Setting up harvesting: [UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,NET_ETHER,NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: uhub5: 10 ports with 10 removable, self powered . re0: link state changed to DOWN Starting Network: lo0 re0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 groups: lo re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 nd6 options=29 media: Ethernet autoselect (none) status: no carrier Starting devd. add host 127.0.0.1: gateway lo0 fib 0: route already in table add net default: gateway 192.168.1.1 add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Starting rpcbind. NFS access cache time=60 Starting watchdogd. No core dumps found. Additional ABI support: linux. lock order reversal: 1st 0xbc82148 bufwait (bufwait) @ kern/vfs_bio.c:3893 2nd 0x1b24e600 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:289 stack backtrace: #0 0x11117a1 at witness_debugger+0x81 #1 0x1111668 at witness_checkorder+0xcd8 #2 0x10b16e4 at _sx_xlock+0x64 #3 0x13cf5a3 at ufsdirhash_add+0x53 #4 0x13d410f at ufs_direnter+0x4df #5 0x13dd292 at ufs_mkdir+0x852 #6 0x16b4ef6 at VOP_MKDIR_APV+0xf6 #7 0x118f0ae at kern_mkdirat+0x21e #8 0x118ee81 at sys_mkdir+0x31 #9 0x168133e at syscall+0x6ee #10 0xffc032c0 at PTDpde+0x42c8 Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Starting statd. Starting lockd. Recovering vi editor sessions:. Updating motd:. Mounting late filesystems:. Starting ntpd. Starting powerd. Starting smartd. Apr 19 10:50:49 x4 smartd[639]: Device: /dev/ada0, WARNING: A firmware update for this drive may be available, Apr 19 10:50:49 x4 smartd[639]: see the following Seagate web pages: Apr 19 10:50:49 x4 smartd[639]: http://knowledge.seagate.com/articles/en_US/FAQ/207931en Apr 19 10:50:49 x4 smartd[639]: http://knowledge.seagate.com/articles/en_US/FAQ/213891en Configuring vt: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting sendmail_submit. Starting sendmail_msp_queue. Starting cron. Local package initialization: backup. Starting nfscbd. Starting default mousedmoused: unable to open /dev/psm0: No such file or directory . Starting inetd. Thu Apr 19 10:50 FreeBSD/i386 (x4.osted.lan) (ttyu0) login: Apr 19 11:11:10 x4 su: pho to root on /dev/pts/1 20180419 11:11:27 all (1/566): 1st.sh 20180419 11:11:31 all (2/566): 256m.sh 20180419 11:11:33 all (3/566): advlock.sh lock order reversal: 1st 0x1f5338bc ufs (ufs) @ kern/vfs_mount.c:1335 2nd 0x219a58bc devfs (devfs) @ ufs/ffs/ffs_vfsops.c:1371 stack backtrace: #0 0x11117a1 at witness_debugger+0x81 #1 0x1111668 at witness_checkorder+0xcd8 #2 0x107adc5 at lockmgr_lock_fast_path+0x195 #3 0x116bc3b at vop_stdlock+0x3b #4 0x16b5cfa at VOP_LOCK1_APV+0xda #5 0x1192661 at _vn_lock+0x61 #6 0x13c46ad at ffs_flushfiles+0xcd #7 0x13a6d87 at softdep_flushfiles+0x67 #8 0x13c73e8 at ffs_unmount+0xe8 #9 0x1176263 at dounmount+0x583 #10 0x1175bd5 at sys_unmount+0x315 #11 0x168133e at syscall+0x6ee #12 0xffc032c0 at PTDpde+0x42c8 20180419 11:12:41 all (4/566): alternativeFlushPath.sh lock order reversal: 1st 0x219a5d00 ufs (ufs) @ kern/vfs_lookup.c:871 2nd 0xbd99b58 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:282 3rd 0x218edb94 ufs (ufs) @ kern/vfs_subr.c:2570 stack backtrace: #0 0x11117a1 at witness_debugger+0x81 #1 0x1111668 at witness_checkorder+0xcd8 #2 0x107b24b at lockmgr_xlock_hard+0x5b #3 0x107ba7f at __lockmgr_args+0x3df #4 0x13c9b67 at ffs_lock+0xa7 #5 0x16b5cfa at VOP_LOCK1_APV+0xda #6 0x1192661 at _vn_lock+0x61 #7 0x117e591 at vget+0xc1 #8 0x116fb12 at vfs_hash_get+0xd2 #9 0x13c4844 at ffs_vgetf+0x44 #10 0x13b9d7f at softdep_sync_buf+0xa7f #11 0x13caa0f at ffs_syncvnode+0x2df #12 0x13c99d6 at ffs_fsync+0x26 #13 0x16b46f6 at VOP_FSYNC_APV+0xf6 #14 0x13d44cd at ufs_direnter+0x89d #15 0x13de094 at ufs_makeinode+0x5a4 #16 0x13d9bc8 at ufs_create+0x38 #17 0x16b2736 at VOP_CREATE_APV+0xf6 freework leak: 5/19. 20180419 11:33:51 all (5/566): audit.sh 20180419 11:33:56 all (6/566): bench.sh mount leak: 5/102 20180419 11:36:36 all (7/566): bio.sh lock order reversal: 1st 0x1feaba28 syncer (syncer) @ kern/vfs_subr.c:2151 2nd 0x22d09d00 ufs (ufs) @ kern/vfs_subr.c:2570 stack backtrace: #0 0x11117a1 at witness_debugger+0x81 #1 0x1111668 at witness_checkorder+0xcd8 #2 0x107b24b at lockmgr_xlock_hard+0x5b #3 0x107ba7f at __lockmgr_args+0x3df #4 0x13c9b67 at ffs_lock+0xa7 #5 0x16b5cfa at VOP_LOCK1_APV+0xda #6 0x1192661 at _vn_lock+0x61 #7 0x117e591 at vget+0xc1 #8 0x1180a6a at vfs_msync+0xaa #9 0x11862d2 at sync_fsync+0xe2 #10 0x16b46f6 at VOP_FSYNC_APV+0xf6 #11 0x1183db6 at sched_sync+0x2b6 #12 0x1065d9e at fork_exit+0x7e #13 0xffc032d2 at PTDpde+0x42da mount leak: 1/103 20180419 11:43:47 all (8/566): buildworld.sh lock order reversal: 1st 0x2025b80 cpslk (cpslk) @ i386/i386/copyout.c:128 2nd 0xbc0f1c4 bufwait (bufwait) @ vm/vm_pager.c:374 stack backtrace: #0 0x11117a1 at witness_debugger+0x81 #1 0x1111668 at witness_checkorder+0xcd8 #2 0x107b24b at lockmgr_xlock_hard+0x5b #3 0x107ba7f at __lockmgr_args+0x3df #4 0x141114c at getpbuf+0x22c #5 0x13e0719 at swap_pager_getpages+0x39 #6 0x1410c43 at vm_pager_get_pages+0x53 #7 0x13ee0e6 at vm_fault_hold+0xe26 #8 0x13ed283 at vm_fault+0x83 #9 0x16808ee at trap_pfault+0xfe #10 0x167fe5c at trap+0x3ec #11 0xffc0311c at PTDpde+0x4124 #12 0x1667331 at copyin_slow0+0x21 #13 0x166701a at cp_slow0+0x14a #14 0x16672e3 at copyin+0xc3 #15 0x1109cd3 at uiomove_faultflag+0x123 #16 0x1109b9f at uiomove+0x1f #17 0x1119a6c at pipe_write+0x8cc freework leak: 1/20. mount leak: 1/104 20180419 12:04:23 all (9/566): buildworld2.sh 20180419 12:04:26 all (10/566): burnin.sh mount leak: 1/105 20180419 12:25:44 all (11/566): callout_reset_on.sh Expensive timeout(9) function: 0xdb7580(0x1ac9b000) 0.010184752 s 20180419 12:29:10 all (12/566): callout_reset_on2.sh 20180419 12:39:21 all (13/566): churn.sh 20180419 12:49:25 all (14/566): cluster.sh newblk leak: 1267/1282. 20180419 13:10:13 all (15/566): cmp.sh mount leak: 313/418 20180419 13:14:41 all (16/566): context.sh Apr 19 13:15:03 x4 kernel: pid 86225 (swap), uid 0, was killed: out of swap space 20180419 13:19:46 all (17/566): context2.sh 20180419 13:24:49 all (18/566): contigmalloc.sh Apr 19 13:26:48 x4 kernel: pid 608 (ntpd), uid 0, was killed: out of swap space Apr 19 13:26:51 x4 kernel: pid 1075 (top), uid 1001, was killed: out of swap space Apr 19 13:26:57 x4 kernel: pid 337 (devd), uid 0, was killed: out of swap space Apr 19 13:26:58 x4 kernel: pid 2530 (bash), uid 0, was killed: out of swap space Apr 19 13:27:01 x4 kernel: pid 2528 (csh), uid 0, was killed: out of swap space Apr 19 13:27:04 x4 kernel: pid 641 (smartd), uid 0, was killed: out of swap space Apr 19 13:27:05 x4 kernel: pid 682 (sendmail), uid 0, was killed: out of swap space Apr 19 13:27:06 x4 kernel: pid 556 (mountd), uid 0, was killed: out of swap space Apr 19 13:27:08 x4 kernel: pid 685 (sendmail), uid 25, was killed: out of swap space Apr 19 13:27:11 x4 kernel: pid 2519 (bash), uid 1001, was killed: out of swap space 20180419 13:27:14 all (19/566): contigmalloc2.sh 20180419 13:27:26 all (20/566): core.sh 20180419 13:30:03 all (21/566): core2.sh 20180419 13:32:23 all (22/566): core3.sh Apr 19 13:32:30 x4 kernel: Failed to write core file for process core3 (error 5) Apr 19 13:33:01 x4 last message repeated 7943 times Apr 19 13:35:02 x4 last message repeated 34063 times Apr 19 13:42:29 x4 last message repeated 125059 times GEOM leak: 605/858 20180419 13:52:31 all (23/566): core4.sh Apr 19 13:52:34 x4 kernel: Failed to write core file for process core4 (error 5) 20180419 13:52:55 all (24/566): core5.sh Apr 19 13:52:53 x4 last message repeated 59 times lock order reversal: 1st 0x1f091a90 filedesc structure (filedesc structure) @ kern/kern_descrip.c:846 2nd 0x1f0ae1a0 ufs (ufs) @ kern/vfs_subr.c:5023 stack backtrace: #0 0x11117a1 at witness_debugger+0x81 #1 0x1111668 at witness_checkorder+0xcd8 #2 0x107b24b at lockmgr_xlock_hard+0x5b #3 0x107ba7f at __lockmgr_args+0x3df #4 0x13c9b67 at ffs_lock+0xa7 #5 0x16b5cfa at VOP_LOCK1_APV+0xda #6 0x1192661 at _vn_lock+0x61 #7 0x1180ef9 at vfs_knllock+0x29 #8 0x105aa19 at knlist_remove_kq+0x99 #9 0x105a96f at knlist_remove+0x1f #10 0x11866df at filt_vfsdetach+0x2f #11 0x105b603 at knote_fdclose+0x123 #12 0x104d953 at closefp+0x63 #13 0x104b8ef at kern_dup+0x61f #14 0x104b2c1 at sys_dup2+0x31 #15 0x168133e at syscall+0x6ee #16 0xffc032c0 at PTDpde+0x42c8 20180419 14:03:03 all (25/566): cpuset.sh 20180419 14:03:05 all (26/566): credleak.sh 20180419 14:04:03 all (27/566): crossmp.sh freework leak: 179/199. 20180419 14:29:49 all (28/566): crossmp10.sh 20180419 14:35:06 all (29/566): crossmp11.sh Apr 19 14:35:33 x4 kernel: pid 25436 (rw), uid 1004 inumber 73739 on /mnt11: filesystem full Apr 19 14:36:04 x4 kernel: pid 25430 (rw), uid 1004 inumber 73735 on /mnt11: filesystem full Apr 19 14:36:23 x4 kernel: pid 25346 (rw), uid 1004 inumber 73746 on /mnt10: filesystem full Apr 19 14:36:23 x4 kernel: pid 25338 (mkdir), uid 1004 inumber 88 on /mnt10: filesystem full Apr 19 14:36:31 x4 kernel: pid 25449 (rw), uid 1004 inumber 24587 on /mnt12: filesystem full Apr 19 14:36:41 x4 kernel: pid 25431 (rw), uid 1004 inumber 15 on /mnt11: filesystem full Apr 19 14:36:41 x4 kernel: pid 25458 (mkdir), uid 1004 inumber 49162 on /mnt11: filesystem full Apr 19 14:36:50 x4 kernel: pid 25445 (rw), uid 1004 inumber 24585 on /mnt12: filesystem full Apr 19 14:37:09 x4 kernel: pid 25504 (rw), uid 1004 inumber 73733 on /mnt13: filesystem full Apr 19 14:37:09 x4 kernel: pid 25488 (creat), uid 1004 inumber 49158 on /mnt13: filesystem full Apr 19 14:39:04 x4 kernel: pid 26642 (rw), uid 1004 inumber 49316 on /mnt13: filesystem full Apr 19 14:39:04 x4 kernel: pid 26600 (mkdir), uid 1004 inumber 6 on /mnt13: filesystem full Apr 19 14:39:05 x4 kernel: pid 26611 (mkdir), uid 1004 inumber 73746 on /mnt13: filesystem full Apr 19 14:39:06 x4 kernel: pid 26629 (rw), uid 1004 inumber 24602 on /mnt13: filesystem full Apr 19 14:39:19 x4 kernel: pid 26578 (rw), uid 1004 inumber 49154 on /mnt12: filesystem full Apr 19 14:39:25 x4 kernel: pid 26876 (rw), uid 1004 inumber 25509 on /mnt10: filesystem full Apr 19 14:40:32 x4 kernel: pid 26644 (rw), uid 1004 inumber 24583 on /mnt13: filesystem full Apr 19 14:40:51 x4 kernel: pid 28191 (rw), uid 1004 inumber 24592 on /mnt10: filesystem full Apr 19 14:40:51 x4 kernel: pid 28225 (mkdir), uid 1004 inumber 73729 on /mnt10: filesystem full Apr 19 14:42:28 x4 kernel: pid 28336 (rw), uid 1004 inumber 24586 on /mnt12: filesystem full Apr 19 14:42:28 x4 kernel: pid 28354 (mkdir), uid 1004 inumber 49364 on /mnt12: filesystem full 20180419 14:42:55 all (30/566): crossmp12.sh 20180419 14:42:57 all (31/566): crossmp2.sh 20180419 14:46:53 all (32/566): crossmp3.sh 20180419 14:55:17 all (33/566): crossmp5.sh 20180419 14:56:30 all (34/566): crossmp6.sh 20180419 15:01:40 all (35/566): crossmp7.sh ZFS NOTICE: Prefetch is disabled by default on i386 -- to enable, add "vfs.zfs.prefetch_disable=0" to /boot/loader.conf. ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Warning: memory type solaris leaked memory on destroy (11 allocations, 2368 bytes leaked). 20180419 15:10:24 all (36/566): crossmp8.sh 20180419 15:11:31 all (37/566): crossmp9.sh 20180419 15:16:37 all (38/566): dangling.sh 20180419 15:26:45 all (39/566): datamove.sh 20180419 15:26:54 all (40/566): datamove2.sh 20180419 15:27:24 all (41/566): datamove3.sh 20180419 15:27:28 all (42/566): datamove4.sh 20180419 15:27:41 all (43/566): datamove5.sh 20180419 15:28:07 all (44/566): db.sh 20180419 15:31:11 all (45/566): dd.sh newblk leak: 13774/15056. 20180419 15:34:02 all (46/566): dev2.sh 20180419 15:39:13 all (47/566): dev3.sh pts leak: 2/4 20180419 16:02:16 all (48/566): devfd.sh 20180419 16:02:34 all (49/566): devfs.sh 20180419 16:07:40 all (50/566): devfs2.sh 20180419 16:07:43 all (51/566): devfs3.sh 20180419 16:12:50 all (52/566): dfull.sh Apr 19 16:12:55 x4 kernel: pid 7516 (rw), uid 0 inumber 99 on /mnt: filesystem full Apr 19 16:12:55 x4 kernel: pid 7480 (mkdir), uid 0 inumber 108 on /mnt: filesystem full Apr 19 16:13:55 x4 kernel: pid 13157 (rw), uid 0 inumber 49192 on /mnt: filesystem full Apr 19 16:14:55 x4 kernel: pid 16465 (rw), uid 0 inumber 19935 on /mnt: filesystem full Apr 19 16:15:19 x4 kernel: pid 16464 (rw), uid 0 inumber 504 on /mnt: filesystem full Apr 19 16:15:56 x4 kernel: pid 21935 (rw), uid 0 inumber 49188 on /mnt: filesystem full Apr 19 16:15:56 x4 kernel: pid 21963 (mkdir), uid 0 inumber 54664 on /mnt: filesystem full Apr 19 16:16:56 x4 kernel: pid 23616 (rw), uid 0 inumber 49179 on /mnt: filesystem full Apr 19 16:17:58 x4 kernel: pid 25176 (rw), uid 0 inumber 33 on /mnt: filesystem full Apr 19 16:18:59 x4 kernel: pid 27076 (rw), uid 0 inumber 16428 on /mnt: filesystem full Apr 19 16:20:01 x4 kernel: pid 30093 (rw), uid 0 inumber 49188 on /mnt: filesystem full Apr 19 16:20:20 x4 kernel: pid 30084 (rw), uid 0 inumber 49173 on /mnt: filesystem full Apr 19 16:21:03 x4 kernel: pid 32326 (creat), uid 0 inumber 33 on /mnt: filesystem full Apr 19 16:21:03 x4 kernel: pid 32312 (rw), uid 0 inumber 19 on /mnt: filesystem full Apr 19 16:23:05 x4 kernel: pid 38841 (rw), uid 0 inumber 16415 on /mnt: filesystem full Apr 19 16:23:08 x4 kernel: pid 38847 (mkdir), uid 0 inumber 165 on /mnt: filesystem full Apr 19 16:24:05 x4 kernel: pid 43552 (rw), uid 0 inumber 32901 on /mnt: filesystem full Apr 19 16:24:07 x4 kernel: pid 43566 (rw), uid 0 inumber 34212 on /mnt: filesystem full Apr 19 16:26:05 x4 kernel: pid 49410 (rw), uid 0 inumber 44019 on /mnt: filesystem full Apr 19 16:27:05 x4 kernel: pid 52264 (rw), uid 0 inumber 2643 on /mnt: filesystem full Apr 19 16:28:06 x4 kernel: pid 54345 (rw), uid 0 inumber 116 on /mnt: filesystem full Apr 19 16:31:08 x4 kernel: pid 66008 (rw), uid 0 inumber 50441 on /mnt: filesystem full Apr 19 16:31:10 x4 kernel: pid 66014 (rw), uid 0 inumber 32781 on /mnt: filesystem full Apr 19 16:31:11 x4 kernel: pid 66001 (rw), uid 0 inumber 50435 on /mnt: filesystem full Apr 19 16:32:10 x4 kernel: pid 69009 (rw), uid 0 inumber 568 on /mnt: filesystem full Apr 19 16:32:10 x4 kernel: pid 69041 (mkdir), uid 0 inumber 52650 on /mnt: filesystem full Apr 19 16:32:55 x4 kernel: pid 69016 (creat), uid 0 inumber 644 on /mnt: filesystem full Apr 19 16:32:55 x4 kernel: pid 69006 (rw), uid 0 inumber 564 on /mnt: filesystem full Apr 19 16:33:09 x4 kernel: pid 69010 (rw), uid 0 inumber 574 on /mnt: filesystem full Apr 19 16:33:10 x4 kernel: pid 72059 (rw), uid 0 inumber 125 on /mnt: filesystem full Apr 19 16:33:11 x4 kernel: pid 72025 (rw), uid 0 inumber 131 on /mnt: filesystem full Apr 19 16:34:24 x4 kernel: pid 77999 (rw), uid 0 inumber 16969 on /mnt: filesystem full Apr 19 16:35:12 x4 kernel: pid 83920 (rw), uid 0 inumber 122 on /mnt: filesystem full Apr 19 16:36:12 x4 kernel: pid 89571 (rw), uid 0 inumber 49296 on /mnt: filesystem full Apr 19 16:37:13 x4 kernel: pid 94324 (rw), uid 0 inumber 18914 on /mnt: filesystem full Apr 19 16:37:33 x4 kernel: pid 94323 (rw), uid 0 inumber 49385 on /mnt: filesystem full Apr 19 16:38:12 x4 kernel: pid 350 (rw), uid 0 inumber 131 on /mnt: filesystem full Apr 19 16:38:14 x4 kernel: pid 360 (rw), uid 0 inumber 49302 on /mnt: filesystem full Apr 19 16:39:12 x4 kernel: pid 6328 (rw), uid 0 inumber 8482 on /mnt: filesystem full Apr 19 16:39:14 x4 kernel: pid 6358 (rw), uid 0 inumber 57303 on /mnt: filesystem full Apr 19 16:40:13 x4 kernel: pid 8805 (rw), uid 0 inumber 49193 on /mnt: filesystem full Apr 19 16:41:13 x4 kernel: pid 14421 (rw), uid 0 inumber 254 on /mnt: filesystem full Apr 19 16:41:46 x4 kernel: pid 14439 (rw), uid 0 inumber 269 on /mnt: filesystem full Apr 19 16:42:15 x4 kernel: pid 16836 (rw), uid 0 inumber 152 on /mnt: filesystem full 20180419 16:43:18 all (53/566): dtrace_fault.sh 20180419 16:43:26 all (54/566): dtrace.sh 20180419 16:50:16 all (55/566): dumpfs.sh 20180419 16:50:20 all (56/566): dup2.sh 20180419 16:50:28 all (57/566): execi386.sh 20180419 16:50:31 all (58/566): execve.sh 20180419 16:51:13 all (59/566): exlock.sh 20180419 16:55:32 all (60/566): ext2fs.sh swap_pager: I/O error - pageout failed; blkno 2372768,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 2372800,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 2372832,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 2372864,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 2372896,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 2374603,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 2374752,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 2374880,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 2375008,size 131072, error 12 Apr 19 17:04:31 x4 kernel: pid 79941 (swap), uid 1004, was killed: out of swap space swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3066368, size: 131072 20180419 17:06:14 all (61/566): ext2fs2.sh 20180419 17:16:27 all (62/566): ext2fs3.sh 20180419 17:16:39 all (63/566): extattr_set_fd.sh 20180419 17:16:43 all (64/566): extattr.sh 20180419 17:16:53 all (65/566): extattrctl.sh lock order reversal: 1st 0x2969f71c ufs_extattr_sx (ufs_extattr_sx) @ ufs/ufs/ufs_extattr.c:118 2nd 0x2507a30c ufs (ufs) @ ufs/ffs/ffs_vfsops.c:1677 stack backtrace: #0 0x11117a1 at witness_debugger+0x81 #1 0x1111668 at witness_checkorder+0xcd8 #2 0x107b24b at lockmgr_xlock_hard+0x5b #3 0x107ba7f at __lockmgr_args+0x3df #4 0x13c4955 at ffs_vgetf+0x155 #5 0x13c47f7 at ffs_vget+0x37 #6 0x13d91d4 at ufs_root+0x54 #7 0x13d06e4 at ufs_extattr_autostart+0x84 #8 0x13c71cc at ffs_mount+0x200c #9 0x1174bd3 at vfs_domount+0x7e3 #10 0x1173dd5 at vfs_donmount+0x7e5 #11 0x11735ca at sys_nmount+0x7a #12 0x168133e at syscall+0x6ee #13 0xffc032c0 at PTDpde+0x42c8 20180419 17:16:57 all (66/566): f_offset.sh 20180419 17:18:18 all (67/566): fcntl.sh 20180419 17:18:28 all (68/566): fdatasync.sh 20180419 17:21:38 all (69/566): fdescfs.sh 20180419 17:26:44 all (70/566): ffs_blkfree.sh lock order reversal: 1st 0xbd59d64 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:282 2nd 0x2451d71c snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:2309 stack backtrace: #0 0x11117a1 at witness_debugger+0x81 #1 0x1111668 at witness_checkorder+0xcd8 #2 0x107b24b at lockmgr_xlock_hard+0x5b #3 0x107ba7f at __lockmgr_args+0x3df #4 0x13a585f at ffs_copyonwrite+0x1df #5 0x13c894c at ffs_geom_strategy+0x7c #6 0x13dd886 at ufs_strategy+0xa6 #7 0x16b6244 at VOP_STRATEGY_APV+0x104 #8 0x115825d at bufstrategy+0x4d #9 0x115805f at bufwrite+0x22f #10 0x13caaad at ffs_syncvnode+0x37d #11 0x13c99d6 at ffs_fsync+0x26 #12 0x16b46f6 at VOP_FSYNC_APV+0xf6 #13 0x13db1c1 at ufs_remove+0xe1 #14 0x16b48fc at VOP_REMOVE_APV+0x11c #15 0x118ac88 at kern_unlinkat+0x268 #16 0x118aa1a at sys_unlink+0x3a #17 0x168133e at syscall+0x6ee lock order reversal: 1st 0x2451d71c snaplk (snaplk) @ kern/vfs_vnops.c:448 2nd 0x279b1d00 ufs (ufs) @ ufs/ffs/ffs_snapshot.c:1636 stack backtrace: #0 0x11117a1 at witness_debugger+0x81 #1 0x1111668 at witness_checkorder+0xcd8 #2 0x107b24b at lockmgr_xlock_hard+0x5b #3 0x107ba7f at __lockmgr_args+0x3df #4 0x13a36d3 at ffs_snapremove+0x123 #5 0x139c7ca at ffs_truncate+0x4fa #6 0x13d2610 at ufs_inactive+0x250 #7 0x16b5946 at VOP_INACTIVE_APV+0xf6 #8 0x117e9ce at vinactive+0x11e #9 0x117f095 at vputx+0x365 #10 0x1192899 at vn_close1+0x129 #11 0x1191471 at vn_closefile+0x51 #12 0x10509ef at closef+0x21f #13 0x1050452 at fdescfree_fds+0xa2 #14 0x104ff91 at fdescfree+0x501 #15 0x106041b at exit1+0x5fb #16 0x105fe12 at sys_sys_exit+0x22 #17 0x168133e at syscall+0x6ee 20180419 17:27:07 all (71/566): ffs_sync.sh 20180419 17:30:30 all (72/566): ffs_syncvnode.sh Apr 19 17:46:46 x4 kernel: pid 8918 (rw), uid 1004 inumber 65537 on /mnt: filesystem full 20180419 18:00:59 all (73/566): ffs_syncvnode2.sh Apr 19 18:03:41 x4 kernel: pid 64022 (creat), uid 1004 inumber 196617 on /mnt: filesystem full Apr 19 18:03:42 x4 kernel: pid 64037 (mkdir), uid 1004 inumber 68217 on /mnt: filesystem full Apr 19 18:03:44 x4 kernel: pid 64046 (mkdir), uid 1004 inumber 68224 on /mnt: filesystem full Apr 19 18:03:44 x4 kernel: pid 64025 (rw), uid 1004 inumber 196621 on /mnt: filesystem full Apr 19 18:05:48 x4 kernel: pid 70869 (creat), uid 1004 inumber 131081 on /mnt: filesystem full Apr 19 18:05:48 x4 kernel: pid 70876 (rw), uid 1004 inumber 131083 on /mnt: filesystem full Apr 19 18:05:48 x4 kernel: pid 70890 (mkdir), uid 1004 inumber 198578 on /mnt: filesystem full Apr 19 18:07:13 x4 kernel: pid 77293 (rw), uid 1004 inumber 211258 on /mnt: filesystem full Apr 19 18:07:13 x4 kernel: pid 77284 (mkdir), uid 1004 inumber 72402 on /mnt: filesystem full Apr 19 18:16:34 x4 kernel: pid 5114 (mkdir), uid 1004 inumber 198039 on /mnt: filesystem full Apr 19 18:16:34 x4 kernel: pid 5093 (rw), uid 1004 inumber 65592 on /mnt: filesystem full Apr 19 18:19:26 x4 kernel: pid 14110 (rw), uid 1004 inumber 65548 on /mnt: filesystem full 20180419 18:21:27 all (74/566): fifo.sh 20180419 18:21:37 all (75/566): fifo2.sh 20180419 18:23:41 all (76/566): fifo3.sh 20180419 18:27:04 all (77/566): fifo4.sh Apr 19 18:28:03 x4 inetd[757]: discard/udp server failing (looping), service terminated 20180419 18:29:20 all (78/566): flock_open_close.sh Apr 19 18:38:04 x4 inetd[757]: discard/udp server failing (looping), service terminated 20180419 18:40:18 all (79/566): flock.sh 20180419 18:41:21 all (80/566): fork.sh 20180419 18:41:31 all (81/566): fork2.sh witness_lock_list_get: witness exhausted 20180419 18:44:44 all (82/566): forkbomb.sh maxproc limit exceeded by uid 1004 (pid 50468); see tuning(7) and login.conf(5) 20180419 18:44:59 all (83/566): fpclone.sh 20180419 18:47:25 all (84/566): fpclone2.sh 20180419 18:47:31 all (85/566): fpu.sh 20180419 18:50:16 all (86/566): fragments.sh Apr 19 18:50:26 x4 kernel: pid 89575 (fragments), uid 1004 inumber 51104 on /mnt: filesystem full Apr 19 18:50:27 x4 kernel: pid 89575 (fragments), uid 1004 inumber 32786 on /mnt: filesystem full Apr 19 18:50:27 x4 kernel: pid 89578 (fragments), uid 1004 inumber 6187 on /mnt: filesystem full Apr 19 18:50:28 x4 kernel: pid 89579 (fragments), uid 1004 inumber 6143 on /mnt: filesystem full Apr 19 18:50:29 x4 kernel: pid 89578 (fragments), uid 1004 inumber 6239 on /mnt: filesystem full Apr 19 18:50:30 x4 kernel: pid 89581 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:50:30 x4 kernel: pid 89583 (fragments), uid 1004 inumber 6254 on /mnt: filesystem full Apr 19 18:50:31 x4 kernel: pid 91078 (fragments), uid 1004 inumber 6072 on /mnt: filesystem full Apr 19 18:50:32 x4 kernel: pid 91073 (fragments), uid 1004 inumber 6181 on /mnt: filesystem full Apr 19 18:50:34 x4 kernel: pid 91074 (fragments), uid 1004 inumber 6183 on /mnt: filesystem full Apr 19 18:50:35 x4 kernel: pid 91076 (fragments), uid 1004 inumber 6260 on /mnt: filesystem full Apr 19 18:50:36 x4 kernel: pid 91076 (fragments), uid 1004 inumber 6312 on /mnt: filesystem full Apr 19 18:50:37 x4 kernel: pid 91076 (fragments), uid 1004 inumber 6387 on /mnt: filesystem full Apr 19 18:50:38 x4 kernel: pid 91073 (fragments), uid 1004 inumber 6408 on /mnt: filesystem full Apr 19 18:50:39 x4 kernel: pid 91075 (fragments), uid 1004 inumber 6307 on /mnt: filesystem full Apr 19 18:50:40 x4 kernel: pid 91075 (fragments), uid 1004 inumber 6143 on /mnt: filesystem full Apr 19 18:50:41 x4 kernel: pid 91075 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:50:43 x4 last message repeated 2 times Apr 19 18:50:43 x4 kernel: pid 91075 (fragments), uid 1004 inumber 6194 on /mnt: filesystem full Apr 19 18:50:44 x4 kernel: pid 91889 (fragments), uid 1004 inumber 6182 on /mnt: filesystem full Apr 19 18:50:45 x4 kernel: pid 91884 (fragments), uid 1004 inumber 6226 on /mnt: filesystem full Apr 19 18:50:46 x4 kernel: pid 91886 (fragments), uid 1004 inumber 6192 on /mnt: filesystem full Apr 19 18:50:47 x4 kernel: pid 91888 (fragments), uid 1004 inumber 6318 on /mnt: filesystem full Apr 19 18:50:48 x4 kernel: pid 91889 (fragments), uid 1004 inumber 6453 on /mnt: filesystem full Apr 19 18:50:49 x4 kernel: pid 92581 (fragments), uid 1004 inumber 6133 on /mnt: filesystem full Apr 19 18:50:50 x4 kernel: pid 92578 (fragments), uid 1004 inumber 6210 on /mnt: filesystem full Apr 19 18:50:51 x4 kernel: pid 92582 (fragments), uid 1004 inumber 6261 on /mnt: filesystem full Apr 19 18:50:52 x4 kernel: pid 92578 (fragments), uid 1004 inumber 6330 on /mnt: filesystem full Apr 19 18:50:53 x4 kernel: pid 92578 (fragments), uid 1004 inumber 6215 on /mnt: filesystem full Apr 19 18:50:54 x4 kernel: pid 92578 (fragments), uid 1004 inumber 6194 on /mnt: filesystem full Apr 19 18:50:55 x4 kernel: pid 92582 (fragments), uid 1004 inumber 6197 on /mnt: filesystem full Apr 19 18:50:56 x4 kernel: pid 92576 (fragments), uid 1004 inumber 6205 on /mnt: filesystem full Apr 19 18:50:57 x4 kernel: pid 92579 (fragments), uid 1004 inumber 6345 on /mnt: filesystem full Apr 19 18:50:58 x4 kernel: pid 92579 (fragments), uid 1004 inumber 6228 on /mnt: filesystem full Apr 19 18:50:59 x4 kernel: pid 92576 (fragments), uid 1004 inumber 6145 on /mnt: filesystem full Apr 19 18:51:00 x4 kernel: pid 94070 (fragments), uid 1004 inumber 6116 on /mnt: filesystem full Apr 19 18:51:01 x4 kernel: pid 94074 (fragments), uid 1004 inumber 6074 on /mnt: filesystem full Apr 19 18:51:02 x4 kernel: pid 94073 (fragments), uid 1004 inumber 6184 on /mnt: filesystem full Apr 19 18:51:03 x4 kernel: pid 94072 (fragments), uid 1004 inumber 6375 on /mnt: filesystem full Apr 19 18:51:04 x4 kernel: pid 94069 (fragments), uid 1004 inumber 6111 on /mnt: filesystem full Apr 19 18:51:05 x4 kernel: pid 94069 (fragments), uid 1004 inumber 6273 on /mnt: filesystem full Apr 19 18:51:06 x4 kernel: pid 94069 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:51:07 x4 kernel: pid 94075 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:51:08 x4 kernel: pid 94075 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:51:09 x4 kernel: pid 94069 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:51:10 x4 kernel: pid 94069 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:51:11 x4 kernel: pid 94075 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:51:12 x4 kernel: pid 94075 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:51:13 x4 kernel: pid 94069 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:51:14 x4 kernel: pid 94071 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:51:15 x4 kernel: pid 94069 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:51:16 x4 kernel: pid 94069 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:51:17 x4 kernel: pid 94071 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:51:17 x4 kernel: pid 95563 (fragments), uid 1004 inumber 6303 on /mnt: filesystem full Apr 19 18:51:18 x4 kernel: pid 95570 (fragments), uid 1004 inumber 6176 on /mnt: filesystem full Apr 19 18:51:19 x4 kernel: pid 95568 (fragments), uid 1004 inumber 6173 on /mnt: filesystem full Apr 19 18:51:20 x4 kernel: pid 95566 (fragments), uid 1004 inumber 6200 on /mnt: filesystem full Apr 19 18:51:21 x4 kernel: pid 95570 (fragments), uid 1004 inumber 6197 on /mnt: filesystem full Apr 19 18:51:22 x4 kernel: pid 95567 (fragments), uid 1004 inumber 6290 on /mnt: filesystem full Apr 19 18:51:22 x4 kernel: pid 95563 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:51:23 x4 kernel: pid 95570 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:51:24 x4 kernel: pid 95563 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:51:27 x4 last message repeated 3 times Apr 19 18:51:28 x4 kernel: pid 95570 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:51:30 x4 kernel: pid 95563 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:51:31 x4 kernel: pid 95570 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:51:32 x4 kernel: pid 95563 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:51:33 x4 kernel: pid 95570 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:51:34 x4 kernel: pid 95567 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:51:36 x4 last message repeated 2 times Apr 19 18:51:37 x4 kernel: pid 95563 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:51:38 x4 kernel: pid 95567 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:51:40 x4 last message repeated 2 times Apr 19 18:51:41 x4 kernel: pid 95570 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:51:43 x4 last message repeated 2 times Apr 19 18:51:44 x4 kernel: pid 95567 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:51:45 x4 kernel: pid 95570 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:51:45 x4 kernel: pid 98551 (fragments), uid 1004 inumber 6303 on /mnt: filesystem full Apr 19 18:51:46 x4 kernel: pid 98552 (fragments), uid 1004 inumber 6197 on /mnt: filesystem full Apr 19 18:51:47 x4 kernel: pid 98548 (fragments), uid 1004 inumber 6220 on /mnt: filesystem full Apr 19 18:51:49 x4 kernel: pid 98546 (fragments), uid 1004 inumber 6244 on /mnt: filesystem full Apr 19 18:51:50 x4 kernel: pid 98562 (fragments), uid 1004 inumber 6136 on /mnt: filesystem full Apr 19 18:51:51 x4 kernel: pid 98562 (fragments), uid 1004 inumber 6142 on /mnt: filesystem full Apr 19 18:51:52 x4 kernel: pid 98565 (fragments), uid 1004 inumber 6194 on /mnt: filesystem full Apr 19 18:51:53 x4 kernel: pid 98559 (fragments), uid 1004 inumber 6229 on /mnt: filesystem full Apr 19 18:51:54 x4 kernel: pid 98565 (fragments), uid 1004 inumber 6208 on /mnt: filesystem full Apr 19 18:51:54 x4 kernel: pid 98565 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:51:55 x4 kernel: pid 98563 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:51:56 x4 kernel: pid 98563 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:51:56 x4 kernel: pid 156 (fragments), uid 1004 inumber 6214 on /mnt: filesystem full Apr 19 18:51:57 x4 kernel: pid 149 (fragments), uid 1004 inumber 6210 on /mnt: filesystem full Apr 19 18:51:58 x4 kernel: pid 153 (fragments), uid 1004 inumber 6228 on /mnt: filesystem full Apr 19 18:51:59 x4 kernel: pid 154 (fragments), uid 1004 inumber 6355 on /mnt: filesystem full Apr 19 18:52:00 x4 kernel: pid 155 (fragments), uid 1004 inumber 6179 on /mnt: filesystem full Apr 19 18:52:01 x4 kernel: pid 160 (fragments), uid 1004 inumber 6073 on /mnt: filesystem full Apr 19 18:52:02 x4 kernel: pid 160 (fragments), uid 1004 inumber 6129 on /mnt: filesystem full Apr 19 18:52:03 x4 kernel: pid 160 (fragments), uid 1004 inumber 6271 on /mnt: filesystem full Apr 19 18:52:04 x4 kernel: pid 162 (fragments), uid 1004 inumber 6342 on /mnt: filesystem full Apr 19 18:52:04 x4 kernel: pid 162 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:52:05 x4 kernel: pid 159 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:52:06 x4 kernel: pid 159 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:52:07 x4 kernel: pid 164 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:52:09 x4 kernel: pid 164 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:52:09 x4 kernel: pid 164 (fragments), uid 1004 inumber 6070 on /mnt: filesystem full Apr 19 18:52:10 x4 kernel: pid 161 (fragments), uid 1004 inumber 6393 on /mnt: filesystem full Apr 19 18:52:11 x4 kernel: pid 161 (fragments), uid 1004 inumber 6204 on /mnt: filesystem full Apr 19 18:52:12 x4 kernel: pid 163 (fragments), uid 1004 inumber 6384 on /mnt: filesystem full Apr 19 18:52:13 x4 kernel: pid 163 (fragments), uid 1004 inumber 6105 on /mnt: filesystem full Apr 19 18:52:14 x4 kernel: pid 163 (fragments), uid 1004 inumber 6185 on /mnt: filesystem full Apr 19 18:52:15 x4 kernel: pid 163 (fragments), uid 1004 inumber 6237 on /mnt: filesystem full Apr 19 18:52:16 x4 kernel: pid 1684 (fragments), uid 1004 inumber 6149 on /mnt: filesystem full Apr 19 18:52:17 x4 kernel: pid 1685 (fragments), uid 1004 inumber 6072 on /mnt: filesystem full Apr 19 18:52:18 x4 kernel: pid 1686 (fragments), uid 1004 inumber 6189 on /mnt: filesystem full Apr 19 18:52:19 x4 kernel: pid 1691 (fragments), uid 1004 inumber 6425 on /mnt: filesystem full Apr 19 18:52:20 x4 kernel: pid 3184 (fragments), uid 1004 inumber 6069 on /mnt: filesystem full Apr 19 18:52:21 x4 kernel: pid 3178 (fragments), uid 1004 inumber 6142 on /mnt: filesystem full Apr 19 18:52:22 x4 kernel: pid 3182 (fragments), uid 1004 inumber 6206 on /mnt: filesystem full Apr 19 18:52:23 x4 kernel: pid 3178 (fragments), uid 1004 inumber 6123 on /mnt: filesystem full Apr 19 18:52:24 x4 kernel: pid 3185 (fragments), uid 1004 inumber 6183 on /mnt: filesystem full Apr 19 18:52:25 x4 kernel: pid 3194 (fragments), uid 1004 inumber 6282 on /mnt: filesystem full Apr 19 18:52:26 x4 kernel: pid 3189 (fragments), uid 1004 inumber 6164 on /mnt: filesystem full Apr 19 18:52:27 x4 kernel: pid 3191 (fragments), uid 1004 inumber 6085 on /mnt: filesystem full Apr 19 18:52:28 x4 kernel: pid 3191 (fragments), uid 1004 inumber 6164 on /mnt: filesystem full Apr 19 18:52:29 x4 kernel: pid 3191 (fragments), uid 1004 inumber 6265 on /mnt: filesystem full Apr 19 18:52:30 x4 kernel: pid 3208 (fragments), uid 1004 inumber 6069 on /mnt: filesystem full Apr 19 18:52:31 x4 kernel: pid 3206 (fragments), uid 1004 inumber 6214 on /mnt: filesystem full Apr 19 18:52:33 x4 kernel: pid 3208 (fragments), uid 1004 inumber 6285 on /mnt: filesystem full Apr 19 18:52:34 x4 kernel: pid 3208 (fragments), uid 1004 inumber 6178 on /mnt: filesystem full Apr 19 18:52:35 x4 kernel: pid 3202 (fragments), uid 1004 inumber 6383 on /mnt: filesystem full Apr 19 18:52:36 x4 kernel: pid 3207 (fragments), uid 1004 inumber 6401 on /mnt: filesystem full Apr 19 18:52:37 x4 kernel: pid 3208 (fragments), uid 1004 inumber 6232 on /mnt: filesystem full Apr 19 18:52:38 x4 kernel: pid 3202 (fragments), uid 1004 inumber 6213 on /mnt: filesystem full Apr 19 18:52:39 x4 kernel: pid 4695 (fragments), uid 1004 inumber 6089 on /mnt: filesystem full Apr 19 18:52:40 x4 kernel: pid 4693 (fragments), uid 1004 inumber 6172 on /mnt: filesystem full Apr 19 18:52:41 x4 kernel: pid 4694 (fragments), uid 1004 inumber 6095 on /mnt: filesystem full Apr 19 18:52:42 x4 kernel: pid 4694 (fragments), uid 1004 inumber 6210 on /mnt: filesystem full Apr 19 18:52:43 x4 kernel: pid 4707 (fragments), uid 1004 inumber 6125 on /mnt: filesystem full Apr 19 18:52:44 x4 kernel: pid 4702 (fragments), uid 1004 inumber 6182 on /mnt: filesystem full Apr 19 18:52:45 x4 kernel: pid 4708 (fragments), uid 1004 inumber 6161 on /mnt: filesystem full Apr 19 18:52:46 x4 kernel: pid 4707 (fragments), uid 1004 inumber 6269 on /mnt: filesystem full Apr 19 18:52:47 x4 kernel: pid 4701 (fragments), uid 1004 inumber 6107 on /mnt: filesystem full Apr 19 18:52:48 x4 kernel: pid 4707 (fragments), uid 1004 inumber 6128 on /mnt: filesystem full Apr 19 18:52:49 x4 kernel: pid 6198 (fragments), uid 1004 inumber 6087 on /mnt: filesystem full Apr 19 18:52:50 x4 kernel: pid 6202 (fragments), uid 1004 inumber 6142 on /mnt: filesystem full Apr 19 18:52:51 x4 kernel: pid 6195 (fragments), uid 1004 inumber 6362 on /mnt: filesystem full Apr 19 18:52:52 x4 kernel: pid 6201 (fragments), uid 1004 inumber 6079 on /mnt: filesystem full Apr 19 18:52:53 x4 kernel: pid 6195 (fragments), uid 1004 inumber 6192 on /mnt: filesystem full Apr 19 18:52:54 x4 kernel: pid 6201 (fragments), uid 1004 inumber 6321 on /mnt: filesystem full Apr 19 18:52:55 x4 kernel: pid 6197 (fragments), uid 1004 inumber 6470 on /mnt: filesystem full Apr 19 18:52:56 x4 kernel: pid 6204 (fragments), uid 1004 inumber 6171 on /mnt: filesystem full Apr 19 18:52:57 x4 kernel: pid 6208 (fragments), uid 1004 inumber 6193 on /mnt: filesystem full Apr 19 18:52:58 x4 kernel: pid 6208 (fragments), uid 1004 inumber 6133 on /mnt: filesystem full Apr 19 18:52:59 x4 kernel: pid 6207 (fragments), uid 1004 inumber 6268 on /mnt: filesystem full Apr 19 18:53:00 x4 kernel: pid 6203 (fragments), uid 1004 inumber 6364 on /mnt: filesystem full Apr 19 18:53:01 x4 kernel: pid 6210 (fragments), uid 1004 inumber 6430 on /mnt: filesystem full Apr 19 18:53:02 x4 kernel: pid 6204 (fragments), uid 1004 inumber 6125 on /mnt: filesystem full Apr 19 18:53:03 x4 kernel: pid 6209 (fragments), uid 1004 inumber 6151 on /mnt: filesystem full Apr 19 18:53:04 x4 kernel: pid 6209 (fragments), uid 1004 inumber 6268 on /mnt: filesystem full Apr 19 18:53:05 x4 kernel: pid 6206 (fragments), uid 1004 inumber 6110 on /mnt: filesystem full Apr 19 18:53:06 x4 kernel: pid 7704 (fragments), uid 1004 inumber 6110 on /mnt: filesystem full Apr 19 18:53:07 x4 kernel: pid 7703 (fragments), uid 1004 inumber 6205 on /mnt: filesystem full Apr 19 18:53:08 x4 kernel: pid 7701 (fragments), uid 1004 inumber 6241 on /mnt: filesystem full Apr 19 18:53:09 x4 kernel: pid 7701 (fragments), uid 1004 inumber 6322 on /mnt: filesystem full Apr 19 18:53:10 x4 kernel: pid 7704 (fragments), uid 1004 inumber 6108 on /mnt: filesystem full Apr 19 18:53:11 x4 kernel: pid 7699 (fragments), uid 1004 inumber 6073 on /mnt: filesystem full Apr 19 18:53:12 x4 kernel: pid 7700 (fragments), uid 1004 inumber 6128 on /mnt: filesystem full Apr 19 18:53:13 x4 kernel: pid 8613 (fragments), uid 1004 inumber 6149 on /mnt: filesystem full Apr 19 18:53:15 x4 kernel: pid 8609 (fragments), uid 1004 inumber 6163 on /mnt: filesystem full Apr 19 18:53:16 x4 kernel: pid 8615 (fragments), uid 1004 inumber 6305 on /mnt: filesystem full Apr 19 18:53:17 x4 kernel: pid 8613 (fragments), uid 1004 inumber 6172 on /mnt: filesystem full Apr 19 18:53:18 x4 kernel: pid 8612 (fragments), uid 1004 inumber 6270 on /mnt: filesystem full Apr 19 18:53:19 x4 kernel: pid 8611 (fragments), uid 1004 inumber 6117 on /mnt: filesystem full Apr 19 18:53:19 x4 kernel: pid 9203 (fragments), uid 1004 inumber 6068 on /mnt: filesystem full Apr 19 18:53:21 x4 kernel: pid 9201 (fragments), uid 1004 inumber 6172 on /mnt: filesystem full Apr 19 18:53:22 x4 kernel: pid 9205 (fragments), uid 1004 inumber 6205 on /mnt: filesystem full Apr 19 18:53:23 x4 kernel: pid 9201 (fragments), uid 1004 inumber 6161 on /mnt: filesystem full Apr 19 18:53:24 x4 kernel: pid 9199 (fragments), uid 1004 inumber 6091 on /mnt: filesystem full Apr 19 18:53:25 x4 kernel: pid 9200 (fragments), uid 1004 inumber 6122 on /mnt: filesystem full Apr 19 18:53:26 x4 kernel: pid 9204 (fragments), uid 1004 inumber 6112 on /mnt: filesystem full Apr 19 18:53:27 x4 kernel: pid 9997 (fragments), uid 1004 inumber 6096 on /mnt: filesystem full Apr 19 18:53:28 x4 kernel: pid 9995 (fragments), uid 1004 inumber 6096 on /mnt: filesystem full Apr 19 18:53:29 x4 kernel: pid 9997 (fragments), uid 1004 inumber 6239 on /mnt: filesystem full Apr 19 18:53:30 x4 kernel: pid 9997 (fragments), uid 1004 inumber 6359 on /mnt: filesystem full Apr 19 18:53:31 x4 kernel: pid 9998 (fragments), uid 1004 inumber 6119 on /mnt: filesystem full Apr 19 18:53:32 x4 kernel: pid 10001 (fragments), uid 1004 inumber 6133 on /mnt: filesystem full Apr 19 18:53:33 x4 kernel: pid 9997 (fragments), uid 1004 inumber 6196 on /mnt: filesystem full Apr 19 18:53:34 x4 kernel: pid 10711 (fragments), uid 1004 inumber 6096 on /mnt: filesystem full Apr 19 18:53:35 x4 kernel: pid 10709 (fragments), uid 1004 inumber 6139 on /mnt: filesystem full Apr 19 18:53:36 x4 kernel: pid 10711 (fragments), uid 1004 inumber 6264 on /mnt: filesystem full Apr 19 18:53:37 x4 kernel: pid 10709 (fragments), uid 1004 inumber 6301 on /mnt: filesystem full Apr 19 18:53:38 x4 kernel: pid 10709 (fragments), uid 1004 inumber 6102 on /mnt: filesystem full Apr 19 18:53:39 x4 kernel: pid 10708 (fragments), uid 1004 inumber 6284 on /mnt: filesystem full Apr 19 18:53:39 x4 kernel: pid 10710 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:53:40 x4 kernel: pid 10710 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:53:40 x4 kernel: pid 10710 (fragments), uid 1004 inumber 6301 on /mnt: filesystem full Apr 19 18:53:41 x4 kernel: pid 11898 (fragments), uid 1004 inumber 6094 on /mnt: filesystem full Apr 19 18:53:42 x4 kernel: pid 11899 (fragments), uid 1004 inumber 6099 on /mnt: filesystem full Apr 19 18:53:43 x4 kernel: pid 11895 (fragments), uid 1004 inumber 6228 on /mnt: filesystem full Apr 19 18:53:44 x4 kernel: pid 11894 (fragments), uid 1004 inumber 6087 on /mnt: filesystem full Apr 19 18:53:45 x4 kernel: pid 12213 (fragments), uid 1004 inumber 6082 on /mnt: filesystem full Apr 19 18:53:46 x4 kernel: pid 12206 (fragments), uid 1004 inumber 6193 on /mnt: filesystem full Apr 19 18:53:47 x4 kernel: pid 12211 (fragments), uid 1004 inumber 6167 on /mnt: filesystem full Apr 19 18:53:49 x4 kernel: pid 12212 (fragments), uid 1004 inumber 6255 on /mnt: filesystem full Apr 19 18:53:50 x4 kernel: pid 12210 (fragments), uid 1004 inumber 6262 on /mnt: filesystem full Apr 19 18:53:50 x4 kernel: pid 12218 (fragments), uid 1004 inumber 6131 on /mnt: filesystem full Apr 19 18:53:51 x4 kernel: pid 12214 (fragments), uid 1004 inumber 6158 on /mnt: filesystem full Apr 19 18:53:52 x4 kernel: pid 12219 (fragments), uid 1004 inumber 6323 on /mnt: filesystem full Apr 19 18:53:53 x4 kernel: pid 12215 (fragments), uid 1004 inumber 6092 on /mnt: filesystem full Apr 19 18:53:54 x4 kernel: pid 13222 (fragments), uid 1004 inumber 6116 on /mnt: filesystem full Apr 19 18:53:56 x4 kernel: pid 13225 (fragments), uid 1004 inumber 6098 on /mnt: filesystem full Apr 19 18:53:57 x4 kernel: pid 13222 (fragments), uid 1004 inumber 6089 on /mnt: filesystem full Apr 19 18:53:58 x4 kernel: pid 13225 (fragments), uid 1004 inumber 6331 on /mnt: filesystem full Apr 19 18:53:58 x4 kernel: pid 13717 (fragments), uid 1004 inumber 6128 on /mnt: filesystem full Apr 19 18:54:00 x4 kernel: pid 13723 (fragments), uid 1004 inumber 6085 on /mnt: filesystem full Apr 19 18:54:01 x4 kernel: pid 13723 (fragments), uid 1004 inumber 6091 on /mnt: filesystem full Apr 19 18:54:02 x4 kernel: pid 13716 (fragments), uid 1004 inumber 6224 on /mnt: filesystem full Apr 19 18:54:03 x4 kernel: pid 13728 (fragments), uid 1004 inumber 6127 on /mnt: filesystem full Apr 19 18:54:04 x4 kernel: pid 13726 (fragments), uid 1004 inumber 6190 on /mnt: filesystem full Apr 19 18:54:05 x4 kernel: pid 13727 (fragments), uid 1004 inumber 6198 on /mnt: filesystem full Apr 19 18:54:06 x4 kernel: pid 13727 (fragments), uid 1004 inumber 6200 on /mnt: filesystem full Apr 19 18:54:07 x4 kernel: pid 13727 (fragments), uid 1004 inumber 6265 on /mnt: filesystem full Apr 19 18:54:08 x4 kernel: pid 13724 (fragments), uid 1004 inumber 6267 on /mnt: filesystem full Apr 19 18:54:09 x4 kernel: pid 13727 (fragments), uid 1004 inumber 6277 on /mnt: filesystem full Apr 19 18:54:10 x4 kernel: pid 13725 (fragments), uid 1004 inumber 6070 on /mnt: filesystem full Apr 19 18:54:11 x4 kernel: pid 15224 (fragments), uid 1004 inumber 6086 on /mnt: filesystem full Apr 19 18:54:12 x4 kernel: pid 15222 (fragments), uid 1004 inumber 6075 on /mnt: filesystem full Apr 19 18:54:13 x4 kernel: pid 15221 (fragments), uid 1004 inumber 6136 on /mnt: filesystem full Apr 19 18:54:14 x4 kernel: pid 15225 (fragments), uid 1004 inumber 6249 on /mnt: filesystem full Apr 19 18:54:15 x4 kernel: pid 15218 (fragments), uid 1004 inumber 6210 on /mnt: filesystem full Apr 19 18:54:16 x4 kernel: pid 15229 (fragments), uid 1004 inumber 6097 on /mnt: filesystem full Apr 19 18:54:17 x4 kernel: pid 15233 (fragments), uid 1004 inumber 6106 on /mnt: filesystem full Apr 19 18:54:18 x4 kernel: pid 15232 (fragments), uid 1004 inumber 6169 on /mnt: filesystem full Apr 19 18:54:19 x4 kernel: pid 15233 (fragments), uid 1004 inumber 6249 on /mnt: filesystem full Apr 19 18:54:20 x4 kernel: pid 15228 (fragments), uid 1004 inumber 6107 on /mnt: filesystem full Apr 19 18:54:21 x4 kernel: pid 15231 (fragments), uid 1004 inumber 6255 on /mnt: filesystem full Apr 19 18:54:22 x4 kernel: pid 16333 (fragments), uid 1004 inumber 6142 on /mnt: filesystem full Apr 19 18:54:23 x4 kernel: pid 16330 (fragments), uid 1004 inumber 6240 on /mnt: filesystem full Apr 19 18:54:24 x4 kernel: pid 16330 (fragments), uid 1004 inumber 6362 on /mnt: filesystem full Apr 19 18:54:25 x4 kernel: pid 16332 (fragments), uid 1004 inumber 6303 on /mnt: filesystem full Apr 19 18:54:26 x4 kernel: pid 16330 (fragments), uid 1004 inumber 6359 on /mnt: filesystem full Apr 19 18:54:27 x4 kernel: pid 16336 (fragments), uid 1004 inumber 6109 on /mnt: filesystem full Apr 19 18:54:28 x4 kernel: pid 16334 (fragments), uid 1004 inumber 6272 on /mnt: filesystem full Apr 19 18:54:29 x4 kernel: pid 16734 (fragments), uid 1004 inumber 6181 on /mnt: filesystem full Apr 19 18:54:30 x4 kernel: pid 16736 (fragments), uid 1004 inumber 6242 on /mnt: filesystem full Apr 19 18:54:31 x4 kernel: pid 16738 (fragments), uid 1004 inumber 6449 on /mnt: filesystem full Apr 19 18:54:32 x4 kernel: pid 16738 (fragments), uid 1004 inumber 6193 on /mnt: filesystem full Apr 19 18:54:33 x4 kernel: pid 16739 (fragments), uid 1004 inumber 6122 on /mnt: filesystem full Apr 19 18:54:34 x4 kernel: pid 16739 (fragments), uid 1004 inumber 6170 on /mnt: filesystem full Apr 19 18:54:35 x4 kernel: pid 16746 (fragments), uid 1004 inumber 6300 on /mnt: filesystem full Apr 19 18:54:36 x4 kernel: pid 16743 (fragments), uid 1004 inumber 6080 on /mnt: filesystem full Apr 19 18:54:37 x4 kernel: pid 16744 (fragments), uid 1004 inumber 6500 on /mnt: filesystem full Apr 19 18:54:39 x4 kernel: pid 18239 (fragments), uid 1004 inumber 6154 on /mnt: filesystem full Apr 19 18:54:39 x4 kernel: pid 18236 (fragments), uid 1004 inumber 6228 on /mnt: filesystem full Apr 19 18:54:40 x4 kernel: pid 18238 (fragments), uid 1004 inumber 6199 on /mnt: filesystem full Apr 19 18:54:42 x4 kernel: pid 18237 (fragments), uid 1004 inumber 6272 on /mnt: filesystem full Apr 19 18:54:43 x4 kernel: pid 18248 (fragments), uid 1004 inumber 6132 on /mnt: filesystem full Apr 19 18:54:44 x4 kernel: pid 18247 (fragments), uid 1004 inumber 6096 on /mnt: filesystem full Apr 19 18:54:45 x4 kernel: pid 18244 (fragments), uid 1004 inumber 6283 on /mnt: filesystem full Apr 19 18:54:46 x4 kernel: pid 18248 (fragments), uid 1004 inumber 6114 on /mnt: filesystem full Apr 19 18:54:47 x4 kernel: pid 18311 (fragments), uid 1004 inumber 6106 on /mnt: filesystem full Apr 19 18:54:48 x4 kernel: pid 18311 (fragments), uid 1004 inumber 6182 on /mnt: filesystem full Apr 19 18:54:49 x4 kernel: pid 18309 (fragments), uid 1004 inumber 6140 on /mnt: filesystem full Apr 19 18:54:50 x4 kernel: pid 18309 (fragments), uid 1004 inumber 6297 on /mnt: filesystem full Apr 19 18:54:51 x4 kernel: pid 18311 (fragments), uid 1004 inumber 6111 on /mnt: filesystem full Apr 19 18:54:52 x4 kernel: pid 18307 (fragments), uid 1004 inumber 6409 on /mnt: filesystem full Apr 19 18:54:53 x4 kernel: pid 18308 (fragments), uid 1004 inumber 6245 on /mnt: filesystem full Apr 19 18:54:54 x4 kernel: pid 19746 (fragments), uid 1004 inumber 6129 on /mnt: filesystem full Apr 19 18:54:55 x4 kernel: pid 19749 (fragments), uid 1004 inumber 6108 on /mnt: filesystem full Apr 19 18:54:56 x4 kernel: pid 19747 (fragments), uid 1004 inumber 6227 on /mnt: filesystem full Apr 19 18:54:57 x4 kernel: pid 19745 (fragments), uid 1004 inumber 6171 on /mnt: filesystem full Apr 19 18:54:58 x4 kernel: pid 19745 (fragments), uid 1004 inumber 6120 on /mnt: filesystem full Apr 19 18:54:59 x4 kernel: pid 19746 (fragments), uid 1004 inumber 6071 on /mnt: filesystem full Apr 19 18:55:00 x4 kernel: pid 19772 (fragments), uid 1004 inumber 6080 on /mnt: filesystem full Apr 19 18:55:01 x4 kernel: pid 19770 (fragments), uid 1004 inumber 6100 on /mnt: filesystem full Apr 19 18:55:02 x4 kernel: pid 19767 (fragments), uid 1004 inumber 6158 on /mnt: filesystem full Apr 19 18:55:03 x4 kernel: pid 19766 (fragments), uid 1004 inumber 6263 on /mnt: filesystem full Apr 19 18:55:04 x4 kernel: pid 19766 (fragments), uid 1004 inumber 6409 on /mnt: filesystem full Apr 19 18:55:05 x4 kernel: pid 21266 (fragments), uid 1004 inumber 6120 on /mnt: filesystem full Apr 19 18:55:06 x4 kernel: pid 21262 (fragments), uid 1004 inumber 6168 on /mnt: filesystem full Apr 19 18:55:07 x4 kernel: pid 21264 (fragments), uid 1004 inumber 6168 on /mnt: filesystem full Apr 19 18:55:08 x4 kernel: pid 21264 (fragments), uid 1004 inumber 6093 on /mnt: filesystem full Apr 19 18:55:09 x4 kernel: pid 21265 (fragments), uid 1004 inumber 6157 on /mnt: filesystem full Apr 19 18:55:11 x4 kernel: pid 21271 (fragments), uid 1004 inumber 6113 on /mnt: filesystem full Apr 19 18:55:12 x4 kernel: pid 21271 (fragments), uid 1004 inumber 6316 on /mnt: filesystem full Apr 19 18:55:12 x4 kernel: pid 21268 (fragments), uid 1004 inumber 6144 on /mnt: filesystem full Apr 19 18:55:13 x4 kernel: pid 21270 (fragments), uid 1004 inumber 6080 on /mnt: filesystem full Apr 19 18:55:14 x4 kernel: pid 21270 (fragments), uid 1004 inumber 6217 on /mnt: filesystem full Apr 19 18:55:15 x4 kernel: pid 21270 (fragments), uid 1004 inumber 6083 on /mnt: filesystem full Apr 19 18:55:16 x4 kernel: pid 21270 (fragments), uid 1004 inumber 6255 on /mnt: filesystem full Apr 19 18:55:18 x4 kernel: pid 22622 (fragments), uid 1004 inumber 6155 on /mnt: filesystem full Apr 19 18:55:19 x4 kernel: pid 22621 (fragments), uid 1004 inumber 6242 on /mnt: filesystem full Apr 19 18:55:19 x4 kernel: pid 22619 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:55:20 x4 kernel: pid 22619 (fragments), uid 1004 inumber 6539 on /mnt: filesystem full Apr 19 18:55:21 x4 kernel: pid 22771 (fragments), uid 1004 inumber 6154 on /mnt: filesystem full Apr 19 18:55:22 x4 kernel: pid 22773 (fragments), uid 1004 inumber 6181 on /mnt: filesystem full Apr 19 18:55:23 x4 kernel: pid 22770 (fragments), uid 1004 inumber 6352 on /mnt: filesystem full Apr 19 18:55:23 x4 kernel: pid 22769 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:55:24 x4 kernel: pid 22769 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:55:25 x4 kernel: pid 22773 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:55:26 x4 kernel: pid 22770 (fragments), uid 1004 inumber 6071 on /mnt: filesystem full Apr 19 18:55:27 x4 kernel: pid 22774 (fragments), uid 1004 inumber 6254 on /mnt: filesystem full Apr 19 18:55:27 x4 kernel: pid 22774 (fragments), uid 1004 inumber 6137 on /mnt: filesystem full Apr 19 18:55:29 x4 kernel: pid 22770 (fragments), uid 1004 inumber 6296 on /mnt: filesystem full Apr 19 18:55:30 x4 kernel: pid 23545 (fragments), uid 1004 inumber 6133 on /mnt: filesystem full Apr 19 18:55:31 x4 kernel: pid 23551 (fragments), uid 1004 inumber 6222 on /mnt: filesystem full Apr 19 18:55:32 x4 kernel: pid 23551 (fragments), uid 1004 inumber 6233 on /mnt: filesystem full Apr 19 18:55:33 x4 kernel: pid 23551 (fragments), uid 1004 inumber 6244 on /mnt: filesystem full Apr 19 18:55:34 x4 kernel: pid 23550 (fragments), uid 1004 inumber 6363 on /mnt: filesystem full Apr 19 18:55:35 x4 kernel: pid 23549 (fragments), uid 1004 inumber 6210 on /mnt: filesystem full Apr 19 18:55:35 x4 kernel: pid 23550 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:55:36 x4 kernel: pid 23549 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:55:37 x4 kernel: pid 23550 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:55:40 x4 last message repeated 3 times Apr 19 18:55:41 x4 kernel: pid 23549 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:55:42 x4 kernel: pid 23548 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:55:43 x4 kernel: pid 23549 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:55:44 x4 kernel: pid 23548 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:55:45 x4 kernel: pid 23549 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:55:46 x4 kernel: pid 23549 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:55:47 x4 kernel: pid 23550 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:55:48 x4 kernel: pid 23549 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:55:49 x4 kernel: pid 23548 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:55:52 x4 last message repeated 2 times Apr 19 18:55:53 x4 kernel: pid 23549 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:55:54 x4 kernel: pid 23548 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:55:55 x4 kernel: pid 23549 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:55:56 x4 kernel: pid 23550 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:55:57 x4 kernel: pid 23550 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:55:58 x4 kernel: pid 23548 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:55:58 x4 kernel: pid 27250 (fragments), uid 1004 inumber 6248 on /mnt: filesystem full Apr 19 18:55:59 x4 kernel: pid 27251 (fragments), uid 1004 inumber 6075 on /mnt: filesystem full Apr 19 18:56:00 x4 kernel: pid 27249 (fragments), uid 1004 inumber 6262 on /mnt: filesystem full Apr 19 18:56:01 x4 kernel: pid 27248 (fragments), uid 1004 inumber 6279 on /mnt: filesystem full Apr 19 18:56:03 x4 kernel: pid 27246 (fragments), uid 1004 inumber 6095 on /mnt: filesystem full Apr 19 18:56:04 x4 kernel: pid 27260 (fragments), uid 1004 inumber 6084 on /mnt: filesystem full Apr 19 18:56:05 x4 kernel: pid 27261 (fragments), uid 1004 inumber 6092 on /mnt: filesystem full Apr 19 18:56:06 x4 kernel: pid 27259 (fragments), uid 1004 inumber 6173 on /mnt: filesystem full Apr 19 18:56:07 x4 kernel: pid 27254 (fragments), uid 1004 inumber 6217 on /mnt: filesystem full Apr 19 18:56:08 x4 kernel: pid 27258 (fragments), uid 1004 inumber 6112 on /mnt: filesystem full Apr 19 18:56:09 x4 kernel: pid 27256 (fragments), uid 1004 inumber 6090 on /mnt: filesystem full Apr 19 18:56:10 x4 kernel: pid 27255 (fragments), uid 1004 inumber 6169 on /mnt: filesystem full Apr 19 18:56:10 x4 kernel: pid 27255 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:56:11 x4 kernel: pid 27259 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:56:13 x4 last message repeated 2 times Apr 19 18:56:14 x4 kernel: pid 27260 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:56:15 x4 kernel: pid 27255 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:56:16 x4 kernel: pid 27255 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:56:17 x4 kernel: pid 27260 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:56:18 x4 kernel: pid 27255 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:56:19 x4 kernel: pid 27255 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:56:20 x4 kernel: pid 27259 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:56:21 x4 kernel: pid 27260 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:56:22 x4 kernel: pid 27255 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:56:23 x4 kernel: pid 27259 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:56:24 x4 kernel: pid 27259 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:56:25 x4 kernel: pid 27255 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:56:26 x4 kernel: pid 27259 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:56:27 x4 kernel: pid 27255 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:56:28 x4 kernel: pid 27255 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:56:29 x4 kernel: pid 27260 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:56:30 x4 kernel: pid 27260 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:56:31 x4 kernel: pid 27255 (fragments), uid 1004 inumber 2 on /mnt: filesystem full Apr 19 18:56:32 x4 kernel: pid 30243 (fragments), uid 1004 inumber 6177 on /mnt: filesystem full Apr 19 18:56:33 x4 kernel: pid 30237 (fragments), uid 1004 inumber 6178 on /mnt: filesystem full Apr 19 18:56:34 x4 kernel: pid 30239 (fragments), uid 1004 inumber 6080 on /mnt: filesystem full Apr 19 18:56:35 x4 kernel: pid 30250 (fragments), uid 1004 inumber 6117 on /mnt: filesystem full Apr 19 18:56:36 x4 kernel: pid 30252 (fragments), uid 1004 inumber 6131 on /mnt: filesystem full Apr 19 18:56:37 x4 kernel: pid 30246 (fragments), uid 1004 inumber 6304 on /mnt: filesystem full Apr 19 18:56:38 x4 kernel: pid 30251 (fragments), uid 1004 inumber 6210 on /mnt: filesystem full Apr 19 18:56:39 x4 kernel: pid 30246 (fragments), uid 1004 inumber 6177 on /mnt: filesystem full Apr 19 18:56:40 x4 kernel: pid 31741 (fragments), uid 1004 inumber 6113 on /mnt: filesystem full Apr 19 18:56:41 x4 kernel: pid 31746 (fragments), uid 1004 inumber 6137 on /mnt: filesystem full Apr 19 18:56:42 x4 kernel: pid 31742 (fragments), uid 1004 inumber 6163 on /mnt: filesystem full Apr 19 18:56:44 x4 kernel: pid 31744 (fragments), uid 1004 inumber 6257 on /mnt: filesystem full Apr 19 18:56:45 x4 kernel: pid 31743 (fragments), uid 1004 inumber 6174 on /mnt: filesystem full Apr 19 18:56:45 x4 kernel: pid 31743 (fragments), uid 1004 inumber 6263 on /mnt: filesystem full Apr 19 18:56:46 x4 kernel: pid 31743 (fragments), uid 1004 inumber 6294 on /mnt: filesystem full Apr 19 18:56:48 x4 kernel: pid 31743 (fragments), uid 1004 inumber 6117 on /mnt: filesystem full Apr 19 18:56:49 x4 kernel: pid 31743 (fragments), uid 1004 inumber 6192 on /mnt: filesystem full Apr 19 18:56:50 x4 kernel: pid 32042 (fragments), uid 1004 inumber 6245 on /mnt: filesystem full Apr 19 18:56:51 x4 kernel: pid 32044 (fragments), uid 1004 inumber 6198 on /mnt: filesystem full Apr 19 18:56:52 x4 kernel: pid 32042 (fragments), uid 1004 inumber 6207 on /mnt: filesystem full Apr 19 18:56:53 x4 kernel: pid 32043 (fragments), uid 1004 inumber 6423 on /mnt: filesystem full Apr 19 18:56:54 x4 kernel: pid 32040 (fragments), uid 1004 inumber 6127 on /mnt: filesystem full Apr 19 18:56:55 x4 kernel: pid 32040 (fragments), uid 1004 inumber 6178 on /mnt: filesystem full Apr 19 18:56:56 x4 kernel: pid 32040 (fragments), uid 1004 inumber 6245 on /mnt: filesystem full 20180419 18:56:59 all (87/566): freepages.sh 20180419 19:02:03 all (88/566): fs.sh Apr 19 19:05:08 x4 kernel: pid 48850 (rw), uid 1004 inumber 769 on /mnt: filesystem full Apr 19 19:05:21 x4 kernel: pid 48840 (creat), uid 1004 inumber 771 on /mnt: out of inodes Apr 19 19:05:23 x4 kernel: pid 48843 (creat), uid 1004 inumber 770 on /mnt: out of inodes Apr 19 19:05:31 x4 last message repeated 2 times Apr 19 19:05:33 x4 kernel: pid 48837 (creat), uid 1004 inumber 14 on /mnt: out of inodes Apr 19 19:05:34 x4 kernel: pid 48843 (creat), uid 1004 inumber 770 on /mnt: out of inodes Apr 19 19:05:36 x4 kernel: pid 48840 (creat), uid 1004 inumber 771 on /mnt: out of inodes Apr 19 19:05:40 x4 kernel: pid 48834 (creat), uid 1004 inumber 2309 on /mnt: out of inodes Apr 19 19:05:42 x4 kernel: pid 48837 (creat), uid 1004 inumber 14 on /mnt: out of inodes Apr 19 19:05:43 x4 kernel: pid 48840 (creat), uid 1004 inumber 771 on /mnt: out of inodes Apr 19 19:05:44 x4 kernel: pid 48843 (creat), uid 1004 inumber 770 on /mnt: out of inodes Apr 19 19:05:45 x4 kernel: pid 48840 (creat), uid 1004 inumber 771 on /mnt: out of inodes Apr 19 19:05:47 x4 kernel: pid 48843 (creat), uid 1004 inumber 770 on /mnt: out of inodes Apr 19 19:05:50 x4 kernel: pid 48837 (creat), uid 1004 inumber 14 on /mnt: out of inodes Apr 19 19:05:54 x4 kernel: pid 48837 (creat), uid 1004 inumber 14 on /mnt: out of inodes Apr 19 19:06:01 x4 kernel: pid 48855 (mkdir), uid 1004 inumber 2304 on /mnt: out of inodes Apr 19 19:06:02 x4 kernel: pid 48834 (creat), uid 1004 inumber 2309 on /mnt: out of inodes Apr 19 19:06:04 x4 kernel: pid 48837 (creat), uid 1004 inumber 14 on /mnt: out of inodes Apr 19 19:06:05 x4 kernel: pid 48834 (creat), uid 1004 inumber 2309 on /mnt: out of inodes Apr 19 19:09:08 x4 kernel: pid 62544 (rw), uid 1004 inumber 644 on /mnt: filesystem full Apr 19 19:10:11 x4 kernel: pid 66565 (mkdir), uid 1004 inumber 2039 on /mnt: out of inodes Apr 19 19:10:13 x4 kernel: pid 66526 (mkdir), uid 1004 inumber 1968 on /mnt: out of inodes Apr 19 19:10:15 x4 kernel: pid 66536 (mkdir), uid 1004 inumber 18 on /mnt: out of inodes Apr 19 19:10:17 x4 kernel: pid 66542 (creat), uid 1004 inumber 14 on /mnt: out of inodes Apr 19 19:10:18 x4 kernel: pid 66540 (mkdir), uid 1004 inumber 92 on /mnt: out of inodes Apr 19 19:10:19 x4 kernel: pid 66550 (creat), uid 1004 inumber 1922 on /mnt: out of inodes Apr 19 19:10:20 x4 kernel: pid 66547 (mkdir), uid 1004 inumber 487 on /mnt: out of inodes Apr 19 19:10:21 x4 kernel: pid 66551 (creat), uid 1004 inumber 5 on /mnt: out of inodes Apr 19 19:10:23 x4 kernel: pid 66560 (mkdir), uid 1004 inumber 2494 on /mnt: out of inodes Apr 19 19:10:24 x4 kernel: pid 66552 (creat), uid 1004 inumber 4 on /mnt: out of inodes Apr 19 19:10:25 x4 kernel: pid 66549 (creat), uid 1004 inumber 1923 on /mnt: out of inodes Apr 19 19:10:26 x4 kernel: pid 66527 (creat), uid 1004 inumber 1921 on /mnt: out of inodes Apr 19 19:10:28 x4 kernel: pid 66561 (mkdir), uid 1004 inumber 2559 on /mnt: out of inodes Apr 19 19:10:31 x4 kernel: pid 66543 (mkdir), uid 1004 inumber 1456 on /mnt: filesystem full Apr 19 19:10:31 x4 kernel: pid 66548 (rw), uid 1004 inumber 1608 on /mnt: filesystem full Apr 19 19:10:43 x4 kernel: pid 66537 (rw), uid 1004 inumber 1024 on /mnt: filesystem full Apr 19 19:10:54 x4 kernel: pid 66522 (rw), uid 1004 inumber 118 on /mnt: filesystem full Apr 19 19:10:57 x4 kernel: pid 66529 (creat), uid 1004 inumber 643 on /mnt: out of inodes Apr 19 19:11:05 x4 kernel: pid 66551 (creat), uid 1004 inumber 5 on /mnt: out of inodes Apr 19 19:11:06 x4 inetd[757]: discard/udp server failing (looping), service terminated Apr 19 19:11:17 x4 kernel: pid 70429 (rw), uid 1004 inumber 668 on /mnt: filesystem full Apr 19 19:11:19 x4 kernel: pid 70426 (creat), uid 1004 inumber 1434 on /mnt: out of inodes Apr 19 19:11:37 x4 kernel: pid 70428 (rw), uid 1004 inumber 1917 on /mnt: filesystem full Apr 19 19:11:37 x4 kernel: pid 70418 (rw), uid 1004 inumber 2048 on /mnt: filesystem full Apr 19 19:11:37 x4 kernel: pid 70431 (rw), uid 1004 inumber 2154 on /mnt: filesystem full Apr 19 19:11:37 x4 kernel: pid 70415 (creat), uid 1004 inumber 1417 on /mnt: out of inodes Apr 19 19:11:44 x4 kernel: pid 70430 (rw), uid 1004 inumber 1027 on /mnt: filesystem full Apr 19 19:11:45 x4 kernel: pid 70415 (creat), uid 1004 inumber 1417 on /mnt: out of inodes Apr 19 19:11:47 x4 kernel: pid 70434 (creat), uid 1004 inumber 1452 on /mnt: out of inodes Apr 19 19:11:48 x4 kernel: pid 70436 (creat), uid 1004 inumber 1444 on /mnt: out of inodes Apr 19 19:11:50 x4 kernel: pid 70413 (creat), uid 1004 inumber 1029 on /mnt: out of inodes Apr 19 19:11:52 x4 kernel: pid 70435 (creat), uid 1004 inumber 1445 on /mnt: out of inodes Apr 19 19:11:56 x4 kernel: pid 70437 (creat), uid 1004 inumber 302 on /mnt: out of inodes Apr 19 19:11:58 x4 kernel: pid 70413 (creat), uid 1004 inumber 1029 on /mnt: out of inodes Apr 19 19:12:00 x4 kernel: pid 70435 (creat), uid 1004 inumber 1445 on /mnt: out of inodes Apr 19 19:12:01 x4 kernel: pid 70433 (creat), uid 1004 inumber 1441 on /mnt: out of inodes Apr 19 19:12:04 x4 kernel: pid 70415 (creat), uid 1004 inumber 1417 on /mnt: out of inodes Apr 19 19:12:11 x4 kernel: pid 75273 (rw), uid 1004 inumber 2242 on /mnt: filesystem full Apr 19 19:12:14 x4 kernel: pid 75277 (mkdir), uid 1004 inumber 542 on /mnt: filesystem full Apr 19 19:12:14 x4 kernel: pid 75267 (rw), uid 1004 inumber 412 on /mnt: filesystem full Apr 19 19:12:15 x4 kernel: pid 75268 (rw), uid 1004 inumber 1958 on /mnt: filesystem full Apr 19 19:12:15 x4 kernel: pid 75278 (mkdir), uid 1004 inumber 37 on /mnt: out of inodes Apr 19 19:12:17 x4 kernel: pid 75291 (creat), uid 1004 inumber 10 on /mnt: out of inodes Apr 19 19:12:19 x4 kernel: pid 75275 (creat), uid 1004 inumber 1924 on /mnt: out of inodes Apr 19 19:12:21 x4 kernel: pid 75284 (mkdir), uid 1004 inumber 607 on /mnt: out of inodes Apr 19 19:12:23 x4 kernel: pid 75292 (creat), uid 1004 inumber 646 on /mnt: out of inodes Apr 19 19:12:24 x4 kernel: pid 75270 (rw), uid 1004 inumber 453 on /mnt: filesystem full Apr 19 19:12:24 x4 kernel: pid 75292 (creat), uid 1004 inumber 646 on /mnt: out of inodes Apr 19 19:12:26 x4 kernel: pid 75276 (creat), uid 1004 inumber 1280 on /mnt: out of inodes Apr 19 19:12:26 x4 kernel: pid 75272 (rw), uid 1004 inumber 2540 on /mnt: filesystem full Apr 19 19:12:27 x4 kernel: pid 75285 (rw), uid 1004 inumber 2186 on /mnt: filesystem full Apr 19 19:12:28 x4 kernel: pid 75290 (creat), uid 1004 inumber 640 on /mnt: out of inodes Apr 19 19:12:29 x4 kernel: pid 75292 (creat), uid 1004 inumber 646 on /mnt: out of inodes Apr 19 19:12:29 x4 kernel: pid 75288 (creat), uid 1004 inumber 9 on /mnt: out of inodes Apr 19 19:12:31 x4 kernel: pid 75265 (rw), uid 1004 inumber 1921 on /mnt: out of inodes Apr 19 19:12:32 x4 kernel: pid 75289 (creat), uid 1004 inumber 645 on /mnt: out of inodes Apr 19 19:12:33 x4 kernel: pid 75292 (creat), uid 1004 inumber 646 on /mnt: out of inodes Apr 19 19:12:34 x4 kernel: pid 75289 (creat), uid 1004 inumber 645 on /mnt: out of inodes Apr 19 19:12:35 x4 kernel: pid 75291 (creat), uid 1004 inumber 10 on /mnt: out of inodes Apr 19 19:12:36 x4 kernel: pid 75291 (creat), uid 1004 inumber 10 on /mnt: out of inodes Apr 19 19:12:37 x4 kernel: pid 75292 (creat), uid 1004 inumber 646 on /mnt: out of inodes Apr 19 19:12:39 x4 kernel: pid 75289 (creat), uid 1004 inumber 645 on /mnt: out of inodes Apr 19 19:12:40 x4 kernel: pid 75292 (creat), uid 1004 inumber 646 on /mnt: out of inodes Apr 19 19:12:41 x4 kernel: pid 75290 (creat), uid 1004 inumber 640 on /mnt: out of inodes Apr 19 19:12:42 x4 kernel: pid 75288 (creat), uid 1004 inumber 9 on /mnt: out of inodes Apr 19 19:12:43 x4 kernel: pid 75290 (creat), uid 1004 inumber 640 on /mnt: out of inodes Apr 19 19:12:44 x4 kernel: pid 75288 (creat), uid 1004 inumber 9 on /mnt: out of inodes Apr 19 19:12:45 x4 kernel: pid 75290 (creat), uid 1004 inumber 640 on /mnt: out of inodes Apr 19 19:12:46 x4 kernel: pid 75292 (creat), uid 1004 inumber 646 on /mnt: out of inodes Apr 19 19:12:47 x4 kernel: pid 75288 (creat), uid 1004 inumber 9 on /mnt: out of inodes Apr 19 19:12:48 x4 kernel: pid 75290 (creat), uid 1004 inumber 640 on /mnt: out of inodes Apr 19 19:12:49 x4 kernel: pid 75288 (creat), uid 1004 inumber 9 on /mnt: out of inodes Apr 19 19:12:52 x4 last message repeated 2 times Apr 19 19:12:53 x4 kernel: pid 75289 (creat), uid 1004 inumber 645 on /mnt: out of inodes Apr 19 19:12:54 x4 kernel: pid 75276 (creat), uid 1004 inumber 1280 on /mnt: out of inodes Apr 19 19:12:55 x4 kernel: pid 75292 (creat), uid 1004 inumber 646 on /mnt: out of inodes Apr 19 19:12:56 x4 kernel: pid 75275 (creat), uid 1004 inumber 1924 on /mnt: out of inodes Apr 19 19:12:57 x4 kernel: pid 75289 (creat), uid 1004 inumber 645 on /mnt: out of inodes Apr 19 19:12:58 x4 kernel: pid 75289 (creat), uid 1004 inumber 645 on /mnt: out of inodes Apr 19 19:12:59 x4 kernel: pid 75291 (creat), uid 1004 inumber 10 on /mnt: out of inodes Apr 19 19:13:00 x4 kernel: pid 75291 (creat), uid 1004 inumber 10 on /mnt: out of inodes Apr 19 19:13:01 x4 kernel: pid 75289 (creat), uid 1004 inumber 645 on /mnt: out of inodes Apr 19 19:13:02 x4 kernel: pid 75275 (creat), uid 1004 inumber 1924 on /mnt: out of inodes Apr 19 19:13:03 x4 kernel: pid 75292 (creat), uid 1004 inumber 646 on /mnt: out of inodes Apr 19 19:13:05 x4 kernel: pid 75275 (creat), uid 1004 inumber 1924 on /mnt: out of inodes Apr 19 19:13:06 x4 kernel: pid 75288 (creat), uid 1004 inumber 9 on /mnt: out of inodes Apr 19 19:13:07 x4 kernel: pid 75289 (creat), uid 1004 inumber 645 on /mnt: out of inodes Apr 19 19:13:11 x4 kernel: pid 81005 (creat), uid 1004 inumber 121 on /mnt: out of inodes Apr 19 19:13:11 x4 kernel: pid 80995 (rw), uid 1004 inumber 1751 on /mnt: filesystem full Apr 19 19:13:11 x4 kernel: pid 80997 (rw), uid 1004 inumber 2213 on /mnt: filesystem full Apr 19 19:13:11 x4 kernel: pid 80999 (rw), uid 1004 inumber 1782 on /mnt: filesystem full Apr 19 19:13:12 x4 kernel: pid 81014 (mkdir), uid 1004 inumber 503 on /mnt: out of inodes Apr 19 19:13:14 x4 kernel: pid 80998 (creat), uid 1004 inumber 123 on /mnt: out of inodes Apr 19 19:13:16 x4 kernel: pid 80998 (creat), uid 1004 inumber 123 on /mnt: out of inodes Apr 19 19:13:17 x4 kernel: pid 81011 (creat), uid 1004 inumber 720 on /mnt: out of inodes Apr 19 19:13:18 x4 kernel: pid 81002 (creat), uid 1004 inumber 132 on /mnt: out of inodes Apr 19 19:13:19 x4 kernel: pid 81008 (creat), uid 1004 inumber 710 on /mnt: out of inodes Apr 19 19:13:20 x4 kernel: pid 81008 (creat), uid 1004 inumber 710 on /mnt: out of inodes Apr 19 19:13:21 x4 kernel: pid 80998 (creat), uid 1004 inumber 123 on /mnt: out of inodes Apr 19 19:13:22 x4 kernel: pid 81011 (creat), uid 1004 inumber 720 on /mnt: out of inodes Apr 19 19:13:23 x4 kernel: pid 81005 (creat), uid 1004 inumber 121 on /mnt: out of inodes Apr 19 19:13:24 x4 kernel: pid 80998 (creat), uid 1004 inumber 123 on /mnt: out of inodes Apr 19 19:13:25 x4 kernel: pid 81011 (creat), uid 1004 inumber 720 on /mnt: out of inodes Apr 19 19:13:26 x4 kernel: pid 81008 (creat), uid 1004 inumber 710 on /mnt: out of inodes Apr 19 19:13:27 x4 kernel: pid 81011 (creat), uid 1004 inumber 720 on /mnt: out of inodes Apr 19 19:13:28 x4 kernel: pid 81011 (creat), uid 1004 inumber 720 on /mnt: out of inodes Apr 19 19:13:29 x4 kernel: pid 81002 (creat), uid 1004 inumber 132 on /mnt: out of inodes Apr 19 19:13:30 x4 kernel: pid 81002 (creat), uid 1004 inumber 132 on /mnt: out of inodes Apr 19 19:13:31 x4 kernel: pid 81005 (creat), uid 1004 inumber 121 on /mnt: out of inodes Apr 19 19:13:32 x4 kernel: pid 81002 (creat), uid 1004 inumber 132 on /mnt: out of inodes Apr 19 19:13:33 x4 kernel: pid 80998 (creat), uid 1004 inumber 123 on /mnt: out of inodes Apr 19 19:13:34 x4 kernel: pid 81008 (creat), uid 1004 inumber 710 on /mnt: out of inodes Apr 19 19:13:35 x4 kernel: pid 80998 (creat), uid 1004 inumber 123 on /mnt: out of inodes Apr 19 19:13:37 x4 kernel: pid 80998 (creat), uid 1004 inumber 123 on /mnt: out of inodes Apr 19 19:13:38 x4 kernel: pid 81002 (creat), uid 1004 inumber 132 on /mnt: out of inodes Apr 19 19:13:39 x4 kernel: pid 81002 (creat), uid 1004 inumber 132 on /mnt: out of inodes Apr 19 19:13:40 x4 kernel: pid 81008 (creat), uid 1004 inumber 710 on /mnt: out of inodes Apr 19 19:13:42 x4 last message repeated 2 times Apr 19 19:13:43 x4 kernel: pid 80998 (creat), uid 1004 inumber 123 on /mnt: out of inodes Apr 19 19:13:44 x4 kernel: pid 80998 (creat), uid 1004 inumber 123 on /mnt: out of inodes Apr 19 19:13:45 x4 kernel: pid 81002 (creat), uid 1004 inumber 132 on /mnt: out of inodes Apr 19 19:13:46 x4 kernel: pid 80998 (creat), uid 1004 inumber 123 on /mnt: out of inodes Apr 19 19:13:47 x4 kernel: pid 81005 (creat), uid 1004 inumber 121 on /mnt: out of inodes Apr 19 19:13:48 x4 kernel: pid 81002 (creat), uid 1004 inumber 132 on /mnt: out of inodes Apr 19 19:13:49 x4 kernel: pid 81002 (creat), uid 1004 inumber 132 on /mnt: out of inodes Apr 19 19:13:50 x4 kernel: pid 81011 (creat), uid 1004 inumber 720 on /mnt: out of inodes Apr 19 19:13:51 x4 kernel: pid 81005 (creat), uid 1004 inumber 121 on /mnt: out of inodes Apr 19 19:13:52 x4 kernel: pid 81005 (creat), uid 1004 inumber 121 on /mnt: out of inodes Apr 19 19:13:53 x4 kernel: pid 80998 (creat), uid 1004 inumber 123 on /mnt: out of inodes Apr 19 19:13:54 x4 kernel: pid 81008 (creat), uid 1004 inumber 710 on /mnt: out of inodes Apr 19 19:13:55 x4 kernel: pid 81011 (creat), uid 1004 inumber 720 on /mnt: out of inodes Apr 19 19:13:56 x4 kernel: pid 80998 (creat), uid 1004 inumber 123 on /mnt: out of inodes Apr 19 19:13:57 x4 kernel: pid 81008 (creat), uid 1004 inumber 710 on /mnt: out of inodes Apr 19 19:13:58 x4 kernel: pid 81002 (creat), uid 1004 inumber 132 on /mnt: out of inodes Apr 19 19:13:59 x4 kernel: pid 81008 (creat), uid 1004 inumber 710 on /mnt: out of inodes Apr 19 19:14:00 x4 kernel: pid 81002 (creat), uid 1004 inumber 132 on /mnt: out of inodes Apr 19 19:14:01 x4 kernel: pid 81011 (creat), uid 1004 inumber 720 on /mnt: out of inodes Apr 19 19:14:02 x4 kernel: pid 81002 (creat), uid 1004 inumber 132 on /mnt: out of inodes Apr 19 19:14:04 x4 last message repeated 2 times Apr 19 19:14:05 x4 kernel: pid 81005 (creat), uid 1004 inumber 121 on /mnt: out of inodes Apr 19 19:14:06 x4 kernel: pid 81011 (creat), uid 1004 inumber 720 on /mnt: out of inodes Apr 19 19:14:16 x4 kernel: pid 87065 (creat), uid 1004 inumber 1292 on /mnt: out of inodes Apr 19 19:14:18 x4 kernel: pid 87041 (rw), uid 1004 inumber 1293 on /mnt: out of inodes Apr 19 19:14:19 x4 kernel: pid 87048 (mkdir), uid 1004 inumber 724 on /mnt: out of inodes Apr 19 19:14:20 x4 kernel: pid 87062 (creat), uid 1004 inumber 1928 on /mnt: out of inodes Apr 19 19:14:22 x4 kernel: pid 87057 (mkdir), uid 1004 inumber 740 on /mnt: out of inodes Apr 19 19:14:24 x4 kernel: pid 87050 (creat), uid 1004 inumber 647 on /mnt: out of inodes Apr 19 19:14:26 x4 kernel: pid 87036 (rw), uid 1004 inumber 653 on /mnt: out of inodes Apr 19 19:14:42 x4 kernel: pid 87050 (creat), uid 1004 inumber 647 on /mnt: out of inodes Apr 19 19:14:48 x4 kernel: pid 87050 (creat), uid 1004 inumber 647 on /mnt: out of inodes Apr 19 19:14:52 x4 kernel: pid 87061 (mkdir), uid 1004 inumber 2012 on /mnt: filesystem full Apr 19 19:15:01 x4 kernel: pid 87067 (creat), uid 1004 inumber 1930 on /mnt: out of inodes Apr 19 19:15:16 x4 kernel: pid 91070 (rw), uid 1004 inumber 670 on /mnt: filesystem full Apr 19 19:15:19 x4 kernel: pid 91076 (creat), uid 1004 inumber 1935 on /mnt: out of inodes Apr 19 19:15:20 x4 kernel: pid 91073 (creat), uid 1004 inumber 1936 on /mnt: out of inodes Apr 19 19:15:21 x4 kernel: pid 91078 (creat), uid 1004 inumber 1943 on /mnt: out of inodes Apr 19 19:15:23 x4 kernel: pid 91075 (creat), uid 1004 inumber 1289 on /mnt: out of inodes Apr 19 19:15:24 x4 kernel: pid 91073 (creat), uid 1004 inumber 1936 on /mnt: out of inodes Apr 19 19:15:25 x4 kernel: pid 91073 (creat), uid 1004 inumber 1936 on /mnt: out of inodes Apr 19 19:15:27 x4 kernel: pid 91076 (creat), uid 1004 inumber 1935 on /mnt: out of inodes Apr 19 19:15:28 x4 kernel: pid 91067 (creat), uid 1004 inumber 1925 on /mnt: out of inodes Apr 19 19:15:30 x4 kernel: pid 91078 (creat), uid 1004 inumber 1943 on /mnt: out of inodes Apr 19 19:15:31 x4 kernel: pid 91071 (creat), uid 1004 inumber 1942 on /mnt: out of inodes Apr 19 19:15:32 x4 kernel: pid 91072 (creat), uid 1004 inumber 654 on /mnt: out of inodes Apr 19 19:15:34 x4 kernel: pid 91075 (creat), uid 1004 inumber 1289 on /mnt: out of inodes Apr 19 19:15:35 x4 kernel: pid 91078 (creat), uid 1004 inumber 1943 on /mnt: out of inodes Apr 19 19:15:36 x4 kernel: pid 91072 (creat), uid 1004 inumber 654 on /mnt: out of inodes Apr 19 19:15:37 x4 kernel: pid 91071 (creat), uid 1004 inumber 1942 on /mnt: out of inodes Apr 19 19:15:38 x4 kernel: pid 91071 (creat), uid 1004 inumber 1942 on /mnt: out of inodes Apr 19 19:15:39 x4 kernel: pid 91067 (creat), uid 1004 inumber 1925 on /mnt: out of inodes Apr 19 19:15:40 x4 kernel: pid 91075 (creat), uid 1004 inumber 1289 on /mnt: out of inodes Apr 19 19:15:42 x4 kernel: pid 91072 (creat), uid 1004 inumber 654 on /mnt: out of inodes Apr 19 19:15:44 x4 kernel: pid 91080 (creat), uid 1004 inumber 1283 on /mnt: out of inodes Apr 19 19:15:45 x4 kernel: pid 91073 (creat), uid 1004 inumber 1936 on /mnt: out of inodes Apr 19 19:15:47 x4 kernel: pid 91081 (creat), uid 1004 inumber 1927 on /mnt: out of inodes Apr 19 19:15:48 x4 kernel: pid 91077 (creat), uid 1004 inumber 1938 on /mnt: out of inodes Apr 19 19:15:49 x4 kernel: pid 91079 (creat), uid 1004 inumber 1950 on /mnt: out of inodes Apr 19 19:15:51 x4 kernel: pid 91079 (creat), uid 1004 inumber 1950 on /mnt: out of inodes Apr 19 19:15:52 x4 kernel: pid 91076 (creat), uid 1004 inumber 1935 on /mnt: out of inodes Apr 19 19:15:53 x4 kernel: pid 91079 (creat), uid 1004 inumber 1950 on /mnt: out of inodes Apr 19 19:15:54 x4 kernel: pid 91076 (creat), uid 1004 inumber 1935 on /mnt: out of inodes Apr 19 19:15:56 x4 last message repeated 2 times Apr 19 19:15:58 x4 kernel: pid 91069 (creat), uid 1004 inumber 1993 on /mnt: out of inodes Apr 19 19:15:59 x4 kernel: pid 91067 (creat), uid 1004 inumber 1925 on /mnt: out of inodes Apr 19 19:16:00 x4 kernel: pid 91074 (creat), uid 1004 inumber 646 on /mnt: out of inodes Apr 19 19:16:01 x4 kernel: pid 91076 (creat), uid 1004 inumber 1935 on /mnt: out of inodes Apr 19 19:16:02 x4 kernel: pid 91081 (creat), uid 1004 inumber 1927 on /mnt: out of inodes Apr 19 19:16:04 x4 kernel: pid 91069 (creat), uid 1004 inumber 1993 on /mnt: out of inodes Apr 19 19:16:05 x4 kernel: pid 91071 (creat), uid 1004 inumber 1942 on /mnt: out of inodes Apr 19 19:16:06 x4 kernel: pid 91080 (creat), uid 1004 inumber 1283 on /mnt: out of inodes Apr 19 19:16:07 x4 kernel: pid 91076 (creat), uid 1004 inumber 1935 on /mnt: out of inodes Apr 19 19:16:10 x4 kernel: pid 96116 (rw), uid 1004 inumber 654 on /mnt: filesystem full Apr 19 19:16:10 x4 kernel: pid 96112 (rw), uid 1004 inumber 647 on /mnt: filesystem full Apr 19 19:16:11 x4 kernel: pid 96117 (rw), uid 1004 inumber 884 on /mnt: filesystem full Apr 19 19:16:12 x4 kernel: pid 96123 (creat), uid 1004 inumber 659 on /mnt: out of inodes Apr 19 19:16:13 x4 kernel: pid 96124 (creat), uid 1004 inumber 660 on /mnt: out of inodes Apr 19 19:16:14 x4 kernel: pid 96125 (creat), uid 1004 inumber 646 on /mnt: out of inodes Apr 19 19:16:15 x4 kernel: pid 96122 (creat), uid 1004 inumber 1283 on /mnt: out of inodes Apr 19 19:16:16 x4 kernel: pid 96122 (creat), uid 1004 inumber 1283 on /mnt: out of inodes Apr 19 19:16:17 x4 kernel: pid 96123 (creat), uid 1004 inumber 659 on /mnt: out of inodes Apr 19 19:16:18 x4 kernel: pid 96122 (creat), uid 1004 inumber 1283 on /mnt: out of inodes Apr 19 19:16:20 x4 last message repeated 2 times Apr 19 19:16:21 x4 kernel: pid 96125 (creat), uid 1004 inumber 646 on /mnt: out of inodes Apr 19 19:16:22 x4 kernel: pid 96123 (creat), uid 1004 inumber 659 on /mnt: out of inodes Apr 19 19:16:23 x4 kernel: pid 96125 (creat), uid 1004 inumber 646 on /mnt: out of inodes Apr 19 19:16:24 x4 kernel: pid 96122 (creat), uid 1004 inumber 1283 on /mnt: out of inodes Apr 19 19:16:25 x4 kernel: pid 96123 (creat), uid 1004 inumber 659 on /mnt: out of inodes Apr 19 19:16:26 x4 kernel: pid 96122 (creat), uid 1004 inumber 1283 on /mnt: out of inodes Apr 19 19:16:27 x4 kernel: pid 96125 (creat), uid 1004 inumber 646 on /mnt: out of inodes Apr 19 19:16:28 x4 kernel: pid 96122 (creat), uid 1004 inumber 1283 on /mnt: out of inodes Apr 19 19:16:29 x4 kernel: pid 96122 (creat), uid 1004 inumber 1283 on /mnt: out of inodes Apr 19 19:16:30 x4 kernel: pid 96119 (creat), uid 1004 inumber 645 on /mnt: out of inodes Apr 19 19:16:31 x4 kernel: pid 96122 (creat), uid 1004 inumber 1283 on /mnt: out of inodes Apr 19 19:16:32 x4 kernel: pid 96122 (creat), uid 1004 inumber 1283 on /mnt: out of inodes Apr 19 19:16:33 x4 kernel: pid 96124 (creat), uid 1004 inumber 660 on /mnt: out of inodes Apr 19 19:16:34 x4 kernel: pid 96122 (creat), uid 1004 inumber 1283 on /mnt: out of inodes Apr 19 19:16:35 x4 kernel: pid 96122 (creat), uid 1004 inumber 1283 on /mnt: out of inodes Apr 19 19:16:36 x4 kernel: pid 96125 (creat), uid 1004 inumber 646 on /mnt: out of inodes Apr 19 19:16:37 x4 kernel: pid 96125 (creat), uid 1004 inumber 646 on /mnt: out of inodes Apr 19 19:16:38 x4 kernel: pid 96122 (creat), uid 1004 inumber 1283 on /mnt: out of inodes Apr 19 19:16:39 x4 kernel: pid 96122 (creat), uid 1004 inumber 1283 on /mnt: out of inodes Apr 19 19:16:40 x4 kernel: pid 96125 (creat), uid 1004 inumber 646 on /mnt: out of inodes Apr 19 19:16:41 x4 kernel: pid 96125 (creat), uid 1004 inumber 646 on /mnt: out of inodes Apr 19 19:16:42 x4 kernel: pid 96124 (creat), uid 1004 inumber 660 on /mnt: out of inodes Apr 19 19:16:43 x4 kernel: pid 96122 (creat), uid 1004 inumber 1283 on /mnt: out of inodes Apr 19 19:16:44 x4 kernel: pid 96123 (creat), uid 1004 inumber 659 on /mnt: out of inodes Apr 19 19:16:45 x4 kernel: pid 96123 (creat), uid 1004 inumber 659 on /mnt: out of inodes Apr 19 19:16:46 x4 kernel: pid 96122 (creat), uid 1004 inumber 1283 on /mnt: out of inodes Apr 19 19:16:47 x4 kernel: pid 96119 (creat), uid 1004 inumber 645 on /mnt: out of inodes Apr 19 19:16:48 x4 kernel: pid 96122 (creat), uid 1004 inumber 1283 on /mnt: out of inodes Apr 19 19:16:49 x4 kernel: pid 96119 (creat), uid 1004 inumber 645 on /mnt: out of inodes Apr 19 19:16:51 x4 kernel: pid 96122 (creat), uid 1004 inumber 1283 on /mnt: out of inodes Apr 19 19:16:52 x4 kernel: pid 96123 (creat), uid 1004 inumber 659 on /mnt: out of inodes Apr 19 19:16:53 x4 kernel: pid 96122 (creat), uid 1004 inumber 1283 on /mnt: out of inodes Apr 19 19:16:54 x4 kernel: pid 96122 (creat), uid 1004 inumber 1283 on /mnt: out of inodes Apr 19 19:16:55 x4 kernel: pid 96119 (creat), uid 1004 inumber 645 on /mnt: out of inodes Apr 19 19:16:56 x4 kernel: pid 96125 (creat), uid 1004 inumber 646 on /mnt: out of inodes Apr 19 19:16:57 x4 kernel: pid 96125 (creat), uid 1004 inumber 646 on /mnt: out of inodes Apr 19 19:16:58 x4 kernel: pid 96122 (creat), uid 1004 inumber 1283 on /mnt: out of inodes Apr 19 19:16:59 x4 kernel: pid 96122 (creat), uid 1004 inumber 1283 on /mnt: out of inodes Apr 19 19:17:00 x4 kernel: pid 96124 (creat), uid 1004 inumber 660 on /mnt: out of inodes Apr 19 19:17:01 x4 kernel: pid 96122 (creat), uid 1004 inumber 1283 on /mnt: out of inodes Apr 19 19:17:02 x4 kernel: pid 96122 (creat), uid 1004 inumber 1283 on /mnt: out of inodes Apr 19 19:17:03 x4 kernel: pid 96123 (creat), uid 1004 inumber 659 on /mnt: out of inodes Apr 19 19:17:04 x4 kernel: pid 96119 (creat), uid 1004 inumber 645 on /mnt: out of inodes Apr 19 19:17:05 x4 kernel: pid 96122 (creat), uid 1004 inumber 1283 on /mnt: out of inodes Apr 19 19:17:06 x4 kernel: pid 96125 (creat), uid 1004 inumber 646 on /mnt: out of inodes Apr 19 19:17:07 x4 kernel: pid 96125 (creat), uid 1004 inumber 646 on /mnt: out of inodes Apr 19 19:17:08 x4 kernel: pid 96122 (creat), uid 1004 inumber 1283 on /mnt: out of inodes Apr 19 19:17:12 x4 kernel: pid 2261 (creat), uid 1004 inumber 1925 on /mnt: out of inodes Apr 19 19:17:13 x4 kernel: pid 2285 (mkdir), uid 1004 inumber 1892 on /mnt: out of inodes Apr 19 19:17:14 x4 kernel: pid 2269 (creat), uid 1004 inumber 1928 on /mnt: out of inodes Apr 19 19:17:15 x4 kernel: pid 2284 (creat), uid 1004 inumber 644 on /mnt: out of inodes Apr 19 19:17:17 x4 kernel: pid 2274 (creat), uid 1004 inumber 641 on /mnt: out of inodes Apr 19 19:17:18 x4 kernel: pid 2287 (mkdir), uid 1004 inumber 1292 on /mnt: out of inodes Apr 19 19:17:19 x4 kernel: pid 2257 (creat), uid 1004 inumber 1926 on /mnt: out of inodes Apr 19 19:17:20 x4 kernel: pid 2277 (creat), uid 1004 inumber 1281 on /mnt: out of inodes Apr 19 19:17:21 x4 kernel: pid 2257 (creat), uid 1004 inumber 1926 on /mnt: out of inodes Apr 19 19:17:22 x4 kernel: pid 2269 (creat), uid 1004 inumber 1928 on /mnt: out of inodes Apr 19 19:17:23 x4 kernel: pid 2263 (creat), uid 1004 inumber 8 on /mnt: out of inodes Apr 19 19:17:24 x4 kernel: pid 2284 (creat), uid 1004 inumber 644 on /mnt: out of inodes Apr 19 19:17:25 x4 kernel: pid 2286 (creat), uid 1004 inumber 5 on /mnt: out of inodes Apr 19 19:17:26 x4 kernel: pid 2257 (creat), uid 1004 inumber 1926 on /mnt: out of inodes Apr 19 19:17:28 x4 kernel: pid 2266 (creat), uid 1004 inumber 1927 on /mnt: out of inodes Apr 19 19:17:29 x4 kernel: pid 2269 (creat), uid 1004 inumber 1928 on /mnt: out of inodes Apr 19 19:17:30 x4 kernel: pid 2263 (creat), uid 1004 inumber 8 on /mnt: out of inodes Apr 19 19:17:31 x4 kernel: pid 2274 (creat), uid 1004 inumber 641 on /mnt: out of inodes Apr 19 19:17:32 x4 kernel: pid 2269 (creat), uid 1004 inumber 1928 on /mnt: out of inodes Apr 19 19:17:33 x4 kernel: pid 2284 (creat), uid 1004 inumber 644 on /mnt: out of inodes Apr 19 19:17:34 x4 kernel: pid 2275 (creat), uid 1004 inumber 6 on /mnt: out of inodes Apr 19 19:17:35 x4 kernel: pid 2286 (creat), uid 1004 inumber 5 on /mnt: out of inodes Apr 19 19:17:36 x4 kernel: pid 2282 (creat), uid 1004 inumber 1282 on /mnt: out of inodes Apr 19 19:17:37 x4 kernel: pid 2257 (creat), uid 1004 inumber 1926 on /mnt: out of inodes Apr 19 19:17:38 x4 kernel: pid 2269 (creat), uid 1004 inumber 1928 on /mnt: out of inodes Apr 19 19:17:39 x4 kernel: pid 2257 (creat), uid 1004 inumber 1926 on /mnt: out of inodes Apr 19 19:17:41 x4 kernel: pid 2271 (creat), uid 1004 inumber 1280 on /mnt: out of inodes Apr 19 19:17:42 x4 kernel: pid 2269 (creat), uid 1004 inumber 1928 on /mnt: out of inodes Apr 19 19:17:43 x4 kernel: pid 2254 (creat), uid 1004 inumber 1923 on /mnt: out of inodes Apr 19 19:17:44 x4 kernel: pid 2284 (creat), uid 1004 inumber 644 on /mnt: out of inodes Apr 19 19:17:45 x4 kernel: pid 2269 (creat), uid 1004 inumber 1928 on /mnt: out of inodes Apr 19 19:17:46 x4 kernel: pid 2263 (creat), uid 1004 inumber 8 on /mnt: out of inodes Apr 19 19:17:47 x4 kernel: pid 2277 (creat), uid 1004 inumber 1281 on /mnt: out of inodes Apr 19 19:17:48 x4 kernel: pid 2266 (creat), uid 1004 inumber 1927 on /mnt: out of inodes Apr 19 19:17:49 x4 kernel: pid 2279 (creat), uid 1004 inumber 643 on /mnt: out of inodes Apr 19 19:17:50 x4 kernel: pid 2271 (creat), uid 1004 inumber 1280 on /mnt: out of inodes Apr 19 19:17:51 x4 kernel: pid 2261 (creat), uid 1004 inumber 1925 on /mnt: out of inodes Apr 19 19:17:52 x4 kernel: pid 2257 (creat), uid 1004 inumber 1926 on /mnt: out of inodes Apr 19 19:17:53 x4 kernel: pid 2254 (creat), uid 1004 inumber 1923 on /mnt: out of inodes Apr 19 19:17:54 x4 kernel: pid 2254 (creat), uid 1004 inumber 1923 on /mnt: out of inodes Apr 19 19:17:55 x4 kernel: pid 2275 (creat), uid 1004 inumber 6 on /mnt: out of inodes Apr 19 19:17:56 x4 kernel: pid 2254 (creat), uid 1004 inumber 1923 on /mnt: out of inodes Apr 19 19:17:57 x4 kernel: pid 2268 (creat), uid 1004 inumber 642 on /mnt: out of inodes Apr 19 19:17:58 x4 kernel: pid 2268 (creat), uid 1004 inumber 642 on /mnt: out of inodes Apr 19 19:18:00 x4 kernel: pid 2269 (creat), uid 1004 inumber 1928 on /mnt: out of inodes Apr 19 19:18:01 x4 kernel: pid 2274 (creat), uid 1004 inumber 641 on /mnt: out of inodes Apr 19 19:18:02 x4 kernel: pid 2269 (creat), uid 1004 inumber 1928 on /mnt: out of inodes Apr 19 19:18:03 x4 kernel: pid 2257 (creat), uid 1004 inumber 1926 on /mnt: out of inodes Apr 19 19:18:04 x4 kernel: pid 2261 (creat), uid 1004 inumber 1925 on /mnt: out of inodes Apr 19 19:18:05 x4 kernel: pid 2268 (creat), uid 1004 inumber 642 on /mnt: out of inodes Apr 19 19:18:06 x4 kernel: pid 2274 (creat), uid 1004 inumber 641 on /mnt: out of inodes Apr 19 19:18:07 x4 kernel: pid 2254 (creat), uid 1004 inumber 1923 on /mnt: out of inodes 20180419 19:18:10 all (89/566): fsck.sh Apr 19 19:21:07 x4 inetd[757]: discard/udp server failing (looping), service terminated 20180419 19:28:13 all (90/566): fsgs.sh 20180419 19:29:16 all (91/566): ftruncate.sh 20180419 19:32:24 all (92/566): ftruncate2.sh 20180419 19:35:28 all (93/566): fts.sh swap_pager: I/O error - pageout failed; blkno 3163488,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 3163520,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 3163552,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 3163584,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 3163616,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 3163648,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 3163680,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 3163712,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 3163744,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 3168384,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 3168448,size 131072, error 12 Apr 19 19:40:33 x4 kernel: pid 78986 (swap), uid 1004, was killed: out of swap space Apr 19 19:53:09 x4 kernel: pid 89513 (swap), uid 1004, was killed: out of swap space 20180419 19:57:01 all (94/566): fts2.sh 20180419 19:58:11 all (95/566): fts3.sh 20180419 20:00:23 all (96/566): full.sh Apr 19 20:00:26 x4 badcode: stack overflow detected; terminated Apr 19 20:00:35 x4 last message repeated 12 times Apr 19 20:05:41 x4 badcode: stack overflow detected; terminated swap_pager: I/O error - pageout failed; blkno 1126912,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1126944,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1127040,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1127072,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1127136,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1127168,size 131072, error 12 Expensive timeout(9) function: 0x12cebe0(0x24c3c2d0) 0.010570261 s Expensive timeout(9) function: 0xec6080(0x1afa3aa0) 0.013123572 s 20180419 20:12:55 all (97/566): fullpath.sh 20180419 20:14:04 all (98/566): fullpath2.sh Apr 19 20:10:25 x4 last message repeated 40 times 20180419 20:19:51 all (99/566): geli.sh GEOM leak: 7/865 20180419 20:20:04 all (100/566): geomleak.sh 20180419 20:20:09 all (101/566): gjournal.sh GEOM_JOURNAL: Journal 3224381166: md10 contains data. GEOM_JOURNAL: Journal 3224381166: md10 contains journal. GEOM_JOURNAL: Journal md10 clean. GEOM_JOURNAL: BIO_FLUSH not supported by md10. Apr 19 20:20:26 x4 kernel: pid 51073 (dd), uid 0 inumber 4 on /mnt2: filesystem full 20180419 20:20:28 all (102/566): gjournal4.sh 20180419 20:20:31 all (103/566): gnop.sh GEOM_NOP: Device md10.nop created. swap_pager: I/O error - pageout failed; blkno 1663104,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 1663120,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1663152,size 98304, error 12 swap_pager: I/O error - pageout failed; blkno 1663176,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1663208,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1663240,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1663272,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1663304,size 98304, error 12 swap_pager: I/O error - pageout failed; blkno 1663328,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 1663344,size 98304, error 12 swap_pager: I/O error - pageout failed; blkno 1663368,size 98304, error 12 GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. Apr 19 20:27:46 x4 kernel: pid 58602 (swap), uid 1004, was killed: out of swap space GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. 20180419 20:38:15 all (104/566): gnop2.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. 20180419 20:45:18 all (105/566): gnop3.sh GEOM_NOP: Device md10.nop created. Apr 19 21:05:44 x4 kernel: pid 30877 (swap), uid 1004, was killed: out of swap space GEOM_NOP: Device md10.nop removed. 20180419 21:06:44 all (106/566): gnop4.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. 20180419 21:31:30 all (107/566): gnop5.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. 20180419 21:31:35 all (108/566): graid0.sh GEOM_STRIPE: Device data created (id=136837622). GEOM_STRIPE: Disk md10 attached to data. GEOM_STRIPE: Disk md11 attached to data. GEOM_STRIPE: Disk md12 attached to data. GEOM_STRIPE: Device stripe/data activated. GEOM_STRIPE: Disk md12 removed from data. GEOM_STRIPE: Device stripe/data deactivated. GEOM_STRIPE: Disk md11 removed from data. GEOM_STRIPE: Disk md10 removed from data. GEOM_STRIPE: Device data destroyed. 20180419 21:42:25 all (109/566): graid1_10.sh 20180419 21:44:55 all (110/566): graid1_2.sh 20180419 21:50:10 all (111/566): graid1_3.sh 20180419 21:52:21 all (112/566): graid1_4.sh 20180419 22:05:22 all (113/566): graid1_5.sh GEOM_NOP: Device md11.nop created. GEOM_NOP: Device md12.nop created. GEOM_NOP: Device md11.nop removed. GEOM_NOP: Device md12.nop removed. 20180419 22:11:54 all (114/566): graid1_6.sh 20180419 22:18:32 all (115/566): graid1_7.sh 20180419 22:24:46 all (116/566): graid1.sh Apr 19 22:25:03 x4 kernel: pid 75321 (rw), uid 1004 inumber 4614 on /mnt: filesystem full Apr 19 22:25:23 x4 kernel: pid 75319 (rw), uid 1004 inumber 35880 on /mnt: filesystem full Apr 19 22:25:23 x4 kernel: pid 75316 (rw), uid 1004 inumber 18452 on /mnt: filesystem full Apr 19 22:25:23 x4 kernel: pid 75383 (link), uid 1004 inumber 16400 on /mnt: filesystem full swap_pager: I/O error - pageout failed; blkno 1843296,size 131072, error 12 Apr 19 22:29:36 x4 kernel: pid 80475 (rw), uid 1004 inumber 37593 on /mnt: filesystem full 20180419 22:35:16 all (117/566): graid3.sh GEOM_RAID3: Device raid3/data launched (3/3). Apr 19 22:40:08 x4 kernel: pid 94031 (swap), uid 1004, was killed: out of swap space GEOM_RAID3: Device data: provider raid3/data destroyed. GEOM_RAID3: Device data destroyed. 20180419 22:56:35 all (118/566): growfs.sh g_access(958): provider ufsid/5ad902856c586e7b has error 6 set g_access(958): provider ufsid/5ad902856c586e7b has error 6 set g_access(958): provider ufsid/5ad902856c586e7b has error 6 set g_access(958): provider ufsid/5ad902856c586e7b has error 6 set g_access(958): provider gptid/268fc3ab-4414-11e8-b689-00218515337d has error 6 set g_access(958): provider gptid/268fc3ab-4414-11e8-b689-00218515337d has error 6 set g_access(958): provider gptid/268fc3ab-4414-11e8-b689-00218515337d has error 6 set g_access(958): provider gptid/268fc3ab-4414-11e8-b689-00218515337d has error 6 set g_dev_taste: make_dev_p() failed (gp->name=gptid/268fc3ab-4414-11e8-b689-00218515337d, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/268fc3ab-4414-11e8-b689-00218515337d, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5ad902856c586e7b, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/268fc3ab-4414-11e8-b689-00218515337d, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5ad902856c586e7b, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/268fc3ab-4414-11e8-b689-00218515337d, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5ad902856c586e7b, error=17) GEOM leak: 7/872 20180419 22:56:52 all (119/566): holdcnt0.sh 20180419 22:56:55 all (120/566): holdcnt02.sh 20180419 22:56:57 all (121/566): holdcnt03.sh 20180419 22:56:59 all (122/566): holdcnt04.sh 20180419 22:57:01 all (123/566): inversion.sh 20180419 23:07:09 all (124/566): isofs.sh freework leak: 4951/5150. 20180419 23:07:22 all (125/566): isofs2.sh 20180419 23:07:25 all (126/566): isofs3.sh Apr 19 23:09:59 x4 run: stack overflow detected; terminated 20180419 23:10:03 all (127/566): jail.sh 20180419 23:10:11 all (128/566): jail2.sh 20180419 23:10:15 all (129/566): jail3.sh 20180419 23:10:18 all (130/566): jail4.sh 20180419 23:10:21 all (131/566): jumbo.sh 20180419 23:13:00 all (132/566): kern_umtx_inf_loop.sh 20180419 23:13:04 all (133/566): kevent.sh 20180419 23:15:07 all (134/566): kevent10.sh 20180419 23:15:11 all (135/566): kevent11.sh 20180419 23:18:17 all (136/566): kevent2.sh 20180419 23:18:28 all (137/566): kevent3.sh 20180419 23:18:34 all (138/566): kevent4.sh fsync: giving up on dirty (error = 35) 0x1ecd9000: tag devfs, type VCHR usecount 1, writecount 0, refcount 28 rdev 0x1affea00 flags (VI_ACTIVE) v_object 0x1ecefa5c ref 0 pages 1419 cleanbuf 23 dirtybuf 3 lock type devfs: EXCL by thread 0x25c4e000 (pid 87250, mkdir, tid 104729) with exclusive waiters pending #0 0x107b54f at lockmgr_xlock_hard+0x35f #1 0x107ae6e at lockmgr_lock_fast_path+0x23e #2 0x116bc3b at vop_stdlock+0x3b #3 0x16b5cfa at VOP_LOCK1_APV+0xda #4 0x1192661 at _vn_lock+0x61 #5 0x13c7db0 at ffs_sync+0x320 #6 0x13a9313 at softdep_ast_cleanup_proc+0x203 #7 0x1105fc6 at userret+0x1b6 #8 0x1680f95 at syscall+0x345 #9 0xffc032c0 at PTDpde+0x42c8 dev label/tmp 20180419 23:21:09 all (139/566): kevent5.sh 20180419 23:27:52 all (140/566): kevent6.sh 20180419 23:28:48 all (141/566): kevent7.sh 20180419 23:33:58 all (142/566): kevent8.sh 20180419 23:34:30 all (143/566): kevent9.sh 20180419 23:39:37 all (144/566): killpg.sh 20180419 23:39:41 all (145/566): kinfo.sh 20180419 23:59:46 all (146/566): kinfo2.sh 20180420 00:14:50 all (147/566): kinfo3.sh 20180420 00:34:56 all (148/566): laundry.sh 20180420 00:40:02 all (149/566): ldt.sh 20180420 00:40:06 all (150/566): ldt2.sh 20180420 00:40:08 all (151/566): libMicro.sh 20180420 00:41:12 all (152/566): linger.sh 20180420 00:56:23 all (153/566): linger2.sh Apr 20 00:56:27 x4 kernel: pid 49249 (linger2), uid 1004 inumber 888 on /mnt: filesystem full Apr 20 00:56:27 x4 kernel: pid 49253 (linger2), uid 1004 inumber 890 on /mnt: filesystem full 20180420 00:56:32 all (154/566): linger3.sh 20180420 00:56:49 all (155/566): linger4.sh 20180420 01:16:58 all (156/566): link.sh 20180420 01:21:36 all (157/566): link2.sh 20180420 01:23:45 all (158/566): lockd.sh 20180420 01:23:48 all (159/566): lockf.sh 20180420 01:23:51 all (160/566): lockf2.sh 20180420 01:29:19 all (161/566): lockf3.sh Apr 20 01:30:19 x4 kernel: pid 37953 (swap), uid 0, was killed: out of swap space Apr 20 01:50:07 x4 kernel: pid 41447 (swap), uid 0, was killed: out of swap space GEOM leak: 29/901 20180420 01:59:52 all (162/566): lockf4.sh 20180420 02:18:53 all (163/566): lookup_shared.sh 20180420 02:29:17 all (164/566): lstat.sh 20180420 02:39:28 all (165/566): mac_chkexec.sh 20180420 02:39:31 all (166/566): mac.sh 20180420 02:39:33 all (167/566): machipc.sh 20180420 02:39:35 all (168/566): machipc2.sh 20180420 02:39:37 all (169/566): marcus.sh Apr 20 02:45:58 x4 kernel: pid 13505 (rw), uid 1004 inumber 21276 on /mnt: filesystem full Apr 20 02:46:48 x4 kernel: pid 15322 (swap), uid 1004, was killed: out of swap space Apr 20 02:46:48 x4 kernel: pid 15330 (swap), uid 1004, was killed: out of swap space 20180420 03:10:25 all (170/566): marcus2.sh 20180420 03:31:46 all (171/566): marcus4.sh 20180420 03:49:56 all (172/566): marcus5.sh swap_pager: I/O error - pageout failed; blkno 1835788,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 1835804,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 1835820,size 32768, error 12 swap_pager: I/O error - pageout failed; blkno 1835836,size 32768, error 12 swap_pager: I/O error - pageout failed; blkno 1835844,size 32768, error 12 swap_pager: I/O error - pageout failed; blkno 1835852,size 131072, error 12 20180420 04:06:32 all (173/566): marcus6.sh 20180420 04:21:34 all (174/566): marcus7.sh 20180420 04:32:34 all (175/566): maxmemdom.sh 20180420 04:32:37 all (176/566): maxproc.sh maxproc limit exceeded by uid 1001 (pid 71808); see tuning(7) and login.conf(5) 20180420 04:33:01 all (177/566): maxvnodes.sh 20180420 04:43:31 all (178/566): md.sh Apr 20 04:43:36 x4 kernel: pid 89859 (rw), uid 0 inumber 5 on /mnt: filesystem full Apr 20 04:43:36 x4 kernel: pid 89861 (rw), uid 0 inumber 133 on /mnt: filesystem full Apr 20 04:45:34 x4 kernel: pid 2141 (rw), uid 0 inumber 132 on /mnt: filesystem full Apr 20 04:45:36 x4 kernel: pid 2139 (rw), uid 0 inumber 129 on /mnt: filesystem full Apr 20 04:45:38 x4 kernel: pid 2140 (rw), uid 0 inumber 129 on /mnt: filesystem full Apr 20 04:45:40 x4 kernel: pid 2138 (rw), uid 0 inumber 7 on /mnt: filesystem full Apr 20 04:47:34 x4 kernel: pid 14397 (rw), uid 0 inumber 130 on /mnt: filesystem full Apr 20 04:47:39 x4 kernel: pid 14406 (rw), uid 0 inumber 137 on /mnt: filesystem full Apr 20 04:47:39 x4 kernel: pid 14401 (rw), uid 0 inumber 138 on /mnt: filesystem full Apr 20 04:47:40 x4 kernel: pid 14402 (rw), uid 0 inumber 129 on /mnt: filesystem full Apr 20 04:47:41 x4 kernel: pid 14408 (rw), uid 0 inumber 130 on /mnt: filesystem full Apr 20 04:47:44 x4 kernel: pid 14407 (rw), uid 0 inumber 130 on /mnt: filesystem full Apr 20 04:47:44 x4 kernel: pid 14405 (rw), uid 0 inumber 134 on /mnt: filesystem full Apr 20 04:49:37 x4 kernel: pid 27997 (rw), uid 0 inumber 132 on /mnt: filesystem full Apr 20 04:49:38 x4 kernel: pid 27996 (rw), uid 0 inumber 130 on /mnt: filesystem full Apr 20 04:49:40 x4 kernel: pid 27995 (rw), uid 0 inumber 5 on /mnt: filesystem full Apr 20 04:49:47 x4 kernel: pid 28004 (rw), uid 0 inumber 134 on /mnt: filesystem full Apr 20 04:49:47 x4 kernel: pid 28005 (rw), uid 0 inumber 5 on /mnt: filesystem full Apr 20 04:51:43 x4 kernel: pid 40085 (rw), uid 0 inumber 11 on /mnt: filesystem full Apr 20 04:51:43 x4 kernel: pid 40093 (rw), uid 0 inumber 141 on /mnt: filesystem full Apr 20 04:51:44 x4 kernel: pid 40098 (rw), uid 0 inumber 12 on /mnt: filesystem full Apr 20 04:51:44 x4 kernel: pid 40095 (rw), uid 0 inumber 133 on /mnt: filesystem full Apr 20 04:51:46 x4 kernel: pid 40099 (rw), uid 0 inumber 136 on /mnt: filesystem full Apr 20 04:51:47 x4 kernel: pid 40088 (rw), uid 0 inumber 135 on /mnt: filesystem full Apr 20 04:51:49 x4 kernel: pid 40086 (rw), uid 0 inumber 132 on /mnt: filesystem full Apr 20 04:51:53 x4 kernel: pid 41633 (rw), uid 0 inumber 141 on /mnt: filesystem full Apr 20 04:51:53 x4 kernel: pid 41642 (rw), uid 0 inumber 12 on /mnt: filesystem full Apr 20 04:51:55 x4 kernel: pid 41639 (rw), uid 0 inumber 142 on /mnt: filesystem full Apr 20 04:51:56 x4 kernel: pid 41647 (rw), uid 0 inumber 6 on /mnt: filesystem full Apr 20 04:51:58 x4 kernel: pid 41644 (rw), uid 0 inumber 8 on /mnt: filesystem full Apr 20 04:51:59 x4 kernel: pid 41643 (rw), uid 0 inumber 5 on /mnt: filesystem full Apr 20 04:51:59 x4 kernel: pid 41646 (rw), uid 0 inumber 131 on /mnt: filesystem full Apr 20 04:52:00 x4 kernel: pid 41631 (rw), uid 0 inumber 131 on /mnt: filesystem full Apr 20 04:53:52 x4 kernel: pid 53792 (rw), uid 0 inumber 141 on /mnt: filesystem full Apr 20 04:53:52 x4 kernel: pid 53789 (rw), uid 0 inumber 140 on /mnt: filesystem full Apr 20 04:53:52 x4 kernel: pid 53793 (rw), uid 0 inumber 11 on /mnt: filesystem full Apr 20 04:53:54 x4 kernel: pid 53802 (rw), uid 0 inumber 129 on /mnt: filesystem full Apr 20 04:53:56 x4 kernel: pid 53797 (rw), uid 0 inumber 129 on /mnt: filesystem full Apr 20 04:53:56 x4 kernel: pid 53794 (rw), uid 0 inumber 10 on /mnt: filesystem full Apr 20 04:53:58 x4 kernel: pid 53801 (rw), uid 0 inumber 4 on /mnt: filesystem full Apr 20 04:53:59 x4 kernel: pid 53804 (rw), uid 0 inumber 134 on /mnt: filesystem full Apr 20 04:54:00 x4 kernel: pid 53798 (rw), uid 0 inumber 131 on /mnt: filesystem full Apr 20 04:54:00 x4 kernel: pid 53805 (rw), uid 0 inumber 129 on /mnt: filesystem full Apr 20 04:55:52 x4 kernel: pid 67366 (rw), uid 0 inumber 137 on /mnt: filesystem full Apr 20 04:55:52 x4 kernel: pid 67359 (rw), uid 0 inumber 138 on /mnt: filesystem full Apr 20 04:55:52 x4 kernel: pid 67365 (rw), uid 0 inumber 140 on /mnt: filesystem full Apr 20 04:55:53 x4 kernel: pid 67363 (rw), uid 0 inumber 7 on /mnt: filesystem full Apr 20 04:55:55 x4 kernel: pid 67360 (rw), uid 0 inumber 129 on /mnt: filesystem full Apr 20 04:55:56 x4 kernel: pid 67358 (rw), uid 0 inumber 4 on /mnt: filesystem full Apr 20 04:55:58 x4 kernel: pid 67357 (rw), uid 0 inumber 129 on /mnt: filesystem full Apr 20 04:55:59 x4 kernel: pid 67362 (rw), uid 0 inumber 129 on /mnt: filesystem full Apr 20 04:56:00 x4 kernel: pid 67361 (rw), uid 0 inumber 4 on /mnt: filesystem full Apr 20 04:56:02 x4 kernel: pid 68893 (rw), uid 0 inumber 140 on /mnt: filesystem full Apr 20 04:56:03 x4 kernel: pid 68888 (rw), uid 0 inumber 14 on /mnt: filesystem full Apr 20 04:56:04 x4 kernel: pid 68895 (rw), uid 0 inumber 10 on /mnt: filesystem full Apr 20 04:56:06 x4 kernel: pid 68903 (rw), uid 0 inumber 5 on /mnt: filesystem full Apr 20 04:56:08 x4 kernel: pid 68898 (rw), uid 0 inumber 131 on /mnt: filesystem full Apr 20 04:56:11 x4 kernel: pid 68897 (rw), uid 0 inumber 131 on /mnt: filesystem full Apr 20 04:56:11 x4 kernel: pid 68901 (rw), uid 0 inumber 5 on /mnt: filesystem full Apr 20 04:56:14 x4 kernel: pid 69653 (rw), uid 0 inumber 134 on /mnt: filesystem full Apr 20 04:56:16 x4 kernel: pid 69655 (rw), uid 0 inumber 134 on /mnt: filesystem full Apr 20 04:56:17 x4 kernel: pid 69656 (rw), uid 0 inumber 131 on /mnt: filesystem full Apr 20 04:56:20 x4 kernel: pid 69652 (rw), uid 0 inumber 130 on /mnt: filesystem full Apr 20 04:56:22 x4 kernel: pid 70455 (rw), uid 0 inumber 133 on /mnt: filesystem full Apr 20 04:56:24 x4 kernel: pid 70453 (rw), uid 0 inumber 130 on /mnt: filesystem full Apr 20 04:56:27 x4 kernel: pid 70456 (rw), uid 0 inumber 5 on /mnt: filesystem full Apr 20 04:56:29 x4 kernel: pid 71975 (rw), uid 0 inumber 138 on /mnt: filesystem full Apr 20 04:56:29 x4 kernel: pid 71976 (rw), uid 0 inumber 140 on /mnt: filesystem full Apr 20 04:56:31 x4 kernel: pid 71974 (rw), uid 0 inumber 132 on /mnt: filesystem full Apr 20 04:56:32 x4 kernel: pid 71973 (rw), uid 0 inumber 130 on /mnt: filesystem full Apr 20 04:56:33 x4 kernel: pid 71970 (rw), uid 0 inumber 130 on /mnt: filesystem full Apr 20 04:56:36 x4 kernel: pid 71982 (rw), uid 0 inumber 129 on /mnt: filesystem full Apr 20 04:56:37 x4 kernel: pid 71981 (rw), uid 0 inumber 4 on /mnt: filesystem full Apr 20 04:56:37 x4 kernel: pid 71983 (rw), uid 0 inumber 7 on /mnt: filesystem full Apr 20 04:56:37 x4 kernel: pid 71971 (rw), uid 0 inumber 8 on /mnt: filesystem full Apr 20 04:56:39 x4 kernel: pid 72550 (rw), uid 0 inumber 139 on /mnt: filesystem full Apr 20 04:56:39 x4 kernel: pid 72548 (rw), uid 0 inumber 141 on /mnt: filesystem full Apr 20 04:56:42 x4 kernel: pid 72542 (rw), uid 0 inumber 10 on /mnt: filesystem full Apr 20 04:56:43 x4 kernel: pid 72544 (rw), uid 0 inumber 5 on /mnt: filesystem full Apr 20 04:56:47 x4 kernel: pid 72549 (rw), uid 0 inumber 129 on /mnt: filesystem full Apr 20 04:56:48 x4 kernel: pid 72538 (rw), uid 0 inumber 130 on /mnt: filesystem full Apr 20 04:56:48 x4 kernel: pid 72541 (rw), uid 0 inumber 131 on /mnt: filesystem full Apr 20 04:56:56 x4 kernel: pid 73545 (rw), uid 0 inumber 132 on /mnt: filesystem full Apr 20 04:56:59 x4 kernel: pid 73544 (rw), uid 0 inumber 5 on /mnt: filesystem full Apr 20 04:57:02 x4 kernel: pid 75059 (rw), uid 0 inumber 133 on /mnt: filesystem full Apr 20 04:57:06 x4 kernel: pid 75061 (rw), uid 0 inumber 5 on /mnt: filesystem full Apr 20 04:57:08 x4 kernel: pid 75058 (rw), uid 0 inumber 132 on /mnt: filesystem full 20180420 04:57:11 all (179/566): md2.sh g_vfs_done():md10[WRITE(offset=74285056, length=131072)]error = 28 g_vfs_done():md10[WRITE(offset=74416128, length=131072)]error = 28 g_vfs_done():md10[WRITE(offset=88244224, length=131072)]error = 28 g_vfs_done():md10[WRITE(offset=88375296, length=131072)]error = 28 g_vfs_done():md10[WRITE(offset=88506368, length=131072)]error = 28 g_vfs_done():md10[WRITE(offset=122781696, length=131072)]error = 28 g_vfs_done():md10[WRITE(offset=122912768, length=131072)]error = 28 g_vfs_done():md10[WRITE(offset=125140992, length=131072)]error = 28 g_vfs_done():md10[WRITE(offset=125272064, length=131072)]error = 28 g_vfs_done():md10[WRITE(offset=125403136, length=131072)]error = 28 g_vfs_done():md10[WRITE(offset=125534208, length=131072)]error = 28 g_vfs_done():md10[WRITE(offset=125665280, length=131072)]error = 28 g_vfs_done():md10[WRITE(offset=127467520, length=131072)]error = 28 g_vfs_done():md10[WRITE(offset=148602880, length=131072)]error = 28 g_vfs_done():md10[WRITE(offset=148733952, length=131072)]error = 28 g_vfs_done():md10[WRITE(offset=148865024, length=131072)]error = 28 g_vfs_done():md10[WRITE(offset=153387008, length=131072)]error = 28 g_vfs_done():md10[WRITE(offset=153518080, length=131072)]error = 28 g_vfs_done():md10[WRITE(offset=166658048, length=131072)]error = 28 g_vfs_done():md10[WRITE(offset=166789120, length=131072)]error = 28 g_vfs_done():md10[WRITE(offset=166920192, length=131072)]error = 28 g_vfs_done():md10[WRITE(offset=167051264, length=131072)]error = 28 g_vfs_done():md10[WRITE(offset=167182336, length=131072)]error = 28 g_vfs_done():md10[WRITE(offset=174358528, length=131072)]error = 28 Apr 20 05:11:18 x4 kernel: pid 98523 (swap), uid 0, was killed: out of swap space 20180420 05:18:03 all (180/566): md3.sh Apr 20 05:25:15 x4 kernel: pid 11998 (swap), uid 0, was killed: out of swap space 20180420 05:28:54 all (181/566): md4.sh 20180420 05:28:56 all (182/566): md5.sh 20180420 05:29:03 all (183/566): md6.sh 20180420 05:29:06 all (184/566): md7.sh warning: total configured swap (4194304 pages) exceeds maximum recommended amount (1724580 pages). warning: increase kern.maxswzone or reduce amount of swap. 20180420 05:39:46 all (185/566): md8.sh 20180420 05:40:50 all (186/566): md9.sh 20180420 05:40:59 all (187/566): mdconfig2.sh 20180420 05:42:02 all (188/566): memguard4.sh 20180420 05:42:06 all (189/566): mkfifo.sh 20180420 06:03:42 all (190/566): mkfifo2c.sh 20180420 06:35:14 all (191/566): mkfifo2d.sh 20180420 06:41:53 all (192/566): mkfifo3.sh 20180420 06:43:12 all (193/566): mkfifo4.sh 20180420 06:50:29 all (194/566): mkfifo5.sh mount leak: 16/434 20180420 06:50:38 all (195/566): mkfifo6.sh 20180420 06:50:44 all (196/566): mkfifo7.sh 20180420 06:50:48 all (197/566): mknod.sh 20180420 06:51:51 all (198/566): mlockall.sh 20180420 06:52:05 all (199/566): mlockall2.sh 20180420 07:05:18 all (200/566): mlockall3.sh 20180420 07:08:21 all (201/566): mlockall4.sh 20180420 07:08:30 all (202/566): mlockall5.sh 20180420 07:08:33 all (203/566): mlockall6.sh Apr 20 07:11:01 x4 kernel: pid 57656 (swap), uid 0, was killed: out of swap space 20180420 07:18:45 all (204/566): mlockall7.sh 20180420 07:21:51 all (205/566): mmap.sh 20180420 07:21:55 all (206/566): mmap10.sh Apr 20 07:21:58 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Apr 20 07:21:58 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Apr 20 07:21:59 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Apr 20 07:22:41 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb8db000 with size 0x20000 to be written at offset 0xc496000 for process mmap10 Apr 20 07:22:41 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb9dc000 with size 0x20000 to be written at offset 0xc4b6000 for process mmap10 Apr 20 07:22:41 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbadd000 with size 0x20000 to be written at offset 0xc4d6000 for process mmap10 Apr 20 07:22:41 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbbde000 with size 0x20000 to be written at offset 0xc4f6000 for process mmap10 Apr 20 07:22:41 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap10 Apr 20 07:22:59 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Apr 20 07:22:59 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap10 Apr 20 07:22:59 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap10 Apr 20 07:22:59 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap10 Apr 20 07:22:59 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Apr 20 07:22:59 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Apr 20 07:22:59 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Apr 20 07:22:59 x4 kernel: Failed to fully fault in a core file segment at VA 0x804b000 with size 0x20000 to be written at offset 0x5000 for process mmap10 Apr 20 07:22:59 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Apr 20 07:22:59 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Apr 20 07:22:59 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Apr 20 07:22:59 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0xc206000 to be written at offset 0x290000 for process mmap10 Apr 20 07:23:00 x4 kernel: Failed to fully fault in a core file segment at VA 0x804b000 with size 0x20000 to be written at offset 0x5000 for process mmap10 Apr 20 07:23:00 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Apr 20 07:23:00 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap10 Apr 20 07:23:00 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap10 Apr 20 07:23:00 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap10 Apr 20 07:23:00 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Apr 20 07:23:00 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Apr 20 07:23:00 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Apr 20 07:23:00 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb8db000 with size 0x20000 to be written at offset 0x496000 for process mmap10 Apr 20 07:23:00 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb9dc000 with size 0x20000 to be written at offset 0x4b6000 for process mmap10 Apr 20 07:23:00 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbadd000 with size 0x20000 to be written at offset 0x4d6000 for process mmap10 Apr 20 07:23:00 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbbde000 with size 0x20000 to be written at offset 0x4f6000 for process mmap10 Apr 20 07:23:00 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Apr 20 07:23:00 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Apr 20 07:23:00 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Apr 20 07:23:00 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x205000 to be written at offset 0x290000 for process mmap10 Apr 20 07:23:00 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x1000 to be written at offset 0x495000 for process mmap10 Apr 20 07:23:19 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb8db000 with size 0x20000 to be written at offset 0x496000 for process mmap10 Apr 20 07:23:19 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb9dc000 with size 0x20000 to be written at offset 0x4b6000 for process mmap10 Apr 20 07:23:19 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbadd000 with size 0x20000 to be written at offset 0x4d6000 for process mmap10 Apr 20 07:23:19 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbbde000 with size 0x20000 to be written at offset 0x4f6000 for process mmap10 Apr 20 07:23:21 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap10 Apr 20 07:23:21 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Apr 20 07:23:21 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap10 Apr 20 07:23:21 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap10 Apr 20 07:23:21 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap10 Apr 20 07:23:21 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Apr 20 07:23:21 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Apr 20 07:23:21 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Apr 20 07:23:41 x4 kernel: Failed to fully fault in a core file segment at VA 0x29a08000 with size 0x4861000 to be written at offset 0x181e000 for process mmap10 Apr 20 07:23:53 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Apr 20 07:23:53 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0xe000 to be written at offset 0x4000 for process mmap10 Apr 20 07:23:54 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Apr 20 07:23:54 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Apr 20 07:23:54 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Apr 20 07:24:13 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap10 Apr 20 07:24:13 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Apr 20 07:24:14 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb8db000 with size 0x20000 to be written at offset 0x496000 for process mmap10 Apr 20 07:24:14 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb9dc000 with size 0x20000 to be written at offset 0x4b6000 for process mmap10 Apr 20 07:24:14 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbadd000 with size 0x20000 to be written at offset 0x4d6000 for process mmap10 Apr 20 07:24:14 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbbde000 with size 0x20000 to be written at offset 0x4f6000 for process mmap10 Apr 20 07:24:14 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap10 Apr 20 07:24:14 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Apr 20 07:24:14 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Apr 20 07:24:14 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Apr 20 07:24:14 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Apr 20 07:24:15 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb8db000 with size 0x20000 to be written at offset 0x496000 for process mmap10 Apr 20 07:24:15 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb9dc000 with size 0x20000 to be written at offset 0x4b6000 for process mmap10 Apr 20 07:24:15 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbadd000 with size 0x20000 to be written at offset 0x4d6000 for process mmap10 Apr 20 07:24:15 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbbde000 with size 0x20000 to be written at offset 0x4f6000 for process mmap10 Apr 20 07:24:15 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x24000 for process mmap10 Apr 20 07:24:15 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x47000 for process mmap10 Apr 20 07:24:15 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x48000 for process mmap10 Apr 20 07:24:15 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x51000 for process mmap10 Apr 20 07:24:15 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5a000 for process mmap10 Apr 20 07:24:15 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28e000 for process mmap10 Apr 20 07:24:15 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x206000 to be written at offset 0x28f000 for process mmap10 Apr 20 07:24:33 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Apr 20 07:24:33 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap10 Apr 20 07:24:33 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap10 Apr 20 07:24:33 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap10 Apr 20 07:24:33 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Apr 20 07:24:33 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Apr 20 07:24:33 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Apr 20 07:24:53 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Apr 20 07:24:53 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap10 Apr 20 07:24:53 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap10 Apr 20 07:24:53 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap10 Apr 20 07:24:53 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Apr 20 07:24:53 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Apr 20 07:24:53 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Apr 20 07:24:53 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Apr 20 07:24:53 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Apr 20 07:24:53 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Apr 20 07:24:53 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Apr 20 07:24:53 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap10 Apr 20 07:24:53 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap10 Apr 20 07:24:53 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap10 Apr 20 07:24:53 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Apr 20 07:24:53 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Apr 20 07:24:53 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x205000 to be written at offset 0x290000 for process mmap10 Apr 20 07:24:53 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x1000 to be written at offset 0x495000 for process mmap10 Apr 20 07:25:12 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap10 Apr 20 07:25:13 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x3000 for process mmap10 Apr 20 07:25:27 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap10 Apr 20 07:25:27 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Apr 20 07:25:27 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap10 Apr 20 07:25:27 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap10 Apr 20 07:25:27 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap10 Apr 20 07:25:27 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Apr 20 07:25:27 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Apr 20 07:25:27 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Apr 20 07:25:27 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x3000 for process mmap10 Apr 20 07:25:27 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x24000 for process mmap10 Apr 20 07:25:27 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x47000 for process mmap10 Apr 20 07:25:28 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x48000 for process mmap10 Apr 20 07:25:28 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x51000 for process mmap10 Apr 20 07:25:28 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5a000 for process mmap10 Apr 20 07:25:28 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28e000 for process mmap10 Apr 20 07:25:28 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x28f000 for process mmap10 Apr 20 07:25:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x24000 for process mmap10 Apr 20 07:25:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x47000 for process mmap10 Apr 20 07:25:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x48000 for process mmap10 Apr 20 07:25:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x51000 for process mmap10 Apr 20 07:25:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5a000 for process mmap10 Apr 20 07:25:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28e000 for process mmap10 Apr 20 07:25:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x5000 to be written at offset 0x28f000 for process mmap10 Apr 20 07:25:46 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap10 Apr 20 07:25:46 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Apr 20 07:25:46 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap10 Apr 20 07:25:46 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap10 Apr 20 07:25:46 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap10 Apr 20 07:25:46 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Apr 20 07:25:46 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Apr 20 07:25:46 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Apr 20 07:26:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Apr 20 07:26:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Apr 20 07:26:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Apr 20 07:26:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Apr 20 07:26:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x24000 for process mmap10 Apr 20 07:26:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x47000 for process mmap10 Apr 20 07:26:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x48000 for process mmap10 Apr 20 07:26:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x51000 for process mmap10 Apr 20 07:26:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5a000 for process mmap10 Apr 20 07:26:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28e000 for process mmap10 Apr 20 07:26:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x201000 to be written at offset 0x28f000 for process mmap10 Apr 20 07:26:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x2867b000 with size 0x5000 to be written at offset 0x490000 for process mmap10 Apr 20 07:26:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Apr 20 07:26:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap10 Apr 20 07:26:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap10 Apr 20 07:26:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap10 Apr 20 07:26:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Apr 20 07:26:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Apr 20 07:26:08 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb8db000 with size 0x20000 to be written at offset 0x496000 for process mmap10 Apr 20 07:26:08 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb9dc000 with size 0x20000 to be written at offset 0x4b6000 for process mmap10 Apr 20 07:26:08 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbadd000 with size 0x20000 to be written at offset 0x4d6000 for process mmap10 Apr 20 07:26:08 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbbde000 with size 0x20000 to be written at offset 0x4f6000 for process mmap10 Apr 20 07:26:08 x4 kernel: Failed to fully fault in a core file segment at VA 0x3467b000 with size 0x5000 to be written at offset 0x491000 for process mmap10 Apr 20 07:26:09 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap10 Apr 20 07:26:09 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Apr 20 07:26:09 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap10 Apr 20 07:26:09 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap10 Apr 20 07:26:09 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap10 Apr 20 07:26:09 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Apr 20 07:26:09 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Apr 20 07:26:09 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x201000 to be written at offset 0x290000 for process mmap10 Apr 20 07:26:09 x4 kernel: Failed to fully fault in a core file segment at VA 0x3467b000 with size 0x5000 to be written at offset 0x491000 for process mmap10 Apr 20 07:26:09 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Apr 20 07:26:09 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Apr 20 07:26:09 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x5000 to be written at offset 0x290000 for process mmap10 Apr 20 07:26:09 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0xc201000 to be written at offset 0x295000 for process mmap10 Apr 20 07:26:09 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Apr 20 07:26:09 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap10 Apr 20 07:26:09 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap10 Apr 20 07:26:09 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap10 Apr 20 07:26:09 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Apr 20 07:26:09 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x2000 to be written at offset 0x28f000 for process mmap10 Apr 20 07:26:09 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847b000 with size 0x5000 to be written at offset 0x291000 for process mmap10 Apr 20 07:26:09 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447b000 with size 0xc200000 to be written at offset 0x296000 for process mmap10 Apr 20 07:26:09 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap10 Apr 20 07:26:27 x4 kernel: Failed to fully fault in a core file segment at VA 0x804e000 with size 0x1d000 to be written at offset 0x8000 for process mmap10 Apr 20 07:26:27 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap10 Apr 20 07:26:27 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Apr 20 07:26:27 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Apr 20 07:26:27 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Apr 20 07:26:27 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0xc206000 to be written at offset 0x290000 for process mmap10 Apr 20 07:26:46 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Apr 20 07:26:46 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Apr 20 07:26:46 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x205000 to be written at offset 0x290000 for process mmap10 Apr 20 07:27:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x24000 for process mmap10 Apr 20 07:27:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x47000 for process mmap10 Apr 20 07:27:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x48000 for process mmap10 Apr 20 07:27:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x51000 for process mmap10 Apr 20 07:27:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5a000 for process mmap10 Apr 20 07:27:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28e000 for process mmap10 Apr 20 07:27:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Apr 20 07:27:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847b000 with size 0x5000 to be written at offset 0x290000 for process mmap10 Apr 20 07:27:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447b000 with size 0x200000 to be written at offset 0x295000 for process mmap10 Apr 20 07:27:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Apr 20 07:27:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Apr 20 07:27:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x2000 to be written at offset 0x28f000 for process mmap10 Apr 20 07:27:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847b000 with size 0x205000 to be written at offset 0x291000 for process mmap10 Apr 20 07:27:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Apr 20 07:27:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap10 Apr 20 07:27:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap10 Apr 20 07:27:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap10 Apr 20 07:27:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Apr 20 07:27:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Apr 20 07:27:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x205000 to be written at offset 0x290000 for process mmap10 Apr 20 07:27:05 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Apr 20 07:27:05 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap10 Apr 20 07:27:05 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap10 Apr 20 07:27:05 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap10 Apr 20 07:27:05 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Apr 20 07:27:05 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Apr 20 07:27:05 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x205000 to be written at offset 0x290000 for process mmap10 Apr 20 07:27:06 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb8db000 with size 0x20000 to be written at offset 0x496000 for process mmap10 Apr 20 07:27:06 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb9dc000 with size 0x20000 to be written at offset 0x4b6000 for process mmap10 Apr 20 07:27:06 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbadd000 with size 0x20000 to be written at offset 0x4d6000 for process mmap10 Apr 20 07:27:06 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbbde000 with size 0x20000 to be written at offset 0x4f6000 for process mmap10 Apr 20 07:27:07 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb8db000 with size 0x20000 to be written at offset 0x495000 for process mmap10 Apr 20 07:27:07 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb9dc000 with size 0x20000 to be written at offset 0x4b5000 for process mmap10 Apr 20 07:27:07 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbadd000 with size 0x20000 to be written at offset 0x4d5000 for process mmap10 Apr 20 07:27:07 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbbde000 with size 0x20000 to be written at offset 0x4f5000 for process mmap10 Apr 20 07:27:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x3000 for process mmap10 Apr 20 07:27:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x24000 for process mmap10 Apr 20 07:27:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x47000 for process mmap10 Apr 20 07:27:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x48000 for process mmap10 Apr 20 07:27:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x51000 for process mmap10 Apr 20 07:27:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5a000 for process mmap10 Apr 20 07:27:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28e000 for process mmap10 Apr 20 07:27:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x205000 to be written at offset 0x28f000 for process mmap10 Apr 20 07:27:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x1000 to be written at offset 0x494000 for process mmap10 Apr 20 07:27:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x3000 for process mmap10 Apr 20 07:27:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x24000 for process mmap10 Apr 20 07:27:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5a000 for process mmap10 Apr 20 07:27:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x205000 to be written at offset 0x28f000 for process mmap10 Apr 20 07:27:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x1000 to be written at offset 0x494000 for process mmap10 Apr 20 07:27:07 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb8db000 with size 0x20000 to be written at offset 0x495000 for process mmap10 Apr 20 07:27:07 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb9dc000 with size 0x20000 to be written at offset 0x4b5000 for process mmap10 20180420 07:27:10 all (207/566): mmap11.sh Apr 20 07:28:00 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:28:00 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:28:00 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:28:01 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap11 Apr 20 07:28:01 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:28:01 x4 kernel: Failed to fully fault in a core file segment at VA 0x804f000 with size 0xa000 to be written at offset 0x9000 for process mmap11 Apr 20 07:28:01 x4 kernel: Failed to fully fault in a core file segment at VA 0x8059000 with size 0x3000 to be written at offset 0x13000 for process mmap11 Apr 20 07:28:01 x4 kernel: Failed to fully fault in a core file segment at VA 0x805c000 with size 0xf000 to be written at offset 0x16000 for process mmap11 Apr 20 07:28:01 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:28:01 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap11 Apr 20 07:28:01 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap11 Apr 20 07:28:01 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:28:01 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:28:01 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap11 Apr 20 07:28:01 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x290000 for process mmap11 Apr 20 07:28:01 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:28:01 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap11 Apr 20 07:28:01 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap11 Apr 20 07:28:01 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:28:01 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:28:01 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap11 Apr 20 07:28:01 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x206000 to be written at offset 0x290000 for process mmap11 Apr 20 07:28:01 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:28:01 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:28:01 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:28:01 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x5000 to be written at offset 0x290000 for process mmap11 Apr 20 07:28:02 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:28:02 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:28:02 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:28:02 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447b000 with size 0x200000 to be written at offset 0x296000 for process mmap11 Apr 20 07:28:19 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb7da000 with size 0x20000 to be written at offset 0xc496000 for process mmap11 Apr 20 07:28:19 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb8db000 with size 0x20000 to be written at offset 0xc4b6000 for process mmap11 Apr 20 07:28:19 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb9dc000 with size 0x20000 to be written at offset 0xc4d6000 for process mmap11 Apr 20 07:28:19 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbadd000 with size 0x20000 to be written at offset 0xc4f6000 for process mmap11 Apr 20 07:28:19 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbbde000 with size 0x20000 to be written at offset 0xc516000 for process mmap11 Apr 20 07:28:19 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:28:19 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:28:19 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:28:19 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x207000 to be written at offset 0x28f000 for process mmap11 Apr 20 07:29:13 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:29:13 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap11 Apr 20 07:29:13 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap11 Apr 20 07:29:13 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:29:13 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:29:13 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap11 Apr 20 07:29:13 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0xc000000 to be written at offset 0x290000 for process mmap11 Apr 20 07:29:13 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x206000 to be written at offset 0xc290000 for process mmap11 Apr 20 07:29:13 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:29:13 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:29:13 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:29:13 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0xc000000 to be written at offset 0x290000 for process mmap11 Apr 20 07:29:14 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x1000 to be written at offset 0x294000 for process mmap11 Apr 20 07:29:14 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447b000 with size 0x200000 to be written at offset 0x295000 for process mmap11 Apr 20 07:29:32 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb7da000 with size 0x20000 to be written at offset 0xc495000 for process mmap11 Apr 20 07:29:32 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb8db000 with size 0x20000 to be written at offset 0xc4b5000 for process mmap11 Apr 20 07:29:32 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb9dc000 with size 0x20000 to be written at offset 0xc4d5000 for process mmap11 Apr 20 07:29:32 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbadd000 with size 0x20000 to be written at offset 0xc4f5000 for process mmap11 Apr 20 07:29:32 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbbde000 with size 0x20000 to be written at offset 0xc515000 for process mmap11 Apr 20 07:29:32 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:29:32 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap11 Apr 20 07:29:32 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap11 Apr 20 07:29:32 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:29:32 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:29:32 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x2000 to be written at offset 0x28f000 for process mmap11 Apr 20 07:29:43 x4 kernel: Failed to fully fault in a core file segment at VA 0x2f720000 with size 0x4d5a000 to be written at offset 0x7536000 for process mmap11 Apr 20 07:29:43 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x206000 to be written at offset 0xc290000 for process mmap11 Apr 20 07:29:43 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x24000 for process mmap11 Apr 20 07:29:43 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x47000 for process mmap11 Apr 20 07:29:43 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x48000 for process mmap11 Apr 20 07:29:43 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x51000 for process mmap11 Apr 20 07:29:43 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5a000 for process mmap11 Apr 20 07:29:43 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28e000 for process mmap11 Apr 20 07:29:43 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x206000 to be written at offset 0x28f000 for process mmap11 Apr 20 07:29:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:29:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:29:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:29:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x206000 to be written at offset 0x290000 for process mmap11 Apr 20 07:29:51 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:29:51 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:29:51 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:29:51 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb7da000 with size 0x20000 to be written at offset 0x496000 for process mmap11 Apr 20 07:29:51 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb8db000 with size 0x20000 to be written at offset 0x4b6000 for process mmap11 Apr 20 07:29:51 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb9dc000 with size 0x20000 to be written at offset 0x4d6000 for process mmap11 Apr 20 07:29:51 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbadd000 with size 0x20000 to be written at offset 0x4f6000 for process mmap11 Apr 20 07:29:51 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbbde000 with size 0x20000 to be written at offset 0x516000 for process mmap11 Apr 20 07:30:11 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:30:11 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap11 Apr 20 07:30:11 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap11 Apr 20 07:30:11 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:30:11 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:30:11 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap11 Apr 20 07:30:11 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x201000 to be written at offset 0x290000 for process mmap11 Apr 20 07:30:11 x4 kernel: Failed to fully fault in a core file segment at VA 0x3467b000 with size 0x5000 to be written at offset 0x491000 for process mmap11 Apr 20 07:30:12 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap11 Apr 20 07:30:12 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb7da000 with size 0x20000 to be written at offset 0x25000 for process mmap11 Apr 20 07:30:12 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb8db000 with size 0x20000 to be written at offset 0x45000 for process mmap11 Apr 20 07:30:12 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb9dc000 with size 0x20000 to be written at offset 0x65000 for process mmap11 Apr 20 07:30:12 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbadd000 with size 0x20000 to be written at offset 0x85000 for process mmap11 Apr 20 07:30:12 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbbde000 with size 0x20000 to be written at offset 0xa5000 for process mmap11 Apr 20 07:30:12 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:30:12 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap11 Apr 20 07:30:12 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap11 Apr 20 07:30:12 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:30:12 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:30:12 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap11 Apr 20 07:30:12 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x201000 to be written at offset 0x290000 for process mmap11 Apr 20 07:30:12 x4 kernel: Failed to fully fault in a core file segment at VA 0x3467b000 with size 0x5000 to be written at offset 0x491000 for process mmap11 Apr 20 07:30:12 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb7da000 with size 0x20000 to be written at offset 0x496000 for process mmap11 Apr 20 07:30:12 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb8db000 with size 0x20000 to be written at offset 0x4b6000 for process mmap11 Apr 20 07:30:12 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb9dc000 with size 0x20000 to be written at offset 0x4d6000 for process mmap11 Apr 20 07:30:12 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbadd000 with size 0x20000 to be written at offset 0x4f6000 for process mmap11 Apr 20 07:30:12 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbbde000 with size 0x20000 to be written at offset 0x516000 for process mmap11 Apr 20 07:30:13 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap11 Apr 20 07:30:13 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:30:13 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap11 Apr 20 07:30:13 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap11 Apr 20 07:30:13 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:30:13 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:30:13 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap11 Apr 20 07:30:13 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x206000 to be written at offset 0x290000 for process mmap11 Apr 20 07:30:13 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap11 Apr 20 07:30:48 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap11 Apr 20 07:30:48 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:30:48 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:30:48 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:30:55 x4 kernel: Failed to fully fault in a core file segment at VA 0x2db8f000 with size 0x68eb000 to be written at offset 0x59a5000 for process mmap11 Apr 20 07:30:55 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x206000 to be written at offset 0xc290000 for process mmap11 Apr 20 07:30:56 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap11 Apr 20 07:30:56 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:30:56 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:30:56 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:30:56 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x7e1e000 to be written at offset 0x290000 for process mmap11 Apr 20 07:30:56 x4 kernel: Failed to fully fault in a core file segment at VA 0x30298000 with size 0x41e2000 to be written at offset 0x80ae000 for process mmap11 Apr 20 07:30:56 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x206000 to be written at offset 0xc290000 for process mmap11 Apr 20 07:31:13 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:31:13 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:31:13 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:31:13 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0xc000000 to be written at offset 0x290000 for process mmap11 Apr 20 07:31:14 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap11 Apr 20 07:31:14 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:31:14 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:31:14 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:31:14 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb7da000 with size 0x20000 to be written at offset 0x496000 for process mmap11 Apr 20 07:31:14 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb8db000 with size 0x20000 to be written at offset 0x4b6000 for process mmap11 Apr 20 07:31:14 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb9dc000 with size 0x20000 to be written at offset 0x4d6000 for process mmap11 Apr 20 07:31:14 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbadd000 with size 0x20000 to be written at offset 0x4f6000 for process mmap11 Apr 20 07:31:14 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbbde000 with size 0x20000 to be written at offset 0x516000 for process mmap11 Apr 20 07:31:14 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:31:14 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:31:14 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:31:14 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:31:14 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap11 Apr 20 07:31:14 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap11 Apr 20 07:31:14 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:31:14 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:31:14 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x207000 to be written at offset 0x28f000 for process mmap11 Apr 20 07:31:14 x4 kernel: Failed to fully fault in a core file segment at VA 0x28680000 with size 0xc000000 to be written at offset 0x496000 for process mmap11 Apr 20 07:31:14 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:31:14 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:31:14 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:31:14 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap11 Apr 20 07:31:14 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:31:14 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:31:14 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:31:14 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x5000 to be written at offset 0x290000 for process mmap11 Apr 20 07:31:14 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x201000 to be written at offset 0x295000 for process mmap11 Apr 20 07:31:33 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:31:33 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap11 Apr 20 07:31:33 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap11 Apr 20 07:31:33 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:31:33 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:31:33 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap11 Apr 20 07:31:49 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb7da000 with size 0x20000 to be written at offset 0xc496000 for process mmap11 Apr 20 07:31:49 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb8db000 with size 0x20000 to be written at offset 0xc4b6000 for process mmap11 Apr 20 07:31:49 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb9dc000 with size 0x20000 to be written at offset 0xc4d6000 for process mmap11 Apr 20 07:31:49 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbadd000 with size 0x20000 to be written at offset 0xc4f6000 for process mmap11 Apr 20 07:31:49 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbbde000 with size 0x20000 to be written at offset 0xc516000 for process mmap11 Apr 20 07:31:57 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:31:57 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:31:57 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:31:57 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x290000 for process mmap11 Apr 20 07:31:57 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap11 Apr 20 07:31:57 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:31:57 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap11 Apr 20 07:31:57 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap11 Apr 20 07:31:57 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:31:57 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:31:57 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap11 Apr 20 07:31:57 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x8000 to be written at offset 0x4000 for process mmap11 Apr 20 07:31:58 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:31:58 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:31:58 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:31:58 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847b000 with size 0x5000 to be written at offset 0x291000 for process mmap11 Apr 20 07:31:58 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447b000 with size 0x200000 to be written at offset 0x296000 for process mmap11 Apr 20 07:32:33 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap11 Apr 20 07:32:33 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:32:33 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:32:33 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:32:33 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap11 Apr 20 07:32:33 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:32:33 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap11 Apr 20 07:32:33 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap11 Apr 20 07:32:33 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:32:33 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:32:33 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap11 Apr 20 07:32:33 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x290000 for process mmap11 Apr 20 07:32:34 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:32:34 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:32:35 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap11 Apr 20 07:32:35 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:32:35 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:32:35 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:32:35 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x206000 to be written at offset 0x290000 for process mmap11 Apr 20 07:32:36 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap11 Apr 20 07:32:36 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:32:36 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:32:36 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:32:36 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x207000 to be written at offset 0x28f000 for process mmap11 Apr 20 07:32:37 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x6000 for process mmap11 Apr 20 07:32:37 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x2a000 for process mmap11 Apr 20 07:32:37 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x33000 for process mmap11 Apr 20 07:32:37 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x3c000 for process mmap11 Apr 20 07:32:37 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x270000 for process mmap11 Apr 20 07:32:37 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x206000 to be written at offset 0x271000 for process mmap11 Apr 20 07:32:37 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:32:37 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:32:37 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:32:37 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x206000 to be written at offset 0x290000 for process mmap11 Apr 20 07:32:37 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap11 Apr 20 07:32:38 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap11 Apr 20 07:32:38 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:32:38 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:32:38 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:32:38 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0xc206000 to be written at offset 0x290000 for process mmap11 Apr 20 07:32:38 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:32:38 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:32:38 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:32:38 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847b000 with size 0x205000 to be written at offset 0x291000 for process mmap11 Apr 20 07:32:38 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x5000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x24000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x47000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x48000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x51000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5a000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28e000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x28f000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb7da000 with size 0x20000 to be written at offset 0x495000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb8db000 with size 0x20000 to be written at offset 0x4b5000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb9dc000 with size 0x20000 to be written at offset 0x4d5000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbadd000 with size 0x20000 to be written at offset 0x4f5000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbbde000 with size 0x20000 to be written at offset 0x515000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x24000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x47000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x48000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x51000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5a000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28e000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x1000 to be written at offset 0x28f000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447b000 with size 0x200000 to be written at offset 0x290000 for process Apr 20 07:32:40 x4 kernel: mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x3467b000 with size 0x5000 to be written at offset 0x490000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x3000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x24000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x47000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x48000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x51000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5a000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28e000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x7e1e000 to be written at offset 0x28f000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x30298000 with size 0x41e2000 to be written at offset 0x80ad000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x206000 to be written at offset 0xc28f000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x804b000 with size 0x4000 to be written at offset 0x5000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x804f000 with size 0x1000 to be written at offset 0x9000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x8050000 with size 0x1b000 to be written at offset 0xa000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x207000 to be written at offset 0x28f000 for process mmap11 Apr 20 07:32:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:32:41 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:32:41 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:32:41 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x290000 for process mmap11 Apr 20 07:32:41 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb7da000 with size 0x20000 to be written at offset 0x496000 for process mmap11 Apr 20 07:32:41 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb8db000 with size 0x20000 to be written at offset 0x4b6000 for process mmap11 Apr 20 07:32:41 x4 kernel: Failed to fully fault in a core file segment at VA 0xfb9dc000 with size 0x20000 to be written at offset 0x4d6000 for process mmap11 Apr 20 07:32:41 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbadd000 with size 0x20000 to be written at offset 0x4f6000 for process mmap11 Apr 20 07:32:41 x4 kernel: Failed to fully fault in a core file segment at VA 0xfbbde000 with size 0x20000 to be written at offset 0x516000 for process mmap11 Apr 20 07:32:41 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x3000 for process mmap11 Apr 20 07:32:42 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap11 Apr 20 07:32:42 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap11 Apr 20 07:32:42 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap11 Apr 20 07:32:42 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x5000 to be written at offset 0x290000 for process mmap11 Apr 20 07:32:42 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x201000 to be written at offset 0x295000 for process mmap11 20180420 07:33:02 all (208/566): mmap12.sh 20180420 07:33:06 all (209/566): mmap13.sh 20180420 07:33:18 all (210/566): mmap14.sh Apr 20 07:35:15 x4 kernel: pid 40341 (swap), uid 0, was killed: out of swap space 20180420 07:36:42 all (211/566): mmap15.sh 20180420 07:42:44 all (212/566): mmap16.sh 20180420 07:42:47 all (213/566): mmap17.sh 20180420 07:42:51 all (214/566): mmap18.sh Apr 20 07:43:49 x4 kernel: pid 42732 (mmap18), uid 0, was killed: out of swap space Apr 20 07:44:04 x4 kernel: pid 42745 (mmap18), uid 0, was killed: out of swap space Apr 20 07:44:11 x4 kernel: pid 566 (rpc.statd), uid 0, was killed: out of swap space Apr 20 07:44:19 x4 kernel: pid 1070 (sshd), uid 1001, was killed: out of swap space Apr 20 07:44:23 x4 kernel: pid 570 (rpc.lockd), uid 0, was killed: out of swap space Apr 20 07:44:30 x4 kernel: pid 562 (nfsd), uid 0, was killed: out of swap space Apr 20 07:44:38 x4 kernel: pid 43452 (vmstat), uid 1001, was killed: out of swap space Apr 20 07:44:39 x4 kernel: pid 1071 (sshd), uid 1001, was killed: out of swap space Apr 20 07:44:43 x4 kernel: pid 418 (rpcbind), uid 0, was killed: out of swap space Apr 20 07:44:49 x4 kernel: pid 3421 (sh), uid 0, was killed: out of swap space Apr 20 07:44:50 x4 kernel: pid 1079 (awk), uid 1001, was killed: out of swap space Apr 20 07:45:00 x4 kernel: pid 21523 (sh), uid 0, was killed: out of swap space Apr 20 07:45:02 x4 kernel: pid 43453 (sed), uid 1001, was killed: out of swap space Apr 20 07:45:10 x4 kernel: pid 1073 (tail), uid 1001, was killed: out of swap space Apr 20 07:45:16 x4 kernel: pid 41956 (mmap18), uid 0, was killed: out of swap space Apr 20 07:45:22 x4 kernel: pid 781 (getty), uid 0, was killed: out of swap space Apr 20 07:45:29 x4 kernel: pid 43462 (getty), uid 0, was killed: out of swap space Apr 20 07:45:35 x4 kernel: pid 43463 (getty), uid 0, was killed: out of swap space Apr 20 07:45:41 x4 kernel: pid 43464 (getty), uid 0, was killed: out of swap space Apr 20 07:45:47 x4 kernel: pid 43465 (getty), uid 0, was killed: out of swap space Apr 20 07:46:01 x4 kernel: pid 43466 (getty), uid 0, was killed: out of swap space Apr 20 07:46:07 x4 kernel: pid 43467 (getty), uid 0, was killed: out of swap space Apr 20 07:46:14 x4 kernel: pid 43468 (getty), uid 0, was killed: out of swap space Apr 20 07:46:22 x4 kernel: pid 43469 (getty), uid 0, was killed: out of swap space Apr 20 07:46:31 x4 kernel: pid 43473 (getty), uid 0, was killed: out of swap space Apr 20 07:46:37 x4 kernel: pid 43474 (getty), uid 0, was killed: out of swap space Apr 20 07:46:42 x4 kernel: pid 43475 (getty), uid 0, was killed: out of swap space Apr 20 07:46:48 x4 kernel: pid 43476 (getty), uid 0, was killed: out of swap space Apr 20 07:47:01 x4 kernel: pid 43477 (getty), uid 0, was killed: out of swap space Apr 20 07:47:06 x4 kernel: pid 43478 (getty), uid 0, was killed: out of swap space Apr 20 07:47:12 x4 kernel: pid 43479 (getty), uid 0, was killed: out of swap space Apr 20 07:47:19 x4 kernel: pid 43480 (getty), uid 0, was killed: out of swap space Apr 20 07:47:30 x4 kernel: pid 43484 (getty), uid 0, was killed: out of swap space Apr 20 07:47:36 x4 kernel: pid 43485 (getty), uid 0, was killed: out of swap space Apr 20 07:47:42 x4 kernel: pid 43486 (getty), uid 0, was killed: out of swap space Apr 20 07:47:49 x4 kernel: pid 43487 (getty), uid 0, was killed: out of swap space Apr 20 07:48:00 x4 kernel: pid 43488 (getty), uid 0, was killed: out of swap space Apr 20 07:48:08 x4 kernel: pid 43489 (getty), uid 0, was killed: out of swap space Apr 20 07:48:13 x4 kernel: pid 43490 (getty), uid 0, was killed: out of swap space Apr 20 07:48:19 x4 kernel: pid 43491 (getty), uid 0, was killed: out of swap space Apr 20 07:48:31 x4 kernel: pid 43495 (getty), uid 0, was killed: out of swap space Apr 20 07:48:37 x4 kernel: pid 43496 (getty), uid 0, was killed: out of swap space Apr 20 07:48:43 x4 kernel: pid 43497 (getty), uid 0, was killed: out of swap space Apr 20 07:48:48 x4 kernel: pid 43498 (getty), uid 0, was killed: out of swap space Apr 20 07:49:03 x4 kernel: pid 43499 (getty), uid 0, was killed: out of swap space Apr 20 07:49:09 x4 kernel: pid 43500 (getty), uid 0, was killed: out of swap space Apr 20 07:49:17 x4 kernel: pid 43501 (getty), uid 0, was killed: out of swap space Apr 20 07:49:23 x4 kernel: pid 43502 (getty), uid 0, was killed: out of swap space Apr 20 07:49:31 x4 kernel: pid 43506 (getty), uid 0, was killed: out of swap space Apr 20 07:49:39 x4 kernel: pid 43507 (getty), uid 0, was killed: out of swap space Apr 20 07:49:43 x4 kernel: pid 43508 (getty), uid 0, was killed: out of swap space Apr 20 07:49:49 x4 kernel: pid 43509 (getty), uid 0, was killed: out of swap space Apr 20 07:50:02 x4 kernel: pid 43510 (getty), uid 0, was killed: out of swap space Apr 20 07:50:08 x4 kernel: pid 43511 (getty), uid 0, was killed: out of swap space Apr 20 07:50:14 x4 kernel: pid 43512 (getty), uid 0, was killed: out of swap space Apr 20 07:50:20 x4 kernel: pid 43513 (getty), uid 0, was killed: out of swap space Apr 20 07:50:32 x4 kernel: pid 43517 (getty), uid 0, was killed: out of swap space Apr 20 07:50:38 x4 kernel: pid 43518 (getty), uid 0, was killed: out of swap space Apr 20 07:50:46 x4 kernel: pid 43519 (getty), uid 0, was killed: out of swap space Apr 20 07:50:51 x4 kernel: pid 43520 (getty), uid 0, was killed: out of swap space Apr 20 07:51:01 x4 kernel: pid 43521 (getty), uid 0, was killed: out of swap space Apr 20 07:51:07 x4 kernel: pid 43522 (getty), uid 0, was killed: out of swap space Apr 20 07:51:14 x4 kernel: pid 43523 (getty), uid 0, was killed: out of swap space Apr 20 07:51:23 x4 kernel: pid 43524 (getty), uid 0, was killed: out of swap space Apr 20 07:51:32 x4 kernel: pid 43528 (getty), uid 0, was killed: out of swap space Apr 20 07:51:37 x4 kernel: pid 43529 (getty), uid 0, was killed: out of swap space Apr 20 07:51:44 x4 kernel: pid 43530 (getty), uid 0, was killed: out of swap space Apr 20 07:51:51 x4 kernel: pid 43531 (getty), uid 0, was killed: out of swap space Apr 20 07:52:01 x4 kernel: pid 43532 (getty), uid 0, was killed: out of swap space Apr 20 07:52:06 x4 kernel: pid 43533 (getty), uid 0, was killed: out of swap space Apr 20 07:52:13 x4 kernel: pid 43534 (getty), uid 0, was killed: out of swap space Apr 20 07:52:20 x4 kernel: pid 43535 (getty), uid 0, was killed: out of swap space Apr 20 07:52:31 x4 kernel: pid 43539 (getty), uid 0, was killed: out of swap space Apr 20 07:52:39 x4 kernel: pid 43540 (getty), uid 0, was killed: out of swap space Apr 20 07:52:46 x4 kernel: pid 43541 (getty), uid 0, was killed: out of swap space Apr 20 07:52:52 x4 kernel: pid 43542 (getty), uid 0, was killed: out of swap space Apr 20 07:53:02 x4 kernel: pid 43543 (getty), uid 0, was killed: out of swap space Apr 20 07:53:09 x4 kernel: pid 43544 (getty), uid 0, was killed: out of swap space Apr 20 07:53:16 x4 kernel: pid 43545 (getty), uid 0, was killed: out of swap space Apr 20 07:53:23 x4 kernel: pid 43546 (getty), uid 0, was killed: out of swap space Apr 20 07:53:32 x4 kernel: pid 43550 (getty), uid 0, was killed: out of swap space Apr 20 07:53:39 x4 kernel: pid 43551 (getty), uid 0, was killed: out of swap space Apr 20 07:53:45 x4 kernel: pid 43552 (getty), uid 0, was killed: out of swap space Apr 20 07:53:51 x4 kernel: pid 43553 (getty), uid 0, was killed: out of swap space Apr 20 07:54:01 x4 kernel: pid 43554 (getty), uid 0, was killed: out of swap space Apr 20 07:54:10 x4 kernel: pid 43555 (getty), uid 0, was killed: out of swap space Apr 20 07:54:15 x4 kernel: pid 43556 (getty), uid 0, was killed: out of swap space Apr 20 07:54:23 x4 kernel: pid 43557 (getty), uid 0, was killed: out of swap space Apr 20 07:54:32 x4 kernel: pid 43561 (getty), uid 0, was killed: out of swap space Apr 20 07:54:39 x4 kernel: pid 43562 (getty), uid 0, was killed: out of swap space Apr 20 07:54:46 x4 kernel: pid 43563 (getty), uid 0, was killed: out of swap space Apr 20 07:54:52 x4 kernel: pid 43564 (getty), uid 0, was killed: out of swap space Apr 20 07:55:02 x4 kernel: pid 43565 (getty), uid 0, was killed: out of swap space Apr 20 07:55:09 x4 kernel: pid 43566 (getty), uid 0, was killed: out of swap space Apr 20 07:55:16 x4 kernel: pid 43567 (getty), uid 0, was killed: out of swap space Apr 20 07:55:23 x4 kernel: pid 43568 (getty), uid 0, was killed: out of swap space Apr 20 07:55:33 x4 kernel: pid 43572 (getty), uid 0, was killed: out of swap space Apr 20 07:55:38 x4 kernel: pid 43573 (getty), uid 0, was killed: out of swap space Apr 20 07:55:45 x4 kernel: pid 43574 (getty), uid 0, was killed: out of swap space Apr 20 07:55:52 x4 kernel: pid 43575 (getty), uid 0, was killed: out of swap space Apr 20 07:56:03 x4 kernel: pid 43576 (getty), uid 0, was killed: out of swap space Apr 20 07:56:09 x4 kernel: pid 43577 (getty), uid 0, was killed: out of swap space Apr 20 07:56:16 x4 kernel: pid 43578 (getty), uid 0, was killed: out of swap space Apr 20 07:56:22 x4 kernel: pid 43579 (getty), uid 0, was killed: out of swap space Apr 20 07:56:32 x4 kernel: pid 43583 (getty), uid 0, was killed: out of swap space Apr 20 07:56:39 x4 kernel: pid 43584 (getty), uid 0, was killed: out of swap space Apr 20 07:56:46 x4 kernel: pid 43585 (getty), uid 0, was killed: out of swap space Apr 20 07:56:53 x4 kernel: pid 43586 (getty), uid 0, was killed: out of swap space Apr 20 07:57:03 x4 kernel: pid 43587 (getty), uid 0, was killed: out of swap space Apr 20 07:57:08 x4 kernel: pid 43588 (getty), uid 0, was killed: out of swap space Apr 20 07:57:14 x4 kernel: pid 43589 (getty), uid 0, was killed: out of swap space Apr 20 07:57:21 x4 kernel: pid 43590 (getty), uid 0, was killed: out of swap space Apr 20 07:57:32 x4 kernel: pid 43594 (getty), uid 0, was killed: out of swap space Apr 20 07:57:40 x4 kernel: pid 43595 (getty), uid 0, was killed: out of swap space Apr 20 07:57:46 x4 kernel: pid 43596 (getty), uid 0, was killed: out of swap space Apr 20 07:57:52 x4 kernel: pid 43597 (getty), uid 0, was killed: out of swap space Apr 20 07:58:03 x4 kernel: pid 43598 (getty), uid 0, was killed: out of swap space Apr 20 07:58:09 x4 kernel: pid 43599 (getty), uid 0, was killed: out of swap space Apr 20 07:58:16 x4 kernel: pid 43600 (getty), uid 0, was killed: out of swap space Apr 20 07:58:23 x4 kernel: pid 43601 (getty), uid 0, was killed: out of swap space Apr 20 07:58:32 x4 kernel: pid 43605 (getty), uid 0, was killed: out of swap space Apr 20 07:58:38 x4 kernel: pid 43606 (getty), uid 0, was killed: out of swap space Apr 20 07:58:45 x4 kernel: pid 43607 (getty), uid 0, was killed: out of swap space Apr 20 07:58:52 x4 kernel: pid 43608 (getty), uid 0, was killed: out of swap space Apr 20 07:59:03 x4 kernel: pid 43609 (getty), uid 0, was killed: out of swap space Apr 20 07:59:09 x4 kernel: pid 43610 (getty), uid 0, was killed: out of swap space Apr 20 07:59:15 x4 kernel: pid 43611 (getty), uid 0, was killed: out of swap space Apr 20 07:59:22 x4 kernel: pid 43612 (getty), uid 0, was killed: out of swap space Apr 20 07:59:33 x4 kernel: pid 43616 (getty), uid 0, was killed: out of swap space Apr 20 07:59:40 x4 kernel: pid 43617 (getty), uid 0, was killed: out of swap space Apr 20 07:59:46 x4 kernel: pid 43618 (getty), uid 0, was killed: out of swap space Apr 20 07:59:52 x4 kernel: pid 43619 (getty), uid 0, was killed: out of swap space Apr 20 08:00:04 x4 kernel: pid 43620 (getty), uid 0, was killed: out of swap space Apr 20 08:00:10 x4 kernel: pid 43621 (getty), uid 0, was killed: out of swap space Apr 20 08:00:15 x4 kernel: pid 43622 (getty), uid 0, was killed: out of swap space Apr 20 08:00:22 x4 kernel: pid 43623 (getty), uid 0, was killed: out of swap space Apr 20 08:00:33 x4 kernel: pid 43627 (getty), uid 0, was killed: out of swap space Apr 20 08:00:40 x4 kernel: pid 43628 (getty), uid 0, was killed: out of swap space Apr 20 08:00:46 x4 kernel: pid 43629 (getty), uid 0, was killed: out of swap space Apr 20 08:00:54 x4 kernel: pid 43630 (getty), uid 0, was killed: out of swap space Apr 20 08:01:02 x4 kernel: pid 43631 (getty), uid 0, was killed: out of swap space Apr 20 08:01:08 x4 kernel: pid 43632 (getty), uid 0, was killed: out of swap space Apr 20 08:01:14 x4 kernel: pid 43633 (getty), uid 0, was killed: out of swap space Apr 20 08:01:20 x4 kernel: pid 43634 (getty), uid 0, was killed: out of swap space Apr 20 08:01:34 x4 kernel: pid 43638 (getty), uid 0, was killed: out of swap space Apr 20 08:01:40 x4 kernel: pid 43639 (getty), uid 0, was killed: out of swap space Apr 20 08:01:48 x4 kernel: pid 43640 (getty), uid 0, was killed: out of swap space Apr 20 08:01:55 x4 kernel: pid 43641 (getty), uid 0, was killed: out of swap space Apr 20 08:02:02 x4 kernel: pid 43642 (getty), uid 0, was killed: out of swap space Apr 20 08:02:08 x4 kernel: pid 43643 (getty), uid 0, was killed: out of swap space Apr 20 08:02:14 x4 kernel: pid 43644 (getty), uid 0, was killed: out of swap space Apr 20 08:02:20 x4 kernel: pid 43645 (getty), uid 0, was killed: out of swap space Apr 20 08:02:35 x4 kernel: pid 43649 (getty), uid 0, was killed: out of swap space Apr 20 08:02:40 x4 kernel: pid 43650 (getty), uid 0, was killed: out of swap space Apr 20 08:02:46 x4 kernel: pid 43651 (getty), uid 0, was killed: out of swap space Apr 20 08:02:51 x4 kernel: pid 43652 (getty), uid 0, was killed: out of swap space Apr 20 08:03:04 x4 kernel: pid 43653 (getty), uid 0, was killed: out of swap space Apr 20 08:03:11 x4 kernel: pid 43654 (getty), uid 0, was killed: out of swap space Apr 20 08:03:18 x4 kernel: pid 43655 (getty), uid 0, was killed: out of swap space Apr 20 08:03:24 x4 kernel: pid 43656 (getty), uid 0, was killed: out of swap space Apr 20 08:03:33 x4 kernel: pid 43660 (getty), uid 0, was killed: out of swap space Apr 20 08:03:39 x4 kernel: pid 43661 (getty), uid 0, was killed: out of swap space Apr 20 08:03:44 x4 kernel: pid 43662 (getty), uid 0, was killed: out of swap space Apr 20 08:03:49 x4 kernel: pid 43663 (getty), uid 0, was killed: out of swap space Apr 20 08:03:55 x4 kernel: pid 43664 (getty), uid 0, was killed: out of swap space Apr 20 08:04:01 x4 kernel: pid 43665 (getty), uid 0, was killed: out of swap space Apr 20 08:04:07 x4 kernel: pid 43666 (getty), uid 0, was killed: out of swap space Apr 20 08:04:15 x4 kernel: pid 43667 (getty), uid 0, was killed: out of swap space Apr 20 08:04:23 x4 kernel: pid 43668 (getty), uid 0, was killed: out of swap space Apr 20 08:04:34 x4 kernel: pid 43672 (getty), uid 0, was killed: out of swap space Apr 20 08:04:40 x4 kernel: pid 43673 (getty), uid 0, was killed: out of swap space Apr 20 08:04:48 x4 kernel: pid 43674 (getty), uid 0, was killed: out of swap space Apr 20 08:04:53 x4 kernel: pid 43675 (getty), uid 0, was killed: out of swap space Apr 20 08:05:03 x4 kernel: pid 43676 (getty), uid 0, was killed: out of swap space Apr 20 08:05:11 x4 kernel: pid 43677 (getty), uid 0, was killed: out of swap space Apr 20 08:05:18 x4 kernel: pid 43678 (getty), uid 0, was killed: out of swap space Apr 20 08:05:25 x4 kernel: pid 43679 (getty), uid 0, was killed: out of swap space Apr 20 08:05:35 x4 kernel: pid 43683 (getty), uid 0, was killed: out of swap space Apr 20 08:05:42 x4 kernel: pid 43684 (getty), uid 0, was killed: out of swap space Apr 20 08:05:48 x4 kernel: pid 43685 (getty), uid 0, was killed: out of swap space Apr 20 08:05:53 x4 kernel: pid 43686 (getty), uid 0, was killed: out of swap space Apr 20 08:06:04 x4 kernel: pid 43687 (getty), uid 0, was killed: out of swap space Apr 20 08:06:11 x4 kernel: pid 43688 (getty), uid 0, was killed: out of swap space Apr 20 08:06:20 x4 kernel: pid 43689 (getty), uid 0, was killed: out of swap space Apr 20 08:06:26 x4 kernel: pid 43693 (getty), uid 0, was killed: out of swap space Apr 20 08:06:35 x4 kernel: pid 43694 (getty), uid 0, was killed: out of swap space Apr 20 08:06:42 x4 kernel: pid 43695 (getty), uid 0, was killed: out of swap space Apr 20 08:06:47 x4 kernel: pid 43696 (getty), uid 0, was killed: out of swap space Apr 20 08:06:53 x4 kernel: pid 43697 (getty), uid 0, was killed: out of swap space Apr 20 08:07:04 x4 kernel: pid 43698 (getty), uid 0, was killed: out of swap space Apr 20 08:07:12 x4 kernel: pid 43699 (getty), uid 0, was killed: out of swap space Apr 20 08:07:17 x4 kernel: pid 43700 (getty), uid 0, was killed: out of swap space Apr 20 08:07:23 x4 kernel: pid 43701 (getty), uid 0, was killed: out of swap space Apr 20 08:07:34 x4 kernel: pid 43705 (getty), uid 0, was killed: out of swap space Apr 20 08:07:40 x4 kernel: pid 43706 (getty), uid 0, was killed: out of swap space Apr 20 08:07:47 x4 kernel: pid 43707 (getty), uid 0, was killed: out of swap space Apr 20 08:07:53 x4 kernel: pid 43708 (getty), uid 0, was killed: out of swap space Apr 20 08:08:06 x4 kernel: pid 43709 (getty), uid 0, was killed: out of swap space Apr 20 08:08:13 x4 kernel: pid 43710 (getty), uid 0, was killed: out of swap space Apr 20 08:08:20 x4 kernel: pid 43711 (getty), uid 0, was killed: out of swap space Apr 20 08:08:26 x4 kernel: pid 43715 (getty), uid 0, was killed: out of swap space Apr 20 08:08:33 x4 kernel: pid 43716 (getty), uid 0, was killed: out of swap space Apr 20 08:08:40 x4 kernel: pid 43717 (getty), uid 0, was killed: out of swap space Apr 20 08:08:45 x4 kernel: pid 43718 (getty), uid 0, was killed: out of swap space Apr 20 08:08:51 x4 kernel: pid 43719 (getty), uid 0, was killed: out of swap space Apr 20 08:09:01 x4 kernel: pid 43720 (getty), uid 0, was killed: out of swap space Apr 20 08:09:08 x4 kernel: pid 43721 (getty), uid 0, was killed: out of swap space Apr 20 08:09:15 x4 kernel: pid 43722 (getty), uid 0, was killed: out of swap space Apr 20 08:09:20 x4 kernel: pid 43723 (getty), uid 0, was killed: out of swap space Apr 20 08:09:35 x4 kernel: pid 43727 (getty), uid 0, was killed: out of swap space Apr 20 08:09:43 x4 kernel: pid 43728 (getty), uid 0, was killed: out of swap space Apr 20 08:09:50 x4 kernel: pid 43729 (getty), uid 0, was killed: out of swap space Apr 20 08:10:04 x4 kernel: pid 43730 (getty), uid 0, was killed: out of swap space Apr 20 08:10:11 x4 kernel: pid 43731 (getty), uid 0, was killed: out of swap space Apr 20 08:10:14 x4 kernel: pid 43732 (getty), uid 0, was killed: out of swap space Apr 20 08:10:20 x4 kernel: pid 43733 (getty), uid 0, was killed: out of swap space Apr 20 08:10:27 x4 kernel: pid 43737 (getty), uid 0, was killed: out of swap space Apr 20 08:10:33 x4 kernel: pid 43738 (getty), uid 0, was killed: out of swap space Apr 20 08:10:39 x4 kernel: pid 43739 (getty), uid 0, was killed: out of swap space Apr 20 08:10:46 x4 kernel: pid 43740 (getty), uid 0, was killed: out of swap space Apr 20 08:10:51 x4 kernel: pid 43741 (getty), uid 0, was killed: out of swap space Apr 20 08:11:04 x4 kernel: pid 43742 (getty), uid 0, was killed: out of swap space Apr 20 08:11:11 x4 kernel: pid 43743 (getty), uid 0, was killed: out of swap space Apr 20 08:11:17 x4 kernel: pid 43744 (getty), uid 0, was killed: out of swap space Apr 20 08:11:24 x4 kernel: pid 43745 (getty), uid 0, was killed: out of swap space Apr 20 08:11:34 x4 kernel: pid 43749 (getty), uid 0, was killed: out of swap space Apr 20 08:11:42 x4 kernel: pid 43750 (getty), uid 0, was killed: out of swap space Apr 20 08:11:47 x4 kernel: pid 43751 (getty), uid 0, was killed: out of swap space Apr 20 08:11:54 x4 kernel: pid 43752 (getty), uid 0, was killed: out of swap space Apr 20 08:12:04 x4 kernel: pid 43753 (getty), uid 0, was killed: out of swap space Apr 20 08:12:11 x4 kernel: pid 43754 (getty), uid 0, was killed: out of swap space Apr 20 08:12:18 x4 kernel: pid 43755 (getty), uid 0, was killed: out of swap space Apr 20 08:12:23 x4 kernel: pid 43756 (getty), uid 0, was killed: out of swap space Apr 20 08:12:36 x4 kernel: pid 43760 (getty), uid 0, was killed: out of swap space Apr 20 08:12:43 x4 kernel: pid 43761 (getty), uid 0, was killed: out of swap space Apr 20 08:12:51 x4 kernel: pid 43762 (getty), uid 0, was killed: out of swap space Apr 20 08:13:07 x4 kernel: pid 43763 (getty), uid 0, was killed: out of swap space Apr 20 08:13:14 x4 kernel: pid 43764 (getty), uid 0, was killed: out of swap space Apr 20 08:13:20 x4 kernel: pid 43765 (getty), uid 0, was killed: out of swap space Apr 20 08:13:27 x4 kernel: pid 43769 (getty), uid 0, was killed: out of swap space Apr 20 08:13:35 x4 kernel: pid 43770 (getty), uid 0, was killed: out of swap space Apr 20 08:13:43 x4 kernel: pid 43771 (getty), uid 0, was killed: out of swap space Apr 20 08:13:48 x4 kernel: pid 43772 (getty), uid 0, was killed: out of swap space Apr 20 08:13:54 x4 kernel: pid 43773 (getty), uid 0, was killed: out of swap space Apr 20 08:14:05 x4 kernel: pid 43774 (getty), uid 0, was killed: out of swap space Apr 20 08:14:11 x4 kernel: pid 43775 (getty), uid 0, was killed: out of swap space Apr 20 08:14:19 x4 kernel: pid 43776 (getty), uid 0, was killed: out of swap space Apr 20 08:14:24 x4 kernel: pid 43777 (getty), uid 0, was killed: out of swap space Apr 20 08:14:35 x4 kernel: pid 43781 (getty), uid 0, was killed: out of swap space Apr 20 08:14:43 x4 kernel: pid 43782 (getty), uid 0, was killed: out of swap space Apr 20 08:14:50 x4 kernel: pid 43783 (getty), uid 0, was killed: out of swap space Apr 20 08:14:57 x4 kernel: pid 43784 (getty), uid 0, was killed: out of swap space Apr 20 08:15:05 x4 kernel: pid 43785 (getty), uid 0, was killed: out of swap space Apr 20 08:15:10 x4 kernel: pid 43786 (getty), uid 0, was killed: out of swap space Apr 20 08:15:16 x4 kernel: pid 43787 (getty), uid 0, was killed: out of swap space Apr 20 08:15:23 x4 kernel: pid 43788 (getty), uid 0, was killed: out of swap space Apr 20 08:15:35 x4 kernel: pid 43792 (getty), uid 0, was killed: out of swap space Apr 20 08:15:41 x4 kernel: pid 43793 (getty), uid 0, was killed: out of swap space Apr 20 08:15:46 x4 kernel: pid 43794 (getty), uid 0, was killed: out of swap space Apr 20 08:15:54 x4 kernel: pid 43795 (getty), uid 0, was killed: out of swap space Apr 20 08:16:07 x4 kernel: pid 43796 (getty), uid 0, was killed: out of swap space Apr 20 08:16:12 x4 kernel: pid 43797 (getty), uid 0, was killed: out of swap space Apr 20 08:16:21 x4 kernel: pid 43798 (getty), uid 0, was killed: out of swap space Apr 20 08:16:24 x4 kernel: pid 43802 (getty), uid 0, was killed: out of swap space Apr 20 08:16:34 x4 kernel: pid 43803 (getty), uid 0, was killed: out of swap space Apr 20 08:16:40 x4 kernel: pid 43804 (getty), uid 0, was killed: out of swap space Apr 20 08:16:46 x4 kernel: pid 43805 (getty), uid 0, was killed: out of swap space Apr 20 08:16:51 x4 kernel: pid 43806 (getty), uid 0, was killed: out of swap space Apr 20 08:16:57 x4 kernel: pid 43807 (getty), uid 0, was killed: out of swap space Apr 20 08:17:07 x4 kernel: pid 43808 (getty), uid 0, was killed: out of swap space Apr 20 08:17:12 x4 kernel: pid 43809 (getty), uid 0, was killed: out of swap space Apr 20 08:17:19 x4 kernel: pid 43810 (getty), uid 0, was killed: out of swap space Apr 20 08:17:26 x4 kernel: pid 43811 (getty), uid 0, was killed: out of swap space Apr 20 08:17:36 x4 kernel: pid 43815 (getty), uid 0, was killed: out of swap space Apr 20 08:17:42 x4 kernel: pid 43816 (getty), uid 0, was killed: out of swap space Apr 20 08:17:47 x4 kernel: pid 43817 (getty), uid 0, was killed: out of swap space Apr 20 08:17:53 x4 kernel: pid 43818 (getty), uid 0, was killed: out of swap space Apr 20 08:17:58 x4 kernel: pid 43819 (getty), uid 0, was killed: out of swap space Apr 20 08:18:04 x4 kernel: pid 43820 (getty), uid 0, was killed: out of swap space Apr 20 08:18:11 x4 kernel: pid 43821 (getty), uid 0, was killed: out of swap space Apr 20 08:18:16 x4 kernel: pid 43822 (getty), uid 0, was killed: out of swap space Apr 20 08:18:21 x4 kernel: pid 43823 (getty), uid 0, was killed: out of swap space Apr 20 08:18:27 x4 kernel: pid 43827 (getty), uid 0, was killed: out of swap space Apr 20 08:18:38 x4 kernel: pid 43828 (getty), uid 0, was killed: out of swap space Apr 20 08:18:43 x4 kernel: pid 43829 (getty), uid 0, was killed: out of swap space Apr 20 08:18:50 x4 kernel: pid 43830 (getty), uid 0, was killed: out of swap space Apr 20 08:18:57 x4 kernel: pid 43831 (getty), uid 0, was killed: out of swap space Apr 20 08:19:06 x4 kernel: pid 43832 (getty), uid 0, was killed: out of swap space Apr 20 08:19:11 x4 kernel: pid 43833 (getty), uid 0, was killed: out of swap space Apr 20 08:19:18 x4 kernel: pid 43834 (getty), uid 0, was killed: out of swap space Apr 20 08:19:27 x4 kernel: pid 43835 (getty), uid 0, was killed: out of swap space Apr 20 08:19:35 x4 kernel: pid 43839 (getty), uid 0, was killed: out of swap space Apr 20 08:19:42 x4 kernel: pid 43840 (getty), uid 0, was killed: out of swap space Apr 20 08:19:47 x4 kernel: pid 43841 (getty), uid 0, was killed: out of swap space Apr 20 08:19:54 x4 kernel: pid 43842 (getty), uid 0, was killed: out of swap space Apr 20 08:20:07 x4 kernel: pid 43843 (getty), uid 0, was killed: out of swap space Apr 20 08:20:14 x4 kernel: pid 43844 (getty), uid 0, was killed: out of swap space Apr 20 08:20:23 x4 kernel: pid 43845 (getty), uid 0, was killed: out of swap space Apr 20 08:20:28 x4 kernel: pid 43849 (getty), uid 0, was killed: out of swap space Apr 20 08:20:36 x4 kernel: pid 43850 (getty), uid 0, was killed: out of swap space Apr 20 08:20:43 x4 kernel: pid 43851 (getty), uid 0, was killed: out of swap space Apr 20 08:20:50 x4 kernel: pid 43852 (getty), uid 0, was killed: out of swap space Apr 20 08:20:57 x4 kernel: pid 43853 (getty), uid 0, was killed: out of swap space Apr 20 08:21:00 x4 kernel: pid 43854 (getty), uid 0, was killed: out of swap space Apr 20 08:21:05 x4 kernel: pid 43855 (getty), uid 0, was killed: out of swap space Apr 20 08:21:12 x4 kernel: pid 43856 (getty), uid 0, was killed: out of swap space Apr 20 08:21:17 x4 kernel: pid 43857 (getty), uid 0, was killed: out of swap space Apr 20 08:21:22 x4 kernel: pid 43858 (getty), uid 0, was killed: out of swap space Apr 20 08:21:29 x4 kernel: pid 43862 (getty), uid 0, was killed: out of swap space Apr 20 08:21:36 x4 kernel: pid 43863 (getty), uid 0, was killed: out of swap space Apr 20 08:21:43 x4 kernel: pid 43864 (getty), uid 0, was killed: out of swap space Apr 20 08:21:52 x4 kernel: pid 43865 (getty), uid 0, was killed: out of swap space Apr 20 08:21:57 x4 kernel: pid 43866 (getty), uid 0, was killed: out of swap space Apr 20 08:22:05 x4 kernel: pid 43867 (getty), uid 0, was killed: out of swap space Apr 20 08:22:10 x4 kernel: pid 43868 (getty), uid 0, was killed: out of swap space Apr 20 08:22:17 x4 kernel: pid 43869 (getty), uid 0, was killed: out of swap space Apr 20 08:22:26 x4 kernel: pid 43870 (getty), uid 0, was killed: out of swap space Apr 20 08:22:36 x4 kernel: pid 43874 (getty), uid 0, was killed: out of swap space Apr 20 08:22:43 x4 kernel: pid 43875 (getty), uid 0, was killed: out of swap space Apr 20 08:22:48 x4 kernel: pid 43876 (getty), uid 0, was killed: out of swap space Apr 20 08:22:55 x4 kernel: pid 43877 (getty), uid 0, was killed: out of swap space Apr 20 08:23:07 x4 kernel: pid 43878 (getty), uid 0, was killed: out of swap space Apr 20 08:23:13 x4 kernel: pid 43879 (getty), uid 0, was killed: out of swap space Apr 20 08:23:19 x4 kernel: pid 43880 (getty), uid 0, was killed: out of swap space Apr 20 08:23:27 x4 kernel: pid 43881 (getty), uid 0, was killed: out of swap space Apr 20 08:23:35 x4 kernel: pid 43885 (getty), uid 0, was killed: out of swap space Apr 20 08:23:42 x4 kernel: pid 43886 (getty), uid 0, was killed: out of swap space Apr 20 08:23:49 x4 kernel: pid 43887 (getty), uid 0, was killed: out of swap space Apr 20 08:23:54 x4 kernel: pid 43888 (getty), uid 0, was killed: out of swap space Apr 20 08:24:05 x4 kernel: pid 43889 (getty), uid 0, was killed: out of swap space Apr 20 08:24:09 x4 kernel: pid 43890 (getty), uid 0, was killed: out of swap space Apr 20 08:24:15 x4 kernel: pid 43891 (getty), uid 0, was killed: out of swap space Apr 20 08:24:21 x4 kernel: pid 43892 (getty), uid 0, was killed: out of swap space Apr 20 08:24:28 x4 kernel: pid 43896 (getty), uid 0, was killed: out of swap space Apr 20 08:24:35 x4 kernel: pid 43897 (getty), uid 0, was killed: out of swap space Apr 20 08:24:42 x4 kernel: pid 43898 (getty), uid 0, was killed: out of swap space Apr 20 08:24:49 x4 kernel: pid 43899 (getty), uid 0, was killed: out of swap space Apr 20 08:24:54 x4 kernel: pid 43900 (getty), uid 0, was killed: out of swap space Apr 20 08:25:00 x4 kernel: pid 43901 (getty), uid 0, was killed: out of swap space Apr 20 08:25:06 x4 kernel: pid 43902 (getty), uid 0, was killed: out of swap space Apr 20 08:25:13 x4 kernel: pid 43903 (getty), uid 0, was killed: out of swap space Apr 20 08:25:18 x4 kernel: pid 43904 (getty), uid 0, was killed: out of swap space Apr 20 08:25:26 x4 kernel: pid 43905 (getty), uid 0, was killed: out of swap space Apr 20 08:25:35 x4 kernel: pid 43909 (getty), uid 0, was killed: out of swap space Apr 20 08:25:42 x4 kernel: pid 43910 (getty), uid 0, was killed: out of swap space Apr 20 08:25:48 x4 kernel: pid 43911 (getty), uid 0, was killed: out of swap space Apr 20 08:25:54 x4 kernel: pid 43912 (getty), uid 0, was killed: out of swap space Apr 20 08:26:01 x4 kernel: pid 43913 (getty), uid 0, was killed: out of swap space Apr 20 08:26:07 x4 kernel: pid 43914 (getty), uid 0, was killed: out of swap space Apr 20 08:26:14 x4 kernel: pid 43915 (getty), uid 0, was killed: out of swap space Apr 20 08:26:19 x4 kernel: pid 43916 (getty), uid 0, was killed: out of swap space Apr 20 08:26:25 x4 kernel: pid 43917 (getty), uid 0, was killed: out of swap space Apr 20 08:26:37 x4 kernel: pid 43921 (getty), uid 0, was killed: out of swap space Apr 20 08:26:40 x4 kernel: pid 43922 (getty), uid 0, was killed: out of swap space Apr 20 08:26:45 x4 kernel: pid 43923 (getty), uid 0, was killed: out of swap space Apr 20 08:26:51 x4 kernel: pid 43924 (getty), uid 0, was killed: out of swap space Apr 20 08:26:56 x4 kernel: pid 43925 (getty), uid 0, was killed: out of swap space Apr 20 08:27:08 x4 kernel: pid 43926 (getty), uid 0, was killed: out of swap space Apr 20 08:27:15 x4 kernel: pid 43927 (getty), uid 0, was killed: out of swap space Apr 20 08:27:22 x4 kernel: pid 43928 (getty), uid 0, was killed: out of swap space Apr 20 08:27:28 x4 kernel: pid 43932 (getty), uid 0, was killed: out of swap space Apr 20 08:27:35 x4 kernel: pid 43933 (getty), uid 0, was killed: out of swap space Apr 20 08:27:43 x4 kernel: pid 43934 (getty), uid 0, was killed: out of swap space Apr 20 08:27:50 x4 kernel: pid 43935 (getty), uid 0, was killed: out of swap space Apr 20 08:27:56 x4 kernel: pid 43936 (getty), uid 0, was killed: out of swap space Apr 20 08:28:07 x4 kernel: pid 43937 (getty), uid 0, was killed: out of swap space Apr 20 08:28:14 x4 kernel: pid 43938 (getty), uid 0, was killed: out of swap space Apr 20 08:28:20 x4 kernel: pid 43939 (getty), uid 0, was killed: out of swap space Apr 20 08:28:26 x4 kernel: pid 43940 (getty), uid 0, was killed: out of swap space Apr 20 08:28:35 x4 kernel: pid 43944 (getty), uid 0, was killed: out of swap space Apr 20 08:28:41 x4 kernel: pid 43945 (getty), uid 0, was killed: out of swap space Apr 20 08:28:46 x4 kernel: pid 43946 (getty), uid 0, was killed: out of swap space Apr 20 08:28:51 x4 kernel: pid 43947 (getty), uid 0, was killed: out of swap space Apr 20 08:28:57 x4 kernel: pid 43948 (getty), uid 0, was killed: out of swap space Apr 20 08:29:07 x4 kernel: pid 43949 (getty), uid 0, was killed: out of swap space Apr 20 08:29:15 x4 kernel: pid 43950 (getty), uid 0, was killed: out of swap space Apr 20 08:29:22 x4 kernel: pid 43951 (getty), uid 0, was killed: out of swap space Apr 20 08:29:25 x4 kernel: pid 43955 (getty), uid 0, was killed: out of swap space Apr 20 08:29:31 x4 kernel: pid 43956 (getty), uid 0, was killed: out of swap space Apr 20 08:29:36 x4 kernel: pid 43957 (getty), uid 0, was killed: out of swap space Apr 20 08:29:42 x4 kernel: pid 43958 (getty), uid 0, was killed: out of swap space Apr 20 08:29:49 x4 kernel: pid 43959 (getty), uid 0, was killed: out of swap space Apr 20 08:29:56 x4 kernel: pid 43960 (getty), uid 0, was killed: out of swap space Apr 20 08:30:08 x4 kernel: pid 43961 (getty), uid 0, was killed: out of swap space Apr 20 08:30:15 x4 kernel: pid 43962 (getty), uid 0, was killed: out of swap space Apr 20 08:30:20 x4 kernel: pid 43963 (getty), uid 0, was killed: out of swap space Apr 20 08:30:27 x4 kernel: pid 43964 (getty), uid 0, was killed: out of swap space Apr 20 08:30:36 x4 kernel: pid 43968 (getty), uid 0, was killed: out of swap space Apr 20 08:30:44 x4 kernel: pid 43969 (getty), uid 0, was killed: out of swap space Apr 20 08:30:49 x4 kernel: pid 43970 (getty), uid 0, was killed: out of swap space Apr 20 08:30:54 x4 kernel: pid 43971 (getty), uid 0, was killed: out of swap space Apr 20 08:30:59 x4 kernel: pid 43972 (getty), uid 0, was killed: out of swap space Apr 20 08:31:07 x4 kernel: pid 43973 (getty), uid 0, was killed: out of swap space Apr 20 08:31:12 x4 kernel: pid 43974 (getty), uid 0, was killed: out of swap space Apr 20 08:31:19 x4 kernel: pid 43975 (getty), uid 0, was killed: out of swap space Apr 20 08:31:26 x4 kernel: pid 43976 (getty), uid 0, was killed: out of swap space Apr 20 08:31:31 x4 kernel: pid 43980 (getty), uid 0, was killed: out of swap space Apr 20 08:31:37 x4 kernel: pid 43981 (getty), uid 0, was killed: out of swap space Apr 20 08:31:43 x4 kernel: pid 43982 (getty), uid 0, was killed: out of swap space Apr 20 08:31:48 x4 kernel: pid 43983 (getty), uid 0, was killed: out of swap space Apr 20 08:31:57 x4 kernel: pid 43984 (getty), uid 0, was killed: out of swap space Apr 20 08:32:08 x4 kernel: pid 43985 (getty), uid 0, was killed: out of swap space Apr 20 08:32:16 x4 kernel: pid 43986 (getty), uid 0, was killed: out of swap space Apr 20 08:32:22 x4 kernel: pid 43987 (getty), uid 0, was killed: out of swap space Apr 20 08:32:27 x4 kernel: pid 43991 (getty), uid 0, was killed: out of swap space Apr 20 08:32:32 x4 kernel: pid 43992 (getty), uid 0, was killed: out of swap space Apr 20 08:32:38 x4 kernel: pid 43993 (getty), uid 0, was killed: out of swap space Apr 20 08:32:41 x4 kernel: pid 43994 (getty), uid 0, was killed: out of swap space Apr 20 08:32:44 x4 kernel: pid 43995 (getty), uid 0, was killed: out of swap space Apr 20 08:32:51 x4 kernel: pid 43996 (getty), uid 0, was killed: out of swap space Apr 20 08:32:57 x4 kernel: pid 43997 (getty), uid 0, was killed: out of swap space Apr 20 08:33:08 x4 kernel: pid 43998 (getty), uid 0, was killed: out of swap space Apr 20 08:33:15 x4 kernel: pid 43999 (getty), uid 0, was killed: out of swap space Apr 20 08:33:22 x4 kernel: pid 44000 (getty), uid 0, was killed: out of swap space Apr 20 08:33:29 x4 kernel: pid 44004 (getty), uid 0, was killed: out of swap space Apr 20 08:33:39 x4 kernel: pid 44005 (getty), uid 0, was killed: out of swap space Apr 20 08:33:46 x4 kernel: pid 44006 (getty), uid 0, was killed: out of swap space Apr 20 08:33:51 x4 kernel: pid 44007 (getty), uid 0, was killed: out of swap space Apr 20 08:33:58 x4 kernel: pid 44008 (getty), uid 0, was killed: out of swap space Apr 20 08:34:06 x4 kernel: pid 44009 (getty), uid 0, was killed: out of swap space Apr 20 08:34:12 x4 kernel: pid 44010 (getty), uid 0, was killed: out of swap space Apr 20 08:34:20 x4 kernel: pid 44011 (getty), uid 0, was killed: out of swap space Apr 20 08:34:26 x4 kernel: pid 44012 (getty), uid 0, was killed: out of swap space Apr 20 08:34:33 x4 kernel: pid 44016 (getty), uid 0, was killed: out of swap space Apr 20 08:34:39 x4 kernel: pid 44017 (getty), uid 0, was killed: out of swap space Apr 20 08:34:46 x4 kernel: pid 44018 (getty), uid 0, was killed: out of swap space Apr 20 08:34:53 x4 kernel: pid 44019 (getty), uid 0, was killed: out of swap space Apr 20 08:34:58 x4 kernel: pid 44020 (getty), uid 0, was killed: out of swap space Apr 20 08:35:08 x4 kernel: pid 44021 (getty), uid 0, was killed: out of swap space Apr 20 08:35:13 x4 kernel: pid 44022 (getty), uid 0, was killed: out of swap space Apr 20 08:35:19 x4 kernel: pid 44023 (getty), uid 0, was killed: out of swap space Apr 20 08:35:28 x4 kernel: pid 44024 (getty), uid 0, was killed: out of swap space Apr 20 08:35:32 x4 kernel: pid 44028 (getty), uid 0, was killed: out of swap space Apr 20 08:35:38 x4 kernel: pid 44029 (getty), uid 0, was killed: out of swap space Apr 20 08:35:44 x4 kernel: pid 44030 (getty), uid 0, was killed: out of swap space Apr 20 08:35:50 x4 kernel: pid 44031 (getty), uid 0, was killed: out of swap space Apr 20 08:35:56 x4 kernel: pid 44032 (getty), uid 0, was killed: out of swap space Apr 20 08:36:08 x4 kernel: pid 44033 (getty), uid 0, was killed: out of swap space Apr 20 08:36:15 x4 kernel: pid 44034 (getty), uid 0, was killed: out of swap space Apr 20 08:36:21 x4 kernel: pid 44035 (getty), uid 0, was killed: out of swap space Apr 20 08:36:27 x4 kernel: pid 44036 (getty), uid 0, was killed: out of swap space Apr 20 08:36:36 x4 kernel: pid 44040 (getty), uid 0, was killed: out of swap space Apr 20 08:36:44 x4 kernel: pid 44041 (getty), uid 0, was killed: out of swap space Apr 20 08:36:49 x4 kernel: pid 44042 (getty), uid 0, was killed: out of swap space Apr 20 08:36:57 x4 kernel: pid 44043 (getty), uid 0, was killed: out of swap space Apr 20 08:37:09 x4 kernel: pid 44044 (getty), uid 0, was killed: out of swap space Apr 20 08:37:16 x4 kernel: pid 44045 (getty), uid 0, was killed: out of swap space Apr 20 08:37:23 x4 kernel: pid 44046 (getty), uid 0, was killed: out of swap space Apr 20 08:37:29 x4 kernel: pid 44050 (getty), uid 0, was killed: out of swap space Apr 20 08:37:38 x4 kernel: pid 44051 (getty), uid 0, was killed: out of swap space Apr 20 08:37:46 x4 kernel: pid 44052 (getty), uid 0, was killed: out of swap space Apr 20 08:37:54 x4 kernel: pid 44053 (getty), uid 0, was killed: out of swap space Apr 20 08:38:02 x4 kernel: pid 44054 (getty), uid 0, was killed: out of swap space Apr 20 08:38:08 x4 kernel: pid 44055 (getty), uid 0, was killed: out of swap space Apr 20 08:38:14 x4 kernel: pid 44056 (getty), uid 0, was killed: out of swap space Apr 20 08:38:20 x4 kernel: pid 44057 (getty), uid 0, was killed: out of swap space Apr 20 08:38:28 x4 kernel: pid 44058 (getty), uid 0, was killed: out of swap space Apr 20 08:38:38 x4 kernel: pid 44062 (getty), uid 0, was killed: out of swap space Apr 20 08:38:44 x4 kernel: pid 44063 (getty), uid 0, was killed: out of swap space Apr 20 08:38:49 x4 kernel: pid 44064 (getty), uid 0, was killed: out of swap space Apr 20 08:38:56 x4 kernel: pid 44065 (getty), uid 0, was killed: out of swap space Apr 20 08:39:01 x4 kernel: pid 44066 (getty), uid 0, was killed: out of swap space Apr 20 08:39:08 x4 kernel: pid 44067 (getty), uid 0, was killed: out of swap space Apr 20 08:39:15 x4 kernel: pid 44068 (getty), uid 0, was killed: out of swap space Apr 20 08:39:23 x4 kernel: pid 44069 (getty), uid 0, was killed: out of swap space Apr 20 08:39:29 x4 kernel: pid 44073 (getty), uid 0, was killed: out of swap space Apr 20 08:39:33 x4 kernel: pid 44074 (getty), uid 0, was killed: out of swap space Apr 20 08:39:39 x4 kernel: pid 44075 (getty), uid 0, was killed: out of swap space Apr 20 08:39:47 x4 kernel: pid 44076 (getty), uid 0, was killed: out of swap space Apr 20 08:39:52 x4 kernel: pid 44077 (getty), uid 0, was killed: out of swap space Apr 20 08:40:00 x4 kernel: pid 44078 (getty), uid 0, was killed: out of swap space Apr 20 08:40:08 x4 kernel: pid 44079 (getty), uid 0, was killed: out of swap space Apr 20 08:40:15 x4 kernel: pid 44080 (getty), uid 0, was killed: out of swap space Apr 20 08:40:23 x4 kernel: pid 44081 (getty), uid 0, was killed: out of swap space Apr 20 08:40:30 x4 kernel: pid 44085 (getty), uid 0, was killed: out of swap space Apr 20 08:40:38 x4 kernel: pid 44086 (getty), uid 0, was killed: out of swap space Apr 20 08:40:43 x4 kernel: pid 44087 (getty), uid 0, was killed: out of swap space Apr 20 08:40:48 x4 kernel: pid 44088 (getty), uid 0, was killed: out of swap space Apr 20 08:40:55 x4 kernel: pid 44089 (getty), uid 0, was killed: out of swap space Apr 20 08:41:00 x4 kernel: pid 44090 (getty), uid 0, was killed: out of swap space Apr 20 08:41:12 x4 kernel: pid 44091 (getty), uid 0, was killed: out of swap space Apr 20 08:41:17 x4 kernel: pid 44092 (getty), uid 0, was killed: out of swap space Apr 20 08:41:23 x4 kernel: pid 44093 (getty), uid 0, was killed: out of swap space Apr 20 08:41:31 x4 kernel: pid 44097 (getty), uid 0, was killed: out of swap space Apr 20 08:41:40 x4 kernel: pid 44098 (getty), uid 0, was killed: out of swap space Apr 20 08:41:47 x4 kernel: pid 44099 (getty), uid 0, was killed: out of swap space Apr 20 08:41:54 x4 kernel: pid 44100 (getty), uid 0, was killed: out of swap space Apr 20 08:42:00 x4 kernel: pid 44101 (getty), uid 0, was killed: out of swap space Apr 20 08:42:09 x4 kernel: pid 44102 (getty), uid 0, was killed: out of swap space Apr 20 08:42:14 x4 kernel: pid 44103 (getty), uid 0, was killed: out of swap space Apr 20 08:42:18 x4 kernel: pid 44104 (getty), uid 0, was killed: out of swap space Apr 20 08:42:26 x4 kernel: pid 44105 (getty), uid 0, was killed: out of swap space Apr 20 08:42:31 x4 kernel: pid 44109 (getty), uid 0, was killed: out of swap space Apr 20 08:42:38 x4 kernel: pid 44110 (getty), uid 0, was killed: out of swap space Apr 20 08:42:45 x4 kernel: pid 44111 (getty), uid 0, was killed: out of swap space Apr 20 08:42:48 x4 kernel: pid 44112 (getty), uid 0, was killed: out of swap space Apr 20 08:42:54 x4 kernel: pid 44113 (getty), uid 0, was killed: out of swap space Apr 20 08:43:01 x4 kernel: pid 44114 (getty), uid 0, was killed: out of swap space Apr 20 08:43:08 x4 kernel: pid 44115 (getty), uid 0, was killed: out of swap space Apr 20 08:43:11 x4 kernel: pid 44116 (getty), uid 0, was killed: out of swap space Apr 20 08:43:17 x4 kernel: pid 44117 (getty), uid 0, was killed: out of swap space Apr 20 08:43:23 x4 kernel: pid 44118 (getty), uid 0, was killed: out of swap space Apr 20 08:43:28 x4 kernel: pid 44122 (getty), uid 0, was killed: out of swap space Apr 20 08:43:39 x4 kernel: pid 44123 (getty), uid 0, was killed: out of swap space Apr 20 08:43:44 x4 kernel: pid 44124 (getty), uid 0, was killed: out of swap space Apr 20 08:43:50 x4 kernel: pid 44125 (getty), uid 0, was killed: out of swap space Apr 20 08:43:54 x4 kernel: pid 44126 (getty), uid 0, was killed: out of swap space Apr 20 08:44:01 x4 kernel: pid 44127 (getty), uid 0, was killed: out of swap space Apr 20 08:44:06 x4 kernel: pid 44128 (getty), uid 0, was killed: out of swap space Apr 20 08:44:13 x4 kernel: pid 44129 (getty), uid 0, was killed: out of swap space Apr 20 08:44:16 x4 kernel: pid 44130 (getty), uid 0, was killed: out of swap space Apr 20 08:44:20 x4 kernel: pid 44131 (getty), uid 0, was killed: out of swap space Apr 20 08:44:28 x4 kernel: pid 44132 (getty), uid 0, was killed: out of swap space Apr 20 08:44:33 x4 kernel: pid 44136 (getty), uid 0, was killed: out of swap space Apr 20 08:44:39 x4 kernel: pid 44137 (getty), uid 0, was killed: out of swap space Apr 20 08:44:47 x4 kernel: pid 44138 (getty), uid 0, was killed: out of swap space Apr 20 08:44:52 x4 kernel: pid 44139 (getty), uid 0, was killed: out of swap space Apr 20 08:44:58 x4 kernel: pid 44140 (getty), uid 0, was killed: out of swap space Apr 20 08:45:09 x4 kernel: pid 44141 (getty), uid 0, was killed: out of swap space Apr 20 08:45:16 x4 kernel: pid 44142 (getty), uid 0, was killed: out of swap space Apr 20 08:45:23 x4 kernel: pid 44143 (getty), uid 0, was killed: out of swap space Apr 20 08:45:29 x4 kernel: pid 44147 (getty), uid 0, was killed: out of swap space Apr 20 08:45:33 x4 kernel: pid 44148 (getty), uid 0, was killed: out of swap space Apr 20 08:45:41 x4 kernel: pid 44149 (getty), uid 0, was killed: out of swap space Apr 20 08:45:47 x4 kernel: pid 44150 (getty), uid 0, was killed: out of swap space Apr 20 08:45:55 x4 kernel: pid 44151 (getty), uid 0, was killed: out of swap space Apr 20 08:46:02 x4 kernel: pid 44152 (getty), uid 0, was killed: out of swap space Apr 20 08:46:09 x4 kernel: pid 44153 (getty), uid 0, was killed: out of swap space Apr 20 08:46:16 x4 kernel: pid 44154 (getty), uid 0, was killed: out of swap space Apr 20 08:46:23 x4 kernel: pid 44155 (getty), uid 0, was killed: out of swap space Apr 20 08:46:29 x4 kernel: pid 44159 (getty), uid 0, was killed: out of swap space Apr 20 08:46:38 x4 kernel: pid 44160 (getty), uid 0, was killed: out of swap space Apr 20 08:46:45 x4 kernel: pid 44161 (getty), uid 0, was killed: out of swap space Apr 20 08:46:51 x4 kernel: pid 44162 (getty), uid 0, was killed: out of swap space Apr 20 08:46:57 x4 kernel: pid 44163 (getty), uid 0, was killed: out of swap space Apr 20 08:47:03 x4 kernel: pid 44164 (getty), uid 0, was killed: out of swap space Apr 20 08:47:10 x4 kernel: pid 44165 (getty), uid 0, was killed: out of swap space Apr 20 08:47:16 x4 kernel: pid 44166 (getty), uid 0, was killed: out of swap space Apr 20 08:47:23 x4 kernel: pid 44167 (getty), uid 0, was killed: out of swap space Apr 20 08:47:30 x4 kernel: pid 44171 (getty), uid 0, was killed: out of swap space Apr 20 08:47:39 x4 kernel: pid 44172 (getty), uid 0, was killed: out of swap space Apr 20 08:47:47 x4 kernel: pid 44173 (getty), uid 0, was killed: out of swap space Apr 20 08:47:52 x4 kernel: pid 44174 (getty), uid 0, was killed: out of swap space Apr 20 08:47:58 x4 kernel: pid 44175 (getty), uid 0, was killed: out of swap space Apr 20 08:48:09 x4 kernel: pid 44176 (getty), uid 0, was killed: out of swap space Apr 20 08:48:16 x4 kernel: pid 44177 (getty), uid 0, was killed: out of swap space Apr 20 08:48:23 x4 kernel: pid 44178 (getty), uid 0, was killed: out of swap space Apr 20 08:48:29 x4 kernel: pid 44182 (getty), uid 0, was killed: out of swap space Apr 20 08:48:41 x4 kernel: pid 44183 (getty), uid 0, was killed: out of swap space Apr 20 08:48:44 x4 kernel: pid 44184 (getty), uid 0, was killed: out of swap space Apr 20 08:48:51 x4 kernel: pid 44185 (getty), uid 0, was killed: out of swap space Apr 20 08:48:59 x4 kernel: pid 44186 (getty), uid 0, was killed: out of swap space Apr 20 08:49:04 x4 kernel: pid 44187 (getty), uid 0, was killed: out of swap space Apr 20 08:49:11 x4 kernel: pid 44188 (getty), uid 0, was killed: out of swap space Apr 20 08:49:18 x4 kernel: pid 44189 (getty), uid 0, was killed: out of swap space Apr 20 08:49:24 x4 kernel: pid 44190 (getty), uid 0, was killed: out of swap space Apr 20 08:49:30 x4 kernel: pid 44194 (getty), uid 0, was killed: out of swap space Apr 20 08:49:39 x4 kernel: pid 44195 (getty), uid 0, was killed: out of swap space Apr 20 08:49:45 x4 kernel: pid 44196 (getty), uid 0, was killed: out of swap space Apr 20 08:49:50 x4 kernel: pid 44197 (getty), uid 0, was killed: out of swap space Apr 20 08:49:58 x4 kernel: pid 44198 (getty), uid 0, was killed: out of swap space Apr 20 08:50:03 x4 kernel: pid 44199 (getty), uid 0, was killed: out of swap space Apr 20 08:50:11 x4 kernel: pid 44200 (getty), uid 0, was killed: out of swap space Apr 20 08:50:17 x4 kernel: pid 44201 (getty), uid 0, was killed: out of swap space Apr 20 08:50:24 x4 kernel: pid 44202 (getty), uid 0, was killed: out of swap space Apr 20 08:50:30 x4 kernel: pid 44206 (getty), uid 0, was killed: out of swap space Apr 20 08:50:41 x4 kernel: pid 44207 (getty), uid 0, was killed: out of swap space Apr 20 08:50:47 x4 kernel: pid 44208 (getty), uid 0, was killed: out of swap space Apr 20 08:50:54 x4 kernel: pid 44209 (getty), uid 0, was killed: out of swap space Apr 20 08:51:01 x4 kernel: pid 44210 (getty), uid 0, was killed: out of swap space Apr 20 08:51:12 x4 kernel: pid 44211 (getty), uid 0, was killed: out of swap space Apr 20 08:51:18 x4 kernel: pid 44212 (getty), uid 0, was killed: out of swap space Apr 20 08:51:22 x4 kernel: pid 44213 (getty), uid 0, was killed: out of swap space Apr 20 08:51:29 x4 kernel: pid 44214 (getty), uid 0, was killed: out of swap space Apr 20 08:51:39 x4 kernel: pid 44218 (getty), uid 0, was killed: out of swap space Apr 20 08:51:46 x4 kernel: pid 44219 (getty), uid 0, was killed: out of swap space Apr 20 08:51:51 x4 kernel: pid 44220 (getty), uid 0, was killed: out of swap space Apr 20 08:51:58 x4 kernel: pid 44221 (getty), uid 0, was killed: out of swap space Apr 20 08:52:04 x4 kernel: pid 44222 (getty), uid 0, was killed: out of swap space Apr 20 08:52:11 x4 kernel: pid 44223 (getty), uid 0, was killed: out of swap space Apr 20 08:52:17 x4 kernel: pid 44224 (getty), uid 0, was killed: out of swap space Apr 20 08:52:24 x4 kernel: pid 44225 (getty), uid 0, was killed: out of swap space Apr 20 08:52:32 x4 kernel: pid 44229 (getty), uid 0, was killed: out of swap space Apr 20 08:52:40 x4 kernel: pid 44230 (getty), uid 0, was killed: out of swap space Apr 20 08:52:46 x4 kernel: pid 44231 (getty), uid 0, was killed: out of swap space Apr 20 08:52:50 x4 kernel: pid 44232 (getty), uid 0, was killed: out of swap space Apr 20 08:52:58 x4 kernel: pid 44233 (getty), uid 0, was killed: out of swap space Apr 20 08:53:04 x4 kernel: pid 44234 (getty), uid 0, was killed: out of swap space Apr 20 08:53:12 x4 kernel: pid 44235 (getty), uid 0, was killed: out of swap space Apr 20 08:53:19 x4 kernel: pid 44236 (getty), uid 0, was killed: out of swap space Apr 20 08:53:27 x4 kernel: pid 44237 (getty), uid 0, was killed: out of swap space Apr 20 08:53:40 x4 kernel: pid 44241 (getty), uid 0, was killed: out of swap space Apr 20 08:53:43 x4 kernel: pid 44242 (getty), uid 0, was killed: out of swap space Apr 20 08:53:50 x4 kernel: pid 44243 (getty), uid 0, was killed: out of swap space Apr 20 08:53:55 x4 kernel: pid 44244 (getty), uid 0, was killed: out of swap space Apr 20 08:54:00 x4 kernel: pid 44245 (getty), uid 0, was killed: out of swap space Apr 20 08:54:04 x4 kernel: pid 44246 (getty), uid 0, was killed: out of swap space Apr 20 08:54:09 x4 kernel: pid 44247 (getty), uid 0, was killed: out of swap space Apr 20 08:54:16 x4 kernel: pid 44248 (getty), uid 0, was killed: out of swap space Apr 20 08:54:23 x4 kernel: pid 44249 (getty), uid 0, was killed: out of swap space Apr 20 08:54:29 x4 kernel: pid 44251 (getty), uid 0, was killed: out of swap space Apr 20 08:54:34 x4 kernel: pid 44254 (getty), uid 0, was killed: out of swap space Apr 20 08:54:41 x4 kernel: pid 44255 (getty), uid 0, was killed: out of swap space Apr 20 08:54:46 x4 kernel: pid 44256 (getty), uid 0, was killed: out of swap space Apr 20 08:54:52 x4 kernel: pid 44257 (getty), uid 0, was killed: out of swap space Apr 20 08:54:59 x4 kernel: pid 44258 (getty), uid 0, was killed: out of swap space Apr 20 08:55:08 x4 kernel: pid 44259 (getty), uid 0, was killed: out of swap space Apr 20 08:55:16 x4 kernel: pid 44260 (getty), uid 0, was killed: out of swap space Apr 20 08:55:22 x4 kernel: pid 44261 (getty), uid 0, was killed: out of swap space Apr 20 08:55:27 x4 kernel: pid 44262 (getty), uid 0, was killed: out of swap space Apr 20 08:55:40 x4 kernel: pid 44266 (getty), uid 0, was killed: out of swap space Apr 20 08:55:46 x4 kernel: pid 44267 (getty), uid 0, was killed: out of swap space Apr 20 08:55:53 x4 kernel: pid 44268 (getty), uid 0, was killed: out of swap space Apr 20 08:55:59 x4 kernel: pid 44269 (getty), uid 0, was killed: out of swap space Apr 20 08:56:04 x4 kernel: pid 44270 (getty), uid 0, was killed: out of swap space Apr 20 08:56:11 x4 kernel: pid 44271 (getty), uid 0, was killed: out of swap space Apr 20 08:56:16 x4 kernel: pid 44272 (getty), uid 0, was killed: out of swap space Apr 20 08:56:21 x4 kernel: pid 44273 (getty), uid 0, was killed: out of swap space Apr 20 08:56:28 x4 kernel: pid 44274 (getty), uid 0, was killed: out of swap space Apr 20 08:56:34 x4 kernel: pid 44278 (getty), uid 0, was killed: out of swap space Apr 20 08:56:40 x4 kernel: pid 44279 (getty), uid 0, was killed: out of swap space Apr 20 08:56:48 x4 kernel: pid 44280 (getty), uid 0, was killed: out of swap space Apr 20 08:56:54 x4 kernel: pid 44281 (getty), uid 0, was killed: out of swap space Apr 20 08:57:01 x4 kernel: pid 44282 (getty), uid 0, was killed: out of swap space Apr 20 08:57:10 x4 kernel: pid 44283 (getty), uid 0, was killed: out of swap space Apr 20 08:57:16 x4 kernel: pid 44284 (getty), uid 0, was killed: out of swap space Apr 20 08:57:23 x4 kernel: pid 44285 (getty), uid 0, was killed: out of swap space Apr 20 08:57:29 x4 kernel: pid 44286 (getty), uid 0, was killed: out of swap space Apr 20 08:57:42 x4 kernel: pid 44290 (getty), uid 0, was killed: out of swap space Apr 20 08:57:47 x4 kernel: pid 44291 (getty), uid 0, was killed: out of swap space Apr 20 08:57:52 x4 kernel: pid 44292 (getty), uid 0, was killed: out of swap space Apr 20 08:57:59 x4 kernel: pid 44293 (getty), uid 0, was killed: out of swap space Apr 20 08:58:05 x4 kernel: pid 44294 (getty), uid 0, was killed: out of swap space Apr 20 08:58:11 x4 kernel: pid 44295 (getty), uid 0, was killed: out of swap space Apr 20 08:58:19 x4 kernel: pid 44296 (getty), uid 0, was killed: out of swap space Apr 20 08:58:25 x4 kernel: pid 44297 (getty), uid 0, was killed: out of swap space Apr 20 08:58:31 x4 kernel: pid 44301 (getty), uid 0, was killed: out of swap space Apr 20 08:58:41 x4 kernel: pid 44302 (getty), uid 0, was killed: out of swap space Apr 20 08:58:48 x4 kernel: pid 44303 (getty), uid 0, was killed: out of swap space Apr 20 08:58:54 x4 kernel: pid 44304 (getty), uid 0, was killed: out of swap space Apr 20 08:59:01 x4 kernel: pid 44305 (getty), uid 0, was killed: out of swap space Apr 20 08:59:11 x4 kernel: pid 44306 (getty), uid 0, was killed: out of swap space Apr 20 08:59:17 x4 kernel: pid 44307 (getty), uid 0, was killed: out of swap space Apr 20 08:59:24 x4 kernel: pid 44308 (getty), uid 0, was killed: out of swap space Apr 20 08:59:30 x4 kernel: pid 44312 (getty), uid 0, was killed: out of swap space Apr 20 08:59:40 x4 kernel: pid 44313 (getty), uid 0, was killed: out of swap space Apr 20 08:59:48 x4 kernel: pid 44314 (getty), uid 0, was killed: out of swap space Apr 20 08:59:53 x4 kernel: pid 44315 (getty), uid 0, was killed: out of swap space Apr 20 08:59:58 x4 kernel: pid 44316 (getty), uid 0, was killed: out of swap space Apr 20 09:00:05 x4 kernel: pid 44317 (getty), uid 0, was killed: out of swap space Apr 20 09:00:10 x4 kernel: pid 44318 (getty), uid 0, was killed: out of swap space Apr 20 09:00:15 x4 kernel: pid 44319 (getty), uid 0, was killed: out of swap space Apr 20 09:00:24 x4 kernel: pid 44320 (getty), uid 0, was killed: out of swap space Apr 20 09:00:30 x4 kernel: pid 44324 (getty), uid 0, was killed: out of swap space Apr 20 09:00:41 x4 kernel: pid 44325 (getty), uid 0, was killed: out of swap space Apr 20 09:00:48 x4 kernel: pid 44326 (getty), uid 0, was killed: out of swap space Apr 20 09:00:56 x4 kernel: pid 44327 (getty), uid 0, was killed: out of swap space Apr 20 09:01:01 x4 kernel: pid 44328 (getty), uid 0, was killed: out of swap space Apr 20 09:01:11 x4 kernel: pid 44329 (getty), uid 0, was killed: out of swap space Apr 20 09:01:17 x4 kernel: pid 44330 (getty), uid 0, was killed: out of swap space Apr 20 09:01:25 x4 kernel: pid 44331 (getty), uid 0, was killed: out of swap space Apr 20 09:01:30 x4 kernel: pid 44335 (getty), uid 0, was killed: out of swap space Apr 20 09:01:35 x4 kernel: pid 44336 (getty), uid 0, was killed: out of swap space Apr 20 09:01:42 x4 kernel: pid 44337 (getty), uid 0, was killed: out of swap space Apr 20 09:01:48 x4 kernel: pid 44338 (getty), uid 0, was killed: out of swap space Apr 20 09:01:54 x4 kernel: pid 44339 (getty), uid 0, was killed: out of swap space Apr 20 09:01:59 x4 kernel: pid 44340 (getty), uid 0, was killed: out of swap space Apr 20 09:02:06 x4 kernel: pid 44341 (getty), uid 0, was killed: out of swap space Apr 20 09:02:12 x4 kernel: pid 44342 (getty), uid 0, was killed: out of swap space Apr 20 09:02:18 x4 kernel: pid 44343 (getty), uid 0, was killed: out of swap space Apr 20 09:02:25 x4 kernel: pid 44344 (getty), uid 0, was killed: out of swap space Apr 20 09:02:32 x4 kernel: pid 44348 (getty), uid 0, was killed: out of swap space Apr 20 09:02:42 x4 kernel: pid 44349 (getty), uid 0, was killed: out of swap space Apr 20 09:02:49 x4 kernel: pid 44350 (getty), uid 0, was killed: out of swap space Apr 20 09:02:56 x4 kernel: pid 44351 (getty), uid 0, was killed: out of swap space Apr 20 09:03:03 x4 kernel: pid 44352 (getty), uid 0, was killed: out of swap space Apr 20 09:03:06 x4 kernel: pid 44353 (getty), uid 0, was killed: out of swap space Apr 20 09:03:11 x4 kernel: pid 44354 (getty), uid 0, was killed: out of swap space Apr 20 09:03:18 x4 kernel: pid 44355 (getty), uid 0, was killed: out of swap space Apr 20 09:03:25 x4 kernel: pid 44356 (getty), uid 0, was killed: out of swap space Apr 20 09:03:31 x4 kernel: pid 44360 (getty), uid 0, was killed: out of swap space Apr 20 09:03:43 x4 kernel: pid 44361 (getty), uid 0, was killed: out of swap space Apr 20 09:03:48 x4 kernel: pid 44362 (getty), uid 0, was killed: out of swap space Apr 20 09:03:55 x4 kernel: pid 44363 (getty), uid 0, was killed: out of swap space Apr 20 09:03:58 x4 kernel: pid 44364 (getty), uid 0, was killed: out of swap space Apr 20 09:04:04 x4 kernel: pid 44365 (getty), uid 0, was killed: out of swap space Apr 20 09:04:11 x4 kernel: pid 44366 (getty), uid 0, was killed: out of swap space Apr 20 09:04:18 x4 kernel: pid 44367 (getty), uid 0, was killed: out of swap space Apr 20 09:04:25 x4 kernel: pid 44368 (getty), uid 0, was killed: out of swap space Apr 20 09:04:31 x4 kernel: pid 44372 (getty), uid 0, was killed: out of swap space Apr 20 09:04:36 x4 kernel: pid 44373 (getty), uid 0, was killed: out of swap space Apr 20 09:04:42 x4 kernel: pid 44374 (getty), uid 0, was killed: out of swap space Apr 20 09:04:50 x4 kernel: pid 44375 (getty), uid 0, was killed: out of swap space Apr 20 09:04:57 x4 kernel: pid 44376 (getty), uid 0, was killed: out of swap space Apr 20 09:05:05 x4 kernel: pid 44377 (getty), uid 0, was killed: out of swap space Apr 20 09:05:11 x4 kernel: pid 44378 (getty), uid 0, was killed: out of swap space Apr 20 09:05:17 x4 kernel: pid 44379 (getty), uid 0, was killed: out of swap space Apr 20 09:05:25 x4 kernel: pid 44380 (getty), uid 0, was killed: out of swap space Apr 20 09:05:31 x4 kernel: pid 44384 (getty), uid 0, was killed: out of swap space Apr 20 09:05:42 x4 kernel: pid 44385 (getty), uid 0, was killed: out of swap space Apr 20 09:05:47 x4 kernel: pid 44386 (getty), uid 0, was killed: out of swap space Apr 20 09:05:52 x4 kernel: pid 44387 (getty), uid 0, was killed: out of swap space Apr 20 09:06:00 x4 kernel: pid 44388 (getty), uid 0, was killed: out of swap space Apr 20 09:06:12 x4 kernel: pid 44389 (getty), uid 0, was killed: out of swap space Apr 20 09:06:21 x4 kernel: pid 44390 (getty), uid 0, was killed: out of swap space Apr 20 09:06:26 x4 kernel: pid 44391 (getty), uid 0, was killed: out of swap space Apr 20 09:06:35 x4 kernel: pid 44395 (getty), uid 0, was killed: out of swap space Apr 20 09:06:41 x4 kernel: pid 44396 (getty), uid 0, was killed: out of swap space Apr 20 09:06:47 x4 kernel: pid 44397 (getty), uid 0, was killed: out of swap space Apr 20 09:06:55 x4 kernel: pid 44398 (getty), uid 0, was killed: out of swap space Apr 20 09:07:00 x4 kernel: pid 44399 (getty), uid 0, was killed: out of swap space Apr 20 09:07:06 x4 kernel: pid 44400 (getty), uid 0, was killed: out of swap space Apr 20 09:07:14 x4 kernel: pid 44401 (getty), uid 0, was killed: out of swap space Apr 20 09:07:19 x4 kernel: pid 44402 (getty), uid 0, was killed: out of swap space Apr 20 09:07:25 x4 kernel: pid 44403 (getty), uid 0, was killed: out of swap space Apr 20 09:07:31 x4 kernel: pid 44407 (getty), uid 0, was killed: out of swap space Apr 20 09:07:34 x4 kernel: pid 44408 (getty), uid 0, was killed: out of swap space Apr 20 09:07:42 x4 kernel: pid 44409 (getty), uid 0, was killed: out of swap space Apr 20 09:07:50 x4 kernel: pid 44410 (getty), uid 0, was killed: out of swap space Apr 20 09:07:56 x4 kernel: pid 44411 (getty), uid 0, was killed: out of swap space Apr 20 09:08:05 x4 kernel: pid 44412 (getty), uid 0, was killed: out of swap space Apr 20 09:08:12 x4 kernel: pid 44413 (getty), uid 0, was killed: out of swap space Apr 20 09:08:19 x4 kernel: pid 44414 (getty), uid 0, was killed: out of swap space Apr 20 09:08:26 x4 kernel: pid 44415 (getty), uid 0, was killed: out of swap space Apr 20 09:08:33 x4 kernel: pid 44419 (getty), uid 0, was killed: out of swap space Apr 20 09:08:43 x4 kernel: pid 44420 (getty), uid 0, was killed: out of swap space Apr 20 09:08:48 x4 kernel: pid 44421 (getty), uid 0, was killed: out of swap space Apr 20 09:08:53 x4 kernel: pid 44422 (getty), uid 0, was killed: out of swap space Apr 20 09:09:00 x4 kernel: pid 44423 (getty), uid 0, was killed: out of swap space Apr 20 09:09:06 x4 kernel: pid 44424 (getty), uid 0, was killed: out of swap space Apr 20 09:09:14 x4 kernel: pid 44425 (getty), uid 0, was killed: out of swap space Apr 20 09:09:18 x4 kernel: pid 44426 (getty), uid 0, was killed: out of swap space Apr 20 09:09:23 x4 kernel: pid 44427 (getty), uid 0, was killed: out of swap space Apr 20 09:09:29 x4 kernel: pid 44428 (getty), uid 0, was killed: out of swap space Apr 20 09:09:36 x4 kernel: pid 44432 (getty), uid 0, was killed: out of swap space Apr 20 09:09:42 x4 kernel: pid 44433 (getty), uid 0, was killed: out of swap space Apr 20 09:09:47 x4 kernel: pid 44434 (getty), uid 0, was killed: out of swap space Apr 20 09:09:54 x4 kernel: pid 44435 (getty), uid 0, was killed: out of swap space Apr 20 09:09:59 x4 kernel: pid 44436 (getty), uid 0, was killed: out of swap space Apr 20 09:10:04 x4 kernel: pid 44437 (getty), uid 0, was killed: out of swap space Apr 20 09:10:13 x4 kernel: pid 44438 (getty), uid 0, was killed: out of swap space Apr 20 09:10:18 x4 kernel: pid 44439 (getty), uid 0, was killed: out of swap space Apr 20 09:10:25 x4 kernel: pid 44440 (getty), uid 0, was killed: out of swap space Apr 20 09:10:32 x4 kernel: pid 44444 (getty), uid 0, was killed: out of swap space Apr 20 09:10:36 x4 kernel: pid 44445 (getty), uid 0, was killed: out of swap space Apr 20 09:10:41 x4 kernel: pid 44446 (getty), uid 0, was killed: out of swap space Apr 20 09:10:48 x4 kernel: pid 44447 (getty), uid 0, was killed: out of swap space Apr 20 09:10:54 x4 kernel: pid 44448 (getty), uid 0, was killed: out of swap space Apr 20 09:11:03 x4 kernel: pid 44449 (getty), uid 0, was killed: out of swap space Apr 20 09:11:13 x4 kernel: pid 44450 (getty), uid 0, was killed: out of swap space Apr 20 09:11:21 x4 kernel: pid 44451 (getty), uid 0, was killed: out of swap space Apr 20 09:11:25 x4 kernel: pid 44452 (getty), uid 0, was killed: out of swap space Apr 20 09:11:32 x4 kernel: pid 44456 (getty), uid 0, was killed: out of swap space Apr 20 09:11:36 x4 kernel: pid 44457 (getty), uid 0, was killed: out of swap space Apr 20 09:11:42 x4 kernel: pid 44458 (getty), uid 0, was killed: out of swap space Apr 20 09:11:49 x4 kernel: pid 44459 (getty), uid 0, was killed: out of swap space Apr 20 09:11:57 x4 kernel: pid 44460 (getty), uid 0, was killed: out of swap space Apr 20 09:12:03 x4 kernel: pid 44461 (getty), uid 0, was killed: out of swap space Apr 20 09:12:11 x4 kernel: pid 44462 (getty), uid 0, was killed: out of swap space Apr 20 09:12:18 x4 kernel: pid 44463 (getty), uid 0, was killed: out of swap space Apr 20 09:12:24 x4 kernel: pid 44464 (getty), uid 0, was killed: out of swap space Apr 20 09:12:32 x4 kernel: pid 44468 (getty), uid 0, was killed: out of swap space Apr 20 09:12:37 x4 kernel: pid 44469 (getty), uid 0, was killed: out of swap space Apr 20 09:12:43 x4 kernel: pid 44470 (getty), uid 0, was killed: out of swap space Apr 20 09:12:48 x4 kernel: pid 44471 (getty), uid 0, was killed: out of swap space Apr 20 09:12:55 x4 kernel: pid 44472 (getty), uid 0, was killed: out of swap space Apr 20 09:13:01 x4 kernel: pid 44473 (getty), uid 0, was killed: out of swap space Apr 20 09:13:06 x4 kernel: pid 44474 (getty), uid 0, was killed: out of swap space Apr 20 09:13:13 x4 kernel: pid 44475 (getty), uid 0, was killed: out of swap space Apr 20 09:13:18 x4 kernel: pid 44476 (getty), uid 0, was killed: out of swap space Apr 20 09:13:23 x4 kernel: pid 44477 (getty), uid 0, was killed: out of swap space Apr 20 09:13:29 x4 kernel: pid 44478 (getty), uid 0, was killed: out of swap space Apr 20 09:13:35 x4 kernel: pid 44482 (getty), uid 0, was killed: out of swap space Apr 20 09:13:44 x4 kernel: pid 44483 (getty), uid 0, was killed: out of swap space Apr 20 09:13:50 x4 kernel: pid 44484 (getty), uid 0, was killed: out of swap space Apr 20 09:13:56 x4 kernel: pid 44485 (getty), uid 0, was killed: out of swap space Apr 20 09:14:03 x4 kernel: pid 44486 (getty), uid 0, was killed: out of swap space Apr 20 09:14:07 x4 kernel: pid 44487 (getty), uid 0, was killed: out of swap space Apr 20 09:14:13 x4 kernel: pid 44488 (getty), uid 0, was killed: out of swap space Apr 20 09:14:20 x4 kernel: pid 44489 (getty), uid 0, was killed: out of swap space Apr 20 09:14:25 x4 kernel: pid 44490 (getty), uid 0, was killed: out of swap space Apr 20 09:14:32 x4 kernel: pid 44494 (getty), uid 0, was killed: out of swap space Apr 20 09:14:37 x4 kernel: pid 44495 (getty), uid 0, was killed: out of swap space Apr 20 09:14:42 x4 kernel: pid 44496 (getty), uid 0, was killed: out of swap space Apr 20 09:14:49 x4 kernel: pid 44497 (getty), uid 0, was killed: out of swap space Apr 20 09:14:55 x4 kernel: pid 44498 (getty), uid 0, was killed: out of swap space Apr 20 09:15:02 x4 kernel: pid 44499 (getty), uid 0, was killed: out of swap space Apr 20 09:15:13 x4 kernel: pid 44500 (getty), uid 0, was killed: out of swap space Apr 20 09:15:19 x4 kernel: pid 44501 (getty), uid 0, was killed: out of swap space Apr 20 09:15:26 x4 kernel: pid 44502 (getty), uid 0, was killed: out of swap space Apr 20 09:15:32 x4 kernel: pid 44506 (getty), uid 0, was killed: out of swap space Apr 20 09:15:43 x4 kernel: pid 44507 (getty), uid 0, was killed: out of swap space Apr 20 09:15:50 x4 kernel: pid 44508 (getty), uid 0, was killed: out of swap space Apr 20 09:15:56 x4 kernel: pid 44509 (getty), uid 0, was killed: out of swap space Apr 20 09:16:02 x4 kernel: pid 44510 (getty), uid 0, was killed: out of swap space Apr 20 09:16:14 x4 kernel: pid 44511 (getty), uid 0, was killed: out of swap space Apr 20 09:16:19 x4 kernel: pid 44512 (getty), uid 0, was killed: out of swap space Apr 20 09:16:28 x4 kernel: pid 44513 (getty), uid 0, was killed: out of swap space Apr 20 09:16:35 x4 kernel: pid 44517 (getty), uid 0, was killed: out of swap space Apr 20 09:16:44 x4 kernel: pid 44518 (getty), uid 0, was killed: out of swap space Apr 20 09:16:51 x4 kernel: pid 44519 (getty), uid 0, was killed: out of swap space Apr 20 09:16:56 x4 kernel: pid 44520 (getty), uid 0, was killed: out of swap space Apr 20 09:17:04 x4 kernel: pid 44521 (getty), uid 0, was killed: out of swap space Apr 20 09:17:14 x4 kernel: pid 44522 (getty), uid 0, was killed: out of swap space Apr 20 09:17:21 x4 kernel: pid 44523 (getty), uid 0, was killed: out of swap space Apr 20 09:17:28 x4 kernel: pid 44524 (getty), uid 0, was killed: out of swap space Apr 20 09:17:34 x4 kernel: pid 44528 (getty), uid 0, was killed: out of swap space Apr 20 09:17:43 x4 kernel: pid 44529 (getty), uid 0, was killed: out of swap space Apr 20 09:17:48 x4 kernel: pid 44530 (getty), uid 0, was killed: out of swap space Apr 20 09:17:56 x4 kernel: pid 44531 (getty), uid 0, was killed: out of swap space Apr 20 09:18:01 x4 kernel: pid 44532 (getty), uid 0, was killed: out of swap space Apr 20 09:18:14 x4 kernel: pid 44533 (getty), uid 0, was killed: out of swap space Apr 20 09:18:19 x4 kernel: pid 44534 (getty), uid 0, was killed: out of swap space Apr 20 09:18:24 x4 kernel: pid 44535 (getty), uid 0, was killed: out of swap space Apr 20 09:18:30 x4 kernel: pid 44536 (getty), uid 0, was killed: out of swap space Apr 20 09:18:37 x4 kernel: pid 44540 (getty), uid 0, was killed: out of swap space Apr 20 09:18:42 x4 kernel: pid 44541 (getty), uid 0, was killed: out of swap space Apr 20 09:18:47 x4 kernel: pid 44542 (getty), uid 0, was killed: out of swap space Apr 20 09:18:51 x4 kernel: pid 44543 (getty), uid 0, was killed: out of swap space Apr 20 09:18:58 x4 kernel: pid 44544 (getty), uid 0, was killed: out of swap space Apr 20 09:19:04 x4 kernel: pid 44545 (getty), uid 0, was killed: out of swap space Apr 20 09:19:08 x4 kernel: pid 44546 (getty), uid 0, was killed: out of swap space FreeBSD/i386 (x4.osted.lan) (ttyu0) login: FreeBSD/i386 (x4.osted.lan) (ttyu0) login: Apr 20 09:19:21 x4 kernel: pid 782 (getty), uid 0, was killed: out of swap space Apr 20 09:19:28 x4 kernel: pid 44547 (getty), uid 0, was killed: out of swap space Apr 20 09:19:33 x4 kernel: pid 44552 (getty), uid 0, was killed: out of swap space Apr 20 09:19:37 x4 kernel: pid 44553 (getty), uid 0, was killed: out of swap space Apr 20 09:19:44 x4 kernel: pid 44554 (getty), uid 0, was killed: out of swap space Apr 20 09:19:51 x4 kernel: pid 44555 (getty), uid 0, was killed: out of swap space Apr 20 09:20:00 x4 kernel: pid 44556 (getty), uid 0, was killed: out of swap space Apr 20 09:20:03 x4 kernel: pid 44557 (getty), uid 0, was killed: out of swap space Apr 20 09:20:12 x4 kernel: pid 44558 (getty), uid 0, was killed: out of swap space Apr 20 09:20:19 x4 kernel: pid 44559 (getty), uid 0, was killed: out of swap space Apr 20 09:20:26 x4 kernel: pid 44560 (getty), uid 0, was killed: out of swap space Apr 20 09:20:32 x4 kernel: pid 44564 (getty), uid 0, was killed: out of swap space Apr 20 09:20:38 x4 kernel: pid 44565 (getty), uid 0, was killed: out of swap space Apr 20 09:20:56 x4 kernel: pid 44570 (bash), uid 1001, was killed: out of swap space Apr 20 09:21:00 x4 kernel: pid 44566 (getty), uid 0, was killed: out of swap space Apr 20 09:21:04 x4 kernel: pid 44578 (getty), uid 0, was killed: out of swap space FreeBSD/i386 (x4.osted.lan) (ttyu0) login: KDB: enter: Break to debugger [ thread pid 11 tid 100006 ] Stopped at kdb_alt_break_internal+0xf0: movl $0,kdb_why db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> bt Tracing pid 11 tid 100006 td 0xbfcfa80 kdb_alt_break_internal(0,15125acc,ea3577,2,1aff8888,...) at kdb_alt_break_internal+0xf0/frame 0x15125aa0 kdb_alt_break(2,1aff8888,1a3f113,0,40000,...) at kdb_alt_break+0x16/frame 0x15125aac uart_intr_rxready(1aff8800,13c88,be85d40,bfcfa80,15125af0,...) at uart_intr_rxready+0x87/frame 0x15125acc uart_intr(1aff8800,0,13c88,1,bfcfa80,...) at uart_intr+0x130/frame 0x15125b0c intr_event_handle(bfbea80,15125ba0,1f88f9c,9f75380,1,...) at intr_event_handle+0xa5/frame 0x15125b38 intr_execute_handlers(bff4130,15125ba0,3) at intr_execute_handlers+0xa5/frame 0x15125b70 lapic_handle_intr(32,15125ba0,8,28,28,...) at lapic_handle_intr+0x5e/frame 0x15125b90 Xapic_isr1_pti() at PTDpde+0x4bbf/frame 0x15125b90 --- interrupt, eip = 0x1698005, esp = 0x15125be0, ebp = 0x15125be0 --- acpi_cpu_c1(15125c34,16881d2,be85d50,0,1c8ae43,...) at acpi_cpu_c1+0x5/frame 0x15125be0 acpi_cpu_idle(1b196e03,0,1b196e03,15125c50,169860a,...) at acpi_cpu_idle+0x30b/frame 0x15125c20 cpu_idle_acpi(1b196e03,0,1f88f40,1,ffffffff,...) at cpu_idle_acpi+0x3f/frame 0x15125c34 cpu_idle(0,15125c80,1a83ce8,aea,1,...) at cpu_idle+0x9a/frame 0x15125c50 sched_idletd(0,15125ce8,1a7773c,407,0,...) at sched_idletd+0x236/frame 0x15125cac fork_exit(10d8c60,0,15125ce8,0,0,...) at fork_exit+0x7e/frame 0x15125cd4 fork_trampoline() at PTDpde+0x42da/frame 0x15125cd4 --- trap 0, eip = 0, esp = 0x15125d20, ebp = 0 --- (null)() at 0 db:1:pho1> show allpcpu Current CPU: 3 cpuid = 0 dynamic pcpu = 0x68eb80 curthread = 0xbfd0700: pid 11 tid 100003 "idle: cpu0" curpcb = 0x15116d40 fpcurthread = none idlethread = 0xbfd0700: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 trampstk = 0xffc06ff0 kesp0 = 0x15116d30 common_tssp = 0xffc01260 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xa0e1b80 curthread = 0xbfd0380: pid 11 tid 100004 "idle: cpu1" curpcb = 0x1511bd40 fpcurthread = none idlethread = 0xbfd0380: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 trampstk = 0xffc09ff0 kesp0 = 0x1511bd30 common_tssp = 0xffc012c8 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xa0e6b80 curthread = 0xbfd0000: pid 11 tid 100005 "idle: cpu2" curpcb = 0x15120d40 fpcurthread = none idlethread = 0xbfd0000: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 trampstk = 0xffc0aff0 kesp0 = 0x15120d30 common_tssp = 0xffc01330 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xa0ebb80 curthread = 0xbfcfa80: pid 11 tid 100006 "idle: cpu3" curpcb = 0x15125d40 fpcurthread = none idlethread = 0xbfcfa80: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 trampstk = 0xffc0cff0 kesp0 = 0x15125d30 common_tssp = 0xffc01398 curvnet = 0 spin locks held: db:1:pho1> show alllocks db:1:pho1> show lockedvnods Locked vnodes db:1:pho1> show allchains chain 1: thread 100160 (pid 44579, getty) sleeping on 0x9f6c474 "ttyin" chain 2: thread 100194 (pid 44548, getty) sleeping on 0x1afdd074 "ttyin" chain 3: thread 107457 (pid 43455, sh) sleeping on 0x26114350 "piperd" chain 4: thread 103157 (pid 43454, sh) sleeping on 0x1d7f000 "pfault" chain 5: thread 101272 (pid 43452, vmstat) sleeping on 0x1d7f000 "pfault" chain 6: thread 100634 (pid 42745, mmap18) sleeping on 0x23ac733c "mbusy" chain 7: thread 100196 (pid 42745, tmmap) sleeping on 0x25270f00 "urdlck" chain 8: thread 100371 (pid 42745, tmlock) sleeping on 0x23ac7334 "vmmaps" chain 9: thread 100475 (pid 42745, tmprotect) sleeping on 0x23ac733c "mbusy" chain 10: thread 100549 (pid 42745, tmlockall) sleeping on 0x1d7f000 "pfault" chain 11: thread 100962 (pid 42732, mmap18) sleeping on 0x1f101f04 "mbusy" chain 12: thread 101710 (pid 42732, tmmap) sleeping on 0x1f101efc "vmmaps" chain 13: thread 101721 (pid 42732, tmprotect) sleeping on 0x1f101f04 "mbusy" chain 14: thread 101743 (pid 42732, tmlockall) sleeping on 0x1d7f000 "pfault" chain 15: thread 107424 (pid 42717, mmap18) sleeping on 0x1d7f000 "vmwait" chain 16: thread 101506 (pid 42717, tmmap) blocked on sx "vm map (user)" XLOCK thread 107424 (pid 42717, mmap18) sleeping on 0x1d7f000 "vmwait" chain 17: thread 101548 (pid 42717, tmprotect) blocked on sx "vm map (user)" XLOCK thread 107424 (pid 42717, mmap18) sleeping on 0x1d7f000 "vmwait" chain 18: thread 101592 (pid 42717, tmlockall) blocked on sx "vm map (user)" XLOCK thread 107424 (pid 42717, mmap18) sleeping on 0x1d7f000 "vmwait" chain 19: thread 107548 (pid 21522, tee) sleeping on 0x234e26a0 "piperd" chain 20: thread 100756 (pid 21521, sh) sleeping on 0x1b2bf35c "wait" chain 21: thread 106673 (pid 38201, watchdogd) sleeping on 0x1f7a8bd "nanslp" chain 22: thread 100123 (pid 1073, tail) sleeping on 0x1d7f000 "pfault" chain 23: thread 100165 (pid 780, getty) sleeping on 0x9f6c674 "ttyin" chain 24: thread 100177 (pid 779, getty) sleeping on 0x9f6c874 "ttyin" chain 25: thread 100179 (pid 778, getty) sleeping on 0x9f6ca74 "ttyin" chain 26: thread 100184 (pid 777, getty) sleeping on 0x9f6cc74 "ttyin" chain 27: thread 100183 (pid 776, getty) sleeping on 0x9f6ce74 "ttyin" chain 28: thread 100182 (pid 775, getty) sleeping on 0x9f6d074 "ttyin" chain 29: thread 100103 (pid 774, getty) sleeping on 0x9f6d274 "ttyin" chain 30: thread 100178 (pid 757, inetd) sleeping on 0x1b1f3c64 "select" chain 31: thread 100173 (pid 723, nfscbd: master) sleeping on 0x1b2fa4d0 "rpcsvc" chain 32: thread 100174 (pid 723, nfscbd: service) sleeping on 0xbff5cd0 "rpcsvc" chain 33: thread 100175 (pid 723, nfscbd: service) sleeping on 0xbff5c50 "rpcsvc" chain 34: thread 100176 (pid 723, nfscbd: service) sleeping on 0xbff5bd0 "rpcsvc" chain 35: thread 100156 (pid 722, nfscbd) sleeping on 0x1f5be2c0 "accept" chain 36: thread 100109 (pid 679, sshd) sleeping on 0x1accf624 "select" chain 37: thread 100117 (pid 611, powerd) sleeping on 0x1b1aaee4 "select" chain 38: thread 100108 (pid 565, nfsd: master) sleeping on 0xbff5e50 "rpcsvc" chain 39: thread 100124 (pid 565, nfsd: service) sleeping on 0x1b555650 "rpcsvc" chain 40: thread 100125 (pid 565, nfsd: service) sleeping on 0x1ec0a450 "rpcsvc" chain 41: thread 100126 (pid 565, nfsd: service) sleeping on 0x1ec0a4d0 "rpcsvc" chain 42: thread 100127 (pid 565, nfsd: service) sleeping on 0x1b5555d0 "rpcsvc" chain 43: thread 100128 (pid 565, nfsd: service) sleeping on 0x1b2facd0 "rpcsvc" chain 44: thread 100129 (pid 565, nfsd: service) sleeping on 0x1b555550 "rpcsvc" chain 45: thread 100130 (pid 565, nfsd: service) sleeping on 0x1b5554d0 "rpcsvc" chain 46: thread 100131 (pid 565, nfsd: service) sleeping on 0x1ec0a550 "rpcsvc" chain 47: thread 100132 (pid 565, nfsd: service) sleeping on 0x1b555450 "rpcsvc" chain 48: thread 100133 (pid 565, nfsd: service) sleeping on 0x1b555950 "rpcsvc" chain 49: thread 100134 (pid 565, nfsd: service) sleeping on 0x1b5553d0 "rpcsvc" chain 50: thread 100135 (pid 565, nfsd: service) sleeping on 0x1b555350 "rpcsvc" chain 51: thread 100136 (pid 565, nfsd: service) sleeping on 0x1b5559d0 "rpcsvc" chain 52: thread 100137 (pid 565, nfsd: service) sleeping on 0x1b2fad50 "rpcsvc" chain 53: thread 100138 (pid 565, nfsd: service) sleeping on 0x1ec0a5d0 "rpcsvc" chain 54: thread 100139 (pid 565, nfsd: service) sleeping on 0x1b2fadd0 "rpcsvc" chain 55: thread 100140 (pid 565, nfsd: service) sleeping on 0x1b2fae50 "rpcsvc" chain 56: thread 100141 (pid 565, nfsd: service) sleeping on 0x1b555a50 "rpcsvc" chain 57: thread 100142 (pid 565, nfsd: service) sleeping on 0x1b5552d0 "rpcsvc" chain 58: thread 100143 (pid 565, nfsd: service) sleeping on 0x1b555250 "rpcsvc" chain 59: thread 100144 (pid 565, nfsd: service) sleeping on 0x1b5551d0 "rpcsvc" chain 60: thread 100145 (pid 565, nfsd: service) sleeping on 0x1b555150 "rpcsvc" chain 61: thread 100146 (pid 565, nfsd: service) sleeping on 0x1ec0a650 "rpcsvc" chain 62: thread 100147 (pid 565, nfsd: service) sleeping on 0x1b5550d0 "rpcsvc" chain 63: thread 100148 (pid 565, nfsd: service) sleeping on 0x1b555ad0 "rpcsvc" chain 64: thread 100149 (pid 565, nfsd: service) sleeping on 0x1b555050 "rpcsvc" chain 65: thread 100150 (pid 565, nfsd: service) sleeping on 0x1b555b50 "rpcsvc" chain 66: thread 100151 (pid 565, nfsd: service) sleeping on 0x1b554f50 "rpcsvc" chain 67: thread 100152 (pid 565, nfsd: service) sleeping on 0x1b555bd0 "rpcsvc" chain 68: thread 100153 (pid 565, nfsd: service) sleeping on 0x1b554ed0 "rpcsvc" chain 69: thread 100154 (pid 565, nfsd: service) sleeping on 0xbff64d0 "rpcsvc" chain 70: thread 100122 (pid 549, nfsuserd) sleeping on 0x1b1aaf64 "select" chain 71: thread 100107 (pid 548, nfsuserd) sleeping on 0x1af7f71c "pause" chain 72: thread 100116 (pid 409, syslogd) sleeping on 0x1b1ab224 "select" chain 73: thread 100102 (pid 24, vnlru) sleeping on 0x1b7366b8 "vlruwt" chain 74: thread 100100 (pid 23, syncer) sleeping on 0x1ff4fe0 "syncer" chain 75: thread 100099 (pid 22, bufdaemon) sleeping on 0x1ff496c "qsleep" chain 76: thread 100101 (pid 22, bufspacedaemon-0) sleeping on 0x1d51980 "-" chain 77: thread 100112 (pid 22, /home worker) sleeping on 0x1ee15884 "sdflush" chain 78: thread 100113 (pid 22, /tmp worker) sleeping on 0x1ee15684 "sdflush" chain 79: thread 100114 (pid 22, /usr worker) sleeping on 0x1ee15484 "sdflush" chain 80: thread 100115 (pid 22, /var worker) sleeping on 0x1ee15284 "sdflush" chain 81: thread 100096 (pid 21, vmdaemon) sleeping on 0x1ff9f6c "psleep" chain 82: thread 100095 (pid 20, dom0) sleeping on 0x1f797bb "pwait" chain 83: thread 100097 (pid 20, laundry: dom0) sleeping on 0x1f797ba "laundp" chain 84: thread 100098 (pid 20, uma) sleeping on 0x13e9df0 "umarcl" chain 85: thread 100092 (pid 19, rand_harvestq) sleeping on 0x1e52b20 "-" chain 86: thread 100088 (pid 18, sctp_iterator) sleeping on 0x20234e0 "waiting_for_work" chain 87: thread 100087 (pid 17, soaiod4) sleeping on 0x1ff4598 "-" chain 88: thread 100086 (pid 16, soaiod3) sleeping on 0x1ff4598 "-" chain 89: thread 100085 (pid 15, soaiod2) sleeping on 0x1ff4598 "-" chain 90: thread 100084 (pid 9, soaiod1) sleeping on 0x1ff4598 "-" chain 91: thread 100081 (pid 8, fdc0) sleeping on 0x1ac7523c "-" chain 92: thread 100046 (pid 14, usbus0) sleeping on 0x1acb0acc "-" chain 93: thread 100047 (pid 14, usbus0) sleeping on 0x1acb0afc "-" chain 94: thread 100048 (pid 14, usbus0) sleeping on 0x1acb0b2c "-" chain 95: thread 100049 (pid 14, usbus0) sleeping on 0x1acb0b5c "-" chain 96: thread 100050 (pid 14, usbus0) sleeping on 0x1acb0b8c "-" chain 97: thread 100052 (pid 14, usbus1) sleeping on 0x1af8aacc "-" chain 98: thread 100053 (pid 14, usbus1) sleeping on 0x1af8aafc "-" chain 99: thread 100054 (pid 14, usbus1) sleeping on 0x1af8ab2c "-" chain 100: thread 100055 (pid 14, usbus1) sleeping on 0x1af8ab5c "-" chain 101: thread 100056 (pid 14, usbus1) sleeping on 0x1af8ab8c "-" chain 102: thread 100058 (pid 14, usbus2) sleeping on 0x1af9facc "-" chain 103: thread 100059 (pid 14, usbus2) sleeping on 0x1af9fafc "-" chain 104: thread 100060 (pid 14, usbus2) sleeping on 0x1af9fb2c "-" chain 105: thread 100061 (pid 14, usbus2) sleeping on 0x1af9fb5c "-" chain 106: thread 100062 (pid 14, usbus2) sleeping on 0x1af9fb8c "-" chain 107: thread 100063 (pid 14, usbus3) sleeping on 0x1afa3acc "-" chain 108: thread 100064 (pid 14, usbus3) sleeping on 0x1afa3afc "-" chain 109: thread 100065 (pid 14, usbus3) sleeping on 0x1afa3b2c "-" chain 110: thread 100066 (pid 14, usbus3) sleeping on 0x1afa3b5c "-" chain 111: thread 100067 (pid 14, usbus3) sleeping on 0x1afa3b8c "-" chain 112: thread 100068 (pid 14, usbus4) sleeping on 0x1afabacc "-" chain 113: thread 100069 (pid 14, usbus4) sleeping on 0x1afabafc "-" chain 114: thread 100070 (pid 14, usbus4) sleeping on 0x1afabb2c "-" chain 115: thread 100071 (pid 14, usbus4) sleeping on 0x1afabb5c "-" chain 116: thread 100072 (pid 14, usbus4) sleeping on 0x1afabb8c "-" chain 117: thread 100074 (pid 14, usbus5) sleeping on 0x1ac91ca4 "-" chain 118: thread 100075 (pid 14, usbus5) sleeping on 0x1ac91cd4 "-" chain 119: thread 100076 (pid 14, usbus5) sleeping on 0x1ac91d04 "-" chain 120: thread 100077 (pid 14, usbus5) sleeping on 0x1ac91d34 "-" chain 121: thread 100078 (pid 14, usbus5) sleeping on 0x1ac91d64 "-" chain 122: thread 100041 (pid 7, doneq0) sleeping on 0x1d9fec0 "-" chain 123: thread 100094 (pid 7, scanner) sleeping on 0x1d9fdec "-" chain 124: thread 100040 (pid 6, crypto returns 3) sleeping on 0xbf9dec4 "crypto_ret_wait" chain 125: thread 100039 (pid 5, crypto returns 2) sleeping on 0xbf9de8c "crypto_ret_wait" chain 126: thread 100038 (pid 4, crypto returns 1) sleeping on 0xbf9de54 "crypto_ret_wait" chain 127: thread 100037 (pid 3, crypto returns 0) sleeping on 0xbf9de1c "crypto_ret_wait" chain 128: thread 100036 (pid 2, crypto) sleeping on 0x1ff8db4 "crypto_wait" chain 129: thread 100028 (pid 13, g_event) sleeping on 0x201f988 "-" chain 130: thread 100029 (pid 13, g_up) sleeping on 0x201f98c "-" chain 131: thread 100030 (pid 13, g_down) sleeping on 0x201f990 "-" chain 132: thread 100002 (pid 1, init) sleeping on 0xbfcca14 "wait" chain 133: thread 100001 (pid 10, audit) sleeping on 0x2023c98 "audit_worker_cv" chain 134: thread 100000 (pid 0, swapper) sleeping on 0x1d7f000 "vmwait" chain 135: thread 100007 (pid 0, aiod_kick taskq) sleeping on 0xbff9000 "-" chain 136: thread 100008 (pid 0, kqueue_ctx taskq) sleeping on 0xbff8f00 "-" chain 137: thread 100011 (pid 0, thread taskq) sleeping on 0xbff8d80 "-" chain 138: thread 100013 (pid 0, if_config_tqg_0) sleeping on 0xbe89680 "-" chain 139: thread 100014 (pid 0, if_io_tqg_0) sleeping on 0xbe89600 "-" chain 140: thread 100015 (pid 0, if_io_tqg_1) sleeping on 0xbe89580 "-" chain 141: thread 100016 (pid 0, if_io_tqg_2) sleeping on 0xbe89500 "-" chain 142: thread 100017 (pid 0, if_io_tqg_3) sleeping on 0xbe89480 "-" chain 143: thread 100018 (pid 0, softirq_0) sleeping on 0xbe89400 "-" chain 144: thread 100019 (pid 0, softirq_1) sleeping on 0xbe89380 "-" chain 145: thread 100020 (pid 0, softirq_2) sleeping on 0xbe89300 "-" chain 146: thread 100021 (pid 0, softirq_3) sleeping on 0xbe89280 "-" chain 147: thread 100031 (pid 0, firmware taskq) sleeping on 0xbff8c00 "-" chain 148: thread 100032 (pid 0, crypto_0) sleeping on 0xbff8a80 "-" chain 149: thread 100033 (pid 0, crypto_1) sleeping on 0xbff8a80 "-" chain 150: thread 100034 (pid 0, crypto_2) sleeping on 0xbff8a80 "-" chain 151: thread 100035 (pid 0, crypto_3) sleeping on 0xbff8a80 "-" chain 152: thread 100083 (pid 0, mca taskq) sleeping on 0x1ac63080 "-" chain 153: thread 100089 (pid 0, acpi_task_0) sleeping on 0x1b2fb080 "-" chain 154: thread 100090 (pid 0, acpi_task_1) sleeping on 0x1b2fb080 "-" chain 155: thread 100091 (pid 0, acpi_task_2) sleeping on 0x1b2fb080 "-" chain 156: thread 100093 (pid 0, CAM taskq) sleeping on 0xbff8980 "-" db:1:pho1> show mount 0x1ec1e000 /dev/ada0s1a on / (ufs) 0x1b727000 devfs on /dev (devfs) 0x1ec1d000 /dev/ada0s1f on /home (ufs) 0x1ec1c000 /dev/label/tmp on /tmp (ufs) 0x1ef46000 /dev/ada0s1d on /usr (ufs) 0x1ef45000 /dev/ada0s1e on /var (ufs) 0x1ef44000 procfs on /proc (procfs) More info: show mount db:1:pho1> show bufqueues bqempty: 1 Buf domain 0 freebufs 2218 lofreebufs 311 hifreebufs 466 bufspace 55388160 maxbufspace 94683136 hibufspace 94027776 lobufspace 89326372 bufspacethresh 91677074 numdirtybuffers 43 lodirtybuffers 732 hidirtybuffers 1464 dirtybufthresh 1317 cleanq count 3447 (53716992) dirtyq count 43 (649216) wakeup 0 lim 28 CPU 25, 23, 3, 19, Locked buffers: 1 space 16384 Total buffers: 5779 space 55388160 db:1:pho1> show page vm_cnt.v_free_count: 4001 vm_cnt.v_inactive_count: 9 vm_cnt.v_active_count: 16 vm_cnt.v_laundry_count: 0 vm_cnt.v_wire_count: 858112 vm_cnt.v_free_reserved: 1188 vm_cnt.v_free_min: 5498 vm_cnt.v_free_target: 18428 vm_cnt.v_inactive_target: 27642 db:1:pho1> show pageq pq_free 4001 dom 0 page_cnt 862225 free 4001 pq_act 16 pq_inact 9 pq_laund 0 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 -- -- -- -- 10 (004096K) | 000000 09 (002048K) | 000000 08 (001024K) | 000000 07 (000512K) | 000000 06 (000256K) | 000000 05 (000128K) | 000000 04 (000064K) | 000006 03 (000032K) | 000011 02 (000016K) | 000057 01 (000008K) | 000463 00 (000004K) | 001399 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 -- -- -- -- 10 (004096K) | 000000 09 (002048K) | 000000 08 (001024K) | 000000 07 (000512K) | 000000 06 (000256K) | 000000 05 (000128K) | 000005 04 (000064K) | 000027 03 (000032K) | 000053 02 (000016K) | 000044 01 (000008K) | 000003 00 (000004K) | 000066 db:0:pho> acttrace Tracing command idle pid 11 tid 100003 td 0xbfd0700 (CPU 0) cpustop_handler(0,7be55d8,15116b94,167fb1c,0,...) at cpustop_handler+0x25/frame 0x15116a80 ipi_nmi_handler(0,0,0,2428d6c,0,...) at ipi_nmi_handler+0x36/frame 0x15116a90 trap(15116ba0,8,28,28,1ac24800,...) at trap+0xac/frame 0x15116b94 calltrap() at PTDpde+0x4124/frame 0x15116b94 --- trap 0x13, eip = 0x1698005, esp = 0x15116be0, ebp = 0x15116be0 --- acpi_cpu_c1(15116c34,16881d2,2428d50,0,1c8ae43,...) at acpi_cpu_c1+0x5/frame 0x15116be0 acpi_cpu_idle(aa5fe08,0,aa5fe08,15116c50,169860a,...) at acpi_cpu_idle+0x30b/frame 0x15116c20 cpu_idle_acpi(aa5fe08,0,1f87b00,2,ffffffff,...) at cpu_idle_acpi+0x3f/frame 0x15116c34 cpu_idle(0,15116c80,1a83ce8,aea,2,...) at cpu_idle+0x9a/frame 0x15116c50 sched_idletd(0,15116ce8,1a7773c,407,0,...) at sched_idletd+0x236/frame 0x15116cac fork_exit(10d8c60,0,15116ce8,0,0,...) at fork_exit+0x7e/frame 0x15116cd4 fork_trampoline() at PTDpde+0x42da/frame 0x15116cd4 --- trap 0, eip = 0, esp = 0x15116d20, ebp = 0 --- (null)() at 0 Tracing command idle pid 11 tid 100004 td 0xbfd0380 (CPU 1) cpustop_handler(1,7be55d8,1511bb94,167fb1c,0,...) at cpustop_handler+0x25/frame 0x1511ba80 ipi_nmi_handler(0,be7bd6c,0,13c88,1511baf0,...) at ipi_nmi_handler+0x36/frame 0x1511ba90 trap(1511bba0,8,28,28,1ac24600,...) at trap+0xac/frame 0x1511bb94 calltrap() at PTDpde+0x4124/frame 0x1511bb94 --- trap 0x13, eip = 0x1698005, esp = 0x1511bbe0, ebp = 0x1511bbe0 --- acpi_cpu_c1(1511bc34,16881d2,be7bd50,0,1c8ae43,...) at acpi_cpu_c1+0x5/frame 0x1511bbe0 acpi_cpu_idle(1b1e3e63,0,1b1e3e63,1511bc50,169860a,...) at acpi_cpu_idle+0x30b/frame 0x1511bc20 cpu_idle_acpi(1b1e3e63,0,1f881c0,1,ffffffff,...) at cpu_idle_acpi+0x3f/frame 0x1511bc34 cpu_idle(0,1511bc80,1a83ce8,aea,1,...) at cpu_idle+0x9a/frame 0x1511bc50 sched_idletd(0,1511bce8,1a7773c,407,0,...) at sched_idletd+0x236/frame 0x1511bcac fork_exit(10d8c60,0,1511bce8,0,0,...) at fork_exit+0x7e/frame 0x1511bcd4 fork_trampoline() at PTDpde+0x42da/frame 0x1511bcd4 --- trap 0, eip = 0, esp = 0x1511bd20, ebp = 0 --- (null)() at 0 Tracing command idle pid 11 tid 100005 td 0xbfd0000 (CPU 2) cpustop_handler(2,7be55d8,15120b94,167fb1c,0,...) at cpustop_handler+0x25/frame 0x15120a80 ipi_nmi_handler(0,be80d6c,0,13c88,15120af0,...) at ipi_nmi_handler+0x36/frame 0x15120a90 trap(15120ba0,8,28,28,1ac24400,...) at trap+0xac/frame 0x15120b94 calltrap() at PTDpde+0x4124/frame 0x15120b94 --- trap 0x13, eip = 0x1698005, esp = 0x15120be0, ebp = 0x15120be0 --- acpi_cpu_c1(15120c34,16881d2,be80d50,0,1c8ae43,...) at acpi_cpu_c1+0x5/frame 0x15120be0 acpi_cpu_idle(973fd9d,0,973fd9d,15120c50,169860a,...) at acpi_cpu_idle+0x30b/frame 0x15120c20 cpu_idle_acpi(973fd9d,0,1f88880,1,ffffffff,...) at cpu_idle_acpi+0x3f/frame 0x15120c34 cpu_idle(0,15120c80,1a83ce8,aea,1,...) at cpu_idle+0x9a/frame 0x15120c50 sched_idletd(0,15120ce8,1a7773c,407,0,...) at sched_idletd+0x236/frame 0x15120cac fork_exit(10d8c60,0,15120ce8,0,0,...) at fork_exit+0x7e/frame 0x15120cd4 fork_trampoline() at PTDpde+0x42da/frame 0x15120cd4 --- trap 0, eip = 0, esp = 0x15120d20, ebp = 0 --- (null)() at 0 Tracing command idle pid 11 tid 100006 td 0xbfcfa80 (CPU 3) kdb_alt_break_internal(0,15125acc,ea3577,2,1aff8888,...) at kdb_alt_break_internal+0xf0/frame 0x15125aa0 kdb_alt_break(2,1aff8888,1a3f113,0,40000,...) at kdb_alt_break+0x16/frame 0x15125aac uart_intr_rxready(1aff8800,13c88,be85d40,bfcfa80,15125af0,...) at uart_intr_rxready+0x87/frame 0x15125acc uart_intr(1aff8800,0,13c88,1,bfcfa80,...) at uart_intr+0x130/frame 0x15125b0c intr_event_handle(bfbea80,15125ba0,1f88f9c,9f75380,1,...) at intr_event_handle+0xa5/frame 0x15125b38 intr_execute_handlers(bff4130,15125ba0,3) at intr_execute_handlers+0xa5/frame 0x15125b70 lapic_handle_intr(32,15125ba0,8,28,28,...) at lapic_handle_intr+0x5e/frame 0x15125b90 Xapic_isr1_pti() at PTDpde+0x4bbf/frame 0x15125b90 --- interrupt, eip = 0x1698005, esp = 0x15125be0, ebp = 0x15125be0 --- acpi_cpu_c1(15125c34,16881d2,be85d50,0,1c8ae43,...) at acpi_cpu_c1+0x5/frame 0x15125be0 acpi_cpu_idle(1b196e03,0,1b196e03,15125c50,169860a,...) at acpi_cpu_idle+0x30b/frame 0x15125c20 cpu_idle_acpi(1b196e03,0,1f88f40,1,ffffffff,...) at cpu_idle_acpi+0x3f/frame 0x15125c34 cpu_idle(0,15125c80,1a83ce8,aea,1,...) at cpu_idle+0x9a/frame 0x15125c50 sched_idletd(0,15125ce8,1a7773c,407,0,...) at sched_idletd+0x236/frame 0x15125cac fork_exit(10d8c60,0,15125ce8,0,0,...) at fork_exit+0x7e/frame 0x15125cd4 fork_trampoline() at PTDpde+0x42da/frame 0x15125cd4 --- trap 0, eip = 0, esp = 0x15125d20, ebp = 0 --- (null)() at 0 db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 44579 1 44579 0 Ss+ ttyin 0x9f6c474 getty 44548 1 44548 0 Ss+ ttyin 0x1afdd074 getty 43455 1078 1074 1001 S piperd 0x26114350 sh 43454 1078 1074 1001 DW pfault 0x1d7f000 sh 43452 1078 1074 1001 DW pfault 0x1d7f000 vmstat 42745 41956 3421 0 D (threaded) mmap18 100634 D mbusy 0x23ac733c mmap18 100196 S urdlck 0x25270f00 tmmap 100371 D vmmaps 0x23ac7334 tmlock 100475 D mbusy 0x23ac733c tmprotect 100549 D pfault 0x1d7f000 tmlockall 42732 41956 3421 0 D (threaded) mmap18 100962 D mbusy 0x1f101f04 mmap18 101710 D vmmaps 0x1f101efc tmmap 101721 D mbusy 0x1f101f04 tmprotect 101743 D pfault 0x1d7f000 tmlockall 42717 41956 3421 0 D (threaded) mmap18 107424 D vmwait 0x1d7f000 mmap18 101506 D vm map 0xbfd8b24 tmmap 101548 D vm map 0xbfd8b24 tmprotect 101592 D vm map 0xbfd8b24 tmlockall 41956 21523 3421 0 ?W mmap18 21523 21521 3421 0 ?W sh 21522 3421 3421 0 S piperd 0x234e26a0 tee 21521 3421 3421 0 SW wait 0x1b2bf35c sh 38201 1 38201 0 Ss nanslp 0x1f7a8bd watchdogd 3421 1 3421 0 ?W+ sh 1078 1074 1074 1001 ?W sh 1074 1 1074 1001 ?Ws sh 1073 1 1073 1001 DWs pfault 0x1d7f000 tail 780 1 780 0 Ss+ ttyin 0x9f6c674 getty 779 1 779 0 Ss+ ttyin 0x9f6c874 getty 778 1 778 0 Ss+ ttyin 0x9f6ca74 getty 777 1 777 0 Ss+ ttyin 0x9f6cc74 getty 776 1 776 0 Ss+ ttyin 0x9f6ce74 getty 775 1 775 0 Ss+ ttyin 0x9f6d074 getty 774 1 774 0 Ss+ ttyin 0x9f6d274 getty 757 1 757 0 Ss select 0x1b1f3c64 inetd 723 722 722 0 S (threaded) nfscbd 100173 S rpcsvc 0x1b2fa4d0 nfscbd: master 100174 S rpcsvc 0xbff5cd0 nfscbd: service 100175 S rpcsvc 0xbff5c50 nfscbd: service 100176 S rpcsvc 0xbff5bd0 nfscbd: service 722 1 722 0 SWs accept 0x1f5be2c0 nfscbd 689 1 689 0 ?Ws cron 679 1 679 0 Ss select 0x1accf624 sshd 611 1 611 0 Ss select 0x1b1aaee4 powerd 565 1 562 0 S (threaded) nfsd 100108 S rpcsvc 0xbff5e50 nfsd: master 100124 S rpcsvc 0x1b555650 nfsd: service 100125 S rpcsvc 0x1ec0a450 nfsd: service 100126 S rpcsvc 0x1ec0a4d0 nfsd: service 100127 S rpcsvc 0x1b5555d0 nfsd: service 100128 S rpcsvc 0x1b2facd0 nfsd: service 100129 S rpcsvc 0x1b555550 nfsd: service 100130 S rpcsvc 0x1b5554d0 nfsd: service 100131 S rpcsvc 0x1ec0a550 nfsd: service 100132 S rpcsvc 0x1b555450 nfsd: service 100133 S rpcsvc 0x1b555950 nfsd: service 100134 S rpcsvc 0x1b5553d0 nfsd: service 100135 S rpcsvc 0x1b555350 nfsd: service 100136 S rpcsvc 0x1b5559d0 nfsd: service 100137 S rpcsvc 0x1b2fad50 nfsd: service 100138 S rpcsvc 0x1ec0a5d0 nfsd: service 100139 S rpcsvc 0x1b2fadd0 nfsd: service 100140 S rpcsvc 0x1b2fae50 nfsd: service 100141 S rpcsvc 0x1b555a50 nfsd: service 100142 S rpcsvc 0x1b5552d0 nfsd: service 100143 S rpcsvc 0x1b555250 nfsd: service 100144 S rpcsvc 0x1b5551d0 nfsd: service 100145 S rpcsvc 0x1b555150 nfsd: service 100146 S rpcsvc 0x1ec0a650 nfsd: service 100147 S rpcsvc 0x1b5550d0 nfsd: service 100148 S rpcsvc 0x1b555ad0 nfsd: service 100149 S rpcsvc 0x1b555050 nfsd: service 100150 S rpcsvc 0x1b555b50 nfsd: service 100151 S rpcsvc 0x1b554f50 nfsd: service 100152 S rpcsvc 0x1b555bd0 nfsd: service 100153 S rpcsvc 0x1b554ed0 nfsd: service 100154 S rpcsvc 0xbff64d0 nfsd: service 549 548 548 0 S select 0x1b1aaf64 nfsuserd 548 1 548 0 SWs pause 0x1af7f71c nfsuserd 409 1 409 0 Ss select 0x1b1ab224 syslogd 24 0 0 0 DL vlruwt 0x1b7366b8 [vnlru] 23 0 0 0 DL syncer 0x1ff4fe0 [syncer] 22 0 0 0 DL (threaded) [bufdaemon] 100099 D qsleep 0x1ff496c [bufdaemon] 100101 D - 0x1d51980 [bufspacedaemon-0] 100112 D sdflush 0x1ee15884 [/home worker] 100113 D sdflush 0x1ee15684 [/tmp worker] 100114 D sdflush 0x1ee15484 [/usr worker] 100115 D sdflush 0x1ee15284 [/var worker] 21 0 0 0 DL psleep 0x1ff9f6c [vmdaemon] 20 0 0 0 DL (threaded) [pagedaemon] 100095 D pwait 0x1f797bb [dom0] 100097 D laundp 0x1f797ba [laundry: dom0] 100098 D umarcl 0x13e9df0 [uma] 19 0 0 0 DL - 0x1e52b20 [rand_harvestq] 18 0 0 0 DL waiting 0x20234e0 [sctp_iterator] 17 0 0 0 DL - 0x1ff4598 [soaiod4] 16 0 0 0 DL - 0x1ff4598 [soaiod3] 15 0 0 0 DL - 0x1ff4598 [soaiod2] 9 0 0 0 DL - 0x1ff4598 [soaiod1] 8 0 0 0 DL - 0x1ac7523c [fdc0] 14 0 0 0 DL (threaded) [usb] 100046 D - 0x1acb0acc [usbus0] 100047 D - 0x1acb0afc [usbus0] 100048 D - 0x1acb0b2c [usbus0] 100049 D - 0x1acb0b5c [usbus0] 100050 D - 0x1acb0b8c [usbus0] 100052 D - 0x1af8aacc [usbus1] 100053 D - 0x1af8aafc [usbus1] 100054 D - 0x1af8ab2c [usbus1] 100055 D - 0x1af8ab5c [usbus1] 100056 D - 0x1af8ab8c [usbus1] 100058 D - 0x1af9facc [usbus2] 100059 D - 0x1af9fafc [usbus2] 100060 D - 0x1af9fb2c [usbus2] 100061 D - 0x1af9fb5c [usbus2] 100062 D - 0x1af9fb8c [usbus2] 100063 D - 0x1afa3acc [usbus3] 100064 D - 0x1afa3afc [usbus3] 100065 D - 0x1afa3b2c [usbus3] 100066 D - 0x1afa3b5c [usbus3] 100067 D - 0x1afa3b8c [usbus3] 100068 D - 0x1afabacc [usbus4] 100069 D - 0x1afabafc [usbus4] 100070 D - 0x1afabb2c [usbus4] 100071 D - 0x1afabb5c [usbus4] 100072 D - 0x1afabb8c [usbus4] 100074 D - 0x1ac91ca4 [usbus5] 100075 D - 0x1ac91cd4 [usbus5] 100076 D - 0x1ac91d04 [usbus5] 100077 D - 0x1ac91d34 [usbus5] 100078 D - 0x1ac91d64 [usbus5] 7 0 0 0 DL (threaded) [cam] 100041 D - 0x1d9fec0 [doneq0] 100094 D - 0x1d9fdec [scanner] 6 0 0 0 DL crypto_ 0xbf9dec4 [crypto returns 3] 5 0 0 0 DL crypto_ 0xbf9de8c [crypto returns 2] 4 0 0 0 DL crypto_ 0xbf9de54 [crypto returns 1] 3 0 0 0 DL crypto_ 0xbf9de1c [crypto returns 0] 2 0 0 0 DL crypto_ 0x1ff8db4 [crypto] 13 0 0 0 DL (threaded) [geom] 100028 D - 0x201f988 [g_event] 100029 D - 0x201f98c [g_up] 100030 D - 0x201f990 [g_down] 12 0 0 0 WL (threaded) [intr] 100009 I [swi6: task queue] 100010 I [swi6: Giant taskq] 100012 I [swi5: fast taskq] 100022 I [swi3: vm] 100023 I [swi1: netisr 0] 100024 I [swi4: clock (0)] 100025 I [swi4: clock (1)] 100026 I [swi4: clock (2)] 100027 I [swi4: clock (3)] 100042 I [irq256: hdac0] 100043 I [irq257: re0] 100044 I [irq22: ahci0] 100045 I [irq16: hdac1 ohci0] 100051 I [irq17: ohci1 ohci3] 100057 I [irq18: ohci2 ohci4] 100073 I [irq19: ehci0] 100079 I [irq14: ata0] 100080 I [swi0: uart] 100082 I [irq1: atkbd0] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 1 0 1 0 SLs wait 0xbfcca14 [init] 10 0 0 0 DL audit_w 0x2023c98 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D vmwait 0x1d7f000 [swapper] 100007 D - 0xbff9000 [aiod_kick taskq] 100008 D - 0xbff8f00 [kqueue_ctx taskq] 100011 D - 0xbff8d80 [thread taskq] 100013 D - 0xbe89680 [if_config_tqg_0] 100014 D - 0xbe89600 [if_io_tqg_0] 100015 D - 0xbe89580 [if_io_tqg_1] 100016 D - 0xbe89500 [if_io_tqg_2] 100017 D - 0xbe89480 [if_io_tqg_3] 100018 D - 0xbe89400 [softirq_0] 100019 D - 0xbe89380 [softirq_1] 100020 D - 0xbe89300 [softirq_2] 100021 D - 0xbe89280 [softirq_3] 100031 D - 0xbff8c00 [firmware taskq] 100032 D - 0xbff8a80 [crypto_0] 100033 D - 0xbff8a80 [crypto_1] 100034 D - 0xbff8a80 [crypto_2] 100035 D - 0xbff8a80 [crypto_3] 100083 D - 0x1ac63080 [mca taskq] 100089 D - 0x1b2fb080 [acpi_task_0] 100090 D - 0x1b2fb080 [acpi_task_1] 100091 D - 0x1b2fb080 [acpi_task_2] 100093 D - 0xbff8980 [CAM taskq] 43453 1078 1074 1001 Z sed 1080 1074 1074 1001 Z sh 1079 1074 1074 1001 Z awk 43453 1078 1074 1001 Z sed 1080 1074 1074 1001 Z sh 1079 1074 1074 1001 Z awk db:0:pho> allt Tracing command getty pid 44579 tid 100160 td 0x1f5a3a80 sched_switch(1f5a3a80,0,104,189,1f88880,...) at sched_switch+0x80c/frame 0x1d6ff940 mi_switch(104,0,1a886b5,22b,1f5a3a80,...) at mi_switch+0x1f3/frame 0x1d6ff97c sleepq_switch(1f5a3a80,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1d6ff9b0 sleepq_catch_signals(1d6ffa18,1085670,9f6c414,0,0,...) at sleepq_catch_signals+0x360/frame 0x1d6ff9f4 sleepq_wait_sig(9f6c474,0,1d6ffa38,101,0,...) at sleepq_wait_sig+0x14/frame 0x1d6ffa18 _cv_wait_sig(9f6c474,9f6c404,1a8e741,5a9,1d6ffbb8,...) at _cv_wait_sig+0x21f/frame 0x1d6ffa5c tty_wait(9f6c400,9f6c474,1d6ffbb8,1,0,...) at tty_wait+0x4b/frame 0x1d6ffa80 ttydisc_read(9f6c400,1d6ffbb8,0,d1,1d4e09c,...) at ttydisc_read+0x238/frame 0x1d6ffac0 ttydev_read(1b3edb00,1d6ffbb8,0,1f5a3a80,1d6ffb6c,...) at ttydev_read+0x55/frame 0x1d6ffae0 devfs_read_f(1ec81000,1d6ffbb8,1af24c00,0,1f5a3a80,...) at devfs_read_f+0xc5/frame 0x1d6ffb18 dofileread(1ec81000,1d6ffbb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0x1d6ffb48 kern_readv(1f5a3a80,0,1d6ffbb8,1d6ffbe8,ffbfed61,...) at kern_readv+0x93/frame 0x1d6ffb98 sys_read(1f5a3a80,1f5a3d04,1a7717b,4,76,...) at sys_read+0x54/frame 0x1d6ffbe8 syscall(1d6ffce8,3b,3b,3b,0,...) at syscall+0x6ee/frame 0x1d6ffcdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x1d6ffcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2821508f, esp = 0xffbfed34, ebp = 0xffbfed48 --- _end() at 0x2821508f Tracing command getty pid 44548 tid 100194 td 0x1b197700 sched_switch(1b197700,0,104,189,1f881c0,...) at sched_switch+0x80c/frame 0x1d6e2940 mi_switch(104,0,1a886b5,22b,1b197700,...) at mi_switch+0x1f3/frame 0x1d6e297c sleepq_switch(1b197700,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1d6e29b0 sleepq_catch_signals(1d6e2a18,1085670,1afdd014,0,0,...) at sleepq_catch_signals+0x360/frame 0x1d6e29f4 sleepq_wait_sig(1afdd074,0,1d6e2a38,101,0,...) at sleepq_wait_sig+0x14/frame 0x1d6e2a18 _cv_wait_sig(1afdd074,1afdd004,1a8e741,5a9,1d6e2bb8,...) at _cv_wait_sig+0x21f/frame 0x1d6e2a5c tty_wait(1afdd000,1afdd074,1d6e2bb8,1,0,...) at tty_wait+0x4b/frame 0x1d6e2a80 ttydisc_read(1afdd000,1d6e2bb8,0,d1,1d4e09c,...) at ttydisc_read+0x238/frame 0x1d6e2ac0 ttydev_read(1b000900,1d6e2bb8,0,1b197700,1d6e2b6c,...) at ttydev_read+0x55/frame 0x1d6e2ae0 devfs_read_f(1ec81038,1d6e2bb8,28a23200,0,1b197700,...) at devfs_read_f+0xc5/frame 0x1d6e2b18 dofileread(1ec81038,1d6e2bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0x1d6e2b48 kern_readv(1b197700,0,1d6e2bb8,1d6e2be8,ffbfed61,...) at kern_readv+0x93/frame 0x1d6e2b98 sys_read(1b197700,1b197984,1a7717b,4,1c8ae43,...) at sys_read+0x54/frame 0x1d6e2be8 syscall(1d6e2ce8,3b,3b,3b,0,...) at syscall+0x6ee/frame 0x1d6e2cdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x1d6e2cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2821508f, esp = 0xffbfed34, ebp = 0xffbfed48 --- _end() at 0x2821508f Tracing command sh pid 43455 tid 107457 td 0x26f9f000 sched_switch(26f9f000,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x6a1d59a8 mi_switch(104,0,1a886b5,22b,26f9f000,...) at mi_switch+0x1f3/frame 0x6a1d59e8 sleepq_switch(26f9f000,0,1a886b5,1ca,5c,...) at sleepq_switch+0x110/frame 0x6a1d5a1c sleepq_catch_signals(0,1a886b5,178,1f96254,26f9f000,...) at sleepq_catch_signals+0x360/frame 0x6a1d5a60 sleepq_wait_sig(26114350,5c,1a8c1b5,100,0,...) at sleepq_wait_sig+0x14/frame 0x6a1d5a84 _sleep(26114350,261144e0,15c,1a8c1b5,0,...) at _sleep+0x386/frame 0x6a1d5ad8 pipe_read(24c657e0,6a1d5bb8,1b543c00,0,26f9f000,...) at pipe_read+0x49b/frame 0x6a1d5b18 dofileread(24c657e0,6a1d5bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0x6a1d5b48 kern_readv(26f9f000,0,6a1d5bb8,1a892fd,ffbfe867,...) at kern_readv+0x93/frame 0x6a1d5b98 sys_read(26f9f000,26f9f284,1a7717b,4,76,...) at sys_read+0x54/frame 0x6a1d5be8 syscall(6a1d5ce8,3b,3b,3b,0,...) at syscall+0x6ee/frame 0x6a1d5cdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x6a1d5cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2824908f, esp = 0xffbfe804, ebp = 0xffbfe818 --- _end() at 0x2824908f Tracing command sh pid 43454 tid 103157 td 0x214df000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(1a866b4,0,1d2f2b4,1d2f398,151254f8,...) at db_trace_self_wrapper+0x2a/frame 0x15125478 kdb_backtrace(1a86731,151254f8,151255f8,167fb2e,1512552c,...) at kdb_backtrace+0x2d/frame 0x151254e0 kdb_reenter(1512552c,11057bf,1d2f46c,0,1a89241,...) at kdb_reenter+0x2a/frame 0x151254f0 trap(15125604,8,28,28,ffffffff,...) at trap+0xbe/frame 0x151255f8 calltrap() at PTDpde+0x4124/frame 0x151255f8 --- trap 0xc, eip = 0x1669589, esp = 0x15125644, ebp = 0x15125660 --- db_trace_thread(214df000,ffffffff,a9be,192f5,214df000,...) at db_trace_thread+0x29/frame 0x15125660 _db_stack_trace_all(10efe60,0,ffffffff,151256f8,1da1ad0,...) at _db_stack_trace_all+0xe9/frame 0x151256cc db_command(1da28f6,0,1da24e8,1da28f5,60,...) at db_command+0x297/frame 0x15125780 db_script_exec(1ffb798,0,15125828,1512581c,1da1ad0,...) at db_script_exec+0x168/frame 0x151257f0 db_command(16e0773,15125908,9d505d,16e0780,ffff0ff0,...) at db_command+0x297/frame 0x151258a4 db_command_loop(16e0780,ffff0ff0,151258cf,151258ce,9f18000,...) at db_command_loop+0x50/frame 0x151258b0 db_trap(3,ffff0ff0,7,0,1,...) at db_trap+0x10d/frame 0x15125908 kdb_trap(3,ffff0ff0,15125a50,1203ce8,88e,...) at kdb_trap+0x11e/frame 0x15125940 trap(15125a50,8,28,28,4,...) at trap+0x3d1/frame 0x15125a44 calltrap() at PTDpde+0x4124/frame 0x15125a44 --- trap 0x3, eip = 0x10efe60, esp = 0x15125a90, ebp = 0x15125aa0 --- kdb_alt_break_internal(0,15125acc,ea3577,2,1aff8888,...) at kdb_alt_break_internal+0xf0/frame 0x15125aa0 kdb_alt_break(2,1aff8888,1a3f113,0,40000,...) at kdb_alt_break+0x16/frame 0x15125aac uart_intr_rxready(1aff8800,13c88,be85d40,bfcfa80,15125af0,...) at uart_intr_rxready+0x87/frame 0x15125acc uart_intr(1aff8800,0,13c88,1,bfcfa80,...) at uart_intr+0x130/frame 0x15125b0c intr_event_handle(bfbea80,15125ba0,1f88f9c,9f75380,1,...) at intr_event_handle+0xa5/frame 0x15125b38 intr_execute_handlers(bff4130,15125ba0,3) at intr_execute_handlers+0xa5/frame 0x15125b70 lapic_handle_intr(32,15125ba0,8,28,28,...) at lapic_handle_intr+0x5e/frame 0x15125b90 Xapic_isr1_pti() at PTDpde+0x4bbf/frame 0x15125b90 --- interrupt, eip = 0x1698005, esp = 0x15125be0, ebp = 0x15125be0 --- acpi_cpu_c1(15125c34,16881d2,be85d50,0,1c8ae43,...) at acpi_cpu_c1+0x5/frame 0x15125be0 acpi_cpu_idle(1b196e03,0,1b196e03,15125c50,169860a,...) at acpi_cpu_idle+0x30b/frame 0x15125c20 cpu_idle_acpi(1b196e03,0,1f88f40,1,ffffffff,...) at cpu_idle_acpi+0x3f/frame 0x15125c34 cpu_idle(0,15125c80,1a83ce8,aea,1,...) at cpu_idle+0x9a/frame 0x15125c50 sched_idletd(0,15125ce8,1a7773c,407,0,...) at sched_idletd+0x236/frame 0x15125cac fork_exit(10d8c60,0,15125ce8,0,0,...) at fork_exit+0x7e/frame 0x15125cd4 fork_trampoline() at PTDpde+0x42da/frame 0x15125cd4 --- trap 0, eip = 0, esp = 0x15125d20, ebp = 0 --- (null)() at 0 Tracing command vmstat pid 43452 tid 101272 td 0x204dca80 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(1a866b4,0,1d2f2b4,1d2f398,151254f8,...) at db_trace_self_wrapper+0x2a/frame 0x15125478 kdb_backtrace(1a86731,151254f8,151255f8,167fb2e,1512552c,...) at kdb_backtrace+0x2d/frame 0x151254e0 kdb_reenter(1512552c,11057bf,1d2f46c,0,1a89241,...) at kdb_reenter+0x2a/frame 0x151254f0 trap(15125604,8,28,28,ffffffff,...) at trap+0xbe/frame 0x151255f8 calltrap() at PTDpde+0x4124/frame 0x151255f8 --- trap 0xc, eip = 0x1669589, esp = 0x15125644, ebp = 0x15125660 --- db_trace_thread(204dca80,ffffffff,a9bc,18b98,204dca80,...) at db_trace_thread+0x29/frame 0x15125660 _db_stack_trace_all(10efe60,0,ffffffff,151256f8,1da1ad0,...) at _db_stack_trace_all+0xe9/frame 0x151256cc db_command(1da28f6,0,1da24e8,1da28f5,60,...) at db_command+0x297/frame 0x15125780 db_script_exec(1ffb798,0,15125828,1512581c,1da1ad0,...) at db_script_exec+0x168/frame 0x151257f0 db_command(16e0773,15125908,9d505d,16e0780,ffff0ff0,...) at db_command+0x297/frame 0x151258a4 db_command_loop(16e0780,ffff0ff0,151258cf,151258ce,9f18000,...) at db_command_loop+0x50/frame 0x151258b0 db_trap(3,ffff0ff0,7,0,1,...) at db_trap+0x10d/frame 0x15125908 kdb_trap(3,ffff0ff0,15125a50,1203ce8,88e,...) at kdb_trap+0x11e/frame 0x15125940 trap(15125a50,8,28,28,4,...) at trap+0x3d1/frame 0x15125a44 calltrap() at PTDpde+0x4124/frame 0x15125a44 --- trap 0x3, eip = 0x10efe60, esp = 0x15125a90, ebp = 0x15125aa0 --- kdb_alt_break_internal(0,15125acc,ea3577,2,1aff8888,...) at kdb_alt_break_internal+0xf0/frame 0x15125aa0 kdb_alt_break(2,1aff8888,1a3f113,0,40000,...) at kdb_alt_break+0x16/frame 0x15125aac uart_intr_rxready(1aff8800,13c88,be85d40,bfcfa80,15125af0,...) at uart_intr_rxready+0x87/frame 0x15125acc uart_intr(1aff8800,0,13c88,1,bfcfa80,...) at uart_intr+0x130/frame 0x15125b0c intr_event_handle(bfbea80,15125ba0,1f88f9c,9f75380,1,...) at intr_event_handle+0xa5/frame 0x15125b38 intr_execute_handlers(bff4130,15125ba0,3) at intr_execute_handlers+0xa5/frame 0x15125b70 lapic_handle_intr(32,15125ba0,8,28,28,...) at lapic_handle_intr+0x5e/frame 0x15125b90 Xapic_isr1_pti() at PTDpde+0x4bbf/frame 0x15125b90 --- interrupt, eip = 0x1698005, esp = 0x15125be0, ebp = 0x15125be0 --- acpi_cpu_c1(15125c34,16881d2,be85d50,0,1c8ae43,...) at acpi_cpu_c1+0x5/frame 0x15125be0 acpi_cpu_idle(1b196e03,0,1b196e03,15125c50,169860a,...) at acpi_cpu_idle+0x30b/frame 0x15125c20 cpu_idle_acpi(1b196e03,0,1f88f40,1,ffffffff,...) at cpu_idle_acpi+0x3f/frame 0x15125c34 cpu_idle(0,15125c80,1a83ce8,aea,1,...) at cpu_idle+0x9a/frame 0x15125c50 sched_idletd(0,15125ce8,1a7773c,407,0,...) at sched_idletd+0x236/frame 0x15125cac fork_exit(10d8c60,0,15125ce8,0,0,...) at fork_exit+0x7e/frame 0x15125cd4 fork_trampoline() at PTDpde+0x42da/frame 0x15125cd4 --- trap 0, eip = 0, esp = 0x15125d20, ebp = 0 --- (null)() at 0 Tracing command mmap18 pid 42745 tid 100634 td 0x20ecb000 sched_switch(20ecb000,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x64f599b8 mi_switch(104,0,1a886b5,22b,20ecb000,...) at mi_switch+0x1f3/frame 0x64f599f8 sleepq_switch(20ecb000,0,1a886b5,2b3,20ecb000,...) at sleepq_switch+0x110/frame 0x64f59a2c sleepq_wait(23ac733c,0,64f59a80,0,0,...) at sleepq_wait+0x48/frame 0x64f59a50 _sleep(23ac733c,23ac72fc,0,1ad4cb6,0,...) at _sleep+0x396/frame 0x64f59aa4 vm_map_wait_busy(23ac72b8,0,1ad4c82,d64,35c,...) at vm_map_wait_busy+0xd7/frame 0x64f59ae0 vmspace_fork(23ac72b8,64f59b78,2,945,0,...) at vmspace_fork+0x196/frame 0x64f59b28 fork1(20ecb000,64f59bc0,0,1a892fd,14,...) at fork1+0x598/frame 0x64f59ba8 sys_fork(20ecb000,20ecb284,1a7717b,4,64f59c28,...) at sys_fork+0x55/frame 0x64f59be8 syscall(64f59ce8,3b,3b,3b,28475000,...) at syscall+0x6ee/frame 0x64f59cdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x64f59cdc --- syscall (2, FreeBSD ELF32, sys_fork), eip = 0x282220ed, esp = 0xffbfe758, ebp = 0xffbfe7a0 --- _end() at 0x282220ed Tracing command mmap18 pid 42745 tid 100196 td 0x1b1c2380 sched_switch(1b1c2380,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x6334a9a8 mi_switch(104,0,1a886b5,22b,1b1c2380,...) at mi_switch+0x1f3/frame 0x6334a9e8 sleepq_switch(1b1c2380,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x6334aa1c sleepq_catch_signals(0,1a886b5,178,1f96154,1b1c2380,...) at sleepq_catch_signals+0x360/frame 0x6334aa60 sleepq_wait_sig(25270f00,0,1a8340f,100,0,...) at sleepq_wait_sig+0x14/frame 0x6334aa84 _sleep(25270f00,1f7b660,300,1a8340f,0,...) at _sleep+0x386/frame 0x6334aad8 umtxq_sleep(0,4,1a830fb,233,8,...) at umtxq_sleep+0x197/frame 0x6334ab30 do_rw_rdlock(0,0,6334ace8,1d3d628,6334abe8,...) at do_rw_rdlock+0x4f5/frame 0x6334aba8 __umtx_op_rw_rdlock(1b1c2380,1b1c2604,1a7717b,4,1c8ae43,...) at __umtx_op_rw_rdlock+0x8c/frame 0x6334abe8 syscall(6334ace8,3b,3b,3b,28475300,...) at syscall+0x6ee/frame 0x6334acdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x6334acdc --- syscall (454, FreeBSD ELF32, sys__umtx_op), eip = 0x280a0833, esp = 0xfbbfde44, ebp = 0xfbbfde88 --- _end() at 0x280a0833 Tracing command mmap18 pid 42745 tid 100371 td 0x26b38700 sched_switch(26b38700,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x63ec7a68 mi_switch(104,0,1a886b5,22b,26b38700,...) at mi_switch+0x1f3/frame 0x63ec7aa8 sleepq_switch(26b38700,0,1a886b5,2b3,26b38700,...) at sleepq_switch+0x110/frame 0x63ec7adc sleepq_wait(23ac7334,54,1ad4c97,0,0,...) at sleepq_wait+0x48/frame 0x63ec7b00 _sleep(23ac7334,1ff9c84,254,1ad4c97,0,...) at _sleep+0x396/frame 0x63ec7b54 vm_map_unwire(23ac72b8,804e000,da9b1000,1,0,...) at vm_map_unwire+0x2b0/frame 0x63ec7bb0 kern_munlock(26b38700,804e000,d2963000) at kern_munlock+0x74/frame 0x63ec7bd4 sys_munlock(26b38700,26b38984,1a7717b,4,1c8ae43,...) at sys_munlock+0x21/frame 0x63ec7be8 syscall(63ec7ce8,3b,3b,3b,2b,...) at syscall+0x6ee/frame 0x63ec7cdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x63ec7cdc --- syscall (204, FreeBSD ELF32, sys_munlock), eip = 0x280e4fef, esp = 0xfbafcf74, ebp = 0xfbafcf98 --- _end() at 0x280e4fef Tracing command mmap18 pid 42745 tid 100475 td 0x272bfa80 sched_switch(272bfa80,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x65865a60 mi_switch(104,0,1a886b5,22b,272bfa80,...) at mi_switch+0x1f3/frame 0x65865aa0 sleepq_switch(272bfa80,0,1a886b5,2b3,272bfa80,...) at sleepq_switch+0x110/frame 0x65865ad4 sleepq_wait(23ac733c,0,65865b28,0,0,...) at sleepq_wait+0x48/frame 0x65865af8 _sleep(23ac733c,23ac72fc,0,1ad4cb6,0,...) at _sleep+0x396/frame 0x65865b4c vm_map_wait_busy(23ac72b8,0,1ad4c82,813,27d08a14,...) at vm_map_wait_busy+0xd7/frame 0x65865b88 vm_map_protect(23ac72b8,0,4000,0,0,...) at vm_map_protect+0x75/frame 0x65865bc8 sys_mprotect(272bfa80,272bfd04,1a7717b,4,0,...) at sys_mprotect+0x58/frame 0x65865be8 syscall(65865ce8,3b,3b,3b,4000,...) at syscall+0x6ee/frame 0x65865cdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x65865cdc --- syscall (74, FreeBSD ELF32, sys_mprotect), eip = 0x282069bf, esp = 0xfb9fbf70, ebp = 0xfb9fbf98 --- _end() at 0x282069bf Tracing command mmap18 pid 42745 tid 100549 td 0x23abea80 sched_switch(23abea80,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x61343930 mi_switch(104,0,1a886b5,22b,23abea80,...) at mi_switch+0x1f3/frame 0x61343970 sleepq_switch(23abea80,0,1a886b5,2b3,23abea80,...) at sleepq_switch+0x110/frame 0x613439a4 sleepq_wait(1d7f000,78,1ad6ce0,0,0,...) at sleepq_wait+0x48/frame 0x613439c8 _sleep(1d7f000,1d7efc0,78,1ad6ce0,0,...) at _sleep+0x396/frame 0x61343a1c vm_waitpfault(24f6109c,3f69e,0,40,61343a8c,...) at vm_waitpfault+0x85/frame 0x61343a48 vm_fault_hold(23ac72b8,67b17000,0,1,0,...) at vm_fault_hold+0x2f3/frame 0x61343b20 vm_fault(23ac72b8,67b17000,0,1,0,...) at vm_fault+0x83/frame 0x61343b48 vm_map_wire(23ac72b8,1000,ffc00000,3,6fb000,...) at vm_map_wire+0x4ec/frame 0x61343bc0 sys_mlockall(23abea80,23abed04,1a7717b,4,0,...) at sys_mlockall+0x1e9/frame 0x61343be8 syscall(61343ce8,3b,3b,3b,c7,...) at syscall+0x6ee/frame 0x61343cdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x61343cdc --- syscall (324, FreeBSD ELF32, sys_mlockall), eip = 0x280e4c4f, esp = 0xfb8faf78, ebp = 0xfb8faf98 --- _end() at 0x280e4c4f Tracing command mmap18 pid 42732 tid 100962 td 0x2168f380 sched_switch(2168f380,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x64f719b8 mi_switch(104,0,1a886b5,22b,2168f380,...) at mi_switch+0x1f3/frame 0x64f719f8 sleepq_switch(2168f380,0,1a886b5,2b3,2168f380,...) at sleepq_switch+0x110/frame 0x64f71a2c sleepq_wait(1f101f04,0,64f71a80,0,0,...) at sleepq_wait+0x48/frame 0x64f71a50 _sleep(1f101f04,1f101ec4,0,1ad4cb6,0,...) at _sleep+0x396/frame 0x64f71aa4 vm_map_wait_busy(1f101e80,0,1ad4c82,d64,35c,...) at vm_map_wait_busy+0xd7/frame 0x64f71ae0 vmspace_fork(1f101e80,64f71b78,2,10ab450,1f6670b8,...) at vmspace_fork+0x196/frame 0x64f71b28 fork1(2168f380,64f71bc0,0,1a892fd,14,...) at fork1+0x598/frame 0x64f71ba8 sys_fork(2168f380,2168f604,1a7717b,4,64f71c28,...) at sys_fork+0x55/frame 0x64f71be8 syscall(64f71ce8,3b,3b,3b,28475000,...) at syscall+0x6ee/frame 0x64f71cdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x64f71cdc --- syscall (2, FreeBSD ELF32, sys_fork), eip = 0x282220ed, esp = 0xffbfe758, ebp = 0xffbfe7a0 --- _end() at 0x282220ed Tracing command mmap18 pid 42732 tid 101710 td 0x21a84a80 sched_switch(21a84a80,0,104,189,1f88880,...) at sched_switch+0x80c/frame 0xbb82a60 mi_switch(104,0,1a886b5,22b,21a84a80,...) at mi_switch+0x1f3/frame 0xbb82a9c sleepq_switch(21a84a80,0,1a886b5,2b3,21a84a80,...) at sleepq_switch+0x110/frame 0xbb82ad0 sleepq_wait(1f101efc,54,1ad4c97,0,0,...) at sleepq_wait+0x48/frame 0xbb82af4 _sleep(1f101efc,1ff9c84,254,1ad4c97,0,...) at _sleep+0x396/frame 0xbb82b48 vm_map_delete(1f101e80,2847a000,6847a000,bb82be8,1f101e80,...) at vm_map_delete+0x226/frame 0xbb82b98 kern_munmap(21a84a80,2847a000,40000000) at kern_munmap+0x8b/frame 0xbb82bd4 sys_munmap(21a84a80,21a84d04,1a7717b,4,1c8ae43,...) at sys_munmap+0x21/frame 0xbb82be8 syscall(bb82ce8,3b,3b,3b,21,...) at syscall+0x6ee/frame 0xbb82cdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0xbb82cdc --- syscall (73, FreeBSD ELF32, sys_munmap), eip = 0x282124e3, esp = 0xfbbfdf70, ebp = 0xfbbfdf98 --- _end() at 0x282124e3 Tracing command mmap18 pid 42732 tid 101721 td 0x1f63ba80 sched_switch(1f63ba80,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x61af3a60 mi_switch(104,0,1a886b5,22b,1f63ba80,...) at mi_switch+0x1f3/frame 0x61af3aa0 sleepq_switch(1f63ba80,0,1a886b5,2b3,1f63ba80,...) at sleepq_switch+0x110/frame 0x61af3ad4 sleepq_wait(1f101f04,0,61af3b28,0,0,...) at sleepq_wait+0x48/frame 0x61af3af8 _sleep(1f101f04,1f101ec4,0,1ad4cb6,0,...) at _sleep+0x396/frame 0x61af3b4c vm_map_wait_busy(1f101e80,0,1ad4c82,813,1f667000,...) at vm_map_wait_busy+0xd7/frame 0x61af3b88 vm_map_protect(1f101e80,e4a4f000,e4a56000,6,0,...) at vm_map_protect+0x75/frame 0x61af3bc8 sys_mprotect(1f63ba80,1f63bd04,1a7717b,4,1c8ae43,...) at sys_mprotect+0x58/frame 0x61af3be8 syscall(61af3ce8,3b,3b,3b,7000,...) at syscall+0x6ee/frame 0x61af3cdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x61af3cdc --- syscall (74, FreeBSD ELF32, sys_mprotect), eip = 0x282069bf, esp = 0xfb9fbf70, ebp = 0xfb9fbf98 --- _end() at 0x282069bf Tracing command mmap18 pid 42732 tid 101743 td 0x247ef380 sched_switch(247ef380,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x2a4d1930 mi_switch(104,0,1a886b5,22b,247ef380,...) at mi_switch+0x1f3/frame 0x2a4d1970 sleepq_switch(247ef380,0,1a886b5,2b3,247ef380,...) at sleepq_switch+0x110/frame 0x2a4d19a4 sleepq_wait(1d7f000,78,1ad6ce0,0,0,...) at sleepq_wait+0x48/frame 0x2a4d19c8 _sleep(1d7f000,1d7efc0,78,1ad6ce0,0,...) at _sleep+0x396/frame 0x2a4d1a1c vm_waitpfault(1f5367ec,3f74a,0,40,2a4d1a8c,...) at vm_waitpfault+0x85/frame 0x2a4d1a48 vm_fault_hold(1f101e80,67bc4000,0,1,0,...) at vm_fault_hold+0x2f3/frame 0x2a4d1b20 vm_fault(1f101e80,67bc4000,0,1,1a83ce8,...) at vm_fault+0x83/frame 0x2a4d1b48 vm_map_wire(1f101e80,1000,ffc00000,3,6fb000,...) at vm_map_wire+0x4ec/frame 0x2a4d1bc0 sys_mlockall(247ef380,247ef604,1a7717b,4,8,...) at sys_mlockall+0x1e9/frame 0x2a4d1be8 syscall(2a4d1ce8,3b,3b,3b,bd,...) at syscall+0x6ee/frame 0x2a4d1cdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x2a4d1cdc --- syscall (324, FreeBSD ELF32, sys_mlockall), eip = 0x280e4c4f, esp = 0xfb8faf78, ebp = 0xfb8faf98 --- _end() at 0x280e4c4f Tracing command mmap18 pid 42717 tid 107424 td 0x2478c700 sched_switch(2478c700,0,104,189,1f87b00,...) at sched_switch+0x80c/frame 0x6a2c5950 mi_switch(104,0,1a886b5,22b,2478c700,...) at mi_switch+0x1f3/frame 0x6a2c598c sleepq_switch(2478c700,0,1a886b5,2b3,2478c700,...) at sleepq_switch+0x110/frame 0x6a2c59c0 sleepq_wait(1d7f000,54,1ad6cbc,0,0,...) at sleepq_wait+0x48/frame 0x6a2c59e4 _sleep(1d7f000,1d7efc0,54,1ad6cbc,0,...) at _sleep+0x396/frame 0x6a2c5a38 vm_wait_doms(207a1444,1ad41fe,6a1,0,1,...) at vm_wait_doms+0xa2/frame 0x6a2c5a68 vm_fault_copy_entry(2031fd98,bfd8ae0,1effee9c,234cba18,6a2c5b78,...) at vm_fault_copy_entry+0x27e/frame 0x6a2c5ae0 vmspace_fork(bfd8ae0,6a2c5b78,2,10ab450,236e7414,...) at vmspace_fork+0xadb/frame 0x6a2c5b28 fork1(2478c700,6a2c5bc0,be69000,0,14,...) at fork1+0x598/frame 0x6a2c5ba8 sys_fork(2478c700,2478c984,1a7717b,4,1c8ae43,...) at sys_fork+0x55/frame 0x6a2c5be8 syscall(6a2c5ce8,3b,3b,3b,28475000,...) at syscall+0x6ee/frame 0x6a2c5cdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x6a2c5cdc --- syscall (2, FreeBSD ELF32, sys_fork), eip = 0x282220ed, esp = 0xffbfe758, ebp = 0xffbfe7a0 --- _end() at 0x282220ed Tracing command mmap18 pid 42717 tid 101506 td 0x1fa78000 sched_switch(1fa78000,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x65f8ba00 mi_switch(104,0,1a886b5,22b,1fa78000,...) at mi_switch+0x1f3/frame 0x65f8ba40 sleepq_switch(1fa78000,0,1a886b5,2b3,1,...) at sleepq_switch+0x110/frame 0x65f8ba74 sleepq_wait(bfd8b24,0,1a8b27b,3,0,...) at sleepq_wait+0x48/frame 0x65f8ba98 _sx_xlock_hard(bfd8b24,2478c700,0,1ad4c82,c3a,...) at _sx_xlock_hard+0x3a0/frame 0x65f8bb1c _sx_xlock(bfd8b24,0,1ad4c82,c3a,0,...) at _sx_xlock+0xcf/frame 0x65f8bb48 vm_map_delete(bfd8ae0,28680000,68680000,65f8bbe8,bfd8ae0,...) at vm_map_delete+0x283/frame 0x65f8bb98 kern_munmap(1fa78000,28680000,40000000) at kern_munmap+0x8b/frame 0x65f8bbd4 sys_munmap(1fa78000,1fa78284,1a7717b,4,0,...) at sys_munmap+0x21/frame 0x65f8bbe8 syscall(65f8bce8,3b,3b,3b,c,...) at syscall+0x6ee/frame 0x65f8bcdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x65f8bcdc --- syscall (73, FreeBSD ELF32, sys_munmap), eip = 0x282124e3, esp = 0xfbbfdf70, ebp = 0xfbbfdf98 --- _end() at 0x282124e3 Tracing command mmap18 pid 42717 tid 101548 td 0x27b73000 sched_switch(27b73000,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x605b7998 mi_switch(104,0,1a886b5,22b,27b73000,...) at mi_switch+0x1f3/frame 0x605b79d8 sleepq_switch(27b73000,0,1a886b5,2b3,1,...) at sleepq_switch+0x110/frame 0x605b7a0c sleepq_wait(bfd8b24,0,1a8b27b,3,0,...) at sleepq_wait+0x48/frame 0x605b7a30 _sx_xlock_hard(bfd8b24,2478c704,0,1a816cf,bc,...) at _sx_xlock_hard+0x3a0/frame 0x605b7ab4 _sx_xlock(bfd8b24,0,1a816cf,bc) at _sx_xlock+0xcf/frame 0x605b7ae0 lock_sx(bfd8b24,0,1a81b7d,df,0,...) at lock_sx+0x51/frame 0x605b7af8 _sleep(bfd8b64,bfd8b24,0,1ad4cb6,0,...) at _sleep+0x453/frame 0x605b7b4c vm_map_wait_busy(bfd8ae0,0,1ad4c82,813,236e735c,...) at vm_map_wait_busy+0xd7/frame 0x605b7b88 vm_map_protect(bfd8ae0,b7488000,b7490000,1,0,...) at vm_map_protect+0x75/frame 0x605b7bc8 sys_mprotect(27b73000,27b73284,1a7717b,4,1a8157e,...) at sys_mprotect+0x58/frame 0x605b7be8 syscall(605b7ce8,3b,3b,3b,8000,...) at syscall+0x6ee/frame 0x605b7cdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x605b7cdc --- syscall (74, FreeBSD ELF32, sys_mprotect), eip = 0x282069bf, esp = 0xfb9fbf70, ebp = 0xfb9fbf98 --- _end() at 0x282069bf Tracing command mmap18 pid 42717 tid 101592 td 0x28c98700 sched_switch(28c98700,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x664d1a60 mi_switch(104,0,1a886b5,22b,28c98700,...) at mi_switch+0x1f3/frame 0x664d1aa0 sleepq_switch(28c98700,0,1a886b5,2b3,1,...) at sleepq_switch+0x110/frame 0x664d1ad4 sleepq_wait(bfd8b24,0,1a8b27b,3,0,...) at sleepq_wait+0x48/frame 0x664d1af8 _sx_xlock_hard(bfd8b24,2478c704,0,1ad5efc,45e,...) at _sx_xlock_hard+0x3a0/frame 0x664d1b80 _sx_xlock(bfd8b24,0,1ad5efc,45e,28c98700,...) at _sx_xlock+0xcf/frame 0x664d1bac _vm_map_lock(bfd8ae0,1ad5efc,45e,0,0,...) at _vm_map_lock+0x4e/frame 0x664d1bc8 sys_munlockall(28c98700,28c98984,1a7717b,4,1c8ae43,...) at sys_munlockall+0x44/frame 0x664d1be8 syscall(664d1ce8,3b,3b,3b,bb,...) at syscall+0x6ee/frame 0x664d1cdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x664d1cdc --- syscall (325, FreeBSD ELF32, sys_munlockall), eip = 0x280e4c3f, esp = 0xfb8faf78, ebp = 0xfb8faf98 --- _end() at 0x280e4c3f Tracing command mmap18 pid 41956 tid 100215 td 0x23cad380 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(1a866b4,0,1d2f2b4,1d2f398,151254f8,...) at db_trace_self_wrapper+0x2a/frame 0x15125478 kdb_backtrace(1a86731,151254f8,151255f8,167fb2e,1512552c,...) at kdb_backtrace+0x2d/frame 0x151254e0 kdb_reenter(1512552c,11057bf,1d2f46c,0,1a89241,...) at kdb_reenter+0x2a/frame 0x151254f0 trap(15125604,8,28,28,ffffffff,...) at trap+0xbe/frame 0x151255f8 calltrap() at PTDpde+0x4124/frame 0x151255f8 --- trap 0xc, eip = 0x1669589, esp = 0x15125644, ebp = 0x15125660 --- db_trace_thread(23cad380,ffffffff,a3e4,18777,23cad380,...) at db_trace_thread+0x29/frame 0x15125660 _db_stack_trace_all(10efe60,0,ffffffff,151256f8,1da1ad0,...) at _db_stack_trace_all+0xe9/frame 0x151256cc db_command(1da28f6,0,1da24e8,1da28f5,60,...) at db_command+0x297/frame 0x15125780 db_script_exec(1ffb798,0,15125828,1512581c,1da1ad0,...) at db_script_exec+0x168/frame 0x151257f0 db_command(16e0773,15125908,9d505d,16e0780,ffff0ff0,...) at db_command+0x297/frame 0x151258a4 db_command_loop(16e0780,ffff0ff0,151258cf,151258ce,9f18000,...) at db_command_loop+0x50/frame 0x151258b0 db_trap(3,ffff0ff0,7,0,1,...) at db_trap+0x10d/frame 0x15125908 kdb_trap(3,ffff0ff0,15125a50,1203ce8,88e,...) at kdb_trap+0x11e/frame 0x15125940 trap(15125a50,8,28,28,4,...) at trap+0x3d1/frame 0x15125a44 calltrap() at PTDpde+0x4124/frame 0x15125a44 --- trap 0x3, eip = 0x10efe60, esp = 0x15125a90, ebp = 0x15125aa0 --- kdb_alt_break_internal(0,15125acc,ea3577,2,1aff8888,...) at kdb_alt_break_internal+0xf0/frame 0x15125aa0 kdb_alt_break(2,1aff8888,1a3f113,0,40000,...) at kdb_alt_break+0x16/frame 0x15125aac uart_intr_rxready(1aff8800,13c88,be85d40,bfcfa80,15125af0,...) at uart_intr_rxready+0x87/frame 0x15125acc uart_intr(1aff8800,0,13c88,1,bfcfa80,...) at uart_intr+0x130/frame 0x15125b0c intr_event_handle(bfbea80,15125ba0,1f88f9c,9f75380,1,...) at intr_event_handle+0xa5/frame 0x15125b38 intr_execute_handlers(bff4130,15125ba0,3) at intr_execute_handlers+0xa5/frame 0x15125b70 lapic_handle_intr(32,15125ba0,8,28,28,...) at lapic_handle_intr+0x5e/frame 0x15125b90 Xapic_isr1_pti() at PTDpde+0x4bbf/frame 0x15125b90 --- interrupt, eip = 0x1698005, esp = 0x15125be0, ebp = 0x15125be0 --- acpi_cpu_c1(15125c34,16881d2,be85d50,0,1c8ae43,...) at acpi_cpu_c1+0x5/frame 0x15125be0 acpi_cpu_idle(1b196e03,0,1b196e03,15125c50,169860a,...) at acpi_cpu_idle+0x30b/frame 0x15125c20 cpu_idle_acpi(1b196e03,0,1f88f40,1,ffffffff,...) at cpu_idle_acpi+0x3f/frame 0x15125c34 cpu_idle(0,15125c80,1a83ce8,aea,1,...) at cpu_idle+0x9a/frame 0x15125c50 sched_idletd(0,15125ce8,1a7773c,407,0,...) at sched_idletd+0x236/frame 0x15125cac fork_exit(10d8c60,0,15125ce8,0,0,...) at fork_exit+0x7e/frame 0x15125cd4 fork_trampoline() at PTDpde+0x42da/frame 0x15125cd4 --- trap 0, eip = 0, esp = 0x15125d20, ebp = 0 --- (null)() at 0 Tracing command sh pid 21523 tid 107529 td 0x21a80a80 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(1a866b4,0,1d2f2b4,1d2f398,151254f8,...) at db_trace_self_wrapper+0x2a/frame 0x15125478 kdb_backtrace(1a86731,151254f8,151255f8,167fb2e,1512552c,...) at kdb_backtrace+0x2d/frame 0x151254e0 kdb_reenter(1512552c,11057bf,1d2f46c,0,1a89241,...) at kdb_reenter+0x2a/frame 0x151254f0 trap(15125604,8,28,28,ffffffff,...) at trap+0xbe/frame 0x151255f8 calltrap() at PTDpde+0x4124/frame 0x151255f8 --- trap 0xc, eip = 0x1669589, esp = 0x15125644, ebp = 0x15125660 --- db_trace_thread(21a80a80,ffffffff,5413,1a409,21a80a80,...) at db_trace_thread+0x29/frame 0x15125660 _db_stack_trace_all(10efe60,0,ffffffff,151256f8,1da1ad0,...) at _db_stack_trace_all+0xe9/frame 0x151256cc db_command(1da28f6,0,1da24e8,1da28f5,60,...) at db_command+0x297/frame 0x15125780 db_script_exec(1ffb798,0,15125828,1512581c,1da1ad0,...) at db_script_exec+0x168/frame 0x151257f0 db_command(16e0773,15125908,9d505d,16e0780,ffff0ff0,...) at db_command+0x297/frame 0x151258a4 db_command_loop(16e0780,ffff0ff0,151258cf,151258ce,9f18000,...) at db_command_loop+0x50/frame 0x151258b0 db_trap(3,ffff0ff0,7,0,1,...) at db_trap+0x10d/frame 0x15125908 kdb_trap(3,ffff0ff0,15125a50,1203ce8,88e,...) at kdb_trap+0x11e/frame 0x15125940 trap(15125a50,8,28,28,4,...) at trap+0x3d1/frame 0x15125a44 calltrap() at PTDpde+0x4124/frame 0x15125a44 --- trap 0x3, eip = 0x10efe60, esp = 0x15125a90, ebp = 0x15125aa0 --- kdb_alt_break_internal(0,15125acc,ea3577,2,1aff8888,...) at kdb_alt_break_internal+0xf0/frame 0x15125aa0 kdb_alt_break(2,1aff8888,1a3f113,0,40000,...) at kdb_alt_break+0x16/frame 0x15125aac uart_intr_rxready(1aff8800,13c88,be85d40,bfcfa80,15125af0,...) at uart_intr_rxready+0x87/frame 0x15125acc uart_intr(1aff8800,0,13c88,1,bfcfa80,...) at uart_intr+0x130/frame 0x15125b0c intr_event_handle(bfbea80,15125ba0,1f88f9c,9f75380,1,...) at intr_event_handle+0xa5/frame 0x15125b38 intr_execute_handlers(bff4130,15125ba0,3) at intr_execute_handlers+0xa5/frame 0x15125b70 lapic_handle_intr(32,15125ba0,8,28,28,...) at lapic_handle_intr+0x5e/frame 0x15125b90 Xapic_isr1_pti() at PTDpde+0x4bbf/frame 0x15125b90 --- interrupt, eip = 0x1698005, esp = 0x15125be0, ebp = 0x15125be0 --- acpi_cpu_c1(15125c34,16881d2,be85d50,0,1c8ae43,...) at acpi_cpu_c1+0x5/frame 0x15125be0 acpi_cpu_idle(1b196e03,0,1b196e03,15125c50,169860a,...) at acpi_cpu_idle+0x30b/frame 0x15125c20 cpu_idle_acpi(1b196e03,0,1f88f40,1,ffffffff,...) at cpu_idle_acpi+0x3f/frame 0x15125c34 cpu_idle(0,15125c80,1a83ce8,aea,1,...) at cpu_idle+0x9a/frame 0x15125c50 sched_idletd(0,15125ce8,1a7773c,407,0,...) at sched_idletd+0x236/frame 0x15125cac fork_exit(10d8c60,0,15125ce8,0,0,...) at fork_exit+0x7e/frame 0x15125cd4 fork_trampoline() at PTDpde+0x42da/frame 0x15125cd4 --- trap 0, eip = 0, esp = 0x15125d20, ebp = 0 --- (null)() at 0 Tracing command tee pid 21522 tid 107548 td 0x207cea80 sched_switch(207cea80,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x6a1769a8 mi_switch(104,0,1a886b5,22b,207cea80,...) at mi_switch+0x1f3/frame 0x6a1769e8 sleepq_switch(207cea80,0,1a886b5,1ca,5c,...) at sleepq_switch+0x110/frame 0x6a176a1c sleepq_catch_signals(0,1a886b5,178,1f97f14,207cea80,...) at sleepq_catch_signals+0x360/frame 0x6a176a60 sleepq_wait_sig(234e26a0,5c,1a8c1b5,100,0,...) at sleepq_wait_sig+0x14/frame 0x6a176a84 _sleep(234e26a0,234e2830,15c,1a8c1b5,0,...) at _sleep+0x386/frame 0x6a176ad8 pipe_read(275c8f18,6a176bb8,24880c00,0,207cea80,...) at pipe_read+0x49b/frame 0x6a176b18 dofileread(275c8f18,6a176bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0x6a176b48 kern_readv(207cea80,0,6a176bb8,1b737760,28447000,...) at kern_readv+0x93/frame 0x6a176b98 sys_read(207cea80,207ced04,1a7717b,4,1c8ae43,...) at sys_read+0x54/frame 0x6a176be8 syscall(6a176ce8,3b,3b,3b,ffbfe844,...) at syscall+0x6ee/frame 0x6a176cdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x6a176cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281fe08f, esp = 0xffbfe784, ebp = 0xffbfe798 --- _end() at 0x281fe08f Tracing command sh pid 21521 tid 100756 td 0x221eda80 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(1a866b4,0,1d2f2b4,1d2f398,151254f8,...) at db_trace_self_wrapper+0x2a/frame 0x15125478 kdb_backtrace(1a86731,151254f8,151255f8,167fb2e,1512552c,...) at kdb_backtrace+0x2d/frame 0x151254e0 kdb_reenter(1512552c,11057bf,1d2f46c,0,1a89241,...) at kdb_reenter+0x2a/frame 0x151254f0 trap(15125604,8,28,28,ffffffff,...) at trap+0xbe/frame 0x151255f8 calltrap() at PTDpde+0x4124/frame 0x151255f8 --- trap 0xc, eip = 0x1669589, esp = 0x15125644, ebp = 0x15125660 --- db_trace_thread(221eda80,ffffffff,5411,18994,221eda80,...) at db_trace_thread+0x29/frame 0x15125660 _db_stack_trace_all(10efe60,0,ffffffff,151256f8,1da1ad0,...) at _db_stack_trace_all+0xe9/frame 0x151256cc db_command(1da28f6,0,1da24e8,1da28f5,60,...) at db_command+0x297/frame 0x15125780 db_script_exec(1ffb798,0,15125828,1512581c,1da1ad0,...) at db_script_exec+0x168/frame 0x151257f0 db_command(16e0773,15125908,9d505d,16e0780,ffff0ff0,...) at db_command+0x297/frame 0x151258a4 db_command_loop(16e0780,ffff0ff0,151258cf,151258ce,9f18000,...) at db_command_loop+0x50/frame 0x151258b0 db_trap(3,ffff0ff0,7,0,1,...) at db_trap+0x10d/frame 0x15125908 kdb_trap(3,ffff0ff0,15125a50,1203ce8,88e,...) at kdb_trap+0x11e/frame 0x15125940 trap(15125a50,8,28,28,4,...) at trap+0x3d1/frame 0x15125a44 calltrap() at PTDpde+0x4124/frame 0x15125a44 --- trap 0x3, eip = 0x10efe60, esp = 0x15125a90, ebp = 0x15125aa0 --- kdb_alt_break_internal(0,15125acc,ea3577,2,1aff8888,...) at kdb_alt_break_internal+0xf0/frame 0x15125aa0 kdb_alt_break(2,1aff8888,1a3f113,0,40000,...) at kdb_alt_break+0x16/frame 0x15125aac uart_intr_rxready(1aff8800,13c88,be85d40,bfcfa80,15125af0,...) at uart_intr_rxready+0x87/frame 0x15125acc uart_intr(1aff8800,0,13c88,1,bfcfa80,...) at uart_intr+0x130/frame 0x15125b0c intr_event_handle(bfbea80,15125ba0,1f88f9c,9f75380,1,...) at intr_event_handle+0xa5/frame 0x15125b38 intr_execute_handlers(bff4130,15125ba0,3) at intr_execute_handlers+0xa5/frame 0x15125b70 lapic_handle_intr(32,15125ba0,8,28,28,...) at lapic_handle_intr+0x5e/frame 0x15125b90 Xapic_isr1_pti() at PTDpde+0x4bbf/frame 0x15125b90 --- interrupt, eip = 0x1698005, esp = 0x15125be0, ebp = 0x15125be0 --- acpi_cpu_c1(15125c34,16881d2,be85d50,0,1c8ae43,...) at acpi_cpu_c1+0x5/frame 0x15125be0 acpi_cpu_idle(1b196e03,0,1b196e03,15125c50,169860a,...) at acpi_cpu_idle+0x30b/frame 0x15125c20 cpu_idle_acpi(1b196e03,0,1f88f40,1,ffffffff,...) at cpu_idle_acpi+0x3f/frame 0x15125c34 cpu_idle(0,15125c80,1a83ce8,aea,1,...) at cpu_idle+0x9a/frame 0x15125c50 sched_idletd(0,15125ce8,1a7773c,407,0,...) at sched_idletd+0x236/frame 0x15125cac fork_exit(10d8c60,0,15125ce8,0,0,...) at fork_exit+0x7e/frame 0x15125cd4 fork_trampoline() at PTDpde+0x42da/frame 0x15125cd4 --- trap 0, eip = 0, esp = 0x15125d20, ebp = 0 --- (null)() at 0 Tracing command watchdogd pid 38201 tid 106673 td 0x21fc2380 sched_switch(21fc2380,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x66d4d9f0 mi_switch(104,0,1a886b5,22b,21fc2380,...) at mi_switch+0x1f3/frame 0x66d4da30 sleepq_switch(21fc2380,0,1a886b5,1ca,6c,...) at sleepq_switch+0x110/frame 0x66d4da64 sleepq_catch_signals(21fc2380,1,601,66d4dae4,13c99,...) at sleepq_catch_signals+0x360/frame 0x66d4daa8 sleepq_timedwait_sig(1f7a8bd,6c,13c99,c0000000,3,...) at sleepq_timedwait_sig+0x17/frame 0x66d4dae4 _sleep(1f7a8bd,0,16c,1a82949,df4e4607,...) at _sleep+0x31a/frame 0x66d4db38 kern_clock_nanosleep(21fc2380,0,0,66d4dbc8,66d4dbc0,...) at kern_clock_nanosleep+0x1e2/frame 0x66d4dba0 sys_nanosleep(21fc2380,21fc2604,1a7717b,4,0,...) at sys_nanosleep+0x7f/frame 0x66d4dbe8 syscall(66d4dce8,3b,3b,3b,3c,...) at syscall+0x6ee/frame 0x66d4dcdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x66d4dcdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x281a30c3, esp = 0xffbfec64, ebp = 0xffbfec98 --- _end() at 0x281a30c3 Tracing command sh pid 3421 tid 100214 td 0x21a79000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(1a866b4,0,1d2f2b4,1d2f398,151254f8,...) at db_trace_self_wrapper+0x2a/frame 0x15125478 kdb_backtrace(1a86731,151254f8,151255f8,167fb2e,1512552c,...) at kdb_backtrace+0x2d/frame 0x151254e0 kdb_reenter(1512552c,11057bf,1d2f46c,0,1a89241,...) at kdb_reenter+0x2a/frame 0x151254f0 trap(15125604,8,28,28,ffffffff,...) at trap+0xbe/frame 0x151255f8 calltrap() at PTDpde+0x4124/frame 0x151255f8 --- trap 0xc, eip = 0x1669589, esp = 0x15125644, ebp = 0x15125660 --- db_trace_thread(21a79000,ffffffff,d5d,18776,21a79000,...) at db_trace_thread+0x29/frame 0x15125660 _db_stack_trace_all(10efe60,0,ffffffff,151256f8,1da1ad0,...) at _db_stack_trace_all+0xe9/frame 0x151256cc db_command(1da28f6,0,1da24e8,1da28f5,60,...) at db_command+0x297/frame 0x15125780 db_script_exec(1ffb798,0,15125828,1512581c,1da1ad0,...) at db_script_exec+0x168/frame 0x151257f0 db_command(16e0773,15125908,9d505d,16e0780,ffff0ff0,...) at db_command+0x297/frame 0x151258a4 db_command_loop(16e0780,ffff0ff0,151258cf,151258ce,9f18000,...) at db_command_loop+0x50/frame 0x151258b0 db_trap(3,ffff0ff0,7,0,1,...) at db_trap+0x10d/frame 0x15125908 kdb_trap(3,ffff0ff0,15125a50,1203ce8,88e,...) at kdb_trap+0x11e/frame 0x15125940 trap(15125a50,8,28,28,4,...) at trap+0x3d1/frame 0x15125a44 calltrap() at PTDpde+0x4124/frame 0x15125a44 --- trap 0x3, eip = 0x10efe60, esp = 0x15125a90, ebp = 0x15125aa0 --- kdb_alt_break_internal(0,15125acc,ea3577,2,1aff8888,...) at kdb_alt_break_internal+0xf0/frame 0x15125aa0 kdb_alt_break(2,1aff8888,1a3f113,0,40000,...) at kdb_alt_break+0x16/frame 0x15125aac uart_intr_rxready(1aff8800,13c88,be85d40,bfcfa80,15125af0,...) at uart_intr_rxready+0x87/frame 0x15125acc uart_intr(1aff8800,0,13c88,1,bfcfa80,...) at uart_intr+0x130/frame 0x15125b0c intr_event_handle(bfbea80,15125ba0,1f88f9c,9f75380,1,...) at intr_event_handle+0xa5/frame 0x15125b38 intr_execute_handlers(bff4130,15125ba0,3) at intr_execute_handlers+0xa5/frame 0x15125b70 lapic_handle_intr(32,15125ba0,8,28,28,...) at lapic_handle_intr+0x5e/frame 0x15125b90 Xapic_isr1_pti() at PTDpde+0x4bbf/frame 0x15125b90 --- interrupt, eip = 0x1698005, esp = 0x15125be0, ebp = 0x15125be0 --- acpi_cpu_c1(15125c34,16881d2,be85d50,0,1c8ae43,...) at acpi_cpu_c1+0x5/frame 0x15125be0 acpi_cpu_idle(1b196e03,0,1b196e03,15125c50,169860a,...) at acpi_cpu_idle+0x30b/frame 0x15125c20 cpu_idle_acpi(1b196e03,0,1f88f40,1,ffffffff,...) at cpu_idle_acpi+0x3f/frame 0x15125c34 cpu_idle(0,15125c80,1a83ce8,aea,1,...) at cpu_idle+0x9a/frame 0x15125c50 sched_idletd(0,15125ce8,1a7773c,407,0,...) at sched_idletd+0x236/frame 0x15125cac fork_exit(10d8c60,0,15125ce8,0,0,...) at fork_exit+0x7e/frame 0x15125cd4 fork_trampoline() at PTDpde+0x42da/frame 0x15125cd4 --- trap 0, eip = 0, esp = 0x15125d20, ebp = 0 --- (null)() at 0 Tracing command sh pid 1078 tid 100195 td 0x20fcd380 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(1a866b4,0,1d2f2b4,1d2f398,151254f8,...) at db_trace_self_wrapper+0x2a/frame 0x15125478 kdb_backtrace(1a86731,151254f8,151255f8,167fb2e,1512552c,...) at kdb_backtrace+0x2d/frame 0x151254e0 kdb_reenter(1512552c,11057bf,1d2f46c,0,1a89241,...) at kdb_reenter+0x2a/frame 0x151254f0 trap(15125604,8,28,28,ffffffff,...) at trap+0xbe/frame 0x151255f8 calltrap() at PTDpde+0x4124/frame 0x151255f8 --- trap 0xc, eip = 0x1669589, esp = 0x15125644, ebp = 0x15125660 --- db_trace_thread(20fcd380,ffffffff,436,18763,20fcd380,...) at db_trace_thread+0x29/frame 0x15125660 _db_stack_trace_all(10efe60,0,ffffffff,151256f8,1da1ad0,...) at _db_stack_trace_all+0xe9/frame 0x151256cc db_command(1da28f6,0,1da24e8,1da28f5,60,...) at db_command+0x297/frame 0x15125780 db_script_exec(1ffb798,0,15125828,1512581c,1da1ad0,...) at db_script_exec+0x168/frame 0x151257f0 db_command(16e0773,15125908,9d505d,16e0780,ffff0ff0,...) at db_command+0x297/frame 0x151258a4 db_command_loop(16e0780,ffff0ff0,151258cf,151258ce,9f18000,...) at db_command_loop+0x50/frame 0x151258b0 db_trap(3,ffff0ff0,7,0,1,...) at db_trap+0x10d/frame 0x15125908 kdb_trap(3,ffff0ff0,15125a50,1203ce8,88e,...) at kdb_trap+0x11e/frame 0x15125940 trap(15125a50,8,28,28,4,...) at trap+0x3d1/frame 0x15125a44 calltrap() at PTDpde+0x4124/frame 0x15125a44 --- trap 0x3, eip = 0x10efe60, esp = 0x15125a90, ebp = 0x15125aa0 --- kdb_alt_break_internal(0,15125acc,ea3577,2,1aff8888,...) at kdb_alt_break_internal+0xf0/frame 0x15125aa0 kdb_alt_break(2,1aff8888,1a3f113,0,40000,...) at kdb_alt_break+0x16/frame 0x15125aac uart_intr_rxready(1aff8800,13c88,be85d40,bfcfa80,15125af0,...) at uart_intr_rxready+0x87/frame 0x15125acc uart_intr(1aff8800,0,13c88,1,bfcfa80,...) at uart_intr+0x130/frame 0x15125b0c intr_event_handle(bfbea80,15125ba0,1f88f9c,9f75380,1,...) at intr_event_handle+0xa5/frame 0x15125b38 intr_execute_handlers(bff4130,15125ba0,3) at intr_execute_handlers+0xa5/frame 0x15125b70 lapic_handle_intr(32,15125ba0,8,28,28,...) at lapic_handle_intr+0x5e/frame 0x15125b90 Xapic_isr1_pti() at PTDpde+0x4bbf/frame 0x15125b90 --- interrupt, eip = 0x1698005, esp = 0x15125be0, ebp = 0x15125be0 --- acpi_cpu_c1(15125c34,16881d2,be85d50,0,1c8ae43,...) at acpi_cpu_c1+0x5/frame 0x15125be0 acpi_cpu_idle(1b196e03,0,1b196e03,15125c50,169860a,...) at acpi_cpu_idle+0x30b/frame 0x15125c20 cpu_idle_acpi(1b196e03,0,1f88f40,1,ffffffff,...) at cpu_idle_acpi+0x3f/frame 0x15125c34 cpu_idle(0,15125c80,1a83ce8,aea,1,...) at cpu_idle+0x9a/frame 0x15125c50 sched_idletd(0,15125ce8,1a7773c,407,0,...) at sched_idletd+0x236/frame 0x15125cac fork_exit(10d8c60,0,15125ce8,0,0,...) at fork_exit+0x7e/frame 0x15125cd4 fork_trampoline() at PTDpde+0x42da/frame 0x15125cd4 --- trap 0, eip = 0, esp = 0x15125d20, ebp = 0 --- (null)() at 0 Tracing command sh pid 1074 tid 100187 td 0x1f5a5a80 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(1a866b4,0,1d2f2b4,1d2f398,151254f8,...) at db_trace_self_wrapper+0x2a/frame 0x15125478 kdb_backtrace(1a86731,151254f8,151255f8,167fb2e,1512552c,...) at kdb_backtrace+0x2d/frame 0x151254e0 kdb_reenter(1512552c,11057bf,1d2f46c,0,1a89241,...) at kdb_reenter+0x2a/frame 0x151254f0 trap(15125604,8,28,28,ffffffff,...) at trap+0xbe/frame 0x151255f8 calltrap() at PTDpde+0x4124/frame 0x151255f8 --- trap 0xc, eip = 0x1669589, esp = 0x15125644, ebp = 0x15125660 --- db_trace_thread(1f5a5a80,ffffffff,432,1875b,1f5a5a80,...) at db_trace_thread+0x29/frame 0x15125660 _db_stack_trace_all(10efe60,0,ffffffff,151256f8,1da1ad0,...) at _db_stack_trace_all+0xe9/frame 0x151256cc db_command(1da28f6,0,1da24e8,1da28f5,60,...) at db_command+0x297/frame 0x15125780 db_script_exec(1ffb798,0,15125828,1512581c,1da1ad0,...) at db_script_exec+0x168/frame 0x151257f0 db_command(16e0773,15125908,9d505d,16e0780,ffff0ff0,...) at db_command+0x297/frame 0x151258a4 db_command_loop(16e0780,ffff0ff0,151258cf,151258ce,9f18000,...) at db_command_loop+0x50/frame 0x151258b0 db_trap(3,ffff0ff0,7,0,1,...) at db_trap+0x10d/frame 0x15125908 kdb_trap(3,ffff0ff0,15125a50,1203ce8,88e,...) at kdb_trap+0x11e/frame 0x15125940 trap(15125a50,8,28,28,4,...) at trap+0x3d1/frame 0x15125a44 calltrap() at PTDpde+0x4124/frame 0x15125a44 --- trap 0x3, eip = 0x10efe60, esp = 0x15125a90, ebp = 0x15125aa0 --- kdb_alt_break_internal(0,15125acc,ea3577,2,1aff8888,...) at kdb_alt_break_internal+0xf0/frame 0x15125aa0 kdb_alt_break(2,1aff8888,1a3f113,0,40000,...) at kdb_alt_break+0x16/frame 0x15125aac uart_intr_rxready(1aff8800,13c88,be85d40,bfcfa80,15125af0,...) at uart_intr_rxready+0x87/frame 0x15125acc uart_intr(1aff8800,0,13c88,1,bfcfa80,...) at uart_intr+0x130/frame 0x15125b0c intr_event_handle(bfbea80,15125ba0,1f88f9c,9f75380,1,...) at intr_event_handle+0xa5/frame 0x15125b38 intr_execute_handlers(bff4130,15125ba0,3) at intr_execute_handlers+0xa5/frame 0x15125b70 lapic_handle_intr(32,15125ba0,8,28,28,...) at lapic_handle_intr+0x5e/frame 0x15125b90 Xapic_isr1_pti() at PTDpde+0x4bbf/frame 0x15125b90 --- interrupt, eip = 0x1698005, esp = 0x15125be0, ebp = 0x15125be0 --- acpi_cpu_c1(15125c34,16881d2,be85d50,0,1c8ae43,...) at acpi_cpu_c1+0x5/frame 0x15125be0 acpi_cpu_idle(1b196e03,0,1b196e03,15125c50,169860a,...) at acpi_cpu_idle+0x30b/frame 0x15125c20 cpu_idle_acpi(1b196e03,0,1f88f40,1,ffffffff,...) at cpu_idle_acpi+0x3f/frame 0x15125c34 cpu_idle(0,15125c80,1a83ce8,aea,1,...) at cpu_idle+0x9a/frame 0x15125c50 sched_idletd(0,15125ce8,1a7773c,407,0,...) at sched_idletd+0x236/frame 0x15125cac fork_exit(10d8c60,0,15125ce8,0,0,...) at fork_exit+0x7e/frame 0x15125cd4 fork_trampoline() at PTDpde+0x42da/frame 0x15125cd4 --- trap 0, eip = 0, esp = 0x15125d20, ebp = 0 --- (null)() at 0 Tracing command tail pid 1073 tid 100123 td 0x1f4a4380 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(1a866b4,0,1d2f2b4,1d2f398,151254f8,...) at db_trace_self_wrapper+0x2a/frame 0x15125478 kdb_backtrace(1a86731,151254f8,151255f8,167fb2e,1512552c,...) at kdb_backtrace+0x2d/frame 0x151254e0 kdb_reenter(1512552c,11057bf,1d2f46c,0,1a89241,...) at kdb_reenter+0x2a/frame 0x151254f0 trap(15125604,8,28,28,ffffffff,...) at trap+0xbe/frame 0x151255f8 calltrap() at PTDpde+0x4124/frame 0x151255f8 --- trap 0xc, eip = 0x1669589, esp = 0x15125644, ebp = 0x15125660 --- db_trace_thread(1f4a4380,ffffffff,431,1871b,1f4a4380,...) at db_trace_thread+0x29/frame 0x15125660 _db_stack_trace_all(10efe60,0,ffffffff,151256f8,1da1ad0,...) at _db_stack_trace_all+0xe9/frame 0x151256cc db_command(1da28f6,0,1da24e8,1da28f5,60,...) at db_command+0x297/frame 0x15125780 db_script_exec(1ffb798,0,15125828,1512581c,1da1ad0,...) at db_script_exec+0x168/frame 0x151257f0 db_command(16e0773,15125908,9d505d,16e0780,ffff0ff0,...) at db_command+0x297/frame 0x151258a4 db_command_loop(16e0780,ffff0ff0,151258cf,151258ce,9f18000,...) at db_command_loop+0x50/frame 0x151258b0 db_trap(3,ffff0ff0,7,0,1,...) at db_trap+0x10d/frame 0x15125908 kdb_trap(3,ffff0ff0,15125a50,1203ce8,88e,...) at kdb_trap+0x11e/frame 0x15125940 trap(15125a50,8,28,28,4,...) at trap+0x3d1/frame 0x15125a44 calltrap() at PTDpde+0x4124/frame 0x15125a44 --- trap 0x3, eip = 0x10efe60, esp = 0x15125a90, ebp = 0x15125aa0 --- kdb_alt_break_internal(0,15125acc,ea3577,2,1aff8888,...) at kdb_alt_break_internal+0xf0/frame 0x15125aa0 kdb_alt_break(2,1aff8888,1a3f113,0,40000,...) at kdb_alt_break+0x16/frame 0x15125aac uart_intr_rxready(1aff8800,13c88,be85d40,bfcfa80,15125af0,...) at uart_intr_rxready+0x87/frame 0x15125acc uart_intr(1aff8800,0,13c88,1,bfcfa80,...) at uart_intr+0x130/frame 0x15125b0c intr_event_handle(bfbea80,15125ba0,1f88f9c,9f75380,1,...) at intr_event_handle+0xa5/frame 0x15125b38 intr_execute_handlers(bff4130,15125ba0,3) at intr_execute_handlers+0xa5/frame 0x15125b70 lapic_handle_intr(32,15125ba0,8,28,28,...) at lapic_handle_intr+0x5e/frame 0x15125b90 Xapic_isr1_pti() at PTDpde+0x4bbf/frame 0x15125b90 --- interrupt, eip = 0x1698005, esp = 0x15125be0, ebp = 0x15125be0 --- acpi_cpu_c1(15125c34,16881d2,be85d50,0,1c8ae43,...) at acpi_cpu_c1+0x5/frame 0x15125be0 acpi_cpu_idle(1b196e03,0,1b196e03,15125c50,169860a,...) at acpi_cpu_idle+0x30b/frame 0x15125c20 cpu_idle_acpi(1b196e03,0,1f88f40,1,ffffffff,...) at cpu_idle_acpi+0x3f/frame 0x15125c34 cpu_idle(0,15125c80,1a83ce8,aea,1,...) at cpu_idle+0x9a/frame 0x15125c50 sched_idletd(0,15125ce8,1a7773c,407,0,...) at sched_idletd+0x236/frame 0x15125cac fork_exit(10d8c60,0,15125ce8,0,0,...) at fork_exit+0x7e/frame 0x15125cd4 fork_trampoline() at PTDpde+0x42da/frame 0x15125cd4 --- trap 0, eip = 0, esp = 0x15125d20, ebp = 0 --- (null)() at 0 Tracing command getty pid 780 tid 100165 td 0x1f632380 sched_switch(1f632380,0,104,189,1f87b00,...) at sched_switch+0x80c/frame 0x1d718940 mi_switch(104,0,1a886b5,22b,1f632380,...) at mi_switch+0x1f3/frame 0x1d71897c sleepq_switch(1f632380,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1d7189b0 sleepq_catch_signals(1d718a18,1085670,9f6c614,0,0,...) at sleepq_catch_signals+0x360/frame 0x1d7189f4 sleepq_wait_sig(9f6c674,0,1d718a38,101,0,...) at sleepq_wait_sig+0x14/frame 0x1d718a18 _cv_wait_sig(9f6c674,9f6c604,1a8e741,5a9,1d718bb8,...) at _cv_wait_sig+0x21f/frame 0x1d718a5c tty_wait(9f6c600,9f6c674,1d718bb8,1,0,...) at tty_wait+0x4b/frame 0x1d718a80 ttydisc_read(9f6c600,1d718bb8,0,d1,1d4e09c,...) at ttydisc_read+0x238/frame 0x1d718ac0 ttydev_read(1b3edd00,1d718bb8,0,1f632380,1d718b6c,...) at ttydev_read+0x55/frame 0x1d718ae0 devfs_read_f(1ec98508,1d718bb8,1b543600,0,1f632380,...) at devfs_read_f+0xc5/frame 0x1d718b18 dofileread(1ec98508,1d718bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0x1d718b48 kern_readv(1f632380,0,1d718bb8,1d718be8,ffbfed61,...) at kern_readv+0x93/frame 0x1d718b98 sys_read(1f632380,1f632604,1a7717b,4,1c8ae43,...) at sys_read+0x54/frame 0x1d718be8 syscall(1d718ce8,3b,3b,3b,0,...) at syscall+0x6ee/frame 0x1d718cdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x1d718cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2821508f, esp = 0xffbfed34, ebp = 0xffbfed48 --- _end() at 0x2821508f Tracing command getty pid 779 tid 100177 td 0x1f5a3380 sched_switch(1f5a3380,0,104,189,1f881c0,...) at sched_switch+0x80c/frame 0x1d75a940 mi_switch(104,0,1a886b5,22b,1f5a3380,...) at mi_switch+0x1f3/frame 0x1d75a97c sleepq_switch(1f5a3380,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1d75a9b0 sleepq_catch_signals(1d75aa18,1085670,9f6c814,0,0,...) at sleepq_catch_signals+0x360/frame 0x1d75a9f4 sleepq_wait_sig(9f6c874,0,1d75aa38,101,0,...) at sleepq_wait_sig+0x14/frame 0x1d75aa18 _cv_wait_sig(9f6c874,9f6c804,1a8e741,5a9,1d75abb8,...) at _cv_wait_sig+0x21f/frame 0x1d75aa5c tty_wait(9f6c800,9f6c874,1d75abb8,1,0,...) at tty_wait+0x4b/frame 0x1d75aa80 ttydisc_read(9f6c800,1d75abb8,0,d1,1d4e09c,...) at ttydisc_read+0x238/frame 0x1d75aac0 ttydev_read(1b3ee000,1d75abb8,0,1f5a3380,1d75ab6c,...) at ttydev_read+0x55/frame 0x1d75aae0 devfs_read_f(1ec98540,1d75abb8,1b313b00,0,1f5a3380,...) at devfs_read_f+0xc5/frame 0x1d75ab18 dofileread(1ec98540,1d75abb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0x1d75ab48 kern_readv(1f5a3380,0,1d75abb8,1d75abe8,ffbfed61,...) at kern_readv+0x93/frame 0x1d75ab98 sys_read(1f5a3380,1f5a3604,1a7717b,4,77f43194,...) at sys_read+0x54/frame 0x1d75abe8 syscall(1d75ace8,3b,3b,3b,0,...) at syscall+0x6ee/frame 0x1d75acdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x1d75acdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2821508f, esp = 0xffbfed34, ebp = 0xffbfed48 --- _end() at 0x2821508f Tracing command getty pid 778 tid 100179 td 0x1f631a80 sched_switch(1f631a80,0,104,189,1f881c0,...) at sched_switch+0x80c/frame 0x1d764940 mi_switch(104,0,1a886b5,22b,1f631a80,...) at mi_switch+0x1f3/frame 0x1d76497c sleepq_switch(1f631a80,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1d7649b0 sleepq_catch_signals(1d764a18,1085670,9f6ca14,0,0,...) at sleepq_catch_signals+0x360/frame 0x1d7649f4 sleepq_wait_sig(9f6ca74,0,1d764a38,101,0,...) at sleepq_wait_sig+0x14/frame 0x1d764a18 _cv_wait_sig(9f6ca74,9f6ca04,1a8e741,5a9,1d764bb8,...) at _cv_wait_sig+0x21f/frame 0x1d764a5c tty_wait(9f6ca00,9f6ca74,1d764bb8,1,0,...) at tty_wait+0x4b/frame 0x1d764a80 ttydisc_read(9f6ca00,1d764bb8,0,d1,1d4e09c,...) at ttydisc_read+0x238/frame 0x1d764ac0 ttydev_read(1b3ee200,1d764bb8,0,1f631a80,1d764b6c,...) at ttydev_read+0x55/frame 0x1d764ae0 devfs_read_f(1ec47e38,1d764bb8,1b313c00,0,1f631a80,...) at devfs_read_f+0xc5/frame 0x1d764b18 dofileread(1ec47e38,1d764bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0x1d764b48 kern_readv(1f631a80,0,1d764bb8,1d764be8,ffbfed61,...) at kern_readv+0x93/frame 0x1d764b98 sys_read(1f631a80,1f631d04,1a7717b,4,1c8ae43,...) at sys_read+0x54/frame 0x1d764be8 syscall(1d764ce8,3b,3b,3b,0,...) at syscall+0x6ee/frame 0x1d764cdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x1d764cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2821508f, esp = 0xffbfed34, ebp = 0xffbfed48 --- _end() at 0x2821508f Tracing command getty pid 777 tid 100184 td 0x1f630700 sched_switch(1f630700,0,104,189,1f881c0,...) at sched_switch+0x80c/frame 0x1d77d940 mi_switch(104,0,1a886b5,22b,1f630700,...) at mi_switch+0x1f3/frame 0x1d77d97c sleepq_switch(1f630700,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1d77d9b0 sleepq_catch_signals(1d77da18,1085670,9f6cc14,0,0,...) at sleepq_catch_signals+0x360/frame 0x1d77d9f4 sleepq_wait_sig(9f6cc74,0,1d77da38,101,0,...) at sleepq_wait_sig+0x14/frame 0x1d77da18 _cv_wait_sig(9f6cc74,9f6cc04,1a8e741,5a9,1d77dbb8,...) at _cv_wait_sig+0x21f/frame 0x1d77da5c tty_wait(9f6cc00,9f6cc74,1d77dbb8,1,0,...) at tty_wait+0x4b/frame 0x1d77da80 ttydisc_read(9f6cc00,1d77dbb8,0,d1,1d4e09c,...) at ttydisc_read+0x238/frame 0x1d77dac0 ttydev_read(1b3ee400,1d77dbb8,0,1f630700,1d77db6c,...) at ttydev_read+0x55/frame 0x1d77dae0 devfs_read_f(1ec47d58,1d77dbb8,bf8d000,0,1f630700,...) at devfs_read_f+0xc5/frame 0x1d77db18 dofileread(1ec47d58,1d77dbb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0x1d77db48 kern_readv(1f630700,0,1d77dbb8,1d77dbe8,ffbfed61,...) at kern_readv+0x93/frame 0x1d77db98 sys_read(1f630700,1f630984,1a7717b,4,77f43194,...) at sys_read+0x54/frame 0x1d77dbe8 syscall(1d77dce8,3b,3b,3b,0,...) at syscall+0x6ee/frame 0x1d77dcdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x1d77dcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2821508f, esp = 0xffbfed34, ebp = 0xffbfed48 --- _end() at 0x2821508f Tracing command getty pid 776 tid 100183 td 0x1f630a80 sched_switch(1f630a80,0,104,189,1f87b00,...) at sched_switch+0x80c/frame 0x1d778940 mi_switch(104,0,1a886b5,22b,1f630a80,...) at mi_switch+0x1f3/frame 0x1d77897c sleepq_switch(1f630a80,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1d7789b0 sleepq_catch_signals(1d778a18,1085670,9f6ce14,0,0,...) at sleepq_catch_signals+0x360/frame 0x1d7789f4 sleepq_wait_sig(9f6ce74,0,1d778a38,101,0,...) at sleepq_wait_sig+0x14/frame 0x1d778a18 _cv_wait_sig(9f6ce74,9f6ce04,1a8e741,5a9,1d778bb8,...) at _cv_wait_sig+0x21f/frame 0x1d778a5c tty_wait(9f6ce00,9f6ce74,1d778bb8,1,0,...) at tty_wait+0x4b/frame 0x1d778a80 ttydisc_read(9f6ce00,1d778bb8,0,d1,1d4e09c,...) at ttydisc_read+0x238/frame 0x1d778ac0 ttydev_read(1b3ee600,1d778bb8,0,1f630a80,1d778b6c,...) at ttydev_read+0x55/frame 0x1d778ae0 devfs_read_f(1ec47cb0,1d778bb8,1b313d00,0,1f630a80,...) at devfs_read_f+0xc5/frame 0x1d778b18 dofileread(1ec47cb0,1d778bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0x1d778b48 kern_readv(1f630a80,0,1d778bb8,1d778be8,ffbfed61,...) at kern_readv+0x93/frame 0x1d778b98 sys_read(1f630a80,1f630d04,1a7717b,4,1c8ae43,...) at sys_read+0x54/frame 0x1d778be8 syscall(1d778ce8,3b,3b,3b,0,...) at syscall+0x6ee/frame 0x1d778cdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x1d778cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2821508f, esp = 0xffbfed34, ebp = 0xffbfed48 --- _end() at 0x2821508f Tracing command getty pid 775 tid 100182 td 0x1f631000 sched_switch(1f631000,0,104,189,1f881c0,...) at sched_switch+0x80c/frame 0x1d773940 mi_switch(104,0,1a886b5,22b,1f631000,...) at mi_switch+0x1f3/frame 0x1d77397c sleepq_switch(1f631000,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1d7739b0 sleepq_catch_signals(1d773a18,1085670,9f6d014,0,0,...) at sleepq_catch_signals+0x360/frame 0x1d7739f4 sleepq_wait_sig(9f6d074,0,1d773a38,101,0,...) at sleepq_wait_sig+0x14/frame 0x1d773a18 _cv_wait_sig(9f6d074,9f6d004,1a8e741,5a9,1d773bb8,...) at _cv_wait_sig+0x21f/frame 0x1d773a5c tty_wait(9f6d000,9f6d074,1d773bb8,1,0,...) at tty_wait+0x4b/frame 0x1d773a80 ttydisc_read(9f6d000,1d773bb8,0,d1,1d4e09c,...) at ttydisc_read+0x238/frame 0x1d773ac0 ttydev_read(1b3ee800,1d773bb8,0,1f631000,1d773b6c,...) at ttydev_read+0x55/frame 0x1d773ae0 devfs_read_f(1ec47ce8,1d773bb8,bf8d100,0,1f631000,...) at devfs_read_f+0xc5/frame 0x1d773b18 dofileread(1ec47ce8,1d773bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0x1d773b48 kern_readv(1f631000,0,1d773bb8,1d773be8,ffbfed61,...) at kern_readv+0x93/frame 0x1d773b98 sys_read(1f631000,1f631284,1a7717b,4,1d773c48,...) at sys_read+0x54/frame 0x1d773be8 syscall(1d773ce8,3b,3b,3b,0,...) at syscall+0x6ee/frame 0x1d773cdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x1d773cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2821508f, esp = 0xffbfed34, ebp = 0xffbfed48 --- _end() at 0x2821508f Tracing command getty pid 774 tid 100103 td 0x9f74000 sched_switch(9f74000,0,104,189,1f88880,...) at sched_switch+0x80c/frame 0x1eaa4940 mi_switch(104,0,1a886b5,22b,9f74000,...) at mi_switch+0x1f3/frame 0x1eaa497c sleepq_switch(9f74000,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1eaa49b0 sleepq_catch_signals(1eaa4a18,1085670,9f6d214,0,0,...) at sleepq_catch_signals+0x360/frame 0x1eaa49f4 sleepq_wait_sig(9f6d274,0,1eaa4a38,101,0,...) at sleepq_wait_sig+0x14/frame 0x1eaa4a18 _cv_wait_sig(9f6d274,9f6d204,1a8e741,5a9,1eaa4bb8,...) at _cv_wait_sig+0x21f/frame 0x1eaa4a5c tty_wait(9f6d200,9f6d274,1eaa4bb8,1,0,...) at tty_wait+0x4b/frame 0x1eaa4a80 ttydisc_read(9f6d200,1eaa4bb8,0,d1,1d4e09c,...) at ttydisc_read+0x238/frame 0x1eaa4ac0 ttydev_read(1b3eea00,1eaa4bb8,0,9f74000,1eaa4b6c,...) at ttydev_read+0x55/frame 0x1eaa4ae0 devfs_read_f(1ec98460,1eaa4bb8,1b543700,0,9f74000,...) at devfs_read_f+0xc5/frame 0x1eaa4b18 dofileread(1ec98460,1eaa4bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0x1eaa4b48 kern_readv(9f74000,0,1eaa4bb8,1eaa4be8,ffbfed61,...) at kern_readv+0x93/frame 0x1eaa4b98 sys_read(9f74000,9f74284,1a7717b,4,1c8ae43,...) at sys_read+0x54/frame 0x1eaa4be8 syscall(1eaa4ce8,3b,3b,3b,0,...) at syscall+0x6ee/frame 0x1eaa4cdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x1eaa4cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2821508f, esp = 0xffbfed34, ebp = 0xffbfed48 --- _end() at 0x2821508f Tracing command inetd pid 757 tid 100178 td 0x1f5a3000 sched_switch(1f5a3000,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1d75f8b0 mi_switch(104,0,1a886b5,22b,1f5a3000,...) at mi_switch+0x1f3/frame 0x1d75f8f0 sleepq_switch(1f5a3000,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1d75f924 sleepq_catch_signals(1d75f98c,1085670,1b1f3c60,0,0,...) at sleepq_catch_signals+0x360/frame 0x1d75f968 sleepq_wait_sig(1b1f3c64,0,1d75f9ac,101,0,...) at sleepq_wait_sig+0x14/frame 0x1d75f98c _cv_wait_sig(1b1f3c64,1b1f3c50,1a8bf2f,73c,200ca800,...) at _cv_wait_sig+0x21f/frame 0x1d75f9d0 seltdwait(ffffffff,0,0,1f5a3000,0,...) at seltdwait+0xbb/frame 0x1d75fa00 kern_select(1f5a3000,9,ffbfe5c0,0,0,...) at kern_select+0x876/frame 0x1d75fba0 sys_select(1f5a3000,1f5a3284,1a7717b,4,1d75fc28,...) at sys_select+0x68/frame 0x1d75fbe8 syscall(1d75fce8,3b,3b,3b,0,...) at syscall+0x6ee/frame 0x1d75fcdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x1d75fcdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2822807f, esp = 0xffbfdfec, ebp = 0xffbfe010 --- _end() at 0x2822807f Tracing command nfscbd pid 723 tid 100173 td 0x1f5a3700 sched_switch(1f5a3700,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1d7467e8 mi_switch(104,0,1a886b5,22b,1f5a3700,...) at mi_switch+0x1f3/frame 0x1d746828 sleepq_switch(1f5a3700,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1d74685c sleepq_catch_signals(8,1a7cce7,cb,1f5a3700,1f5a3700,...) at sleepq_catch_signals+0x360/frame 0x1d7468a0 sleepq_timedwait_sig(1b2fa4d0,0,1d746904,0,0,...) at sleepq_timedwait_sig+0x17/frame 0x1d7468e0 _cv_timedwait_sig_sbt(1b2fa4d0,1af740c0,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x24a/frame 0x1d746928 svc_run_internal(1365e00,1af740c0,1b73535c,1d746a30,0,...) at svc_run_internal+0xb2c/frame 0x1d746a04 svc_run(1af74000,0,1a63ae2,f5,1,...) at svc_run+0x1ed/frame 0x1d746a58 nfscbd_nfsd(1f5a3700,1d746b30,4,ffbfeae0,1d746b44,...) at nfscbd_nfsd+0x105/frame 0x1d746af8 nfssvc_nfscl(1f5a3700,1f5a3984,0,1f5a3700,1d746cdc,...) at nfssvc_nfscl+0x279/frame 0x1d746bd0 sys_nfssvc(1f5a3700,1f5a3984,1a7717b,4,1d746c48,...) at sys_nfssvc+0xa6/frame 0x1d746be8 syscall(1d746ce8,3b,3b,3b,1,...) at syscall+0x6ee/frame 0x1d746cdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x1d746cdc --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280c10bf, esp = 0xffbfeb0c, ebp = 0xffbfee28 --- _end() at 0x280c10bf Tracing command nfscbd pid 723 tid 100174 td 0x1f4a2000 sched_switch(1f4a2000,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1d74baa8 mi_switch(104,0,1a886b5,22b,1f4a2000,...) at mi_switch+0x1f3/frame 0x1d74bae8 sleepq_switch(1f4a2000,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1d74bb1c sleepq_catch_signals(1d74bb84,1085670,1af740d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1d74bb60 sleepq_wait_sig(bff5cd0,0,1d74bba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1d74bb84 _cv_wait_sig(bff5cd0,1af740c0,1ac69eb,439,0,...) at _cv_wait_sig+0x21f/frame 0x1d74bbc8 svc_run_internal(1d74bcd4,1065d9e,1af740c0,1d74bce8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1d74bca4 svc_thread_start(1af740c0,1d74bce8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1d74bcac fork_exit(1365e00,1af740c0,1d74bce8,3b,3b,...) at fork_exit+0x7e/frame 0x1d74bcd4 fork_trampoline() at PTDpde+0x42da/frame 0x1d74bcd4 --- trap 0x28222978, eip = 0, esp = 0x1d74bd20, ebp = 0x1 --- (null)() at 0 Tracing command nfscbd pid 723 tid 100175 td 0x1f08fa80 sched_switch(1f08fa80,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1d750aa8 mi_switch(104,0,1a886b5,22b,1f08fa80,...) at mi_switch+0x1f3/frame 0x1d750ae8 sleepq_switch(1f08fa80,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1d750b1c sleepq_catch_signals(1d750b84,1085670,1af740d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1d750b60 sleepq_wait_sig(bff5c50,0,1d750ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1d750b84 _cv_wait_sig(bff5c50,1af740c0,1ac69eb,481,284eb8c0,...) at _cv_wait_sig+0x21f/frame 0x1d750bc8 svc_run_internal(1d750cd4,1065d9e,1af740c0,1d750ce8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1d750ca4 svc_thread_start(1af740c0,1d750ce8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1d750cac fork_exit(1365e00,1af740c0,1d750ce8,3b,3b,...) at fork_exit+0x7e/frame 0x1d750cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1d750cd4 --- trap 0x28222978, eip = 0, esp = 0x1d750d20, ebp = 0x1 --- (null)() at 0 Tracing command nfscbd pid 723 tid 100176 td 0x1f64ba80 sched_switch(1f64ba80,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1d755aa8 mi_switch(104,0,1a886b5,22b,1f64ba80,...) at mi_switch+0x1f3/frame 0x1d755ae8 sleepq_switch(1f64ba80,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1d755b1c sleepq_catch_signals(1d755b84,1085670,1af740d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1d755b60 sleepq_wait_sig(bff5bd0,0,1d755ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1d755b84 _cv_wait_sig(bff5bd0,1af740c0,1ac69eb,481,0,...) at _cv_wait_sig+0x21f/frame 0x1d755bc8 svc_run_internal(1d755cd4,1065d9e,1af740c0,1d755ce8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1d755ca4 svc_thread_start(1af740c0,1d755ce8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1d755cac fork_exit(1365e00,1af740c0,1d755ce8,3b,3b,...) at fork_exit+0x7e/frame 0x1d755cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1d755cd4 --- trap 0x28222978, eip = 0, esp = 0x1d755d20, ebp = 0x1 --- (null)() at 0 Tracing command nfscbd pid 722 tid 100156 td 0x1f4a4000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(1a866b4,0,1d2f2b4,1d2f398,151254f8,...) at db_trace_self_wrapper+0x2a/frame 0x15125478 kdb_backtrace(1a86731,151254f8,151255f8,167fb2e,1512552c,...) at kdb_backtrace+0x2d/frame 0x151254e0 kdb_reenter(1512552c,11057bf,1d2f46c,0,1a89241,...) at kdb_reenter+0x2a/frame 0x151254f0 trap(15125604,8,28,28,ffffffff,...) at trap+0xbe/frame 0x151255f8 calltrap() at PTDpde+0x4124/frame 0x151255f8 --- trap 0xc, eip = 0x1669589, esp = 0x15125644, ebp = 0x15125660 --- db_trace_thread(1f4a4000,ffffffff,2d2,1873c,1f4a4000,...) at db_trace_thread+0x29/frame 0x15125660 _db_stack_trace_all(10efe60,0,ffffffff,151256f8,1da1ad0,...) at _db_stack_trace_all+0xe9/frame 0x151256cc db_command(1da28f6,0,1da24e8,1da28f5,60,...) at db_command+0x297/frame 0x15125780 db_script_exec(1ffb798,0,15125828,1512581c,1da1ad0,...) at db_script_exec+0x168/frame 0x151257f0 db_command(16e0773,15125908,9d505d,16e0780,ffff0ff0,...) at db_command+0x297/frame 0x151258a4 db_command_loop(16e0780,ffff0ff0,151258cf,151258ce,9f18000,...) at db_command_loop+0x50/frame 0x151258b0 db_trap(3,ffff0ff0,7,0,1,...) at db_trap+0x10d/frame 0x15125908 kdb_trap(3,ffff0ff0,15125a50,1203ce8,88e,...) at kdb_trap+0x11e/frame 0x15125940 trap(15125a50,8,28,28,4,...) at trap+0x3d1/frame 0x15125a44 calltrap() at PTDpde+0x4124/frame 0x15125a44 --- trap 0x3, eip = 0x10efe60, esp = 0x15125a90, ebp = 0x15125aa0 --- kdb_alt_break_internal(0,15125acc,ea3577,2,1aff8888,...) at kdb_alt_break_internal+0xf0/frame 0x15125aa0 kdb_alt_break(2,1aff8888,1a3f113,0,40000,...) at kdb_alt_break+0x16/frame 0x15125aac uart_intr_rxready(1aff8800,13c88,be85d40,bfcfa80,15125af0,...) at uart_intr_rxready+0x87/frame 0x15125acc uart_intr(1aff8800,0,13c88,1,bfcfa80,...) at uart_intr+0x130/frame 0x15125b0c intr_event_handle(bfbea80,15125ba0,1f88f9c,9f75380,1,...) at intr_event_handle+0xa5/frame 0x15125b38 intr_execute_handlers(bff4130,15125ba0,3) at intr_execute_handlers+0xa5/frame 0x15125b70 lapic_handle_intr(32,15125ba0,8,28,28,...) at lapic_handle_intr+0x5e/frame 0x15125b90 Xapic_isr1_pti() at PTDpde+0x4bbf/frame 0x15125b90 --- interrupt, eip = 0x1698005, esp = 0x15125be0, ebp = 0x15125be0 --- acpi_cpu_c1(15125c34,16881d2,be85d50,0,1c8ae43,...) at acpi_cpu_c1+0x5/frame 0x15125be0 acpi_cpu_idle(1b196e03,0,1b196e03,15125c50,169860a,...) at acpi_cpu_idle+0x30b/frame 0x15125c20 cpu_idle_acpi(1b196e03,0,1f88f40,1,ffffffff,...) at cpu_idle_acpi+0x3f/frame 0x15125c34 cpu_idle(0,15125c80,1a83ce8,aea,1,...) at cpu_idle+0x9a/frame 0x15125c50 sched_idletd(0,15125ce8,1a7773c,407,0,...) at sched_idletd+0x236/frame 0x15125cac fork_exit(10d8c60,0,15125ce8,0,0,...) at fork_exit+0x7e/frame 0x15125cd4 fork_trampoline() at PTDpde+0x42da/frame 0x15125cd4 --- trap 0, eip = 0, esp = 0x15125d20, ebp = 0 --- (null)() at 0 Tracing command cron pid 689 tid 100164 td 0x1f632700 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(1a866b4,0,1d2f2b4,1d2f398,151254f8,...) at db_trace_self_wrapper+0x2a/frame 0x15125478 kdb_backtrace(1a86731,151254f8,151255f8,167fb2e,1512552c,...) at kdb_backtrace+0x2d/frame 0x151254e0 kdb_reenter(1512552c,11057bf,1d2f46c,0,1a89241,...) at kdb_reenter+0x2a/frame 0x151254f0 trap(15125604,8,28,28,ffffffff,...) at trap+0xbe/frame 0x151255f8 calltrap() at PTDpde+0x4124/frame 0x151255f8 --- trap 0xc, eip = 0x1669589, esp = 0x15125644, ebp = 0x15125660 --- db_trace_thread(1f632700,ffffffff,2b1,18744,1f632700,...) at db_trace_thread+0x29/frame 0x15125660 _db_stack_trace_all(10efe60,0,ffffffff,151256f8,1da1ad0,...) at _db_stack_trace_all+0xe9/frame 0x151256cc db_command(1da28f6,0,1da24e8,1da28f5,60,...) at db_command+0x297/frame 0x15125780 db_script_exec(1ffb798,0,15125828,1512581c,1da1ad0,...) at db_script_exec+0x168/frame 0x151257f0 db_command(16e0773,15125908,9d505d,16e0780,ffff0ff0,...) at db_command+0x297/frame 0x151258a4 db_command_loop(16e0780,ffff0ff0,151258cf,151258ce,9f18000,...) at db_command_loop+0x50/frame 0x151258b0 db_trap(3,ffff0ff0,7,0,1,...) at db_trap+0x10d/frame 0x15125908 kdb_trap(3,ffff0ff0,15125a50,1203ce8,88e,...) at kdb_trap+0x11e/frame 0x15125940 trap(15125a50,8,28,28,4,...) at trap+0x3d1/frame 0x15125a44 calltrap() at PTDpde+0x4124/frame 0x15125a44 --- trap 0x3, eip = 0x10efe60, esp = 0x15125a90, ebp = 0x15125aa0 --- kdb_alt_break_internal(0,15125acc,ea3577,2,1aff8888,...) at kdb_alt_break_internal+0xf0/frame 0x15125aa0 kdb_alt_break(2,1aff8888,1a3f113,0,40000,...) at kdb_alt_break+0x16/frame 0x15125aac uart_intr_rxready(1aff8800,13c88,be85d40,bfcfa80,15125af0,...) at uart_intr_rxready+0x87/frame 0x15125acc uart_intr(1aff8800,0,13c88,1,bfcfa80,...) at uart_intr+0x130/frame 0x15125b0c intr_event_handle(bfbea80,15125ba0,1f88f9c,9f75380,1,...) at intr_event_handle+0xa5/frame 0x15125b38 intr_execute_handlers(bff4130,15125ba0,3) at intr_execute_handlers+0xa5/frame 0x15125b70 lapic_handle_intr(32,15125ba0,8,28,28,...) at lapic_handle_intr+0x5e/frame 0x15125b90 Xapic_isr1_pti() at PTDpde+0x4bbf/frame 0x15125b90 --- interrupt, eip = 0x1698005, esp = 0x15125be0, ebp = 0x15125be0 --- acpi_cpu_c1(15125c34,16881d2,be85d50,0,1c8ae43,...) at acpi_cpu_c1+0x5/frame 0x15125be0 acpi_cpu_idle(1b196e03,0,1b196e03,15125c50,169860a,...) at acpi_cpu_idle+0x30b/frame 0x15125c20 cpu_idle_acpi(1b196e03,0,1f88f40,1,ffffffff,...) at cpu_idle_acpi+0x3f/frame 0x15125c34 cpu_idle(0,15125c80,1a83ce8,aea,1,...) at cpu_idle+0x9a/frame 0x15125c50 sched_idletd(0,15125ce8,1a7773c,407,0,...) at sched_idletd+0x236/frame 0x15125cac fork_exit(10d8c60,0,15125ce8,0,0,...) at fork_exit+0x7e/frame 0x15125cd4 fork_trampoline() at PTDpde+0x42da/frame 0x15125cd4 --- trap 0, eip = 0, esp = 0x15125d20, ebp = 0 --- (null)() at 0 Tracing command sshd pid 679 tid 100109 td 0x1b1ad380 sched_switch(1b1ad380,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1eace8b0 mi_switch(104,0,1a886b5,22b,1b1ad380,...) at mi_switch+0x1f3/frame 0x1eace8f0 sleepq_switch(1b1ad380,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1eace924 sleepq_catch_signals(1eace98c,1085670,1accf620,0,0,...) at sleepq_catch_signals+0x360/frame 0x1eace968 sleepq_wait_sig(1accf624,0,1eace9ac,101,0,...) at sleepq_wait_sig+0x14/frame 0x1eace98c _cv_wait_sig(1accf624,1accf610,1a8bf2f,73c,1f0d7e00,...) at _cv_wait_sig+0x21f/frame 0x1eace9d0 seltdwait(ffffffff,0,0,1b1ad380,0,...) at seltdwait+0xbb/frame 0x1eacea00 kern_select(1b1ad380,9,280c3158,0,0,...) at kern_select+0x876/frame 0x1eaceba0 sys_select(1b1ad380,1b1ad604,1a7717b,4,1eacec28,...) at sys_select+0x68/frame 0x1eacebe8 syscall(1eacece8,3b,3b,3b,28975000,...) at syscall+0x6ee/frame 0x1eacecdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x1eacecdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2855d07f, esp = 0xffbfe7f4, ebp = 0xffbfe818 --- _end() at 0x2855d07f Tracing command powerd pid 611 tid 100117 td 0x1f08f700 sched_switch(1f08f700,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1eb01890 mi_switch(104,0,1a886b5,22b,1f08f700,...) at mi_switch+0x1f3/frame 0x1eb018d0 sleepq_switch(1f08f700,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1eb01904 sleepq_catch_signals(8,1a7cce7,cb,1f08f700,1f08f700,...) at sleepq_catch_signals+0x360/frame 0x1eb01948 sleepq_timedwait_sig(1b1aaee4,0,1eb019ac,3ffffff,0,...) at sleepq_timedwait_sig+0x17/frame 0x1eb01988 _cv_timedwait_sig_sbt(1b1aaee4,1b1aaed0,2985977a,13c89,3ffffff,...) at _cv_timedwait_sig_sbt+0x24a/frame 0x1eb019d0 seltdwait(13c89,3ffffff,0,1,1eb01a4c,...) at seltdwait+0x82/frame 0x1eb01a00 kern_select(1f08f700,0,ffbfed90,0,ffbfed90,...) at kern_select+0x876/frame 0x1eb01ba0 sys_select(1f08f700,1f08f984,1a7717b,4,1c8ae43,...) at sys_select+0x68/frame 0x1eb01be8 syscall(1eb01ce8,3b,3b,3b,ffbfed80,...) at syscall+0x6ee/frame 0x1eb01cdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x1eb01cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2821207f, esp = 0xffbfecf4, ebp = 0xffbfed18 --- _end() at 0x2821207f Tracing command nfsd pid 565 tid 100108 td 0x1b2c5000 sched_switch(1b2c5000,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1eac83c8 mi_switch(104,0,1a886b5,22b,0,...) at mi_switch+0x1f3/frame 0x1eac8408 sleepq_switch(1b2c5000,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1eac843c sleepq_catch_signals(8,1a7cce7,cb,1b2c5000,1b2c5000,...) at sleepq_catch_signals+0x360/frame 0x1eac8480 sleepq_timedwait_sig(bff5e50,0,1eac84e4,0,0,...) at sleepq_timedwait_sig+0x17/frame 0x1eac84c0 _cv_timedwait_sig_sbt(bff5e50,1b19f0c0,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x24a/frame 0x1eac8508 svc_run_internal(1365e00,1b19f0c0,1b2c0000,1eac8610,0,...) at svc_run_internal+0xb2c/frame 0x1eac85e4 svc_run(1b19f000,0,1a66cb9,1f8,200246,...) at svc_run+0x1ed/frame 0x1eac8638 nfsrvd_nfsd(1b2c5000,1eac87b0,c,1086c36,1f87b00,...) at nfsrvd_nfsd+0x213/frame 0x1eac8778 nfssvc_nfsd(1b2c5000,1b2c5284,0,1b2c5000,1eac8cdc,...) at nfssvc_nfsd+0x201/frame 0x1eac8bd0 sys_nfssvc(1b2c5000,1b2c5284,1a7717b,4,1eac8c48,...) at sys_nfssvc+0xa6/frame 0x1eac8be8 syscall(1eac8ce8,3b,3b,3b,ffbfe84e,...) at syscall+0x6ee/frame 0x1eac8cdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x1eac8cdc --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280c30bf, esp = 0xffbfe7f4, ebp = 0xffbfea68 --- _end() at 0x280c30bf Tracing command nfsd pid 565 tid 100124 td 0x1f08f380 sched_switch(1f08f380,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1eb82aa8 mi_switch(104,0,1a886b5,22b,1f08f380,...) at mi_switch+0x1f3/frame 0x1eb82ae8 sleepq_switch(1f08f380,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1eb82b1c sleepq_catch_signals(1eb82b84,1085670,1b19f0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1eb82b60 sleepq_wait_sig(1b555650,0,1eb82ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1eb82b84 _cv_wait_sig(1b555650,1b19f0c0,1ac69eb,439,5a5a5a5a,...) at _cv_wait_sig+0x21f/frame 0x1eb82bc8 svc_run_internal(1eb82cd4,1065d9e,1b19f0c0,1eb82ce8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1eb82ca4 svc_thread_start(1b19f0c0,1eb82ce8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1eb82cac fork_exit(1365e00,1b19f0c0,1eb82ce8,3b,3b,...) at fork_exit+0x7e/frame 0x1eb82cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1eb82cd4 --- trap 0x20, eip = 0, esp = 0x1eb82d20, ebp = 0xffbfe84e --- (null)() at 0 Tracing command nfsd pid 565 tid 100125 td 0x1f08f000 sched_switch(1f08f000,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1eb87aa8 mi_switch(104,0,1a886b5,22b,1f08f000,...) at mi_switch+0x1f3/frame 0x1eb87ae8 sleepq_switch(1f08f000,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1eb87b1c sleepq_catch_signals(1eb87b84,1085670,1b19f0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1eb87b60 sleepq_wait_sig(1ec0a450,0,1eb87ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1eb87b84 _cv_wait_sig(1ec0a450,1b19f0c0,1ac69eb,481,0,...) at _cv_wait_sig+0x21f/frame 0x1eb87bc8 svc_run_internal(1eb87cd4,1065d9e,1b19f0c0,1eb87ce8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1eb87ca4 svc_thread_start(1b19f0c0,1eb87ce8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1eb87cac fork_exit(1365e00,1b19f0c0,1eb87ce8,3b,3b,...) at fork_exit+0x7e/frame 0x1eb87cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1eb87cd4 --- trap 0x20, eip = 0, esp = 0x1eb87d20, ebp = 0xffbfe84e --- (null)() at 0 Tracing command nfsd pid 565 tid 100126 td 0x1f08ea80 sched_switch(1f08ea80,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1eb8caa8 mi_switch(104,0,1a886b5,22b,1f08ea80,...) at mi_switch+0x1f3/frame 0x1eb8cae8 sleepq_switch(1f08ea80,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1eb8cb1c sleepq_catch_signals(1eb8cb84,1085670,1b19f0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1eb8cb60 sleepq_wait_sig(1ec0a4d0,0,1eb8cba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1eb8cb84 _cv_wait_sig(1ec0a4d0,1b19f0c0,1ac69eb,481,0,...) at _cv_wait_sig+0x21f/frame 0x1eb8cbc8 svc_run_internal(1eb8ccd4,1065d9e,1b19f0c0,1eb8cce8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1eb8cca4 svc_thread_start(1b19f0c0,1eb8cce8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1eb8ccac fork_exit(1365e00,1b19f0c0,1eb8cce8,3b,3b,...) at fork_exit+0x7e/frame 0x1eb8ccd4 fork_trampoline() at PTDpde+0x42da/frame 0x1eb8ccd4 --- trap 0x20, eip = 0, esp = 0x1eb8cd20, ebp = 0xffbfe84e --- (null)() at 0 Tracing command nfsd pid 565 tid 100127 td 0x1f08e700 sched_switch(1f08e700,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1eb91aa8 mi_switch(104,0,1a886b5,22b,1f08e700,...) at mi_switch+0x1f3/frame 0x1eb91ae8 sleepq_switch(1f08e700,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1eb91b1c sleepq_catch_signals(1eb91b84,1085670,1b19f0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1eb91b60 sleepq_wait_sig(1b5555d0,0,1eb91ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1eb91b84 _cv_wait_sig(1b5555d0,1b19f0c0,1ac69eb,481,0,...) at _cv_wait_sig+0x21f/frame 0x1eb91bc8 svc_run_internal(1eb91cd4,1065d9e,1b19f0c0,1eb91ce8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1eb91ca4 svc_thread_start(1b19f0c0,1eb91ce8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1eb91cac fork_exit(1365e00,1b19f0c0,1eb91ce8,3b,3b,...) at fork_exit+0x7e/frame 0x1eb91cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1eb91cd4 --- trap 0x20, eip = 0, esp = 0x1eb91d20, ebp = 0xffbfe84e --- (null)() at 0 Tracing command nfsd pid 565 tid 100128 td 0x1f08e380 sched_switch(1f08e380,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1eb96aa8 mi_switch(104,0,1a886b5,22b,1f08e380,...) at mi_switch+0x1f3/frame 0x1eb96ae8 sleepq_switch(1f08e380,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1eb96b1c sleepq_catch_signals(1eb96b84,1085670,1b19f0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1eb96b60 sleepq_wait_sig(1b2facd0,0,1eb96ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1eb96b84 _cv_wait_sig(1b2facd0,1b19f0c0,1ac69eb,481,0,...) at _cv_wait_sig+0x21f/frame 0x1eb96bc8 svc_run_internal(1eb96cd4,1065d9e,1b19f0c0,1eb96ce8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1eb96ca4 svc_thread_start(1b19f0c0,1eb96ce8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1eb96cac fork_exit(1365e00,1b19f0c0,1eb96ce8,3b,3b,...) at fork_exit+0x7e/frame 0x1eb96cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1eb96cd4 --- trap 0x20, eip = 0, esp = 0x1eb96d20, ebp = 0xffbfe84e --- (null)() at 0 Tracing command nfsd pid 565 tid 100129 td 0x1f08e000 sched_switch(1f08e000,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1eb9baa8 mi_switch(104,0,1a886b5,22b,1f08e000,...) at mi_switch+0x1f3/frame 0x1eb9bae8 sleepq_switch(1f08e000,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1eb9bb1c sleepq_catch_signals(1eb9bb84,1085670,1b19f0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1eb9bb60 sleepq_wait_sig(1b555550,0,1eb9bba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1eb9bb84 _cv_wait_sig(1b555550,1b19f0c0,1ac69eb,481,0,...) at _cv_wait_sig+0x21f/frame 0x1eb9bbc8 svc_run_internal(1eb9bcd4,1065d9e,1b19f0c0,1eb9bce8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1eb9bca4 svc_thread_start(1b19f0c0,1eb9bce8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1eb9bcac fork_exit(1365e00,1b19f0c0,1eb9bce8,3b,3b,...) at fork_exit+0x7e/frame 0x1eb9bcd4 fork_trampoline() at PTDpde+0x42da/frame 0x1eb9bcd4 --- trap 0x20, eip = 0, esp = 0x1eb9bd20, ebp = 0xffbfe84e --- (null)() at 0 Tracing command nfsd pid 565 tid 100130 td 0x1f08da80 sched_switch(1f08da80,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1eba0aa8 mi_switch(104,0,1a886b5,22b,1f08da80,...) at mi_switch+0x1f3/frame 0x1eba0ae8 sleepq_switch(1f08da80,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1eba0b1c sleepq_catch_signals(1eba0b84,1085670,1b19f0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1eba0b60 sleepq_wait_sig(1b5554d0,0,1eba0ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1eba0b84 _cv_wait_sig(1b5554d0,1b19f0c0,1ac69eb,481,282621f1,...) at _cv_wait_sig+0x21f/frame 0x1eba0bc8 svc_run_internal(1eba0cd4,1065d9e,1b19f0c0,1eba0ce8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1eba0ca4 svc_thread_start(1b19f0c0,1eba0ce8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1eba0cac fork_exit(1365e00,1b19f0c0,1eba0ce8,3b,3b,...) at fork_exit+0x7e/frame 0x1eba0cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1eba0cd4 --- trap 0x20, eip = 0, esp = 0x1eba0d20, ebp = 0xffbfe84e --- (null)() at 0 Tracing command nfsd pid 565 tid 100131 td 0x1f08d700 sched_switch(1f08d700,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1eba5aa8 mi_switch(104,0,1a886b5,22b,1f08d700,...) at mi_switch+0x1f3/frame 0x1eba5ae8 sleepq_switch(1f08d700,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1eba5b1c sleepq_catch_signals(1eba5b84,1085670,1b19f0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1eba5b60 sleepq_wait_sig(1ec0a550,0,1eba5ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1eba5b84 _cv_wait_sig(1ec0a550,1b19f0c0,1ac69eb,481,0,...) at _cv_wait_sig+0x21f/frame 0x1eba5bc8 svc_run_internal(1eba5cd4,1065d9e,1b19f0c0,1eba5ce8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1eba5ca4 svc_thread_start(1b19f0c0,1eba5ce8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1eba5cac fork_exit(1365e00,1b19f0c0,1eba5ce8,3b,3b,...) at fork_exit+0x7e/frame 0x1eba5cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1eba5cd4 --- trap 0x20, eip = 0, esp = 0x1eba5d20, ebp = 0xffbfe84e --- (null)() at 0 Tracing command nfsd pid 565 tid 100132 td 0x1f08d380 sched_switch(1f08d380,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ebaaaa8 mi_switch(104,0,1a886b5,22b,1f08d380,...) at mi_switch+0x1f3/frame 0x1ebaaae8 sleepq_switch(1f08d380,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1ebaab1c sleepq_catch_signals(1ebaab84,1085670,1b19f0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1ebaab60 sleepq_wait_sig(1b555450,0,1ebaaba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1ebaab84 _cv_wait_sig(1b555450,1b19f0c0,1ac69eb,481,0,...) at _cv_wait_sig+0x21f/frame 0x1ebaabc8 svc_run_internal(1ebaacd4,1065d9e,1b19f0c0,1ebaace8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1ebaaca4 svc_thread_start(1b19f0c0,1ebaace8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1ebaacac fork_exit(1365e00,1b19f0c0,1ebaace8,3b,3b,...) at fork_exit+0x7e/frame 0x1ebaacd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ebaacd4 --- trap 0x20, eip = 0, esp = 0x1ebaad20, ebp = 0xffbfe84e --- (null)() at 0 Tracing command nfsd pid 565 tid 100133 td 0x1f08d000 sched_switch(1f08d000,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ebafaa8 mi_switch(104,0,1a886b5,22b,1f08d000,...) at mi_switch+0x1f3/frame 0x1ebafae8 sleepq_switch(1f08d000,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1ebafb1c sleepq_catch_signals(1ebafb84,1085670,1b19f0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1ebafb60 sleepq_wait_sig(1b555950,0,1ebafba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1ebafb84 _cv_wait_sig(1b555950,1b19f0c0,1ac69eb,481,0,...) at _cv_wait_sig+0x21f/frame 0x1ebafbc8 svc_run_internal(1ebafcd4,1065d9e,1b19f0c0,1ebafce8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1ebafca4 svc_thread_start(1b19f0c0,1ebafce8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1ebafcac fork_exit(1365e00,1b19f0c0,1ebafce8,3b,3b,...) at fork_exit+0x7e/frame 0x1ebafcd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ebafcd4 --- trap 0x20, eip = 0, esp = 0x1ebafd20, ebp = 0xffbfe84e --- (null)() at 0 Tracing command nfsd pid 565 tid 100134 td 0x1b2cfa80 sched_switch(1b2cfa80,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ebb4aa8 mi_switch(104,0,1a886b5,22b,1b2cfa80,...) at mi_switch+0x1f3/frame 0x1ebb4ae8 sleepq_switch(1b2cfa80,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1ebb4b1c sleepq_catch_signals(1ebb4b84,1085670,1b19f0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1ebb4b60 sleepq_wait_sig(1b5553d0,0,1ebb4ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1ebb4b84 _cv_wait_sig(1b5553d0,1b19f0c0,1ac69eb,481,0,...) at _cv_wait_sig+0x21f/frame 0x1ebb4bc8 svc_run_internal(1ebb4cd4,1065d9e,1b19f0c0,1ebb4ce8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1ebb4ca4 svc_thread_start(1b19f0c0,1ebb4ce8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1ebb4cac fork_exit(1365e00,1b19f0c0,1ebb4ce8,3b,3b,...) at fork_exit+0x7e/frame 0x1ebb4cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ebb4cd4 --- trap 0x20, eip = 0, esp = 0x1ebb4d20, ebp = 0xffbfe84e --- (null)() at 0 Tracing command nfsd pid 565 tid 100135 td 0x1b2cf700 sched_switch(1b2cf700,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ebb9aa8 mi_switch(104,0,1a886b5,22b,1b2cf700,...) at mi_switch+0x1f3/frame 0x1ebb9ae8 sleepq_switch(1b2cf700,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1ebb9b1c sleepq_catch_signals(1ebb9b84,1085670,1b19f0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1ebb9b60 sleepq_wait_sig(1b555350,0,1ebb9ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1ebb9b84 _cv_wait_sig(1b555350,1b19f0c0,1ac69eb,481,8,...) at _cv_wait_sig+0x21f/frame 0x1ebb9bc8 svc_run_internal(1ebb9cd4,1065d9e,1b19f0c0,1ebb9ce8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1ebb9ca4 svc_thread_start(1b19f0c0,1ebb9ce8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1ebb9cac fork_exit(1365e00,1b19f0c0,1ebb9ce8,3b,3b,...) at fork_exit+0x7e/frame 0x1ebb9cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ebb9cd4 --- trap 0x20, eip = 0, esp = 0x1ebb9d20, ebp = 0xffbfe84e --- (null)() at 0 Tracing command nfsd pid 565 tid 100136 td 0x1f5a2000 sched_switch(1f5a2000,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ebbeaa8 mi_switch(104,0,1a886b5,22b,1f5a2000,...) at mi_switch+0x1f3/frame 0x1ebbeae8 sleepq_switch(1f5a2000,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1ebbeb1c sleepq_catch_signals(1ebbeb84,1085670,1b19f0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1ebbeb60 sleepq_wait_sig(1b5559d0,0,1ebbeba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1ebbeb84 _cv_wait_sig(1b5559d0,1b19f0c0,1ac69eb,481,0,...) at _cv_wait_sig+0x21f/frame 0x1ebbebc8 svc_run_internal(1ebbecd4,1065d9e,1b19f0c0,1ebbece8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1ebbeca4 svc_thread_start(1b19f0c0,1ebbece8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1ebbecac fork_exit(1365e00,1b19f0c0,1ebbece8,3b,3b,...) at fork_exit+0x7e/frame 0x1ebbecd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ebbecd4 --- trap 0x20, eip = 0, esp = 0x1ebbed20, ebp = 0xffbfe84e --- (null)() at 0 Tracing command nfsd pid 565 tid 100137 td 0x1f5a1a80 sched_switch(1f5a1a80,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ebc3aa8 mi_switch(104,0,1a886b5,22b,1f5a1a80,...) at mi_switch+0x1f3/frame 0x1ebc3ae8 sleepq_switch(1f5a1a80,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1ebc3b1c sleepq_catch_signals(1ebc3b84,1085670,1b19f0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1ebc3b60 sleepq_wait_sig(1b2fad50,0,1ebc3ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1ebc3b84 _cv_wait_sig(1b2fad50,1b19f0c0,1ac69eb,481,0,...) at _cv_wait_sig+0x21f/frame 0x1ebc3bc8 svc_run_internal(1ebc3cd4,1065d9e,1b19f0c0,1ebc3ce8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1ebc3ca4 svc_thread_start(1b19f0c0,1ebc3ce8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1ebc3cac fork_exit(1365e00,1b19f0c0,1ebc3ce8,3b,3b,...) at fork_exit+0x7e/frame 0x1ebc3cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ebc3cd4 --- trap 0x20, eip = 0, esp = 0x1ebc3d20, ebp = 0xffbfe84e --- (null)() at 0 Tracing command nfsd pid 565 tid 100138 td 0x1f5a1700 sched_switch(1f5a1700,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ebc8aa8 mi_switch(104,0,1a886b5,22b,1f5a1700,...) at mi_switch+0x1f3/frame 0x1ebc8ae8 sleepq_switch(1f5a1700,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1ebc8b1c sleepq_catch_signals(1ebc8b84,1085670,1b19f0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1ebc8b60 sleepq_wait_sig(1ec0a5d0,0,1ebc8ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1ebc8b84 _cv_wait_sig(1ec0a5d0,1b19f0c0,1ac69eb,481,4,...) at _cv_wait_sig+0x21f/frame 0x1ebc8bc8 svc_run_internal(1ebc8cd4,1065d9e,1b19f0c0,1ebc8ce8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1ebc8ca4 svc_thread_start(1b19f0c0,1ebc8ce8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1ebc8cac fork_exit(1365e00,1b19f0c0,1ebc8ce8,3b,3b,...) at fork_exit+0x7e/frame 0x1ebc8cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ebc8cd4 --- trap 0x20, eip = 0, esp = 0x1ebc8d20, ebp = 0xffbfe84e --- (null)() at 0 Tracing command nfsd pid 565 tid 100139 td 0x1f5a1380 sched_switch(1f5a1380,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ebcdaa8 mi_switch(104,0,1a886b5,22b,1f5a1380,...) at mi_switch+0x1f3/frame 0x1ebcdae8 sleepq_switch(1f5a1380,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1ebcdb1c sleepq_catch_signals(1ebcdb84,1085670,1b19f0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1ebcdb60 sleepq_wait_sig(1b2fadd0,0,1ebcdba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1ebcdb84 _cv_wait_sig(1b2fadd0,1b19f0c0,1ac69eb,481,0,...) at _cv_wait_sig+0x21f/frame 0x1ebcdbc8 svc_run_internal(1ebcdcd4,1065d9e,1b19f0c0,1ebcdce8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1ebcdca4 svc_thread_start(1b19f0c0,1ebcdce8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1ebcdcac fork_exit(1365e00,1b19f0c0,1ebcdce8,3b,3b,...) at fork_exit+0x7e/frame 0x1ebcdcd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ebcdcd4 --- trap 0x20, eip = 0, esp = 0x1ebcdd20, ebp = 0xffbfe84e --- (null)() at 0 Tracing command nfsd pid 565 tid 100140 td 0x1f5a1000 sched_switch(1f5a1000,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ebd2aa8 mi_switch(104,0,1a886b5,22b,1f5a1000,...) at mi_switch+0x1f3/frame 0x1ebd2ae8 sleepq_switch(1f5a1000,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1ebd2b1c sleepq_catch_signals(1ebd2b84,1085670,1b19f0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1ebd2b60 sleepq_wait_sig(1b2fae50,0,1ebd2ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1ebd2b84 _cv_wait_sig(1b2fae50,1b19f0c0,1ac69eb,481,0,...) at _cv_wait_sig+0x21f/frame 0x1ebd2bc8 svc_run_internal(1ebd2cd4,1065d9e,1b19f0c0,1ebd2ce8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1ebd2ca4 svc_thread_start(1b19f0c0,1ebd2ce8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1ebd2cac fork_exit(1365e00,1b19f0c0,1ebd2ce8,3b,3b,...) at fork_exit+0x7e/frame 0x1ebd2cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ebd2cd4 --- trap 0x20, eip = 0, esp = 0x1ebd2d20, ebp = 0xffbfe84e --- (null)() at 0 Tracing command nfsd pid 565 tid 100141 td 0x1f5a0a80 sched_switch(1f5a0a80,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ebd7aa8 mi_switch(104,0,1a886b5,22b,1f5a0a80,...) at mi_switch+0x1f3/frame 0x1ebd7ae8 sleepq_switch(1f5a0a80,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1ebd7b1c sleepq_catch_signals(1ebd7b84,1085670,1b19f0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1ebd7b60 sleepq_wait_sig(1b555a50,0,1ebd7ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1ebd7b84 _cv_wait_sig(1b555a50,1b19f0c0,1ac69eb,481,0,...) at _cv_wait_sig+0x21f/frame 0x1ebd7bc8 svc_run_internal(1ebd7cd4,1065d9e,1b19f0c0,1ebd7ce8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1ebd7ca4 svc_thread_start(1b19f0c0,1ebd7ce8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1ebd7cac fork_exit(1365e00,1b19f0c0,1ebd7ce8,3b,3b,...) at fork_exit+0x7e/frame 0x1ebd7cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ebd7cd4 --- trap 0x20, eip = 0, esp = 0x1ebd7d20, ebp = 0xffbfe84e --- (null)() at 0 Tracing command nfsd pid 565 tid 100142 td 0x1f5a0700 sched_switch(1f5a0700,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ebdcaa8 mi_switch(104,0,1a886b5,22b,1f5a0700,...) at mi_switch+0x1f3/frame 0x1ebdcae8 sleepq_switch(1f5a0700,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1ebdcb1c sleepq_catch_signals(1ebdcb84,1085670,1b19f0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1ebdcb60 sleepq_wait_sig(1b5552d0,0,1ebdcba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1ebdcb84 _cv_wait_sig(1b5552d0,1b19f0c0,1ac69eb,481,0,...) at _cv_wait_sig+0x21f/frame 0x1ebdcbc8 svc_run_internal(1ebdccd4,1065d9e,1b19f0c0,1ebdcce8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1ebdcca4 svc_thread_start(1b19f0c0,1ebdcce8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1ebdccac fork_exit(1365e00,1b19f0c0,1ebdcce8,3b,3b,...) at fork_exit+0x7e/frame 0x1ebdccd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ebdccd4 --- trap 0x20, eip = 0, esp = 0x1ebdcd20, ebp = 0xffbfe84e --- (null)() at 0 Tracing command nfsd pid 565 tid 100143 td 0x1f5a0380 sched_switch(1f5a0380,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ebe1aa8 mi_switch(104,0,1a886b5,22b,1f5a0380,...) at mi_switch+0x1f3/frame 0x1ebe1ae8 sleepq_switch(1f5a0380,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1ebe1b1c sleepq_catch_signals(1ebe1b84,1085670,1b19f0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1ebe1b60 sleepq_wait_sig(1b555250,0,1ebe1ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1ebe1b84 _cv_wait_sig(1b555250,1b19f0c0,1ac69eb,481,0,...) at _cv_wait_sig+0x21f/frame 0x1ebe1bc8 svc_run_internal(1ebe1cd4,1065d9e,1b19f0c0,1ebe1ce8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1ebe1ca4 svc_thread_start(1b19f0c0,1ebe1ce8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1ebe1cac fork_exit(1365e00,1b19f0c0,1ebe1ce8,3b,3b,...) at fork_exit+0x7e/frame 0x1ebe1cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ebe1cd4 --- trap 0x20, eip = 0, esp = 0x1ebe1d20, ebp = 0xffbfe84e --- (null)() at 0 Tracing command nfsd pid 565 tid 100144 td 0x1f5a0000 sched_switch(1f5a0000,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ebe6aa8 mi_switch(104,0,1a886b5,22b,1f5a0000,...) at mi_switch+0x1f3/frame 0x1ebe6ae8 sleepq_switch(1f5a0000,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1ebe6b1c sleepq_catch_signals(1ebe6b84,1085670,1b19f0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1ebe6b60 sleepq_wait_sig(1b5551d0,0,1ebe6ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1ebe6b84 _cv_wait_sig(1b5551d0,1b19f0c0,1ac69eb,481,0,...) at _cv_wait_sig+0x21f/frame 0x1ebe6bc8 svc_run_internal(1ebe6cd4,1065d9e,1b19f0c0,1ebe6ce8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1ebe6ca4 svc_thread_start(1b19f0c0,1ebe6ce8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1ebe6cac fork_exit(1365e00,1b19f0c0,1ebe6ce8,3b,3b,...) at fork_exit+0x7e/frame 0x1ebe6cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ebe6cd4 --- trap 0x20, eip = 0, esp = 0x1ebe6d20, ebp = 0xffbfe84e --- (null)() at 0 Tracing command nfsd pid 565 tid 100145 td 0x1f59fa80 sched_switch(1f59fa80,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ebebaa8 mi_switch(104,0,1a886b5,22b,1f59fa80,...) at mi_switch+0x1f3/frame 0x1ebebae8 sleepq_switch(1f59fa80,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1ebebb1c sleepq_catch_signals(1ebebb84,1085670,1b19f0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1ebebb60 sleepq_wait_sig(1b555150,0,1ebebba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1ebebb84 _cv_wait_sig(1b555150,1b19f0c0,1ac69eb,481,0,...) at _cv_wait_sig+0x21f/frame 0x1ebebbc8 svc_run_internal(1ebebcd4,1065d9e,1b19f0c0,1ebebce8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1ebebca4 svc_thread_start(1b19f0c0,1ebebce8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1ebebcac fork_exit(1365e00,1b19f0c0,1ebebce8,3b,3b,...) at fork_exit+0x7e/frame 0x1ebebcd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ebebcd4 --- trap 0x20, eip = 0, esp = 0x1ebebd20, ebp = 0xffbfe84e --- (null)() at 0 Tracing command nfsd pid 565 tid 100146 td 0x1f59f700 sched_switch(1f59f700,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ebf0aa8 mi_switch(104,0,1a886b5,22b,1f59f700,...) at mi_switch+0x1f3/frame 0x1ebf0ae8 sleepq_switch(1f59f700,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1ebf0b1c sleepq_catch_signals(1ebf0b84,1085670,1b19f0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1ebf0b60 sleepq_wait_sig(1ec0a650,0,1ebf0ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1ebf0b84 _cv_wait_sig(1ec0a650,1b19f0c0,1ac69eb,481,0,...) at _cv_wait_sig+0x21f/frame 0x1ebf0bc8 svc_run_internal(1ebf0cd4,1065d9e,1b19f0c0,1ebf0ce8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1ebf0ca4 svc_thread_start(1b19f0c0,1ebf0ce8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1ebf0cac fork_exit(1365e00,1b19f0c0,1ebf0ce8,3b,3b,...) at fork_exit+0x7e/frame 0x1ebf0cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ebf0cd4 --- trap 0x20, eip = 0, esp = 0x1ebf0d20, ebp = 0xffbfe84e --- (null)() at 0 Tracing command nfsd pid 565 tid 100147 td 0x1f59f380 sched_switch(1f59f380,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ebf5aa8 mi_switch(104,0,1a886b5,22b,1f59f380,...) at mi_switch+0x1f3/frame 0x1ebf5ae8 sleepq_switch(1f59f380,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1ebf5b1c sleepq_catch_signals(1ebf5b84,1085670,1b19f0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1ebf5b60 sleepq_wait_sig(1b5550d0,0,1ebf5ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1ebf5b84 _cv_wait_sig(1b5550d0,1b19f0c0,1ac69eb,481,0,...) at _cv_wait_sig+0x21f/frame 0x1ebf5bc8 svc_run_internal(1ebf5cd4,1065d9e,1b19f0c0,1ebf5ce8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1ebf5ca4 svc_thread_start(1b19f0c0,1ebf5ce8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1ebf5cac fork_exit(1365e00,1b19f0c0,1ebf5ce8,3b,3b,...) at fork_exit+0x7e/frame 0x1ebf5cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ebf5cd4 --- trap 0x20, eip = 0, esp = 0x1ebf5d20, ebp = 0xffbfe84e --- (null)() at 0 Tracing command nfsd pid 565 tid 100148 td 0x1f59f000 sched_switch(1f59f000,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ebfaaa8 mi_switch(104,0,1a886b5,22b,1f59f000,...) at mi_switch+0x1f3/frame 0x1ebfaae8 sleepq_switch(1f59f000,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1ebfab1c sleepq_catch_signals(1ebfab84,1085670,1b19f0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1ebfab60 sleepq_wait_sig(1b555ad0,0,1ebfaba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1ebfab84 _cv_wait_sig(1b555ad0,1b19f0c0,1ac69eb,481,0,...) at _cv_wait_sig+0x21f/frame 0x1ebfabc8 svc_run_internal(1ebfacd4,1065d9e,1b19f0c0,1ebface8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1ebfaca4 svc_thread_start(1b19f0c0,1ebface8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1ebfacac fork_exit(1365e00,1b19f0c0,1ebface8,3b,3b,...) at fork_exit+0x7e/frame 0x1ebfacd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ebfacd4 --- trap 0x20, eip = 0, esp = 0x1ebfad20, ebp = 0xffbfe84e --- (null)() at 0 Tracing command nfsd pid 565 tid 100149 td 0x1f5a5380 sched_switch(1f5a5380,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ebffaa8 mi_switch(104,0,1a886b5,22b,1f5a5380,...) at mi_switch+0x1f3/frame 0x1ebffae8 sleepq_switch(1f5a5380,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1ebffb1c sleepq_catch_signals(1ebffb84,1085670,1b19f0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1ebffb60 sleepq_wait_sig(1b555050,0,1ebffba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1ebffb84 _cv_wait_sig(1b555050,1b19f0c0,1ac69eb,481,0,...) at _cv_wait_sig+0x21f/frame 0x1ebffbc8 svc_run_internal(1ebffcd4,1065d9e,1b19f0c0,1ebffce8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1ebffca4 svc_thread_start(1b19f0c0,1ebffce8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1ebffcac fork_exit(1365e00,1b19f0c0,1ebffce8,3b,3b,...) at fork_exit+0x7e/frame 0x1ebffcd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ebffcd4 --- trap 0x20, eip = 0, esp = 0x1ebffd20, ebp = 0xffbfe84e --- (null)() at 0 Tracing command nfsd pid 565 tid 100150 td 0x1f5a5000 sched_switch(1f5a5000,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1d6a3aa8 mi_switch(104,0,1a886b5,22b,1f5a5000,...) at mi_switch+0x1f3/frame 0x1d6a3ae8 sleepq_switch(1f5a5000,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1d6a3b1c sleepq_catch_signals(1d6a3b84,1085670,1b19f0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1d6a3b60 sleepq_wait_sig(1b555b50,0,1d6a3ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1d6a3b84 _cv_wait_sig(1b555b50,1b19f0c0,1ac69eb,481,0,...) at _cv_wait_sig+0x21f/frame 0x1d6a3bc8 svc_run_internal(1d6a3cd4,1065d9e,1b19f0c0,1d6a3ce8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1d6a3ca4 svc_thread_start(1b19f0c0,1d6a3ce8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1d6a3cac fork_exit(1365e00,1b19f0c0,1d6a3ce8,3b,3b,...) at fork_exit+0x7e/frame 0x1d6a3cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1d6a3cd4 --- trap 0x20, eip = 0, esp = 0x1d6a3d20, ebp = 0xffbfe84e --- (null)() at 0 Tracing command nfsd pid 565 tid 100151 td 0x1f5a4a80 sched_switch(1f5a4a80,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1d6a8aa8 mi_switch(104,0,1a886b5,22b,1f5a4a80,...) at mi_switch+0x1f3/frame 0x1d6a8ae8 sleepq_switch(1f5a4a80,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1d6a8b1c sleepq_catch_signals(1d6a8b84,1085670,1b19f0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1d6a8b60 sleepq_wait_sig(1b554f50,0,1d6a8ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1d6a8b84 _cv_wait_sig(1b554f50,1b19f0c0,1ac69eb,481,2857afa0,...) at _cv_wait_sig+0x21f/frame 0x1d6a8bc8 svc_run_internal(1d6a8cd4,1065d9e,1b19f0c0,1d6a8ce8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1d6a8ca4 svc_thread_start(1b19f0c0,1d6a8ce8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1d6a8cac fork_exit(1365e00,1b19f0c0,1d6a8ce8,3b,3b,...) at fork_exit+0x7e/frame 0x1d6a8cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1d6a8cd4 --- trap 0x20, eip = 0, esp = 0x1d6a8d20, ebp = 0xffbfe84e --- (null)() at 0 Tracing command nfsd pid 565 tid 100152 td 0x1f5a4700 sched_switch(1f5a4700,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1d6adaa8 mi_switch(104,0,1a886b5,22b,1f5a4700,...) at mi_switch+0x1f3/frame 0x1d6adae8 sleepq_switch(1f5a4700,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1d6adb1c sleepq_catch_signals(1d6adb84,1085670,1b19f0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1d6adb60 sleepq_wait_sig(1b555bd0,0,1d6adba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1d6adb84 _cv_wait_sig(1b555bd0,1b19f0c0,1ac69eb,481,0,...) at _cv_wait_sig+0x21f/frame 0x1d6adbc8 svc_run_internal(1d6adcd4,1065d9e,1b19f0c0,1d6adce8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1d6adca4 svc_thread_start(1b19f0c0,1d6adce8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1d6adcac fork_exit(1365e00,1b19f0c0,1d6adce8,3b,3b,...) at fork_exit+0x7e/frame 0x1d6adcd4 fork_trampoline() at PTDpde+0x42da/frame 0x1d6adcd4 --- trap 0x20, eip = 0, esp = 0x1d6add20, ebp = 0xffbfe84e --- (null)() at 0 Tracing command nfsd pid 565 tid 100153 td 0x1f5a4380 sched_switch(1f5a4380,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1d6b2aa8 mi_switch(104,0,1a886b5,22b,1f5a4380,...) at mi_switch+0x1f3/frame 0x1d6b2ae8 sleepq_switch(1f5a4380,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1d6b2b1c sleepq_catch_signals(1d6b2b84,1085670,1b19f0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1d6b2b60 sleepq_wait_sig(1b554ed0,0,1d6b2ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1d6b2b84 _cv_wait_sig(1b554ed0,1b19f0c0,1ac69eb,481,2857afa0,...) at _cv_wait_sig+0x21f/frame 0x1d6b2bc8 svc_run_internal(1d6b2cd4,1065d9e,1b19f0c0,1d6b2ce8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1d6b2ca4 svc_thread_start(1b19f0c0,1d6b2ce8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1d6b2cac fork_exit(1365e00,1b19f0c0,1d6b2ce8,3b,3b,...) at fork_exit+0x7e/frame 0x1d6b2cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1d6b2cd4 --- trap 0x20, eip = 0, esp = 0x1d6b2d20, ebp = 0xffbfe84e --- (null)() at 0 Tracing command nfsd pid 565 tid 100154 td 0x1f5a4000 sched_switch(1f5a4000,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1d6b7aa8 mi_switch(104,0,1a886b5,22b,1f5a4000,...) at mi_switch+0x1f3/frame 0x1d6b7ae8 sleepq_switch(1f5a4000,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1d6b7b1c sleepq_catch_signals(1d6b7b84,1085670,1b19f0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0x1d6b7b60 sleepq_wait_sig(bff64d0,0,1d6b7ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0x1d6b7b84 _cv_wait_sig(bff64d0,1b19f0c0,1ac69eb,481,0,...) at _cv_wait_sig+0x21f/frame 0x1d6b7bc8 svc_run_internal(1d6b7cd4,1065d9e,1b19f0c0,1d6b7ce8,1a7773c,...) at svc_run_internal+0xc8b/frame 0x1d6b7ca4 svc_thread_start(1b19f0c0,1d6b7ce8,1a7773c,407,0,...) at svc_thread_start+0xd/frame 0x1d6b7cac fork_exit(1365e00,1b19f0c0,1d6b7ce8,3b,3b,...) at fork_exit+0x7e/frame 0x1d6b7cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1d6b7cd4 --- trap 0x20, eip = 0, esp = 0x1d6b7d20, ebp = 0xffbfe84e --- (null)() at 0 Tracing command nfsuserd pid 549 tid 100122 td 0x1f4a4700 sched_switch(1f4a4700,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1eb77890 mi_switch(104,0,1a886b5,22b,1f4a4700,...) at mi_switch+0x1f3/frame 0x1eb778d0 sleepq_switch(1f4a4700,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1eb77904 sleepq_catch_signals(8,1a7cce7,cb,1f4a4700,1f4a4700,...) at sleepq_catch_signals+0x360/frame 0x1eb77948 sleepq_timedwait_sig(1b1aaf64,0,1eb779ac,e0000000,1,...) at sleepq_timedwait_sig+0x17/frame 0x1eb77988 _cv_timedwait_sig_sbt(1b1aaf64,1b1aaf50,75e9c3e1,13c89,e0000000,...) at _cv_timedwait_sig_sbt+0x24a/frame 0x1eb779d0 seltdwait(13c89,e0000000,1,1f4a4700,0,...) at seltdwait+0x82/frame 0x1eb77a00 kern_select(1f4a4700,4,ffbfdb80,0,0,...) at kern_select+0x876/frame 0x1eb77ba0 sys_select(1f4a4700,1f4a4984,1a7717b,4,1c8ae43,...) at sys_select+0x68/frame 0x1eb77be8 syscall(1eb77ce8,3b,3b,3b,ffbfdb80,...) at syscall+0x6ee/frame 0x1eb77cdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x1eb77cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281ff07f, esp = 0xffbfdacc, ebp = 0xffbfdc18 --- _end() at 0x281ff07f Tracing command nfsuserd pid 548 tid 100107 td 0x1b020a80 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(1a866b4,0,1d2f2b4,1d2f398,151254f8,...) at db_trace_self_wrapper+0x2a/frame 0x15125478 kdb_backtrace(1a86731,151254f8,151255f8,167fb2e,1512552c,...) at kdb_backtrace+0x2d/frame 0x151254e0 kdb_reenter(1512552c,11057bf,1d2f46c,0,1a89241,...) at kdb_reenter+0x2a/frame 0x151254f0 trap(15125604,8,28,28,ffffffff,...) at trap+0xbe/frame 0x151255f8 calltrap() at PTDpde+0x4124/frame 0x151255f8 --- trap 0xc, eip = 0x1669589, esp = 0x15125644, ebp = 0x15125660 --- db_trace_thread(1b020a80,ffffffff,224,1870b,1b020a80,...) at db_trace_thread+0x29/frame 0x15125660 _db_stack_trace_all(10efe60,0,ffffffff,151256f8,1da1ad0,...) at _db_stack_trace_all+0xe9/frame 0x151256cc db_command(1da28f6,0,1da24e8,1da28f5,60,...) at db_command+0x297/frame 0x15125780 db_script_exec(1ffb798,0,15125828,1512581c,1da1ad0,...) at db_script_exec+0x168/frame 0x151257f0 db_command(16e0773,15125908,9d505d,16e0780,ffff0ff0,...) at db_command+0x297/frame 0x151258a4 db_command_loop(16e0780,ffff0ff0,151258cf,151258ce,9f18000,...) at db_command_loop+0x50/frame 0x151258b0 db_trap(3,ffff0ff0,7,0,1,...) at db_trap+0x10d/frame 0x15125908 kdb_trap(3,ffff0ff0,15125a50,1203ce8,88e,...) at kdb_trap+0x11e/frame 0x15125940 trap(15125a50,8,28,28,4,...) at trap+0x3d1/frame 0x15125a44 calltrap() at PTDpde+0x4124/frame 0x15125a44 --- trap 0x3, eip = 0x10efe60, esp = 0x15125a90, ebp = 0x15125aa0 --- kdb_alt_break_internal(0,15125acc,ea3577,2,1aff8888,...) at kdb_alt_break_internal+0xf0/frame 0x15125aa0 kdb_alt_break(2,1aff8888,1a3f113,0,40000,...) at kdb_alt_break+0x16/frame 0x15125aac uart_intr_rxready(1aff8800,13c88,be85d40,bfcfa80,15125af0,...) at uart_intr_rxready+0x87/frame 0x15125acc uart_intr(1aff8800,0,13c88,1,bfcfa80,...) at uart_intr+0x130/frame 0x15125b0c intr_event_handle(bfbea80,15125ba0,1f88f9c,9f75380,1,...) at intr_event_handle+0xa5/frame 0x15125b38 intr_execute_handlers(bff4130,15125ba0,3) at intr_execute_handlers+0xa5/frame 0x15125b70 lapic_handle_intr(32,15125ba0,8,28,28,...) at lapic_handle_intr+0x5e/frame 0x15125b90 Xapic_isr1_pti() at PTDpde+0x4bbf/frame 0x15125b90 --- interrupt, eip = 0x1698005, esp = 0x15125be0, ebp = 0x15125be0 --- acpi_cpu_c1(15125c34,16881d2,be85d50,0,1c8ae43,...) at acpi_cpu_c1+0x5/frame 0x15125be0 acpi_cpu_idle(1b196e03,0,1b196e03,15125c50,169860a,...) at acpi_cpu_idle+0x30b/frame 0x15125c20 cpu_idle_acpi(1b196e03,0,1f88f40,1,ffffffff,...) at cpu_idle_acpi+0x3f/frame 0x15125c34 cpu_idle(0,15125c80,1a83ce8,aea,1,...) at cpu_idle+0x9a/frame 0x15125c50 sched_idletd(0,15125ce8,1a7773c,407,0,...) at sched_idletd+0x236/frame 0x15125cac fork_exit(10d8c60,0,15125ce8,0,0,...) at fork_exit+0x7e/frame 0x15125cd4 fork_trampoline() at PTDpde+0x42da/frame 0x15125cd4 --- trap 0, eip = 0, esp = 0x15125d20, ebp = 0 --- (null)() at 0 Tracing command syslogd pid 409 tid 100116 td 0x9e66a80 sched_switch(9e66a80,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1eaf88b0 mi_switch(104,0,1a886b5,22b,9e66a80,...) at mi_switch+0x1f3/frame 0x1eaf88f0 sleepq_switch(9e66a80,0,1a886b5,1ca,0,...) at sleepq_switch+0x110/frame 0x1eaf8924 sleepq_catch_signals(1eaf898c,1085670,1b1ab220,0,0,...) at sleepq_catch_signals+0x360/frame 0x1eaf8968 sleepq_wait_sig(1b1ab224,0,1eaf89ac,101,0,...) at sleepq_wait_sig+0x14/frame 0x1eaf898c _cv_wait_sig(1b1ab224,1b1ab210,1a8bf2f,73c,1f116200,...) at _cv_wait_sig+0x21f/frame 0x1eaf89d0 seltdwait(ffffffff,0,0,9e66a80,0,...) at seltdwait+0xbb/frame 0x1eaf8a00 kern_select(9e66a80,a,280900c0,0,0,...) at kern_select+0x876/frame 0x1eaf8ba0 sys_select(9e66a80,9e66d04,1a7717b,4,1eaf8c28,...) at sys_select+0x68/frame 0x1eaf8be8 syscall(1eaf8ce8,3b,3b,3b,0,...) at syscall+0x6ee/frame 0x1eaf8cdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x1eaf8cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2821807f, esp = 0xffbfe874, ebp = 0xffbfe898 --- _end() at 0x2821807f Tracing command vnlru pid 24 tid 100102 td 0x9f74380 sched_switch(9f74380,0,104,189,1f881c0,...) at sched_switch+0x80c/frame 0x1ea9fb30 mi_switch(104,0,1a886b5,22b,9f74380,...) at mi_switch+0x1f3/frame 0x1ea9fb6c sleepq_switch(9f74380,0,1a886b5,2d6,13c89,...) at sleepq_switch+0x110/frame 0x1ea9fba0 sleepq_timedwait(1b7366b8,60,0,0,0,...) at sleepq_timedwait+0x53/frame 0x1ea9fbdc _sleep(1b7366b8,1ff4f8c,260,1a96b05,fffffed8,...) at _sleep+0x332/frame 0x1ea9fc30 vnlru_proc(0,1ea9fce8,1a7773c,407,0,...) at vnlru_proc+0xbc/frame 0x1ea9fcac fork_exit(1183180,0,1ea9fce8,0,0,...) at fork_exit+0x7e/frame 0x1ea9fcd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ea9fcd4 --- trap 0, eip = 0, esp = 0x1ea9fd20, ebp = 0 --- (null)() at 0 Tracing command syncer pid 23 tid 100100 td 0x9f74700 sched_switch(9f74700,0,104,189,1f88f40,...) at sched_switch+0x80c/frame 0x1ea95b48 mi_switch(104,0,1a886b5,22b,9f74700,...) at mi_switch+0x1f3/frame 0x1ea95b84 sleepq_switch(9f74700,0,1a886b5,2d6,9f74700,...) at sleepq_switch+0x110/frame 0x1ea95bb8 sleepq_timedwait(1ff4fe0,0,1ea95c1c,0,0,...) at sleepq_timedwait+0x53/frame 0x1ea95bf8 _cv_timedwait_sbt(1ff4fe0,1ff4fc0,fffffed8,0,0,...) at _cv_timedwait_sbt+0x24a/frame 0x1ea95c40 sched_sync(0,1ea95ce8,1a7773c,407,0,...) at sched_sync+0x6e0/frame 0x1ea95cac fork_exit(1183b00,0,1ea95ce8,0,0,...) at fork_exit+0x7e/frame 0x1ea95cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ea95cd4 --- trap 0, eip = 0, esp = 0x1ea95d20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 22 tid 100099 td 0x9f74a80 sched_switch(9f74a80,0,104,189,1f881c0,...) at sched_switch+0x80c/frame 0x1ea90b68 mi_switch(104,0,1a886b5,22b,9f74a80,...) at mi_switch+0x1f3/frame 0x1ea90ba4 sleepq_switch(9f74a80,0,1a886b5,2d6,13c89,...) at sleepq_switch+0x110/frame 0x1ea90bd8 sleepq_timedwait(1ff496c,54,0,0,0,...) at sleepq_timedwait+0x53/frame 0x1ea90c14 _sleep(1ff496c,1d50680,54,1a9332f,1999997c,...) at _sleep+0x332/frame 0x1ea90c68 buf_daemon(0,1ea90ce8,1a7773c,407,0,...) at buf_daemon+0xfc/frame 0x1ea90cac fork_exit(1160650,0,1ea90ce8,0,0,...) at fork_exit+0x7e/frame 0x1ea90cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ea90cd4 --- trap 0, eip = 0, esp = 0x1ea90d20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 22 tid 100101 td 0x1b2c5700 sched_switch(1b2c5700,0,104,189,1f88f40,...) at sched_switch+0x80c/frame 0x1ea9ab60 mi_switch(104,0,1a886b5,22b,1b2c5700,...) at mi_switch+0x1f3/frame 0x1ea9ab9c sleepq_switch(1b2c5700,0,1a886b5,2d6,13c89,...) at sleepq_switch+0x110/frame 0x1ea9abd0 sleepq_timedwait(1d51980,5c,0,0,0,...) at sleepq_timedwait+0x53/frame 0x1ea9ac0c _sleep(1d51980,1d518c0,25c,1a678bb,fffffed8,...) at _sleep+0x332/frame 0x1ea9ac60 bufspace_daemon(1d50780,1ea9ace8,1a7773c,407,0,...) at bufspace_daemon+0x349/frame 0x1ea9acac fork_exit(1160a50,1d50780,1ea9ace8,0,0,...) at fork_exit+0x7e/frame 0x1ea9acd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ea9acd4 --- trap 0, eip = 0, esp = 0x1ea9ad20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 22 tid 100112 td 0x9f73a80 sched_switch(9f73a80,0,104,189,1f88f40,...) at sched_switch+0x80c/frame 0x1eae0b70 mi_switch(104,0,1a886b5,22b,9f73a80,...) at mi_switch+0x1f3/frame 0x1eae0bac sleepq_switch(9f73a80,0,1a886b5,2d6,13c89,...) at sleepq_switch+0x110/frame 0x1eae0be0 sleepq_timedwait(1ee15884,54,0,0,0,...) at sleepq_timedwait+0x53/frame 0x1eae0c1c _sleep(1ee15884,1ee15800,54,1aceb21,7fffff6c,...) at _sleep+0x332/frame 0x1eae0c70 softdep_flush(1ec1d000,1eae0ce8,1a7773c,407,0,...) at softdep_flush+0x199/frame 0x1eae0cac fork_exit(13aa1c0,1ec1d000,1eae0ce8,0,0,...) at fork_exit+0x7e/frame 0x1eae0cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1eae0cd4 --- trap 0, eip = 0, esp = 0x1eae0d20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 22 tid 100113 td 0x9f73700 sched_switch(9f73700,0,104,189,1f881c0,...) at sched_switch+0x80c/frame 0x1eae5b70 mi_switch(104,0,1a886b5,22b,9f73700,...) at mi_switch+0x1f3/frame 0x1eae5bac sleepq_switch(9f73700,0,1a886b5,2d6,13c89,...) at sleepq_switch+0x110/frame 0x1eae5be0 sleepq_timedwait(1ee15684,54,0,0,0,...) at sleepq_timedwait+0x53/frame 0x1eae5c1c _sleep(1ee15684,1ee15600,54,1aceb21,7fffff6c,...) at _sleep+0x332/frame 0x1eae5c70 softdep_flush(1ec1c000,1eae5ce8,1a7773c,407,0,...) at softdep_flush+0x199/frame 0x1eae5cac fork_exit(13aa1c0,1ec1c000,1eae5ce8,0,0,...) at fork_exit+0x7e/frame 0x1eae5cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1eae5cd4 --- trap 0, eip = 0, esp = 0x1eae5d20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 22 tid 100114 td 0x9f73380 sched_switch(9f73380,0,104,189,1f88880,...) at sched_switch+0x80c/frame 0x1eaeab70 mi_switch(104,0,1a886b5,22b,9f73380,...) at mi_switch+0x1f3/frame 0x1eaeabac sleepq_switch(9f73380,0,1a886b5,2d6,13c89,...) at sleepq_switch+0x110/frame 0x1eaeabe0 sleepq_timedwait(1ee15484,54,0,0,0,...) at sleepq_timedwait+0x53/frame 0x1eaeac1c _sleep(1ee15484,1ee15400,54,1aceb21,7fffff6c,...) at _sleep+0x332/frame 0x1eaeac70 softdep_flush(1ef46000,1eaeace8,1a7773c,407,0,...) at softdep_flush+0x199/frame 0x1eaeacac fork_exit(13aa1c0,1ef46000,1eaeace8,0,0,...) at fork_exit+0x7e/frame 0x1eaeacd4 fork_trampoline() at PTDpde+0x42da/frame 0x1eaeacd4 --- trap 0, eip = 0, esp = 0x1eaead20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 22 tid 100115 td 0x9f73000 sched_switch(9f73000,0,104,189,1f87b00,...) at sched_switch+0x80c/frame 0x1eaefb70 mi_switch(104,0,1a886b5,22b,9f73000,...) at mi_switch+0x1f3/frame 0x1eaefbac sleepq_switch(9f73000,0,1a886b5,2d6,13c89,...) at sleepq_switch+0x110/frame 0x1eaefbe0 sleepq_timedwait(1ee15284,54,0,0,0,...) at sleepq_timedwait+0x53/frame 0x1eaefc1c _sleep(1ee15284,1ee15200,54,1aceb21,7fffff6c,...) at _sleep+0x332/frame 0x1eaefc70 softdep_flush(1ef45000,1eaefce8,1a7773c,407,0,...) at softdep_flush+0x199/frame 0x1eaefcac fork_exit(13aa1c0,1ef45000,1eaefce8,0,0,...) at fork_exit+0x7e/frame 0x1eaefcd4 fork_trampoline() at PTDpde+0x42da/frame 0x1eaefcd4 --- trap 0, eip = 0, esp = 0x1eaefd20, ebp = 0 --- (null)() at 0 Tracing command vmdaemon pid 21 tid 100096 td 0x9f75000 sched_switch(9f75000,0,104,189,1f88f40,...) at sched_switch+0x80c/frame 0x1abfdb50 mi_switch(104,0,1a886b5,22b,9f75000,...) at mi_switch+0x1f3/frame 0x1abfdb8c sleepq_switch(9f75000,0,1a886b5,2b3,9f75000,...) at sleepq_switch+0x110/frame 0x1abfdbc0 sleepq_wait(1ff9f6c,74,1a93328,0,0,...) at sleepq_wait+0x48/frame 0x1abfdbe4 _sleep(1ff9f6c,1ff9f58,74,1a93328,0,...) at _sleep+0x396/frame 0x1abfdc38 vm_daemon(0,1abfdce8,1a7773c,407,0,...) at vm_daemon+0xa6/frame 0x1abfdcac fork_exit(1418770,0,1abfdce8,0,0,...) at fork_exit+0x7e/frame 0x1abfdcd4 fork_trampoline() at PTDpde+0x42da/frame 0x1abfdcd4 --- trap 0, eip = 0, esp = 0x1abfdd20, ebp = 0 --- (null)() at 0 Tracing command pagedaemon pid 20 tid 100095 td 0x9f75380 sched_switch(9f75380,0,104,189,1f88f40,...) at sched_switch+0x80c/frame 0x1abf8938 mi_switch(104,0,1a886b5,22b,9f75380,...) at mi_switch+0x1f3/frame 0x1abf8974 sleepq_switch(9f75380,0,1a886b5,2d6,13c89,...) at sleepq_switch+0x110/frame 0x1abf89a8 sleepq_timedwait(1f797bb,0,0,0,0,...) at sleepq_timedwait+0x53/frame 0x1abf89e8 _sleep(1f797bb,0,0,1a7df5c,1999997c,...) at _sleep+0x332/frame 0x1abf8a3c pause_sbt(1a7df5c,1999997c,0,0,0,...) at pause_sbt+0x12c/frame 0x1abf8a78 vm_pageout_worker(0,0,bfca35c,0,0,...) at vm_pageout_worker+0x436/frame 0x1abf8c7c vm_pageout(0,1abf8ce8,1a7773c,407,0,...) at vm_pageout+0x16a/frame 0x1abf8cac fork_exit(140d060,0,1abf8ce8,0,0,...) at fork_exit+0x7e/frame 0x1abf8cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1abf8cd4 --- trap 0, eip = 0, esp = 0x1abf8d20, ebp = 0 --- (null)() at 0 Tracing command pagedaemon pid 20 tid 100097 td 0x1b1ae000 sched_switch(1b1ae000,0,104,189,1f88880,...) at sched_switch+0x80c/frame 0x1ea869b8 mi_switch(104,0,1a886b5,22b,1b1ae000,...) at mi_switch+0x1f3/frame 0x1ea869f4 sleepq_switch(1b1ae000,0,1a886b5,2d6,13c89,...) at sleepq_switch+0x110/frame 0x1ea86a28 sleepq_timedwait(1f797ba,0,0,0,0,...) at sleepq_timedwait+0x53/frame 0x1ea86a68 _sleep(1f797ba,0,0,1ad79c7,1999997c,...) at _sleep+0x332/frame 0x1ea86abc pause_sbt(1ad79c7,1999997c,0,0,0,...) at pause_sbt+0x12c/frame 0x1ea86af8 vm_pageout_laundry_worker(0,1ea86ce8,1a7773c,407,0,...) at vm_pageout_laundry_worker+0x107f/frame 0x1ea86cac fork_exit(140d230,0,1ea86ce8,0,0,...) at fork_exit+0x7e/frame 0x1ea86cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ea86cd4 --- trap 0, eip = 0, esp = 0x1ea86d20, ebp = 0 --- (null)() at 0 Tracing command pagedaemon pid 20 tid 100098 td 0x1b1ada80 sched_switch(1b1ada80,0,104,189,1f881c0,...) at sched_switch+0x80c/frame 0x1ea8bb70 mi_switch(104,0,1a886b5,22b,1b1ada80,...) at mi_switch+0x1f3/frame 0x1ea8bbac sleepq_switch(1b1ada80,0,1a886b5,2d6,1f978c4,...) at sleepq_switch+0x110/frame 0x1ea8bbe0 sleepq_timedwait(13e9df0,54,1ea8bc50,0,0,...) at sleepq_timedwait+0x53/frame 0x1ea8bc20 _sleep(13e9df0,1ff9c1c,54,1ad3adb,fffffed8,...) at _sleep+0x332/frame 0x1ea8bc74 uma_reclaim_worker(0,1ea8bce8,1a7773c,407,0,...) at uma_reclaim_worker+0x147/frame 0x1ea8bcac fork_exit(13ea480,0,1ea8bce8,0,0,...) at fork_exit+0x7e/frame 0x1ea8bcd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ea8bcd4 --- trap 0, eip = 0, esp = 0x1ea8bd20, ebp = 0 --- (null)() at 0 Tracing command rand_harvestq pid 19 tid 100092 td 0x1b2ce380 sched_switch(1b2ce380,0,104,189,1f87b00,...) at sched_switch+0x80c/frame 0x1abe9b48 mi_switch(104,0,1a886b5,22b,1b2ce380,...) at mi_switch+0x1f3/frame 0x1abe9b84 sleepq_switch(1b2ce380,0,1a886b5,2d6,13c89,...) at sleepq_switch+0x110/frame 0x1abe9bb8 sleepq_timedwait(1e52b20,0,0,0,0,...) at sleepq_timedwait+0x53/frame 0x1abe9bf4 _sleep(1e52b20,0,0,1a678bb,19999999,...) at _sleep+0x332/frame 0x1abe9c48 random_kthread(0,1abe9ce8,1a7773c,407,0,...) at random_kthread+0x7c/frame 0x1abe9cac fork_exit(db0980,0,1abe9ce8,0,0,...) at fork_exit+0x7e/frame 0x1abe9cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1abe9cd4 --- trap 0, eip = 0, esp = 0x1abe9d20, ebp = 0 --- (null)() at 0 Tracing command sctp_iterator pid 18 tid 100088 td 0x1b2cf380 sched_switch(1b2cf380,0,104,189,1f88880,...) at sched_switch+0x80c/frame 0x1abd5b98 mi_switch(104,0,1a886b5,22b,1b2cf380,...) at mi_switch+0x1f3/frame 0x1abd5bd4 sleepq_switch(1b2cf380,0,1a886b5,2b3,1b2cf380,...) at sleepq_switch+0x110/frame 0x1abd5c08 sleepq_wait(20234e0,0,1ab1463,0,0,...) at sleepq_wait+0x48/frame 0x1abd5c2c _sleep(20234e0,20234a8,0,1ab1463,0,...) at _sleep+0x396/frame 0x1abd5c80 sctp_iterator_thread(0,1abd5ce8,1a7773c,407,0,...) at sctp_iterator_thread+0x7c/frame 0x1abd5cac fork_exit(124f680,0,1abd5ce8,0,0,...) at fork_exit+0x7e/frame 0x1abd5cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1abd5cd4 --- trap 0, eip = 0, esp = 0x1abd5d20, ebp = 0 --- (null)() at 0 Tracing command soaiod4 pid 17 tid 100087 td 0x1b1ae380 sched_switch(1b1ae380,0,104,189,1f881c0,...) at sched_switch+0x80c/frame 0x1abcfb70 mi_switch(104,0,1a886b5,22b,1b1ae380,...) at mi_switch+0x1f3/frame 0x1abcfbac sleepq_switch(1b1ae380,0,1a886b5,2d6,13c9a,...) at sleepq_switch+0x110/frame 0x1abcfbe0 sleepq_timedwait(1ff4598,0,1d,0,0,...) at sleepq_timedwait+0x53/frame 0x1abcfc1c _sleep(1ff4598,1ff4578,0,1a678bb,ffffdd50,...) at _sleep+0x332/frame 0x1abcfc70 soaio_kproc_loop(4,1abcfce8,1a7773c,407,0,...) at soaio_kproc_loop+0x1a7/frame 0x1abcfcac fork_exit(1120640,4,1abcfce8,0,0,...) at fork_exit+0x7e/frame 0x1abcfcd4 fork_trampoline() at PTDpde+0x42da/frame 0x1abcfcd4 --- trap 0, eip = 0, esp = 0x1abcfd20, ebp = 0 --- (null)() at 0 Tracing command soaiod3 pid 16 tid 100086 td 0x1b1ae700 sched_switch(1b1ae700,0,104,189,1f88f40,...) at sched_switch+0x80c/frame 0x1abcab70 mi_switch(104,0,1a886b5,22b,1b1ae700,...) at mi_switch+0x1f3/frame 0x1abcabac sleepq_switch(1b1ae700,0,1a886b5,2d6,13c9b,...) at sleepq_switch+0x110/frame 0x1abcabe0 sleepq_timedwait(1ff4598,0,1d,0,0,...) at sleepq_timedwait+0x53/frame 0x1abcac1c _sleep(1ff4598,1ff4578,0,1a678bb,ffffdd50,...) at _sleep+0x332/frame 0x1abcac70 soaio_kproc_loop(3,1abcace8,1a7773c,407,0,...) at soaio_kproc_loop+0x1a7/frame 0x1abcacac fork_exit(1120640,3,1abcace8,0,0,...) at fork_exit+0x7e/frame 0x1abcacd4 fork_trampoline() at PTDpde+0x42da/frame 0x1abcacd4 --- trap 0, eip = 0, esp = 0x1abcad20, ebp = 0 --- (null)() at 0 Tracing command soaiod2 pid 15 tid 100085 td 0x1b1aea80 sched_switch(1b1aea80,0,104,189,1f88880,...) at sched_switch+0x80c/frame 0x1abc5b70 mi_switch(104,0,1a886b5,22b,1b1aea80,...) at mi_switch+0x1f3/frame 0x1abc5bac sleepq_switch(1b1aea80,0,1a886b5,2d6,13c9d,...) at sleepq_switch+0x110/frame 0x1abc5be0 sleepq_timedwait(1ff4598,0,1d,0,0,...) at sleepq_timedwait+0x53/frame 0x1abc5c1c _sleep(1ff4598,1ff4578,0,1a678bb,ffffdd50,...) at _sleep+0x332/frame 0x1abc5c70 soaio_kproc_loop(2,1abc5ce8,1a7773c,407,0,...) at soaio_kproc_loop+0x1a7/frame 0x1abc5cac fork_exit(1120640,2,1abc5ce8,0,0,...) at fork_exit+0x7e/frame 0x1abc5cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1abc5cd4 --- trap 0, eip = 0, esp = 0x1abc5d20, ebp = 0 --- (null)() at 0 Tracing command soaiod1 pid 9 tid 100084 td 0x1b1af000 sched_switch(1b1af000,0,104,189,1f881c0,...) at sched_switch+0x80c/frame 0x1abc0b70 mi_switch(104,0,1a886b5,22b,1b1af000,...) at mi_switch+0x1f3/frame 0x1abc0bac sleepq_switch(1b1af000,0,1a886b5,2d6,13c9b,...) at sleepq_switch+0x110/frame 0x1abc0be0 sleepq_timedwait(1ff4598,0,1d,0,0,...) at sleepq_timedwait+0x53/frame 0x1abc0c1c _sleep(1ff4598,1ff4578,0,1a678bb,ffffdd50,...) at _sleep+0x332/frame 0x1abc0c70 soaio_kproc_loop(1,1abc0ce8,1a7773c,407,0,...) at soaio_kproc_loop+0x1a7/frame 0x1abc0cac fork_exit(1120640,1,1abc0ce8,0,0,...) at fork_exit+0x7e/frame 0x1abc0cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1abc0cd4 --- trap 0, eip = 0, esp = 0x1abc0d20, ebp = 0 --- (null)() at 0 Tracing command fdc0 pid 8 tid 100081 td 0x1b021a80 sched_switch(1b021a80,0,104,189,1f88f40,...) at sched_switch+0x80c/frame 0x1abb1b40 mi_switch(104,0,1a886b5,22b,1b021a80,...) at mi_switch+0x1f3/frame 0x1abb1b7c sleepq_switch(1b021a80,0,1a886b5,2b3,1b021a80,...) at sleepq_switch+0x110/frame 0x1abb1bb0 sleepq_wait(1ac7523c,5c,1a678bb,0,0,...) at sleepq_wait+0x48/frame 0x1abb1bd4 _sleep(1ac7523c,1ac752f0,5c,1a678bb,0,...) at _sleep+0x396/frame 0x1abb1c28 fdc_thread(1ac75200,1abb1ce8,1a7773c,407,0,...) at fdc_thread+0x336/frame 0x1abb1cac fork_exit(15ec400,1ac75200,1abb1ce8,0,0,...) at fork_exit+0x7e/frame 0x1abb1cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1abb1cd4 --- trap 0, eip = 0, esp = 0x1abb1d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100046 td 0x1acd2000 sched_switch(1acd2000,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1aaf9ba8 mi_switch(104,0,1a886b5,22b,1acd2000,...) at mi_switch+0x1f3/frame 0x1aaf9be8 sleepq_switch(1acd2000,0,1a886b5,2b3,1d446c8,...) at sleepq_switch+0x110/frame 0x1aaf9c1c sleepq_wait(1acb0acc,0,1aaf9c60,1,0,...) at sleepq_wait+0x48/frame 0x1aaf9c40 _cv_wait(1acb0acc,1acb0cf8,1a49356,78,1acb0ad4,...) at _cv_wait+0x21f/frame 0x1aaf9c84 usb_process(1acb0ac4,1aaf9ce8,1a7773c,407,0,...) at usb_process+0x140/frame 0x1aaf9cac fork_exit(ee1210,1acb0ac4,1aaf9ce8,0,0,...) at fork_exit+0x7e/frame 0x1aaf9cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aaf9cd4 --- trap 0, eip = 0, esp = 0x1aaf9d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100047 td 0x1acd1a80 sched_switch(1acd1a80,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1aafeba8 mi_switch(104,0,1a886b5,22b,1acd1a80,...) at mi_switch+0x1f3/frame 0x1aafebe8 sleepq_switch(1acd1a80,0,1a886b5,2b3,1d446c8,...) at sleepq_switch+0x110/frame 0x1aafec1c sleepq_wait(1acb0afc,0,1aafec60,1,0,...) at sleepq_wait+0x48/frame 0x1aafec40 _cv_wait(1acb0afc,1acb0cf8,1a49356,78,1acb0b04,...) at _cv_wait+0x21f/frame 0x1aafec84 usb_process(1acb0af4,1aafece8,1a7773c,407,0,...) at usb_process+0x140/frame 0x1aafecac fork_exit(ee1210,1acb0af4,1aafece8,0,0,...) at fork_exit+0x7e/frame 0x1aafecd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aafecd4 --- trap 0, eip = 0, esp = 0x1aafed20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100048 td 0x1acd1700 sched_switch(1acd1700,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ab03ba8 mi_switch(104,0,1a886b5,22b,1acd1700,...) at mi_switch+0x1f3/frame 0x1ab03be8 sleepq_switch(1acd1700,0,1a886b5,2b3,1d446c8,...) at sleepq_switch+0x110/frame 0x1ab03c1c sleepq_wait(1acb0b2c,0,1ab03c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab03c40 _cv_wait(1acb0b2c,1acb0cf8,1a49356,78,1acb0b34,...) at _cv_wait+0x21f/frame 0x1ab03c84 usb_process(1acb0b24,1ab03ce8,1a7773c,407,0,...) at usb_process+0x140/frame 0x1ab03cac fork_exit(ee1210,1acb0b24,1ab03ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab03cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ab03cd4 --- trap 0, eip = 0, esp = 0x1ab03d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100049 td 0x1acd1380 sched_switch(1acd1380,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ab08ba8 mi_switch(104,0,1a886b5,22b,1acd1380,...) at mi_switch+0x1f3/frame 0x1ab08be8 sleepq_switch(1acd1380,0,1a886b5,2b3,1d446c8,...) at sleepq_switch+0x110/frame 0x1ab08c1c sleepq_wait(1acb0b5c,0,1ab08c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab08c40 _cv_wait(1acb0b5c,1acb0cf8,1a49356,78,1acb0b64,...) at _cv_wait+0x21f/frame 0x1ab08c84 usb_process(1acb0b54,1ab08ce8,1a7773c,407,0,...) at usb_process+0x140/frame 0x1ab08cac fork_exit(ee1210,1acb0b54,1ab08ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab08cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ab08cd4 --- trap 0, eip = 0, esp = 0x1ab08d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100050 td 0x1acd1000 sched_switch(1acd1000,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ab0dba8 mi_switch(104,0,1a886b5,22b,1acd1000,...) at mi_switch+0x1f3/frame 0x1ab0dbe8 sleepq_switch(1acd1000,0,1a886b5,2b3,1d446c8,...) at sleepq_switch+0x110/frame 0x1ab0dc1c sleepq_wait(1acb0b8c,0,1ab0dc60,1,0,...) at sleepq_wait+0x48/frame 0x1ab0dc40 _cv_wait(1acb0b8c,1acb0cf8,1a49356,78,1acb0b94,...) at _cv_wait+0x21f/frame 0x1ab0dc84 usb_process(1acb0b84,1ab0dce8,1a7773c,407,0,...) at usb_process+0x140/frame 0x1ab0dcac fork_exit(ee1210,1acb0b84,1ab0dce8,0,0,...) at fork_exit+0x7e/frame 0x1ab0dcd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ab0dcd4 --- trap 0, eip = 0, esp = 0x1ab0dd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100052 td 0x1acc0700 sched_switch(1acc0700,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ab18ba8 mi_switch(104,0,1a886b5,22b,1acc0700,...) at mi_switch+0x1f3/frame 0x1ab18be8 sleepq_switch(1acc0700,0,1a886b5,2b3,1d446c8,...) at sleepq_switch+0x110/frame 0x1ab18c1c sleepq_wait(1af8aacc,0,1ab18c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab18c40 _cv_wait(1af8aacc,1af8acf8,1a49356,78,1af8aad4,...) at _cv_wait+0x21f/frame 0x1ab18c84 usb_process(1af8aac4,1ab18ce8,1a7773c,407,0,...) at usb_process+0x140/frame 0x1ab18cac fork_exit(ee1210,1af8aac4,1ab18ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab18cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ab18cd4 --- trap 0, eip = 0, esp = 0x1ab18d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100053 td 0x1acc0380 sched_switch(1acc0380,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ab1dba8 mi_switch(104,0,1a886b5,22b,1acc0380,...) at mi_switch+0x1f3/frame 0x1ab1dbe8 sleepq_switch(1acc0380,0,1a886b5,2b3,1d446c8,...) at sleepq_switch+0x110/frame 0x1ab1dc1c sleepq_wait(1af8aafc,0,1ab1dc60,1,0,...) at sleepq_wait+0x48/frame 0x1ab1dc40 _cv_wait(1af8aafc,1af8acf8,1a49356,78,1af8ab04,...) at _cv_wait+0x21f/frame 0x1ab1dc84 usb_process(1af8aaf4,1ab1dce8,1a7773c,407,0,...) at usb_process+0x140/frame 0x1ab1dcac fork_exit(ee1210,1af8aaf4,1ab1dce8,0,0,...) at fork_exit+0x7e/frame 0x1ab1dcd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ab1dcd4 --- trap 0, eip = 0, esp = 0x1ab1dd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100054 td 0x1acc0000 sched_switch(1acc0000,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ab22ba8 mi_switch(104,0,1a886b5,22b,1acc0000,...) at mi_switch+0x1f3/frame 0x1ab22be8 sleepq_switch(1acc0000,0,1a886b5,2b3,1d446c8,...) at sleepq_switch+0x110/frame 0x1ab22c1c sleepq_wait(1af8ab2c,0,1ab22c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab22c40 _cv_wait(1af8ab2c,1af8acf8,1a49356,78,1af8ab34,...) at _cv_wait+0x21f/frame 0x1ab22c84 usb_process(1af8ab24,1ab22ce8,1a7773c,407,0,...) at usb_process+0x140/frame 0x1ab22cac fork_exit(ee1210,1af8ab24,1ab22ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab22cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ab22cd4 --- trap 0, eip = 0, esp = 0x1ab22d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100055 td 0x1af90380 sched_switch(1af90380,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ab27ba8 mi_switch(104,0,1a886b5,22b,1af90380,...) at mi_switch+0x1f3/frame 0x1ab27be8 sleepq_switch(1af90380,0,1a886b5,2b3,1d446c8,...) at sleepq_switch+0x110/frame 0x1ab27c1c sleepq_wait(1af8ab5c,0,1ab27c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab27c40 _cv_wait(1af8ab5c,1af8acf8,1a49356,78,1af8ab64,...) at _cv_wait+0x21f/frame 0x1ab27c84 usb_process(1af8ab54,1ab27ce8,1a7773c,407,0,...) at usb_process+0x140/frame 0x1ab27cac fork_exit(ee1210,1af8ab54,1ab27ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab27cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ab27cd4 --- trap 0, eip = 0, esp = 0x1ab27d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100056 td 0x1af90000 sched_switch(1af90000,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ab2cba8 mi_switch(104,0,1a886b5,22b,1af90000,...) at mi_switch+0x1f3/frame 0x1ab2cbe8 sleepq_switch(1af90000,0,1a886b5,2b3,1d446c8,...) at sleepq_switch+0x110/frame 0x1ab2cc1c sleepq_wait(1af8ab8c,0,1ab2cc60,1,0,...) at sleepq_wait+0x48/frame 0x1ab2cc40 _cv_wait(1af8ab8c,1af8acf8,1a49356,78,1af8ab94,...) at _cv_wait+0x21f/frame 0x1ab2cc84 usb_process(1af8ab84,1ab2cce8,1a7773c,407,0,...) at usb_process+0x140/frame 0x1ab2ccac fork_exit(ee1210,1af8ab84,1ab2cce8,0,0,...) at fork_exit+0x7e/frame 0x1ab2ccd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ab2ccd4 --- trap 0, eip = 0, esp = 0x1ab2cd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100058 td 0x1af8f700 sched_switch(1af8f700,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ab37ba8 mi_switch(104,0,1a886b5,22b,1af8f700,...) at mi_switch+0x1f3/frame 0x1ab37be8 sleepq_switch(1af8f700,0,1a886b5,2b3,1d446c8,...) at sleepq_switch+0x110/frame 0x1ab37c1c sleepq_wait(1af9facc,0,1ab37c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab37c40 _cv_wait(1af9facc,1af9fcf8,1a49356,78,1af9fad4,...) at _cv_wait+0x21f/frame 0x1ab37c84 usb_process(1af9fac4,1ab37ce8,1a7773c,407,0,...) at usb_process+0x140/frame 0x1ab37cac fork_exit(ee1210,1af9fac4,1ab37ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab37cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ab37cd4 --- trap 0, eip = 0, esp = 0x1ab37d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100059 td 0x1af8f380 sched_switch(1af8f380,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ab3cba8 mi_switch(104,0,1a886b5,22b,1af8f380,...) at mi_switch+0x1f3/frame 0x1ab3cbe8 sleepq_switch(1af8f380,0,1a886b5,2b3,1d446c8,...) at sleepq_switch+0x110/frame 0x1ab3cc1c sleepq_wait(1af9fafc,0,1ab3cc60,1,0,...) at sleepq_wait+0x48/frame 0x1ab3cc40 _cv_wait(1af9fafc,1af9fcf8,1a49356,78,1af9fb04,...) at _cv_wait+0x21f/frame 0x1ab3cc84 usb_process(1af9faf4,1ab3cce8,1a7773c,407,0,...) at usb_process+0x140/frame 0x1ab3ccac fork_exit(ee1210,1af9faf4,1ab3cce8,0,0,...) at fork_exit+0x7e/frame 0x1ab3ccd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ab3ccd4 --- trap 0, eip = 0, esp = 0x1ab3cd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100060 td 0x1af8f000 sched_switch(1af8f000,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ab41ba8 mi_switch(104,0,1a886b5,22b,1af8f000,...) at mi_switch+0x1f3/frame 0x1ab41be8 sleepq_switch(1af8f000,0,1a886b5,2b3,1d446c8,...) at sleepq_switch+0x110/frame 0x1ab41c1c sleepq_wait(1af9fb2c,0,1ab41c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab41c40 _cv_wait(1af9fb2c,1af9fcf8,1a49356,78,1af9fb34,...) at _cv_wait+0x21f/frame 0x1ab41c84 usb_process(1af9fb24,1ab41ce8,1a7773c,407,0,...) at usb_process+0x140/frame 0x1ab41cac fork_exit(ee1210,1af9fb24,1ab41ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab41cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ab41cd4 --- trap 0, eip = 0, esp = 0x1ab41d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100061 td 0x1af8ea80 sched_switch(1af8ea80,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ab46ba8 mi_switch(104,0,1a886b5,22b,1af8ea80,...) at mi_switch+0x1f3/frame 0x1ab46be8 sleepq_switch(1af8ea80,0,1a886b5,2b3,1d446c8,...) at sleepq_switch+0x110/frame 0x1ab46c1c sleepq_wait(1af9fb5c,0,1ab46c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab46c40 _cv_wait(1af9fb5c,1af9fcf8,1a49356,78,1af9fb64,...) at _cv_wait+0x21f/frame 0x1ab46c84 usb_process(1af9fb54,1ab46ce8,1a7773c,407,0,...) at usb_process+0x140/frame 0x1ab46cac fork_exit(ee1210,1af9fb54,1ab46ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab46cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ab46cd4 --- trap 0, eip = 0, esp = 0x1ab46d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100062 td 0x1af8e700 sched_switch(1af8e700,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ab4bba8 mi_switch(104,0,1a886b5,22b,1af8e700,...) at mi_switch+0x1f3/frame 0x1ab4bbe8 sleepq_switch(1af8e700,0,1a886b5,2b3,1d446c8,...) at sleepq_switch+0x110/frame 0x1ab4bc1c sleepq_wait(1af9fb8c,0,1ab4bc60,1,0,...) at sleepq_wait+0x48/frame 0x1ab4bc40 _cv_wait(1af9fb8c,1af9fcf8,1a49356,78,1af9fb94,...) at _cv_wait+0x21f/frame 0x1ab4bc84 usb_process(1af9fb84,1ab4bce8,1a7773c,407,0,...) at usb_process+0x140/frame 0x1ab4bcac fork_exit(ee1210,1af9fb84,1ab4bce8,0,0,...) at fork_exit+0x7e/frame 0x1ab4bcd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ab4bcd4 --- trap 0, eip = 0, esp = 0x1ab4bd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100063 td 0x1af8e380 sched_switch(1af8e380,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ab51ba8 mi_switch(104,0,1a886b5,22b,1af8e380,...) at mi_switch+0x1f3/frame 0x1ab51be8 sleepq_switch(1af8e380,0,1a886b5,2b3,1d446c8,...) at sleepq_switch+0x110/frame 0x1ab51c1c sleepq_wait(1afa3acc,0,1ab51c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab51c40 _cv_wait(1afa3acc,1afa3cf8,1a49356,78,1afa3ad4,...) at _cv_wait+0x21f/frame 0x1ab51c84 usb_process(1afa3ac4,1ab51ce8,1a7773c,407,0,...) at usb_process+0x140/frame 0x1ab51cac fork_exit(ee1210,1afa3ac4,1ab51ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab51cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ab51cd4 --- trap 0, eip = 0, esp = 0x1ab51d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100064 td 0x1af8e000 sched_switch(1af8e000,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ab56ba8 mi_switch(104,0,1a886b5,22b,1af8e000,...) at mi_switch+0x1f3/frame 0x1ab56be8 sleepq_switch(1af8e000,0,1a886b5,2b3,1d446c8,...) at sleepq_switch+0x110/frame 0x1ab56c1c sleepq_wait(1afa3afc,0,1ab56c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab56c40 _cv_wait(1afa3afc,1afa3cf8,1a49356,78,1afa3b04,...) at _cv_wait+0x21f/frame 0x1ab56c84 usb_process(1afa3af4,1ab56ce8,1a7773c,407,0,...) at usb_process+0x140/frame 0x1ab56cac fork_exit(ee1210,1afa3af4,1ab56ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab56cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ab56cd4 --- trap 0, eip = 0, esp = 0x1ab56d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100065 td 0x1acd3a80 sched_switch(1acd3a80,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ab5bba8 mi_switch(104,0,1a886b5,22b,1acd3a80,...) at mi_switch+0x1f3/frame 0x1ab5bbe8 sleepq_switch(1acd3a80,0,1a886b5,2b3,1d446c8,...) at sleepq_switch+0x110/frame 0x1ab5bc1c sleepq_wait(1afa3b2c,0,1ab5bc60,1,0,...) at sleepq_wait+0x48/frame 0x1ab5bc40 _cv_wait(1afa3b2c,1afa3cf8,1a49356,78,1afa3b34,...) at _cv_wait+0x21f/frame 0x1ab5bc84 usb_process(1afa3b24,1ab5bce8,1a7773c,407,0,...) at usb_process+0x140/frame 0x1ab5bcac fork_exit(ee1210,1afa3b24,1ab5bce8,0,0,...) at fork_exit+0x7e/frame 0x1ab5bcd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ab5bcd4 --- trap 0, eip = 0, esp = 0x1ab5bd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100066 td 0x1acd3700 sched_switch(1acd3700,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ab60ba8 mi_switch(104,0,1a886b5,22b,1acd3700,...) at mi_switch+0x1f3/frame 0x1ab60be8 sleepq_switch(1acd3700,0,1a886b5,2b3,1d446c8,...) at sleepq_switch+0x110/frame 0x1ab60c1c sleepq_wait(1afa3b5c,0,1ab60c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab60c40 _cv_wait(1afa3b5c,1afa3cf8,1a49356,78,1afa3b64,...) at _cv_wait+0x21f/frame 0x1ab60c84 usb_process(1afa3b54,1ab60ce8,1a7773c,407,0,...) at usb_process+0x140/frame 0x1ab60cac fork_exit(ee1210,1afa3b54,1ab60ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab60cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ab60cd4 --- trap 0, eip = 0, esp = 0x1ab60d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100067 td 0x1acd3380 sched_switch(1acd3380,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ab65ba8 mi_switch(104,0,1a886b5,22b,1acd3380,...) at mi_switch+0x1f3/frame 0x1ab65be8 sleepq_switch(1acd3380,0,1a886b5,2b3,1d446c8,...) at sleepq_switch+0x110/frame 0x1ab65c1c sleepq_wait(1afa3b8c,0,1ab65c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab65c40 _cv_wait(1afa3b8c,1afa3cf8,1a49356,78,1afa3b94,...) at _cv_wait+0x21f/frame 0x1ab65c84 usb_process(1afa3b84,1ab65ce8,1a7773c,407,0,...) at usb_process+0x140/frame 0x1ab65cac fork_exit(ee1210,1afa3b84,1ab65ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab65cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ab65cd4 --- trap 0, eip = 0, esp = 0x1ab65d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100068 td 0x1afb1700 sched_switch(1afb1700,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ab6bba8 mi_switch(104,0,1a886b5,22b,1afb1700,...) at mi_switch+0x1f3/frame 0x1ab6bbe8 sleepq_switch(1afb1700,0,1a886b5,2b3,1d446c8,...) at sleepq_switch+0x110/frame 0x1ab6bc1c sleepq_wait(1afabacc,0,1ab6bc60,1,0,...) at sleepq_wait+0x48/frame 0x1ab6bc40 _cv_wait(1afabacc,1afabcf8,1a49356,78,1afabad4,...) at _cv_wait+0x21f/frame 0x1ab6bc84 usb_process(1afabac4,1ab6bce8,1a7773c,407,0,...) at usb_process+0x140/frame 0x1ab6bcac fork_exit(ee1210,1afabac4,1ab6bce8,0,0,...) at fork_exit+0x7e/frame 0x1ab6bcd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ab6bcd4 --- trap 0, eip = 0, esp = 0x1ab6bd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100069 td 0x1afb1380 sched_switch(1afb1380,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ab70ba8 mi_switch(104,0,1a886b5,22b,1afb1380,...) at mi_switch+0x1f3/frame 0x1ab70be8 sleepq_switch(1afb1380,0,1a886b5,2b3,1d446c8,...) at sleepq_switch+0x110/frame 0x1ab70c1c sleepq_wait(1afabafc,0,1ab70c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab70c40 _cv_wait(1afabafc,1afabcf8,1a49356,78,1afabb04,...) at _cv_wait+0x21f/frame 0x1ab70c84 usb_process(1afabaf4,1ab70ce8,1a7773c,407,0,...) at usb_process+0x140/frame 0x1ab70cac fork_exit(ee1210,1afabaf4,1ab70ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab70cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ab70cd4 --- trap 0, eip = 0, esp = 0x1ab70d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100070 td 0x1afb1000 sched_switch(1afb1000,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ab75ba8 mi_switch(104,0,1a886b5,22b,1afb1000,...) at mi_switch+0x1f3/frame 0x1ab75be8 sleepq_switch(1afb1000,0,1a886b5,2b3,1d446c8,...) at sleepq_switch+0x110/frame 0x1ab75c1c sleepq_wait(1afabb2c,0,1ab75c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab75c40 _cv_wait(1afabb2c,1afabcf8,1a49356,78,1afabb34,...) at _cv_wait+0x21f/frame 0x1ab75c84 usb_process(1afabb24,1ab75ce8,1a7773c,407,0,...) at usb_process+0x140/frame 0x1ab75cac fork_exit(ee1210,1afabb24,1ab75ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab75cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ab75cd4 --- trap 0, eip = 0, esp = 0x1ab75d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100071 td 0x1afb0a80 sched_switch(1afb0a80,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ab7aba8 mi_switch(104,0,1a886b5,22b,1afb0a80,...) at mi_switch+0x1f3/frame 0x1ab7abe8 sleepq_switch(1afb0a80,0,1a886b5,2b3,1d446c8,...) at sleepq_switch+0x110/frame 0x1ab7ac1c sleepq_wait(1afabb5c,0,1ab7ac60,1,0,...) at sleepq_wait+0x48/frame 0x1ab7ac40 _cv_wait(1afabb5c,1afabcf8,1a49356,78,1afabb64,...) at _cv_wait+0x21f/frame 0x1ab7ac84 usb_process(1afabb54,1ab7ace8,1a7773c,407,0,...) at usb_process+0x140/frame 0x1ab7acac fork_exit(ee1210,1afabb54,1ab7ace8,0,0,...) at fork_exit+0x7e/frame 0x1ab7acd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ab7acd4 --- trap 0, eip = 0, esp = 0x1ab7ad20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100072 td 0x1afb0700 sched_switch(1afb0700,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ab7fba8 mi_switch(104,0,1a886b5,22b,1afb0700,...) at mi_switch+0x1f3/frame 0x1ab7fbe8 sleepq_switch(1afb0700,0,1a886b5,2b3,1d446c8,...) at sleepq_switch+0x110/frame 0x1ab7fc1c sleepq_wait(1afabb8c,0,1ab7fc60,1,0,...) at sleepq_wait+0x48/frame 0x1ab7fc40 _cv_wait(1afabb8c,1afabcf8,1a49356,78,1afabb94,...) at _cv_wait+0x21f/frame 0x1ab7fc84 usb_process(1afabb84,1ab7fce8,1a7773c,407,0,...) at usb_process+0x140/frame 0x1ab7fcac fork_exit(ee1210,1afabb84,1ab7fce8,0,0,...) at fork_exit+0x7e/frame 0x1ab7fcd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ab7fcd4 --- trap 0, eip = 0, esp = 0x1ab7fd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100074 td 0x1afb0000 sched_switch(1afb0000,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ab8aba8 mi_switch(104,0,1a886b5,22b,1afb0000,...) at mi_switch+0x1f3/frame 0x1ab8abe8 sleepq_switch(1afb0000,0,1a886b5,2b3,1d446c8,...) at sleepq_switch+0x110/frame 0x1ab8ac1c sleepq_wait(1ac91ca4,0,1ab8ac60,1,0,...) at sleepq_wait+0x48/frame 0x1ab8ac40 _cv_wait(1ac91ca4,1ac91ed0,1a49356,78,1ac91cac,...) at _cv_wait+0x21f/frame 0x1ab8ac84 usb_process(1ac91c9c,1ab8ace8,1a7773c,407,0,...) at usb_process+0x140/frame 0x1ab8acac fork_exit(ee1210,1ac91c9c,1ab8ace8,0,0,...) at fork_exit+0x7e/frame 0x1ab8acd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ab8acd4 --- trap 0, eip = 0, esp = 0x1ab8ad20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100075 td 0x1afafa80 sched_switch(1afafa80,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ab8fba8 mi_switch(104,0,1a886b5,22b,1afafa80,...) at mi_switch+0x1f3/frame 0x1ab8fbe8 sleepq_switch(1afafa80,0,1a886b5,2b3,1d446c8,...) at sleepq_switch+0x110/frame 0x1ab8fc1c sleepq_wait(1ac91cd4,0,1ab8fc60,1,0,...) at sleepq_wait+0x48/frame 0x1ab8fc40 _cv_wait(1ac91cd4,1ac91ed0,1a49356,78,1ac91cdc,...) at _cv_wait+0x21f/frame 0x1ab8fc84 usb_process(1ac91ccc,1ab8fce8,1a7773c,407,0,...) at usb_process+0x140/frame 0x1ab8fcac fork_exit(ee1210,1ac91ccc,1ab8fce8,0,0,...) at fork_exit+0x7e/frame 0x1ab8fcd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ab8fcd4 --- trap 0, eip = 0, esp = 0x1ab8fd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100076 td 0x1afaf700 sched_switch(1afaf700,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ab94ba8 mi_switch(104,0,1a886b5,22b,1afaf700,...) at mi_switch+0x1f3/frame 0x1ab94be8 sleepq_switch(1afaf700,0,1a886b5,2b3,1d446c8,...) at sleepq_switch+0x110/frame 0x1ab94c1c sleepq_wait(1ac91d04,0,1ab94c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab94c40 _cv_wait(1ac91d04,1ac91ed0,1a49356,78,1ac91d0c,...) at _cv_wait+0x21f/frame 0x1ab94c84 usb_process(1ac91cfc,1ab94ce8,1a7773c,407,0,...) at usb_process+0x140/frame 0x1ab94cac fork_exit(ee1210,1ac91cfc,1ab94ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab94cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ab94cd4 --- trap 0, eip = 0, esp = 0x1ab94d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100077 td 0x1afaf380 sched_switch(1afaf380,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ab99ba8 mi_switch(104,0,1a886b5,22b,1afaf380,...) at mi_switch+0x1f3/frame 0x1ab99be8 sleepq_switch(1afaf380,0,1a886b5,2b3,1d446c8,...) at sleepq_switch+0x110/frame 0x1ab99c1c sleepq_wait(1ac91d34,0,1ab99c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab99c40 _cv_wait(1ac91d34,1ac91ed0,1a49356,78,1ac91d3c,...) at _cv_wait+0x21f/frame 0x1ab99c84 usb_process(1ac91d2c,1ab99ce8,1a7773c,407,0,...) at usb_process+0x140/frame 0x1ab99cac fork_exit(ee1210,1ac91d2c,1ab99ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab99cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ab99cd4 --- trap 0, eip = 0, esp = 0x1ab99d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100078 td 0x1afaf000 sched_switch(1afaf000,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1ab9eba8 mi_switch(104,0,1a886b5,22b,1afaf000,...) at mi_switch+0x1f3/frame 0x1ab9ebe8 sleepq_switch(1afaf000,0,1a886b5,2b3,1d446c8,...) at sleepq_switch+0x110/frame 0x1ab9ec1c sleepq_wait(1ac91d64,0,1ab9ec60,1,0,...) at sleepq_wait+0x48/frame 0x1ab9ec40 _cv_wait(1ac91d64,1ac91ed0,1a49356,78,1ac91d6c,...) at _cv_wait+0x21f/frame 0x1ab9ec84 usb_process(1ac91d5c,1ab9ece8,1a7773c,407,0,...) at usb_process+0x140/frame 0x1ab9ecac fork_exit(ee1210,1ac91d5c,1ab9ece8,0,0,...) at fork_exit+0x7e/frame 0x1ab9ecd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ab9ecd4 --- trap 0, eip = 0, esp = 0x1ab9ed20, ebp = 0 --- (null)() at 0 Tracing command cam pid 7 tid 100041 td 0x9f75700 sched_switch(9f75700,0,104,189,1f88f40,...) at sched_switch+0x80c/frame 0x1aaafb78 mi_switch(104,0,1a886b5,22b,9f75700,...) at mi_switch+0x1f3/frame 0x1aaafbb4 sleepq_switch(9f75700,0,1a886b5,2b3,9f75700,...) at sleepq_switch+0x110/frame 0x1aaafbe8 sleepq_wait(1d9fec0,5c,1a678bb,0,0,...) at sleepq_wait+0x48/frame 0x1aaafc0c _sleep(1d9fec0,1d9fe80,5c,1a678bb,0,...) at _sleep+0x396/frame 0x1aaafc60 xpt_done_td(1d9fe80,1aaafce8,1a7773c,407,0,...) at xpt_done_td+0x9b/frame 0x1aaafcac fork_exit(8e38e0,1d9fe80,1aaafce8,0,0,...) at fork_exit+0x7e/frame 0x1aaafcd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aaafcd4 --- trap 0, eip = 0, esp = 0x1aaafd20, ebp = 0 --- (null)() at 0 Tracing command cam pid 7 tid 100094 td 0x1b2c5a80 sched_switch(1b2c5a80,0,104,189,1f881c0,...) at sched_switch+0x80c/frame 0x1abf3b70 mi_switch(104,0,1a886b5,22b,1b2c5a80,...) at mi_switch+0x1f3/frame 0x1abf3bac sleepq_switch(1b2c5a80,0,1a886b5,2b3,1b2c5a80,...) at sleepq_switch+0x110/frame 0x1abf3be0 sleepq_wait(1d9fdec,5c,1a678bb,0,0,...) at sleepq_wait+0x48/frame 0x1abf3c04 _sleep(1d9fdec,1d9fe40,5c,1a678bb,0,...) at _sleep+0x396/frame 0x1abf3c58 xpt_scanner_thread(0,1abf3ce8,1a7773c,407,0,...) at xpt_scanner_thread+0x97/frame 0x1abf3cac fork_exit(8e3c60,0,1abf3ce8,0,0,...) at fork_exit+0x7e/frame 0x1abf3cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1abf3cd4 --- trap 0, eip = 0, esp = 0x1abf3d20, ebp = 0 --- (null)() at 0 Tracing command crypto returns 3 pid 6 tid 100040 td 0x9f75a80 sched_switch(9f75a80,0,104,189,1f88f40,...) at sched_switch+0x80c/frame 0x1aaaab70 mi_switch(104,0,1a886b5,22b,9f75a80,...) at mi_switch+0x1f3/frame 0x1aaaabac sleepq_switch(9f75a80,0,1a886b5,2b3,9f75a80,...) at sleepq_switch+0x110/frame 0x1aaaabe0 sleepq_wait(bf9dec4,6c,1ac5c79,0,0,...) at sleepq_wait+0x48/frame 0x1aaaac04 _sleep(bf9dec4,bf9dea8,6c,1ac5c79,0,...) at _sleep+0x396/frame 0x1aaaac58 crypto_ret_proc(bf9dea8,1aaaace8,1a7773c,407,0,...) at crypto_ret_proc+0x241/frame 0x1aaaacac fork_exit(1351540,bf9dea8,1aaaace8,0,0,...) at fork_exit+0x7e/frame 0x1aaaacd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aaaacd4 --- trap 0, eip = 0, esp = 0x1aaaad20, ebp = 0 --- (null)() at 0 Tracing command crypto returns 2 pid 5 tid 100039 td 0x9e5b700 sched_switch(9e5b700,0,104,189,1f88f40,...) at sched_switch+0x80c/frame 0x1aaa5b70 mi_switch(104,0,1a886b5,22b,9e5b700,...) at mi_switch+0x1f3/frame 0x1aaa5bac sleepq_switch(9e5b700,0,1a886b5,2b3,9e5b700,...) at sleepq_switch+0x110/frame 0x1aaa5be0 sleepq_wait(bf9de8c,6c,1ac5c79,0,0,...) at sleepq_wait+0x48/frame 0x1aaa5c04 _sleep(bf9de8c,bf9de70,6c,1ac5c79,0,...) at _sleep+0x396/frame 0x1aaa5c58 crypto_ret_proc(bf9de70,1aaa5ce8,1a7773c,407,0,...) at crypto_ret_proc+0x241/frame 0x1aaa5cac fork_exit(1351540,bf9de70,1aaa5ce8,0,0,...) at fork_exit+0x7e/frame 0x1aaa5cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aaa5cd4 --- trap 0, eip = 0, esp = 0x1aaa5d20, ebp = 0 --- (null)() at 0 Tracing command crypto returns 1 pid 4 tid 100038 td 0x9e5ba80 sched_switch(9e5ba80,0,104,189,1f881c0,...) at sched_switch+0x80c/frame 0x1aaa0b70 mi_switch(104,0,1a886b5,22b,9e5ba80,...) at mi_switch+0x1f3/frame 0x1aaa0bac sleepq_switch(9e5ba80,0,1a886b5,2b3,9e5ba80,...) at sleepq_switch+0x110/frame 0x1aaa0be0 sleepq_wait(bf9de54,6c,1ac5c79,0,0,...) at sleepq_wait+0x48/frame 0x1aaa0c04 _sleep(bf9de54,bf9de38,6c,1ac5c79,0,...) at _sleep+0x396/frame 0x1aaa0c58 crypto_ret_proc(bf9de38,1aaa0ce8,1a7773c,407,0,...) at crypto_ret_proc+0x241/frame 0x1aaa0cac fork_exit(1351540,bf9de38,1aaa0ce8,0,0,...) at fork_exit+0x7e/frame 0x1aaa0cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aaa0cd4 --- trap 0, eip = 0, esp = 0x1aaa0d20, ebp = 0 --- (null)() at 0 Tracing command crypto returns 0 pid 3 tid 100037 td 0x9e64000 sched_switch(9e64000,0,104,189,1f881c0,...) at sched_switch+0x80c/frame 0x1aa9bb70 mi_switch(104,0,1a886b5,22b,9e64000,...) at mi_switch+0x1f3/frame 0x1aa9bbac sleepq_switch(9e64000,0,1a886b5,2b3,9e64000,...) at sleepq_switch+0x110/frame 0x1aa9bbe0 sleepq_wait(bf9de1c,6c,1ac5c79,0,0,...) at sleepq_wait+0x48/frame 0x1aa9bc04 _sleep(bf9de1c,bf9de00,6c,1ac5c79,0,...) at _sleep+0x396/frame 0x1aa9bc58 crypto_ret_proc(bf9de00,1aa9bce8,1a7773c,407,0,...) at crypto_ret_proc+0x241/frame 0x1aa9bcac fork_exit(1351540,bf9de00,1aa9bce8,0,0,...) at fork_exit+0x7e/frame 0x1aa9bcd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aa9bcd4 --- trap 0, eip = 0, esp = 0x1aa9bd20, ebp = 0 --- (null)() at 0 Tracing command crypto pid 2 tid 100036 td 0x9e64380 sched_switch(9e64380,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1aa96b80 mi_switch(104,0,1a886b5,22b,9e64380,...) at mi_switch+0x1f3/frame 0x1aa96bc0 sleepq_switch(9e64380,0,1a886b5,2b3,9e64380,...) at sleepq_switch+0x110/frame 0x1aa96bf4 sleepq_wait(1ff8db4,6c,1ac5c6d,0,0,...) at sleepq_wait+0x48/frame 0x1aa96c18 _sleep(1ff8db4,1ff8d9c,6c,1ac5c6d,0,...) at _sleep+0x396/frame 0x1aa96c6c crypto_proc(0,1aa96ce8,1a7773c,407,0,...) at crypto_proc+0x2a9/frame 0x1aa96cac fork_exit(1351140,0,1aa96ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa96cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aa96cd4 --- trap 0, eip = 0, esp = 0x1aa96d20, ebp = 0 --- (null)() at 0 Tracing command geom pid 13 tid 100028 td 0x9e66380 sched_switch(9e66380,0,104,189,1f88880,...) at sched_switch+0x80c/frame 0x1aa6eb88 mi_switch(104,0,1a886b5,22b,9e66380,...) at mi_switch+0x1f3/frame 0x1aa6ebc4 sleepq_switch(9e66380,0,1a886b5,2b3,9e66380,...) at sleepq_switch+0x110/frame 0x1aa6ebf8 sleepq_wait(201f988,5c,1a678bb,0,0,...) at sleepq_wait+0x48/frame 0x1aa6ec1c _sleep(201f988,1f775a8,25c,1a678bb,0,...) at _sleep+0x396/frame 0x1aa6ec70 g_run_events(0,1aa6ece8,1a7773c,407,0,...) at g_run_events+0x67/frame 0x1aa6ecac fork_exit(fe9f10,0,1aa6ece8,0,0,...) at fork_exit+0x7e/frame 0x1aa6ecd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aa6ecd4 --- trap 0, eip = 0, esp = 0x1aa6ed20, ebp = 0 --- (null)() at 0 Tracing command geom pid 13 tid 100029 td 0x9e66000 sched_switch(9e66000,0,104,189,1f881c0,...) at sched_switch+0x80c/frame 0x1aa73b78 mi_switch(104,0,1a886b5,22b,9e66000,...) at mi_switch+0x1f3/frame 0x1aa73bb4 sleepq_switch(9e66000,0,1a886b5,2b3,9e66000,...) at sleepq_switch+0x110/frame 0x1aa73be8 sleepq_wait(201f98c,5c,1a678bb,0,0,...) at sleepq_wait+0x48/frame 0x1aa73c0c _sleep(201f98c,1f775f0,25c,1a678bb,0,...) at _sleep+0x396/frame 0x1aa73c60 g_io_schedule_up(9e66000,0,1a69968,61,1aa73cd4,...) at g_io_schedule_up+0xcf/frame 0x1aa73c94 g_up_procbody(0,1aa73ce8,1a7773c,407,0,...) at g_up_procbody+0x7d/frame 0x1aa73cac fork_exit(fe9f90,0,1aa73ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa73cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aa73cd4 --- trap 0, eip = 0, esp = 0x1aa73d20, ebp = 0 --- (null)() at 0 Tracing command geom pid 13 tid 100030 td 0x9e65a80 sched_switch(9e65a80,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1aa78b70 mi_switch(104,0,1a886b5,22b,9e65a80,...) at mi_switch+0x1f3/frame 0x1aa78bb0 sleepq_switch(9e65a80,0,1a886b5,2b3,9e65a80,...) at sleepq_switch+0x110/frame 0x1aa78be4 sleepq_wait(201f990,5c,1a678bb,0,0,...) at sleepq_wait+0x48/frame 0x1aa78c08 _sleep(201f990,1f775d0,25c,1a678bb,0,...) at _sleep+0x396/frame 0x1aa78c5c g_io_schedule_down(9e65a80,0,1a69968,6d,1aa78cd4,...) at g_io_schedule_down+0xec/frame 0x1aa78c94 g_down_procbody(0,1aa78ce8,1a7773c,407,0,...) at g_down_procbody+0x7d/frame 0x1aa78cac fork_exit(fea010,0,1aa78ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa78cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aa78cd4 --- trap 0, eip = 0, esp = 0x1aa78d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100009 td 0xbfcf000 sched_switch(bfcf000,0,109,189,8,...) at sched_switch+0x80c/frame 0x1aa0fc30 mi_switch(109,0,1a77ae1,5a1,1a7773c,...) at mi_switch+0x1f3/frame 0x1aa0fc70 ithread_loop(bffb020,1aa0fce8,1a7773c,407,0,...) at ithread_loop+0x200/frame 0x1aa0fcac fork_exit(1069030,bffb020,1aa0fce8,0,0,...) at fork_exit+0x7e/frame 0x1aa0fcd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aa0fcd4 --- trap 0, eip = 0, esp = 0x1aa0fd20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100010 td 0xbfcea80 sched_switch(bfcea80,0,109,189,8,...) at sched_switch+0x80c/frame 0x1aa14c30 mi_switch(109,0,1a77ae1,5a1,1a7773c,...) at mi_switch+0x1f3/frame 0x1aa14c70 ithread_loop(bffb010,1aa14ce8,1a7773c,407,0,...) at ithread_loop+0x200/frame 0x1aa14cac fork_exit(1069030,bffb010,1aa14ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa14cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aa14cd4 --- trap 0, eip = 0, esp = 0x1aa14d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100012 td 0xbfce380 PTDpde() at PTDpde+0x42d0 Tracing command intr pid 12 tid 100022 td 0x9e59380 PTDpde() at PTDpde+0x42d0 Tracing command intr pid 12 tid 100023 td 0x9e59000 sched_switch(9e59000,0,109,189,8,...) at sched_switch+0x80c/frame 0x1aa55c30 mi_switch(109,0,1a77ae1,5a1,1a7773c,...) at mi_switch+0x1f3/frame 0x1aa55c70 ithread_loop(bffaf80,1aa55ce8,1a7773c,407,0,...) at ithread_loop+0x200/frame 0x1aa55cac fork_exit(1069030,bffaf80,1aa55ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa55cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aa55cd4 --- trap 0, eip = 0, esp = 0x1aa55d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100024 td 0xbfd1a80 sched_switch(bfd1a80,0,109,189,8,...) at sched_switch+0x80c/frame 0x1aa5ac30 mi_switch(109,0,1a77ae1,5a1,1a7773c,...) at mi_switch+0x1f3/frame 0x1aa5ac70 ithread_loop(bffaf70,1aa5ace8,1a7773c,407,0,...) at ithread_loop+0x200/frame 0x1aa5acac fork_exit(1069030,bffaf70,1aa5ace8,0,0,...) at fork_exit+0x7e/frame 0x1aa5acd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aa5acd4 --- trap 0, eip = 0, esp = 0x1aa5ad20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100025 td 0xbfd1700 PTDpde() at PTDpde+0x42d0 Tracing command intr pid 12 tid 100026 td 0xbfd1380 PTDpde() at PTDpde+0x42d0 Tracing command intr pid 12 tid 100027 td 0x9e66700 PTDpde() at PTDpde+0x42d0 Tracing command intr pid 12 tid 100042 td 0x1acd3000 sched_switch(1acd3000,0,109,189,8,...) at sched_switch+0x80c/frame 0x1aae2c30 mi_switch(109,0,1a77ae1,5a1,1a7773c,...) at mi_switch+0x1f3/frame 0x1aae2c70 ithread_loop(1acbf050,1aae2ce8,1a7773c,407,0,...) at ithread_loop+0x200/frame 0x1aae2cac fork_exit(1069030,1acbf050,1aae2ce8,0,0,...) at fork_exit+0x7e/frame 0x1aae2cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aae2cd4 --- trap 0, eip = 0, esp = 0x1aae2d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100043 td 0x1acd2a80 sched_switch(1acd2a80,0,109,189,8,...) at sched_switch+0x80c/frame 0x1aae8c30 mi_switch(109,0,1a77ae1,5a1,1a7773c,...) at mi_switch+0x1f3/frame 0x1aae8c70 ithread_loop(1acbf040,1aae8ce8,1a7773c,407,0,...) at ithread_loop+0x200/frame 0x1aae8cac fork_exit(1069030,1acbf040,1aae8ce8,0,0,...) at fork_exit+0x7e/frame 0x1aae8cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aae8cd4 --- trap 0, eip = 0, esp = 0x1aae8d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100044 td 0x1acd2700 sched_switch(1acd2700,0,109,189,8,...) at sched_switch+0x80c/frame 0x1aaeec30 mi_switch(109,0,1a77ae1,5a1,1a7773c,...) at mi_switch+0x1f3/frame 0x1aaeec70 ithread_loop(1acbf030,1aaeece8,1a7773c,407,0,...) at ithread_loop+0x200/frame 0x1aaeecac fork_exit(1069030,1acbf030,1aaeece8,0,0,...) at fork_exit+0x7e/frame 0x1aaeecd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aaeecd4 --- trap 0, eip = 0, esp = 0x1aaeed20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100045 td 0x1acd2380 sched_switch(1acd2380,0,109,189,8,...) at sched_switch+0x80c/frame 0x1aaf4c30 mi_switch(109,0,1a77ae1,5a1,1a7773c,...) at mi_switch+0x1f3/frame 0x1aaf4c70 ithread_loop(1acbf020,1aaf4ce8,1a7773c,407,0,...) at ithread_loop+0x200/frame 0x1aaf4cac fork_exit(1069030,1acbf020,1aaf4ce8,0,0,...) at fork_exit+0x7e/frame 0x1aaf4cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aaf4cd4 --- trap 0, eip = 0, esp = 0x1aaf4d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100051 td 0x1acc0a80 sched_switch(1acc0a80,0,109,189,8,...) at sched_switch+0x80c/frame 0x1ab13c30 mi_switch(109,0,1a77ae1,5a1,1a7773c,...) at mi_switch+0x1f3/frame 0x1ab13c70 ithread_loop(1acbf010,1ab13ce8,1a7773c,407,0,...) at ithread_loop+0x200/frame 0x1ab13cac fork_exit(1069030,1acbf010,1ab13ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab13cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ab13cd4 --- trap 0, eip = 0, esp = 0x1ab13d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100057 td 0x1af8fa80 sched_switch(1af8fa80,0,109,189,8,...) at sched_switch+0x80c/frame 0x1ab32c30 mi_switch(109,0,1a77ae1,5a1,1a7773c,...) at mi_switch+0x1f3/frame 0x1ab32c70 ithread_loop(1acbf000,1ab32ce8,1a7773c,407,0,...) at ithread_loop+0x200/frame 0x1ab32cac fork_exit(1069030,1acbf000,1ab32ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab32cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1ab32cd4 --- trap 0, eip = 0, esp = 0x1ab32d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100073 td 0x1afb0380 PTDpde() at PTDpde+0x42d0 Tracing command intr pid 12 tid 100079 td 0x1af90a80 sched_switch(1af90a80,0,109,189,8,...) at sched_switch+0x80c/frame 0x1aba3c30 mi_switch(109,0,1a77ae1,5a1,1a7773c,...) at mi_switch+0x1f3/frame 0x1aba3c70 ithread_loop(bffbf80,1aba3ce8,1a7773c,407,0,...) at ithread_loop+0x200/frame 0x1aba3cac fork_exit(1069030,bffbf80,1aba3ce8,0,0,...) at fork_exit+0x7e/frame 0x1aba3cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aba3cd4 --- trap 0, eip = 0, esp = 0x1aba3d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100080 td 0x1af90700 sched_switch(1af90700,0,109,189,8,...) at sched_switch+0x80c/frame 0x1abacc30 mi_switch(109,0,1a77ae1,5a1,1a7773c,...) at mi_switch+0x1f3/frame 0x1abacc70 ithread_loop(bffbf60,1abacce8,1a7773c,407,0,...) at ithread_loop+0x200/frame 0x1abaccac fork_exit(1069030,bffbf60,1abacce8,0,0,...) at fork_exit+0x7e/frame 0x1abaccd4 fork_trampoline() at PTDpde+0x42da/frame 0x1abaccd4 --- trap 0, eip = 0, esp = 0x1abacd20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100082 td 0x1b021700 PTDpde() at PTDpde+0x42d0 Tracing command idle pid 11 tid 100003 td 0xbfd0700 (CPU 0) cpustop_handler(0,7be55d8,15116b94,167fb1c,0,...) at cpustop_handler+0x25/frame 0x15116a80 ipi_nmi_handler(0,0,0,2428d6c,0,...) at ipi_nmi_handler+0x36/frame 0x15116a90 trap(15116ba0,8,28,28,1ac24800,...) at trap+0xac/frame 0x15116b94 calltrap() at PTDpde+0x4124/frame 0x15116b94 --- trap 0x13, eip = 0x1698005, esp = 0x15116be0, ebp = 0x15116be0 --- acpi_cpu_c1(15116c34,16881d2,2428d50,0,1c8ae43,...) at acpi_cpu_c1+0x5/frame 0x15116be0 acpi_cpu_idle(aa5fe08,0,aa5fe08,15116c50,169860a,...) at acpi_cpu_idle+0x30b/frame 0x15116c20 cpu_idle_acpi(aa5fe08,0,1f87b00,2,ffffffff,...) at cpu_idle_acpi+0x3f/frame 0x15116c34 cpu_idle(0,15116c80,1a83ce8,aea,2,...) at cpu_idle+0x9a/frame 0x15116c50 sched_idletd(0,15116ce8,1a7773c,407,0,...) at sched_idletd+0x236/frame 0x15116cac fork_exit(10d8c60,0,15116ce8,0,0,...) at fork_exit+0x7e/frame 0x15116cd4 fork_trampoline() at PTDpde+0x42da/frame 0x15116cd4 --- trap 0, eip = 0, esp = 0x15116d20, ebp = 0 --- (null)() at 0 Tracing command idle pid 11 tid 100004 td 0xbfd0380 (CPU 1) cpustop_handler(1,7be55d8,1511bb94,167fb1c,0,...) at cpustop_handler+0x25/frame 0x1511ba80 ipi_nmi_handler(0,be7bd6c,0,13c88,1511baf0,...) at ipi_nmi_handler+0x36/frame 0x1511ba90 trap(1511bba0,8,28,28,1ac24600,...) at trap+0xac/frame 0x1511bb94 calltrap() at PTDpde+0x4124/frame 0x1511bb94 --- trap 0x13, eip = 0x1698005, esp = 0x1511bbe0, ebp = 0x1511bbe0 --- acpi_cpu_c1(1511bc34,16881d2,be7bd50,0,1c8ae43,...) at acpi_cpu_c1+0x5/frame 0x1511bbe0 acpi_cpu_idle(1b1e3e63,0,1b1e3e63,1511bc50,169860a,...) at acpi_cpu_idle+0x30b/frame 0x1511bc20 cpu_idle_acpi(1b1e3e63,0,1f881c0,1,ffffffff,...) at cpu_idle_acpi+0x3f/frame 0x1511bc34 cpu_idle(0,1511bc80,1a83ce8,aea,1,...) at cpu_idle+0x9a/frame 0x1511bc50 sched_idletd(0,1511bce8,1a7773c,407,0,...) at sched_idletd+0x236/frame 0x1511bcac fork_exit(10d8c60,0,1511bce8,0,0,...) at fork_exit+0x7e/frame 0x1511bcd4 fork_trampoline() at PTDpde+0x42da/frame 0x1511bcd4 --- trap 0, eip = 0, esp = 0x1511bd20, ebp = 0 --- (null)() at 0 Tracing command idle pid 11 tid 100005 td 0xbfd0000 (CPU 2) cpustop_handler(2,7be55d8,15120b94,167fb1c,0,...) at cpustop_handler+0x25/frame 0x15120a80 ipi_nmi_handler(0,be80d6c,0,13c88,15120af0,...) at ipi_nmi_handler+0x36/frame 0x15120a90 trap(15120ba0,8,28,28,1ac24400,...) at trap+0xac/frame 0x15120b94 calltrap() at PTDpde+0x4124/frame 0x15120b94 --- trap 0x13, eip = 0x1698005, esp = 0x15120be0, ebp = 0x15120be0 --- acpi_cpu_c1(15120c34,16881d2,be80d50,0,1c8ae43,...) at acpi_cpu_c1+0x5/frame 0x15120be0 acpi_cpu_idle(973fd9d,0,973fd9d,15120c50,169860a,...) at acpi_cpu_idle+0x30b/frame 0x15120c20 cpu_idle_acpi(973fd9d,0,1f88880,1,ffffffff,...) at cpu_idle_acpi+0x3f/frame 0x15120c34 cpu_idle(0,15120c80,1a83ce8,aea,1,...) at cpu_idle+0x9a/frame 0x15120c50 sched_idletd(0,15120ce8,1a7773c,407,0,...) at sched_idletd+0x236/frame 0x15120cac fork_exit(10d8c60,0,15120ce8,0,0,...) at fork_exit+0x7e/frame 0x15120cd4 fork_trampoline() at PTDpde+0x42da/frame 0x15120cd4 --- trap 0, eip = 0, esp = 0x15120d20, ebp = 0 --- (null)() at 0 Tracing command idle pid 11 tid 100006 td 0xbfcfa80 (CPU 3) kdb_alt_break_internal(0,15125acc,ea3577,2,1aff8888,...) at kdb_alt_break_internal+0xf0/frame 0x15125aa0 kdb_alt_break(2,1aff8888,1a3f113,0,40000,...) at kdb_alt_break+0x16/frame 0x15125aac uart_intr_rxready(1aff8800,13c88,be85d40,bfcfa80,15125af0,...) at uart_intr_rxready+0x87/frame 0x15125acc uart_intr(1aff8800,0,13c88,1,bfcfa80,...) at uart_intr+0x130/frame 0x15125b0c intr_event_handle(bfbea80,15125ba0,1f88f9c,9f75380,1,...) at intr_event_handle+0xa5/frame 0x15125b38 intr_execute_handlers(bff4130,15125ba0,3) at intr_execute_handlers+0xa5/frame 0x15125b70 lapic_handle_intr(32,15125ba0,8,28,28,...) at lapic_handle_intr+0x5e/frame 0x15125b90 Xapic_isr1_pti() at PTDpde+0x4bbf/frame 0x15125b90 --- interrupt, eip = 0x1698005, esp = 0x15125be0, ebp = 0x15125be0 --- acpi_cpu_c1(15125c34,16881d2,be85d50,0,1c8ae43,...) at acpi_cpu_c1+0x5/frame 0x15125be0 acpi_cpu_idle(1b196e03,0,1b196e03,15125c50,169860a,...) at acpi_cpu_idle+0x30b/frame 0x15125c20 cpu_idle_acpi(1b196e03,0,1f88f40,1,ffffffff,...) at cpu_idle_acpi+0x3f/frame 0x15125c34 cpu_idle(0,15125c80,1a83ce8,aea,1,...) at cpu_idle+0x9a/frame 0x15125c50 sched_idletd(0,15125ce8,1a7773c,407,0,...) at sched_idletd+0x236/frame 0x15125cac fork_exit(10d8c60,0,15125ce8,0,0,...) at fork_exit+0x7e/frame 0x15125cd4 fork_trampoline() at PTDpde+0x42da/frame 0x15125cd4 --- trap 0, eip = 0, esp = 0x15125d20, ebp = 0 --- (null)() at 0 Tracing command init pid 1 tid 100002 td 0xbfd0a80 sched_switch(bfd0a80,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x15110940 mi_switch(104,0,1a886b5,22b,bfd0a80,...) at mi_switch+0x1f3/frame 0x15110980 sleepq_switch(bfd0a80,0,1a886b5,1ca,6c,...) at sleepq_switch+0x110/frame 0x151109b4 sleepq_catch_signals(0,1a886b5,178,1f99514,bfd0a80,...) at sleepq_catch_signals+0x360/frame 0x151109f8 sleepq_wait_sig(bfcca14,6c,1a8caca,100,0,...) at sleepq_wait_sig+0x14/frame 0x15110a1c _sleep(bfcca14,bfccabc,36c,1a8caca,0,...) at _sleep+0x386/frame 0x15110a70 kern_wait6(bfd0a80,7,0,0,15110af4,...) at kern_wait6+0x567/frame 0x15110ac8 sys_wait4(bfd0a80,bfd0d04,1a7717b,4,1c8ae43,...) at sys_wait4+0x87/frame 0x15110be8 syscall(15110ce8,3b,3b,3b,ffbfe8d0,...) at syscall+0x6ee/frame 0x15110cdc Xint0x80_syscall() at PTDpde+0x42c8/frame 0x15110cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x806a2c7, esp = 0xffbfe884, ebp = 0xffbfe898 --- _end() at 0x806a2c7 Tracing command audit pid 10 tid 100001 td 0xbfd1000 sched_switch(bfd1000,0,104,189,1f881c0,...) at sched_switch+0x80c/frame 0x1510bb80 mi_switch(104,0,1a886b5,22b,bfd1000,...) at mi_switch+0x1f3/frame 0x1510bbbc sleepq_switch(bfd1000,0,1a886b5,2b3,1d446c8,...) at sleepq_switch+0x110/frame 0x1510bbf0 sleepq_wait(2023c98,0,1510bc34,1,0,...) at sleepq_wait+0x48/frame 0x1510bc14 _cv_wait(2023c98,2023c20,1ac840e,1be,8,...) at _cv_wait+0x21f/frame 0x1510bc58 audit_worker(0,1510bce8,1a7773c,407,0,...) at audit_worker+0x94/frame 0x1510bcac fork_exit(1373af0,0,1510bce8,0,0,...) at fork_exit+0x7e/frame 0x1510bcd4 fork_trampoline() at PTDpde+0x42da/frame 0x1510bcd4 --- trap 0, eip = 0, esp = 0x1510bd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100000 td 0x201fd00 sched_switch(201fd00,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x2423bd8 mi_switch(104,0,1a886b5,22b,201fd00,...) at mi_switch+0x1f3/frame 0x2423c18 sleepq_switch(201fd00,0,1a886b5,2b3,201fd00,...) at sleepq_switch+0x110/frame 0x2423c4c sleepq_wait(1d7f000,54,1ad6cbc,0,0,...) at sleepq_wait+0x48/frame 0x2423c70 _sleep(1d7f000,1d7efc0,54,1ad6cbc,0,...) at _sleep+0x396/frame 0x2423cc4 vm_wait_min(201f9a4,0,54,1ad915b,fffff470,...) at vm_wait_min+0x92/frame 0x2423cf0 swapper() at swapper+0x25/frame 0x2423d38 btext() at btext+0x5f Tracing command kernel pid 0 tid 100007 td 0xbfcf700 sched_switch(bfcf700,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1aa05b88 mi_switch(104,0,1a886b5,22b,bfcf700,...) at mi_switch+0x1f3/frame 0x1aa05bc8 sleepq_switch(bfcf700,0,1a886b5,2b3,bfcf700,...) at sleepq_switch+0x110/frame 0x1aa05bfc sleepq_wait(bff9000,0,1a678bb,0,0,...) at sleepq_wait+0x48/frame 0x1aa05c20 _sleep(bff9000,bff901c,0,1a678bb,0,...) at _sleep+0x396/frame 0x1aa05c74 taskqueue_thread_loop(2023078,1aa05ce8,1a7773c,407,0,...) at taskqueue_thread_loop+0x144/frame 0x1aa05cac fork_exit(11048d0,2023078,1aa05ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa05cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aa05cd4 --- trap 0, eip = 0, esp = 0x1aa05d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100008 td 0xbfcf380 sched_switch(bfcf380,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1aa0ab88 mi_switch(104,0,1a886b5,22b,bfcf380,...) at mi_switch+0x1f3/frame 0x1aa0abc8 sleepq_switch(bfcf380,0,1a886b5,2b3,bfcf380,...) at sleepq_switch+0x110/frame 0x1aa0abfc sleepq_wait(bff8f00,0,1a678bb,0,0,...) at sleepq_wait+0x48/frame 0x1aa0ac20 _sleep(bff8f00,bff8f1c,0,1a678bb,0,...) at _sleep+0x396/frame 0x1aa0ac74 taskqueue_thread_loop(202029c,1aa0ace8,1a7773c,407,0,...) at taskqueue_thread_loop+0x144/frame 0x1aa0acac fork_exit(11048d0,202029c,1aa0ace8,0,0,...) at fork_exit+0x7e/frame 0x1aa0acd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aa0acd4 --- trap 0, eip = 0, esp = 0x1aa0ad20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100011 td 0xbfce700 sched_switch(bfce700,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1aa19b88 mi_switch(104,0,1a886b5,22b,bfce700,...) at mi_switch+0x1f3/frame 0x1aa19bc8 sleepq_switch(bfce700,0,1a886b5,2b3,bfce700,...) at sleepq_switch+0x110/frame 0x1aa19bfc sleepq_wait(bff8d80,0,1a678bb,0,0,...) at sleepq_wait+0x48/frame 0x1aa19c20 _sleep(bff8d80,bff8d9c,0,1a678bb,0,...) at _sleep+0x396/frame 0x1aa19c74 taskqueue_thread_loop(202301c,1aa19ce8,1a7773c,407,0,...) at taskqueue_thread_loop+0x144/frame 0x1aa19cac fork_exit(11048d0,202301c,1aa19ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa19cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aa19cd4 --- trap 0, eip = 0, esp = 0x1aa19d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100013 td 0xbfce000 sched_switch(bfce000,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1aa23b98 mi_switch(104,0,1a886b5,22b,bfce000,...) at mi_switch+0x1f3/frame 0x1aa23bd8 sleepq_switch(bfce000,0,1a886b5,2b3,be89680,...) at sleepq_switch+0x110/frame 0x1aa23c0c sleepq_wait(be89680,0,1a81b03,1a678bb,0,...) at sleepq_wait+0x48/frame 0x1aa23c30 msleep_spin_sbt(be89680,be8969c,1a678bb,0,0,...) at msleep_spin_sbt+0x226/frame 0x1aa23c74 gtaskqueue_thread_loop(bf82c04,1aa23ce8,1a7773c,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0x1aa23cac fork_exit(10ee770,bf82c04,1aa23ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa23cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aa23cd4 --- trap 0, eip = 0, esp = 0x1aa23d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100014 td 0x9e5b380 sched_switch(9e5b380,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1aa28b98 mi_switch(104,0,1a886b5,22b,9e5b380,...) at mi_switch+0x1f3/frame 0x1aa28bd8 sleepq_switch(9e5b380,0,1a886b5,2b3,be89600,...) at sleepq_switch+0x110/frame 0x1aa28c0c sleepq_wait(be89600,0,1a81b03,1a678bb,0,...) at sleepq_wait+0x48/frame 0x1aa28c30 msleep_spin_sbt(be89600,be8961c,1a678bb,0,0,...) at msleep_spin_sbt+0x226/frame 0x1aa28c74 gtaskqueue_thread_loop(bf82404,1aa28ce8,1a7773c,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0x1aa28cac fork_exit(10ee770,bf82404,1aa28ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa28cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aa28cd4 --- trap 0, eip = 0, esp = 0x1aa28d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100015 td 0x9e5b000 sched_switch(9e5b000,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1aa2db98 mi_switch(104,0,1a886b5,22b,9e5b000,...) at mi_switch+0x1f3/frame 0x1aa2dbd8 sleepq_switch(9e5b000,0,1a886b5,2b3,be89580,...) at sleepq_switch+0x110/frame 0x1aa2dc0c sleepq_wait(be89580,0,1a81b03,1a678bb,0,...) at sleepq_wait+0x48/frame 0x1aa2dc30 msleep_spin_sbt(be89580,be8959c,1a678bb,0,0,...) at msleep_spin_sbt+0x226/frame 0x1aa2dc74 gtaskqueue_thread_loop(bf82414,1aa2dce8,1a7773c,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0x1aa2dcac fork_exit(10ee770,bf82414,1aa2dce8,0,0,...) at fork_exit+0x7e/frame 0x1aa2dcd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aa2dcd4 --- trap 0, eip = 0, esp = 0x1aa2dd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100016 td 0x9e5aa80 sched_switch(9e5aa80,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1aa32b98 mi_switch(104,0,1a886b5,22b,9e5aa80,...) at mi_switch+0x1f3/frame 0x1aa32bd8 sleepq_switch(9e5aa80,0,1a886b5,2b3,be89500,...) at sleepq_switch+0x110/frame 0x1aa32c0c sleepq_wait(be89500,0,1a81b03,1a678bb,0,...) at sleepq_wait+0x48/frame 0x1aa32c30 msleep_spin_sbt(be89500,be8951c,1a678bb,0,0,...) at msleep_spin_sbt+0x226/frame 0x1aa32c74 gtaskqueue_thread_loop(bf82424,1aa32ce8,1a7773c,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0x1aa32cac fork_exit(10ee770,bf82424,1aa32ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa32cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aa32cd4 --- trap 0, eip = 0, esp = 0x1aa32d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100017 td 0x9e5a700 sched_switch(9e5a700,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1aa37b98 mi_switch(104,0,1a886b5,22b,9e5a700,...) at mi_switch+0x1f3/frame 0x1aa37bd8 sleepq_switch(9e5a700,0,1a886b5,2b3,be89480,...) at sleepq_switch+0x110/frame 0x1aa37c0c sleepq_wait(be89480,0,1a81b03,1a678bb,0,...) at sleepq_wait+0x48/frame 0x1aa37c30 msleep_spin_sbt(be89480,be8949c,1a678bb,0,0,...) at msleep_spin_sbt+0x226/frame 0x1aa37c74 gtaskqueue_thread_loop(bf82434,1aa37ce8,1a7773c,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0x1aa37cac fork_exit(10ee770,bf82434,1aa37ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa37cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aa37cd4 --- trap 0, eip = 0, esp = 0x1aa37d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100018 td 0x9e5a380 sched_switch(9e5a380,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1aa3cb98 mi_switch(104,0,1a886b5,22b,9e5a380,...) at mi_switch+0x1f3/frame 0x1aa3cbd8 sleepq_switch(9e5a380,0,1a886b5,2b3,be89400,...) at sleepq_switch+0x110/frame 0x1aa3cc0c sleepq_wait(be89400,0,1a81b03,1a678bb,0,...) at sleepq_wait+0x48/frame 0x1aa3cc30 msleep_spin_sbt(be89400,be8941c,1a678bb,0,0,...) at msleep_spin_sbt+0x226/frame 0x1aa3cc74 gtaskqueue_thread_loop(bf82804,1aa3cce8,1a7773c,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0x1aa3ccac fork_exit(10ee770,bf82804,1aa3cce8,0,0,...) at fork_exit+0x7e/frame 0x1aa3ccd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aa3ccd4 --- trap 0, eip = 0, esp = 0x1aa3cd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100019 td 0x9e5a000 sched_switch(9e5a000,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1aa41b98 mi_switch(104,0,1a886b5,22b,9e5a000,...) at mi_switch+0x1f3/frame 0x1aa41bd8 sleepq_switch(9e5a000,0,1a886b5,2b3,be89380,...) at sleepq_switch+0x110/frame 0x1aa41c0c sleepq_wait(be89380,0,1a81b03,1a678bb,0,...) at sleepq_wait+0x48/frame 0x1aa41c30 msleep_spin_sbt(be89380,be8939c,1a678bb,0,0,...) at msleep_spin_sbt+0x226/frame 0x1aa41c74 gtaskqueue_thread_loop(bf82814,1aa41ce8,1a7773c,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0x1aa41cac fork_exit(10ee770,bf82814,1aa41ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa41cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aa41cd4 --- trap 0, eip = 0, esp = 0x1aa41d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100020 td 0x9e59a80 sched_switch(9e59a80,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1aa46b98 mi_switch(104,0,1a886b5,22b,9e59a80,...) at mi_switch+0x1f3/frame 0x1aa46bd8 sleepq_switch(9e59a80,0,1a886b5,2b3,be89300,...) at sleepq_switch+0x110/frame 0x1aa46c0c sleepq_wait(be89300,0,1a81b03,1a678bb,0,...) at sleepq_wait+0x48/frame 0x1aa46c30 msleep_spin_sbt(be89300,be8931c,1a678bb,0,0,...) at msleep_spin_sbt+0x226/frame 0x1aa46c74 gtaskqueue_thread_loop(bf82824,1aa46ce8,1a7773c,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0x1aa46cac fork_exit(10ee770,bf82824,1aa46ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa46cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aa46cd4 --- trap 0, eip = 0, esp = 0x1aa46d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100021 td 0x9e59700 sched_switch(9e59700,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1aa4bb98 mi_switch(104,0,1a886b5,22b,9e59700,...) at mi_switch+0x1f3/frame 0x1aa4bbd8 sleepq_switch(9e59700,0,1a886b5,2b3,be89280,...) at sleepq_switch+0x110/frame 0x1aa4bc0c sleepq_wait(be89280,0,1a81b03,1a678bb,0,...) at sleepq_wait+0x48/frame 0x1aa4bc30 msleep_spin_sbt(be89280,be8929c,1a678bb,0,0,...) at msleep_spin_sbt+0x226/frame 0x1aa4bc74 gtaskqueue_thread_loop(bf82834,1aa4bce8,1a7773c,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0x1aa4bcac fork_exit(10ee770,bf82834,1aa4bce8,0,0,...) at fork_exit+0x7e/frame 0x1aa4bcd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aa4bcd4 --- trap 0, eip = 0, esp = 0x1aa4bd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100031 td 0x9e65700 sched_switch(9e65700,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1aa7db88 mi_switch(104,0,1a886b5,22b,9e65700,...) at mi_switch+0x1f3/frame 0x1aa7dbc8 sleepq_switch(9e65700,0,1a886b5,2b3,9e65700,...) at sleepq_switch+0x110/frame 0x1aa7dbfc sleepq_wait(bff8c00,0,1a678bb,0,0,...) at sleepq_wait+0x48/frame 0x1aa7dc20 _sleep(bff8c00,bff8c1c,0,1a678bb,0,...) at _sleep+0x396/frame 0x1aa7dc74 taskqueue_thread_loop(1f95428,1aa7dce8,1a7773c,407,0,...) at taskqueue_thread_loop+0x144/frame 0x1aa7dcac fork_exit(11048d0,1f95428,1aa7dce8,0,0,...) at fork_exit+0x7e/frame 0x1aa7dcd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aa7dcd4 --- trap 0, eip = 0, esp = 0x1aa7dd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100032 td 0x9e65380 sched_switch(9e65380,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1aa82b88 mi_switch(104,0,1a886b5,22b,9e65380,...) at mi_switch+0x1f3/frame 0x1aa82bc8 sleepq_switch(9e65380,0,1a886b5,2b3,9e65380,...) at sleepq_switch+0x110/frame 0x1aa82bfc sleepq_wait(bff8a80,0,1a678bb,0,0,...) at sleepq_wait+0x48/frame 0x1aa82c20 _sleep(bff8a80,bff8a9c,0,1a678bb,0,...) at _sleep+0x396/frame 0x1aa82c74 taskqueue_thread_loop(1ff8e58,1aa82ce8,1a7773c,407,0,...) at taskqueue_thread_loop+0x144/frame 0x1aa82cac fork_exit(11048d0,1ff8e58,1aa82ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa82cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aa82cd4 --- trap 0, eip = 0, esp = 0x1aa82d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100033 td 0x9e65000 sched_switch(9e65000,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1aa87b88 mi_switch(104,0,1a886b5,22b,9e65000,...) at mi_switch+0x1f3/frame 0x1aa87bc8 sleepq_switch(9e65000,0,1a886b5,2b3,9e65000,...) at sleepq_switch+0x110/frame 0x1aa87bfc sleepq_wait(bff8a80,0,1a678bb,0,0,...) at sleepq_wait+0x48/frame 0x1aa87c20 _sleep(bff8a80,bff8a9c,0,1a678bb,0,...) at _sleep+0x396/frame 0x1aa87c74 taskqueue_thread_loop(1ff8e58,1aa87ce8,1a7773c,407,0,...) at taskqueue_thread_loop+0x144/frame 0x1aa87cac fork_exit(11048d0,1ff8e58,1aa87ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa87cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aa87cd4 --- trap 0, eip = 0, esp = 0x1aa87d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100034 td 0x9e64a80 sched_switch(9e64a80,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1aa8cb88 mi_switch(104,0,1a886b5,22b,9e64a80,...) at mi_switch+0x1f3/frame 0x1aa8cbc8 sleepq_switch(9e64a80,0,1a886b5,2b3,9e64a80,...) at sleepq_switch+0x110/frame 0x1aa8cbfc sleepq_wait(bff8a80,0,1a678bb,0,0,...) at sleepq_wait+0x48/frame 0x1aa8cc20 _sleep(bff8a80,bff8a9c,0,1a678bb,0,...) at _sleep+0x396/frame 0x1aa8cc74 taskqueue_thread_loop(1ff8e58,1aa8cce8,1a7773c,407,0,...) at taskqueue_thread_loop+0x144/frame 0x1aa8ccac fork_exit(11048d0,1ff8e58,1aa8cce8,0,0,...) at fork_exit+0x7e/frame 0x1aa8ccd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aa8ccd4 --- trap 0, eip = 0, esp = 0x1aa8cd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100035 td 0x9e64700 sched_switch(9e64700,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1aa91b88 mi_switch(104,0,1a886b5,22b,9e64700,...) at mi_switch+0x1f3/frame 0x1aa91bc8 sleepq_switch(9e64700,0,1a886b5,2b3,9e64700,...) at sleepq_switch+0x110/frame 0x1aa91bfc sleepq_wait(bff8a80,0,1a678bb,0,0,...) at sleepq_wait+0x48/frame 0x1aa91c20 _sleep(bff8a80,bff8a9c,0,1a678bb,0,...) at _sleep+0x396/frame 0x1aa91c74 taskqueue_thread_loop(1ff8e58,1aa91ce8,1a7773c,407,0,...) at taskqueue_thread_loop+0x144/frame 0x1aa91cac fork_exit(11048d0,1ff8e58,1aa91ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa91cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1aa91cd4 --- trap 0, eip = 0, esp = 0x1aa91d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100083 td 0x1b021380 sched_switch(1b021380,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1abbbb98 mi_switch(104,0,1a886b5,22b,1b021380,...) at mi_switch+0x1f3/frame 0x1abbbbd8 sleepq_switch(1b021380,0,1a886b5,2b3,1ac63080,...) at sleepq_switch+0x110/frame 0x1abbbc0c sleepq_wait(1ac63080,0,1a81b03,1a678bb,0,...) at sleepq_wait+0x48/frame 0x1abbbc30 msleep_spin_sbt(1ac63080,1ac6309c,1a678bb,0,0,...) at msleep_spin_sbt+0x226/frame 0x1abbbc74 taskqueue_thread_loop(2013e84,1abbbce8,1a7773c,407,0,...) at taskqueue_thread_loop+0xf3/frame 0x1abbbcac fork_exit(11048d0,2013e84,1abbbce8,0,0,...) at fork_exit+0x7e/frame 0x1abbbcd4 fork_trampoline() at PTDpde+0x42da/frame 0x1abbbcd4 --- trap 0, eip = 0, esp = 0x1abbbd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100089 td 0x1b2cf000 sched_switch(1b2cf000,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1abdab98 mi_switch(104,0,1a886b5,22b,1b2cf000,...) at mi_switch+0x1f3/frame 0x1abdabd8 sleepq_switch(1b2cf000,0,1a886b5,2b3,1b2fb080,...) at sleepq_switch+0x110/frame 0x1abdac0c sleepq_wait(1b2fb080,0,1a81b03,1a678bb,0,...) at sleepq_wait+0x48/frame 0x1abdac30 msleep_spin_sbt(1b2fb080,1b2fb09c,1a678bb,0,0,...) at msleep_spin_sbt+0x226/frame 0x1abdac74 taskqueue_thread_loop(2015a74,1abdace8,1a7773c,407,0,...) at taskqueue_thread_loop+0xf3/frame 0x1abdacac fork_exit(11048d0,2015a74,1abdace8,0,0,...) at fork_exit+0x7e/frame 0x1abdacd4 fork_trampoline() at PTDpde+0x42da/frame 0x1abdacd4 --- trap 0, eip = 0, esp = 0x1abdad20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100090 td 0x1b2cea80 sched_switch(1b2cea80,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1abdfb98 mi_switch(104,0,1a886b5,22b,1b2cea80,...) at mi_switch+0x1f3/frame 0x1abdfbd8 sleepq_switch(1b2cea80,0,1a886b5,2b3,1b2fb080,...) at sleepq_switch+0x110/frame 0x1abdfc0c sleepq_wait(1b2fb080,0,1a81b03,1a678bb,0,...) at sleepq_wait+0x48/frame 0x1abdfc30 msleep_spin_sbt(1b2fb080,1b2fb09c,1a678bb,0,0,...) at msleep_spin_sbt+0x226/frame 0x1abdfc74 taskqueue_thread_loop(2015a74,1abdfce8,1a7773c,407,0,...) at taskqueue_thread_loop+0xf3/frame 0x1abdfcac fork_exit(11048d0,2015a74,1abdfce8,0,0,...) at fork_exit+0x7e/frame 0x1abdfcd4 fork_trampoline() at PTDpde+0x42da/frame 0x1abdfcd4 --- trap 0, eip = 0, esp = 0x1abdfd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100091 td 0x1b2ce700 sched_switch(1b2ce700,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1abe4b98 mi_switch(104,0,1a886b5,22b,1b2ce700,...) at mi_switch+0x1f3/frame 0x1abe4bd8 sleepq_switch(1b2ce700,0,1a886b5,2b3,1b2fb080,...) at sleepq_switch+0x110/frame 0x1abe4c0c sleepq_wait(1b2fb080,0,1a81b03,1a678bb,0,...) at sleepq_wait+0x48/frame 0x1abe4c30 msleep_spin_sbt(1b2fb080,1b2fb09c,1a678bb,0,0,...) at msleep_spin_sbt+0x226/frame 0x1abe4c74 taskqueue_thread_loop(2015a74,1abe4ce8,1a7773c,407,0,...) at taskqueue_thread_loop+0xf3/frame 0x1abe4cac fork_exit(11048d0,2015a74,1abe4ce8,0,0,...) at fork_exit+0x7e/frame 0x1abe4cd4 fork_trampoline() at PTDpde+0x42da/frame 0x1abe4cd4 --- trap 0, eip = 0, esp = 0x1abe4d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100093 td 0x1b2ce000 sched_switch(1b2ce000,0,104,189,166f4c0,...) at sched_switch+0x80c/frame 0x1abeeb88 mi_switch(104,0,1a886b5,22b,1b2ce000,...) at mi_switch+0x1f3/frame 0x1abeebc8 sleepq_switch(1b2ce000,0,1a886b5,2b3,1b2ce000,...) at sleepq_switch+0x110/frame 0x1abeebfc sleepq_wait(bff8980,0,1a678bb,0,0,...) at sleepq_wait+0x48/frame 0x1abeec20 _sleep(bff8980,bff899c,0,1a678bb,0,...) at _sleep+0x396/frame 0x1abeec74 taskqueue_thread_loop(1d9fe68,1abeece8,1a7773c,407,0,...) at taskqueue_thread_loop+0x144/frame 0x1abeecac fork_exit(11048d0,1d9fe68,1abeece8,0,0,...) at fork_exit+0x7e/frame 0x1abeecd4 fork_trampoline() at PTDpde+0x42da/frame 0x1abeecd4 --- trap 0, eip = 0, esp = 0x1abeed20, ebp = 0 --- (null)() at 0 db:0:pho> dump Physical memory: 3427 MB Dumping 346 MB: 331 315 299 283 267 251 235 219 203 187 171 155 139 123 107 91 75 59 43 27 11 Dump complete db> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 3 $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/amd64/include/vmparam.h =================================================================== --- /usr/src/sys/amd64/include/vmparam.h (revision 332760) +++ /usr/src/sys/amd64/include/vmparam.h (working copy) @@ -227,4 +227,10 @@ #define ZERO_REGION_SIZE (2 * 1024 * 1024) /* 2MB */ +/* + * Use a fairly large batch size since we expect amd64 systems to have lots of + * memory. + */ +#define VM_BATCHQUEUE_SIZE 31 + #endif /* _MACHINE_VMPARAM_H_ */ Index: /usr/src/sys/kern/subr_witness.c =================================================================== --- /usr/src/sys/kern/subr_witness.c (revision 332760) +++ /usr/src/sys/kern/subr_witness.c (working copy) @@ -603,7 +603,6 @@ static struct witness_order_list_entry order_lists * CDEV */ { "vm map (system)", &lock_class_mtx_sleep }, - { "vm pagequeue", &lock_class_mtx_sleep }, { "vnode interlock", &lock_class_mtx_sleep }, { "cdev", &lock_class_mtx_sleep }, { NULL, NULL }, @@ -613,11 +612,11 @@ static struct witness_order_list_entry order_lists { "vm map (user)", &lock_class_sx }, { "vm object", &lock_class_rw }, { "vm page", &lock_class_mtx_sleep }, - { "vm pagequeue", &lock_class_mtx_sleep }, { "pmap pv global", &lock_class_rw }, { "pmap", &lock_class_mtx_sleep }, { "pmap pv list", &lock_class_rw }, { "vm page free queue", &lock_class_mtx_sleep }, + { "vm pagequeue", &lock_class_mtx_sleep }, { NULL, NULL }, /* * kqueue/VFS interaction Index: /usr/src/sys/vm/vm_object.c =================================================================== --- /usr/src/sys/vm/vm_object.c (revision 332760) +++ /usr/src/sys/vm/vm_object.c (working copy) @@ -720,14 +720,11 @@ static void vm_object_terminate_pages(vm_object_t object) { vm_page_t p, p_next; - struct mtx *mtx, *mtx1; - struct vm_pagequeue *pq, *pq1; - int dequeued; + struct mtx *mtx; VM_OBJECT_ASSERT_WLOCKED(object); mtx = NULL; - pq = NULL; /* * Free any remaining pageable pages. This also removes them from the @@ -737,60 +734,21 @@ vm_object_terminate_pages(vm_object_t object) */ TAILQ_FOREACH_SAFE(p, &object->memq, listq, p_next) { vm_page_assert_unbusied(p); - if ((object->flags & OBJ_UNMANAGED) == 0) { + if ((object->flags & OBJ_UNMANAGED) == 0) /* * vm_page_free_prep() only needs the page * lock for managed pages. */ - mtx1 = vm_page_lockptr(p); - if (mtx1 != mtx) { - if (mtx != NULL) - mtx_unlock(mtx); - if (pq != NULL) { - vm_pagequeue_cnt_add(pq, dequeued); - vm_pagequeue_unlock(pq); - pq = NULL; - } - mtx = mtx1; - mtx_lock(mtx); - } - } + vm_page_change_lock(p, &mtx); p->object = NULL; if (p->wire_count != 0) - goto unlist; + continue; VM_CNT_INC(v_pfree); - p->flags &= ~PG_ZERO; - if (p->queue != PQ_NONE) { - KASSERT(p->queue < PQ_COUNT, ("vm_object_terminate: " - "page %p is not queued", p)); - pq1 = vm_page_pagequeue(p); - if (pq != pq1) { - if (pq != NULL) { - vm_pagequeue_cnt_add(pq, dequeued); - vm_pagequeue_unlock(pq); - } - pq = pq1; - vm_pagequeue_lock(pq); - dequeued = 0; - } - p->queue = PQ_NONE; - TAILQ_REMOVE(&pq->pq_pl, p, plinks.q); - dequeued--; - } - if (vm_page_free_prep(p, true)) - continue; -unlist: - TAILQ_REMOVE(&object->memq, p, listq); + vm_page_free(p); } - if (pq != NULL) { - vm_pagequeue_cnt_add(pq, dequeued); - vm_pagequeue_unlock(pq); - } if (mtx != NULL) mtx_unlock(mtx); - vm_page_free_phys_pglist(&object->memq); - /* * If the object contained any pages, then reset it to an empty state. * None of the object's fields, including "resident_page_count", were @@ -1973,7 +1931,6 @@ vm_object_page_remove(vm_object_t object, vm_pinde { vm_page_t p, next; struct mtx *mtx; - struct pglist pgl; VM_OBJECT_ASSERT_WLOCKED(object); KASSERT((object->flags & OBJ_UNMANAGED) == 0 || @@ -1982,7 +1939,6 @@ vm_object_page_remove(vm_object_t object, vm_pinde if (object->resident_page_count == 0) return; vm_object_pip_add(object, 1); - TAILQ_INIT(&pgl); again: p = vm_page_find_least(object, start); mtx = NULL; @@ -2036,13 +1992,10 @@ again: } if ((options & OBJPR_NOTMAPPED) == 0 && object->ref_count != 0) pmap_remove_all(p); - p->flags &= ~PG_ZERO; - if (vm_page_free_prep(p, false)) - TAILQ_INSERT_TAIL(&pgl, p, listq); + vm_page_free(p); } if (mtx != NULL) mtx_unlock(mtx); - vm_page_free_phys_pglist(&pgl); vm_object_pip_wakeup(object); } Index: /usr/src/sys/vm/vm_page.c =================================================================== --- /usr/src/sys/vm/vm_page.c (revision 332760) +++ /usr/src/sys/vm/vm_page.c (working copy) @@ -102,6 +102,7 @@ __FBSDID("$FreeBSD$"); #include #include #include +#include #include #include #include @@ -131,13 +132,10 @@ extern int uma_startup_count(int); extern void uma_startup(void *, int); extern int vmem_startup_count(void); -/* - * Associated with page of user-allocatable memory is a - * page structure. - */ - struct vm_domain vm_dom[MAXMEMDOM]; +static DPCPU_DEFINE(struct vm_batchqueue, pqbatch[MAXMEMDOM][PQ_COUNT]); + struct mtx_padalign __exclusive_cache_line pa_lock[PA_LOCK_COUNT]; struct mtx_padalign __exclusive_cache_line vm_domainset_lock; @@ -176,7 +174,8 @@ static uma_zone_t fakepg_zone; static void vm_page_alloc_check(vm_page_t m); static void vm_page_clear_dirty_mask(vm_page_t m, vm_page_bits_t pagebits); -static void vm_page_enqueue(uint8_t queue, vm_page_t m); +static void vm_page_dequeue_complete(vm_page_t m); +static void vm_page_enqueue(vm_page_t m, uint8_t queue); static void vm_page_init(void *dummy); static int vm_page_insert_after(vm_page_t m, vm_object_t object, vm_pindex_t pindex, vm_page_t mpred); @@ -1826,6 +1825,7 @@ again: KASSERT(m != NULL, ("missing page")); found: + vm_page_dequeue(m); vm_page_alloc_check(m); /* @@ -2022,8 +2022,10 @@ again: #if VM_NRESERVLEVEL > 0 found: #endif - for (m = m_ret; m < &m_ret[npages]; m++) + for (m = m_ret; m < &m_ret[npages]; m++) { + vm_page_dequeue(m); vm_page_alloc_check(m); + } /* * Initialize the pages. Only the PG_ZERO flag is inherited. @@ -2167,6 +2169,7 @@ again: goto again; return (NULL); } + vm_page_dequeue(m); vm_page_alloc_check(m); /* @@ -2360,7 +2363,7 @@ retry: vm_reserv_size(level)) - pa); #endif } else if (object->memattr == VM_MEMATTR_DEFAULT && - m->queue != PQ_NONE && !vm_page_busied(m)) { + vm_page_enqueued(m) && !vm_page_busied(m)) { /* * The page is allocated but eligible for * relocation. Extend the current run by one @@ -2511,7 +2514,7 @@ retry: error = EINVAL; else if (object->memattr != VM_MEMATTR_DEFAULT) error = EINVAL; - else if (m->queue != PQ_NONE && !vm_page_busied(m)) { + else if (vm_page_enqueued(m) && !vm_page_busied(m)) { KASSERT(pmap_page_get_memattr(m) == VM_MEMATTR_DEFAULT, ("page %p has an unexpected memattr", m)); @@ -2571,7 +2574,8 @@ retry: */ if (object->ref_count != 0) pmap_remove_all(m); - m_new->aflags = m->aflags; + m_new->aflags = m->aflags & + ~PGA_QUEUE_STATE_MASK; KASSERT(m_new->oflags == VPO_UNMANAGED, ("page %p is managed", m_new)); m_new->oflags = m->oflags & VPO_NOSYNC; @@ -2583,7 +2587,7 @@ retry: vm_page_remque(m); vm_page_replace_checked(m_new, object, m->pindex, m); - if (vm_page_free_prep(m, false)) + if (vm_page_free_prep(m)) SLIST_INSERT_HEAD(&free, m, plinks.s.ss); @@ -2597,7 +2601,7 @@ retry: m->flags &= ~PG_ZERO; vm_page_remque(m); vm_page_remove(m); - if (vm_page_free_prep(m, false)) + if (vm_page_free_prep(m)) SLIST_INSERT_HEAD(&free, m, plinks.s.ss); KASSERT(m->dirty == 0, @@ -3040,35 +3044,209 @@ vm_page_pagequeue(vm_page_t m) return (&vm_pagequeue_domain(m)->vmd_pagequeues[m->queue]); } +static struct mtx * +vm_page_pagequeue_lockptr(vm_page_t m) +{ + + if (m->queue == PQ_NONE) + return (NULL); + return (&vm_page_pagequeue(m)->pq_mutex); +} + +static inline void +vm_pqbatch_process_page(struct vm_pagequeue *pq, vm_page_t m) +{ + struct vm_domain *vmd; + uint8_t aflags; + + vm_pagequeue_assert_locked(pq); + KASSERT(pq == vm_page_pagequeue(m), + ("page %p doesn't belong to %p", m, pq)); + + aflags = m->aflags; + if ((aflags & PGA_DEQUEUE) != 0) { + if (__predict_true((aflags & PGA_ENQUEUED) != 0)) { + TAILQ_REMOVE(&pq->pq_pl, m, plinks.q); + vm_pagequeue_cnt_dec(pq); + } + vm_page_dequeue_complete(m); + } else if ((aflags & (PGA_REQUEUE | PGA_REQUEUE_HEAD)) != 0) { + if ((aflags & PGA_ENQUEUED) != 0) + TAILQ_REMOVE(&pq->pq_pl, m, plinks.q); + else { + vm_pagequeue_cnt_inc(pq); + vm_page_aflag_set(m, PGA_ENQUEUED); + } + if ((aflags & PGA_REQUEUE_HEAD) != 0) { + KASSERT(m->queue == PQ_INACTIVE, + ("head enqueue not supported for page %p", m)); + vmd = vm_pagequeue_domain(m); + TAILQ_INSERT_BEFORE(&vmd->vmd_inacthead, m, plinks.q); + } else + TAILQ_INSERT_TAIL(&pq->pq_pl, m, plinks.q); + + /* + * PGA_REQUEUE and PGA_REQUEUE_HEAD must be cleared after + * setting PGA_ENQUEUED in order to synchronize with the + * page daemon. + */ + vm_page_aflag_clear(m, PGA_REQUEUE | PGA_REQUEUE_HEAD); + } +} + +static void +vm_pqbatch_process(struct vm_pagequeue *pq, struct vm_batchqueue *bq, + uint8_t queue) +{ + vm_page_t m; + int i; + + for (i = 0; i < bq->bq_cnt; i++) { + m = bq->bq_pa[i]; + if (__predict_false(m->queue != queue)) + continue; + vm_pqbatch_process_page(pq, m); + } + vm_batchqueue_init(bq); +} + +static void +vm_pqbatch_submit_page(vm_page_t m, uint8_t queue) +{ + struct vm_batchqueue *bq; + struct vm_pagequeue *pq; + int domain; + + vm_page_assert_locked(m); + KASSERT(queue < PQ_COUNT, ("invalid queue %d", queue)); + + domain = vm_phys_domain(m); + pq = &vm_pagequeue_domain(m)->vmd_pagequeues[queue]; + + critical_enter(); + bq = DPCPU_PTR(pqbatch[domain][queue]); + if (vm_batchqueue_insert(bq, m)) { + critical_exit(); + return; + } + if (!vm_pagequeue_trylock(pq)) { + critical_exit(); + vm_pagequeue_lock(pq); + critical_enter(); + bq = DPCPU_PTR(pqbatch[domain][queue]); + } + vm_pqbatch_process(pq, bq, queue); + + /* + * The page may have been logically dequeued before we acquired the + * page queue lock. In this case, the page lock prevents the page + * from being logically enqueued elsewhere. + */ + if (__predict_true(m->queue == queue)) + vm_pqbatch_process_page(pq, m); + else { + KASSERT(m->queue == PQ_NONE, + ("invalid queue transition for page %p", m)); + KASSERT((m->aflags & PGA_ENQUEUED) == 0, + ("page %p is enqueued with invalid queue index", m)); + vm_page_aflag_clear(m, PGA_QUEUE_STATE_MASK); + } + vm_pagequeue_unlock(pq); + critical_exit(); +} + /* - * vm_page_dequeue: + * vm_page_drain_pqbatch: [ internal use only ] * - * Remove the given page from its current page queue. + * Force all per-CPU page queue batch queues to be drained. This is + * intended for use in severe memory shortages, to ensure that pages + * do not remain stuck in the batch queues. + */ +void +vm_page_drain_pqbatch(void) +{ + struct thread *td; + struct vm_domain *vmd; + struct vm_pagequeue *pq; + int domain, i, queue; + + td = curthread; + CPU_FOREACH(i) { + thread_lock(td); + sched_bind(td, i); + thread_unlock(td); + + for (domain = 0; domain < vm_ndomains; domain++) { + vmd = VM_DOMAIN(domain); + for (queue = 0; queue < PQ_COUNT; queue++) { + pq = &vmd->vmd_pagequeues[queue]; + vm_pagequeue_lock(pq); + critical_enter(); + vm_pqbatch_process(pq, + DPCPU_PTR(pqbatch[domain][queue]), queue); + critical_exit(); + vm_pagequeue_unlock(pq); + } + } + } + thread_lock(td); + sched_unbind(td); + thread_unlock(td); +} + +/* + * Complete the logical removal of a page from a page queue. We must be + * careful to synchronize with the page daemon, which may be concurrently + * examining the page with only the page lock held. The page must not be + * in a state where it appears to be logically enqueued. + */ +static void +vm_page_dequeue_complete(vm_page_t m) +{ + + m->queue = PQ_NONE; + atomic_thread_fence_rel(); + vm_page_aflag_clear(m, PGA_QUEUE_STATE_MASK); +} + +/* + * vm_page_dequeue_deferred: [ internal use only ] * + * Request removal of the given page from its current page + * queue. Physical removal from the queue may be deferred + * indefinitely. + * * The page must be locked. */ void -vm_page_dequeue(vm_page_t m) +vm_page_dequeue_deferred(vm_page_t m) { - struct vm_pagequeue *pq; + int queue; vm_page_assert_locked(m); - KASSERT(m->queue < PQ_COUNT, ("vm_page_dequeue: page %p is not queued", - m)); - pq = vm_page_pagequeue(m); - vm_pagequeue_lock(pq); - m->queue = PQ_NONE; - TAILQ_REMOVE(&pq->pq_pl, m, plinks.q); - vm_pagequeue_cnt_dec(pq); - vm_pagequeue_unlock(pq); + + queue = m->queue; + if (queue == PQ_NONE) { + KASSERT((m->aflags & PGA_QUEUE_STATE_MASK) == 0, + ("page %p has queue state", m)); + return; + } + if ((m->aflags & PGA_DEQUEUE) == 0) + vm_page_aflag_set(m, PGA_DEQUEUE); + vm_pqbatch_submit_page(m, queue); } /* * vm_page_dequeue_locked: * - * Remove the given page from its current page queue. + * Remove the page from its page queue, which must be locked. + * If the page lock is not held, there is no guarantee that the + * page will not be enqueued by another thread before this function + * returns. In this case, it is up to the caller to ensure that + * no other threads hold a reference to the page. * - * The page and page queue must be locked. + * The page queue lock must be held. If the page is not already + * logically dequeued, the page lock must be held as well. */ void vm_page_dequeue_locked(vm_page_t m) @@ -3075,78 +3253,88 @@ vm_page_dequeue_locked(vm_page_t m) { struct vm_pagequeue *pq; - vm_page_lock_assert(m, MA_OWNED); pq = vm_page_pagequeue(m); + + KASSERT(m->queue != PQ_NONE, + ("%s: page %p queue field is PQ_NONE", __func__, m)); vm_pagequeue_assert_locked(pq); - m->queue = PQ_NONE; - TAILQ_REMOVE(&pq->pq_pl, m, plinks.q); - vm_pagequeue_cnt_dec(pq); + KASSERT((m->aflags & PGA_DEQUEUE) != 0 || + mtx_owned(vm_page_lockptr(m)), + ("%s: queued unlocked page %p", __func__, m)); + + if ((m->aflags & PGA_ENQUEUED) != 0) { + TAILQ_REMOVE(&pq->pq_pl, m, plinks.q); + vm_pagequeue_cnt_dec(pq); + } + vm_page_dequeue_complete(m); } /* - * vm_page_enqueue: + * vm_page_dequeue: * - * Add the given page to the specified page queue. - * - * The page must be locked. + * Remove the page from whichever page queue it's in, if any. + * If the page lock is not held, there is no guarantee that the + * page will not be enqueued by another thread before this function + * returns. In this case, it is up to the caller to ensure that + * no other threads hold a reference to the page. */ -static void -vm_page_enqueue(uint8_t queue, vm_page_t m) +void +vm_page_dequeue(vm_page_t m) { - struct vm_pagequeue *pq; + struct mtx *lock, *lock1; - vm_page_lock_assert(m, MA_OWNED); - KASSERT(queue < PQ_COUNT, - ("vm_page_enqueue: invalid queue %u request for page %p", - queue, m)); - pq = &vm_pagequeue_domain(m)->vmd_pagequeues[queue]; - vm_pagequeue_lock(pq); - m->queue = queue; - TAILQ_INSERT_TAIL(&pq->pq_pl, m, plinks.q); - vm_pagequeue_cnt_inc(pq); - vm_pagequeue_unlock(pq); + lock = vm_page_pagequeue_lockptr(m); + for (;;) { + if (lock == NULL) + return; + mtx_lock(lock); + if ((lock1 = vm_page_pagequeue_lockptr(m)) == lock) + break; + mtx_unlock(lock); + lock = lock1; + } + KASSERT(lock == vm_page_pagequeue_lockptr(m), + ("%s: page %p migrated directly between queues", __func__, m)); + vm_page_dequeue_locked(m); + mtx_unlock(lock); } /* - * vm_page_requeue: - * - * Move the given page to the tail of its current page queue. - * - * The page must be locked. + * Schedule the given page for insertion into the specified page queue. + * Physical insertion of the page may be deferred indefinitely. */ -void -vm_page_requeue(vm_page_t m) +static void +vm_page_enqueue(vm_page_t m, uint8_t queue) { - struct vm_pagequeue *pq; - vm_page_lock_assert(m, MA_OWNED); - KASSERT(m->queue != PQ_NONE, - ("vm_page_requeue: page %p is not queued", m)); - pq = vm_page_pagequeue(m); - vm_pagequeue_lock(pq); - TAILQ_REMOVE(&pq->pq_pl, m, plinks.q); - TAILQ_INSERT_TAIL(&pq->pq_pl, m, plinks.q); - vm_pagequeue_unlock(pq); + vm_page_assert_locked(m); + KASSERT(m->queue == PQ_NONE && (m->aflags & PGA_QUEUE_STATE_MASK) == 0, + ("%s: page %p is already enqueued", __func__, m)); + + m->queue = queue; + if ((m->aflags & PGA_REQUEUE) == 0) + vm_page_aflag_set(m, PGA_REQUEUE); + vm_pqbatch_submit_page(m, queue); } /* - * vm_page_requeue_locked: + * vm_page_requeue: [ internal use only ] * - * Move the given page to the tail of its current page queue. + * Schedule a requeue of the given page. * - * The page queue must be locked. + * The page must be locked. */ void -vm_page_requeue_locked(vm_page_t m) +vm_page_requeue(vm_page_t m) { - struct vm_pagequeue *pq; + vm_page_assert_locked(m); KASSERT(m->queue != PQ_NONE, - ("vm_page_requeue_locked: page %p is not queued", m)); - pq = vm_page_pagequeue(m); - vm_pagequeue_assert_locked(pq); - TAILQ_REMOVE(&pq->pq_pl, m, plinks.q); - TAILQ_INSERT_TAIL(&pq->pq_pl, m, plinks.q); + ("%s: page %p is not logically enqueued", __func__, m)); + + if ((m->aflags & PGA_REQUEUE) == 0) + vm_page_aflag_set(m, PGA_REQUEUE); + vm_pqbatch_submit_page(m, m->queue); } /* @@ -3164,18 +3352,18 @@ vm_page_activate(vm_page_t m) int queue; vm_page_lock_assert(m, MA_OWNED); - if ((queue = m->queue) != PQ_ACTIVE) { - if (m->wire_count == 0 && (m->oflags & VPO_UNMANAGED) == 0) { - if (m->act_count < ACT_INIT) - m->act_count = ACT_INIT; - if (queue != PQ_NONE) - vm_page_dequeue(m); - vm_page_enqueue(PQ_ACTIVE, m); - } - } else { - if (m->act_count < ACT_INIT) + + if ((queue = m->queue) == PQ_ACTIVE || m->wire_count > 0 || + (m->oflags & VPO_UNMANAGED) != 0) { + if (queue == PQ_ACTIVE && m->act_count < ACT_INIT) m->act_count = ACT_INIT; + return; } + + vm_page_remque(m); + if (m->act_count < ACT_INIT) + m->act_count = ACT_INIT; + vm_page_enqueue(m, PQ_ACTIVE); } /* @@ -3186,11 +3374,10 @@ vm_page_activate(vm_page_t m) * the page to the free list only if this function returns true. * * The object must be locked. The page must be locked if it is - * managed. For a queued managed page, the pagequeue_locked - * argument specifies whether the page queue is already locked. + * managed. */ bool -vm_page_free_prep(vm_page_t m, bool pagequeue_locked) +vm_page_free_prep(vm_page_t m) { #if defined(DIAGNOSTIC) && defined(PHYS_TO_DMAP) @@ -3206,14 +3393,14 @@ bool if ((m->oflags & VPO_UNMANAGED) == 0) { vm_page_lock_assert(m, MA_OWNED); KASSERT(!pmap_page_is_mapped(m), - ("vm_page_free_toq: freeing mapped page %p", m)); + ("vm_page_free_prep: freeing mapped page %p", m)); } else KASSERT(m->queue == PQ_NONE, - ("vm_page_free_toq: unmanaged page %p is queued", m)); + ("vm_page_free_prep: unmanaged page %p is queued", m)); VM_CNT_INC(v_tfree); if (vm_page_sbusied(m)) - panic("vm_page_free: freeing busy page %p", m); + panic("vm_page_free_prep: freeing busy page %p", m); vm_page_remove(m); @@ -3229,21 +3416,23 @@ bool return (false); } - if (m->queue != PQ_NONE) { - if (pagequeue_locked) - vm_page_dequeue_locked(m); - else - vm_page_dequeue(m); - } + /* + * Pages need not be dequeued before they are returned to the physical + * memory allocator, but they must at least be marked for a deferred + * dequeue. + */ + if ((m->oflags & VPO_UNMANAGED) == 0) + vm_page_dequeue_deferred(m); + m->valid = 0; vm_page_undirty(m); if (m->wire_count != 0) - panic("vm_page_free: freeing wired page %p", m); + panic("vm_page_free_prep: freeing wired page %p", m); if (m->hold_count != 0) { m->flags &= ~PG_ZERO; KASSERT((m->flags & PG_UNHOLDFREE) == 0, - ("vm_page_free: freeing PG_UNHOLDFREE page %p", m)); + ("vm_page_free_prep: freeing PG_UNHOLDFREE page %p", m)); m->flags |= PG_UNHOLDFREE; return (false); } @@ -3262,36 +3451,6 @@ bool return (true); } -void -vm_page_free_phys_pglist(struct pglist *tq) -{ - struct vm_domain *vmd; - vm_page_t m; - int cnt; - - if (TAILQ_EMPTY(tq)) - return; - vmd = NULL; - cnt = 0; - TAILQ_FOREACH(m, tq, listq) { - if (vmd != vm_pagequeue_domain(m)) { - if (vmd != NULL) { - vm_domain_free_unlock(vmd); - vm_domain_freecnt_inc(vmd, cnt); - cnt = 0; - } - vmd = vm_pagequeue_domain(m); - vm_domain_free_lock(vmd); - } - vm_phys_free_pages(m, 0); - cnt++; - } - if (vmd != NULL) { - vm_domain_free_unlock(vmd); - vm_domain_freecnt_inc(vmd, cnt); - } -} - /* * vm_page_free_toq: * @@ -3306,7 +3465,7 @@ vm_page_free_toq(vm_page_t m) { struct vm_domain *vmd; - if (!vm_page_free_prep(m, false)) + if (!vm_page_free_prep(m)) return; vmd = vm_pagequeue_domain(m); @@ -3404,22 +3563,25 @@ vm_page_unwire(vm_page_t m, uint8_t queue) KASSERT(queue < PQ_COUNT || queue == PQ_NONE, ("vm_page_unwire: invalid queue %u request for page %p", queue, m)); + if ((m->oflags & VPO_UNMANAGED) == 0) + vm_page_assert_locked(m); unwired = vm_page_unwire_noq(m); - if (unwired && (m->oflags & VPO_UNMANAGED) == 0 && m->object != NULL) { - if (m->queue == queue) { + if (!unwired || (m->oflags & VPO_UNMANAGED) != 0 || m->object == NULL) + return (unwired); + + if (m->queue == queue) { + if (queue == PQ_ACTIVE) + vm_page_reference(m); + else if (queue != PQ_NONE) + vm_page_requeue(m); + } else { + vm_page_dequeue(m); + if (queue != PQ_NONE) { + vm_page_enqueue(m, queue); if (queue == PQ_ACTIVE) - vm_page_reference(m); - else if (queue != PQ_NONE) - vm_page_requeue(m); - } else { - vm_page_remque(m); - if (queue != PQ_NONE) { - vm_page_enqueue(queue, m); - if (queue == PQ_ACTIVE) - /* Initialize act_count. */ - vm_page_activate(m); - } + /* Initialize act_count. */ + vm_page_activate(m); } } return (unwired); @@ -3455,65 +3617,32 @@ vm_page_unwire_noq(vm_page_t m) } /* - * Move the specified page to the inactive queue, or requeue the page if it is - * already in the inactive queue. + * Move the specified page to the tail of the inactive queue, or requeue + * the page if it is already in the inactive queue. * - * Normally, "noreuse" is FALSE, resulting in LRU ordering of the inactive - * queue. However, setting "noreuse" to TRUE will accelerate the specified - * page's reclamation, but it will not unmap the page from any address space. - * This is implemented by inserting the page near the head of the inactive - * queue, using a marker page to guide FIFO insertion ordering. - * * The page must be locked. */ -static inline void -_vm_page_deactivate(vm_page_t m, boolean_t noreuse) +void +vm_page_deactivate(vm_page_t m) { - struct vm_pagequeue *pq; - int queue; vm_page_assert_locked(m); - if (m->wire_count == 0 && (m->oflags & VPO_UNMANAGED) == 0) { - pq = &vm_pagequeue_domain(m)->vmd_pagequeues[PQ_INACTIVE]; - /* Avoid multiple acquisitions of the inactive queue lock. */ - queue = m->queue; - if (queue == PQ_INACTIVE) { - vm_pagequeue_lock(pq); - vm_page_dequeue_locked(m); - } else { - if (queue != PQ_NONE) - vm_page_dequeue(m); - vm_pagequeue_lock(pq); - } - m->queue = PQ_INACTIVE; - if (noreuse) - TAILQ_INSERT_BEFORE( - &vm_pagequeue_domain(m)->vmd_inacthead, m, - plinks.q); - else - TAILQ_INSERT_TAIL(&pq->pq_pl, m, plinks.q); - vm_pagequeue_cnt_inc(pq); - vm_pagequeue_unlock(pq); - } -} + if (m->wire_count > 0 || (m->oflags & VPO_UNMANAGED) != 0) + return; -/* - * Move the specified page to the inactive queue, or requeue the page if it is - * already in the inactive queue. - * - * The page must be locked. - */ -void -vm_page_deactivate(vm_page_t m) -{ - - _vm_page_deactivate(m, FALSE); + if (!vm_page_inactive(m)) { + vm_page_remque(m); + vm_page_enqueue(m, PQ_INACTIVE); + } else + vm_page_requeue(m); } /* - * Move the specified page to the inactive queue with the expectation - * that it is unlikely to be reused. + * Move the specified page close to the head of the inactive queue, + * bypassing LRU. A marker page is used to maintain FIFO ordering. + * As with regular enqueues, we use a per-CPU batch queue to reduce + * contention on the page queue lock. * * The page must be locked. */ @@ -3521,7 +3650,17 @@ void vm_page_deactivate_noreuse(vm_page_t m) { - _vm_page_deactivate(m, TRUE); + vm_page_assert_locked(m); + + if (m->wire_count > 0 || (m->oflags & VPO_UNMANAGED) != 0) + return; + + if (!vm_page_inactive(m)) + vm_page_remque(m); + m->queue = PQ_INACTIVE; + if ((m->aflags & PGA_REQUEUE_HEAD) == 0) + vm_page_aflag_set(m, PGA_REQUEUE_HEAD); + vm_pqbatch_submit_page(m, PQ_INACTIVE); } /* @@ -3534,13 +3673,14 @@ vm_page_launder(vm_page_t m) { vm_page_assert_locked(m); - if (m->wire_count == 0 && (m->oflags & VPO_UNMANAGED) == 0) { - if (m->queue == PQ_LAUNDRY) - vm_page_requeue(m); - else { - vm_page_remque(m); - vm_page_enqueue(PQ_LAUNDRY, m); - } + if (m->wire_count > 0 || (m->oflags & VPO_UNMANAGED) != 0) + return; + + if (m->queue == PQ_LAUNDRY) + vm_page_requeue(m); + else { + vm_page_remque(m); + vm_page_enqueue(m, PQ_LAUNDRY); } } @@ -3556,9 +3696,9 @@ vm_page_unswappable(vm_page_t m) vm_page_assert_locked(m); KASSERT(m->wire_count == 0 && (m->oflags & VPO_UNMANAGED) == 0, ("page %p already unswappable", m)); - if (m->queue != PQ_NONE) - vm_page_dequeue(m); - vm_page_enqueue(PQ_UNSWAPPABLE, m); + + vm_page_remque(m); + vm_page_enqueue(m, PQ_UNSWAPPABLE); } /* Index: /usr/src/sys/vm/vm_page.h =================================================================== --- /usr/src/sys/vm/vm_page.h (revision 332760) +++ /usr/src/sys/vm/vm_page.h (working copy) @@ -93,8 +93,11 @@ * * In general, operations on this structure's mutable fields are * synchronized using either one of or a combination of the lock on the - * object that the page belongs to (O), the pool lock for the page (P), - * or the lock for either the free or paging queue (Q). If a field is + * object that the page belongs to (O), the page lock (P), + * the per-domain lock for the free queues (F), or the page's queue + * lock (Q). The physical address of a page is used to select its page + * lock from a pool. The queue lock for a page depends on the value of + * its queue field and described in detail below. If a field is * annotated below with two of these locks, then holding either lock is * sufficient for read access, but both locks are required for write * access. An annotation of (C) indicates that the field is immutable. @@ -143,6 +146,29 @@ * causing the thread to block. vm_page_sleep_if_busy() can be used to * sleep until the page's busy state changes, after which the caller * must re-lookup the page and re-evaluate its state. + * + * The queue field is the index of the page queue containing the + * page, or PQ_NONE if the page is not enqueued. The queue lock of a + * page is the page queue lock corresponding to the page queue index, + * or the page lock (P) for the page if it is not enqueued. To modify + * the queue field, the queue lock for the old value of the field must + * be held. It is invalid for a page's queue field to transition + * between two distinct page queue indices. That is, when updating + * the queue field, either the new value or the old value must be + * PQ_NONE. + * + * To avoid contention on page queue locks, page queue operations + * (enqueue, dequeue, requeue) are batched using per-CPU queues. + * A deferred operation is requested by inserting an entry into a + * batch queue; the entry is simply a pointer to the page, and the + * request type is encoded in the page's aflags field using the values + * in PGA_QUEUE_STATE_MASK. The type-stability of struct vm_pages is + * crucial to this scheme since the processing of entries in a given + * batch queue may be deferred indefinitely. In particular, a page + * may be freed before its pending batch queue entries have been + * processed. The page lock (P) must be held to schedule a batched + * queue operation, and the page queue lock must be held in order to + * process batch queue entries for the page queue. */ #if PAGE_SIZE == 4096 @@ -174,7 +200,7 @@ struct vm_page { TAILQ_ENTRY(vm_page) listq; /* pages in same object (O) */ vm_object_t object; /* which object am I in (O,P) */ vm_pindex_t pindex; /* offset into object (O,P) */ - vm_paddr_t phys_addr; /* physical address of page */ + vm_paddr_t phys_addr; /* physical address of page (C) */ struct md_page md; /* machine dependent stuff */ u_int wire_count; /* wired down maps refs (P) */ volatile u_int busy_lock; /* busy owners lock */ @@ -182,11 +208,11 @@ struct vm_page { uint16_t flags; /* page PG_* flags (P) */ uint8_t aflags; /* access is atomic */ uint8_t oflags; /* page VPO_* flags (O) */ - uint8_t queue; /* page queue index (P,Q) */ + uint8_t queue; /* page queue index (Q) */ int8_t psind; /* pagesizes[] index (O) */ int8_t segind; /* vm_phys segment index (C) */ - uint8_t order; /* index of the buddy queue */ - uint8_t pool; /* vm_phys freepool index (Q) */ + uint8_t order; /* index of the buddy queue (F) */ + uint8_t pool; /* vm_phys freepool index (F) */ u_char act_count; /* page usage count (P) */ /* NOTE that these must support one bit per DEV_BSIZE in a page */ /* so, on normal X86 kernels, they must be at least 8 bits wide */ @@ -314,11 +340,39 @@ extern struct mtx_padalign pa_lock[]; * * PGA_EXECUTABLE may be set by pmap routines, and indicates that a page has * at least one executable mapping. It is not consumed by the MI VM layer. + * + * PGA_ENQUEUED is set and cleared when a page is inserted into or removed + * from a page queue, respectively. It determines whether the plinks.q field + * of the page is valid. To set or clear this flag, the queue lock for the + * page must be held: the page queue lock corresponding to the page's "queue" + * field if its value is not PQ_NONE, and the page lock otherwise. + * + * PGA_DEQUEUE is set when the page is scheduled to be dequeued from a page + * queue, and cleared when the dequeue request is processed. A page may + * have PGA_DEQUEUE set and PGA_ENQUEUED cleared, for instance if a dequeue + * is requested after the page is scheduled to be enqueued but before it is + * actually inserted into the page queue. The page lock must be held to set + * this flag, and the queue lock for the page must be held to clear it. + * + * PGA_REQUEUE is set when the page is scheduled to be enqueued or requeued + * in its page queue. The page lock must be held to set this flag, and the + * queue lock for the page must be held to clear it. + * + * PGA_REQUEUE_HEAD is a special flag for enqueuing pages near the head of + * the inactive queue, thus bypassing LRU. The page lock must be held to + * set this flag, and the queue lock for the page must be held to clear it. */ #define PGA_WRITEABLE 0x01 /* page may be mapped writeable */ #define PGA_REFERENCED 0x02 /* page has been referenced */ #define PGA_EXECUTABLE 0x04 /* page may be mapped executable */ +#define PGA_ENQUEUED 0x08 /* page is enqueued in a page queue */ +#define PGA_DEQUEUE 0x10 /* page is due to be dequeued */ +#define PGA_REQUEUE 0x20 /* page is due to be requeued */ +#define PGA_REQUEUE_HEAD 0x40 /* page requeue should bypass LRU */ +#define PGA_QUEUE_STATE_MASK (PGA_ENQUEUED | PGA_DEQUEUE | PGA_REQUEUE | \ + PGA_REQUEUE_HEAD) + /* * Page flags. If changed at any other time than page allocation or * freeing, the modification must be protected by the vm_page lock. @@ -484,10 +538,11 @@ int vm_page_grab_pages(vm_object_t object, vm_pind void vm_page_deactivate(vm_page_t); void vm_page_deactivate_noreuse(vm_page_t); void vm_page_dequeue(vm_page_t m); +void vm_page_dequeue_deferred(vm_page_t m); void vm_page_dequeue_locked(vm_page_t m); +void vm_page_drain_pqbatch(void); vm_page_t vm_page_find_least(vm_object_t, vm_pindex_t); -void vm_page_free_phys_pglist(struct pglist *tq); -bool vm_page_free_prep(vm_page_t m, bool pagequeue_locked); +bool vm_page_free_prep(vm_page_t m); vm_page_t vm_page_getfake(vm_paddr_t paddr, vm_memattr_t memattr); void vm_page_initfake(vm_page_t m, vm_paddr_t paddr, vm_memattr_t memattr); int vm_page_insert (vm_page_t, vm_object_t, vm_pindex_t); @@ -752,6 +807,24 @@ vm_page_in_laundry(vm_page_t m) } /* + * vm_page_enqueued: + * + * Return true if the page is logically enqueued and no deferred + * dequeue is pending. + */ +static inline bool +vm_page_enqueued(vm_page_t m) +{ + + vm_page_assert_locked(m); + + if ((m->aflags & PGA_DEQUEUE) != 0) + return (false); + atomic_thread_fence_acq(); + return (m->queue != PQ_NONE); +} + +/* * vm_page_held: * * Return true if a reference prevents the page from being reclaimable. Index: /usr/src/sys/vm/vm_pageout.c =================================================================== --- /usr/src/sys/vm/vm_pageout.c (revision 332760) +++ /usr/src/sys/vm/vm_pageout.c (working copy) @@ -201,12 +201,18 @@ SYSCTL_INT(_vm, OID_AUTO, max_wired, CTLFLAG_RW, &vm_page_max_wired, 0, "System-wide limit to wired page count"); static u_int isqrt(u_int num); -static boolean_t vm_pageout_fallback_object_lock(vm_page_t, vm_page_t *); static int vm_pageout_launder(struct vm_domain *vmd, int launder, bool in_shortfall); static void vm_pageout_laundry_worker(void *arg); -static boolean_t vm_pageout_page_lock(vm_page_t, vm_page_t *); +struct scan_state { + struct vm_batchqueue bq; + struct vm_pagequeue *pq; + vm_page_t marker; + int maxscan; + int scanned; +}; + /* * Initialize a dummy page for marking the caller's place in the specified * paging queue. In principle, this function only needs to set the flag @@ -214,11 +220,12 @@ static void vm_pageout_laundry_worker(void *arg); * to one as safety precautions. */ static void -vm_pageout_init_marker(vm_page_t marker, u_short queue) +vm_pageout_init_marker(vm_page_t marker, u_short queue, uint8_t aflags) { bzero(marker, sizeof(*marker)); marker->flags = PG_MARKER; + marker->aflags = aflags; marker->busy_lock = VPB_SINGLE_EXCLUSIVER; marker->queue = queue; marker->hold_count = 1; @@ -225,98 +232,160 @@ static void } /* - * vm_pageout_fallback_object_lock: - * - * Lock vm object currently associated with `m'. VM_OBJECT_TRYWLOCK is - * known to have failed and page queue must be either PQ_ACTIVE or - * PQ_INACTIVE. To avoid lock order violation, unlock the page queue - * while locking the vm object. Use marker page to detect page queue - * changes and maintain notion of next page on page queue. Return - * TRUE if no changes were detected, FALSE otherwise. vm object is - * locked on return. - * - * This function depends on both the lock portion of struct vm_object - * and normal struct vm_page being type stable. + * Initialize and enqueue static queue markers. */ -static boolean_t -vm_pageout_fallback_object_lock(vm_page_t m, vm_page_t *next) +static void +vm_pageout_insert_markers(struct vm_domain *vmd) { - struct vm_page marker; struct vm_pagequeue *pq; - boolean_t unchanged; - u_short queue; - vm_object_t object; + vm_page_t marker; + int i; - queue = m->queue; - vm_pageout_init_marker(&marker, queue); - pq = vm_page_pagequeue(m); - object = m->object; - - TAILQ_INSERT_AFTER(&pq->pq_pl, m, &marker, plinks.q); - vm_pagequeue_unlock(pq); - vm_page_unlock(m); - VM_OBJECT_WLOCK(object); - vm_page_lock(m); - vm_pagequeue_lock(pq); + /* + * inacthead is used to provide FIFO ordering for LRU-bypassing + * insertions. + */ + marker = &vmd->vmd_inacthead; + pq = &vmd->vmd_pagequeues[PQ_INACTIVE]; + vm_pageout_init_marker(marker, PQ_INACTIVE, PGA_ENQUEUED); + TAILQ_INSERT_HEAD(&pq->pq_pl, marker, plinks.q); /* - * The page's object might have changed, and/or the page might - * have moved from its original position in the queue. If the - * page's object has changed, then the caller should abandon - * processing the page because the wrong object lock was - * acquired. Use the marker's plinks.q, not the page's, to - * determine if the page has been moved. The state of the - * page's plinks.q can be indeterminate; whereas, the marker's - * plinks.q must be valid. + * The clock pages are used to implement active queue scanning without + * requeues. Scans start at clock[0], which is advanced after the scan + * ends. When the two clock hands meet, they are reset and scanning + * resumes from the head of the queue. */ - *next = TAILQ_NEXT(&marker, plinks.q); - unchanged = m->object == object && - m == TAILQ_PREV(&marker, pglist, plinks.q); - KASSERT(!unchanged || m->queue == queue, - ("page %p queue %d %d", m, queue, m->queue)); - TAILQ_REMOVE(&pq->pq_pl, &marker, plinks.q); - return (unchanged); + marker = &vmd->vmd_clock[0]; + pq = &vmd->vmd_pagequeues[PQ_ACTIVE]; + vm_pageout_init_marker(marker, PQ_ACTIVE, PGA_ENQUEUED); + TAILQ_INSERT_HEAD(&pq->pq_pl, marker, plinks.q); + marker = &vmd->vmd_clock[1]; + vm_pageout_init_marker(marker, PQ_ACTIVE, PGA_ENQUEUED); + TAILQ_INSERT_TAIL(&pq->pq_pl, marker, plinks.q); + + for (i = 0; i < PQ_COUNT; i++) + vm_pageout_init_marker(&vmd->vmd_markers[i], i, 0); } +static void +vm_pageout_init_scan(struct scan_state *ss, struct vm_pagequeue *pq, + vm_page_t marker, vm_page_t after, int maxscan) +{ + + vm_pagequeue_assert_locked(pq); + KASSERT((marker->aflags & PGA_ENQUEUED) == 0, + ("marker %p already enqueued", marker)); + + if (after == NULL) + TAILQ_INSERT_HEAD(&pq->pq_pl, marker, plinks.q); + else + TAILQ_INSERT_AFTER(&pq->pq_pl, after, marker, plinks.q); + vm_page_aflag_set(marker, PGA_ENQUEUED); + + vm_batchqueue_init(&ss->bq); + ss->pq = pq; + ss->marker = marker; + ss->maxscan = maxscan; + ss->scanned = 0; + vm_pagequeue_unlock(pq); +} + +static void +vm_pageout_end_scan(struct scan_state *ss) +{ + struct vm_pagequeue *pq; + + pq = ss->pq; + vm_pagequeue_assert_locked(pq); + KASSERT((ss->marker->aflags & PGA_ENQUEUED) != 0, + ("marker %p not enqueued", ss->marker)); + + TAILQ_REMOVE(&pq->pq_pl, ss->marker, plinks.q); + vm_page_aflag_clear(ss->marker, PGA_ENQUEUED); + VM_CNT_ADD(v_pdpages, ss->scanned); +} + /* - * Lock the page while holding the page queue lock. Use marker page - * to detect page queue changes and maintain notion of next page on - * page queue. Return TRUE if no changes were detected, FALSE - * otherwise. The page is locked on return. The page queue lock might - * be dropped and reacquired. + * Ensure that the page has not been dequeued after a pageout batch was + * collected. See vm_page_dequeue_complete(). + */ +static inline bool +vm_pageout_page_queued(vm_page_t m, int queue) +{ + + vm_page_assert_locked(m); + + if ((m->aflags & PGA_DEQUEUE) != 0) + return (false); + atomic_thread_fence_acq(); + return (m->queue == queue); +} + +/* + * Add a small number of queued pages to a batch queue for later processing + * without the corresponding queue lock held. The caller must have enqueued a + * marker page at the desired start point for the scan. Pages will be + * physically dequeued if the caller so requests. Otherwise, the returned + * batch may contain marker pages, and it is up to the caller to handle them. * - * This function depends on normal struct vm_page being type stable. + * When processing the batch queue, vm_pageout_page_queued() must be used to + * determine whether the page was logically dequeued by another thread. Once + * this check is performed, the page lock guarantees that the page will not be + * disassociated from the queue. */ -static boolean_t -vm_pageout_page_lock(vm_page_t m, vm_page_t *next) +static __always_inline void +vm_pageout_collect_batch(struct scan_state *ss, const bool dequeue) { - struct vm_page marker; struct vm_pagequeue *pq; - boolean_t unchanged; - u_short queue; + vm_page_t m, marker; - vm_page_lock_assert(m, MA_NOTOWNED); - if (vm_page_trylock(m)) - return (TRUE); + marker = ss->marker; + pq = ss->pq; - queue = m->queue; - vm_pageout_init_marker(&marker, queue); - pq = vm_page_pagequeue(m); + KASSERT((marker->aflags & PGA_ENQUEUED) != 0, + ("marker %p not enqueued", ss->marker)); - TAILQ_INSERT_AFTER(&pq->pq_pl, m, &marker, plinks.q); - vm_pagequeue_unlock(pq); - vm_page_lock(m); vm_pagequeue_lock(pq); + for (m = TAILQ_NEXT(marker, plinks.q); m != NULL && + ss->scanned < ss->maxscan && ss->bq.bq_cnt < VM_BATCHQUEUE_SIZE; + m = TAILQ_NEXT(m, plinks.q), ss->scanned++) { + if ((m->flags & PG_MARKER) == 0) { + KASSERT((m->aflags & PGA_ENQUEUED) != 0, + ("page %p not enqueued", m)); + KASSERT((m->flags & PG_FICTITIOUS) == 0, + ("Fictitious page %p cannot be in page queue", m)); + KASSERT((m->oflags & VPO_UNMANAGED) == 0, + ("Unmanaged page %p cannot be in page queue", m)); + } else if (dequeue) + continue; - /* Page queue might have changed. */ - *next = TAILQ_NEXT(&marker, plinks.q); - unchanged = m == TAILQ_PREV(&marker, pglist, plinks.q); - KASSERT(!unchanged || m->queue == queue, - ("page %p queue %d %d", m, queue, m->queue)); - TAILQ_REMOVE(&pq->pq_pl, &marker, plinks.q); - return (unchanged); + (void)vm_batchqueue_insert(&ss->bq, m); + if (dequeue) { + TAILQ_REMOVE(&pq->pq_pl, m, plinks.q); + vm_page_aflag_clear(m, PGA_ENQUEUED); + } + } + TAILQ_REMOVE(&pq->pq_pl, marker, plinks.q); + if (__predict_true(m != NULL)) + TAILQ_INSERT_BEFORE(m, marker, plinks.q); + else + TAILQ_INSERT_TAIL(&pq->pq_pl, marker, plinks.q); + if (dequeue) + vm_pagequeue_cnt_add(pq, -ss->bq.bq_cnt); + vm_pagequeue_unlock(pq); } +/* Return the next page to be scanned, or NULL if the scan is complete. */ +static __always_inline vm_page_t +vm_pageout_next(struct scan_state *ss, const bool dequeue) +{ + + if (ss->bq.bq_cnt == 0) + vm_pageout_collect_batch(ss, dequeue); + return (vm_batchqueue_pop(&ss->bq)); +} + /* * Scan for pages at adjacent offsets within the given page's object that are * eligible for laundering, form a cluster of these pages and the given page, @@ -370,12 +439,12 @@ more: break; } vm_page_test_dirty(p); - if (p->dirty == 0) { + if (p->dirty == 0 || !vm_page_in_laundry(p)) { ib = 0; break; } vm_page_lock(p); - if (!vm_page_in_laundry(p) || vm_page_held(p)) { + if (vm_page_held(p)) { vm_page_unlock(p); ib = 0; break; @@ -398,10 +467,10 @@ more: if ((p = vm_page_next(ps)) == NULL || vm_page_busied(p)) break; vm_page_test_dirty(p); - if (p->dirty == 0) + if (p->dirty == 0 || !vm_page_in_laundry(p)) break; vm_page_lock(p); - if (!vm_page_in_laundry(p) || vm_page_held(p)) { + if (vm_page_held(p)) { vm_page_unlock(p); break; } @@ -692,13 +761,18 @@ unlock_mp: static int vm_pageout_launder(struct vm_domain *vmd, int launder, bool in_shortfall) { + struct scan_state ss; struct vm_pagequeue *pq; + struct mtx *mtx; vm_object_t object; - vm_page_t m, next; - int act_delta, error, maxscan, numpagedout, starting_target; + vm_page_t m, marker; + int act_delta, error, numpagedout, queue, starting_target; int vnodes_skipped; - bool pageout_ok, queue_locked; + bool obj_locked, pageout_ok; + mtx = NULL; + obj_locked = false; + object = NULL; starting_target = launder; vnodes_skipped = 0; @@ -708,64 +782,77 @@ vm_pageout_launder(struct vm_domain *vmd, int laun * we've reached the end of the queue. A single iteration of this loop * may cause more than one page to be laundered because of clustering. * - * maxscan ensures that we don't re-examine requeued pages. Any - * additional pages written as part of a cluster are subtracted from - * maxscan since they must be taken from the laundry queue. - * * As an optimization, we avoid laundering from PQ_UNSWAPPABLE when no * swap devices are configured. */ if (atomic_load_acq_int(&swapdev_enabled)) - pq = &vmd->vmd_pagequeues[PQ_UNSWAPPABLE]; + queue = PQ_UNSWAPPABLE; else - pq = &vmd->vmd_pagequeues[PQ_LAUNDRY]; + queue = PQ_LAUNDRY; + marker = &vmd->vmd_markers[queue]; + pq = &vmd->vmd_pagequeues[queue]; scan: vm_pagequeue_lock(pq); - maxscan = pq->pq_cnt; - queue_locked = true; - for (m = TAILQ_FIRST(&pq->pq_pl); - m != NULL && maxscan-- > 0 && launder > 0; - m = next) { - vm_pagequeue_assert_locked(pq); - KASSERT(queue_locked, ("unlocked laundry queue")); - KASSERT(vm_page_in_laundry(m), - ("page %p has an inconsistent queue", m)); - next = TAILQ_NEXT(m, plinks.q); - if ((m->flags & PG_MARKER) != 0) + vm_pageout_init_scan(&ss, pq, marker, NULL, pq->pq_cnt); + while (launder > 0 && (m = vm_pageout_next(&ss, false)) != NULL) { + if (__predict_false((m->flags & PG_MARKER) != 0)) continue; - KASSERT((m->flags & PG_FICTITIOUS) == 0, - ("PG_FICTITIOUS page %p cannot be in laundry queue", m)); - KASSERT((m->oflags & VPO_UNMANAGED) == 0, - ("VPO_UNMANAGED page %p cannot be in laundry queue", m)); - if (!vm_pageout_page_lock(m, &next) || m->hold_count != 0) { - vm_page_unlock(m); + + vm_page_change_lock(m, &mtx); + +recheck: + /* + * The page may have been disassociated from the queue + * while locks were dropped. + */ + if (!vm_pageout_page_queued(m, queue)) continue; + + /* + * A requeue was requested, so this page gets a second + * chance. + */ + if ((m->aflags & PGA_REQUEUE) != 0) { + vm_page_requeue(m); + continue; } + + /* + * Held pages are essentially stuck in the queue. + * + * Wired pages may not be freed. Complete their removal + * from the queue now to avoid needless revisits during + * future scans. + */ + if (m->hold_count != 0) + continue; if (m->wire_count != 0) { - vm_page_dequeue_locked(m); - vm_page_unlock(m); + vm_page_dequeue_deferred(m); continue; } - object = m->object; - if ((!VM_OBJECT_TRYWLOCK(object) && - (!vm_pageout_fallback_object_lock(m, &next) || - vm_page_held(m))) || vm_page_busied(m)) { - VM_OBJECT_WUNLOCK(object); - if (m->wire_count != 0 && vm_page_pagequeue(m) == pq) - vm_page_dequeue_locked(m); - vm_page_unlock(m); - continue; + + if (object != m->object) { + if (obj_locked) { + VM_OBJECT_WUNLOCK(object); + obj_locked = false; + } + object = m->object; } + if (!obj_locked) { + if (!VM_OBJECT_TRYWLOCK(object)) { + mtx_unlock(mtx); + /* Depends on type-stability. */ + VM_OBJECT_WLOCK(object); + obj_locked = true; + mtx_lock(mtx); + goto recheck; + } else + obj_locked = true; + } - /* - * Unlock the laundry queue, invalidating the 'next' pointer. - * Use a marker to remember our place in the laundry queue. - */ - TAILQ_INSERT_AFTER(&pq->pq_pl, m, &vmd->vmd_laundry_marker, - plinks.q); - vm_pagequeue_unlock(pq); - queue_locked = false; + if (vm_page_busied(m)) + continue; /* * Invalid pages can be easily freed. They cannot be @@ -814,9 +901,11 @@ scan: */ if (!in_shortfall) launder--; - goto drop_page; - } else if ((object->flags & OBJ_DEAD) == 0) - goto requeue_page; + continue; + } else if ((object->flags & OBJ_DEAD) == 0) { + vm_page_requeue(m); + continue; + } } /* @@ -851,11 +940,8 @@ free_page: else pageout_ok = true; if (!pageout_ok) { -requeue_page: - vm_pagequeue_lock(pq); - queue_locked = true; - vm_page_requeue_locked(m); - goto drop_page; + vm_page_requeue(m); + continue; } /* @@ -874,28 +960,31 @@ free_page: error = vm_pageout_clean(m, &numpagedout); if (error == 0) { launder -= numpagedout; - maxscan -= numpagedout - 1; + ss.scanned += numpagedout; } else if (error == EDEADLK) { pageout_lock_miss++; vnodes_skipped++; } - goto relock_queue; + mtx = NULL; + obj_locked = false; } -drop_page: - vm_page_unlock(m); + } + if (mtx != NULL) { + mtx_unlock(mtx); + mtx = NULL; + } + if (obj_locked) { VM_OBJECT_WUNLOCK(object); -relock_queue: - if (!queue_locked) { - vm_pagequeue_lock(pq); - queue_locked = true; - } - next = TAILQ_NEXT(&vmd->vmd_laundry_marker, plinks.q); - TAILQ_REMOVE(&pq->pq_pl, &vmd->vmd_laundry_marker, plinks.q); + obj_locked = false; } + vm_pagequeue_lock(pq); + vm_pageout_end_scan(&ss); vm_pagequeue_unlock(pq); - if (launder > 0 && pq == &vmd->vmd_pagequeues[PQ_UNSWAPPABLE]) { - pq = &vmd->vmd_pagequeues[PQ_LAUNDRY]; + if (launder > 0 && queue == PQ_UNSWAPPABLE) { + queue = PQ_LAUNDRY; + marker = &vmd->vmd_markers[queue]; + pq = &vmd->vmd_pagequeues[queue]; goto scan; } @@ -951,7 +1040,6 @@ vm_pageout_laundry_worker(void *arg) vmd = VM_DOMAIN(domain); pq = &vmd->vmd_pagequeues[PQ_LAUNDRY]; KASSERT(vmd->vmd_segs != 0, ("domain without segments")); - vm_pageout_init_marker(&vmd->vmd_laundry_marker, PQ_LAUNDRY); shortfall = 0; in_shortfall = false; @@ -1093,7 +1181,57 @@ dolaundry: } } +static int +vm_pageout_reinsert_inactive_page(struct scan_state *ss, vm_page_t m) +{ + struct vm_domain *vmd; + + if (!vm_page_inactive(m) || (m->aflags & PGA_ENQUEUED) != 0) + return (0); + vm_page_aflag_set(m, PGA_ENQUEUED); + if ((m->aflags & PGA_REQUEUE_HEAD) != 0) { + vmd = vm_pagequeue_domain(m); + TAILQ_INSERT_BEFORE(&vmd->vmd_inacthead, m, plinks.q); + vm_page_aflag_clear(m, PGA_REQUEUE | PGA_REQUEUE_HEAD); + } else if ((m->aflags & PGA_REQUEUE) != 0) { + TAILQ_INSERT_TAIL(&ss->pq->pq_pl, m, plinks.q); + vm_page_aflag_clear(m, PGA_REQUEUE | PGA_REQUEUE_HEAD); + } else + TAILQ_INSERT_BEFORE(ss->marker, m, plinks.q); + return (1); +} + /* + * Re-add stuck pages to the inactive queue. We will examine them again + * during the next scan. If the queue state of a page has changed since + * it was physically removed from the page queue in + * vm_pageout_collect_batch(), don't do anything with that page. + */ +static void +vm_pageout_reinsert_inactive(struct scan_state *ss, struct vm_batchqueue *bq, + vm_page_t m) +{ + struct vm_pagequeue *pq; + int delta; + + delta = 0; + pq = ss->pq; + + if (m != NULL) { + if (vm_batchqueue_insert(bq, m)) + return; + vm_pagequeue_lock(pq); + delta += vm_pageout_reinsert_inactive_page(ss, m); + } else + vm_pagequeue_lock(pq); + while ((m = vm_batchqueue_pop(bq)) != NULL) + delta += vm_pageout_reinsert_inactive_page(ss, m); + vm_pagequeue_cnt_add(pq, delta); + vm_pagequeue_unlock(pq); + vm_batchqueue_init(bq); +} + +/* * vm_pageout_scan does the dirty work for the pageout daemon. * * pass == 0: Update active LRU/deactivate pages @@ -1105,13 +1243,16 @@ dolaundry: static bool vm_pageout_scan(struct vm_domain *vmd, int pass, int shortage) { - vm_page_t m, next; + struct scan_state ss; + struct vm_batchqueue rq; + struct mtx *mtx; + vm_page_t m, marker; struct vm_pagequeue *pq; vm_object_t object; long min_scan; int act_delta, addl_page_shortage, deficit, inactq_shortage, maxscan; - int page_shortage, scan_tick, scanned, starting_page_shortage; - boolean_t queue_locked; + int page_shortage, scan_tick, starting_page_shortage; + bool obj_locked; /* * If we need to reclaim memory ask kernel caches to return @@ -1152,6 +1293,11 @@ vm_pageout_scan(struct vm_domain *vmd, int pass, i page_shortage = deficit = 0; starting_page_shortage = page_shortage; + mtx = NULL; + obj_locked = false; + object = NULL; + vm_batchqueue_init(&rq); + /* * Start scanning the inactive queue for pages that we can free. The * scan will stop when we reach the target or we have scanned the @@ -1158,72 +1304,74 @@ vm_pageout_scan(struct vm_domain *vmd, int pass, i * entire queue. (Note that m->act_count is not used to make * decisions for the inactive queue, only for the active queue.) */ + marker = &vmd->vmd_markers[PQ_INACTIVE]; pq = &vmd->vmd_pagequeues[PQ_INACTIVE]; - maxscan = pq->pq_cnt; vm_pagequeue_lock(pq); - queue_locked = TRUE; - for (m = TAILQ_FIRST(&pq->pq_pl); - m != NULL && maxscan-- > 0 && page_shortage > 0; - m = next) { - vm_pagequeue_assert_locked(pq); - KASSERT(queue_locked, ("unlocked inactive queue")); - KASSERT(vm_page_inactive(m), ("Inactive queue %p", m)); + vm_pageout_init_scan(&ss, pq, marker, NULL, pq->pq_cnt); + while (page_shortage > 0 && (m = vm_pageout_next(&ss, true)) != NULL) { + KASSERT((m->flags & PG_MARKER) == 0, + ("marker page %p was dequeued", m)); - VM_CNT_INC(v_pdpages); - next = TAILQ_NEXT(m, plinks.q); + vm_page_change_lock(m, &mtx); +recheck: /* - * skip marker pages + * The page may have been disassociated from the queue + * while locks were dropped. */ - if (m->flags & PG_MARKER) + if (!vm_pageout_page_queued(m, PQ_INACTIVE)) { + addl_page_shortage++; continue; + } - KASSERT((m->flags & PG_FICTITIOUS) == 0, - ("Fictitious page %p cannot be in inactive queue", m)); - KASSERT((m->oflags & VPO_UNMANAGED) == 0, - ("Unmanaged page %p cannot be in inactive queue", m)); + /* + * The page was re-enqueued after the page queue lock was + * dropped, or a requeue was requested. This page gets a second + * chance. + */ + if ((m->aflags & (PGA_ENQUEUED | PGA_REQUEUE | + PGA_REQUEUE_HEAD)) != 0) + goto reinsert; /* - * The page or object lock acquisitions fail if the - * page was removed from the queue or moved to a - * different position within the queue. In either - * case, addl_page_shortage should not be incremented. + * Held pages are essentially stuck in the queue. So, + * they ought to be discounted from the inactive count. + * See the calculation of inactq_shortage before the + * loop over the active queue below. + * + * Wired pages may not be freed. Complete their removal + * from the queue now to avoid needless revisits during + * future scans. */ - if (!vm_pageout_page_lock(m, &next)) - goto unlock_page; - else if (m->wire_count != 0) { - /* - * Wired pages may not be freed, and unwiring a queued - * page will cause it to be requeued. Thus, remove them - * from the queue now to avoid unnecessary revisits. - */ - vm_page_dequeue_locked(m); + if (m->hold_count != 0) { addl_page_shortage++; - goto unlock_page; - } else if (m->hold_count != 0) { - /* - * Held pages are essentially stuck in the - * queue. So, they ought to be discounted - * from the inactive count. See the - * calculation of inactq_shortage before the - * loop over the active queue below. - */ + goto reinsert; + } + if (m->wire_count != 0) { addl_page_shortage++; - goto unlock_page; + vm_page_dequeue_deferred(m); + continue; } - object = m->object; - if (!VM_OBJECT_TRYWLOCK(object)) { - if (!vm_pageout_fallback_object_lock(m, &next)) - goto unlock_object; - else if (m->wire_count != 0) { - vm_page_dequeue_locked(m); - addl_page_shortage++; - goto unlock_object; - } else if (m->hold_count != 0) { - addl_page_shortage++; - goto unlock_object; + + if (object != m->object) { + if (obj_locked) { + VM_OBJECT_WUNLOCK(object); + obj_locked = false; } + object = m->object; } + if (!obj_locked) { + if (!VM_OBJECT_TRYWLOCK(object)) { + mtx_unlock(mtx); + /* Depends on type-stability. */ + VM_OBJECT_WLOCK(object); + obj_locked = true; + mtx_lock(mtx); + goto recheck; + } else + obj_locked = true; + } + if (vm_page_busied(m)) { /* * Don't mess with busy pages. Leave them at @@ -1234,28 +1382,10 @@ vm_pageout_scan(struct vm_domain *vmd, int pass, i * inactive count. */ addl_page_shortage++; -unlock_object: - VM_OBJECT_WUNLOCK(object); -unlock_page: - vm_page_unlock(m); - continue; + goto reinsert; } - KASSERT(!vm_page_held(m), ("Held page %p", m)); /* - * Dequeue the inactive page and unlock the inactive page - * queue, invalidating the 'next' pointer. Dequeueing the - * page here avoids a later reacquisition (and release) of - * the inactive page queue lock when vm_page_activate(), - * vm_page_free(), or vm_page_launder() is called. Use a - * marker to remember our place in the inactive queue. - */ - TAILQ_INSERT_AFTER(&pq->pq_pl, m, &vmd->vmd_marker, plinks.q); - vm_page_dequeue_locked(m); - vm_pagequeue_unlock(pq); - queue_locked = FALSE; - - /* * Invalid pages can be easily freed. They cannot be * mapped, vm_page_free() asserts this. */ @@ -1291,14 +1421,10 @@ vm_pageout_scan(struct vm_domain *vmd, int pass, i * queue. */ m->act_count += act_delta + ACT_ADVANCE; - goto drop_page; + continue; } else if ((object->flags & OBJ_DEAD) == 0) { - vm_pagequeue_lock(pq); - queue_locked = TRUE; - m->queue = PQ_INACTIVE; - TAILQ_INSERT_TAIL(&pq->pq_pl, m, plinks.q); - vm_pagequeue_cnt_inc(pq); - goto drop_page; + vm_page_aflag_set(m, PGA_REQUEUE); + goto reinsert; } } @@ -1324,23 +1450,39 @@ vm_pageout_scan(struct vm_domain *vmd, int pass, i */ if (m->dirty == 0) { free_page: + /* + * Because we dequeued the page and have already + * checked for concurrent dequeue and enqueue + * requests, we can safely disassociate the page + * from the inactive queue. + */ + KASSERT((m->aflags & PGA_QUEUE_STATE_MASK) == 0, + ("page %p has queue state", m)); + m->queue = PQ_NONE; vm_page_free(m); - VM_CNT_INC(v_dfree); - --page_shortage; + page_shortage--; } else if ((object->flags & OBJ_DEAD) == 0) vm_page_launder(m); -drop_page: - vm_page_unlock(m); + continue; +reinsert: + vm_pageout_reinsert_inactive(&ss, &rq, m); + } + if (mtx != NULL) { + mtx_unlock(mtx); + mtx = NULL; + } + if (obj_locked) { VM_OBJECT_WUNLOCK(object); - if (!queue_locked) { - vm_pagequeue_lock(pq); - queue_locked = TRUE; - } - next = TAILQ_NEXT(&vmd->vmd_marker, plinks.q); - TAILQ_REMOVE(&pq->pq_pl, &vmd->vmd_marker, plinks.q); + obj_locked = false; } + vm_pageout_reinsert_inactive(&ss, &rq, NULL); + vm_pageout_reinsert_inactive(&ss, &ss.bq, NULL); + vm_pagequeue_lock(pq); + vm_pageout_end_scan(&ss); vm_pagequeue_unlock(pq); + VM_CNT_ADD(v_dfree, starting_page_shortage - page_shortage); + /* * Wake up the laundry thread so that it can perform any needed * laundering. If we didn't meet our target, we're in shortfall and @@ -1401,9 +1543,9 @@ free_page: vm_paging_target(vmd) + deficit + addl_page_shortage; inactq_shortage *= act_scan_laundry_weight; + marker = &vmd->vmd_markers[PQ_ACTIVE]; pq = &vmd->vmd_pagequeues[PQ_ACTIVE]; vm_pagequeue_lock(pq); - maxscan = pq->pq_cnt; /* * If we're just idle polling attempt to visit every @@ -1416,7 +1558,7 @@ free_page: min_scan /= hz * vm_pageout_update_period; } else min_scan = 0; - if (min_scan > 0 || (inactq_shortage > 0 && maxscan > 0)) + if (min_scan > 0 || (inactq_shortage > 0 && pq->pq_cnt > 0)) vmd->vmd_last_active_scan = scan_tick; /* @@ -1423,36 +1565,48 @@ free_page: * Scan the active queue for pages that can be deactivated. Update * the per-page activity counter and use it to identify deactivation * candidates. Held pages may be deactivated. + * + * To avoid requeuing each page that remains in the active queue, we + * implement the CLOCK algorithm. To maintain consistency in the + * generic page queue code, pages are inserted at the tail of the + * active queue. We thus use two hands, represented by marker pages: + * scans begin at the first hand, which precedes the second hand in + * the queue. When the two hands meet, they are moved back to the + * head and tail of the queue, respectively, and scanning resumes. */ - for (m = TAILQ_FIRST(&pq->pq_pl), scanned = 0; m != NULL && (scanned < - min_scan || (inactq_shortage > 0 && scanned < maxscan)); m = next, - scanned++) { - KASSERT(m->queue == PQ_ACTIVE, - ("vm_pageout_scan: page %p isn't active", m)); - next = TAILQ_NEXT(m, plinks.q); - if ((m->flags & PG_MARKER) != 0) + maxscan = inactq_shortage > 0 ? pq->pq_cnt : min_scan; +act_scan: + vm_pageout_init_scan(&ss, pq, marker, &vmd->vmd_clock[0], maxscan); + while ((m = vm_pageout_next(&ss, false)) != NULL) { + if (__predict_false(m == &vmd->vmd_clock[1])) { + vm_pagequeue_lock(pq); + TAILQ_REMOVE(&pq->pq_pl, &vmd->vmd_clock[0], plinks.q); + TAILQ_REMOVE(&pq->pq_pl, &vmd->vmd_clock[1], plinks.q); + TAILQ_INSERT_HEAD(&pq->pq_pl, &vmd->vmd_clock[0], + plinks.q); + TAILQ_INSERT_TAIL(&pq->pq_pl, &vmd->vmd_clock[1], + plinks.q); + maxscan -= ss.scanned; + vm_pageout_end_scan(&ss); + goto act_scan; + } + if (__predict_false((m->flags & PG_MARKER) != 0)) continue; - KASSERT((m->flags & PG_FICTITIOUS) == 0, - ("Fictitious page %p cannot be in active queue", m)); - KASSERT((m->oflags & VPO_UNMANAGED) == 0, - ("Unmanaged page %p cannot be in active queue", m)); - if (!vm_pageout_page_lock(m, &next)) { - vm_page_unlock(m); - continue; - } + vm_page_change_lock(m, &mtx); + /* - * The count for page daemon pages is updated after checking - * the page for eligibility. + * The page may have been disassociated from the queue + * while locks were dropped. */ - VM_CNT_INC(v_pdpages); + if (!vm_pageout_page_queued(m, PQ_ACTIVE)) + continue; /* * Wired pages are dequeued lazily. */ if (m->wire_count != 0) { - vm_page_dequeue_locked(m); - vm_page_unlock(m); + vm_page_dequeue_deferred(m); continue; } @@ -1491,14 +1645,7 @@ free_page: } else m->act_count -= min(m->act_count, ACT_DECLINE); - /* - * Move this page to the tail of the active, inactive or laundry - * queue depending on usage. - */ if (m->act_count == 0) { - /* Dequeue to avoid later lock recursion. */ - vm_page_dequeue_locked(m); - /* * When not short for inactive pages, let dirty pages go * through the inactive queue before moving to the @@ -1530,11 +1677,18 @@ free_page: inactq_shortage--; } } - } else - vm_page_requeue_locked(m); - vm_page_unlock(m); + } } + if (mtx != NULL) { + mtx_unlock(mtx); + mtx = NULL; + } + vm_pagequeue_lock(pq); + TAILQ_REMOVE(&pq->pq_pl, &vmd->vmd_clock[0], plinks.q); + TAILQ_INSERT_AFTER(&pq->pq_pl, marker, &vmd->vmd_clock[0], plinks.q); + vm_pageout_end_scan(&ss); vm_pagequeue_unlock(pq); + if (pass > 0) vm_swapout_run_idle(); return (page_shortage <= 0); @@ -1781,11 +1935,9 @@ vm_pageout_worker(void *arg) KASSERT(vmd->vmd_segs != 0, ("domain without segments")); vmd->vmd_last_active_scan = ticks; - vm_pageout_init_marker(&vmd->vmd_marker, PQ_INACTIVE); - vm_pageout_init_marker(&vmd->vmd_inacthead, PQ_INACTIVE); - TAILQ_INSERT_HEAD(&vmd->vmd_pagequeues[PQ_INACTIVE].pq_pl, - &vmd->vmd_inacthead, plinks.q); + vm_pageout_insert_markers(vmd); + /* * The pageout daemon worker is never done, so loop forever. */ Index: /usr/src/sys/vm/vm_pagequeue.h =================================================================== --- /usr/src/sys/vm/vm_pagequeue.h (revision 332760) +++ /usr/src/sys/vm/vm_pagequeue.h (working copy) @@ -73,8 +73,17 @@ struct vm_pagequeue { const char * const pq_name; } __aligned(CACHE_LINE_SIZE); +#ifndef VM_BATCHQUEUE_SIZE +#define VM_BATCHQUEUE_SIZE 7 +#endif + +struct vm_batchqueue { + vm_page_t bq_pa[VM_BATCHQUEUE_SIZE]; + int bq_cnt; +} __aligned(CACHE_LINE_SIZE); + +#include #include -#include struct sysctl_oid; /* @@ -82,12 +91,12 @@ struct sysctl_oid; * and accounting. * * Lock Key: - * f vmd_free_mtx - * p vmd_pageout_mtx - * d vm_domainset_lock - * a atomic - * c const after boot - * q page queue lock + * f vmd_free_mtx + * p vmd_pageout_mtx + * d vm_domainset_lock + * a atomic + * c const after boot + * q page queue lock */ struct vm_domain { struct vm_pagequeue vmd_pagequeues[PQ_COUNT]; @@ -107,9 +116,9 @@ struct vm_domain { boolean_t vmd_oom; int vmd_oom_seq; int vmd_last_active_scan; - struct vm_page vmd_laundry_marker; - struct vm_page vmd_marker; /* marker for pagedaemon private use */ + struct vm_page vmd_markers[PQ_COUNT]; /* (q) for page daemon use */ struct vm_page vmd_inacthead; /* marker for LRU-defeating insertions */ + struct vm_page vmd_clock[2]; /* markers for active queue scan */ int vmd_pageout_wanted; /* (a, p) pageout daemon wait channel */ int vmd_pageout_pages_needed; /* (d) page daemon waiting for pages? */ @@ -145,6 +154,7 @@ extern struct vm_domain vm_dom[MAXMEMDOM]; #define vm_pagequeue_assert_locked(pq) mtx_assert(&(pq)->pq_mutex, MA_OWNED) #define vm_pagequeue_lock(pq) mtx_lock(&(pq)->pq_mutex) #define vm_pagequeue_lockptr(pq) (&(pq)->pq_mutex) +#define vm_pagequeue_trylock(pq) mtx_trylock(&(pq)->pq_mutex) #define vm_pagequeue_unlock(pq) mtx_unlock(&(pq)->pq_mutex) #define vm_domain_free_assert_locked(n) \ @@ -155,6 +165,8 @@ extern struct vm_domain vm_dom[MAXMEMDOM]; mtx_lock(vm_domain_free_lockptr((d))) #define vm_domain_free_lockptr(d) \ (&(d)->vmd_free_mtx) +#define vm_domain_free_trylock(d) \ + mtx_trylock(vm_domain_free_lockptr((d))) #define vm_domain_free_unlock(d) \ mtx_unlock(vm_domain_free_lockptr((d))) @@ -173,14 +185,39 @@ static __inline void vm_pagequeue_cnt_add(struct vm_pagequeue *pq, int addend) { -#ifdef notyet vm_pagequeue_assert_locked(pq); -#endif pq->pq_cnt += addend; } #define vm_pagequeue_cnt_inc(pq) vm_pagequeue_cnt_add((pq), 1) #define vm_pagequeue_cnt_dec(pq) vm_pagequeue_cnt_add((pq), -1) +static inline void +vm_batchqueue_init(struct vm_batchqueue *bq) +{ + + bq->bq_cnt = 0; +} + +static inline bool +vm_batchqueue_insert(struct vm_batchqueue *bq, vm_page_t m) +{ + + if (bq->bq_cnt < nitems(bq->bq_pa)) { + bq->bq_pa[bq->bq_cnt++] = m; + return (true); + } + return (false); +} + +static inline vm_page_t +vm_batchqueue_pop(struct vm_batchqueue *bq) +{ + + if (bq->bq_cnt == 0) + return (NULL); + return (bq->bq_pa[--bq->bq_cnt]); +} + void vm_domain_set(struct vm_domain *vmd); void vm_domain_clear(struct vm_domain *vmd); int vm_domain_allocate(struct vm_domain *vmd, int req, int npages); Index: /usr/src/sys/vm/vm_phys.c =================================================================== --- /usr/src/sys/vm/vm_phys.c (revision 332760) +++ /usr/src/sys/vm/vm_phys.c (working copy) @@ -354,9 +354,9 @@ vm_freelist_add(struct vm_freelist *fl, vm_page_t m->order = order; if (tail) - TAILQ_INSERT_TAIL(&fl[order].pl, m, plinks.q); + TAILQ_INSERT_TAIL(&fl[order].pl, m, listq); else - TAILQ_INSERT_HEAD(&fl[order].pl, m, plinks.q); + TAILQ_INSERT_HEAD(&fl[order].pl, m, listq); fl[order].lcnt++; } @@ -364,7 +364,7 @@ static void vm_freelist_rem(struct vm_freelist *fl, vm_page_t m, int order) { - TAILQ_REMOVE(&fl[order].pl, m, plinks.q); + TAILQ_REMOVE(&fl[order].pl, m, listq); fl[order].lcnt--; m->order = VM_NFREEORDER; } @@ -1196,7 +1196,7 @@ vm_phys_alloc_seg_contig(struct vm_phys_seg *seg, oind++) { for (pind = 0; pind < VM_NFREEPOOL; pind++) { fl = (*seg->free_queues)[pind]; - TAILQ_FOREACH(m_ret, &fl[oind].pl, plinks.q) { + TAILQ_FOREACH(m_ret, &fl[oind].pl, listq) { /* * Is the size of this allocation request * larger than the largest block size? Index: /usr/src/sys/vm/vm_swapout.c =================================================================== --- /usr/src/sys/vm/vm_swapout.c (revision 332760) +++ /usr/src/sys/vm/vm_swapout.c (working copy) @@ -399,8 +399,15 @@ vm_daemon(void) swapout_flags = vm_pageout_req_swapout; vm_pageout_req_swapout = 0; mtx_unlock(&vm_daemon_mtx); - if (swapout_flags) + if (swapout_flags != 0) { + /* + * Drain the per-CPU page queue batches as a deadlock + * avoidance measure. + */ + if ((swapout_flags & VM_SWAP_NORMAL) != 0) + vm_page_drain_pqbatch(); swapout_procs(swapout_flags); + } /* * scan the processes for exceeding their rlimits or if -- Test scenario: misc/mmap18.sh