GENERIC HEAD from 2018-03-31 05:17:12 UTC, r331837M, No vmcore GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2018 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 12.0-CURRENT #0 r331837M: Sat Mar 31 12:00:50 CEST 2018 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 FreeBSD clang version 6.0.0 (tags/RELEASE_600/final 326565) (based on LLVM 6.0.0) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Entering uma_startup with 10 boot pages configured startup_alloc from "UMA Kegs", 9 boot pages left startup_alloc from "UMA Zones", 8 boot pages left startup_alloc from "UMA Hash", 7 boot pages left startup_alloc from "UMA Zones", 6 boot pages left startup_alloc from "vmem btag", 5 boot pages left startup_alloc from "MAP", 4 boot pages left startup_alloc from "UMA Kegs", 3 boot pages left startup_alloc from "KMAP ENTRY", 2 boot pages left startup_alloc from "vmem", 1 boot pages left Entering uma_startup2 with 0 boot pages left VT(vga): resolution 640x480 CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin="AuthenticAMD" Id=0x100f23 Family=0x10 Model=0x2 Stepping=3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff SVM: NP,NAsids=64 TSC: P-state invariant real memory = 8589934592 (8192 MB) avail memory = 3526672384 (3363 MB) : Trying to mount root from ufs:/dev/ada0s1a [rw]... WARNING: DIAGNOSTIC option enabled, expect reduced performance. uhub0: 2 ports with 2 removable, self powered uhub2: 2 ports with 2 removable, self powered uhub3: 2 ports with 2 removable, self powered uhub4: 2 ports with 2 removable, self powered uhub5: 2 ports with 2 removable, self powered Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. eval: limits: not found /etc/rc: WARNING: failed to start ddb warning: total configured swap (4194304 pages) exceeds maximum recommended amount (1724580 pages). warning: increase kern.maxswzone or reduce amount of swap. Starting file system checks: /dev/ada0s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1a: clean, 482998 free (2206 frags, 60099 blocks, 0.2% fragmentation) /dev/ada0s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1f: clean, 841681 free (11145 frags, 103817 blocks, 1.1% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 41771024 free (42872 frags, 5216019 blocks, 0.0% fragmentation) /dev/ada0s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1d: clean, 2094866 free (329466 frags, 220675 blocks, 3.2% fragmentation) /dev/ada0s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1e: clean, 3786290 free (159378 frags, 453364 blocks, 0.6% fragmentation) Mounting local filesystems:. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/arduino/lib /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/gcc49 /usr/local/lib/mysql /usr/local/lib/nss /usr/local/lib/perl5/5.24/mach/CORE /usr/local/lib/pth /usr/local/lib/qt4 /usr/local/llvm37/lib /usr/local/llvm39/lib a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Setting hostname: x4.osted.lan. Setting up harvesting: [UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,NET_ETHER,NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: uhub1: 10 ports with 10 removable, self powered . re0: link state changed to DOWN Starting Network: lo0 re0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 groups: lo re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 nd6 options=29 media: Ethernet autoselect (none) status: no carrier Starting devd. re0: link state changed to UP add host 127.0.0.1: gateway lo0 fib 0: route already in table add net default: gateway 192.168.1.1 add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Starting rpcbind. NFS access cache time=60 Starting watchdogd. No core dumps found. Additional ABI support: linux. lock order reversal: 1st 0xcb475e8c bufwait (bufwait) @ kern/vfs_bio.c:3894 2nd 0xdbc0ea00 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:289 stack backtrace: #0 0xc0d10fe1 at witness_debugger+0x81 #1 0xc0d10ea8 at witness_checkorder+0xcd8 #2 0xc0cb0f34 at _sx_xlock+0x64 #3 0xc0fcea23 at ufsdirhash_add+0x53 #4 0xc0fd358f at ufs_direnter+0x4df #5 0xc0fdc712 at ufs_mkdir+0x852 #6 0xc12b11f6 at VOP_MKDIR_APV+0xf6 #7 0xc0d8eace at kern_mkdirat+0x21e #8 0xc0d8e8a1 at sys_mkdir+0x31 #9 0xc127d9ae at syscall+0x6ee #10 0xc126713b at Xint0x80_syscall+0x2b Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Starting statd. Starting lockd. Recovering vi editor sessions:. Updating motd:. Mounting late filesystems:. Starting ntpd. Starting powerd. Starting smartd. Mar 31 12:20:17 x4 smartd[638]: Device: /dev/ada0, WARNING: A firmware update for this drive may be available, Mar 31 12:20:17 x4 smartd[638]: see the following Seagate web pages: Mar 31 12:20:17 x4 smartd[638]: http://knowledge.seagate.com/articles/en_US/FAQ/207931en Mar 31 12:20:17 x4 smartd[638]: http://knowledge.seagate.com/articles/en_US/FAQ/213891en Configuring vt: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting sendmail_submit. Starting sendmail_msp_queue. Starting cron. Local package initialization: backup. Starting nfscbd. Starting default mousedmoused: unable to open /dev/psm0: No such file or directory . Starting inetd. Sat Mar 31 12:20 FreeBSD/i386 (x4.osted.lan) (ttyu0) login: Mar 31 12:45:48 x4 su: pho to root on /dev/pts/0 20180331 12:47:28 all (1/562): nfsrename.sh 20180331 12:51:00 all (2/562): procfs3.sh 20180331 12:51:22 all (3/562): mmap10.sh Mar 31 12:51:34 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 12:51:34 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 12:51:34 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x207000 to be written at offset 0x28f000 for process mmap10 Mar 31 12:51:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap10 Mar 31 12:51:44 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap10 Mar 31 12:51:44 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 12:51:44 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap10 Mar 31 12:51:44 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap10 Mar 31 12:51:44 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap10 Mar 31 12:51:44 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 12:51:44 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Mar 31 12:51:44 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Mar 31 12:53:41 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0x495000 for process mmap10 Mar 31 12:53:41 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0x4b5000 for process mmap10 Mar 31 12:53:41 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0x4d5000 for process mmap10 Mar 31 12:53:41 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0x4f5000 for process mmap10 Mar 31 12:53:41 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbdf000 with size 0x20000 to be written at offset 0x515000 for process mmap10 Mar 31 12:53:41 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbff000 with size 0x1000 to be written at offset 0x535000 for process mmap10 Mar 31 12:53:59 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0xc496000 for process mmap10 Mar 31 12:53:59 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0xc4b6000 for process mmap10 Mar 31 12:53:59 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0xc4d6000 for process mmap10 Mar 31 12:53:59 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0xc4f6000 for process mmap10 Mar 31 12:53:59 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbdf000 with size 0x20000 to be written at offset 0xc516000 for process mmap10 Mar 31 12:54:00 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x3000 for process mmap10 Mar 31 12:54:00 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x24000 for process mmap10 Mar 31 12:54:00 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x47000 for process mmap10 Mar 31 12:54:00 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x48000 for process mmap10 Mar 31 12:54:00 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x51000 for process mmap10 Mar 31 12:54:00 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5a000 for process mmap10 Mar 31 12:54:00 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28e000 for process mmap10 Mar 31 12:54:00 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x28f000 for process mmap10 Mar 31 12:54:00 x4 kernel: Failed to fully fault in a core file segment at VA 0x804f000 with size 0x3000 to be written at offset 0x8000 for process mmap10 Mar 31 12:54:20 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0xc495000 for process mmap10 Mar 31 12:54:20 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0xc4b5000 for process mmap10 Mar 31 12:54:20 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0xc4d5000 for process mmap10 Mar 31 12:54:20 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0xc4f5000 for process mmap10 Mar 31 12:54:20 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbdf000 with size 0x20000 to be written at offset 0xc515000 for process mmap10 Mar 31 12:54:20 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbff000 with size 0x1000 to be written at offset 0xc535000 for process mmap10 Mar 31 12:54:21 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0x495000 for process mmap10 Mar 31 12:54:21 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0x4b5000 for process mmap10 Mar 31 12:54:21 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0x4d5000 for process mmap10 Mar 31 12:54:21 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0x4f5000 for process mmap10 Mar 31 12:54:21 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbdf000 with size 0x20000 to be written at offset 0x515000 for process mmap10 Mar 31 12:54:21 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x4000 for process mmap10 Mar 31 12:54:21 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x27000 for process mmap10 Mar 31 12:54:21 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x28000 for process mmap10 Mar 31 12:54:21 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x31000 for process mmap10 Mar 31 12:54:21 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x3a000 for process mmap10 Mar 31 12:54:21 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x26e000 for process mmap10 Mar 31 12:54:21 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x26f000 for process mmap10 Mar 31 12:54:21 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0x24000 for process mmap10 Mar 31 12:54:21 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0x44000 for process mmap10 Mar 31 12:54:21 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0x64000 for process mmap10 Mar 31 12:54:21 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0x84000 for process mmap10 Mar 31 12:54:22 x4 kernel: Failed to fully fault in a core file segment at VA 0x804f000 with size 0x3000 to be written at offset 0x9000 for process mmap10 Mar 31 12:54:24 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0x25000 for process mmap10 Mar 31 12:54:24 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0x45000 for process mmap10 Mar 31 12:54:24 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0x65000 for process mmap10 Mar 31 12:54:24 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0x85000 for process mmap10 Mar 31 12:54:24 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0x495000 for process mmap10 Mar 31 12:54:24 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0x4b5000 for process mmap10 Mar 31 12:54:24 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0x4d5000 for process mmap10 Mar 31 12:54:24 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0x4f5000 for process mmap10 Mar 31 12:54:24 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbdf000 with size 0x20000 to be written at offset 0x515000 for process mmap10 Mar 31 12:54:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x24000 for process mmap10 Mar 31 12:54:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x47000 for process mmap10 Mar 31 12:54:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x48000 for process mmap10 Mar 31 12:54:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x51000 for process mmap10 Mar 31 12:54:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5a000 for process mmap10 Mar 31 12:54:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28e000 for process mmap10 Mar 31 12:54:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x205000 to be written at offset 0x28f000 for process mmap10 Mar 31 12:54:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x1000 to be written at offset 0x494000 for process mmap10 Mar 31 12:54:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x24000 for process mmap10 Mar 31 12:54:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x47000 for process mmap10 Mar 31 12:54:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x48000 for process mmap10 Mar 31 12:54:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x51000 for process mmap10 Mar 31 12:54:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x4000 to be written at offset 0x5a000 for process mmap10 Mar 31 12:54:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x28249000 with size 0x230000 to be written at offset 0x5e000 for process mmap10 Mar 31 12:54:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28e000 for process mmap10 Mar 31 12:54:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x28f000 for process mmap10 Mar 31 12:54:45 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0x495000 for process mmap10 Mar 31 12:54:45 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0x4b5000 for process mmap10 Mar 31 12:54:45 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0x4d5000 for process mmap10 Mar 31 12:54:45 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0x4f5000 for process mmap10 Mar 31 12:54:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 12:54:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap10 Mar 31 12:54:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap10 Mar 31 12:54:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap10 Mar 31 12:54:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 12:54:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Mar 31 12:54:45 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Mar 31 12:54:46 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x201000 to be written at offset 0x294000 for process mmap10 Mar 31 12:55:07 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0x496000 for process mmap10 Mar 31 12:55:07 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0x4b6000 for process mmap10 Mar 31 12:55:07 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0x4d6000 for process mmap10 Mar 31 12:55:07 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0x4f6000 for process mmap10 Mar 31 12:55:07 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbdf000 with size 0x20000 to be written at offset 0x516000 for process mmap10 Mar 31 12:55:47 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0x495000 for process mmap10 Mar 31 12:55:47 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0x4b5000 for process mmap10 Mar 31 12:55:47 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0x4d5000 for process mmap10 Mar 31 12:55:47 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0x4f5000 for process mmap10 Mar 31 12:55:47 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbdf000 with size 0x20000 to be written at offset 0x515000 for process mmap10 Mar 31 12:55:49 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x24000 for process mmap10 Mar 31 12:55:49 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x47000 for process mmap10 Mar 31 12:55:49 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x48000 for process mmap10 Mar 31 12:55:49 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x51000 for process mmap10 Mar 31 12:55:49 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5a000 for process mmap10 Mar 31 12:55:49 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28e000 for process mmap10 Mar 31 12:55:49 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x205000 to be written at offset 0x28f000 for process mmap10 Mar 31 12:55:49 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x1000 to be written at offset 0x494000 for process mmap10 Mar 31 12:55:49 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0x495000 for process mmap10 Mar 31 12:55:49 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0x4b5000 for process mmap10 Mar 31 12:55:49 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0x4d5000 for process mmap10 Mar 31 12:55:49 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0x4f5000 for process mmap10 Mar 31 12:55:51 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x24000 for process mmap10 Mar 31 12:55:51 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x47000 for process mmap10 Mar 31 12:55:51 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x48000 for process mmap10 Mar 31 12:55:51 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x51000 for process mmap10 Mar 31 12:55:51 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5a000 for process mmap10 Mar 31 12:55:51 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28e000 for process mmap10 Mar 31 12:55:51 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x206000 to be written at offset 0x28f000 for process mmap10 Mar 31 12:55:51 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x24000 for process mmap10 Mar 31 12:55:51 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x47000 for process mmap10 Mar 31 12:55:51 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x48000 for process mmap10 Mar 31 12:55:51 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x51000 for process mmap10 Mar 31 12:55:51 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5a000 for process mmap10 Mar 31 12:55:51 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28e000 for process mmap10 Mar 31 12:55:52 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x206000 to be written at offset 0x28f000 for process mmap10 Mar 31 12:55:55 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x201000 to be written at offset 0x294000 for process mmap10 Mar 31 12:55:55 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap10 Mar 31 12:55:56 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x3000 for process mmap10 Mar 31 12:55:56 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x24000 for process mmap10 Mar 31 12:55:56 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x47000 for process mmap10 Mar 31 12:55:56 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x48000 for process mmap10 Mar 31 12:55:56 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x51000 for process mmap10 Mar 31 12:55:56 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5a000 for process mmap10 Mar 31 12:55:56 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28e000 for process mmap10 Mar 31 12:55:56 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x28f000 for process mmap10 Mar 31 12:55:57 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x24000 for process mmap10 Mar 31 12:55:57 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x47000 for process mmap10 Mar 31 12:55:57 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x48000 for process mmap10 Mar 31 12:55:57 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x51000 for process mmap10 Mar 31 12:55:57 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5a000 for process mmap10 Mar 31 12:55:57 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x2000 to be written at offset 0x28e000 for process mmap10 Mar 31 12:55:57 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847b000 with size 0x205000 to be written at offset 0x290000 for process mmap10 Mar 31 12:55:58 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0x496000 for process mmap10 Mar 31 12:55:58 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0x4b6000 for process mmap10 Mar 31 12:55:58 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0x4d6000 for process mmap10 Mar 31 12:55:58 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0x4f6000 for process mmap10 Mar 31 12:55:59 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap10 Mar 31 12:55:59 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 12:55:59 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap10 Mar 31 12:55:59 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap10 Mar 31 12:55:59 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap10 Mar 31 12:55:59 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 12:55:59 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Mar 31 12:55:59 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Mar 31 12:56:02 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0x496000 for process mmap10 Mar 31 12:56:02 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0x4b6000 for process mmap10 Mar 31 12:56:02 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0x4d6000 for process mmap10 Mar 31 12:56:02 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0x4f6000 for process mmap10 Mar 31 12:56:02 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbdf000 with size 0x20000 to be written at offset 0x516000 for process mmap10 Mar 31 12:56:02 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 12:56:02 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap10 Mar 31 12:56:02 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap10 Mar 31 12:56:02 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap10 Mar 31 12:56:02 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 12:56:02 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Mar 31 12:56:02 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x205000 to be written at offset 0x290000 for process mmap10 Mar 31 12:56:02 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x1000 to be written at offset 0x495000 for process mmap10 Mar 31 12:56:03 x4 kernel: Failed to fully fault in a core file segment at VA 0x344d9000 with size 0x1a7000 to be written at offset 0x2ef000 for process mmap10 Mar 31 12:56:03 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 12:56:03 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap10 Mar 31 12:56:03 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap10 Mar 31 12:56:03 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap10 Mar 31 12:56:03 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 12:56:03 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Mar 31 12:56:03 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Mar 31 12:56:04 x4 kernel: Failed to fully fault in a core file segment at VA 0x34500000 with size 0x7000 to be written at offset 0x316000 for process mmap10 Mar 31 12:56:05 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0x496000 for process mmap10 Mar 31 12:56:05 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0x4b6000 for process mmap10 Mar 31 12:56:05 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0x4d6000 for process mmap10 Mar 31 12:56:05 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0x4f6000 for process mmap10 Mar 31 12:56:05 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbdf000 with size 0x20000 to be written at offset 0x516000 for process mmap10 Mar 31 12:56:24 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x24000 for process mmap10 Mar 31 12:56:24 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x47000 for process mmap10 Mar 31 12:56:24 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x48000 for process mmap10 Mar 31 12:56:24 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x51000 for process mmap10 Mar 31 12:56:24 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5a000 for process mmap10 Mar 31 12:56:24 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28e000 for process mmap10 Mar 31 12:56:24 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x28f000 for process mmap10 Mar 31 12:56:24 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 12:56:24 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap10 Mar 31 12:56:24 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap10 Mar 31 12:56:24 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 12:56:24 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Mar 31 12:56:24 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Mar 31 12:56:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x201000 to be written at offset 0x295000 for process mmap10 Mar 31 12:56:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap10 Mar 31 12:56:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 12:56:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap10 Mar 31 12:56:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap10 Mar 31 12:56:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap10 Mar 31 12:56:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 12:56:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Mar 31 12:56:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Mar 31 12:56:27 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0x496000 for process mmap10 Mar 31 12:56:27 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0x4b6000 for process mmap10 Mar 31 12:56:27 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0x4d6000 for process mmap10 Mar 31 12:56:27 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0x4f6000 for process mmap10 Mar 31 12:56:27 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbdf000 with size 0x20000 to be written at offset 0x516000 for process mmap10 Mar 31 12:56:27 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 12:56:27 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap10 Mar 31 12:56:27 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap10 Mar 31 12:56:27 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 12:56:27 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Mar 31 12:56:27 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x1000 to be written at offset 0x290000 for process mmap10 Mar 31 12:56:27 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447b000 with size 0x205000 to be written at offset 0x291000 for process mmap10 Mar 31 12:56:28 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0x496000 for process mmap10 Mar 31 12:56:28 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0x4b6000 for process mmap10 Mar 31 12:56:28 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0x4d6000 for process mmap10 Mar 31 12:56:28 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0x4f6000 for process mmap10 Mar 31 12:56:28 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbdf000 with size 0x20000 to be written at offset 0x516000 for process mmap10 Mar 31 12:56:29 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 12:56:29 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap10 Mar 31 12:56:29 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap10 Mar 31 12:56:29 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 12:56:29 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Mar 31 12:56:29 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Mar 31 12:56:29 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0x496000 for process mmap10 Mar 31 12:56:29 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0x4b6000 for process mmap10 Mar 31 12:56:29 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0x4d6000 for process mmap10 Mar 31 12:56:29 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0x4f6000 for process mmap10 Mar 31 12:56:29 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbdf000 with size 0x20000 to be written at offset 0x516000 for process mmap10 Mar 31 12:56:51 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x1000 to be written at offset 0x4000 for process mmap10 Mar 31 12:56:51 x4 kernel: Failed to fully fault in a core file segment at VA 0x804b000 with size 0x1000 to be written at offset 0x5000 for process mmap10 Mar 31 12:56:51 x4 kernel: Failed to fully fault in a core file segment at VA 0x804c000 with size 0x2000 to be written at offset 0x6000 for process mmap10 Mar 31 12:56:51 x4 kernel: Failed to fully fault in a core file segment at VA 0x804e000 with size 0x8000 to be written at offset 0x8000 for process mmap10 Mar 31 12:56:51 x4 kernel: Failed to fully fault in a core file segment at VA 0x8056000 with size 0x15000 to be written at offset 0x10000 for process mmap10 Mar 31 12:56:51 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 12:56:51 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap10 Mar 31 12:56:51 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap10 Mar 31 12:56:51 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap10 Mar 31 12:56:51 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 12:56:51 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Mar 31 12:56:51 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Mar 31 12:57:10 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 12:57:10 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 12:57:11 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap10 Mar 31 12:57:11 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 12:57:11 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 12:57:11 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0xc206000 to be written at offset 0x290000 for process mmap10 Mar 31 12:57:11 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x24000 for process mmap10 Mar 31 12:57:11 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x47000 for process mmap10 Mar 31 12:57:11 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x48000 for process mmap10 Mar 31 12:57:11 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x51000 for process mmap10 Mar 31 12:57:11 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5a000 for process mmap10 Mar 31 12:57:11 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28e000 for process mmap10 Mar 31 12:57:11 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x206000 to be written at offset 0x28f000 for process mmap10 Mar 31 12:57:49 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447b000 with size 0x205000 to be written at offset 0x291000 for process mmap10 Mar 31 12:58:03 x4 kernel: Failed to fully fault in a core file segment at VA 0x30fbc000 with size 0x36c4000 to be written at offset 0x8dd2000 for process mmap10 Mar 31 12:58:22 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 12:58:22 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 12:58:22 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x205000 to be written at offset 0x290000 for process mmap10 Mar 31 12:58:32 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0x496000 for process mmap10 Mar 31 12:58:32 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0x4b6000 for process mmap10 Mar 31 12:58:32 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0x4d6000 for process mmap10 Mar 31 12:58:32 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0x4f6000 for process mmap10 Mar 31 12:58:52 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0xc496000 for process mmap10 Mar 31 12:58:52 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0xc4b6000 for process mmap10 Mar 31 12:58:52 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0xc4d6000 for process mmap10 Mar 31 12:58:52 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0xc4f6000 for process mmap10 Mar 31 12:58:52 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbdf000 with size 0x20000 to be written at offset 0xc516000 for process mmap10 Mar 31 12:58:52 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap10 Mar 31 12:58:52 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 12:58:52 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 12:58:53 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0x496000 for process mmap10 Mar 31 12:58:53 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0x4b6000 for process mmap10 Mar 31 12:58:53 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0x4d6000 for process mmap10 Mar 31 12:58:53 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0x4f6000 for process mmap10 Mar 31 12:58:53 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbdf000 with size 0x20000 to be written at offset 0x516000 for process mmap10 Mar 31 12:58:53 x4 kernel: Failed to fully fault in a core file segment at VA 0x28d45000 with size 0x1009000 to be written at offset 0xb5b000 for process mmap10 Mar 31 12:59:10 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 12:59:10 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap10 Mar 31 12:59:10 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap10 Mar 31 12:59:10 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap10 Mar 31 12:59:10 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 12:59:10 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Mar 31 12:59:11 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 12:59:11 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap10 Mar 31 12:59:11 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap10 Mar 31 12:59:11 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap10 Mar 31 12:59:11 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 12:59:11 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Mar 31 12:59:11 x4 kernel: Failed to fully fault in a core file segment at VA 0x804e000 with size 0x1d000 to be written at offset 0x8000 for process mmap10 Mar 31 12:59:11 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 12:59:11 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 12:59:11 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Mar 31 12:59:15 x4 kernel: Failed to fully fault in a core file segment at VA 0x2a051000 with size 0xa429000 to be written at offset 0x1e67000 for process mmap10 Mar 31 12:59:15 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0xc496000 for process mmap10 Mar 31 12:59:15 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0xc4b6000 for process mmap10 Mar 31 12:59:15 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0xc4d6000 for process mmap10 Mar 31 12:59:15 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0xc4f6000 for process mmap10 Mar 31 12:59:15 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbdf000 with size 0x20000 to be written at offset 0xc516000 for process mmap10 Mar 31 12:59:15 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x24000 for process mmap10 Mar 31 12:59:15 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5a000 for process mmap10 Mar 31 12:59:15 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x206000 to be written at offset 0x28f000 for process mmap10 Mar 31 12:59:33 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap10 Mar 31 12:59:33 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 12:59:33 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 12:59:33 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Mar 31 12:59:33 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Mar 31 12:59:47 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0xc495000 for process mmap10 Mar 31 12:59:47 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0xc4b5000 for process mmap10 Mar 31 12:59:47 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0xc4d5000 for process mmap10 Mar 31 12:59:47 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0xc4f5000 for process mmap10 Mar 31 12:59:47 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbdf000 with size 0x20000 to be written at offset 0xc515000 for process mmap10 Mar 31 12:59:47 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbff000 with size 0x1000 to be written at offset 0xc535000 for process mmap10 Mar 31 12:59:47 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x3000 for process mmap10 Mar 31 12:59:47 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x24000 for process mmap10 Mar 31 12:59:47 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5a000 for process mmap10 Mar 31 12:59:47 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847b000 with size 0x205000 to be written at offset 0x290000 for process mmap10 Mar 31 12:59:47 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0x495000 for process mmap10 Mar 31 12:59:47 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0x4b5000 for process mmap10 Mar 31 12:59:47 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0x4d5000 for process mmap10 Mar 31 12:59:47 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0x4f5000 for process mmap10 Mar 31 12:59:47 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbdf000 with size 0x20000 to be written at offset 0x515000 for process mmap10 Mar 31 12:59:48 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0x496000 for process mmap10 Mar 31 12:59:48 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0x4b6000 for process mmap10 Mar 31 12:59:48 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0x4d6000 for process mmap10 Mar 31 12:59:48 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0x4f6000 for process mmap10 Mar 31 12:59:48 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbdf000 with size 0x20000 to be written at offset 0x516000 for process mmap10 Mar 31 12:59:48 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0x496000 for process mmap10 Mar 31 12:59:48 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0x4b6000 for process mmap10 Mar 31 12:59:48 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0x4d6000 for process mmap10 Mar 31 12:59:48 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0x4f6000 for process mmap10 Mar 31 12:59:48 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbdf000 with size 0x20000 to be written at offset 0x516000 for process mmap10 Mar 31 12:59:48 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 12:59:48 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 12:59:48 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Mar 31 12:59:51 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0x495000 for process mmap10 Mar 31 12:59:51 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0x4b5000 for process mmap10 Mar 31 12:59:51 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0x4d5000 for process mmap10 Mar 31 12:59:51 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0x4f5000 for process mmap10 Mar 31 12:59:51 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbdf000 with size 0x20000 to be written at offset 0x515000 for process mmap10 Mar 31 12:59:51 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbff000 with size 0x1000 to be written at offset 0x535000 for process mmap10 Mar 31 12:59:51 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 12:59:51 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 12:59:51 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x3000 for process mmap10 Mar 31 12:59:51 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x10000 to be written at offset 0x495000 for process mmap10 Mar 31 12:59:52 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 12:59:52 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 12:59:52 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Mar 31 13:00:12 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap10 Mar 31 13:00:12 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 13:00:12 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 13:00:12 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x207000 to be written at offset 0x28f000 for process mmap10 Mar 31 13:00:32 x4 kernel: Failed to fully fault in a core file segment at VA 0x804e000 with size 0x1d000 to be written at offset 0x8000 for process mmap10 Mar 31 13:00:32 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 13:00:32 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap10 Mar 31 13:00:32 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap10 Mar 31 13:00:32 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap10 Mar 31 13:00:32 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 13:00:32 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Mar 31 13:00:32 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Mar 31 13:00:32 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 13:00:32 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap10 Mar 31 13:00:32 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap10 Mar 31 13:00:32 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap10 Mar 31 13:00:32 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 13:00:32 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Mar 31 13:00:32 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Mar 31 13:00:33 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap10 Mar 31 13:00:40 x4 kernel: Failed to fully fault in a core file segment at VA 0x2d5e1000 with size 0x6e99000 to be written at offset 0x53f7000 for process mmap10 Mar 31 13:00:41 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0x496000 for process mmap10 Mar 31 13:00:41 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0x4b6000 for process mmap10 Mar 31 13:00:41 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0x4d6000 for process mmap10 Mar 31 13:00:41 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0x4f6000 for process mmap10 Mar 31 13:00:41 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbdf000 with size 0x20000 to be written at offset 0x516000 for process mmap10 Mar 31 13:00:41 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 13:00:41 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 13:00:42 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap10 Mar 31 13:00:42 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 13:00:42 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 13:00:54 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0x496000 for process mmap10 Mar 31 13:00:54 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0x4b6000 for process mmap10 Mar 31 13:00:54 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0x4d6000 for process mmap10 Mar 31 13:00:54 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0x4f6000 for process mmap10 Mar 31 13:00:54 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbdf000 with size 0x20000 to be written at offset 0x516000 for process mmap10 Mar 31 13:00:55 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 13:00:55 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap10 Mar 31 13:00:55 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 13:00:55 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447b000 with size 0x205000 to be written at offset 0x291000 for process mmap10 Mar 31 13:00:55 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x24000 for process mmap10 Mar 31 13:00:55 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5a000 for process mmap10 Mar 31 13:00:55 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x206000 to be written at offset 0x28f000 for process mmap10 Mar 31 13:00:55 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0x495000 for process mmap10 Mar 31 13:00:55 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0x4b5000 for process mmap10 Mar 31 13:00:55 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0x4d5000 for process mmap10 Mar 31 13:00:55 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0x4f5000 for process mmap10 Mar 31 13:00:55 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbdf000 with size 0x20000 to be written at offset 0x515000 for process mmap10 Mar 31 13:00:55 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbff000 with size 0x1000 to be written at offset 0x535000 for process mmap10 Mar 31 13:00:55 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x1000 to be written at offset 0x3000 for process mmap10 Mar 31 13:00:55 x4 kernel: Failed to fully fault in a core file segment at VA 0x804b000 with size 0x9000 to be written at offset 0x4000 for process mmap10 Mar 31 13:00:55 x4 kernel: Failed to fully fault in a core file segment at VA 0x8054000 with size 0x5000 to be written at offset 0xd000 for process mmap10 Mar 31 13:00:55 x4 kernel: Failed to fully fault in a core file segment at VA 0x8059000 with size 0x12000 to be written at offset 0x12000 for process mmap10 Mar 31 13:00:55 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x24000 for process mmap10 Mar 31 13:00:55 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x47000 for process mmap10 Mar 31 13:00:55 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x48000 for process mmap10 Mar 31 13:00:55 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x51000 for process mmap10 Mar 31 13:00:55 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5a000 for process mmap10 Mar 31 13:00:55 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28e000 for process mmap10 Mar 31 13:00:55 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x28f000 for process mmap10 Mar 31 13:00:56 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 13:00:56 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 13:00:56 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Mar 31 13:00:56 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0x496000 for process mmap10 Mar 31 13:00:56 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0x4b6000 for process mmap10 Mar 31 13:00:56 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0x4d6000 for process mmap10 Mar 31 13:00:56 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0x4f6000 for process mmap10 Mar 31 13:00:56 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbdf000 with size 0x20000 to be written at offset 0x516000 for process mmap10 Mar 31 13:00:56 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 13:00:56 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap10 Mar 31 13:00:56 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 13:00:56 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Mar 31 13:00:56 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0x496000 for process mmap10 Mar 31 13:00:56 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0x4b6000 for process mmap10 Mar 31 13:00:56 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0x4d6000 for process mmap10 Mar 31 13:00:56 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0x4f6000 for process mmap10 Mar 31 13:00:56 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbdf000 with size 0x20000 to be written at offset 0x516000 for process mmap10 Mar 31 13:00:58 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 13:00:58 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap10 Mar 31 13:00:58 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 13:00:58 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Mar 31 13:00:58 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0x496000 for process mmap10 Mar 31 13:00:58 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0x4b6000 for process mmap10 Mar 31 13:00:58 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0x4d6000 for process mmap10 Mar 31 13:00:58 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0x4f6000 for process mmap10 Mar 31 13:00:58 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x1000 to be written at offset 0x4000 for process mmap10 Mar 31 13:00:58 x4 kernel: Failed to fully fault in a core file segment at VA 0x804b000 with size 0x9000 to be written at offset 0x5000 for process mmap10 Mar 31 13:00:58 x4 kernel: Failed to fully fault in a core file segment at VA 0x8054000 with size 0x5000 to be written at offset 0xe000 for process mmap10 Mar 31 13:00:58 x4 kernel: Failed to fully fault in a core file segment at VA 0x8059000 with size 0x12000 to be written at offset 0x13000 for process mmap10 Mar 31 13:00:58 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 13:00:58 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x48000 for process mmap10 Mar 31 13:00:58 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x49000 for process mmap10 Mar 31 13:00:58 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x52000 for process mmap10 Mar 31 13:00:58 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 13:00:58 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28f000 for process mmap10 Mar 31 13:00:58 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Mar 31 13:00:59 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x3000 for process mmap10 Mar 31 13:01:07 x4 kernel: Failed to fully fault in a core file segment at VA 0x2d5e1000 with size 0x6e99000 to be written at offset 0x53f6000 for process mmap10 Mar 31 13:01:26 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0x496000 for process mmap10 Mar 31 13:01:26 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0x4b6000 for process mmap10 Mar 31 13:01:26 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0x4d6000 for process mmap10 Mar 31 13:01:26 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0x4f6000 for process mmap10 Mar 31 13:01:26 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbdf000 with size 0x20000 to be written at offset 0x516000 for process mmap10 Mar 31 13:01:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x804a000 with size 0x21000 to be written at offset 0x4000 for process mmap10 Mar 31 13:01:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x25000 for process mmap10 Mar 31 13:01:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5b000 for process mmap10 Mar 31 13:01:26 x4 kernel: Failed to fully fault in a core file segment at VA 0x2847a000 with size 0x206000 to be written at offset 0x290000 for process mmap10 Mar 31 13:01:26 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0x4b6000 for process mmap10 Mar 31 13:01:26 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0x4d6000 for process mmap10 Mar 31 13:01:26 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0x4f6000 for process mmap10 Mar 31 13:01:26 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbdf000 with size 0x20000 to be written at offset 0x516000 for process mmap10 Mar 31 13:01:46 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb8db000 with size 0x20000 to be written at offset 0x495000 for process mmap10 Mar 31 13:01:46 x4 kernel: Failed to fully fault in a core file segment at VA 0xbb9dc000 with size 0x20000 to be written at offset 0x4b5000 for process mmap10 Mar 31 13:01:46 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbadd000 with size 0x20000 to be written at offset 0x4d5000 for process mmap10 Mar 31 13:01:46 x4 kernel: Failed to fully fault in a core file segment at VA 0xbbbde000 with size 0x20000 to be written at offset 0x4f5000 for process mmap10 Mar 31 13:01:46 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbdf000 with size 0x20000 to be written at offset 0x515000 for process mmap10 Mar 31 13:01:46 x4 kernel: Failed to fully fault in a core file segment at VA 0xbfbff000 with size 0x1000 to be written at offset 0x535000 for process mmap10 Mar 31 13:01:46 x4 kernel: Failed to fully fault in a core file segment at VA 0x28067000 with size 0x23000 to be written at offset 0x24000 for process mmap10 Mar 31 13:01:46 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a4000 with size 0x1000 to be written at offset 0x47000 for process mmap10 Mar 31 13:01:46 x4 kernel: Failed to fully fault in a core file segment at VA 0x280a5000 with size 0x9000 to be written at offset 0x48000 for process mmap10 Mar 31 13:01:46 x4 kernel: Failed to fully fault in a core file segment at VA 0x2823c000 with size 0x9000 to be written at offset 0x51000 for process mmap10 Mar 31 13:01:46 x4 kernel: Failed to fully fault in a core file segment at VA 0x28245000 with size 0x234000 to be written at offset 0x5a000 for process mmap10 Mar 31 13:01:46 x4 kernel: Failed to fully fault in a core file segment at VA 0x28479000 with size 0x1000 to be written at offset 0x28e000 for process mmap10 Mar 31 13:01:46 x4 kernel: Failed to fully fault in a core file segment at VA 0x3447a000 with size 0x206000 to be written at offset 0x28f000 for process mmap10 freework leak: 4/17. 20180331 13:01:49 all (4/562): kevent6.sh lock order reversal: 1st 0xd868e028 filedesc structure (filedesc structure) @ kern/kern_descrip.c:1245 2nd 0xdc8885e4 ufs (ufs) @ kern/vfs_subr.c:5024 stack backtrace: #0 0xc0d10fe1 at witness_debugger+0x81 #1 0xc0d10ea8 at witness_checkorder+0xcd8 #2 0xc0c7abeb at lockmgr_xlock_hard+0x5b #3 0xc0c7b41f at __lockmgr_args+0x3df #4 0xc0fc8fe7 at ffs_lock+0xa7 #5 0xc12b1ffa at VOP_LOCK1_APV+0xda #6 0xc0d92081 at _vn_lock+0x61 #7 0xc0d80919 at vfs_knllock+0x29 #8 0xc0c5a409 at knlist_remove_kq+0x99 #9 0xc0c5a35f at knlist_remove+0x1f #10 0xc0d860ff at filt_vfsdetach+0x2f #11 0xc0c5aff3 at knote_fdclose+0x123 #12 0xc0c4d3a3 at closefp+0x63 #13 0xc0c4dd8e at kern_close+0x14e #14 0xc0c4dc3a at sys_close+0x1a #15 0xc127d9ae at syscall+0x6ee #16 0xc126713b at Xint0x80_syscall+0x2b lock order reversal: 1st 0xdc91d478 ufs (ufs) @ kern/vfs_subr.c:2571 2nd 0xcb58bba4 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:282 3rd 0xdc8885e4 ufs (ufs) @ kern/vfs_subr.c:2571 stack backtrace: #0 0xc0d10fe1 at witness_debugger+0x81 #1 0xc0d10ea8 at witness_checkorder+0xcd8 #2 0xc0c7abeb at lockmgr_xlock_hard+0x5b #3 0xc0c7b41f at __lockmgr_args+0x3df #4 0xc0fc8fe7 at ffs_lock+0xa7 #5 0xc12b1ffa at VOP_LOCK1_APV+0xda #6 0xc0d92081 at _vn_lock+0x61 #7 0xc0d7dfb1 at vget+0xc1 #8 0xc0d6f532 at vfs_hash_get+0xd2 #9 0xc0fc3cc4 at ffs_vgetf+0x44 #10 0xc0fb920f at softdep_sync_buf+0xa7f #11 0xc0fc9e8f at ffs_syncvnode+0x2df #12 0xc0fc7158 at ffs_sync+0x248 #13 0xc0d75cc6 at dounmount+0x5c6 #14 0xc0d755f5 at sys_unmount+0x315 #15 0xc127d9ae at syscall+0x6ee #16 0xc126713b at Xint0x80_syscall+0x2b lock order reversal: 1st 0xdbecd5e4 ufs (ufs) @ kern/vfs_mount.c:1335 2nd 0xdc8888bc devfs (devfs) @ ufs/ffs/ffs_softdep.c:1912 stack backtrace: #0 0xc0d10fe1 at witness_debugger+0x81 #1 0xc0d10ea8 at witness_checkorder+0xcd8 #2 0xc0c7a765 at lockmgr_lock_fast_path+0x195 #3 0xc0d6b65b at vop_stdlock+0x3b #4 0xc12b1ffa at VOP_LOCK1_APV+0xda #5 0xc0d92081 at _vn_lock+0x61 #6 0xc0fa6005 at softdep_flushworklist+0x65 #7 0xc0fc73ca at ffs_sync+0x4ba #8 0xc0d75cc6 at dounmount+0x5c6 #9 0xc0d755f5 at sys_unmount+0x315 #10 0xc127d9ae at syscall+0x6ee #11 0xc126713b at Xint0x80_syscall+0x2b 20180331 13:02:52 all (5/562): kevent11.sh mount leak: 1/98 20180331 13:06:00 all (6/562): devfs.sh mount leak: 1/99 20180331 13:11:05 all (7/562): gnop5.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. mount leak: 3/102 20180331 13:11:09 all (8/562): nfs15lockd2.sh Mar 31 13:11:21 x4 kernel: Failed to write core file for process nfs15lockd (error 70) freework leak: 1/18. 20180331 13:16:21 all (9/562): extattrctl.sh lock order reversal: 1st 0xd816c41c ufs_extattr_sx (ufs_extattr_sx) @ ufs/ufs/ufs_extattr.c:118 2nd 0xde44de6c ufs (ufs) @ ufs/ffs/ffs_vfsops.c:1677 stack backtrace: #0 0xc0d10fe1 at witness_debugger+0x81 #1 0xc0d10ea8 at witness_checkorder+0xcd8 #2 0xc0c7abeb at lockmgr_xlock_hard+0x5b #3 0xc0c7b41f at __lockmgr_args+0x3df #4 0xc0fc3dd5 at ffs_vgetf+0x155 #5 0xc0fc3c77 at ffs_vget+0x37 #6 0xc0fd8654 at ufs_root+0x54 #7 0xc0fcfb64 at ufs_extattr_autostart+0x84 #8 0xc0fc664c at ffs_mount+0x200c #9 0xc0d745f3 at vfs_domount+0x7e3 #10 0xc0d737f5 at vfs_donmount+0x7e5 #11 0xc0d72fea at sys_nmount+0x7a #12 0xc127d9ae at syscall+0x6ee #13 0xc126713b at Xint0x80_syscall+0x2b mount leak: 2/104 20180331 13:16:25 all (10/562): lockf3.sh Mar 31 13:17:32 x4 kernel: pid 51449 (swap), uid 0, was killed: out of swap space Mar 31 13:17:33 x4 kernel: pid 51460 (swap), uid 0, was killed: out of swap space Mar 31 13:17:34 x4 kernel: pid 51462 (swap), uid 0, was killed: out of swap space Mar 31 13:27:01 x4 kernel: pid 51758 (swap), uid 0, was killed: out of swap space Mar 31 13:37:59 x4 kernel: pid 52221 (swap), uid 0, was killed: out of swap space Mar 31 13:38:02 x4 kernel: pid 52220 (swap), uid 0, was killed: out of swap space Mar 31 13:38:08 x4 kernel: pid 52102 (swap), uid 0, was killed: out of swap space pts leak: 1/2 mount leak: 1/105 GEOM leak: 29/282 20180331 13:46:57 all (11/562): truncate3.sh mount leak: 1/106 20180331 13:47:09 all (12/562): mmap19.sh 20180331 13:47:36 all (13/562): 256m.sh 20180331 13:47:38 all (14/562): mmap18.sh 20180331 13:48:52 all (15/562): suj2.sh mount leak: 1/107 20180331 13:48:56 all (16/562): suj23.sh mount leak: 1/108 20180331 13:50:30 all (17/562): vmio.sh warning: total configured swap (4194304 pages) exceeds maximum recommended amount (1724580 pages). warning: increase kern.maxswzone or reduce amount of swap. 20180331 13:53:07 all (18/562): msdos3.sh mount leak: 1/109 20180331 13:53:11 all (19/562): trim3.sh Mar 31 14:06:41 x4 kernel: pid 23331 (swap), uid 1004, was killed: out of swap space swap_pager: I/O error - pageout failed; blkno 1160950,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1160982,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1161014,size 131072, error 12 mount leak: 3/112 20180331 14:18:46 all (20/562): pipe.sh 20180331 14:23:55 all (21/562): symlink4.sh mount leak: 1/113 20180331 14:24:13 all (22/562): msdos10.sh lock order reversal: 1st 0xde96d750 msdosfs (msdosfs) @ vm/vm_object.c:1107 2nd 0xde1181a0 devfs (devfs) @ fs/msdosfs/msdosfs_vnops.c:856 stack backtrace: #0 0xc0d10fe1 at witness_debugger+0x81 #1 0xc0d10ea8 at witness_checkorder+0xcd8 #2 0xc0c7a765 at lockmgr_lock_fast_path+0x195 #3 0xc0d6b65b at vop_stdlock+0x3b #4 0xc12b1ffa at VOP_LOCK1_APV+0xda #5 0xc0d92081 at _vn_lock+0x61 #6 0xc0b6f7c1 at msdosfs_fsync+0x51 #7 0xc12b09f6 at VOP_FSYNC_APV+0xf6 #8 0xc1000239 at vm_object_sync+0x279 #9 0xc0ff7cba at vm_map_sync+0x33a #10 0xc0ffc04e at sys_msync+0x6e #11 0xc127d9ae at syscall+0x6ee #12 0xc126713b at Xint0x80_syscall+0x2b mount leak: 1/114 20180331 14:30:24 all (23/562): jail2.sh 20180331 14:30:32 all (24/562): unix_socket_detach.sh 20180331 14:35:37 all (25/562): fts2.sh mount leak: 1/115 20180331 14:37:23 all (26/562): mkfifo6.sh mount leak: 16/131 20180331 14:38:28 all (27/562): rdgsbase.sh 20180331 14:38:59 all (28/562): seekdir.sh 20180331 14:39:50 all (29/562): core.sh 20180331 14:44:04 all (30/562): extattr.sh 20180331 14:44:12 all (31/562): newfs.sh Mar 31 14:54:25 x4 kernel: pid 77615 (creat), uid 1004 inumber 12290 on /mnt: out of inodes Mar 31 14:54:26 x4 kernel: pid 77654 (creat), uid 1004 inumber 4139 on /mnt: out of inodes Mar 31 14:54:28 x4 kernel: pid 77648 (creat), uid 1004 inumber 4142 on /mnt: out of inodes Mar 31 14:55:07 x4 kernel: pid 77991 (creat), uid 1004 inumber 6154 on /mnt: out of inodes Mar 31 14:55:11 x4 kernel: pid 77996 (creat), uid 1004 inumber 6161 on /mnt: out of inodes Mar 31 14:58:44 x4 kernel: pid 79591 (creat), uid 1004 inumber 4102 on /mnt: out of inodes Mar 31 14:58:46 x4 kernel: pid 79614 (creat), uid 1004 inumber 4113 on /mnt: out of inodes Mar 31 14:58:47 x4 kernel: pid 79614 (creat), uid 1004 inumber 4113 on /mnt: out of inodes Mar 31 14:58:49 x4 kernel: pid 79595 (creat), uid 1004 inumber 4104 on /mnt: out of inodes mount leak: 66/197 20180331 14:58:50 all: done 20180331 15:13:36 all (1/1): graid1_4.sh freework leak: 20/33. mount leak: 1/198 20180331 15:25:54 all: done 20180331 15:43:58 all (1/1): graid1_4.sh Mar 31 15:44:50 x4 kernel: pid 20846 (swap), uid 1004, was killed: out of swap space freework leak: 19/33. mount leak: 1/199 20180331 15:55:29 all: done 20180331 17:24:14 all (1/7): graid1_10.sh mount leak: 1/200 20180331 17:26:44 all (2/7): graid1_2.sh freework leak: 7/21. 20180331 17:31:59 all (3/7): graid1_3.sh freework leak: 9/30. 20180331 17:34:11 all (4/7): graid1_4.sh Mar 31 17:37:25 x4 kernel: pid 52360 (swap), uid 1004, was killed: out of swap space Mar 31 17:37:34 x4 kernel: pid 52347 (swap), uid 1004, was killed: out of swap space freework leak: 3/33. mount leak: 1/201 20180331 17:46:00 all (5/7): graid1_5.sh GEOM_NOP: Device md11.nop created. GEOM_NOP: Device md12.nop created. GEOM_NOP: Device md11.nop removed. GEOM_NOP: Device md12.nop removed. mount leak: 1/202 20180331 17:52:31 all (6/7): graid1_6.sh Mar 31 17:54:22 x4 kernel: pid 10570 (rw), uid 1004 inumber 40807 on /mnt: filesystem full Mar 31 17:54:22 x4 kernel: pid 10636 (lockf), uid 1004 inumber 41206 on /mnt: filesystem full Mar 31 17:54:24 x4 kernel: pid 10572 (rw), uid 1004 inumber 42500 on /mnt: filesystem full mount leak: 1/203 20180331 18:00:10 all (7/7): graid1_7.sh mount leak: 1/204 20180331 18:06:22 all: done Mar 31 20:41:53 x4 sshd[66787]: error: PAM: Authentication error for pho from t1.osted.lan FreeBSD/i386 (x4.osted.lan) (ttyu0) login: root Password: Last login: Mon Mar 26 15:53:41 on ttyu0 Mar 31 22:45:09 x4 login: ROOT LOGIN (root) ON ttyu0 FreeBSD 12.0-CURRENT (PHO) #0 r331837M: Sat Mar 31 12:00:50 CEST 2018 You have new mail. ps -lUroot 78root@x4:~ # ps -lUroot UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 0 0 0 0 -16 0 0 368 swapin DLs - 0:08.24 [kernel] 0 1 0 0 31 0 3588 104 wait ILs - 0:01.71 /sbin/init -- 0 2 0 0 -16 0 0 16 crypto_w DL - 0:00.00 [crypto] 0 3 0 0 -16 0 0 16 crypto_r DL - 0:00.00 [crypto returns 0] 0 4 0 0 -16 0 0 16 crypto_r DL - 0:00.00 [crypto returns 1] 0 5 0 0 -16 0 0 16 crypto_r DL - 0:00.00 [crypto returns 2] 0 6 0 0 -16 0 0 16 crypto_r DL - 0:00.00 [crypto returns 3] 0 7 0 0 -16 0 0 32 - RL - 4:57.53 [cam] 0 8 0 0 -16 0 0 16 - DL - 0:00.00 [fdc0] 0 9 0 0 -16 0 0 16 - DL - 0:00.01 [soaiod1] 0 10 0 0 -16 0 0 16 audit_wo DL - 0:00.00 [audit] 0 11 0 0 155 0 0 64 - RNL - 1857:47.45 [idle] 0 12 0 0 -56 0 0 304 - WL - 3:07.06 [intr] 0 13 0 0 -8 0 0 48 - DL - 4:50.52 [geom] 0 14 0 0 -68 0 0 480 - DL - 0:01.68 [usb] 0 15 0 0 -16 0 0 16 - DL - 0:00.02 [soaiod2] 0 16 0 0 -16 0 0 16 - DL - 0:00.02 [soaiod3] 0 17 0 0 -16 0 0 16 - DL - 0:00.01 [soaiod4] 0 18 0 0 -16 0 0 16 waiting_ DL - 0:00.00 [sctp_iterator] 0 19 0 0 -16 0 0 16 - DL - 0:07.35 [rand_harvestq] 0 20 0 0 -16 0 0 48 psleep DL - 19:42.10 [pagedaemon] 0 21 0 0 -16 0 0 16 psleep DL - 0:02.73 [vmdaemon] 0 22 0 0 20 0 0 96 qsleep DL - 6:19.93 [bufdaemon] 0 23 0 0 16 0 0 16 syncer DL - 2:38.63 [syncer] 0 24 0 0 20 0 0 16 vlruwt DL - 0:01.68 [vnlru] 0 341 1 0 20 0 6460 568 select Ss - 0:21.29 /sbin/devd 0 413 1 0 20 0 4676 812 select Ss - 0:10.17 /usr/sbin/syslogd -s 0 422 1 0 20 0 4736 1072 select Ss - 0:00.31 /usr/sbin/rpcbind 0 548 1 0 52 0 4916 0 pause IWs - 0:00.00 nfsuserd: master (nfsuserd) 0 549 548 0 20 0 4916 308 select S - 0:00.25 nfsuserd: slave (nfsuserd) 0 556 1 0 20 0 5936 1612 select Is - 0:42.88 /usr/sbin/mountd -n 0 562 1 0 20 0 5460 440 select Is - 0:00.05 nfsd: master (nfsd) 0 565 562 0 20 0 4308 512 rpcsvc S - 0:01.68 nfsd: server (nfsd) 0 566 1 0 20 0 267788 1040 select Ss - 0:00.18 /usr/sbin/rpc.statd 0 569 1 0 20 0 5488 24 rpcsvc Ss - 0:00.51 /usr/sbin/rpc.lockd 0 607 1 0 20 0 10492 10528 select Ss - 0:02.44 /usr/sbin/ntpd -g -c /etc/ntp.conf -p /var/run/ntpd.pid -f /var/db/ntpd.drift 0 610 1 0 20 0 4372 172 select Ss - 0:05.56 /usr/sbin/powerd 0 640 1 0 20 0 7068 0 nanslp IW - 0:00.00 /usr/local/sbin/smartd -c /usr/local/etc/smartd.conf -p /var/run/smartd.pid 0 678 1 0 20 0 10048 1336 select Is - 0:00.11 /usr/sbin/sshd 0 681 1 0 20 0 8100 1368 select Ss - 0:00.98 sendmail: rejecting connections on daemon Daemon0: load average: 72 (sendmail) 0 688 1 0 20 0 4712 668 nanslp Is - 0:00.34 /usr/sbin/cron -s 0 721 1 0 52 0 4248 0 accept IWs - 0:00.00 nfscbd: master (nfscbd) 0 722 721 0 52 0 4248 64 rpcsvc S - 0:00.10 nfscbd: server (nfscbd) 0 756 1 0 52 0 4796 16 select Is - 0:00.00 /usr/sbin/inetd -wW -C 60 0 1042 678 0 27 0 10740 24 select Is - 0:00.08 sshd: pho [priv] (sshd) 0 10793 678 0 20 0 10740 6052 select Is - 0:00.06 sshd: pho [priv] (sshd) 0 81051 678 0 30 0 10740 24 select Is - 0:00.21 sshd: pho [priv] (sshd) 0 81052 678 0 30 0 10740 24 select Is - 0:00.21 sshd: pho [priv] (sshd) 0 81053 678 0 28 0 10740 24 select Is - 0:00.21 sshd: pho [priv] (sshd) 0 781 1 0 20 0 5292 2608 wait Is u0 0:00.06 login [pam] (login) 0 14291 781 0 20 0 6456 3736 pause S u0 0:00.06 -csh (csh) 0 14672 14291 0 21 0 5176 2644 - R+ u0 0:00.01 ps -lUroot 0 773 1 0 52 0 4404 24 ttyin Is+ v0 0:00.00 /usr/libexec/getty Pc ttyv0 0 774 1 0 52 0 4404 24 ttyin Is+ v1 0:00.00 /usr/libexec/getty Pc ttyv1 0 775 1 0 52 0 4404 24 ttyin Is+ v2 0:00.00 /usr/libexec/getty Pc ttyv2 0 776 1 0 52 0 4404 24 ttyin Is+ v3 0:00.00 /usr/libexec/getty Pc ttyv3 0 777 1 0 52 0 4404 24 ttyin Is+ v4 0:00.00 /usr/libexec/getty Pc ttyv4 0 778 1 0 52 0 4404 24 ttyin Is+ v5 0:00.00 /usr/libexec/getty Pc ttyv5 0 779 1 0 52 0 4404 24 ttyin Is+ v6 0:00.00 /usr/libexec/getty Pc ttyv6 0 780 1 0 52 0 4404 24 ttyin Is+ v7 0:00.00 /usr/libexec/getty Pc ttyv7 0 1053 1045 0 27 0 5236 0 wait IW 0 0:00.00 su 0 1054 1053 0 30 0 6472 0 pause IW 0 0:00.00 _su (csh) 0 1056 1054 0 20 0 6928 2700 wait I 0 0:00.12 bash 0 6632 1056 0 52 0 5172 2304 wait I 0 0:00.01 sh -x ./marcus4.sh 0 6675 6632 0 52 0 5236 2544 wait I 0 0:00.01 su stress -c cd ..; ./testcases/run/run $TESTPROGS 0 6676 6632 0 52 0 4224 1968 nanslp IC 0 0:00.00 sleep 960 root@x4:~ # kill 6676 root@x4:~ # Mar 31 23:23:13 x4 inetd[756]: discard/udp server failing (looping), service terminated Mar 31 23:39:57 x4 inetd[756]: discard/udp server failing (looping), service terminated Apr 1 06:16:12 x4 inetd[756]: discard/udp server failing (looping), service terminated panic: Bad tailq NEXT(0xc1c1de94->tqh_last) != NULL cpuid = 2 time = 1522556477 KDB: stack backtrace: db_trace_self_wrapper(c16828e4,c192814c,0,c164feac,e02759f8,...) at db_trace_self_wrapper+0x2a/frame 0xe02759c8 kdb_backtrace(c167c7a7,5ac05e3d,0,e0275a84,b,...) at kdb_backtrace+0x2d/frame 0xe0275a30 vpanic(c12b7617,e0275a84,e0275a84,e0275aa0,c10085d5,...) at vpanic+0x133/frame 0xe0275a64 panic(c12b7617,c1c1de94,c16d29f5,c17,1000004,...) at panic+0x1b/frame 0xe0275a78 vm_page_enqueue(c3aa8234,0,c16d03de,4f3,0,...) at vm_page_enqueue+0xf5/frame 0xe0275aa0 vm_fault_hold(cb7b91c8,284d9000,2,0,0,...) at vm_fault_hold+0x2052/frame 0xe0275b78 vm_fault(cb7b91c8,284d9000,2,0,1,...) at vm_fault+0x83/frame 0xe0275ba0 trap_pfault(284d9950,e0275ce8,d819b380,dd3190b8,e0275c48,...) at trap_pfault+0x109/frame 0xe0275be8 trap(e0275ce8) at trap+0x4d9/frame 0xe0275cdc calltrap() at calltrap+0x6/frame 0xe0275cdc --- trap 0xc, eip = 0x281b3f4b, esp = 0xbfbfe390, ebp = 0xbfbfe3c0 --- KDB: enter: panic [ thread pid 36959 tid 101735 ] Stopped at kdb_enter+0x3a: movl $0,kdb_why db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> bt Tracing pid 36959 tid 101735 td 0xd819b380 kdb_enter(c167c937,c167c937,0,e0275a84,b,...) at kdb_enter+0x3a/frame 0xe0275a30 vpanic(c12b7617,e0275a84,e0275a84,e0275aa0,c10085d5,...) at vpanic+0x150/frame 0xe0275a64 panic(c12b7617,c1c1de94,c16d29f5,c17,1000004,...) at panic+0x1b/frame 0xe0275a78 vm_page_enqueue(c3aa8234,0,c16d03de,4f3,0,...) at vm_page_enqueue+0xf5/frame 0xe0275aa0 vm_fault_hold(cb7b91c8,284d9000,2,0,0,...) at vm_fault_hold+0x2052/frame 0xe0275b78 vm_fault(cb7b91c8,284d9000,2,0,1,...) at vm_fault+0x83/frame 0xe0275ba0 trap_pfault(284d9950,e0275ce8,d819b380,dd3190b8,e0275c48,...) at trap_pfault+0x109/frame 0xe0275be8 trap(e0275ce8) at trap+0x4d9/frame 0xe0275cdc calltrap() at calltrap+0x6/frame 0xe0275cdc --- trap 0xc, eip = 0x281b3f4b, esp = 0xbfbfe390, ebp = 0xbfbfe3c0 --- db:1:pho1> show allpcpu Current CPU: 2 cpuid = 0 dynamic pcpu = 0x694c00 curthread = 0xdc4fc380: pid 36957 tid 100878 "sh" curpcb = 0xcb0c9d40 fpcurthread = none idlethread = 0xcb7b3700: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0x9cdbc00 curthread = 0xdd3d3700: pid 36958 tid 101442 "sh" curpcb = 0xc91b7d40 fpcurthread = none idlethread = 0xcb7b3380: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0x9ce0c00 curthread = 0xd819b380: pid 36959 tid 101735 "sh" curpcb = 0xe0275d40 fpcurthread = none idlethread = 0xcb7b3000: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0x9ce5c00 curthread = 0xd7c9ca80: pid 12 tid 100043 "irq257: re0" curpcb = 0xd7ae8d40 fpcurthread = none idlethread = 0xcb7b2a80: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 36959 (sh) thread 0xd819b380 (101735) exclusive sleep mutex vm active pagequeue (vm pagequeue) r = 0 (0xc1c1de80) locked @ vm/vm_page.c:3095 exclusive sleep mutex vm page (vm page) r = 0 (0xc19779c0) locked @ vm/vm_fault.c:1267 exclusive rw vm object (vm object) r = 0 (0xdfbe5618) locked @ vm/vm_fault.c:1266 shared sx vm map (user) (vm map (user)) r = 0 (0xcb7b920c) locked @ vm/vm_map.c:4065 Process 36958 (sh) thread 0xdd3d3700 (101442) exclusive rw pmap pv global (pmap pv global) r = 0 (0xc1c054c0) locked @ i386/i386/pmap.c:4468 exclusive sleep mutex vm inactive pagequeue (vm pagequeue) r = 0 (0xc1c1de40) locked @ vm/vm_object.c:773 exclusive sleep mutex vm page (vm page) r = 0 (0xc1977a40) locked @ vm/vm_object.c:755 exclusive rw vm object (vm object) r = 0 (0xdc38accc) locked @ vm/vm_object.c:542 Process 36957 (sh) thread 0xdc4fc380 (100878) shared sx vm map (user) (vm map (user)) r = 0 (0xdbfc9a10) locked @ vm/vm_map.c:4065 Process 565 (nfsd) thread 0xdbd6da80 (100140) exclusive lockmgr ufs (ufs) r = 0 (0xdf8bd30c) locked @ kern/vfs_subr.c:2571 Process 565 (nfsd) thread 0xdc347380 (100154) exclusive lockmgr ufs (ufs) r = 0 (0xdcdfa750) locked @ kern/vfs_subr.c:2571 Process 22 (bufdaemon) thread 0xc9766380 (100115) exclusive lockmgr bufwait (bufwait) r = 0 (0xcb5e8c50) locked @ kern/vfs_bio.c:1668 exclusive lockmgr bufwait (bufwait) r = 0 (0xcb5c35a0) locked @ kern/vfs_bio.c:1668 Process 12 (intr) thread 0xd7c9ca80 (100043) exclusive sleep mutex re0 (network driver) r = 0 (0xd7c88130) locked @ dev/re/if_re.c:2645 db:1:pho1> show lockedvnods Locked vnodes vnode 0xdcdfa71c: tag ufs, type VREG usecount 1, writecount 0, refcount 824 flags (VI_ACTIVE) v_object 0xdf9db924 ref 0 pages 48828 cleanbuf 821 dirtybuf 1 lock type ufs: EXCL by thread 0xdc347380 (pid 565, nfsd, tid 100154) #0 0xc0c7aeef at lockmgr_xlock_hard+0x35f #1 0xc0c7b41f at __lockmgr_args+0x3df #2 0xc0fc8fe7 at ffs_lock+0xa7 #3 0xc12b1ffa at VOP_LOCK1_APV+0xda #4 0xc0d92081 at _vn_lock+0x61 #5 0xc0d7dfb1 at vget+0xc1 #6 0xc0d6f532 at vfs_hash_get+0xd2 #7 0xc0fc3cc4 at ffs_vgetf+0x44 #8 0xc0fc3c77 at ffs_vget+0x37 #9 0xc0fd88ba at ufs_fhtovp+0x5a #10 0xc0fc7863 at ffs_fhtovp+0xc3 #11 0xc0bd61c5 at nfsvno_fhtovp+0x65 #12 0xc0bd6351 at nfsd_fhtovp+0xa1 #13 0xc0bb6611 at nfsrvd_dorpc+0x141 #14 0xc0bc67cf at nfssvc_program+0x56f #15 0xc0f64e82 at svc_run_internal+0xa52 #16 0xc0f656ad at svc_thread_start+0xd #17 0xc0c6573e at fork_exit+0x7e ino 3509714, on dev label/tmp vnode 0xdf8bd2d8: tag ufs, type VREG usecount 1, writecount 0, refcount 721 flags (VI_ACTIVE) v_object 0xddbde09c ref 0 pages 26564 cleanbuf 718 dirtybuf 1 lock type ufs: EXCL by thread 0xdbd6da80 (pid 565, nfsd, tid 100140) #0 0xc0c7aeef at lockmgr_xlock_hard+0x35f #1 0xc0c7b41f at __lockmgr_args+0x3df #2 0xc0fc8fe7 at ffs_lock+0xa7 #3 0xc12b1ffa at VOP_LOCK1_APV+0xda #4 0xc0d92081 at _vn_lock+0x61 #5 0xc0d7dfb1 at vget+0xc1 #6 0xc0d6f532 at vfs_hash_get+0xd2 #7 0xc0fc3cc4 at ffs_vgetf+0x44 #8 0xc0fc3c77 at ffs_vget+0x37 #9 0xc0fd88ba at ufs_fhtovp+0x5a #10 0xc0fc7863 at ffs_fhtovp+0xc3 #11 0xc0bd61c5 at nfsvno_fhtovp+0x65 #12 0xc0bd6351 at nfsd_fhtovp+0xa1 #13 0xc0bb6611 at nfsrvd_dorpc+0x141 #14 0xc0bc67cf at nfssvc_program+0x56f #15 0xc0f64e82 at svc_run_internal+0xa52 #16 0xc0f656ad at svc_thread_start+0xd #17 0xc0c6573e at fork_exit+0x7e ino 3512880, on dev label/tmp db:1:pho1> show mount 0xd8762000 /dev/ada0s1a on / (ufs) 0xd8686000 devfs on /dev (devfs) 0xdbd7a000 /dev/ada0s1f on /home (ufs) 0xdbd79000 /dev/label/tmp on /tmp (ufs) 0xdbd78000 /dev/ada0s1d on /usr (ufs) 0xdbe5e000 /dev/ada0s1e on /var (ufs) 0xdbe5d000 procfs on /proc (procfs) More info: show mount db:1:pho1> show bufqueues bqempty: 0 Buf domain 0 freebufs 469 lofreebufs 311 hifreebufs 466 bufspace 70004736 maxbufspace 94683136 hibufspace 94027776 lobufspace 89326372 bufspacethresh 91677074 numdirtybuffers 1020 lodirtybuffers 732 hidirtybuffers 1464 dirtybufthresh 1317 cleanq count 4168 (62734336) dirtyq count 1100 (6791168) wakeup 0 lim 28 CPU 13, 4, 8, 13, Locked buffers: 84 space 1376256 Total buffers: 5779 space 70004736 db:1:pho1> show page vm_cnt.v_free_count: 688413 vm_cnt.v_inactive_count: 123298 vm_cnt.v_active_count: 540 vm_cnt.v_laundry_count: 2332 vm_cnt.v_wire_count: 47583 vm_cnt.v_free_reserved: 1188 vm_cnt.v_free_min: 5498 vm_cnt.v_free_target: 18428 vm_cnt.v_inactive_target: 27642 db:1:pho1> show pageq pq_free 688413 dom 0 page_cnt 862226 free 688413 pq_act 540 pq_inact 123298 pq_laund 2332 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 -- -- -- -- 10 (004096K) | 000000 09 (002048K) | 000153 08 (001024K) | 000070 07 (000512K) | 000373 06 (000256K) | 000954 05 (000128K) | 005031 04 (000064K) | 007851 03 (000032K) | 011152 02 (000016K) | 013709 01 (000008K) | 014792 00 (000004K) | 012016 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 -- -- -- -- 10 (004096K) | 000000 09 (002048K) | 000001 08 (001024K) | 000001 07 (000512K) | 000000 06 (000256K) | 000001 05 (000128K) | 000000 04 (000064K) | 000002 03 (000032K) | 000003 02 (000016K) | 000004 01 (000008K) | 000004 00 (000004K) | 000002 db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 36959 36957 81064 1001 R CPU 2 sh 36958 36957 81064 1001 RE CPU 1 sh 36957 36593 81064 1001 R CPU 0 sh 36593 81069 81064 1001 S piperd 0xdca08d40 sh 22250 1 22250 0 Ss nanslp 0xc1b7373e watchdogd 14598 14295 14598 1001 Ss+ select 0xd81ff2a4 bash 14295 10793 10793 1001 S select 0xde61b064 sshd 14291 781 14291 0 S+ ttyin 0xd7c62274 csh 10793 678 10793 0 Ss select 0xdfeec124 sshd 81072 81064 81064 1001 S piperd 0xd87d9350 sh 81070 81064 81064 1001 S piperd 0xd87d94f8 awk 81069 81064 81064 1001 S wait 0xde7a0358 sh 81065 81062 81065 1001 Ss+ select 0xdd08cb64 top 81064 81061 81064 1001 SWs wait 0xde9c6358 sh 81063 81060 81063 1001 Ss kqread 0xd7c44200 tail 81062 81051 81051 1001 S select 0xd82e72e4 sshd 81061 81053 81053 1001 S select 0xdf121f24 sshd 81060 81052 81052 1001 S select 0xd82ddf24 sshd 81053 678 81053 0 Ss select 0xdcc4db24 sshd 81052 678 81052 0 Ss select 0xd82e7324 sshd 81051 678 81051 0 Ss select 0xd7fdbe24 sshd 1056 1054 1056 0 S+ select 0xd81ffb24 bash 1054 1053 1054 0 SW+ pause 0xdc492a6c csh 1053 1045 1053 1001 SW+ wait 0xd7f3aa08 su 1045 1044 1045 1001 SWs+ wait 0xd869a6b0 bash 1044 1042 1042 1001 S select 0xd8200a64 sshd 1042 678 1042 0 Ss select 0xd8200aa4 sshd 781 1 781 0 SWs+ wait 0xdc482358 login 780 1 780 0 Ss+ ttyin 0xc9605a74 getty 779 1 779 0 Ss+ ttyin 0xc9605c74 getty 778 1 778 0 Ss+ ttyin 0xc9605e74 getty 777 1 777 0 Ss+ ttyin 0xc9606074 getty 776 1 776 0 Ss+ ttyin 0xc9606274 getty 775 1 775 0 Ss+ ttyin 0xc9606474 getty 774 1 774 0 Ss+ ttyin 0xc9606674 getty 773 1 773 0 Ss+ ttyin 0xc9606874 getty 756 1 756 0 Ss select 0xd8200ae4 inetd 722 721 721 0 S (threaded) nfscbd 100175 S rpcsvc 0xd7c18150 nfscbd: master 100176 S rpcsvc 0xd8257050 nfscbd: service 100177 S rpcsvc 0xd7f9cdd0 nfscbd: service 100178 S rpcsvc 0xd82570d0 nfscbd: service 721 1 721 0 SWs accept 0xdbf6e2c0 nfscbd 688 1 688 0 Ss nanslp 0xc1b7373d cron 684 1 684 25 Ss pause 0xd8698064 sendmail 681 1 681 0 Ss select 0xd8200b24 sendmail 678 1 678 0 Ss select 0xd8200b64 sshd 640 1 639 0 S nanslp 0xc1b7373d smartd 610 1 610 0 Ss select 0xd7fd9764 powerd 607 1 607 0 Ss (threaded) ntpd 100122 S select 0xd81ffc64 ntpd 569 1 569 0 Ss rpcsvc 0xd84b57d0 NLM: master 566 1 566 0 Ss select 0xd8200ba4 rpc.statd 565 562 562 0 R (threaded) nfsd 100124 S rpcsvc 0xd7c172d0 nfsd: master 100127 S rpcsvc 0xd8256050 nfsd: service 100128 S rpcsvc 0xd8256dd0 nfsd: service 100129 S rpcsvc 0xd7c17a50 nfsd: service 100130 S rpcsvc 0xd7f9ef50 nfsd: service 100131 S rpcsvc 0xd7c17ad0 nfsd: service 100132 S rpcsvc 0xd7f9eed0 nfsd: service 100133 S rpcsvc 0xd7c186d0 nfsd: service 100134 S rpcsvc 0xd7f9ee50 nfsd: service 100135 S rpcsvc 0xd8256e50 nfsd: service 100136 S rpcsvc 0xd7f9edd0 nfsd: service 100137 S rpcsvc 0xd7c17b50 nfsd: service 100138 S rpcsvc 0xd7f9ed50 nfsd: service 100139 RunQ nfsd: service 100140 D wdrain 0xc1bed7e4 nfsd: service 100141 S rpcsvc 0xd7c17c50 nfsd: service 100142 S rpcsvc 0xd7c17cd0 nfsd: service 100143 S rpcsvc 0xd7f9ec50 nfsd: service 100144 S rpcsvc 0xd7c17d50 nfsd: service 100145 S rpcsvc 0xd7f9ebd0 nfsd: service 100146 S rpcsvc 0xd7c17dd0 nfsd: service 100147 S rpcsvc 0xd7f9eb50 nfsd: service 100148 S rpcsvc 0xd7c17e50 nfsd: service 100149 S rpcsvc 0xd7f9ead0 nfsd: service 100150 S rpcsvc 0xd7f9ea50 nfsd: service 100151 S rpcsvc 0xd7f9e9d0 nfsd: service 100152 S rpcsvc 0xd7c17ed0 nfsd: service 100153 S rpcsvc 0xd7c17f50 nfsd: service 100154 D wdrain 0xc1bed7e4 nfsd: service 100155 S rpcsvc 0xd7c180d0 nfsd: service 100156 S rpcsvc 0xd7f9e950 nfsd: service 100157 S rpcsvc 0xd8256ed0 nfsd: service 562 1 562 0 Ss select 0xd84ae0a4 nfsd 556 1 556 0 Ss select 0xd81ffce4 mountd 549 548 548 0 S select 0xd7fd97a4 nfsuserd 548 1 548 0 SWs pause 0xd7f35a6c nfsuserd 422 1 422 0 Ss select 0xd81ffd24 rpcbind 413 1 413 0 Ss select 0xd81ffd64 syslogd 341 1 341 0 Ss select 0xd7fd97e4 devd 24 0 0 0 DL vlruwt 0xd86986b0 [vnlru] 23 0 0 0 DL syncer 0xc1bede60 [syncer] 22 0 0 0 DL (threaded) [bufdaemon] 100099 D wdrain 0xc1bed7e4 [bufdaemon] 100101 D - 0xc194a740 [bufspacedaemon-0] 100114 D sdflush 0xd84dc084 [/home worker] 100115 D biord 0xcb5e8bf4 [/tmp worker] 100116 D sdflush 0xd84dbc84 [/usr worker] 100117 D sdflush 0xd84dba84 [/var worker] 21 0 0 0 DL psleep 0xc1bf2dec [vmdaemon] 20 0 0 0 DL (threaded) [pagedaemon] 100095 D psleep 0xc1c1e14c [dom0] 100097 D launds 0xc1c1e158 [laundry: dom0] 100098 D umarcl 0xc0fe9230 [uma] 19 0 0 0 DL - 0xc1a4b9a0 [rand_harvestq] 18 0 0 0 DL waiting 0xc1c1d3a0 [sctp_iterator] 17 0 0 0 DL - 0xc1bed418 [soaiod4] 16 0 0 0 DL - 0xc1bed418 [soaiod3] 15 0 0 0 DL - 0xc1bed418 [soaiod2] 9 0 0 0 DL - 0xc1bed418 [soaiod1] 8 0 0 0 DL - 0xd7c4a23c [fdc0] 14 0 0 0 DL (threaded) [usb] 100046 D - 0xd7c8bacc [usbus0] 100047 D - 0xd7c8bafc [usbus0] 100048 D - 0xd7c8bb2c [usbus0] 100049 D - 0xd7c8bb5c [usbus0] 100050 D - 0xd7c8bb8c [usbus0] 100052 D - 0xd7f40acc [usbus1] 100053 D - 0xd7f40afc [usbus1] 100054 D - 0xd7f40b2c [usbus1] 100055 D - 0xd7f40b5c [usbus1] 100056 D - 0xd7f40b8c [usbus1] 100058 D - 0xd7f47acc [usbus2] 100059 D - 0xd7f47afc [usbus2] 100060 D - 0xd7f47b2c [usbus2] 100061 D - 0xd7f47b5c [usbus2] 100062 D - 0xd7f47b8c [usbus2] 100063 D - 0xd7f55acc [usbus3] 100064 D - 0xd7f55afc [usbus3] 100065 D - 0xd7f55b2c [usbus3] 100066 D - 0xd7f55b5c [usbus3] 100067 D - 0xd7f55b8c [usbus3] 100068 D - 0xd7f5cacc [usbus4] 100069 D - 0xd7f5cafc [usbus4] 100070 D - 0xd7f5cb2c [usbus4] 100071 D - 0xd7f5cb5c [usbus4] 100072 D - 0xd7f5cb8c [usbus4] 100074 D - 0xd7c7cca4 [usbus5] 100075 D - 0xd7c7ccd4 [usbus5] 100076 D - 0xd7c7cd04 [usbus5] 100077 D - 0xd7c7cd34 [usbus5] 100078 D - 0xd7c7cd64 [usbus5] 7 0 0 0 DL (threaded) [cam] 100041 D - 0xc1998d40 [doneq0] 100094 D - 0xc1998c6c [scanner] 6 0 0 0 DL crypto_ 0xcb782cc4 [crypto returns 3] 5 0 0 0 DL crypto_ 0xcb782c8c [crypto returns 2] 4 0 0 0 DL crypto_ 0xcb782c54 [crypto returns 1] 3 0 0 0 DL crypto_ 0xcb782c1c [crypto returns 0] 2 0 0 0 DL crypto_ 0xc1bf1c34 [crypto] 13 0 0 0 DL (threaded) [geom] 100028 D - 0xc1c19818 [g_event] 100029 D - 0xc1c1981c [g_up] 100030 D - 0xc1c19820 [g_down] 12 0 0 0 RL (threaded) [intr] 100008 I [swi5: fast taskq] 100011 I [swi6: task queue] 100012 I [swi6: Giant taskq] 100022 I [swi1: netisr 0] 100023 I [swi4: clock (0)] 100024 I [swi4: clock (1)] 100025 I [swi4: clock (2)] 100026 I [swi4: clock (3)] 100027 I [swi3: vm] 100042 I [irq256: hdac0] 100043 Run CPU 3 [irq257: re0] 100044 I [irq22: ahci0] 100045 I [irq16: hdac1 ohci0] 100051 I [irq17: ohci1 ohci3] 100057 I [irq18: ohci2 ohci4] 100073 I [irq19: ehci0] 100079 I [irq14: ata0] 100080 I [swi0: uart] 100082 I [irq1: atkbd0] 11 0 0 0 RL (threaded) [idle] 100003 CanRun [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 CanRun [idle: cpu2] 100006 CanRun [idle: cpu3] 1 0 1 0 SLs wait 0xcb7afa08 [init] 10 0 0 0 DL audit_w 0xc1c1db58 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xc1c19844 [swapper] 100007 D - 0xc962f400 [thread taskq] 100009 D - 0xc962f280 [aiod_kick taskq] 100010 D - 0xc962f200 [kqueue_ctx taskq] 100013 D - 0xc963d000 [if_io_tqg_0] 100014 D - 0xc963cf00 [if_io_tqg_1] 100015 D - 0xc963ce80 [if_io_tqg_2] 100016 D - 0xc963ce00 [if_io_tqg_3] 100017 D - 0xc963cd80 [softirq_0] 100018 D - 0xc963cd00 [softirq_1] 100019 D - 0xc963cc80 [softirq_2] 100020 D - 0xc963cc00 [softirq_3] 100021 D - 0xc963cb80 [if_config_tqg_0] 100031 D - 0xc962cc00 [firmware taskq] 100032 D - 0xc962cb80 [crypto_0] 100033 D - 0xc962cb80 [crypto_1] 100034 D - 0xc962cb80 [crypto_2] 100035 D - 0xc962cb80 [crypto_3] 100083 D - 0xd7c4ed80 [mca taskq] 100089 D - 0xd824db80 [acpi_task_0] 100090 D - 0xd824db80 [acpi_task_1] 100091 D - 0xd824db80 [acpi_task_2] 100093 D - 0xc962cb00 [CAM taskq] db:0:pho> allt Tracing command sh pid 36959 tid 101735 td 0xd819b380 (CPU 2) kdb_enter(c167c937,c167c937,0,e0275a84,b,...) at kdb_enter+0x3a/frame 0xe0275a30 vpanic(c12b7617,e0275a84,e0275a84,e0275aa0,c10085d5,...) at vpanic+0x150/frame 0xe0275a64 panic(c12b7617,c1c1de94,c16d29f5,c17,1000004,...) at panic+0x1b/frame 0xe0275a78 vm_page_enqueue(c3aa8234,0,c16d03de,4f3,0,...) at vm_page_enqueue+0xf5/frame 0xe0275aa0 vm_fault_hold(cb7b91c8,284d9000,2,0,0,...) at vm_fault_hold+0x2052/frame 0xe0275b78 vm_fault(cb7b91c8,284d9000,2,0,1,...) at vm_fault+0x83/frame 0xe0275ba0 trap_pfault(284d9950,e0275ce8,d819b380,dd3190b8,e0275c48,...) at trap_pfault+0x109/frame 0xe0275be8 trap(e0275ce8) at trap+0x4d9/frame 0xe0275cdc calltrap() at calltrap+0x6/frame 0xe0275cdc --- trap 0xc, eip = 0x281b3f4b, esp = 0xbfbfe390, ebp = 0xbfbfe3c0 --- Tracing command sh pid 36958 tid 101442 td 0xdd3d3700 (CPU 1) cpustop_handler(1,c91b7970,c91b7964,c127c233,9,...) at cpustop_handler+0x25/frame 0xc91b7860 ipi_nmi_handler(9,c167d7a2,c91b78a8,c0c865b6,c1b80980,...) at ipi_nmi_handler+0x36/frame 0xc91b7870 trap(c91b7970) at trap+0xa3/frame 0xc91b7964 calltrap() at calltrap+0x6/frame 0xc91b7964 --- trap 0x13, eip = 0xc0d118ae, esp = 0xc91b79b0, ebp = 0xc91b79e8 --- witness_unlock(c1c054c0,8,c1884898,1178,c302bbf8,...) at witness_unlock+0x6e/frame 0xc91b79e8 _rw_wunlock_cookie(c1c054d0,c1884898,1178,c302bbf8,dc38accc,...) at _rw_wunlock_cookie+0x5a/frame 0xc91b7a0c pmap_page_is_mapped(c302bbf8,4,c16d29f5,c7f,c16d21da,...) at pmap_page_is_mapped+0x75/frame 0xc91b7a28 vm_page_free_prep(c302bbf8,1,c16d21da,305,c167f31f,...) at vm_page_free_prep+0x4c/frame 0xc91b7a60 vm_object_terminate(dc38accc,c16d21da,2a3,0,c23b2640,...) at vm_object_terminate+0x44a/frame 0xc91b7ac8 vm_object_deallocate(d80f1924,c97fc3fc,0,d87d6cbc,1000,...) at vm_object_deallocate+0x4bd/frame 0xc91b7b20 vm_map_process_deferred(d87d6cbc,c16d0e62,c75,c72,dd3d3700,...) at vm_map_process_deferred+0x9a/frame 0xc91b7b40 vm_map_remove(d87d6c78,1000,bfc00000,167,dd0b26b0,...) at vm_map_remove+0xd7/frame 0xc91b7b60 vmspace_exit(dd3d3700,0,c1673450,167,c91b7be8,...) at vmspace_exit+0xcb/frame 0xc91b7b88 exit1(dd3d3700,0,0,c91b7cdc,c127d9ae,...) at exit1+0x6ac/frame 0xc91b7bd4 sys_sys_exit(dd3d3700,dd3d3984,c16733db,4,c91b7c48,...) at sys_sys_exit+0x22/frame 0xc91b7be8 syscall(c91b7ce8) at syscall+0x6ee/frame 0xc91b7cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xc91b7cdc --- syscall (1, FreeBSD ELF32, sys_sys_exit), eip = 0x281d9ee3, esp = 0xbfbfec14, ebp = 0xbfbfeca0 --- Tracing command sh pid 36957 tid 100878 td 0xdc4fc380 (CPU 0) cpustop_handler(0,cb0c9a1c,cb0c9a10,c127c233,c1b81050,...) at cpustop_handler+0x25/frame 0xcb0c9908 ipi_nmi_handler(c1b81050,83d48e7b,83d4b683,6c0,c1b81084,...) at ipi_nmi_handler+0x36/frame 0xcb0c9918 trap(cb0c9a1c) at trap+0xa3/frame 0xcb0c9a10 calltrap() at calltrap+0x6/frame 0xcb0c9a10 --- trap 0x13, eip = 0xc0fef4ac, esp = 0xcb0c9a5c, ebp = 0xcb0c9aa0 --- vm_fault_prefault(4,4,c5ecdd50,1,0,...) at vm_fault_prefault+0x17c/frame 0xcb0c9aa0 vm_fault_hold(dbfc99cc,8068000,2,0,0,...) at vm_fault_hold+0x1fea/frame 0xcb0c9b78 vm_fault(dbfc99cc,8068000,2,0,1,...) at vm_fault+0x83/frame 0xcb0c9ba0 trap_pfault(8068948,cb0c9ce8,c16733db,8,cb0c9c48,...) at trap_pfault+0x109/frame 0xcb0c9be8 trap(cb0c9ce8) at trap+0x4d9/frame 0xcb0c9cdc calltrap() at calltrap+0x6/frame 0xcb0c9cdc --- trap 0xc, eip = 0x8055ddb, esp = 0xbfbfe64c, ebp = 0xbfbfe668 --- Tracing command sh pid 36593 tid 100922 td 0xdc6e7a80 sched_switch(dc6e7a80,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xcb1829a8 mi_switch(104,0,c16848e5,22b,dc6e7a80,...) at mi_switch+0x1f3/frame 0xcb1829e8 sleepq_switch(dc6e7a80,0,c16848e5,1ca,5c,...) at sleepq_switch+0x110/frame 0xcb182a1c sleepq_catch_signals(0,c16848e5,178,c1b91f54,dc6e7a80,...) at sleepq_catch_signals+0x360/frame 0xcb182a60 sleepq_wait_sig(dca08d40,5c,c16883c9,100,0,...) at sleepq_wait_sig+0x14/frame 0xcb182a84 _sleep(dca08d40,dca08ed0,15c,c16883c9,0,...) at _sleep+0x386/frame 0xcb182ad8 pipe_read(d87dc498,cb182bb8,dcd48c00,0,dc6e7a80,...) at pipe_read+0x49b/frame 0xcb182b18 dofileread(d87dc498,cb182bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xcb182b48 kern_readv(dc6e7a80,3,cb182bb8,cb182be8,bfbfe7a8,...) at kern_readv+0x93/frame 0xcb182b98 sys_read(dc6e7a80,dc6e7d04,c16733db,4,530d643,...) at sys_read+0x54/frame 0xcb182be8 syscall(cb182ce8) at syscall+0x6ee/frame 0xcb182cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb182cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2824908f, esp = 0xbfbfe734, ebp = 0xbfbfe748 --- Tracing command watchdogd pid 22250 tid 100994 td 0xdc546700 sched_switch(dc546700,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xc92489f0 mi_switch(104,0,c16848e5,22b,dc546700,...) at mi_switch+0x1f3/frame 0xc9248a30 sleepq_switch(dc546700,0,c16848e5,1ca,6c,...) at sleepq_switch+0x110/frame 0xc9248a64 sleepq_catch_signals(dc546700,2,601,c9248ae4,fd8f,...) at sleepq_catch_signals+0x360/frame 0xc9248aa8 sleepq_timedwait_sig(c1b7373e,6c,fd8f,c0000000,3,...) at sleepq_timedwait_sig+0x17/frame 0xc9248ae4 _sleep(c1b7373e,0,16c,c167eb6d,38ade6cd,...) at _sleep+0x31a/frame 0xc9248b38 kern_clock_nanosleep(dc546700,0,0,c9248bc8,c9248bc0,...) at kern_clock_nanosleep+0x1e2/frame 0xc9248ba0 sys_nanosleep(dc546700,dc546984,c16733db,4,0,...) at sys_nanosleep+0x7f/frame 0xc9248be8 syscall(c9248ce8) at syscall+0x6ee/frame 0xc9248cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xc9248cdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x281a30c3, esp = 0xbfbfec64, ebp = 0xbfbfec98 --- Tracing command bash pid 14598 tid 101762 td 0xdf6fd000 sched_switch(df6fd000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xe0331888 mi_switch(104,0,c16848e5,22b,df6fd000,...) at mi_switch+0x1f3/frame 0xe03318c8 sleepq_switch(df6fd000,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xe03318fc sleepq_catch_signals(e0331964,c0c85000,d81ff2a0,0,0,...) at sleepq_catch_signals+0x360/frame 0xe0331940 sleepq_wait_sig(d81ff2a4,0,e0331984,101,0,...) at sleepq_wait_sig+0x14/frame 0xe0331964 _cv_wait_sig(d81ff2a4,d81ff290,c1688143,73d,0,...) at _cv_wait_sig+0x21f/frame 0xe03319a8 seltdwait(ffffffff,0,0,df6fd000,0,...) at seltdwait+0xbb/frame 0xe03319d8 kern_select(df6fd000,1,bfbfe008,0,0,...) at kern_select+0x876/frame 0xe0331b78 sys_pselect(df6fd000,df6fd284,c16733db,4,c1886e6f,...) at sys_pselect+0x166/frame 0xe0331be8 syscall(e0331ce8) at syscall+0x6ee/frame 0xe0331cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xe0331cdc --- syscall (522, FreeBSD ELF32, sys_pselect), eip = 0x282b9093, esp = 0xbfbfdfa8, ebp = 0xbfbfdfd0 --- Tracing command sshd pid 14295 tid 101734 td 0xd80e6a80 sched_switch(d80e6a80,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xe02708b0 mi_switch(104,0,c16848e5,22b,d80e6a80,...) at mi_switch+0x1f3/frame 0xe02708f0 sleepq_switch(d80e6a80,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xe0270924 sleepq_catch_signals(e027098c,c0c85000,de61b060,0,0,...) at sleepq_catch_signals+0x360/frame 0xe0270968 sleepq_wait_sig(de61b064,0,e02709ac,101,0,...) at sleepq_wait_sig+0x14/frame 0xe027098c _cv_wait_sig(de61b064,de61b050,c1688143,73d,1b1,...) at _cv_wait_sig+0x21f/frame 0xe02709d0 seltdwait(ffffffff,0,0,d80e6a80,0,...) at seltdwait+0xbb/frame 0xe0270a00 kern_select(d80e6a80,c,280c30a8,280c30d0,0,...) at kern_select+0x876/frame 0xe0270ba0 sys_select(d80e6a80,d80e6d04,c16733db,4,8,...) at sys_select+0x68/frame 0xe0270be8 syscall(e0270ce8) at syscall+0x6ee/frame 0xe0270cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xe0270cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2855d07f, esp = 0xbfbfa76c, ebp = 0xbfbfa790 --- Tracing command csh pid 14291 tid 101758 td 0xded0d700 sched_switch(ded0d700,0,104,189,c1b81700,...) at sched_switch+0x80c/frame 0xe02e8940 mi_switch(104,0,c16848e5,22b,ded0d700,...) at mi_switch+0x1f3/frame 0xe02e897c sleepq_switch(ded0d700,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xe02e89b0 sleepq_catch_signals(e02e8a18,c0c85000,d7c62214,0,0,...) at sleepq_catch_signals+0x360/frame 0xe02e89f4 sleepq_wait_sig(d7c62274,0,e02e8a38,101,0,...) at sleepq_wait_sig+0x14/frame 0xe02e8a18 _cv_wait_sig(d7c62274,d7c62204,c168a955,5aa,e02e8bb8,...) at _cv_wait_sig+0x21f/frame 0xe02e8a5c tty_wait(d7c62200,d7c62274,e02e8bb8,1,0,...) at tty_wait+0x4b/frame 0xe02e8a80 ttydisc_read(d7c62200,e02e8bb8,0,d2,c1946e5c,...) at ttydisc_read+0x238/frame 0xe02e8ac0 ttydev_read(c96f1600,e02e8bb8,0,ded0d700,e02e8b6c,...) at ttydev_read+0x55/frame 0xe02e8ae0 devfs_read_f(d87dde70,e02e8bb8,df62b600,0,ded0d700,...) at devfs_read_f+0xc5/frame 0xe02e8b18 dofileread(d87dde70,e02e8bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xe02e8b48 kern_readv(ded0d700,10,e02e8bb8,e02e8be8,bfbfe4ca,...) at kern_readv+0x93/frame 0xe02e8b98 sys_read(ded0d700,ded0d984,c16733db,4,c1886e6f,...) at sys_read+0x54/frame 0xe02e8be8 syscall(e02e8ce8) at syscall+0x6ee/frame 0xe02e8cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xe02e8cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282be08f, esp = 0xbfbfe478, ebp = 0xbfbfe48c --- Tracing command sshd pid 10793 tid 100295 td 0xdd3d3a80 sched_switch(dd3d3a80,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xcb3998e0 mi_switch(104,0,c16848e5,22b,dd3d3a80,...) at mi_switch+0x1f3/frame 0xcb399920 sleepq_switch(dd3d3a80,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xcb399954 sleepq_catch_signals(cb3999bc,c0c85000,dfeec120,0,0,...) at sleepq_catch_signals+0x360/frame 0xcb399998 sleepq_wait_sig(dfeec124,0,cb3999dc,101,0,...) at sleepq_wait_sig+0x14/frame 0xcb3999bc _cv_wait_sig(dfeec124,dfeec110,c1688143,73d,0,...) at _cv_wait_sig+0x21f/frame 0xcb399a00 seltdwait(ffffffff,0,0,dd3d3a80,0,...) at seltdwait+0xbb/frame 0xcb399a30 kern_poll(dd3d3a80,bfbfe7f0,1,0,0,...) at kern_poll+0x4ab/frame 0xcb399bb0 sys_poll(dd3d3a80,dd3d3d04,c16733db,4,530d643,...) at sys_poll+0x67/frame 0xcb399be8 syscall(cb399ce8) at syscall+0x6ee/frame 0xcb399cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb399cdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2850031b, esp = 0xbfbfe77c, ebp = 0xbfbfe798 --- Tracing command sh pid 81072 tid 100835 td 0xdf700000 sched_switch(df700000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xe01cb9a8 mi_switch(104,0,c16848e5,22b,df700000,...) at mi_switch+0x1f3/frame 0xe01cb9e8 sleepq_switch(df700000,0,c16848e5,1ca,5c,...) at sleepq_switch+0x110/frame 0xe01cba1c sleepq_catch_signals(0,c16848e5,178,c1b91cd4,df700000,...) at sleepq_catch_signals+0x360/frame 0xe01cba60 sleepq_wait_sig(d87d9350,5c,c16883c9,100,0,...) at sleepq_wait_sig+0x14/frame 0xe01cba84 _sleep(d87d9350,d87d94e0,15c,c16883c9,0,...) at _sleep+0x386/frame 0xe01cbad8 pipe_read(de9fb850,e01cbbb8,dcd48c00,0,df700000,...) at pipe_read+0x49b/frame 0xe01cbb18 dofileread(de9fb850,e01cbbb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xe01cbb48 kern_readv(df700000,0,e01cbbb8,e01cbbe8,bfbfe99f,...) at kern_readv+0x93/frame 0xe01cbb98 sys_read(df700000,df700284,c16733db,4,e01cbc48,...) at sys_read+0x54/frame 0xe01cbbe8 syscall(e01cbce8) at syscall+0x6ee/frame 0xe01cbcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xe01cbcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2824908f, esp = 0xbfbfe93c, ebp = 0xbfbfe950 --- Tracing command awk pid 81070 tid 100425 td 0xde9e0700 sched_switch(de9e0700,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xcb2229a8 mi_switch(104,0,c16848e5,22b,de9e0700,...) at mi_switch+0x1f3/frame 0xcb2229e8 sleepq_switch(de9e0700,0,c16848e5,1ca,5c,...) at sleepq_switch+0x110/frame 0xcb222a1c sleepq_catch_signals(0,c16848e5,178,c1b90714,de9e0700,...) at sleepq_catch_signals+0x360/frame 0xcb222a60 sleepq_wait_sig(d87d94f8,5c,c16883c9,100,0,...) at sleepq_wait_sig+0x14/frame 0xcb222a84 _sleep(d87d94f8,d87d9688,15c,c16883c9,0,...) at _sleep+0x386/frame 0xcb222ad8 pipe_read(d87ddd58,cb222bb8,dcd48c00,0,de9e0700,...) at pipe_read+0x49b/frame 0xcb222b18 dofileread(d87ddd58,cb222bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xcb222b48 kern_readv(de9e0700,0,cb222bb8,cb222be8,28508000,...) at kern_readv+0x93/frame 0xcb222b98 sys_read(de9e0700,de9e0984,c16733db,4,c167d7a2,...) at sys_read+0x54/frame 0xcb222be8 syscall(cb222ce8) at syscall+0x6ee/frame 0xcb222cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb222cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2825508f, esp = 0xbfbfe9a0, ebp = 0xbfbfe9b4 --- Tracing command sh pid 81069 tid 100436 td 0xd80ec380 sched_switch(d80ec380,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xcb385940 mi_switch(104,0,c16848e5,22b,d80ec380,...) at mi_switch+0x1f3/frame 0xcb385980 sleepq_switch(d80ec380,0,c16848e5,1ca,6c,...) at sleepq_switch+0x110/frame 0xcb3859b4 sleepq_catch_signals(0,c16848e5,178,c1b902d4,d80ec380,...) at sleepq_catch_signals+0x360/frame 0xcb3859f8 sleepq_wait_sig(de7a0358,6c,c1688cde,100,0,...) at sleepq_wait_sig+0x14/frame 0xcb385a1c _sleep(de7a0358,de7a0400,36c,c1688cde,0,...) at _sleep+0x386/frame 0xcb385a70 kern_wait6(d80ec380,7,0,0,cb385af4,...) at kern_wait6+0x567/frame 0xcb385ac8 sys_wait4(d80ec380,d80ec604,c16733db,4,0,...) at sys_wait4+0x87/frame 0xcb385be8 syscall(cb385ce8) at syscall+0x6ee/frame 0xcb385cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb385cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281da003, esp = 0xbfbfe9f8, ebp = 0xbfbfea10 --- Tracing command top pid 81065 tid 101211 td 0xdef56a80 sched_switch(def56a80,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xe0117890 mi_switch(104,0,c16848e5,22b,def56a80,...) at mi_switch+0x1f3/frame 0xe01178d0 sleepq_switch(def56a80,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xe0117904 sleepq_catch_signals(8,c1678f47,cb,def56a80,def56a80,...) at sleepq_catch_signals+0x360/frame 0xe0117948 sleepq_timedwait_sig(dd08cb64,0,e01179ac,10000000,0,...) at sleepq_timedwait_sig+0x17/frame 0xe0117988 _cv_timedwait_sig_sbt(dd08cb64,dd08cb50,c1a370eb,fd69,10000000,...) at _cv_timedwait_sig_sbt+0x24a/frame 0xe01179d0 seltdwait(fd69,10000000,0,def56a80,0,...) at seltdwait+0x82/frame 0xe0117a00 kern_select(def56a80,2,bfbfec60,0,0,...) at kern_select+0x876/frame 0xe0117ba0 sys_select(def56a80,def56d04,c16733db,4,c1886e6f,...) at sys_select+0x68/frame 0xe0117be8 syscall(e0117ce8) at syscall+0x6ee/frame 0xe0117cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xe0117cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2829807f, esp = 0xbfbfeb5c, ebp = 0xbfbfeb80 --- Tracing command sh pid 81064 tid 101061 td 0xdc42d000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c16828e4,c0b113e5,c19280bc,c19281a0,e0275460,...) at db_trace_self_wrapper+0x2a/frame 0xe0275428 kdb_backtrace(c1682961,c0d04fff,e0275598,c127c245,c1685471,...) at kdb_backtrace+0x2d/frame 0xe0275490 kdb_reenter(c1685471,244,c0aa9035,aa65e44,700,...) at kdb_reenter+0x2a/frame 0xe02754a0 trap(e02755a4) at trap+0xb5/frame 0xe0275598 calltrap() at calltrap+0x6/frame 0xe0275598 --- trap 0xc, eip = 0xc1266509, esp = 0xe02755e4, ebp = 0xe0275600 --- db_trace_thread(dc42d000,ffffffff,13ca8,18ac5,dc42d000,...) at db_trace_thread+0x29/frame 0xe0275600 _db_stack_trace_all(c0cef54a,0,ffffffff,e0275698,c199a950,...) at _db_stack_trace_all+0xe9/frame 0xe027566c db_command(c199b76c,0,c199b368,c199b76b,60,...) at db_command+0x297/frame 0xe0275720 db_script_exec(c1bf4618,0,e02757c8,e02757bc,c199a950,...) at db_script_exec+0x168/frame 0xe0275790 db_command(c12dca73,e02758a8,c05d4f8d,c167c937,ffff0ff0,...) at db_command+0x297/frame 0xe0275844 db_command_loop(c167c937,ffff0ff0,e027586f,e027586e,c19281a0,...) at db_command_loop+0x50/frame 0xe0275850 db_trap(3,ffff0ff0,c168292b,0,0,...) at db_trap+0x10d/frame 0xe02758a8 kdb_trap(3,ffff0ff0,e02759e4,e0275990,e0275a01,...) at kdb_trap+0x11e/frame 0xe02758e0 trap(e02759e4) at trap+0x817/frame 0xe02759d8 calltrap() at calltrap+0x6/frame 0xe02759d8 --- trap 0x3, eip = 0xc0cef54a, esp = 0xe0275a24, ebp = 0xe0275a30 --- kdb_enter(c167c937,c167c937,0,e0275a84,b,...) at kdb_enter+0x3a/frame 0xe0275a30 vpanic(c12b7617,e0275a84,e0275a84,e0275aa0,c10085d5,...) at vpanic+0x150/frame 0xe0275a64 panic(c12b7617,c1c1de94,c16d29f5,c17,1000004,...) at panic+0x1b/frame 0xe0275a78 vm_page_enqueue(c3aa8234,0,c16d03de,4f3,0,...) at vm_page_enqueue+0xf5/frame 0xe0275aa0 vm_fault_hold(cb7b91c8,284d9000,2,0,0,...) at vm_fault_hold+0x2052/frame 0xe0275b78 vm_fault(cb7b91c8,284d9000,2,0,1,...) at vm_fault+0x83/frame 0xe0275ba0 trap_pfault(284d9950,e0275ce8,d819b380,dd3190b8,e0275c48,...) at trap_pfault+0x109/frame 0xe0275be8 trap(e0275ce8) at trap+0x4d9/frame 0xe0275cdc calltrap() at calltrap+0x6/frame 0xe0275cdc --- trap 0xc, eip = 0x281b3f4b, esp = 0xbfbfe390, ebp = 0xbfbfe3c0 --- Tracing command tail pid 81063 tid 100599 td 0xdcc78700 sched_switch(dcc78700,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd4a2b748 mi_switch(104,0,c16848e5,22b,dcc78700,...) at mi_switch+0x1f3/frame 0xd4a2b788 sleepq_switch(dcc78700,0,c16848e5,1ca,68,...) at sleepq_switch+0x110/frame 0xd4a2b7bc sleepq_catch_signals(dcc78700,2,601,d4a2b83c,fd69,...) at sleepq_catch_signals+0x360/frame 0xd4a2b800 sleepq_timedwait_sig(d7c44200,68,fd69,10000000,0,...) at sleepq_timedwait_sig+0x17/frame 0xd4a2b83c _sleep(d7c44200,d7c44200,168,c1672f21,8a57a942,...) at _sleep+0x31a/frame 0xd4a2b890 kqueue_kevent(0,1,d4a2bbc0,d4a2bb90,0,...) at kqueue_kevent+0x3aa/frame 0xd4a2baf4 kern_kevent_fp(dcc78700,de9fb968,0,1,d4a2bbc0,...) at kern_kevent_fp+0x9d/frame 0xd4a2bb18 kern_kevent(dcc78700,4,0,1,d4a2bbc0,...) at kern_kevent+0xe8/frame 0xd4a2bb68 kern_kevent_generic(d4a2bbc0,c1689693,dcc78984,c0c58320,c0c58370,...) at kern_kevent_generic+0xb4/frame 0xd4a2bbb0 sys_kevent(dcc78700,dcc78984,c16733db,4,c167d7a2,...) at sys_kevent+0x6c/frame 0xd4a2bbe8 syscall(d4a2bce8) at syscall+0x6ee/frame 0xd4a2bcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd4a2bcdc --- syscall (560, FreeBSD ELF32, sys_kevent), eip = 0x281e73c3, esp = 0xbfbfeaa8, ebp = 0xbfbfead0 --- Tracing command sshd pid 81062 tid 100265 td 0xde669000 sched_switch(de669000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xc93428b0 mi_switch(104,0,c16848e5,22b,de669000,...) at mi_switch+0x1f3/frame 0xc93428f0 sleepq_switch(de669000,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xc9342924 sleepq_catch_signals(c934298c,c0c85000,d82e72e0,0,0,...) at sleepq_catch_signals+0x360/frame 0xc9342968 sleepq_wait_sig(d82e72e4,0,c93429ac,101,0,...) at sleepq_wait_sig+0x14/frame 0xc934298c _cv_wait_sig(d82e72e4,d82e72d0,c1688143,73d,1b1,...) at _cv_wait_sig+0x21f/frame 0xc93429d0 seltdwait(ffffffff,0,0,de669000,0,...) at seltdwait+0xbb/frame 0xc9342a00 kern_select(de669000,a,280c30a8,280c30d0,0,...) at kern_select+0x876/frame 0xc9342ba0 sys_select(de669000,de669284,c16733db,4,c167d7a2,...) at sys_select+0x68/frame 0xc9342be8 syscall(c9342ce8) at syscall+0x6ee/frame 0xc9342cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xc9342cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2855d07f, esp = 0xbfbfa76c, ebp = 0xbfbfa790 --- Tracing command sshd pid 81061 tid 101302 td 0xd816f700 sched_switch(d816f700,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xcb2188b0 mi_switch(104,0,c16848e5,22b,d816f700,...) at mi_switch+0x1f3/frame 0xcb2188f0 sleepq_switch(d816f700,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xcb218924 sleepq_catch_signals(cb21898c,c0c85000,df121f20,0,0,...) at sleepq_catch_signals+0x360/frame 0xcb218968 sleepq_wait_sig(df121f24,0,cb2189ac,101,0,...) at sleepq_wait_sig+0x14/frame 0xcb21898c _cv_wait_sig(df121f24,df121f10,c1688143,73d,5cf,...) at _cv_wait_sig+0x21f/frame 0xcb2189d0 seltdwait(ffffffff,0,0,d816f700,0,...) at seltdwait+0xbb/frame 0xcb218a00 kern_select(d816f700,c,280c30a8,280c30d0,0,...) at kern_select+0x876/frame 0xcb218ba0 sys_select(d816f700,d816f984,c16733db,4,c1886e6f,...) at sys_select+0x68/frame 0xcb218be8 syscall(cb218ce8) at syscall+0x6ee/frame 0xcb218cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb218cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2855d07f, esp = 0xbfbfa76c, ebp = 0xbfbfa790 --- Tracing command sshd pid 81060 tid 101301 td 0xdf8c6000 sched_switch(df8c6000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xc92438b0 mi_switch(104,0,c16848e5,22b,df8c6000,...) at mi_switch+0x1f3/frame 0xc92438f0 sleepq_switch(df8c6000,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xc9243924 sleepq_catch_signals(c924398c,c0c85000,d82ddf20,0,0,...) at sleepq_catch_signals+0x360/frame 0xc9243968 sleepq_wait_sig(d82ddf24,0,c92439ac,101,0,...) at sleepq_wait_sig+0x14/frame 0xc924398c _cv_wait_sig(d82ddf24,d82ddf10,c1688143,73d,5cf,...) at _cv_wait_sig+0x21f/frame 0xc92439d0 seltdwait(ffffffff,0,0,df8c6000,0,...) at seltdwait+0xbb/frame 0xc9243a00 kern_select(df8c6000,c,280c30a8,280c30d0,0,...) at kern_select+0x876/frame 0xc9243ba0 sys_select(df8c6000,df8c6284,c16733db,4,c167d7a2,...) at sys_select+0x68/frame 0xc9243be8 syscall(c9243ce8) at syscall+0x6ee/frame 0xc9243cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xc9243cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2855d07f, esp = 0xbfbfa76c, ebp = 0xbfbfa790 --- Tracing command sshd pid 81053 tid 100965 td 0xdd4cfa80 sched_switch(dd4cfa80,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xcb24a8e0 mi_switch(104,0,c16848e5,22b,dd4cfa80,...) at mi_switch+0x1f3/frame 0xcb24a920 sleepq_switch(dd4cfa80,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xcb24a954 sleepq_catch_signals(cb24a9bc,c0c85000,dcc4db20,0,0,...) at sleepq_catch_signals+0x360/frame 0xcb24a998 sleepq_wait_sig(dcc4db24,0,cb24a9dc,101,0,...) at sleepq_wait_sig+0x14/frame 0xcb24a9bc _cv_wait_sig(dcc4db24,dcc4db10,c1688143,73d,0,...) at _cv_wait_sig+0x21f/frame 0xcb24aa00 seltdwait(ffffffff,0,0,dd4cfa80,0,...) at seltdwait+0xbb/frame 0xcb24aa30 kern_poll(dd4cfa80,bfbfe7f0,1,0,0,...) at kern_poll+0x4ab/frame 0xcb24abb0 sys_poll(dd4cfa80,dd4cfd04,c16733db,4,c1886e6f,...) at sys_poll+0x67/frame 0xcb24abe8 syscall(cb24ace8) at syscall+0x6ee/frame 0xcb24acdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb24acdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2850031b, esp = 0xbfbfe77c, ebp = 0xbfbfe798 --- Tracing command sshd pid 81052 tid 101336 td 0xde66a000 sched_switch(de66a000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd4b188e0 mi_switch(104,0,c16848e5,22b,de66a000,...) at mi_switch+0x1f3/frame 0xd4b18920 sleepq_switch(de66a000,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xd4b18954 sleepq_catch_signals(d4b189bc,c0c85000,d82e7320,0,0,...) at sleepq_catch_signals+0x360/frame 0xd4b18998 sleepq_wait_sig(d82e7324,0,d4b189dc,101,0,...) at sleepq_wait_sig+0x14/frame 0xd4b189bc _cv_wait_sig(d82e7324,d82e7310,c1688143,73d,0,...) at _cv_wait_sig+0x21f/frame 0xd4b18a00 seltdwait(ffffffff,0,0,de66a000,0,...) at seltdwait+0xbb/frame 0xd4b18a30 kern_poll(de66a000,bfbfe7f0,1,0,0,...) at kern_poll+0x4ab/frame 0xd4b18bb0 sys_poll(de66a000,de66a284,c16733db,4,c1886e6f,...) at sys_poll+0x67/frame 0xd4b18be8 syscall(d4b18ce8) at syscall+0x6ee/frame 0xd4b18cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd4b18cdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2850031b, esp = 0xbfbfe77c, ebp = 0xbfbfe798 --- Tracing command sshd pid 81051 tid 100443 td 0xdc55d000 sched_switch(dc55d000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xcb29f8e0 mi_switch(104,0,c16848e5,22b,dc55d000,...) at mi_switch+0x1f3/frame 0xcb29f920 sleepq_switch(dc55d000,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xcb29f954 sleepq_catch_signals(cb29f9bc,c0c85000,d7fdbe20,0,0,...) at sleepq_catch_signals+0x360/frame 0xcb29f998 sleepq_wait_sig(d7fdbe24,0,cb29f9dc,101,0,...) at sleepq_wait_sig+0x14/frame 0xcb29f9bc _cv_wait_sig(d7fdbe24,d7fdbe10,c1688143,73d,0,...) at _cv_wait_sig+0x21f/frame 0xcb29fa00 seltdwait(ffffffff,0,0,dc55d000,0,...) at seltdwait+0xbb/frame 0xcb29fa30 kern_poll(dc55d000,bfbfe7f0,1,0,0,...) at kern_poll+0x4ab/frame 0xcb29fbb0 sys_poll(dc55d000,dc55d284,c16733db,4,c1886e6f,...) at sys_poll+0x67/frame 0xcb29fbe8 syscall(cb29fce8) at syscall+0x6ee/frame 0xcb29fcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb29fcdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2850031b, esp = 0xbfbfe77c, ebp = 0xbfbfe798 --- Tracing command bash pid 1056 tid 100193 td 0xdc4faa80 sched_switch(dc4faa80,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xda7d3888 mi_switch(104,0,c16848e5,22b,dc4faa80,...) at mi_switch+0x1f3/frame 0xda7d38c8 sleepq_switch(dc4faa80,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda7d38fc sleepq_catch_signals(da7d3964,c0c85000,d81ffb20,0,0,...) at sleepq_catch_signals+0x360/frame 0xda7d3940 sleepq_wait_sig(d81ffb24,0,da7d3984,101,0,...) at sleepq_wait_sig+0x14/frame 0xda7d3964 _cv_wait_sig(d81ffb24,d81ffb10,c1688143,73d,0,...) at _cv_wait_sig+0x21f/frame 0xda7d39a8 seltdwait(ffffffff,0,0,dc4faa80,0,...) at seltdwait+0xbb/frame 0xda7d39d8 kern_select(dc4faa80,1,bfbfde08,0,0,...) at kern_select+0x876/frame 0xda7d3b78 sys_pselect(dc4faa80,dc4fad04,c16733db,4,530d643,...) at sys_pselect+0x166/frame 0xda7d3be8 syscall(da7d3ce8) at syscall+0x6ee/frame 0xda7d3cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xda7d3cdc --- syscall (522, FreeBSD ELF32, sys_pselect), eip = 0x282b9093, esp = 0xbfbfdda8, ebp = 0xbfbfddd0 --- Tracing command csh pid 1054 tid 100184 td 0xdc4b2700 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c16828e4,c0b113e5,c19280bc,c19281a0,e0275460,...) at db_trace_self_wrapper+0x2a/frame 0xe0275428 kdb_backtrace(c1682961,c0d04fff,e0275598,c127c245,c1685471,...) at kdb_backtrace+0x2d/frame 0xe0275490 kdb_reenter(c1685471,244,c0aa9035,aa65e44,700,...) at kdb_reenter+0x2a/frame 0xe02754a0 trap(e02755a4) at trap+0xb5/frame 0xe0275598 calltrap() at calltrap+0x6/frame 0xe0275598 --- trap 0xc, eip = 0xc1266509, esp = 0xe02755e4, ebp = 0xe0275600 --- db_trace_thread(dc4b2700,ffffffff,41e,18758,dc4b2700,...) at db_trace_thread+0x29/frame 0xe0275600 _db_stack_trace_all(c0cef54a,0,ffffffff,e0275698,c199a950,...) at _db_stack_trace_all+0xe9/frame 0xe027566c db_command(c199b76c,0,c199b368,c199b76b,60,...) at db_command+0x297/frame 0xe0275720 db_script_exec(c1bf4618,0,e02757c8,e02757bc,c199a950,...) at db_script_exec+0x168/frame 0xe0275790 db_command(c12dca73,e02758a8,c05d4f8d,c167c937,ffff0ff0,...) at db_command+0x297/frame 0xe0275844 db_command_loop(c167c937,ffff0ff0,e027586f,e027586e,c19281a0,...) at db_command_loop+0x50/frame 0xe0275850 db_trap(3,ffff0ff0,c168292b,0,0,...) at db_trap+0x10d/frame 0xe02758a8 kdb_trap(3,ffff0ff0,e02759e4,e0275990,e0275a01,...) at kdb_trap+0x11e/frame 0xe02758e0 trap(e02759e4) at trap+0x817/frame 0xe02759d8 calltrap() at calltrap+0x6/frame 0xe02759d8 --- trap 0x3, eip = 0xc0cef54a, esp = 0xe0275a24, ebp = 0xe0275a30 --- kdb_enter(c167c937,c167c937,0,e0275a84,b,...) at kdb_enter+0x3a/frame 0xe0275a30 vpanic(c12b7617,e0275a84,e0275a84,e0275aa0,c10085d5,...) at vpanic+0x150/frame 0xe0275a64 panic(c12b7617,c1c1de94,c16d29f5,c17,1000004,...) at panic+0x1b/frame 0xe0275a78 vm_page_enqueue(c3aa8234,0,c16d03de,4f3,0,...) at vm_page_enqueue+0xf5/frame 0xe0275aa0 vm_fault_hold(cb7b91c8,284d9000,2,0,0,...) at vm_fault_hold+0x2052/frame 0xe0275b78 vm_fault(cb7b91c8,284d9000,2,0,1,...) at vm_fault+0x83/frame 0xe0275ba0 trap_pfault(284d9950,e0275ce8,d819b380,dd3190b8,e0275c48,...) at trap_pfault+0x109/frame 0xe0275be8 trap(e0275ce8) at trap+0x4d9/frame 0xe0275cdc calltrap() at calltrap+0x6/frame 0xe0275cdc --- trap 0xc, eip = 0x281b3f4b, esp = 0xbfbfe390, ebp = 0xbfbfe3c0 --- Tracing command su pid 1053 tid 100103 td 0xd7fd5a80 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c16828e4,c0b113e5,c19280bc,c19281a0,e0275460,...) at db_trace_self_wrapper+0x2a/frame 0xe0275428 kdb_backtrace(c1682961,c0d04fff,e0275598,c127c245,c1685471,...) at kdb_backtrace+0x2d/frame 0xe0275490 kdb_reenter(c1685471,244,c0aa9035,aa65e44,700,...) at kdb_reenter+0x2a/frame 0xe02754a0 trap(e02755a4) at trap+0xb5/frame 0xe0275598 calltrap() at calltrap+0x6/frame 0xe0275598 --- trap 0xc, eip = 0xc1266509, esp = 0xe02755e4, ebp = 0xe0275600 --- db_trace_thread(d7fd5a80,ffffffff,41d,18707,d7fd5a80,...) at db_trace_thread+0x29/frame 0xe0275600 _db_stack_trace_all(c0cef54a,0,ffffffff,e0275698,c199a950,...) at _db_stack_trace_all+0xe9/frame 0xe027566c db_command(c199b76c,0,c199b368,c199b76b,60,...) at db_command+0x297/frame 0xe0275720 db_script_exec(c1bf4618,0,e02757c8,e02757bc,c199a950,...) at db_script_exec+0x168/frame 0xe0275790 db_command(c12dca73,e02758a8,c05d4f8d,c167c937,ffff0ff0,...) at db_command+0x297/frame 0xe0275844 db_command_loop(c167c937,ffff0ff0,e027586f,e027586e,c19281a0,...) at db_command_loop+0x50/frame 0xe0275850 db_trap(3,ffff0ff0,c168292b,0,0,...) at db_trap+0x10d/frame 0xe02758a8 kdb_trap(3,ffff0ff0,e02759e4,e0275990,e0275a01,...) at kdb_trap+0x11e/frame 0xe02758e0 trap(e02759e4) at trap+0x817/frame 0xe02759d8 calltrap() at calltrap+0x6/frame 0xe02759d8 --- trap 0x3, eip = 0xc0cef54a, esp = 0xe0275a24, ebp = 0xe0275a30 --- kdb_enter(c167c937,c167c937,0,e0275a84,b,...) at kdb_enter+0x3a/frame 0xe0275a30 vpanic(c12b7617,e0275a84,e0275a84,e0275aa0,c10085d5,...) at vpanic+0x150/frame 0xe0275a64 panic(c12b7617,c1c1de94,c16d29f5,c17,1000004,...) at panic+0x1b/frame 0xe0275a78 vm_page_enqueue(c3aa8234,0,c16d03de,4f3,0,...) at vm_page_enqueue+0xf5/frame 0xe0275aa0 vm_fault_hold(cb7b91c8,284d9000,2,0,0,...) at vm_fault_hold+0x2052/frame 0xe0275b78 vm_fault(cb7b91c8,284d9000,2,0,1,...) at vm_fault+0x83/frame 0xe0275ba0 trap_pfault(284d9950,e0275ce8,d819b380,dd3190b8,e0275c48,...) at trap_pfault+0x109/frame 0xe0275be8 trap(e0275ce8) at trap+0x4d9/frame 0xe0275cdc calltrap() at calltrap+0x6/frame 0xe0275cdc --- trap 0xc, eip = 0x281b3f4b, esp = 0xbfbfe390, ebp = 0xbfbfe3c0 --- Tracing command bash pid 1045 tid 100194 td 0xdc4fa700 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c16828e4,c0b113e5,c19280bc,c19281a0,e0275460,...) at db_trace_self_wrapper+0x2a/frame 0xe0275428 kdb_backtrace(c1682961,c0d04fff,e0275598,c127c245,c1685471,...) at kdb_backtrace+0x2d/frame 0xe0275490 kdb_reenter(c1685471,244,c0aa9035,aa65e44,700,...) at kdb_reenter+0x2a/frame 0xe02754a0 trap(e02755a4) at trap+0xb5/frame 0xe0275598 calltrap() at calltrap+0x6/frame 0xe0275598 --- trap 0xc, eip = 0xc1266509, esp = 0xe02755e4, ebp = 0xe0275600 --- db_trace_thread(dc4fa700,ffffffff,415,18762,dc4fa700,...) at db_trace_thread+0x29/frame 0xe0275600 _db_stack_trace_all(c0cef54a,0,ffffffff,e0275698,c199a950,...) at _db_stack_trace_all+0xe9/frame 0xe027566c db_command(c199b76c,0,c199b368,c199b76b,60,...) at db_command+0x297/frame 0xe0275720 db_script_exec(c1bf4618,0,e02757c8,e02757bc,c199a950,...) at db_script_exec+0x168/frame 0xe0275790 db_command(c12dca73,e02758a8,c05d4f8d,c167c937,ffff0ff0,...) at db_command+0x297/frame 0xe0275844 db_command_loop(c167c937,ffff0ff0,e027586f,e027586e,c19281a0,...) at db_command_loop+0x50/frame 0xe0275850 db_trap(3,ffff0ff0,c168292b,0,0,...) at db_trap+0x10d/frame 0xe02758a8 kdb_trap(3,ffff0ff0,e02759e4,e0275990,e0275a01,...) at kdb_trap+0x11e/frame 0xe02758e0 trap(e02759e4) at trap+0x817/frame 0xe02759d8 calltrap() at calltrap+0x6/frame 0xe02759d8 --- trap 0x3, eip = 0xc0cef54a, esp = 0xe0275a24, ebp = 0xe0275a30 --- kdb_enter(c167c937,c167c937,0,e0275a84,b,...) at kdb_enter+0x3a/frame 0xe0275a30 vpanic(c12b7617,e0275a84,e0275a84,e0275aa0,c10085d5,...) at vpanic+0x150/frame 0xe0275a64 panic(c12b7617,c1c1de94,c16d29f5,c17,1000004,...) at panic+0x1b/frame 0xe0275a78 vm_page_enqueue(c3aa8234,0,c16d03de,4f3,0,...) at vm_page_enqueue+0xf5/frame 0xe0275aa0 vm_fault_hold(cb7b91c8,284d9000,2,0,0,...) at vm_fault_hold+0x2052/frame 0xe0275b78 vm_fault(cb7b91c8,284d9000,2,0,1,...) at vm_fault+0x83/frame 0xe0275ba0 trap_pfault(284d9950,e0275ce8,d819b380,dd3190b8,e0275c48,...) at trap_pfault+0x109/frame 0xe0275be8 trap(e0275ce8) at trap+0x4d9/frame 0xe0275cdc calltrap() at calltrap+0x6/frame 0xe0275cdc --- trap 0xc, eip = 0x281b3f4b, esp = 0xbfbfe390, ebp = 0xbfbfe3c0 --- Tracing command sshd pid 1044 tid 100195 td 0xdc4fa380 sched_switch(dc4fa380,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xda7ff8b0 mi_switch(104,0,c16848e5,22b,dc4fa380,...) at mi_switch+0x1f3/frame 0xda7ff8f0 sleepq_switch(dc4fa380,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda7ff924 sleepq_catch_signals(da7ff98c,c0c85000,d8200a60,0,0,...) at sleepq_catch_signals+0x360/frame 0xda7ff968 sleepq_wait_sig(d8200a64,0,da7ff9ac,101,0,...) at sleepq_wait_sig+0x14/frame 0xda7ff98c _cv_wait_sig(d8200a64,d8200a50,c1688143,73d,1b1,...) at _cv_wait_sig+0x21f/frame 0xda7ff9d0 seltdwait(ffffffff,0,0,dc4fa380,0,...) at seltdwait+0xbb/frame 0xda7ffa00 kern_select(dc4fa380,c,280c30a8,280c30d0,0,...) at kern_select+0x876/frame 0xda7ffba0 sys_select(dc4fa380,dc4fa604,c16733db,4,c1886e6f,...) at sys_select+0x68/frame 0xda7ffbe8 syscall(da7ffce8) at syscall+0x6ee/frame 0xda7ffcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xda7ffcdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2855d07f, esp = 0xbfbfa76c, ebp = 0xbfbfa790 --- Tracing command sshd pid 1042 tid 100174 td 0xdc345700 sched_switch(dc345700,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xda76e8e0 mi_switch(104,0,c16848e5,22b,dc345700,...) at mi_switch+0x1f3/frame 0xda76e920 sleepq_switch(dc345700,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda76e954 sleepq_catch_signals(da76e9bc,c0c85000,d8200aa0,0,0,...) at sleepq_catch_signals+0x360/frame 0xda76e998 sleepq_wait_sig(d8200aa4,0,da76e9dc,101,0,...) at sleepq_wait_sig+0x14/frame 0xda76e9bc _cv_wait_sig(d8200aa4,d8200a90,c1688143,73d,0,...) at _cv_wait_sig+0x21f/frame 0xda76ea00 seltdwait(ffffffff,0,0,dc345700,0,...) at seltdwait+0xbb/frame 0xda76ea30 kern_poll(dc345700,bfbfe7f0,1,0,0,...) at kern_poll+0x4ab/frame 0xda76ebb0 sys_poll(dc345700,dc345984,c16733db,4,c1886e6f,...) at sys_poll+0x67/frame 0xda76ebe8 syscall(da76ece8) at syscall+0x6ee/frame 0xda76ecdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xda76ecdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2850031b, esp = 0xbfbfe77c, ebp = 0xbfbfe798 --- Tracing command login pid 781 tid 100191 td 0xdc4fb380 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c16828e4,c0b113e5,c19280bc,c19281a0,e0275460,...) at db_trace_self_wrapper+0x2a/frame 0xe0275428 kdb_backtrace(c1682961,c0d04fff,e0275598,c127c245,c1685471,...) at kdb_backtrace+0x2d/frame 0xe0275490 kdb_reenter(c1685471,244,c0aa9035,aa65e44,700,...) at kdb_reenter+0x2a/frame 0xe02754a0 trap(e02755a4) at trap+0xb5/frame 0xe0275598 calltrap() at calltrap+0x6/frame 0xe0275598 --- trap 0xc, eip = 0xc1266509, esp = 0xe02755e4, ebp = 0xe0275600 --- db_trace_thread(dc4fb380,ffffffff,30d,1875f,dc4fb380,...) at db_trace_thread+0x29/frame 0xe0275600 _db_stack_trace_all(c0cef54a,0,ffffffff,e0275698,c199a950,...) at _db_stack_trace_all+0xe9/frame 0xe027566c db_command(c199b76c,0,c199b368,c199b76b,60,...) at db_command+0x297/frame 0xe0275720 db_script_exec(c1bf4618,0,e02757c8,e02757bc,c199a950,...) at db_script_exec+0x168/frame 0xe0275790 db_command(c12dca73,e02758a8,c05d4f8d,c167c937,ffff0ff0,...) at db_command+0x297/frame 0xe0275844 db_command_loop(c167c937,ffff0ff0,e027586f,e027586e,c19281a0,...) at db_command_loop+0x50/frame 0xe0275850 db_trap(3,ffff0ff0,c168292b,0,0,...) at db_trap+0x10d/frame 0xe02758a8 kdb_trap(3,ffff0ff0,e02759e4,e0275990,e0275a01,...) at kdb_trap+0x11e/frame 0xe02758e0 trap(e02759e4) at trap+0x817/frame 0xe02759d8 calltrap() at calltrap+0x6/frame 0xe02759d8 --- trap 0x3, eip = 0xc0cef54a, esp = 0xe0275a24, ebp = 0xe0275a30 --- kdb_enter(c167c937,c167c937,0,e0275a84,b,...) at kdb_enter+0x3a/frame 0xe0275a30 vpanic(c12b7617,e0275a84,e0275a84,e0275aa0,c10085d5,...) at vpanic+0x150/frame 0xe0275a64 panic(c12b7617,c1c1de94,c16d29f5,c17,1000004,...) at panic+0x1b/frame 0xe0275a78 vm_page_enqueue(c3aa8234,0,c16d03de,4f3,0,...) at vm_page_enqueue+0xf5/frame 0xe0275aa0 vm_fault_hold(cb7b91c8,284d9000,2,0,0,...) at vm_fault_hold+0x2052/frame 0xe0275b78 vm_fault(cb7b91c8,284d9000,2,0,1,...) at vm_fault+0x83/frame 0xe0275ba0 trap_pfault(284d9950,e0275ce8,d819b380,dd3190b8,e0275c48,...) at trap_pfault+0x109/frame 0xe0275be8 trap(e0275ce8) at trap+0x4d9/frame 0xe0275cdc calltrap() at calltrap+0x6/frame 0xe0275cdc --- trap 0xc, eip = 0x281b3f4b, esp = 0xbfbfe390, ebp = 0xbfbfe3c0 --- Tracing command getty pid 780 tid 100190 td 0xdc4fb700 sched_switch(dc4fb700,0,104,189,c1b80980,...) at sched_switch+0x80c/frame 0xda7c4940 mi_switch(104,0,c16848e5,22b,dc4fb700,...) at mi_switch+0x1f3/frame 0xda7c497c sleepq_switch(dc4fb700,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda7c49b0 sleepq_catch_signals(da7c4a18,c0c85000,c9605a14,0,0,...) at sleepq_catch_signals+0x360/frame 0xda7c49f4 sleepq_wait_sig(c9605a74,0,da7c4a38,101,0,...) at sleepq_wait_sig+0x14/frame 0xda7c4a18 _cv_wait_sig(c9605a74,c9605a04,c168a955,5aa,da7c4bb8,...) at _cv_wait_sig+0x21f/frame 0xda7c4a5c tty_wait(c9605a00,c9605a74,da7c4bb8,1,0,...) at tty_wait+0x4b/frame 0xda7c4a80 ttydisc_read(c9605a00,da7c4bb8,0,d2,c1946e5c,...) at ttydisc_read+0x238/frame 0xda7c4ac0 ttydev_read(d853d600,da7c4bb8,0,dc4fb700,da7c4b6c,...) at ttydev_read+0x55/frame 0xda7c4ae0 devfs_read_f(d87ddf18,da7c4bb8,d7edda00,0,dc4fb700,...) at devfs_read_f+0xc5/frame 0xda7c4b18 dofileread(d87ddf18,da7c4bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xda7c4b48 kern_readv(dc4fb700,0,da7c4bb8,da7c4be8,bfbfed61,...) at kern_readv+0x93/frame 0xda7c4b98 sys_read(dc4fb700,dc4fb984,c16733db,4,530d643,...) at sys_read+0x54/frame 0xda7c4be8 syscall(da7c4ce8) at syscall+0x6ee/frame 0xda7c4cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xda7c4cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2821508f, esp = 0xbfbfed34, ebp = 0xbfbfed48 --- Tracing command getty pid 779 tid 100189 td 0xdc4fba80 sched_switch(dc4fba80,0,104,189,c1b81700,...) at sched_switch+0x80c/frame 0xda7bf940 mi_switch(104,0,c16848e5,22b,dc4fba80,...) at mi_switch+0x1f3/frame 0xda7bf97c sleepq_switch(dc4fba80,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda7bf9b0 sleepq_catch_signals(da7bfa18,c0c85000,c9605c14,0,0,...) at sleepq_catch_signals+0x360/frame 0xda7bf9f4 sleepq_wait_sig(c9605c74,0,da7bfa38,101,0,...) at sleepq_wait_sig+0x14/frame 0xda7bfa18 _cv_wait_sig(c9605c74,c9605c04,c168a955,5aa,da7bfbb8,...) at _cv_wait_sig+0x21f/frame 0xda7bfa5c tty_wait(c9605c00,c9605c74,da7bfbb8,1,0,...) at tty_wait+0x4b/frame 0xda7bfa80 ttydisc_read(c9605c00,da7bfbb8,0,d2,c1946e5c,...) at ttydisc_read+0x238/frame 0xda7bfac0 ttydev_read(d853d700,da7bfbb8,0,dc4fba80,da7bfb6c,...) at ttydev_read+0x55/frame 0xda7bfae0 devfs_read_f(d87972a0,da7bfbb8,d8199700,0,dc4fba80,...) at devfs_read_f+0xc5/frame 0xda7bfb18 dofileread(d87972a0,da7bfbb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xda7bfb48 kern_readv(dc4fba80,0,da7bfbb8,da7bfbe8,bfbfed61,...) at kern_readv+0x93/frame 0xda7bfb98 sys_read(dc4fba80,dc4fbd04,c16733db,4,530d643,...) at sys_read+0x54/frame 0xda7bfbe8 syscall(da7bfce8) at syscall+0x6ee/frame 0xda7bfcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xda7bfcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2821508f, esp = 0xbfbfed34, ebp = 0xbfbfed48 --- Tracing command getty pid 778 tid 100188 td 0xdc4fc000 sched_switch(dc4fc000,0,104,189,c1b81700,...) at sched_switch+0x80c/frame 0xda7ba940 mi_switch(104,0,c16848e5,22b,dc4fc000,...) at mi_switch+0x1f3/frame 0xda7ba97c sleepq_switch(dc4fc000,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda7ba9b0 sleepq_catch_signals(da7baa18,c0c85000,c9605e14,0,0,...) at sleepq_catch_signals+0x360/frame 0xda7ba9f4 sleepq_wait_sig(c9605e74,0,da7baa38,101,0,...) at sleepq_wait_sig+0x14/frame 0xda7baa18 _cv_wait_sig(c9605e74,c9605e04,c168a955,5aa,da7babb8,...) at _cv_wait_sig+0x21f/frame 0xda7baa5c tty_wait(c9605e00,c9605e74,da7babb8,1,0,...) at tty_wait+0x4b/frame 0xda7baa80 ttydisc_read(c9605e00,da7babb8,0,d2,c1946e5c,...) at ttydisc_read+0x238/frame 0xda7baac0 ttydev_read(d853d800,da7babb8,0,dc4fc000,da7bab6c,...) at ttydev_read+0x55/frame 0xda7baae0 devfs_read_f(d87dde38,da7babb8,d819a000,0,dc4fc000,...) at devfs_read_f+0xc5/frame 0xda7bab18 dofileread(d87dde38,da7babb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xda7bab48 kern_readv(dc4fc000,0,da7babb8,da7babe8,bfbfed61,...) at kern_readv+0x93/frame 0xda7bab98 sys_read(dc4fc000,dc4fc284,c16733db,4,c1886e6f,...) at sys_read+0x54/frame 0xda7babe8 syscall(da7bace8) at syscall+0x6ee/frame 0xda7bacdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xda7bacdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2821508f, esp = 0xbfbfed34, ebp = 0xbfbfed48 --- Tracing command getty pid 777 tid 100187 td 0xd8226700 sched_switch(d8226700,0,104,189,c1b81700,...) at sched_switch+0x80c/frame 0xda7b5940 mi_switch(104,0,c16848e5,22b,d8226700,...) at mi_switch+0x1f3/frame 0xda7b597c sleepq_switch(d8226700,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda7b59b0 sleepq_catch_signals(da7b5a18,c0c85000,c9606014,0,0,...) at sleepq_catch_signals+0x360/frame 0xda7b59f4 sleepq_wait_sig(c9606074,0,da7b5a38,101,0,...) at sleepq_wait_sig+0x14/frame 0xda7b5a18 _cv_wait_sig(c9606074,c9606004,c168a955,5aa,da7b5bb8,...) at _cv_wait_sig+0x21f/frame 0xda7b5a5c tty_wait(c9606000,c9606074,da7b5bb8,1,0,...) at tty_wait+0x4b/frame 0xda7b5a80 ttydisc_read(c9606000,da7b5bb8,0,d2,c1946e5c,...) at ttydisc_read+0x238/frame 0xda7b5ac0 ttydev_read(d853d900,da7b5bb8,0,d8226700,da7b5b6c,...) at ttydev_read+0x55/frame 0xda7b5ae0 devfs_read_f(d87c4a10,da7b5bb8,cb782200,0,d8226700,...) at devfs_read_f+0xc5/frame 0xda7b5b18 dofileread(d87c4a10,da7b5bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xda7b5b48 kern_readv(d8226700,0,da7b5bb8,da7b5be8,bfbfed61,...) at kern_readv+0x93/frame 0xda7b5b98 sys_read(d8226700,d8226984,c16733db,4,c1886e6f,...) at sys_read+0x54/frame 0xda7b5be8 syscall(da7b5ce8) at syscall+0x6ee/frame 0xda7b5cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xda7b5cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2821508f, esp = 0xbfbfed34, ebp = 0xbfbfed48 --- Tracing command getty pid 776 tid 100186 td 0xd8226a80 sched_switch(d8226a80,0,104,189,c1b80980,...) at sched_switch+0x80c/frame 0xda7b0940 mi_switch(104,0,c16848e5,22b,d8226a80,...) at mi_switch+0x1f3/frame 0xda7b097c sleepq_switch(d8226a80,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda7b09b0 sleepq_catch_signals(da7b0a18,c0c85000,c9606214,0,0,...) at sleepq_catch_signals+0x360/frame 0xda7b09f4 sleepq_wait_sig(c9606274,0,da7b0a38,101,0,...) at sleepq_wait_sig+0x14/frame 0xda7b0a18 _cv_wait_sig(c9606274,c9606204,c168a955,5aa,da7b0bb8,...) at _cv_wait_sig+0x21f/frame 0xda7b0a5c tty_wait(c9606200,c9606274,da7b0bb8,1,0,...) at tty_wait+0x4b/frame 0xda7b0a80 ttydisc_read(c9606200,da7b0bb8,0,d2,c1946e5c,...) at ttydisc_read+0x238/frame 0xda7b0ac0 ttydev_read(d853da00,da7b0bb8,0,d8226a80,da7b0b6c,...) at ttydev_read+0x55/frame 0xda7b0ae0 devfs_read_f(d87de038,da7b0bb8,d8198e00,0,d8226a80,...) at devfs_read_f+0xc5/frame 0xda7b0b18 dofileread(d87de038,da7b0bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xda7b0b48 kern_readv(d8226a80,0,da7b0bb8,da7b0be8,bfbfed61,...) at kern_readv+0x93/frame 0xda7b0b98 sys_read(d8226a80,d8226d04,c16733db,4,c1886e6f,...) at sys_read+0x54/frame 0xda7b0be8 syscall(da7b0ce8) at syscall+0x6ee/frame 0xda7b0cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xda7b0cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2821508f, esp = 0xbfbfed34, ebp = 0xbfbfed48 --- Tracing command getty pid 775 tid 100110 td 0xd80ee700 sched_switch(d80ee700,0,104,189,c1b81040,...) at sched_switch+0x80c/frame 0xdbad4940 mi_switch(104,0,c16848e5,22b,d80ee700,...) at mi_switch+0x1f3/frame 0xdbad497c sleepq_switch(d80ee700,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xdbad49b0 sleepq_catch_signals(dbad4a18,c0c85000,c9606414,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbad49f4 sleepq_wait_sig(c9606474,0,dbad4a38,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbad4a18 _cv_wait_sig(c9606474,c9606404,c168a955,5aa,dbad4bb8,...) at _cv_wait_sig+0x21f/frame 0xdbad4a5c tty_wait(c9606400,c9606474,dbad4bb8,1,0,...) at tty_wait+0x4b/frame 0xdbad4a80 ttydisc_read(c9606400,dbad4bb8,0,d2,c1946e5c,...) at ttydisc_read+0x238/frame 0xdbad4ac0 ttydev_read(d853db00,dbad4bb8,0,d80ee700,dbad4b6c,...) at ttydev_read+0x55/frame 0xdbad4ae0 devfs_read_f(d87de0e0,dbad4bb8,cb782100,0,d80ee700,...) at devfs_read_f+0xc5/frame 0xdbad4b18 dofileread(d87de0e0,dbad4bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xdbad4b48 kern_readv(d80ee700,0,dbad4bb8,dbad4be8,bfbfed61,...) at kern_readv+0x93/frame 0xdbad4b98 sys_read(d80ee700,d80ee984,c16733db,4,c1886e6f,...) at sys_read+0x54/frame 0xdbad4be8 syscall(dbad4ce8) at syscall+0x6ee/frame 0xdbad4cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdbad4cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2821508f, esp = 0xbfbfed34, ebp = 0xbfbfed48 --- Tracing command getty pid 774 tid 100173 td 0xdc42e000 sched_switch(dc42e000,0,104,189,c1b81040,...) at sched_switch+0x80c/frame 0xda769940 mi_switch(104,0,c16848e5,22b,dc42e000,...) at mi_switch+0x1f3/frame 0xda76997c sleepq_switch(dc42e000,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda7699b0 sleepq_catch_signals(da769a18,c0c85000,c9606614,0,0,...) at sleepq_catch_signals+0x360/frame 0xda7699f4 sleepq_wait_sig(c9606674,0,da769a38,101,0,...) at sleepq_wait_sig+0x14/frame 0xda769a18 _cv_wait_sig(c9606674,c9606604,c168a955,5aa,da769bb8,...) at _cv_wait_sig+0x21f/frame 0xda769a5c tty_wait(c9606600,c9606674,da769bb8,1,0,...) at tty_wait+0x4b/frame 0xda769a80 ttydisc_read(c9606600,da769bb8,0,d2,c1946e5c,...) at ttydisc_read+0x238/frame 0xda769ac0 ttydev_read(c96f4200,da769bb8,0,dc42e000,da769b6c,...) at ttydev_read+0x55/frame 0xda769ae0 devfs_read_f(d87de000,da769bb8,d7edd600,0,dc42e000,...) at devfs_read_f+0xc5/frame 0xda769b18 dofileread(d87de000,da769bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xda769b48 kern_readv(dc42e000,0,da769bb8,da769be8,bfbfed61,...) at kern_readv+0x93/frame 0xda769b98 sys_read(dc42e000,dc42e284,c16733db,4,c1886e6f,...) at sys_read+0x54/frame 0xda769be8 syscall(da769ce8) at syscall+0x6ee/frame 0xda769cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xda769cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2821508f, esp = 0xbfbfed34, ebp = 0xbfbfed48 --- Tracing command getty pid 773 tid 100185 td 0xdc4b2380 sched_switch(dc4b2380,0,104,189,c1b81700,...) at sched_switch+0x80c/frame 0xda7ab940 mi_switch(104,0,c16848e5,22b,dc4b2380,...) at mi_switch+0x1f3/frame 0xda7ab97c sleepq_switch(dc4b2380,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda7ab9b0 sleepq_catch_signals(da7aba18,c0c85000,c9606814,0,0,...) at sleepq_catch_signals+0x360/frame 0xda7ab9f4 sleepq_wait_sig(c9606874,0,da7aba38,101,0,...) at sleepq_wait_sig+0x14/frame 0xda7aba18 _cv_wait_sig(c9606874,c9606804,c168a955,5aa,da7abbb8,...) at _cv_wait_sig+0x21f/frame 0xda7aba5c tty_wait(c9606800,c9606874,da7abbb8,1,0,...) at tty_wait+0x4b/frame 0xda7aba80 ttydisc_read(c9606800,da7abbb8,0,d2,c1946e5c,...) at ttydisc_read+0x238/frame 0xda7abac0 ttydev_read(c96f4300,da7abbb8,0,dc4b2380,da7abb6c,...) at ttydev_read+0x55/frame 0xda7abae0 devfs_read_f(d87de1c0,da7abbb8,cb782300,0,dc4b2380,...) at devfs_read_f+0xc5/frame 0xda7abb18 dofileread(d87de1c0,da7abbb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xda7abb48 kern_readv(dc4b2380,0,da7abbb8,da7abbe8,bfbfed61,...) at kern_readv+0x93/frame 0xda7abb98 sys_read(dc4b2380,dc4b2604,c16733db,4,c1886e6f,...) at sys_read+0x54/frame 0xda7abbe8 syscall(da7abce8) at syscall+0x6ee/frame 0xda7abcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xda7abcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2821508f, esp = 0xbfbfed34, ebp = 0xbfbfed48 --- Tracing command inetd pid 756 tid 100180 td 0xdc342a80 sched_switch(dc342a80,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xda7928b0 mi_switch(104,0,c16848e5,22b,dc342a80,...) at mi_switch+0x1f3/frame 0xda7928f0 sleepq_switch(dc342a80,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda792924 sleepq_catch_signals(da79298c,c0c85000,d8200ae0,0,0,...) at sleepq_catch_signals+0x360/frame 0xda792968 sleepq_wait_sig(d8200ae4,0,da7929ac,101,0,...) at sleepq_wait_sig+0x14/frame 0xda79298c _cv_wait_sig(d8200ae4,d8200ad0,c1688143,73d,dbf02a00,...) at _cv_wait_sig+0x21f/frame 0xda7929d0 seltdwait(ffffffff,0,0,dc342a80,0,...) at seltdwait+0xbb/frame 0xda792a00 kern_select(dc342a80,9,bfbfe5c0,0,0,...) at kern_select+0x876/frame 0xda792ba0 sys_select(dc342a80,dc342d04,c16733db,4,c1b81050,...) at sys_select+0x68/frame 0xda792be8 syscall(da792ce8) at syscall+0x6ee/frame 0xda792cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xda792cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2822807f, esp = 0xbfbfdfec, ebp = 0xbfbfe010 --- Tracing command nfscbd pid 722 tid 100175 td 0xdc345380 sched_switch(dc345380,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xda7737e8 mi_switch(104,0,c16848e5,22b,dc345380,...) at mi_switch+0x1f3/frame 0xda773828 sleepq_switch(dc345380,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda77385c sleepq_catch_signals(8,c1678f47,cb,dc345380,dc345380,...) at sleepq_catch_signals+0x360/frame 0xda7738a0 sleepq_timedwait_sig(d7c18150,0,da773904,0,0,...) at sleepq_timedwait_sig+0x17/frame 0xda7738e0 _cv_timedwait_sig_sbt(d7c18150,d7f2e0c0,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x24a/frame 0xda773928 svc_run_internal(c0f656a0,d7f2e0c0,dc494358,da773a30,0,...) at svc_run_internal+0xb2c/frame 0xda773a04 svc_run(d7f2e000,0,c165fd42,f5,da773ad0,...) at svc_run+0x1ed/frame 0xda773a58 nfscbd_nfsd(dc345380,da773b30,4,c0cb66d0,0,...) at nfscbd_nfsd+0x105/frame 0xda773af8 nfssvc_nfscl(dc345380,dc345604,0,dc345380,da773cdc,...) at nfssvc_nfscl+0x279/frame 0xda773bd0 sys_nfssvc(dc345380,dc345604,c16733db,4,da773c48,...) at sys_nfssvc+0xa6/frame 0xda773be8 syscall(da773ce8) at syscall+0x6ee/frame 0xda773cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xda773cdc --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280c10bf, esp = 0xbfbfeb0c, ebp = 0xbfbfee28 --- Tracing command nfscbd pid 722 tid 100176 td 0xdc42da80 sched_switch(dc42da80,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xda778aa8 mi_switch(104,0,c16848e5,22b,dc42da80,...) at mi_switch+0x1f3/frame 0xda778ae8 sleepq_switch(dc42da80,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda778b1c sleepq_catch_signals(da778b84,c0c85000,d7f2e0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xda778b60 sleepq_wait_sig(d8257050,0,da778ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xda778b84 _cv_wait_sig(d8257050,d7f2e0c0,c16c2ceb,481,0,...) at _cv_wait_sig+0x21f/frame 0xda778bc8 svc_run_internal(da778cd4,c0c6573e,d7f2e0c0,da778ce8,c167399c,...) at svc_run_internal+0xc8b/frame 0xda778ca4 svc_thread_start(d7f2e0c0,da778ce8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xda778cac fork_exit(c0f656a0,d7f2e0c0,da778ce8) at fork_exit+0x7e/frame 0xda778cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xda778cd4 --- trap 0x28222978, eip = 0, esp = 0xda778d20, ebp = 0x1 --- Tracing command nfscbd pid 722 tid 100177 td 0xdc42d700 sched_switch(dc42d700,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xda77daa8 mi_switch(104,0,c16848e5,22b,dc42d700,...) at mi_switch+0x1f3/frame 0xda77dae8 sleepq_switch(dc42d700,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda77db1c sleepq_catch_signals(da77db84,c0c85000,d7f2e0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xda77db60 sleepq_wait_sig(d7f9cdd0,0,da77dba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xda77db84 _cv_wait_sig(d7f9cdd0,d7f2e0c0,c16c2ceb,481,0,...) at _cv_wait_sig+0x21f/frame 0xda77dbc8 svc_run_internal(da77dcd4,c0c6573e,d7f2e0c0,da77dce8,c167399c,...) at svc_run_internal+0xc8b/frame 0xda77dca4 svc_thread_start(d7f2e0c0,da77dce8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xda77dcac fork_exit(c0f656a0,d7f2e0c0,da77dce8) at fork_exit+0x7e/frame 0xda77dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xda77dcd4 --- trap 0x28222978, eip = 0, esp = 0xda77dd20, ebp = 0x1 --- Tracing command nfscbd pid 722 tid 100178 td 0xdc42d380 sched_switch(dc42d380,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xda782aa8 mi_switch(104,0,c16848e5,22b,dc42d380,...) at mi_switch+0x1f3/frame 0xda782ae8 sleepq_switch(dc42d380,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda782b1c sleepq_catch_signals(da782b84,c0c85000,d7f2e0d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xda782b60 sleepq_wait_sig(d82570d0,0,da782ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xda782b84 _cv_wait_sig(d82570d0,d7f2e0c0,c16c2ceb,481,0,...) at _cv_wait_sig+0x21f/frame 0xda782bc8 svc_run_internal(da782cd4,c0c6573e,d7f2e0c0,da782ce8,c167399c,...) at svc_run_internal+0xc8b/frame 0xda782ca4 svc_thread_start(d7f2e0c0,da782ce8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xda782cac fork_exit(c0f656a0,d7f2e0c0,da782ce8) at fork_exit+0x7e/frame 0xda782cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xda782cd4 --- trap 0x28222978, eip = 0, esp = 0xda782d20, ebp = 0x1 --- Tracing command nfscbd pid 721 tid 100168 td 0xdbd6ba80 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c16828e4,c0b113e5,c19280bc,c19281a0,e0275460,...) at db_trace_self_wrapper+0x2a/frame 0xe0275428 kdb_backtrace(c1682961,c0d04fff,e0275598,c127c245,c1685471,...) at kdb_backtrace+0x2d/frame 0xe0275490 kdb_reenter(c1685471,244,c0aa9035,aa65e44,700,...) at kdb_reenter+0x2a/frame 0xe02754a0 trap(e02755a4) at trap+0xb5/frame 0xe0275598 calltrap() at calltrap+0x6/frame 0xe0275598 --- trap 0xc, eip = 0xc1266509, esp = 0xe02755e4, ebp = 0xe0275600 --- db_trace_thread(dbd6ba80,ffffffff,2d1,18748,dbd6ba80,...) at db_trace_thread+0x29/frame 0xe0275600 _db_stack_trace_all(c0cef54a,0,ffffffff,e0275698,c199a950,...) at _db_stack_trace_all+0xe9/frame 0xe027566c db_command(c199b76c,0,c199b368,c199b76b,60,...) at db_command+0x297/frame 0xe0275720 db_script_exec(c1bf4618,0,e02757c8,e02757bc,c199a950,...) at db_script_exec+0x168/frame 0xe0275790 db_command(c12dca73,e02758a8,c05d4f8d,c167c937,ffff0ff0,...) at db_command+0x297/frame 0xe0275844 db_command_loop(c167c937,ffff0ff0,e027586f,e027586e,c19281a0,...) at db_command_loop+0x50/frame 0xe0275850 db_trap(3,ffff0ff0,c168292b,0,0,...) at db_trap+0x10d/frame 0xe02758a8 kdb_trap(3,ffff0ff0,e02759e4,e0275990,e0275a01,...) at kdb_trap+0x11e/frame 0xe02758e0 trap(e02759e4) at trap+0x817/frame 0xe02759d8 calltrap() at calltrap+0x6/frame 0xe02759d8 --- trap 0x3, eip = 0xc0cef54a, esp = 0xe0275a24, ebp = 0xe0275a30 --- kdb_enter(c167c937,c167c937,0,e0275a84,b,...) at kdb_enter+0x3a/frame 0xe0275a30 vpanic(c12b7617,e0275a84,e0275a84,e0275aa0,c10085d5,...) at vpanic+0x150/frame 0xe0275a64 panic(c12b7617,c1c1de94,c16d29f5,c17,1000004,...) at panic+0x1b/frame 0xe0275a78 vm_page_enqueue(c3aa8234,0,c16d03de,4f3,0,...) at vm_page_enqueue+0xf5/frame 0xe0275aa0 vm_fault_hold(cb7b91c8,284d9000,2,0,0,...) at vm_fault_hold+0x2052/frame 0xe0275b78 vm_fault(cb7b91c8,284d9000,2,0,1,...) at vm_fault+0x83/frame 0xe0275ba0 trap_pfault(284d9950,e0275ce8,d819b380,dd3190b8,e0275c48,...) at trap_pfault+0x109/frame 0xe0275be8 trap(e0275ce8) at trap+0x4d9/frame 0xe0275cdc calltrap() at calltrap+0x6/frame 0xe0275cdc --- trap 0xc, eip = 0x281b3f4b, esp = 0xbfbfe390, ebp = 0xbfbfe3c0 --- Tracing command cron pid 688 tid 100165 td 0xdc42e380 sched_switch(dc42e380,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xda73d9f0 mi_switch(104,0,c16848e5,22b,dc42e380,...) at mi_switch+0x1f3/frame 0xda73da30 sleepq_switch(dc42e380,0,c16848e5,1ca,6c,...) at sleepq_switch+0x110/frame 0xda73da64 sleepq_catch_signals(dc42e380,1,601,da73dae4,fd93,...) at sleepq_catch_signals+0x360/frame 0xda73daa8 sleepq_timedwait_sig(c1b7373d,6c,fd93,bffc3ac7,3,...) at sleepq_timedwait_sig+0x17/frame 0xda73dae4 _sleep(c1b7373d,0,16c,c167eb6d,56a69902,...) at _sleep+0x31a/frame 0xda73db38 kern_clock_nanosleep(dc42e380,0,0,da73dbc8,da73dbc0,...) at kern_clock_nanosleep+0x1e2/frame 0xda73dba0 sys_nanosleep(dc42e380,dc42e604,c16733db,4,530d643,...) at sys_nanosleep+0x7f/frame 0xda73dbe8 syscall(da73dce8) at syscall+0x6ee/frame 0xda73dcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xda73dcdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x281b50c3, esp = 0xbfbfec90, ebp = 0xbfbfeca0 --- Tracing command sendmail pid 684 tid 100113 td 0xc9766a80 sched_switch(c9766a80,0,104,189,c1b80980,...) at sched_switch+0x80c/frame 0xdbae6a48 mi_switch(104,0,c16848e5,22b,c9766a80,...) at mi_switch+0x1f3/frame 0xdbae6a84 sleepq_switch(c9766a80,0,c16848e5,1ca,74,...) at sleepq_switch+0x110/frame 0xdbae6ab8 sleepq_catch_signals(0,c16848e5,178,c1b92514,c9766a80,...) at sleepq_catch_signals+0x360/frame 0xdbae6afc sleepq_wait_sig(d8698064,74,c13a146f,100,0,...) at sleepq_wait_sig+0x14/frame 0xdbae6b20 _sleep(d8698064,d86980a8,174,c13a146f,0,...) at _sleep+0x386/frame 0xdbae6b74 kern_sigsuspend(c9766a80,0,0,0,0,...) at kern_sigsuspend+0xd4/frame 0xdbae6bb8 sys_sigsuspend(c9766a80,c9766d04,c16733db,4,530d643,...) at sys_sigsuspend+0x55/frame 0xdbae6be8 syscall(dbae6ce8) at syscall+0x6ee/frame 0xdbae6cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdbae6cdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x28461043, esp = 0xbfbfda5c, ebp = 0xbfbfda68 --- Tracing command sendmail pid 681 tid 100166 td 0xdbd6c380 sched_switch(dbd6c380,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xda742890 mi_switch(104,0,c16848e5,22b,dbd6c380,...) at mi_switch+0x1f3/frame 0xda7428d0 sleepq_switch(dbd6c380,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda742904 sleepq_catch_signals(8,c1678f47,cb,dbd6c380,dbd6c380,...) at sleepq_catch_signals+0x360/frame 0xda742948 sleepq_timedwait_sig(d8200b24,0,da7429ac,50000000,0,...) at sleepq_timedwait_sig+0x17/frame 0xda742988 _cv_timedwait_sig_sbt(d8200b24,d8200b10,b30c0cf0,fd6b,50000000,...) at _cv_timedwait_sig_sbt+0x24a/frame 0xda7429d0 seltdwait(fd6b,50000000,0,dbd6c380,0,...) at seltdwait+0x82/frame 0xda742a00 kern_select(dbd6c380,5,bfbfd100,0,0,...) at kern_select+0x876/frame 0xda742ba0 sys_select(dbd6c380,dbd6c604,c16733db,4,530d643,...) at sys_select+0x68/frame 0xda742be8 syscall(da742ce8) at syscall+0x6ee/frame 0xda742cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xda742cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d007f, esp = 0xbfbfcfd4, ebp = 0xbfbfcff8 --- Tracing command sshd pid 678 tid 100105 td 0xc9767000 sched_switch(c9767000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xdbab48b0 mi_switch(104,0,c16848e5,22b,c9767000,...) at mi_switch+0x1f3/frame 0xdbab48f0 sleepq_switch(c9767000,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xdbab4924 sleepq_catch_signals(dbab498c,c0c85000,d8200b60,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbab4968 sleepq_wait_sig(d8200b64,0,dbab49ac,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbab498c _cv_wait_sig(d8200b64,d8200b50,c1688143,73d,dbf02e00,...) at _cv_wait_sig+0x21f/frame 0xdbab49d0 seltdwait(ffffffff,0,0,c9767000,0,...) at seltdwait+0xbb/frame 0xdbab4a00 kern_select(c9767000,9,280c3158,0,0,...) at kern_select+0x876/frame 0xdbab4ba0 sys_select(c9767000,c9767284,c16733db,4,530d643,...) at sys_select+0x68/frame 0xdbab4be8 syscall(dbab4ce8) at syscall+0x6ee/frame 0xdbab4cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdbab4cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2855d07f, esp = 0xbfbfe7f4, ebp = 0xbfbfe818 --- Tracing command smartd pid 640 tid 100163 td 0xdc42e700 sched_switch(dc42e700,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xda7269f0 mi_switch(104,0,c16848e5,22b,dc42e700,...) at mi_switch+0x1f3/frame 0xda726a30 sleepq_switch(dc42e700,0,c16848e5,1ca,6c,...) at sleepq_switch+0x110/frame 0xda726a64 sleepq_catch_signals(dc42e700,1,601,da726ae4,10434,...) at sleepq_catch_signals+0x360/frame 0xda726aa8 sleepq_timedwait_sig(c1b7373d,6c,10434,50000000,70,...) at sleepq_timedwait_sig+0x17/frame 0xda726ae4 _sleep(c1b7373d,0,16c,c167eb6d,bc8523d3,...) at _sleep+0x31a/frame 0xda726b38 kern_clock_nanosleep(dc42e700,0,0,da726bc8,da726bc0,...) at kern_clock_nanosleep+0x1e2/frame 0xda726ba0 sys_nanosleep(dc42e700,dc42e984,c16733db,4,530d643,...) at sys_nanosleep+0x7f/frame 0xda726be8 syscall(da726ce8) at syscall+0x6ee/frame 0xda726cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xda726cdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x283420c3, esp = 0xbfbf9f50, ebp = 0xbfbf9f68 --- Tracing command powerd pid 610 tid 100160 td 0xdbd6d000 sched_switch(dbd6d000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xda704890 mi_switch(104,0,c16848e5,22b,dbd6d000,...) at mi_switch+0x1f3/frame 0xda7048d0 sleepq_switch(dbd6d000,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda704904 sleepq_catch_signals(8,c1678f47,cb,dbd6d000,dbd6d000,...) at sleepq_catch_signals+0x360/frame 0xda704948 sleepq_timedwait_sig(d7fd9764,0,da7049ac,3ffffff,0,...) at sleepq_timedwait_sig+0x17/frame 0xda704988 _cv_timedwait_sig_sbt(d7fd9764,d7fd9750,3140fa6c,fd69,3ffffff,...) at _cv_timedwait_sig_sbt+0x24a/frame 0xda7049d0 seltdwait(fd69,3ffffff,0,1,da704a4c,...) at seltdwait+0x82/frame 0xda704a00 kern_select(dbd6d000,0,bfbfed90,0,bfbfed90,...) at kern_select+0x876/frame 0xda704ba0 sys_select(dbd6d000,dbd6d284,c16733db,4,c167d7a2,...) at sys_select+0x68/frame 0xda704be8 syscall(da704ce8) at syscall+0x6ee/frame 0xda704cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xda704cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2821207f, esp = 0xbfbfecf4, ebp = 0xbfbfed18 --- Tracing command ntpd pid 607 tid 100122 td 0xd7fd5000 sched_switch(d7fd5000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xdbb768b0 mi_switch(104,0,c16848e5,22b,d7fd5000,...) at mi_switch+0x1f3/frame 0xdbb768f0 sleepq_switch(d7fd5000,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xdbb76924 sleepq_catch_signals(dbb7698c,c0c85000,d81ffc60,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbb76968 sleepq_wait_sig(d81ffc64,0,dbb769ac,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbb7698c _cv_wait_sig(d81ffc64,d81ffc50,c1688143,73d,dc3f8800,...) at _cv_wait_sig+0x21f/frame 0xdbb769d0 seltdwait(ffffffff,0,0,d7fd5000,0,...) at seltdwait+0xbb/frame 0xdbb76a00 kern_select(d7fd5000,1b,bfbfe2c0,0,0,...) at kern_select+0x876/frame 0xdbb76ba0 sys_select(d7fd5000,d7fd5284,c16733db,4,c1673d41,...) at sys_select+0x68/frame 0xdbb76be8 syscall(dbb76ce8) at syscall+0x6ee/frame 0xdbb76cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdbb76cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284b307f, esp = 0xbfbfe1e4, ebp = 0xbfbfe208 --- Tracing command rpc.lockd pid 569 tid 100126 td 0xd7fd4000 sched_switch(d7fd4000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xdbbaf838 mi_switch(104,0,c16848e5,22b,d7fd4000,...) at mi_switch+0x1f3/frame 0xdbbaf878 sleepq_switch(d7fd4000,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xdbbaf8ac sleepq_catch_signals(8,c1678f47,cb,d7fd4000,d7fd4000,...) at sleepq_catch_signals+0x360/frame 0xdbbaf8f0 sleepq_timedwait_sig(d84b57d0,0,dbbaf954,0,0,...) at sleepq_timedwait_sig+0x17/frame 0xdbbaf930 _cv_timedwait_sig_sbt(d84b57d0,dc3f60c0,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x24a/frame 0xdbbaf978 svc_run_internal(d7fd41c4,14,c16c2d29,c16bf41a,19,...) at svc_run_internal+0xb2c/frame 0xdbbafa54 svc_run(dc3f6000,0,4,c0f4c8f0,dbbafb40,...) at svc_run+0x1ed/frame 0xdbbafaa8 sys_nlm_syscall(d7fd4000,d7fd4284,c16733db,4,dbbafc48,...) at sys_nlm_syscall+0x8ca/frame 0xdbbafbe8 syscall(dbbafce8) at syscall+0x6ee/frame 0xdbbafcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdbbafcdc --- syscall (154, FreeBSD ELF32, sys_nlm_syscall), eip = 0x280d60cf, esp = 0xbfbfed74, ebp = 0xbfbfee28 --- Tracing command rpc.statd pid 566 tid 100158 td 0xdbd6d380 sched_switch(dbd6d380,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xda6ee890 mi_switch(104,0,c16848e5,22b,dbd6d380,...) at mi_switch+0x1f3/frame 0xda6ee8d0 sleepq_switch(dbd6d380,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda6ee904 sleepq_catch_signals(8,c1678f47,cb,dbd6d380,dbd6d380,...) at sleepq_catch_signals+0x360/frame 0xda6ee948 sleepq_timedwait_sig(d8200ba4,0,da6ee9ac,e0000000,1,...) at sleepq_timedwait_sig+0x17/frame 0xda6ee988 _cv_timedwait_sig_sbt(d8200ba4,d8200b90,9f1456ae,fd6a,e0000000,...) at _cv_timedwait_sig_sbt+0x24a/frame 0xda6ee9d0 seltdwait(fd6a,e0000000,1,dbd6d380,0,...) at seltdwait+0x82/frame 0xda6eea00 kern_select(dbd6d380,8,bfbfece8,0,0,...) at kern_select+0x876/frame 0xda6eeba0 sys_select(dbd6d380,dbd6d604,c16733db,4,c167d7a2,...) at sys_select+0x68/frame 0xda6eebe8 syscall(da6eece8) at syscall+0x6ee/frame 0xda6eecdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xda6eecdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2820a07f, esp = 0xbfbfec34, ebp = 0xbfbfed80 --- Tracing command nfsd pid 565 tid 100124 td 0xd7fd4700 sched_switch(d7fd4700,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xdbb853c8 mi_switch(104,0,c16848e5,22b,d7fd4700,...) at mi_switch+0x1f3/frame 0xdbb85408 sleepq_switch(d7fd4700,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xdbb8543c sleepq_catch_signals(8,c1678f47,cb,d7fd4700,d7fd4700,...) at sleepq_catch_signals+0x360/frame 0xdbb85480 sleepq_timedwait_sig(d7c172d0,0,dbb854e4,0,0,...) at sleepq_timedwait_sig+0x17/frame 0xdbb854c0 _cv_timedwait_sig_sbt(d7c172d0,d80e40c0,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x24a/frame 0xdbb85508 svc_run_internal(c0f656a0,d80e40c0,d7f356b0,dbb85610,0,...) at svc_run_internal+0xb2c/frame 0xdbb855e4 svc_run(d80e4000,0,c1662f19,1f8,c1bbe9a8,...) at svc_run+0x1ed/frame 0xdbb85638 nfsrvd_nfsd(d7fd4700,dbb857b0,c,0,40,...) at nfsrvd_nfsd+0x213/frame 0xdbb85778 nfssvc_nfsd(d7fd4700,d7fd4984,0,d7fd4700,dbb85cdc,...) at nfssvc_nfsd+0x201/frame 0xdbb85bd0 sys_nfssvc(d7fd4700,d7fd4984,c16733db,4,dbb85c48,...) at sys_nfssvc+0xa6/frame 0xdbb85be8 syscall(dbb85ce8) at syscall+0x6ee/frame 0xdbb85cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdbb85cdc --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280c30bf, esp = 0xbfbfe7f4, ebp = 0xbfbfea68 --- Tracing command nfsd pid 565 tid 100127 td 0xd7f62a80 sched_switch(d7f62a80,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xdbbb4aa8 mi_switch(104,0,c16848e5,22b,d7f62a80,...) at mi_switch+0x1f3/frame 0xdbbb4ae8 sleepq_switch(d7f62a80,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xdbbb4b1c sleepq_catch_signals(dbbb4b84,c0c85000,d80e40d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbbb4b60 sleepq_wait_sig(d8256050,0,dbbb4ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbbb4b84 _cv_wait_sig(d8256050,d80e40c0,c16c2ceb,51e,0,...) at _cv_wait_sig+0x21f/frame 0xdbbb4bc8 svc_run_internal(dbbb4cd4,c0c6573e,d80e40c0,dbbb4ce8,c167399c,...) at svc_run_internal+0xc8b/frame 0xdbbb4ca4 svc_thread_start(d80e40c0,dbbb4ce8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xdbbb4cac fork_exit(c0f656a0,d80e40c0,dbbb4ce8) at fork_exit+0x7e/frame 0xdbbb4cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbbb4cd4 --- trap 0x20, eip = 0, esp = 0xdbbb4d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 565 tid 100128 td 0xdc33ca80 sched_switch(dc33ca80,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xdbbb9aa8 mi_switch(104,0,c16848e5,22b,dc33ca80,...) at mi_switch+0x1f3/frame 0xdbbb9ae8 sleepq_switch(dc33ca80,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xdbbb9b1c sleepq_catch_signals(dbbb9b84,c0c85000,d80e40d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbbb9b60 sleepq_wait_sig(d8256dd0,0,dbbb9ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbbb9b84 _cv_wait_sig(d8256dd0,d80e40c0,c16c2ceb,51e,0,...) at _cv_wait_sig+0x21f/frame 0xdbbb9bc8 svc_run_internal(dbbb9cd4,c0c6573e,d80e40c0,dbbb9ce8,c167399c,...) at svc_run_internal+0xc8b/frame 0xdbbb9ca4 svc_thread_start(d80e40c0,dbbb9ce8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xdbbb9cac fork_exit(c0f656a0,d80e40c0,dbbb9ce8) at fork_exit+0x7e/frame 0xdbbb9cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbbb9cd4 --- trap 0x20, eip = 0, esp = 0xdbbb9d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 565 tid 100129 td 0xdc33c700 sched_switch(dc33c700,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xdbbbeaa8 mi_switch(104,0,c16848e5,22b,dc33c700,...) at mi_switch+0x1f3/frame 0xdbbbeae8 sleepq_switch(dc33c700,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xdbbbeb1c sleepq_catch_signals(dbbbeb84,c0c85000,d80e40d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbbbeb60 sleepq_wait_sig(d7c17a50,0,dbbbeba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbbbeb84 _cv_wait_sig(d7c17a50,d80e40c0,c16c2ceb,51e,0,...) at _cv_wait_sig+0x21f/frame 0xdbbbebc8 svc_run_internal(dbbbecd4,c0c6573e,d80e40c0,dbbbece8,c167399c,...) at svc_run_internal+0xc8b/frame 0xdbbbeca4 svc_thread_start(d80e40c0,dbbbece8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xdbbbecac fork_exit(c0f656a0,d80e40c0,dbbbece8) at fork_exit+0x7e/frame 0xdbbbecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbbbecd4 --- trap 0x20, eip = 0, esp = 0xdbbbed20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 565 tid 100130 td 0xdc33c380 sched_switch(dc33c380,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xdbbc3aa8 mi_switch(104,0,c16848e5,22b,dc33c380,...) at mi_switch+0x1f3/frame 0xdbbc3ae8 sleepq_switch(dc33c380,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xdbbc3b1c sleepq_catch_signals(dbbc3b84,c0c85000,d80e40d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbbc3b60 sleepq_wait_sig(d7f9ef50,0,dbbc3ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbbc3b84 _cv_wait_sig(d7f9ef50,d80e40c0,c16c2ceb,51e,28069c54,...) at _cv_wait_sig+0x21f/frame 0xdbbc3bc8 svc_run_internal(dbbc3cd4,c0c6573e,d80e40c0,dbbc3ce8,c167399c,...) at svc_run_internal+0xc8b/frame 0xdbbc3ca4 svc_thread_start(d80e40c0,dbbc3ce8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xdbbc3cac fork_exit(c0f656a0,d80e40c0,dbbc3ce8) at fork_exit+0x7e/frame 0xdbbc3cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbbc3cd4 --- trap 0x20, eip = 0, esp = 0xdbbc3d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 565 tid 100131 td 0xdc33c000 sched_switch(dc33c000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xdbbc8aa8 mi_switch(104,0,c16848e5,22b,dc33c000,...) at mi_switch+0x1f3/frame 0xdbbc8ae8 sleepq_switch(dc33c000,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xdbbc8b1c sleepq_catch_signals(dbbc8b84,c0c85000,d80e40d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbbc8b60 sleepq_wait_sig(d7c17ad0,0,dbbc8ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbbc8b84 _cv_wait_sig(d7c17ad0,d80e40c0,c16c2ceb,51e,0,...) at _cv_wait_sig+0x21f/frame 0xdbbc8bc8 svc_run_internal(dbbc8cd4,c0c6573e,d80e40c0,dbbc8ce8,c167399c,...) at svc_run_internal+0xc8b/frame 0xdbbc8ca4 svc_thread_start(d80e40c0,dbbc8ce8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xdbbc8cac fork_exit(c0f656a0,d80e40c0,dbbc8ce8) at fork_exit+0x7e/frame 0xdbbc8cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbbc8cd4 --- trap 0x20, eip = 0, esp = 0xdbbc8d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 565 tid 100132 td 0xdc33ba80 sched_switch(dc33ba80,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xdbbcdaa8 mi_switch(104,0,c16848e5,22b,dc33ba80,...) at mi_switch+0x1f3/frame 0xdbbcdae8 sleepq_switch(dc33ba80,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xdbbcdb1c sleepq_catch_signals(dbbcdb84,c0c85000,d80e40d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbbcdb60 sleepq_wait_sig(d7f9eed0,0,dbbcdba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbbcdb84 _cv_wait_sig(d7f9eed0,d80e40c0,c16c2ceb,51e,0,...) at _cv_wait_sig+0x21f/frame 0xdbbcdbc8 svc_run_internal(dbbcdcd4,c0c6573e,d80e40c0,dbbcdce8,c167399c,...) at svc_run_internal+0xc8b/frame 0xdbbcdca4 svc_thread_start(d80e40c0,dbbcdce8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xdbbcdcac fork_exit(c0f656a0,d80e40c0,dbbcdce8) at fork_exit+0x7e/frame 0xdbbcdcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbbcdcd4 --- trap 0x20, eip = 0, esp = 0xdbbcdd20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 565 tid 100133 td 0xdc33b700 sched_switch(dc33b700,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xdbbd2aa8 mi_switch(104,0,c16848e5,22b,dc33b700,...) at mi_switch+0x1f3/frame 0xdbbd2ae8 sleepq_switch(dc33b700,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xdbbd2b1c sleepq_catch_signals(dbbd2b84,c0c85000,d80e40d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbbd2b60 sleepq_wait_sig(d7c186d0,0,dbbd2ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbbd2b84 _cv_wait_sig(d7c186d0,d80e40c0,c16c2ceb,51e,8048e78,...) at _cv_wait_sig+0x21f/frame 0xdbbd2bc8 svc_run_internal(dbbd2cd4,c0c6573e,d80e40c0,dbbd2ce8,c167399c,...) at svc_run_internal+0xc8b/frame 0xdbbd2ca4 svc_thread_start(d80e40c0,dbbd2ce8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xdbbd2cac fork_exit(c0f656a0,d80e40c0,dbbd2ce8) at fork_exit+0x7e/frame 0xdbbd2cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbbd2cd4 --- trap 0x20, eip = 0, esp = 0xdbbd2d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 565 tid 100134 td 0xdc33b380 sched_switch(dc33b380,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xdbbd7aa8 mi_switch(104,0,c16848e5,22b,dc33b380,...) at mi_switch+0x1f3/frame 0xdbbd7ae8 sleepq_switch(dc33b380,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xdbbd7b1c sleepq_catch_signals(dbbd7b84,c0c85000,d80e40d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbbd7b60 sleepq_wait_sig(d7f9ee50,0,dbbd7ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbbd7b84 _cv_wait_sig(d7f9ee50,d80e40c0,c16c2ceb,51e,0,...) at _cv_wait_sig+0x21f/frame 0xdbbd7bc8 svc_run_internal(dbbd7cd4,c0c6573e,d80e40c0,dbbd7ce8,c167399c,...) at svc_run_internal+0xc8b/frame 0xdbbd7ca4 svc_thread_start(d80e40c0,dbbd7ce8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xdbbd7cac fork_exit(c0f656a0,d80e40c0,dbbd7ce8) at fork_exit+0x7e/frame 0xdbbd7cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbbd7cd4 --- trap 0x20, eip = 0, esp = 0xdbbd7d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 565 tid 100135 td 0xdc33b000 sched_switch(dc33b000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xdbbdcaa8 mi_switch(104,0,c16848e5,22b,dc33b000,...) at mi_switch+0x1f3/frame 0xdbbdcae8 sleepq_switch(dc33b000,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xdbbdcb1c sleepq_catch_signals(dbbdcb84,c0c85000,d80e40d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbbdcb60 sleepq_wait_sig(d8256e50,0,dbbdcba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbbdcb84 _cv_wait_sig(d8256e50,d80e40c0,c16c2ceb,51e,0,...) at _cv_wait_sig+0x21f/frame 0xdbbdcbc8 svc_run_internal(dbbdccd4,c0c6573e,d80e40c0,dbbdcce8,c167399c,...) at svc_run_internal+0xc8b/frame 0xdbbdcca4 svc_thread_start(d80e40c0,dbbdcce8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xdbbdccac fork_exit(c0f656a0,d80e40c0,dbbdcce8) at fork_exit+0x7e/frame 0xdbbdccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbbdccd4 --- trap 0x20, eip = 0, esp = 0xdbbdcd20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 565 tid 100136 td 0xdc33aa80 sched_switch(dc33aa80,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xdbbe1aa8 mi_switch(104,0,c16848e5,22b,dc33aa80,...) at mi_switch+0x1f3/frame 0xdbbe1ae8 sleepq_switch(dc33aa80,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xdbbe1b1c sleepq_catch_signals(dbbe1b84,c0c85000,d80e40d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbbe1b60 sleepq_wait_sig(d7f9edd0,0,dbbe1ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbbe1b84 _cv_wait_sig(d7f9edd0,d80e40c0,c16c2ceb,51e,8048e78,...) at _cv_wait_sig+0x21f/frame 0xdbbe1bc8 svc_run_internal(dbbe1cd4,c0c6573e,d80e40c0,dbbe1ce8,c167399c,...) at svc_run_internal+0xc8b/frame 0xdbbe1ca4 svc_thread_start(d80e40c0,dbbe1ce8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xdbbe1cac fork_exit(c0f656a0,d80e40c0,dbbe1ce8) at fork_exit+0x7e/frame 0xdbbe1cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbbe1cd4 --- trap 0x20, eip = 0, esp = 0xdbbe1d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 565 tid 100137 td 0xdc33a700 sched_switch(dc33a700,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xdbbe6aa8 mi_switch(104,0,c16848e5,22b,dc33a700,...) at mi_switch+0x1f3/frame 0xdbbe6ae8 sleepq_switch(dc33a700,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xdbbe6b1c sleepq_catch_signals(dbbe6b84,c0c85000,d80e40d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbbe6b60 sleepq_wait_sig(d7c17b50,0,dbbe6ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbbe6b84 _cv_wait_sig(d7c17b50,d80e40c0,c16c2ceb,51e,0,...) at _cv_wait_sig+0x21f/frame 0xdbbe6bc8 svc_run_internal(dbbe6cd4,c0c6573e,d80e40c0,dbbe6ce8,c167399c,...) at svc_run_internal+0xc8b/frame 0xdbbe6ca4 svc_thread_start(d80e40c0,dbbe6ce8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xdbbe6cac fork_exit(c0f656a0,d80e40c0,dbbe6ce8) at fork_exit+0x7e/frame 0xdbbe6cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbbe6cd4 --- trap 0x20, eip = 0, esp = 0xdbbe6d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 565 tid 100138 td 0xdc33a380 sched_switch(dc33a380,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xdbbebaa8 mi_switch(104,0,c16848e5,22b,dc33a380,...) at mi_switch+0x1f3/frame 0xdbbebae8 sleepq_switch(dc33a380,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xdbbebb1c sleepq_catch_signals(dbbebb84,c0c85000,d80e40d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbbebb60 sleepq_wait_sig(d7f9ed50,0,dbbebba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbbebb84 _cv_wait_sig(d7f9ed50,d80e40c0,c16c2ceb,51e,0,...) at _cv_wait_sig+0x21f/frame 0xdbbebbc8 svc_run_internal(dbbebcd4,c0c6573e,d80e40c0,dbbebce8,c167399c,...) at svc_run_internal+0xc8b/frame 0xdbbebca4 svc_thread_start(d80e40c0,dbbebce8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xdbbebcac fork_exit(c0f656a0,d80e40c0,dbbebce8) at fork_exit+0x7e/frame 0xdbbebcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbbebcd4 --- trap 0x20, eip = 0, esp = 0xdbbebd20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 565 tid 100139 td 0xdc33a000 sched_switch(dc33a000,0,602,185,8,...) at sched_switch+0x80c/frame 0xdbbf0908 mi_switch(602,0,c167d7a2,f1,dc33a000,...) at mi_switch+0x1f3/frame 0xdbbf0948 critical_exit(dc8f3b80,dbbf0988,c0d06e39,c1b938c8,0,...) at critical_exit+0xa2/frame 0xdbbf0964 spinlock_exit(c1b938c8,0,c16857f4,267) at spinlock_exit+0x10/frame 0xdbbf0970 turnstile_chain_unlock(cb773460,0,c1bbe320,c193d488,1,c1bbe320) at turnstile_chain_unlock+0x39/frame 0xdbbf0988 __mtx_unlock_sleep(cb773470,dc33a002,0,f0f,cb773460,...) at __mtx_unlock_sleep+0x92/frame 0xdbbf09b4 __mtx_unlock_flags(cb773470,0,c16cf9be,f0f,c192bc48,...) at __mtx_unlock_flags+0x116/frame 0xdbbf09dc uma_dbg_free(dc0fe000,c1bbe320,c1c17f08,c1c17f18,c16635b3,...) at uma_dbg_free+0xf4/frame 0xdbbf0a0c uma_zfree_arg(cb7bf000,dc0fe000,0,1,0,...) at uma_zfree_arg+0x55/frame 0xdbbf0a44 mb_free_ext(df759a00,8,c1662f19,10e,c1c139d4,...) at mb_free_ext+0x15c/frame 0xdbbf0a68 m_freem(df759a00,0,c1662f19,10e,0,...) at m_freem+0x58/frame 0xdbbf0a90 nfssvc_program(dc6b4800,d7c49800,c16c2ceb,517,0,...) at nfssvc_program+0x6a9/frame 0xdbbf0bc8 svc_run_internal(dbbf0cd4,c0c6573e,d80e40c0,dbbf0ce8,c167399c,...) at svc_run_internal+0xa52/frame 0xdbbf0ca4 svc_thread_start(d80e40c0,dbbf0ce8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xdbbf0cac fork_exit(c0f656a0,d80e40c0,dbbf0ce8) at fork_exit+0x7e/frame 0xdbbf0cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbbf0cd4 --- trap 0x20, eip = 0, esp = 0xdbbf0d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 565 tid 100140 td 0xdbd6da80 sched_switch(dbd6da80,0,104,189,c1b81dc0,...) at sched_switch+0x80c/frame 0xdbbf52e0 mi_switch(104,0,c16848e5,22b,dbd6da80,...) at mi_switch+0x1f3/frame 0xdbbf531c sleepq_switch(dbd6da80,0,c16848e5,2b3,dbd6da80,...) at sleepq_switch+0x110/frame 0xdbbf5350 sleepq_wait(c1bed7e4,54,c168e396,0,0,...) at sleepq_wait+0x48/frame 0xdbbf5374 _sleep(c1bed7e4,c1949400,54,c168e396,0,...) at _sleep+0x396/frame 0xdbbf53c8 bufwrite(cb418a4c,c16907c1,3f1,0,0,...) at bufwrite+0x2f6/frame 0xdbbf540c cluster_wbuild(df8bd2d8,4000,19e4,0,8,...) at cluster_wbuild+0x51e/frame 0xdbbf5478 cluster_write(df8bd2d8,cb559b6c,67b0000,0,33,...) at cluster_write+0x1a6/frame 0xdbbf5518 ffs_write(dbbf56a0,c1892861,dbbf55f0,c0d12278,c254ee48,...) at ffs_write+0x4a2/frame 0xdbbf5598 VOP_WRITE_APV(c1974f74,dbbf56a0,2,dfb5f800,dfb5f960,...) at VOP_WRITE_APV+0x187/frame 0xdbbf5668 nfsvno_write(df8bd2d8,67a0000,0,10000,2d,...) at nfsvno_write+0x127/frame 0xdbbf56c8 nfsrvd_write(dbbf5ad8,0,df8bd2d8,dbd6da80,dbbf5a18,...) at nfsrvd_write+0x4d8/frame 0xdbbf5920 nfsrvd_dorpc(dbbf5ad8,0,0,ffffffff,0,...) at nfsrvd_dorpc+0x79c/frame 0xdbbf5a90 nfssvc_program(dcfcb000,d7c49800,c16c2ceb,517,0,...) at nfssvc_program+0x56f/frame 0xdbbf5bc8 svc_run_internal(dbbf5cd4,c0c6573e,d80e40c0,dbbf5ce8,c167399c,...) at svc_run_internal+0xa52/frame 0xdbbf5ca4 svc_thread_start(d80e40c0,dbbf5ce8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xdbbf5cac fork_exit(c0f656a0,d80e40c0,dbbf5ce8) at fork_exit+0x7e/frame 0xdbbf5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbbf5cd4 --- trap 0x20, eip = 0, esp = 0xdbbf5d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 565 tid 100141 td 0xdc342000 sched_switch(dc342000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xdbbfaaa8 mi_switch(104,0,c16848e5,22b,dc342000,...) at mi_switch+0x1f3/frame 0xdbbfaae8 sleepq_switch(dc342000,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xdbbfab1c sleepq_catch_signals(dbbfab84,c0c85000,d80e40d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbbfab60 sleepq_wait_sig(d7c17c50,0,dbbfaba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbbfab84 _cv_wait_sig(d7c17c50,d80e40c0,c16c2ceb,51e,2821d1f1,...) at _cv_wait_sig+0x21f/frame 0xdbbfabc8 svc_run_internal(dbbfacd4,c0c6573e,d80e40c0,dbbface8,c167399c,...) at svc_run_internal+0xc8b/frame 0xdbbfaca4 svc_thread_start(d80e40c0,dbbface8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xdbbfacac fork_exit(c0f656a0,d80e40c0,dbbface8) at fork_exit+0x7e/frame 0xdbbfacd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbbfacd4 --- trap 0x20, eip = 0, esp = 0xdbbfad20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 565 tid 100142 td 0xdc341a80 sched_switch(dc341a80,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xdbbffaa8 mi_switch(104,0,c16848e5,22b,dc341a80,...) at mi_switch+0x1f3/frame 0xdbbffae8 sleepq_switch(dc341a80,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xdbbffb1c sleepq_catch_signals(dbbffb84,c0c85000,d80e40d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbbffb60 sleepq_wait_sig(d7c17cd0,0,dbbffba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbbffb84 _cv_wait_sig(d7c17cd0,d80e40c0,c16c2ceb,51e,0,...) at _cv_wait_sig+0x21f/frame 0xdbbffbc8 svc_run_internal(dbbffcd4,c0c6573e,d80e40c0,dbbffce8,c167399c,...) at svc_run_internal+0xc8b/frame 0xdbbffca4 svc_thread_start(d80e40c0,dbbffce8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xdbbffcac fork_exit(c0f656a0,d80e40c0,dbbffce8) at fork_exit+0x7e/frame 0xdbbffcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbbffcd4 --- trap 0x20, eip = 0, esp = 0xdbbffd20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 565 tid 100143 td 0xdc341700 sched_switch(dc341700,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xda6a3aa8 mi_switch(104,0,c16848e5,22b,dc341700,...) at mi_switch+0x1f3/frame 0xda6a3ae8 sleepq_switch(dc341700,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda6a3b1c sleepq_catch_signals(da6a3b84,c0c85000,d80e40d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xda6a3b60 sleepq_wait_sig(d7f9ec50,0,da6a3ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xda6a3b84 _cv_wait_sig(d7f9ec50,d80e40c0,c16c2ceb,51e,0,...) at _cv_wait_sig+0x21f/frame 0xda6a3bc8 svc_run_internal(da6a3cd4,c0c6573e,d80e40c0,da6a3ce8,c167399c,...) at svc_run_internal+0xc8b/frame 0xda6a3ca4 svc_thread_start(d80e40c0,da6a3ce8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xda6a3cac fork_exit(c0f656a0,d80e40c0,da6a3ce8) at fork_exit+0x7e/frame 0xda6a3cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xda6a3cd4 --- trap 0x20, eip = 0, esp = 0xda6a3d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 565 tid 100144 td 0xdc341380 sched_switch(dc341380,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xda6a8aa8 mi_switch(104,0,c16848e5,22b,dc341380,...) at mi_switch+0x1f3/frame 0xda6a8ae8 sleepq_switch(dc341380,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda6a8b1c sleepq_catch_signals(da6a8b84,c0c85000,d80e40d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xda6a8b60 sleepq_wait_sig(d7c17d50,0,da6a8ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xda6a8b84 _cv_wait_sig(d7c17d50,d80e40c0,c16c2ceb,51e,0,...) at _cv_wait_sig+0x21f/frame 0xda6a8bc8 svc_run_internal(da6a8cd4,c0c6573e,d80e40c0,da6a8ce8,c167399c,...) at svc_run_internal+0xc8b/frame 0xda6a8ca4 svc_thread_start(d80e40c0,da6a8ce8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xda6a8cac fork_exit(c0f656a0,d80e40c0,da6a8ce8) at fork_exit+0x7e/frame 0xda6a8cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xda6a8cd4 --- trap 0x20, eip = 0, esp = 0xda6a8d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 565 tid 100145 td 0xdc341000 sched_switch(dc341000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xda6adaa8 mi_switch(104,0,c16848e5,22b,dc341000,...) at mi_switch+0x1f3/frame 0xda6adae8 sleepq_switch(dc341000,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda6adb1c sleepq_catch_signals(da6adb84,c0c85000,d80e40d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xda6adb60 sleepq_wait_sig(d7f9ebd0,0,da6adba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xda6adb84 _cv_wait_sig(d7f9ebd0,d80e40c0,c16c2ceb,51e,0,...) at _cv_wait_sig+0x21f/frame 0xda6adbc8 svc_run_internal(da6adcd4,c0c6573e,d80e40c0,da6adce8,c167399c,...) at svc_run_internal+0xc8b/frame 0xda6adca4 svc_thread_start(d80e40c0,da6adce8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xda6adcac fork_exit(c0f656a0,d80e40c0,da6adce8) at fork_exit+0x7e/frame 0xda6adcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xda6adcd4 --- trap 0x20, eip = 0, esp = 0xda6add20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 565 tid 100146 td 0xdc340a80 sched_switch(dc340a80,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xda6b2aa8 mi_switch(104,0,c16848e5,22b,dc340a80,...) at mi_switch+0x1f3/frame 0xda6b2ae8 sleepq_switch(dc340a80,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda6b2b1c sleepq_catch_signals(da6b2b84,c0c85000,d80e40d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xda6b2b60 sleepq_wait_sig(d7c17dd0,0,da6b2ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xda6b2b84 _cv_wait_sig(d7c17dd0,d80e40c0,c16c2ceb,51e,0,...) at _cv_wait_sig+0x21f/frame 0xda6b2bc8 svc_run_internal(da6b2cd4,c0c6573e,d80e40c0,da6b2ce8,c167399c,...) at svc_run_internal+0xc8b/frame 0xda6b2ca4 svc_thread_start(d80e40c0,da6b2ce8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xda6b2cac fork_exit(c0f656a0,d80e40c0,da6b2ce8) at fork_exit+0x7e/frame 0xda6b2cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xda6b2cd4 --- trap 0x20, eip = 0, esp = 0xda6b2d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 565 tid 100147 td 0xdc340700 sched_switch(dc340700,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xda6b7aa8 mi_switch(104,0,c16848e5,22b,dc340700,...) at mi_switch+0x1f3/frame 0xda6b7ae8 sleepq_switch(dc340700,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda6b7b1c sleepq_catch_signals(da6b7b84,c0c85000,d80e40d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xda6b7b60 sleepq_wait_sig(d7f9eb50,0,da6b7ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xda6b7b84 _cv_wait_sig(d7f9eb50,d80e40c0,c16c2ceb,51e,0,...) at _cv_wait_sig+0x21f/frame 0xda6b7bc8 svc_run_internal(da6b7cd4,c0c6573e,d80e40c0,da6b7ce8,c167399c,...) at svc_run_internal+0xc8b/frame 0xda6b7ca4 svc_thread_start(d80e40c0,da6b7ce8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xda6b7cac fork_exit(c0f656a0,d80e40c0,da6b7ce8) at fork_exit+0x7e/frame 0xda6b7cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xda6b7cd4 --- trap 0x20, eip = 0, esp = 0xda6b7d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 565 tid 100148 td 0xdc340380 sched_switch(dc340380,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xda6bcaa8 mi_switch(104,0,c16848e5,22b,dc340380,...) at mi_switch+0x1f3/frame 0xda6bcae8 sleepq_switch(dc340380,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda6bcb1c sleepq_catch_signals(da6bcb84,c0c85000,d80e40d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xda6bcb60 sleepq_wait_sig(d7c17e50,0,da6bcba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xda6bcb84 _cv_wait_sig(d7c17e50,d80e40c0,c16c2ceb,51e,0,...) at _cv_wait_sig+0x21f/frame 0xda6bcbc8 svc_run_internal(da6bccd4,c0c6573e,d80e40c0,da6bcce8,c167399c,...) at svc_run_internal+0xc8b/frame 0xda6bcca4 svc_thread_start(d80e40c0,da6bcce8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xda6bccac fork_exit(c0f656a0,d80e40c0,da6bcce8) at fork_exit+0x7e/frame 0xda6bccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xda6bccd4 --- trap 0x20, eip = 0, esp = 0xda6bcd20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 565 tid 100149 td 0xdc340000 sched_switch(dc340000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xda6c1aa8 mi_switch(104,0,c16848e5,22b,dc340000,...) at mi_switch+0x1f3/frame 0xda6c1ae8 sleepq_switch(dc340000,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda6c1b1c sleepq_catch_signals(da6c1b84,c0c85000,d80e40d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xda6c1b60 sleepq_wait_sig(d7f9ead0,0,da6c1ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xda6c1b84 _cv_wait_sig(d7f9ead0,d80e40c0,c16c2ceb,51e,0,...) at _cv_wait_sig+0x21f/frame 0xda6c1bc8 svc_run_internal(da6c1cd4,c0c6573e,d80e40c0,da6c1ce8,c167399c,...) at svc_run_internal+0xc8b/frame 0xda6c1ca4 svc_thread_start(d80e40c0,da6c1ce8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xda6c1cac fork_exit(c0f656a0,d80e40c0,da6c1ce8) at fork_exit+0x7e/frame 0xda6c1cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xda6c1cd4 --- trap 0x20, eip = 0, esp = 0xda6c1d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 565 tid 100150 td 0xdc33fa80 sched_switch(dc33fa80,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xda6c6aa8 mi_switch(104,0,c16848e5,22b,dc33fa80,...) at mi_switch+0x1f3/frame 0xda6c6ae8 sleepq_switch(dc33fa80,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda6c6b1c sleepq_catch_signals(da6c6b84,c0c85000,d80e40d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xda6c6b60 sleepq_wait_sig(d7f9ea50,0,da6c6ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xda6c6b84 _cv_wait_sig(d7f9ea50,d80e40c0,c16c2ceb,51e,0,...) at _cv_wait_sig+0x21f/frame 0xda6c6bc8 svc_run_internal(da6c6cd4,c0c6573e,d80e40c0,da6c6ce8,c167399c,...) at svc_run_internal+0xc8b/frame 0xda6c6ca4 svc_thread_start(d80e40c0,da6c6ce8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xda6c6cac fork_exit(c0f656a0,d80e40c0,da6c6ce8) at fork_exit+0x7e/frame 0xda6c6cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xda6c6cd4 --- trap 0x20, eip = 0, esp = 0xda6c6d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 565 tid 100151 td 0xdc33f700 sched_switch(dc33f700,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xda6cbaa8 mi_switch(104,0,c16848e5,22b,dc33f700,...) at mi_switch+0x1f3/frame 0xda6cbae8 sleepq_switch(dc33f700,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda6cbb1c sleepq_catch_signals(da6cbb84,c0c85000,d80e40d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xda6cbb60 sleepq_wait_sig(d7f9e9d0,0,da6cbba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xda6cbb84 _cv_wait_sig(d7f9e9d0,d80e40c0,c16c2ceb,51e,0,...) at _cv_wait_sig+0x21f/frame 0xda6cbbc8 svc_run_internal(da6cbcd4,c0c6573e,d80e40c0,da6cbce8,c167399c,...) at svc_run_internal+0xc8b/frame 0xda6cbca4 svc_thread_start(d80e40c0,da6cbce8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xda6cbcac fork_exit(c0f656a0,d80e40c0,da6cbce8) at fork_exit+0x7e/frame 0xda6cbcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xda6cbcd4 --- trap 0x20, eip = 0, esp = 0xda6cbd20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 565 tid 100152 td 0xdc33f380 sched_switch(dc33f380,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xda6d0aa8 mi_switch(104,0,c16848e5,22b,dc33f380,...) at mi_switch+0x1f3/frame 0xda6d0ae8 sleepq_switch(dc33f380,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda6d0b1c sleepq_catch_signals(da6d0b84,c0c85000,d80e40d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xda6d0b60 sleepq_wait_sig(d7c17ed0,0,da6d0ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xda6d0b84 _cv_wait_sig(d7c17ed0,d80e40c0,c16c2ceb,51e,0,...) at _cv_wait_sig+0x21f/frame 0xda6d0bc8 svc_run_internal(da6d0cd4,c0c6573e,d80e40c0,da6d0ce8,c167399c,...) at svc_run_internal+0xc8b/frame 0xda6d0ca4 svc_thread_start(d80e40c0,da6d0ce8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xda6d0cac fork_exit(c0f656a0,d80e40c0,da6d0ce8) at fork_exit+0x7e/frame 0xda6d0cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xda6d0cd4 --- trap 0x20, eip = 0, esp = 0xda6d0d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 565 tid 100153 td 0xdc33f000 sched_switch(dc33f000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xda6d5aa8 mi_switch(104,0,c16848e5,22b,dc33f000,...) at mi_switch+0x1f3/frame 0xda6d5ae8 sleepq_switch(dc33f000,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda6d5b1c sleepq_catch_signals(da6d5b84,c0c85000,d80e40d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xda6d5b60 sleepq_wait_sig(d7c17f50,0,da6d5ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xda6d5b84 _cv_wait_sig(d7c17f50,d80e40c0,c16c2ceb,51e,0,...) at _cv_wait_sig+0x21f/frame 0xda6d5bc8 svc_run_internal(da6d5cd4,c0c6573e,d80e40c0,da6d5ce8,c167399c,...) at svc_run_internal+0xc8b/frame 0xda6d5ca4 svc_thread_start(d80e40c0,da6d5ce8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xda6d5cac fork_exit(c0f656a0,d80e40c0,da6d5ce8) at fork_exit+0x7e/frame 0xda6d5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xda6d5cd4 --- trap 0x20, eip = 0, esp = 0xda6d5d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 565 tid 100154 td 0xdc347380 sched_switch(dc347380,0,104,189,c1b81700,...) at sched_switch+0x80c/frame 0xda6da2e0 mi_switch(104,0,c16848e5,22b,dc347380,...) at mi_switch+0x1f3/frame 0xda6da31c sleepq_switch(dc347380,0,c16848e5,2b3,dc347380,...) at sleepq_switch+0x110/frame 0xda6da350 sleepq_wait(c1bed7e4,54,c168e396,0,0,...) at sleepq_wait+0x48/frame 0xda6da374 _sleep(c1bed7e4,c1949400,54,c168e396,0,...) at _sleep+0x396/frame 0xda6da3c8 bufwrite(cb40d2d4,c16907c1,3f1,0,0,...) at bufwrite+0x2f6/frame 0xda6da40c cluster_wbuild(dcdfa71c,4000,2fa0,0,8,...) at cluster_wbuild+0x51e/frame 0xda6da478 cluster_write(dcdfa71c,cb5bc300,bea0000,0,7f,...) at cluster_write+0x1a6/frame 0xda6da518 ffs_write(da6da6a0,c1892861,da6da5f0,c0d12278,c254ee48,...) at ffs_write+0x4a2/frame 0xda6da598 VOP_WRITE_APV(c1974f74,da6da6a0,2,e0819600,e0819760,...) at VOP_WRITE_APV+0x187/frame 0xda6da668 nfsvno_write(dcdfa71c,be90000,0,10000,2d,...) at nfsvno_write+0x127/frame 0xda6da6c8 nfsrvd_write(da6daad8,0,dcdfa71c,dc347380,da6daa18,...) at nfsrvd_write+0x4d8/frame 0xda6da920 nfsrvd_dorpc(da6daad8,0,0,ffffffff,0,...) at nfsrvd_dorpc+0x79c/frame 0xda6daa90 nfssvc_program(dd943800,d7c49800,c16c2ceb,517,0,...) at nfssvc_program+0x56f/frame 0xda6dabc8 svc_run_internal(da6dacd4,c0c6573e,d80e40c0,da6dace8,c167399c,...) at svc_run_internal+0xa52/frame 0xda6daca4 svc_thread_start(d80e40c0,da6dace8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xda6dacac fork_exit(c0f656a0,d80e40c0,da6dace8) at fork_exit+0x7e/frame 0xda6dacd4 fork_trampoline() at fork_trampoline+0x8/frame 0xda6dacd4 --- trap 0x20, eip = 0, esp = 0xda6dad20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 565 tid 100155 td 0xdc347000 sched_switch(dc347000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xda6dfaa8 mi_switch(104,0,c16848e5,22b,dc347000,...) at mi_switch+0x1f3/frame 0xda6dfae8 sleepq_switch(dc347000,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda6dfb1c sleepq_catch_signals(da6dfb84,c0c85000,d80e40d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xda6dfb60 sleepq_wait_sig(d7c180d0,0,da6dfba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xda6dfb84 _cv_wait_sig(d7c180d0,d80e40c0,c16c2ceb,51e,0,...) at _cv_wait_sig+0x21f/frame 0xda6dfbc8 svc_run_internal(da6dfcd4,c0c6573e,d80e40c0,da6dfce8,c167399c,...) at svc_run_internal+0xc8b/frame 0xda6dfca4 svc_thread_start(d80e40c0,da6dfce8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xda6dfcac fork_exit(c0f656a0,d80e40c0,da6dfce8) at fork_exit+0x7e/frame 0xda6dfcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xda6dfcd4 --- trap 0x20, eip = 0, esp = 0xda6dfd20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 565 tid 100156 td 0xdc346a80 sched_switch(dc346a80,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xda6e4aa8 mi_switch(104,0,c16848e5,22b,dc346a80,...) at mi_switch+0x1f3/frame 0xda6e4ae8 sleepq_switch(dc346a80,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda6e4b1c sleepq_catch_signals(da6e4b84,c0c85000,d80e40d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xda6e4b60 sleepq_wait_sig(d7f9e950,0,da6e4ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xda6e4b84 _cv_wait_sig(d7f9e950,d80e40c0,c16c2ceb,51e,0,...) at _cv_wait_sig+0x21f/frame 0xda6e4bc8 svc_run_internal(da6e4cd4,c0c6573e,d80e40c0,da6e4ce8,c167399c,...) at svc_run_internal+0xc8b/frame 0xda6e4ca4 svc_thread_start(d80e40c0,da6e4ce8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xda6e4cac fork_exit(c0f656a0,d80e40c0,da6e4ce8) at fork_exit+0x7e/frame 0xda6e4cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xda6e4cd4 --- trap 0x20, eip = 0, esp = 0xda6e4d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 565 tid 100157 td 0xdc346700 sched_switch(dc346700,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xda6e9aa8 mi_switch(104,0,c16848e5,22b,dc346700,...) at mi_switch+0x1f3/frame 0xda6e9ae8 sleepq_switch(dc346700,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xda6e9b1c sleepq_catch_signals(da6e9b84,c0c85000,d80e40d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xda6e9b60 sleepq_wait_sig(d8256ed0,0,da6e9ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xda6e9b84 _cv_wait_sig(d8256ed0,d80e40c0,c16c2ceb,51e,0,...) at _cv_wait_sig+0x21f/frame 0xda6e9bc8 svc_run_internal(da6e9cd4,c0c6573e,d80e40c0,da6e9ce8,c167399c,...) at svc_run_internal+0xc8b/frame 0xda6e9ca4 svc_thread_start(d80e40c0,da6e9ce8,c167399c,407,0,...) at svc_thread_start+0xd/frame 0xda6e9cac fork_exit(c0f656a0,d80e40c0,da6e9ce8) at fork_exit+0x7e/frame 0xda6e9cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xda6e9cd4 --- trap 0x20, eip = 0, esp = 0xda6e9d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 562 tid 100111 td 0xd80ee380 sched_switch(d80ee380,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xdbada8b0 mi_switch(104,0,c16848e5,22b,d80ee380,...) at mi_switch+0x1f3/frame 0xdbada8f0 sleepq_switch(d80ee380,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xdbada924 sleepq_catch_signals(dbada98c,c0c85000,d84ae0a0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbada968 sleepq_wait_sig(d84ae0a4,0,dbada9ac,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbada98c _cv_wait_sig(d84ae0a4,d84ae090,c1688143,73d,dbef8800,...) at _cv_wait_sig+0x21f/frame 0xdbada9d0 seltdwait(ffffffff,0,0,d80ee380,0,...) at seltdwait+0xbb/frame 0xdbadaa00 kern_select(d80ee380,7,bfbfec40,0,0,...) at kern_select+0x876/frame 0xdbadaba0 sys_select(d80ee380,d80ee604,c16733db,4,c1886e6f,...) at sys_select+0x68/frame 0xdbadabe8 syscall(dbadace8) at syscall+0x6ee/frame 0xdbadacdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdbadacdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2820007f, esp = 0xbfbfea44, ebp = 0xbfbfea68 --- Tracing command mountd pid 556 tid 100125 td 0xd7fd4380 sched_switch(d7fd4380,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xdbbaa8b0 mi_switch(104,0,c16848e5,22b,d7fd4380,...) at mi_switch+0x1f3/frame 0xdbbaa8f0 sleepq_switch(d7fd4380,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xdbbaa924 sleepq_catch_signals(dbbaa98c,c0c85000,d81ffce0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbbaa968 sleepq_wait_sig(d81ffce4,0,dbbaa9ac,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbbaa98c _cv_wait_sig(d81ffce4,d81ffcd0,c1688143,73d,dc0db800,...) at _cv_wait_sig+0x21f/frame 0xdbbaa9d0 seltdwait(ffffffff,0,0,d7fd4380,0,...) at seltdwait+0xbb/frame 0xdbbaaa00 kern_select(d7fd4380,a,bfbfe8e0,0,0,...) at kern_select+0x876/frame 0xdbbaaba0 sys_select(d7fd4380,d7fd4604,c16733db,4,c1886e6f,...) at sys_select+0x68/frame 0xdbbaabe8 syscall(dbbaace8) at syscall+0x6ee/frame 0xdbbaacdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdbbaacdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2821907f, esp = 0xbfbfe84c, ebp = 0xbfbfe870 --- Tracing command nfsuserd pid 549 tid 100118 td 0xd80eca80 sched_switch(d80eca80,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xdbb08890 mi_switch(104,0,c16848e5,22b,d80eca80,...) at mi_switch+0x1f3/frame 0xdbb088d0 sleepq_switch(d80eca80,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xdbb08904 sleepq_catch_signals(8,c1678f47,cb,d80eca80,d80eca80,...) at sleepq_catch_signals+0x360/frame 0xdbb08948 sleepq_timedwait_sig(d7fd97a4,0,dbb089ac,e0000000,1,...) at sleepq_timedwait_sig+0x17/frame 0xdbb08988 _cv_timedwait_sig_sbt(d7fd97a4,d7fd9790,1e50c9a,fd69,e0000000,...) at _cv_timedwait_sig_sbt+0x24a/frame 0xdbb089d0 seltdwait(fd69,e0000000,1,d80eca80,0,...) at seltdwait+0x82/frame 0xdbb08a00 kern_select(d80eca80,7,bfbfdb80,0,0,...) at kern_select+0x876/frame 0xdbb08ba0 sys_select(d80eca80,d80ecd04,c16733db,4,c167d7a2,...) at sys_select+0x68/frame 0xdbb08be8 syscall(dbb08ce8) at syscall+0x6ee/frame 0xdbb08cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdbb08cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281ff07f, esp = 0xbfbfdacc, ebp = 0xbfbfdc18 --- Tracing command nfsuserd pid 548 tid 100123 td 0xd7fd4a80 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c16828e4,c0b113e5,c19280bc,c19281a0,e0275460,...) at db_trace_self_wrapper+0x2a/frame 0xe0275428 kdb_backtrace(c1682961,c0d04fff,e0275598,c127c245,c1685471,...) at kdb_backtrace+0x2d/frame 0xe0275490 kdb_reenter(c1685471,244,c0aa9035,aa65e44,700,...) at kdb_reenter+0x2a/frame 0xe02754a0 trap(e02755a4) at trap+0xb5/frame 0xe0275598 calltrap() at calltrap+0x6/frame 0xe0275598 --- trap 0xc, eip = 0xc1266509, esp = 0xe02755e4, ebp = 0xe0275600 --- db_trace_thread(d7fd4a80,ffffffff,224,1871b,d7fd4a80,...) at db_trace_thread+0x29/frame 0xe0275600 _db_stack_trace_all(c0cef54a,0,ffffffff,e0275698,c199a950,...) at _db_stack_trace_all+0xe9/frame 0xe027566c db_command(c199b76c,0,c199b368,c199b76b,60,...) at db_command+0x297/frame 0xe0275720 db_script_exec(c1bf4618,0,e02757c8,e02757bc,c199a950,...) at db_script_exec+0x168/frame 0xe0275790 db_command(c12dca73,e02758a8,c05d4f8d,c167c937,ffff0ff0,...) at db_command+0x297/frame 0xe0275844 db_command_loop(c167c937,ffff0ff0,e027586f,e027586e,c19281a0,...) at db_command_loop+0x50/frame 0xe0275850 db_trap(3,ffff0ff0,c168292b,0,0,...) at db_trap+0x10d/frame 0xe02758a8 kdb_trap(3,ffff0ff0,e02759e4,e0275990,e0275a01,...) at kdb_trap+0x11e/frame 0xe02758e0 trap(e02759e4) at trap+0x817/frame 0xe02759d8 calltrap() at calltrap+0x6/frame 0xe02759d8 --- trap 0x3, eip = 0xc0cef54a, esp = 0xe0275a24, ebp = 0xe0275a30 --- kdb_enter(c167c937,c167c937,0,e0275a84,b,...) at kdb_enter+0x3a/frame 0xe0275a30 vpanic(c12b7617,e0275a84,e0275a84,e0275aa0,c10085d5,...) at vpanic+0x150/frame 0xe0275a64 panic(c12b7617,c1c1de94,c16d29f5,c17,1000004,...) at panic+0x1b/frame 0xe0275a78 vm_page_enqueue(c3aa8234,0,c16d03de,4f3,0,...) at vm_page_enqueue+0xf5/frame 0xe0275aa0 vm_fault_hold(cb7b91c8,284d9000,2,0,0,...) at vm_fault_hold+0x2052/frame 0xe0275b78 vm_fault(cb7b91c8,284d9000,2,0,1,...) at vm_fault+0x83/frame 0xe0275ba0 trap_pfault(284d9950,e0275ce8,d819b380,dd3190b8,e0275c48,...) at trap_pfault+0x109/frame 0xe0275be8 trap(e0275ce8) at trap+0x4d9/frame 0xe0275cdc calltrap() at calltrap+0x6/frame 0xe0275cdc --- trap 0xc, eip = 0x281b3f4b, esp = 0xbfbfe390, ebp = 0xbfbfe3c0 --- Tracing command rpcbind pid 422 tid 100108 td 0xd7fd5380 sched_switch(d7fd5380,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xdbac38c0 mi_switch(104,0,c16848e5,22b,d7fd5380,...) at mi_switch+0x1f3/frame 0xdbac3900 sleepq_switch(d7fd5380,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xdbac3934 sleepq_catch_signals(8,c1678f47,cb,d7fd5380,d7fd5380,...) at sleepq_catch_signals+0x360/frame 0xdbac3978 sleepq_timedwait_sig(d81ffd24,0,dbac39dc,e0000000,1,...) at sleepq_timedwait_sig+0x17/frame 0xdbac39b8 _cv_timedwait_sig_sbt(d81ffd24,d81ffd10,61624816,fd81,e0000000,...) at _cv_timedwait_sig_sbt+0x24a/frame 0xdbac3a00 seltdwait(fd81,e0000000,1,d7fd5380,0,...) at seltdwait+0x82/frame 0xdbac3a30 kern_poll(d7fd5380,bfbfcdb0,8,dbac3bd0,0,...) at kern_poll+0x4ab/frame 0xdbac3bb0 sys_poll(d7fd5380,d7fd5604,c16733db,4,c1886e6f,...) at sys_poll+0x67/frame 0xdbac3be8 syscall(dbac3ce8) at syscall+0x6ee/frame 0xdbac3cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdbac3cdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x281b031b, esp = 0xbfbfcbe4, ebp = 0xbfbfcbf8 --- Tracing command syslogd pid 413 tid 100107 td 0xd7fd5700 sched_switch(d7fd5700,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xdbabe8b0 mi_switch(104,0,c16848e5,22b,d7fd5700,...) at mi_switch+0x1f3/frame 0xdbabe8f0 sleepq_switch(d7fd5700,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xdbabe924 sleepq_catch_signals(dbabe98c,c0c85000,d81ffd60,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbabe968 sleepq_wait_sig(d81ffd64,0,dbabe9ac,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbabe98c _cv_wait_sig(d81ffd64,d81ffd50,c1688143,73d,dbf6e600,...) at _cv_wait_sig+0x21f/frame 0xdbabe9d0 seltdwait(ffffffff,0,0,d7fd5700,0,...) at seltdwait+0xbb/frame 0xdbabea00 kern_select(d7fd5700,a,280900c0,0,0,...) at kern_select+0x876/frame 0xdbabeba0 sys_select(d7fd5700,d7fd5984,c16733db,4,c167d7a2,...) at sys_select+0x68/frame 0xdbabebe8 syscall(dbabece8) at syscall+0x6ee/frame 0xdbabecdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdbabecdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2821807f, esp = 0xbfbfe874, ebp = 0xbfbfe898 --- Tracing command devd pid 341 tid 100119 td 0xd80ec700 sched_switch(d80ec700,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xdbb0e890 mi_switch(104,0,c16848e5,22b,d80ec700,...) at mi_switch+0x1f3/frame 0xdbb0e8d0 sleepq_switch(d80ec700,0,c16848e5,1ca,0,...) at sleepq_switch+0x110/frame 0xdbb0e904 sleepq_catch_signals(8,c1678f47,cb,d80ec700,d80ec700,...) at sleepq_catch_signals+0x360/frame 0xdbb0e948 sleepq_timedwait_sig(d7fd97e4,0,dbb0e9ac,c0000000,3,...) at sleepq_timedwait_sig+0x17/frame 0xdbb0e988 _cv_timedwait_sig_sbt(d7fd97e4,d7fd97d0,c78718ba,fda3,c0000000,...) at _cv_timedwait_sig_sbt+0x24a/frame 0xdbb0e9d0 seltdwait(fda3,c0000000,3,d80ec700,0,...) at seltdwait+0x82/frame 0xdbb0ea00 kern_select(d80ec700,6,bfbfcda0,0,0,...) at kern_select+0x876/frame 0xdbb0eba0 sys_select(d80ec700,d80ec984,c16733db,4,c1886e6f,...) at sys_select+0x68/frame 0xdbb0ebe8 syscall(dbb0ece8) at syscall+0x6ee/frame 0xdbb0ecdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdbb0ecdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x80abfcb, esp = 0xbfbfcd0c, ebp = 0xbfbfee38 --- Tracing command vnlru pid 24 tid 100102 td 0xc9767380 sched_switch(c9767380,0,104,189,c1b81dc0,...) at sched_switch+0x80c/frame 0xdba9fb30 mi_switch(104,0,c16848e5,22b,c9767380,...) at mi_switch+0x1f3/frame 0xdba9fb6c sleepq_switch(c9767380,0,c16848e5,2d6,fd69,...) at sleepq_switch+0x110/frame 0xdba9fba0 sleepq_timedwait(d86986b0,60,0,0,0,...) at sleepq_timedwait+0x53/frame 0xdba9fbdc _sleep(d86986b0,c1bede0c,260,c1692d19,fffffed8,...) at _sleep+0x332/frame 0xdba9fc30 vnlru_proc(0,dba9fce8,c167399c,407,0,...) at vnlru_proc+0xbc/frame 0xdba9fcac fork_exit(c0d82ba0,0,dba9fce8) at fork_exit+0x7e/frame 0xdba9fcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdba9fcd4 --- trap 0, eip = 0, esp = 0xdba9fd20, ebp = 0 --- Tracing command syncer pid 23 tid 100100 td 0xc9767700 sched_switch(c9767700,0,104,189,c1b81dc0,...) at sched_switch+0x80c/frame 0xdba95b48 mi_switch(104,0,c16848e5,22b,c9767700,...) at mi_switch+0x1f3/frame 0xdba95b84 sleepq_switch(c9767700,0,c16848e5,2d6,c9767700,...) at sleepq_switch+0x110/frame 0xdba95bb8 sleepq_timedwait(c1bede60,0,dba95c1c,0,0,...) at sleepq_timedwait+0x53/frame 0xdba95bf8 _cv_timedwait_sbt(c1bede60,c1bede40,fffffed8,0,0,...) at _cv_timedwait_sbt+0x24a/frame 0xdba95c40 sched_sync(0,dba95ce8,c167399c,407,0,...) at sched_sync+0x6e0/frame 0xdba95cac fork_exit(c0d83520,0,dba95ce8) at fork_exit+0x7e/frame 0xdba95cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdba95cd4 --- trap 0, eip = 0, esp = 0xdba95d20, ebp = 0 --- Tracing command bufdaemon pid 22 tid 100099 td 0xc9767a80 sched_switch(c9767a80,0,104,189,c1b81040,...) at sched_switch+0x80c/frame 0xdba90b00 mi_switch(104,0,c16848e5,22b,c9767a80,...) at mi_switch+0x1f3/frame 0xdba90b3c sleepq_switch(c9767a80,0,c16848e5,2b3,c9767a80,...) at sleepq_switch+0x110/frame 0xdba90b70 sleepq_wait(c1bed7e4,54,c168e396,0,0,...) at sleepq_wait+0x48/frame 0xdba90b94 _sleep(c1bed7e4,c1949400,54,c168e396,0,...) at _sleep+0x396/frame 0xdba90be8 flushbufqueues(147,0,c168e37e,d37,fffffed8,...) at flushbufqueues+0x6a0/frame 0xdba90c68 buf_daemon(0,dba90ce8,c167399c,407,0,...) at buf_daemon+0x1c6/frame 0xdba90cac fork_exit(c0d60070,0,dba90ce8) at fork_exit+0x7e/frame 0xdba90cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdba90cd4 --- trap 0, eip = 0, esp = 0xdba90d20, ebp = 0 --- Tracing command bufdaemon pid 22 tid 100101 td 0xd7fd6000 sched_switch(d7fd6000,0,104,189,c1b81700,...) at sched_switch+0x80c/frame 0xdba9ab60 mi_switch(104,0,c16848e5,22b,d7fd6000,...) at mi_switch+0x1f3/frame 0xdba9ab9c sleepq_switch(d7fd6000,0,c16848e5,2d6,fd69,...) at sleepq_switch+0x110/frame 0xdba9abd0 sleepq_timedwait(c194a740,5c,0,0,0,...) at sleepq_timedwait+0x53/frame 0xdba9ac0c _sleep(c194a740,c194a680,25c,c1663b1b,fffffed8,...) at _sleep+0x332/frame 0xdba9ac60 bufspace_daemon(c1949540,dba9ace8,c167399c,407,0,...) at bufspace_daemon+0x349/frame 0xdba9acac fork_exit(c0d60470,c1949540,dba9ace8) at fork_exit+0x7e/frame 0xdba9acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdba9acd4 --- trap 0, eip = 0, esp = 0xdba9ad20, ebp = 0 --- Tracing command bufdaemon pid 22 tid 100114 td 0xc9766700 sched_switch(c9766700,0,104,189,c1b80980,...) at sched_switch+0x80c/frame 0xdbaecb70 mi_switch(104,0,c16848e5,22b,c9766700,...) at mi_switch+0x1f3/frame 0xdbaecbac sleepq_switch(c9766700,0,c16848e5,2d6,fd69,...) at sleepq_switch+0x110/frame 0xdbaecbe0 sleepq_timedwait(d84dc084,54,0,0,0,...) at sleepq_timedwait+0x53/frame 0xdbaecc1c _sleep(d84dc084,d84dc000,54,c16cad21,7fffff6c,...) at _sleep+0x332/frame 0xdbaecc70 softdep_flush(dbd7a000,dbaecce8,c167399c,407,0,...) at softdep_flush+0x199/frame 0xdbaeccac fork_exit(c0fa9680,dbd7a000,dbaecce8) at fork_exit+0x7e/frame 0xdbaeccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbaeccd4 --- trap 0, eip = 0, esp = 0xdbaecd20, ebp = 0 --- Tracing command bufdaemon pid 22 tid 100115 td 0xc9766380 sched_switch(c9766380,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xdbaf18d0 mi_switch(104,0,c16848e5,22b,c9766380,...) at mi_switch+0x1f3/frame 0xdbaf1910 sleepq_switch(c9766380,0,c16848e5,2b3,c9766380,...) at sleepq_switch+0x110/frame 0xdbaf1944 sleepq_wait(cb5e8bf4,5c,c168e859,0,0,...) at sleepq_wait+0x48/frame 0xdbaf1968 _sleep(cb5e8bf4,c95d7330,5c,c168e859,0,...) at _sleep+0x396/frame 0xdbaf19bc bufwait(cb5e8bf4,0,0,0,0,...) at bufwait+0xa4/frame 0xdbaf19f8 breadn_flags(d804d000,36cbe20,0,4000,0,...) at breadn_flags+0x1b0/frame 0xdbaf1a28 indir_trunc(0,ffffe7f4,ffffffff,4000,0,...) at indir_trunc+0x840/frame 0xdbaf1ae0 indir_trunc(0,fffff7f3,ffffffff,c193f788,1,...) at indir_trunc+0x478/frame 0xdbaf1b98 handle_workitem_freeblocks(0,dbaf1c28,2,6f0,dbd79000,...) at handle_workitem_freeblocks+0x21d/frame 0xdbaf1be8 process_worklist_item(200,c16c9373,639,dbd79000,5ac05e3d,...) at process_worklist_item+0x25f/frame 0xdbaf1c40 softdep_process_worklist(d84dbe10,c16c9373,585,c16cad21,7fffff6c,...) at softdep_process_worklist+0xa5/frame 0xdbaf1c70 softdep_flush(dbd79000,dbaf1ce8,c167399c,407,0,...) at softdep_flush+0xde/frame 0xdbaf1cac fork_exit(c0fa9680,dbd79000,dbaf1ce8) at fork_exit+0x7e/frame 0xdbaf1cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbaf1cd4 --- trap 0, eip = 0, esp = 0xdbaf1d20, ebp = 0 --- Tracing command bufdaemon pid 22 tid 100116 td 0xc9766000 sched_switch(c9766000,0,104,189,c1b80980,...) at sched_switch+0x80c/frame 0xdbaf6b70 mi_switch(104,0,c16848e5,22b,c9766000,...) at mi_switch+0x1f3/frame 0xdbaf6bac sleepq_switch(c9766000,0,c16848e5,2d6,fd69,...) at sleepq_switch+0x110/frame 0xdbaf6be0 sleepq_timedwait(d84dbc84,54,0,0,0,...) at sleepq_timedwait+0x53/frame 0xdbaf6c1c _sleep(d84dbc84,d84dbc00,54,c16cad21,7fffff6c,...) at _sleep+0x332/frame 0xdbaf6c70 softdep_flush(dbd78000,dbaf6ce8,c167399c,407,0,...) at softdep_flush+0x199/frame 0xdbaf6cac fork_exit(c0fa9680,dbd78000,dbaf6ce8) at fork_exit+0x7e/frame 0xdbaf6cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbaf6cd4 --- trap 0, eip = 0, esp = 0xdbaf6d20, ebp = 0 --- Tracing command bufdaemon pid 22 tid 100117 td 0xc964da80 sched_switch(c964da80,0,104,189,c1b81dc0,...) at sched_switch+0x80c/frame 0xdbafbb70 mi_switch(104,0,c16848e5,22b,c964da80,...) at mi_switch+0x1f3/frame 0xdbafbbac sleepq_switch(c964da80,0,c16848e5,2d6,fd69,...) at sleepq_switch+0x110/frame 0xdbafbbe0 sleepq_timedwait(d84dba84,54,0,0,0,...) at sleepq_timedwait+0x53/frame 0xdbafbc1c _sleep(d84dba84,d84dba00,54,c16cad21,7fffff6c,...) at _sleep+0x332/frame 0xdbafbc70 softdep_flush(dbe5e000,dbafbce8,c167399c,407,0,...) at softdep_flush+0x199/frame 0xdbafbcac fork_exit(c0fa9680,dbe5e000,dbafbce8) at fork_exit+0x7e/frame 0xdbafbcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbafbcd4 --- trap 0, eip = 0, esp = 0xdbafbd20, ebp = 0 --- Tracing command vmdaemon pid 21 tid 100096 td 0xc9768000 sched_switch(c9768000,0,104,189,c1b80980,...) at sched_switch+0x80c/frame 0xd7bfdb50 mi_switch(104,0,c16848e5,22b,c9768000,...) at mi_switch+0x1f3/frame 0xd7bfdb8c sleepq_switch(c9768000,0,c16848e5,2b3,c9768000,...) at sleepq_switch+0x110/frame 0xd7bfdbc0 sleepq_wait(c1bf2dec,74,c168f53c,0,0,...) at sleepq_wait+0x48/frame 0xd7bfdbe4 _sleep(c1bf2dec,c1bf2dd8,74,c168f53c,0,...) at _sleep+0x396/frame 0xd7bfdc38 vm_daemon(0,d7bfdce8,c167399c,407,0,...) at vm_daemon+0xa6/frame 0xd7bfdcac fork_exit(c1016410,0,d7bfdce8) at fork_exit+0x7e/frame 0xd7bfdcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7bfdcd4 --- trap 0, eip = 0, esp = 0xd7bfdd20, ebp = 0 --- Tracing command pagedaemon pid 20 tid 100095 td 0xc9768380 sched_switch(c9768380,0,104,189,c1b81040,...) at sched_switch+0x80c/frame 0xd7bf8ad8 mi_switch(104,0,c16848e5,22b,c9768380,...) at mi_switch+0x1f3/frame 0xd7bf8b14 sleepq_switch(c9768380,0,c16848e5,2d6,fd69,...) at sleepq_switch+0x110/frame 0xd7bf8b48 sleepq_timedwait(c1c1e14c,54,0,0,0,...) at sleepq_timedwait+0x53/frame 0xd7bf8b84 _sleep(c1c1e14c,c1c1df80,254,c168f53c,1999997c,...) at _sleep+0x332/frame 0xd7bf8bd8 vm_pageout_worker(0,0,cb7ad358,0,0,...) at vm_pageout_worker+0x2dc/frame 0xd7bf8c7c vm_pageout(0,d7bf8ce8,c167399c,407,0,...) at vm_pageout+0x16a/frame 0xd7bf8cac fork_exit(c100bb00,0,d7bf8ce8) at fork_exit+0x7e/frame 0xd7bf8cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7bf8cd4 --- trap 0, eip = 0, esp = 0xd7bf8d20, ebp = 0 --- Tracing command pagedaemon pid 20 tid 100097 td 0xd821c700 sched_switch(d821c700,0,104,189,c1b81dc0,...) at sched_switch+0x80c/frame 0xdba86b10 mi_switch(104,0,c16848e5,22b,d821c700,...) at mi_switch+0x1f3/frame 0xdba86b4c sleepq_switch(d821c700,0,c16848e5,2b3,d821c700,...) at sleepq_switch+0x110/frame 0xdba86b80 sleepq_wait(c1c1e158,54,c16d3ae2,0,0,...) at sleepq_wait+0x48/frame 0xdba86ba4 _sleep(c1c1e158,c1c1dec0,54,c16d3ae2,0,...) at _sleep+0x396/frame 0xdba86bf8 vm_pageout_laundry_worker(0,dba86ce8,c167399c,407,0,...) at vm_pageout_laundry_worker+0xd68/frame 0xdba86cac fork_exit(c100bcd0,0,dba86ce8) at fork_exit+0x7e/frame 0xdba86cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdba86cd4 --- trap 0, eip = 0, esp = 0xdba86d20, ebp = 0 --- Tracing command pagedaemon pid 20 tid 100098 td 0xd821c380 sched_switch(d821c380,0,104,189,c1b81040,...) at sched_switch+0x80c/frame 0xdba8bb70 mi_switch(104,0,c16848e5,22b,d821c380,...) at mi_switch+0x1f3/frame 0xdba8bbac sleepq_switch(d821c380,0,c16848e5,2d6,c1b91484,...) at sleepq_switch+0x110/frame 0xdba8bbe0 sleepq_timedwait(c0fe9230,54,dba8bc50,0,0,...) at sleepq_timedwait+0x53/frame 0xdba8bc20 _sleep(c0fe9230,c1bf2a9c,54,c16cfcdb,fffffed8,...) at _sleep+0x332/frame 0xdba8bc74 uma_reclaim_worker(0,dba8bce8,c167399c,407,0,...) at uma_reclaim_worker+0x147/frame 0xdba8bcac fork_exit(c0fe98c0,0,dba8bce8) at fork_exit+0x7e/frame 0xdba8bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdba8bcd4 --- trap 0, eip = 0, esp = 0xdba8bd20, ebp = 0 --- Tracing command rand_harvestq pid 19 tid 100092 td 0xd8225380 sched_switch(d8225380,0,104,189,c1b81700,...) at sched_switch+0x80c/frame 0xd7be9b48 mi_switch(104,0,c16848e5,22b,d8225380,...) at mi_switch+0x1f3/frame 0xd7be9b84 sleepq_switch(d8225380,0,c16848e5,2d6,fd69,...) at sleepq_switch+0x110/frame 0xd7be9bb8 sleepq_timedwait(c1a4b9a0,0,0,0,0,...) at sleepq_timedwait+0x53/frame 0xd7be9bf4 _sleep(c1a4b9a0,0,0,c1663b1b,19999999,...) at _sleep+0x332/frame 0xd7be9c48 random_kthread(0,d7be9ce8,c167399c,407,0,...) at random_kthread+0x7c/frame 0xd7be9cac fork_exit(c09b0890,0,d7be9ce8) at fork_exit+0x7e/frame 0xd7be9cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7be9cd4 --- trap 0, eip = 0, esp = 0xd7be9d20, ebp = 0 --- Tracing command sctp_iterator pid 18 tid 100088 td 0xd8226380 sched_switch(d8226380,0,104,189,c1b81dc0,...) at sched_switch+0x80c/frame 0xd7bd5b98 mi_switch(104,0,c16848e5,22b,d8226380,...) at mi_switch+0x1f3/frame 0xd7bd5bd4 sleepq_switch(d8226380,0,c16848e5,2b3,d8226380,...) at sleepq_switch+0x110/frame 0xd7bd5c08 sleepq_wait(c1c1d3a0,0,c16ad6d3,0,0,...) at sleepq_wait+0x48/frame 0xd7bd5c2c _sleep(c1c1d3a0,c1c1d368,0,c16ad6d3,0,...) at _sleep+0x396/frame 0xd7bd5c80 sctp_iterator_thread(0,d7bd5ce8,c167399c,407,0,...) at sctp_iterator_thread+0x7c/frame 0xd7bd5cac fork_exit(c0e4eea0,0,d7bd5ce8) at fork_exit+0x7e/frame 0xd7bd5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7bd5cd4 --- trap 0, eip = 0, esp = 0xd7bd5d20, ebp = 0 --- Tracing command soaiod4 pid 17 tid 100087 td 0xd80ed380 sched_switch(d80ed380,0,104,189,c1b81040,...) at sched_switch+0x80c/frame 0xd7bcfb70 mi_switch(104,0,c16848e5,22b,d80ed380,...) at mi_switch+0x1f3/frame 0xd7bcfbac sleepq_switch(d80ed380,0,c16848e5,2d6,fd71,...) at sleepq_switch+0x110/frame 0xd7bcfbe0 sleepq_timedwait(c1bed418,0,1d,0,0,...) at sleepq_timedwait+0x53/frame 0xd7bcfc1c _sleep(c1bed418,c1bed3f8,0,c1663b1b,ffffdd50,...) at _sleep+0x332/frame 0xd7bcfc70 soaio_kproc_loop(4,d7bcfce8,c167399c,407,0,...) at soaio_kproc_loop+0x1a7/frame 0xd7bcfcac fork_exit(c0d20090,4,d7bcfce8) at fork_exit+0x7e/frame 0xd7bcfcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7bcfcd4 --- trap 0, eip = 0, esp = 0xd7bcfd20, ebp = 0 --- Tracing command soaiod3 pid 16 tid 100086 td 0xd80ed700 sched_switch(d80ed700,0,104,189,c1b81700,...) at sched_switch+0x80c/frame 0xd7bcab70 mi_switch(104,0,c16848e5,22b,d80ed700,...) at mi_switch+0x1f3/frame 0xd7bcabac sleepq_switch(d80ed700,0,c16848e5,2d6,fd71,...) at sleepq_switch+0x110/frame 0xd7bcabe0 sleepq_timedwait(c1bed418,0,1d,0,0,...) at sleepq_timedwait+0x53/frame 0xd7bcac1c _sleep(c1bed418,c1bed3f8,0,c1663b1b,ffffdd50,...) at _sleep+0x332/frame 0xd7bcac70 soaio_kproc_loop(3,d7bcace8,c167399c,407,0,...) at soaio_kproc_loop+0x1a7/frame 0xd7bcacac fork_exit(c0d20090,3,d7bcace8) at fork_exit+0x7e/frame 0xd7bcacd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7bcacd4 --- trap 0, eip = 0, esp = 0xd7bcad20, ebp = 0 --- Tracing command soaiod2 pid 15 tid 100085 td 0xd80eda80 sched_switch(d80eda80,0,104,189,c1b81700,...) at sched_switch+0x80c/frame 0xd7bc5b70 mi_switch(104,0,c16848e5,22b,d80eda80,...) at mi_switch+0x1f3/frame 0xd7bc5bac sleepq_switch(d80eda80,0,c16848e5,2d6,fd71,...) at sleepq_switch+0x110/frame 0xd7bc5be0 sleepq_timedwait(c1bed418,0,1d,0,0,...) at sleepq_timedwait+0x53/frame 0xd7bc5c1c _sleep(c1bed418,c1bed3f8,0,c1663b1b,ffffdd50,...) at _sleep+0x332/frame 0xd7bc5c70 soaio_kproc_loop(2,d7bc5ce8,c167399c,407,0,...) at soaio_kproc_loop+0x1a7/frame 0xd7bc5cac fork_exit(c0d20090,2,d7bc5ce8) at fork_exit+0x7e/frame 0xd7bc5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7bc5cd4 --- trap 0, eip = 0, esp = 0xd7bc5d20, ebp = 0 --- Tracing command soaiod1 pid 9 tid 100084 td 0xd80ee000 sched_switch(d80ee000,0,104,189,c1b81dc0,...) at sched_switch+0x80c/frame 0xd7bc0b70 mi_switch(104,0,c16848e5,22b,d80ee000,...) at mi_switch+0x1f3/frame 0xd7bc0bac sleepq_switch(d80ee000,0,c16848e5,2d6,fd73,...) at sleepq_switch+0x110/frame 0xd7bc0be0 sleepq_timedwait(c1bed418,0,1d,0,0,...) at sleepq_timedwait+0x53/frame 0xd7bc0c1c _sleep(c1bed418,c1bed3f8,0,c1663b1b,ffffdd50,...) at _sleep+0x332/frame 0xd7bc0c70 soaio_kproc_loop(1,d7bc0ce8,c167399c,407,0,...) at soaio_kproc_loop+0x1a7/frame 0xd7bc0cac fork_exit(c0d20090,1,d7bc0ce8) at fork_exit+0x7e/frame 0xd7bc0cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7bc0cd4 --- trap 0, eip = 0, esp = 0xd7bc0d20, ebp = 0 --- Tracing command fdc0 pid 8 tid 100081 td 0xd7fd6a80 sched_switch(d7fd6a80,0,104,189,c1b80980,...) at sched_switch+0x80c/frame 0xd7bb1b40 mi_switch(104,0,c16848e5,22b,d7fd6a80,...) at mi_switch+0x1f3/frame 0xd7bb1b7c sleepq_switch(d7fd6a80,0,c16848e5,2b3,d7fd6a80,...) at sleepq_switch+0x110/frame 0xd7bb1bb0 sleepq_wait(d7c4a23c,5c,c1663b1b,0,0,...) at sleepq_wait+0x48/frame 0xd7bb1bd4 _sleep(d7c4a23c,d7c4a2f0,5c,c1663b1b,0,...) at _sleep+0x396/frame 0xd7bb1c28 fdc_thread(d7c4a200,d7bb1ce8,c167399c,407,0,...) at fdc_thread+0x336/frame 0xd7bb1cac fork_exit(c11ea090,d7c4a200,d7bb1ce8) at fork_exit+0x7e/frame 0xd7bb1cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7bb1cd4 --- trap 0, eip = 0, esp = 0xd7bb1d20, ebp = 0 --- Tracing command usb pid 14 tid 100046 td 0xd7c9c000 sched_switch(d7c9c000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7af9ba8 mi_switch(104,0,c16848e5,22b,d7c9c000,...) at mi_switch+0x1f3/frame 0xd7af9be8 sleepq_switch(d7c9c000,0,c16848e5,2b3,c193d488,...) at sleepq_switch+0x110/frame 0xd7af9c1c sleepq_wait(d7c8bacc,0,d7af9c60,1,0,...) at sleepq_wait+0x48/frame 0xd7af9c40 _cv_wait(d7c8bacc,d7c8bcf8,c16455c6,78,d7c8bad4,...) at _cv_wait+0x21f/frame 0xd7af9c84 usb_process(d7c8bac4,d7af9ce8,c167399c,407,0,...) at usb_process+0x140/frame 0xd7af9cac fork_exit(c0ae1120,d7c8bac4,d7af9ce8) at fork_exit+0x7e/frame 0xd7af9cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7af9cd4 --- trap 0, eip = 0, esp = 0xd7af9d20, ebp = 0 --- Tracing command usb pid 14 tid 100047 td 0xd7c9ba80 sched_switch(d7c9ba80,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7afeba8 mi_switch(104,0,c16848e5,22b,d7c9ba80,...) at mi_switch+0x1f3/frame 0xd7afebe8 sleepq_switch(d7c9ba80,0,c16848e5,2b3,c193d488,...) at sleepq_switch+0x110/frame 0xd7afec1c sleepq_wait(d7c8bafc,0,d7afec60,1,0,...) at sleepq_wait+0x48/frame 0xd7afec40 _cv_wait(d7c8bafc,d7c8bcf8,c16455c6,78,d7c8bb04,...) at _cv_wait+0x21f/frame 0xd7afec84 usb_process(d7c8baf4,d7afece8,c167399c,407,0,...) at usb_process+0x140/frame 0xd7afecac fork_exit(c0ae1120,d7c8baf4,d7afece8) at fork_exit+0x7e/frame 0xd7afecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7afecd4 --- trap 0, eip = 0, esp = 0xd7afed20, ebp = 0 --- Tracing command usb pid 14 tid 100048 td 0xd7c9b700 sched_switch(d7c9b700,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7b03ba8 mi_switch(104,0,c16848e5,22b,d7c9b700,...) at mi_switch+0x1f3/frame 0xd7b03be8 sleepq_switch(d7c9b700,0,c16848e5,2b3,c193d488,...) at sleepq_switch+0x110/frame 0xd7b03c1c sleepq_wait(d7c8bb2c,0,d7b03c60,1,0,...) at sleepq_wait+0x48/frame 0xd7b03c40 _cv_wait(d7c8bb2c,d7c8bcf8,c16455c6,78,d7c8bb34,...) at _cv_wait+0x21f/frame 0xd7b03c84 usb_process(d7c8bb24,d7b03ce8,c167399c,407,0,...) at usb_process+0x140/frame 0xd7b03cac fork_exit(c0ae1120,d7c8bb24,d7b03ce8) at fork_exit+0x7e/frame 0xd7b03cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7b03cd4 --- trap 0, eip = 0, esp = 0xd7b03d20, ebp = 0 --- Tracing command usb pid 14 tid 100049 td 0xd7c9b380 sched_switch(d7c9b380,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7b08ba8 mi_switch(104,0,c16848e5,22b,d7c9b380,...) at mi_switch+0x1f3/frame 0xd7b08be8 sleepq_switch(d7c9b380,0,c16848e5,2b3,c193d488,...) at sleepq_switch+0x110/frame 0xd7b08c1c sleepq_wait(d7c8bb5c,0,d7b08c60,1,0,...) at sleepq_wait+0x48/frame 0xd7b08c40 _cv_wait(d7c8bb5c,d7c8bcf8,c16455c6,78,d7c8bb64,...) at _cv_wait+0x21f/frame 0xd7b08c84 usb_process(d7c8bb54,d7b08ce8,c167399c,407,0,...) at usb_process+0x140/frame 0xd7b08cac fork_exit(c0ae1120,d7c8bb54,d7b08ce8) at fork_exit+0x7e/frame 0xd7b08cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7b08cd4 --- trap 0, eip = 0, esp = 0xd7b08d20, ebp = 0 --- Tracing command usb pid 14 tid 100050 td 0xd7c9b000 sched_switch(d7c9b000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7b0dba8 mi_switch(104,0,c16848e5,22b,d7c9b000,...) at mi_switch+0x1f3/frame 0xd7b0dbe8 sleepq_switch(d7c9b000,0,c16848e5,2b3,c193d488,...) at sleepq_switch+0x110/frame 0xd7b0dc1c sleepq_wait(d7c8bb8c,0,d7b0dc60,1,0,...) at sleepq_wait+0x48/frame 0xd7b0dc40 _cv_wait(d7c8bb8c,d7c8bcf8,c16455c6,78,d7c8bb94,...) at _cv_wait+0x21f/frame 0xd7b0dc84 usb_process(d7c8bb84,d7b0dce8,c167399c,407,0,...) at usb_process+0x140/frame 0xd7b0dcac fork_exit(c0ae1120,d7c8bb84,d7b0dce8) at fork_exit+0x7e/frame 0xd7b0dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7b0dcd4 --- trap 0, eip = 0, esp = 0xd7b0dd20, ebp = 0 --- Tracing command usb pid 14 tid 100052 td 0xd7c92700 sched_switch(d7c92700,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7b18ba8 mi_switch(104,0,c16848e5,22b,d7c92700,...) at mi_switch+0x1f3/frame 0xd7b18be8 sleepq_switch(d7c92700,0,c16848e5,2b3,c193d488,...) at sleepq_switch+0x110/frame 0xd7b18c1c sleepq_wait(d7f40acc,0,d7b18c60,1,0,...) at sleepq_wait+0x48/frame 0xd7b18c40 _cv_wait(d7f40acc,d7f40cf8,c16455c6,78,d7f40ad4,...) at _cv_wait+0x21f/frame 0xd7b18c84 usb_process(d7f40ac4,d7b18ce8,c167399c,407,0,...) at usb_process+0x140/frame 0xd7b18cac fork_exit(c0ae1120,d7f40ac4,d7b18ce8) at fork_exit+0x7e/frame 0xd7b18cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7b18cd4 --- trap 0, eip = 0, esp = 0xd7b18d20, ebp = 0 --- Tracing command usb pid 14 tid 100053 td 0xd7c92380 sched_switch(d7c92380,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7b1dba8 mi_switch(104,0,c16848e5,22b,d7c92380,...) at mi_switch+0x1f3/frame 0xd7b1dbe8 sleepq_switch(d7c92380,0,c16848e5,2b3,c193d488,...) at sleepq_switch+0x110/frame 0xd7b1dc1c sleepq_wait(d7f40afc,0,d7b1dc60,1,0,...) at sleepq_wait+0x48/frame 0xd7b1dc40 _cv_wait(d7f40afc,d7f40cf8,c16455c6,78,d7f40b04,...) at _cv_wait+0x21f/frame 0xd7b1dc84 usb_process(d7f40af4,d7b1dce8,c167399c,407,0,...) at usb_process+0x140/frame 0xd7b1dcac fork_exit(c0ae1120,d7f40af4,d7b1dce8) at fork_exit+0x7e/frame 0xd7b1dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7b1dcd4 --- trap 0, eip = 0, esp = 0xd7b1dd20, ebp = 0 --- Tracing command usb pid 14 tid 100054 td 0xd7c92000 sched_switch(d7c92000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7b22ba8 mi_switch(104,0,c16848e5,22b,d7c92000,...) at mi_switch+0x1f3/frame 0xd7b22be8 sleepq_switch(d7c92000,0,c16848e5,2b3,c193d488,...) at sleepq_switch+0x110/frame 0xd7b22c1c sleepq_wait(d7f40b2c,0,d7b22c60,1,0,...) at sleepq_wait+0x48/frame 0xd7b22c40 _cv_wait(d7f40b2c,d7f40cf8,c16455c6,78,d7f40b34,...) at _cv_wait+0x21f/frame 0xd7b22c84 usb_process(d7f40b24,d7b22ce8,c167399c,407,0,...) at usb_process+0x140/frame 0xd7b22cac fork_exit(c0ae1120,d7f40b24,d7b22ce8) at fork_exit+0x7e/frame 0xd7b22cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7b22cd4 --- trap 0, eip = 0, esp = 0xd7b22d20, ebp = 0 --- Tracing command usb pid 14 tid 100055 td 0xd7f46380 sched_switch(d7f46380,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7b27ba8 mi_switch(104,0,c16848e5,22b,d7f46380,...) at mi_switch+0x1f3/frame 0xd7b27be8 sleepq_switch(d7f46380,0,c16848e5,2b3,c193d488,...) at sleepq_switch+0x110/frame 0xd7b27c1c sleepq_wait(d7f40b5c,0,d7b27c60,1,0,...) at sleepq_wait+0x48/frame 0xd7b27c40 _cv_wait(d7f40b5c,d7f40cf8,c16455c6,78,d7f40b64,...) at _cv_wait+0x21f/frame 0xd7b27c84 usb_process(d7f40b54,d7b27ce8,c167399c,407,0,...) at usb_process+0x140/frame 0xd7b27cac fork_exit(c0ae1120,d7f40b54,d7b27ce8) at fork_exit+0x7e/frame 0xd7b27cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7b27cd4 --- trap 0, eip = 0, esp = 0xd7b27d20, ebp = 0 --- Tracing command usb pid 14 tid 100056 td 0xd7f46000 sched_switch(d7f46000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7b2cba8 mi_switch(104,0,c16848e5,22b,d7f46000,...) at mi_switch+0x1f3/frame 0xd7b2cbe8 sleepq_switch(d7f46000,0,c16848e5,2b3,c193d488,...) at sleepq_switch+0x110/frame 0xd7b2cc1c sleepq_wait(d7f40b8c,0,d7b2cc60,1,0,...) at sleepq_wait+0x48/frame 0xd7b2cc40 _cv_wait(d7f40b8c,d7f40cf8,c16455c6,78,d7f40b94,...) at _cv_wait+0x21f/frame 0xd7b2cc84 usb_process(d7f40b84,d7b2cce8,c167399c,407,0,...) at usb_process+0x140/frame 0xd7b2ccac fork_exit(c0ae1120,d7f40b84,d7b2cce8) at fork_exit+0x7e/frame 0xd7b2ccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7b2ccd4 --- trap 0, eip = 0, esp = 0xd7b2cd20, ebp = 0 --- Tracing command usb pid 14 tid 100058 td 0xd7f45700 sched_switch(d7f45700,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7b37ba8 mi_switch(104,0,c16848e5,22b,d7f45700,...) at mi_switch+0x1f3/frame 0xd7b37be8 sleepq_switch(d7f45700,0,c16848e5,2b3,c193d488,...) at sleepq_switch+0x110/frame 0xd7b37c1c sleepq_wait(d7f47acc,0,d7b37c60,1,0,...) at sleepq_wait+0x48/frame 0xd7b37c40 _cv_wait(d7f47acc,d7f47cf8,c16455c6,78,d7f47ad4,...) at _cv_wait+0x21f/frame 0xd7b37c84 usb_process(d7f47ac4,d7b37ce8,c167399c,407,0,...) at usb_process+0x140/frame 0xd7b37cac fork_exit(c0ae1120,d7f47ac4,d7b37ce8) at fork_exit+0x7e/frame 0xd7b37cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7b37cd4 --- trap 0, eip = 0, esp = 0xd7b37d20, ebp = 0 --- Tracing command usb pid 14 tid 100059 td 0xd7f45380 sched_switch(d7f45380,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7b3cba8 mi_switch(104,0,c16848e5,22b,d7f45380,...) at mi_switch+0x1f3/frame 0xd7b3cbe8 sleepq_switch(d7f45380,0,c16848e5,2b3,c193d488,...) at sleepq_switch+0x110/frame 0xd7b3cc1c sleepq_wait(d7f47afc,0,d7b3cc60,1,0,...) at sleepq_wait+0x48/frame 0xd7b3cc40 _cv_wait(d7f47afc,d7f47cf8,c16455c6,78,d7f47b04,...) at _cv_wait+0x21f/frame 0xd7b3cc84 usb_process(d7f47af4,d7b3cce8,c167399c,407,0,...) at usb_process+0x140/frame 0xd7b3ccac fork_exit(c0ae1120,d7f47af4,d7b3cce8) at fork_exit+0x7e/frame 0xd7b3ccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7b3ccd4 --- trap 0, eip = 0, esp = 0xd7b3cd20, ebp = 0 --- Tracing command usb pid 14 tid 100060 td 0xd7f45000 sched_switch(d7f45000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7b41ba8 mi_switch(104,0,c16848e5,22b,d7f45000,...) at mi_switch+0x1f3/frame 0xd7b41be8 sleepq_switch(d7f45000,0,c16848e5,2b3,c193d488,...) at sleepq_switch+0x110/frame 0xd7b41c1c sleepq_wait(d7f47b2c,0,d7b41c60,1,0,...) at sleepq_wait+0x48/frame 0xd7b41c40 _cv_wait(d7f47b2c,d7f47cf8,c16455c6,78,d7f47b34,...) at _cv_wait+0x21f/frame 0xd7b41c84 usb_process(d7f47b24,d7b41ce8,c167399c,407,0,...) at usb_process+0x140/frame 0xd7b41cac fork_exit(c0ae1120,d7f47b24,d7b41ce8) at fork_exit+0x7e/frame 0xd7b41cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7b41cd4 --- trap 0, eip = 0, esp = 0xd7b41d20, ebp = 0 --- Tracing command usb pid 14 tid 100061 td 0xd7f44a80 sched_switch(d7f44a80,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7b46ba8 mi_switch(104,0,c16848e5,22b,d7f44a80,...) at mi_switch+0x1f3/frame 0xd7b46be8 sleepq_switch(d7f44a80,0,c16848e5,2b3,c193d488,...) at sleepq_switch+0x110/frame 0xd7b46c1c sleepq_wait(d7f47b5c,0,d7b46c60,1,0,...) at sleepq_wait+0x48/frame 0xd7b46c40 _cv_wait(d7f47b5c,d7f47cf8,c16455c6,78,d7f47b64,...) at _cv_wait+0x21f/frame 0xd7b46c84 usb_process(d7f47b54,d7b46ce8,c167399c,407,0,...) at usb_process+0x140/frame 0xd7b46cac fork_exit(c0ae1120,d7f47b54,d7b46ce8) at fork_exit+0x7e/frame 0xd7b46cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7b46cd4 --- trap 0, eip = 0, esp = 0xd7b46d20, ebp = 0 --- Tracing command usb pid 14 tid 100062 td 0xd7f44700 sched_switch(d7f44700,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7b4bba8 mi_switch(104,0,c16848e5,22b,d7f44700,...) at mi_switch+0x1f3/frame 0xd7b4bbe8 sleepq_switch(d7f44700,0,c16848e5,2b3,c193d488,...) at sleepq_switch+0x110/frame 0xd7b4bc1c sleepq_wait(d7f47b8c,0,d7b4bc60,1,0,...) at sleepq_wait+0x48/frame 0xd7b4bc40 _cv_wait(d7f47b8c,d7f47cf8,c16455c6,78,d7f47b94,...) at _cv_wait+0x21f/frame 0xd7b4bc84 usb_process(d7f47b84,d7b4bce8,c167399c,407,0,...) at usb_process+0x140/frame 0xd7b4bcac fork_exit(c0ae1120,d7f47b84,d7b4bce8) at fork_exit+0x7e/frame 0xd7b4bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7b4bcd4 --- trap 0, eip = 0, esp = 0xd7b4bd20, ebp = 0 --- Tracing command usb pid 14 tid 100063 td 0xd7f44380 sched_switch(d7f44380,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7b51ba8 mi_switch(104,0,c16848e5,22b,d7f44380,...) at mi_switch+0x1f3/frame 0xd7b51be8 sleepq_switch(d7f44380,0,c16848e5,2b3,c193d488,...) at sleepq_switch+0x110/frame 0xd7b51c1c sleepq_wait(d7f55acc,0,d7b51c60,1,0,...) at sleepq_wait+0x48/frame 0xd7b51c40 _cv_wait(d7f55acc,d7f55cf8,c16455c6,78,d7f55ad4,...) at _cv_wait+0x21f/frame 0xd7b51c84 usb_process(d7f55ac4,d7b51ce8,c167399c,407,0,...) at usb_process+0x140/frame 0xd7b51cac fork_exit(c0ae1120,d7f55ac4,d7b51ce8) at fork_exit+0x7e/frame 0xd7b51cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7b51cd4 --- trap 0, eip = 0, esp = 0xd7b51d20, ebp = 0 --- Tracing command usb pid 14 tid 100064 td 0xd7f44000 sched_switch(d7f44000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7b56ba8 mi_switch(104,0,c16848e5,22b,d7f44000,...) at mi_switch+0x1f3/frame 0xd7b56be8 sleepq_switch(d7f44000,0,c16848e5,2b3,c193d488,...) at sleepq_switch+0x110/frame 0xd7b56c1c sleepq_wait(d7f55afc,0,d7b56c60,1,0,...) at sleepq_wait+0x48/frame 0xd7b56c40 _cv_wait(d7f55afc,d7f55cf8,c16455c6,78,d7f55b04,...) at _cv_wait+0x21f/frame 0xd7b56c84 usb_process(d7f55af4,d7b56ce8,c167399c,407,0,...) at usb_process+0x140/frame 0xd7b56cac fork_exit(c0ae1120,d7f55af4,d7b56ce8) at fork_exit+0x7e/frame 0xd7b56cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7b56cd4 --- trap 0, eip = 0, esp = 0xd7b56d20, ebp = 0 --- Tracing command usb pid 14 tid 100065 td 0xd7c9da80 sched_switch(d7c9da80,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7b5bba8 mi_switch(104,0,c16848e5,22b,d7c9da80,...) at mi_switch+0x1f3/frame 0xd7b5bbe8 sleepq_switch(d7c9da80,0,c16848e5,2b3,c193d488,...) at sleepq_switch+0x110/frame 0xd7b5bc1c sleepq_wait(d7f55b2c,0,d7b5bc60,1,0,...) at sleepq_wait+0x48/frame 0xd7b5bc40 _cv_wait(d7f55b2c,d7f55cf8,c16455c6,78,d7f55b34,...) at _cv_wait+0x21f/frame 0xd7b5bc84 usb_process(d7f55b24,d7b5bce8,c167399c,407,0,...) at usb_process+0x140/frame 0xd7b5bcac fork_exit(c0ae1120,d7f55b24,d7b5bce8) at fork_exit+0x7e/frame 0xd7b5bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7b5bcd4 --- trap 0, eip = 0, esp = 0xd7b5bd20, ebp = 0 --- Tracing command usb pid 14 tid 100066 td 0xd7c9d700 sched_switch(d7c9d700,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7b60ba8 mi_switch(104,0,c16848e5,22b,d7c9d700,...) at mi_switch+0x1f3/frame 0xd7b60be8 sleepq_switch(d7c9d700,0,c16848e5,2b3,c193d488,...) at sleepq_switch+0x110/frame 0xd7b60c1c sleepq_wait(d7f55b5c,0,d7b60c60,1,0,...) at sleepq_wait+0x48/frame 0xd7b60c40 _cv_wait(d7f55b5c,d7f55cf8,c16455c6,78,d7f55b64,...) at _cv_wait+0x21f/frame 0xd7b60c84 usb_process(d7f55b54,d7b60ce8,c167399c,407,0,...) at usb_process+0x140/frame 0xd7b60cac fork_exit(c0ae1120,d7f55b54,d7b60ce8) at fork_exit+0x7e/frame 0xd7b60cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7b60cd4 --- trap 0, eip = 0, esp = 0xd7b60d20, ebp = 0 --- Tracing command usb pid 14 tid 100067 td 0xd7c9d380 sched_switch(d7c9d380,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7b65ba8 mi_switch(104,0,c16848e5,22b,d7c9d380,...) at mi_switch+0x1f3/frame 0xd7b65be8 sleepq_switch(d7c9d380,0,c16848e5,2b3,c193d488,...) at sleepq_switch+0x110/frame 0xd7b65c1c sleepq_wait(d7f55b8c,0,d7b65c60,1,0,...) at sleepq_wait+0x48/frame 0xd7b65c40 _cv_wait(d7f55b8c,d7f55cf8,c16455c6,78,d7f55b94,...) at _cv_wait+0x21f/frame 0xd7b65c84 usb_process(d7f55b84,d7b65ce8,c167399c,407,0,...) at usb_process+0x140/frame 0xd7b65cac fork_exit(c0ae1120,d7f55b84,d7b65ce8) at fork_exit+0x7e/frame 0xd7b65cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7b65cd4 --- trap 0, eip = 0, esp = 0xd7b65d20, ebp = 0 --- Tracing command usb pid 14 tid 100068 td 0xd7f62700 sched_switch(d7f62700,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7b6bba8 mi_switch(104,0,c16848e5,22b,d7f62700,...) at mi_switch+0x1f3/frame 0xd7b6bbe8 sleepq_switch(d7f62700,0,c16848e5,2b3,c193d488,...) at sleepq_switch+0x110/frame 0xd7b6bc1c sleepq_wait(d7f5cacc,0,d7b6bc60,1,0,...) at sleepq_wait+0x48/frame 0xd7b6bc40 _cv_wait(d7f5cacc,d7f5ccf8,c16455c6,78,d7f5cad4,...) at _cv_wait+0x21f/frame 0xd7b6bc84 usb_process(d7f5cac4,d7b6bce8,c167399c,407,0,...) at usb_process+0x140/frame 0xd7b6bcac fork_exit(c0ae1120,d7f5cac4,d7b6bce8) at fork_exit+0x7e/frame 0xd7b6bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7b6bcd4 --- trap 0, eip = 0, esp = 0xd7b6bd20, ebp = 0 --- Tracing command usb pid 14 tid 100069 td 0xd7f62380 sched_switch(d7f62380,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7b70ba8 mi_switch(104,0,c16848e5,22b,d7f62380,...) at mi_switch+0x1f3/frame 0xd7b70be8 sleepq_switch(d7f62380,0,c16848e5,2b3,c193d488,...) at sleepq_switch+0x110/frame 0xd7b70c1c sleepq_wait(d7f5cafc,0,d7b70c60,1,0,...) at sleepq_wait+0x48/frame 0xd7b70c40 _cv_wait(d7f5cafc,d7f5ccf8,c16455c6,78,d7f5cb04,...) at _cv_wait+0x21f/frame 0xd7b70c84 usb_process(d7f5caf4,d7b70ce8,c167399c,407,0,...) at usb_process+0x140/frame 0xd7b70cac fork_exit(c0ae1120,d7f5caf4,d7b70ce8) at fork_exit+0x7e/frame 0xd7b70cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7b70cd4 --- trap 0, eip = 0, esp = 0xd7b70d20, ebp = 0 --- Tracing command usb pid 14 tid 100070 td 0xd7f62000 sched_switch(d7f62000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7b75ba8 mi_switch(104,0,c16848e5,22b,d7f62000,...) at mi_switch+0x1f3/frame 0xd7b75be8 sleepq_switch(d7f62000,0,c16848e5,2b3,c193d488,...) at sleepq_switch+0x110/frame 0xd7b75c1c sleepq_wait(d7f5cb2c,0,d7b75c60,1,0,...) at sleepq_wait+0x48/frame 0xd7b75c40 _cv_wait(d7f5cb2c,d7f5ccf8,c16455c6,78,d7f5cb34,...) at _cv_wait+0x21f/frame 0xd7b75c84 usb_process(d7f5cb24,d7b75ce8,c167399c,407,0,...) at usb_process+0x140/frame 0xd7b75cac fork_exit(c0ae1120,d7f5cb24,d7b75ce8) at fork_exit+0x7e/frame 0xd7b75cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7b75cd4 --- trap 0, eip = 0, esp = 0xd7b75d20, ebp = 0 --- Tracing command usb pid 14 tid 100071 td 0xd7f61a80 sched_switch(d7f61a80,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7b7aba8 mi_switch(104,0,c16848e5,22b,d7f61a80,...) at mi_switch+0x1f3/frame 0xd7b7abe8 sleepq_switch(d7f61a80,0,c16848e5,2b3,c193d488,...) at sleepq_switch+0x110/frame 0xd7b7ac1c sleepq_wait(d7f5cb5c,0,d7b7ac60,1,0,...) at sleepq_wait+0x48/frame 0xd7b7ac40 _cv_wait(d7f5cb5c,d7f5ccf8,c16455c6,78,d7f5cb64,...) at _cv_wait+0x21f/frame 0xd7b7ac84 usb_process(d7f5cb54,d7b7ace8,c167399c,407,0,...) at usb_process+0x140/frame 0xd7b7acac fork_exit(c0ae1120,d7f5cb54,d7b7ace8) at fork_exit+0x7e/frame 0xd7b7acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7b7acd4 --- trap 0, eip = 0, esp = 0xd7b7ad20, ebp = 0 --- Tracing command usb pid 14 tid 100072 td 0xd7f61700 sched_switch(d7f61700,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7b7fba8 mi_switch(104,0,c16848e5,22b,d7f61700,...) at mi_switch+0x1f3/frame 0xd7b7fbe8 sleepq_switch(d7f61700,0,c16848e5,2b3,c193d488,...) at sleepq_switch+0x110/frame 0xd7b7fc1c sleepq_wait(d7f5cb8c,0,d7b7fc60,1,0,...) at sleepq_wait+0x48/frame 0xd7b7fc40 _cv_wait(d7f5cb8c,d7f5ccf8,c16455c6,78,d7f5cb94,...) at _cv_wait+0x21f/frame 0xd7b7fc84 usb_process(d7f5cb84,d7b7fce8,c167399c,407,0,...) at usb_process+0x140/frame 0xd7b7fcac fork_exit(c0ae1120,d7f5cb84,d7b7fce8) at fork_exit+0x7e/frame 0xd7b7fcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7b7fcd4 --- trap 0, eip = 0, esp = 0xd7b7fd20, ebp = 0 --- Tracing command usb pid 14 tid 100074 td 0xd7f61000 sched_switch(d7f61000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7b8aba8 mi_switch(104,0,c16848e5,22b,d7f61000,...) at mi_switch+0x1f3/frame 0xd7b8abe8 sleepq_switch(d7f61000,0,c16848e5,2b3,c193d488,...) at sleepq_switch+0x110/frame 0xd7b8ac1c sleepq_wait(d7c7cca4,0,d7b8ac60,1,0,...) at sleepq_wait+0x48/frame 0xd7b8ac40 _cv_wait(d7c7cca4,d7c7ced0,c16455c6,78,d7c7ccac,...) at _cv_wait+0x21f/frame 0xd7b8ac84 usb_process(d7c7cc9c,d7b8ace8,c167399c,407,0,...) at usb_process+0x140/frame 0xd7b8acac fork_exit(c0ae1120,d7c7cc9c,d7b8ace8) at fork_exit+0x7e/frame 0xd7b8acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7b8acd4 --- trap 0, eip = 0, esp = 0xd7b8ad20, ebp = 0 --- Tracing command usb pid 14 tid 100075 td 0xd7f60a80 sched_switch(d7f60a80,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7b8fba8 mi_switch(104,0,c16848e5,22b,d7f60a80,...) at mi_switch+0x1f3/frame 0xd7b8fbe8 sleepq_switch(d7f60a80,0,c16848e5,2b3,c193d488,...) at sleepq_switch+0x110/frame 0xd7b8fc1c sleepq_wait(d7c7ccd4,0,d7b8fc60,1,0,...) at sleepq_wait+0x48/frame 0xd7b8fc40 _cv_wait(d7c7ccd4,d7c7ced0,c16455c6,78,d7c7ccdc,...) at _cv_wait+0x21f/frame 0xd7b8fc84 usb_process(d7c7cccc,d7b8fce8,c167399c,407,0,...) at usb_process+0x140/frame 0xd7b8fcac fork_exit(c0ae1120,d7c7cccc,d7b8fce8) at fork_exit+0x7e/frame 0xd7b8fcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7b8fcd4 --- trap 0, eip = 0, esp = 0xd7b8fd20, ebp = 0 --- Tracing command usb pid 14 tid 100076 td 0xd7f60700 sched_switch(d7f60700,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7b94ba8 mi_switch(104,0,c16848e5,22b,d7f60700,...) at mi_switch+0x1f3/frame 0xd7b94be8 sleepq_switch(d7f60700,0,c16848e5,2b3,c193d488,...) at sleepq_switch+0x110/frame 0xd7b94c1c sleepq_wait(d7c7cd04,0,d7b94c60,1,0,...) at sleepq_wait+0x48/frame 0xd7b94c40 _cv_wait(d7c7cd04,d7c7ced0,c16455c6,78,d7c7cd0c,...) at _cv_wait+0x21f/frame 0xd7b94c84 usb_process(d7c7ccfc,d7b94ce8,c167399c,407,0,...) at usb_process+0x140/frame 0xd7b94cac fork_exit(c0ae1120,d7c7ccfc,d7b94ce8) at fork_exit+0x7e/frame 0xd7b94cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7b94cd4 --- trap 0, eip = 0, esp = 0xd7b94d20, ebp = 0 --- Tracing command usb pid 14 tid 100077 td 0xd7f60380 sched_switch(d7f60380,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7b99ba8 mi_switch(104,0,c16848e5,22b,d7f60380,...) at mi_switch+0x1f3/frame 0xd7b99be8 sleepq_switch(d7f60380,0,c16848e5,2b3,c193d488,...) at sleepq_switch+0x110/frame 0xd7b99c1c sleepq_wait(d7c7cd34,0,d7b99c60,1,0,...) at sleepq_wait+0x48/frame 0xd7b99c40 _cv_wait(d7c7cd34,d7c7ced0,c16455c6,78,d7c7cd3c,...) at _cv_wait+0x21f/frame 0xd7b99c84 usb_process(d7c7cd2c,d7b99ce8,c167399c,407,0,...) at usb_process+0x140/frame 0xd7b99cac fork_exit(c0ae1120,d7c7cd2c,d7b99ce8) at fork_exit+0x7e/frame 0xd7b99cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7b99cd4 --- trap 0, eip = 0, esp = 0xd7b99d20, ebp = 0 --- Tracing command usb pid 14 tid 100078 td 0xd7f60000 sched_switch(d7f60000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7b9eba8 mi_switch(104,0,c16848e5,22b,d7f60000,...) at mi_switch+0x1f3/frame 0xd7b9ebe8 sleepq_switch(d7f60000,0,c16848e5,2b3,c193d488,...) at sleepq_switch+0x110/frame 0xd7b9ec1c sleepq_wait(d7c7cd64,0,d7b9ec60,1,0,...) at sleepq_wait+0x48/frame 0xd7b9ec40 _cv_wait(d7c7cd64,d7c7ced0,c16455c6,78,d7c7cd6c,...) at _cv_wait+0x21f/frame 0xd7b9ec84 usb_process(d7c7cd5c,d7b9ece8,c167399c,407,0,...) at usb_process+0x140/frame 0xd7b9ecac fork_exit(c0ae1120,d7c7cd5c,d7b9ece8) at fork_exit+0x7e/frame 0xd7b9ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7b9ecd4 --- trap 0, eip = 0, esp = 0xd7b9ed20, ebp = 0 --- Tracing command cam pid 7 tid 100041 td 0xc9768700 sched_switch(c9768700,0,104,189,c1b81700,...) at sched_switch+0x80c/frame 0xd7aafb78 mi_switch(104,0,c16848e5,22b,c9768700,...) at mi_switch+0x1f3/frame 0xd7aafbb4 sleepq_switch(c9768700,0,c16848e5,2b3,c9768700,...) at sleepq_switch+0x110/frame 0xd7aafbe8 sleepq_wait(c1998d40,5c,c1663b1b,0,0,...) at sleepq_wait+0x48/frame 0xd7aafc0c _sleep(c1998d40,c1998d00,5c,c1663b1b,0,...) at _sleep+0x396/frame 0xd7aafc60 xpt_done_td(c1998d00,d7aafce8,c167399c,407,0,...) at xpt_done_td+0x9b/frame 0xd7aafcac fork_exit(c04e38e0,c1998d00,d7aafce8) at fork_exit+0x7e/frame 0xd7aafcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7aafcd4 --- trap 0, eip = 0, esp = 0xd7aafd20, ebp = 0 --- Tracing command cam pid 7 tid 100094 td 0xd821ca80 sched_switch(d821ca80,0,104,189,c1b81040,...) at sched_switch+0x80c/frame 0xd7bf3b70 mi_switch(104,0,c16848e5,22b,d821ca80,...) at mi_switch+0x1f3/frame 0xd7bf3bac sleepq_switch(d821ca80,0,c16848e5,2b3,d821ca80,...) at sleepq_switch+0x110/frame 0xd7bf3be0 sleepq_wait(c1998c6c,5c,c1663b1b,0,0,...) at sleepq_wait+0x48/frame 0xd7bf3c04 _sleep(c1998c6c,c1998cc0,5c,c1663b1b,0,...) at _sleep+0x396/frame 0xd7bf3c58 xpt_scanner_thread(0,d7bf3ce8,c167399c,407,0,...) at xpt_scanner_thread+0x97/frame 0xd7bf3cac fork_exit(c04e3c60,0,d7bf3ce8) at fork_exit+0x7e/frame 0xd7bf3cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7bf3cd4 --- trap 0, eip = 0, esp = 0xd7bf3d20, ebp = 0 --- Tracing command crypto returns 3 pid 6 tid 100040 td 0xc9768a80 sched_switch(c9768a80,0,104,189,c1b81dc0,...) at sched_switch+0x80c/frame 0xd7aaab70 mi_switch(104,0,c16848e5,22b,c9768a80,...) at mi_switch+0x1f3/frame 0xd7aaabac sleepq_switch(c9768a80,0,c16848e5,2b3,c9768a80,...) at sleepq_switch+0x110/frame 0xd7aaabe0 sleepq_wait(cb782cc4,6c,c16c1f79,0,0,...) at sleepq_wait+0x48/frame 0xd7aaac04 _sleep(cb782cc4,cb782ca8,6c,c16c1f79,0,...) at _sleep+0x396/frame 0xd7aaac58 crypto_ret_proc(cb782ca8,d7aaace8,c167399c,407,0,...) at crypto_ret_proc+0x241/frame 0xd7aaacac fork_exit(c0f50de0,cb782ca8,d7aaace8) at fork_exit+0x7e/frame 0xd7aaacd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7aaacd4 --- trap 0, eip = 0, esp = 0xd7aaad20, ebp = 0 --- Tracing command crypto returns 2 pid 5 tid 100039 td 0xc9642700 sched_switch(c9642700,0,104,189,c1b81040,...) at sched_switch+0x80c/frame 0xd7aa5b70 mi_switch(104,0,c16848e5,22b,c9642700,...) at mi_switch+0x1f3/frame 0xd7aa5bac sleepq_switch(c9642700,0,c16848e5,2b3,c9642700,...) at sleepq_switch+0x110/frame 0xd7aa5be0 sleepq_wait(cb782c8c,6c,c16c1f79,0,0,...) at sleepq_wait+0x48/frame 0xd7aa5c04 _sleep(cb782c8c,cb782c70,6c,c16c1f79,0,...) at _sleep+0x396/frame 0xd7aa5c58 crypto_ret_proc(cb782c70,d7aa5ce8,c167399c,407,0,...) at crypto_ret_proc+0x241/frame 0xd7aa5cac fork_exit(c0f50de0,cb782c70,d7aa5ce8) at fork_exit+0x7e/frame 0xd7aa5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7aa5cd4 --- trap 0, eip = 0, esp = 0xd7aa5d20, ebp = 0 --- Tracing command crypto returns 1 pid 4 tid 100038 td 0xc9642a80 sched_switch(c9642a80,0,104,189,c1b81dc0,...) at sched_switch+0x80c/frame 0xd7aa0b70 mi_switch(104,0,c16848e5,22b,c9642a80,...) at mi_switch+0x1f3/frame 0xd7aa0bac sleepq_switch(c9642a80,0,c16848e5,2b3,c9642a80,...) at sleepq_switch+0x110/frame 0xd7aa0be0 sleepq_wait(cb782c54,6c,c16c1f79,0,0,...) at sleepq_wait+0x48/frame 0xd7aa0c04 _sleep(cb782c54,cb782c38,6c,c16c1f79,0,...) at _sleep+0x396/frame 0xd7aa0c58 crypto_ret_proc(cb782c38,d7aa0ce8,c167399c,407,0,...) at crypto_ret_proc+0x241/frame 0xd7aa0cac fork_exit(c0f50de0,cb782c38,d7aa0ce8) at fork_exit+0x7e/frame 0xd7aa0cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7aa0cd4 --- trap 0, eip = 0, esp = 0xd7aa0d20, ebp = 0 --- Tracing command crypto returns 0 pid 3 tid 100037 td 0xc964b000 sched_switch(c964b000,0,104,189,c1b81dc0,...) at sched_switch+0x80c/frame 0xd7a9bb70 mi_switch(104,0,c16848e5,22b,c964b000,...) at mi_switch+0x1f3/frame 0xd7a9bbac sleepq_switch(c964b000,0,c16848e5,2b3,c964b000,...) at sleepq_switch+0x110/frame 0xd7a9bbe0 sleepq_wait(cb782c1c,6c,c16c1f79,0,0,...) at sleepq_wait+0x48/frame 0xd7a9bc04 _sleep(cb782c1c,cb782c00,6c,c16c1f79,0,...) at _sleep+0x396/frame 0xd7a9bc58 crypto_ret_proc(cb782c00,d7a9bce8,c167399c,407,0,...) at crypto_ret_proc+0x241/frame 0xd7a9bcac fork_exit(c0f50de0,cb782c00,d7a9bce8) at fork_exit+0x7e/frame 0xd7a9bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7a9bcd4 --- trap 0, eip = 0, esp = 0xd7a9bd20, ebp = 0 --- Tracing command crypto pid 2 tid 100036 td 0xc964b380 sched_switch(c964b380,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7a96b80 mi_switch(104,0,c16848e5,22b,c964b380,...) at mi_switch+0x1f3/frame 0xd7a96bc0 sleepq_switch(c964b380,0,c16848e5,2b3,c964b380,...) at sleepq_switch+0x110/frame 0xd7a96bf4 sleepq_wait(c1bf1c34,6c,c16c1f6d,0,0,...) at sleepq_wait+0x48/frame 0xd7a96c18 _sleep(c1bf1c34,c1bf1c1c,6c,c16c1f6d,0,...) at _sleep+0x396/frame 0xd7a96c6c crypto_proc(0,d7a96ce8,c167399c,407,0,...) at crypto_proc+0x2a9/frame 0xd7a96cac fork_exit(c0f509e0,0,d7a96ce8) at fork_exit+0x7e/frame 0xd7a96cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7a96cd4 --- trap 0, eip = 0, esp = 0xd7a96d20, ebp = 0 --- Tracing command geom pid 13 tid 100028 td 0xc964d380 sched_switch(c964d380,0,104,189,c1b81700,...) at sched_switch+0x80c/frame 0xd7a6eb88 mi_switch(104,0,c16848e5,22b,c964d380,...) at mi_switch+0x1f3/frame 0xd7a6ebc4 sleepq_switch(c964d380,0,c16848e5,2b3,c964d380,...) at sleepq_switch+0x110/frame 0xd7a6ebf8 sleepq_wait(c1c19818,5c,c1663b1b,0,0,...) at sleepq_wait+0x48/frame 0xd7a6ec1c _sleep(c1c19818,c1b70428,25c,c1663b1b,0,...) at _sleep+0x396/frame 0xd7a6ec70 g_run_events(0,d7a6ece8,c167399c,407,0,...) at g_run_events+0x67/frame 0xd7a6ecac fork_exit(c0be9e20,0,d7a6ece8) at fork_exit+0x7e/frame 0xd7a6ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7a6ecd4 --- trap 0, eip = 0, esp = 0xd7a6ed20, ebp = 0 --- Tracing command geom pid 13 tid 100029 td 0xc964d000 sched_switch(c964d000,0,104,189,c1b80980,...) at sched_switch+0x80c/frame 0xd7a73b78 mi_switch(104,0,c16848e5,22b,c964d000,...) at mi_switch+0x1f3/frame 0xd7a73bb4 sleepq_switch(c964d000,0,c16848e5,2b3,c964d000,...) at sleepq_switch+0x110/frame 0xd7a73be8 sleepq_wait(c1c1981c,5c,c1663b1b,0,0,...) at sleepq_wait+0x48/frame 0xd7a73c0c _sleep(c1c1981c,c1b70470,25c,c1663b1b,0,...) at _sleep+0x396/frame 0xd7a73c60 g_io_schedule_up(c964d000,0,c1665bc8,61,d7a73cd4,...) at g_io_schedule_up+0xcf/frame 0xd7a73c94 g_up_procbody(0,d7a73ce8,c167399c,407,0,...) at g_up_procbody+0x7d/frame 0xd7a73cac fork_exit(c0be9ea0,0,d7a73ce8) at fork_exit+0x7e/frame 0xd7a73cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7a73cd4 --- trap 0, eip = 0, esp = 0xd7a73d20, ebp = 0 --- Tracing command geom pid 13 tid 100030 td 0xc964ca80 sched_switch(c964ca80,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7a78b70 mi_switch(104,0,c16848e5,22b,c964ca80,...) at mi_switch+0x1f3/frame 0xd7a78bb0 sleepq_switch(c964ca80,0,c16848e5,2b3,c964ca80,...) at sleepq_switch+0x110/frame 0xd7a78be4 sleepq_wait(c1c19820,5c,c1663b1b,0,0,...) at sleepq_wait+0x48/frame 0xd7a78c08 _sleep(c1c19820,c1b70450,25c,c1663b1b,0,...) at _sleep+0x396/frame 0xd7a78c5c g_io_schedule_down(c964ca80,0,c1665bc8,6d,d7a78cd4,...) at g_io_schedule_down+0xec/frame 0xd7a78c94 g_down_procbody(0,d7a78ce8,c167399c,407,0,...) at g_down_procbody+0x7d/frame 0xd7a78cac fork_exit(c0be9f20,0,d7a78ce8) at fork_exit+0x7e/frame 0xd7a78cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7a78cd4 --- trap 0, eip = 0, esp = 0xd7a78d20, ebp = 0 --- Tracing command intr pid 12 tid 100008 td 0xcb7b2380 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100011 td 0xcb7b1700 sched_switch(cb7b1700,0,109,189,8,...) at sched_switch+0x80c/frame 0xd7a19c30 mi_switch(109,0,c1673d41,5a1,c167399c,...) at mi_switch+0x1f3/frame 0xd7a19c70 ithread_loop(c96080a0,d7a19ce8,c167399c,407,0,...) at ithread_loop+0x200/frame 0xd7a19cac fork_exit(c0c689d0,c96080a0,d7a19ce8) at fork_exit+0x7e/frame 0xd7a19cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7a19cd4 --- trap 0, eip = 0, esp = 0xd7a19d20, ebp = 0 --- Tracing command intr pid 12 tid 100012 td 0xcb7b1380 sched_switch(cb7b1380,0,109,189,8,...) at sched_switch+0x80c/frame 0xd7a1ec30 mi_switch(109,0,c1673d41,5a1,c167399c,...) at mi_switch+0x1f3/frame 0xd7a1ec70 ithread_loop(c9608090,d7a1ece8,c167399c,407,0,...) at ithread_loop+0x200/frame 0xd7a1ecac fork_exit(c0c689d0,c9608090,d7a1ece8) at fork_exit+0x7e/frame 0xd7a1ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7a1ecd4 --- trap 0, eip = 0, esp = 0xd7a1ed20, ebp = 0 --- Tracing command intr pid 12 tid 100022 td 0xc9640380 sched_switch(c9640380,0,109,189,8,...) at sched_switch+0x80c/frame 0xd7a50c30 mi_switch(109,0,c1673d41,5a1,c167399c,...) at mi_switch+0x1f3/frame 0xd7a50c70 ithread_loop(c9608080,d7a50ce8,c167399c,407,0,...) at ithread_loop+0x200/frame 0xd7a50cac fork_exit(c0c689d0,c9608080,d7a50ce8) at fork_exit+0x7e/frame 0xd7a50cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7a50cd4 --- trap 0, eip = 0, esp = 0xd7a50d20, ebp = 0 --- Tracing command intr pid 12 tid 100023 td 0xc9640000 sched_switch(c9640000,0,109,189,8,...) at sched_switch+0x80c/frame 0xd7a55c30 mi_switch(109,0,c1673d41,5a1,c167399c,...) at mi_switch+0x1f3/frame 0xd7a55c70 ithread_loop(c9608070,d7a55ce8,c167399c,407,0,...) at ithread_loop+0x200/frame 0xd7a55cac fork_exit(c0c689d0,c9608070,d7a55ce8) at fork_exit+0x7e/frame 0xd7a55cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7a55cd4 --- trap 0, eip = 0, esp = 0xd7a55d20, ebp = 0 --- Tracing command intr pid 12 tid 100024 td 0xcb7b4a80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100025 td 0xcb7b4700 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100026 td 0xcb7b4380 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100027 td 0xc964d700 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100042 td 0xd7c9d000 sched_switch(d7c9d000,0,109,189,8,...) at sched_switch+0x80c/frame 0xd7ae2c30 mi_switch(109,0,c1673d41,5a1,c167399c,...) at mi_switch+0x1f3/frame 0xd7ae2c70 ithread_loop(d7c8d050,d7ae2ce8,c167399c,407,0,...) at ithread_loop+0x200/frame 0xd7ae2cac fork_exit(c0c689d0,d7c8d050,d7ae2ce8) at fork_exit+0x7e/frame 0xd7ae2cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7ae2cd4 --- trap 0, eip = 0, esp = 0xd7ae2d20, ebp = 0 --- Tracing command intr pid 12 tid 100043 td 0xd7c9ca80 (CPU 3) cpustop_handler(3,d7ae8b94,d7ae8b88,c127c233,0,...) at cpustop_handler+0x25/frame 0xd7ae8a80 ipi_nmi_handler(0,0,1,c1687932,c1a4b944,...) at ipi_nmi_handler+0x36/frame 0xd7ae8a90 trap(d7ae8b94) at trap+0xa3/frame 0xd7ae8b88 calltrap() at calltrap+0x6/frame 0xd7ae8b88 --- trap 0x13, eip = 0xc09b887f, esp = 0xd7ae8bd4, ebp = 0xd7ae8c1c --- re_rxeof(d7c88140,0,c161cf9a,a55,d7c88140,...) at re_rxeof+0x46f/frame 0xd7ae8c1c re_intr_msi(d7c86000,0,d7c9ca80,c1b80980,d7c50848,...) at re_intr_msi+0xc6/frame 0xd7ae8c48 intr_event_execute_handlers(c1b80990,d7c50800,c1673d41,5ac,c167399c,...) at intr_event_execute_handlers+0x8e/frame 0xd7ae8c70 ithread_loop(d7c8d000,d7ae8ce8,c167399c,407,0,...) at ithread_loop+0xa0/frame 0xd7ae8cac fork_exit(c0c689d0,d7c8d000,d7ae8ce8) at fork_exit+0x7e/frame 0xd7ae8cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7ae8cd4 --- trap 0, eip = 0, esp = 0xd7ae8d20, ebp = 0 --- Tracing command intr pid 12 tid 100044 td 0xd7c9c700 sched_switch(d7c9c700,0,109,189,8,...) at sched_switch+0x80c/frame 0xd7aeec30 mi_switch(109,0,c1673d41,5a1,c167399c,...) at mi_switch+0x1f3/frame 0xd7aeec70 ithread_loop(c975df90,d7aeece8,c167399c,407,0,...) at ithread_loop+0x200/frame 0xd7aeecac fork_exit(c0c689d0,c975df90,d7aeece8) at fork_exit+0x7e/frame 0xd7aeecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7aeecd4 --- trap 0, eip = 0, esp = 0xd7aeed20, ebp = 0 --- Tracing command intr pid 12 tid 100045 td 0xd7c9c380 sched_switch(d7c9c380,0,109,189,8,...) at sched_switch+0x80c/frame 0xd7af4c30 mi_switch(109,0,c1673d41,5a1,c167399c,...) at mi_switch+0x1f3/frame 0xd7af4c70 ithread_loop(c975df80,d7af4ce8,c167399c,407,0,...) at ithread_loop+0x200/frame 0xd7af4cac fork_exit(c0c689d0,c975df80,d7af4ce8) at fork_exit+0x7e/frame 0xd7af4cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7af4cd4 --- trap 0, eip = 0, esp = 0xd7af4d20, ebp = 0 --- Tracing command intr pid 12 tid 100051 td 0xd7c92a80 sched_switch(d7c92a80,0,109,189,8,...) at sched_switch+0x80c/frame 0xd7b13c30 mi_switch(109,0,c1673d41,5a1,c167399c,...) at mi_switch+0x1f3/frame 0xd7b13c70 ithread_loop(c975df60,d7b13ce8,c167399c,407,0,...) at ithread_loop+0x200/frame 0xd7b13cac fork_exit(c0c689d0,c975df60,d7b13ce8) at fork_exit+0x7e/frame 0xd7b13cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7b13cd4 --- trap 0, eip = 0, esp = 0xd7b13d20, ebp = 0 --- Tracing command intr pid 12 tid 100057 td 0xd7f45a80 sched_switch(d7f45a80,0,109,189,8,...) at sched_switch+0x80c/frame 0xd7b32c30 mi_switch(109,0,c1673d41,5a1,c167399c,...) at mi_switch+0x1f3/frame 0xd7b32c70 ithread_loop(c975df40,d7b32ce8,c167399c,407,0,...) at ithread_loop+0x200/frame 0xd7b32cac fork_exit(c0c689d0,c975df40,d7b32ce8) at fork_exit+0x7e/frame 0xd7b32cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7b32cd4 --- trap 0, eip = 0, esp = 0xd7b32d20, ebp = 0 --- Tracing command intr pid 12 tid 100073 td 0xd7f61380 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100079 td 0xd7f46a80 sched_switch(d7f46a80,0,109,189,8,...) at sched_switch+0x80c/frame 0xd7ba3c30 mi_switch(109,0,c1673d41,5a1,c167399c,...) at mi_switch+0x1f3/frame 0xd7ba3c70 ithread_loop(c975dee0,d7ba3ce8,c167399c,407,0,...) at ithread_loop+0x200/frame 0xd7ba3cac fork_exit(c0c689d0,c975dee0,d7ba3ce8) at fork_exit+0x7e/frame 0xd7ba3cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7ba3cd4 --- trap 0, eip = 0, esp = 0xd7ba3d20, ebp = 0 --- Tracing command intr pid 12 tid 100080 td 0xd7f46700 sched_switch(d7f46700,0,109,189,8,...) at sched_switch+0x80c/frame 0xd7bacc30 mi_switch(109,0,c1673d41,5a1,c167399c,...) at mi_switch+0x1f3/frame 0xd7bacc70 ithread_loop(c975deb0,d7bacce8,c167399c,407,0,...) at ithread_loop+0x200/frame 0xd7baccac fork_exit(c0c689d0,c975deb0,d7bacce8) at fork_exit+0x7e/frame 0xd7baccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7baccd4 --- trap 0, eip = 0, esp = 0xd7bacd20, ebp = 0 --- Tracing command intr pid 12 tid 100082 td 0xd7fd6700 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xcb7b3700 sched_switch(cb7b3700,0,608,185,8,...) at sched_switch+0x80c/frame 0xd4906b20 mi_switch(608,0,c167d7a2,f1,cb7b3700,...) at mi_switch+0x1f3/frame 0xd4906b60 critical_exit(c96fb700,0,cb7b3700,3,cb7b3700,...) at critical_exit+0xa2/frame 0xd4906b7c intr_event_handle(d7c50800,d4906c0c,9,c167ff18,1,...) at intr_event_handle+0x128/frame 0xd4906ba8 intr_execute_handlers(c96fb700,d4906c0c,0) at intr_execute_handlers+0xa5/frame 0xd4906bdc lapic_handle_intr(32,d4906c0c) at lapic_handle_intr+0x5e/frame 0xd4906bfc Xapic_isr1_pti() at Xapic_isr1_pti+0x52/frame 0xd4906bfc --- interrupt, eip = 0xc126b880, esp = 0xd4906c4c, ebp = 0xd4906c50 --- spinlock_exit(c1b80990,0,c167ff18,aea,13f,...) at spinlock_exit+0x20/frame 0xd4906c50 sched_idletd(0,d4906ce8,c167399c,407,0,...) at sched_idletd+0xda/frame 0xd4906cac fork_exit(c0cd8470,0,d4906ce8) at fork_exit+0x7e/frame 0xd4906cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd4906cd4 --- trap 0, eip = 0, esp = 0xd4906d20, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xcb7b3380 sched_switch(cb7b3380,0,108,185,0,...) at sched_switch+0x80c/frame 0xd490bc10 mi_switch(108,0,c167ff18,ae8,c2,...) at mi_switch+0x1f3/frame 0xd490bc50 sched_idletd(0,d490bce8,c167399c,407,0,...) at sched_idletd+0xb5/frame 0xd490bcac fork_exit(c0cd8470,0,d490bce8) at fork_exit+0x7e/frame 0xd490bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd490bcd4 --- trap 0, eip = 0, esp = 0xd490bd20, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xcb7b3000 sched_switch(cb7b3000,0,108,185,8,...) at sched_switch+0x80c/frame 0xd4910c10 mi_switch(108,0,c167ff18,ae8,c9,...) at mi_switch+0x1f3/frame 0xd4910c50 sched_idletd(0,d4910ce8,c167399c,407,0,...) at sched_idletd+0xb5/frame 0xd4910cac fork_exit(c0cd8470,0,d4910ce8) at fork_exit+0x7e/frame 0xd4910cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd4910cd4 --- trap 0, eip = 0, esp = 0xd4910d20, ebp = 0 --- Tracing command idle pid 11 tid 100006 td 0xcb7b2a80 sched_switch(cb7b2a80,0,108,185,0,...) at sched_switch+0x80c/frame 0xd4915c10 mi_switch(108,0,c167ff18,ae8,ec,...) at mi_switch+0x1f3/frame 0xd4915c50 sched_idletd(0,d4915ce8,c167399c,407,0,...) at sched_idletd+0xb5/frame 0xd4915cac fork_exit(c0cd8470,0,d4915ce8) at fork_exit+0x7e/frame 0xd4915cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd4915cd4 --- trap 0, eip = 0, esp = 0xd4915d20, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xcb7b3a80 sched_switch(cb7b3a80,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd4900940 mi_switch(104,0,c16848e5,22b,cb7b3a80,...) at mi_switch+0x1f3/frame 0xd4900980 sleepq_switch(cb7b3a80,0,c16848e5,1ca,6c,...) at sleepq_switch+0x110/frame 0xd49009b4 sleepq_catch_signals(0,c16848e5,178,c1b92894,cb7b3a80,...) at sleepq_catch_signals+0x360/frame 0xd49009f8 sleepq_wait_sig(cb7afa08,6c,c1688cde,100,0,...) at sleepq_wait_sig+0x14/frame 0xd4900a1c _sleep(cb7afa08,cb7afab0,36c,c1688cde,0,...) at _sleep+0x386/frame 0xd4900a70 kern_wait6(cb7b3a80,7,0,0,d4900af4,...) at kern_wait6+0x567/frame 0xd4900ac8 sys_wait4(cb7b3a80,cb7b3d04,c16733db,4,530d643,...) at sys_wait4+0x87/frame 0xd4900be8 syscall(d4900ce8) at syscall+0x6ee/frame 0xd4900cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd4900cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x806a2c7, esp = 0xbfbfe884, ebp = 0xbfbfe898 --- Tracing command audit pid 10 tid 100001 td 0xcb7b4000 sched_switch(cb7b4000,0,104,189,c1b81040,...) at sched_switch+0x80c/frame 0xd48fbb80 mi_switch(104,0,c16848e5,22b,cb7b4000,...) at mi_switch+0x1f3/frame 0xd48fbbbc sleepq_switch(cb7b4000,0,c16848e5,2b3,c193d488,...) at sleepq_switch+0x110/frame 0xd48fbbf0 sleepq_wait(c1c1db58,0,d48fbc34,1,0,...) at sleepq_wait+0x48/frame 0xd48fbc14 _cv_wait(c1c1db58,c1c1dae0,c16c470e,1be,8,...) at _cv_wait+0x21f/frame 0xd48fbc58 audit_worker(0,d48fbce8,c167399c,407,0,...) at audit_worker+0x94/frame 0xd48fbcac fork_exit(c0f73390,0,d48fbce8) at fork_exit+0x7e/frame 0xd48fbcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd48fbcd4 --- trap 0, eip = 0, esp = 0xd48fbd20, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc1c19ba0 sched_switch(c1c19ba0,0,104,189,c1b81040,...) at sched_switch+0x80c/frame 0xc2022bf0 mi_switch(104,0,c16848e5,22b,c1c19ba0,...) at mi_switch+0x1f3/frame 0xc2022c2c sleepq_switch(c1c19ba0,0,c16848e5,2d6,fd70,...) at sleepq_switch+0x110/frame 0xc2022c60 sleepq_timedwait(c1c19844,54,9,0,0,...) at sleepq_timedwait+0x53/frame 0xc2022c9c _sleep(c1c19844,0,54,c16d534a,fffff470,...) at _sleep+0x332/frame 0xc2022cf0 swapper() at swapper+0x2c8/frame 0xc2022d38 begin() at begin+0x2f Tracing command kernel pid 0 tid 100007 td 0xcb7b2700 sched_switch(cb7b2700,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7a05b88 mi_switch(104,0,c16848e5,22b,cb7b2700,...) at mi_switch+0x1f3/frame 0xd7a05bc8 sleepq_switch(cb7b2700,0,c16848e5,2b3,cb7b2700,...) at sleepq_switch+0x110/frame 0xd7a05bfc sleepq_wait(c962f400,0,c1663b1b,0,0,...) at sleepq_wait+0x48/frame 0xd7a05c20 _sleep(c962f400,c962f41c,0,c1663b1b,0,...) at _sleep+0x396/frame 0xd7a05c74 taskqueue_thread_loop(c1c1cedc,d7a05ce8,c167399c,407,0,...) at taskqueue_thread_loop+0x144/frame 0xd7a05cac fork_exit(c0d04110,c1c1cedc,d7a05ce8) at fork_exit+0x7e/frame 0xd7a05cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7a05cd4 --- trap 0, eip = 0, esp = 0xd7a05d20, ebp = 0 --- Tracing command kernel pid 0 tid 100009 td 0xcb7b2000 sched_switch(cb7b2000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7a0fb88 mi_switch(104,0,c16848e5,22b,cb7b2000,...) at mi_switch+0x1f3/frame 0xd7a0fbc8 sleepq_switch(cb7b2000,0,c16848e5,2b3,cb7b2000,...) at sleepq_switch+0x110/frame 0xd7a0fbfc sleepq_wait(c962f280,0,c1663b1b,0,0,...) at sleepq_wait+0x48/frame 0xd7a0fc20 _sleep(c962f280,c962f29c,0,c1663b1b,0,...) at _sleep+0x396/frame 0xd7a0fc74 taskqueue_thread_loop(c1c1cf38,d7a0fce8,c167399c,407,0,...) at taskqueue_thread_loop+0x144/frame 0xd7a0fcac fork_exit(c0d04110,c1c1cf38,d7a0fce8) at fork_exit+0x7e/frame 0xd7a0fcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7a0fcd4 --- trap 0, eip = 0, esp = 0xd7a0fd20, ebp = 0 --- Tracing command kernel pid 0 tid 100010 td 0xcb7b1a80 sched_switch(cb7b1a80,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7a14b88 mi_switch(104,0,c16848e5,22b,cb7b1a80,...) at mi_switch+0x1f3/frame 0xd7a14bc8 sleepq_switch(cb7b1a80,0,c16848e5,2b3,cb7b1a80,...) at sleepq_switch+0x110/frame 0xd7a14bfc sleepq_wait(c962f200,0,c1663b1b,0,0,...) at sleepq_wait+0x48/frame 0xd7a14c20 _sleep(c962f200,c962f21c,0,c1663b1b,0,...) at _sleep+0x396/frame 0xd7a14c74 taskqueue_thread_loop(c1c1a138,d7a14ce8,c167399c,407,0,...) at taskqueue_thread_loop+0x144/frame 0xd7a14cac fork_exit(c0d04110,c1c1a138,d7a14ce8) at fork_exit+0x7e/frame 0xd7a14cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7a14cd4 --- trap 0, eip = 0, esp = 0xd7a14d20, ebp = 0 --- Tracing command kernel pid 0 tid 100013 td 0xcb7b1000 sched_switch(cb7b1000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7a23b98 mi_switch(104,0,c16848e5,22b,cb7b1000,...) at mi_switch+0x1f3/frame 0xd7a23bd8 sleepq_switch(cb7b1000,0,c16848e5,2b3,c963d000,...) at sleepq_switch+0x110/frame 0xd7a23c0c sleepq_wait(c963d000,0,c167dd27,c1663b1b,0,...) at sleepq_wait+0x48/frame 0xd7a23c30 msleep_spin_sbt(c963d000,c963d01c,c1663b1b,0,0,...) at msleep_spin_sbt+0x226/frame 0xd7a23c74 gtaskqueue_thread_loop(c9633c04,d7a23ce8,c167399c,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0xd7a23cac fork_exit(c0cedf80,c9633c04,d7a23ce8) at fork_exit+0x7e/frame 0xd7a23cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7a23cd4 --- trap 0, eip = 0, esp = 0xd7a23d20, ebp = 0 --- Tracing command kernel pid 0 tid 100014 td 0xc9642380 sched_switch(c9642380,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7a28b98 mi_switch(104,0,c16848e5,22b,c9642380,...) at mi_switch+0x1f3/frame 0xd7a28bd8 sleepq_switch(c9642380,0,c16848e5,2b3,c963cf00,...) at sleepq_switch+0x110/frame 0xd7a28c0c sleepq_wait(c963cf00,0,c167dd27,c1663b1b,0,...) at sleepq_wait+0x48/frame 0xd7a28c30 msleep_spin_sbt(c963cf00,c963cf1c,c1663b1b,0,0,...) at msleep_spin_sbt+0x226/frame 0xd7a28c74 gtaskqueue_thread_loop(c9633c14,d7a28ce8,c167399c,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0xd7a28cac fork_exit(c0cedf80,c9633c14,d7a28ce8) at fork_exit+0x7e/frame 0xd7a28cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7a28cd4 --- trap 0, eip = 0, esp = 0xd7a28d20, ebp = 0 --- Tracing command kernel pid 0 tid 100015 td 0xc9642000 sched_switch(c9642000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7a2db98 mi_switch(104,0,c16848e5,22b,c9642000,...) at mi_switch+0x1f3/frame 0xd7a2dbd8 sleepq_switch(c9642000,0,c16848e5,2b3,c963ce80,...) at sleepq_switch+0x110/frame 0xd7a2dc0c sleepq_wait(c963ce80,0,c167dd27,c1663b1b,0,...) at sleepq_wait+0x48/frame 0xd7a2dc30 msleep_spin_sbt(c963ce80,c963ce9c,c1663b1b,0,0,...) at msleep_spin_sbt+0x226/frame 0xd7a2dc74 gtaskqueue_thread_loop(c9633c24,d7a2dce8,c167399c,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0xd7a2dcac fork_exit(c0cedf80,c9633c24,d7a2dce8) at fork_exit+0x7e/frame 0xd7a2dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7a2dcd4 --- trap 0, eip = 0, esp = 0xd7a2dd20, ebp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xc9641a80 sched_switch(c9641a80,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7a32b98 mi_switch(104,0,c16848e5,22b,c9641a80,...) at mi_switch+0x1f3/frame 0xd7a32bd8 sleepq_switch(c9641a80,0,c16848e5,2b3,c963ce00,...) at sleepq_switch+0x110/frame 0xd7a32c0c sleepq_wait(c963ce00,0,c167dd27,c1663b1b,0,...) at sleepq_wait+0x48/frame 0xd7a32c30 msleep_spin_sbt(c963ce00,c963ce1c,c1663b1b,0,0,...) at msleep_spin_sbt+0x226/frame 0xd7a32c74 gtaskqueue_thread_loop(c9633c34,d7a32ce8,c167399c,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0xd7a32cac fork_exit(c0cedf80,c9633c34,d7a32ce8) at fork_exit+0x7e/frame 0xd7a32cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7a32cd4 --- trap 0, eip = 0, esp = 0xd7a32d20, ebp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xc9641700 sched_switch(c9641700,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7a37b98 mi_switch(104,0,c16848e5,22b,c9641700,...) at mi_switch+0x1f3/frame 0xd7a37bd8 sleepq_switch(c9641700,0,c16848e5,2b3,c963cd80,...) at sleepq_switch+0x110/frame 0xd7a37c0c sleepq_wait(c963cd80,0,c167dd27,c1663b1b,0,...) at sleepq_wait+0x48/frame 0xd7a37c30 msleep_spin_sbt(c963cd80,c963cd9c,c1663b1b,0,0,...) at msleep_spin_sbt+0x226/frame 0xd7a37c74 gtaskqueue_thread_loop(c9634004,d7a37ce8,c167399c,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0xd7a37cac fork_exit(c0cedf80,c9634004,d7a37ce8) at fork_exit+0x7e/frame 0xd7a37cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7a37cd4 --- trap 0, eip = 0, esp = 0xd7a37d20, ebp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xc9641380 sched_switch(c9641380,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7a3cb98 mi_switch(104,0,c16848e5,22b,c9641380,...) at mi_switch+0x1f3/frame 0xd7a3cbd8 sleepq_switch(c9641380,0,c16848e5,2b3,c963cd00,...) at sleepq_switch+0x110/frame 0xd7a3cc0c sleepq_wait(c963cd00,0,c167dd27,c1663b1b,0,...) at sleepq_wait+0x48/frame 0xd7a3cc30 msleep_spin_sbt(c963cd00,c963cd1c,c1663b1b,0,0,...) at msleep_spin_sbt+0x226/frame 0xd7a3cc74 gtaskqueue_thread_loop(c9634014,d7a3cce8,c167399c,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0xd7a3ccac fork_exit(c0cedf80,c9634014,d7a3cce8) at fork_exit+0x7e/frame 0xd7a3ccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7a3ccd4 --- trap 0, eip = 0, esp = 0xd7a3cd20, ebp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xc9641000 sched_switch(c9641000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7a41b98 mi_switch(104,0,c16848e5,22b,c9641000,...) at mi_switch+0x1f3/frame 0xd7a41bd8 sleepq_switch(c9641000,0,c16848e5,2b3,c963cc80,...) at sleepq_switch+0x110/frame 0xd7a41c0c sleepq_wait(c963cc80,0,c167dd27,c1663b1b,0,...) at sleepq_wait+0x48/frame 0xd7a41c30 msleep_spin_sbt(c963cc80,c963cc9c,c1663b1b,0,0,...) at msleep_spin_sbt+0x226/frame 0xd7a41c74 gtaskqueue_thread_loop(c9634024,d7a41ce8,c167399c,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0xd7a41cac fork_exit(c0cedf80,c9634024,d7a41ce8) at fork_exit+0x7e/frame 0xd7a41cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7a41cd4 --- trap 0, eip = 0, esp = 0xd7a41d20, ebp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xc9640a80 sched_switch(c9640a80,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7a46b98 mi_switch(104,0,c16848e5,22b,c9640a80,...) at mi_switch+0x1f3/frame 0xd7a46bd8 sleepq_switch(c9640a80,0,c16848e5,2b3,c963cc00,...) at sleepq_switch+0x110/frame 0xd7a46c0c sleepq_wait(c963cc00,0,c167dd27,c1663b1b,0,...) at sleepq_wait+0x48/frame 0xd7a46c30 msleep_spin_sbt(c963cc00,c963cc1c,c1663b1b,0,0,...) at msleep_spin_sbt+0x226/frame 0xd7a46c74 gtaskqueue_thread_loop(c9634034,d7a46ce8,c167399c,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0xd7a46cac fork_exit(c0cedf80,c9634034,d7a46ce8) at fork_exit+0x7e/frame 0xd7a46cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7a46cd4 --- trap 0, eip = 0, esp = 0xd7a46d20, ebp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xc9640700 sched_switch(c9640700,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7a4bb98 mi_switch(104,0,c16848e5,22b,c9640700,...) at mi_switch+0x1f3/frame 0xd7a4bbd8 sleepq_switch(c9640700,0,c16848e5,2b3,c963cb80,...) at sleepq_switch+0x110/frame 0xd7a4bc0c sleepq_wait(c963cb80,0,c167dd27,c1663b1b,0,...) at sleepq_wait+0x48/frame 0xd7a4bc30 msleep_spin_sbt(c963cb80,c963cb9c,c1663b1b,0,0,...) at msleep_spin_sbt+0x226/frame 0xd7a4bc74 gtaskqueue_thread_loop(c9633804,d7a4bce8,c167399c,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0xd7a4bcac fork_exit(c0cedf80,c9633804,d7a4bce8) at fork_exit+0x7e/frame 0xd7a4bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7a4bcd4 --- trap 0, eip = 0, esp = 0xd7a4bd20, ebp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xc964c700 sched_switch(c964c700,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7a7db88 mi_switch(104,0,c16848e5,22b,c964c700,...) at mi_switch+0x1f3/frame 0xd7a7dbc8 sleepq_switch(c964c700,0,c16848e5,2b3,c964c700,...) at sleepq_switch+0x110/frame 0xd7a7dbfc sleepq_wait(c962cc00,0,c1663b1b,0,0,...) at sleepq_wait+0x48/frame 0xd7a7dc20 _sleep(c962cc00,c962cc1c,0,c1663b1b,0,...) at _sleep+0x396/frame 0xd7a7dc74 taskqueue_thread_loop(c1b8e2a8,d7a7dce8,c167399c,407,0,...) at taskqueue_thread_loop+0x144/frame 0xd7a7dcac fork_exit(c0d04110,c1b8e2a8,d7a7dce8) at fork_exit+0x7e/frame 0xd7a7dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7a7dcd4 --- trap 0, eip = 0, esp = 0xd7a7dd20, ebp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xc964c380 sched_switch(c964c380,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7a82b88 mi_switch(104,0,c16848e5,22b,c964c380,...) at mi_switch+0x1f3/frame 0xd7a82bc8 sleepq_switch(c964c380,0,c16848e5,2b3,c964c380,...) at sleepq_switch+0x110/frame 0xd7a82bfc sleepq_wait(c962cb80,0,c1663b1b,0,0,...) at sleepq_wait+0x48/frame 0xd7a82c20 _sleep(c962cb80,c962cb9c,0,c1663b1b,0,...) at _sleep+0x396/frame 0xd7a82c74 taskqueue_thread_loop(c1bf1cd8,d7a82ce8,c167399c,407,0,...) at taskqueue_thread_loop+0x144/frame 0xd7a82cac fork_exit(c0d04110,c1bf1cd8,d7a82ce8) at fork_exit+0x7e/frame 0xd7a82cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7a82cd4 --- trap 0, eip = 0, esp = 0xd7a82d20, ebp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xc964c000 sched_switch(c964c000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7a87b88 mi_switch(104,0,c16848e5,22b,c964c000,...) at mi_switch+0x1f3/frame 0xd7a87bc8 sleepq_switch(c964c000,0,c16848e5,2b3,c964c000,...) at sleepq_switch+0x110/frame 0xd7a87bfc sleepq_wait(c962cb80,0,c1663b1b,0,0,...) at sleepq_wait+0x48/frame 0xd7a87c20 _sleep(c962cb80,c962cb9c,0,c1663b1b,0,...) at _sleep+0x396/frame 0xd7a87c74 taskqueue_thread_loop(c1bf1cd8,d7a87ce8,c167399c,407,0,...) at taskqueue_thread_loop+0x144/frame 0xd7a87cac fork_exit(c0d04110,c1bf1cd8,d7a87ce8) at fork_exit+0x7e/frame 0xd7a87cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7a87cd4 --- trap 0, eip = 0, esp = 0xd7a87d20, ebp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xc964ba80 sched_switch(c964ba80,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7a8cb88 mi_switch(104,0,c16848e5,22b,c964ba80,...) at mi_switch+0x1f3/frame 0xd7a8cbc8 sleepq_switch(c964ba80,0,c16848e5,2b3,c964ba80,...) at sleepq_switch+0x110/frame 0xd7a8cbfc sleepq_wait(c962cb80,0,c1663b1b,0,0,...) at sleepq_wait+0x48/frame 0xd7a8cc20 _sleep(c962cb80,c962cb9c,0,c1663b1b,0,...) at _sleep+0x396/frame 0xd7a8cc74 taskqueue_thread_loop(c1bf1cd8,d7a8cce8,c167399c,407,0,...) at taskqueue_thread_loop+0x144/frame 0xd7a8ccac fork_exit(c0d04110,c1bf1cd8,d7a8cce8) at fork_exit+0x7e/frame 0xd7a8ccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7a8ccd4 --- trap 0, eip = 0, esp = 0xd7a8cd20, ebp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xc964b700 sched_switch(c964b700,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7a91b88 mi_switch(104,0,c16848e5,22b,c964b700,...) at mi_switch+0x1f3/frame 0xd7a91bc8 sleepq_switch(c964b700,0,c16848e5,2b3,c964b700,...) at sleepq_switch+0x110/frame 0xd7a91bfc sleepq_wait(c962cb80,0,c1663b1b,0,0,...) at sleepq_wait+0x48/frame 0xd7a91c20 _sleep(c962cb80,c962cb9c,0,c1663b1b,0,...) at _sleep+0x396/frame 0xd7a91c74 taskqueue_thread_loop(c1bf1cd8,d7a91ce8,c167399c,407,0,...) at taskqueue_thread_loop+0x144/frame 0xd7a91cac fork_exit(c0d04110,c1bf1cd8,d7a91ce8) at fork_exit+0x7e/frame 0xd7a91cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7a91cd4 --- trap 0, eip = 0, esp = 0xd7a91d20, ebp = 0 --- Tracing command kernel pid 0 tid 100083 td 0xd7fd6380 sched_switch(d7fd6380,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7bbbb98 mi_switch(104,0,c16848e5,22b,d7fd6380,...) at mi_switch+0x1f3/frame 0xd7bbbbd8 sleepq_switch(d7fd6380,0,c16848e5,2b3,d7c4ed80,...) at sleepq_switch+0x110/frame 0xd7bbbc0c sleepq_wait(d7c4ed80,0,c167dd27,c1663b1b,0,...) at sleepq_wait+0x48/frame 0xd7bbbc30 msleep_spin_sbt(d7c4ed80,d7c4ed9c,c1663b1b,0,0,...) at msleep_spin_sbt+0x226/frame 0xd7bbbc74 taskqueue_thread_loop(c1c0dd14,d7bbbce8,c167399c,407,0,...) at taskqueue_thread_loop+0xf3/frame 0xd7bbbcac fork_exit(c0d04110,c1c0dd14,d7bbbce8) at fork_exit+0x7e/frame 0xd7bbbcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7bbbcd4 --- trap 0, eip = 0, esp = 0xd7bbbd20, ebp = 0 --- Tracing command kernel pid 0 tid 100089 td 0xd8226000 sched_switch(d8226000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7bdab98 mi_switch(104,0,c16848e5,22b,d8226000,...) at mi_switch+0x1f3/frame 0xd7bdabd8 sleepq_switch(d8226000,0,c16848e5,2b3,d824db80,...) at sleepq_switch+0x110/frame 0xd7bdac0c sleepq_wait(d824db80,0,c167dd27,c1663b1b,0,...) at sleepq_wait+0x48/frame 0xd7bdac30 msleep_spin_sbt(d824db80,d824db9c,c1663b1b,0,0,...) at msleep_spin_sbt+0x226/frame 0xd7bdac74 taskqueue_thread_loop(c1c0f904,d7bdace8,c167399c,407,0,...) at taskqueue_thread_loop+0xf3/frame 0xd7bdacac fork_exit(c0d04110,c1c0f904,d7bdace8) at fork_exit+0x7e/frame 0xd7bdacd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7bdacd4 --- trap 0, eip = 0, esp = 0xd7bdad20, ebp = 0 --- Tracing command kernel pid 0 tid 100090 td 0xd8225a80 sched_switch(d8225a80,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7bdfb98 mi_switch(104,0,c16848e5,22b,d8225a80,...) at mi_switch+0x1f3/frame 0xd7bdfbd8 sleepq_switch(d8225a80,0,c16848e5,2b3,d824db80,...) at sleepq_switch+0x110/frame 0xd7bdfc0c sleepq_wait(d824db80,0,c167dd27,c1663b1b,0,...) at sleepq_wait+0x48/frame 0xd7bdfc30 msleep_spin_sbt(d824db80,d824db9c,c1663b1b,0,0,...) at msleep_spin_sbt+0x226/frame 0xd7bdfc74 taskqueue_thread_loop(c1c0f904,d7bdfce8,c167399c,407,0,...) at taskqueue_thread_loop+0xf3/frame 0xd7bdfcac fork_exit(c0d04110,c1c0f904,d7bdfce8) at fork_exit+0x7e/frame 0xd7bdfcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7bdfcd4 --- trap 0, eip = 0, esp = 0xd7bdfd20, ebp = 0 --- Tracing command kernel pid 0 tid 100091 td 0xd8225700 sched_switch(d8225700,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7be4b98 mi_switch(104,0,c16848e5,22b,d8225700,...) at mi_switch+0x1f3/frame 0xd7be4bd8 sleepq_switch(d8225700,0,c16848e5,2b3,d824db80,...) at sleepq_switch+0x110/frame 0xd7be4c0c sleepq_wait(d824db80,0,c167dd27,c1663b1b,0,...) at sleepq_wait+0x48/frame 0xd7be4c30 msleep_spin_sbt(d824db80,d824db9c,c1663b1b,0,0,...) at msleep_spin_sbt+0x226/frame 0xd7be4c74 taskqueue_thread_loop(c1c0f904,d7be4ce8,c167399c,407,0,...) at taskqueue_thread_loop+0xf3/frame 0xd7be4cac fork_exit(c0d04110,c1c0f904,d7be4ce8) at fork_exit+0x7e/frame 0xd7be4cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7be4cd4 --- trap 0, eip = 0, esp = 0xd7be4d20, ebp = 0 --- Tracing command kernel pid 0 tid 100093 td 0xd8225000 sched_switch(d8225000,0,104,189,c126b870,...) at sched_switch+0x80c/frame 0xd7beeb88 mi_switch(104,0,c16848e5,22b,d8225000,...) at mi_switch+0x1f3/frame 0xd7beebc8 sleepq_switch(d8225000,0,c16848e5,2b3,d8225000,...) at sleepq_switch+0x110/frame 0xd7beebfc sleepq_wait(c962cb00,0,c1663b1b,0,0,...) at sleepq_wait+0x48/frame 0xd7beec20 _sleep(c962cb00,c962cb1c,0,c1663b1b,0,...) at _sleep+0x396/frame 0xd7beec74 taskqueue_thread_loop(c1998ce8,d7beece8,c167399c,407,0,...) at taskqueue_thread_loop+0x144/frame 0xd7beecac fork_exit(c0d04110,c1998ce8,d7beece8) at fork_exit+0x7e/frame 0xd7beecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7beecd4 --- trap 0, eip = 0, esp = 0xd7beed20, ebp = 0 --- db:0:pho> dump Physical memory: 3427 MB Dumping 232 MB:panic: thread 0xd819b380 owns no locks cpuid = 2 time = 1522556477 Uptime: 18h1m12s Rebooting... cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 2 (kgdb) l *vm_page_enqueue+0xf5 0xc10085d5 is in vm_page_enqueue (../../../vm/vm_page.c:3097). 3092 ("vm_page_enqueue: invalid queue %u request for page %p", 3093 queue, m)); 3094 pq = &vm_pagequeue_domain(m)->vmd_pagequeues[queue]; 3095 vm_pagequeue_lock(pq); 3096 m->queue = queue; 3097 TAILQ_INSERT_TAIL(&pq->pq_pl, m, plinks.q); 3098 vm_pagequeue_cnt_inc(pq); 3099 vm_pagequeue_unlock(pq); 3100 } 3101 (kgdb) $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/vm/uma.h =================================================================== --- /usr/src/sys/vm/uma.h (revision 331837) +++ /usr/src/sys/vm/uma.h (working copy) @@ -286,6 +286,10 @@ uma_zone_t uma_zcache_create(char *name, int size, * NUMA aware Zone. Implements a best * effort first-touch policy. */ +#define UMA_ZONE_NOBUCKETCACHE 0x20000 /* + * Don't cache full buckets. Limit + * UMA to per-cpu state. + */ /* * These flags are shared between the keg and zone. In zones wishing to add Index: /usr/src/sys/vm/uma_core.c =================================================================== --- /usr/src/sys/vm/uma_core.c (revision 331837) +++ /usr/src/sys/vm/uma_core.c (working copy) @@ -2965,7 +2965,13 @@ zfree_start: /* ub_cnt is pointing to the last free item */ KASSERT(bucket->ub_cnt != 0, ("uma_zfree: Attempting to insert an empty bucket onto the full list.\n")); - LIST_INSERT_HEAD(&zdom->uzd_buckets, bucket, ub_link); + if ((zone->uz_flags & UMA_ZONE_NOBUCKETCACHE) != 0) { + ZONE_UNLOCK(zone); + bucket_drain(zone, bucket); + bucket_free(zone, bucket, udata); + goto zfree_restart; + } else + LIST_INSERT_HEAD(&zdom->uzd_buckets, bucket, ub_link); } /* Index: /usr/src/sys/vm/vm_page.c =================================================================== --- /usr/src/sys/vm/vm_page.c (revision 331837) +++ /usr/src/sys/vm/vm_page.c (working copy) @@ -186,6 +186,9 @@ static int vm_page_reclaim_run(int req_class, int vm_page_t m_run, vm_paddr_t high); static int vm_domain_alloc_fail(struct vm_domain *vmd, vm_object_t object, int req); +static int vm_page_import(void *arg, void **store, int cnt, int domain, + int flags); +static void vm_page_release(void *arg, void **store, int cnt); SYSINIT(vm_page, SI_SUB_VM, SI_ORDER_SECOND, vm_page_init, NULL); @@ -199,6 +202,32 @@ vm_page_init(void *dummy) VM_ALLOC_NORMAL | VM_ALLOC_WIRED); } +/* + * The cache page zone is initialized later since we need to be able to allocate + * pages before UMA is fully initialized. + */ +static void +vm_page_init_cache_zones(void *dummy __unused) +{ + struct vm_domain *vmd; + int i; + + for (i = 0; i < vm_ndomains; i++) { + vmd = VM_DOMAIN(i); + /* + * Don't allow the page cache to take up more than .25% of + * memory. + */ + if (vmd->vmd_page_count / 400 < 256 * mp_ncpus) + continue; + vmd->vmd_pgcache = uma_zcache_create("vm pgcache", + sizeof(struct vm_page), NULL, NULL, NULL, NULL, + vm_page_import, vm_page_release, vmd, + UMA_ZONE_NOBUCKETCACHE | UMA_ZONE_MAXBUCKET | UMA_ZONE_VM); + } +} +SYSINIT(vm_page2, SI_SUB_VM_CONF, SI_ORDER_ANY, vm_page_init_cache_zones, NULL); + /* Make sure that u_long is at least 64 bits when PAGE_SIZE is 32K. */ #if PAGE_SIZE == 32768 #ifdef CTASSERT @@ -1753,6 +1782,11 @@ again: } #endif vmd = VM_DOMAIN(domain); + if (object != NULL && vmd->vmd_pgcache != NULL) { + m = uma_zalloc(vmd->vmd_pgcache, M_NOWAIT); + if (m != NULL) + goto found; + } if (vm_domain_allocate(vmd, req, 1)) { /* * If not, allocate it from the free page queues. @@ -1783,9 +1817,7 @@ again: */ KASSERT(m != NULL, ("missing page")); -#if VM_NRESERVLEVEL > 0 found: -#endif vm_page_alloc_check(m); /* @@ -2150,6 +2182,52 @@ again: return (m); } +static int +vm_page_import(void *arg, void **store, int cnt, int domain, int flags) +{ + struct vm_domain *vmd; + vm_page_t m; + int i, j, n; + + vmd = arg; + /* Only import if we can bring in a full bucket. */ + if (cnt == 1 || !vm_domain_allocate(vmd, VM_ALLOC_NORMAL, cnt)) + return (0); + domain = vmd->vmd_domain; + n = 64; /* Starting stride, arbitrary. */ + vm_domain_free_lock(vmd); + for (i = 0; i < cnt; i+=n) { + n = vm_phys_alloc_npages(domain, VM_FREELIST_DEFAULT, &m, + MIN(n, cnt-i)); + if (n == 0) + break; + for (j = 0; j < n; j++) + store[i+j] = m++; + } + vm_domain_free_unlock(vmd); + if (cnt != i) + vm_domain_freecnt_inc(vmd, cnt - i); + + return (i); +} + +static void +vm_page_release(void *arg, void **store, int cnt) +{ + struct vm_domain *vmd; + vm_page_t m; + int i; + + vmd = arg; + vm_domain_free_lock(vmd); + for (i = 0; i < cnt; i++) { + m = (vm_page_t)store[i]; + vm_phys_free_pages(m, 0); + } + vm_domain_free_unlock(vmd); + vm_domain_freecnt_inc(vmd, cnt); +} + #define VPSC_ANY 0 /* No restrictions. */ #define VPSC_NORESERV 1 /* Skip reservations; implies VPSC_NOSUPER. */ #define VPSC_NOSUPER 2 /* Skip superpages. */ @@ -3222,7 +3300,12 @@ vm_page_free_toq(vm_page_t m) if (!vm_page_free_prep(m, false)) return; + vmd = vm_pagequeue_domain(m); + if (m->pool == VM_FREEPOOL_DEFAULT && vmd->vmd_pgcache != NULL) { + uma_zfree(vmd->vmd_pgcache, m); + return; + } vm_domain_free_lock(vmd); vm_phys_free_pages(m, 0); vm_domain_free_unlock(vmd); @@ -3243,7 +3326,6 @@ void vm_page_free_pages_toq(struct spglist *free, bool update_wire_count) { vm_page_t m; - struct pglist pgl; int count; if (SLIST_EMPTY(free)) @@ -3250,16 +3332,12 @@ vm_page_free_pages_toq(struct spglist *free, bool return; count = 0; - TAILQ_INIT(&pgl); while ((m = SLIST_FIRST(free)) != NULL) { count++; SLIST_REMOVE_HEAD(free, plinks.s.ss); - if (vm_page_free_prep(m, false)) - TAILQ_INSERT_TAIL(&pgl, m, listq); + vm_page_free_toq(m); } - vm_page_free_phys_pglist(&pgl); - if (update_wire_count) vm_wire_sub(count); } Index: /usr/src/sys/vm/vm_pagequeue.h =================================================================== --- /usr/src/sys/vm/vm_pagequeue.h (revision 331837) +++ /usr/src/sys/vm/vm_pagequeue.h (working copy) @@ -74,6 +74,7 @@ struct vm_pagequeue { } __aligned(CACHE_LINE_SIZE); #include +#include struct sysctl_oid; /* @@ -92,6 +93,7 @@ struct vm_domain { struct vm_pagequeue vmd_pagequeues[PQ_COUNT]; struct mtx_padalign vmd_free_mtx; struct mtx_padalign vmd_pageout_mtx; + uma_zone_t vmd_pgcache; /* (c) page free cache. */ struct vmem *vmd_kernel_arena; /* (c) per-domain kva arena. */ u_int vmd_domain; /* (c) Domain number. */ u_int vmd_page_count; /* (c) Total page count. */ Index: /usr/src/sys/vm/vm_phys.c =================================================================== --- /usr/src/sys/vm/vm_phys.c (revision 331837) +++ /usr/src/sys/vm/vm_phys.c (working copy) @@ -624,6 +624,26 @@ vm_phys_alloc_pages(int domain, int pool, int orde return (NULL); } +int +vm_phys_alloc_npages(int domain, int pool, vm_page_t *mp, int cnt) +{ + vm_page_t m; + int order, freelist; + + for (freelist = 0; freelist < VM_NFREELIST; freelist++) { + for (order = fls(cnt) -1; order >= 0; order--) { + m = vm_phys_alloc_freelist_pages(domain, freelist, + pool, order); + if (m != NULL) { + *mp = m; + return (1 << order); + } + } + } + *mp = NULL; + return (0); +} + /* * Allocate a contiguous, power of two-sized set of physical pages from the * specified free list. The free list must be specified using one of the Index: /usr/src/sys/vm/vm_phys.h =================================================================== --- /usr/src/sys/vm/vm_phys.h (revision 331837) +++ /usr/src/sys/vm/vm_phys.h (working copy) @@ -78,6 +78,7 @@ vm_page_t vm_phys_alloc_contig(int domain, u_long vm_page_t vm_phys_alloc_freelist_pages(int domain, int freelist, int pool, int order); vm_page_t vm_phys_alloc_pages(int domain, int pool, int order); +int vm_phys_alloc_npages(int domain, int pool, vm_page_t *m, int cnt); int vm_phys_domain_match(int prefer, vm_paddr_t low, vm_paddr_t high); int vm_phys_fictitious_reg_range(vm_paddr_t start, vm_paddr_t end, vm_memattr_t memattr);