GENERIC HEAD from 2018-02-05 07:05:28 UTC, r328874M, vmcore.1068 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2018 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 12.0-CURRENT #0 r328874M: Mon Feb 5 10:02:59 CET 2018 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 FreeBSD clang version 6.0.0 (branches/release_60 321788) (based on LLVM 6.0.0) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin="AuthenticAMD" Id=0x100f23 Family=0x10 Model=0x2 Stepping=3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff SVM: NP,NAsids=64 TSC: P-state invariant real memory = 8589934592 (8192 MB) avail memory = 3525746688 (3362 MB) : Trying to mount root from ufs:/dev/ada0s1a [rw]... uhub1: 2 ports with 2 removable, self powered uhub2: 2 ports with 2 removable, self powered uhub3: 2 ports with 2 removable, self powered uhub5: 2 ports with 2 removable, self powered uhub4: 2 ports with 2 removable, self powered Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. eval: limits: not found /etc/rc: WARNING: failed to start ddb warning: total configured swap (4194304 pages) exceeds maximum recommended amount (1725680 pages). warning: increase kern.maxswzone or reduce amount of swap. Starting file system checks: /dev/ada0s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1a: clean, 491762 free (2226 frags, 61192 blocks, 0.2% fragmentation) /dev/ada0s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1f: clean, 849972 free (11164 frags, 104851 blocks, 1.1% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 45399647 free (42207 frags, 5669680 blocks, 0.0% fragmentation) /dev/ada0s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1d: clean, 1926589 free (393269 frags, 191665 blocks, 3.9% fragmentation) /dev/ada0s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1e: clean, 6184151 free (232199 frags, 743994 blocks, 0.9% fragmentation) Mounting local filesystems:. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/arduino/lib /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/gcc49 /usr/local/lib/mysql /usr/local/lib/nss /usr/local/lib/perl5/5.24/mach/CORE /usr/local/lib/pth /usr/local/lib/qt4 /usr/local/llvm37/lib /usr/local/llvm39/lib a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Setting hostname: x4.osted.lan. Setting up harvesting: [UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,NET_ETHER,NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . uhub0: 10 ports with 10 removable, self powered re0: link state changed to DOWN Starting Network: lo0 re0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 groups: lo re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 nd6 options=29 media: Ethernet autoselect (none) status: no carrier Starting devd. re0: link state changed to UP add host 127.0.0.1: gateway lo0 fib 0: route already in table add net default: gateway 192.168.1.1 add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Starting rpcbind. NFS access cache time=60 Starting watchdogd. No core dumps found. Additional ABI support: linux. lock order reversal: 1st 0xcb5b1af0 bufwait (bufwait) @ kern/vfs_bio.c:3564 2nd 0xd8b1d200 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:289 stack backtrace: #0 0xc0cdf051 at witness_debugger+0x81 #1 0xc0cdef18 at witness_checkorder+0xcd8 #2 0xc0c805c4 at _sx_xlock+0x64 #3 0xc0f9ae73 at ufsdirhash_add+0x53 #4 0xc0f9f9df at ufs_direnter+0x4df #5 0xc0fa8b52 at ufs_mkdir+0x852 #6 0xc1283bd6 at VOP_MKDIR_APV+0xf6 #7 0xc0d5c29e at kern_mkdirat+0x21e #8 0xc0d5c071 at sys_mkdir+0x31 #9 0xc124fa6e at syscall+0x6ee #10 0xc123918b at Xint0x80_syscall+0x2b Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Starting statd. Starting lockd. Recovering vi editor sessions:. Updating motd:. Mounting late filesystems:. Starting ntpd. Starting powerd. Starting smartd. Feb 5 20:25:05 x4 smartd[631]: Device: /dev/ada0, WARNING: A firmware update for this drive may be available, Feb 5 20:25:05 x4 smartd[631]: see the following Seagate web pages: Feb 5 20:25:05 x4 smartd[631]: http://knowledge.seagate.com/articles/en_US/FAQ/207931en Feb 5 20:25:05 x4 smartd[631]: http://knowledge.seagate.com/articles/en_US/FAQ/213891en Configuring vt: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting sendmail_submit. Starting sendmail_msp_queue. Starting cron. Local package initialization: backuplock order reversal: 1st 0xd8b058a4 ufs (ufs) @ kern/vfs_subr.c:2607 2nd 0xcb5a3330 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:282 3rd 0xdc56fb74 ufs (ufs) @ kern/vfs_subr.c:2607 stack backtrace: #0 0xc0cdf051 at witness_debugger+0x81 #1 0xc0cdef18 at witness_checkorder+0xcd8 #2 0xc0c4ae76 at __lockmgr_args+0x796 #3 0xc0f95437 at ffs_lock+0xa7 #4 0xc12849da at VOP_LOCK1_APV+0xda #5 0xc0d5f851 at _vn_lock+0x61 #6 0xc0d4b741 at vget+0xc1 #7 0xc0d3c9b2 at vfs_hash_get+0xd2 #8 0xc0f90184 at ffs_vgetf+0x44 #9 0xc0f85127 at softdep_sync_buf+0x357 #10 0xc0f962df at ffs_syncvnode+0x2df #11 0xc0f935f8 at ffs_sync+0x248 #12 0xc0d60fe4 at vfs_write_suspend+0x1c4 #13 0xc0d61215 at vfs_write_suspend_umnt+0x45 #14 0xc0f92cd4 at ffs_unmount+0xb4 #15 0xc0d430d3 at dounmount+0x583 #16 0xc0d42a45 at sys_unmount+0x315 #17 0xc124fa6e at syscall+0x6ee lock order reversal: 1st 0xd8aec304 ufs (ufs) @ kern/vfs_mount.c:1280 2nd 0xd8b73e44 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1912 stack backtrace: #0 0xc0cdf051 at witness_debugger+0x81 #1 0xc0cdef18 at witness_checkorder+0xcd8 #2 0xc0c4a617 at lockmgr_lock_fast_path+0x1c7 #3 0xc0d3889b at vop_stdlock+0x3b #4 0xc12849da at VOP_LOCK1_APV+0xda #5 0xc0d5f851 at _vn_lock+0x61 #6 0xc0f72645 at softdep_flushworklist+0x65 #7 0xc0f9386a at ffs_sync+0x4ba #8 0xc0d60fe4 at vfs_write_suspend+0x1c4 #9 0xc0d61215 at vfs_write_suspend_umnt+0x45 #10 0xc0f92cd4 at ffs_unmount+0xb4 #11 0xc0d430d3 at dounmount+0x583 #12 0xc0d42a45 at sys_unmount+0x315 #13 0xc124fa6e at syscall+0x6ee #14 0xc123918b at Xint0x80_syscall+0x2b ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes 78** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 1110549 files, 72914334 used, 45399647 free (42207 frags, 5669680 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmp. Starting nfscbd. Starting default mousedmoused: unable to open /dev/psm0: No such file or directory . Starting inetd. Mon Feb 5 20:28 FreeBSD/i386 (x4.osted.lan) (ttyu0) login: Feb 5 20:30:05 x4 su: pho to root on /dev/pts/0 20180205 20:30:19 all (1/9): graid1_10.sh pts leak: 1/2 20180205 20:32:48 all (2/9): graid1_2.sh freework leak: 12/21. 20180205 20:38:02 all (3/9): graid1_3.sh freework leak: 9/30. 20180205 20:40:12 all (4/9): graid1_4.sh freework leak: 3/33. mount leak: 1/99 20180205 20:51:13 all (5/9): graid1_5.sh GEOM_NOP: Device md11.nop created. GEOM_NOP: Device md12.nop created. swap_pager: I/O error - pageout failed; blkno 329760,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 340295,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 340327,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 340359,size 131072, error 12 GEOM_NOP: Device md11.nop removed. GEOM_NOP: Device md12.nop removed. mount leak: 1/100 20180205 20:57:39 all (6/9): graid1_6.sh mount leak: 1/101 20180205 21:02:22 all (7/9): graid1_7.sh mount leak: 1/102 20180205 21:08:36 all (8/9): graid1_9.sh swap_pager: I/O error - pageout failed; blkno 1539472,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1539536,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1539592,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1539656,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1539720,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1539784,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1539848,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 1539896,size 8192, error 12 swap_pager: I/O error - pageout failed; blkno 1539906,size 4096, error 12 swap_pager: I/O error - pageout failed; blkno 1539914,size 8192, error 12 swap_pager: I/O error - pageout failed; blkno 1539923,size 4096, error 12 swap_pager: I/O error - pageout failed; blkno 1539930,size 4096, error 12 swap_pager: I/O error - pageout failed; blkno 1539968,size 4096, error 12 swap_pager: I/O error - pageout failed; blkno 1539969,size 4096, error 12 swap_pager: I/O error - pageout failed; blkno 1539970,size 4096, error 12 swap_pager: I/O error - pageout failed; blkno 1539971,size 4096, error 12 swap_pager: I/O error - pageout failed; blkno 1539972,size 8192, error 12 swap_pager: I/O error - pageout failed; blkno 1539974,size 4096, error 12 swap_pager: I/O error - pageout failed; blkno 1539975,size 8192, error 12 swap_pager: I/O error - pageout failed; blkno 1539977,size 4096, error 12 swap_pager: I/O error - pageout failed; blkno 1539978,size 8192, error 12 swap_pager: I/O error - pageout failed; blkno 1539980,size 4096, error 12 swap_pager: I/O error - pageout failed; blkno 1539981,size 20480, error 12 swap_pager: I/O error - pageout failed; blkno 1539986,size 8192, error 12 swap_pager: I/O error - pageout failed; blkno 1539988,size 4096, error 12 swap_pager: I/O error - pageout failed; blkno 1539989,size 24576, error 12 swap_pager: I/O error - pageout failed; blkno 1539995,size 4096, error 12 swap_pager: I/O error - pageout failed; blkno 1539996,size 4096, error 12 swap_pager: I/O error - pageout failed; blkno 1539997,size 4096, error 12 swap_pager: I/O error - pageout failed; blkno 1539998,size 4096, error 12 swap_pager: I/O error - pageout failed; blkno 1539999,size 12288, error 12 swap_pager: I/O error - pageout failed; blkno 1540002,size 4096, error 12 swap_pager: I/O error - pageout failed; blkno 1540003,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1540035,size 4096, error 12 swap_pager: I/O error - pageout failed; blkno 1540036,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 1540052,size 8192, error 12 swap_pager: I/O error - pageout failed; blkno 1540054,size 4096, error 12 swap_pager: I/O error - pageout failed; blkno 1540055,size 4096, error 12 swap_pager: I/O error - pageout failed; blkno 1540056,size 12288, error 12 swap_pager: I/O error - pageout failed; blkno 1540059,size 4096, error 12 swap_pager: I/O error - pageout failed; blkno 1540060,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1540096,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 1540112,size 4096, error 12 swap_pager: I/O error - pageout failed; blkno 1540113,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 1540129,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1540161,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 1540177,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 1540193,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1540225,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 1540241,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 1540257,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1540289,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 1540305,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 1540321,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1540353,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 1540369,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 1540385,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1540417,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 1540433,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 1540449,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1540481,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 1540497,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 1540513,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1540545,size 32768, error 12 swap_pager: I/O error - pageout failed; blkno 1540553,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 1540569,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1540601,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 1540617,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 1540633,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1540665,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 1602528,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1602560,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1602592,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1602624,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1602656,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1602688,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1602720,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1602752,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1602784,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1602816,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1602848,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1602880,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1602912,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1602944,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1602976,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1603008,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 1605440,size 131072, error 12 mount leak: 1/103 20180205 21:19:08 all (9/9): graid1.sh swap_pager: I/O error - pageout failed; blkno 19915,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 19947,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 19979,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 19995,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 20011,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 20027,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 20043,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 20059,size 16384, error 12 swap_pager: I/O error - pageout failed; blkno 20063,size 16384, error 12 swap_pager: I/O error - pageout failed; blkno 20067,size 16384, error 12 swap_pager: I/O error - pageout failed; blkno 20071,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 20087,size 28672, error 12 swap_pager: I/O error - pageout failed; blkno 20094,size 28672, error 12 swap_pager: I/O error - pageout failed; blkno 20101,size 28672, error 12 swap_pager: I/O error - pageout failed; blkno 20108,size 32768, error 12 swap_pager: I/O error - pageout failed; blkno 20116,size 32768, error 12 swap_pager: I/O error - pageout failed; blkno 331872,size 16384, error 12 swap_pager: I/O error - pageout failed; blkno 332042,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 332290,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 332414,size 86016, error 12 swap_pager: I/O error - pageout failed; blkno 332598,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 332800,size 98304, error 12 swap_pager: I/O error - pageout failed; blkno 332992,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 333208,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 546779,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 546912,size 98304, error 12 swap_pager: I/O error - pageout failed; blkno 547168,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 547296,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 547456,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 547488,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 547616,size 98304, error 12 swap_pager: I/O error - pageout failed; blkno 573045,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 573077,size 20480, error 12 swap_pager: I/O error - pageout failed; blkno 573082,size 86016, error 12 swap_pager: I/O error - pageout failed; blkno 573103,size 118784, error 12 swap_pager: I/O error - pageout failed; blkno 573132,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 573148,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 573180,size 8192, error 12 swap_pager: I/O error - pageout failed; blkno 573182,size 8192, error 12 swap_pager: I/O error - pageout failed; blkno 573184,size 73728, error 12 swap_pager: I/O error - pageout failed; blkno 573202,size 8192, error 12 swap_pager: I/O error - pageout failed; blkno 573204,size 73728, error 12 swap_pager: I/O error - pageout failed; blkno 573222,size 8192, error 12 swap_pager: I/O error - pageout failed; blkno 573224,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 573240,size 53248, error 12 swap_pager: I/O error - pageout failed; blkno 573253,size 32768, error 12 swap_pager: I/O error - pageout failed; blkno 573261,size 53248, error 12 swap_pager: I/O error - pageout failed; blkno 573274,size 32768, error 12 swap_pager: I/O error - pageout failed; blkno 573282,size 53248, error 12 swap_pager: I/O error - pageout failed; blkno 573295,size 65536, error 12 swap_pager: I/O error - pageout failed; blkno 573311,size 8192, error 12 swap_pager: I/O error - pageout failed; blkno 573313,size 40960, error 12 swap_pager: I/O error - pageout failed; blkno 573323,size 53248, error 12 swap_pager: I/O error - pageout failed; blkno 573336,size 86016, error 12 swap_pager: I/O error - pageout failed; blkno 573357,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 573389,size 118784, error 12 swap_pager: I/O error - pageout failed; blkno 573440,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 573472,size 40960, error 12 swap_pager: I/O error - pageout failed; blkno 573482,size 73728, error 12 swap_pager: I/O error - pageout failed; blkno 573500,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 573532,size 118784, error 12 swap_pager: I/O error - pageout failed; blkno 573561,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 573593,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 573625,size 40960, error 12 swap_pager: I/O error - pageout failed; blkno 573635,size 106496, error 12 swap_pager: I/O error - pageout failed; blkno 573661,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 573693,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 573725,size 86016, error 12 swap_pager: I/O error - pageout failed; blkno 573746,size 32768, error 12 swap_pager: I/O error - pageout failed; blkno 573754,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 573786,size 86016, error 12 swap_pager: I/O error - pageout failed; blkno 573807,size 98304, error 12 swap_pager: I/O error - pageout failed; blkno 622976,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 623040,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 623072,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 623104,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 623136,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 623168,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 623200,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 623232,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 623264,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 623296,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 623328,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 623360,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 623392,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 623424,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 623456,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 623488,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 623520,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 623552,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 623584,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 623616,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 623648,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 623680,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 623712,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 623744,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 623776,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 623808,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 623840,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 623872,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 623904,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 623936,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 623968,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 624000,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 624032,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 624064,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 624096,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 624128,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 624160,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 624192,size 131072, error 12 swap_pager: I/O error - pageout failed; blkno 657856,size 131072, error 12 mount leak: 1/104 20180205 21:29:54 all: done 20180205 21:40:40 all (1/9): graid1_10.sh mount leak: 1/105 20180205 21:43:09 all (2/9): graid1_2.sh freework leak: 12/21. 20180205 21:48:22 all (3/9): graid1_3.sh swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3031, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3031, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3031, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3031, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3031, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3031, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3031, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3031, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3031, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3031, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3031, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3031, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3031, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3031, size: 4096 : : swap_pager: indefinite wait buffer: bufobj: 0, blkno: 5550, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3031, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 5550, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3031, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 5550, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3031, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 5550, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3031, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 5550, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3031, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 5550, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3031, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 5550, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3031, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 5550, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3031, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 5550, size: 4096 interrupt total irq4: uart0 361 irq6: fdc0 1 irq9: acpi0 2 irq14: ata0 25344 irq16: hdac1 ohci0 91 irq17: ohci1 ohci3 3 irq18: ohci2 ohci4 2 irq22: ahci0 4504947 cpu0:timer 8618184 cpu2:timer 6001243 cpu3:timer 8219555 cpu1:timer 8437289 irq256: hdac0 5 irq257: re0 172298 Total 35979333 KDB: stack backtrace: db_trace_self_wrapper(c16523c0,c125817f,66da0783,7ffedb99,369e99,...) at db_trace_self_wrapper+0x2a/frame 0xd7e50850 kdb_backtrace(c1640920,2250045,0,2250045,ffffffff,...) at kdb_backtrace+0x2d/frame 0xd7e508b8 watchdog_fire(1,8,c18578ef,d7e50928,0,...) at watchdog_fire+0x98/frame 0xd7e508e0 hardclock_cnt(1,0,c18578ef,e0,9e524c0,...) at hardclock_cnt+0x26a/frame 0xd7e50928 handleevents(0,9d9a,1,cb7acc40,9d9a,...) at handleevents+0xfe/frame 0xd7e50970 timercb(c1bd80e4,0,3,3,d7e50a78,...) at timercb+0x25d/frame 0xd7e509ac lapic_handle_timer(d7e509d8) at lapic_handle_timer+0x80/frame 0xd7e509cc Xtimerint_pti(d7e50a78,d615a44c,c6dc06b8,0,246,...) at Xtimerint_pti+0x2b/frame 0xd7e50a38 __mtx_lock_sleep(cb7de970,d63d3a80,0,c167bbe3,1ec,...) at __mtx_lock_sleep+0xd8/frame 0xd7e50aa8 __mtx_lock_flags(cb7de970,0,c167bbe3,1ec,d615a380,...) at __mtx_lock_flags+0x107/frame 0xd7e50ad8 ipreass_slowtimo(c1be75a4,c167b18c,349,95c2,c1648c33,...) at ipreass_slowtimo+0x53/frame 0xd7e50b28 ip_slowtimo(c1be50c0,8,c194d860,d7e50b88,c0c86e22,...) at ip_slowtimo+0x6d/frame 0xd7e50b54 pfslowtimo(0,0,c164e8c1,2b3,3f,...) at pfslowtimo+0x50/frame 0xd7e50b88 softclock_call_cc(0,0,c164e8c1,362,c1be50d0,...) at softclock_call_cc+0x16e/frame 0xd7e50c20 softclock(c1be50c0,0,d615a380,c1b49500,d60efc48,...) at softclock+0x84/frame 0xd7e50c48 intr_event_execute_handlers(c1b49510,d60efc00,c1643981,5ac,c16435dc,...) at intr_event_execute_handlers+0x8e/frame 0xd7e50c70 ithread_loop(d6157ed0,d7e50ce8,c16435dc,407,0,...) at ithread_loop+0xa0/frame 0xd7e50cac fork_exit(c0c38860,d6157ed0,d7e50ce8) at fork_exit+0x7e/frame 0xd7e50cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e50cd4 --- trap 0, eip = 0, esp = 0xd7e50d20, ebp = 0 --- KDB: enter: watchdog timeout [ thread pid 12 tid 100022 ] Stopped at kdb_enter+0x3a: movl $0,kdb_why db> run pho db:0:pho> bt Tracing pid 12 tid 100022 td 0xd615a380 kdb_enter(c12cedc2,c1351ca5,0,2250045,ffffffff) at kdb_enter+0x3a/frame 0xd7e508b8 watchdog_fire(1,8,c18578ef,d7e50928,0,...) at watchdog_fire+0xac/frame 0xd7e508e0 hardclock_cnt(1,0,c18578ef,e0,9e524c0,...) at hardclock_cnt+0x26a/frame 0xd7e50928 handleevents(0,9d9a,1,cb7acc40,9d9a,...) at handleevents+0xfe/frame 0xd7e50970 timercb(c1bd80e4,0,3,3,d7e50a78,...) at timercb+0x25d/frame 0xd7e509ac lapic_handle_timer(d7e509d8) at lapic_handle_timer+0x80/frame 0xd7e509cc Xtimerint_pti(d7e50a78,d615a44c,c6dc06b8,0,246,...) at Xtimerint_pti+0x2b/frame 0xd7e50a38 __mtx_lock_sleep(cb7de970,d63d3a80,0,c167bbe3,1ec,...) at __mtx_lock_sleep+0xd8/frame 0xd7e50aa8 __mtx_lock_flags(cb7de970,0,c167bbe3,1ec,d615a380,...) at __mtx_lock_flags+0x107/frame 0xd7e50ad8 ipreass_slowtimo(c1be75a4,c167b18c,349,95c2,c1648c33,...) at ipreass_slowtimo+0x53/frame 0xd7e50b28 ip_slowtimo(c1be50c0,8,c194d860,d7e50b88,c0c86e22,...) at ip_slowtimo+0x6d/frame 0xd7e50b54 pfslowtimo(0,0,c164e8c1,2b3,3f,...) at pfslowtimo+0x50/frame 0xd7e50b88 softclock_call_cc(0,0,c164e8c1,362,c1be50d0,...) at softclock_call_cc+0x16e/frame 0xd7e50c20 softclock(c1be50c0,0,d615a380,c1b49500,d60efc48,...) at softclock+0x84/frame 0xd7e50c48 intr_event_execute_handlers(c1b49510,d60efc00,c1643981,5ac,c16435dc,...) at intr_event_execute_handlers+0x8e/frame 0xd7e50c70 ithread_loop(d6157ed0,d7e50ce8,c16435dc,407,0,...) at ithread_loop+0xa0/frame 0xd7e50cac fork_exit(c0c38860,d6157ed0,d7e50ce8) at fork_exit+0x7e/frame 0xd7e50cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e50cd4 --- trap 0, eip = 0, esp = 0xd7e50d20, ebp = 0 --- db:0:bt> show allpcpu Current CPU: 3 cpuid = 0 dynamic pcpu = 0x6cd4c0 curthread = 0xd63d3a80: pid 12 tid 100043 "irq257: re0" curpcb = 0xd7ee8d40 fpcurthread = none idlethread = 0xd60f9700: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 curvnet = 0xcb51bc00 spin locks held: cpuid = 1 dynamic pcpu = 0x9e484c0 curthread = 0xd852e380: pid 20 tid 100098 "uma" curpcb = 0xdbe8ed40 fpcurthread = none idlethread = 0xd60f9380: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 curvnet = 0xcb51bc00 spin locks held: cpuid = 2 dynamic pcpu = 0x9e4d4c0 curthread = 0xd60f9000: pid 11 tid 100005 "idle: cpu2" curpcb = 0xd4910d40 fpcurthread = none idlethread = 0xd60f9000: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0x9e524c0 curthread = 0xd615a380: pid 12 tid 100022 "swi4: clock (0)" curpcb = 0xd7e50d40 fpcurthread = none idlethread = 0xd60f8a80: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 curvnet = 0xcb51bc00 spin locks held: db:0:allpcpu> show alllocks Process 18669 (sh) thread 0xded17000 (100284) shared lockmgr ufs (ufs) r = 0 (0xd8b73b74) locked @ kern/vfs_subr.c:2607 Process 18668 (newsyslog) thread 0xdeb75000 (100277) shared lockmgr ufs (ufs) r = 0 (0xd8aeb73c) locked @ kern/vfs_subr.c:2607 Process 18645 (sh) thread 0xdeb91700 (100225) shared lockmgr ufs (ufs) r = 0 (0xd8b73b74) locked @ kern/vfs_subr.c:2607 Process 18604 (sh) thread 0xdeb1f380 (100300) shared lockmgr ufs (ufs) r = 0 (0xd8b73b74) locked @ kern/vfs_subr.c:2607 Process 18564 (sh) thread 0xdeaf9a80 (100388) shared lockmgr ufs (ufs) r = 0 (0xd8b73b74) locked @ kern/vfs_subr.c:2607 Process 18522 (sh) thread 0xde99c380 (100368) shared lockmgr ufs (ufs) r = 0 (0xd8b73b74) locked @ kern/vfs_subr.c:2607 Process 18482 (sh) thread 0xdeb7ea80 (100254) shared lockmgr ufs (ufs) r = 0 (0xd8b73b74) locked @ kern/vfs_subr.c:2607 Process 18441 (sh) thread 0xdec01000 (100301) shared lockmgr ufs (ufs) r = 0 (0xd8b73b74) locked @ kern/vfs_subr.c:2607 Process 18440 (newsyslog) thread 0xdc29a000 (100375) shared lockmgr ufs (ufs) r = 0 (0xd8aeb73c) locked @ kern/vfs_subr.c:2607 Process 18417 (sh) thread 0xd89ae380 (100401) shared lockmgr ufs (ufs) r = 0 (0xd8b73b74) locked @ kern/vfs_subr.c:2607 Process 18376 (sh) thread 0xdeb8f380 (100268) shared lockmgr ufs (ufs) r = 0 (0xd8b73b74) locked @ kern/vfs_subr.c:2607 Process 18336 (sh) thread 0xdec03000 (100275) shared lockmgr ufs (ufs) r = 0 (0xd8b73b74) locked @ kern/vfs_subr.c:2607 Process 18292 (sh) thread 0xdc47d700 (100403) shared lockmgr ufs (ufs) r = 0 (0xd8b73b74) locked @ kern/vfs_subr.c:2607 Process 18253 (sh) thread 0xcb791000 (100405) shared lockmgr ufs (ufs) r = 0 (0xd8b73b74) locked @ kern/vfs_subr.c:2607 Process 18214 (sh) thread 0xdec02380 (100315) shared lockmgr ufs (ufs) r = 0 (0xd8b73b74) locked @ kern/vfs_subr.c:2607 Process 18188 (sh) thread 0xdec02000 (100318) shared lockmgr ufs (ufs) r = 0 (0xd8b73b74) locked @ kern/vfs_subr.c:2607 Process 18147 (sh) thread 0xdc381700 (100437) shared lockmgr ufs (ufs) r = 0 (0xd8b73b74) locked @ kern/vfs_subr.c:2607 Process 18107 (sh) thread 0xdeb75380 (100276) shared lockmgr ufs (ufs) r = 0 (0xd8b73b74) locked @ kern/vfs_subr.c:2607 Process 18063 (sh) thread 0xdeb80380 (100247) shared lockmgr ufs (ufs) r = 0 (0xd8b73b74) locked @ kern/vfs_subr.c:2607 Process 18023 (sh) thread 0xcb793700 (100407) shared lockmgr ufs (ufs) r = 0 (0xd8b73b74) locked @ kern/vfs_subr.c:2607 Process 17980 (sh) thread 0xdc47d380 (100390) shared lockmgr ufs (ufs) r = 0 (0xd8b73b74) locked @ kern/vfs_subr.c:2607 Process 17979 (newsyslog) thread 0xdeb76700 (100238) shared lockmgr ufs (ufs) r = 0 (0xd8aeb73c) locked @ kern/vfs_subr.c:2607 Process 17956 (sh) thread 0xdc2e3a80 (100338) shared lockmgr ufs (ufs) r = 0 (0xd8b73b74) locked @ kern/vfs_subr.c:2607 Process 17915 (sh) thread 0xdeb7e380 (100256) shared lockmgr ufs (ufs) r = 0 (0xd8b73b74) locked @ kern/vfs_subr.c:2607 Process 17875 (sh) thread 0xdee53380 (100347) shared lockmgr ufs (ufs) r = 0 (0xd8b73b74) locked @ kern/vfs_subr.c:2607 Process 17832 (dd) thread 0xd6354380 (100335) exclusive lockmgr bufwait (bufwait) r = 0 (0xcb6ffd48) locked @ kern/vfs_bio.c:1477 exclusive lockmgr ufs (ufs) r = 0 (0xf908173c) locked @ ufs/ffs/ffs_vfsops.c:1677 exclusive lockmgr ufs (ufs) r = 0 (0xf7edd304) locked @ kern/vfs_lookup.c:671 Process 17652 (sh) thread 0xd8315000 (100103) exclusive sx vm map (user) (vm map (user)) r = 0 (0xd6101af4) locked @ vm/vm_map.c:3432 exclusive sx vm map (user) (vm map (user)) r = 0 (0xd8b09680) locked @ vm/vm_map.c:3428 Process 17648 (rsync) thread 0xdc810a80 (100243) shared lockmgr ufs (ufs) r = 0 (0xf94195d4) locked @ kern/vfs_vnops.c:803 Process 89376 (find) thread 0xdd9bb000 (100332) exclusive sx dirhash (dirhash) r = 0 (0xf5a8a600) locked @ ufs/ufs/ufs_dirhash.c:218 shared lockmgr ufs (ufs) r = 0 (0xf9c0719c) locked @ kern/vfs_lookup.c:671 Process 1332 (sshd) thread 0xdc80b380 (100214) exclusive sx so_snd_sx (so_snd_sx) r = 0 (0xdc6aaf64) locked @ kern/uipc_sockbuf.c:285 Process 408 (syslogd) thread 0xd841fa80 (100108) exclusive lockmgr ufs (ufs) r = 0 (0xdc1f0b74) locked @ kern/vfs_vnops.c:883 Process 332 (devd) thread 0xd8421380 (100123) exclusive sx so_snd_sx (so_snd_sx) r = 0 (0xdc227164) locked @ kern/uipc_sockbuf.c:285 Process 25 (syncer) thread 0xd627d000 (100102) exclusive lockmgr ufs (ufs) r = 0 (0xde981a0c) locked @ kern/vfs_subr.c:2607 exclusive lockmgr syncer (syncer) r = 0 (0xd8b0546c) locked @ kern/vfs_subr.c:2157 Process 20 (pagedaemon) thread 0xd852e380 (100098) shared rw vnet_rwlock (vnet_rwlock) r = 0 (0xc1be7594) locked @ netinet/ip_input.c:855 Process 12 (intr) thread 0xd615a380 (100022) shared rw vnet_rwlock (vnet_rwlock) r = 0 (0xc1be7594) locked @ netinet/ip_input.c:841 Process 12 (intr) thread 0xd63d3a80 (100043) exclusive sleep mutex IP reassembly (IP reassembly) r = 0 (0xcb7de960) locked @ netinet/ip_reass.c:208 db:0:alllocks> show lockedvnods Locked vnodes vnode 0xd8b05438: tag syncer, type VNON usecount 1, writecount 0, refcount 2 flags (VI_ACTIVE) lock type syncer: EXCL by thread 0xd627d000 (pid 25, syncer, tid 100102) #0 0xc0c4a671 at lockmgr_lock_fast_path+0x221 #1 0xc0d3889b at vop_stdlock+0x3b #2 0xc12849da at VOP_LOCK1_APV+0xda #3 0xc0d5f851 at _vn_lock+0x61 #4 0xc0d50f72 at sched_sync+0x282 #5 0xc0c355ce at fork_exit+0x7e #6 0xc123919c at fork_trampoline+0x8 vnode 0xde9819d8: tag ufs, type VREG usecount 7, writecount 0, refcount 8 flags (VI_ACTIVE) v_object 0xde42bd68 ref 6 pages 4 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xd627d000 (pid 25, syncer, tid 100102) #0 0xc0c4b5da at __lockmgr_args+0xefa #1 0xc0f95437 at ffs_lock+0xa7 #2 0xc12849da at VOP_LOCK1_APV+0xda #3 0xc0d5f851 at _vn_lock+0x61 #4 0xc0d4b741 at vget+0xc1 #5 0xc0f93998 at ffs_sync+0x5e8 #6 0xc0d534fc at sync_fsync+0x11c #7 0xc12833d6 at VOP_FSYNC_APV+0xf6 #8 0xc0d50fa6 at sched_sync+0x2b6 #9 0xc0c355ce at fork_exit+0x7e #10 0xc123919c at fork_trampoline+0x8 ino 447893, on dev ada0s1d vnode 0xd8b73b40: tag ufs, type VDIR usecount 21, writecount 0, refcount 24 mountedhere 0 flags (VI_ACTIVE) v_object 0xdc223270 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: SHARED (count 21) #0 0xc0c4ad47 at __lockmgr_args+0x667 #1 0xc0f95437 at ffs_lock+0xa7 #2 0xc12849da at VOP_LOCK1_APV+0xda #3 0xc0d5f851 at _vn_lock+0x61 #4 0xc0d4b741 at vget+0xc1 #5 0xc0d2f97b at cache_lookup+0x97b #6 0xc0d342b5 at vfs_cache_lookup+0xb5 #7 0xc1280ff6 at VOP_LOOKUP_APV+0xf6 #8 0xc0d3e893 at lookup+0x663 #9 0xc0d3de21 at namei+0x5f1 #10 0xc0d5896e at kern_statat+0xae #11 0xc0d59279 at sys_fstatat+0x49 #12 0xc124fa6e at syscall+0x6ee #13 0xc123918b at Xint0x80_syscall+0x2b ino 1742848, on dev ada0s1e vnode 0xd8aeb708: tag ufs, type VDIR usecount 3, writecount 0, refcount 6 mountedhere 0 flags (VI_ACTIVE) v_object 0xd8499b94 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: SHARED (count 3) #0 0xc0c4ad47 at __lockmgr_args+0x667 #1 0xc0f95437 at ffs_lock+0xa7 #2 0xc12849da at VOP_LOCK1_APV+0xda #3 0xc0d5f851 at _vn_lock+0x61 #4 0xc0d4b741 at vget+0xc1 #5 0xc0d2f97b at cache_lookup+0x97b #6 0xc0d342b5 at vfs_cache_lookup+0xb5 #7 0xc1280ff6 at VOP_LOOKUP_APV+0xf6 #8 0xc0d3e893 at lookup+0x663 #9 0xc0d3de21 at namei+0x5f1 #10 0xc0d5896e at kern_statat+0xae #11 0xc0d59279 at sys_fstatat+0x49 #12 0xc124fa6e at syscall+0x6ee #13 0xc123918b at Xint0x80_syscall+0x2b ino 6052864, on dev ada0s1e vnode 0xdc1f0b40: tag ufs, type VREG usecount 1, writecount 1, refcount 8 flags (VI_ACTIVE) v_object 0xdc1e23a8 ref 0 pages 12 cleanbuf 3 dirtybuf 0 lock type ufs: EXCL by thread 0xd841fa80 (pid 408, syslogd, tid 100108) with shared waiters pending #0 0xc0c4b5da at __lockmgr_args+0xefa #1 0xc0f95437 at ffs_lock+0xa7 #2 0xc12849da at VOP_LOCK1_APV+0xda #3 0xc0d5f851 at _vn_lock+0x61 #4 0xc0d6276d at vn_write+0x1bd #5 0xc0d621c3 at vn_io_fault_doio+0x83 #6 0xc0d5ff65 at vn_io_fault1+0x165 #7 0xc0d5e127 at vn_io_fault+0x1e7 #8 0xc0ce4102 at dofilewrite+0xb2 #9 0xc0ce3d23 at kern_writev+0x93 #10 0xc0ce4032 at sys_writev+0x42 #11 0xc124fa6e at syscall+0x6ee #12 0xc123918b at Xint0x80_syscall+0x2b ino 6052894, on dev ada0s1e vnode 0xf7edd2d0: tag ufs, type VDIR usecount 3, writecount 0, refcount 26 mountedhere 0 flags (VI_ACTIVE) v_object 0xde1d76b4 ref 0 pages 1 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xd6354380 (pid 17832, dd, tid 100335) with shared waiters pending #0 0xc0c4ad47 at __lockmgr_args+0x667 #1 0xc0f95437 at ffs_lock+0xa7 #2 0xc12849da at VOP_LOCK1_APV+0xda #3 0xc0d5f851 at _vn_lock+0x61 #4 0xc0d3e32a at lookup+0xfa #5 0xc0d3de21 at namei+0x5f1 #6 0xc0d5ef23 at vn_open_cred+0xa3 #7 0xc0d5ee6d at vn_open+0x3d #8 0xc0d565d6 at kern_openat+0x336 #9 0xc0d56893 at sys_openat+0x53 #10 0xc124fa6e at syscall+0x6ee #11 0xc123918b at Xint0x80_syscall+0x2b ino 1742849, on dev ada0s1e vnode 0xf9081708: tag ufs, type VNON usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) lock type ufs: EXCL by thread 0xd6354380 (pid 17832, dd, tid 100335) #0 0xc0c4b5da at __lockmgr_args+0xefa #1 0xc0f90295 at ffs_vgetf+0x155 #2 0xc0f90137 at ffs_vget+0x37 #3 0xc0f5f44d at ffs_valloc+0x67d #4 0xc0fa9465 at ufs_makeinode+0xb5 #5 0xc0fa5488 at ufs_create+0x38 #6 0xc1281416 at VOP_CREATE_APV+0xf6 #7 0xc0d5f0dc at vn_open_cred+0x25c #8 0xc0d5ee6d at vn_open+0x3d #9 0xc0d565d6 at kern_openat+0x336 #10 0xc0d56893 at sys_openat+0x53 #11 0xc124fa6e at syscall+0x6ee #12 0xc123918b at Xint0x80_syscall+0x2b ino 1743049, on dev ada0s1e vnode 0xf9c07168: tag ufs, type VDIR usecount 3, writecount 0, refcount 5 mountedhere 0 flags (VI_ACTIVE) v_object 0xf518209c ref 0 pages 4 cleanbuf 1 dirtybuf 0 lock type ufs: SHARED (count 1) #0 0xc0c4ad47 at __lockmgr_args+0x667 #1 0xc0f95437 at ffs_lock+0xa7 #2 0xc12849da at VOP_LOCK1_APV+0xda #3 0xc0d5f851 at _vn_lock+0x61 #4 0xc0d3e32a at lookup+0xfa #5 0xc0d3de21 at namei+0x5f1 #6 0xc0d5896e at kern_statat+0xae #7 0xc0d59279 at sys_fstatat+0x49 #8 0xc124fa6e at syscall+0x6ee #9 0xc123918b at Xint0x80_syscall+0x2b ino 2520076, on dev label/tmp vnode 0xf94195a0: tag ufs, type VREG usecount 1, writecount 0, refcount 166 flags (VI_ACTIVE) v_object 0xf4d58c30 ref 0 pages 656 cleanbuf 164 dirtybuf 0 lock type ufs: SHARED (count 1) #0 0xc0c4ad47 at __lockmgr_args+0x667 #1 0xc0f95437 at ffs_lock+0xa7 #2 0xc12849da at VOP_LOCK1_APV+0xda #3 0xc0d5f851 at _vn_lock+0x61 #4 0xc0d62343 at vn_read+0x123 #5 0xc0d621c3 at vn_io_fault_doio+0x83 #6 0xc0d5ff65 at vn_io_fault1+0x165 #7 0xc0d5e127 at vn_io_fault+0x1e7 #8 0xc0ce3b4b at dofileread+0xab #9 0xc0ce3773 at kern_readv+0x93 #10 0xc0ce36c4 at sys_read+0x54 #11 0xc124fa6e at syscall+0x6ee #12 0xc123918b at Xint0x80_syscall+0x2b ino 5795160, on dev label/tmp db:0:lockedvnods> show mount 0xd89b5000 /dev/ada0s1a on / (ufs) 0xd89b6000 devfs on /dev (devfs) 0xd8b87000 /dev/ada0s1f on /home (ufs) 0xd8b85000 /dev/ada0s1d on /usr (ufs) 0xdc17b000 /dev/ada0s1e on /var (ufs) 0xdc17a000 procfs on /proc (procfs) 0xd8b86000 /dev/label/tmp on /tmp (ufs) More info: show mount db:0:mount> show page vm_cnt.v_free_count: 659315 vm_cnt.v_inactive_count: 29622 vm_cnt.v_active_count: 2059 vm_cnt.v_laundry_count: 2 vm_cnt.v_wire_count: 171784 vm_cnt.v_free_reserved: 1189 vm_cnt.v_free_min: 5501 vm_cnt.v_free_target: 18437 vm_cnt.v_inactive_target: 27655 db:0:page> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 -- -- -- -- 10 (004096K) | 000000 09 (002048K) | 000041 08 (001024K) | 000282 07 (000512K) | 000994 06 (000256K) | 002234 05 (000128K) | 003858 04 (000064K) | 006400 03 (000032K) | 008473 02 (000016K) | 000351 01 (000008K) | 000000 00 (000004K) | 000000 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 -- -- -- -- 10 (004096K) | 000000 09 (002048K) | 000000 08 (001024K) | 000000 07 (000512K) | 000002 06 (000256K) | 000004 05 (000128K) | 000005 04 (000064K) | 000007 03 (000032K) | 000006 02 (000016K) | 000007 01 (000008K) | 000007 00 (000004K) | 000005 db:0:freepages> ps pid ppid pgrp uid state wmesg wchan cmd 18685 18665 0 0 NE ls 18684 501 0 0 NE sh 18669 18666 18669 2 Ds ufs 0xf7edd304 sh 18668 18665 18668 0 Ds ufs 0xdc1f0b74 newsyslog 18666 681 681 0 S piperd 0xfc8c51a8 cron 18665 681 681 0 S piperd 0xdc1e61a8 cron 18645 18643 18645 2 Ds ufs 0xf7edd304 sh 18643 681 681 0 S piperd 0xdca764f8 cron 18604 18603 18604 2 Ds ufs 0xf7edd304 sh 18603 681 681 0 S piperd 0xfc8b7b98 cron 18564 18563 18564 2 Ds ufs 0xf7edd304 sh 18563 681 681 0 S piperd 0xd8b61848 cron 18522 18521 18522 2 Ds ufs 0xf7edd304 sh 18521 681 681 0 S piperd 0xdea1bd40 cron 18482 18481 18482 2 Ds ufs 0xf7edd304 sh 18481 681 681 0 S piperd 0xf5b4eb98 cron 18441 18438 18441 2 Ds ufs 0xf7edd304 sh 18440 18437 18440 0 Ds ufs 0xdc1f0b74 newsyslog 18438 681 681 0 S piperd 0xfc8b7848 cron 18437 681 681 0 S piperd 0xdca761a8 cron 18417 18415 18417 2 Ds ufs 0xf7edd304 sh 18415 681 681 0 S piperd 0xf5b4e000 cron 18376 18375 18376 2 Ds ufs 0xf7edd304 sh 18375 681 681 0 S piperd 0xdea1b848 cron 18336 18335 18336 2 Ds ufs 0xf7edd304 sh 18335 681 681 0 S piperd 0xd8b61350 cron 18292 18291 18292 2 Ds ufs 0xf7edd304 sh 18291 681 681 0 S piperd 0xdc1e5000 cron 18253 18252 18253 2 Ds ufs 0xf7edd304 sh 18252 681 681 0 S piperd 0xfec8d000 cron 18214 18595 0 2 NE df 18213 18210 18213 0 DVs kernel 0xc1b5b780 cron 18212 18208 18212 0 DVs kernel 0xc1b5b780 cron 18211 18209 18211 2 Ds kernel 0xc1b5b780 sh 18210 681 681 0 D ppwait 0xdc50932c cron 18209 681 681 0 S piperd 0xfd3aa9f0 cron 18208 681 681 0 D ppwait 0xdeb8a32c cron 18188 18186 18188 2 Ds ufs 0xf7edd304 sh 18186 681 681 0 S piperd 0xd8af7000 cron 18147 18146 18147 2 Ds ufs 0xf7edd304 sh 18146 681 681 0 S piperd 0xf5b4ed40 cron 18107 18106 18107 2 Ds ufs 0xf7edd304 sh 18106 681 681 0 S piperd 0xf5b4e1a8 cron 18063 18062 18063 2 Ds ufs 0xf7edd304 sh 18062 681 681 0 S piperd 0xdca766a0 cron 18023 18022 18023 2 Ds ufs 0xf7edd304 sh 18022 681 681 0 S piperd 0xf5b4e4f8 cron 17980 17977 17980 2 Ds ufs 0xf7edd304 sh 17979 17976 17979 0 Ds ufs 0xdc1f0b74 newsyslog 17977 681 681 0 S piperd 0xd8b7e4f8 cron 17976 681 681 0 S piperd 0xdc1e6848 cron 17956 17954 17956 2 Ds ufs 0xf7edd304 sh 17954 681 681 0 S piperd 0xdc1e54f8 cron 17915 17914 17915 2 Ds ufs 0xf7edd304 sh 17914 681 681 0 S piperd 0xdc1e6350 cron 17875 17874 17875 2 Ds ufs 0xf7edd304 sh 17874 681 681 0 S piperd 0xd8af74f8 cron 17832 17822 17822 2 D biord 0xcb6ffcec dd 17822 17821 17822 2 Ss wait 0xdcf8f6b0 sh 17821 681 681 0 S piperd 0xd8af71a8 cron 17715 17648 17648 1001 S select 0xd85f1164 rsync 17652 1338 1334 1001 D kernel 0xc1b5b780 sh 17648 17560 17648 1001 Ds getblk 0xcb62e4f4 rsync 17560 17123 17123 1001 S select 0xdc4de2e4 sshd 17123 671 17123 0 Ss select 0xd8438f24 sshd 89379 89377 88947 0 S piperd 0xd8b611a8 cat 89377 89372 88947 0 S wait 0xde692000 sh 89376 89372 88947 0 D kernel 0xc1b5b780 find 89372 89370 88947 0 S wait 0xd899c6b0 sh 89371 89362 88947 0 S piperd 0xd8b61000 mail 89370 89362 88947 0 S wait 0xddb7b000 sh 89362 89361 88947 0 S wait 0xdd809a08 sh 89361 89359 88947 0 S wait 0xdd1296b0 lockf 89359 89358 88947 0 S wait 0xdeb89358 sh 89358 89014 88947 0 S wait 0xdc478a08 sh 89016 88974 88947 0 S piperd 0xf5522d40 mail 89014 88974 88947 0 S wait 0xdd80a6b0 sh 88974 88967 88947 0 S wait 0xdc6cda08 sh 88967 88947 88947 0 S wait 0xdeb89a08 lockf 88947 88945 88947 0 Ss wait 0xdc547358 sh 88945 681 681 0 S piperd 0xdca76000 cron 67385 61564 6353 0 D+ g_waitf 0xf95f2c00 gmirror 67384 62486 6353 0 D+ g_waitf 0xf52bb080 gmirror 67383 62487 6353 0 D+ g_waiti 0xc1b37bac gmirror 67382 0 0 0 DL m:w1 0xde695600 [g_mirror markj-mirr] 62487 61564 6353 0 S+ wait 0xdc6cd000 sh 62486 61564 6353 0 S+ wait 0xdc6b7358 sh 62315 0 0 0 DL mdwait 0xdcb7c000 [md11] 62259 0 0 0 DL mdwait 0xdcff8000 [md10] 61564 61562 6353 0 S+ wait 0xd8527358 sh 61563 6353 6353 0 S+ piperd 0xf5b4e848 tee 61562 6353 6353 0 S+ wait 0xdcf8f000 sh 6353 920 6353 0 S+ wait 0xd83ffa08 sh 1340 1334 1334 1001 S piperd 0xdc1e59f0 sh 1339 1334 1334 1001 S piperd 0xdc1e5d40 awk 1338 1334 1334 1001 S wait 0xde6926b0 sh 1335 1332 1335 1001 Ss+ ttyout 0xd6275a7c top 1334 1331 1334 1001 SWs wait 0xde694358 sh 1333 1330 1333 1001 Ss kqread 0xd857de00 tail 1332 1325 1325 1001 D kernel 0xc1b5b780 sshd 1331 1328 1328 1001 S select 0xd87cfe64 sshd 1330 1324 1324 1001 S select 0xd85f10a4 sshd 1328 671 1328 0 Ss select 0xd8437a64 sshd 1325 671 1325 0 Ss select 0xd85f11a4 sshd 1324 671 1324 0 Ss select 0xd8437aa4 sshd 920 918 920 0 S+ wait 0xde693a08 bash 918 917 918 0 SW+ pause 0xd8272714 csh 917 906 917 1001 SW+ wait 0xde694000 su 906 905 906 1001 SWs+ wait 0xd60ec358 bash 905 903 903 1001 S select 0xd85f12a4 sshd 903 671 903 0 Ss select 0xd87d0024 sshd 830 1 830 0 Ss+ ttyin 0xd82eb274 getty 829 1 829 0 Ss+ ttyin 0xd6276874 getty 828 1 828 0 Ss+ ttyin 0xd6276a74 getty 827 1 827 0 Ss+ ttyin 0xd6276c74 getty 826 1 826 0 Ss+ ttyin 0xd6276e74 getty 825 1 825 0 Ss+ ttyin 0xd6277074 getty 824 1 824 0 Ss+ ttyin 0xd6277274 getty 823 1 823 0 Ss+ ttyin 0xd6277474 getty 822 1 822 0 Ss+ ttyin 0xd6277674 getty 805 1 805 0 Ds swread 0xdc6c98e0 inetd 771 770 770 0 S (threaded) nfscbd 100106 S rpcsvc 0xd87c53d0 nfscbd: master 100176 S rpcsvc 0xd85719d0 nfscbd: service 100177 S rpcsvc 0xd8571950 nfscbd: service 100178 S rpcsvc 0xd85718d0 nfscbd: service 770 1 770 0 SWs accept 0xdc6ab4c0 nfscbd 681 1 681 0 Ds kernel 0xc1b5b780 cron 677 1 677 25 Ss pause 0xd899aa6c sendmail 674 1 674 0 Ds kernel 0xc1b5b780 sendmail 671 1 671 0 Ss select 0xd85f1324 sshd 633 1 632 0 S nanslp 0xc1b3ae96 smartd 603 1 603 0 Ds kernel 0xc1b5b780 powerd 600 1 600 0 Ds (threaded) ntpd 100159 D kernel 0xc1b5b780 ntpd 564 1 564 0 Ss rpcsvc 0xd8571a50 NLM: master 561 1 561 0 Ss select 0xd8318aa4 rpc.statd 560 557 557 0 S (threaded) nfsd 100124 S rpcsvc 0xc6db2b50 nfsd: master 100127 S rpcsvc 0xd6363a50 nfsd: service 100128 S rpcsvc 0xd87c7dd0 nfsd: service 100129 S rpcsvc 0xd63639d0 nfsd: service 100130 S rpcsvc 0xd87c7e50 nfsd: service 100131 S rpcsvc 0xd87c7ed0 nfsd: service 100132 S rpcsvc 0xd6363950 nfsd: service 100133 S rpcsvc 0xd87c7f50 nfsd: service 100134 S rpcsvc 0xd87c8050 nfsd: service 100135 S rpcsvc 0xd63638d0 nfsd: service 100136 S rpcsvc 0xd6363850 nfsd: service 100137 S rpcsvc 0xd63637d0 nfsd: service 100138 S rpcsvc 0xd6363750 nfsd: service 100139 S rpcsvc 0xd63636d0 nfsd: service 100140 S rpcsvc 0xd6363650 nfsd: service 100141 S rpcsvc 0xd87c80d0 nfsd: service 100142 S rpcsvc 0xd8571dd0 nfsd: service 100143 S rpcsvc 0xd63635d0 nfsd: service 100144 S rpcsvc 0xd8571d50 nfsd: service 100145 S rpcsvc 0xd6363550 nfsd: service 100146 S rpcsvc 0xd8571cd0 nfsd: service 100147 S rpcsvc 0xd63634d0 nfsd: service 100148 S rpcsvc 0xd8571c50 nfsd: service 100149 S rpcsvc 0xd6363450 nfsd: service 100150 S rpcsvc 0xd8571bd0 nfsd: service 100151 S rpcsvc 0xd63633d0 nfsd: service 100152 S rpcsvc 0xd6363350 nfsd: service 100153 S rpcsvc 0xd63632d0 nfsd: service 100154 S rpcsvc 0xd6363250 nfsd: service 100155 S rpcsvc 0xd8571b50 nfsd: service 100156 S rpcsvc 0xd63631d0 nfsd: service 100157 S rpcsvc 0xd8571ad0 nfsd: service 557 1 557 0 Ss select 0xd87d00a4 nfsd 551 1 551 0 Ss select 0xd8318ae4 mountd 544 543 543 0 S select 0xd87d0124 nfsuserd 543 1 543 0 SWs pause 0xd8404714 nfsuserd 501 1 501 0 Ds kernel 0xc1b5b780 watchdogd 417 1 417 0 Ds swread 0xd842a670 rpcbind 408 1 408 0 Ds getblk 0xcb68ec58 syslogd 332 1 332 0 Ds kernel 0xc1b5b780 devd 25 0 0 0 DL getblk 0xcb54fea0 [syncer] 24 0 0 0 DL vlruwt 0xd899b6b0 [vnlru] 23 0 0 0 DL (threaded) [bufdaemon] 100100 D psleep 0xc1bb7c2c [bufdaemon] 100112 D sdflush 0xd8b12c84 [/home worker] 100114 D sdflush 0xd8b12884 [/usr worker] 100115 D sdflush 0xd8b12684 [/var worker] 100175 D sdflush 0xd8b12a84 [/tmp worker] 22 0 0 0 DL - 0xc1bb7d80 [bufspacedaemon] 21 0 0 0 DL psleep 0xc1bbd27c [vmdaemon] 20 0 0 0 RL (threaded) [pagedaemon] 100095 D psleep 0xc1bbd0e0 [pagedaemon] 100097 D launds 0xc1bbd0ec [laundry: dom0] 100098 Run CPU 1 [uma] 19 0 0 0 DL - 0xc1a1310c [rand_harvestq] 18 0 0 0 DL waiting 0xc1be779c [sctp_iterator] 17 0 0 0 DL - 0xc1bb7858 [soaiod4] 16 0 0 0 DL - 0xc1bb7858 [soaiod3] 15 0 0 0 DL - 0xc1bb7858 [soaiod2] 9 0 0 0 DL - 0xc1bb7858 [soaiod1] 8 0 0 0 DL - 0xd637923c [fdc0] 14 0 0 0 DL (threaded) [usb] 100046 D - 0xd63b1acc [usbus0] 100047 D - 0xd63b1afc [usbus0] 100048 D - 0xd63b1b2c [usbus0] 100049 D - 0xd63b1b5c [usbus0] 100050 D - 0xd63b1b8c [usbus0] 100052 D - 0xd827bacc [usbus1] 100053 D - 0xd827bafc [usbus1] 100054 D - 0xd827bb2c [usbus1] 100055 D - 0xd827bb5c [usbus1] 100056 D - 0xd827bb8c [usbus1] 100058 D - 0xd8290acc [usbus2] 100059 D - 0xd8290afc [usbus2] 100060 D - 0xd8290b2c [usbus2] 100061 D - 0xd8290b5c [usbus2] 100062 D - 0xd8290b8c [usbus2] 100063 D - 0xd8294acc [usbus3] 100064 D - 0xd8294afc [usbus3] 100065 D - 0xd8294b2c [usbus3] 100066 D - 0xd8294b5c [usbus3] 100067 D - 0xd8294b8c [usbus3] 100068 D - 0xd829eacc [usbus4] 100069 D - 0xd829eafc [usbus4] 100070 D - 0xd829eb2c [usbus4] 100071 D - 0xd829eb5c [usbus4] 100072 D - 0xd829eb8c [usbus4] 100074 D - 0xd63a2ca4 [usbus5] 100075 D - 0xd63a2cd4 [usbus5] 100076 D - 0xd63a2d04 [usbus5] 100077 D - 0xd63a2d34 [usbus5] 100078 D - 0xd63a2d64 [usbus5] 7 0 0 0 DL (threaded) [cam] 100041 D - 0xc19604c0 [doneq0] 100094 D - 0xc19603ec [scanner] 6 0 0 0 DL crypto_ 0xd60cb7c4 [crypto returns 3] 5 0 0 0 DL crypto_ 0xd60cb78c [crypto returns 2] 4 0 0 0 DL crypto_ 0xd60cb754 [crypto returns 1] 3 0 0 0 DL crypto_ 0xd60cb71c [crypto returns 0] 2 0 0 0 DL crypto_ 0xc1bbc1bc [crypto] 13 0 0 0 DL (threaded) [geom] 100028 D kernel 0xc1b5b780 [g_event] 100029 D - 0xc1be3c3c [g_up] 100030 D - 0xc1be3c40 [g_down] 12 0 0 0 RL (threaded) [intr] 100007 I [swi6: Giant taskq] 100009 I [swi5: fast taskq] 100012 I [swi6: task queue] 100022 Run CPU 3 [swi4: clock (0)] 100023 I [swi4: clock (1)] 100024 I [swi4: clock (2)] 100025 I [swi4: clock (3)] 100026 I [swi3: vm] 100027 I [swi1: netisr 0] 100042 I [irq256: hdac0] 100043 Run CPU 0 [irq257: re0] 100044 I [irq22: ahci0] 100045 I [irq16: hdac1 ohci0] 100051 I [irq17: ohci1 ohci3] 100057 I [irq18: ohci2 ohci4] 100073 I [irq19: ehci0] 100079 I [irq14: ata0] 100080 I [swi0: uart] 100082 I [irq1: atkbd0] 11 0 0 0 RL (threaded) [idle] 100003 CanRun [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 CanRun [idle: cpu3] 1 0 1 0 SLs wait 0xd60eba08 [init] 10 0 0 0 DL audit_w 0xc1be7f54 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xc1be3c64 [swapper] 100008 D - 0xd60f0a80 [thread taskq] 100010 D - 0xd60f0900 [kqueue_ctx taskq] 100011 D - 0xd60f0880 [aiod_kick taskq] 100013 D - 0xd60f0700 [if_config_tqg_0] 100014 D - 0xd60f0680 [if_io_tqg_0] 100015 D - 0xd60f0000 [if_io_tqg_1] 100016 D - 0xd60eff00 [if_io_tqg_2] 100017 D - 0xd60efe80 [if_io_tqg_3] 100018 D - 0xd60efe00 [softirq_0] 100019 D - 0xd60efd80 [softirq_1] 100020 D - 0xd60efd00 [softirq_2] 100021 D - 0xd60efc80 [softirq_3] 100031 D - 0xd60ef300 [firmware taskq] 100032 D - 0xd60ef280 [crypto_0] 100033 D - 0xd60ef280 [crypto_1] 100034 D - 0xd60ef280 [crypto_2] 100035 D - 0xd60ef280 [crypto_3] 100083 D - 0xd63c1400 [mca taskq] 100089 D - 0xd853bb00 [acpi_task_0] 100090 D - 0xd853bb00 [acpi_task_1] 100091 D - 0xd853bb00 [acpi_task_2] 100093 D kernel 0xc1b5b780 [CAM taskq] oops, ran out of processes early! db:0:ps> allt Tracing command cron pid 18685 tid 100204 td 0xdc685380 sched_switch(80,d491f984,0,60,c165daab,...) at sched_switch+0x503/frame 0xd491f948 (null)(0,ce2b4000,0,2,2276c000,...) at 0x80/frame 0xcb5944a4 (null)(0,c6dbf610,1,c193e738,d63d9270,...) at 0x4000/frame 0xd836c4f8 kernload(7265746e,6b636f6c,6c694600,69742065,7473656d,...) at 0x5230000/frame 0xc1661f60 Tracing command watchdogd pid 18684 tid 100224 td 0xdeb91a80 sched_switch(c6db8a00,1,c165714f,c1b851f0,c6db82b0,...) at sched_switch+0x503/frame 0xd49e6948 _end(2f6d762f,5f616d75,65726f63,7500632e,7a5f616d,...) at 0xd49e6994/frame 0xc169eb97 Tracing command sh pid 18669 tid 100284 td 0xded17000 sched_switch(ded17000,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xd4b89508 mi_switch(104,0,c1654159,22b,ded17000,...) at mi_switch+0x1f3/frame 0xd4b89544 sleepq_switch(ded17000,0,c1654159,2b3,f7edd304,...) at sleepq_switch+0x110/frame 0xd4b89578 sleepq_wait(f7edd304,60,c1637586,4,1,...) at sleepq_wait+0x48/frame 0xd4b8959c sleeplk(f7edd370,c1637586,60,33,1,...) at sleeplk+0x1a0/frame 0xd4b895e0 __lockmgr_args(f7edd304,206000,f7edd370,0,0,...) at __lockmgr_args+0x60e/frame 0xd4b8964c ffs_lock(d4b896c8,0,c16611f5,c1b85928,c6dc1b08,...) at ffs_lock+0xa7/frame 0xd4b89684 VOP_LOCK1_APV(c193e9b4,d4b896c8,d4b896cc,c0d386b8,c1956ea8,...) at VOP_LOCK1_APV+0xda/frame 0xd4b896b0 _vn_lock(f7edd2d0,206000,c16611f5,a2f,0,...) at _vn_lock+0x61/frame 0xd4b896f0 vget(f7edd2d0,206000,ded17000,d4b89768,ded170cc,...) at vget+0xc1/frame 0xd4b89728 cache_lookup(d8b73b40,d4b89a80,d4b89a94,0,0,...) at cache_lookup+0x97b/frame 0xd4b897a8 vfs_cache_lookup(d4b89848,c1862ecd,0,c1954fa0,d8b73b40,...) at vfs_cache_lookup+0xb5/frame 0xd4b897f4 VOP_LOOKUP_APV(c193e9b4,d4b89848,d4b89a94,3cd,2,...) at VOP_LOOKUP_APV+0xf6/frame 0xd4b89820 lookup(d4b89a38,c1660292,1b3,17c,200246,...) at lookup+0x663/frame 0xd4b89890 namei(d4b89a38,0,4000144,0,284e144c,...) at namei+0x5f1/frame 0xd4b89928 kern_statat(ded17000,0,ffffff9c,284e144c,0,...) at kern_statat+0xae/frame 0xd4b89ad8 sys_fstatat(ded17000,ded17280,c164301b,4,0,...) at sys_fstatat+0x49/frame 0xd4b89be8 syscall(d4b89ce8) at syscall+0x6ee/frame 0xd4b89cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd4b89cdc --- syscall (552, FreeBSD ELF32, sys_fstatat), eip = 0x28245243, esp = 0xbfbfe90c, ebp = 0xbfbfe998 --- Tracing command newsyslog pid 18668 tid 100277 td 0xdeb75000 sched_switch(deb75000,0,104,188,c1b48780,...) at sched_switch+0x503/frame 0xd4b66508 mi_switch(104,0,c1654159,22b,deb75000,...) at mi_switch+0x1f3/frame 0xd4b66544 sleepq_switch(deb75000,0,c1654159,2b3,dc1f0b74,...) at sleepq_switch+0x110/frame 0xd4b66578 sleepq_wait(dc1f0b74,60,c1637586,4,1,...) at sleepq_wait+0x48/frame 0xd4b6659c sleeplk(dc1f0be0,c1637586,60,33,1,...) at sleeplk+0x1a0/frame 0xd4b665e0 __lockmgr_args(dc1f0b74,206000,dc1f0be0,0,0,...) at __lockmgr_args+0x60e/frame 0xd4b6664c ffs_lock(d4b666c8,0,c16611f5,c1b87b88,c6dc1b08,...) at ffs_lock+0xa7/frame 0xd4b66684 VOP_LOCK1_APV(c193e9b4,d4b666c8,d4b666cc,c0d386b8,c1956ea8,...) at VOP_LOCK1_APV+0xda/frame 0xd4b666b0 _vn_lock(dc1f0b40,206000,c16611f5,a2f,0,...) at _vn_lock+0x61/frame 0xd4b666f0 vget(dc1f0b40,206000,deb75000,d4b66768,deb750cc,...) at vget+0xc1/frame 0xd4b66728 cache_lookup(d8aeb708,d4b66a80,d4b66a94,0,0,...) at cache_lookup+0x97b/frame 0xd4b667a8 vfs_cache_lookup(d4b66848,c1862ecd,0,c1954fa0,d8aeb708,...) at vfs_cache_lookup+0xb5/frame 0xd4b667f4 VOP_LOOKUP_APV(c193e9b4,d4b66848,d4b66a94,3cd,2,...) at VOP_LOOKUP_APV+0xf6/frame 0xd4b66820 lookup(d4b66a38,c1660292,1b3,17c,dc17b9c4,...) at lookup+0x663/frame 0xd4b66890 namei(d4b66a38,0,4000144,0,28470000,...) at namei+0x5f1/frame 0xd4b66928 kern_statat(deb75000,0,ffffff9c,28470000,0,...) at kern_statat+0xae/frame 0xd4b66ad8 sys_fstatat(deb75000,deb75280,c164301b,4,c18578ef,...) at sys_fstatat+0x49/frame 0xd4b66be8 syscall(d4b66ce8) at syscall+0x6ee/frame 0xd4b66cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd4b66cdc --- syscall (552, FreeBSD ELF32, sys_fstatat), eip = 0x28201243, esp = 0xbfbfcfb4, ebp = 0xbfbfd040 --- Tracing command cron pid 18666 tid 100399 td 0xd89ae700 sched_switch(d89ae700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xcb2779a8 mi_switch(104,0,c1654159,22b,d89ae700,...) at mi_switch+0x1f3/frame 0xcb2779e8 sleepq_switch(d89ae700,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xcb277a1c sleepq_catch_signals(0,c1654159,178,c1b5a194,d89ae700,...) at sleepq_catch_signals+0x360/frame 0xcb277a60 sleepq_wait_sig(fc8c51a8,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xcb277a84 _sleep(fc8c51a8,fc8c5338,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xcb277ad8 pipe_read(d8ade8f8,cb277bb8,d858c400,0,d89ae700,...) at pipe_read+0x49b/frame 0xcb277b18 dofileread(d8ade8f8,cb277bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xcb277b48 kern_readv(d89ae700,5,cb277bb8,cb277be8,2846f000,...) at kern_readv+0x93/frame 0xcb277b98 sys_read(d89ae700,d89ae980,c164301b,4,0,...) at sys_read+0x54/frame 0xcb277be8 syscall(cb277ce8) at syscall+0x6ee/frame 0xcb277cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb277cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282236df, esp = 0xbfbfe6a4, ebp = 0xbfbfe6b8 --- Tracing command cron pid 18665 tid 100426 td 0xf4e00a80 sched_switch(f4e00a80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xcb3149a8 mi_switch(104,0,c1654159,22b,f4e00a80,...) at mi_switch+0x1f3/frame 0xcb3149e8 sleepq_switch(f4e00a80,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xcb314a1c sleepq_catch_signals(0,c1654159,178,c1b59594,f4e00a80,...) at sleepq_catch_signals+0x360/frame 0xcb314a60 sleepq_wait_sig(dc1e61a8,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xcb314a84 _sleep(dc1e61a8,dc1e6338,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xcb314ad8 pipe_read(d8afc460,cb314bb8,d858c400,0,f4e00a80,...) at pipe_read+0x49b/frame 0xcb314b18 dofileread(d8afc460,cb314bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xcb314b48 kern_readv(f4e00a80,5,cb314bb8,cb314be8,28470000,...) at kern_readv+0x93/frame 0xcb314b98 sys_read(f4e00a80,f4e00d00,c164301b,4,0,...) at sys_read+0x54/frame 0xcb314be8 syscall(cb314ce8) at syscall+0x6ee/frame 0xcb314cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb314cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282236df, esp = 0xbfbfe6a4, ebp = 0xbfbfe6b8 --- Tracing command sh pid 18645 tid 100225 td 0xdeb91700 sched_switch(deb91700,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xd49eb508 mi_switch(104,0,c1654159,22b,deb91700,...) at mi_switch+0x1f3/frame 0xd49eb544 sleepq_switch(deb91700,0,c1654159,2b3,f7edd304,...) at sleepq_switch+0x110/frame 0xd49eb578 sleepq_wait(f7edd304,60,c1637586,4,1,...) at sleepq_wait+0x48/frame 0xd49eb59c sleeplk(f7edd370,c1637586,60,33,1,...) at sleeplk+0x1a0/frame 0xd49eb5e0 __lockmgr_args(f7edd304,206000,f7edd370,0,0,...) at __lockmgr_args+0x60e/frame 0xd49eb64c ffs_lock(d49eb6c8,0,c16611f5,c1b87660,c6dc1b08,...) at ffs_lock+0xa7/frame 0xd49eb684 VOP_LOCK1_APV(c193e9b4,d49eb6c8,d49eb6cc,c0d386b8,c1956ea8,...) at VOP_LOCK1_APV+0xda/frame 0xd49eb6b0 _vn_lock(f7edd2d0,206000,c16611f5,a2f,0,...) at _vn_lock+0x61/frame 0xd49eb6f0 vget(f7edd2d0,206000,deb91700,d49eb768,deb917cc,...) at vget+0xc1/frame 0xd49eb728 cache_lookup(d8b73b40,d49eba80,d49eba94,0,0,...) at cache_lookup+0x97b/frame 0xd49eb7a8 vfs_cache_lookup(d49eb848,c1862ecd,0,c1954fa0,d8b73b40,...) at vfs_cache_lookup+0xb5/frame 0xd49eb7f4 VOP_LOOKUP_APV(c193e9b4,d49eb848,d49eba94,3cd,2,...) at VOP_LOOKUP_APV+0xf6/frame 0xd49eb820 lookup(d49eba38,c1660292,1b3,17c,200246,...) at lookup+0x663/frame 0xd49eb890 namei(d49eba38,0,4000144,0,284e144c,...) at namei+0x5f1/frame 0xd49eb928 kern_statat(deb91700,0,ffffff9c,284e144c,0,...) at kern_statat+0xae/frame 0xd49ebad8 sys_fstatat(deb91700,deb91980,c164301b,4,0,...) at sys_fstatat+0x49/frame 0xd49ebbe8 syscall(d49ebce8) at syscall+0x6ee/frame 0xd49ebcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd49ebcdc --- syscall (552, FreeBSD ELF32, sys_fstatat), eip = 0x28245243, esp = 0xbfbfe90c, ebp = 0xbfbfe998 --- Tracing command cron pid 18643 tid 100406 td 0xcb793a80 sched_switch(cb793a80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xcb2b09a8 mi_switch(104,0,c1654159,22b,cb793a80,...) at mi_switch+0x1f3/frame 0xcb2b09e8 sleepq_switch(cb793a80,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xcb2b0a1c sleepq_catch_signals(0,c1654159,178,c1b58a54,cb793a80,...) at sleepq_catch_signals+0x360/frame 0xcb2b0a60 sleepq_wait_sig(dca764f8,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xcb2b0a84 _sleep(dca764f8,dca76688,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xcb2b0ad8 pipe_read(debc29a0,cb2b0bb8,d858c400,0,cb793a80,...) at pipe_read+0x49b/frame 0xcb2b0b18 dofileread(debc29a0,cb2b0bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xcb2b0b48 kern_readv(cb793a80,5,cb2b0bb8,cb2b0be8,2846f000,...) at kern_readv+0x93/frame 0xcb2b0b98 sys_read(cb793a80,cb793d00,c164301b,4,0,...) at sys_read+0x54/frame 0xcb2b0be8 syscall(cb2b0ce8) at syscall+0x6ee/frame 0xcb2b0cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb2b0cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282236df, esp = 0xbfbfe6a4, ebp = 0xbfbfe6b8 --- Tracing command sh pid 18604 tid 100300 td 0xdeb1f380 sched_switch(deb1f380,0,104,188,c1b49500,...) at sched_switch+0x503/frame 0xd4bd9508 mi_switch(104,0,c1654159,22b,deb1f380,...) at mi_switch+0x1f3/frame 0xd4bd9544 sleepq_switch(deb1f380,0,c1654159,2b3,f7edd304,...) at sleepq_switch+0x110/frame 0xd4bd9578 sleepq_wait(f7edd304,60,c1637586,4,1,...) at sleepq_wait+0x48/frame 0xd4bd959c sleeplk(f7edd370,c1637586,60,33,1,...) at sleeplk+0x1a0/frame 0xd4bd95e0 __lockmgr_args(f7edd304,206000,f7edd370,0,0,...) at __lockmgr_args+0x60e/frame 0xd4bd964c ffs_lock(d4bd96c8,0,c16611f5,c1b878c8,c6dc1b08,...) at ffs_lock+0xa7/frame 0xd4bd9684 VOP_LOCK1_APV(c193e9b4,d4bd96c8,d4bd96cc,c0d386b8,c1956ea8,...) at VOP_LOCK1_APV+0xda/frame 0xd4bd96b0 _vn_lock(f7edd2d0,206000,c16611f5,a2f,0,...) at _vn_lock+0x61/frame 0xd4bd96f0 vget(f7edd2d0,206000,deb1f380,d4bd9768,deb1f44c,...) at vget+0xc1/frame 0xd4bd9728 cache_lookup(d8b73b40,d4bd9a80,d4bd9a94,0,0,...) at cache_lookup+0x97b/frame 0xd4bd97a8 vfs_cache_lookup(d4bd9848,c1862ecd,0,c1954fa0,d8b73b40,...) at vfs_cache_lookup+0xb5/frame 0xd4bd97f4 VOP_LOOKUP_APV(c193e9b4,d4bd9848,d4bd9a94,3cd,2,...) at VOP_LOOKUP_APV+0xf6/frame 0xd4bd9820 lookup(d4bd9a38,c1660292,1b3,17c,200246,...) at lookup+0x663/frame 0xd4bd9890 namei(d4bd9a38,0,4000144,0,284e144c,...) at namei+0x5f1/frame 0xd4bd9928 kern_statat(deb1f380,0,ffffff9c,284e144c,0,...) at kern_statat+0xae/frame 0xd4bd9ad8 sys_fstatat(deb1f380,deb1f600,c164301b,4,0,...) at sys_fstatat+0x49/frame 0xd4bd9be8 syscall(d4bd9ce8) at syscall+0x6ee/frame 0xd4bd9cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd4bd9cdc --- syscall (552, FreeBSD ELF32, sys_fstatat), eip = 0x28245243, esp = 0xbfbfe90c, ebp = 0xbfbfe998 --- Tracing command cron pid 18603 tid 100257 td 0xdeb7e000 sched_switch(deb7e000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd4a9a9a8 mi_switch(104,0,c1654159,22b,deb7e000,...) at mi_switch+0x1f3/frame 0xd4a9a9e8 sleepq_switch(deb7e000,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xd4a9aa1c sleepq_catch_signals(0,c1654159,178,c1b59c14,deb7e000,...) at sleepq_catch_signals+0x360/frame 0xd4a9aa60 sleepq_wait_sig(fc8b7b98,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xd4a9aa84 _sleep(fc8b7b98,fc8b7d28,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xd4a9aad8 pipe_read(d8aacc78,d4a9abb8,d858c400,0,deb7e000,...) at pipe_read+0x49b/frame 0xd4a9ab18 dofileread(d8aacc78,d4a9abb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xd4a9ab48 kern_readv(deb7e000,5,d4a9abb8,d4a9abe8,2846f000,...) at kern_readv+0x93/frame 0xd4a9ab98 sys_read(deb7e000,deb7e280,c164301b,4,0,...) at sys_read+0x54/frame 0xd4a9abe8 syscall(d4a9ace8) at syscall+0x6ee/frame 0xd4a9acdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd4a9acdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282236df, esp = 0xbfbfe6a4, ebp = 0xbfbfe6b8 --- Tracing command sh pid 18564 tid 100388 td 0xdeaf9a80 sched_switch(deaf9a80,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xcb240508 mi_switch(104,0,c1654159,22b,deaf9a80,...) at mi_switch+0x1f3/frame 0xcb240544 sleepq_switch(deaf9a80,0,c1654159,2b3,f7edd304,...) at sleepq_switch+0x110/frame 0xcb240578 sleepq_wait(f7edd304,60,c1637586,4,1,...) at sleepq_wait+0x48/frame 0xcb24059c sleeplk(f7edd370,c1637586,60,33,1,...) at sleeplk+0x1a0/frame 0xcb2405e0 __lockmgr_args(f7edd304,206000,f7edd370,0,0,...) at __lockmgr_args+0x60e/frame 0xcb24064c ffs_lock(cb2406c8,0,c16611f5,c1b86060,c6dc1b08,...) at ffs_lock+0xa7/frame 0xcb240684 VOP_LOCK1_APV(c193e9b4,cb2406c8,cb2406cc,c0d386b8,c1956ea8,...) at VOP_LOCK1_APV+0xda/frame 0xcb2406b0 _vn_lock(f7edd2d0,206000,c16611f5,a2f,0,...) at _vn_lock+0x61/frame 0xcb2406f0 vget(f7edd2d0,206000,deaf9a80,cb240768,deaf9b4c,...) at vget+0xc1/frame 0xcb240728 cache_lookup(d8b73b40,cb240a80,cb240a94,0,0,...) at cache_lookup+0x97b/frame 0xcb2407a8 vfs_cache_lookup(cb240848,c1862ecd,0,c1954fa0,d8b73b40,...) at vfs_cache_lookup+0xb5/frame 0xcb2407f4 VOP_LOOKUP_APV(c193e9b4,cb240848,cb240a94,3cd,2,...) at VOP_LOOKUP_APV+0xf6/frame 0xcb240820 lookup(cb240a38,c1660292,1b3,17c,200246,...) at lookup+0x663/frame 0xcb240890 namei(cb240a38,0,4000144,0,284e144c,...) at namei+0x5f1/frame 0xcb240928 kern_statat(deaf9a80,0,ffffff9c,284e144c,0,...) at kern_statat+0xae/frame 0xcb240ad8 sys_fstatat(deaf9a80,deaf9d00,c164301b,4,c18578ef,...) at sys_fstatat+0x49/frame 0xcb240be8 syscall(cb240ce8) at syscall+0x6ee/frame 0xcb240cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb240cdc --- syscall (552, FreeBSD ELF32, sys_fstatat), eip = 0x28245243, esp = 0xbfbfe90c, ebp = 0xbfbfe998 --- Tracing command cron pid 18563 tid 100321 td 0xdc433700 sched_switch(dc433700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xcb0ea9a8 mi_switch(104,0,c1654159,22b,dc433700,...) at mi_switch+0x1f3/frame 0xcb0ea9e8 sleepq_switch(dc433700,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xcb0eaa1c sleepq_catch_signals(0,c1654159,178,c1b57754,dc433700,...) at sleepq_catch_signals+0x360/frame 0xcb0eaa60 sleepq_wait_sig(d8b61848,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xcb0eaa84 _sleep(d8b61848,d8b619d8,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xcb0eaad8 pipe_read(d8afb5e8,cb0eabb8,d858c400,0,dc433700,...) at pipe_read+0x49b/frame 0xcb0eab18 dofileread(d8afb5e8,cb0eabb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xcb0eab48 kern_readv(dc433700,5,cb0eabb8,cb0eabe8,2846f000,...) at kern_readv+0x93/frame 0xcb0eab98 sys_read(dc433700,dc433980,c164301b,4,0,...) at sys_read+0x54/frame 0xcb0eabe8 syscall(cb0eace8) at syscall+0x6ee/frame 0xcb0eacdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb0eacdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282236df, esp = 0xbfbfe6a4, ebp = 0xbfbfe6b8 --- Tracing command sh pid 18522 tid 100368 td 0xde99c380 sched_switch(de99c380,0,104,188,c1b49500,...) at sched_switch+0x503/frame 0xcb1d6508 mi_switch(104,0,c1654159,22b,de99c380,...) at mi_switch+0x1f3/frame 0xcb1d6544 sleepq_switch(de99c380,0,c1654159,2b3,f7edd304,...) at sleepq_switch+0x110/frame 0xcb1d6578 sleepq_wait(f7edd304,60,c1637586,4,1,...) at sleepq_wait+0x48/frame 0xcb1d659c sleeplk(f7edd370,c1637586,60,33,1,...) at sleeplk+0x1a0/frame 0xcb1d65e0 __lockmgr_args(f7edd304,206000,f7edd370,0,0,...) at __lockmgr_args+0x60e/frame 0xcb1d664c ffs_lock(cb1d66c8,0,c16611f5,c1b875b0,c6dc1b08,...) at ffs_lock+0xa7/frame 0xcb1d6684 VOP_LOCK1_APV(c193e9b4,cb1d66c8,cb1d66cc,c0d386b8,c1956ea8,...) at VOP_LOCK1_APV+0xda/frame 0xcb1d66b0 _vn_lock(f7edd2d0,206000,c16611f5,a2f,0,...) at _vn_lock+0x61/frame 0xcb1d66f0 vget(f7edd2d0,206000,de99c380,cb1d6768,de99c44c,...) at vget+0xc1/frame 0xcb1d6728 cache_lookup(d8b73b40,cb1d6a80,cb1d6a94,0,0,...) at cache_lookup+0x97b/frame 0xcb1d67a8 vfs_cache_lookup(cb1d6848,c1862ecd,0,c1954fa0,d8b73b40,...) at vfs_cache_lookup+0xb5/frame 0xcb1d67f4 VOP_LOOKUP_APV(c193e9b4,cb1d6848,cb1d6a94,3cd,2,...) at VOP_LOOKUP_APV+0xf6/frame 0xcb1d6820 lookup(cb1d6a38,c1660292,1b3,17c,200246,...) at lookup+0x663/frame 0xcb1d6890 namei(cb1d6a38,0,4000144,0,284e144c,...) at namei+0x5f1/frame 0xcb1d6928 kern_statat(de99c380,0,ffffff9c,284e144c,0,...) at kern_statat+0xae/frame 0xcb1d6ad8 sys_fstatat(de99c380,de99c600,c164301b,4,0,...) at sys_fstatat+0x49/frame 0xcb1d6be8 syscall(cb1d6ce8) at syscall+0x6ee/frame 0xcb1d6cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb1d6cdc --- syscall (552, FreeBSD ELF32, sys_fstatat), eip = 0x28245243, esp = 0xbfbfe90c, ebp = 0xbfbfe998 --- Tracing command cron pid 18521 tid 100170 td 0xdc6b9700 sched_switch(dc6b9700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdab449a8 mi_switch(104,0,c1654159,22b,dc6b9700,...) at mi_switch+0x1f3/frame 0xdab449e8 sleepq_switch(dc6b9700,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xdab44a1c sleepq_catch_signals(0,c1654159,178,c1b5a294,dc6b9700,...) at sleepq_catch_signals+0x360/frame 0xdab44a60 sleepq_wait_sig(dea1bd40,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xdab44a84 _sleep(dea1bd40,dea1bed0,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xdab44ad8 pipe_read(debd19a0,dab44bb8,d858c400,0,dc6b9700,...) at pipe_read+0x49b/frame 0xdab44b18 dofileread(debd19a0,dab44bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xdab44b48 kern_readv(dc6b9700,5,dab44bb8,dab44be8,2846f000,...) at kern_readv+0x93/frame 0xdab44b98 sys_read(dc6b9700,dc6b9980,c164301b,4,0,...) at sys_read+0x54/frame 0xdab44be8 syscall(dab44ce8) at syscall+0x6ee/frame 0xdab44cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdab44cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282236df, esp = 0xbfbfe6a4, ebp = 0xbfbfe6b8 --- Tracing command sh pid 18482 tid 100254 td 0xdeb7ea80 sched_switch(deb7ea80,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xd4a8b508 mi_switch(104,0,c1654159,22b,deb7ea80,...) at mi_switch+0x1f3/frame 0xd4a8b544 sleepq_switch(deb7ea80,0,c1654159,2b3,f7edd304,...) at sleepq_switch+0x110/frame 0xd4a8b578 sleepq_wait(f7edd304,60,c1637586,4,1,...) at sleepq_wait+0x48/frame 0xd4a8b59c sleeplk(f7edd370,c1637586,60,33,1,...) at sleeplk+0x1a0/frame 0xd4a8b5e0 __lockmgr_args(f7edd304,206000,f7edd370,0,0,...) at __lockmgr_args+0x60e/frame 0xd4a8b64c ffs_lock(d4a8b6c8,0,c16611f5,c1b88c08,c6dc1b08,...) at ffs_lock+0xa7/frame 0xd4a8b684 VOP_LOCK1_APV(c193e9b4,d4a8b6c8,d4a8b6cc,c0d386b8,c1956ea8,...) at VOP_LOCK1_APV+0xda/frame 0xd4a8b6b0 _vn_lock(f7edd2d0,206000,c16611f5,a2f,0,...) at _vn_lock+0x61/frame 0xd4a8b6f0 vget(f7edd2d0,206000,deb7ea80,d4a8b768,deb7eb4c,...) at vget+0xc1/frame 0xd4a8b728 cache_lookup(d8b73b40,d4a8ba80,d4a8ba94,0,0,...) at cache_lookup+0x97b/frame 0xd4a8b7a8 vfs_cache_lookup(d4a8b848,c1862ecd,0,c1954fa0,d8b73b40,...) at vfs_cache_lookup+0xb5/frame 0xd4a8b7f4 VOP_LOOKUP_APV(c193e9b4,d4a8b848,d4a8ba94,3cd,2,...) at VOP_LOOKUP_APV+0xf6/frame 0xd4a8b820 lookup(d4a8ba38,c1660292,1b3,17c,200246,...) at lookup+0x663/frame 0xd4a8b890 namei(d4a8ba38,0,4000144,0,284e144c,...) at namei+0x5f1/frame 0xd4a8b928 kern_statat(deb7ea80,0,ffffff9c,284e144c,0,...) at kern_statat+0xae/frame 0xd4a8bad8 sys_fstatat(deb7ea80,deb7ed00,c164301b,4,c18578ef,...) at sys_fstatat+0x49/frame 0xd4a8bbe8 syscall(d4a8bce8) at syscall+0x6ee/frame 0xd4a8bcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd4a8bcdc --- syscall (552, FreeBSD ELF32, sys_fstatat), eip = 0x28245243, esp = 0xbfbfe90c, ebp = 0xbfbfe998 --- Tracing command cron pid 18481 tid 100210 td 0xdc7be000 sched_switch(dc7be000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd493d9a8 mi_switch(104,0,c1654159,22b,dc7be000,...) at mi_switch+0x1f3/frame 0xd493d9e8 sleepq_switch(dc7be000,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xd493da1c sleepq_catch_signals(0,c1654159,178,c1b58014,dc7be000,...) at sleepq_catch_signals+0x360/frame 0xd493da60 sleepq_wait_sig(f5b4eb98,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xd493da84 _sleep(f5b4eb98,f5b4ed28,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xd493dad8 pipe_read(d8adf428,d493dbb8,d858c400,0,dc7be000,...) at pipe_read+0x49b/frame 0xd493db18 dofileread(d8adf428,d493dbb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xd493db48 kern_readv(dc7be000,5,d493dbb8,d493dbe8,2846f000,...) at kern_readv+0x93/frame 0xd493db98 sys_read(dc7be000,dc7be280,c164301b,4,0,...) at sys_read+0x54/frame 0xd493dbe8 syscall(d493dce8) at syscall+0x6ee/frame 0xd493dcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd493dcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282236df, esp = 0xbfbfe6a4, ebp = 0xbfbfe6b8 --- Tracing command sh pid 18441 tid 100301 td 0xdec01000 sched_switch(dec01000,0,104,188,c1b480c0,...) at sched_switch+0x503/frame 0xd4bde508 mi_switch(104,0,c1654159,22b,dec01000,...) at mi_switch+0x1f3/frame 0xd4bde544 sleepq_switch(dec01000,0,c1654159,2b3,f7edd304,...) at sleepq_switch+0x110/frame 0xd4bde578 sleepq_wait(f7edd304,60,c1637586,4,1,...) at sleepq_wait+0x48/frame 0xd4bde59c sleeplk(f7edd370,c1637586,60,33,1,...) at sleeplk+0x1a0/frame 0xd4bde5e0 __lockmgr_args(f7edd304,206000,f7edd370,0,0,...) at __lockmgr_args+0x60e/frame 0xd4bde64c ffs_lock(d4bde6c8,0,c16611f5,c1b87be0,c6dc1b08,...) at ffs_lock+0xa7/frame 0xd4bde684 VOP_LOCK1_APV(c193e9b4,d4bde6c8,d4bde6cc,c0d386b8,c1956ea8,...) at VOP_LOCK1_APV+0xda/frame 0xd4bde6b0 _vn_lock(f7edd2d0,206000,c16611f5,a2f,0,...) at _vn_lock+0x61/frame 0xd4bde6f0 vget(f7edd2d0,206000,dec01000,d4bde768,dec010cc,...) at vget+0xc1/frame 0xd4bde728 cache_lookup(d8b73b40,d4bdea80,d4bdea94,0,0,...) at cache_lookup+0x97b/frame 0xd4bde7a8 vfs_cache_lookup(d4bde848,c1862ecd,0,c1954fa0,d8b73b40,...) at vfs_cache_lookup+0xb5/frame 0xd4bde7f4 VOP_LOOKUP_APV(c193e9b4,d4bde848,d4bdea94,3cd,2,...) at VOP_LOOKUP_APV+0xf6/frame 0xd4bde820 lookup(d4bdea38,c1660292,1b3,17c,200246,...) at lookup+0x663/frame 0xd4bde890 namei(d4bdea38,0,4000144,0,284e144c,...) at namei+0x5f1/frame 0xd4bde928 kern_statat(dec01000,0,ffffff9c,284e144c,0,...) at kern_statat+0xae/frame 0xd4bdead8 sys_fstatat(dec01000,dec01280,c164301b,4,0,...) at sys_fstatat+0x49/frame 0xd4bdebe8 syscall(d4bdece8) at syscall+0x6ee/frame 0xd4bdecdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd4bdecdc --- syscall (552, FreeBSD ELF32, sys_fstatat), eip = 0x28245243, esp = 0xbfbfe90c, ebp = 0xbfbfe998 --- Tracing command newsyslog pid 18440 tid 100375 td 0xdc29a000 sched_switch(dc29a000,0,104,188,c1b49500,...) at sched_switch+0x503/frame 0xcb1fd508 mi_switch(104,0,c1654159,22b,dc29a000,...) at mi_switch+0x1f3/frame 0xcb1fd544 sleepq_switch(dc29a000,0,c1654159,2b3,dc1f0b74,...) at sleepq_switch+0x110/frame 0xcb1fd578 sleepq_wait(dc1f0b74,60,c1637586,4,1,...) at sleepq_wait+0x48/frame 0xcb1fd59c sleeplk(dc1f0be0,c1637586,60,33,1,...) at sleeplk+0x1a0/frame 0xcb1fd5e0 __lockmgr_args(dc1f0b74,206000,dc1f0be0,0,0,...) at __lockmgr_args+0x60e/frame 0xcb1fd64c ffs_lock(cb1fd6c8,0,3,c1b87190,c6dc1b08,...) at ffs_lock+0xa7/frame 0xcb1fd684 VOP_LOCK1_APV(c193e9b4,cb1fd6c8,cb1fd6cc,c0d386b8,c1956ea8,...) at VOP_LOCK1_APV+0xda/frame 0xcb1fd6b0 _vn_lock(dc1f0b40,206000,c16611f5,a2f,0,...) at _vn_lock+0x61/frame 0xcb1fd6f0 vget(dc1f0b40,206000,dc29a000,cb1fd768,dc29a0cc,...) at vget+0xc1/frame 0xcb1fd728 cache_lookup(d8aeb708,cb1fda80,cb1fda94,0,0,...) at cache_lookup+0x97b/frame 0xcb1fd7a8 vfs_cache_lookup(cb1fd848,c1862ecd,0,c1954fa0,d8aeb708,...) at vfs_cache_lookup+0xb5/frame 0xcb1fd7f4 VOP_LOOKUP_APV(c193e9b4,cb1fd848,cb1fda94,3cd,2,...) at VOP_LOOKUP_APV+0xf6/frame 0xcb1fd820 lookup(cb1fda38,c1660292,1b3,17c,dc17b9c4,...) at lookup+0x663/frame 0xcb1fd890 namei(cb1fda38,0,4000144,0,28470000,...) at namei+0x5f1/frame 0xcb1fd928 kern_statat(dc29a000,0,ffffff9c,28470000,0,...) at kern_statat+0xae/frame 0xcb1fdad8 sys_fstatat(dc29a000,dc29a280,c164301b,4,c18578ef,...) at sys_fstatat+0x49/frame 0xcb1fdbe8 syscall(cb1fdce8) at syscall+0x6ee/frame 0xcb1fdcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb1fdcdc --- syscall (552, FreeBSD ELF32, sys_fstatat), eip = 0x28201243, esp = 0xbfbfcfb4, ebp = 0xbfbfd040 --- Tracing command cron pid 18438 tid 100402 td 0xdc47da80 sched_switch(dc47da80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xcb29c9a8 mi_switch(104,0,c1654159,22b,dc47da80,...) at mi_switch+0x1f3/frame 0xcb29c9e8 sleepq_switch(dc47da80,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xcb29ca1c sleepq_catch_signals(0,c1654159,178,c1b56f54,dc47da80,...) at sleepq_catch_signals+0x360/frame 0xcb29ca60 sleepq_wait_sig(fc8b7848,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xcb29ca84 _sleep(fc8b7848,fc8b79d8,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xcb29cad8 pipe_read(d8ae68c0,cb29cbb8,d858c400,0,dc47da80,...) at pipe_read+0x49b/frame 0xcb29cb18 dofileread(d8ae68c0,cb29cbb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xcb29cb48 kern_readv(dc47da80,5,cb29cbb8,cb29cbe8,2846f000,...) at kern_readv+0x93/frame 0xcb29cb98 sys_read(dc47da80,dc47dd00,c164301b,4,0,...) at sys_read+0x54/frame 0xcb29cbe8 syscall(cb29cce8) at syscall+0x6ee/frame 0xcb29ccdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb29ccdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282236df, esp = 0xbfbfe6a4, ebp = 0xbfbfe6b8 --- Tracing command cron pid 18437 tid 100438 td 0xdc381a80 sched_switch(dc381a80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xcb3519a8 mi_switch(104,0,c1654159,22b,dc381a80,...) at mi_switch+0x1f3/frame 0xcb3519e8 sleepq_switch(dc381a80,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xcb351a1c sleepq_catch_signals(0,c1654159,178,c1b59594,dc381a80,...) at sleepq_catch_signals+0x360/frame 0xcb351a60 sleepq_wait_sig(dca761a8,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xcb351a84 _sleep(dca761a8,dca76338,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xcb351ad8 pipe_read(d8aab348,cb351bb8,d858c400,0,dc381a80,...) at pipe_read+0x49b/frame 0xcb351b18 dofileread(d8aab348,cb351bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xcb351b48 kern_readv(dc381a80,5,cb351bb8,cb351be8,28470000,...) at kern_readv+0x93/frame 0xcb351b98 sys_read(dc381a80,dc381d00,c164301b,4,0,...) at sys_read+0x54/frame 0xcb351be8 syscall(cb351ce8) at syscall+0x6ee/frame 0xcb351cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb351cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282236df, esp = 0xbfbfe6a4, ebp = 0xbfbfe6b8 --- Tracing command sh pid 18417 tid 100401 td 0xd89ae380 sched_switch(d89ae380,0,104,188,c1b49500,...) at sched_switch+0x503/frame 0xcb297508 mi_switch(104,0,c1654159,22b,d89ae380,...) at mi_switch+0x1f3/frame 0xcb297544 sleepq_switch(d89ae380,0,c1654159,2b3,f7edd304,...) at sleepq_switch+0x110/frame 0xcb297578 sleepq_wait(f7edd304,60,c1637586,4,1,...) at sleepq_wait+0x48/frame 0xcb29759c sleeplk(f7edd370,c1637586,60,33,1,...) at sleeplk+0x1a0/frame 0xcb2975e0 __lockmgr_args(f7edd304,206000,f7edd370,0,0,...) at __lockmgr_args+0x60e/frame 0xcb29764c ffs_lock(cb2976c8,0,c16611f5,c1b85980,c6dc1b08,...) at ffs_lock+0xa7/frame 0xcb297684 VOP_LOCK1_APV(c193e9b4,cb2976c8,cb2976cc,c0d386b8,c1956ea8,...) at VOP_LOCK1_APV+0xda/frame 0xcb2976b0 _vn_lock(f7edd2d0,206000,c16611f5,a2f,0,...) at _vn_lock+0x61/frame 0xcb2976f0 vget(f7edd2d0,206000,d89ae380,cb297768,d89ae44c,...) at vget+0xc1/frame 0xcb297728 cache_lookup(d8b73b40,cb297a80,cb297a94,0,0,...) at cache_lookup+0x97b/frame 0xcb2977a8 vfs_cache_lookup(cb297848,c1862ecd,0,c1954fa0,d8b73b40,...) at vfs_cache_lookup+0xb5/frame 0xcb2977f4 VOP_LOOKUP_APV(c193e9b4,cb297848,cb297a94,3cd,2,...) at VOP_LOOKUP_APV+0xf6/frame 0xcb297820 lookup(cb297a38,c1660292,1b3,17c,200246,...) at lookup+0x663/frame 0xcb297890 namei(cb297a38,0,4000144,0,284e144c,...) at namei+0x5f1/frame 0xcb297928 kern_statat(d89ae380,0,ffffff9c,284e144c,0,...) at kern_statat+0xae/frame 0xcb297ad8 sys_fstatat(d89ae380,d89ae600,c164301b,4,c18578ef,...) at sys_fstatat+0x49/frame 0xcb297be8 syscall(cb297ce8) at syscall+0x6ee/frame 0xcb297cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb297cdc --- syscall (552, FreeBSD ELF32, sys_fstatat), eip = 0x28245243, esp = 0xbfbfe90c, ebp = 0xbfbfe998 --- Tracing command cron pid 18415 tid 100237 td 0xdeb76a80 sched_switch(deb76a80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd4a2b9a8 mi_switch(104,0,c1654159,22b,deb76a80,...) at mi_switch+0x1f3/frame 0xd4a2b9e8 sleepq_switch(deb76a80,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xd4a2ba1c sleepq_catch_signals(0,c1654159,178,c1b59b54,deb76a80,...) at sleepq_catch_signals+0x360/frame 0xd4a2ba60 sleepq_wait_sig(f5b4e000,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xd4a2ba84 _sleep(f5b4e000,f5b4e190,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xd4a2bad8 pipe_read(d8af9a48,d4a2bbb8,d858c400,0,deb76a80,...) at pipe_read+0x49b/frame 0xd4a2bb18 dofileread(d8af9a48,d4a2bbb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xd4a2bb48 kern_readv(deb76a80,5,d4a2bbb8,d4a2bbe8,2846f000,...) at kern_readv+0x93/frame 0xd4a2bb98 sys_read(deb76a80,deb76d00,c164301b,4,0,...) at sys_read+0x54/frame 0xd4a2bbe8 syscall(d4a2bce8) at syscall+0x6ee/frame 0xd4a2bcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd4a2bcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282236df, esp = 0xbfbfe6a4, ebp = 0xbfbfe6b8 --- Tracing command sh pid 18376 tid 100268 td 0xdeb8f380 sched_switch(deb8f380,0,104,188,c1b480c0,...) at sched_switch+0x503/frame 0xd4aee508 mi_switch(104,0,c1654159,22b,deb8f380,...) at mi_switch+0x1f3/frame 0xd4aee544 sleepq_switch(deb8f380,0,c1654159,2b3,f7edd304,...) at sleepq_switch+0x110/frame 0xd4aee578 sleepq_wait(f7edd304,60,c1637586,4,1,...) at sleepq_wait+0x48/frame 0xd4aee59c sleeplk(f7edd370,c1637586,60,33,1,...) at sleeplk+0x1a0/frame 0xd4aee5e0 __lockmgr_args(f7edd304,206000,f7edd370,0,0,...) at __lockmgr_args+0x60e/frame 0xd4aee64c ffs_lock(d4aee6c8,0,c16611f5,c1b87608,c6dc1b08,...) at ffs_lock+0xa7/frame 0xd4aee684 VOP_LOCK1_APV(c193e9b4,d4aee6c8,d4aee6cc,c0d386b8,c1956ea8,...) at VOP_LOCK1_APV+0xda/frame 0xd4aee6b0 _vn_lock(f7edd2d0,206000,c16611f5,a2f,0,...) at _vn_lock+0x61/frame 0xd4aee6f0 vget(f7edd2d0,206000,deb8f380,d4aee768,deb8f44c,...) at vget+0xc1/frame 0xd4aee728 cache_lookup(d8b73b40,d4aeea80,d4aeea94,0,0,...) at cache_lookup+0x97b/frame 0xd4aee7a8 vfs_cache_lookup(d4aee848,c1862ecd,0,c1954fa0,d8b73b40,...) at vfs_cache_lookup+0xb5/frame 0xd4aee7f4 VOP_LOOKUP_APV(c193e9b4,d4aee848,d4aeea94,3cd,2,...) at VOP_LOOKUP_APV+0xf6/frame 0xd4aee820 lookup(d4aeea38,c1660292,1b3,17c,200246,...) at lookup+0x663/frame 0xd4aee890 namei(d4aeea38,0,4000144,0,284e144c,...) at namei+0x5f1/frame 0xd4aee928 kern_statat(deb8f380,0,ffffff9c,284e144c,0,...) at kern_statat+0xae/frame 0xd4aeead8 sys_fstatat(deb8f380,deb8f600,c164301b,4,0,...) at sys_fstatat+0x49/frame 0xd4aeebe8 syscall(d4aeece8) at syscall+0x6ee/frame 0xd4aeecdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd4aeecdc --- syscall (552, FreeBSD ELF32, sys_fstatat), eip = 0x28245243, esp = 0xbfbfe90c, ebp = 0xbfbfe998 --- Tracing command cron pid 18375 tid 100197 td 0xdc80f380 sched_switch(dc80f380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdabde9a8 mi_switch(104,0,c1654159,22b,dc80f380,...) at mi_switch+0x1f3/frame 0xdabde9e8 sleepq_switch(dc80f380,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xdabdea1c sleepq_catch_signals(0,c1654159,178,c1b59f54,dc80f380,...) at sleepq_catch_signals+0x360/frame 0xdabdea60 sleepq_wait_sig(dea1b848,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xdabdea84 _sleep(dea1b848,dea1b9d8,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xdabdead8 pipe_read(debcf690,dabdebb8,d858c400,0,dc80f380,...) at pipe_read+0x49b/frame 0xdabdeb18 dofileread(debcf690,dabdebb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xdabdeb48 kern_readv(dc80f380,5,dabdebb8,dabdebe8,2846f000,...) at kern_readv+0x93/frame 0xdabdeb98 sys_read(dc80f380,dc80f600,c164301b,4,0,...) at sys_read+0x54/frame 0xdabdebe8 syscall(dabdece8) at syscall+0x6ee/frame 0xdabdecdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdabdecdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282236df, esp = 0xbfbfe6a4, ebp = 0xbfbfe6b8 --- Tracing command sh pid 18336 tid 100275 td 0xdec03000 sched_switch(dec03000,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xd4b5c508 mi_switch(104,0,c1654159,22b,dec03000,...) at mi_switch+0x1f3/frame 0xd4b5c544 sleepq_switch(dec03000,0,c1654159,2b3,f7edd304,...) at sleepq_switch+0x110/frame 0xd4b5c578 sleepq_wait(f7edd304,60,c1637586,4,1,...) at sleepq_wait+0x48/frame 0xd4b5c59c sleeplk(f7edd370,c1637586,60,33,1,...) at sleeplk+0x1a0/frame 0xd4b5c5e0 __lockmgr_args(f7edd304,206000,f7edd370,0,0,...) at __lockmgr_args+0x60e/frame 0xd4b5c64c ffs_lock(d4b5c6c8,0,c16611f5,c1b84f88,c6dc1b08,...) at ffs_lock+0xa7/frame 0xd4b5c684 VOP_LOCK1_APV(c193e9b4,d4b5c6c8,d4b5c6cc,c0d386b8,c1956ea8,...) at VOP_LOCK1_APV+0xda/frame 0xd4b5c6b0 _vn_lock(f7edd2d0,206000,c16611f5,a2f,0,...) at _vn_lock+0x61/frame 0xd4b5c6f0 vget(f7edd2d0,206000,dec03000,d4b5c768,dec030cc,...) at vget+0xc1/frame 0xd4b5c728 cache_lookup(d8b73b40,d4b5ca80,d4b5ca94,0,0,...) at cache_lookup+0x97b/frame 0xd4b5c7a8 vfs_cache_lookup(d4b5c848,c1862ecd,0,c1954fa0,d8b73b40,...) at vfs_cache_lookup+0xb5/frame 0xd4b5c7f4 VOP_LOOKUP_APV(c193e9b4,d4b5c848,d4b5ca94,3cd,2,...) at VOP_LOOKUP_APV+0xf6/frame 0xd4b5c820 lookup(d4b5ca38,c1660292,1b3,17c,200246,...) at lookup+0x663/frame 0xd4b5c890 namei(d4b5ca38,0,4000144,0,284e144c,...) at namei+0x5f1/frame 0xd4b5c928 kern_statat(dec03000,0,ffffff9c,284e144c,0,...) at kern_statat+0xae/frame 0xd4b5cad8 sys_fstatat(dec03000,dec03280,c164301b,4,0,...) at sys_fstatat+0x49/frame 0xd4b5cbe8 syscall(d4b5cce8) at syscall+0x6ee/frame 0xd4b5ccdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd4b5ccdc --- syscall (552, FreeBSD ELF32, sys_fstatat), eip = 0x28245243, esp = 0xbfbfe90c, ebp = 0xbfbfe998 --- Tracing command cron pid 18335 tid 100226 td 0xdeb09a80 sched_switch(deb09a80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd49f09a8 mi_switch(104,0,c1654159,22b,deb09a80,...) at mi_switch+0x1f3/frame 0xd49f09e8 sleepq_switch(deb09a80,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xd49f0a1c sleepq_catch_signals(0,c1654159,178,c1b57414,deb09a80,...) at sleepq_catch_signals+0x360/frame 0xd49f0a60 sleepq_wait_sig(d8b61350,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xd49f0a84 _sleep(d8b61350,d8b614e0,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xd49f0ad8 pipe_read(debd06c8,d49f0bb8,d858c400,0,deb09a80,...) at pipe_read+0x49b/frame 0xd49f0b18 dofileread(debd06c8,d49f0bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xd49f0b48 kern_readv(deb09a80,5,d49f0bb8,d49f0be8,2846f000,...) at kern_readv+0x93/frame 0xd49f0b98 sys_read(deb09a80,deb09d00,c164301b,4,0,...) at sys_read+0x54/frame 0xd49f0be8 syscall(d49f0ce8) at syscall+0x6ee/frame 0xd49f0cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd49f0cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282236df, esp = 0xbfbfe6a4, ebp = 0xbfbfe6b8 --- Tracing command sh pid 18292 tid 100403 td 0xdc47d700 sched_switch(dc47d700,0,104,188,c1b48780,...) at sched_switch+0x503/frame 0xcb2a1508 mi_switch(104,0,c1654159,22b,dc47d700,...) at mi_switch+0x1f3/frame 0xcb2a1544 sleepq_switch(dc47d700,0,c1654159,2b3,f7edd304,...) at sleepq_switch+0x110/frame 0xcb2a1578 sleepq_wait(f7edd304,60,c1637586,4,1,...) at sleepq_wait+0x48/frame 0xcb2a159c sleeplk(f7edd370,c1637586,60,33,1,...) at sleeplk+0x1a0/frame 0xcb2a15e0 __lockmgr_args(f7edd304,206000,f7edd370,0,0,...) at __lockmgr_args+0x60e/frame 0xcb2a164c ffs_lock(cb2a16c8,0,c16611f5,c1b84bc0,c6dc1b08,...) at ffs_lock+0xa7/frame 0xcb2a1684 VOP_LOCK1_APV(c193e9b4,cb2a16c8,cb2a16cc,c0d386b8,c1956ea8,...) at VOP_LOCK1_APV+0xda/frame 0xcb2a16b0 _vn_lock(f7edd2d0,206000,c16611f5,a2f,0,...) at _vn_lock+0x61/frame 0xcb2a16f0 vget(f7edd2d0,206000,dc47d700,cb2a1768,dc47d7cc,...) at vget+0xc1/frame 0xcb2a1728 cache_lookup(d8b73b40,cb2a1a80,cb2a1a94,0,0,...) at cache_lookup+0x97b/frame 0xcb2a17a8 vfs_cache_lookup(cb2a1848,c1862ecd,0,c1954fa0,d8b73b40,...) at vfs_cache_lookup+0xb5/frame 0xcb2a17f4 VOP_LOOKUP_APV(c193e9b4,cb2a1848,cb2a1a94,3cd,2,...) at VOP_LOOKUP_APV+0xf6/frame 0xcb2a1820 lookup(cb2a1a38,c1660292,1b3,17c,200246,...) at lookup+0x663/frame 0xcb2a1890 namei(cb2a1a38,0,4000144,0,284e144c,...) at namei+0x5f1/frame 0xcb2a1928 kern_statat(dc47d700,0,ffffff9c,284e144c,0,...) at kern_statat+0xae/frame 0xcb2a1ad8 sys_fstatat(dc47d700,dc47d980,c164301b,4,0,...) at sys_fstatat+0x49/frame 0xcb2a1be8 syscall(cb2a1ce8) at syscall+0x6ee/frame 0xcb2a1cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb2a1cdc --- syscall (552, FreeBSD ELF32, sys_fstatat), eip = 0x28245243, esp = 0xbfbfe90c, ebp = 0xbfbfe998 --- Tracing command cron pid 18291 tid 100109 td 0xd841f700 sched_switch(d841f700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdbed09a8 mi_switch(104,0,c1654159,22b,d841f700,...) at mi_switch+0x1f3/frame 0xdbed09e8 sleepq_switch(d841f700,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xdbed0a1c sleepq_catch_signals(0,c1654159,178,c1b57754,d841f700,...) at sleepq_catch_signals+0x360/frame 0xdbed0a60 sleepq_wait_sig(dc1e5000,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xdbed0a84 _sleep(dc1e5000,dc1e5190,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xdbed0ad8 pipe_read(d8ae6540,dbed0bb8,d858c400,0,d841f700,...) at pipe_read+0x49b/frame 0xdbed0b18 dofileread(d8ae6540,dbed0bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xdbed0b48 kern_readv(d841f700,5,dbed0bb8,dbed0be8,2846f000,...) at kern_readv+0x93/frame 0xdbed0b98 sys_read(d841f700,d841f980,c164301b,4,0,...) at sys_read+0x54/frame 0xdbed0be8 syscall(dbed0ce8) at syscall+0x6ee/frame 0xdbed0cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdbed0cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282236df, esp = 0xbfbfe6a4, ebp = 0xbfbfe6b8 --- Tracing command sh pid 18253 tid 100405 td 0xcb791000 sched_switch(cb791000,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xcb2ab508 mi_switch(104,0,c1654159,22b,cb791000,...) at mi_switch+0x1f3/frame 0xcb2ab544 sleepq_switch(cb791000,0,c1654159,2b3,f7edd304,...) at sleepq_switch+0x110/frame 0xcb2ab578 sleepq_wait(f7edd304,60,c1637586,4,1,...) at sleepq_wait+0x48/frame 0xcb2ab59c sleeplk(f7edd370,c1637586,60,33,1,...) at sleeplk+0x1a0/frame 0xcb2ab5e0 __lockmgr_args(f7edd304,206000,f7edd370,0,0,...) at __lockmgr_args+0x60e/frame 0xcb2ab64c ffs_lock(cb2ab6c8,0,c16611f5,c1b860b8,c6dc1b08,...) at ffs_lock+0xa7/frame 0xcb2ab684 VOP_LOCK1_APV(c193e9b4,cb2ab6c8,cb2ab6cc,c0d386b8,c1956ea8,...) at VOP_LOCK1_APV+0xda/frame 0xcb2ab6b0 _vn_lock(f7edd2d0,206000,c16611f5,a2f,0,...) at _vn_lock+0x61/frame 0xcb2ab6f0 vget(f7edd2d0,206000,cb791000,cb2ab768,cb7910cc,...) at vget+0xc1/frame 0xcb2ab728 cache_lookup(d8b73b40,cb2aba80,cb2aba94,0,0,...) at cache_lookup+0x97b/frame 0xcb2ab7a8 vfs_cache_lookup(cb2ab848,c1862ecd,0,c1954fa0,d8b73b40,...) at vfs_cache_lookup+0xb5/frame 0xcb2ab7f4 VOP_LOOKUP_APV(c193e9b4,cb2ab848,cb2aba94,3cd,2,...) at VOP_LOOKUP_APV+0xf6/frame 0xcb2ab820 lookup(cb2aba38,c1660292,1b3,17c,200246,...) at lookup+0x663/frame 0xcb2ab890 namei(cb2aba38,0,4000144,0,284e144c,...) at namei+0x5f1/frame 0xcb2ab928 kern_statat(cb791000,0,ffffff9c,284e144c,0,...) at kern_statat+0xae/frame 0xcb2abad8 sys_fstatat(cb791000,cb791280,c164301b,4,0,...) at sys_fstatat+0x49/frame 0xcb2abbe8 syscall(cb2abce8) at syscall+0x6ee/frame 0xcb2abcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb2abcdc --- syscall (552, FreeBSD ELF32, sys_fstatat), eip = 0x28245243, esp = 0xbfbfe90c, ebp = 0xbfbfe998 --- Tracing command cron pid 18252 tid 100369 td 0xddb7c700 sched_switch(ddb7c700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xcb1db9a8 mi_switch(104,0,c1654159,22b,ddb7c700,...) at mi_switch+0x1f3/frame 0xcb1db9e8 sleepq_switch(ddb7c700,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xcb1dba1c sleepq_catch_signals(0,c1654159,178,c1b59754,ddb7c700,...) at sleepq_catch_signals+0x360/frame 0xcb1dba60 sleepq_wait_sig(fec8d000,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xcb1dba84 _sleep(fec8d000,fec8d190,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xcb1dbad8 pipe_read(debc2ce8,cb1dbbb8,d858c400,0,ddb7c700,...) at pipe_read+0x49b/frame 0xcb1dbb18 dofileread(debc2ce8,cb1dbbb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xcb1dbb48 kern_readv(ddb7c700,5,cb1dbbb8,cb1dbbe8,2846f000,...) at kern_readv+0x93/frame 0xcb1dbb98 sys_read(ddb7c700,ddb7c980,c164301b,4,0,...) at sys_read+0x54/frame 0xcb1dbbe8 syscall(cb1dbce8) at syscall+0x6ee/frame 0xcb1dbcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb1dbcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282236df, esp = 0xbfbfe6a4, ebp = 0xbfbfe6b8 --- Tracing command sh pid 18214 tid 100315 td 0xdec02380 fork_trampoline() at fork_trampoline Tracing command cron pid 18213 tid 100392 td 0xcb791a80 sched_switch(cb791a80,0,104,188,c1b48780,...) at sched_switch+0x503/frame 0xcb254480 mi_switch(104,0,c1654159,22b,cb791a80,...) at mi_switch+0x1f3/frame 0xcb2544bc sleepq_switch(cb791a80,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xcb2544f0 sleepq_wait(c1b5b780,0,cb254534,1,0,...) at sleepq_wait+0x48/frame 0xcb254514 _cv_wait(c1b5b780,c1b5b740,c1655993,362,2002,...) at _cv_wait+0x21f/frame 0xcb254558 vmem_xalloc(c1b5b740,400000,0,0,0,...) at vmem_xalloc+0x1df/frame 0xcb2545bc vmem_alloc(c1b5b740,400000,2002,cb25460c,0,...) at vmem_alloc+0xcc/frame 0xcb2545f4 vmem_xalloc(c2381000,1000,0,0,0,...) at vmem_xalloc+0x417/frame 0xcb254658 vmem_alloc(c2381000,1000,2002,cb2546ac,fc8d40b0,...) at vmem_alloc+0xcc/frame 0xcb254690 kmem_malloc_domain(0,1000,2) at kmem_malloc_domain+0x44/frame 0xcb2546bc page_alloc(c2388640,1000,0,cb254707,2,...) at page_alloc+0x26/frame 0xcb2546d4 keg_alloc_slab(0,2,c169eb97,94c,c6db8a00,...) at keg_alloc_slab+0xf6/frame 0xcb25471c keg_fetch_slab(ffffffff,2,c169eb97,9ae,3,...) at keg_fetch_slab+0x10e/frame 0xcb254774 zone_fetch_slab(c2388640,0,ffffffff,2,c193f85c,...) at zone_fetch_slab+0x61/frame 0xcb254798 zone_import(c2388640,fc8d040c,1d,ffffffff,2,...) at zone_import+0x3b/frame 0xcb2547d0 uma_zalloc_arg(c2388640,0,2,c6db7340,c190dc28,...) at uma_zalloc_arg+0x357/frame 0xcb25480c malloc(170,c190e53c,2,d8aa8ca8,0,...) at malloc+0x116/frame 0xcb254848 elf32_load_file(cb25492c,cb2549e8,1000,404,3,...) at elf32_load_file+0x48/frame 0xcb2548b0 exec_elf32_imgact(cb2549d0,d8aa8ca8,0,cb2549d0,d4d45000,...) at exec_elf32_imgact+0x11a7/frame 0xcb254960 kern_execve(cb791a80,cb254ba0,0,bfbfe6d0,2848e180,...) at kern_execve+0x8b4/frame 0xcb254b80 sys_execve(cb791a80,cb791d00,c164301b,4,c18578ef,...) at sys_execve+0x6a/frame 0xcb254be8 syscall(cb254ce8) at syscall+0x6ee/frame 0xcb254cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb254cdc --- syscall (59, FreeBSD ELF32, sys_execve), eip = 0x28191617, esp = 0xbfbfe6c0, ebp = 0xbfbfe710 --- Tracing command cron pid 18212 tid 100229 td 0xd627c700 sched_switch(d627c700,0,104,188,c1b48780,...) at sched_switch+0x503/frame 0xd49ff480 mi_switch(104,0,c1654159,22b,d627c700,...) at mi_switch+0x1f3/frame 0xd49ff4bc sleepq_switch(d627c700,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd49ff4f0 sleepq_wait(c1b5b780,0,d49ff534,1,0,...) at sleepq_wait+0x48/frame 0xd49ff514 _cv_wait(c1b5b780,c1b5b740,c1655993,362,2002,...) at _cv_wait+0x21f/frame 0xd49ff558 vmem_xalloc(c1b5b740,400000,0,0,0,...) at vmem_xalloc+0x1df/frame 0xd49ff5bc vmem_alloc(c1b5b740,400000,2002,d49ff60c,0,...) at vmem_alloc+0xcc/frame 0xd49ff5f4 vmem_xalloc(c2381000,1000,0,0,0,...) at vmem_xalloc+0x417/frame 0xd49ff658 vmem_alloc(c2381000,1000,2002,d49ff6ac,fc8d4000,...) at vmem_alloc+0xcc/frame 0xd49ff690 kmem_malloc_domain(0,1000,2) at kmem_malloc_domain+0x44/frame 0xd49ff6bc page_alloc(c2388640,1000,0,d49ff707,2,...) at page_alloc+0x26/frame 0xd49ff6d4 keg_alloc_slab(0,2,c169eb97,94c,c6db8a00,...) at keg_alloc_slab+0xf6/frame 0xd49ff71c keg_fetch_slab(ffffffff,2,c169eb97,9ae,0,...) at keg_fetch_slab+0x10e/frame 0xd49ff774 zone_fetch_slab(c2388640,0,ffffffff,2,c193f85c,...) at zone_fetch_slab+0x61/frame 0xd49ff798 zone_import(c2388640,ff57c38c,1d,ffffffff,2,...) at zone_import+0x3b/frame 0xd49ff7d0 uma_zalloc_arg(c2388640,0,2,c6db7340,c190dc28,...) at uma_zalloc_arg+0x357/frame 0xd49ff80c malloc(170,c190e53c,2,d8aa8ca8,0,...) at malloc+0x116/frame 0xd49ff848 elf32_load_file(d49ff92c,d49ff9e8,1000,404,3,...) at elf32_load_file+0x48/frame 0xd49ff8b0 exec_elf32_imgact(d49ff9d0,d8aa8ca8,0,d49ff9d0,d4cc3000,...) at exec_elf32_imgact+0x11a7/frame 0xd49ff960 kern_execve(d627c700,d49ffba0,0,bfbfe6d0,2848e0a0,...) at kern_execve+0x8b4/frame 0xd49ffb80 sys_execve(d627c700,d627c980,c164301b,4,c18578ef,...) at sys_execve+0x6a/frame 0xd49ffbe8 syscall(d49ffce8) at syscall+0x6ee/frame 0xd49ffcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd49ffcdc --- syscall (59, FreeBSD ELF32, sys_execve), eip = 0x28191617, esp = 0xbfbfe6c0, ebp = 0xbfbfe710 --- Tracing command sh pid 18211 tid 100310 td 0xdec02700 sched_switch(dec02700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xcb0ae748 mi_switch(104,0,c1654159,22b,dec02700,...) at mi_switch+0x1f3/frame 0xcb0ae788 sleepq_switch(dec02700,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xcb0ae7bc sleepq_wait(c1b5b780,0,cb0ae800,1,0,...) at sleepq_wait+0x48/frame 0xcb0ae7e0 _cv_wait(c1b5b780,c1b5b740,c1655993,362,2002,...) at _cv_wait+0x21f/frame 0xcb0ae824 vmem_xalloc(c1b5b740,400000,0,0,0,...) at vmem_xalloc+0x1df/frame 0xcb0ae888 vmem_alloc(c1b5b740,400000,2002,cb0ae8d8,0,...) at vmem_alloc+0xcc/frame 0xcb0ae8c0 vmem_xalloc(c2381000,1000,0,0,0,...) at vmem_xalloc+0x417/frame 0xcb0ae924 vmem_alloc(c2381000,1000,2002,cb0ae978,fc8d4108,...) at vmem_alloc+0xcc/frame 0xcb0ae95c kmem_malloc_domain(0,1000,2) at kmem_malloc_domain+0x44/frame 0xcb0ae988 page_alloc(c238b3c0,1000,0,cb0ae9d3,2,...) at page_alloc+0x26/frame 0xcb0ae9a0 keg_alloc_slab(0,102,c169eb97,94c,c6db8a00,...) at keg_alloc_slab+0xf6/frame 0xcb0ae9e8 keg_fetch_slab(ffffffff,102,c169eb97,9ae,9,...) at keg_fetch_slab+0x10e/frame 0xcb0aea40 zone_fetch_slab(c238b3c0,0,ffffffff,102,c193f80c,...) at zone_fetch_slab+0x61/frame 0xcb0aea64 zone_import(c238b3c0,c239d02c,1,ffffffff,102,...) at zone_import+0x3b/frame 0xcb0aea9c uma_zalloc_arg(c238b3c0,0,102,c0c55115,c1910478,...) at uma_zalloc_arg+0x357/frame 0xcb0aead8 malloc(abc,c1910f84,102,dc47eac0,dc47ea08,...) at malloc+0x116/frame 0xcb0aeb14 sigacts_alloc(dc47e768,0,c16435dc,1ae,200246,...) at sigacts_alloc+0x23/frame 0xcb0aeb30 fork1(dec02700,cb0aebc0,0,0,80000034,...) at fork1+0xc5b/frame 0xcb0aeba8 sys_vfork(dec02700,dec02980,c164301b,4,c18578ef,...) at sys_vfork+0x55/frame 0xcb0aebe8 syscall(cb0aece8) at syscall+0x6ee/frame 0xcb0aecdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb0aecdc --- syscall (66, FreeBSD ELF32, sys_vfork), eip = 0x281b5eec, esp = 0xbfbfe888, ebp = 0xbfbfe8e8 --- Tracing command cron pid 18210 tid 100391 td 0xdc47d000 sched_switch(dc47d000,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xcb24faf0 mi_switch(104,0,c1654159,22b,dc47d000,...) at mi_switch+0x1f3/frame 0xcb24fb2c sleepq_switch(dc47d000,0,c1654159,2d6,dc47d000,...) at sleepq_switch+0x110/frame 0xcb24fb60 sleepq_timedwait(dc50932c,0,cb24fbc4,0,0,...) at sleepq_timedwait+0x53/frame 0xcb24fba0 _cv_timedwait_sbt(dc50932c,dc5090a8,fffffed8,0,0,...) at _cv_timedwait_sbt+0x24a/frame 0xcb24fbe8 syscall(cb24fce8) at syscall+0x977/frame 0xcb24fcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb24fcdc --- syscall (18213), eip = 0x28190eec, esp = 0xbfbfe718, ebp = 0xbfbfec58 --- Tracing command cron pid 18209 tid 100383 td 0xdd7fc000 sched_switch(dd7fc000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xcb2279a8 mi_switch(104,0,c1654159,22b,dd7fc000,...) at mi_switch+0x1f3/frame 0xcb2279e8 sleepq_switch(dd7fc000,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xcb227a1c sleepq_catch_signals(0,c1654159,178,c1b57994,dd7fc000,...) at sleepq_catch_signals+0x360/frame 0xcb227a60 sleepq_wait_sig(fd3aa9f0,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xcb227a84 _sleep(fd3aa9f0,fd3aab80,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xcb227ad8 pipe_read(d8af9310,cb227bb8,d858c400,0,dd7fc000,...) at pipe_read+0x49b/frame 0xcb227b18 dofileread(d8af9310,cb227bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xcb227b48 kern_readv(dd7fc000,5,cb227bb8,cb227be8,2846f000,...) at kern_readv+0x93/frame 0xcb227b98 sys_read(dd7fc000,dd7fc280,c164301b,4,0,...) at sys_read+0x54/frame 0xcb227be8 syscall(cb227ce8) at syscall+0x6ee/frame 0xcb227cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb227cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282236df, esp = 0xbfbfe6a4, ebp = 0xbfbfe6b8 --- Tracing command cron pid 18208 tid 100293 td 0xdeb1f700 sched_switch(deb1f700,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xd4bb6af0 mi_switch(104,0,c1654159,22b,deb1f700,...) at mi_switch+0x1f3/frame 0xd4bb6b2c sleepq_switch(deb1f700,0,c1654159,2d6,deb1f700,...) at sleepq_switch+0x110/frame 0xd4bb6b60 sleepq_timedwait(deb8a32c,0,d4bb6bc4,0,0,...) at sleepq_timedwait+0x53/frame 0xd4bb6ba0 _cv_timedwait_sbt(deb8a32c,deb8a0a8,fffffed8,0,0,...) at _cv_timedwait_sbt+0x24a/frame 0xd4bb6be8 syscall(d4bb6ce8) at syscall+0x977/frame 0xd4bb6cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd4bb6cdc --- syscall (18212), eip = 0x28190eec, esp = 0xbfbfe718, ebp = 0xbfbfec58 --- Tracing command sh pid 18188 tid 100318 td 0xdec02000 sched_switch(dec02000,0,104,188,c1b48780,...) at sched_switch+0x503/frame 0xcb0db508 mi_switch(104,0,c1654159,22b,dec02000,...) at mi_switch+0x1f3/frame 0xcb0db544 sleepq_switch(dec02000,0,c1654159,2b3,f7edd304,...) at sleepq_switch+0x110/frame 0xcb0db578 sleepq_wait(f7edd304,60,c1637586,4,1,...) at sleepq_wait+0x48/frame 0xcb0db59c sleeplk(f7edd370,c1637586,60,33,1,...) at sleeplk+0x1a0/frame 0xcb0db5e0 __lockmgr_args(f7edd304,206000,f7edd370,0,0,...) at __lockmgr_args+0x60e/frame 0xcb0db64c ffs_lock(cb0db6c8,0,c16611f5,c1b863d0,c6dc1b08,...) at ffs_lock+0xa7/frame 0xcb0db684 VOP_LOCK1_APV(c193e9b4,cb0db6c8,cb0db6cc,c0d386b8,c1956ea8,...) at VOP_LOCK1_APV+0xda/frame 0xcb0db6b0 _vn_lock(f7edd2d0,206000,c16611f5,a2f,0,...) at _vn_lock+0x61/frame 0xcb0db6f0 vget(f7edd2d0,206000,dec02000,cb0db768,dec020cc,...) at vget+0xc1/frame 0xcb0db728 cache_lookup(d8b73b40,cb0dba80,cb0dba94,0,0,...) at cache_lookup+0x97b/frame 0xcb0db7a8 vfs_cache_lookup(cb0db848,c1862ecd,0,c1954fa0,d8b73b40,...) at vfs_cache_lookup+0xb5/frame 0xcb0db7f4 VOP_LOOKUP_APV(c193e9b4,cb0db848,cb0dba94,3cd,2,...) at VOP_LOOKUP_APV+0xf6/frame 0xcb0db820 lookup(cb0dba38,c1660292,1b3,17c,200246,...) at lookup+0x663/frame 0xcb0db890 namei(cb0dba38,0,4000144,0,284e144c,...) at namei+0x5f1/frame 0xcb0db928 kern_statat(dec02000,0,ffffff9c,284e144c,0,...) at kern_statat+0xae/frame 0xcb0dbad8 sys_fstatat(dec02000,dec02280,c164301b,4,0,...) at sys_fstatat+0x49/frame 0xcb0dbbe8 syscall(cb0dbce8) at syscall+0x6ee/frame 0xcb0dbcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb0dbcdc --- syscall (552, FreeBSD ELF32, sys_fstatat), eip = 0x28245243, esp = 0xbfbfe90c, ebp = 0xbfbfe998 --- Tracing command cron pid 18186 tid 100334 td 0xd6354700 sched_switch(d6354700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xcb12b9a8 mi_switch(104,0,c1654159,22b,d6354700,...) at mi_switch+0x1f3/frame 0xcb12b9e8 sleepq_switch(d6354700,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xcb12ba1c sleepq_catch_signals(0,c1654159,178,c1b57f54,d6354700,...) at sleepq_catch_signals+0x360/frame 0xcb12ba60 sleepq_wait_sig(d8af7000,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xcb12ba84 _sleep(d8af7000,d8af7190,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xcb12bad8 pipe_read(d8aab4d0,cb12bbb8,d858c400,0,d6354700,...) at pipe_read+0x49b/frame 0xcb12bb18 dofileread(d8aab4d0,cb12bbb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xcb12bb48 kern_readv(d6354700,5,cb12bbb8,cb12bbe8,2846f000,...) at kern_readv+0x93/frame 0xcb12bb98 sys_read(d6354700,d6354980,c164301b,4,0,...) at sys_read+0x54/frame 0xcb12bbe8 syscall(cb12bce8) at syscall+0x6ee/frame 0xcb12bcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb12bcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282236df, esp = 0xbfbfe6a4, ebp = 0xbfbfe6b8 --- Tracing command sh pid 18147 tid 100437 td 0xdc381700 sched_switch(dc381700,0,104,188,c1b49500,...) at sched_switch+0x503/frame 0xcb34b508 mi_switch(104,0,c1654159,22b,dc381700,...) at mi_switch+0x1f3/frame 0xcb34b544 sleepq_switch(dc381700,0,c1654159,2b3,f7edd304,...) at sleepq_switch+0x110/frame 0xcb34b578 sleepq_wait(f7edd304,60,c1637586,4,1,...) at sleepq_wait+0x48/frame 0xcb34b59c sleeplk(f7edd370,c1637586,60,33,1,...) at sleeplk+0x1a0/frame 0xcb34b5e0 __lockmgr_args(f7edd304,206000,f7edd370,0,0,...) at __lockmgr_args+0x60e/frame 0xcb34b64c ffs_lock(cb34b6c8,0,c16611f5,c1b873a0,c6dc1b08,...) at ffs_lock+0xa7/frame 0xcb34b684 VOP_LOCK1_APV(c193e9b4,cb34b6c8,cb34b6cc,c0d386b8,c1956ea8,...) at VOP_LOCK1_APV+0xda/frame 0xcb34b6b0 _vn_lock(f7edd2d0,206000,c16611f5,a2f,0,...) at _vn_lock+0x61/frame 0xcb34b6f0 vget(f7edd2d0,206000,dc381700,cb34b768,dc3817cc,...) at vget+0xc1/frame 0xcb34b728 cache_lookup(d8b73b40,cb34ba80,cb34ba94,0,0,...) at cache_lookup+0x97b/frame 0xcb34b7a8 vfs_cache_lookup(cb34b848,c1862ecd,0,c1954fa0,d8b73b40,...) at vfs_cache_lookup+0xb5/frame 0xcb34b7f4 VOP_LOOKUP_APV(c193e9b4,cb34b848,cb34ba94,3cd,2,...) at VOP_LOOKUP_APV+0xf6/frame 0xcb34b820 lookup(cb34ba38,c1660292,1b3,17c,200246,...) at lookup+0x663/frame 0xcb34b890 namei(cb34ba38,0,4000144,0,284e144c,...) at namei+0x5f1/frame 0xcb34b928 kern_statat(dc381700,0,ffffff9c,284e144c,0,...) at kern_statat+0xae/frame 0xcb34bad8 sys_fstatat(dc381700,dc381980,c164301b,4,0,...) at sys_fstatat+0x49/frame 0xcb34bbe8 syscall(cb34bce8) at syscall+0x6ee/frame 0xcb34bcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb34bcdc --- syscall (552, FreeBSD ELF32, sys_fstatat), eip = 0x28245243, esp = 0xbfbfe90c, ebp = 0xbfbfe998 --- Tracing command cron pid 18146 tid 100183 td 0xd82a4a80 sched_switch(d82a4a80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdab879a8 mi_switch(104,0,c1654159,22b,d82a4a80,...) at mi_switch+0x1f3/frame 0xdab879e8 sleepq_switch(d82a4a80,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xdab87a1c sleepq_catch_signals(0,c1654159,178,c1b58e94,d82a4a80,...) at sleepq_catch_signals+0x360/frame 0xdab87a60 sleepq_wait_sig(f5b4ed40,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xdab87a84 _sleep(f5b4ed40,f5b4eed0,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xdab87ad8 pipe_read(d8ae7348,dab87bb8,d858c400,0,d82a4a80,...) at pipe_read+0x49b/frame 0xdab87b18 dofileread(d8ae7348,dab87bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xdab87b48 kern_readv(d82a4a80,5,dab87bb8,dab87be8,2846f000,...) at kern_readv+0x93/frame 0xdab87b98 sys_read(d82a4a80,d82a4d00,c164301b,4,0,...) at sys_read+0x54/frame 0xdab87be8 syscall(dab87ce8) at syscall+0x6ee/frame 0xdab87cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdab87cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282236df, esp = 0xbfbfe6a4, ebp = 0xbfbfe6b8 --- Tracing command sh pid 18107 tid 100276 td 0xdeb75380 sched_switch(deb75380,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xd4b61508 mi_switch(104,0,c1654159,22b,deb75380,...) at mi_switch+0x1f3/frame 0xd4b61544 sleepq_switch(deb75380,0,c1654159,2b3,f7edd304,...) at sleepq_switch+0x110/frame 0xd4b61578 sleepq_wait(f7edd304,60,c1637586,4,1,...) at sleepq_wait+0x48/frame 0xd4b6159c sleeplk(f7edd370,c1637586,60,33,1,...) at sleeplk+0x1a0/frame 0xd4b615e0 __lockmgr_args(f7edd304,206000,f7edd370,0,0,...) at __lockmgr_args+0x60e/frame 0xd4b6164c ffs_lock(d4b616c8,0,c16611f5,c1b86638,c6dc1b08,...) at ffs_lock+0xa7/frame 0xd4b61684 VOP_LOCK1_APV(c193e9b4,d4b616c8,d4b616cc,c0d386b8,c1956ea8,...) at VOP_LOCK1_APV+0xda/frame 0xd4b616b0 _vn_lock(f7edd2d0,206000,c16611f5,a2f,0,...) at _vn_lock+0x61/frame 0xd4b616f0 vget(f7edd2d0,206000,deb75380,d4b61768,deb7544c,...) at vget+0xc1/frame 0xd4b61728 cache_lookup(d8b73b40,d4b61a80,d4b61a94,0,0,...) at cache_lookup+0x97b/frame 0xd4b617a8 vfs_cache_lookup(d4b61848,c1862ecd,0,c1954fa0,d8b73b40,...) at vfs_cache_lookup+0xb5/frame 0xd4b617f4 VOP_LOOKUP_APV(c193e9b4,d4b61848,d4b61a94,3cd,2,...) at VOP_LOOKUP_APV+0xf6/frame 0xd4b61820 lookup(d4b61a38,c1660292,1b3,17c,200246,...) at lookup+0x663/frame 0xd4b61890 namei(d4b61a38,0,4000144,0,284e144c,...) at namei+0x5f1/frame 0xd4b61928 kern_statat(deb75380,0,ffffff9c,284e144c,0,...) at kern_statat+0xae/frame 0xd4b61ad8 sys_fstatat(deb75380,deb75600,c164301b,4,0,...) at sys_fstatat+0x49/frame 0xd4b61be8 syscall(d4b61ce8) at syscall+0x6ee/frame 0xd4b61cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd4b61cdc --- syscall (552, FreeBSD ELF32, sys_fstatat), eip = 0x28245243, esp = 0xbfbfe90c, ebp = 0xbfbfe998 --- Tracing command cron pid 18106 tid 100350 td 0xdd9bb700 sched_switch(dd9bb700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xcb17b9a8 mi_switch(104,0,c1654159,22b,dd9bb700,...) at mi_switch+0x1f3/frame 0xcb17b9e8 sleepq_switch(dd9bb700,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xcb17ba1c sleepq_catch_signals(0,c1654159,178,c1b57594,dd9bb700,...) at sleepq_catch_signals+0x360/frame 0xcb17ba60 sleepq_wait_sig(f5b4e1a8,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xcb17ba84 _sleep(f5b4e1a8,f5b4e338,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xcb17bad8 pipe_read(d8aab1f8,cb17bbb8,d858c400,0,dd9bb700,...) at pipe_read+0x49b/frame 0xcb17bb18 dofileread(d8aab1f8,cb17bbb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xcb17bb48 kern_readv(dd9bb700,5,cb17bbb8,cb17bbe8,2846f000,...) at kern_readv+0x93/frame 0xcb17bb98 sys_read(dd9bb700,dd9bb980,c164301b,4,0,...) at sys_read+0x54/frame 0xcb17bbe8 syscall(cb17bce8) at syscall+0x6ee/frame 0xcb17bcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb17bcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282236df, esp = 0xbfbfe6a4, ebp = 0xbfbfe6b8 --- Tracing command sh pid 18063 tid 100247 td 0xdeb80380 sched_switch(deb80380,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xd4a68508 mi_switch(104,0,c1654159,22b,deb80380,...) at mi_switch+0x1f3/frame 0xd4a68544 sleepq_switch(deb80380,0,c1654159,2b3,f7edd304,...) at sleepq_switch+0x110/frame 0xd4a68578 sleepq_wait(f7edd304,60,c1637586,4,1,...) at sleepq_wait+0x48/frame 0xd4a6859c sleeplk(f7edd370,c1637586,60,33,1,...) at sleeplk+0x1a0/frame 0xd4a685e0 __lockmgr_args(f7edd304,206000,f7edd370,0,0,...) at __lockmgr_args+0x60e/frame 0xd4a6864c ffs_lock(d4a686c8,0,c16611f5,c1b86c10,c6dc1b08,...) at ffs_lock+0xa7/frame 0xd4a68684 VOP_LOCK1_APV(c193e9b4,d4a686c8,d4a686cc,c0d386b8,c1956ea8,...) at VOP_LOCK1_APV+0xda/frame 0xd4a686b0 _vn_lock(f7edd2d0,206000,c16611f5,a2f,0,...) at _vn_lock+0x61/frame 0xd4a686f0 vget(f7edd2d0,206000,deb80380,d4a68768,deb8044c,...) at vget+0xc1/frame 0xd4a68728 cache_lookup(d8b73b40,d4a68a80,d4a68a94,0,0,...) at cache_lookup+0x97b/frame 0xd4a687a8 vfs_cache_lookup(d4a68848,c1862ecd,0,c1954fa0,d8b73b40,...) at vfs_cache_lookup+0xb5/frame 0xd4a687f4 VOP_LOOKUP_APV(c193e9b4,d4a68848,d4a68a94,3cd,2,...) at VOP_LOOKUP_APV+0xf6/frame 0xd4a68820 lookup(d4a68a38,c1660292,1b3,17c,200246,...) at lookup+0x663/frame 0xd4a68890 namei(d4a68a38,0,4000144,0,284e144c,...) at namei+0x5f1/frame 0xd4a68928 kern_statat(deb80380,0,ffffff9c,284e144c,0,...) at kern_statat+0xae/frame 0xd4a68ad8 sys_fstatat(deb80380,deb80600,c164301b,4,0,...) at sys_fstatat+0x49/frame 0xd4a68be8 syscall(d4a68ce8) at syscall+0x6ee/frame 0xd4a68cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd4a68cdc --- syscall (552, FreeBSD ELF32, sys_fstatat), eip = 0x28245243, esp = 0xbfbfe90c, ebp = 0xbfbfe998 --- Tracing command cron pid 18062 tid 100246 td 0xdeb91380 sched_switch(deb91380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd4a639a8 mi_switch(104,0,c1654159,22b,deb91380,...) at mi_switch+0x1f3/frame 0xd4a639e8 sleepq_switch(deb91380,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xd4a63a1c sleepq_catch_signals(0,c1654159,178,c1b594d4,deb91380,...) at sleepq_catch_signals+0x360/frame 0xd4a63a60 sleepq_wait_sig(dca766a0,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xd4a63a84 _sleep(dca766a0,dca76830,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xd4a63ad8 pipe_read(debd1150,d4a63bb8,d858c400,0,deb91380,...) at pipe_read+0x49b/frame 0xd4a63b18 dofileread(debd1150,d4a63bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xd4a63b48 kern_readv(deb91380,5,d4a63bb8,d4a63be8,2846f000,...) at kern_readv+0x93/frame 0xd4a63b98 sys_read(deb91380,deb91600,c164301b,4,0,...) at sys_read+0x54/frame 0xd4a63be8 syscall(d4a63ce8) at syscall+0x6ee/frame 0xd4a63cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd4a63cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282236df, esp = 0xbfbfe6a4, ebp = 0xbfbfe6b8 --- Tracing command sh pid 18023 tid 100407 td 0xcb793700 sched_switch(cb793700,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xcb2b5508 mi_switch(104,0,c1654159,22b,cb793700,...) at mi_switch+0x1f3/frame 0xcb2b5544 sleepq_switch(cb793700,0,c1654159,2b3,f7edd304,...) at sleepq_switch+0x110/frame 0xcb2b5578 sleepq_wait(f7edd304,60,c1637586,4,1,...) at sleepq_wait+0x48/frame 0xcb2b559c sleeplk(f7edd370,c1637586,60,33,1,...) at sleeplk+0x1a0/frame 0xcb2b55e0 __lockmgr_args(f7edd304,206000,f7edd370,0,0,...) at __lockmgr_args+0x60e/frame 0xcb2b564c ffs_lock(cb2b56c8,0,c16611f5,c1b861c0,c6dc1b08,...) at ffs_lock+0xa7/frame 0xcb2b5684 VOP_LOCK1_APV(c193e9b4,cb2b56c8,cb2b56cc,c0d386b8,c1956ea8,...) at VOP_LOCK1_APV+0xda/frame 0xcb2b56b0 _vn_lock(f7edd2d0,206000,c16611f5,a2f,0,...) at _vn_lock+0x61/frame 0xcb2b56f0 vget(f7edd2d0,206000,cb793700,cb2b5768,cb7937cc,...) at vget+0xc1/frame 0xcb2b5728 cache_lookup(d8b73b40,cb2b5a80,cb2b5a94,0,0,...) at cache_lookup+0x97b/frame 0xcb2b57a8 vfs_cache_lookup(cb2b5848,c1862ecd,0,c1954fa0,d8b73b40,...) at vfs_cache_lookup+0xb5/frame 0xcb2b57f4 VOP_LOOKUP_APV(c193e9b4,cb2b5848,cb2b5a94,3cd,2,...) at VOP_LOOKUP_APV+0xf6/frame 0xcb2b5820 lookup(cb2b5a38,c1660292,1b3,17c,200246,...) at lookup+0x663/frame 0xcb2b5890 namei(cb2b5a38,0,4000144,0,284e144c,...) at namei+0x5f1/frame 0xcb2b5928 kern_statat(cb793700,0,ffffff9c,284e144c,0,...) at kern_statat+0xae/frame 0xcb2b5ad8 sys_fstatat(cb793700,cb793980,c164301b,4,0,...) at sys_fstatat+0x49/frame 0xcb2b5be8 syscall(cb2b5ce8) at syscall+0x6ee/frame 0xcb2b5cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb2b5cdc --- syscall (552, FreeBSD ELF32, sys_fstatat), eip = 0x28245243, esp = 0xbfbfe90c, ebp = 0xbfbfe998 --- Tracing command cron pid 18022 tid 100363 td 0xdeb8e700 sched_switch(deb8e700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xcb1bc9a8 mi_switch(104,0,c1654159,22b,deb8e700,...) at mi_switch+0x1f3/frame 0xcb1bc9e8 sleepq_switch(deb8e700,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xcb1bca1c sleepq_catch_signals(0,c1654159,178,c1b56a54,deb8e700,...) at sleepq_catch_signals+0x360/frame 0xcb1bca60 sleepq_wait_sig(f5b4e4f8,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xcb1bca84 _sleep(f5b4e4f8,f5b4e688,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xcb1bcad8 pipe_read(d8ae7770,cb1bcbb8,d858c400,0,deb8e700,...) at pipe_read+0x49b/frame 0xcb1bcb18 dofileread(d8ae7770,cb1bcbb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xcb1bcb48 kern_readv(deb8e700,5,cb1bcbb8,cb1bcbe8,2846f000,...) at kern_readv+0x93/frame 0xcb1bcb98 sys_read(deb8e700,deb8e980,c164301b,4,0,...) at sys_read+0x54/frame 0xcb1bcbe8 syscall(cb1bcce8) at syscall+0x6ee/frame 0xcb1bccdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb1bccdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282236df, esp = 0xbfbfe6a4, ebp = 0xbfbfe6b8 --- Tracing command sh pid 17980 tid 100390 td 0xdc47d380 sched_switch(dc47d380,0,104,188,c1b49500,...) at sched_switch+0x503/frame 0xcb24a508 mi_switch(104,0,c1654159,22b,dc47d380,...) at mi_switch+0x1f3/frame 0xcb24a544 sleepq_switch(dc47d380,0,c1654159,2b3,f7edd304,...) at sleepq_switch+0x110/frame 0xcb24a578 sleepq_wait(f7edd304,60,c1637586,4,1,...) at sleepq_wait+0x48/frame 0xcb24a59c sleeplk(f7edd370,c1637586,60,33,1,...) at sleeplk+0x1a0/frame 0xcb24a5e0 __lockmgr_args(f7edd304,206000,f7edd370,0,0,...) at __lockmgr_args+0x60e/frame 0xcb24a64c ffs_lock(cb24a6c8,0,c16611f5,c1b87558,c6dc1b08,...) at ffs_lock+0xa7/frame 0xcb24a684 VOP_LOCK1_APV(c193e9b4,cb24a6c8,cb24a6cc,c0d386b8,c1956ea8,...) at VOP_LOCK1_APV+0xda/frame 0xcb24a6b0 _vn_lock(f7edd2d0,206000,c16611f5,a2f,0,...) at _vn_lock+0x61/frame 0xcb24a6f0 vget(f7edd2d0,206000,dc47d380,cb24a768,dc47d44c,...) at vget+0xc1/frame 0xcb24a728 cache_lookup(d8b73b40,cb24aa80,cb24aa94,0,0,...) at cache_lookup+0x97b/frame 0xcb24a7a8 vfs_cache_lookup(cb24a848,c1862ecd,0,c1954fa0,d8b73b40,...) at vfs_cache_lookup+0xb5/frame 0xcb24a7f4 VOP_LOOKUP_APV(c193e9b4,cb24a848,cb24aa94,3cd,2,...) at VOP_LOOKUP_APV+0xf6/frame 0xcb24a820 lookup(cb24aa38,c1660292,1b3,17c,200246,...) at lookup+0x663/frame 0xcb24a890 namei(cb24aa38,0,4000144,0,284e144c,...) at namei+0x5f1/frame 0xcb24a928 kern_statat(dc47d380,0,ffffff9c,284e144c,0,...) at kern_statat+0xae/frame 0xcb24aad8 sys_fstatat(dc47d380,dc47d600,c164301b,4,c18578ef,...) at sys_fstatat+0x49/frame 0xcb24abe8 syscall(cb24ace8) at syscall+0x6ee/frame 0xcb24acdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb24acdc --- syscall (552, FreeBSD ELF32, sys_fstatat), eip = 0x28245243, esp = 0xbfbfe90c, ebp = 0xbfbfe998 --- Tracing command newsyslog pid 17979 tid 100238 td 0xdeb76700 sched_switch(deb76700,0,104,188,c1b480c0,...) at sched_switch+0x503/frame 0xd4a30508 mi_switch(104,0,c1654159,22b,deb76700,...) at mi_switch+0x1f3/frame 0xd4a30544 sleepq_switch(deb76700,0,c1654159,2b3,dc1f0b74,...) at sleepq_switch+0x110/frame 0xd4a30578 sleepq_wait(dc1f0b74,60,c1637586,4,1,...) at sleepq_wait+0x48/frame 0xd4a3059c sleeplk(dc1f0be0,c1637586,60,33,1,...) at sleeplk+0x1a0/frame 0xd4a305e0 __lockmgr_args(dc1f0b74,206000,dc1f0be0,0,0,...) at __lockmgr_args+0x60e/frame 0xd4a3064c ffs_lock(d4a306c8,0,c16611f5,c1b85350,c6dc1b08,...) at ffs_lock+0xa7/frame 0xd4a30684 VOP_LOCK1_APV(c193e9b4,d4a306c8,d4a306cc,c0d386b8,c1956ea8,...) at VOP_LOCK1_APV+0xda/frame 0xd4a306b0 _vn_lock(dc1f0b40,206000,c16611f5,a2f,0,...) at _vn_lock+0x61/frame 0xd4a306f0 vget(dc1f0b40,206000,deb76700,d4a30768,deb767cc,...) at vget+0xc1/frame 0xd4a30728 cache_lookup(d8aeb708,d4a30a80,d4a30a94,0,0,...) at cache_lookup+0x97b/frame 0xd4a307a8 vfs_cache_lookup(d4a30848,c1862ecd,0,c1954fa0,d8aeb708,...) at vfs_cache_lookup+0xb5/frame 0xd4a307f4 VOP_LOOKUP_APV(c193e9b4,d4a30848,d4a30a94,3cd,2,...) at VOP_LOOKUP_APV+0xf6/frame 0xd4a30820 lookup(d4a30a38,c1660292,1b3,17c,dc17b9c4,...) at lookup+0x663/frame 0xd4a30890 namei(d4a30a38,0,4000144,0,28470000,...) at namei+0x5f1/frame 0xd4a30928 kern_statat(deb76700,0,ffffff9c,28470000,0,...) at kern_statat+0xae/frame 0xd4a30ad8 sys_fstatat(deb76700,deb76980,c164301b,4,c18578ef,...) at sys_fstatat+0x49/frame 0xd4a30be8 syscall(d4a30ce8) at syscall+0x6ee/frame 0xd4a30cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd4a30cdc --- syscall (552, FreeBSD ELF32, sys_fstatat), eip = 0x28201243, esp = 0xbfbfcfb4, ebp = 0xbfbfd040 --- Tracing command cron pid 17977 tid 100207 td 0xdc7bea80 sched_switch(dc7bea80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd492e9a8 mi_switch(104,0,c1654159,22b,dc7bea80,...) at mi_switch+0x1f3/frame 0xd492e9e8 sleepq_switch(dc7bea80,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xd492ea1c sleepq_catch_signals(0,c1654159,178,c1b56a54,dc7bea80,...) at sleepq_catch_signals+0x360/frame 0xd492ea60 sleepq_wait_sig(d8b7e4f8,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xd492ea84 _sleep(d8b7e4f8,d8b7e688,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xd492ead8 pipe_read(debce3f0,d492ebb8,d858c400,0,dc7bea80,...) at pipe_read+0x49b/frame 0xd492eb18 dofileread(debce3f0,d492ebb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xd492eb48 kern_readv(dc7bea80,5,d492ebb8,d492ebe8,2846f000,...) at kern_readv+0x93/frame 0xd492eb98 sys_read(dc7bea80,dc7bed00,c164301b,4,0,...) at sys_read+0x54/frame 0xd492ebe8 syscall(d492ece8) at syscall+0x6ee/frame 0xd492ecdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd492ecdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282236df, esp = 0xbfbfe6a4, ebp = 0xbfbfe6b8 --- Tracing command cron pid 17976 tid 100329 td 0xdeafb380 sched_switch(deafb380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xcb1129a8 mi_switch(104,0,c1654159,22b,deafb380,...) at mi_switch+0x1f3/frame 0xcb1129e8 sleepq_switch(deafb380,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xcb112a1c sleepq_catch_signals(0,c1654159,178,c1b56b54,deafb380,...) at sleepq_catch_signals+0x360/frame 0xcb112a60 sleepq_wait_sig(dc1e6848,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xcb112a84 _sleep(dc1e6848,dc1e69d8,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xcb112ad8 pipe_read(d8af99a0,cb112bb8,d858c400,0,deafb380,...) at pipe_read+0x49b/frame 0xcb112b18 dofileread(d8af99a0,cb112bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xcb112b48 kern_readv(deafb380,5,cb112bb8,cb112be8,28470000,...) at kern_readv+0x93/frame 0xcb112b98 sys_read(deafb380,deafb600,c164301b,4,0,...) at sys_read+0x54/frame 0xcb112be8 syscall(cb112ce8) at syscall+0x6ee/frame 0xcb112cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb112cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282236df, esp = 0xbfbfe6a4, ebp = 0xbfbfe6b8 --- Tracing command sh pid 17956 tid 100338 td 0xdc2e3a80 sched_switch(dc2e3a80,0,104,188,c1b48780,...) at sched_switch+0x503/frame 0xcb13f508 mi_switch(104,0,c1654159,22b,dc2e3a80,...) at mi_switch+0x1f3/frame 0xcb13f544 sleepq_switch(dc2e3a80,0,c1654159,2b3,f7edd304,...) at sleepq_switch+0x110/frame 0xcb13f578 sleepq_wait(f7edd304,60,c1637586,4,1,...) at sleepq_wait+0x48/frame 0xcb13f59c sleeplk(f7edd370,c1637586,60,33,1,...) at sleeplk+0x1a0/frame 0xcb13f5e0 __lockmgr_args(f7edd304,206000,f7edd370,0,0,...) at __lockmgr_args+0x60e/frame 0xcb13f64c ffs_lock(cb13f6c8,0,c16611f5,c1b852f8,c6dc1b08,...) at ffs_lock+0xa7/frame 0xcb13f684 VOP_LOCK1_APV(c193e9b4,cb13f6c8,cb13f6cc,c0d386b8,c1956ea8,...) at VOP_LOCK1_APV+0xda/frame 0xcb13f6b0 _vn_lock(f7edd2d0,206000,c16611f5,a2f,0,...) at _vn_lock+0x61/frame 0xcb13f6f0 vget(f7edd2d0,206000,dc2e3a80,cb13f768,dc2e3b4c,...) at vget+0xc1/frame 0xcb13f728 cache_lookup(d8b73b40,cb13fa80,cb13fa94,0,0,...) at cache_lookup+0x97b/frame 0xcb13f7a8 vfs_cache_lookup(cb13f848,c1862ecd,0,c1954fa0,d8b73b40,...) at vfs_cache_lookup+0xb5/frame 0xcb13f7f4 VOP_LOOKUP_APV(c193e9b4,cb13f848,cb13fa94,3cd,2,...) at VOP_LOOKUP_APV+0xf6/frame 0xcb13f820 lookup(cb13fa38,c1660292,1b3,17c,200246,...) at lookup+0x663/frame 0xcb13f890 namei(cb13fa38,0,4000144,0,284e144c,...) at namei+0x5f1/frame 0xcb13f928 kern_statat(dc2e3a80,0,ffffff9c,284e144c,0,...) at kern_statat+0xae/frame 0xcb13fad8 sys_fstatat(dc2e3a80,dc2e3d00,c164301b,4,0,...) at sys_fstatat+0x49/frame 0xcb13fbe8 syscall(cb13fce8) at syscall+0x6ee/frame 0xcb13fcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb13fcdc --- syscall (552, FreeBSD ELF32, sys_fstatat), eip = 0x28245243, esp = 0xbfbfe90c, ebp = 0xbfbfe998 --- Tracing command cron pid 17954 tid 100281 td 0xdeb74000 sched_switch(deb74000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd4b7a9a8 mi_switch(104,0,c1654159,22b,deb74000,...) at mi_switch+0x1f3/frame 0xd4b7a9e8 sleepq_switch(deb74000,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xd4b7aa1c sleepq_catch_signals(0,c1654159,178,c1b58e54,deb74000,...) at sleepq_catch_signals+0x360/frame 0xd4b7aa60 sleepq_wait_sig(dc1e54f8,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xd4b7aa84 _sleep(dc1e54f8,dc1e5688,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xd4b7aad8 pipe_read(d8aac310,d4b7abb8,d858c400,0,deb74000,...) at pipe_read+0x49b/frame 0xd4b7ab18 dofileread(d8aac310,d4b7abb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xd4b7ab48 kern_readv(deb74000,5,d4b7abb8,d4b7abe8,2846f000,...) at kern_readv+0x93/frame 0xd4b7ab98 sys_read(deb74000,deb74280,c164301b,4,0,...) at sys_read+0x54/frame 0xd4b7abe8 syscall(d4b7ace8) at syscall+0x6ee/frame 0xd4b7acdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd4b7acdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282236df, esp = 0xbfbfe6a4, ebp = 0xbfbfe6b8 --- Tracing command sh pid 17915 tid 100256 td 0xdeb7e380 sched_switch(deb7e380,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xd4a95508 mi_switch(104,0,c1654159,22b,deb7e380,...) at mi_switch+0x1f3/frame 0xd4a95544 sleepq_switch(deb7e380,0,c1654159,2b3,f7edd304,...) at sleepq_switch+0x110/frame 0xd4a95578 sleepq_wait(f7edd304,60,c1637586,4,1,...) at sleepq_wait+0x48/frame 0xd4a9559c sleeplk(f7edd370,c1637586,60,33,1,...) at sleeplk+0x1a0/frame 0xd4a955e0 __lockmgr_args(f7edd304,206000,f7edd370,0,0,...) at __lockmgr_args+0x60e/frame 0xd4a9564c ffs_lock(d4a956c8,0,c16611f5,c1b88000,c6dc1b08,...) at ffs_lock+0xa7/frame 0xd4a95684 VOP_LOCK1_APV(c193e9b4,d4a956c8,d4a956cc,c0d386b8,c1956ea8,...) at VOP_LOCK1_APV+0xda/frame 0xd4a956b0 _vn_lock(f7edd2d0,206000,c16611f5,a2f,0,...) at _vn_lock+0x61/frame 0xd4a956f0 vget(f7edd2d0,206000,deb7e380,d4a95768,deb7e44c,...) at vget+0xc1/frame 0xd4a95728 cache_lookup(d8b73b40,d4a95a80,d4a95a94,0,0,...) at cache_lookup+0x97b/frame 0xd4a957a8 vfs_cache_lookup(d4a95848,c1862ecd,0,c1954fa0,d8b73b40,...) at vfs_cache_lookup+0xb5/frame 0xd4a957f4 VOP_LOOKUP_APV(c193e9b4,d4a95848,d4a95a94,3cd,2,...) at VOP_LOOKUP_APV+0xf6/frame 0xd4a95820 lookup(d4a95a38,c1660292,1b3,17c,200246,...) at lookup+0x663/frame 0xd4a95890 namei(d4a95a38,0,4000144,0,284e144c,...) at namei+0x5f1/frame 0xd4a95928 kern_statat(deb7e380,0,ffffff9c,284e144c,0,...) at kern_statat+0xae/frame 0xd4a95ad8 sys_fstatat(deb7e380,deb7e600,c164301b,4,0,...) at sys_fstatat+0x49/frame 0xd4a95be8 syscall(d4a95ce8) at syscall+0x6ee/frame 0xd4a95cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd4a95cdc --- syscall (552, FreeBSD ELF32, sys_fstatat), eip = 0x28245243, esp = 0xbfbfe90c, ebp = 0xbfbfe998 --- Tracing command cron pid 17914 tid 100167 td 0xdc6b9a80 sched_switch(dc6b9a80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdab339a8 mi_switch(104,0,c1654159,22b,dc6b9a80,...) at mi_switch+0x1f3/frame 0xdab339e8 sleepq_switch(dc6b9a80,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xdab33a1c sleepq_catch_signals(0,c1654159,178,c1b57014,dc6b9a80,...) at sleepq_catch_signals+0x360/frame 0xdab33a60 sleepq_wait_sig(dc1e6350,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xdab33a84 _sleep(dc1e6350,dc1e64e0,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xdab33ad8 pipe_read(d8ae5348,dab33bb8,d858c400,0,dc6b9a80,...) at pipe_read+0x49b/frame 0xdab33b18 dofileread(d8ae5348,dab33bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xdab33b48 kern_readv(dc6b9a80,5,dab33bb8,dab33be8,2846f000,...) at kern_readv+0x93/frame 0xdab33b98 sys_read(dc6b9a80,dc6b9d00,c164301b,4,0,...) at sys_read+0x54/frame 0xdab33be8 syscall(dab33ce8) at syscall+0x6ee/frame 0xdab33cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdab33cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282236df, esp = 0xbfbfe6a4, ebp = 0xbfbfe6b8 --- Tracing command sh pid 17875 tid 100347 td 0xdee53380 sched_switch(dee53380,0,104,188,c1b48780,...) at sched_switch+0x503/frame 0xcb16c508 mi_switch(104,0,c1654159,22b,dee53380,...) at mi_switch+0x1f3/frame 0xcb16c544 sleepq_switch(dee53380,0,c1654159,2b3,f7edd304,...) at sleepq_switch+0x110/frame 0xcb16c578 sleepq_wait(f7edd304,60,c1637586,4,1,...) at sleepq_wait+0x48/frame 0xcb16c59c sleeplk(f7edd370,c1637586,60,33,1,...) at sleeplk+0x1a0/frame 0xcb16c5e0 __lockmgr_args(f7edd304,206000,f7edd370,0,0,...) at __lockmgr_args+0x60e/frame 0xcb16c64c ffs_lock(cb16c6c8,0,c16611f5,c1b865e0,c6dc1b08,...) at ffs_lock+0xa7/frame 0xcb16c684 VOP_LOCK1_APV(c193e9b4,cb16c6c8,cb16c6cc,c0d386b8,c1956ea8,...) at VOP_LOCK1_APV+0xda/frame 0xcb16c6b0 _vn_lock(f7edd2d0,206000,c16611f5,a2f,0,...) at _vn_lock+0x61/frame 0xcb16c6f0 vget(f7edd2d0,206000,dee53380,cb16c768,dee5344c,...) at vget+0xc1/frame 0xcb16c728 cache_lookup(d8b73b40,cb16ca80,cb16ca94,0,0,...) at cache_lookup+0x97b/frame 0xcb16c7a8 vfs_cache_lookup(cb16c848,c1862ecd,0,c1954fa0,d8b73b40,...) at vfs_cache_lookup+0xb5/frame 0xcb16c7f4 VOP_LOOKUP_APV(c193e9b4,cb16c848,cb16ca94,3cd,2,...) at VOP_LOOKUP_APV+0xf6/frame 0xcb16c820 lookup(cb16ca38,c1660292,1b3,17c,200246,...) at lookup+0x663/frame 0xcb16c890 namei(cb16ca38,0,4000144,0,284e144c,...) at namei+0x5f1/frame 0xcb16c928 kern_statat(dee53380,0,ffffff9c,284e144c,0,...) at kern_statat+0xae/frame 0xcb16cad8 sys_fstatat(dee53380,dee53600,c164301b,4,0,...) at sys_fstatat+0x49/frame 0xcb16cbe8 syscall(cb16cce8) at syscall+0x6ee/frame 0xcb16ccdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb16ccdc --- syscall (552, FreeBSD ELF32, sys_fstatat), eip = 0x28245243, esp = 0xbfbfe90c, ebp = 0xbfbfe998 --- Tracing command cron pid 17874 tid 100169 td 0xdc573380 sched_switch(dc573380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdab3f9a8 mi_switch(104,0,c1654159,22b,dc573380,...) at mi_switch+0x1f3/frame 0xdab3f9e8 sleepq_switch(dc573380,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xdab3fa1c sleepq_catch_signals(0,c1654159,178,c1b58654,dc573380,...) at sleepq_catch_signals+0x360/frame 0xdab3fa60 sleepq_wait_sig(d8af74f8,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xdab3fa84 _sleep(d8af74f8,d8af7688,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xdab3fad8 pipe_read(d8ae5498,dab3fbb8,d858c400,0,dc573380,...) at pipe_read+0x49b/frame 0xdab3fb18 dofileread(d8ae5498,dab3fbb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xdab3fb48 kern_readv(dc573380,5,dab3fbb8,dab3fbe8,2846f000,...) at kern_readv+0x93/frame 0xdab3fb98 sys_read(dc573380,dc573600,c164301b,4,0,...) at sys_read+0x54/frame 0xdab3fbe8 syscall(dab3fce8) at syscall+0x6ee/frame 0xdab3fcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdab3fcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282236df, esp = 0xbfbfe6a4, ebp = 0xbfbfe6b8 --- Tracing command dd pid 17832 tid 100335 td 0xd6354380 sched_switch(d6354380,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xcb1305b0 mi_switch(104,0,c1654159,22b,d6354380,...) at mi_switch+0x1f3/frame 0xcb1305ec sleepq_switch(d6354380,0,c1654159,2b3,d6354380,...) at sleepq_switch+0x110/frame 0xcb130620 sleepq_wait(cb6ffcec,5c,c165dfe1,0,0,...) at sleepq_wait+0x48/frame 0xcb130644 _sleep(cb6ffcec,cb4e6970,5c,c165dfe1,0,...) at _sleep+0x396/frame 0xcb130698 bufwait(cb6ffcec,0,0,0,0,...) at bufwait+0xa4/frame 0xcb1306d4 breadn_flags(d8b062d0,1a8f680,0,4000,0,...) at breadn_flags+0x1b0/frame 0xcb130704 ffs_vgetf(dc17b000,1a98c9,0,80000,cb130834,0) at ffs_vgetf+0x3ba/frame 0xcb130768 ffs_vget(dc17b000,1a98c9,0,80000,cb130834,...) at ffs_vget+0x37/frame 0xcb130790 ffs_valloc(f7edd2d0,8100,cb7f8300,cb130834,ffffffff,...) at ffs_valloc+0x67d/frame 0xcb130810 ufs_makeinode(cb130b68,cb130b7c,c169dba4,f7edd2d0,cb1309c8,...) at ufs_makeinode+0xb5/frame 0xcb130978 ufs_create(cb1309f8,c1862f83,f7edd2d0,cb1309ec,0,...) at ufs_create+0x38/frame 0xcb13099c VOP_CREATE_APV(c193e9b4,cb1309f8,cb130b7c,cb130a10,cb130a10,...) at VOP_CREATE_APV+0xf6/frame 0xcb1309c8 vn_open_cred(cb130b20,cb130bd8,100,0,cb7f8300,debd0818) at vn_open_cred+0x25c/frame 0xcb130aa0 vn_open(cb130b20,cb130bd8,100,debd0818,2844a003,...) at vn_open+0x3d/frame 0xcb130ac8 kern_openat(d6354380,ffffff9c,2844a003,0,603,1b6) at kern_openat+0x336/frame 0xcb130bc0 sys_openat(d6354380,d6354600,c164301b,4,c18578ef,...) at sys_openat+0x53/frame 0xcb130be8 syscall(cb130ce8) at syscall+0x6ee/frame 0xcb130cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb130cdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x28191f63, esp = 0xbfbfed24, ebp = 0xbfbfed48 --- Tracing command sh pid 17822 tid 100362 td 0xdeb8ea80 sched_switch(deb8ea80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xcb1b7948 mi_switch(104,0,c1654159,22b,deb8ea80,...) at mi_switch+0x1f3/frame 0xcb1b7988 sleepq_switch(deb8ea80,0,c1654159,1ca,6c,...) at sleepq_switch+0x110/frame 0xcb1b79bc sleepq_catch_signals(0,c1654159,178,c1b574d4,deb8ea80,...) at sleepq_catch_signals+0x360/frame 0xcb1b7a00 sleepq_wait_sig(dcf8f6b0,6c,c16584d2,100,0,...) at sleepq_wait_sig+0x14/frame 0xcb1b7a24 _sleep(dcf8f6b0,dcf8f758,16c,c16584d2,0,...) at _sleep+0x386/frame 0xcb1b7a78 kern_wait6(deb8ea80,7,0,0,cb1b7af4,...) at kern_wait6+0x4ae/frame 0xcb1b7ac8 sys_wait4(deb8ea80,deb8ed00,c164301b,4,0,...) at sys_wait4+0x87/frame 0xcb1b7be8 syscall(cb1b7ce8) at syscall+0x6ee/frame 0xcb1b7cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb1b7cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281d9eb3, esp = 0xbfbfeb40, ebp = 0xbfbfeb58 --- Tracing command cron pid 17821 tid 100351 td 0xdd9bba80 sched_switch(dd9bba80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xcb1809a8 mi_switch(104,0,c1654159,22b,dd9bba80,...) at mi_switch+0x1f3/frame 0xcb1809e8 sleepq_switch(dd9bba80,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xcb180a1c sleepq_catch_signals(0,c1654159,178,c1b59994,dd9bba80,...) at sleepq_catch_signals+0x360/frame 0xcb180a60 sleepq_wait_sig(d8af71a8,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xcb180a84 _sleep(d8af71a8,d8af7338,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xcb180ad8 pipe_read(d8afb540,cb180bb8,d858c400,0,dd9bba80,...) at pipe_read+0x49b/frame 0xcb180b18 dofileread(d8afb540,cb180bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xcb180b48 kern_readv(dd9bba80,5,cb180bb8,cb180be8,2846f000,...) at kern_readv+0x93/frame 0xcb180b98 sys_read(dd9bba80,dd9bbd00,c164301b,4,0,...) at sys_read+0x54/frame 0xcb180be8 syscall(cb180ce8) at syscall+0x6ee/frame 0xcb180cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb180cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282236df, esp = 0xbfbfe6a4, ebp = 0xbfbfe6b8 --- Tracing command rsync pid 17715 tid 100202 td 0xdc80e000 sched_switch(dc80e000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdabfb890 mi_switch(104,0,c1654159,22b,dc80e000,...) at mi_switch+0x1f3/frame 0xdabfb8d0 sleepq_switch(dc80e000,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdabfb904 sleepq_catch_signals(8,c1648c33,cb,dc80e000,dc80e000,...) at sleepq_catch_signals+0x360/frame 0xdabfb948 sleepq_timedwait_sig(d85f1164,0,dabfb9ac,c0000000,3,...) at sleepq_timedwait_sig+0x17/frame 0xdabfb988 _cv_timedwait_sig_sbt(d85f1164,d85f1150,9b0ea067,9da8,c0000000,...) at _cv_timedwait_sig_sbt+0x24a/frame 0xdabfb9d0 seltdwait(9da8,c0000000,3,dc80e000,0,...) at seltdwait+0x82/frame 0xdabfba00 kern_select(dc80e000,5,bfbfc420,bfbfc4a0,bfbfc520,...) at kern_select+0x876/frame 0xdabfbba0 sys_select(dc80e000,dc80e280,c164301b,4,c18578ef,...) at sys_select+0x68/frame 0xdabfbbe8 syscall(dabfbce8) at syscall+0x6ee/frame 0xdabfbcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdabfbcdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x283526cf, esp = 0xbfbfc3a4, ebp = 0xbfbfc3c8 --- Tracing command sh pid 17652 tid 100103 td 0xd8315000 sched_switch(d8315000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdbea7758 mi_switch(104,0,c1654159,22b,d8315000,...) at mi_switch+0x1f3/frame 0xdbea7798 sleepq_switch(d8315000,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xdbea77cc sleepq_wait(c1b5b780,0,dbea7810,1,0,...) at sleepq_wait+0x48/frame 0xdbea77f0 _cv_wait(c1b5b780,c1b5b740,c1655993,362,d8b09680,...) at _cv_wait+0x21f/frame 0xdbea7834 vmem_xalloc(c1b5b740,400000,0,0,0,...) at vmem_xalloc+0x1df/frame 0xdbea7898 vmem_alloc(c1b5b740,400000,2002,dbea78e8,0,...) at vmem_alloc+0xcc/frame 0xdbea78d0 vmem_xalloc(c2381000,1000,0,0,0,...) at vmem_xalloc+0x417/frame 0xdbea7934 vmem_alloc(c2381000,1000,2102,dbea7988,c169eb97,...) at vmem_alloc+0xcc/frame 0xdbea796c kmem_malloc_domain(0,1000,102) at kmem_malloc_domain+0x44/frame 0xdbea7998 page_alloc(c237c640,1000,0,dbea79e3,102,...) at page_alloc+0x26/frame 0xdbea79b0 keg_alloc_slab(0,2,c169eb97,94c,c6db8a00,...) at keg_alloc_slab+0xf6/frame 0xdbea79f8 keg_fetch_slab(ffffffff,2,c169eb97,9ae,0,...) at keg_fetch_slab+0x10e/frame 0xdbea7a50 zone_fetch_slab(c237c640,0,ffffffff,2,c193f87c,...) at zone_fetch_slab+0x61/frame 0xdbea7a74 zone_import(c237c640,f9cc500c,7d,ffffffff,2,...) at zone_import+0x3b/frame 0xdbea7aac uma_zalloc_arg(c237c640,0,2,cb8,2851e000,...) at uma_zalloc_arg+0x357/frame 0xdbea7ae8 vmspace_fork(d8b0963c,dbea7b80,2,c1b480c0,200246,...) at vmspace_fork+0x64c/frame 0xdbea7b30 fork1(d8315000,dbea7bc0,0,0,14,...) at fork1+0x587/frame 0xdbea7ba8 sys_fork(d8315000,d8315280,c164301b,4,c1643981,...) at sys_fork+0x55/frame 0xdbea7be8 syscall(dbea7ce8) at syscall+0x6ee/frame 0xdbea7cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdbea7cdc --- syscall (2, FreeBSD ELF32, sys_fork), eip = 0x281d9f93, esp = 0xbfbfe904, ebp = 0xbfbfe90c --- Tracing command rsync pid 17648 tid 100243 td 0xdc810a80 sched_switch(dc810a80,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xd4a54640 mi_switch(104,0,c1654159,22b,dc810a80,...) at mi_switch+0x1f3/frame 0xd4a5467c sleepq_switch(dc810a80,0,c1654159,2b3,cb62e4f4,...) at sleepq_switch+0x110/frame 0xd4a546b0 sleepq_wait(cb62e4f4,60,c165dea7,4,0,...) at sleepq_wait+0x48/frame 0xd4a546d4 sleeplk(f9419660,c165dea7,60,0,0,...) at sleeplk+0x1a0/frame 0xd4a54718 __lockmgr_args(cb62e4f4,81900,f9419660,c165dea7,60,...) at __lockmgr_args+0x9ba/frame 0xd4a54788 getblk(f94195a0,63,0,4000,0,...) at getblk+0x136/frame 0xd4a547e0 cluster_read(f94195a0,1274f08,0,63,0,...) at cluster_read+0xf6/frame 0xd4a54878 ffs_read(d4a54988,c18632a3,c1662fd6,c1954fa0,f94195a0,...) at ffs_read+0x2c4/frame 0xd4a5492c VOP_READ_APV(c193e9b4,d4a54988,f94195a0,323,d4a54bc0,...) at VOP_READ_APV+0xf6/frame 0xd4a54958 vn_read(d8ae0508,d4a54bb8,ff577500,1,dc810a80,...) at vn_read+0x22d/frame 0xd4a549b8 vn_io_fault_doio(dc810a80,0,c1654159,126,dc810b4c,...) at vn_io_fault_doio+0x83/frame 0xd4a54a00 vn_io_fault1(dc810a80,17ec00,0,1be000,0,...) at vn_io_fault1+0x165/frame 0xd4a54ac8 vn_io_fault(d8ae0508,d4a54bb8,ff577500,0,dc810a80,...) at vn_io_fault+0x1e7/frame 0xd4a54b18 dofileread(d8ae0508,d4a54bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xd4a54b48 kern_readv(dc810a80,0,d4a54bb8,d4a54be8,286f3040,...) at kern_readv+0x93/frame 0xd4a54b98 sys_read(dc810a80,dc810d00,c164301b,4,c18578ef,...) at sys_read+0x54/frame 0xd4a54be8 syscall(d4a54ce8) at syscall+0x6ee/frame 0xd4a54cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd4a54cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x283526df, esp = 0xbfbfcd54, ebp = 0xbfbfcd68 --- Tracing command sshd pid 17560 tid 100349 td 0xd85ed700 sched_switch(d85ed700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xcb1768b0 mi_switch(104,0,c1654159,22b,d85ed700,...) at mi_switch+0x1f3/frame 0xcb1768f0 sleepq_switch(d85ed700,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xcb176924 sleepq_catch_signals(cb17698c,c0c549a0,dc4de2e0,0,0,...) at sleepq_catch_signals+0x360/frame 0xcb176968 sleepq_wait_sig(dc4de2e4,0,cb1769ac,101,0,...) at sleepq_wait_sig+0x14/frame 0xcb17698c _cv_wait_sig(dc4de2e4,dc4de2d0,c1657937,73d,5cf,...) at _cv_wait_sig+0x21f/frame 0xcb1769d0 seltdwait(ffffffff,0,0,d85ed700,0,...) at seltdwait+0xbb/frame 0xcb176a00 kern_select(d85ed700,c,280c30a8,280c30d0,0,...) at kern_select+0x876/frame 0xcb176ba0 sys_select(d85ed700,d85ed980,c164301b,4,c18578ef,...) at sys_select+0x68/frame 0xcb176be8 syscall(cb176ce8) at syscall+0x6ee/frame 0xcb176cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb176cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2855b6cf, esp = 0xbfbfa76c, ebp = 0xbfbfa790 --- Tracing command sshd pid 17123 tid 100273 td 0xdec03380 sched_switch(dec03380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd4b078e0 mi_switch(104,0,c1654159,22b,dec03380,...) at mi_switch+0x1f3/frame 0xd4b07920 sleepq_switch(dec03380,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xd4b07954 sleepq_catch_signals(d4b079bc,c0c549a0,d8438f20,0,0,...) at sleepq_catch_signals+0x360/frame 0xd4b07998 sleepq_wait_sig(d8438f24,0,d4b079dc,101,0,...) at sleepq_wait_sig+0x14/frame 0xd4b079bc _cv_wait_sig(d8438f24,d8438f10,c1657937,73d,0,...) at _cv_wait_sig+0x21f/frame 0xd4b07a00 seltdwait(ffffffff,0,0,dec03380,0,...) at seltdwait+0xbb/frame 0xd4b07a30 kern_poll(dec03380,bfbfe7f0,1,0,0,...) at kern_poll+0x4ab/frame 0xd4b07bb0 sys_poll(dec03380,dec03600,c164301b,4,c18578ef,...) at sys_poll+0x67/frame 0xd4b07be8 syscall(d4b07ce8) at syscall+0x6ee/frame 0xd4b07cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd4b07cdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284ff16b, esp = 0xbfbfe77c, ebp = 0xbfbfe798 --- Tracing command cat pid 89379 tid 100179 td 0xd8313a80 sched_switch(d8313a80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdab6f9a8 mi_switch(104,0,c1654159,22b,d8313a80,...) at mi_switch+0x1f3/frame 0xdab6f9e8 sleepq_switch(d8313a80,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xdab6fa1c sleepq_catch_signals(0,c1654159,178,c1b59194,d8313a80,...) at sleepq_catch_signals+0x360/frame 0xdab6fa60 sleepq_wait_sig(d8b611a8,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xdab6fa84 _sleep(d8b611a8,d8b61338,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xdab6fad8 pipe_read(debc25e8,dab6fbb8,cb7f8d00,0,d8313a80,...) at pipe_read+0x49b/frame 0xdab6fb18 dofileread(debc25e8,dab6fbb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xdab6fb48 kern_readv(d8313a80,0,dab6fbb8,dab6fbe8,28446000,...) at kern_readv+0x93/frame 0xdab6fb98 sys_read(d8313a80,d8313d00,c164301b,4,c18578ef,...) at sys_read+0x54/frame 0xdab6fbe8 syscall(dab6fce8) at syscall+0x6ee/frame 0xdab6fcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdab6fcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281fd6df, esp = 0xbfbfe8bc, ebp = 0xbfbfe8d0 --- Tracing command sh pid 89377 tid 100218 td 0xdeb20380 sched_switch(deb20380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd49c8948 mi_switch(104,0,c1654159,22b,deb20380,...) at mi_switch+0x1f3/frame 0xd49c8988 sleepq_switch(deb20380,0,c1654159,1ca,6c,...) at sleepq_switch+0x110/frame 0xd49c89bc sleepq_catch_signals(0,c1654159,178,c1b56b54,deb20380,...) at sleepq_catch_signals+0x360/frame 0xd49c8a00 sleepq_wait_sig(de692000,6c,c16584d2,100,0,...) at sleepq_wait_sig+0x14/frame 0xd49c8a24 _sleep(de692000,de6920a8,16c,c16584d2,0,...) at _sleep+0x386/frame 0xd49c8a78 kern_wait6(deb20380,7,0,0,d49c8af4,...) at kern_wait6+0x4ae/frame 0xd49c8ac8 sys_wait4(deb20380,deb20600,c164301b,4,0,...) at sys_wait4+0x87/frame 0xd49c8be8 syscall(d49c8ce8) at syscall+0x6ee/frame 0xd49c8cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd49c8cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281d9eb3, esp = 0xbfbfe7f0, ebp = 0xbfbfe808 --- Tracing command find pid 89376 tid 100332 td 0xdd9bb000 sched_switch(dd9bb000,0,104,188,c1b48780,...) at sched_switch+0x503/frame 0xcb1212c0 mi_switch(104,0,c1654159,22b,dd9bb000,...) at mi_switch+0x1f3/frame 0xcb1212fc sleepq_switch(dd9bb000,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xcb121330 sleepq_wait(c1b5b780,0,cb121374,1,0,...) at sleepq_wait+0x48/frame 0xcb121354 _cv_wait(c1b5b780,c1b5b740,c1655993,362,f9c0719c,...) at _cv_wait+0x21f/frame 0xcb121398 vmem_xalloc(c1b5b740,400000,0,0,0,...) at vmem_xalloc+0x1df/frame 0xcb1213fc vmem_alloc(c1b5b740,400000,2002,cb12144c,0,...) at vmem_alloc+0xcc/frame 0xcb121434 vmem_xalloc(c2381000,1000,0,0,0,...) at vmem_xalloc+0x417/frame 0xcb121498 vmem_alloc(c2381000,1000,2102,cb1214ec,feccf000,...) at vmem_alloc+0xcc/frame 0xcb1214d0 kmem_malloc_domain(0,1000,102) at kmem_malloc_domain+0x44/frame 0xcb1214fc page_alloc(d8325a00,1000,0,cb121547,102,...) at page_alloc+0x26/frame 0xcb121514 keg_alloc_slab(0,2,c169eb97,94c,c6db8a00,...) at keg_alloc_slab+0xf6/frame 0xcb12155c keg_fetch_slab(ffffffff,2,c169eb97,9ae,0,...) at keg_fetch_slab+0x10e/frame 0xcb1215b4 zone_fetch_slab(d8325a00,0,ffffffff,2,c193f84c,...) at zone_fetch_slab+0x61/frame 0xcb1215d8 zone_import(d8325a00,f6ce864c,d,ffffffff,2,...) at zone_import+0x3b/frame 0xcb121610 uma_zalloc_arg(d8325a00,0,2,18f,f80e9318,...) at uma_zalloc_arg+0x357/frame 0xcb12164c ufsdirhash_build(dcb97910,c169d442,0,dd9bb000,cb1216cc,...) at ufsdirhash_build+0x633/frame 0xcb1216a8 ufs_lookup_ino(f9c07168,cb121a80,cb121a94,0) at ufs_lookup_ino+0x1bb/frame 0xcb121764 ufs_lookup(cb1217c8,c1862f2e,cb1217e0,c0,c0d386b8,...) at ufs_lookup+0x2a/frame 0xcb12177c VOP_CACHEDLOOKUP_APV(c193e9b4,cb1217c8,cb121a94,0,0,...) at VOP_CACHEDLOOKUP_APV+0xf6/frame 0xcb1217a8 vfs_cache_lookup(cb121848,c1862ecd,c1660292,c1954fa0,f9c07168,...) at vfs_cache_lookup+0xe5/frame 0xcb1217f4 VOP_LOOKUP_APV(c193e9b4,cb121848,cb121a94,29f,2,...) at VOP_LOOKUP_APV+0xf6/frame 0xcb121820 lookup(cb121a38,c1660292,1b3,17c,dd9bb000,...) at lookup+0x663/frame 0xcb121890 namei(cb121a38,0,4000104,0,284fb034,...) at namei+0x5f1/frame 0xcb121928 kern_statat(dd9bb000,200,ffffff9c,284fb034,0,...) at kern_statat+0xae/frame 0xcb121ad8 sys_fstatat(dd9bb000,dd9bb280,c164301b,4,c18578ef,...) at sys_fstatat+0x49/frame 0xcb121be8 syscall(cb121ce8) at syscall+0x6ee/frame 0xcb121cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb121cdc --- syscall (552, FreeBSD ELF32, sys_fstatat), eip = 0x28202243, esp = 0xbfbfe9bc, ebp = 0xbfbfea50 --- Tracing command sh pid 89372 tid 100192 td 0xdc80fa80 sched_switch(dc80fa80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdabbb948 mi_switch(104,0,c1654159,22b,dc80fa80,...) at mi_switch+0x1f3/frame 0xdabbb988 sleepq_switch(dc80fa80,0,c1654159,1ca,6c,...) at sleepq_switch+0x110/frame 0xdabbb9bc sleepq_catch_signals(0,c1654159,178,c1b580d4,dc80fa80,...) at sleepq_catch_signals+0x360/frame 0xdabbba00 sleepq_wait_sig(d899c6b0,6c,c16584d2,100,0,...) at sleepq_wait_sig+0x14/frame 0xdabbba24 _sleep(d899c6b0,d899c758,16c,c16584d2,0,...) at _sleep+0x386/frame 0xdabbba78 kern_wait6(dc80fa80,7,0,0,dabbbaf4,...) at kern_wait6+0x4ae/frame 0xdabbbac8 sys_wait4(dc80fa80,dc80fd00,c164301b,4,c18578ef,...) at sys_wait4+0x87/frame 0xdabbbbe8 syscall(dabbbce8) at syscall+0x6ee/frame 0xdabbbcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdabbbcdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281d9eb3, esp = 0xbfbfeb28, ebp = 0xbfbfeb40 --- Tracing command mail pid 89371 tid 100410 td 0xdef2e700 sched_switch(def2e700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xcb2c49a8 mi_switch(104,0,c1654159,22b,def2e700,...) at mi_switch+0x1f3/frame 0xcb2c49e8 sleepq_switch(def2e700,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xcb2c4a1c sleepq_catch_signals(0,c1654159,178,c1b56754,def2e700,...) at sleepq_catch_signals+0x360/frame 0xcb2c4a60 sleepq_wait_sig(d8b61000,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xcb2c4a84 _sleep(d8b61000,d8b61190,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xcb2c4ad8 pipe_read(debc25b0,cb2c4bb8,cb7f8d00,0,def2e700,...) at pipe_read+0x49b/frame 0xcb2c4b18 dofileread(debc25b0,cb2c4bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xcb2c4b48 kern_readv(def2e700,0,cb2c4bb8,cb2c4be8,28464000,...) at kern_readv+0x93/frame 0xcb2c4b98 sys_read(def2e700,def2e980,c164301b,4,cb2c4c48,...) at sys_read+0x54/frame 0xcb2c4be8 syscall(cb2c4ce8) at syscall+0x6ee/frame 0xcb2c4cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb2c4cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2820f6df, esp = 0xbfbfdf20, ebp = 0xbfbfdf34 --- Tracing command sh pid 89370 tid 100352 td 0xdee54700 sched_switch(dee54700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xcb185948 mi_switch(104,0,c1654159,22b,dee54700,...) at mi_switch+0x1f3/frame 0xcb185988 sleepq_switch(dee54700,0,c1654159,1ca,6c,...) at sleepq_switch+0x110/frame 0xcb1859bc sleepq_catch_signals(0,c1654159,178,c1b58f54,dee54700,...) at sleepq_catch_signals+0x360/frame 0xcb185a00 sleepq_wait_sig(ddb7b000,6c,c16584d2,100,0,...) at sleepq_wait_sig+0x14/frame 0xcb185a24 _sleep(ddb7b000,ddb7b0a8,16c,c16584d2,0,...) at _sleep+0x386/frame 0xcb185a78 kern_wait6(dee54700,7,0,0,cb185af4,...) at kern_wait6+0x4ae/frame 0xcb185ac8 sys_wait4(dee54700,dee54980,c164301b,4,c18578ef,...) at sys_wait4+0x87/frame 0xcb185be8 syscall(cb185ce8) at syscall+0x6ee/frame 0xcb185cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb185cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281d9eb3, esp = 0xbfbfe898, ebp = 0xbfbfe8b0 --- Tracing command sh pid 89362 tid 100404 td 0xcb791380 sched_switch(cb791380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xcb2a6948 mi_switch(104,0,c1654159,22b,cb791380,...) at mi_switch+0x1f3/frame 0xcb2a6988 sleepq_switch(cb791380,0,c1654159,1ca,6c,...) at sleepq_switch+0x110/frame 0xcb2a69bc sleepq_catch_signals(0,c1654159,178,c1b587d4,cb791380,...) at sleepq_catch_signals+0x360/frame 0xcb2a6a00 sleepq_wait_sig(dd809a08,6c,c16584d2,100,0,...) at sleepq_wait_sig+0x14/frame 0xcb2a6a24 _sleep(dd809a08,dd809ab0,16c,c16584d2,0,...) at _sleep+0x386/frame 0xcb2a6a78 kern_wait6(cb791380,7,0,0,cb2a6af4,...) at kern_wait6+0x4ae/frame 0xcb2a6ac8 sys_wait4(cb791380,cb791600,c164301b,4,0,...) at sys_wait4+0x87/frame 0xcb2a6be8 syscall(cb2a6ce8) at syscall+0x6ee/frame 0xcb2a6cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb2a6cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281d9eb3, esp = 0xbfbfeba0, ebp = 0xbfbfebb8 --- Tracing command lockf pid 89361 tid 100333 td 0xd6354a80 sched_switch(d6354a80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xcb126948 mi_switch(104,0,c1654159,22b,d6354a80,...) at mi_switch+0x1f3/frame 0xcb126988 sleepq_switch(d6354a80,0,c1654159,1ca,6c,...) at sleepq_switch+0x110/frame 0xcb1269bc sleepq_catch_signals(0,c1654159,178,c1b56cd4,d6354a80,...) at sleepq_catch_signals+0x360/frame 0xcb126a00 sleepq_wait_sig(dd1296b0,6c,c16584d2,100,0,...) at sleepq_wait_sig+0x14/frame 0xcb126a24 _sleep(dd1296b0,dd129758,16c,c16584d2,0,...) at _sleep+0x386/frame 0xcb126a78 kern_wait6(d6354a80,0,15d12,0,cb126af4,...) at kern_wait6+0x4ae/frame 0xcb126ac8 sys_wait4(d6354a80,d6354d00,c164301b,4,c18578ef,...) at sys_wait4+0x87/frame 0xcb126be8 syscall(cb126ce8) at syscall+0x6ee/frame 0xcb126cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb126cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2818eeb3, esp = 0xbfbfeca8, ebp = 0xbfbfecc0 --- Tracing command sh pid 89359 tid 100244 td 0xdc810700 sched_switch(dc810700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd4a59948 mi_switch(104,0,c1654159,22b,dc810700,...) at mi_switch+0x1f3/frame 0xd4a59988 sleepq_switch(dc810700,0,c1654159,1ca,6c,...) at sleepq_switch+0x110/frame 0xd4a599bc sleepq_catch_signals(0,c1654159,178,c1b59614,dc810700,...) at sleepq_catch_signals+0x360/frame 0xd4a59a00 sleepq_wait_sig(deb89358,6c,c16584d2,100,0,...) at sleepq_wait_sig+0x14/frame 0xd4a59a24 _sleep(deb89358,deb89400,16c,c16584d2,0,...) at _sleep+0x386/frame 0xd4a59a78 kern_wait6(dc810700,7,0,0,d4a59af4,...) at kern_wait6+0x4ae/frame 0xd4a59ac8 sys_wait4(dc810700,dc810980,c164301b,4,0,...) at sys_wait4+0x87/frame 0xd4a59be8 syscall(d4a59ce8) at syscall+0x6ee/frame 0xd4a59cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd4a59cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281d9eb3, esp = 0xbfbfe968, ebp = 0xbfbfe980 --- Tracing command sh pid 89358 tid 100314 td 0xdc433a80 sched_switch(dc433a80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xcb0c7948 mi_switch(104,0,c1654159,22b,dc433a80,...) at mi_switch+0x1f3/frame 0xcb0c7988 sleepq_switch(dc433a80,0,c1654159,1ca,6c,...) at sleepq_switch+0x110/frame 0xcb0c79bc sleepq_catch_signals(0,c1654159,178,c1b583d4,dc433a80,...) at sleepq_catch_signals+0x360/frame 0xcb0c7a00 sleepq_wait_sig(dc478a08,6c,c16584d2,100,0,...) at sleepq_wait_sig+0x14/frame 0xcb0c7a24 _sleep(dc478a08,dc478ab0,16c,c16584d2,0,...) at _sleep+0x386/frame 0xcb0c7a78 kern_wait6(dc433a80,7,0,0,cb0c7af4,...) at kern_wait6+0x4ae/frame 0xcb0c7ac8 sys_wait4(dc433a80,dc433d00,c164301b,4,0,...) at sys_wait4+0x87/frame 0xcb0c7be8 syscall(cb0c7ce8) at syscall+0x6ee/frame 0xcb0c7cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb0c7cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281d9eb3, esp = 0xbfbfea58, ebp = 0xbfbfea70 --- Tracing command mail pid 89016 tid 100373 td 0xdd993700 sched_switch(dd993700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xcb1f39a8 mi_switch(104,0,c1654159,22b,dd993700,...) at mi_switch+0x1f3/frame 0xcb1f39e8 sleepq_switch(dd993700,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xcb1f3a1c sleepq_catch_signals(0,c1654159,178,c1b57e94,dd993700,...) at sleepq_catch_signals+0x360/frame 0xcb1f3a60 sleepq_wait_sig(f5522d40,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xcb1f3a84 _sleep(f5522d40,f5522ed0,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xcb1f3ad8 pipe_read(d8af9428,cb1f3bb8,cb7f8d00,0,dd993700,...) at pipe_read+0x49b/frame 0xcb1f3b18 dofileread(d8af9428,cb1f3bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xcb1f3b48 kern_readv(dd993700,0,cb1f3bb8,cb1f3be8,28464000,...) at kern_readv+0x93/frame 0xcb1f3b98 sys_read(dd993700,dd993980,c164301b,4,c18578ef,...) at sys_read+0x54/frame 0xcb1f3be8 syscall(cb1f3ce8) at syscall+0x6ee/frame 0xcb1f3cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb1f3cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2820f6df, esp = 0xbfbfdf50, ebp = 0xbfbfdf64 --- Tracing command sh pid 89014 tid 100361 td 0xd6353000 sched_switch(d6353000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xcb1b2948 mi_switch(104,0,c1654159,22b,d6353000,...) at mi_switch+0x1f3/frame 0xcb1b2988 sleepq_switch(d6353000,0,c1654159,1ca,6c,...) at sleepq_switch+0x110/frame 0xcb1b29bc sleepq_catch_signals(0,c1654159,178,c1b568d4,d6353000,...) at sleepq_catch_signals+0x360/frame 0xcb1b2a00 sleepq_wait_sig(dd80a6b0,6c,c16584d2,100,0,...) at sleepq_wait_sig+0x14/frame 0xcb1b2a24 _sleep(dd80a6b0,dd80a758,16c,c16584d2,0,...) at _sleep+0x386/frame 0xcb1b2a78 kern_wait6(d6353000,7,0,0,cb1b2af4,...) at kern_wait6+0x4ae/frame 0xcb1b2ac8 sys_wait4(d6353000,d6353280,c164301b,4,0,...) at sys_wait4+0x87/frame 0xcb1b2be8 syscall(cb1b2ce8) at syscall+0x6ee/frame 0xcb1b2cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb1b2cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281d9eb3, esp = 0xbfbfe918, ebp = 0xbfbfe930 --- Tracing command sh pid 88974 tid 100408 td 0xcb793380 sched_switch(cb793380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xcb2ba948 mi_switch(104,0,c1654159,22b,cb793380,...) at mi_switch+0x1f3/frame 0xcb2ba988 sleepq_switch(cb793380,0,c1654159,1ca,6c,...) at sleepq_switch+0x110/frame 0xcb2ba9bc sleepq_catch_signals(0,c1654159,178,c1b597d4,cb793380,...) at sleepq_catch_signals+0x360/frame 0xcb2baa00 sleepq_wait_sig(dc6cda08,6c,c16584d2,100,0,...) at sleepq_wait_sig+0x14/frame 0xcb2baa24 _sleep(dc6cda08,dc6cdab0,16c,c16584d2,0,...) at _sleep+0x386/frame 0xcb2baa78 kern_wait6(cb793380,7,0,0,cb2baaf4,...) at kern_wait6+0x4ae/frame 0xcb2baac8 sys_wait4(cb793380,cb793600,c164301b,4,0,...) at sys_wait4+0x87/frame 0xcb2babe8 syscall(cb2bace8) at syscall+0x6ee/frame 0xcb2bacdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb2bacdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281d9eb3, esp = 0xbfbfec20, ebp = 0xbfbfec38 --- Tracing command lockf pid 88967 tid 100242 td 0xdeb09000 sched_switch(deb09000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd4a4f948 mi_switch(104,0,c1654159,22b,deb09000,...) at mi_switch+0x1f3/frame 0xd4a4f988 sleepq_switch(deb09000,0,c1654159,1ca,6c,...) at sleepq_switch+0x110/frame 0xd4a4f9bc sleepq_catch_signals(0,c1654159,178,c1b587d4,deb09000,...) at sleepq_catch_signals+0x360/frame 0xd4a4fa00 sleepq_wait_sig(deb89a08,6c,c16584d2,100,0,...) at sleepq_wait_sig+0x14/frame 0xd4a4fa24 _sleep(deb89a08,deb89ab0,16c,c16584d2,0,...) at _sleep+0x386/frame 0xd4a4fa78 kern_wait6(deb09000,0,15b8e,0,d4a4faf4,...) at kern_wait6+0x4ae/frame 0xd4a4fac8 sys_wait4(deb09000,deb09280,c164301b,4,d4a4fc48,...) at sys_wait4+0x87/frame 0xd4a4fbe8 syscall(d4a4fce8) at syscall+0x6ee/frame 0xd4a4fcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd4a4fcdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2818eeb3, esp = 0xbfbfed28, ebp = 0xbfbfed40 --- Tracing command sh pid 88947 tid 100423 td 0xdebed380 sched_switch(debed380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xcb305948 mi_switch(104,0,c1654159,22b,debed380,...) at mi_switch+0x1f3/frame 0xcb305988 sleepq_switch(debed380,0,c1654159,1ca,6c,...) at sleepq_switch+0x110/frame 0xcb3059bc sleepq_catch_signals(0,c1654159,178,c1b56e14,debed380,...) at sleepq_catch_signals+0x360/frame 0xcb305a00 sleepq_wait_sig(dc547358,6c,c16584d2,100,0,...) at sleepq_wait_sig+0x14/frame 0xcb305a24 _sleep(dc547358,dc547400,16c,c16584d2,0,...) at _sleep+0x386/frame 0xcb305a78 kern_wait6(debed380,7,0,0,cb305af4,...) at kern_wait6+0x4ae/frame 0xcb305ac8 sys_wait4(debed380,debed600,c164301b,4,0,...) at sys_wait4+0x87/frame 0xcb305be8 syscall(cb305ce8) at syscall+0x6ee/frame 0xcb305cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb305cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281d9eb3, esp = 0xbfbfe9f8, ebp = 0xbfbfea10 --- Tracing command cron pid 88945 tid 100121 td 0xd8421a80 sched_switch(d8421a80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdbf2b9a8 mi_switch(104,0,c1654159,22b,d8421a80,...) at mi_switch+0x1f3/frame 0xdbf2b9e8 sleepq_switch(d8421a80,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xdbf2ba1c sleepq_catch_signals(0,c1654159,178,c1b57b54,d8421a80,...) at sleepq_catch_signals+0x360/frame 0xdbf2ba60 sleepq_wait_sig(dca76000,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xdbf2ba84 _sleep(dca76000,dca76190,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xdbf2bad8 pipe_read(d8ae79a0,dbf2bbb8,d858c400,0,d8421a80,...) at pipe_read+0x49b/frame 0xdbf2bb18 dofileread(d8ae79a0,dbf2bbb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xdbf2bb48 kern_readv(d8421a80,5,dbf2bbb8,dbf2bbe8,28470000,...) at kern_readv+0x93/frame 0xdbf2bb98 sys_read(d8421a80,d8421d00,c164301b,4,0,...) at sys_read+0x54/frame 0xdbf2bbe8 syscall(dbf2bce8) at syscall+0x6ee/frame 0xdbf2bcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdbf2bcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282236df, esp = 0xbfbfe6a4, ebp = 0xbfbfe6b8 --- Tracing command gmirror pid 67385 tid 100409 td 0xdeb74380 sched_switch(deb74380,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xcb2bf8e0 mi_switch(104,0,c1654159,22b,deb74380,...) at mi_switch+0x1f3/frame 0xcb2bf91c sleepq_switch(deb74380,0,c1654159,2d6,9d9a,...) at sleepq_switch+0x110/frame 0xcb2bf950 sleepq_timedwait(f95f2c00,5c,0,0,0,...) at sleepq_timedwait+0x53/frame 0xcb2bf98c _sleep(f95f2c00,c1b37b98,5c,c163507a,fffffed8,...) at _sleep+0x332/frame 0xcb2bf9e0 g_waitfor_event(c0bb6820,feb91e00,2,0,c1901d70,...) at g_waitfor_event+0x113/frame 0xcb2bfa20 sysctl_kern_geom_confxml(c1901d70,0,0,0,cb2bfaf8,...) at sysctl_kern_geom_confxml+0x52/frame 0xcb2bfa44 sysctl_root_handler_locked(0,0,cb2bfaf8,cb2bfaa0,cb2bfaf8,...) at sysctl_root_handler_locked+0xac/frame 0xcb2bfa70 sysctl_root(0,cb2bfaf8,4,0,d6102558,...) at sysctl_root+0x255/frame 0xcb2bfad0 userland_sysctl(deb74380,cb2bfb74,3,0,bfbfbe4c,...) at userland_sysctl+0x190/frame 0xcb2bfb44 sys___sysctl(deb74380,deb74600,c164301b,4,c18578ef,...) at sys___sysctl+0x8e/frame 0xcb2bfbe8 syscall(cb2bfce8) at syscall+0x6ee/frame 0xcb2bfcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb2bfcdc --- syscall (202, FreeBSD ELF32, sys___sysctl), eip = 0x28218cdf, esp = 0xbfbfbdf4, ebp = 0xbfbfbe24 --- Tracing command gmirror pid 67384 tid 100173 td 0xdc573000 sched_switch(dc573000,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xdab54810 mi_switch(104,0,c1654159,22b,dc573000,...) at mi_switch+0x1f3/frame 0xdab5484c sleepq_switch(dc573000,0,c1654159,2d6,9d9b,...) at sleepq_switch+0x110/frame 0xdab54880 sleepq_timedwait(f52bb080,5c,0,0,0,...) at sleepq_timedwait+0x53/frame 0xdab548c0 _sleep(f52bb080,c1b37b98,5c,c163507a,fffffed8,...) at _sleep+0x332/frame 0xdab54914 g_waitfor_event(c0bb2160,dab54b50,2,0,dc64b000,...) at g_waitfor_event+0x113/frame 0xdab54954 g_ctl_ioctl(d61dae00,80244702,dab54b50,1,dc573000,...) at g_ctl_ioctl+0x524/frame 0xdab54984 giant_ioctl(d61dae00,80244702,dab54b50,1,dc573000,...) at giant_ioctl+0xf1/frame 0xdab549ac devfs_ioctl(dab54a38,c1863338,dab54b7c,c1910478,1,...) at devfs_ioctl+0x8c/frame 0xdab549e4 VOP_IOCTL_APV(c18fdbe0,dab54a38,c169eb97,eb8,c23908c0,...) at VOP_IOCTL_APV+0xf6/frame 0xdab54a10 vn_ioctl(d8aabc78,80244702,dab54b50,d636f600,dc573000,...) at vn_ioctl+0x11b/frame 0xdab54ac8 devfs_ioctl_f(d8aabc78,80244702,dab54b50,d636f600,dc573000,...) at devfs_ioctl_f+0x3d/frame 0xdab54af0 kern_ioctl(dc573000,3,80244702,dab54b50,200246,...) at kern_ioctl+0x2b9/frame 0xdab54b30 sys_ioctl(dc573000,dc573280,c164301b,4,c18578ef,...) at sys_ioctl+0x118/frame 0xdab54be8 syscall(dab54ce8) at syscall+0x6ee/frame 0xdab54cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdab54cdc --- syscall (54, FreeBSD ELF32, sys_ioctl), eip = 0x2821872f, esp = 0xbfbfd72c, ebp = 0xbfbfd74c --- Tracing command gmirror pid 67383 tid 100245 td 0xdc810380 sched_switch(dc810380,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xd4a5ea78 mi_switch(104,0,c1654159,22b,dc810380,...) at mi_switch+0x1f3/frame 0xd4a5eab4 sleepq_switch(dc810380,0,c1654159,2d6,9d9a,...) at sleepq_switch+0x110/frame 0xd4a5eae8 sleepq_timedwait(c1b37bac,74,0,0,0,...) at sleepq_timedwait+0x53/frame 0xd4a5eb24 _sleep(c1b37bac,c1b37b98,74,c1634fd4,333332f8,...) at _sleep+0x332/frame 0xd4a5eb78 g_waitidle(deb890b8,0,c1654d53,7f,c124f334,...) at g_waitidle+0xd7/frame 0xd4a5ebac userret(dc810380,d4a5ece8,c164301b,4,c18578ef,...) at userret+0x400/frame 0xd4a5ebe8 syscall(d4a5ece8) at syscall+0x345/frame 0xd4a5ecdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd4a5ecdc --- syscall (0, FreeBSD ELF32, nosys), eip = 0x2821872f, esp = 0xbfbfd71c, ebp = 0xbfbfd73c --- Tracing command g_mirror markj-mirr pid 67382 tid 100340 td 0xdc2e3700 sched_switch(dc2e3700,0,104,188,c1b49500,...) at sched_switch+0x503/frame 0xcb149b38 mi_switch(104,0,c1654159,22b,dc2e3700,...) at mi_switch+0x1f3/frame 0xcb149b74 sleepq_switch(dc2e3700,0,c1654159,2b3,dc2e3700,...) at sleepq_switch+0x110/frame 0xcb149ba8 sleepq_wait(de695600,5c,df439545,0,0,...) at sleepq_wait+0x48/frame 0xcb149bcc _sleep(de695600,de695650,25c,df439545,0,...) at _sleep+0x396/frame 0xcb149c20 g_mirror_worker(de695600,cb149ce8,c16435dc,407,0,...) at g_mirror_worker+0xd4f/frame 0xcb149cac fork_exit(df42e9c0,de695600,cb149ce8) at fork_exit+0x7e/frame 0xcb149cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xcb149cd4 --- trap 0, eip = 0, esp = 0xcb149d20, ebp = 0 --- Tracing command sh pid 62487 tid 100411 td 0xdef2e380 sched_switch(def2e380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xcb2c9948 mi_switch(104,0,c1654159,22b,def2e380,...) at mi_switch+0x1f3/frame 0xcb2c9988 sleepq_switch(def2e380,0,c1654159,1ca,6c,...) at sleepq_switch+0x110/frame 0xcb2c99bc sleepq_catch_signals(0,c1654159,178,c1b59754,def2e380,...) at sleepq_catch_signals+0x360/frame 0xcb2c9a00 sleepq_wait_sig(dc6cd000,6c,c16584d2,100,0,...) at sleepq_wait_sig+0x14/frame 0xcb2c9a24 _sleep(dc6cd000,dc6cd0a8,16c,c16584d2,0,...) at _sleep+0x386/frame 0xcb2c9a78 kern_wait6(def2e380,7,0,0,cb2c9af4,...) at kern_wait6+0x4ae/frame 0xcb2c9ac8 sys_wait4(def2e380,def2e600,c164301b,4,0,...) at sys_wait4+0x87/frame 0xcb2c9be8 syscall(cb2c9ce8) at syscall+0x6ee/frame 0xcb2c9cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb2c9cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281d9eb3, esp = 0xbfbfe3c0, ebp = 0xbfbfe3d8 --- Tracing command sh pid 62486 tid 100158 td 0xdc6ba700 sched_switch(dc6ba700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdaaf3948 mi_switch(104,0,c1654159,22b,dc6ba700,...) at mi_switch+0x1f3/frame 0xdaaf3988 sleepq_switch(dc6ba700,0,c1654159,1ca,6c,...) at sleepq_switch+0x110/frame 0xdaaf39bc sleepq_catch_signals(0,c1654159,178,c1b56e14,dc6ba700,...) at sleepq_catch_signals+0x360/frame 0xdaaf3a00 sleepq_wait_sig(dc6b7358,6c,c16584d2,100,0,...) at sleepq_wait_sig+0x14/frame 0xdaaf3a24 _sleep(dc6b7358,dc6b7400,16c,c16584d2,0,...) at _sleep+0x386/frame 0xdaaf3a78 kern_wait6(dc6ba700,7,0,0,daaf3af4,...) at kern_wait6+0x4ae/frame 0xdaaf3ac8 sys_wait4(dc6ba700,dc6ba980,c164301b,4,0,...) at sys_wait4+0x87/frame 0xdaaf3be8 syscall(daaf3ce8) at syscall+0x6ee/frame 0xdaaf3cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdaaf3cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281d9eb3, esp = 0xbfbfe428, ebp = 0xbfbfe440 --- Tracing command md11 pid 62315 tid 100255 td 0xdeb7e700 sched_switch(deb7e700,0,104,188,c1b480c0,...) at sched_switch+0x503/frame 0xd4a90b80 mi_switch(104,0,c1654159,22b,deb7e700,...) at mi_switch+0x1f3/frame 0xd4a90bbc sleepq_switch(deb7e700,0,c1654159,2b3,deb7e700,...) at sleepq_switch+0x110/frame 0xd4a90bf0 sleepq_wait(dcb7c000,5c,c136c00a,0,0,...) at sleepq_wait+0x48/frame 0xd4a90c14 _sleep(dcb7c000,dcb7c020,25c,c136c00a,0,...) at _sleep+0x396/frame 0xd4a90c68 md_kthread(dcb7c000,d4a90ce8,c16435dc,407,0,...) at md_kthread+0x22a/frame 0xd4a90cac fork_exit(c07f5e40,dcb7c000,d4a90ce8) at fork_exit+0x7e/frame 0xd4a90cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd4a90cd4 --- trap 0, eip = 0, esp = 0xd4a90d20, ebp = 0 --- Tracing command md10 pid 62259 tid 100424 td 0xdebed000 sched_switch(debed000,0,104,188,c1b480c0,...) at sched_switch+0x503/frame 0xcb30ab80 mi_switch(104,0,c1654159,22b,debed000,...) at mi_switch+0x1f3/frame 0xcb30abbc sleepq_switch(debed000,0,c1654159,2b3,debed000,...) at sleepq_switch+0x110/frame 0xcb30abf0 sleepq_wait(dcff8000,5c,c136c00a,0,0,...) at sleepq_wait+0x48/frame 0xcb30ac14 _sleep(dcff8000,dcff8020,25c,c136c00a,0,...) at _sleep+0x396/frame 0xcb30ac68 md_kthread(dcff8000,cb30ace8,c16435dc,407,0,...) at md_kthread+0x22a/frame 0xcb30acac fork_exit(c07f5e40,dcff8000,cb30ace8) at fork_exit+0x7e/frame 0xcb30acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xcb30acd4 --- trap 0, eip = 0, esp = 0xcb30ad20, ebp = 0 --- Tracing command sh pid 61564 tid 100168 td 0xdc573700 sched_switch(dc573700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdab3a948 mi_switch(104,0,c1654159,22b,dc573700,...) at mi_switch+0x1f3/frame 0xdab3a988 sleepq_switch(dc573700,0,c1654159,1ca,6c,...) at sleepq_switch+0x110/frame 0xdab3a9bc sleepq_catch_signals(0,c1654159,178,c1b56e14,dc573700,...) at sleepq_catch_signals+0x360/frame 0xdab3aa00 sleepq_wait_sig(d8527358,6c,c16584d2,100,0,...) at sleepq_wait_sig+0x14/frame 0xdab3aa24 _sleep(d8527358,d8527400,16c,c16584d2,0,...) at _sleep+0x386/frame 0xdab3aa78 kern_wait6(dc573700,7,0,0,dab3aaf4,...) at kern_wait6+0x4ae/frame 0xdab3aac8 sys_wait4(dc573700,dc573980,c164301b,4,0,...) at sys_wait4+0x87/frame 0xdab3abe8 syscall(dab3ace8) at syscall+0x6ee/frame 0xdab3acdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdab3acdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281d9eb3, esp = 0xbfbfe388, ebp = 0xbfbfe3a0 --- Tracing command tee pid 61563 tid 100336 td 0xdeafb000 sched_switch(deafb000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xcb1359a8 mi_switch(104,0,c1654159,22b,deafb000,...) at mi_switch+0x1f3/frame 0xcb1359e8 sleepq_switch(deafb000,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xcb135a1c sleepq_catch_signals(0,c1654159,178,c1b58b54,deafb000,...) at sleepq_catch_signals+0x360/frame 0xcb135a60 sleepq_wait_sig(f5b4e848,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xcb135a84 _sleep(f5b4e848,f5b4e9d8,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xcb135ad8 pipe_read(debcfce8,cb135bb8,ded6dc00,0,deafb000,...) at pipe_read+0x49b/frame 0xcb135b18 dofileread(debcfce8,cb135bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xcb135b48 kern_readv(deafb000,0,cb135bb8,d8a98758,28446000,...) at kern_readv+0x93/frame 0xcb135b98 sys_read(deafb000,deafb280,c164301b,4,cb135c48,...) at sys_read+0x54/frame 0xcb135be8 syscall(cb135ce8) at syscall+0x6ee/frame 0xcb135cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb135cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281fd6df, esp = 0xbfbfe754, ebp = 0xbfbfe768 --- Tracing command sh pid 61562 tid 100364 td 0xdeb8e380 sched_switch(deb8e380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xcb1c1948 mi_switch(104,0,c1654159,22b,deb8e380,...) at mi_switch+0x1f3/frame 0xcb1c1988 sleepq_switch(deb8e380,0,c1654159,1ca,6c,...) at sleepq_switch+0x110/frame 0xcb1c19bc sleepq_catch_signals(0,c1654159,178,c1b59f54,deb8e380,...) at sleepq_catch_signals+0x360/frame 0xcb1c1a00 sleepq_wait_sig(dcf8f000,6c,c16584d2,100,0,...) at sleepq_wait_sig+0x14/frame 0xcb1c1a24 _sleep(dcf8f000,dcf8f0a8,16c,c16584d2,0,...) at _sleep+0x386/frame 0xcb1c1a78 kern_wait6(deb8e380,7,0,0,cb1c1af4,...) at kern_wait6+0x4ae/frame 0xcb1c1ac8 sys_wait4(deb8e380,deb8e600,c164301b,4,cb1c1c48,...) at sys_wait4+0x87/frame 0xcb1c1be8 syscall(cb1c1ce8) at syscall+0x6ee/frame 0xcb1c1cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xcb1c1cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281d9eb3, esp = 0xbfbfe450, ebp = 0xbfbfe468 --- Tracing command sh pid 6353 tid 100116 td 0xd841f380 sched_switch(d841f380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdbefd948 mi_switch(104,0,c1654159,22b,d841f380,...) at mi_switch+0x1f3/frame 0xdbefd988 sleepq_switch(d841f380,0,c1654159,1ca,6c,...) at sleepq_switch+0x110/frame 0xdbefd9bc sleepq_catch_signals(0,c1654159,178,c1b59fd4,d841f380,...) at sleepq_catch_signals+0x360/frame 0xdbefda00 sleepq_wait_sig(d83ffa08,6c,c16584d2,100,0,...) at sleepq_wait_sig+0x14/frame 0xdbefda24 _sleep(d83ffa08,d83ffab0,16c,c16584d2,0,...) at _sleep+0x386/frame 0xdbefda78 kern_wait6(d841f380,7,0,0,dbefdaf4,...) at kern_wait6+0x4ae/frame 0xdbefdac8 sys_wait4(d841f380,d841f600,c164301b,4,0,...) at sys_wait4+0x87/frame 0xdbefdbe8 syscall(dbefdce8) at syscall+0x6ee/frame 0xdbefdcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdbefdcdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281d9eb3, esp = 0xbfbfe6b0, ebp = 0xbfbfe6c8 --- Tracing command sh pid 1340 tid 100181 td 0xd8313380 sched_switch(d8313380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdab7d9a8 mi_switch(104,0,c1654159,22b,d8313380,...) at mi_switch+0x1f3/frame 0xdab7d9e8 sleepq_switch(d8313380,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xdab7da1c sleepq_catch_signals(0,c1654159,178,c1b58d94,d8313380,...) at sleepq_catch_signals+0x360/frame 0xdab7da60 sleepq_wait_sig(dc1e59f0,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xdab7da84 _sleep(dc1e59f0,dc1e5b80,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xdab7dad8 pipe_read(d8afa0a8,dab7dbb8,d87ca400,0,d8313380,...) at pipe_read+0x49b/frame 0xdab7db18 dofileread(d8afa0a8,dab7dbb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xdab7db48 kern_readv(d8313380,0,dab7dbb8,dab7dbe8,bfbfe99f,...) at kern_readv+0x93/frame 0xdab7db98 sys_read(d8313380,d8313600,c164301b,4,dab7dc48,...) at sys_read+0x54/frame 0xdab7dbe8 syscall(dab7dce8) at syscall+0x6ee/frame 0xdab7dcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdab7dcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282486df, esp = 0xbfbfe93c, ebp = 0xbfbfe950 --- Tracing command awk pid 1339 tid 100217 td 0xdeb20700 sched_switch(deb20700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd49c39a8 mi_switch(104,0,c1654159,22b,deb20700,...) at mi_switch+0x1f3/frame 0xd49c39e8 sleepq_switch(deb20700,0,c1654159,1ca,5c,...) at sleepq_switch+0x110/frame 0xd49c3a1c sleepq_catch_signals(0,c1654159,178,c1b56a94,deb20700,...) at sleepq_catch_signals+0x360/frame 0xd49c3a60 sleepq_wait_sig(dc1e5d40,5c,c1657bbd,100,0,...) at sleepq_wait_sig+0x14/frame 0xd49c3a84 _sleep(dc1e5d40,dc1e5ed0,15c,c1657bbd,0,...) at _sleep+0x386/frame 0xd49c3ad8 pipe_read(d8afa888,d49c3bb8,d87ca400,0,deb20700,...) at pipe_read+0x49b/frame 0xd49c3b18 dofileread(d8afa888,d49c3bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xd49c3b48 kern_readv(deb20700,0,d49c3bb8,d49c3be8,28507000,...) at kern_readv+0x93/frame 0xd49c3b98 sys_read(deb20700,deb20980,c164301b,4,c18578ef,...) at sys_read+0x54/frame 0xd49c3be8 syscall(d49c3ce8) at syscall+0x6ee/frame 0xd49c3cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd49c3cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282546df, esp = 0xbfbfe9a0, ebp = 0xbfbfe9b4 --- Tracing command sh pid 1338 tid 100216 td 0xdc80b000 sched_switch(dc80b000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd49be948 mi_switch(104,0,c1654159,22b,dc80b000,...) at mi_switch+0x1f3/frame 0xd49be988 sleepq_switch(dc80b000,0,c1654159,1ca,6c,...) at sleepq_switch+0x110/frame 0xd49be9bc sleepq_catch_signals(0,c1654159,178,c1b588d4,dc80b000,...) at sleepq_catch_signals+0x360/frame 0xd49bea00 sleepq_wait_sig(de6926b0,6c,c16584d2,100,0,...) at sleepq_wait_sig+0x14/frame 0xd49bea24 _sleep(de6926b0,de692758,16c,c16584d2,0,...) at _sleep+0x386/frame 0xd49bea78 kern_wait6(dc80b000,7,0,0,d49beaf4,...) at kern_wait6+0x4ae/frame 0xd49beac8 sys_wait4(dc80b000,dc80b280,c164301b,4,0,...) at sys_wait4+0x87/frame 0xd49bebe8 syscall(d49bece8) at syscall+0x6ee/frame 0xd49becdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd49becdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281d9eb3, esp = 0xbfbfe9f8, ebp = 0xbfbfea10 --- Tracing command top pid 1335 tid 100208 td 0xdc7be700 sched_switch(dc7be700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd4933830 mi_switch(104,0,c1654159,22b,dc7be700,...) at mi_switch+0x1f3/frame 0xd4933870 sleepq_switch(dc7be700,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xd49338a4 sleepq_catch_signals(d493390c,c0c549a0,d6275a14,0,0,...) at sleepq_catch_signals+0x360/frame 0xd49338e8 sleepq_wait_sig(d6275a7c,0,d493392c,101,0,...) at sleepq_wait_sig+0x14/frame 0xd493390c _cv_wait_sig(d6275a7c,d6275a04,c165a0d5,5aa,d6275a00,...) at _cv_wait_sig+0x21f/frame 0xd4933950 tty_wait(d6275a00,d6275a7c,c165a279,6d,d6275a58,...) at tty_wait+0x4b/frame 0xd4933974 ttydisc_write(d6275a00,d4933bb8,0,d2,c0d604e0,...) at ttydisc_write+0x2ed/frame 0xd4933ab4 ttydev_write(d8b7a200,d4933bb8,0,d4933b18,dc7be700,...) at ttydev_write+0x17d/frame 0xd4933adc devfs_write_f(d8afaa10,d4933bb8,d87ca500,0,dc7be700,...) at devfs_write_f+0xc9/frame 0xd4933b14 dofilewrite(d8afaa10,d4933bb8,ffffffff,ffffffff,0,...) at dofilewrite+0xb2/frame 0xd4933b48 kern_writev(dc7be700,1,d4933bb8,d4933be8,8058328,...) at kern_writev+0x93/frame 0xd4933b98 sys_write(dc7be700,dc7be980,c164301b,4,c18578ef,...) at sys_write+0x54/frame 0xd4933be8 syscall(d4933ce8) at syscall+0x6ee/frame 0xd4933cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd4933cdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x282966bf, esp = 0xbfbfeaf4, ebp = 0xbfbfeb08 --- Tracing command sh pid 1334 tid 100199 td 0xdc80ea80 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c16523c0,c0ae14c5,c18fb198,c18fb27c,d7e502e8,...) at db_trace_self_wrapper+0x2a/frame 0xd7e502b0 kdb_backtrace(c165243d,c0cd34bf,d7e50420,c124e305,c1654ce5,...) at kdb_backtrace+0x2d/frame 0xd7e50318 kdb_reenter(c1654ce5,244,c0a793d5,aa2d5b0,700,...) at kdb_reenter+0x2a/frame 0xd7e50328 trap(d7e5042c) at trap+0xb5/frame 0xd7e50420 calltrap() at calltrap+0x6/frame 0xd7e50420 --- trap 0xc, eip = 0xc1238559, esp = 0xd7e5046c, ebp = 0xd7e50488 --- db_trace_thread(dc80ea80,ffffffff,536,18767,dc80ea80,...) at db_trace_thread+0x29/frame 0xd7e50488 _db_stack_trace_all(c0cbe30a,0,ffffffff,d7e50520,c19620d0,...) at _db_stack_trace_all+0xe9/frame 0xd7e504f4 db_command(c1962f19,0,c1bd9ac4,c1962f18,60,...) at db_command+0x297/frame 0xd7e505a8 db_script_exec(c1bbeab8,0,d7e50650,d7e50644,c19620d0,...) at db_script_exec+0x168/frame 0xd7e50618 db_command(c12aedc3,d7e50730,c05b00ad,c12cedc2,ffff0ff0,...) at db_command+0x297/frame 0xd7e506cc db_command_loop(c12cedc2,ffff0ff0,d7e506f7,d7e506f6,d621b000,...) at db_command_loop+0x50/frame 0xd7e506d8 db_trap(3,ffff0ff0,7,0,1,...) at db_trap+0x10d/frame 0xd7e50730 kdb_trap(3,ffff0ff0,d7e5086c,d7e50818,0,...) at kdb_trap+0x11e/frame 0xd7e50768 trap(d7e5086c) at trap+0x817/frame 0xd7e50860 calltrap() at calltrap+0x6/frame 0xd7e50860 --- trap 0x3, eip = 0xc0cbe30a, esp = 0xd7e508ac, ebp = 0xd7e508b8 --- kdb_enter(c12cedc2,c1351ca5,0,2250045,ffffffff) at kdb_enter+0x3a/frame 0xd7e508b8 watchdog_fire(1,8,c18578ef,d7e50928,0,...) at watchdog_fire+0xac/frame 0xd7e508e0 hardclock_cnt(1,0,c18578ef,e0,9e524c0,...) at hardclock_cnt+0x26a/frame 0xd7e50928 handleevents(0,9d9a,1,cb7acc40,9d9a,...) at handleevents+0xfe/frame 0xd7e50970 timercb(c1bd80e4,0,3,3,d7e50a78,...) at timercb+0x25d/frame 0xd7e509ac lapic_handle_timer(d7e509d8) at lapic_handle_timer+0x80/frame 0xd7e509cc Xtimerint_pti(d7e50a78,d615a44c,c6dc06b8,0,246,...) at Xtimerint_pti+0x2b/frame 0xd7e50a38 __mtx_lock_sleep(cb7de970,d63d3a80,0,c167bbe3,1ec,...) at __mtx_lock_sleep+0xd8/frame 0xd7e50aa8 __mtx_lock_flags(cb7de970,0,c167bbe3,1ec,d615a380,...) at __mtx_lock_flags+0x107/frame 0xd7e50ad8 ipreass_slowtimo(c1be75a4,c167b18c,349,95c2,c1648c33,...) at ipreass_slowtimo+0x53/frame 0xd7e50b28 ip_slowtimo(c1be50c0,8,c194d860,d7e50b88,c0c86e22,...) at ip_slowtimo+0x6d/frame 0xd7e50b54 pfslowtimo(0,0,c164e8c1,2b3,3f,...) at pfslowtimo+0x50/frame 0xd7e50b88 softclock_call_cc(0,0,c164e8c1,362,c1be50d0,...) at softclock_call_cc+0x16e/frame 0xd7e50c20 softclock(c1be50c0,0,d615a380,c1b49500,d60efc48,...) at softclock+0x84/frame 0xd7e50c48 intr_event_execute_handlers(c1b49510,d60efc00,c1643981,5ac,c16435dc,...) at intr_event_execute_handlers+0x8e/frame 0xd7e50c70 ithread_loop(d6157ed0,d7e50ce8,c16435dc,407,0,...) at ithread_loop+0xa0/frame 0xd7e50cac fork_exit(c0c38860,d6157ed0,d7e50ce8) at fork_exit+0x7e/frame 0xd7e50cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e50cd4 --- trap 0, eip = 0, esp = 0xd7e50d20, ebp = 0 --- Tracing command tail pid 1333 tid 100182 td 0xd8313000 sched_switch(d8313000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdab82748 mi_switch(104,0,c1654159,22b,d8313000,...) at mi_switch+0x1f3/frame 0xdab82788 sleepq_switch(d8313000,0,c1654159,1ca,68,...) at sleepq_switch+0x110/frame 0xdab827bc sleepq_catch_signals(d8313000,2,601,dab8283c,9d9a,...) at sleepq_catch_signals+0x360/frame 0xdab82800 sleepq_timedwait_sig(d857de00,68,9d9a,10000000,0,...) at sleepq_timedwait_sig+0x17/frame 0xdab8283c _sleep(d857de00,d857de00,168,c1642b61,c02d82b2,...) at _sleep+0x31a/frame 0xdab82890 kqueue_kevent(0,1,dab82bc0,dab82b90,0,...) at kqueue_kevent+0x3aa/frame 0xdab82af4 kern_kevent_fp(d8313000,d8afa3b8,0,1,dab82bc0,...) at kern_kevent_fp+0x9d/frame 0xdab82b18 kern_kevent(d8313000,4,0,1,dab82bc0,...) at kern_kevent+0xe8/frame 0xdab82b68 kern_kevent_generic(dab82bc0,c1658e87,d8313280,c0c281f0,c0c28240,...) at kern_kevent_generic+0xb4/frame 0xdab82bb0 sys_kevent(d8313000,d8313280,c164301b,4,c18578ef,...) at sys_kevent+0x6c/frame 0xdab82be8 syscall(dab82ce8) at syscall+0x6ee/frame 0xdab82cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdab82cdc --- syscall (560, FreeBSD ELF32, sys_kevent), eip = 0x281e7203, esp = 0xbfbfeaa8, ebp = 0xbfbfead0 --- Tracing command sshd pid 1332 tid 100214 td 0xdc80b380 sched_switch(dc80b380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd49b45f0 mi_switch(104,0,c1654159,22b,dc80b380,...) at mi_switch+0x1f3/frame 0xd49b4630 sleepq_switch(dc80b380,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd49b4664 sleepq_wait(c1b5b780,0,d49b46a8,1,0,...) at sleepq_wait+0x48/frame 0xd49b4688 _cv_wait(c1b5b780,c1b5b740,c1655993,362,dc6aaf64,...) at _cv_wait+0x21f/frame 0xd49b46cc vmem_xalloc(c1b5b740,400000,0,0,0,...) at vmem_xalloc+0x1df/frame 0xd49b4730 vmem_alloc(c1b5b740,400000,2002,d49b4780,0,...) at vmem_alloc+0xcc/frame 0xd49b4768 vmem_xalloc(c2381000,1000,0,0,0,...) at vmem_xalloc+0x417/frame 0xd49b47cc vmem_alloc(c2381000,1000,2102,d49b4820,fc816c08,...) at vmem_alloc+0xcc/frame 0xd49b4804 kmem_malloc_domain(0,1000,102) at kmem_malloc_domain+0x44/frame 0xd49b4830 page_alloc(cb502c80,1000,0,d49b487b,102,...) at page_alloc+0x26/frame 0xd49b4848 keg_alloc_slab(0,2,c169eb97,94c,c6db8a00,...) at keg_alloc_slab+0xf6/frame 0xd49b4890 keg_fetch_slab(ffffffff,2,c169eb97,9ae,3,...) at keg_fetch_slab+0x10e/frame 0xd49b48e8 zone_fetch_slab(cb502c80,0,ffffffff,2,c193f82c,...) at zone_fetch_slab+0x61/frame 0xd49b490c zone_import(cb502c80,fd3a2f8c,5,ffffffff,2,...) at zone_import+0x3b/frame 0xd49b4944 uma_zalloc_arg(cb502c80,f5a3fc00,2,1,c2399000,...) at uma_zalloc_arg+0x357/frame 0xd49b4980 mb_zinit_pack(f5a3fc00,100,2,ffffffff,2,...) at mb_zinit_pack+0x23/frame 0xd49b499c uma_zalloc_arg(cb502dc0,d49b49f8,2,c165714f,dc5577c0,...) at uma_zalloc_arg+0x3c6/frame 0xd49b49d8 m_getm2(0,278,2,1,0,...) at m_getm2+0x126/frame 0xd49b4a28 m_uiotombuf(d49b4bb8,2,832c,0,0,...) at m_uiotombuf+0x6a/frame 0xd49b4a58 sosend_generic(dc6aae00,0,d49b4bb8,0,0,...) at sosend_generic+0x2fa/frame 0xd49b4ab4 sosend(dc6aae00,0,d49b4bb8,0,0,...) at sosend+0x73/frame 0xd49b4ae4 soo_write(d8afa2d8,d49b4bb8,de9f7900,0,dc80b380,...) at soo_write+0x5d/frame 0xd49b4b14 dofilewrite(d8afa2d8,d49b4bb8,ffffffff,ffffffff,0,...) at dofilewrite+0xb2/frame 0xd49b4b48 kern_writev(dc80b380,3,d49b4bb8,d49b4be8,28aecf98,...) at kern_writev+0x93/frame 0xd49b4b98 sys_write(dc80b380,dc80b600,c164301b,4,cb7a7c50,...) at sys_write+0x54/frame 0xd49b4be8 syscall(d49b4ce8) at syscall+0x6ee/frame 0xd49b4cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd49b4cdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2855b6bf, esp = 0xbfbfa744, ebp = 0xbfbfa760 --- Tracing command sshd pid 1331 tid 100209 td 0xdc7be380 sched_switch(dc7be380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd49388b0 mi_switch(104,0,c1654159,22b,dc7be380,...) at mi_switch+0x1f3/frame 0xd49388f0 sleepq_switch(dc7be380,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xd4938924 sleepq_catch_signals(d493898c,c0c549a0,d87cfe60,0,0,...) at sleepq_catch_signals+0x360/frame 0xd4938968 sleepq_wait_sig(d87cfe64,0,d49389ac,101,0,...) at sleepq_wait_sig+0x14/frame 0xd493898c _cv_wait_sig(d87cfe64,d87cfe50,c1657937,73d,5cf,...) at _cv_wait_sig+0x21f/frame 0xd49389d0 seltdwait(ffffffff,0,0,dc7be380,0,...) at seltdwait+0xbb/frame 0xd4938a00 kern_select(dc7be380,c,280c30a8,280c30d0,0,...) at kern_select+0x876/frame 0xd4938ba0 sys_select(dc7be380,dc7be600,c164301b,4,c164d3af,...) at sys_select+0x68/frame 0xd4938be8 syscall(d4938ce8) at syscall+0x6ee/frame 0xd4938cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd4938cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2855b6cf, esp = 0xbfbfa76c, ebp = 0xbfbfa790 --- Tracing command sshd pid 1330 tid 100212 td 0xdc80ba80 sched_switch(dc80ba80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd49aa8b0 mi_switch(104,0,c1654159,22b,dc80ba80,...) at mi_switch+0x1f3/frame 0xd49aa8f0 sleepq_switch(dc80ba80,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xd49aa924 sleepq_catch_signals(d49aa98c,c0c549a0,d85f10a0,0,0,...) at sleepq_catch_signals+0x360/frame 0xd49aa968 sleepq_wait_sig(d85f10a4,0,d49aa9ac,101,0,...) at sleepq_wait_sig+0x14/frame 0xd49aa98c _cv_wait_sig(d85f10a4,d85f1090,c1657937,73d,5cf,...) at _cv_wait_sig+0x21f/frame 0xd49aa9d0 seltdwait(ffffffff,0,0,dc80ba80,0,...) at seltdwait+0xbb/frame 0xd49aaa00 kern_select(dc80ba80,c,280c30a8,280c30d0,0,...) at kern_select+0x876/frame 0xd49aaba0 sys_select(dc80ba80,dc80bd00,c164301b,4,c18578ef,...) at sys_select+0x68/frame 0xd49aabe8 syscall(d49aace8) at syscall+0x6ee/frame 0xd49aacdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd49aacdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2855b6cf, esp = 0xbfbfa76c, ebp = 0xbfbfa790 --- Tracing command sshd pid 1328 tid 100215 td 0xdeb0b380 sched_switch(deb0b380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd49b98e0 mi_switch(104,0,c1654159,22b,deb0b380,...) at mi_switch+0x1f3/frame 0xd49b9920 sleepq_switch(deb0b380,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xd49b9954 sleepq_catch_signals(d49b99bc,c0c549a0,d8437a60,0,0,...) at sleepq_catch_signals+0x360/frame 0xd49b9998 sleepq_wait_sig(d8437a64,0,d49b99dc,101,0,...) at sleepq_wait_sig+0x14/frame 0xd49b99bc _cv_wait_sig(d8437a64,d8437a50,c1657937,73d,0,...) at _cv_wait_sig+0x21f/frame 0xd49b9a00 seltdwait(ffffffff,0,0,deb0b380,0,...) at seltdwait+0xbb/frame 0xd49b9a30 kern_poll(deb0b380,bfbfe7f0,1,0,0,...) at kern_poll+0x4ab/frame 0xd49b9bb0 sys_poll(deb0b380,deb0b600,c164301b,4,c164d3af,...) at sys_poll+0x67/frame 0xd49b9be8 syscall(d49b9ce8) at syscall+0x6ee/frame 0xd49b9cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd49b9cdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284ff16b, esp = 0xbfbfe77c, ebp = 0xbfbfe798 --- Tracing command sshd pid 1325 tid 100191 td 0xdc810000 sched_switch(dc810000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdabb68e0 mi_switch(104,0,c1654159,22b,dc810000,...) at mi_switch+0x1f3/frame 0xdabb6920 sleepq_switch(dc810000,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdabb6954 sleepq_catch_signals(dabb69bc,c0c549a0,d85f11a0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdabb6998 sleepq_wait_sig(d85f11a4,0,dabb69dc,101,0,...) at sleepq_wait_sig+0x14/frame 0xdabb69bc _cv_wait_sig(d85f11a4,d85f1190,c1657937,73d,0,...) at _cv_wait_sig+0x21f/frame 0xdabb6a00 seltdwait(ffffffff,0,0,dc810000,0,...) at seltdwait+0xbb/frame 0xdabb6a30 kern_poll(dc810000,bfbfe7f0,1,0,0,...) at kern_poll+0x4ab/frame 0xdabb6bb0 sys_poll(dc810000,dc810280,c164301b,4,3ec3f1e6,...) at sys_poll+0x67/frame 0xdabb6be8 syscall(dabb6ce8) at syscall+0x6ee/frame 0xdabb6cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdabb6cdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284ff16b, esp = 0xbfbfe77c, ebp = 0xbfbfe798 --- Tracing command sshd pid 1324 tid 100213 td 0xdc80b700 sched_switch(dc80b700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd49af8e0 mi_switch(104,0,c1654159,22b,dc80b700,...) at mi_switch+0x1f3/frame 0xd49af920 sleepq_switch(dc80b700,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xd49af954 sleepq_catch_signals(d49af9bc,c0c549a0,d8437aa0,0,0,...) at sleepq_catch_signals+0x360/frame 0xd49af998 sleepq_wait_sig(d8437aa4,0,d49af9dc,101,0,...) at sleepq_wait_sig+0x14/frame 0xd49af9bc _cv_wait_sig(d8437aa4,d8437a90,c1657937,73d,0,...) at _cv_wait_sig+0x21f/frame 0xd49afa00 seltdwait(ffffffff,0,0,dc80b700,0,...) at seltdwait+0xbb/frame 0xd49afa30 kern_poll(dc80b700,bfbfe7f0,1,0,0,...) at kern_poll+0x4ab/frame 0xd49afbb0 sys_poll(dc80b700,dc80b980,c164301b,4,3ec3f1e6,...) at sys_poll+0x67/frame 0xd49afbe8 syscall(d49afce8) at syscall+0x6ee/frame 0xd49afcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd49afcdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284ff16b, esp = 0xbfbfe77c, ebp = 0xbfbfe798 --- Tracing command bash pid 920 tid 100201 td 0xdc80e380 sched_switch(dc80e380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdabf6948 mi_switch(104,0,c1654159,22b,dc80e380,...) at mi_switch+0x1f3/frame 0xdabf6988 sleepq_switch(dc80e380,0,c1654159,1ca,6c,...) at sleepq_switch+0x110/frame 0xdabf69bc sleepq_catch_signals(0,c1654159,178,c1b56fd4,dc80e380,...) at sleepq_catch_signals+0x360/frame 0xdabf6a00 sleepq_wait_sig(de693a08,6c,c16584d2,100,0,...) at sleepq_wait_sig+0x14/frame 0xdabf6a24 _sleep(de693a08,de693ab0,16c,c16584d2,0,...) at _sleep+0x386/frame 0xdabf6a78 kern_wait6(dc80e380,7,0,0,dabf6af4,...) at kern_wait6+0x4ae/frame 0xdabf6ac8 sys_wait4(dc80e380,dc80e600,c164301b,4,cb7a2c50,...) at sys_wait4+0x87/frame 0xdabf6be8 syscall(dabf6ce8) at syscall+0x6ee/frame 0xdabf6cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdabf6cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282b8eb3, esp = 0xbfbfe768, ebp = 0xbfbfe780 --- Tracing command csh pid 918 tid 100104 td 0xd8314a80 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c16523c0,c0ae14c5,c18fb198,c18fb27c,d7e502e8,...) at db_trace_self_wrapper+0x2a/frame 0xd7e502b0 kdb_backtrace(c165243d,c0cd34bf,d7e50420,c124e305,c1654ce5,...) at kdb_backtrace+0x2d/frame 0xd7e50318 kdb_reenter(c1654ce5,244,c0a793d5,aa2d5b0,700,...) at kdb_reenter+0x2a/frame 0xd7e50328 trap(d7e5042c) at trap+0xb5/frame 0xd7e50420 calltrap() at calltrap+0x6/frame 0xd7e50420 --- trap 0xc, eip = 0xc1238559, esp = 0xd7e5046c, ebp = 0xd7e50488 --- db_trace_thread(d8314a80,ffffffff,396,18708,d8314a80,...) at db_trace_thread+0x29/frame 0xd7e50488 _db_stack_trace_all(c0cbe30a,0,ffffffff,d7e50520,c19620d0,...) at _db_stack_trace_all+0xe9/frame 0xd7e504f4 db_command(c1962f19,0,c1bd9ac4,c1962f18,60,...) at db_command+0x297/frame 0xd7e505a8 db_script_exec(c1bbeab8,0,d7e50650,d7e50644,c19620d0,...) at db_script_exec+0x168/frame 0xd7e50618 db_command(c12aedc3,d7e50730,c05b00ad,c12cedc2,ffff0ff0,...) at db_command+0x297/frame 0xd7e506cc db_command_loop(c12cedc2,ffff0ff0,d7e506f7,d7e506f6,d621b000,...) at db_command_loop+0x50/frame 0xd7e506d8 db_trap(3,ffff0ff0,7,0,1,...) at db_trap+0x10d/frame 0xd7e50730 kdb_trap(3,ffff0ff0,d7e5086c,d7e50818,0,...) at kdb_trap+0x11e/frame 0xd7e50768 trap(d7e5086c) at trap+0x817/frame 0xd7e50860 calltrap() at calltrap+0x6/frame 0xd7e50860 --- trap 0x3, eip = 0xc0cbe30a, esp = 0xd7e508ac, ebp = 0xd7e508b8 --- kdb_enter(c12cedc2,c1351ca5,0,2250045,ffffffff) at kdb_enter+0x3a/frame 0xd7e508b8 watchdog_fire(1,8,c18578ef,d7e50928,0,...) at watchdog_fire+0xac/frame 0xd7e508e0 hardclock_cnt(1,0,c18578ef,e0,9e524c0,...) at hardclock_cnt+0x26a/frame 0xd7e50928 handleevents(0,9d9a,1,cb7acc40,9d9a,...) at handleevents+0xfe/frame 0xd7e50970 timercb(c1bd80e4,0,3,3,d7e50a78,...) at timercb+0x25d/frame 0xd7e509ac lapic_handle_timer(d7e509d8) at lapic_handle_timer+0x80/frame 0xd7e509cc Xtimerint_pti(d7e50a78,d615a44c,c6dc06b8,0,246,...) at Xtimerint_pti+0x2b/frame 0xd7e50a38 __mtx_lock_sleep(cb7de970,d63d3a80,0,c167bbe3,1ec,...) at __mtx_lock_sleep+0xd8/frame 0xd7e50aa8 __mtx_lock_flags(cb7de970,0,c167bbe3,1ec,d615a380,...) at __mtx_lock_flags+0x107/frame 0xd7e50ad8 ipreass_slowtimo(c1be75a4,c167b18c,349,95c2,c1648c33,...) at ipreass_slowtimo+0x53/frame 0xd7e50b28 ip_slowtimo(c1be50c0,8,c194d860,d7e50b88,c0c86e22,...) at ip_slowtimo+0x6d/frame 0xd7e50b54 pfslowtimo(0,0,c164e8c1,2b3,3f,...) at pfslowtimo+0x50/frame 0xd7e50b88 softclock_call_cc(0,0,c164e8c1,362,c1be50d0,...) at softclock_call_cc+0x16e/frame 0xd7e50c20 softclock(c1be50c0,0,d615a380,c1b49500,d60efc48,...) at softclock+0x84/frame 0xd7e50c48 intr_event_execute_handlers(c1b49510,d60efc00,c1643981,5ac,c16435dc,...) at intr_event_execute_handlers+0x8e/frame 0xd7e50c70 ithread_loop(d6157ed0,d7e50ce8,c16435dc,407,0,...) at ithread_loop+0xa0/frame 0xd7e50cac fork_exit(c0c38860,d6157ed0,d7e50ce8) at fork_exit+0x7e/frame 0xd7e50cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e50cd4 --- trap 0, eip = 0, esp = 0xd7e50d20, ebp = 0 --- Tracing command su pid 917 tid 100200 td 0xdc80e700 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c16523c0,c0ae14c5,c18fb198,c18fb27c,d7e502e8,...) at db_trace_self_wrapper+0x2a/frame 0xd7e502b0 kdb_backtrace(c165243d,c0cd34bf,d7e50420,c124e305,c1654ce5,...) at kdb_backtrace+0x2d/frame 0xd7e50318 kdb_reenter(c1654ce5,244,c0a793d5,aa2d5b0,700,...) at kdb_reenter+0x2a/frame 0xd7e50328 trap(d7e5042c) at trap+0xb5/frame 0xd7e50420 calltrap() at calltrap+0x6/frame 0xd7e50420 --- trap 0xc, eip = 0xc1238559, esp = 0xd7e5046c, ebp = 0xd7e50488 --- db_trace_thread(dc80e700,ffffffff,395,18768,dc80e700,...) at db_trace_thread+0x29/frame 0xd7e50488 _db_stack_trace_all(c0cbe30a,0,ffffffff,d7e50520,c19620d0,...) at _db_stack_trace_all+0xe9/frame 0xd7e504f4 db_command(c1962f19,0,c1bd9ac4,c1962f18,60,...) at db_command+0x297/frame 0xd7e505a8 db_script_exec(c1bbeab8,0,d7e50650,d7e50644,c19620d0,...) at db_script_exec+0x168/frame 0xd7e50618 db_command(c12aedc3,d7e50730,c05b00ad,c12cedc2,ffff0ff0,...) at db_command+0x297/frame 0xd7e506cc db_command_loop(c12cedc2,ffff0ff0,d7e506f7,d7e506f6,d621b000,...) at db_command_loop+0x50/frame 0xd7e506d8 db_trap(3,ffff0ff0,7,0,1,...) at db_trap+0x10d/frame 0xd7e50730 kdb_trap(3,ffff0ff0,d7e5086c,d7e50818,0,...) at kdb_trap+0x11e/frame 0xd7e50768 trap(d7e5086c) at trap+0x817/frame 0xd7e50860 calltrap() at calltrap+0x6/frame 0xd7e50860 --- trap 0x3, eip = 0xc0cbe30a, esp = 0xd7e508ac, ebp = 0xd7e508b8 --- kdb_enter(c12cedc2,c1351ca5,0,2250045,ffffffff) at kdb_enter+0x3a/frame 0xd7e508b8 watchdog_fire(1,8,c18578ef,d7e50928,0,...) at watchdog_fire+0xac/frame 0xd7e508e0 hardclock_cnt(1,0,c18578ef,e0,9e524c0,...) at hardclock_cnt+0x26a/frame 0xd7e50928 handleevents(0,9d9a,1,cb7acc40,9d9a,...) at handleevents+0xfe/frame 0xd7e50970 timercb(c1bd80e4,0,3,3,d7e50a78,...) at timercb+0x25d/frame 0xd7e509ac lapic_handle_timer(d7e509d8) at lapic_handle_timer+0x80/frame 0xd7e509cc Xtimerint_pti(d7e50a78,d615a44c,c6dc06b8,0,246,...) at Xtimerint_pti+0x2b/frame 0xd7e50a38 __mtx_lock_sleep(cb7de970,d63d3a80,0,c167bbe3,1ec,...) at __mtx_lock_sleep+0xd8/frame 0xd7e50aa8 __mtx_lock_flags(cb7de970,0,c167bbe3,1ec,d615a380,...) at __mtx_lock_flags+0x107/frame 0xd7e50ad8 ipreass_slowtimo(c1be75a4,c167b18c,349,95c2,c1648c33,...) at ipreass_slowtimo+0x53/frame 0xd7e50b28 ip_slowtimo(c1be50c0,8,c194d860,d7e50b88,c0c86e22,...) at ip_slowtimo+0x6d/frame 0xd7e50b54 pfslowtimo(0,0,c164e8c1,2b3,3f,...) at pfslowtimo+0x50/frame 0xd7e50b88 softclock_call_cc(0,0,c164e8c1,362,c1be50d0,...) at softclock_call_cc+0x16e/frame 0xd7e50c20 softclock(c1be50c0,0,d615a380,c1b49500,d60efc48,...) at softclock+0x84/frame 0xd7e50c48 intr_event_execute_handlers(c1b49510,d60efc00,c1643981,5ac,c16435dc,...) at intr_event_execute_handlers+0x8e/frame 0xd7e50c70 ithread_loop(d6157ed0,d7e50ce8,c16435dc,407,0,...) at ithread_loop+0xa0/frame 0xd7e50cac fork_exit(c0c38860,d6157ed0,d7e50ce8) at fork_exit+0x7e/frame 0xd7e50cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e50cd4 --- trap 0, eip = 0, esp = 0xd7e50d20, ebp = 0 --- Tracing command bash pid 906 tid 100184 td 0xdc7c0a80 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c16523c0,c0ae14c5,c18fb198,c18fb27c,d7e502e8,...) at db_trace_self_wrapper+0x2a/frame 0xd7e502b0 kdb_backtrace(c165243d,c0cd34bf,d7e50420,c124e305,c1654ce5,...) at kdb_backtrace+0x2d/frame 0xd7e50318 kdb_reenter(c1654ce5,244,c0a793d5,aa2d5b0,700,...) at kdb_reenter+0x2a/frame 0xd7e50328 trap(d7e5042c) at trap+0xb5/frame 0xd7e50420 calltrap() at calltrap+0x6/frame 0xd7e50420 --- trap 0xc, eip = 0xc1238559, esp = 0xd7e5046c, ebp = 0xd7e50488 --- db_trace_thread(dc7c0a80,ffffffff,38a,18758,dc7c0a80,...) at db_trace_thread+0x29/frame 0xd7e50488 _db_stack_trace_all(c0cbe30a,0,ffffffff,d7e50520,c19620d0,...) at _db_stack_trace_all+0xe9/frame 0xd7e504f4 db_command(c1962f19,0,c1bd9ac4,c1962f18,60,...) at db_command+0x297/frame 0xd7e505a8 db_script_exec(c1bbeab8,0,d7e50650,d7e50644,c19620d0,...) at db_script_exec+0x168/frame 0xd7e50618 db_command(c12aedc3,d7e50730,c05b00ad,c12cedc2,ffff0ff0,...) at db_command+0x297/frame 0xd7e506cc db_command_loop(c12cedc2,ffff0ff0,d7e506f7,d7e506f6,d621b000,...) at db_command_loop+0x50/frame 0xd7e506d8 db_trap(3,ffff0ff0,7,0,1,...) at db_trap+0x10d/frame 0xd7e50730 kdb_trap(3,ffff0ff0,d7e5086c,d7e50818,0,...) at kdb_trap+0x11e/frame 0xd7e50768 trap(d7e5086c) at trap+0x817/frame 0xd7e50860 calltrap() at calltrap+0x6/frame 0xd7e50860 --- trap 0x3, eip = 0xc0cbe30a, esp = 0xd7e508ac, ebp = 0xd7e508b8 --- kdb_enter(c12cedc2,c1351ca5,0,2250045,ffffffff) at kdb_enter+0x3a/frame 0xd7e508b8 watchdog_fire(1,8,c18578ef,d7e50928,0,...) at watchdog_fire+0xac/frame 0xd7e508e0 hardclock_cnt(1,0,c18578ef,e0,9e524c0,...) at hardclock_cnt+0x26a/frame 0xd7e50928 handleevents(0,9d9a,1,cb7acc40,9d9a,...) at handleevents+0xfe/frame 0xd7e50970 timercb(c1bd80e4,0,3,3,d7e50a78,...) at timercb+0x25d/frame 0xd7e509ac lapic_handle_timer(d7e509d8) at lapic_handle_timer+0x80/frame 0xd7e509cc Xtimerint_pti(d7e50a78,d615a44c,c6dc06b8,0,246,...) at Xtimerint_pti+0x2b/frame 0xd7e50a38 __mtx_lock_sleep(cb7de970,d63d3a80,0,c167bbe3,1ec,...) at __mtx_lock_sleep+0xd8/frame 0xd7e50aa8 __mtx_lock_flags(cb7de970,0,c167bbe3,1ec,d615a380,...) at __mtx_lock_flags+0x107/frame 0xd7e50ad8 ipreass_slowtimo(c1be75a4,c167b18c,349,95c2,c1648c33,...) at ipreass_slowtimo+0x53/frame 0xd7e50b28 ip_slowtimo(c1be50c0,8,c194d860,d7e50b88,c0c86e22,...) at ip_slowtimo+0x6d/frame 0xd7e50b54 pfslowtimo(0,0,c164e8c1,2b3,3f,...) at pfslowtimo+0x50/frame 0xd7e50b88 softclock_call_cc(0,0,c164e8c1,362,c1be50d0,...) at softclock_call_cc+0x16e/frame 0xd7e50c20 softclock(c1be50c0,0,d615a380,c1b49500,d60efc48,...) at softclock+0x84/frame 0xd7e50c48 intr_event_execute_handlers(c1b49510,d60efc00,c1643981,5ac,c16435dc,...) at intr_event_execute_handlers+0x8e/frame 0xd7e50c70 ithread_loop(d6157ed0,d7e50ce8,c16435dc,407,0,...) at ithread_loop+0xa0/frame 0xd7e50cac fork_exit(c0c38860,d6157ed0,d7e50ce8) at fork_exit+0x7e/frame 0xd7e50cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e50cd4 --- trap 0, eip = 0, esp = 0xd7e50d20, ebp = 0 --- Tracing command sshd pid 905 tid 100198 td 0xdc80f000 sched_switch(dc80f000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdabe38b0 mi_switch(104,0,c1654159,22b,dc80f000,...) at mi_switch+0x1f3/frame 0xdabe38f0 sleepq_switch(dc80f000,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdabe3924 sleepq_catch_signals(dabe398c,c0c549a0,d85f12a0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdabe3968 sleepq_wait_sig(d85f12a4,0,dabe39ac,101,0,...) at sleepq_wait_sig+0x14/frame 0xdabe398c _cv_wait_sig(d85f12a4,d85f1290,c1657937,73d,1b0,...) at _cv_wait_sig+0x21f/frame 0xdabe39d0 seltdwait(ffffffff,0,0,dc80f000,0,...) at seltdwait+0xbb/frame 0xdabe3a00 kern_select(dc80f000,c,280c30a8,280c30d0,0,...) at kern_select+0x876/frame 0xdabe3ba0 sys_select(dc80f000,dc80f280,c164301b,4,c18578ef,...) at sys_select+0x68/frame 0xdabe3be8 syscall(dabe3ce8) at syscall+0x6ee/frame 0xdabe3cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdabe3cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2855b6cf, esp = 0xbfbfa76c, ebp = 0xbfbfa790 --- Tracing command sshd pid 903 tid 100196 td 0xdc80f700 sched_switch(dc80f700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdabd98e0 mi_switch(104,0,c1654159,22b,dc80f700,...) at mi_switch+0x1f3/frame 0xdabd9920 sleepq_switch(dc80f700,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdabd9954 sleepq_catch_signals(dabd99bc,c0c549a0,d87d0020,0,0,...) at sleepq_catch_signals+0x360/frame 0xdabd9998 sleepq_wait_sig(d87d0024,0,dabd99dc,101,0,...) at sleepq_wait_sig+0x14/frame 0xdabd99bc _cv_wait_sig(d87d0024,d87d0010,c1657937,73d,0,...) at _cv_wait_sig+0x21f/frame 0xdabd9a00 seltdwait(ffffffff,0,0,dc80f700,0,...) at seltdwait+0xbb/frame 0xdabd9a30 kern_poll(dc80f700,bfbfe7f0,1,0,0,...) at kern_poll+0x4ab/frame 0xdabd9bb0 sys_poll(dc80f700,dc80f980,c164301b,4,c18578ef,...) at sys_poll+0x67/frame 0xdabd9be8 syscall(dabd9ce8) at syscall+0x6ee/frame 0xdabd9cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdabd9cdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284ff16b, esp = 0xbfbfe77c, ebp = 0xbfbfe798 --- Tracing command getty pid 830 tid 100190 td 0xdc688700 sched_switch(dc688700,0,104,188,c1b480c0,...) at sched_switch+0x503/frame 0xdabaf940 mi_switch(104,0,c1654159,22b,dc688700,...) at mi_switch+0x1f3/frame 0xdabaf97c sleepq_switch(dc688700,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdabaf9b0 sleepq_catch_signals(dabafa18,c0c549a0,d82eb214,0,0,...) at sleepq_catch_signals+0x360/frame 0xdabaf9f4 sleepq_wait_sig(d82eb274,0,dabafa38,101,0,...) at sleepq_wait_sig+0x14/frame 0xdabafa18 _cv_wait_sig(d82eb274,d82eb204,c165a0d5,5aa,dabafbb8,...) at _cv_wait_sig+0x21f/frame 0xdabafa5c tty_wait(d82eb200,d82eb274,dabafbb8,1,0,...) at tty_wait+0x4b/frame 0xdabafa80 ttydisc_read(d82eb200,dabafbb8,0,d2,c1919d28,...) at ttydisc_read+0x238/frame 0xdabafac0 ttydev_read(d82ef900,dabafbb8,0,dc688700,dabafb6c,...) at ttydev_read+0x55/frame 0xdabafae0 devfs_read_f(d8aad188,dabafbb8,cb7f5000,0,dc688700,...) at devfs_read_f+0xc5/frame 0xdabafb18 dofileread(d8aad188,dabafbb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xdabafb48 kern_readv(dc688700,0,dabafbb8,dabafbe8,bfbfede1,...) at kern_readv+0x93/frame 0xdabafb98 sys_read(dc688700,dc688980,c164301b,4,dabafc48,...) at sys_read+0x54/frame 0xdabafbe8 syscall(dabafce8) at syscall+0x6ee/frame 0xdabafcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdabafcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282146df, esp = 0xbfbfedb4, ebp = 0xbfbfedc8 --- Tracing command getty pid 829 tid 100189 td 0xdc688a80 sched_switch(dc688a80,0,104,188,c1b49500,...) at sched_switch+0x503/frame 0xdabaa940 mi_switch(104,0,c1654159,22b,dc688a80,...) at mi_switch+0x1f3/frame 0xdabaa97c sleepq_switch(dc688a80,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdabaa9b0 sleepq_catch_signals(dabaaa18,c0c549a0,d6276814,0,0,...) at sleepq_catch_signals+0x360/frame 0xdabaa9f4 sleepq_wait_sig(d6276874,0,dabaaa38,101,0,...) at sleepq_wait_sig+0x14/frame 0xdabaaa18 _cv_wait_sig(d6276874,d6276804,c165a0d5,5aa,dabaabb8,...) at _cv_wait_sig+0x21f/frame 0xdabaaa5c tty_wait(d6276800,d6276874,dabaabb8,1,0,...) at tty_wait+0x4b/frame 0xdabaaa80 ttydisc_read(d6276800,dabaabb8,0,d2,c1919d28,...) at ttydisc_read+0x238/frame 0xdabaaac0 ttydev_read(d86aea00,dabaabb8,0,dc688a80,dabaab6c,...) at ttydev_read+0x55/frame 0xdabaaae0 devfs_read_f(d8adf7e0,dabaabb8,d858ba00,0,dc688a80,...) at devfs_read_f+0xc5/frame 0xdabaab18 dofileread(d8adf7e0,dabaabb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xdabaab48 kern_readv(dc688a80,0,dabaabb8,dabaabe8,bfbfede1,...) at kern_readv+0x93/frame 0xdabaab98 sys_read(dc688a80,dc688d00,c164301b,4,dabaac48,...) at sys_read+0x54/frame 0xdabaabe8 syscall(dabaace8) at syscall+0x6ee/frame 0xdabaacdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdabaacdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282146df, esp = 0xbfbfedb4, ebp = 0xbfbfedc8 --- Tracing command getty pid 828 tid 100188 td 0xdc6b8000 sched_switch(dc6b8000,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xdaba5940 mi_switch(104,0,c1654159,22b,dc6b8000,...) at mi_switch+0x1f3/frame 0xdaba597c sleepq_switch(dc6b8000,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdaba59b0 sleepq_catch_signals(daba5a18,c0c549a0,d6276a14,0,0,...) at sleepq_catch_signals+0x360/frame 0xdaba59f4 sleepq_wait_sig(d6276a74,0,daba5a38,101,0,...) at sleepq_wait_sig+0x14/frame 0xdaba5a18 _cv_wait_sig(d6276a74,d6276a04,c165a0d5,5aa,daba5bb8,...) at _cv_wait_sig+0x21f/frame 0xdaba5a5c tty_wait(d6276a00,d6276a74,daba5bb8,1,0,...) at tty_wait+0x4b/frame 0xdaba5a80 ttydisc_read(d6276a00,daba5bb8,0,d2,c1919d28,...) at ttydisc_read+0x238/frame 0xdaba5ac0 ttydev_read(d86aec00,daba5bb8,0,dc6b8000,daba5b6c,...) at ttydev_read+0x55/frame 0xdaba5ae0 devfs_read_f(d8adf6c8,daba5bb8,d858ac00,0,dc6b8000,...) at devfs_read_f+0xc5/frame 0xdaba5b18 dofileread(d8adf6c8,daba5bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xdaba5b48 kern_readv(dc6b8000,0,daba5bb8,daba5be8,bfbfede1,...) at kern_readv+0x93/frame 0xdaba5b98 sys_read(dc6b8000,dc6b8280,c164301b,4,3ec3f1e6,...) at sys_read+0x54/frame 0xdaba5be8 syscall(daba5ce8) at syscall+0x6ee/frame 0xdaba5cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdaba5cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282146df, esp = 0xbfbfedb4, ebp = 0xbfbfedc8 --- Tracing command getty pid 827 tid 100187 td 0xdc6b8380 sched_switch(dc6b8380,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xdaba0940 mi_switch(104,0,c1654159,22b,dc6b8380,...) at mi_switch+0x1f3/frame 0xdaba097c sleepq_switch(dc6b8380,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdaba09b0 sleepq_catch_signals(daba0a18,c0c549a0,d6276c14,0,0,...) at sleepq_catch_signals+0x360/frame 0xdaba09f4 sleepq_wait_sig(d6276c74,0,daba0a38,101,0,...) at sleepq_wait_sig+0x14/frame 0xdaba0a18 _cv_wait_sig(d6276c74,d6276c04,c165a0d5,5aa,daba0bb8,...) at _cv_wait_sig+0x21f/frame 0xdaba0a5c tty_wait(d6276c00,d6276c74,daba0bb8,1,0,...) at tty_wait+0x4b/frame 0xdaba0a80 ttydisc_read(d6276c00,daba0bb8,0,d2,c1919d28,...) at ttydisc_read+0x238/frame 0xdaba0ac0 ttydev_read(d86aee00,daba0bb8,0,dc6b8380,daba0b6c,...) at ttydev_read+0x55/frame 0xdaba0ae0 devfs_read_f(d8adf620,daba0bb8,d858aa00,0,dc6b8380,...) at devfs_read_f+0xc5/frame 0xdaba0b18 dofileread(d8adf620,daba0bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xdaba0b48 kern_readv(dc6b8380,0,daba0bb8,daba0be8,bfbfede1,...) at kern_readv+0x93/frame 0xdaba0b98 sys_read(dc6b8380,dc6b8600,c164301b,4,3ec3f1e6,...) at sys_read+0x54/frame 0xdaba0be8 syscall(daba0ce8) at syscall+0x6ee/frame 0xdaba0cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdaba0cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282146df, esp = 0xbfbfedb4, ebp = 0xbfbfedc8 --- Tracing command getty pid 826 tid 100186 td 0xdc6b8700 sched_switch(dc6b8700,0,104,188,c1b480c0,...) at sched_switch+0x503/frame 0xdab9b940 mi_switch(104,0,c1654159,22b,dc6b8700,...) at mi_switch+0x1f3/frame 0xdab9b97c sleepq_switch(dc6b8700,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdab9b9b0 sleepq_catch_signals(dab9ba18,c0c549a0,d6276e14,0,0,...) at sleepq_catch_signals+0x360/frame 0xdab9b9f4 sleepq_wait_sig(d6276e74,0,dab9ba38,101,0,...) at sleepq_wait_sig+0x14/frame 0xdab9ba18 _cv_wait_sig(d6276e74,d6276e04,c165a0d5,5aa,dab9bbb8,...) at _cv_wait_sig+0x21f/frame 0xdab9ba5c tty_wait(d6276e00,d6276e74,dab9bbb8,1,0,...) at tty_wait+0x4b/frame 0xdab9ba80 ttydisc_read(d6276e00,dab9bbb8,0,d2,c1919d28,...) at ttydisc_read+0x238/frame 0xdab9bac0 ttydev_read(d86af100,dab9bbb8,0,dc6b8700,dab9bb6c,...) at ttydev_read+0x55/frame 0xdab9bae0 devfs_read_f(d8adf540,dab9bbb8,cb7f5100,0,dc6b8700,...) at devfs_read_f+0xc5/frame 0xdab9bb18 dofileread(d8adf540,dab9bbb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xdab9bb48 kern_readv(dc6b8700,0,dab9bbb8,dab9bbe8,bfbfede1,...) at kern_readv+0x93/frame 0xdab9bb98 sys_read(dc6b8700,dc6b8980,c164301b,4,3ec3f1e6,...) at sys_read+0x54/frame 0xdab9bbe8 syscall(dab9bce8) at syscall+0x6ee/frame 0xdab9bcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdab9bcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282146df, esp = 0xbfbfedb4, ebp = 0xbfbfedc8 --- Tracing command getty pid 825 tid 100172 td 0xdc686000 sched_switch(dc686000,0,104,188,c1b480c0,...) at sched_switch+0x503/frame 0xdab4f940 mi_switch(104,0,c1654159,22b,dc686000,...) at mi_switch+0x1f3/frame 0xdab4f97c sleepq_switch(dc686000,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdab4f9b0 sleepq_catch_signals(dab4fa18,c0c549a0,d6277014,0,0,...) at sleepq_catch_signals+0x360/frame 0xdab4f9f4 sleepq_wait_sig(d6277074,0,dab4fa38,101,0,...) at sleepq_wait_sig+0x14/frame 0xdab4fa18 _cv_wait_sig(d6277074,d6277004,c165a0d5,5aa,dab4fbb8,...) at _cv_wait_sig+0x21f/frame 0xdab4fa5c tty_wait(d6277000,d6277074,dab4fbb8,1,0,...) at tty_wait+0x4b/frame 0xdab4fa80 ttydisc_read(d6277000,dab4fbb8,0,d2,c1919d28,...) at ttydisc_read+0x238/frame 0xdab4fac0 ttydev_read(d86af300,dab4fbb8,0,dc686000,dab4fb6c,...) at ttydev_read+0x55/frame 0xdab4fae0 devfs_read_f(d8adf770,dab4fbb8,d858b900,0,dc686000,...) at devfs_read_f+0xc5/frame 0xdab4fb18 dofileread(d8adf770,dab4fbb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xdab4fb48 kern_readv(dc686000,0,dab4fbb8,dab4fbe8,bfbfede1,...) at kern_readv+0x93/frame 0xdab4fb98 sys_read(dc686000,dc686280,c164301b,4,3ec3f1e6,...) at sys_read+0x54/frame 0xdab4fbe8 syscall(dab4fce8) at syscall+0x6ee/frame 0xdab4fcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdab4fcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282146df, esp = 0xbfbfedb4, ebp = 0xbfbfedc8 --- Tracing command getty pid 824 tid 100171 td 0xdc686380 sched_switch(dc686380,0,104,188,c1b480c0,...) at sched_switch+0x503/frame 0xdab4a940 mi_switch(104,0,c1654159,22b,dc686380,...) at mi_switch+0x1f3/frame 0xdab4a97c sleepq_switch(dc686380,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdab4a9b0 sleepq_catch_signals(dab4aa18,c0c549a0,d6277214,0,0,...) at sleepq_catch_signals+0x360/frame 0xdab4a9f4 sleepq_wait_sig(d6277274,0,dab4aa38,101,0,...) at sleepq_wait_sig+0x14/frame 0xdab4aa18 _cv_wait_sig(d6277274,d6277204,c165a0d5,5aa,dab4abb8,...) at _cv_wait_sig+0x21f/frame 0xdab4aa5c tty_wait(d6277200,d6277274,dab4abb8,1,0,...) at tty_wait+0x4b/frame 0xdab4aa80 ttydisc_read(d6277200,dab4abb8,0,d2,c1919d28,...) at ttydisc_read+0x238/frame 0xdab4aac0 ttydev_read(d86af500,dab4abb8,0,dc686380,dab4ab6c,...) at ttydev_read+0x55/frame 0xdab4aae0 devfs_read_f(d8afbc40,dab4abb8,cb7f5200,0,dc686380,...) at devfs_read_f+0xc5/frame 0xdab4ab18 dofileread(d8afbc40,dab4abb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xdab4ab48 kern_readv(dc686380,0,dab4abb8,dab4abe8,bfbfede1,...) at kern_readv+0x93/frame 0xdab4ab98 sys_read(dc686380,dc686600,c164301b,4,c18578ef,...) at sys_read+0x54/frame 0xdab4abe8 syscall(dab4ace8) at syscall+0x6ee/frame 0xdab4acdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdab4acdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282146df, esp = 0xbfbfedb4, ebp = 0xbfbfedc8 --- Tracing command getty pid 823 tid 100166 td 0xdc573a80 sched_switch(dc573a80,0,104,188,c1b48780,...) at sched_switch+0x503/frame 0xdab2e940 mi_switch(104,0,c1654159,22b,dc573a80,...) at mi_switch+0x1f3/frame 0xdab2e97c sleepq_switch(dc573a80,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdab2e9b0 sleepq_catch_signals(dab2ea18,c0c549a0,d6277414,0,0,...) at sleepq_catch_signals+0x360/frame 0xdab2e9f4 sleepq_wait_sig(d6277474,0,dab2ea38,101,0,...) at sleepq_wait_sig+0x14/frame 0xdab2ea18 _cv_wait_sig(d6277474,d6277404,c165a0d5,5aa,dab2ebb8,...) at _cv_wait_sig+0x21f/frame 0xdab2ea5c tty_wait(d6277400,d6277474,dab2ebb8,1,0,...) at tty_wait+0x4b/frame 0xdab2ea80 ttydisc_read(d6277400,dab2ebb8,0,d2,c1919d28,...) at ttydisc_read+0x238/frame 0xdab2eac0 ttydev_read(d86af700,dab2ebb8,0,dc573a80,dab2eb6c,...) at ttydev_read+0x55/frame 0xdab2eae0 devfs_read_f(d8ae01c0,dab2ebb8,d858ab00,0,dc573a80,...) at devfs_read_f+0xc5/frame 0xdab2eb18 dofileread(d8ae01c0,dab2ebb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xdab2eb48 kern_readv(dc573a80,0,dab2ebb8,dab2ebe8,bfbfede1,...) at kern_readv+0x93/frame 0xdab2eb98 sys_read(dc573a80,dc573d00,c164301b,4,c18578ef,...) at sys_read+0x54/frame 0xdab2ebe8 syscall(dab2ece8) at syscall+0x6ee/frame 0xdab2ecdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdab2ecdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282146df, esp = 0xbfbfedb4, ebp = 0xbfbfedc8 --- Tracing command getty pid 822 tid 100180 td 0xd8313700 sched_switch(d8313700,0,104,188,c1b49500,...) at sched_switch+0x503/frame 0xdab78940 mi_switch(104,0,c1654159,22b,d8313700,...) at mi_switch+0x1f3/frame 0xdab7897c sleepq_switch(d8313700,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdab789b0 sleepq_catch_signals(dab78a18,c0c549a0,d6277614,0,0,...) at sleepq_catch_signals+0x360/frame 0xdab789f4 sleepq_wait_sig(d6277674,0,dab78a38,101,0,...) at sleepq_wait_sig+0x14/frame 0xdab78a18 _cv_wait_sig(d6277674,d6277604,c165a0d5,5aa,dab78bb8,...) at _cv_wait_sig+0x21f/frame 0xdab78a5c tty_wait(d6277600,d6277674,dab78bb8,1,0,...) at tty_wait+0x4b/frame 0xdab78a80 ttydisc_read(d6277600,dab78bb8,0,d2,c1919d28,...) at ttydisc_read+0x238/frame 0xdab78ac0 ttydev_read(d86af900,dab78bb8,0,d8313700,dab78b6c,...) at ttydev_read+0x55/frame 0xdab78ae0 devfs_read_f(d8adf818,dab78bb8,d858b800,0,d8313700,...) at devfs_read_f+0xc5/frame 0xdab78b18 dofileread(d8adf818,dab78bb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0xdab78b48 kern_readv(d8313700,0,dab78bb8,dab78be8,bfbfede1,...) at kern_readv+0x93/frame 0xdab78b98 sys_read(d8313700,d8313980,c164301b,4,c18578ef,...) at sys_read+0x54/frame 0xdab78be8 syscall(dab78ce8) at syscall+0x6ee/frame 0xdab78cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdab78cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282146df, esp = 0xbfbfedb4, ebp = 0xbfbfedc8 --- Tracing command inetd pid 805 tid 100122 td 0xd8421700 sched_switch(d8421700,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xdbf4e5c8 mi_switch(104,0,c1654159,22b,d8421700,...) at mi_switch+0x1f3/frame 0xdbf4e604 sleepq_switch(d8421700,0,c1654159,2d6,9da3,...) at sleepq_switch+0x110/frame 0xdbf4e638 sleepq_timedwait(dc6c98e0,50,13,0,0,...) at sleepq_timedwait+0x53/frame 0xdbf4e674 _sleep(dc6c98e0,dc6c9888,50,c169e6ca,ffffe8e0,...) at _sleep+0x332/frame 0xdbf4e6c8 swap_pager_getpages(dc6c9888,dbf4e798,1,dbf4e800,dbf4e804,...) at swap_pager_getpages+0x688/frame 0xdbf4e730 vm_pager_get_pages(dc6c9888,dbf4e798,1,dbf4e800,dbf4e804,...) at vm_pager_get_pages+0x53/frame 0xdbf4e768 vm_fault_hold(d6101e40,bfbfe000,2,0,0,...) at vm_fault_hold+0xe86/frame 0xdbf4e848 vm_fault(d6101e40,bfbfe000,2,0,0,...) at vm_fault+0x83/frame 0xdbf4e870 trap_pfault(bfbfe5c0,188,c123d8d0,c1b48e40,0,...) at trap_pfault+0x109/frame 0xdbf4e8b8 trap(dbf4e9b8) at trap+0x3c2/frame 0xdbf4e9ac calltrap() at calltrap+0x6/frame 0xdbf4e9ac --- trap 0xc, eip = 0xc124c6d5, esp = 0xdbf4e9f8, ebp = 0xdbf4eba0 --- copyout(d8421700,9,bfbfe5c0,0,0,...) at copyout+0x35/frame 0xdbf4eba0 sys_select(d8421700,d8421980,c164301b,4,c18578ef,...) at sys_select+0x68/frame 0xdbf4ebe8 syscall(dbf4ece8) at syscall+0x6ee/frame 0xdbf4ecdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdbf4ecdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x282276cf, esp = 0xbfbfdfec, ebp = 0xbfbfe010 --- Tracing command nfscbd pid 771 tid 100106 td 0xd8314700 sched_switch(d8314700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdbebb7e8 mi_switch(104,0,c1654159,22b,d8314700,...) at mi_switch+0x1f3/frame 0xdbebb828 sleepq_switch(d8314700,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdbebb85c sleepq_catch_signals(8,c1648c33,cb,d8314700,d8314700,...) at sleepq_catch_signals+0x360/frame 0xdbebb8a0 sleepq_timedwait_sig(d87c53d0,0,dbebb904,0,0,...) at sleepq_timedwait_sig+0x17/frame 0xdbebb8e0 _cv_timedwait_sig_sbt(d87c53d0,d82660c0,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x24a/frame 0xdbebb928 svc_run_internal(c0f31a00,d82660c0,d8272358,dbebba30,0,...) at svc_run_internal+0xb2c/frame 0xdbebba04 svc_run(d8266000,0,c162fa56,f5,dbebbac8,...) at svc_run+0x1ed/frame 0xdbebba58 nfscbd_nfsd(d8314700,dbebbb30,4,0,0,...) at nfscbd_nfsd+0x105/frame 0xdbebbaf8 nfssvc_nfscl(d8314700,d8314980,0,d8314700,dbebbcdc,...) at nfssvc_nfscl+0x279/frame 0xdbebbbd0 sys_nfssvc(d8314700,d8314980,c164301b,4,dbebbc48,...) at sys_nfssvc+0xa6/frame 0xdbebbbe8 syscall(dbebbce8) at syscall+0x6ee/frame 0xdbebbcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdbebbcdc --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280c0fff, esp = 0xbfbfeb0c, ebp = 0xbfbfee28 --- Tracing command nfscbd pid 771 tid 100176 td 0xdc6b9380 sched_switch(dc6b9380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdab60aa8 mi_switch(104,0,c1654159,22b,dc6b9380,...) at mi_switch+0x1f3/frame 0xdab60ae8 sleepq_switch(dc6b9380,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdab60b1c sleepq_catch_signals(dab60b84,c0c549a0,d82660d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdab60b60 sleepq_wait_sig(d85719d0,0,dab60ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdab60b84 _cv_wait_sig(d85719d0,d82660c0,c1691f4b,439,1,...) at _cv_wait_sig+0x21f/frame 0xdab60bc8 svc_run_internal(dab60cd4,c0c355ce,d82660c0,dab60ce8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdab60ca4 svc_thread_start(d82660c0,dab60ce8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdab60cac fork_exit(c0f31a00,d82660c0,dab60ce8) at fork_exit+0x7e/frame 0xdab60cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdab60cd4 --- trap 0x28221178, eip = 0, esp = 0xdab60d20, ebp = 0x1 --- Tracing command nfscbd pid 771 tid 100177 td 0xdc6b9000 sched_switch(dc6b9000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdab65aa8 mi_switch(104,0,c1654159,22b,dc6b9000,...) at mi_switch+0x1f3/frame 0xdab65ae8 sleepq_switch(dc6b9000,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdab65b1c sleepq_catch_signals(dab65b84,c0c549a0,d82660d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdab65b60 sleepq_wait_sig(d8571950,0,dab65ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdab65b84 _cv_wait_sig(d8571950,d82660c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdab65bc8 svc_run_internal(dab65cd4,c0c355ce,d82660c0,dab65ce8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdab65ca4 svc_thread_start(d82660c0,dab65ce8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdab65cac fork_exit(c0f31a00,d82660c0,dab65ce8) at fork_exit+0x7e/frame 0xdab65cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdab65cd4 --- trap 0x28221178, eip = 0, esp = 0xdab65d20, ebp = 0x1 --- Tracing command nfscbd pid 771 tid 100178 td 0xdc6b8a80 sched_switch(dc6b8a80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdab6aaa8 mi_switch(104,0,c1654159,22b,dc6b8a80,...) at mi_switch+0x1f3/frame 0xdab6aae8 sleepq_switch(dc6b8a80,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdab6ab1c sleepq_catch_signals(dab6ab84,c0c549a0,d82660d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdab6ab60 sleepq_wait_sig(d85718d0,0,dab6aba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdab6ab84 _cv_wait_sig(d85718d0,d82660c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdab6abc8 svc_run_internal(dab6acd4,c0c355ce,d82660c0,dab6ace8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdab6aca4 svc_thread_start(d82660c0,dab6ace8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdab6acac fork_exit(c0f31a00,d82660c0,dab6ace8) at fork_exit+0x7e/frame 0xdab6acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdab6acd4 --- trap 0x28221178, eip = 0, esp = 0xdab6ad20, ebp = 0x1 --- Tracing command nfscbd pid 770 tid 100165 td 0xdc686700 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c16523c0,c0ae14c5,c18fb198,c18fb27c,d7e502e8,...) at db_trace_self_wrapper+0x2a/frame 0xd7e502b0 kdb_backtrace(c165243d,c0cd34bf,d7e50420,c124e305,c1654ce5,...) at kdb_backtrace+0x2d/frame 0xd7e50318 kdb_reenter(c1654ce5,244,c0a793d5,aa2d5b0,700,...) at kdb_reenter+0x2a/frame 0xd7e50328 trap(d7e5042c) at trap+0xb5/frame 0xd7e50420 calltrap() at calltrap+0x6/frame 0xd7e50420 --- trap 0xc, eip = 0xc1238559, esp = 0xd7e5046c, ebp = 0xd7e50488 --- db_trace_thread(dc686700,ffffffff,302,18745,dc686700,...) at db_trace_thread+0x29/frame 0xd7e50488 _db_stack_trace_all(c0cbe30a,0,ffffffff,d7e50520,c19620d0,...) at _db_stack_trace_all+0xe9/frame 0xd7e504f4 db_command(c1962f19,0,c1bd9ac4,c1962f18,60,...) at db_command+0x297/frame 0xd7e505a8 db_script_exec(c1bbeab8,0,d7e50650,d7e50644,c19620d0,...) at db_script_exec+0x168/frame 0xd7e50618 db_command(c12aedc3,d7e50730,c05b00ad,c12cedc2,ffff0ff0,...) at db_command+0x297/frame 0xd7e506cc db_command_loop(c12cedc2,ffff0ff0,d7e506f7,d7e506f6,d621b000,...) at db_command_loop+0x50/frame 0xd7e506d8 db_trap(3,ffff0ff0,7,0,1,...) at db_trap+0x10d/frame 0xd7e50730 kdb_trap(3,ffff0ff0,d7e5086c,d7e50818,0,...) at kdb_trap+0x11e/frame 0xd7e50768 trap(d7e5086c) at trap+0x817/frame 0xd7e50860 calltrap() at calltrap+0x6/frame 0xd7e50860 --- trap 0x3, eip = 0xc0cbe30a, esp = 0xd7e508ac, ebp = 0xd7e508b8 --- kdb_enter(c12cedc2,c1351ca5,0,2250045,ffffffff) at kdb_enter+0x3a/frame 0xd7e508b8 watchdog_fire(1,8,c18578ef,d7e50928,0,...) at watchdog_fire+0xac/frame 0xd7e508e0 hardclock_cnt(1,0,c18578ef,e0,9e524c0,...) at hardclock_cnt+0x26a/frame 0xd7e50928 handleevents(0,9d9a,1,cb7acc40,9d9a,...) at handleevents+0xfe/frame 0xd7e50970 timercb(c1bd80e4,0,3,3,d7e50a78,...) at timercb+0x25d/frame 0xd7e509ac lapic_handle_timer(d7e509d8) at lapic_handle_timer+0x80/frame 0xd7e509cc Xtimerint_pti(d7e50a78,d615a44c,c6dc06b8,0,246,...) at Xtimerint_pti+0x2b/frame 0xd7e50a38 __mtx_lock_sleep(cb7de970,d63d3a80,0,c167bbe3,1ec,...) at __mtx_lock_sleep+0xd8/frame 0xd7e50aa8 __mtx_lock_flags(cb7de970,0,c167bbe3,1ec,d615a380,...) at __mtx_lock_flags+0x107/frame 0xd7e50ad8 ipreass_slowtimo(c1be75a4,c167b18c,349,95c2,c1648c33,...) at ipreass_slowtimo+0x53/frame 0xd7e50b28 ip_slowtimo(c1be50c0,8,c194d860,d7e50b88,c0c86e22,...) at ip_slowtimo+0x6d/frame 0xd7e50b54 pfslowtimo(0,0,c164e8c1,2b3,3f,...) at pfslowtimo+0x50/frame 0xd7e50b88 softclock_call_cc(0,0,c164e8c1,362,c1be50d0,...) at softclock_call_cc+0x16e/frame 0xd7e50c20 softclock(c1be50c0,0,d615a380,c1b49500,d60efc48,...) at softclock+0x84/frame 0xd7e50c48 intr_event_execute_handlers(c1b49510,d60efc00,c1643981,5ac,c16435dc,...) at intr_event_execute_handlers+0x8e/frame 0xd7e50c70 ithread_loop(d6157ed0,d7e50ce8,c16435dc,407,0,...) at ithread_loop+0xa0/frame 0xd7e50cac fork_exit(c0c38860,d6157ed0,d7e50ce8) at fork_exit+0x7e/frame 0xd7e50cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e50cd4 --- trap 0, eip = 0, esp = 0xd7e50d20, ebp = 0 --- Tracing command cron pid 681 tid 100111 td 0xd852e000 sched_switch(d852e000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdbedf748 mi_switch(104,0,c1654159,22b,d852e000,...) at mi_switch+0x1f3/frame 0xdbedf788 sleepq_switch(d852e000,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xdbedf7bc sleepq_wait(c1b5b780,0,dbedf800,1,0,...) at sleepq_wait+0x48/frame 0xdbedf7e0 _cv_wait(c1b5b780,c1b5b740,c1655993,362,2002,...) at _cv_wait+0x21f/frame 0xdbedf824 vmem_xalloc(c1b5b740,400000,0,0,0,...) at vmem_xalloc+0x1df/frame 0xdbedf888 vmem_alloc(c1b5b740,400000,2002,dbedf8d8,0,...) at vmem_alloc+0xcc/frame 0xdbedf8c0 vmem_xalloc(c2381000,1000,0,0,0,...) at vmem_xalloc+0x417/frame 0xdbedf924 vmem_alloc(c2381000,1000,2002,dbedf978,f81ff898,...) at vmem_alloc+0xcc/frame 0xdbedf95c kmem_malloc_domain(0,1000,2) at kmem_malloc_domain+0x44/frame 0xdbedf988 page_alloc(c238b3c0,1000,0,dbedf9d3,2,...) at page_alloc+0x26/frame 0xdbedf9a0 keg_alloc_slab(0,102,c169eb97,94c,c6db8a00,...) at keg_alloc_slab+0xf6/frame 0xdbedf9e8 keg_fetch_slab(ffffffff,102,c169eb97,9ae,6,...) at keg_fetch_slab+0x10e/frame 0xdbedfa40 zone_fetch_slab(c238b3c0,0,ffffffff,102,c193f80c,...) at zone_fetch_slab+0x61/frame 0xdbedfa64 zone_import(c238b3c0,c239c01c,1,ffffffff,102,...) at zone_import+0x3b/frame 0xdbedfa9c uma_zalloc_arg(c238b3c0,0,102,c0c55115,c1910478,...) at uma_zalloc_arg+0x357/frame 0xdbedfad8 malloc(abc,c1910f84,102,d852d410,d852d358,...) at malloc+0x116/frame 0xdbedfb14 sigacts_alloc(d8999768,0,c16435dc,1ae,200246,...) at sigacts_alloc+0x23/frame 0xdbedfb30 fork1(d852e000,dbedfbc0,0,0,14,...) at fork1+0xc5b/frame 0xdbedfba8 sys_fork(d852e000,d852e280,c164301b,4,3ec3f1e6,...) at sys_fork+0x55/frame 0xdbedfbe8 syscall(dbedfce8) at syscall+0x6ee/frame 0xdbedfcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdbedfcdc --- syscall (2, FreeBSD ELF32, sys_fork), eip = 0x281b4f93, esp = 0xbfbfec50, ebp = 0xbfbfec58 --- Tracing command sendmail pid 677 tid 100162 td 0xdc686a80 sched_switch(dc686a80,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xdab19a48 mi_switch(104,0,c1654159,22b,dc686a80,...) at mi_switch+0x1f3/frame 0xdab19a84 sleepq_switch(dc686a80,0,c1654159,1ca,74,...) at sleepq_switch+0x110/frame 0xdab19ab8 sleepq_catch_signals(0,c1654159,178,c1b594d4,dc686a80,...) at sleepq_catch_signals+0x360/frame 0xdab19afc sleepq_wait_sig(d899aa6c,74,c13737cf,100,0,...) at sleepq_wait_sig+0x14/frame 0xdab19b20 _sleep(d899aa6c,d899aab0,174,c13737cf,0,...) at _sleep+0x386/frame 0xdab19b74 kern_sigsuspend(dc686a80,0,0,0,0,...) at kern_sigsuspend+0xd4/frame 0xdab19bb8 sys_sigsuspend(dc686a80,dc686d00,c164301b,4,3ec3f1e6,...) at sys_sigsuspend+0x55/frame 0xdab19be8 syscall(dab19ce8) at syscall+0x6ee/frame 0xdab19cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdab19cdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2845fef3, esp = 0xbfbfda5c, ebp = 0xbfbfda68 --- Tracing command sendmail pid 674 tid 100164 td 0xdc6ba000 sched_switch(dc6ba000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdab247f8 mi_switch(104,0,c1654159,22b,dc6ba000,...) at mi_switch+0x1f3/frame 0xdab24838 sleepq_switch(dc6ba000,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xdab2486c sleepq_wait(c1b5b780,0,dab248b0,1,0,...) at sleepq_wait+0x48/frame 0xdab24890 _cv_wait(c1b5b780,c1b5b740,c1655993,362,2002,...) at _cv_wait+0x21f/frame 0xdab248d4 vmem_xalloc(c1b5b740,400000,0,0,0,...) at vmem_xalloc+0x1df/frame 0xdab24938 vmem_alloc(c1b5b740,400000,2002,dab24988,0,...) at vmem_alloc+0xcc/frame 0xdab24970 vmem_xalloc(c2381000,1000,0,0,0,...) at vmem_xalloc+0x417/frame 0xdab249d4 vmem_alloc(c2381000,1000,2002,dab24a28,f81fff20,...) at vmem_alloc+0xcc/frame 0xdab24a0c kmem_malloc_domain(0,1000,2) at kmem_malloc_domain+0x44/frame 0xdab24a38 page_alloc(c238b280,1000,0,dab24a83,2,...) at page_alloc+0x26/frame 0xdab24a50 keg_alloc_slab(0,2,c169eb97,94c,c6db8a00,...) at keg_alloc_slab+0xf6/frame 0xdab24a98 keg_fetch_slab(ffffffff,2,c169eb97,9ae,6,...) at keg_fetch_slab+0x10e/frame 0xdab24af0 zone_fetch_slab(c238b280,0,ffffffff,2,c193f80c,...) at zone_fetch_slab+0x61/frame 0xdab24b14 zone_import(c238b280,c239c02c,1,ffffffff,2,...) at zone_import+0x3b/frame 0xdab24b4c uma_zalloc_arg(c238b280,0,2,dc6b6a08,dab24be8,...) at uma_zalloc_arg+0x357/frame 0xdab24b88 malloc(928,c191def8,2,0,0,...) at malloc+0x116/frame 0xdab24bc4 sys_statfs(dc6ba000,dc6ba280,c164301b,4,c1b48e40,...) at sys_statfs+0x2b/frame 0xdab24be8 syscall(dab24ce8) at syscall+0x6ee/frame 0xdab24cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdab24cdc --- syscall (555, FreeBSD ELF32, sys_statfs), eip = 0x283dcc77, esp = 0xbfbfc454, ebp = 0xbfbfc658 --- Tracing command sshd pid 671 tid 100160 td 0xdc6ba380 sched_switch(dc6ba380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdaafd8b0 mi_switch(104,0,c1654159,22b,dc6ba380,...) at mi_switch+0x1f3/frame 0xdaafd8f0 sleepq_switch(dc6ba380,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdaafd924 sleepq_catch_signals(daafd98c,c0c549a0,d85f1320,0,0,...) at sleepq_catch_signals+0x360/frame 0xdaafd968 sleepq_wait_sig(d85f1324,0,daafd9ac,101,0,...) at sleepq_wait_sig+0x14/frame 0xdaafd98c _cv_wait_sig(d85f1324,d85f1310,c1657937,73d,dc219200,...) at _cv_wait_sig+0x21f/frame 0xdaafd9d0 seltdwait(ffffffff,0,0,dc6ba380,0,...) at seltdwait+0xbb/frame 0xdaafda00 kern_select(dc6ba380,9,280c3158,0,0,...) at kern_select+0x876/frame 0xdaafdba0 sys_select(dc6ba380,dc6ba600,c164301b,4,3ec3f1e6,...) at sys_select+0x68/frame 0xdaafdbe8 syscall(daafdce8) at syscall+0x6ee/frame 0xdaafdcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdaafdcdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2855b6cf, esp = 0xbfbfe7f4, ebp = 0xbfbfe818 --- Tracing command smartd pid 633 tid 100163 td 0xdc574000 sched_switch(dc574000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdab1e9f0 mi_switch(104,0,c1654159,22b,dc574000,...) at mi_switch+0x1f3/frame 0xdab1ea30 sleepq_switch(dc574000,0,c1654159,1ca,6c,...) at sleepq_switch+0x110/frame 0xdab1ea64 sleepq_catch_signals(dc574000,2,601,dab1eae4,a1c4,...) at sleepq_catch_signals+0x360/frame 0xdab1eaa8 sleepq_timedwait_sig(c1b3ae96,6c,a1c4,80000000,70,...) at sleepq_timedwait_sig+0x17/frame 0xdab1eae4 _sleep(c1b3ae96,0,16c,c164e779,fda102cc,...) at _sleep+0x31a/frame 0xdab1eb38 kern_clock_nanosleep(dc574000,0,0,dab1ebc8,dab1ebc0,...) at kern_clock_nanosleep+0x1e2/frame 0xdab1eba0 sys_nanosleep(dc574000,dc574280,c164301b,4,c18578ef,...) at sys_nanosleep+0x7f/frame 0xdab1ebe8 syscall(dab1ece8) at syscall+0x6ee/frame 0xdab1ecdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdab1ecdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28341f73, esp = 0xbfbf9f50, ebp = 0xbfbf9f68 --- Tracing command powerd pid 603 tid 100117 td 0xd61d6a80 sched_switch(d61d6a80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdbf08540 mi_switch(104,0,c1654159,22b,d61d6a80,...) at mi_switch+0x1f3/frame 0xdbf08580 sleepq_switch(d61d6a80,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xdbf085b4 sleepq_wait(c1b5b780,0,dbf085f8,1,0,...) at sleepq_wait+0x48/frame 0xdbf085d8 _cv_wait(c1b5b780,c1b5b740,c1655993,362,2002,...) at _cv_wait+0x21f/frame 0xdbf0861c vmem_xalloc(c1b5b740,400000,0,0,0,...) at vmem_xalloc+0x1df/frame 0xdbf08680 vmem_alloc(c1b5b740,400000,2002,dbf086d0,0,...) at vmem_alloc+0xcc/frame 0xdbf086b8 vmem_xalloc(c2381000,1000,0,0,0,...) at vmem_xalloc+0x417/frame 0xdbf0871c vmem_alloc(c2381000,1000,2002,dbf08770,c169eb97,...) at vmem_alloc+0xcc/frame 0xdbf08754 kmem_malloc_domain(0,1000,2) at kmem_malloc_domain+0x44/frame 0xdbf08780 page_alloc(c2386b40,1000,0,dbf087cb,2,...) at page_alloc+0x26/frame 0xdbf08798 keg_alloc_slab(0,102,c169eb97,94c,c6db8a00,...) at keg_alloc_slab+0xf6/frame 0xdbf087e0 keg_fetch_slab(ffffffff,102,c169eb97,9ae,6,...) at keg_fetch_slab+0x10e/frame 0xdbf08838 zone_fetch_slab(c2386b40,0,ffffffff,102,c193f86c,...) at zone_fetch_slab+0x61/frame 0xdbf0885c zone_import(c2386b40,f9875d0c,3d,ffffffff,102,...) at zone_import+0x3b/frame 0xdbf08894 uma_zalloc_arg(c2386b40,0,102,22b,0,...) at uma_zalloc_arg+0x357/frame 0xdbf088d0 malloc(a4,c190e53c,102,c6daeac0,200246,...) at malloc+0x116/frame 0xdbf0890c acpi_battery_get_battinfo(0,dbf08980,c1640b0a,8a,c1be4458,...) at acpi_battery_get_battinfo+0x8f/frame 0xdbf08960 apmioctl(d61d8900,4040500b,dbf08b50,1,d61d6a80,...) at apmioctl+0x338/frame 0xdbf089ac devfs_ioctl(dbf08a38,c1863338,d61d6a80,0,dbf08a8c,...) at devfs_ioctl+0x8c/frame 0xdbf089e4 VOP_IOCTL_APV(c18fdbe0,dbf08a38,c0c71623,0,0,...) at VOP_IOCTL_APV+0xf6/frame 0xdbf08a10 vn_ioctl(d8adf9a0,4040500b,dbf08b50,d87cb900,d61d6a80,...) at vn_ioctl+0x11b/frame 0xdbf08ac8 devfs_ioctl_f(d8adf9a0,4040500b,dbf08b50,d87cb900,d61d6a80,...) at devfs_ioctl_f+0x3d/frame 0xdbf08af0 kern_ioctl(d61d6a80,5,4040500b,dbf08b50,200246,...) at kern_ioctl+0x2b9/frame 0xdbf08b30 sys_ioctl(d61d6a80,d61d6d00,c164301b,4,c18578ef,...) at sys_ioctl+0x118/frame 0xdbf08be8 syscall(dbf08ce8) at syscall+0x6ee/frame 0xdbf08cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdbf08cdc --- syscall (54, FreeBSD ELF32, sys_ioctl), eip = 0x2821172f, esp = 0xbfbfe8e4, ebp = 0xbfbfed18 --- Tracing command ntpd pid 600 tid 100159 td 0xdc574380 sched_switch(dc574380,0,104,188,c1b48780,...) at sched_switch+0x503/frame 0xdaaf84c8 mi_switch(104,0,c1654159,22b,dc574380,...) at mi_switch+0x1f3/frame 0xdaaf8504 sleepq_switch(dc574380,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xdaaf8538 sleepq_wait(c1b5b780,0,daaf857c,1,0,...) at sleepq_wait+0x48/frame 0xdaaf855c _cv_wait(c1b5b780,c1b5b740,c1655993,362,c1910680,...) at _cv_wait+0x21f/frame 0xdaaf85a0 vmem_xalloc(c1b5b740,400000,0,0,0,...) at vmem_xalloc+0x1df/frame 0xdaaf8604 vmem_alloc(c1b5b740,400000,2002,daaf8654,0,...) at vmem_alloc+0xcc/frame 0xdaaf863c vmem_xalloc(c2381000,10000,0,0,0,...) at vmem_xalloc+0x417/frame 0xdaaf86a0 vmem_alloc(c2381000,10000,2002,daaf86f4,f978a790,...) at vmem_alloc+0xcc/frame 0xdaaf86d8 kmem_malloc_domain(0,10000,2) at kmem_malloc_domain+0x44/frame 0xdaaf8704 page_alloc(c2391140,10000,0,daaf874f,2,...) at page_alloc+0x26/frame 0xdaaf871c keg_alloc_slab(0,2,c169eb97,94c,c6db8a00,...) at keg_alloc_slab+0xf6/frame 0xdaaf8764 keg_fetch_slab(ffffffff,2,c169eb97,9ae,3,...) at keg_fetch_slab+0x10e/frame 0xdaaf87bc zone_fetch_slab(c2391140,0,ffffffff,2,c193f80c,...) at zone_fetch_slab+0x61/frame 0xdaaf87e0 zone_import(c2391140,c239c03c,1,ffffffff,2,...) at zone_import+0x3b/frame 0xdaaf8818 uma_zalloc_arg(c2391140,0,2,200,d852c000,...) at uma_zalloc_arg+0x357/frame 0xdaaf8854 malloc(10000,c190e53c,2,daaf8ce8,0,...) at malloc+0x116/frame 0xdaaf8890 sysctl_rtsock(c1921364,daaf8b7c,4,0,daaf8af8,...) at sysctl_rtsock+0x11c/frame 0xdaaf8a44 sysctl_root_handler_locked(4,0,daaf8af8,daaf8aa0,daaf8af8,...) at sysctl_root_handler_locked+0xac/frame 0xdaaf8a70 sysctl_root(0,daaf8af8,4,0,0,...) at sysctl_root+0x255/frame 0xdaaf8ad0 userland_sysctl(dc574380,daaf8b74,6,0,bfbfe520,...) at userland_sysctl+0x190/frame 0xdaaf8b44 sys___sysctl(dc574380,dc574600,c164301b,4,3ec3f1e6,...) at sys___sysctl+0x8e/frame 0xdaaf8be8 syscall(daaf8ce8) at syscall+0x6ee/frame 0xdaaf8cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdaaf8cdc --- syscall (202, FreeBSD ELF32, sys___sysctl), eip = 0x284b9cdf, esp = 0xbfbfe49c, ebp = 0xbfbfe4cc --- Tracing command rpc.lockd pid 564 tid 100107 td 0xd8314380 sched_switch(d8314380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdbec0838 mi_switch(104,0,c1654159,22b,d8314380,...) at mi_switch+0x1f3/frame 0xdbec0878 sleepq_switch(d8314380,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdbec08ac sleepq_catch_signals(8,c1648c33,cb,d8314380,d8314380,...) at sleepq_catch_signals+0x360/frame 0xdbec08f0 sleepq_timedwait_sig(d8571a50,0,dbec0954,0,0,...) at sleepq_timedwait_sig+0x17/frame 0xdbec0930 _cv_timedwait_sig_sbt(d8571a50,dc6a80c0,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x24a/frame 0xdbec0978 svc_run_internal(d8314544,14,c1691f89,c168e6d6,19,...) at svc_run_internal+0xb2c/frame 0xdbec0a54 svc_run(dc6a8000,0,4,c0f18ef0,dbec0b40,...) at svc_run+0x1ed/frame 0xdbec0aa8 sys_nlm_syscall(d8314380,d8314600,c164301b,4,dbec0c48,...) at sys_nlm_syscall+0x8ca/frame 0xdbec0be8 syscall(dbec0ce8) at syscall+0x6ee/frame 0xdbec0cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdbec0cdc --- syscall (154, FreeBSD ELF32, sys_nlm_syscall), eip = 0x280d600f, esp = 0xbfbfed74, ebp = 0xbfbfee28 --- Tracing command rpc.statd pid 561 tid 100118 td 0xd841f000 sched_switch(d841f000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdbf0e890 mi_switch(104,0,c1654159,22b,d841f000,...) at mi_switch+0x1f3/frame 0xdbf0e8d0 sleepq_switch(d841f000,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdbf0e904 sleepq_catch_signals(8,c1648c33,cb,d841f000,d841f000,...) at sleepq_catch_signals+0x360/frame 0xdbf0e948 sleepq_timedwait_sig(d8318aa4,0,dbf0e9ac,e0000000,1,...) at sleepq_timedwait_sig+0x17/frame 0xdbf0e988 _cv_timedwait_sig_sbt(d8318aa4,d8318a90,92dd6439,9d9c,e0000000,...) at _cv_timedwait_sig_sbt+0x24a/frame 0xdbf0e9d0 seltdwait(9d9c,e0000000,1,d841f000,0,...) at seltdwait+0x82/frame 0xdbf0ea00 kern_select(d841f000,8,bfbfece8,0,0,...) at kern_select+0x876/frame 0xdbf0eba0 sys_select(d841f000,d841f280,c164301b,4,c18578ef,...) at sys_select+0x68/frame 0xdbf0ebe8 syscall(dbf0ece8) at syscall+0x6ee/frame 0xdbf0ecdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdbf0ecdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x282096cf, esp = 0xbfbfec34, ebp = 0xbfbfed80 --- Tracing command nfsd pid 560 tid 100124 td 0xd840a380 sched_switch(d840a380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdbf9b3c8 mi_switch(104,0,c1654159,22b,d840a380,...) at mi_switch+0x1f3/frame 0xdbf9b408 sleepq_switch(d840a380,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdbf9b43c sleepq_catch_signals(8,c1648c33,cb,d840a380,d840a380,...) at sleepq_catch_signals+0x360/frame 0xdbf9b480 sleepq_timedwait_sig(c6db2b50,0,dbf9b4e4,0,0,...) at sleepq_timedwait_sig+0x17/frame 0xdbf9b4c0 _cv_timedwait_sig_sbt(c6db2b50,d84120c0,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x24a/frame 0xdbf9b508 svc_run_internal(c0f31a00,d84120c0,d8273a08,dbf9b610,0,...) at svc_run_internal+0xb2c/frame 0xdbf9b5e4 svc_run(d8412000,0,c1632c29,1f8,0,...) at svc_run+0x1ed/frame 0xdbf9b638 nfsrvd_nfsd(d840a380,dbf9b7b0,c,c6db8a00,c193e9b4,...) at nfsrvd_nfsd+0x213/frame 0xdbf9b778 nfssvc_nfsd(d840a380,d840a600,0,d840a380,dbf9bcdc,...) at nfssvc_nfsd+0x201/frame 0xdbf9bbd0 sys_nfssvc(d840a380,d840a600,c164301b,4,dbf9bc48,...) at sys_nfssvc+0xa6/frame 0xdbf9bbe8 syscall(dbf9bce8) at syscall+0x6ee/frame 0xdbf9bcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdbf9bcdc --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280c2fff, esp = 0xbfbfe7f4, ebp = 0xbfbfea68 --- Tracing command nfsd pid 560 tid 100127 td 0xdc67da80 sched_switch(dc67da80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdbfb0aa8 mi_switch(104,0,c1654159,22b,dc67da80,...) at mi_switch+0x1f3/frame 0xdbfb0ae8 sleepq_switch(dc67da80,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdbfb0b1c sleepq_catch_signals(dbfb0b84,c0c549a0,d84120d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbfb0b60 sleepq_wait_sig(d6363a50,0,dbfb0ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbfb0b84 _cv_wait_sig(d6363a50,d84120c0,c1691f4b,439,280c81e2,...) at _cv_wait_sig+0x21f/frame 0xdbfb0bc8 svc_run_internal(dbfb0cd4,c0c355ce,d84120c0,dbfb0ce8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdbfb0ca4 svc_thread_start(d84120c0,dbfb0ce8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdbfb0cac fork_exit(c0f31a00,d84120c0,dbfb0ce8) at fork_exit+0x7e/frame 0xdbfb0cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbfb0cd4 --- trap 0x20, eip = 0, esp = 0xdbfb0d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 560 tid 100128 td 0xdc67d700 sched_switch(dc67d700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdbfb5aa8 mi_switch(104,0,c1654159,22b,dc67d700,...) at mi_switch+0x1f3/frame 0xdbfb5ae8 sleepq_switch(dc67d700,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdbfb5b1c sleepq_catch_signals(dbfb5b84,c0c549a0,d84120d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbfb5b60 sleepq_wait_sig(d87c7dd0,0,dbfb5ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbfb5b84 _cv_wait_sig(d87c7dd0,d84120c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdbfb5bc8 svc_run_internal(dbfb5cd4,c0c355ce,d84120c0,dbfb5ce8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdbfb5ca4 svc_thread_start(d84120c0,dbfb5ce8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdbfb5cac fork_exit(c0f31a00,d84120c0,dbfb5ce8) at fork_exit+0x7e/frame 0xdbfb5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbfb5cd4 --- trap 0x20, eip = 0, esp = 0xdbfb5d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 560 tid 100129 td 0xdc67d380 sched_switch(dc67d380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdbfbaaa8 mi_switch(104,0,c1654159,22b,dc67d380,...) at mi_switch+0x1f3/frame 0xdbfbaae8 sleepq_switch(dc67d380,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdbfbab1c sleepq_catch_signals(dbfbab84,c0c549a0,d84120d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbfbab60 sleepq_wait_sig(d63639d0,0,dbfbaba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbfbab84 _cv_wait_sig(d63639d0,d84120c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdbfbabc8 svc_run_internal(dbfbacd4,c0c355ce,d84120c0,dbfbace8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdbfbaca4 svc_thread_start(d84120c0,dbfbace8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdbfbacac fork_exit(c0f31a00,d84120c0,dbfbace8) at fork_exit+0x7e/frame 0xdbfbacd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbfbacd4 --- trap 0x20, eip = 0, esp = 0xdbfbad20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 560 tid 100130 td 0xdc67d000 sched_switch(dc67d000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdbfbfaa8 mi_switch(104,0,c1654159,22b,dc67d000,...) at mi_switch+0x1f3/frame 0xdbfbfae8 sleepq_switch(dc67d000,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdbfbfb1c sleepq_catch_signals(dbfbfb84,c0c549a0,d84120d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbfbfb60 sleepq_wait_sig(d87c7e50,0,dbfbfba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbfbfb84 _cv_wait_sig(d87c7e50,d84120c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdbfbfbc8 svc_run_internal(dbfbfcd4,c0c355ce,d84120c0,dbfbfce8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdbfbfca4 svc_thread_start(d84120c0,dbfbfce8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdbfbfcac fork_exit(c0f31a00,d84120c0,dbfbfce8) at fork_exit+0x7e/frame 0xdbfbfcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbfbfcd4 --- trap 0x20, eip = 0, esp = 0xdbfbfd20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 560 tid 100131 td 0xdc67ca80 sched_switch(dc67ca80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdbfc4aa8 mi_switch(104,0,c1654159,22b,dc67ca80,...) at mi_switch+0x1f3/frame 0xdbfc4ae8 sleepq_switch(dc67ca80,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdbfc4b1c sleepq_catch_signals(dbfc4b84,c0c549a0,d84120d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbfc4b60 sleepq_wait_sig(d87c7ed0,0,dbfc4ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbfc4b84 _cv_wait_sig(d87c7ed0,d84120c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdbfc4bc8 svc_run_internal(dbfc4cd4,c0c355ce,d84120c0,dbfc4ce8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdbfc4ca4 svc_thread_start(d84120c0,dbfc4ce8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdbfc4cac fork_exit(c0f31a00,d84120c0,dbfc4ce8) at fork_exit+0x7e/frame 0xdbfc4cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbfc4cd4 --- trap 0x20, eip = 0, esp = 0xdbfc4d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 560 tid 100132 td 0xdc67c700 sched_switch(dc67c700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdbfc9aa8 mi_switch(104,0,c1654159,22b,dc67c700,...) at mi_switch+0x1f3/frame 0xdbfc9ae8 sleepq_switch(dc67c700,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdbfc9b1c sleepq_catch_signals(dbfc9b84,c0c549a0,d84120d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbfc9b60 sleepq_wait_sig(d6363950,0,dbfc9ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbfc9b84 _cv_wait_sig(d6363950,d84120c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdbfc9bc8 svc_run_internal(dbfc9cd4,c0c355ce,d84120c0,dbfc9ce8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdbfc9ca4 svc_thread_start(d84120c0,dbfc9ce8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdbfc9cac fork_exit(c0f31a00,d84120c0,dbfc9ce8) at fork_exit+0x7e/frame 0xdbfc9cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbfc9cd4 --- trap 0x20, eip = 0, esp = 0xdbfc9d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 560 tid 100133 td 0xdc67c380 sched_switch(dc67c380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdbfceaa8 mi_switch(104,0,c1654159,22b,dc67c380,...) at mi_switch+0x1f3/frame 0xdbfceae8 sleepq_switch(dc67c380,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdbfceb1c sleepq_catch_signals(dbfceb84,c0c549a0,d84120d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbfceb60 sleepq_wait_sig(d87c7f50,0,dbfceba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbfceb84 _cv_wait_sig(d87c7f50,d84120c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdbfcebc8 svc_run_internal(dbfcecd4,c0c355ce,d84120c0,dbfcece8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdbfceca4 svc_thread_start(d84120c0,dbfcece8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdbfcecac fork_exit(c0f31a00,d84120c0,dbfcece8) at fork_exit+0x7e/frame 0xdbfcecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbfcecd4 --- trap 0x20, eip = 0, esp = 0xdbfced20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 560 tid 100134 td 0xdc67c000 sched_switch(dc67c000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdbfd3aa8 mi_switch(104,0,c1654159,22b,dc67c000,...) at mi_switch+0x1f3/frame 0xdbfd3ae8 sleepq_switch(dc67c000,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdbfd3b1c sleepq_catch_signals(dbfd3b84,c0c549a0,d84120d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbfd3b60 sleepq_wait_sig(d87c8050,0,dbfd3ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbfd3b84 _cv_wait_sig(d87c8050,d84120c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdbfd3bc8 svc_run_internal(dbfd3cd4,c0c355ce,d84120c0,dbfd3ce8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdbfd3ca4 svc_thread_start(d84120c0,dbfd3ce8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdbfd3cac fork_exit(c0f31a00,d84120c0,dbfd3ce8) at fork_exit+0x7e/frame 0xdbfd3cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbfd3cd4 --- trap 0x20, eip = 0, esp = 0xdbfd3d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 560 tid 100135 td 0xdc67ba80 sched_switch(dc67ba80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdbfd8aa8 mi_switch(104,0,c1654159,22b,dc67ba80,...) at mi_switch+0x1f3/frame 0xdbfd8ae8 sleepq_switch(dc67ba80,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdbfd8b1c sleepq_catch_signals(dbfd8b84,c0c549a0,d84120d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbfd8b60 sleepq_wait_sig(d63638d0,0,dbfd8ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbfd8b84 _cv_wait_sig(d63638d0,d84120c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdbfd8bc8 svc_run_internal(dbfd8cd4,c0c355ce,d84120c0,dbfd8ce8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdbfd8ca4 svc_thread_start(d84120c0,dbfd8ce8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdbfd8cac fork_exit(c0f31a00,d84120c0,dbfd8ce8) at fork_exit+0x7e/frame 0xdbfd8cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbfd8cd4 --- trap 0x20, eip = 0, esp = 0xdbfd8d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 560 tid 100136 td 0xdc67b700 sched_switch(dc67b700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdbfddaa8 mi_switch(104,0,c1654159,22b,dc67b700,...) at mi_switch+0x1f3/frame 0xdbfddae8 sleepq_switch(dc67b700,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdbfddb1c sleepq_catch_signals(dbfddb84,c0c549a0,d84120d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbfddb60 sleepq_wait_sig(d6363850,0,dbfddba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbfddb84 _cv_wait_sig(d6363850,d84120c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdbfddbc8 svc_run_internal(dbfddcd4,c0c355ce,d84120c0,dbfddce8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdbfddca4 svc_thread_start(d84120c0,dbfddce8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdbfddcac fork_exit(c0f31a00,d84120c0,dbfddce8) at fork_exit+0x7e/frame 0xdbfddcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbfddcd4 --- trap 0x20, eip = 0, esp = 0xdbfddd20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 560 tid 100137 td 0xdc67b380 sched_switch(dc67b380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdbfe2aa8 mi_switch(104,0,c1654159,22b,dc67b380,...) at mi_switch+0x1f3/frame 0xdbfe2ae8 sleepq_switch(dc67b380,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdbfe2b1c sleepq_catch_signals(dbfe2b84,c0c549a0,d84120d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbfe2b60 sleepq_wait_sig(d63637d0,0,dbfe2ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbfe2b84 _cv_wait_sig(d63637d0,d84120c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdbfe2bc8 svc_run_internal(dbfe2cd4,c0c355ce,d84120c0,dbfe2ce8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdbfe2ca4 svc_thread_start(d84120c0,dbfe2ce8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdbfe2cac fork_exit(c0f31a00,d84120c0,dbfe2ce8) at fork_exit+0x7e/frame 0xdbfe2cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbfe2cd4 --- trap 0x20, eip = 0, esp = 0xdbfe2d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 560 tid 100138 td 0xdc67b000 sched_switch(dc67b000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdbfe7aa8 mi_switch(104,0,c1654159,22b,dc67b000,...) at mi_switch+0x1f3/frame 0xdbfe7ae8 sleepq_switch(dc67b000,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdbfe7b1c sleepq_catch_signals(dbfe7b84,c0c549a0,d84120d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbfe7b60 sleepq_wait_sig(d6363750,0,dbfe7ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbfe7b84 _cv_wait_sig(d6363750,d84120c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdbfe7bc8 svc_run_internal(dbfe7cd4,c0c355ce,d84120c0,dbfe7ce8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdbfe7ca4 svc_thread_start(d84120c0,dbfe7ce8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdbfe7cac fork_exit(c0f31a00,d84120c0,dbfe7ce8) at fork_exit+0x7e/frame 0xdbfe7cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbfe7cd4 --- trap 0x20, eip = 0, esp = 0xdbfe7d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 560 tid 100139 td 0xdc574a80 sched_switch(dc574a80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdbfecaa8 mi_switch(104,0,c1654159,22b,dc574a80,...) at mi_switch+0x1f3/frame 0xdbfecae8 sleepq_switch(dc574a80,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdbfecb1c sleepq_catch_signals(dbfecb84,c0c549a0,d84120d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbfecb60 sleepq_wait_sig(d63636d0,0,dbfecba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbfecb84 _cv_wait_sig(d63636d0,d84120c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdbfecbc8 svc_run_internal(dbfeccd4,c0c355ce,d84120c0,dbfecce8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdbfecca4 svc_thread_start(d84120c0,dbfecce8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdbfeccac fork_exit(c0f31a00,d84120c0,dbfecce8) at fork_exit+0x7e/frame 0xdbfeccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbfeccd4 --- trap 0x20, eip = 0, esp = 0xdbfecd20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 560 tid 100140 td 0xdc685000 sched_switch(dc685000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdbff1aa8 mi_switch(104,0,c1654159,22b,dc685000,...) at mi_switch+0x1f3/frame 0xdbff1ae8 sleepq_switch(dc685000,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdbff1b1c sleepq_catch_signals(dbff1b84,c0c549a0,d84120d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbff1b60 sleepq_wait_sig(d6363650,0,dbff1ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbff1b84 _cv_wait_sig(d6363650,d84120c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdbff1bc8 svc_run_internal(dbff1cd4,c0c355ce,d84120c0,dbff1ce8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdbff1ca4 svc_thread_start(d84120c0,dbff1ce8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdbff1cac fork_exit(c0f31a00,d84120c0,dbff1ce8) at fork_exit+0x7e/frame 0xdbff1cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbff1cd4 --- trap 0x20, eip = 0, esp = 0xdbff1d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 560 tid 100141 td 0xdc684a80 sched_switch(dc684a80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdbff6aa8 mi_switch(104,0,c1654159,22b,dc684a80,...) at mi_switch+0x1f3/frame 0xdbff6ae8 sleepq_switch(dc684a80,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdbff6b1c sleepq_catch_signals(dbff6b84,c0c549a0,d84120d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbff6b60 sleepq_wait_sig(d87c80d0,0,dbff6ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbff6b84 _cv_wait_sig(d87c80d0,d84120c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdbff6bc8 svc_run_internal(dbff6cd4,c0c355ce,d84120c0,dbff6ce8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdbff6ca4 svc_thread_start(d84120c0,dbff6ce8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdbff6cac fork_exit(c0f31a00,d84120c0,dbff6ce8) at fork_exit+0x7e/frame 0xdbff6cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbff6cd4 --- trap 0x20, eip = 0, esp = 0xdbff6d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 560 tid 100142 td 0xdc684700 sched_switch(dc684700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdbffbaa8 mi_switch(104,0,c1654159,22b,dc684700,...) at mi_switch+0x1f3/frame 0xdbffbae8 sleepq_switch(dc684700,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdbffbb1c sleepq_catch_signals(dbffbb84,c0c549a0,d84120d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbffbb60 sleepq_wait_sig(d8571dd0,0,dbffbba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbffbb84 _cv_wait_sig(d8571dd0,d84120c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdbffbbc8 svc_run_internal(dbffbcd4,c0c355ce,d84120c0,dbffbce8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdbffbca4 svc_thread_start(d84120c0,dbffbce8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdbffbcac fork_exit(c0f31a00,d84120c0,dbffbce8) at fork_exit+0x7e/frame 0xdbffbcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbffbcd4 --- trap 0x20, eip = 0, esp = 0xdbffbd20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 560 tid 100143 td 0xdc684380 sched_switch(dc684380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdaaa8aa8 mi_switch(104,0,c1654159,22b,dc684380,...) at mi_switch+0x1f3/frame 0xdaaa8ae8 sleepq_switch(dc684380,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdaaa8b1c sleepq_catch_signals(daaa8b84,c0c549a0,d84120d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdaaa8b60 sleepq_wait_sig(d63635d0,0,daaa8ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdaaa8b84 _cv_wait_sig(d63635d0,d84120c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdaaa8bc8 svc_run_internal(daaa8cd4,c0c355ce,d84120c0,daaa8ce8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdaaa8ca4 svc_thread_start(d84120c0,daaa8ce8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdaaa8cac fork_exit(c0f31a00,d84120c0,daaa8ce8) at fork_exit+0x7e/frame 0xdaaa8cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdaaa8cd4 --- trap 0x20, eip = 0, esp = 0xdaaa8d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 560 tid 100144 td 0xdc684000 sched_switch(dc684000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdaaadaa8 mi_switch(104,0,c1654159,22b,dc684000,...) at mi_switch+0x1f3/frame 0xdaaadae8 sleepq_switch(dc684000,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdaaadb1c sleepq_catch_signals(daaadb84,c0c549a0,d84120d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdaaadb60 sleepq_wait_sig(d8571d50,0,daaadba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdaaadb84 _cv_wait_sig(d8571d50,d84120c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdaaadbc8 svc_run_internal(daaadcd4,c0c355ce,d84120c0,daaadce8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdaaadca4 svc_thread_start(d84120c0,daaadce8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdaaadcac fork_exit(c0f31a00,d84120c0,daaadce8) at fork_exit+0x7e/frame 0xdaaadcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdaaadcd4 --- trap 0x20, eip = 0, esp = 0xdaaadd20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 560 tid 100145 td 0xdc683a80 sched_switch(dc683a80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdaab2aa8 mi_switch(104,0,c1654159,22b,dc683a80,...) at mi_switch+0x1f3/frame 0xdaab2ae8 sleepq_switch(dc683a80,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdaab2b1c sleepq_catch_signals(daab2b84,c0c549a0,d84120d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdaab2b60 sleepq_wait_sig(d6363550,0,daab2ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdaab2b84 _cv_wait_sig(d6363550,d84120c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdaab2bc8 svc_run_internal(daab2cd4,c0c355ce,d84120c0,daab2ce8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdaab2ca4 svc_thread_start(d84120c0,daab2ce8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdaab2cac fork_exit(c0f31a00,d84120c0,daab2ce8) at fork_exit+0x7e/frame 0xdaab2cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdaab2cd4 --- trap 0x20, eip = 0, esp = 0xdaab2d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 560 tid 100146 td 0xdc683700 sched_switch(dc683700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdaab7aa8 mi_switch(104,0,c1654159,22b,dc683700,...) at mi_switch+0x1f3/frame 0xdaab7ae8 sleepq_switch(dc683700,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdaab7b1c sleepq_catch_signals(daab7b84,c0c549a0,d84120d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdaab7b60 sleepq_wait_sig(d8571cd0,0,daab7ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdaab7b84 _cv_wait_sig(d8571cd0,d84120c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdaab7bc8 svc_run_internal(daab7cd4,c0c355ce,d84120c0,daab7ce8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdaab7ca4 svc_thread_start(d84120c0,daab7ce8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdaab7cac fork_exit(c0f31a00,d84120c0,daab7ce8) at fork_exit+0x7e/frame 0xdaab7cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdaab7cd4 --- trap 0x20, eip = 0, esp = 0xdaab7d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 560 tid 100147 td 0xdc683380 sched_switch(dc683380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdaabcaa8 mi_switch(104,0,c1654159,22b,dc683380,...) at mi_switch+0x1f3/frame 0xdaabcae8 sleepq_switch(dc683380,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdaabcb1c sleepq_catch_signals(daabcb84,c0c549a0,d84120d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdaabcb60 sleepq_wait_sig(d63634d0,0,daabcba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdaabcb84 _cv_wait_sig(d63634d0,d84120c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdaabcbc8 svc_run_internal(daabccd4,c0c355ce,d84120c0,daabcce8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdaabcca4 svc_thread_start(d84120c0,daabcce8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdaabccac fork_exit(c0f31a00,d84120c0,daabcce8) at fork_exit+0x7e/frame 0xdaabccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdaabccd4 --- trap 0x20, eip = 0, esp = 0xdaabcd20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 560 tid 100148 td 0xdc683000 sched_switch(dc683000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdaac1aa8 mi_switch(104,0,c1654159,22b,dc683000,...) at mi_switch+0x1f3/frame 0xdaac1ae8 sleepq_switch(dc683000,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdaac1b1c sleepq_catch_signals(daac1b84,c0c549a0,d84120d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdaac1b60 sleepq_wait_sig(d8571c50,0,daac1ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdaac1b84 _cv_wait_sig(d8571c50,d84120c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdaac1bc8 svc_run_internal(daac1cd4,c0c355ce,d84120c0,daac1ce8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdaac1ca4 svc_thread_start(d84120c0,daac1ce8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdaac1cac fork_exit(c0f31a00,d84120c0,daac1ce8) at fork_exit+0x7e/frame 0xdaac1cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdaac1cd4 --- trap 0x20, eip = 0, esp = 0xdaac1d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 560 tid 100149 td 0xdc67ea80 sched_switch(dc67ea80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdaac6aa8 mi_switch(104,0,c1654159,22b,dc67ea80,...) at mi_switch+0x1f3/frame 0xdaac6ae8 sleepq_switch(dc67ea80,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdaac6b1c sleepq_catch_signals(daac6b84,c0c549a0,d84120d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdaac6b60 sleepq_wait_sig(d6363450,0,daac6ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdaac6b84 _cv_wait_sig(d6363450,d84120c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdaac6bc8 svc_run_internal(daac6cd4,c0c355ce,d84120c0,daac6ce8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdaac6ca4 svc_thread_start(d84120c0,daac6ce8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdaac6cac fork_exit(c0f31a00,d84120c0,daac6ce8) at fork_exit+0x7e/frame 0xdaac6cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdaac6cd4 --- trap 0x20, eip = 0, esp = 0xdaac6d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 560 tid 100150 td 0xdc67e700 sched_switch(dc67e700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdaacbaa8 mi_switch(104,0,c1654159,22b,dc67e700,...) at mi_switch+0x1f3/frame 0xdaacbae8 sleepq_switch(dc67e700,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdaacbb1c sleepq_catch_signals(daacbb84,c0c549a0,d84120d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdaacbb60 sleepq_wait_sig(d8571bd0,0,daacbba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdaacbb84 _cv_wait_sig(d8571bd0,d84120c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdaacbbc8 svc_run_internal(daacbcd4,c0c355ce,d84120c0,daacbce8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdaacbca4 svc_thread_start(d84120c0,daacbce8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdaacbcac fork_exit(c0f31a00,d84120c0,daacbce8) at fork_exit+0x7e/frame 0xdaacbcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdaacbcd4 --- trap 0x20, eip = 0, esp = 0xdaacbd20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 560 tid 100151 td 0xdc67e380 sched_switch(dc67e380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdaad0aa8 mi_switch(104,0,c1654159,22b,dc67e380,...) at mi_switch+0x1f3/frame 0xdaad0ae8 sleepq_switch(dc67e380,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdaad0b1c sleepq_catch_signals(daad0b84,c0c549a0,d84120d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdaad0b60 sleepq_wait_sig(d63633d0,0,daad0ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdaad0b84 _cv_wait_sig(d63633d0,d84120c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdaad0bc8 svc_run_internal(daad0cd4,c0c355ce,d84120c0,daad0ce8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdaad0ca4 svc_thread_start(d84120c0,daad0ce8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdaad0cac fork_exit(c0f31a00,d84120c0,daad0ce8) at fork_exit+0x7e/frame 0xdaad0cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdaad0cd4 --- trap 0x20, eip = 0, esp = 0xdaad0d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 560 tid 100152 td 0xdc67e000 sched_switch(dc67e000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdaad5aa8 mi_switch(104,0,c1654159,22b,dc67e000,...) at mi_switch+0x1f3/frame 0xdaad5ae8 sleepq_switch(dc67e000,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdaad5b1c sleepq_catch_signals(daad5b84,c0c549a0,d84120d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdaad5b60 sleepq_wait_sig(d6363350,0,daad5ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdaad5b84 _cv_wait_sig(d6363350,d84120c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdaad5bc8 svc_run_internal(daad5cd4,c0c355ce,d84120c0,daad5ce8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdaad5ca4 svc_thread_start(d84120c0,daad5ce8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdaad5cac fork_exit(c0f31a00,d84120c0,daad5ce8) at fork_exit+0x7e/frame 0xdaad5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdaad5cd4 --- trap 0x20, eip = 0, esp = 0xdaad5d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 560 tid 100153 td 0xdc688380 sched_switch(dc688380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdaadaaa8 mi_switch(104,0,c1654159,22b,dc688380,...) at mi_switch+0x1f3/frame 0xdaadaae8 sleepq_switch(dc688380,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdaadab1c sleepq_catch_signals(daadab84,c0c549a0,d84120d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdaadab60 sleepq_wait_sig(d63632d0,0,daadaba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdaadab84 _cv_wait_sig(d63632d0,d84120c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdaadabc8 svc_run_internal(daadacd4,c0c355ce,d84120c0,daadace8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdaadaca4 svc_thread_start(d84120c0,daadace8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdaadacac fork_exit(c0f31a00,d84120c0,daadace8) at fork_exit+0x7e/frame 0xdaadacd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdaadacd4 --- trap 0x20, eip = 0, esp = 0xdaadad20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 560 tid 100154 td 0xdc688000 sched_switch(dc688000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdaadfaa8 mi_switch(104,0,c1654159,22b,dc688000,...) at mi_switch+0x1f3/frame 0xdaadfae8 sleepq_switch(dc688000,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdaadfb1c sleepq_catch_signals(daadfb84,c0c549a0,d84120d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdaadfb60 sleepq_wait_sig(d6363250,0,daadfba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdaadfb84 _cv_wait_sig(d6363250,d84120c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdaadfbc8 svc_run_internal(daadfcd4,c0c355ce,d84120c0,daadfce8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdaadfca4 svc_thread_start(d84120c0,daadfce8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdaadfcac fork_exit(c0f31a00,d84120c0,daadfce8) at fork_exit+0x7e/frame 0xdaadfcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdaadfcd4 --- trap 0x20, eip = 0, esp = 0xdaadfd20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 560 tid 100155 td 0xdc687a80 sched_switch(dc687a80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdaae4aa8 mi_switch(104,0,c1654159,22b,dc687a80,...) at mi_switch+0x1f3/frame 0xdaae4ae8 sleepq_switch(dc687a80,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdaae4b1c sleepq_catch_signals(daae4b84,c0c549a0,d84120d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdaae4b60 sleepq_wait_sig(d8571b50,0,daae4ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdaae4b84 _cv_wait_sig(d8571b50,d84120c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdaae4bc8 svc_run_internal(daae4cd4,c0c355ce,d84120c0,daae4ce8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdaae4ca4 svc_thread_start(d84120c0,daae4ce8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdaae4cac fork_exit(c0f31a00,d84120c0,daae4ce8) at fork_exit+0x7e/frame 0xdaae4cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdaae4cd4 --- trap 0x20, eip = 0, esp = 0xdaae4d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 560 tid 100156 td 0xdc687700 sched_switch(dc687700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdaae9aa8 mi_switch(104,0,c1654159,22b,dc687700,...) at mi_switch+0x1f3/frame 0xdaae9ae8 sleepq_switch(dc687700,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdaae9b1c sleepq_catch_signals(daae9b84,c0c549a0,d84120d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdaae9b60 sleepq_wait_sig(d63631d0,0,daae9ba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdaae9b84 _cv_wait_sig(d63631d0,d84120c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdaae9bc8 svc_run_internal(daae9cd4,c0c355ce,d84120c0,daae9ce8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdaae9ca4 svc_thread_start(d84120c0,daae9ce8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdaae9cac fork_exit(c0f31a00,d84120c0,daae9ce8) at fork_exit+0x7e/frame 0xdaae9cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdaae9cd4 --- trap 0x20, eip = 0, esp = 0xdaae9d20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 560 tid 100157 td 0xdc687380 sched_switch(dc687380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdaaeeaa8 mi_switch(104,0,c1654159,22b,dc687380,...) at mi_switch+0x1f3/frame 0xdaaeeae8 sleepq_switch(dc687380,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdaaeeb1c sleepq_catch_signals(daaeeb84,c0c549a0,d84120d0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdaaeeb60 sleepq_wait_sig(d8571ad0,0,daaeeba4,101,0,...) at sleepq_wait_sig+0x14/frame 0xdaaeeb84 _cv_wait_sig(d8571ad0,d84120c0,c1691f4b,481,0,...) at _cv_wait_sig+0x21f/frame 0xdaaeebc8 svc_run_internal(daaeecd4,c0c355ce,d84120c0,daaeece8,c16435dc,...) at svc_run_internal+0xc8b/frame 0xdaaeeca4 svc_thread_start(d84120c0,daaeece8,c16435dc,407,0,...) at svc_thread_start+0xd/frame 0xdaaeecac fork_exit(c0f31a00,d84120c0,daaeece8) at fork_exit+0x7e/frame 0xdaaeecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdaaeecd4 --- trap 0x20, eip = 0, esp = 0xdaaeed20, ebp = 0xbfbfe84e --- Tracing command nfsd pid 557 tid 100125 td 0xd840a000 sched_switch(d840a000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdbfa08b0 mi_switch(104,0,c1654159,22b,d840a000,...) at mi_switch+0x1f3/frame 0xdbfa08f0 sleepq_switch(d840a000,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdbfa0924 sleepq_catch_signals(dbfa098c,c0c549a0,d87d00a0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbfa0968 sleepq_wait_sig(d87d00a4,0,dbfa09ac,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbfa098c _cv_wait_sig(d87d00a4,d87d0090,c1657937,73d,dc226400,...) at _cv_wait_sig+0x21f/frame 0xdbfa09d0 seltdwait(ffffffff,0,0,d840a000,0,...) at seltdwait+0xbb/frame 0xdbfa0a00 kern_select(d840a000,7,bfbfec40,0,0,...) at kern_select+0x876/frame 0xdbfa0ba0 sys_select(d840a000,d840a280,c164301b,4,c18578ef,...) at sys_select+0x68/frame 0xdbfa0be8 syscall(dbfa0ce8) at syscall+0x6ee/frame 0xdbfa0cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdbfa0cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281ff6cf, esp = 0xbfbfea44, ebp = 0xbfbfea68 --- Tracing command mountd pid 551 tid 100110 td 0xd8314000 sched_switch(d8314000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdbeda8b0 mi_switch(104,0,c1654159,22b,d8314000,...) at mi_switch+0x1f3/frame 0xdbeda8f0 sleepq_switch(d8314000,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdbeda924 sleepq_catch_signals(dbeda98c,c0c549a0,d8318ae0,0,0,...) at sleepq_catch_signals+0x360/frame 0xdbeda968 sleepq_wait_sig(d8318ae4,0,dbeda9ac,101,0,...) at sleepq_wait_sig+0x14/frame 0xdbeda98c _cv_wait_sig(d8318ae4,d8318ad0,c1657937,73d,dc21b000,...) at _cv_wait_sig+0x21f/frame 0xdbeda9d0 seltdwait(ffffffff,0,0,d8314000,0,...) at seltdwait+0xbb/frame 0xdbedaa00 kern_select(d8314000,a,bfbfe8e0,0,0,...) at kern_select+0x876/frame 0xdbedaba0 sys_select(d8314000,d8314280,c164301b,4,3ec3f1e6,...) at sys_select+0x68/frame 0xdbedabe8 syscall(dbedace8) at syscall+0x6ee/frame 0xdbedacdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdbedacdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x282186cf, esp = 0xbfbfe84c, ebp = 0xbfbfe870 --- Tracing command nfsuserd pid 544 tid 100126 td 0xdc574700 sched_switch(dc574700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdbfa8890 mi_switch(104,0,c1654159,22b,dc574700,...) at mi_switch+0x1f3/frame 0xdbfa88d0 sleepq_switch(dc574700,0,c1654159,1ca,0,...) at sleepq_switch+0x110/frame 0xdbfa8904 sleepq_catch_signals(8,c1648c33,cb,dc574700,dc574700,...) at sleepq_catch_signals+0x360/frame 0xdbfa8948 sleepq_timedwait_sig(d87d0124,0,dbfa89ac,e0000000,1,...) at sleepq_timedwait_sig+0x17/frame 0xdbfa8988 _cv_timedwait_sig_sbt(d87d0124,d87d0110,929c1159,9db2,e0000000,...) at _cv_timedwait_sig_sbt+0x24a/frame 0xdbfa89d0 seltdwait(9db2,e0000000,1,dc574700,0,...) at seltdwait+0x82/frame 0xdbfa8a00 kern_select(dc574700,4,bfbfdb80,0,0,...) at kern_select+0x876/frame 0xdbfa8ba0 sys_select(dc574700,dc574980,c164301b,4,c18578ef,...) at sys_select+0x68/frame 0xdbfa8be8 syscall(dbfa8ce8) at syscall+0x6ee/frame 0xdbfa8cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdbfa8cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281fe6cf, esp = 0xbfbfdacc, ebp = 0xbfbfdc18 --- Tracing command nfsuserd pid 543 tid 100105 td 0xd8420000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c16523c0,c0ae14c5,c18fb198,c18fb27c,d7e502e8,...) at db_trace_self_wrapper+0x2a/frame 0xd7e502b0 kdb_backtrace(c165243d,c0cd34bf,d7e50420,c124e305,c1654ce5,...) at kdb_backtrace+0x2d/frame 0xd7e50318 kdb_reenter(c1654ce5,244,c0a793d5,aa2d5b0,700,...) at kdb_reenter+0x2a/frame 0xd7e50328 trap(d7e5042c) at trap+0xb5/frame 0xd7e50420 calltrap() at calltrap+0x6/frame 0xd7e50420 --- trap 0xc, eip = 0xc1238559, esp = 0xd7e5046c, ebp = 0xd7e50488 --- db_trace_thread(d8420000,ffffffff,21f,18709,d8420000,...) at db_trace_thread+0x29/frame 0xd7e50488 _db_stack_trace_all(c0cbe30a,0,ffffffff,d7e50520,c19620d0,...) at _db_stack_trace_all+0xe9/frame 0xd7e504f4 db_command(c1962f19,0,c1bd9ac4,c1962f18,60,...) at db_command+0x297/frame 0xd7e505a8 db_script_exec(c1bbeab8,0,d7e50650,d7e50644,c19620d0,...) at db_script_exec+0x168/frame 0xd7e50618 db_command(c12aedc3,d7e50730,c05b00ad,c12cedc2,ffff0ff0,...) at db_command+0x297/frame 0xd7e506cc db_command_loop(c12cedc2,ffff0ff0,d7e506f7,d7e506f6,d621b000,...) at db_command_loop+0x50/frame 0xd7e506d8 db_trap(3,ffff0ff0,7,0,1,...) at db_trap+0x10d/frame 0xd7e50730 kdb_trap(3,ffff0ff0,d7e5086c,d7e50818,0,...) at kdb_trap+0x11e/frame 0xd7e50768 trap(d7e5086c) at trap+0x817/frame 0xd7e50860 calltrap() at calltrap+0x6/frame 0xd7e50860 --- trap 0x3, eip = 0xc0cbe30a, esp = 0xd7e508ac, ebp = 0xd7e508b8 --- kdb_enter(c12cedc2,c1351ca5,0,2250045,ffffffff) at kdb_enter+0x3a/frame 0xd7e508b8 watchdog_fire(1,8,c18578ef,d7e50928,0,...) at watchdog_fire+0xac/frame 0xd7e508e0 hardclock_cnt(1,0,c18578ef,e0,9e524c0,...) at hardclock_cnt+0x26a/frame 0xd7e50928 handleevents(0,9d9a,1,cb7acc40,9d9a,...) at handleevents+0xfe/frame 0xd7e50970 timercb(c1bd80e4,0,3,3,d7e50a78,...) at timercb+0x25d/frame 0xd7e509ac lapic_handle_timer(d7e509d8) at lapic_handle_timer+0x80/frame 0xd7e509cc Xtimerint_pti(d7e50a78,d615a44c,c6dc06b8,0,246,...) at Xtimerint_pti+0x2b/frame 0xd7e50a38 __mtx_lock_sleep(cb7de970,d63d3a80,0,c167bbe3,1ec,...) at __mtx_lock_sleep+0xd8/frame 0xd7e50aa8 __mtx_lock_flags(cb7de970,0,c167bbe3,1ec,d615a380,...) at __mtx_lock_flags+0x107/frame 0xd7e50ad8 ipreass_slowtimo(c1be75a4,c167b18c,349,95c2,c1648c33,...) at ipreass_slowtimo+0x53/frame 0xd7e50b28 ip_slowtimo(c1be50c0,8,c194d860,d7e50b88,c0c86e22,...) at ip_slowtimo+0x6d/frame 0xd7e50b54 pfslowtimo(0,0,c164e8c1,2b3,3f,...) at pfslowtimo+0x50/frame 0xd7e50b88 softclock_call_cc(0,0,c164e8c1,362,c1be50d0,...) at softclock_call_cc+0x16e/frame 0xd7e50c20 softclock(c1be50c0,0,d615a380,c1b49500,d60efc48,...) at softclock+0x84/frame 0xd7e50c48 intr_event_execute_handlers(c1b49510,d60efc00,c1643981,5ac,c16435dc,...) at intr_event_execute_handlers+0x8e/frame 0xd7e50c70 ithread_loop(d6157ed0,d7e50ce8,c16435dc,407,0,...) at ithread_loop+0xa0/frame 0xd7e50cac fork_exit(c0c38860,d6157ed0,d7e50ce8) at fork_exit+0x7e/frame 0xd7e50cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e50cd4 --- trap 0, eip = 0, esp = 0xd7e50d20, ebp = 0 --- Tracing command watchdogd pid 501 tid 100119 td 0xd840aa80 sched_switch(d840aa80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xdbf15748 mi_switch(104,0,c1654159,22b,d840aa80,...) at mi_switch+0x1f3/frame 0xdbf15788 sleepq_switch(d840aa80,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xdbf157bc sleepq_wait(c1b5b780,0,dbf15800,1,0,...) at sleepq_wait+0x48/frame 0xdbf157e0 _cv_wait(c1b5b780,c1b5b740,c1655993,362,2002,...) at _cv_wait+0x21f/frame 0xdbf15824 vmem_xalloc(c1b5b740,400000,0,0,0,...) at vmem_xalloc+0x1df/frame 0xdbf15888 vmem_alloc(c1b5b740,400000,2002,dbf158d8,0,...) at vmem_alloc+0xcc/frame 0xdbf158c0 vmem_xalloc(c2381000,1000,0,0,0,...) at vmem_xalloc+0x417/frame 0xdbf15924 vmem_alloc(c2381000,1000,2002,dbf15978,f81ff840,...) at vmem_alloc+0xcc/frame 0xdbf1595c kmem_malloc_domain(0,1000,2) at kmem_malloc_domain+0x44/frame 0xdbf15988 page_alloc(c238b3c0,1000,0,dbf159d3,2,...) at page_alloc+0x26/frame 0xdbf159a0 keg_alloc_slab(0,102,c169eb97,94c,c6db8a00,...) at keg_alloc_slab+0xf6/frame 0xdbf159e8 keg_fetch_slab(ffffffff,102,c169eb97,9ae,6,...) at keg_fetch_slab+0x10e/frame 0xdbf15a40 zone_fetch_slab(c238b3c0,0,ffffffff,102,c193f80c,...) at zone_fetch_slab+0x61/frame 0xdbf15a64 zone_import(c238b3c0,c239c00c,1,ffffffff,102,...) at zone_import+0x3b/frame 0xdbf15a9c uma_zalloc_arg(c238b3c0,0,102,c0c55115,c1910478,...) at uma_zalloc_arg+0x357/frame 0xdbf15ad8 malloc(abc,c1910f84,102,d83ff410,d83ff358,...) at malloc+0x116/frame 0xdbf15b14 sigacts_alloc(d8999410,0,c16435dc,1ae,200246,...) at sigacts_alloc+0x23/frame 0xdbf15b30 fork1(d840aa80,dbf15bc0,0,0,80000034,...) at fork1+0xc5b/frame 0xdbf15ba8 sys_vfork(d840aa80,d840ad00,c164301b,4,0,...) at sys_vfork+0x55/frame 0xdbf15be8 syscall(dbf15ce8) at syscall+0x6ee/frame 0xdbf15cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdbf15cdc --- syscall (66, FreeBSD ELF32, sys_vfork), eip = 0x2817eeec, esp = 0xbfbfebe8, ebp = 0xbfbfec88 --- Tracing command rpcbind pid 417 tid 100120 td 0xd840a700 sched_switch(d840a700,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xdbf1e8f8 mi_switch(104,0,c1654159,22b,d840a700,...) at mi_switch+0x1f3/frame 0xdbf1e934 sleepq_switch(d840a700,0,c1654159,2d6,9d9b,...) at sleepq_switch+0x110/frame 0xdbf1e968 sleepq_timedwait(d842a670,50,13,0,0,...) at sleepq_timedwait+0x53/frame 0xdbf1e9a4 _sleep(d842a670,d842a618,50,c169e6ca,ffffe8e0,...) at _sleep+0x332/frame 0xdbf1e9f8 swap_pager_getpages(d842a618,dbf1eac8,1,dbf1eb30,dbf1eb34,...) at swap_pager_getpages+0x688/frame 0xdbf1ea60 vm_pager_get_pages(d842a618,dbf1eac8,1,dbf1eb30,dbf1eb34,...) at vm_pager_get_pages+0x53/frame 0xdbf1ea98 vm_fault_hold(d8a9bb94,2849b000,1,0,0,...) at vm_fault_hold+0xe86/frame 0xdbf1eb78 vm_fault(d8a9bb94,2849b000,1,0,1,...) at vm_fault+0x83/frame 0xdbf1eba0 trap_pfault(2849b380,0,c164301b,8,202,...) at trap_pfault+0x109/frame 0xdbf1ebe8 trap(dbf1ece8) at trap+0x4d9/frame 0xdbf1ecdc calltrap() at calltrap+0x6/frame 0xdbf1ecdc --- trap 0xc, eip = 0x2818a257, esp = 0xbfbfc538, ebp = 0xbfbfc650 --- Tracing command syslogd pid 408 tid 100108 td 0xd841fa80 sched_switch(d841fa80,0,104,188,c1b48780,...) at sched_switch+0x503/frame 0xdbecb4b8 mi_switch(104,0,c1654159,22b,d841fa80,...) at mi_switch+0x1f3/frame 0xdbecb4f4 sleepq_switch(d841fa80,0,c1654159,2b3,cb68ec58,...) at sleepq_switch+0x110/frame 0xdbecb528 sleepq_wait(cb68ec58,60,c165dea7,4,0,...) at sleepq_wait+0x48/frame 0xdbecb54c sleeplk(dc1f0c00,c165dea7,60,0,0,...) at sleeplk+0x1a0/frame 0xdbecb590 __lockmgr_args(cb68ec58,81900,dc1f0c00,c165dea7,60,...) at __lockmgr_args+0x9ba/frame 0xdbecb600 getblk(dc1f0b40,27,0,4000,0,...) at getblk+0x136/frame 0xdbecb658 cluster_read(dc1f0b40,9dbd5,0,27,0,...) at cluster_read+0xf6/frame 0xdbecb6f0 ffs_balloc_ufs2(dc1f0b40,9dbd5,0,4a,d87cb900,...) at ffs_balloc_ufs2+0x2493/frame 0xdbecb838 ffs_write(dbecb9b8,c18632ed,33,dc1f0b40,0,...) at ffs_write+0x267/frame 0xdbecb8b8 VOP_WRITE_APV(c193e9b4,dbecb9b8,dc1f0b40,373,440003,...) at VOP_WRITE_APV+0x187/frame 0xdbecb988 vn_write(debcf540,dd619880,d87cb900,1,d841fa80,...) at vn_write+0x311/frame 0xdbecb9e8 vn_io_fault_doio(d841fa80,0,c1654159,126,d841fb4c,...) at vn_io_fault_doio+0x83/frame 0xdbecba30 vn_io_fault1(d841fa80,0,0,ffffffff,7fffffff,...) at vn_io_fault1+0x165/frame 0xdbecbaf8 vn_io_fault(debcf540,dd619880,d87cb900,0,d841fa80,...) at vn_io_fault+0x1e7/frame 0xdbecbb44 dofilewrite(debcf540,dd619880,ffffffff,ffffffff,0,...) at dofilewrite+0xb2/frame 0xdbecbb78 kern_writev(d841fa80,12,dd619880,dd619880,0,...) at kern_writev+0x93/frame 0xdbecbbc8 sys_writev(d841fa80,d841fd00,c164301b,4,3ec3f1e6,...) at sys_writev+0x42/frame 0xdbecbbe8 syscall(dbecbce8) at syscall+0x6ee/frame 0xdbecbcdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdbecbcdc --- syscall (121, FreeBSD ELF32, sys_writev), eip = 0x282082e3, esp = 0xbfbfd05c, ebp = 0xbfbfd070 --- Tracing command devd pid 332 tid 100123 td 0xd8421380 sched_switch(d8421380,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xdbf54638 mi_switch(104,0,c1654159,22b,d8421380,...) at mi_switch+0x1f3/frame 0xdbf54674 sleepq_switch(d8421380,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xdbf546a8 sleepq_wait(c1b5b780,0,dbf546ec,1,0,...) at sleepq_wait+0x48/frame 0xdbf546cc _cv_wait(c1b5b780,c1b5b740,c1655993,362,dc227164,...) at _cv_wait+0x21f/frame 0xdbf54710 vmem_xalloc(c1b5b740,400000,0,0,0,...) at vmem_xalloc+0x1df/frame 0xdbf54774 vmem_alloc(c1b5b740,400000,2002,dbf547c4,0,...) at vmem_alloc+0xcc/frame 0xdbf547ac vmem_xalloc(c2381000,1000,0,0,0,...) at vmem_xalloc+0x417/frame 0xdbf54810 vmem_alloc(c2381000,1000,2102,dbf54864,c169eb97,...) at vmem_alloc+0xcc/frame 0xdbf54848 kmem_malloc_domain(0,1000,102) at kmem_malloc_domain+0x44/frame 0xdbf54874 page_alloc(cb502dc0,1000,0,dbf548bf,102,...) at page_alloc+0x26/frame 0xdbf5488c keg_alloc_slab(0,2,c169eb97,94c,c6db8a00,...) at keg_alloc_slab+0xf6/frame 0xdbf548d4 keg_fetch_slab(ffffffff,2,c169eb97,9ae,cb502dc0,...) at keg_fetch_slab+0x10e/frame 0xdbf5492c zone_fetch_slab(cb502dc0,0,ffffffff,2,ffffffff,...) at zone_fetch_slab+0x61/frame 0xdbf54950 zone_import(cb502dc0,dbf549ac,1,ffffffff,2,...) at zone_import+0x3b/frame 0xdbf54988 zone_alloc_item(ffffffff,2,c169eb97,8e4,0,...) at zone_alloc_item+0x3d/frame 0xdbf549bc uma_zalloc_arg(cb502dc0,dbf54a18,2,c169eb97,246,...) at uma_zalloc_arg+0x66c/frame 0xdbf549f8 m_getm2(0,108,2,1,2,...) at m_getm2+0x126/frame 0xdbf54a44 m_uiotombuf(dbf54b30,2,800,4c,2,...) at m_uiotombuf+0x6a/frame 0xdbf54a74 sosend_generic(dc227000,0,dbf54b30,0,0,...) at sosend_generic+0x2fa/frame 0xdbf54ad0 sosend(dc227000,0,dbf54b30,0,0,...) at sosend+0x73/frame 0xdbf54b00 kern_sendit(d8421380,8,dbf54bc8,0,0,...) at kern_sendit+0x2fc/frame 0xdbf54b78 sendit(dbf54bc8,0,bfbfc4d8,bc,0,...) at sendit+0x1a9/frame 0xdbf54bb0 sys_sendto(d8421380,d8421600,c164301b,4,c18578ef,...) at sys_sendto+0x58/frame 0xdbf54be8 syscall(dbf54ce8) at syscall+0x6ee/frame 0xdbf54cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xdbf54cdc --- syscall (133, FreeBSD ELF32, sys_sendto), eip = 0x80a1467, esp = 0xbfbfbfe0, ebp = 0xbfbfc000 --- Tracing command syncer pid 25 tid 100102 td 0xd627d000 sched_switch(d627d000,0,104,188,c1b48780,...) at sched_switch+0x503/frame 0xdbea2918 mi_switch(104,0,c1654159,22b,d627d000,...) at mi_switch+0x1f3/frame 0xdbea2954 sleepq_switch(d627d000,0,c1654159,2b3,cb54fea0,...) at sleepq_switch+0x110/frame 0xdbea2988 sleepq_wait(cb54fea0,60,c165dea7,4,0,...) at sleepq_wait+0x48/frame 0xdbea29ac sleeplk(d8aec7c8,c165dea7,60,0,0,...) at sleeplk+0x1a0/frame 0xdbea29f0 __lockmgr_args(cb54fea0,81900,d8aec7c8,c165dea7,60,...) at __lockmgr_args+0x9ba/frame 0xdbea2a60 getblk(d8aec708,6d1e00,0,4000,0,...) at getblk+0x136/frame 0xdbea2ab8 breadn_flags(d8aec708,6d1e00,0,4000,0,...) at breadn_flags+0x43/frame 0xdbea2ae8 ffs_update(de9819d8,0,d627d000,5aa,c16611f5,...) at ffs_update+0x20d/frame 0xdbea2b68 ffs_sync(d8b85000,3,2,d8b85000,c191e6a4,...) at ffs_sync+0x62e/frame 0xdbea2bf0 sync_fsync(dbea2c88,c1863470,c16611f5,86d,867,...) at sync_fsync+0x11c/frame 0xdbea2c14 VOP_FSYNC_APV(c191e6a4,dbea2c88,c16611f5,86d,0,...) at VOP_FSYNC_APV+0xf6/frame 0xdbea2c40 sched_sync(0,dbea2ce8,c16435dc,407,0,...) at sched_sync+0x2b6/frame 0xdbea2cac fork_exit(c0d50cf0,0,dbea2ce8) at fork_exit+0x7e/frame 0xdbea2cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbea2cd4 --- trap 0, eip = 0, esp = 0xdbea2d20, ebp = 0 --- Tracing command vnlru pid 24 tid 100101 td 0xd627d380 sched_switch(d627d380,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xdbe9db30 mi_switch(104,0,c1654159,22b,d627d380,...) at mi_switch+0x1f3/frame 0xdbe9db6c sleepq_switch(d627d380,0,c1654159,2d6,9d9a,...) at sleepq_switch+0x110/frame 0xdbe9dba0 sleepq_timedwait(d899b6b0,60,0,0,0,...) at sleepq_timedwait+0x53/frame 0xdbe9dbdc _sleep(d899b6b0,c1bb8348,260,c16620ee,fffffed8,...) at _sleep+0x332/frame 0xdbe9dc30 vnlru_proc(0,dbe9dce8,c16435dc,407,0,...) at vnlru_proc+0xbc/frame 0xdbe9dcac fork_exit(c0d50370,0,dbe9dce8) at fork_exit+0x7e/frame 0xdbe9dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbe9dcd4 --- trap 0, eip = 0, esp = 0xdbe9dd20, ebp = 0 --- Tracing command bufdaemon pid 23 tid 100100 td 0xd627d700 sched_switch(d627d700,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xdbe98b78 mi_switch(104,0,c1654159,22b,d627d700,...) at mi_switch+0x1f3/frame 0xdbe98bb4 sleepq_switch(d627d700,0,c1654159,2d6,9d9b,...) at sleepq_switch+0x110/frame 0xdbe98be8 sleepq_timedwait(c1bb7c2c,54,0,0,0,...) at sleepq_timedwait+0x53/frame 0xdbe98c24 _sleep(c1bb7c2c,c191c300,54,c165eb87,fffffed8,...) at _sleep+0x332/frame 0xdbe98c78 buf_daemon(0,dbe98ce8,c16435dc,407,0,...) at buf_daemon+0x8c/frame 0xdbe98cac fork_exit(c0d2db50,0,dbe98ce8) at fork_exit+0x7e/frame 0xdbe98cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbe98cd4 --- trap 0, eip = 0, esp = 0xdbe98d20, ebp = 0 --- Tracing command bufdaemon pid 23 tid 100112 td 0xd627ca80 sched_switch(d627ca80,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xdbee5b70 mi_switch(104,0,c1654159,22b,d627ca80,...) at mi_switch+0x1f3/frame 0xdbee5bac sleepq_switch(d627ca80,0,c1654159,2d6,9d9a,...) at sleepq_switch+0x110/frame 0xdbee5be0 sleepq_timedwait(d8b12c84,54,0,0,0,...) at sleepq_timedwait+0x53/frame 0xdbee5c1c _sleep(d8b12c84,d8b12c00,54,c1699f81,7fffff6c,...) at _sleep+0x332/frame 0xdbee5c70 softdep_flush(d8b87000,dbee5ce8,c16435dc,407,0,...) at softdep_flush+0x199/frame 0xdbee5cac fork_exit(c0f75cc0,d8b87000,dbee5ce8) at fork_exit+0x7e/frame 0xdbee5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbee5cd4 --- trap 0, eip = 0, esp = 0xdbee5d20, ebp = 0 --- Tracing command bufdaemon pid 23 tid 100114 td 0xd627c380 sched_switch(d627c380,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xdbeefb70 mi_switch(104,0,c1654159,22b,d627c380,...) at mi_switch+0x1f3/frame 0xdbeefbac sleepq_switch(d627c380,0,c1654159,2d6,9d9a,...) at sleepq_switch+0x110/frame 0xdbeefbe0 sleepq_timedwait(d8b12884,54,0,0,0,...) at sleepq_timedwait+0x53/frame 0xdbeefc1c _sleep(d8b12884,d8b12800,54,c1699f81,7fffff6c,...) at _sleep+0x332/frame 0xdbeefc70 softdep_flush(d8b85000,dbeefce8,c16435dc,407,0,...) at softdep_flush+0x199/frame 0xdbeefcac fork_exit(c0f75cc0,d8b85000,dbeefce8) at fork_exit+0x7e/frame 0xdbeefcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbeefcd4 --- trap 0, eip = 0, esp = 0xdbeefd20, ebp = 0 --- Tracing command bufdaemon pid 23 tid 100115 td 0xd627c000 sched_switch(d627c000,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xdbef4b70 mi_switch(104,0,c1654159,22b,d627c000,...) at mi_switch+0x1f3/frame 0xdbef4bac sleepq_switch(d627c000,0,c1654159,2d6,9d9a,...) at sleepq_switch+0x110/frame 0xdbef4be0 sleepq_timedwait(d8b12684,54,0,0,0,...) at sleepq_timedwait+0x53/frame 0xdbef4c1c _sleep(d8b12684,d8b12600,54,c1699f81,7fffff6c,...) at _sleep+0x332/frame 0xdbef4c70 softdep_flush(dc17b000,dbef4ce8,c16435dc,407,0,...) at softdep_flush+0x199/frame 0xdbef4cac fork_exit(c0f75cc0,dc17b000,dbef4ce8) at fork_exit+0x7e/frame 0xdbef4cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbef4cd4 --- trap 0, eip = 0, esp = 0xdbef4d20, ebp = 0 --- Tracing command bufdaemon pid 23 tid 100175 td 0xdc685700 sched_switch(dc685700,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xdab5bb70 mi_switch(104,0,c1654159,22b,dc685700,...) at mi_switch+0x1f3/frame 0xdab5bbac sleepq_switch(dc685700,0,c1654159,2d6,9d9b,...) at sleepq_switch+0x110/frame 0xdab5bbe0 sleepq_timedwait(d8b12a84,54,0,0,0,...) at sleepq_timedwait+0x53/frame 0xdab5bc1c _sleep(d8b12a84,d8b12a00,54,c1699f81,7fffff6c,...) at _sleep+0x332/frame 0xdab5bc70 softdep_flush(d8b86000,dab5bce8,c16435dc,407,0,...) at softdep_flush+0x199/frame 0xdab5bcac fork_exit(c0f75cc0,d8b86000,dab5bce8) at fork_exit+0x7e/frame 0xdab5bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdab5bcd4 --- trap 0, eip = 0, esp = 0xdab5bd20, ebp = 0 --- Tracing command bufspacedaemon pid 22 tid 100099 td 0xd627da80 sched_switch(d627da80,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xdbe93b78 mi_switch(104,0,c1654159,22b,d627da80,...) at mi_switch+0x1f3/frame 0xdbe93bb4 sleepq_switch(d627da80,0,c1654159,2d6,9d9b,...) at sleepq_switch+0x110/frame 0xdbe93be8 sleepq_timedwait(c1bb7d80,5c,0,0,0,...) at sleepq_timedwait+0x53/frame 0xdbe93c24 _sleep(c1bb7d80,c191c800,25c,c163382b,fffffed8,...) at _sleep+0x332/frame 0xdbe93c78 bufspace_daemon(0,dbe93ce8,c16435dc,407,0,...) at bufspace_daemon+0x1ff/frame 0xdbe93cac fork_exit(c0d2d4f0,0,dbe93ce8) at fork_exit+0x7e/frame 0xdbe93cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbe93cd4 --- trap 0, eip = 0, esp = 0xdbe93d20, ebp = 0 --- Tracing command vmdaemon pid 21 tid 100096 td 0xd627e000 sched_switch(d627e000,0,104,188,c1b48780,...) at sched_switch+0x503/frame 0xd7ffdb50 mi_switch(104,0,c1654159,22b,d627e000,...) at mi_switch+0x1f3/frame 0xd7ffdb8c sleepq_switch(d627e000,0,c1654159,2b3,d627e000,...) at sleepq_switch+0x110/frame 0xd7ffdbc0 sleepq_wait(c1bbd27c,74,c165eb87,0,0,...) at sleepq_wait+0x48/frame 0xd7ffdbe4 _sleep(c1bbd27c,c1bbd268,74,c165eb87,0,...) at _sleep+0x396/frame 0xd7ffdc38 vm_daemon(0,d7ffdce8,c16435dc,407,0,...) at vm_daemon+0xa6/frame 0xd7ffdcac fork_exit(c0fdfd20,0,d7ffdce8) at fork_exit+0x7e/frame 0xd7ffdcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7ffdcd4 --- trap 0, eip = 0, esp = 0xd7ffdd20, ebp = 0 --- Tracing command pagedaemon pid 20 tid 100095 td 0xd627e380 sched_switch(d627e380,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xd7ff8af0 mi_switch(104,0,c1654159,22b,d627e380,...) at mi_switch+0x1f3/frame 0xd7ff8b2c sleepq_switch(d627e380,0,c1654159,2d6,9d9a,...) at sleepq_switch+0x110/frame 0xd7ff8b60 sleepq_timedwait(c1bbd0e0,54,0,0,0,...) at sleepq_timedwait+0x53/frame 0xd7ff8b9c _sleep(c1bbd0e0,c1941900,254,c165eb87,fffffed8,...) at _sleep+0x332/frame 0xd7ff8bf0 vm_pageout_worker(0,0,d60e9358,0,0,...) at vm_pageout_worker+0x2f7/frame 0xd7ff8c7c vm_pageout(0,d7ff8ce8,c16435dc,407,0,...) at vm_pageout+0x103/frame 0xd7ff8cac fork_exit(c0fd63b0,0,d7ff8ce8) at fork_exit+0x7e/frame 0xd7ff8cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7ff8cd4 --- trap 0, eip = 0, esp = 0xd7ff8d20, ebp = 0 --- Tracing command pagedaemon pid 20 tid 100097 td 0xd852e700 sched_switch(d852e700,0,104,188,c1b49500,...) at sched_switch+0x503/frame 0xdbe89b18 mi_switch(104,0,c1654159,22b,d852e700,...) at mi_switch+0x1f3/frame 0xdbe89b54 sleepq_switch(d852e700,0,c1654159,2b3,d852e700,...) at sleepq_switch+0x110/frame 0xdbe89b88 sleepq_wait(c1bbd0ec,54,c16a2b62,0,0,...) at sleepq_wait+0x48/frame 0xdbe89bac _sleep(c1bbd0ec,c1be82c0,54,c16a2b62,0,...) at _sleep+0x396/frame 0xdbe89c00 vm_pageout_laundry_worker(0,dbe89ce8,c16435dc,407,0,...) at vm_pageout_laundry_worker+0xc1c/frame 0xdbe89cac fork_exit(c0fd6500,0,dbe89ce8) at fork_exit+0x7e/frame 0xdbe89cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbe89cd4 --- trap 0, eip = 0, esp = 0xdbe89d20, ebp = 0 --- Tracing command pagedaemon pid 20 tid 100098 td 0xd852e380 (CPU 1) cpustop_handler(1,dbe8eae0,dbe8ead4,c124e2f3,dbe8ea30,...) at cpustop_handler+0x25/frame 0xdbe8e9d0 ipi_nmi_handler(dbe8ea30,c12569c3,cb7a2c50,8,c18578ef,...) at ipi_nmi_handler+0x36/frame 0xdbe8e9e0 trap(dbe8eae0) at trap+0xa3/frame 0xdbe8ead4 calltrap() at calltrap+0x6/frame 0xdbe8ead4 --- trap 0x13, eip = 0xc0cbf792, esp = 0xdbe8eb20, ebp = 0xdbe8eb40 --- lock_delay(dbe8eb80,188,c6dc06b8,dbe8eb74,0,...) at lock_delay+0x42/frame 0xdbe8eb40 __mtx_lock_sleep(cb7de970,d63d3a80,0,c167bbe3,1fc,...) at __mtx_lock_sleep+0xd8/frame 0xdbe8ebb0 __mtx_lock_flags(cb7de970,0,c167bbe3,1fc,c1be7594,...) at __mtx_lock_flags+0x107/frame 0xdbe8ebe0 ipreass_drain(c1be75a4,c167b18c,357,c16567bd,cb52d49c,...) at ipreass_drain+0x53/frame 0xdbe8ec2c ip_drain(7,0,c1647e95,cb52d480,cb52d49c,...) at ip_drain+0x6d/frame 0xdbe8ec58 mb_reclaim(0,1,c169eb97,d26,0,...) at mb_reclaim+0x60/frame 0xdbe8ec74 uma_reclaim_worker(0,dbe8ece8,c16435dc,407,0,...) at uma_reclaim_worker+0x1fd/frame 0xdbe8ecac fork_exit(c0fb5aa0,0,dbe8ece8) at fork_exit+0x7e/frame 0xdbe8ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xdbe8ecd4 --- trap 0, eip = 0, esp = 0xdbe8ed20, ebp = 0 --- Tracing command rand_harvestq pid 19 tid 100092 td 0xd853d380 sched_switch(d853d380,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xd7fe9b48 mi_switch(104,0,c1654159,22b,d853d380,...) at mi_switch+0x1f3/frame 0xd7fe9b84 sleepq_switch(d853d380,0,c1654159,2d6,9d9a,...) at sleepq_switch+0x110/frame 0xd7fe9bb8 sleepq_timedwait(c1a1310c,0,0,0,0,...) at sleepq_timedwait+0x53/frame 0xd7fe9bf4 _sleep(c1a1310c,0,0,c163382b,19999999,...) at _sleep+0x332/frame 0xd7fe9c48 random_kthread(0,d7fe9ce8,c16435dc,407,0,...) at random_kthread+0x7c/frame 0xd7fe9cac fork_exit(c0980ca0,0,d7fe9ce8) at fork_exit+0x7e/frame 0xd7fe9cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7fe9cd4 --- trap 0, eip = 0, esp = 0xd7fe9d20, ebp = 0 --- Tracing command sctp_iterator pid 18 tid 100088 td 0xd853e380 sched_switch(d853e380,0,104,188,c1b49500,...) at sched_switch+0x503/frame 0xd7fd5b98 mi_switch(104,0,c1654159,22b,d853e380,...) at mi_switch+0x1f3/frame 0xd7fd5bd4 sleepq_switch(d853e380,0,c1654159,2b3,d853e380,...) at sleepq_switch+0x110/frame 0xd7fd5c08 sleepq_wait(c1be779c,0,c167c90f,0,0,...) at sleepq_wait+0x48/frame 0xd7fd5c2c _sleep(c1be779c,c1be7764,0,c167c90f,0,...) at _sleep+0x396/frame 0xd7fd5c80 sctp_iterator_thread(0,d7fd5ce8,c16435dc,407,0,...) at sctp_iterator_thread+0x7c/frame 0xd7fd5cac fork_exit(c0e1bf60,0,d7fd5ce8) at fork_exit+0x7e/frame 0xd7fd5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7fd5cd4 --- trap 0, eip = 0, esp = 0xd7fd5d20, ebp = 0 --- Tracing command soaiod4 pid 17 tid 100087 td 0xd8420380 sched_switch(d8420380,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xd7fcfb70 mi_switch(104,0,c1654159,22b,d8420380,...) at mi_switch+0x1f3/frame 0xd7fcfbac sleepq_switch(d8420380,0,c1654159,2d6,9dac,...) at sleepq_switch+0x110/frame 0xd7fcfbe0 sleepq_timedwait(c1bb7858,0,1d,0,0,...) at sleepq_timedwait+0x53/frame 0xd7fcfc1c _sleep(c1bb7858,c1bb7838,0,c163382b,ffffdd50,...) at _sleep+0x332/frame 0xd7fcfc70 soaio_kproc_loop(4,d7fcfce8,c16435dc,407,0,...) at soaio_kproc_loop+0x1a7/frame 0xd7fcfcac fork_exit(c0cee460,4,d7fcfce8) at fork_exit+0x7e/frame 0xd7fcfcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7fcfcd4 --- trap 0, eip = 0, esp = 0xd7fcfd20, ebp = 0 --- Tracing command soaiod3 pid 16 tid 100086 td 0xd8420700 sched_switch(d8420700,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xd7fcab70 mi_switch(104,0,c1654159,22b,d8420700,...) at mi_switch+0x1f3/frame 0xd7fcabac sleepq_switch(d8420700,0,c1654159,2d6,9daf,...) at sleepq_switch+0x110/frame 0xd7fcabe0 sleepq_timedwait(c1bb7858,0,1d,0,0,...) at sleepq_timedwait+0x53/frame 0xd7fcac1c _sleep(c1bb7858,c1bb7838,0,c163382b,ffffdd50,...) at _sleep+0x332/frame 0xd7fcac70 soaio_kproc_loop(3,d7fcace8,c16435dc,407,0,...) at soaio_kproc_loop+0x1a7/frame 0xd7fcacac fork_exit(c0cee460,3,d7fcace8) at fork_exit+0x7e/frame 0xd7fcacd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7fcacd4 --- trap 0, eip = 0, esp = 0xd7fcad20, ebp = 0 --- Tracing command soaiod2 pid 15 tid 100085 td 0xd8420a80 sched_switch(d8420a80,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xd7fc5b70 mi_switch(104,0,c1654159,22b,d8420a80,...) at mi_switch+0x1f3/frame 0xd7fc5bac sleepq_switch(d8420a80,0,c1654159,2d6,9da6,...) at sleepq_switch+0x110/frame 0xd7fc5be0 sleepq_timedwait(c1bb7858,0,1d,0,0,...) at sleepq_timedwait+0x53/frame 0xd7fc5c1c _sleep(c1bb7858,c1bb7838,0,c163382b,ffffdd50,...) at _sleep+0x332/frame 0xd7fc5c70 soaio_kproc_loop(2,d7fc5ce8,c16435dc,407,0,...) at soaio_kproc_loop+0x1a7/frame 0xd7fc5cac fork_exit(c0cee460,2,d7fc5ce8) at fork_exit+0x7e/frame 0xd7fc5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7fc5cd4 --- trap 0, eip = 0, esp = 0xd7fc5d20, ebp = 0 --- Tracing command soaiod1 pid 9 tid 100084 td 0xd8421000 sched_switch(d8421000,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xd7fc0b70 mi_switch(104,0,c1654159,22b,d8421000,...) at mi_switch+0x1f3/frame 0xd7fc0bac sleepq_switch(d8421000,0,c1654159,2d6,9dac,...) at sleepq_switch+0x110/frame 0xd7fc0be0 sleepq_timedwait(c1bb7858,0,1d,0,0,...) at sleepq_timedwait+0x53/frame 0xd7fc0c1c _sleep(c1bb7858,c1bb7838,0,c163382b,ffffdd50,...) at _sleep+0x332/frame 0xd7fc0c70 soaio_kproc_loop(1,d7fc0ce8,c16435dc,407,0,...) at soaio_kproc_loop+0x1a7/frame 0xd7fc0cac fork_exit(c0cee460,1,d7fc0ce8) at fork_exit+0x7e/frame 0xd7fc0cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7fc0cd4 --- trap 0, eip = 0, esp = 0xd7fc0d20, ebp = 0 --- Tracing command fdc0 pid 8 tid 100081 td 0xd8315a80 sched_switch(d8315a80,0,104,188,c1b49500,...) at sched_switch+0x503/frame 0xd7fb1b40 mi_switch(104,0,c1654159,22b,d8315a80,...) at mi_switch+0x1f3/frame 0xd7fb1b7c sleepq_switch(d8315a80,0,c1654159,2b3,d8315a80,...) at sleepq_switch+0x110/frame 0xd7fb1bb0 sleepq_wait(d637923c,5c,c163382b,0,0,...) at sleepq_wait+0x48/frame 0xd7fb1bd4 _sleep(d637923c,d63792f0,5c,c163382b,0,...) at _sleep+0x396/frame 0xd7fb1c28 fdc_thread(d6379200,d7fb1ce8,c16435dc,407,0,...) at fdc_thread+0x336/frame 0xd7fb1cac fork_exit(c11b3970,d6379200,d7fb1ce8) at fork_exit+0x7e/frame 0xd7fb1cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7fb1cd4 --- trap 0, eip = 0, esp = 0xd7fb1d20, ebp = 0 --- Tracing command usb pid 14 tid 100046 td 0xd63d3000 sched_switch(d63d3000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7ef9ba8 mi_switch(104,0,c1654159,22b,d63d3000,...) at mi_switch+0x1f3/frame 0xd7ef9be8 sleepq_switch(d63d3000,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7ef9c1c sleepq_wait(d63b1acc,0,d7ef9c60,1,0,...) at sleepq_wait+0x48/frame 0xd7ef9c40 _cv_wait(d63b1acc,d63b1cf8,c161533e,78,d63b1ad4,...) at _cv_wait+0x21f/frame 0xd7ef9c84 usb_process(d63b1ac4,d7ef9ce8,c16435dc,407,0,...) at usb_process+0x140/frame 0xd7ef9cac fork_exit(c0ab14c0,d63b1ac4,d7ef9ce8) at fork_exit+0x7e/frame 0xd7ef9cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7ef9cd4 --- trap 0, eip = 0, esp = 0xd7ef9d20, ebp = 0 --- Tracing command usb pid 14 tid 100047 td 0xd63d2a80 sched_switch(d63d2a80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7efeba8 mi_switch(104,0,c1654159,22b,d63d2a80,...) at mi_switch+0x1f3/frame 0xd7efebe8 sleepq_switch(d63d2a80,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7efec1c sleepq_wait(d63b1afc,0,d7efec60,1,0,...) at sleepq_wait+0x48/frame 0xd7efec40 _cv_wait(d63b1afc,d63b1cf8,c161533e,78,d63b1b04,...) at _cv_wait+0x21f/frame 0xd7efec84 usb_process(d63b1af4,d7efece8,c16435dc,407,0,...) at usb_process+0x140/frame 0xd7efecac fork_exit(c0ab14c0,d63b1af4,d7efece8) at fork_exit+0x7e/frame 0xd7efecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7efecd4 --- trap 0, eip = 0, esp = 0xd7efed20, ebp = 0 --- Tracing command usb pid 14 tid 100048 td 0xd63d2700 sched_switch(d63d2700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7f03ba8 mi_switch(104,0,c1654159,22b,d63d2700,...) at mi_switch+0x1f3/frame 0xd7f03be8 sleepq_switch(d63d2700,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7f03c1c sleepq_wait(d63b1b2c,0,d7f03c60,1,0,...) at sleepq_wait+0x48/frame 0xd7f03c40 _cv_wait(d63b1b2c,d63b1cf8,c161533e,78,d63b1b34,...) at _cv_wait+0x21f/frame 0xd7f03c84 usb_process(d63b1b24,d7f03ce8,c16435dc,407,0,...) at usb_process+0x140/frame 0xd7f03cac fork_exit(c0ab14c0,d63b1b24,d7f03ce8) at fork_exit+0x7e/frame 0xd7f03cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7f03cd4 --- trap 0, eip = 0, esp = 0xd7f03d20, ebp = 0 --- Tracing command usb pid 14 tid 100049 td 0xd63d2380 sched_switch(d63d2380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7f08ba8 mi_switch(104,0,c1654159,22b,d63d2380,...) at mi_switch+0x1f3/frame 0xd7f08be8 sleepq_switch(d63d2380,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7f08c1c sleepq_wait(d63b1b5c,0,d7f08c60,1,0,...) at sleepq_wait+0x48/frame 0xd7f08c40 _cv_wait(d63b1b5c,d63b1cf8,c161533e,78,d63b1b64,...) at _cv_wait+0x21f/frame 0xd7f08c84 usb_process(d63b1b54,d7f08ce8,c16435dc,407,0,...) at usb_process+0x140/frame 0xd7f08cac fork_exit(c0ab14c0,d63b1b54,d7f08ce8) at fork_exit+0x7e/frame 0xd7f08cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7f08cd4 --- trap 0, eip = 0, esp = 0xd7f08d20, ebp = 0 --- Tracing command usb pid 14 tid 100050 td 0xd63d2000 sched_switch(d63d2000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7f0dba8 mi_switch(104,0,c1654159,22b,d63d2000,...) at mi_switch+0x1f3/frame 0xd7f0dbe8 sleepq_switch(d63d2000,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7f0dc1c sleepq_wait(d63b1b8c,0,d7f0dc60,1,0,...) at sleepq_wait+0x48/frame 0xd7f0dc40 _cv_wait(d63b1b8c,d63b1cf8,c161533e,78,d63b1b94,...) at _cv_wait+0x21f/frame 0xd7f0dc84 usb_process(d63b1b84,d7f0dce8,c16435dc,407,0,...) at usb_process+0x140/frame 0xd7f0dcac fork_exit(c0ab14c0,d63b1b84,d7f0dce8) at fork_exit+0x7e/frame 0xd7f0dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7f0dcd4 --- trap 0, eip = 0, esp = 0xd7f0dd20, ebp = 0 --- Tracing command usb pid 14 tid 100052 td 0xd63c9700 sched_switch(d63c9700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7f18ba8 mi_switch(104,0,c1654159,22b,d63c9700,...) at mi_switch+0x1f3/frame 0xd7f18be8 sleepq_switch(d63c9700,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7f18c1c sleepq_wait(d827bacc,0,d7f18c60,1,0,...) at sleepq_wait+0x48/frame 0xd7f18c40 _cv_wait(d827bacc,d827bcf8,c161533e,78,d827bad4,...) at _cv_wait+0x21f/frame 0xd7f18c84 usb_process(d827bac4,d7f18ce8,c16435dc,407,0,...) at usb_process+0x140/frame 0xd7f18cac fork_exit(c0ab14c0,d827bac4,d7f18ce8) at fork_exit+0x7e/frame 0xd7f18cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7f18cd4 --- trap 0, eip = 0, esp = 0xd7f18d20, ebp = 0 --- Tracing command usb pid 14 tid 100053 td 0xd63c9380 sched_switch(d63c9380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7f1dba8 mi_switch(104,0,c1654159,22b,d63c9380,...) at mi_switch+0x1f3/frame 0xd7f1dbe8 sleepq_switch(d63c9380,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7f1dc1c sleepq_wait(d827bafc,0,d7f1dc60,1,0,...) at sleepq_wait+0x48/frame 0xd7f1dc40 _cv_wait(d827bafc,d827bcf8,c161533e,78,d827bb04,...) at _cv_wait+0x21f/frame 0xd7f1dc84 usb_process(d827baf4,d7f1dce8,c16435dc,407,0,...) at usb_process+0x140/frame 0xd7f1dcac fork_exit(c0ab14c0,d827baf4,d7f1dce8) at fork_exit+0x7e/frame 0xd7f1dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7f1dcd4 --- trap 0, eip = 0, esp = 0xd7f1dd20, ebp = 0 --- Tracing command usb pid 14 tid 100054 td 0xd63c9000 sched_switch(d63c9000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7f22ba8 mi_switch(104,0,c1654159,22b,d63c9000,...) at mi_switch+0x1f3/frame 0xd7f22be8 sleepq_switch(d63c9000,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7f22c1c sleepq_wait(d827bb2c,0,d7f22c60,1,0,...) at sleepq_wait+0x48/frame 0xd7f22c40 _cv_wait(d827bb2c,d827bcf8,c161533e,78,d827bb34,...) at _cv_wait+0x21f/frame 0xd7f22c84 usb_process(d827bb24,d7f22ce8,c16435dc,407,0,...) at usb_process+0x140/frame 0xd7f22cac fork_exit(c0ab14c0,d827bb24,d7f22ce8) at fork_exit+0x7e/frame 0xd7f22cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7f22cd4 --- trap 0, eip = 0, esp = 0xd7f22d20, ebp = 0 --- Tracing command usb pid 14 tid 100055 td 0xd8281380 sched_switch(d8281380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7f27ba8 mi_switch(104,0,c1654159,22b,d8281380,...) at mi_switch+0x1f3/frame 0xd7f27be8 sleepq_switch(d8281380,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7f27c1c sleepq_wait(d827bb5c,0,d7f27c60,1,0,...) at sleepq_wait+0x48/frame 0xd7f27c40 _cv_wait(d827bb5c,d827bcf8,c161533e,78,d827bb64,...) at _cv_wait+0x21f/frame 0xd7f27c84 usb_process(d827bb54,d7f27ce8,c16435dc,407,0,...) at usb_process+0x140/frame 0xd7f27cac fork_exit(c0ab14c0,d827bb54,d7f27ce8) at fork_exit+0x7e/frame 0xd7f27cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7f27cd4 --- trap 0, eip = 0, esp = 0xd7f27d20, ebp = 0 --- Tracing command usb pid 14 tid 100056 td 0xd8281000 sched_switch(d8281000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7f2cba8 mi_switch(104,0,c1654159,22b,d8281000,...) at mi_switch+0x1f3/frame 0xd7f2cbe8 sleepq_switch(d8281000,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7f2cc1c sleepq_wait(d827bb8c,0,d7f2cc60,1,0,...) at sleepq_wait+0x48/frame 0xd7f2cc40 _cv_wait(d827bb8c,d827bcf8,c161533e,78,d827bb94,...) at _cv_wait+0x21f/frame 0xd7f2cc84 usb_process(d827bb84,d7f2cce8,c16435dc,407,0,...) at usb_process+0x140/frame 0xd7f2ccac fork_exit(c0ab14c0,d827bb84,d7f2cce8) at fork_exit+0x7e/frame 0xd7f2ccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7f2ccd4 --- trap 0, eip = 0, esp = 0xd7f2cd20, ebp = 0 --- Tracing command usb pid 14 tid 100058 td 0xd8280700 sched_switch(d8280700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7f37ba8 mi_switch(104,0,c1654159,22b,d8280700,...) at mi_switch+0x1f3/frame 0xd7f37be8 sleepq_switch(d8280700,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7f37c1c sleepq_wait(d8290acc,0,d7f37c60,1,0,...) at sleepq_wait+0x48/frame 0xd7f37c40 _cv_wait(d8290acc,d8290cf8,c161533e,78,d8290ad4,...) at _cv_wait+0x21f/frame 0xd7f37c84 usb_process(d8290ac4,d7f37ce8,c16435dc,407,0,...) at usb_process+0x140/frame 0xd7f37cac fork_exit(c0ab14c0,d8290ac4,d7f37ce8) at fork_exit+0x7e/frame 0xd7f37cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7f37cd4 --- trap 0, eip = 0, esp = 0xd7f37d20, ebp = 0 --- Tracing command usb pid 14 tid 100059 td 0xd8280380 sched_switch(d8280380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7f3cba8 mi_switch(104,0,c1654159,22b,d8280380,...) at mi_switch+0x1f3/frame 0xd7f3cbe8 sleepq_switch(d8280380,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7f3cc1c sleepq_wait(d8290afc,0,d7f3cc60,1,0,...) at sleepq_wait+0x48/frame 0xd7f3cc40 _cv_wait(d8290afc,d8290cf8,c161533e,78,d8290b04,...) at _cv_wait+0x21f/frame 0xd7f3cc84 usb_process(d8290af4,d7f3cce8,c16435dc,407,0,...) at usb_process+0x140/frame 0xd7f3ccac fork_exit(c0ab14c0,d8290af4,d7f3cce8) at fork_exit+0x7e/frame 0xd7f3ccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7f3ccd4 --- trap 0, eip = 0, esp = 0xd7f3cd20, ebp = 0 --- Tracing command usb pid 14 tid 100060 td 0xd8280000 sched_switch(d8280000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7f41ba8 mi_switch(104,0,c1654159,22b,d8280000,...) at mi_switch+0x1f3/frame 0xd7f41be8 sleepq_switch(d8280000,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7f41c1c sleepq_wait(d8290b2c,0,d7f41c60,1,0,...) at sleepq_wait+0x48/frame 0xd7f41c40 _cv_wait(d8290b2c,d8290cf8,c161533e,78,d8290b34,...) at _cv_wait+0x21f/frame 0xd7f41c84 usb_process(d8290b24,d7f41ce8,c16435dc,407,0,...) at usb_process+0x140/frame 0xd7f41cac fork_exit(c0ab14c0,d8290b24,d7f41ce8) at fork_exit+0x7e/frame 0xd7f41cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7f41cd4 --- trap 0, eip = 0, esp = 0xd7f41d20, ebp = 0 --- Tracing command usb pid 14 tid 100061 td 0xd827fa80 sched_switch(d827fa80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7f46ba8 mi_switch(104,0,c1654159,22b,d827fa80,...) at mi_switch+0x1f3/frame 0xd7f46be8 sleepq_switch(d827fa80,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7f46c1c sleepq_wait(d8290b5c,0,d7f46c60,1,0,...) at sleepq_wait+0x48/frame 0xd7f46c40 _cv_wait(d8290b5c,d8290cf8,c161533e,78,d8290b64,...) at _cv_wait+0x21f/frame 0xd7f46c84 usb_process(d8290b54,d7f46ce8,c16435dc,407,0,...) at usb_process+0x140/frame 0xd7f46cac fork_exit(c0ab14c0,d8290b54,d7f46ce8) at fork_exit+0x7e/frame 0xd7f46cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7f46cd4 --- trap 0, eip = 0, esp = 0xd7f46d20, ebp = 0 --- Tracing command usb pid 14 tid 100062 td 0xd827f700 sched_switch(d827f700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7f4bba8 mi_switch(104,0,c1654159,22b,d827f700,...) at mi_switch+0x1f3/frame 0xd7f4bbe8 sleepq_switch(d827f700,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7f4bc1c sleepq_wait(d8290b8c,0,d7f4bc60,1,0,...) at sleepq_wait+0x48/frame 0xd7f4bc40 _cv_wait(d8290b8c,d8290cf8,c161533e,78,d8290b94,...) at _cv_wait+0x21f/frame 0xd7f4bc84 usb_process(d8290b84,d7f4bce8,c16435dc,407,0,...) at usb_process+0x140/frame 0xd7f4bcac fork_exit(c0ab14c0,d8290b84,d7f4bce8) at fork_exit+0x7e/frame 0xd7f4bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7f4bcd4 --- trap 0, eip = 0, esp = 0xd7f4bd20, ebp = 0 --- Tracing command usb pid 14 tid 100063 td 0xd827f380 sched_switch(d827f380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7f51ba8 mi_switch(104,0,c1654159,22b,d827f380,...) at mi_switch+0x1f3/frame 0xd7f51be8 sleepq_switch(d827f380,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7f51c1c sleepq_wait(d8294acc,0,d7f51c60,1,0,...) at sleepq_wait+0x48/frame 0xd7f51c40 _cv_wait(d8294acc,d8294cf8,c161533e,78,d8294ad4,...) at _cv_wait+0x21f/frame 0xd7f51c84 usb_process(d8294ac4,d7f51ce8,c16435dc,407,0,...) at usb_process+0x140/frame 0xd7f51cac fork_exit(c0ab14c0,d8294ac4,d7f51ce8) at fork_exit+0x7e/frame 0xd7f51cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7f51cd4 --- trap 0, eip = 0, esp = 0xd7f51d20, ebp = 0 --- Tracing command usb pid 14 tid 100064 td 0xd827f000 sched_switch(d827f000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7f56ba8 mi_switch(104,0,c1654159,22b,d827f000,...) at mi_switch+0x1f3/frame 0xd7f56be8 sleepq_switch(d827f000,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7f56c1c sleepq_wait(d8294afc,0,d7f56c60,1,0,...) at sleepq_wait+0x48/frame 0xd7f56c40 _cv_wait(d8294afc,d8294cf8,c161533e,78,d8294b04,...) at _cv_wait+0x21f/frame 0xd7f56c84 usb_process(d8294af4,d7f56ce8,c16435dc,407,0,...) at usb_process+0x140/frame 0xd7f56cac fork_exit(c0ab14c0,d8294af4,d7f56ce8) at fork_exit+0x7e/frame 0xd7f56cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7f56cd4 --- trap 0, eip = 0, esp = 0xd7f56d20, ebp = 0 --- Tracing command usb pid 14 tid 100065 td 0xd63d4a80 sched_switch(d63d4a80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7f5bba8 mi_switch(104,0,c1654159,22b,d63d4a80,...) at mi_switch+0x1f3/frame 0xd7f5bbe8 sleepq_switch(d63d4a80,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7f5bc1c sleepq_wait(d8294b2c,0,d7f5bc60,1,0,...) at sleepq_wait+0x48/frame 0xd7f5bc40 _cv_wait(d8294b2c,d8294cf8,c161533e,78,d8294b34,...) at _cv_wait+0x21f/frame 0xd7f5bc84 usb_process(d8294b24,d7f5bce8,c16435dc,407,0,...) at usb_process+0x140/frame 0xd7f5bcac fork_exit(c0ab14c0,d8294b24,d7f5bce8) at fork_exit+0x7e/frame 0xd7f5bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7f5bcd4 --- trap 0, eip = 0, esp = 0xd7f5bd20, ebp = 0 --- Tracing command usb pid 14 tid 100066 td 0xd63d4700 sched_switch(d63d4700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7f60ba8 mi_switch(104,0,c1654159,22b,d63d4700,...) at mi_switch+0x1f3/frame 0xd7f60be8 sleepq_switch(d63d4700,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7f60c1c sleepq_wait(d8294b5c,0,d7f60c60,1,0,...) at sleepq_wait+0x48/frame 0xd7f60c40 _cv_wait(d8294b5c,d8294cf8,c161533e,78,d8294b64,...) at _cv_wait+0x21f/frame 0xd7f60c84 usb_process(d8294b54,d7f60ce8,c16435dc,407,0,...) at usb_process+0x140/frame 0xd7f60cac fork_exit(c0ab14c0,d8294b54,d7f60ce8) at fork_exit+0x7e/frame 0xd7f60cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7f60cd4 --- trap 0, eip = 0, esp = 0xd7f60d20, ebp = 0 --- Tracing command usb pid 14 tid 100067 td 0xd63d4380 sched_switch(d63d4380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7f65ba8 mi_switch(104,0,c1654159,22b,d63d4380,...) at mi_switch+0x1f3/frame 0xd7f65be8 sleepq_switch(d63d4380,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7f65c1c sleepq_wait(d8294b8c,0,d7f65c60,1,0,...) at sleepq_wait+0x48/frame 0xd7f65c40 _cv_wait(d8294b8c,d8294cf8,c161533e,78,d8294b94,...) at _cv_wait+0x21f/frame 0xd7f65c84 usb_process(d8294b84,d7f65ce8,c16435dc,407,0,...) at usb_process+0x140/frame 0xd7f65cac fork_exit(c0ab14c0,d8294b84,d7f65ce8) at fork_exit+0x7e/frame 0xd7f65cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7f65cd4 --- trap 0, eip = 0, esp = 0xd7f65d20, ebp = 0 --- Tracing command usb pid 14 tid 100068 td 0xd82a4700 sched_switch(d82a4700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7f6bba8 mi_switch(104,0,c1654159,22b,d82a4700,...) at mi_switch+0x1f3/frame 0xd7f6bbe8 sleepq_switch(d82a4700,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7f6bc1c sleepq_wait(d829eacc,0,d7f6bc60,1,0,...) at sleepq_wait+0x48/frame 0xd7f6bc40 _cv_wait(d829eacc,d829ecf8,c161533e,78,d829ead4,...) at _cv_wait+0x21f/frame 0xd7f6bc84 usb_process(d829eac4,d7f6bce8,c16435dc,407,0,...) at usb_process+0x140/frame 0xd7f6bcac fork_exit(c0ab14c0,d829eac4,d7f6bce8) at fork_exit+0x7e/frame 0xd7f6bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7f6bcd4 --- trap 0, eip = 0, esp = 0xd7f6bd20, ebp = 0 --- Tracing command usb pid 14 tid 100069 td 0xd82a4380 sched_switch(d82a4380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7f70ba8 mi_switch(104,0,c1654159,22b,d82a4380,...) at mi_switch+0x1f3/frame 0xd7f70be8 sleepq_switch(d82a4380,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7f70c1c sleepq_wait(d829eafc,0,d7f70c60,1,0,...) at sleepq_wait+0x48/frame 0xd7f70c40 _cv_wait(d829eafc,d829ecf8,c161533e,78,d829eb04,...) at _cv_wait+0x21f/frame 0xd7f70c84 usb_process(d829eaf4,d7f70ce8,c16435dc,407,0,...) at usb_process+0x140/frame 0xd7f70cac fork_exit(c0ab14c0,d829eaf4,d7f70ce8) at fork_exit+0x7e/frame 0xd7f70cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7f70cd4 --- trap 0, eip = 0, esp = 0xd7f70d20, ebp = 0 --- Tracing command usb pid 14 tid 100070 td 0xd82a4000 sched_switch(d82a4000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7f75ba8 mi_switch(104,0,c1654159,22b,d82a4000,...) at mi_switch+0x1f3/frame 0xd7f75be8 sleepq_switch(d82a4000,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7f75c1c sleepq_wait(d829eb2c,0,d7f75c60,1,0,...) at sleepq_wait+0x48/frame 0xd7f75c40 _cv_wait(d829eb2c,d829ecf8,c161533e,78,d829eb34,...) at _cv_wait+0x21f/frame 0xd7f75c84 usb_process(d829eb24,d7f75ce8,c16435dc,407,0,...) at usb_process+0x140/frame 0xd7f75cac fork_exit(c0ab14c0,d829eb24,d7f75ce8) at fork_exit+0x7e/frame 0xd7f75cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7f75cd4 --- trap 0, eip = 0, esp = 0xd7f75d20, ebp = 0 --- Tracing command usb pid 14 tid 100071 td 0xd82a3a80 sched_switch(d82a3a80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7f7aba8 mi_switch(104,0,c1654159,22b,d82a3a80,...) at mi_switch+0x1f3/frame 0xd7f7abe8 sleepq_switch(d82a3a80,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7f7ac1c sleepq_wait(d829eb5c,0,d7f7ac60,1,0,...) at sleepq_wait+0x48/frame 0xd7f7ac40 _cv_wait(d829eb5c,d829ecf8,c161533e,78,d829eb64,...) at _cv_wait+0x21f/frame 0xd7f7ac84 usb_process(d829eb54,d7f7ace8,c16435dc,407,0,...) at usb_process+0x140/frame 0xd7f7acac fork_exit(c0ab14c0,d829eb54,d7f7ace8) at fork_exit+0x7e/frame 0xd7f7acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7f7acd4 --- trap 0, eip = 0, esp = 0xd7f7ad20, ebp = 0 --- Tracing command usb pid 14 tid 100072 td 0xd82a3700 sched_switch(d82a3700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7f7fba8 mi_switch(104,0,c1654159,22b,d82a3700,...) at mi_switch+0x1f3/frame 0xd7f7fbe8 sleepq_switch(d82a3700,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7f7fc1c sleepq_wait(d829eb8c,0,d7f7fc60,1,0,...) at sleepq_wait+0x48/frame 0xd7f7fc40 _cv_wait(d829eb8c,d829ecf8,c161533e,78,d829eb94,...) at _cv_wait+0x21f/frame 0xd7f7fc84 usb_process(d829eb84,d7f7fce8,c16435dc,407,0,...) at usb_process+0x140/frame 0xd7f7fcac fork_exit(c0ab14c0,d829eb84,d7f7fce8) at fork_exit+0x7e/frame 0xd7f7fcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7f7fcd4 --- trap 0, eip = 0, esp = 0xd7f7fd20, ebp = 0 --- Tracing command usb pid 14 tid 100074 td 0xd82a3000 sched_switch(d82a3000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7f8aba8 mi_switch(104,0,c1654159,22b,d82a3000,...) at mi_switch+0x1f3/frame 0xd7f8abe8 sleepq_switch(d82a3000,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7f8ac1c sleepq_wait(d63a2ca4,0,d7f8ac60,1,0,...) at sleepq_wait+0x48/frame 0xd7f8ac40 _cv_wait(d63a2ca4,d63a2ed0,c161533e,78,d63a2cac,...) at _cv_wait+0x21f/frame 0xd7f8ac84 usb_process(d63a2c9c,d7f8ace8,c16435dc,407,0,...) at usb_process+0x140/frame 0xd7f8acac fork_exit(c0ab14c0,d63a2c9c,d7f8ace8) at fork_exit+0x7e/frame 0xd7f8acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7f8acd4 --- trap 0, eip = 0, esp = 0xd7f8ad20, ebp = 0 --- Tracing command usb pid 14 tid 100075 td 0xd82a2a80 sched_switch(d82a2a80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7f8fba8 mi_switch(104,0,c1654159,22b,d82a2a80,...) at mi_switch+0x1f3/frame 0xd7f8fbe8 sleepq_switch(d82a2a80,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7f8fc1c sleepq_wait(d63a2cd4,0,d7f8fc60,1,0,...) at sleepq_wait+0x48/frame 0xd7f8fc40 _cv_wait(d63a2cd4,d63a2ed0,c161533e,78,d63a2cdc,...) at _cv_wait+0x21f/frame 0xd7f8fc84 usb_process(d63a2ccc,d7f8fce8,c16435dc,407,0,...) at usb_process+0x140/frame 0xd7f8fcac fork_exit(c0ab14c0,d63a2ccc,d7f8fce8) at fork_exit+0x7e/frame 0xd7f8fcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7f8fcd4 --- trap 0, eip = 0, esp = 0xd7f8fd20, ebp = 0 --- Tracing command usb pid 14 tid 100076 td 0xd82a2700 sched_switch(d82a2700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7f94ba8 mi_switch(104,0,c1654159,22b,d82a2700,...) at mi_switch+0x1f3/frame 0xd7f94be8 sleepq_switch(d82a2700,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7f94c1c sleepq_wait(d63a2d04,0,d7f94c60,1,0,...) at sleepq_wait+0x48/frame 0xd7f94c40 _cv_wait(d63a2d04,d63a2ed0,c161533e,78,d63a2d0c,...) at _cv_wait+0x21f/frame 0xd7f94c84 usb_process(d63a2cfc,d7f94ce8,c16435dc,407,0,...) at usb_process+0x140/frame 0xd7f94cac fork_exit(c0ab14c0,d63a2cfc,d7f94ce8) at fork_exit+0x7e/frame 0xd7f94cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7f94cd4 --- trap 0, eip = 0, esp = 0xd7f94d20, ebp = 0 --- Tracing command usb pid 14 tid 100077 td 0xd82a2380 sched_switch(d82a2380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7f99ba8 mi_switch(104,0,c1654159,22b,d82a2380,...) at mi_switch+0x1f3/frame 0xd7f99be8 sleepq_switch(d82a2380,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7f99c1c sleepq_wait(d63a2d34,0,d7f99c60,1,0,...) at sleepq_wait+0x48/frame 0xd7f99c40 _cv_wait(d63a2d34,d63a2ed0,c161533e,78,d63a2d3c,...) at _cv_wait+0x21f/frame 0xd7f99c84 usb_process(d63a2d2c,d7f99ce8,c16435dc,407,0,...) at usb_process+0x140/frame 0xd7f99cac fork_exit(c0ab14c0,d63a2d2c,d7f99ce8) at fork_exit+0x7e/frame 0xd7f99cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7f99cd4 --- trap 0, eip = 0, esp = 0xd7f99d20, ebp = 0 --- Tracing command usb pid 14 tid 100078 td 0xd82a2000 sched_switch(d82a2000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7f9eba8 mi_switch(104,0,c1654159,22b,d82a2000,...) at mi_switch+0x1f3/frame 0xd7f9ebe8 sleepq_switch(d82a2000,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7f9ec1c sleepq_wait(d63a2d64,0,d7f9ec60,1,0,...) at sleepq_wait+0x48/frame 0xd7f9ec40 _cv_wait(d63a2d64,d63a2ed0,c161533e,78,d63a2d6c,...) at _cv_wait+0x21f/frame 0xd7f9ec84 usb_process(d63a2d5c,d7f9ece8,c16435dc,407,0,...) at usb_process+0x140/frame 0xd7f9ecac fork_exit(c0ab14c0,d63a2d5c,d7f9ece8) at fork_exit+0x7e/frame 0xd7f9ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7f9ecd4 --- trap 0, eip = 0, esp = 0xd7f9ed20, ebp = 0 --- Tracing command cam pid 7 tid 100041 td 0xd627e700 sched_switch(d627e700,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xd7eafb78 mi_switch(104,0,c1654159,22b,d627e700,...) at mi_switch+0x1f3/frame 0xd7eafbb4 sleepq_switch(d627e700,0,c1654159,2b3,d627e700,...) at sleepq_switch+0x110/frame 0xd7eafbe8 sleepq_wait(c19604c0,5c,c163382b,0,0,...) at sleepq_wait+0x48/frame 0xd7eafc0c _sleep(c19604c0,c1960480,5c,c163382b,0,...) at _sleep+0x396/frame 0xd7eafc60 xpt_done_td(c1960480,d7eafce8,c16435dc,407,0,...) at xpt_done_td+0x9b/frame 0xd7eafcac fork_exit(c04e2830,c1960480,d7eafce8) at fork_exit+0x7e/frame 0xd7eafcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7eafcd4 --- trap 0, eip = 0, esp = 0xd7eafd20, ebp = 0 --- Tracing command cam pid 7 tid 100094 td 0xd852ea80 sched_switch(d852ea80,0,104,188,c1b48780,...) at sched_switch+0x503/frame 0xd7ff3b70 mi_switch(104,0,c1654159,22b,d852ea80,...) at mi_switch+0x1f3/frame 0xd7ff3bac sleepq_switch(d852ea80,0,c1654159,2b3,d852ea80,...) at sleepq_switch+0x110/frame 0xd7ff3be0 sleepq_wait(c19603ec,5c,c163382b,0,0,...) at sleepq_wait+0x48/frame 0xd7ff3c04 _sleep(c19603ec,c1960440,5c,c163382b,0,...) at _sleep+0x396/frame 0xd7ff3c58 xpt_scanner_thread(0,d7ff3ce8,c16435dc,407,0,...) at xpt_scanner_thread+0x97/frame 0xd7ff3cac fork_exit(c04e2bb0,0,d7ff3ce8) at fork_exit+0x7e/frame 0xd7ff3cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7ff3cd4 --- trap 0, eip = 0, esp = 0xd7ff3d20, ebp = 0 --- Tracing command crypto returns 3 pid 6 tid 100040 td 0xd627ea80 sched_switch(d627ea80,0,104,188,c1b49500,...) at sched_switch+0x503/frame 0xd7eaab70 mi_switch(104,0,c1654159,22b,d627ea80,...) at mi_switch+0x1f3/frame 0xd7eaabac sleepq_switch(d627ea80,0,c1654159,2b3,d627ea80,...) at sleepq_switch+0x110/frame 0xd7eaabe0 sleepq_wait(d60cb7c4,6c,c1691209,0,0,...) at sleepq_wait+0x48/frame 0xd7eaac04 _sleep(d60cb7c4,d60cb7a8,6c,c1691209,0,...) at _sleep+0x396/frame 0xd7eaac58 crypto_ret_proc(d60cb7a8,d7eaace8,c16435dc,407,0,...) at crypto_ret_proc+0x241/frame 0xd7eaacac fork_exit(c0f1d3d0,d60cb7a8,d7eaace8) at fork_exit+0x7e/frame 0xd7eaacd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7eaacd4 --- trap 0, eip = 0, esp = 0xd7eaad20, ebp = 0 --- Tracing command crypto returns 2 pid 5 tid 100039 td 0xd615c700 sched_switch(d615c700,0,104,188,c1b49500,...) at sched_switch+0x503/frame 0xd7ea5b70 mi_switch(104,0,c1654159,22b,d615c700,...) at mi_switch+0x1f3/frame 0xd7ea5bac sleepq_switch(d615c700,0,c1654159,2b3,d615c700,...) at sleepq_switch+0x110/frame 0xd7ea5be0 sleepq_wait(d60cb78c,6c,c1691209,0,0,...) at sleepq_wait+0x48/frame 0xd7ea5c04 _sleep(d60cb78c,d60cb770,6c,c1691209,0,...) at _sleep+0x396/frame 0xd7ea5c58 crypto_ret_proc(d60cb770,d7ea5ce8,c16435dc,407,0,...) at crypto_ret_proc+0x241/frame 0xd7ea5cac fork_exit(c0f1d3d0,d60cb770,d7ea5ce8) at fork_exit+0x7e/frame 0xd7ea5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7ea5cd4 --- trap 0, eip = 0, esp = 0xd7ea5d20, ebp = 0 --- Tracing command crypto returns 1 pid 4 tid 100038 td 0xd615ca80 sched_switch(d615ca80,0,104,188,c1b48780,...) at sched_switch+0x503/frame 0xd7ea0b70 mi_switch(104,0,c1654159,22b,d615ca80,...) at mi_switch+0x1f3/frame 0xd7ea0bac sleepq_switch(d615ca80,0,c1654159,2b3,d615ca80,...) at sleepq_switch+0x110/frame 0xd7ea0be0 sleepq_wait(d60cb754,6c,c1691209,0,0,...) at sleepq_wait+0x48/frame 0xd7ea0c04 _sleep(d60cb754,d60cb738,6c,c1691209,0,...) at _sleep+0x396/frame 0xd7ea0c58 crypto_ret_proc(d60cb738,d7ea0ce8,c16435dc,407,0,...) at crypto_ret_proc+0x241/frame 0xd7ea0cac fork_exit(c0f1d3d0,d60cb738,d7ea0ce8) at fork_exit+0x7e/frame 0xd7ea0cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7ea0cd4 --- trap 0, eip = 0, esp = 0xd7ea0d20, ebp = 0 --- Tracing command crypto returns 0 pid 3 tid 100037 td 0xd61d4000 sched_switch(d61d4000,0,104,188,c1b48780,...) at sched_switch+0x503/frame 0xd7e9bb70 mi_switch(104,0,c1654159,22b,d61d4000,...) at mi_switch+0x1f3/frame 0xd7e9bbac sleepq_switch(d61d4000,0,c1654159,2b3,d61d4000,...) at sleepq_switch+0x110/frame 0xd7e9bbe0 sleepq_wait(d60cb71c,6c,c1691209,0,0,...) at sleepq_wait+0x48/frame 0xd7e9bc04 _sleep(d60cb71c,d60cb700,6c,c1691209,0,...) at _sleep+0x396/frame 0xd7e9bc58 crypto_ret_proc(d60cb700,d7e9bce8,c16435dc,407,0,...) at crypto_ret_proc+0x241/frame 0xd7e9bcac fork_exit(c0f1d3d0,d60cb700,d7e9bce8) at fork_exit+0x7e/frame 0xd7e9bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e9bcd4 --- trap 0, eip = 0, esp = 0xd7e9bd20, ebp = 0 --- Tracing command crypto pid 2 tid 100036 td 0xd61d4380 sched_switch(d61d4380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7e96b80 mi_switch(104,0,c1654159,22b,d61d4380,...) at mi_switch+0x1f3/frame 0xd7e96bc0 sleepq_switch(d61d4380,0,c1654159,2b3,d61d4380,...) at sleepq_switch+0x110/frame 0xd7e96bf4 sleepq_wait(c1bbc1bc,6c,c16911fd,0,0,...) at sleepq_wait+0x48/frame 0xd7e96c18 _sleep(c1bbc1bc,c1bbc1a4,6c,c16911fd,0,...) at _sleep+0x396/frame 0xd7e96c6c crypto_proc(0,d7e96ce8,c16435dc,407,0,...) at crypto_proc+0x2a7/frame 0xd7e96cac fork_exit(c0f1cfd0,0,d7e96ce8) at fork_exit+0x7e/frame 0xd7e96cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e96cd4 --- trap 0, eip = 0, esp = 0xd7e96d20, ebp = 0 --- Tracing command geom pid 13 tid 100028 td 0xd61d6380 sched_switch(d61d6380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7e6e6c0 mi_switch(104,0,c1654159,22b,d61d6380,...) at mi_switch+0x1f3/frame 0xd7e6e700 sleepq_switch(d61d6380,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7e6e734 sleepq_wait(c1b5b780,0,d7e6e778,1,0,...) at sleepq_wait+0x48/frame 0xd7e6e758 _cv_wait(c1b5b780,c1b5b740,c1655993,362,2002,...) at _cv_wait+0x21f/frame 0xd7e6e79c vmem_xalloc(c1b5b740,400000,0,0,0,...) at vmem_xalloc+0x1df/frame 0xd7e6e800 vmem_alloc(c1b5b740,400000,2002,d7e6e850,0,...) at vmem_alloc+0xcc/frame 0xd7e6e838 vmem_xalloc(c2381000,2000,0,0,0,...) at vmem_xalloc+0x417/frame 0xd7e6e89c vmem_alloc(c2381000,2000,2002,d7e6e8f0,dc35bf20,...) at vmem_alloc+0xcc/frame 0xd7e6e8d4 kmem_malloc_domain(0,2000,2) at kmem_malloc_domain+0x44/frame 0xd7e6e900 page_alloc(c238d500,2000,0,d7e6e94b,2,...) at page_alloc+0x26/frame 0xd7e6e918 keg_alloc_slab(0,2,c169eb97,94c,c6db8a00,...) at keg_alloc_slab+0xf6/frame 0xd7e6e960 keg_fetch_slab(ffffffff,2,c169eb97,9ae,9,...) at keg_fetch_slab+0x10e/frame 0xd7e6e9b8 zone_fetch_slab(c238d500,0,ffffffff,2,c193f80c,...) at zone_fetch_slab+0x61/frame 0xd7e6e9dc zone_import(c238d500,c239d1ec,1,ffffffff,2,...) at zone_import+0x3b/frame 0xd7e6ea14 uma_zalloc_arg(c238d500,0,2,102,0,...) at uma_zalloc_arg+0x357/frame 0xd7e6ea50 malloc(2000,c1901d00,2,f74a2c80,2000,...) at malloc+0x116/frame 0xd7e6ea8c g_read_data(f74a2c80,2000,0,2000,0,...) at g_read_data+0x9d/frame 0xd7e6eaac g_use_g_read_data(f74a2c80,2000,0,d7e6eb34,2000,...) at g_use_g_read_data+0x63/frame 0xd7e6ead8 ffs_sbget(f74a2c80,d7e6eb34,ffffffff,ffffffff,0,...) at ffs_sbget+0x17b/frame 0xd7e6eb10 g_label_ufs_taste_common(80,1) at g_label_ufs_taste_common+0x78/frame 0xd7e6eb48 g_label_ufs_id_taste(f74a2c80,d7e6eb88,80,184,0,...) at g_label_ufs_id_taste+0x1f/frame 0xd7e6eb58 g_label_taste(c19021ec,f864f180,0,22f,f52bb200,...) at g_label_taste+0x3a1/frame 0xd7e6ec50 g_new_provider_event(f864f180,0,c1634fb9,10b,0,...) at g_new_provider_event+0x1a1/frame 0xd7e6ec70 g_run_events(0,d7e6ece8,c16435dc,407,0,...) at g_run_events+0x1ed/frame 0xd7e6ecac fork_exit(c0bb9ef0,0,d7e6ece8) at fork_exit+0x7e/frame 0xd7e6ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e6ecd4 --- trap 0, eip = 0, esp = 0xd7e6ed20, ebp = 0 --- Tracing command geom pid 13 tid 100029 td 0xd61d6000 sched_switch(d61d6000,0,104,188,c1b48780,...) at sched_switch+0x503/frame 0xd7e73b78 mi_switch(104,0,c1654159,22b,d61d6000,...) at mi_switch+0x1f3/frame 0xd7e73bb4 sleepq_switch(d61d6000,0,c1654159,2b3,d61d6000,...) at sleepq_switch+0x110/frame 0xd7e73be8 sleepq_wait(c1be3c3c,5c,c163382b,0,0,...) at sleepq_wait+0x48/frame 0xd7e73c0c _sleep(c1be3c3c,c1b37be0,25c,c163382b,0,...) at _sleep+0x396/frame 0xd7e73c60 g_io_schedule_up(d61d6000,0,c16358b2,61,d7e73cd4,...) at g_io_schedule_up+0xcf/frame 0xd7e73c94 g_up_procbody(0,d7e73ce8,c16435dc,407,0,...) at g_up_procbody+0x7d/frame 0xd7e73cac fork_exit(c0bb9f70,0,d7e73ce8) at fork_exit+0x7e/frame 0xd7e73cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e73cd4 --- trap 0, eip = 0, esp = 0xd7e73d20, ebp = 0 --- Tracing command geom pid 13 tid 100030 td 0xd61d5a80 sched_switch(d61d5a80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7e78b70 mi_switch(104,0,c1654159,22b,d61d5a80,...) at mi_switch+0x1f3/frame 0xd7e78bb0 sleepq_switch(d61d5a80,0,c1654159,2b3,d61d5a80,...) at sleepq_switch+0x110/frame 0xd7e78be4 sleepq_wait(c1be3c40,5c,c163382b,0,0,...) at sleepq_wait+0x48/frame 0xd7e78c08 _sleep(c1be3c40,c1b37bc0,25c,c163382b,0,...) at _sleep+0x396/frame 0xd7e78c5c g_io_schedule_down(d61d5a80,0,c16358b2,6d,d7e78cd4,...) at g_io_schedule_down+0xec/frame 0xd7e78c94 g_down_procbody(0,d7e78ce8,c16435dc,407,0,...) at g_down_procbody+0x7d/frame 0xd7e78cac fork_exit(c0bb9ff0,0,d7e78ce8) at fork_exit+0x7e/frame 0xd7e78cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e78cd4 --- trap 0, eip = 0, esp = 0xd7e78d20, ebp = 0 --- Tracing command intr pid 12 tid 100007 td 0xd60f8700 sched_switch(d60f8700,0,109,188,8,...) at sched_switch+0x503/frame 0xd7e05c30 mi_switch(109,0,c1643981,5a1,c16435dc,...) at mi_switch+0x1f3/frame 0xd7e05c70 ithread_loop(d6158020,d7e05ce8,c16435dc,407,0,...) at ithread_loop+0x200/frame 0xd7e05cac fork_exit(c0c38860,d6158020,d7e05ce8) at fork_exit+0x7e/frame 0xd7e05cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e05cd4 --- trap 0, eip = 0, esp = 0xd7e05d20, ebp = 0 --- Tracing command intr pid 12 tid 100009 td 0xd60f8000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100012 td 0xd60ed380 sched_switch(d60ed380,0,109,188,8,...) at sched_switch+0x503/frame 0xd7e1ec30 mi_switch(109,0,c1643981,5a1,c16435dc,...) at mi_switch+0x1f3/frame 0xd7e1ec70 ithread_loop(d6157f70,d7e1ece8,c16435dc,407,0,...) at ithread_loop+0x200/frame 0xd7e1ecac fork_exit(c0c38860,d6157f70,d7e1ece8) at fork_exit+0x7e/frame 0xd7e1ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e1ecd4 --- trap 0, eip = 0, esp = 0xd7e1ed20, ebp = 0 --- Tracing command intr pid 12 tid 100022 td 0xd615a380 (CPU 3) kdb_enter(c12cedc2,c1351ca5,0,2250045,ffffffff) at kdb_enter+0x3a/frame 0xd7e508b8 watchdog_fire(1,8,c18578ef,d7e50928,0,...) at watchdog_fire+0xac/frame 0xd7e508e0 hardclock_cnt(1,0,c18578ef,e0,9e524c0,...) at hardclock_cnt+0x26a/frame 0xd7e50928 handleevents(0,9d9a,1,cb7acc40,9d9a,...) at handleevents+0xfe/frame 0xd7e50970 timercb(c1bd80e4,0,3,3,d7e50a78,...) at timercb+0x25d/frame 0xd7e509ac lapic_handle_timer(d7e509d8) at lapic_handle_timer+0x80/frame 0xd7e509cc Xtimerint_pti(d7e50a78,d615a44c,c6dc06b8,0,246,...) at Xtimerint_pti+0x2b/frame 0xd7e50a38 __mtx_lock_sleep(cb7de970,d63d3a80,0,c167bbe3,1ec,...) at __mtx_lock_sleep+0xd8/frame 0xd7e50aa8 __mtx_lock_flags(cb7de970,0,c167bbe3,1ec,d615a380,...) at __mtx_lock_flags+0x107/frame 0xd7e50ad8 ipreass_slowtimo(c1be75a4,c167b18c,349,95c2,c1648c33,...) at ipreass_slowtimo+0x53/frame 0xd7e50b28 ip_slowtimo(c1be50c0,8,c194d860,d7e50b88,c0c86e22,...) at ip_slowtimo+0x6d/frame 0xd7e50b54 pfslowtimo(0,0,c164e8c1,2b3,3f,...) at pfslowtimo+0x50/frame 0xd7e50b88 softclock_call_cc(0,0,c164e8c1,362,c1be50d0,...) at softclock_call_cc+0x16e/frame 0xd7e50c20 softclock(c1be50c0,0,d615a380,c1b49500,d60efc48,...) at softclock+0x84/frame 0xd7e50c48 intr_event_execute_handlers(c1b49510,d60efc00,c1643981,5ac,c16435dc,...) at intr_event_execute_handlers+0x8e/frame 0xd7e50c70 ithread_loop(d6157ed0,d7e50ce8,c16435dc,407,0,...) at ithread_loop+0xa0/frame 0xd7e50cac fork_exit(c0c38860,d6157ed0,d7e50ce8) at fork_exit+0x7e/frame 0xd7e50cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e50cd4 --- trap 0, eip = 0, esp = 0xd7e50d20, ebp = 0 --- Tracing command intr pid 12 tid 100023 td 0xd615a000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100024 td 0xd60faa80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100025 td 0xd60fa700 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100026 td 0xd60fa380 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100027 td 0xd61d6700 sched_switch(d61d6700,0,109,188,8,...) at sched_switch+0x503/frame 0xd7e69c30 mi_switch(109,0,c1643981,5a1,c16435dc,...) at mi_switch+0x1f3/frame 0xd7e69c70 ithread_loop(d6157e80,d7e69ce8,c16435dc,407,0,...) at ithread_loop+0x200/frame 0xd7e69cac fork_exit(c0c38860,d6157e80,d7e69ce8) at fork_exit+0x7e/frame 0xd7e69cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e69cd4 --- trap 0, eip = 0, esp = 0xd7e69d20, ebp = 0 --- Tracing command intr pid 12 tid 100042 td 0xd63d4000 sched_switch(d63d4000,0,109,188,8,...) at sched_switch+0x503/frame 0xd7ee2c30 mi_switch(109,0,c1643981,5a1,c16435dc,...) at mi_switch+0x1f3/frame 0xd7ee2c70 ithread_loop(d63c8050,d7ee2ce8,c16435dc,407,0,...) at ithread_loop+0x200/frame 0xd7ee2cac fork_exit(c0c38860,d63c8050,d7ee2ce8) at fork_exit+0x7e/frame 0xd7ee2cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7ee2cd4 --- trap 0, eip = 0, esp = 0xd7ee2d20, ebp = 0 --- Tracing command intr pid 12 tid 100043 td 0xd63d3a80 (CPU 0) cpustop_handler(0,d7ee891c,d7ee8910,c124e2f3,d7ee8868,...) at cpustop_handler+0x25/frame 0xd7ee8808 ipi_nmi_handler(d7ee8868,c12569c3,c2027c50,8,c18578ef,...) at ipi_nmi_handler+0x36/frame 0xd7ee8818 trap(d7ee891c) at trap+0xa3/frame 0xd7ee8910 calltrap() at calltrap+0x6/frame 0xd7ee8910 --- trap 0x13, eip = 0xc0cdf0d3, esp = 0xd7ee895c, ebp = 0xd7ee8978 --- witness_lock(cb7de89c,c,c167bbe3,26d,cb7de890,...) at witness_lock+0x23/frame 0xd7ee8978 _mtx_trylock_flags_int(cb7de89c,0,c167bbe3,26d) at _mtx_trylock_flags_int+0xf9/frame 0xd7ee89a4 _mtx_trylock_flags_(cb7de8ac,0,c167bbe3,26d,1,...) at _mtx_trylock_flags_+0x2a/frame 0xd7ee89c0 ip_reass(fef0dd00,2,11,6cd4c0,6cd4c0,...) at ip_reass+0x42a/frame 0xd7ee8a28 ip_input(fef0dd00,1,c165714f,c1a130b0,8,...) at ip_input+0x627/frame 0xd7ee8a94 netisr_dispatch_src(1,0,fef0dd00) at netisr_dispatch_src+0x96/frame 0xd7ee8ad0 netisr_dispatch(1,fef0dd00,0,c15ebf11,1df,...) at netisr_dispatch+0x20/frame 0xd7ee8ae4 ether_demux(d80ec400,fef0dd00,6,0,eb8,...) at ether_demux+0x170/frame 0xd7ee8b0c ether_nh_input(fef0dd00,d809a300,d7ee8ba8,1,0,...) at ether_nh_input+0x409/frame 0xd7ee8b4c netisr_dispatch_src(5,0,fef0dd00) at netisr_dispatch_src+0x96/frame 0xd7ee8b88 netisr_dispatch(5,fef0dd00,d63ae130,8,c15eccfe,...) at netisr_dispatch+0x20/frame 0xd7ee8b9c ether_input(d80ec400,fef0dd00,c15eccfe,948,3404c5ee,...) at ether_input+0x8a/frame 0xd7ee8bcc re_rxeof(d63ae140,0,c15eccfe,a55,d63ae140,...) at re_rxeof+0x601/frame 0xd7ee8c1c re_intr_msi(d63ac000,0,d63d3a80,c1b480c0,d63c27c8,...) at re_intr_msi+0xc6/frame 0xd7ee8c48 intr_event_execute_handlers(c1b480d0,d63c2780,c1643981,5ac,c16435dc,...) at intr_event_execute_handlers+0x8e/frame 0xd7ee8c70 ithread_loop(d63c8040,d7ee8ce8,c16435dc,407,0,...) at ithread_loop+0xa0/frame 0xd7ee8cac fork_exit(c0c38860,d63c8040,d7ee8ce8) at fork_exit+0x7e/frame 0xd7ee8cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7ee8cd4 --- trap 0, eip = 0, esp = 0xd7ee8d20, ebp = 0 --- Tracing command intr pid 12 tid 100044 td 0xd63d3700 sched_switch(d63d3700,0,109,188,8,...) at sched_switch+0x503/frame 0xd7eeec30 mi_switch(109,0,c1643981,5a1,c16435dc,...) at mi_switch+0x1f3/frame 0xd7eeec70 ithread_loop(d63c8030,d7eeece8,c16435dc,407,0,...) at ithread_loop+0x200/frame 0xd7eeecac fork_exit(c0c38860,d63c8030,d7eeece8) at fork_exit+0x7e/frame 0xd7eeecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7eeecd4 --- trap 0, eip = 0, esp = 0xd7eeed20, ebp = 0 --- Tracing command intr pid 12 tid 100045 td 0xd63d3380 sched_switch(d63d3380,0,109,188,8,...) at sched_switch+0x503/frame 0xd7ef4c30 mi_switch(109,0,c1643981,5a1,c16435dc,...) at mi_switch+0x1f3/frame 0xd7ef4c70 ithread_loop(d6158f80,d7ef4ce8,c16435dc,407,0,...) at ithread_loop+0x200/frame 0xd7ef4cac fork_exit(c0c38860,d6158f80,d7ef4ce8) at fork_exit+0x7e/frame 0xd7ef4cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7ef4cd4 --- trap 0, eip = 0, esp = 0xd7ef4d20, ebp = 0 --- Tracing command intr pid 12 tid 100051 td 0xd63c9a80 sched_switch(d63c9a80,0,109,188,8,...) at sched_switch+0x503/frame 0xd7f13c30 mi_switch(109,0,c1643981,5a1,c16435dc,...) at mi_switch+0x1f3/frame 0xd7f13c70 ithread_loop(d6158f70,d7f13ce8,c16435dc,407,0,...) at ithread_loop+0x200/frame 0xd7f13cac fork_exit(c0c38860,d6158f70,d7f13ce8) at fork_exit+0x7e/frame 0xd7f13cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7f13cd4 --- trap 0, eip = 0, esp = 0xd7f13d20, ebp = 0 --- Tracing command intr pid 12 tid 100057 td 0xd8280a80 sched_switch(d8280a80,0,109,188,8,...) at sched_switch+0x503/frame 0xd7f32c30 mi_switch(109,0,c1643981,5a1,c16435dc,...) at mi_switch+0x1f3/frame 0xd7f32c70 ithread_loop(d6158f60,d7f32ce8,c16435dc,407,0,...) at ithread_loop+0x200/frame 0xd7f32cac fork_exit(c0c38860,d6158f60,d7f32ce8) at fork_exit+0x7e/frame 0xd7f32cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7f32cd4 --- trap 0, eip = 0, esp = 0xd7f32d20, ebp = 0 --- Tracing command intr pid 12 tid 100073 td 0xd82a3380 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100079 td 0xd8281a80 sched_switch(d8281a80,0,109,188,8,...) at sched_switch+0x503/frame 0xd7fa3c30 mi_switch(109,0,c1643981,5a1,c16435dc,...) at mi_switch+0x1f3/frame 0xd7fa3c70 ithread_loop(d6158f40,d7fa3ce8,c16435dc,407,0,...) at ithread_loop+0x200/frame 0xd7fa3cac fork_exit(c0c38860,d6158f40,d7fa3ce8) at fork_exit+0x7e/frame 0xd7fa3cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7fa3cd4 --- trap 0, eip = 0, esp = 0xd7fa3d20, ebp = 0 --- Tracing command intr pid 12 tid 100080 td 0xd8281700 sched_switch(d8281700,0,109,188,8,...) at sched_switch+0x503/frame 0xd7facc30 mi_switch(109,0,c1643981,5a1,c16435dc,...) at mi_switch+0x1f3/frame 0xd7facc70 ithread_loop(d6158f10,d7facce8,c16435dc,407,0,...) at ithread_loop+0x200/frame 0xd7faccac fork_exit(c0c38860,d6158f10,d7facce8) at fork_exit+0x7e/frame 0xd7faccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7faccd4 --- trap 0, eip = 0, esp = 0xd7facd20, ebp = 0 --- Tracing command intr pid 12 tid 100082 td 0xd8315700 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xd60f9700 sched_switch(d60f9700,0,608,184,8,...) at sched_switch+0x503/frame 0xd4906b08 mi_switch(608,0,c164d3af,f1,d60f9700,...) at mi_switch+0x1f3/frame 0xd4906b48 critical_exit(d63bf340,d60f9700,d4906ba0,c0c384b8,d60f9700,...) at critical_exit+0xa2/frame 0xd4906b64 intr_event_handle(d63c2780,d4906bf4,ffffffff,80000000,1,...) at intr_event_handle+0x128/frame 0xd4906b90 intr_execute_handlers(d63bf340,d4906bf4,0) at intr_execute_handlers+0xa5/frame 0xd4906bc4 lapic_handle_intr(32,d4906bf4) at lapic_handle_intr+0x5e/frame 0xd4906be4 Xapic_isr1_pti() at Xapic_isr1_pti+0x52/frame 0xd4906be4 --- interrupt, eip = 0xc1267545, esp = 0xd4906c34, ebp = 0xd4906c48 --- cpu_idle(1,d4906c80,c164fb28,a74,0,...) at cpu_idle+0xd5/frame 0xd4906c48 sched_idletd(0,d4906ce8,c16435dc,407,0,...) at sched_idletd+0x3a6/frame 0xd4906cac fork_exit(c0ca7600,0,d4906ce8) at fork_exit+0x7e/frame 0xd4906cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd4906cd4 --- trap 0, eip = 0, esp = 0xd4906d20, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xd60f9380 sched_switch(d60f9380,0,608,184,c164d3af,...) at sched_switch+0x503/frame 0xd490bbf0 mi_switch(608,0,c164d3af,f1,c1b48780,...) at mi_switch+0x1f3/frame 0xd490bc2c critical_exit(0,d490bc80,c164fb28,409,0,...) at critical_exit+0xa2/frame 0xd490bc48 sched_idletd(0,d490bce8,c16435dc,407,0,...) at sched_idletd+0x3a6/frame 0xd490bcac fork_exit(c0ca7600,0,d490bce8) at fork_exit+0x7e/frame 0xd490bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd490bcd4 --- trap 0, eip = 0, esp = 0xd490bd20, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xd60f9000 (CPU 2) cpustop_handler(2,d4910b98,d4910b8c,c124e2f3,d4910ae8,...) at cpustop_handler+0x25/frame 0xd4910a88 ipi_nmi_handler(d4910ae8,c12569c3,cb7a7c50,8,c18578ef,...) at ipi_nmi_handler+0x36/frame 0xd4910a98 trap(d4910b98) at trap+0xa3/frame 0xd4910b8c calltrap() at calltrap+0x6/frame 0xd4910b8c --- trap 0x13, eip = 0xc1267145, esp = 0xd4910bd8, ebp = 0xd4910bd8 --- acpi_cpu_c1(d4910c2c,c1256832,cb7a7c50,0,c18578ef,...) at acpi_cpu_c1+0x5/frame 0xd4910bd8 acpi_cpu_idle(a37ecab,0,a37ecab,d4910c48,c126750a,...) at acpi_cpu_idle+0x30b/frame 0xd4910c18 cpu_idle_acpi(a37ecab,0,c1b48e40,3,d60f9000,...) at cpu_idle_acpi+0x3f/frame 0xd4910c2c cpu_idle(0,d4910c80,c164fb28,409,0,...) at cpu_idle+0x9a/frame 0xd4910c48 sched_idletd(0,d4910ce8,c16435dc,407,0,...) at sched_idletd+0x3a6/frame 0xd4910cac fork_exit(c0ca7600,0,d4910ce8) at fork_exit+0x7e/frame 0xd4910cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd4910cd4 --- trap 0, eip = 0, esp = 0xd4910d20, ebp = 0 --- Tracing command idle pid 11 tid 100006 td 0xd60f8a80 sched_switch(d60f8a80,0,608,184,c164d3af,...) at sched_switch+0x503/frame 0xd4915bf0 mi_switch(608,0,c164d3af,f1,c1b49500,...) at mi_switch+0x1f3/frame 0xd4915c2c critical_exit(0,d4915c80,c164fb28,409,0,...) at critical_exit+0xa2/frame 0xd4915c48 sched_idletd(0,d4915ce8,c16435dc,407,0,...) at sched_idletd+0x3a6/frame 0xd4915cac fork_exit(c0ca7600,0,d4915ce8) at fork_exit+0x7e/frame 0xd4915cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd4915cd4 --- trap 0, eip = 0, esp = 0xd4915d20, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xd60f9a80 sched_switch(d60f9a80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd4900948 mi_switch(104,0,c1654159,22b,d60f9a80,...) at mi_switch+0x1f3/frame 0xd4900988 sleepq_switch(d60f9a80,0,c1654159,1ca,6c,...) at sleepq_switch+0x110/frame 0xd49009bc sleepq_catch_signals(0,c1654159,178,c1b58fd4,d60f9a80,...) at sleepq_catch_signals+0x360/frame 0xd4900a00 sleepq_wait_sig(d60eba08,6c,c16584d2,100,0,...) at sleepq_wait_sig+0x14/frame 0xd4900a24 _sleep(d60eba08,d60ebab0,16c,c16584d2,0,...) at _sleep+0x386/frame 0xd4900a78 kern_wait6(d60f9a80,7,0,0,d4900af4,...) at kern_wait6+0x4ae/frame 0xd4900ac8 sys_wait4(d60f9a80,d60f9d00,c164301b,4,c18578ef,...) at sys_wait4+0x87/frame 0xd4900be8 syscall(d4900ce8) at syscall+0x6ee/frame 0xd4900cdc Xint0x80_syscall() at Xint0x80_syscall+0x2b/frame 0xd4900cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x806a2a7, esp = 0xbfbfe884, ebp = 0xbfbfe898 --- Tracing command audit pid 10 tid 100001 td 0xd60fa000 sched_switch(d60fa000,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xd48fbb80 mi_switch(104,0,c1654159,22b,d60fa000,...) at mi_switch+0x1f3/frame 0xd48fbbbc sleepq_switch(d60fa000,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd48fbbf0 sleepq_wait(c1be7f54,0,d48fbc34,1,0,...) at sleepq_wait+0x48/frame 0xd48fbc14 _cv_wait(c1be7f54,c1be7edc,c169396e,1be,8,...) at _cv_wait+0x21f/frame 0xd48fbc58 audit_worker(0,d48fbce8,c16435dc,407,0,...) at audit_worker+0x94/frame 0xd48fbcac fork_exit(c0f3f6f0,0,d48fbce8) at fork_exit+0x7e/frame 0xd48fbcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd48fbcd4 --- trap 0, eip = 0, esp = 0xd48fbd20, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc1be3fc0 sched_switch(c1be3fc0,0,104,188,c1b48e40,...) at sched_switch+0x503/frame 0xc2022bf0 mi_switch(104,0,c1654159,22b,c1be3fc0,...) at mi_switch+0x1f3/frame 0xc2022c2c sleepq_switch(c1be3fc0,0,c1654159,2d6,9d9b,...) at sleepq_switch+0x110/frame 0xc2022c60 sleepq_timedwait(c1be3c64,54,9,0,0,...) at sleepq_timedwait+0x53/frame 0xc2022c9c _sleep(c1be3c64,0,54,c16a45a7,fffff470,...) at _sleep+0x332/frame 0xc2022cf0 swapper() at swapper+0x2b0/frame 0xc2022d38 begin() at begin+0x2f Tracing command kernel pid 0 tid 100008 td 0xd60f8380 sched_switch(d60f8380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7e0ab88 mi_switch(104,0,c1654159,22b,d60f8380,...) at mi_switch+0x1f3/frame 0xd7e0abc8 sleepq_switch(d60f8380,0,c1654159,2b3,d60f8380,...) at sleepq_switch+0x110/frame 0xd7e0abfc sleepq_wait(d60f0a80,0,c163382b,0,0,...) at sleepq_wait+0x48/frame 0xd7e0ac20 _sleep(d60f0a80,d60f0a9c,0,c163382b,0,...) at _sleep+0x396/frame 0xd7e0ac74 taskqueue_thread_loop(c1be72dc,d7e0ace8,c16435dc,407,0,...) at taskqueue_thread_loop+0x144/frame 0xd7e0acac fork_exit(c0cd25d0,c1be72dc,d7e0ace8) at fork_exit+0x7e/frame 0xd7e0acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e0acd4 --- trap 0, eip = 0, esp = 0xd7e0ad20, ebp = 0 --- Tracing command kernel pid 0 tid 100010 td 0xd60eda80 sched_switch(d60eda80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7e14b88 mi_switch(104,0,c1654159,22b,d60eda80,...) at mi_switch+0x1f3/frame 0xd7e14bc8 sleepq_switch(d60eda80,0,c1654159,2b3,d60eda80,...) at sleepq_switch+0x110/frame 0xd7e14bfc sleepq_wait(d60f0900,0,c163382b,0,0,...) at sleepq_wait+0x48/frame 0xd7e14c20 _sleep(d60f0900,d60f091c,0,c163382b,0,...) at _sleep+0x396/frame 0xd7e14c74 taskqueue_thread_loop(c1be4554,d7e14ce8,c16435dc,407,0,...) at taskqueue_thread_loop+0x144/frame 0xd7e14cac fork_exit(c0cd25d0,c1be4554,d7e14ce8) at fork_exit+0x7e/frame 0xd7e14cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e14cd4 --- trap 0, eip = 0, esp = 0xd7e14d20, ebp = 0 --- Tracing command kernel pid 0 tid 100011 td 0xd60ed700 sched_switch(d60ed700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7e19b88 mi_switch(104,0,c1654159,22b,d60ed700,...) at mi_switch+0x1f3/frame 0xd7e19bc8 sleepq_switch(d60ed700,0,c1654159,2b3,d60ed700,...) at sleepq_switch+0x110/frame 0xd7e19bfc sleepq_wait(d60f0880,0,c163382b,0,0,...) at sleepq_wait+0x48/frame 0xd7e19c20 _sleep(d60f0880,d60f089c,0,c163382b,0,...) at _sleep+0x396/frame 0xd7e19c74 taskqueue_thread_loop(c1be7338,d7e19ce8,c16435dc,407,0,...) at taskqueue_thread_loop+0x144/frame 0xd7e19cac fork_exit(c0cd25d0,c1be7338,d7e19ce8) at fork_exit+0x7e/frame 0xd7e19cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e19cd4 --- trap 0, eip = 0, esp = 0xd7e19d20, ebp = 0 --- Tracing command kernel pid 0 tid 100013 td 0xd60ed000 sched_switch(d60ed000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7e23b98 mi_switch(104,0,c1654159,22b,d60ed000,...) at mi_switch+0x1f3/frame 0xd7e23bd8 sleepq_switch(d60ed000,0,c1654159,2b3,d60f0700,...) at sleepq_switch+0x110/frame 0xd7e23c0c sleepq_wait(d60f0700,0,c164d934,c163382b,0,...) at sleepq_wait+0x48/frame 0xd7e23c30 msleep_spin_sbt(d60f0700,d60f071c,c163382b,0,0,...) at msleep_spin_sbt+0x226/frame 0xd7e23c74 gtaskqueue_thread_loop(d6156004,d7e23ce8,c16435dc,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0xd7e23cac fork_exit(c0cbcd40,d6156004,d7e23ce8) at fork_exit+0x7e/frame 0xd7e23cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e23cd4 --- trap 0, eip = 0, esp = 0xd7e23d20, ebp = 0 --- Tracing command kernel pid 0 tid 100014 td 0xd615c380 sched_switch(d615c380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7e28b98 mi_switch(104,0,c1654159,22b,d615c380,...) at mi_switch+0x1f3/frame 0xd7e28bd8 sleepq_switch(d615c380,0,c1654159,2b3,d60f0680,...) at sleepq_switch+0x110/frame 0xd7e28c0c sleepq_wait(d60f0680,0,c164d934,c163382b,0,...) at sleepq_wait+0x48/frame 0xd7e28c30 msleep_spin_sbt(d60f0680,d60f069c,c163382b,0,0,...) at msleep_spin_sbt+0x226/frame 0xd7e28c74 gtaskqueue_thread_loop(d6155804,d7e28ce8,c16435dc,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0xd7e28cac fork_exit(c0cbcd40,d6155804,d7e28ce8) at fork_exit+0x7e/frame 0xd7e28cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e28cd4 --- trap 0, eip = 0, esp = 0xd7e28d20, ebp = 0 --- Tracing command kernel pid 0 tid 100015 td 0xd615c000 sched_switch(d615c000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7e2db98 mi_switch(104,0,c1654159,22b,d615c000,...) at mi_switch+0x1f3/frame 0xd7e2dbd8 sleepq_switch(d615c000,0,c1654159,2b3,d60f0000,...) at sleepq_switch+0x110/frame 0xd7e2dc0c sleepq_wait(d60f0000,0,c164d934,c163382b,0,...) at sleepq_wait+0x48/frame 0xd7e2dc30 msleep_spin_sbt(d60f0000,d60f001c,c163382b,0,0,...) at msleep_spin_sbt+0x226/frame 0xd7e2dc74 gtaskqueue_thread_loop(d6155814,d7e2dce8,c16435dc,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0xd7e2dcac fork_exit(c0cbcd40,d6155814,d7e2dce8) at fork_exit+0x7e/frame 0xd7e2dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e2dcd4 --- trap 0, eip = 0, esp = 0xd7e2dd20, ebp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xd615ba80 sched_switch(d615ba80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7e32b98 mi_switch(104,0,c1654159,22b,d615ba80,...) at mi_switch+0x1f3/frame 0xd7e32bd8 sleepq_switch(d615ba80,0,c1654159,2b3,d60eff00,...) at sleepq_switch+0x110/frame 0xd7e32c0c sleepq_wait(d60eff00,0,c164d934,c163382b,0,...) at sleepq_wait+0x48/frame 0xd7e32c30 msleep_spin_sbt(d60eff00,d60eff1c,c163382b,0,0,...) at msleep_spin_sbt+0x226/frame 0xd7e32c74 gtaskqueue_thread_loop(d6155824,d7e32ce8,c16435dc,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0xd7e32cac fork_exit(c0cbcd40,d6155824,d7e32ce8) at fork_exit+0x7e/frame 0xd7e32cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e32cd4 --- trap 0, eip = 0, esp = 0xd7e32d20, ebp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xd615b700 sched_switch(d615b700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7e37b98 mi_switch(104,0,c1654159,22b,d615b700,...) at mi_switch+0x1f3/frame 0xd7e37bd8 sleepq_switch(d615b700,0,c1654159,2b3,d60efe80,...) at sleepq_switch+0x110/frame 0xd7e37c0c sleepq_wait(d60efe80,0,c164d934,c163382b,0,...) at sleepq_wait+0x48/frame 0xd7e37c30 msleep_spin_sbt(d60efe80,d60efe9c,c163382b,0,0,...) at msleep_spin_sbt+0x226/frame 0xd7e37c74 gtaskqueue_thread_loop(d6155834,d7e37ce8,c16435dc,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0xd7e37cac fork_exit(c0cbcd40,d6155834,d7e37ce8) at fork_exit+0x7e/frame 0xd7e37cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e37cd4 --- trap 0, eip = 0, esp = 0xd7e37d20, ebp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xd615b380 sched_switch(d615b380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7e3cb98 mi_switch(104,0,c1654159,22b,d615b380,...) at mi_switch+0x1f3/frame 0xd7e3cbd8 sleepq_switch(d615b380,0,c1654159,2b3,d60efe00,...) at sleepq_switch+0x110/frame 0xd7e3cc0c sleepq_wait(d60efe00,0,c164d934,c163382b,0,...) at sleepq_wait+0x48/frame 0xd7e3cc30 msleep_spin_sbt(d60efe00,d60efe1c,c163382b,0,0,...) at msleep_spin_sbt+0x226/frame 0xd7e3cc74 gtaskqueue_thread_loop(d6155c04,d7e3cce8,c16435dc,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0xd7e3ccac fork_exit(c0cbcd40,d6155c04,d7e3cce8) at fork_exit+0x7e/frame 0xd7e3ccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e3ccd4 --- trap 0, eip = 0, esp = 0xd7e3cd20, ebp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xd615b000 sched_switch(d615b000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7e41b98 mi_switch(104,0,c1654159,22b,d615b000,...) at mi_switch+0x1f3/frame 0xd7e41bd8 sleepq_switch(d615b000,0,c1654159,2b3,d60efd80,...) at sleepq_switch+0x110/frame 0xd7e41c0c sleepq_wait(d60efd80,0,c164d934,c163382b,0,...) at sleepq_wait+0x48/frame 0xd7e41c30 msleep_spin_sbt(d60efd80,d60efd9c,c163382b,0,0,...) at msleep_spin_sbt+0x226/frame 0xd7e41c74 gtaskqueue_thread_loop(d6155c14,d7e41ce8,c16435dc,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0xd7e41cac fork_exit(c0cbcd40,d6155c14,d7e41ce8) at fork_exit+0x7e/frame 0xd7e41cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e41cd4 --- trap 0, eip = 0, esp = 0xd7e41d20, ebp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xd615aa80 sched_switch(d615aa80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7e46b98 mi_switch(104,0,c1654159,22b,d615aa80,...) at mi_switch+0x1f3/frame 0xd7e46bd8 sleepq_switch(d615aa80,0,c1654159,2b3,d60efd00,...) at sleepq_switch+0x110/frame 0xd7e46c0c sleepq_wait(d60efd00,0,c164d934,c163382b,0,...) at sleepq_wait+0x48/frame 0xd7e46c30 msleep_spin_sbt(d60efd00,d60efd1c,c163382b,0,0,...) at msleep_spin_sbt+0x226/frame 0xd7e46c74 gtaskqueue_thread_loop(d6155c24,d7e46ce8,c16435dc,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0xd7e46cac fork_exit(c0cbcd40,d6155c24,d7e46ce8) at fork_exit+0x7e/frame 0xd7e46cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e46cd4 --- trap 0, eip = 0, esp = 0xd7e46d20, ebp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xd615a700 sched_switch(d615a700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7e4bb98 mi_switch(104,0,c1654159,22b,d615a700,...) at mi_switch+0x1f3/frame 0xd7e4bbd8 sleepq_switch(d615a700,0,c1654159,2b3,d60efc80,...) at sleepq_switch+0x110/frame 0xd7e4bc0c sleepq_wait(d60efc80,0,c164d934,c163382b,0,...) at sleepq_wait+0x48/frame 0xd7e4bc30 msleep_spin_sbt(d60efc80,d60efc9c,c163382b,0,0,...) at msleep_spin_sbt+0x226/frame 0xd7e4bc74 gtaskqueue_thread_loop(d6155c34,d7e4bce8,c16435dc,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0xd7e4bcac fork_exit(c0cbcd40,d6155c34,d7e4bce8) at fork_exit+0x7e/frame 0xd7e4bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e4bcd4 --- trap 0, eip = 0, esp = 0xd7e4bd20, ebp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xd61d5700 sched_switch(d61d5700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7e7db88 mi_switch(104,0,c1654159,22b,d61d5700,...) at mi_switch+0x1f3/frame 0xd7e7dbc8 sleepq_switch(d61d5700,0,c1654159,2b3,d61d5700,...) at sleepq_switch+0x110/frame 0xd7e7dbfc sleepq_wait(d60ef300,0,c163382b,0,0,...) at sleepq_wait+0x48/frame 0xd7e7dc20 _sleep(d60ef300,d60ef31c,0,c163382b,0,...) at _sleep+0x396/frame 0xd7e7dc74 taskqueue_thread_loop(c1b559e4,d7e7dce8,c16435dc,407,0,...) at taskqueue_thread_loop+0x144/frame 0xd7e7dcac fork_exit(c0cd25d0,c1b559e4,d7e7dce8) at fork_exit+0x7e/frame 0xd7e7dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e7dcd4 --- trap 0, eip = 0, esp = 0xd7e7dd20, ebp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xd61d5380 sched_switch(d61d5380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7e82b88 mi_switch(104,0,c1654159,22b,d61d5380,...) at mi_switch+0x1f3/frame 0xd7e82bc8 sleepq_switch(d61d5380,0,c1654159,2b3,d61d5380,...) at sleepq_switch+0x110/frame 0xd7e82bfc sleepq_wait(d60ef280,0,c163382b,0,0,...) at sleepq_wait+0x48/frame 0xd7e82c20 _sleep(d60ef280,d60ef29c,0,c163382b,0,...) at _sleep+0x396/frame 0xd7e82c74 taskqueue_thread_loop(c1bbc260,d7e82ce8,c16435dc,407,0,...) at taskqueue_thread_loop+0x144/frame 0xd7e82cac fork_exit(c0cd25d0,c1bbc260,d7e82ce8) at fork_exit+0x7e/frame 0xd7e82cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e82cd4 --- trap 0, eip = 0, esp = 0xd7e82d20, ebp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xd61d5000 sched_switch(d61d5000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7e87b88 mi_switch(104,0,c1654159,22b,d61d5000,...) at mi_switch+0x1f3/frame 0xd7e87bc8 sleepq_switch(d61d5000,0,c1654159,2b3,d61d5000,...) at sleepq_switch+0x110/frame 0xd7e87bfc sleepq_wait(d60ef280,0,c163382b,0,0,...) at sleepq_wait+0x48/frame 0xd7e87c20 _sleep(d60ef280,d60ef29c,0,c163382b,0,...) at _sleep+0x396/frame 0xd7e87c74 taskqueue_thread_loop(c1bbc260,d7e87ce8,c16435dc,407,0,...) at taskqueue_thread_loop+0x144/frame 0xd7e87cac fork_exit(c0cd25d0,c1bbc260,d7e87ce8) at fork_exit+0x7e/frame 0xd7e87cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e87cd4 --- trap 0, eip = 0, esp = 0xd7e87d20, ebp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xd61d4a80 sched_switch(d61d4a80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7e8cb88 mi_switch(104,0,c1654159,22b,d61d4a80,...) at mi_switch+0x1f3/frame 0xd7e8cbc8 sleepq_switch(d61d4a80,0,c1654159,2b3,d61d4a80,...) at sleepq_switch+0x110/frame 0xd7e8cbfc sleepq_wait(d60ef280,0,c163382b,0,0,...) at sleepq_wait+0x48/frame 0xd7e8cc20 _sleep(d60ef280,d60ef29c,0,c163382b,0,...) at _sleep+0x396/frame 0xd7e8cc74 taskqueue_thread_loop(c1bbc260,d7e8cce8,c16435dc,407,0,...) at taskqueue_thread_loop+0x144/frame 0xd7e8ccac fork_exit(c0cd25d0,c1bbc260,d7e8cce8) at fork_exit+0x7e/frame 0xd7e8ccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e8ccd4 --- trap 0, eip = 0, esp = 0xd7e8cd20, ebp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xd61d4700 sched_switch(d61d4700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7e91b88 mi_switch(104,0,c1654159,22b,d61d4700,...) at mi_switch+0x1f3/frame 0xd7e91bc8 sleepq_switch(d61d4700,0,c1654159,2b3,d61d4700,...) at sleepq_switch+0x110/frame 0xd7e91bfc sleepq_wait(d60ef280,0,c163382b,0,0,...) at sleepq_wait+0x48/frame 0xd7e91c20 _sleep(d60ef280,d60ef29c,0,c163382b,0,...) at _sleep+0x396/frame 0xd7e91c74 taskqueue_thread_loop(c1bbc260,d7e91ce8,c16435dc,407,0,...) at taskqueue_thread_loop+0x144/frame 0xd7e91cac fork_exit(c0cd25d0,c1bbc260,d7e91ce8) at fork_exit+0x7e/frame 0xd7e91cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7e91cd4 --- trap 0, eip = 0, esp = 0xd7e91d20, ebp = 0 --- Tracing command kernel pid 0 tid 100083 td 0xd8315380 sched_switch(d8315380,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7fbbb98 mi_switch(104,0,c1654159,22b,d8315380,...) at mi_switch+0x1f3/frame 0xd7fbbbd8 sleepq_switch(d8315380,0,c1654159,2b3,d63c1400,...) at sleepq_switch+0x110/frame 0xd7fbbc0c sleepq_wait(d63c1400,0,c164d934,c163382b,0,...) at sleepq_wait+0x48/frame 0xd7fbbc30 msleep_spin_sbt(d63c1400,d63c141c,c163382b,0,0,...) at msleep_spin_sbt+0x226/frame 0xd7fbbc74 taskqueue_thread_loop(c1bd816c,d7fbbce8,c16435dc,407,0,...) at taskqueue_thread_loop+0xf3/frame 0xd7fbbcac fork_exit(c0cd25d0,c1bd816c,d7fbbce8) at fork_exit+0x7e/frame 0xd7fbbcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7fbbcd4 --- trap 0, eip = 0, esp = 0xd7fbbd20, ebp = 0 --- Tracing command kernel pid 0 tid 100089 td 0xd853e000 sched_switch(d853e000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7fdab98 mi_switch(104,0,c1654159,22b,d853e000,...) at mi_switch+0x1f3/frame 0xd7fdabd8 sleepq_switch(d853e000,0,c1654159,2b3,d853bb00,...) at sleepq_switch+0x110/frame 0xd7fdac0c sleepq_wait(d853bb00,0,c164d934,c163382b,0,...) at sleepq_wait+0x48/frame 0xd7fdac30 msleep_spin_sbt(d853bb00,d853bb1c,c163382b,0,0,...) at msleep_spin_sbt+0x226/frame 0xd7fdac74 taskqueue_thread_loop(c1bd9d5c,d7fdace8,c16435dc,407,0,...) at taskqueue_thread_loop+0xf3/frame 0xd7fdacac fork_exit(c0cd25d0,c1bd9d5c,d7fdace8) at fork_exit+0x7e/frame 0xd7fdacd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7fdacd4 --- trap 0, eip = 0, esp = 0xd7fdad20, ebp = 0 --- Tracing command kernel pid 0 tid 100090 td 0xd853da80 sched_switch(d853da80,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7fdfb98 mi_switch(104,0,c1654159,22b,d853da80,...) at mi_switch+0x1f3/frame 0xd7fdfbd8 sleepq_switch(d853da80,0,c1654159,2b3,d853bb00,...) at sleepq_switch+0x110/frame 0xd7fdfc0c sleepq_wait(d853bb00,0,c164d934,c163382b,0,...) at sleepq_wait+0x48/frame 0xd7fdfc30 msleep_spin_sbt(d853bb00,d853bb1c,c163382b,0,0,...) at msleep_spin_sbt+0x226/frame 0xd7fdfc74 taskqueue_thread_loop(c1bd9d5c,d7fdfce8,c16435dc,407,0,...) at taskqueue_thread_loop+0xf3/frame 0xd7fdfcac fork_exit(c0cd25d0,c1bd9d5c,d7fdfce8) at fork_exit+0x7e/frame 0xd7fdfcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7fdfcd4 --- trap 0, eip = 0, esp = 0xd7fdfd20, ebp = 0 --- Tracing command kernel pid 0 tid 100091 td 0xd853d700 sched_switch(d853d700,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7fe4b98 mi_switch(104,0,c1654159,22b,d853d700,...) at mi_switch+0x1f3/frame 0xd7fe4bd8 sleepq_switch(d853d700,0,c1654159,2b3,d853bb00,...) at sleepq_switch+0x110/frame 0xd7fe4c0c sleepq_wait(d853bb00,0,c164d934,c163382b,0,...) at sleepq_wait+0x48/frame 0xd7fe4c30 msleep_spin_sbt(d853bb00,d853bb1c,c163382b,0,0,...) at msleep_spin_sbt+0x226/frame 0xd7fe4c74 taskqueue_thread_loop(c1bd9d5c,d7fe4ce8,c16435dc,407,0,...) at taskqueue_thread_loop+0xf3/frame 0xd7fe4cac fork_exit(c0cd25d0,c1bd9d5c,d7fe4ce8) at fork_exit+0x7e/frame 0xd7fe4cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7fe4cd4 --- trap 0, eip = 0, esp = 0xd7fe4d20, ebp = 0 --- Tracing command kernel pid 0 tid 100093 td 0xd853d000 sched_switch(d853d000,0,104,188,c123d8d0,...) at sched_switch+0x503/frame 0xd7fee810 mi_switch(104,0,c1654159,22b,d853d000,...) at mi_switch+0x1f3/frame 0xd7fee850 sleepq_switch(d853d000,0,c1654159,2b3,c1910478,...) at sleepq_switch+0x110/frame 0xd7fee884 sleepq_wait(c1b5b780,0,d7fee8c8,1,0,...) at sleepq_wait+0x48/frame 0xd7fee8a8 _cv_wait(c1b5b780,c1b5b740,c1655993,362,2002,...) at _cv_wait+0x21f/frame 0xd7fee8ec vmem_xalloc(c1b5b740,400000,0,0,0,...) at vmem_xalloc+0x1df/frame 0xd7fee950 vmem_alloc(c1b5b740,400000,2002,d7fee9a0,0,...) at vmem_alloc+0xcc/frame 0xd7fee988 vmem_xalloc(c2381000,1000,0,0,0,...) at vmem_xalloc+0x417/frame 0xd7fee9ec vmem_alloc(c2381000,1000,2002,d7feea40,de524d10,...) at vmem_alloc+0xcc/frame 0xd7feea24 kmem_malloc_domain(0,1000,2) at kmem_malloc_domain+0x44/frame 0xd7feea50 page_alloc(c238aa00,1000,0,d7feea9b,2,...) at page_alloc+0x26/frame 0xd7feea68 keg_alloc_slab(0,102,c169eb97,94c,c6db8a00,...) at keg_alloc_slab+0xf6/frame 0xd7feeab0 keg_fetch_slab(ffffffff,102,c169eb97,9ae,3,...) at keg_fetch_slab+0x10e/frame 0xd7feeb08 zone_fetch_slab(c238aa00,0,ffffffff,102,c193f82c,...) at zone_fetch_slab+0x61/frame 0xd7feeb2c zone_import(c238aa00,c23a4d4c,5,ffffffff,102,...) at zone_import+0x3b/frame 0xd7feeb64 uma_zalloc_arg(c238aa00,0,102,d7feebdc,c0c55115,...) at uma_zalloc_arg+0x357/frame 0xd7feeba0 malloc(484,c1871970,102,128e,d858f000,...) at malloc+0x116/frame 0xd7feebdc xpt_run_allocq(d858f46c,0,c128ac03,d26,d60eeb80,...) at xpt_run_allocq+0x1ef/frame 0xd7feec10 xpt_run_allocq_task(d8581d00,1,c1654beb,1ce,0,...) at xpt_run_allocq_task+0x48/frame 0xd7feec30 taskqueue_run_locked(d60eeb80,d60eeb9c,0,c163382b,0,...) at taskqueue_run_locked+0x14b/frame 0xd7feec74 taskqueue_thread_loop(c1960468,d7feece8,c16435dc,407,0,...) at taskqueue_thread_loop+0xa7/frame 0xd7feecac fork_exit(c0cd25d0,c1960468,d7feece8) at fork_exit+0x7e/frame 0xd7feecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xd7feecd4 --- trap 0, eip = 0, esp = 0xd7feed20, ebp = 0 --- db:0:allt> dump Physical memory: 3427 MB Dumping 747 MB: 732 716 700 684 668 652 636 620 604 588 572 556 540 524 508 492 476 460 444 428 412 396 380 364 348 332 316 300 284 268 252 236 220 204 188 172 156 140 124 108 92 76 60 44 28 12 Dump complete db:0:dump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 3 $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/geom/mirror/g_mirror.c =================================================================== --- /usr/src/sys/geom/mirror/g_mirror.c (revision 328874) +++ /usr/src/sys/geom/mirror/g_mirror.c (working copy) @@ -1336,9 +1336,7 @@ g_mirror_sync_request(struct g_mirror_softc *sc, s */ switch (bp->bio_cmd) { case BIO_READ: { - struct g_mirror_disk *d; struct g_consumer *cp; - int readable; KFAIL_POINT_ERROR(DEBUG_FP, g_mirror_sync_request_read, bp->bio_error); @@ -1349,31 +1347,17 @@ g_mirror_sync_request(struct g_mirror_softc *sc, s bp->bio_error); /* - * If there's at least one other disk from which we can - * read the block, retry the request. - */ - readable = 0; - LIST_FOREACH(d, &sc->sc_disks, d_next) - if (d->d_state == G_MIRROR_DISK_STATE_ACTIVE && - !(d->d_flags & G_MIRROR_DISK_FLAG_BROKEN)) - readable++; - - /* * The read error will trigger a syncid bump, so there's * no need to do that here. * - * If we can retry the read from another disk, do so. - * Otherwise, all we can do is kick out the new disk. + * The read error handling for regular requests will + * retry the read from all active mirrors before passing + * the error back up, so there's no need to retry here. */ - if (readable == 0) { - g_mirror_sync_request_free(disk, bp); - g_mirror_event_send(disk, - G_MIRROR_DISK_STATE_DISCONNECTED, - G_MIRROR_EVENT_DONTWAIT); - } else { - g_mirror_sync_reinit(disk, bp, bp->bio_offset); - goto retry_read; - } + g_mirror_sync_request_free(disk, bp); + g_mirror_event_send(disk, + G_MIRROR_DISK_STATE_DISCONNECTED, + G_MIRROR_EVENT_DONTWAIT); return; } G_MIRROR_LOGREQ(3, bp, @@ -1429,7 +1413,6 @@ g_mirror_sync_request(struct g_mirror_softc *sc, s g_mirror_sync_reinit(disk, bp, sync->ds_offset); sync->ds_offset += bp->bio_length; -retry_read: G_MIRROR_LOGREQ(3, bp, "Sending synchronization request."); sync->ds_consumer->index++; Index: /usr/src/sys/kern/vfs_bio.c =================================================================== --- /usr/src/sys/kern/vfs_bio.c (revision 328874) +++ /usr/src/sys/kern/vfs_bio.c (working copy) @@ -4075,10 +4075,6 @@ bufdone(struct buf *bp) runningbufwakeup(bp); if (bp->b_iocmd == BIO_WRITE) dropobj = bp->b_bufobj; - else if ((bp->b_flags & B_CKHASH) != 0) { - KASSERT(buf_mapped(bp), ("biodone: bp %p not mapped", bp)); - (*bp->b_ckhashcalc)(bp); - } /* call optional completion function if requested */ if (bp->b_iodone != NULL) { biodone = bp->b_iodone; @@ -4115,6 +4111,13 @@ bufdone_finish(struct buf *bp) bp->b_flags |= B_CACHE; vfs_vmio_iodone(bp); } + if ((bp->b_flags & B_CKHASH) != 0) { + KASSERT(bp->b_iocmd == BIO_READ, + ("bufdone_finish: b_iocmd %d not BIO_READ", bp->b_iocmd)); + KASSERT(buf_mapped(bp), + ("bufdone_finish: bp %p not mapped", bp)); + (*bp->b_ckhashcalc)(bp); + } /* * For asynchronous completions, release the buffer now. The brelse