GENERIC HEAD from 2015-04-10 06:02:37 UTC, r281351M, vmcore.789 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb 4718592K of memory above 4GB ignored Copyright (c) 1992-2015 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.0-CURRENT #0 r281351M: Fri Apr 10 08:41:12 CEST 2015 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 FreeBSD clang version 3.6.0 (tags/RELEASE_360/final 230434) 20150225 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT: running with driver "vga". CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin="AuthenticAMD" Id=0x100f23 Family=0x10 Model=0x2 Stepping=3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff SVM: NP,NAsids=64 TSC: P-state invariant real memory = 8589934592 (8192 MB) avail memory = 3528867840 (3365 MB) : Trying to mount root from ufs:/dev/ad4s1a [rw]... WARNING: / was not properly dismounted Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Starting file system checks: /dev/ad4s1a: 6895 files, 978965 used, 34050 free (1202 frags, 4106 blocks, 0.1% fragmentation) /dev/ad4s1f: 21231 files, 279422 used, 733593 free (8897 frags, 90587 blocks, 0.9% fragmentation) /dev/label/tmp: FREE BLK COUNT(S) WRONG IN SUPERBLK (SALVAGED) /dev/label/tmp: 406776 files, 57591960 used, 60722021 free (19565 frags, 7587807 blocks, 0.0% fragmentation) /dev/ad4s1d: 526351 files, 7888753 used, 2265446 free (260790 frags, 250582 blocks, 2.6% fragmentation) ** SU+J Recovering /dev/ad4s1e ** Reading 33554432 byte journal from inode 6. ** Building recovery table. ** Resolving unreferenced inode list. ** Processing journal entries. ** 2 journal records in 512 bytes for 12.50% utilization ** Freed 0 inodes (0 dirs) 0 blocks, and 0 frags. ***** FILE SYSTEM MARKED CLEAN ***** Mounting local file systems:. Setting hostname: x4.osted.lan. Feeding entropy:. re0: link state changed to DOWN Starting Network: lo0 re0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 groups: lo re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 scopeid 0x1 nd6 options=23 media: Ethernet autoselect (none) status: no carrier Starting devd. Starting pflogd: re0: link state changed to UP add net default: gateway 192.168.1.1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Starting rtsold. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/gcc46 /usr/local/lib/gcc48 /usr/local/lib/mysql /usr/local/lib/nss /usr/local/lib/pth /usr/local/lib/qt4 a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. Starting watchdogd. savecore: reboot after panic: share->excl Apr 11 12:45:51 x4 savecore: reboot after panic: sharloce->excl k order reversal: 1st 0xe44c89c8 bufwait (bufwait) @ kern/vfs_bio.c:3097 2nd 0xc9a6e400 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:285 KDB: stack backtrace: db_trace_self_wrapper(c11f072c,c9d9ad68,e44c8978,edbbb6b8,c0bfb3ca,...) at db_trace_self_wrapper+0x2a/frame 0xedbbb688 kdb_backtrace(c11f4825,c9a6e400,c1227fb1,c858b8c0,c1227bf6,...) at kdb_backtrace+0x2d/frame 0xedbbb6f0 witness_checkorder(c9a6e400,9,c1227bed,11d,0,...) at witness_checkorder+0xd2e/frame 0xedbbb744 _sx_xlock(c9a6e400,0,c1227bed,11d,0,...) at _sx_xlock+0x74/frame 0xedbbb774 ufsdirhash_add(c932fe80,edbbb890,188,edbbb800,edbbb804,...) at ufsdirhash_add+0x4a/frame 0xedbbb7a8 ufs_direnter(c9d9aca8,c9daa9d8,edbbb890,edbbbb9c,0,...) at ufs_direnter+0x654/frame 0xedbbb830 ufs_makeinode(edbbbb88,edbbbb9c,c9d9aca8,c149c1c4,c9d9aca8,...) at ufs_makeinode+0x533/frame 0xedbbb9ac ufs_create(edbbbaa8,c13b82c3,c1220da6,c9d9aca8,edbbbaa4,...) at ufs_create+0x30/frame 0xedbbb9d0 VOP_CREATE_APV(c1488e80,edbbbaa8,edbbbb9c,edbbba38,c1f9b900,...) at VOP_CREATE_APV+0x12f/frame 0xedbbba00 vn_open_cred(edbbbb40,edbbbbcc,180,0,c89fab00,c93d2508) at vn_open_cred+0x282/frame 0xedbbbad0 vn_open(edbbbb40,edbbbbcc,180,c93d2508,804cad5,...) at vn_open+0x3d/frame 0xedbbbaf8 kern_openat(c8edc000,ffffff9c,804cad5,0,601,180) at kern_openat+0x2ec/frame 0xedbbbbf0 sys_openat(c8edc000,edbbbca8,c11e4fcd,4,c1073da7,...) at sys_openat+0x3a/frame 0xedbbbc18 syscall(edbbbce8) at syscall+0x34a/frame 0xedbbbcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbbbcdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x2815b83f, esp = 0xbfbfe664, ebp = 0xbfbfe680 --- savecore: writing core to /var/crash/vmcore.788 Writing crash summary to /var/crash/core.txt.788. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 Starting casperd. Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Recovering vi editor sessions:. Updating motd:. Mounting late file systems:. Starting ntpd. Starting powerd. Apr 11 12:46:27 x4 ntpd[669]: setsockopt IPV6_MULTICAST_IF 0 for fe80::221:85ff:fe15:337d%1 fails: Can't assign requested address Apr 11 12:46:27 x4 ntpd[669]: setsockopt IPV6_MULTICAST_IF 0 for fe80::1%2 fails: Can't assign requested address Starting smartd. Apr 11 12:46:27 x4 smartd[689]: Device: /dev/ada0, WARNING: A firmware update for this drive may be available, Apr 11 12:46:27 x4 smartd[689]: see the following Seagate web pages: Apr 11 12:46:27 x4 smartd[689]: http://knowledge.seagate.com/articles/en_US/FAQ/207931en Apr 11 12:46:27 x4 smartd[689]: http://knowledge.seagate.com/articles/en_US/FAQ/213891en Starting default moused. Configuring vt: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting sendmail_submit. Starting sendmail_msp_queue. Starting cron. Local package initialization: backuplock order reversal: 1st 0xc93dae44 ufs (ufs) @ kern/vfs_subr.c:2176 2nd 0xe4615ce0 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:263 3rd 0xca4595d4 ufs (ufs) @ kern/vfs_subr.c:2176 KDB: stack backtrace: db_trace_self_wrapper(c11f072c,edb22630,c0ab226f,4000,0,...) at db_trace_self_wrapper+0x2a/frame 0xedb225d8 kdb_backtrace(c11f483e,ca4595d4,c11dab5d,c858b858,c11fdea9,...) at kdb_backtrace+0x2d/frame 0xedb2263c witness_checkorder(ca4595d4,9,c11fdea0,880,ca459640,...) at witness_checkorder+0xd2e/frame 0xedb22690 __lockmgr_args(ca4595d4,80100,ca459640,0,0,...) at __lockmgr_args+0x935/frame 0xedb2276c ffs_lock(edb227e8,c8589a48,c15b6ae0,c8589a48,c8583178,...) at ffs_lock+0x98/frame 0xedb227a4 VOP_LOCK1_APV(c1488e80,edb227e8,0,c944b000,c149e0cc,...) at VOP_LOCK1_APV+0x10a/frame 0xedb227d0 _vn_lock(ca4595a0,80100,c11fdea0,880,c11fd0c0,...) at _vn_lock+0xba/frame 0xedb22810 vget(ca4595a0,80100,c944b000,57,80100,...) at vget+0x74/frame 0xedb22848 vfs_hash_get(c97ed000,16e3400,80000,c944b000,edb22940,...) at vfs_hash_get+0xe7/frame 0xedb22874 ffs_vgetf(c97ed000,16e3400,80000,edb22940,1,...) at ffs_vgetf+0x44/frame 0xedb228d0 softdep_sync_buf(c93dae10,e4615c90,1,0,0,...) at softdep_sync_buf+0x36b/frame 0xedb22958 ffs_syncvnode(c93dae10,1,0,5f9,c8583588,...) at ffs_syncvnode+0x2aa/frame 0xedb229b0 ffs_sync(c97ed000,4,c11ff954,72d,c944b000,...) at ffs_sync+0x1e9/frame 0xedb22a38 vfs_write_suspend(c97ed000,0,c122819e,79,72,...) at vfs_write_suspend+0x1bf/frame 0xedb22a74 vfs_write_suspend_umnt(c97ed000,c944b000,edb22ac0,c11fdea0,8ce,...) at vfs_write_suspend_umnt+0x42/frame 0xedb22a9c ffs_unmount(c97ed000,8080000,edb22b20,510,c15b6ae0,...) at ffs_unmount+0xa7/frame 0xedb22ae8 dounmount(c97ed000,8080000,c944b000,492,14f,...) at dounmount+0x4c9/frame 0xedb22b48 sys_unmount(c944b000,edb22ca8,c11e4fcd,4,c1577e10,...) at sys_unmount+0x2d4/frame 0xedb22c18 syscall(edb22ce8) at syscall+0x34a/frame 0xedb22cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedb22cdc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280da46b, esp = 0xbfbfe69c, ebp = 0xbfbfe768 --- lock order reversal: 1st 0xc9403304 ufs (ufs) @ kern/vfs_mount.c:1229 2nd 0xc8d2d304 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1904 KDB: stack backtrace: db_trace_self_wrapper(c11f072c,c15b6ae0,8,10,c1461ad0,...) at db_trace_self_wrapper+0x2a/frame 0xedb22740 kdb_backtrace(c11f4825,c8d2d304,c11e6e6c,c858b6b8,c12237c0,...) at kdb_backtrace+0x2d/frame 0xedb227a4 witness_checkorder(c8d2d304,9,c12237b7,770,0,...) at witness_checkorder+0xd2e/frame 0xedb227f8 __lockmgr_args(c8d2d304,80400,c8d2d370,0,0,0,c12237b7,770) at __lockmgr_args+0x935/frame 0xedb228d4 vop_stdlock(edb22948,c9464400,edb22940,c0b5cdd9,c9464400,...) at vop_stdlock+0x53/frame 0xedb22904 VOP_LOCK1_APV(c1451298,edb22948,edb22970,c0dd5175,c149e0cc,...) at VOP_LOCK1_APV+0x10a/frame 0xedb22930 _vn_lock(c8d2d2d0,80400,c12237b7,770,edb22a0c,...) at _vn_lock+0xba/frame 0xedb22970 softdep_flushworklist(c97ed000,edb22a08,c944b000,60d,c8583588,...) at softdep_flushworklist+0x68/frame 0xedb229b0 ffs_sync(c97ed000,4,c11ff954,72d,c944b000,...) at ffs_sync+0x2ae/frame 0xedb22a38 vfs_write_suspend(c97ed000,0,c122819e,79,72,...) at vfs_write_suspend+0x1bf/frame 0xedb22a74 vfs_write_suspend_umnt(c97ed000,c944b000,edb22ac0,c11fdea0,8ce,...) at vfs_write_suspend_umnt+0x42/frame 0xedb22a9c ffs_unmount(c97ed000,8080000,edb22b20,510,c15b6ae0,...) at ffs_unmount+0xa7/frame 0xedb22ae8 dounmount(c97ed000,8080000,c944b000,492,14f,...) at dounmount+0x4c9/frame 0xedb22b48 sys_unmount(c944b000,edb22ca8,c11e4fcd,4,c1577e10,...) at sys_unmount+0x2d4/frame 0xedb22c18 syscall(edb22ce8) at syscall+0x34a/frame 0xedb22cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedb22cdc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280da46b, esp = 0xbfbfe69c, ebp = 0xbfbfe768 --- ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes lock order reversal: 1st 0xcbfaba0c ufs (ufs) @ kern/vfs_vnops.c:877 2nd 0xc163fe10 proctree (proctree) @ kern/subr_prf.c:146 KDB:Apr 11 12:47:57 stax4 kernel: pid 8ck ba92 (svn), uid 10cktr01 inumber 21377ace:0 on /: filesyst em full db_trace_self_wrapper(c11f072c,b5cdd9,33373730,3231,c1226f31,...) at db_trace_self_wrapper+0x2a/frame 0xf895b538 kdb_backtrace(c11f4825,c163fe10,c11ea47c,c8582068,c11f1894,...) at kdb_backtrace+0x2d/frame 0xf895b5a0 witness_checkorder(c163fe10,1,c11f188b,92,0,...) at witness_checkorder+0xd2e/frame 0xf895b5f4 _sx_slock(c163fe10,0,c11f188b,92,10,...) at _sx_slock+0x6e/frame 0xf895b620 uprintf(c122200e,c932a0d4,37c,ca73f5a8,3e9,...) at uprintf+0x46/frame 0xf895b678 ffs_alloc(cbf9e15c,0,0,cf780,0,...) at ffs_alloc+0x469/frame 0xf895b6e0 ffs_balloc_ufs2(cbfab9d8,0,0,1,c89fa400,...) at ffs_balloc_ufs2+0xc97/frame 0xf895b82c ffs_write(f895b9b0,c13b862d,cbfaba0c,cbfab9d8,c149c1c4,...) at ffs_write+0x592/frame 0xf895b8b8 VOP_WRITE_APV(c1488e80,f895b9b0,cbfab9d8,36d,2,...) at VOP_WRITE_APV+0x1ac/frame 0xf895b978 vn_write(c9399bd0,f895bbe8,c89fa400,1,ca742000,...) at vn_write+0x328/frame 0xf895b9e0 vn_io_fault_doio(ca742000,f895ba4c,c0baec5c,c1587ae4,0,...) at vn_io_fault_doio+0x34/frame 0xf895ba28 vn_io_fault1(ca742000,0,0,ffffffff,7fffffff,...) at vn_io_fault1+0x6d/frame 0xf895baf8 vn_io_fault(c9399bd0,f895bbe8,c89fa400,0,ca742000,...) at vn_io_fault+0x1fa/frame 0xf895bb4c dofilewrite(c9399bd0,f895bbe8,ffffffff,ffffffff,0,...) at dofilewrite+0xa0/frame 0xf895bb80 kern_writev(ca742000,4,f895bbe8,c15b6980,bfbfdfef,...) at kern_writev+0x93/frame 0xf895bbc8 sys_write(ca742000,f895bca8,c11e4fcd,4,c1073da7,...) at sys_write+0x59/frame 0xf895bc18 syscall(f895bce8) at syscall+0x34a/frame 0xf895bcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf895bcdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x285f9eef, esp = 0xbfbfdf88, ebp = 0xbfbfdfa4 --- ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 406776 files, 57591960 used, 60722021 free (19565 frags, 7587807 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmp. Starting inetd. Sat Apr 11 12:56:40 CEST 2015 FreeBSD/i386 (x4.osted.lan) (ttyu0) login: lock order reversal: 1st 0xcb1e1a14 so_snd_sx (so_snd_sx) @ kern/uipc_sockbuf.c:265 2nd 0xc936ba80 filedesc structure (filedesc structure) @ kern/uipc_usrreq.c:1937 KDB: stack backtrace: db_trace_self_wrapper(c11f072c,632e7165,3339313a,c8000a37,c9c7afa8,...) at db_trace_self_wrapper+0x2a/frame 0xf8988970 kdb_backtrace(c11f4825,c936ba80,c11e42df,c8587480,c11fa762,...) at kdb_backtrace+0x2d/frame 0xf89889d4 witness_checkorder(c936ba80,1,c11fa759,791,0,...) at witness_checkorder+0xd2e/frame 0xf8988a28 _sx_slock(c936ba80,0,c11fa759,791,c9c93c18,...) at _sx_slock+0x6e/frame 0xf8988a54 uipc_send(cb1e18e8,0,c9c7ac00,0,c9d64a00,...) at uipc_send+0x112/frame 0xf8988aa4 sosend_generic(cb1e18e8,0,f8988b58,0,c9d64a00,...) at sosend_generic+0x423/frame 0xf8988b18 kern_sendit(ca741000,5,f8988be8,0,c9d64a00,...) at kern_sendit+0x298/frame 0xf8988b8c sendit(f8988be8,0,f8988be4,28,0,...) at sendit+0x131/frame 0xf8988bc8 sys_sendmsg(ca741000,f8988ca8,c11e4fcd,4,c1073da7,...) at sys_sendmsg+0x76/frame 0xf8988c18 syscall(f8988ce8) at syscall+0x34a/frame 0xf8988cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8988cdc --- syscall (28, FreeBSD ELF32, sys_sendmsg), eip = 0x284c5faf, esp = 0xbfbfe6e4, ebp = 0xbfbfe700 --- Apr 11 13:24:26 x4 su: pho to root on /dev/pts/0 20150411 13:29:47 all (1/22): umountf5.sh 20150411 13:30:23 all (2/22): rename2.sh 20150411 13:50:25 all (3/22): kevent3.sh 20150411 13:50:27 all (4/22): suj5.sh 20150411 13:51:49 all (5/22): cluster.sh 20150411 13:51:50 all (6/22): datamove3.sh 20150411 13:51:51 all (7/22): crossmp.sh lock order reversal: 1st 0xcaf9a304 ufs (ufs) @ kern/vfs_subr.c:2176 2nd 0xc163fe54 allproc (allproc) @ kern/kern_descrip.c:2880 KDB: stack backtrace: db_trace_self_wrapper(c11f072c,80100,f896aa18,c0c18428,caf9a380,...) at db_trace_self_wrapper+0x2a/frame 0xf896a9d0 kdb_backtrace(c11f4825,c163fe54,c11e2d38,c85820d0,c11e413a,...) at kdb_backtrace+0x2d/frame 0xf896aa38 witness_checkorder(c163fe54,1,c11e4131,b40,0,...) at witness_checkorder+0xd2e/frame 0xf896aa8c _sx_slock(c163fe54,0,c11e4131,b40,80000,...) at _sx_slock+0x6e/frame 0xf896aab8 mountcheckdirs(caf9a2d0,cb57cb40,f896ab20,510,c15b5f88,...) at mountcheckdirs+0x41/frame 0xf896aae8 dounmount(c92ff5d8,8080000,cd185620,492,14f,...) at dounmount+0x413/frame 0xf896ab48 sys_unmount(cd185620,f896aca8,c11e4fcd,4,c1073da7,...) at sys_unmount+0x2d4/frame 0xf896ac18 syscall(f896ace8) at syscall+0x34a/frame 0xf896acdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf896acdc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280da46b, esp = 0xbfbfe0cc, ebp = 0xbfbfe198 --- Apr 11 13:52:10 x4 mountd[604]: can't delete exports for /mnt18: Device busy Apr 11 13:52:32 x4 mountd[604]: can't delete exports for /mnt8: Device busy Apr 11 13:52:34 x4 mountd[604]: can't delete exports for /mnt17: Device busy 20150411 14:08:39 all (8/22): ffs_syncvnode2.sh Apr 11 14:08:51 x4 kernel: pid 44845 (rw), uid 1004 inumber 131089 on /mnt: filesystem full Apr 11 14:08:51 x4 kernel: pid 44835 (mkdir), uid 1004 inumber 20 on /mnt: filesystem full Apr 11 14:08:51 x4 kernel: pid 44826 (creat), uid 1004 inumber 196609 on /mnt: filesystem full Apr 11 14:11:17 x4 kernel: pid 45059 (mkdir), uid 1004 inumber 131134 on /mnt: filesystem full Apr 11 14:11:17 x4 kernel: pid 45034 (rw), uid 1004 inumber 131074 on /mnt: filesystem full Apr 11 14:15:54 x4 kernel: pid 46263 (mkdir), uid 1004 inumber 131607 on /mnt: filesystem full Apr 11 14:15:54 x4 kernel: pid 46248 (rw), uid 1004 inumber 92 on /mnt: filesystem full Apr 11 14:15:54 x4 kernel: pid 46231 (creat), uid 1004 inumber 93 on /mnt: filesystem full Apr 11 14:16:09 x4 kernel: pid 46254 (rw), uid 1004 inumber 84092 on /mnt: filesystem full Apr 11 14:26:49 x4 kernel: pid 49319 (rw), uid 1004 inumber 131084 on /mnt: filesystem full Apr 11 14:26:49 x4 kernel: pid 49349 (creat), uid 1004 inumber 1267 on /mnt: filesystem full Apr 11 14:26:49 x4 kernel: pid 49343 (mkdir), uid 1004 inumber 2073 on /mnt: filesystem full Apr 11 14:33:46 x4 kernel: pid 52032 (mkdir), uid 1004 inumber 133459 on /mnt: filesystem full Apr 11 14:33:48 x4 kernel: pid 52058 (mkdir), uid 1004 inumber 132972 on /mnt: filesystem full Apr 11 14:33:49 x4 kernel: pid 52046 (rw), uid 1004 inumber 131242 on /mnt: filesystem full Apr 11 14:33:49 x4 kernel: pid 52047 (creat), uid 1004 inumber 131237 on /mnt: filesystem full Apr 11 14:34:48 x4 kernel: pid 53491 (rw), uid 1004 inumber 131183 on /mnt: filesystem full Apr 11 14:34:54 x4 kernel: pid 53489 (rw), uid 1004 inumber 131186 on /mnt: filesystem full Apr 11 14:34:54 x4 kernel: pid 53482 (mkdir), uid 1004 inumber 196841 on /mnt: filesystem full Apr 11 14:37:52 x4 kernel: pid 55488 (rw), uid 1004 inumber 141666 on /mnt: filesystem full Apr 11 14:37:54 x4 kernel: pid 55498 (rw), uid 1004 inumber 141687 on /mnt: filesystem full Apr 11 14:37:54 x4 kernel: pid 55471 (creat), uid 1004 inumber 139656 on /mnt: filesystem full Apr 11 14:37:55 x4 kernel: pid 55480 (mkdir), uid 1004 inumber 198455 on /mnt: filesystem full Apr 11 14:37:55 x4 kernel: pid 55477 (creat), uid 1004 inumber 139662 on /mnt: filesystem full Apr 11 14:37:55 x4 kernel: pid 55474 (rw), uid 1004 inumber 141678 on /mnt: filesystem full Apr 11 14:37:56 x4 kernel: pid 55512 (mkdir), uid 1004 inumber 137321 on /mnt: filesystem full Apr 11 14:37:57 x4 kernel: pid 55475 (creat), uid 1004 inumber 139702 on /mnt: filesystem full Apr 11 14:37:57 x4 kernel: pid 55470 (mkdir), uid 1004 inumber 136449 on /mnt: filesystem full Apr 11 14:37:57 x4 kernel: pid 55495 (rw), uid 1004 inumber 141651 on /mnt: filesystem full 20150411 14:38:56 all (9/22): fdgrowtable.sh 20150411 14:43:11 all (10/22): md4.sh 20150411 14:43:11 all (11/22): fpclone2.sh 20150411 14:43:17 all (12/22): marcus.sh *** Excessive run time: marcus.sh, 32 min 20150411 15:15:26 all (13/22): pts.sh 20150411 15:19:38 all (14/22): ffs_syncvnode.sh lock order reversal: 1st 0xd996d304 pseudofs (pseudofs) @ kern/vfs_syscalls.c:4072 2nd 0xc163fe54 allproc (allproc) @ fs/pseudofs/pseudofs_vnops.c:790 KDB: stack backtrace: db_trace_self_wrapper(c11f072c,c0b3ec4a,d996d324,8,c11ff6dc,...) at db_trace_self_wrapper+0x2a/frame 0xf8b759c8 kdb_backtrace(c11f4825,c163fe54,c11e2d38,c85820d0,c11d7785,...) at kdb_backtrace+0x2d/frame 0xf8b75a30 witness_checkorder(c163fe54,1,c11d777c,316,0,...) at witness_checkorder+0xd2e/frame 0xf8b75a84 _sx_slock(c163fe54,0,c11d777c,316,c1097c2e,...) at _sx_slock+0x6e/frame 0xf8b75ab0 pfs_readdir(f8b75bb8,c13b89c4,c1220f10,c11ff6dc,fe8,...) at pfs_readdir+0x10d/frame 0xf8b75b18 VOP_READDIR_APV(c14545ec,f8b75bb8,c11ff6dc,fe8,0,...) at VOP_READDIR_APV+0x12f/frame 0xf8b75b48 kern_getdirentries(ce619310,5,2888b000,1000,f8b75c08,...) at kern_getdirentries+0x1e3/frame 0xf8b75be4 sys_getdirentries(ce619310,f8b75ca8,c11e4fcd,4,df,...) at sys_getdirentries+0x42/frame 0xf8b75c18 syscall(f8b75ce8) at syscall+0x34a/frame 0xf8b75cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8b75cdc --- syscall (196, FreeBSD ELF32, sys_getdirentries), eip = 0x280fd9bb, esp = 0xbfbfe73c, ebp = 0xbfbfe770 --- *** Excessive run time: ffs_syncvnode.sh, 35 min 20150411 15:55:10 all (15/22): overcommit.sh 20150411 16:06:33 all (16/22): nullfs2.sh *** Excessive run time: nullfs2.sh, 34 min 20150411 16:41:21 all (17/22): mountro.sh 20150411 16:42:59 all (18/22): contigmalloc.sh 20150411 16:45:10 all (19/22): tmpfs2.sh lock order reversal: 1st 0xd8337034 tmpfs (tmpfs) @ kern/vfs_subr.c:2176 2nd 0xc163fe54 allproc (allproc) @ kern/kern_descrip.c:2880 KDB: stack backtrace: db_trace_self_wrapper(c11f072c,c11f5084,20,246,c944a930,...) at db_trace_self_wrapper+0x2a/frame 0xedb3f9d0 kdb_backtrace(c11f4825,c163fe54,c11e2d38,c85820d0,c11e413a,...) at kdb_backtrace+0x2d/frame 0xedb3fa38 witness_checkorder(c163fe54,1,c11e4131,b40,0,...) at witness_checkorder+0xd2e/frame 0xedb3fa8c _sx_slock(c163fe54,0,c11e4131,b40,db27b110,...) at _sx_slock+0x6e/frame 0xedb3fab8 mountcheckdirs(d8337000,d970b5a0,edb3fb20,510,c15b4618,...) at mountcheckdirs+0x41/frame 0xedb3fae8 dounmount(cf07e8c4,8080000,c944a930,492,14f,...) at dounmount+0x413/frame 0xedb3fb48 sys_unmount(c944a930,edb3fca8,c11e4fcd,4,8,...) at sys_unmount+0x2d4/frame 0xedb3fc18 syscall(edb3fce8) at syscall+0x34a/frame 0xedb3fcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedb3fcdc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280da46b, esp = 0xbfbfe0cc, ebp = 0xbfbfe198 --- Apr 11 16:45:15 x4 mountd[604]: can't delete exports for /mnt15: Device busy Apr 11 16:45:25 x4 mountd[604]: can't delete exports for /mnt15: Device busy Apr 11 16:45:28 x4 mountd[604]: can't delete exports for /mnt14: Device busy Apr 11 16:45:41 x4 mountd[604]: can't delete exports for /mnt15: Device busy Apr 11 16:45:48 x4 mountd[604]: can't delete exports for /mnt6: Device busy Apr 11 16:45:59 x4 mountd[604]: can't delete exports for /mnt10: Device busy Apr 11 16:46:09 x4 mountd[604]: can't delete exports for /mnt12: Device busy Apr 11 16:46:18 x4 mountd[604]: can't delete exports for /mnt6: Device busy Apr 11 16:46:30 x4 mountd[604]: can't delete exports for /mnt12: Device busy Apr 11 16:46:47 x4 mountd[604]: can't delete exports for /mnt12: Device busy Apr 11 16:48:05 x4 mountd[604]: can't delete exports for /mnt11: Device busy Apr 11 16:48:12 x4 mountd[604]: can't delete exports for /mnt12: Device busy 20150411 16:48:40 all (20/22): newfs5.sh 20150411 16:48:49 all (21/22): truncate.sh 20150411 17:01:08 all (22/22): trim.sh FreeBSD/i386 (x4.osted.lan) (ttyu0) login: KDB: enter: Break to debugger [ thread pid 11 tid 100005 ] Stopped at kdb_alt_break_internal+0x162: movl $0,kdb_why db> set $lines 0 db> run pho db:0:pho> bt Tracing pid 11 tid 100005 td 0xc8a2d930 kdb_alt_break_internal(0,e4741ac8,c097fa37,2,c8c6f684,...) at kdb_alt_break_internal+0x162/frame 0xe4741a9c kdb_alt_break(2,c8c6f684,c11b4431,c8c6f600,40000,...) at kdb_alt_break+0x16/frame 0xe4741aa8 uart_intr_rxready(c8c6f600,c13afc53,df,448c,1,...) at uart_intr_rxready+0x87/frame 0xe4741ac8 uart_intr(c8c6f600,0,b,0,0,...) at uart_intr+0x100/frame 0xe4741b04 intr_event_handle(c8a26680,e4741b80,0,2,0,...) at intr_event_handle+0x7a/frame 0xe4741b30 intr_execute_handlers(c8a7a108,e4741b80,2) at intr_execute_handlers+0x42/frame 0xe4741b50 lapic_handle_intr(30,e4741b80) at lapic_handle_intr+0x5d/frame 0xe4741b70 Xapic_isr1() at Xapic_isr1+0x4a/frame 0xe4741b70 --- interrupt, eip = 0xc1051d75, esp = 0xe4741bc0, ebp = 0xe4741bc0 --- acpi_cpu_c1(e472ec90,0,c13afc53,2ec,448c,...) at acpi_cpu_c1+0x5/frame 0xe4741bc0 acpi_cpu_idle(caed182,0,caed182,e4741c30,c105a5bd,...) at acpi_cpu_idle+0x166/frame 0xe4741c00 cpu_idle_acpi(caed182,0,1,c1578c88,c1578c84,...) at cpu_idle_acpi+0x3f/frame 0xe4741c14 cpu_idle(0,e4741c80,c11ee7a6,a48,c1578c88,...) at cpu_idle+0x9d/frame 0xe4741c30 sched_idletd(0,e4741ce8,c11e53ac,3dc,0,...) at sched_idletd+0x3cb/frame 0xe4741cac fork_exit(c0b8b0b0,0,e4741ce8) at fork_exit+0x7e/frame 0xe4741cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4741cd4 --- trap 0, eip = 0, esp = 0xe4741d20, ebp = 0 --- db:0:bt> show allpcpu Current CPU: 2 cpuid = 0 dynamic pcpu = 0x784380 curthread = 0xc8a2e000: pid 11 "idle: cpu0" curpcb = 0xe473bd40 fpcurthread = none idlethread = 0xc8a2e000: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x2328a380 curthread = 0xc8a2dc40: pid 11 "idle: cpu1" curpcb = 0xe473ed40 fpcurthread = none idlethread = 0xc8a2dc40: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x2328d380 curthread = 0xc8a2d930: pid 11 "idle: cpu2" curpcb = 0xe4741d40 fpcurthread = none idlethread = 0xc8a2d930: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x23290380 curthread = 0xc8a2d620: pid 11 "idle: cpu3" curpcb = 0xe4744d40 fpcurthread = none idlethread = 0xc8a2d620: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks Process 5992 (mdconfig) thread 0xce54f310 (101339) exclusive sx MD config lock (MD config lock) r = 0 (0xc14bb214) locked @ dev/md/md.c:1527 db:0:alllocks> show lockedvnods Locked vnodes db:0:lockedvnods> show mount 0xc93002ec /dev/ad4s1a on / (ufs) 0xc93005d8 devfs on /dev (devfs) 0xc9300000 /dev/ad4s1f on /home (ufs) 0xc97ecbb0 /dev/ad4s1d on /usr (ufs) 0xc97ec8c4 /dev/ad4s1e on /var (ufs) 0xc97ec5d8 procfs on /proc (procfs) 0xc97ec2ec /dev/label/tmp on /tmp (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 6240 6098 6094 1001 S nanslp 0xc156bbe0 sleep 6159 6158 6159 1001 Ss+ ttyin 0xd2ad1670 bash 6158 6156 6156 1001 S select 0xd322ade4 sshd 6156 745 6156 0 Ss select 0xd2e71964 sshd 6099 6094 6094 1001 S piperd 0xcdfbdb28 awk 6098 6094 6094 1001 S wait 0xd2b949c0 sh 6096 1 6096 1001 Ds kmem are 0xc1589400 tail 6094 1 6094 1001 Ss wait 0xca73f680 sh 5993 0 0 0 DL mdwait 0xce533000 [md5] 5992 5975 1158 0 D+ kmem are 0xc1589400 mdconfig 5976 1159 1158 0 S+ piperd 0xcdfd7660 tee 5975 1159 1158 0 S+ wait 0xce53b340 sh 1159 1158 1158 0 S+ wait 0xc940c680 sh 1158 1122 1158 0 SW+ wait 0xc9411340 sh 1122 1120 1122 0 SW+ wait 0xca740000 bash 1120 1119 1120 0 SW+ pause 0xca6f86e4 csh 1119 1111 1119 1001 SW+ wait 0xca73e680 su 1111 1110 1111 1001 SWs+ wait 0xca73e340 bash 1110 1108 1108 1001 S select 0xc9cba864 sshd 1108 745 1108 0 Ss select 0xc9cba964 sshd 980 1 980 0 Ss+ ttyin 0xc8cc7870 getty 979 1 979 0 Ss+ ttyin 0xc8cc6870 getty 978 1 978 0 Ss+ ttyin 0xc8cc6a70 getty 977 1 977 0 Ss+ ttyin 0xc8cc6c70 getty 976 1 976 0 Ss+ ttyin 0xc8cc6e70 getty 975 1 975 0 Ss+ ttyin 0xc8cc7070 getty 974 1 974 0 Ss+ ttyin 0xc8cc7270 getty 973 1 973 0 Ss+ ttyin 0xc8cc7470 getty 972 1 972 0 Ss+ ttyin 0xc8cc7670 getty 953 1 953 0 Ss select 0xc8c080e4 inetd 756 1 756 0 Ss nanslp 0xc156bbe3 cron 751 1 751 25 Ss pause 0xc934f064 sendmail 748 1 748 0 Ss select 0xc9abf524 sendmail 745 1 745 0 Ss select 0xc8c083a4 sshd 698 1 698 0 Ss select 0xc9abf7a4 moused 691 1 690 0 S nanslp 0xc156bbe1 smartd 672 1 672 0 Ss select 0xc9abf664 powerd 669 1 669 0 Ss (threaded) ntpd 100138 S select 0xc9abf5e4 ntpd 615 610 610 0 S (threaded) nfsd 100081 S rpcsvc 0xc8ef8e90 nfsd: master 100105 S rpcsvc 0xca47f290 nfsd: service 100106 S rpcsvc 0xca47eb90 nfsd: service 100107 S rpcsvc 0xca47f190 nfsd: service 100108 S rpcsvc 0xca47f090 nfsd: service 100109 S rpcsvc 0xca47ee90 nfsd: service 100110 S rpcsvc 0xca47ed90 nfsd: service 100111 S rpcsvc 0xca47ec90 nfsd: service 100112 S rpcsvc 0xca47ea90 nfsd: service 100113 S rpcsvc 0xca47e990 nfsd: service 100114 S rpcsvc 0xca47e890 nfsd: service 100115 S rpcsvc 0xca47e790 nfsd: service 100116 S rpcsvc 0xca47e690 nfsd: service 100117 S rpcsvc 0xca47e590 nfsd: service 100118 S rpcsvc 0xca47e490 nfsd: service 100119 S rpcsvc 0xca47e390 nfsd: service 100120 S rpcsvc 0xca47e290 nfsd: service 100121 S rpcsvc 0xca47e190 nfsd: service 100122 S rpcsvc 0xca47e090 nfsd: service 100123 S rpcsvc 0xca47de90 nfsd: service 100124 S rpcsvc 0xca47dd90 nfsd: service 100125 S rpcsvc 0xca47dc90 nfsd: service 100126 S rpcsvc 0xca47db90 nfsd: service 100127 S rpcsvc 0xca47da90 nfsd: service 100128 S rpcsvc 0xca47d990 nfsd: service 100129 S rpcsvc 0xca47d890 nfsd: service 100130 S rpcsvc 0xca47d790 nfsd: service 100131 S rpcsvc 0xca47d690 nfsd: service 100132 S rpcsvc 0xca47d590 nfsd: service 100133 S rpcsvc 0xca47d490 nfsd: service 100134 S rpcsvc 0xca47d390 nfsd: service 100135 S rpcsvc 0xca47d290 nfsd: service 610 1 610 0 Ss select 0xc9abf8a4 nfsd 604 1 604 0 Ss select 0xc9abf9e4 mountd 597 593 593 0 S select 0xc9abf8e4 nfsuserd 596 593 593 0 S select 0xc8c083e4 nfsuserd 595 593 593 0 S select 0xc8c08424 nfsuserd 594 593 593 0 S select 0xc9abf924 nfsuserd 593 1 593 0 SWs pause 0xc943e6e4 nfsuserd 576 1 576 0 Ss select 0xc9abf964 casperd 575 1 575 0 Ss select 0xc92fd924 casperd 561 1 561 0 Ss select 0xc9abf9a4 rpcbind 489 1 489 0 Ss nanslp 0xc156bbe1 watchdogd 485 1 485 0 Ss select 0xc9cbabe4 syslogd 365 1 365 0 Ss select 0xc9abfaa4 rtsold 325 1 325 0 Ss select 0xc92fd9a4 devd 16 0 0 0 DL syncer 0xc15e4454 [syncer] 9 0 0 0 DL vlruwt 0xc9167000 [vnlru] 8 0 0 0 DL (threaded) [bufdaemon] 100072 D psleep 0xc15e3b84 [bufdaemon] 100084 D sdflush 0xc9464684 [/home worker] 100086 D sdflush 0xc9464284 [/usr worker] 100087 D sdflush 0xc9464084 [/var worker] 100173 D sdflush 0xc9463e84 [/tmp worker] 7 0 0 0 DL pgzero 0xc15e96bc [pagezero] 6 0 0 0 DL psleep 0xc15e9438 [vmdaemon] 5 0 0 0 DL psleep 0xc1647004 [pagedaemon] 4 0 0 0 DL waiting_ 0xc164399c [sctp_iterator] 3 0 0 0 DL - 0xc8bfb43c [fdc0] 15 0 0 0 DL (threaded) [usb] 100032 D - 0xc8c21acc [usbus0] 100033 D - 0xc8c21afc [usbus0] 100034 D - 0xc8c21b2c [usbus0] 100035 D - 0xc8c21b5c [usbus0] 100037 D - 0xc8c76acc [usbus1] 100038 D - 0xc8c76afc [usbus1] 100039 D - 0xc8c76b2c [usbus1] 100040 D - 0xc8c76b5c [usbus1] 100042 D - 0xc8c7facc [usbus2] 100043 D - 0xc8c7fafc [usbus2] 100044 D - 0xc8c7fb2c [usbus2] 100045 D - 0xc8c7fb5c [usbus2] 100046 D - 0xc8c85acc [usbus3] 100047 D - 0xc8c85afc [usbus3] 100048 D - 0xc8c85b2c [usbus3] 100049 D - 0xc8c85b5c [usbus3] 100050 D - 0xc8c89acc [usbus4] 100051 D - 0xc8c89afc [usbus4] 100052 D - 0xc8c89b2c [usbus4] 100053 D - 0xc8c89b5c [usbus4] 100055 D - 0xc8c26ca4 [usbus5] 100056 D - 0xc8c26cd4 [usbus5] 100057 D - 0xc8c26d04 [usbus5] 100058 D - 0xc8c26d34 [usbus5] 2 0 0 0 DL (threaded) [cam] 100026 D - 0xc14a1c80 [doneq0] 100068 D - 0xc14a1b2c [scanner] 14 0 0 0 DL - 0xc14bc870 [rand_harvestq] 13 0 0 0 DL (threaded) [geom] 100014 D - 0xc163eb18 [g_event] 100015 D - 0xc163eb1c [g_up] 100016 D - 0xc163eb20 [g_down] 12 0 0 0 WL (threaded) [intr] 100007 I [swi3: vm] 100008 I [swi4: clock (0)] 100009 I [swi4: clock (1)] 100010 I [swi4: clock (2)] 100011 I [swi4: clock (3)] 100012 I [swi1: netisr 0] 100018 I [swi6: Giant taskq] 100021 I [swi5: fast taskq] 100027 I [swi6: task queue] 100028 I [irq256: hdac0] 100029 I [irq257: re0] 100030 I [irq22: ahci0] 100031 I [irq16: hdac1 ohci0] 100036 I [irq17: ohci1 ohci3] 100041 I [irq18: ohci2 ohci4] 100054 I [irq19: ehci0] 100059 I [irq14: ata0] 100060 I [swi0: uart] 100062 I [irq1: atkbd0] 100063 I [irq12: psm0] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 1 0 1 0 SLs wait 0xc8a209c0 [init] 10 0 0 0 DL audit_wo 0xc16458d0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xc163eb34 [swapper] 100013 D - 0xc8a25900 [firmware taskq] 100019 D - 0xc8a24e00 [ffs_trim taskq] 100020 D - 0xc8a24d80 [thread taskq] 100022 D - 0xc8a24c00 [kqueue taskq] 100023 D - 0xc8a24b80 [acpi_task_0] 100024 D - 0xc8a24b80 [acpi_task_1] 100025 D - 0xc8a24b80 [acpi_task_2] 100064 D - 0xc8c8ec80 [mca taskq] 100065 D - 0xc156aaed [deadlkres] 100067 D - 0xc8a24b00 [CAM taskq] db:0:ps> allt Tracing command sleep pid 6240 tid 100216 td 0xce092310 sched_switch(ce092310,0,104,1ba,f8a57a84,...) at sched_switch+0x4e2/frame 0xf8a57a4c mi_switch(104,0,c11f2745,200,4494,...) at mi_switch+0x1bf/frame 0xf8a57a84 sleepq_switch(ce092310,0,c11f2745,1b6,8,...) at sleepq_switch+0x1c5/frame 0xf8a57ab8 sleepq_catch_signals(c0baf1d0,ce092310,0,201,0,...) at sleepq_catch_signals+0x382/frame 0xf8a57af4 sleepq_timedwait_sig(c156bbe0,6c,4494,a0000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf8a57b1c _sleep(c156bbe0,0,16c,c11ed6da,ca135a85,...) at _sleep+0x326/frame 0xf8a57b78 kern_nanosleep(bfbfed00,f8a57bf0,f8a57bf8,f8a57ce8,a,...) at kern_nanosleep+0x14b/frame 0xf8a57bd8 sys_nanosleep(ce092310,f8a57ca8,c11e4fcd,4,c1073da7,...) at sys_nanosleep+0x68/frame 0xf8a57c18 syscall(f8a57ce8) at syscall+0x34a/frame 0xf8a57cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8a57cdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2813584f, esp = 0xbfbfeccc, ebp = 0xbfbfed14 --- Tracing command bash pid 6159 tid 100178 td 0xcd185000 sched_switch(cd185000,0,104,1ba,f89709a4,...) at sched_switch+0x4e2/frame 0xf897096c mi_switch(104,0,c11f2745,200,c15b5068,...) at mi_switch+0x1bf/frame 0xf89709a4 sleepq_switch(cd185000,0,c11f2745,1b6,f8970a1c,...) at sleepq_switch+0x1c5/frame 0xf89709d8 sleepq_catch_signals(f8970a38,c0b473c9,d2ad1614,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf8970a14 sleepq_wait_sig(d2ad1670,0,f8970a70,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8970a38 _cv_wait_sig(d2ad1670,d2ad1604,c11f7d5d,567,1,...) at _cv_wait_sig+0x214/frame 0xf8970a84 tty_wait(d2ad1600,d2ad1670,f8970be8,1,0,...) at tty_wait+0x4b/frame 0xf8970aa8 ttydisc_read(d2ad1600,f8970be8,0,b2,f8970be8,...) at ttydisc_read+0x3d4/frame 0xf8970af0 ttydev_read(d2af6100,f8970be8,0,0,f8970b40,...) at ttydev_read+0x55/frame 0xf8970b10 devfs_read_f(c93e8460,f8970be8,d2b02800,0,cd185000,...) at devfs_read_f+0xa8/frame 0xf8970b4c dofileread(c93e8460,f8970be8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xf8970b80 kern_readv(cd185000,0,f8970be8,c15b5068,bfbfe0a3,...) at kern_readv+0x93/frame 0xf8970bc8 sys_read(cd185000,f8970ca8,c11e4fcd,4,f8970c6c,...) at sys_read+0x59/frame 0xf8970c18 syscall(f8970ce8) at syscall+0x34a/frame 0xf8970cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8970cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2829ff0f, esp = 0xbfbfe090, ebp = 0xbfbfe0b0 --- Tracing command sshd pid 6158 tid 101365 td 0xce83e310 sched_switch(ce83e310,0,104,1ba,c80ce918,...) at sched_switch+0x4e2/frame 0xc80ce8e0 mi_switch(104,0,c11f2745,200,c80ce984,...) at mi_switch+0x1bf/frame 0xc80ce918 sleepq_switch(ce83e310,0,c11f2745,1b6,c80ce990,...) at sleepq_switch+0x1c5/frame 0xc80ce94c sleepq_catch_signals(c80ce9ac,c0b473c9,d322ade0,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xc80ce988 sleepq_wait_sig(d322ade4,0,c80ce9e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xc80ce9ac _cv_wait_sig(d322ade4,d322add0,c11f5c27,72e,1ae,...) at _cv_wait_sig+0x214/frame 0xc80ce9f8 seltdwait(ffffffff,0,0,ce83e310,0,...) at seltdwait+0xbb/frame 0xc80cea28 kern_select(ce83e310,c,28c0c1e0,28c0c1e8,0,...) at kern_select+0x914/frame 0xc80cebd0 sys_select(ce83e310,c80ceca8,c11e4fcd,4,c1073da7,...) at sys_select+0x66/frame 0xc80cec18 syscall(c80cece8) at syscall+0x34a/frame 0xc80cecdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xc80cecdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284e8eff, esp = 0xbfbfe7cc, ebp = 0xbfbfe7f0 --- Tracing command sshd pid 6156 tid 100223 td 0xce090c40 sched_switch(ce090c40,0,104,1ba,f8a6c950,...) at sched_switch+0x4e2/frame 0xf8a6c918 mi_switch(104,0,c11f2745,200,f8a6c9bc,...) at mi_switch+0x1bf/frame 0xf8a6c950 sleepq_switch(ce090c40,0,c11f2745,1b6,f8a6c9c8,...) at sleepq_switch+0x1c5/frame 0xf8a6c984 sleepq_catch_signals(f8a6c9e4,c0b473c9,d2e71960,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf8a6c9c0 sleepq_wait_sig(d2e71964,0,f8a6ca1c,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8a6c9e4 _cv_wait_sig(d2e71964,d2e71950,c11f5c27,72e,629,...) at _cv_wait_sig+0x214/frame 0xf8a6ca30 seltdwait(ffffffff,0,0,ce090c40,0,...) at seltdwait+0xbb/frame 0xf8a6ca60 kern_poll(ce090c40,bfbfe860,1,0,0,...) at kern_poll+0x4f0/frame 0xf8a6cbe0 sys_poll(ce090c40,f8a6cca8,c11e4fcd,4,f8a6cc6c,...) at sys_poll+0x71/frame 0xf8a6cc18 syscall(f8a6cce8) at syscall+0x34a/frame 0xf8a6ccdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8a6ccdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x28487c53, esp = 0xbfbfe82c, ebp = 0xbfbfe848 --- Tracing command awk pid 6099 tid 100384 td 0xce1e7620 sched_switch(ce1e7620,0,104,1ba,f8b60a18,...) at sched_switch+0x4e2/frame 0xf8b609e0 mi_switch(104,0,c11f2745,200,c7839231,...) at mi_switch+0x1bf/frame 0xf8b60a18 sleepq_switch(ce1e7620,0,c11f2745,1b6,c11f2745,...) at sleepq_switch+0x1c5/frame 0xf8b60a4c sleepq_catch_signals(c11f2745,16d,cdfbdcb8,16c8,ce1e7620,...) at sleepq_catch_signals+0x382/frame 0xf8b60a88 sleepq_wait_sig(cdfbdb28,5c,c11f5e9c,100,0,...) at sleepq_wait_sig+0x14/frame 0xf8b60aac _sleep(cdfbdb28,cdfbdca8,15c,c11f5e9c,0,...) at _sleep+0x356/frame 0xf8b60b08 pipe_read(ce1a7dc8,f8b60be8,ce1f9e00,0,ce1e7620,...) at pipe_read+0x2da/frame 0xf8b60b4c dofileread(ce1a7dc8,f8b60be8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xf8b60b80 kern_readv(ce1e7620,0,f8b60be8,c15b6140,2880b000,...) at kern_readv+0x93/frame 0xf8b60bc8 sys_read(ce1e7620,f8b60ca8,c11e4fcd,4,c1073da7,...) at sys_read+0x59/frame 0xf8b60c18 syscall(f8b60ce8) at syscall+0x34a/frame 0xf8b60cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8b60cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281f1f0f, esp = 0xbfbfea18, ebp = 0xbfbfea2c --- Tracing command sh pid 6098 tid 101368 td 0xce60f930 sched_switch(ce60f930,0,104,1ba,c80d79a0,...) at sched_switch+0x4e2/frame 0xc80d7968 mi_switch(104,0,c11f2745,200,188,...) at mi_switch+0x1bf/frame 0xc80d79a0 sleepq_switch(ce60f930,0,c11f2745,1b6,c11f2745,...) at sleepq_switch+0x1c5/frame 0xc80d79d4 sleepq_catch_signals(c11f2745,16d,d2b94a78,cd8,ce60f930,...) at sleepq_catch_signals+0x382/frame 0xc80d7a10 sleepq_wait_sig(d2b949c0,6c,c11f64d5,100,0,...) at sleepq_wait_sig+0x14/frame 0xc80d7a34 _sleep(d2b949c0,d2b94a68,16c,c11f64d5,0,...) at _sleep+0x356/frame 0xc80d7a90 kern_wait6(ce60f930,7,0,0,c80d7b24,...) at kern_wait6+0x45b/frame 0xc80d7af8 sys_wait4(ce60f930,c80d7ca8,c11e4fcd,4,0,...) at sys_wait4+0x8b/frame 0xc80d7c18 syscall(c80d7ce8) at syscall+0x34a/frame 0xc80d7cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xc80d7cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2817f7af, esp = 0xbfbfe980, ebp = 0xbfbfe998 --- Tracing command tail pid 6096 tid 100379 td 0xce60e930 sched_switch(ce60e930,0,104,1ba,f8b3365c,...) at sched_switch+0x4e2/frame 0xf8b33624 mi_switch(104,0,c11f2745,200,c1589380,...) at mi_switch+0x1bf/frame 0xf8b3365c sleepq_switch(ce60e930,0,c11f2745,276,c1589400,...) at sleepq_switch+0x1c5/frame 0xf8b33690 sleepq_wait(c1589400,0,f8b336e4,1,0,...) at sleepq_wait+0x48/frame 0xf8b336b4 _cv_wait(c1589400,c1589380,c11f3d3d,4b2,f8b337ec,...) at _cv_wait+0x1fe/frame 0xf8b336f8 vmem_xalloc(c1589380,1000,0,0,0,...) at vmem_xalloc+0x1df/frame 0xf8b3376c vmem_alloc(c1589380,1000,2102,f8b337bc,0,...) at vmem_alloc+0xc4/frame 0xf8b337a4 kmem_malloc(c1589380,1000,102) at kmem_malloc+0x3b/frame 0xf8b337cc page_alloc(c8cea1e0,1000,f8b3380f,102,c1fb7c00,...) at page_alloc+0x28/frame 0xf8b337e0 keg_alloc_slab(2,4,c12298b5,92b,c8b18300,...) at keg_alloc_slab+0xd2/frame 0xf8b3381c keg_fetch_slab(2,0,c12298b5,976,c8cea1e0,...) at keg_fetch_slab+0x18f/frame 0xf8b33860 zone_fetch_slab(c8cea1e0,0,2,1,c8b18300,...) at zone_fetch_slab+0x5d/frame 0xf8b33884 zone_import(c8cea1e0,ccf7fc0c,fd,2,1,...) at zone_import+0x37/frame 0xf8b338cc uma_zalloc_arg(c8cea1e0,0,2,c1fa4450,f8b339a0,...) at uma_zalloc_arg+0x31f/frame 0xf8b3390c v_addpollinfo(cac035a0,8,c149c1c4,cac035a0,ce60e930,...) at v_addpollinfo+0x36/frame 0xf8b33940 vfs_kqfilter(f8b339a8,c13b8713,c15b44c8,c15b44b8,c15b44b8,...) at vfs_kqfilter+0x52/frame 0xf8b33968 VOP_KQFILTER_APV(c1488e80,f8b339a8,c149d34c,cac035a0,ce05dea0,...) at VOP_KQFILTER_APV+0x12f/frame 0xf8b33998 vn_kqfilter(c939a5b0,ce05dea0) at vn_kqfilter+0x35/frame 0xf8b339b8 filt_fileattach(ce05dea0,0,c11e4ba4,49f,0,...) at filt_fileattach+0x19/frame 0xf8b339c8 kqueue_register(ce60e930,1,2,50f,0,...) at kqueue_register+0x695/frame 0xf8b33a48 kern_kevent(ce60e930,4,2,0,f8b33be8,...) at kern_kevent+0x1d2/frame 0xf8b33b98 sys_kevent(ce60e930,f8b33ca8,c11e4fcd,4,c1073da7,...) at sys_kevent+0x12c/frame 0xf8b33c18 syscall(f8b33ce8) at syscall+0x34a/frame 0xf8b33cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8b33cdc --- syscall (363, FreeBSD ELF32, sys_kevent), eip = 0x28181fbf, esp = 0xbfbfe99c, ebp = 0xbfbfebb8 --- Tracing command sh pid 6094 tid 100169 td 0xca742310 sched_switch(ca742310,0,104,1ba,f89539a0,...) at sched_switch+0x4e2/frame 0xf8953968 mi_switch(104,0,c11f2745,200,c122a1a0,...) at mi_switch+0x1bf/frame 0xf89539a0 sleepq_switch(ca742310,0,c11f2745,1b6,c11f2745,...) at sleepq_switch+0x1c5/frame 0xf89539d4 sleepq_catch_signals(c11f2745,16d,ca73f738,b10,ca742310,...) at sleepq_catch_signals+0x382/frame 0xf8953a10 sleepq_wait_sig(ca73f680,6c,c11f64d5,100,0,...) at sleepq_wait_sig+0x14/frame 0xf8953a34 _sleep(ca73f680,ca73f728,16c,c11f64d5,0,...) at _sleep+0x356/frame 0xf8953a90 kern_wait6(ca742310,7,0,0,f8953b24,...) at kern_wait6+0x45b/frame 0xf8953af8 sys_wait4(ca742310,f8953ca8,c11e4fcd,4,c1073da7,...) at sys_wait4+0x8b/frame 0xf8953c18 syscall(f8953ce8) at syscall+0x34a/frame 0xf8953cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8953cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2817f7af, esp = 0xbfbfeb50, ebp = 0xbfbfeb68 --- Tracing command md5 pid 5993 tid 101341 td 0xce83fc40 sched_switch(ce83fc40,0,104,1ba,c8086bb4,...) at sched_switch+0x4e2/frame 0xc8086b7c mi_switch(104,0,c11f2745,200,ce533020,...) at mi_switch+0x1bf/frame 0xc8086bb4 sleepq_switch(ce83fc40,0,c11f2745,276,ce83fc40,...) at sleepq_switch+0x1c5/frame 0xc8086be8 sleepq_wait(ce533000,5c,c117442a,0,0,...) at sleepq_wait+0x48/frame 0xc8086c0c _sleep(ce533000,ce533020,25c,c117442a,0,...) at _sleep+0x3a1/frame 0xc8086c68 md_kthread(ce533000,c8086ce8,c11e53ac,3dc,0,...) at md_kthread+0x1c7/frame 0xc8086cac fork_exit(c07aa990,ce533000,c8086ce8) at fork_exit+0x7e/frame 0xc8086cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xc8086cd4 --- trap 0, eip = 0, esp = 0xc8086d20, ebp = 0 --- Tracing command mdconfig pid 5992 tid 101339 td 0xce54f310 sched_switch(ce54f310,0,104,1ba,c80806d0,...) at sched_switch+0x4e2/frame 0xc8080698 mi_switch(104,0,c11f2745,200,c1589380,...) at mi_switch+0x1bf/frame 0xc80806d0 sleepq_switch(ce54f310,0,c11f2745,276,c1589400,...) at sleepq_switch+0x1c5/frame 0xc8080704 sleepq_wait(c1589400,0,c8080758,1,0,...) at sleepq_wait+0x48/frame 0xc8080728 _cv_wait(c1589400,c1589380,c11f3d3d,4b2,c15b43d0,...) at _cv_wait+0x1fe/frame 0xc808076c vmem_xalloc(c1589380,1000,0,0,0,...) at vmem_xalloc+0x1df/frame 0xc80807e0 vmem_alloc(c1589380,1000,2102,c8080830,0,...) at vmem_alloc+0xc4/frame 0xc8080818 kmem_malloc(c1589380,1000,102) at kmem_malloc+0x3b/frame 0xc8080840 page_alloc(c916b780,1000,c8080883,102,c1fb7900,...) at page_alloc+0x28/frame 0xc8080854 keg_alloc_slab(102,4,c12298b5,92b,c9324100,...) at keg_alloc_slab+0xd2/frame 0xc8080890 keg_fetch_slab(102,0,c12298b5,976,c916b780,...) at keg_fetch_slab+0x18f/frame 0xc80808d4 zone_fetch_slab(c916b780,0,102,0,c9324100,...) at zone_fetch_slab+0x5d/frame 0xc80808f8 zone_import(c916b780,c928c30c,1d,102,1,...) at zone_import+0x37/frame 0xc8080940 uma_zalloc_arg(c916b780,0,102,0,0,...) at uma_zalloc_arg+0x31f/frame 0xc8080980 mdctlioctl(c8efd800,c1b46d00,d2a6bc00,3,ce54f310,...) at mdctlioctl+0x746/frame 0xc8080ae4 devfs_ioctl_f(ce0634d0,c1b46d00,d2a6bc00,c9264400,ce54f310,...) at devfs_ioctl_f+0x121/frame 0xc8080b1c kern_ioctl(ce54f310,3,c1b46d00,d2a6bc00,0,...) at kern_ioctl+0x2dc/frame 0xc8080b58 sys_ioctl(ce54f310,c8080ca8,c11e4fcd,4,c1073da7,...) at sys_ioctl+0x11b/frame 0xc8080c18 syscall(c8080ce8) at syscall+0x34a/frame 0xc8080cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xc8080cdc --- syscall (54, FreeBSD ELF32, sys_ioctl), eip = 0x281baf3f, esp = 0xbfbfe808, ebp = 0xbfbfe844 --- Tracing command tee pid 5976 tid 101361 td 0xce54f930 sched_switch(ce54f930,0,104,1ba,c80c2a18,...) at sched_switch+0x4e2/frame 0xc80c29e0 mi_switch(104,0,c11f2745,200,c89e6c40,...) at mi_switch+0x1bf/frame 0xc80c2a18 sleepq_switch(ce54f930,0,c11f2745,1b6,c11f2745,...) at sleepq_switch+0x1c5/frame 0xc80c2a4c sleepq_catch_signals(c11f2745,16d,cdfd77f0,210,ce54f930,...) at sleepq_catch_signals+0x382/frame 0xc80c2a88 sleepq_wait_sig(cdfd7660,5c,c11f5e9c,100,0,...) at sleepq_wait_sig+0x14/frame 0xc80c2aac _sleep(cdfd7660,cdfd77e0,15c,c11f5e9c,0,...) at _sleep+0x356/frame 0xc80c2b08 pipe_read(c939ace8,c80c2be8,c9264400,0,ce54f930,...) at pipe_read+0x2da/frame 0xc80c2b4c dofileread(c939ace8,c80c2be8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xc80c2b80 kern_readv(ce54f930,0,c80c2be8,c15b6718,28803000,...) at kern_readv+0x93/frame 0xc80c2bc8 sys_read(ce54f930,c80c2ca8,c11e4fcd,4,c1073da7,...) at sys_read+0x59/frame 0xc80c2c18 syscall(c80c2ce8) at syscall+0x34a/frame 0xc80c2cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xc80c2cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a1f0f, esp = 0xbfbfe848, ebp = 0xbfbfe874 --- Tracing command sh pid 5975 tid 100282 td 0xce54dc40 sched_switch(ce54dc40,0,104,1ba,f8b069a0,...) at sched_switch+0x4e2/frame 0xf8b06968 mi_switch(104,0,c11f2745,200,c0b8a9e0,...) at mi_switch+0x1bf/frame 0xf8b069a0 sleepq_switch(ce54dc40,0,c11f2745,1b6,c11f2745,...) at sleepq_switch+0x1c5/frame 0xf8b069d4 sleepq_catch_signals(c11f2745,16d,ce53b3f8,16c8,ce54dc40,...) at sleepq_catch_signals+0x382/frame 0xf8b06a10 sleepq_wait_sig(ce53b340,6c,c11f64d5,100,0,...) at sleepq_wait_sig+0x14/frame 0xf8b06a34 _sleep(ce53b340,ce53b3e8,16c,c11f64d5,0,...) at _sleep+0x356/frame 0xf8b06a90 kern_wait6(ce54dc40,7,0,0,f8b06b24,...) at kern_wait6+0x45b/frame 0xf8b06af8 sys_wait4(ce54dc40,f8b06ca8,c11e4fcd,4,0,...) at sys_wait4+0x8b/frame 0xf8b06c18 syscall(f8b06ce8) at syscall+0x34a/frame 0xf8b06cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8b06cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2817f7af, esp = 0xbfbfe4a8, ebp = 0xbfbfe4c0 --- Tracing command sh pid 1159 tid 100148 td 0xc9364c40 sched_switch(c9364c40,0,104,1ba,f890a9a0,...) at sched_switch+0x4e2/frame 0xf890a968 mi_switch(104,0,c11f2745,200,c122a1a0,...) at mi_switch+0x1bf/frame 0xf890a9a0 sleepq_switch(c9364c40,0,c11f2745,1b6,c11f2745,...) at sleepq_switch+0x1c5/frame 0xf890a9d4 sleepq_catch_signals(c11f2745,16d,c940c738,690,c9364c40,...) at sleepq_catch_signals+0x382/frame 0xf890aa10 sleepq_wait_sig(c940c680,6c,c11f64d5,100,0,...) at sleepq_wait_sig+0x14/frame 0xf890aa34 _sleep(c940c680,c940c728,16c,c11f64d5,0,...) at _sleep+0x356/frame 0xf890aa90 kern_wait6(c9364c40,7,0,0,f890ab24,...) at kern_wait6+0x45b/frame 0xf890aaf8 sys_wait4(c9364c40,f890aca8,c11e4fcd,4,0,...) at sys_wait4+0x8b/frame 0xf890ac18 syscall(f890ace8) at syscall+0x34a/frame 0xf890acdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf890acdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2817f7af, esp = 0xbfbfe610, ebp = 0xbfbfe628 --- Tracing command sh pid 1158 tid 100143 td 0xc9417620 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c11f072c,c8a2d930,e4741424,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xe4741408 kdb_backtrace(c11f07a9,280,e47415bc,c106b620,8,...) at kdb_backtrace+0x2d/frame 0xe4741470 kdb_reenter(8,c11f3166,225,e47414a8,c8a2d930,...) at kdb_reenter+0x31/frame 0xe4741480 trap(e47415c8) at trap+0x50/frame 0xe47415bc calltrap() at calltrap+0x6/frame 0xe47415bc --- trap 0xc, eip = 0xc1055676, esp = 0xe4741608, ebp = 0xe4741618 --- db_trace_thread(c9417620,ffffffff,486,1872f,c9417620,...) at db_trace_thread+0x16/frame 0xe4741618 db_stack_trace_all(c0b9d632,0,ffffffff,e47416b8,0,...) at db_stack_trace_all+0xa2/frame 0xe4741684 db_command(c14a5682,0,c1635bd8,c14a5681,a,...) at db_command+0x39f/frame 0xe4741740 db_script_exec(e47417f0,0,c8b44250,e47417dc,1,...) at db_script_exec+0x168/frame 0xe47417a8 db_command(c10ba61b,e47418c8,c0532ceb,c10ba713,c079bb27,...) at db_command+0x39f/frame 0xe4741864 db_command_loop(c10ba713,c079bb27,c15eaa24,1,c88d6e00,...) at db_command_loop+0x50/frame 0xe4741870 db_trap(3,0,28,46,1,...) at db_trap+0xdb/frame 0xe47418c8 kdb_trap(3,0,e4741a48,e4741a90,0,...) at kdb_trap+0x117/frame 0xe4741900 trap(e4741a48) at trap+0x87f/frame 0xe4741a3c calltrap() at calltrap+0x6/frame 0xe4741a3c --- trap 0x3, eip = 0xc0b9d632, esp = 0xe4741a88, ebp = 0xe4741a9c --- kdb_alt_break_internal(0,e4741ac8,c097fa37,2,c8c6f684,...) at kdb_alt_break_internal+0x162/frame 0xe4741a9c kdb_alt_break(2,c8c6f684,c11b4431,c8c6f600,40000,...) at kdb_alt_break+0x16/frame 0xe4741aa8 uart_intr_rxready(c8c6f600,c13afc53,df,448c,1,...) at uart_intr_rxready+0x87/frame 0xe4741ac8 uart_intr(c8c6f600,0,b,0,0,...) at uart_intr+0x100/frame 0xe4741b04 intr_event_handle(c8a26680,e4741b80,0,2,0,...) at intr_event_handle+0x7a/frame 0xe4741b30 intr_execute_handlers(c8a7a108,e4741b80,2) at intr_execute_handlers+0x42/frame 0xe4741b50 lapic_handle_intr(30,e4741b80) at lapic_handle_intr+0x5d/frame 0xe4741b70 Xapic_isr1() at Xapic_isr1+0x4a/frame 0xe4741b70 --- interrupt, eip = 0xc1051d75, esp = 0xe4741bc0, ebp = 0xe4741bc0 --- acpi_cpu_c1(e472ec90,0,c13afc53,2ec,448c,...) at acpi_cpu_c1+0x5/frame 0xe4741bc0 acpi_cpu_idle(caed182,0,caed182,e4741c30,c105a5bd,...) at acpi_cpu_idle+0x166/frame 0xe4741c00 cpu_idle_acpi(caed182,0,1,c1578c88,c1578c84,...) at cpu_idle_acpi+0x3f/frame 0xe4741c14 cpu_idle(0,e4741c80,c11ee7a6,a48,c1578c88,...) at cpu_idle+0x9d/frame 0xe4741c30 sched_idletd(0,e4741ce8,c11e53ac,3dc,0,...) at sched_idletd+0x3cb/frame 0xe4741cac fork_exit(c0b8b0b0,0,e4741ce8) at fork_exit+0x7e/frame 0xe4741cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4741cd4 --- trap 0, eip = 0, esp = 0xe4741d20, ebp = 0 --- Tracing command bash pid 1122 tid 100166 td 0xca742930 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c11f072c,c8a2d930,e4741424,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xe4741408 kdb_backtrace(c11f07a9,280,e47415bc,c106b620,8,...) at kdb_backtrace+0x2d/frame 0xe4741470 kdb_reenter(8,c11f3166,225,e47414a8,c8a2d930,...) at kdb_reenter+0x31/frame 0xe4741480 trap(e47415c8) at trap+0x50/frame 0xe47415bc calltrap() at calltrap+0x6/frame 0xe47415bc --- trap 0xc, eip = 0xc1055676, esp = 0xe4741608, ebp = 0xe4741618 --- db_trace_thread(ca742930,ffffffff,462,18746,ca742930,...) at db_trace_thread+0x16/frame 0xe4741618 db_stack_trace_all(c0b9d632,0,ffffffff,e47416b8,0,...) at db_stack_trace_all+0xa2/frame 0xe4741684 db_command(c14a5682,0,c1635bd8,c14a5681,a,...) at db_command+0x39f/frame 0xe4741740 db_script_exec(e47417f0,0,c8b44250,e47417dc,1,...) at db_script_exec+0x168/frame 0xe47417a8 db_command(c10ba61b,e47418c8,c0532ceb,c10ba713,c079bb27,...) at db_command+0x39f/frame 0xe4741864 db_command_loop(c10ba713,c079bb27,c15eaa24,1,c88d6e00,...) at db_command_loop+0x50/frame 0xe4741870 db_trap(3,0,28,46,1,...) at db_trap+0xdb/frame 0xe47418c8 kdb_trap(3,0,e4741a48,e4741a90,0,...) at kdb_trap+0x117/frame 0xe4741900 trap(e4741a48) at trap+0x87f/frame 0xe4741a3c calltrap() at calltrap+0x6/frame 0xe4741a3c --- trap 0x3, eip = 0xc0b9d632, esp = 0xe4741a88, ebp = 0xe4741a9c --- kdb_alt_break_internal(0,e4741ac8,c097fa37,2,c8c6f684,...) at kdb_alt_break_internal+0x162/frame 0xe4741a9c kdb_alt_break(2,c8c6f684,c11b4431,c8c6f600,40000,...) at kdb_alt_break+0x16/frame 0xe4741aa8 uart_intr_rxready(c8c6f600,c13afc53,df,448c,1,...) at uart_intr_rxready+0x87/frame 0xe4741ac8 uart_intr(c8c6f600,0,b,0,0,...) at uart_intr+0x100/frame 0xe4741b04 intr_event_handle(c8a26680,e4741b80,0,2,0,...) at intr_event_handle+0x7a/frame 0xe4741b30 intr_execute_handlers(c8a7a108,e4741b80,2) at intr_execute_handlers+0x42/frame 0xe4741b50 lapic_handle_intr(30,e4741b80) at lapic_handle_intr+0x5d/frame 0xe4741b70 Xapic_isr1() at Xapic_isr1+0x4a/frame 0xe4741b70 --- interrupt, eip = 0xc1051d75, esp = 0xe4741bc0, ebp = 0xe4741bc0 --- acpi_cpu_c1(e472ec90,0,c13afc53,2ec,448c,...) at acpi_cpu_c1+0x5/frame 0xe4741bc0 acpi_cpu_idle(caed182,0,caed182,e4741c30,c105a5bd,...) at acpi_cpu_idle+0x166/frame 0xe4741c00 cpu_idle_acpi(caed182,0,1,c1578c88,c1578c84,...) at cpu_idle_acpi+0x3f/frame 0xe4741c14 cpu_idle(0,e4741c80,c11ee7a6,a48,c1578c88,...) at cpu_idle+0x9d/frame 0xe4741c30 sched_idletd(0,e4741ce8,c11e53ac,3dc,0,...) at sched_idletd+0x3cb/frame 0xe4741cac fork_exit(c0b8b0b0,0,e4741ce8) at fork_exit+0x7e/frame 0xe4741cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4741cd4 --- trap 0, eip = 0, esp = 0xe4741d20, ebp = 0 --- Tracing command csh pid 1120 tid 100174 td 0xcd185c40 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c11f072c,c8a2d930,e4741424,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xe4741408 kdb_backtrace(c11f07a9,280,e47415bc,c106b620,8,...) at kdb_backtrace+0x2d/frame 0xe4741470 kdb_reenter(8,c11f3166,225,e47414a8,c8a2d930,...) at kdb_reenter+0x31/frame 0xe4741480 trap(e47415c8) at trap+0x50/frame 0xe47415bc calltrap() at calltrap+0x6/frame 0xe47415bc --- trap 0xc, eip = 0xc1055676, esp = 0xe4741608, ebp = 0xe4741618 --- db_trace_thread(cd185c40,ffffffff,460,1874e,cd185c40,...) at db_trace_thread+0x16/frame 0xe4741618 db_stack_trace_all(c0b9d632,0,ffffffff,e47416b8,0,...) at db_stack_trace_all+0xa2/frame 0xe4741684 db_command(c14a5682,0,c1635bd8,c14a5681,a,...) at db_command+0x39f/frame 0xe4741740 db_script_exec(e47417f0,0,c8b44250,e47417dc,1,...) at db_script_exec+0x168/frame 0xe47417a8 db_command(c10ba61b,e47418c8,c0532ceb,c10ba713,c079bb27,...) at db_command+0x39f/frame 0xe4741864 db_command_loop(c10ba713,c079bb27,c15eaa24,1,c88d6e00,...) at db_command_loop+0x50/frame 0xe4741870 db_trap(3,0,28,46,1,...) at db_trap+0xdb/frame 0xe47418c8 kdb_trap(3,0,e4741a48,e4741a90,0,...) at kdb_trap+0x117/frame 0xe4741900 trap(e4741a48) at trap+0x87f/frame 0xe4741a3c calltrap() at calltrap+0x6/frame 0xe4741a3c --- trap 0x3, eip = 0xc0b9d632, esp = 0xe4741a88, ebp = 0xe4741a9c --- kdb_alt_break_internal(0,e4741ac8,c097fa37,2,c8c6f684,...) at kdb_alt_break_internal+0x162/frame 0xe4741a9c kdb_alt_break(2,c8c6f684,c11b4431,c8c6f600,40000,...) at kdb_alt_break+0x16/frame 0xe4741aa8 uart_intr_rxready(c8c6f600,c13afc53,df,448c,1,...) at uart_intr_rxready+0x87/frame 0xe4741ac8 uart_intr(c8c6f600,0,b,0,0,...) at uart_intr+0x100/frame 0xe4741b04 intr_event_handle(c8a26680,e4741b80,0,2,0,...) at intr_event_handle+0x7a/frame 0xe4741b30 intr_execute_handlers(c8a7a108,e4741b80,2) at intr_execute_handlers+0x42/frame 0xe4741b50 lapic_handle_intr(30,e4741b80) at lapic_handle_intr+0x5d/frame 0xe4741b70 Xapic_isr1() at Xapic_isr1+0x4a/frame 0xe4741b70 --- interrupt, eip = 0xc1051d75, esp = 0xe4741bc0, ebp = 0xe4741bc0 --- acpi_cpu_c1(e472ec90,0,c13afc53,2ec,448c,...) at acpi_cpu_c1+0x5/frame 0xe4741bc0 acpi_cpu_idle(caed182,0,caed182,e4741c30,c105a5bd,...) at acpi_cpu_idle+0x166/frame 0xe4741c00 cpu_idle_acpi(caed182,0,1,c1578c88,c1578c84,...) at cpu_idle_acpi+0x3f/frame 0xe4741c14 cpu_idle(0,e4741c80,c11ee7a6,a48,c1578c88,...) at cpu_idle+0x9d/frame 0xe4741c30 sched_idletd(0,e4741ce8,c11e53ac,3dc,0,...) at sched_idletd+0x3cb/frame 0xe4741cac fork_exit(c0b8b0b0,0,e4741ce8) at fork_exit+0x7e/frame 0xe4741cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4741cd4 --- trap 0, eip = 0, esp = 0xe4741d20, ebp = 0 --- Tracing command su pid 1119 tid 100184 td 0xca741620 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c11f072c,c8a2d930,e4741424,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xe4741408 kdb_backtrace(c11f07a9,280,e47415bc,c106b620,8,...) at kdb_backtrace+0x2d/frame 0xe4741470 kdb_reenter(8,c11f3166,225,e47414a8,c8a2d930,...) at kdb_reenter+0x31/frame 0xe4741480 trap(e47415c8) at trap+0x50/frame 0xe47415bc calltrap() at calltrap+0x6/frame 0xe47415bc --- trap 0xc, eip = 0xc1055676, esp = 0xe4741608, ebp = 0xe4741618 --- db_trace_thread(ca741620,ffffffff,45f,18758,ca741620,...) at db_trace_thread+0x16/frame 0xe4741618 db_stack_trace_all(c0b9d632,0,ffffffff,e47416b8,0,...) at db_stack_trace_all+0xa2/frame 0xe4741684 db_command(c14a5682,0,c1635bd8,c14a5681,a,...) at db_command+0x39f/frame 0xe4741740 db_script_exec(e47417f0,0,c8b44250,e47417dc,1,...) at db_script_exec+0x168/frame 0xe47417a8 db_command(c10ba61b,e47418c8,c0532ceb,c10ba713,c079bb27,...) at db_command+0x39f/frame 0xe4741864 db_command_loop(c10ba713,c079bb27,c15eaa24,1,c88d6e00,...) at db_command_loop+0x50/frame 0xe4741870 db_trap(3,0,28,46,1,...) at db_trap+0xdb/frame 0xe47418c8 kdb_trap(3,0,e4741a48,e4741a90,0,...) at kdb_trap+0x117/frame 0xe4741900 trap(e4741a48) at trap+0x87f/frame 0xe4741a3c calltrap() at calltrap+0x6/frame 0xe4741a3c --- trap 0x3, eip = 0xc0b9d632, esp = 0xe4741a88, ebp = 0xe4741a9c --- kdb_alt_break_internal(0,e4741ac8,c097fa37,2,c8c6f684,...) at kdb_alt_break_internal+0x162/frame 0xe4741a9c kdb_alt_break(2,c8c6f684,c11b4431,c8c6f600,40000,...) at kdb_alt_break+0x16/frame 0xe4741aa8 uart_intr_rxready(c8c6f600,c13afc53,df,448c,1,...) at uart_intr_rxready+0x87/frame 0xe4741ac8 uart_intr(c8c6f600,0,b,0,0,...) at uart_intr+0x100/frame 0xe4741b04 intr_event_handle(c8a26680,e4741b80,0,2,0,...) at intr_event_handle+0x7a/frame 0xe4741b30 intr_execute_handlers(c8a7a108,e4741b80,2) at intr_execute_handlers+0x42/frame 0xe4741b50 lapic_handle_intr(30,e4741b80) at lapic_handle_intr+0x5d/frame 0xe4741b70 Xapic_isr1() at Xapic_isr1+0x4a/frame 0xe4741b70 --- interrupt, eip = 0xc1051d75, esp = 0xe4741bc0, ebp = 0xe4741bc0 --- acpi_cpu_c1(e472ec90,0,c13afc53,2ec,448c,...) at acpi_cpu_c1+0x5/frame 0xe4741bc0 acpi_cpu_idle(caed182,0,caed182,e4741c30,c105a5bd,...) at acpi_cpu_idle+0x166/frame 0xe4741c00 cpu_idle_acpi(caed182,0,1,c1578c88,c1578c84,...) at cpu_idle_acpi+0x3f/frame 0xe4741c14 cpu_idle(0,e4741c80,c11ee7a6,a48,c1578c88,...) at cpu_idle+0x9d/frame 0xe4741c30 sched_idletd(0,e4741ce8,c11e53ac,3dc,0,...) at sched_idletd+0x3cb/frame 0xe4741cac fork_exit(c0b8b0b0,0,e4741ce8) at fork_exit+0x7e/frame 0xe4741cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4741cd4 --- trap 0, eip = 0, esp = 0xe4741d20, ebp = 0 --- Tracing command bash pid 1111 tid 100185 td 0xca741310 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c11f072c,c8a2d930,e4741424,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xe4741408 kdb_backtrace(c11f07a9,280,e47415bc,c106b620,8,...) at kdb_backtrace+0x2d/frame 0xe4741470 kdb_reenter(8,c11f3166,225,e47414a8,c8a2d930,...) at kdb_reenter+0x31/frame 0xe4741480 trap(e47415c8) at trap+0x50/frame 0xe47415bc calltrap() at calltrap+0x6/frame 0xe47415bc --- trap 0xc, eip = 0xc1055676, esp = 0xe4741608, ebp = 0xe4741618 --- db_trace_thread(ca741310,ffffffff,457,18759,ca741310,...) at db_trace_thread+0x16/frame 0xe4741618 db_stack_trace_all(c0b9d632,0,ffffffff,e47416b8,0,...) at db_stack_trace_all+0xa2/frame 0xe4741684 db_command(c14a5682,0,c1635bd8,c14a5681,a,...) at db_command+0x39f/frame 0xe4741740 db_script_exec(e47417f0,0,c8b44250,e47417dc,1,...) at db_script_exec+0x168/frame 0xe47417a8 db_command(c10ba61b,e47418c8,c0532ceb,c10ba713,c079bb27,...) at db_command+0x39f/frame 0xe4741864 db_command_loop(c10ba713,c079bb27,c15eaa24,1,c88d6e00,...) at db_command_loop+0x50/frame 0xe4741870 db_trap(3,0,28,46,1,...) at db_trap+0xdb/frame 0xe47418c8 kdb_trap(3,0,e4741a48,e4741a90,0,...) at kdb_trap+0x117/frame 0xe4741900 trap(e4741a48) at trap+0x87f/frame 0xe4741a3c calltrap() at calltrap+0x6/frame 0xe4741a3c --- trap 0x3, eip = 0xc0b9d632, esp = 0xe4741a88, ebp = 0xe4741a9c --- kdb_alt_break_internal(0,e4741ac8,c097fa37,2,c8c6f684,...) at kdb_alt_break_internal+0x162/frame 0xe4741a9c kdb_alt_break(2,c8c6f684,c11b4431,c8c6f600,40000,...) at kdb_alt_break+0x16/frame 0xe4741aa8 uart_intr_rxready(c8c6f600,c13afc53,df,448c,1,...) at uart_intr_rxready+0x87/frame 0xe4741ac8 uart_intr(c8c6f600,0,b,0,0,...) at uart_intr+0x100/frame 0xe4741b04 intr_event_handle(c8a26680,e4741b80,0,2,0,...) at intr_event_handle+0x7a/frame 0xe4741b30 intr_execute_handlers(c8a7a108,e4741b80,2) at intr_execute_handlers+0x42/frame 0xe4741b50 lapic_handle_intr(30,e4741b80) at lapic_handle_intr+0x5d/frame 0xe4741b70 Xapic_isr1() at Xapic_isr1+0x4a/frame 0xe4741b70 --- interrupt, eip = 0xc1051d75, esp = 0xe4741bc0, ebp = 0xe4741bc0 --- acpi_cpu_c1(e472ec90,0,c13afc53,2ec,448c,...) at acpi_cpu_c1+0x5/frame 0xe4741bc0 acpi_cpu_idle(caed182,0,caed182,e4741c30,c105a5bd,...) at acpi_cpu_idle+0x166/frame 0xe4741c00 cpu_idle_acpi(caed182,0,1,c1578c88,c1578c84,...) at cpu_idle_acpi+0x3f/frame 0xe4741c14 cpu_idle(0,e4741c80,c11ee7a6,a48,c1578c88,...) at cpu_idle+0x9d/frame 0xe4741c30 sched_idletd(0,e4741ce8,c11e53ac,3dc,0,...) at sched_idletd+0x3cb/frame 0xe4741cac fork_exit(c0b8b0b0,0,e4741ce8) at fork_exit+0x7e/frame 0xe4741cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4741cd4 --- trap 0, eip = 0, esp = 0xe4741d20, ebp = 0 --- Tracing command sshd pid 1110 tid 100152 td 0xca486000 sched_switch(ca486000,0,104,1ba,f8918918,...) at sched_switch+0x4e2/frame 0xf89188e0 mi_switch(104,0,c11f2745,200,f8918984,...) at mi_switch+0x1bf/frame 0xf8918918 sleepq_switch(ca486000,0,c11f2745,1b6,f8918990,...) at sleepq_switch+0x1c5/frame 0xf891894c sleepq_catch_signals(f89189ac,c0b473c9,c9cba860,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf8918988 sleepq_wait_sig(c9cba864,0,f89189e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xf89189ac _cv_wait_sig(c9cba864,c9cba850,c11f5c27,72e,1ae,...) at _cv_wait_sig+0x214/frame 0xf89189f8 seltdwait(ffffffff,0,0,ca486000,0,...) at seltdwait+0xbb/frame 0xf8918a28 kern_select(ca486000,c,28c0c1e0,28c0c1e8,0,...) at kern_select+0x914/frame 0xf8918bd0 sys_select(ca486000,f8918ca8,c11e4fcd,4,c1073da7,...) at sys_select+0x66/frame 0xf8918c18 syscall(f8918ce8) at syscall+0x34a/frame 0xf8918cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8918cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284e8eff, esp = 0xbfbfe7cc, ebp = 0xbfbfe7f0 --- Tracing command sshd pid 1108 tid 100186 td 0xca741000 sched_switch(ca741000,0,104,1ba,f8988950,...) at sched_switch+0x4e2/frame 0xf8988918 mi_switch(104,0,c11f2745,200,f89889bc,...) at mi_switch+0x1bf/frame 0xf8988950 sleepq_switch(ca741000,0,c11f2745,1b6,f89889c8,...) at sleepq_switch+0x1c5/frame 0xf8988984 sleepq_catch_signals(f89889e4,c0b473c9,c9cba960,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf89889c0 sleepq_wait_sig(c9cba964,0,f8988a1c,101,0,...) at sleepq_wait_sig+0x14/frame 0xf89889e4 _cv_wait_sig(c9cba964,c9cba950,c11f5c27,72e,629,...) at _cv_wait_sig+0x214/frame 0xf8988a30 seltdwait(ffffffff,0,0,ca741000,0,...) at seltdwait+0xbb/frame 0xf8988a60 kern_poll(ca741000,bfbfe860,1,0,0,...) at kern_poll+0x4f0/frame 0xf8988be0 sys_poll(ca741000,f8988ca8,c11e4fcd,4,c1073da7,...) at sys_poll+0x71/frame 0xf8988c18 syscall(f8988ce8) at syscall+0x34a/frame 0xf8988cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8988cdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x28487c53, esp = 0xbfbfe82c, ebp = 0xbfbfe848 --- Tracing command getty pid 980 tid 100168 td 0xc942cc40 sched_switch(c942cc40,0,104,1ba,f894d9a4,...) at sched_switch+0x4e2/frame 0xf894d96c mi_switch(104,0,c11f2745,200,c15b6c40,...) at mi_switch+0x1bf/frame 0xf894d9a4 sleepq_switch(c942cc40,0,c11f2745,1b6,f894da1c,...) at sleepq_switch+0x1c5/frame 0xf894d9d8 sleepq_catch_signals(f894da38,c0b473c9,c8cc7814,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf894da14 sleepq_wait_sig(c8cc7870,0,f894da70,101,0,...) at sleepq_wait_sig+0x14/frame 0xf894da38 _cv_wait_sig(c8cc7870,c8cc7804,c11f7d5d,567,1,...) at _cv_wait_sig+0x214/frame 0xf894da84 tty_wait(c8cc7800,c8cc7870,f894dbe8,1,0,...) at tty_wait+0x4b/frame 0xf894daa8 ttydisc_read(c8cc7800,f894dbe8,0,b2,f894dbe8,...) at ttydisc_read+0x3d4/frame 0xf894daf0 ttydev_read(c89f6e00,f894dbe8,0,0,f894db40,...) at ttydev_read+0x55/frame 0xf894db10 devfs_read_f(c93d1ce8,f894dbe8,cb189400,0,c942cc40,...) at devfs_read_f+0xa8/frame 0xf894db4c dofileread(c93d1ce8,f894dbe8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xf894db80 kern_readv(c942cc40,0,f894dbe8,c15b6c40,bfbfedf7,...) at kern_readv+0x93/frame 0xf894dbc8 sys_read(c942cc40,f894dca8,c11e4fcd,4,c1073da7,...) at sys_read+0x59/frame 0xf894dc18 syscall(f894dce8) at syscall+0x34a/frame 0xf894dcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf894dcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b7f0f, esp = 0xbfbfedd8, ebp = 0xbfbfee08 --- Tracing command getty pid 979 tid 100153 td 0xca485c40 sched_switch(ca485c40,0,104,1ba,f891b9a4,...) at sched_switch+0x4e2/frame 0xf891b96c mi_switch(104,0,c11f2745,200,c15b6ea8,...) at mi_switch+0x1bf/frame 0xf891b9a4 sleepq_switch(ca485c40,0,c11f2745,1b6,f891ba1c,...) at sleepq_switch+0x1c5/frame 0xf891b9d8 sleepq_catch_signals(f891ba38,c0b473c9,c8cc6814,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf891ba14 sleepq_wait_sig(c8cc6870,0,f891ba70,101,0,...) at sleepq_wait_sig+0x14/frame 0xf891ba38 _cv_wait_sig(c8cc6870,c8cc6804,c11f7d5d,567,1,...) at _cv_wait_sig+0x214/frame 0xf891ba84 tty_wait(c8cc6800,c8cc6870,f891bbe8,1,0,...) at tty_wait+0x4b/frame 0xf891baa8 ttydisc_read(c8cc6800,f891bbe8,0,b2,f891bbe8,...) at ttydisc_read+0x3d4/frame 0xf891baf0 ttydev_read(c8efb300,f891bbe8,0,0,f891bb40,...) at ttydev_read+0x55/frame 0xf891bb10 devfs_read_f(c9373460,f891bbe8,c92c2000,0,ca485c40,...) at devfs_read_f+0xa8/frame 0xf891bb4c dofileread(c9373460,f891bbe8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xf891bb80 kern_readv(ca485c40,0,f891bbe8,c15b6ea8,bfbfedf7,...) at kern_readv+0x93/frame 0xf891bbc8 sys_read(ca485c40,f891bca8,c11e4fcd,4,c1578510,...) at sys_read+0x59/frame 0xf891bc18 syscall(f891bce8) at syscall+0x34a/frame 0xf891bcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf891bcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b7f0f, esp = 0xbfbfedd8, ebp = 0xbfbfee08 --- Tracing command getty pid 978 tid 100157 td 0xc9364310 sched_switch(c9364310,0,104,1ba,f89279a4,...) at sched_switch+0x4e2/frame 0xf892796c mi_switch(104,0,c11f2745,200,c15b6820,...) at mi_switch+0x1bf/frame 0xf89279a4 sleepq_switch(c9364310,0,c11f2745,1b6,f8927a1c,...) at sleepq_switch+0x1c5/frame 0xf89279d8 sleepq_catch_signals(f8927a38,c0b473c9,c8cc6a14,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf8927a14 sleepq_wait_sig(c8cc6a70,0,f8927a70,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8927a38 _cv_wait_sig(c8cc6a70,c8cc6a04,c11f7d5d,567,1,...) at _cv_wait_sig+0x214/frame 0xf8927a84 tty_wait(c8cc6a00,c8cc6a70,f8927be8,1,0,...) at tty_wait+0x4b/frame 0xf8927aa8 ttydisc_read(c8cc6a00,f8927be8,0,b2,f8927be8,...) at ttydisc_read+0x3d4/frame 0xf8927af0 ttydev_read(c8efb400,f8927be8,0,0,f8927b40,...) at ttydev_read+0x55/frame 0xf8927b10 devfs_read_f(c93d1a48,f8927be8,cb188b00,0,c9364310,...) at devfs_read_f+0xa8/frame 0xf8927b4c dofileread(c93d1a48,f8927be8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xf8927b80 kern_readv(c9364310,0,f8927be8,c15b6820,bfbfedf7,...) at kern_readv+0x93/frame 0xf8927bc8 sys_read(c9364310,f8927ca8,c11e4fcd,4,c1073da7,...) at sys_read+0x59/frame 0xf8927c18 syscall(f8927ce8) at syscall+0x34a/frame 0xf8927cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8927cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b7f0f, esp = 0xbfbfedd8, ebp = 0xbfbfee08 --- Tracing command getty pid 977 tid 100089 td 0xc9363930 sched_switch(c9363930,0,104,1ba,edb559a4,...) at sched_switch+0x4e2/frame 0xedb5596c mi_switch(104,0,c11f2745,200,c15b67c8,...) at mi_switch+0x1bf/frame 0xedb559a4 sleepq_switch(c9363930,0,c11f2745,1b6,edb55a1c,...) at sleepq_switch+0x1c5/frame 0xedb559d8 sleepq_catch_signals(edb55a38,c0b473c9,c8cc6c14,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xedb55a14 sleepq_wait_sig(c8cc6c70,0,edb55a70,101,0,...) at sleepq_wait_sig+0x14/frame 0xedb55a38 _cv_wait_sig(c8cc6c70,c8cc6c04,c11f7d5d,567,1,...) at _cv_wait_sig+0x214/frame 0xedb55a84 tty_wait(c8cc6c00,c8cc6c70,edb55be8,1,0,...) at tty_wait+0x4b/frame 0xedb55aa8 ttydisc_read(c8cc6c00,edb55be8,0,b2,edb55be8,...) at ttydisc_read+0x3d4/frame 0xedb55af0 ttydev_read(c8efb500,edb55be8,0,0,edb55b40,...) at ttydev_read+0x55/frame 0xedb55b10 devfs_read_f(c93d2888,edb55be8,cb188a00,0,c9363930,...) at devfs_read_f+0xa8/frame 0xedb55b4c dofileread(c93d2888,edb55be8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xedb55b80 kern_readv(c9363930,0,edb55be8,c15b67c8,bfbfedf7,...) at kern_readv+0x93/frame 0xedb55bc8 sys_read(c9363930,edb55ca8,c11e4fcd,4,c1073da7,...) at sys_read+0x59/frame 0xedb55c18 syscall(edb55ce8) at syscall+0x34a/frame 0xedb55cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedb55cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b7f0f, esp = 0xbfbfedd8, ebp = 0xbfbfee08 --- Tracing command getty pid 976 tid 100183 td 0xcd180000 sched_switch(cd180000,0,104,1ba,f897f9a4,...) at sched_switch+0x4e2/frame 0xf897f96c mi_switch(104,0,c11f2745,200,c15b6928,...) at mi_switch+0x1bf/frame 0xf897f9a4 sleepq_switch(cd180000,0,c11f2745,1b6,f897fa1c,...) at sleepq_switch+0x1c5/frame 0xf897f9d8 sleepq_catch_signals(f897fa38,c0b473c9,c8cc6e14,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf897fa14 sleepq_wait_sig(c8cc6e70,0,f897fa70,101,0,...) at sleepq_wait_sig+0x14/frame 0xf897fa38 _cv_wait_sig(c8cc6e70,c8cc6e04,c11f7d5d,567,1,...) at _cv_wait_sig+0x214/frame 0xf897fa84 tty_wait(c8cc6e00,c8cc6e70,f897fbe8,1,0,...) at tty_wait+0x4b/frame 0xf897faa8 ttydisc_read(c8cc6e00,f897fbe8,0,b2,f897fbe8,...) at ttydisc_read+0x3d4/frame 0xf897faf0 ttydev_read(c8efb600,f897fbe8,0,0,f897fb40,...) at ttydev_read+0x55/frame 0xf897fb10 devfs_read_f(c93e98c0,f897fbe8,c92c3600,0,cd180000,...) at devfs_read_f+0xa8/frame 0xf897fb4c dofileread(c93e98c0,f897fbe8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xf897fb80 kern_readv(cd180000,0,f897fbe8,c15b6928,bfbfedf7,...) at kern_readv+0x93/frame 0xf897fbc8 sys_read(cd180000,f897fca8,c11e4fcd,4,c1073da7,...) at sys_read+0x59/frame 0xf897fc18 syscall(f897fce8) at syscall+0x34a/frame 0xf897fcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf897fcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b7f0f, esp = 0xbfbfedd8, ebp = 0xbfbfee08 --- Tracing command getty pid 975 tid 100182 td 0xcd180310 sched_switch(cd180310,0,104,1ba,f897c9a4,...) at sched_switch+0x4e2/frame 0xf897c96c mi_switch(104,0,c11f2745,200,c15b6980,...) at mi_switch+0x1bf/frame 0xf897c9a4 sleepq_switch(cd180310,0,c11f2745,1b6,f897ca1c,...) at sleepq_switch+0x1c5/frame 0xf897c9d8 sleepq_catch_signals(f897ca38,c0b473c9,c8cc7014,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf897ca14 sleepq_wait_sig(c8cc7070,0,f897ca70,101,0,...) at sleepq_wait_sig+0x14/frame 0xf897ca38 _cv_wait_sig(c8cc7070,c8cc7004,c11f7d5d,567,1,...) at _cv_wait_sig+0x214/frame 0xf897ca84 tty_wait(c8cc7000,c8cc7070,f897cbe8,1,0,...) at tty_wait+0x4b/frame 0xf897caa8 ttydisc_read(c8cc7000,f897cbe8,0,b2,f897cbe8,...) at ttydisc_read+0x3d4/frame 0xf897caf0 ttydev_read(c8efb700,f897cbe8,0,0,f897cb40,...) at ttydev_read+0x55/frame 0xf897cb10 devfs_read_f(c93d2118,f897cbe8,c92c2100,0,cd180310,...) at devfs_read_f+0xa8/frame 0xf897cb4c dofileread(c93d2118,f897cbe8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xf897cb80 kern_readv(cd180310,0,f897cbe8,c15b6980,bfbfedf7,...) at kern_readv+0x93/frame 0xf897cbc8 sys_read(cd180310,f897cca8,c11e4fcd,4,c1577e10,...) at sys_read+0x59/frame 0xf897cc18 syscall(f897cce8) at syscall+0x34a/frame 0xf897ccdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf897ccdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b7f0f, esp = 0xbfbfedd8, ebp = 0xbfbfee08 --- Tracing command getty pid 974 tid 100181 td 0xcd180620 sched_switch(cd180620,0,104,1ba,f89799a4,...) at sched_switch+0x4e2/frame 0xf897996c mi_switch(104,0,c11f2745,200,c15b6ae0,...) at mi_switch+0x1bf/frame 0xf89799a4 sleepq_switch(cd180620,0,c11f2745,1b6,f8979a1c,...) at sleepq_switch+0x1c5/frame 0xf89799d8 sleepq_catch_signals(f8979a38,c0b473c9,c8cc7214,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf8979a14 sleepq_wait_sig(c8cc7270,0,f8979a70,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8979a38 _cv_wait_sig(c8cc7270,c8cc7204,c11f7d5d,567,1,...) at _cv_wait_sig+0x214/frame 0xf8979a84 tty_wait(c8cc7200,c8cc7270,f8979be8,1,0,...) at tty_wait+0x4b/frame 0xf8979aa8 ttydisc_read(c8cc7200,f8979be8,0,b2,f8979be8,...) at ttydisc_read+0x3d4/frame 0xf8979af0 ttydev_read(c8efb800,f8979be8,0,0,f8979b40,...) at ttydev_read+0x55/frame 0xf8979b10 devfs_read_f(c9399ce8,f8979be8,c92c1c00,0,cd180620,...) at devfs_read_f+0xa8/frame 0xf8979b4c dofileread(c9399ce8,f8979be8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xf8979b80 kern_readv(cd180620,0,f8979be8,c15b6ae0,bfbfedf7,...) at kern_readv+0x93/frame 0xf8979bc8 sys_read(cd180620,f8979ca8,c11e4fcd,4,c1577e10,...) at sys_read+0x59/frame 0xf8979c18 syscall(f8979ce8) at syscall+0x34a/frame 0xf8979cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8979cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b7f0f, esp = 0xbfbfedd8, ebp = 0xbfbfee08 --- Tracing command getty pid 973 tid 100180 td 0xcd180930 sched_switch(cd180930,0,104,1ba,f89769a4,...) at sched_switch+0x4e2/frame 0xf897696c mi_switch(104,0,c11f2745,200,c15b7cc0,...) at mi_switch+0x1bf/frame 0xf89769a4 sleepq_switch(cd180930,0,c11f2745,1b6,f8976a1c,...) at sleepq_switch+0x1c5/frame 0xf89769d8 sleepq_catch_signals(f8976a38,c0b473c9,c8cc7414,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf8976a14 sleepq_wait_sig(c8cc7470,0,f8976a70,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8976a38 _cv_wait_sig(c8cc7470,c8cc7404,c11f7d5d,567,1,...) at _cv_wait_sig+0x214/frame 0xf8976a84 tty_wait(c8cc7400,c8cc7470,f8976be8,1,0,...) at tty_wait+0x4b/frame 0xf8976aa8 ttydisc_read(c8cc7400,f8976be8,0,b2,f8976be8,...) at ttydisc_read+0x3d4/frame 0xf8976af0 ttydev_read(c8efb900,f8976be8,0,0,f8976b40,...) at ttydev_read+0x55/frame 0xf8976b10 devfs_read_f(c93d2188,f8976be8,c89faa00,0,cd180930,...) at devfs_read_f+0xa8/frame 0xf8976b4c dofileread(c93d2188,f8976be8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xf8976b80 kern_readv(cd180930,0,f8976be8,c15b7cc0,bfbfedf7,...) at kern_readv+0x93/frame 0xf8976bc8 sys_read(cd180930,f8976ca8,c11e4fcd,4,c1073da7,...) at sys_read+0x59/frame 0xf8976c18 syscall(f8976ce8) at syscall+0x34a/frame 0xf8976cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8976cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b7f0f, esp = 0xbfbfedd8, ebp = 0xbfbfee08 --- Tracing command getty pid 972 tid 100177 td 0xcd185310 sched_switch(cd185310,0,104,1ba,f896d9a4,...) at sched_switch+0x4e2/frame 0xf896d96c mi_switch(104,0,c11f2745,200,c15b8348,...) at mi_switch+0x1bf/frame 0xf896d9a4 sleepq_switch(cd185310,0,c11f2745,1b6,f896da1c,...) at sleepq_switch+0x1c5/frame 0xf896d9d8 sleepq_catch_signals(f896da38,c0b473c9,c8cc7614,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf896da14 sleepq_wait_sig(c8cc7670,0,f896da70,101,0,...) at sleepq_wait_sig+0x14/frame 0xf896da38 _cv_wait_sig(c8cc7670,c8cc7604,c11f7d5d,567,1,...) at _cv_wait_sig+0x214/frame 0xf896da84 tty_wait(c8cc7600,c8cc7670,f896dbe8,1,0,...) at tty_wait+0x4b/frame 0xf896daa8 ttydisc_read(c8cc7600,f896dbe8,0,b2,f896dbe8,...) at ttydisc_read+0x3d4/frame 0xf896daf0 ttydev_read(c8efba00,f896dbe8,0,0,f896db40,...) at ttydev_read+0x55/frame 0xf896db10 devfs_read_f(c93730e0,f896dbe8,c89fa100,0,cd185310,...) at devfs_read_f+0xa8/frame 0xf896db4c dofileread(c93730e0,f896dbe8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xf896db80 kern_readv(cd185310,0,f896dbe8,c15b8348,bfbfedf7,...) at kern_readv+0x93/frame 0xf896dbc8 sys_read(cd185310,f896dca8,c11e4fcd,4,c1073da7,...) at sys_read+0x59/frame 0xf896dc18 syscall(f896dce8) at syscall+0x34a/frame 0xf896dcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf896dcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b7f0f, esp = 0xbfbfedd8, ebp = 0xbfbfee08 --- Tracing command inetd pid 953 tid 100172 td 0xca741930 sched_switch(ca741930,0,104,1ba,f88e0918,...) at sched_switch+0x4e2/frame 0xf88e08e0 mi_switch(104,0,c11f2745,200,f88e0984,...) at mi_switch+0x1bf/frame 0xf88e0918 sleepq_switch(ca741930,0,c11f2745,1b6,f88e0990,...) at sleepq_switch+0x1c5/frame 0xf88e094c sleepq_catch_signals(f88e09ac,c0b473c9,c8c080e0,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf88e0988 sleepq_wait_sig(c8c080e4,0,f88e09e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88e09ac _cv_wait_sig(c8c080e4,c8c080d0,c11f5c27,72e,c9b10720,...) at _cv_wait_sig+0x214/frame 0xf88e09f8 seltdwait(ffffffff,0,0,ca741930,0,...) at seltdwait+0xbb/frame 0xf88e0a28 kern_select(ca741930,a,bfbfe078,0,0,...) at kern_select+0x914/frame 0xf88e0bd0 sys_select(ca741930,f88e0ca8,c11e4fcd,4,c1073da7,...) at sys_select+0x66/frame 0xf88e0c18 syscall(f88e0ce8) at syscall+0x34a/frame 0xf88e0cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf88e0cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281cbeff, esp = 0xbfbfe014, ebp = 0xbfbfee34 --- Tracing command cron pid 756 tid 100147 td 0xc9417000 sched_switch(c9417000,0,104,1ba,f8905a84,...) at sched_switch+0x4e2/frame 0xf8905a4c mi_switch(104,0,c11f2745,200,44a9,...) at mi_switch+0x1bf/frame 0xf8905a84 sleepq_switch(c9417000,0,c11f2745,1b6,8,...) at sleepq_switch+0x1c5/frame 0xf8905ab8 sleepq_catch_signals(c0baf1d0,c9417000,3,201,3,...) at sleepq_catch_signals+0x382/frame 0xf8905af4 sleepq_timedwait_sig(c156bbe3,6c,44a9,bfd66825,3,...) at sleepq_timedwait_sig+0x14/frame 0xf8905b1c _sleep(c156bbe3,0,16c,c11ed6da,d02e4339,...) at _sleep+0x326/frame 0xf8905b78 kern_nanosleep(bfbfee28,f8905bf0,f8905bf8,f8905ce8,3b,...) at kern_nanosleep+0x14b/frame 0xf8905bd8 sys_nanosleep(c9417000,f8905ca8,c11e4fcd,4,ca516000,...) at sys_nanosleep+0x68/frame 0xf8905c18 syscall(f8905ce8) at syscall+0x34a/frame 0xf8905cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8905cdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2815984f, esp = 0xbfbfecb4, ebp = 0xbfbfee44 --- Tracing command sendmail pid 751 tid 100145 td 0xc8edec40 sched_switch(c8edec40,0,104,1ba,f88ffab8,...) at sched_switch+0x4e2/frame 0xf88ffa80 mi_switch(104,0,c11f2745,200,0,...) at mi_switch+0x1bf/frame 0xf88ffab8 sleepq_switch(c8edec40,0,c11f2745,1b6,c11f2745,...) at sleepq_switch+0x1c5/frame 0xf88ffaec sleepq_catch_signals(c11f2745,16d,c934f0b8,de0,c8edec40,...) at sleepq_catch_signals+0x382/frame 0xf88ffb28 sleepq_wait_sig(c934f064,74,c10cda74,100,0,...) at sleepq_wait_sig+0x14/frame 0xf88ffb4c _sleep(c934f064,c934f0a8,174,c10cda74,0,...) at _sleep+0x356/frame 0xf88ffba8 kern_sigsuspend(c8edec40,0,0,0,0,...) at kern_sigsuspend+0xd4/frame 0xf88ffbe8 sys_sigsuspend(c8edec40,f88ffca8,c11e4fcd,4,c11f5084,...) at sys_sigsuspend+0x55/frame 0xf88ffc18 syscall(f88ffce8) at syscall+0x34a/frame 0xf88ffcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf88ffcdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x283d57ef, esp = 0xbfbfda94, ebp = 0xbfbfdac0 --- Tracing command sendmail pid 748 tid 100097 td 0xc9441620 sched_switch(c9441620,0,104,1ba,edbc3910,...) at sched_switch+0x4e2/frame 0xedbc38d8 mi_switch(104,0,c11f2745,200,c1640190,...) at mi_switch+0x1bf/frame 0xedbc3910 sleepq_switch(c9441620,0,c11f2745,1b6,c9abf510,...) at sleepq_switch+0x1c5/frame 0xedbc3944 sleepq_catch_signals(c1461ad0,edbc39a8,c0b473c9,c9abf520,0,...) at sleepq_catch_signals+0x382/frame 0xedbc3980 sleepq_timedwait_sig(c9abf524,0,edbc39e4,50000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xedbc39a8 _cv_timedwait_sig_sbt(c9abf524,c9abf510,9869b2d0,448c,50000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedbc39f8 seltdwait(448c,50000000,0,c9441620,0,...) at seltdwait+0xad/frame 0xedbc3a28 kern_select(c9441620,5,bfbfd118,0,0,...) at kern_select+0x914/frame 0xedbc3bd0 sys_select(c9441620,edbc3ca8,c11e4fcd,4,c11ee7a6,...) at sys_select+0x66/frame 0xedbc3c18 syscall(edbc3ce8) at syscall+0x34a/frame 0xedbc3cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbc3cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28441eff, esp = 0xbfbfcfec, ebp = 0xbfbfdaa0 --- Tracing command sshd pid 745 tid 100095 td 0xc8edc000 sched_switch(c8edc000,0,104,1ba,edbbb918,...) at sched_switch+0x4e2/frame 0xedbbb8e0 mi_switch(104,0,c11f2745,200,edbbb984,...) at mi_switch+0x1bf/frame 0xedbbb918 sleepq_switch(c8edc000,0,c11f2745,1b6,edbbb990,...) at sleepq_switch+0x1c5/frame 0xedbbb94c sleepq_catch_signals(edbbb9ac,c0b473c9,c8c083a0,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xedbbb988 sleepq_wait_sig(c8c083a4,0,edbbb9e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xedbbb9ac _cv_wait_sig(c8c083a4,c8c08390,c11f5c27,72e,c9b1a8e8,...) at _cv_wait_sig+0x214/frame 0xedbbb9f8 seltdwait(ffffffff,0,0,c8edc000,0,...) at seltdwait+0xbb/frame 0xedbbba28 kern_select(c8edc000,9,28c0c158,0,0,...) at kern_select+0x914/frame 0xedbbbbd0 sys_select(c8edc000,edbbbca8,c11e4fcd,4,ca4d5000,...) at sys_select+0x66/frame 0xedbbbc18 syscall(edbbbce8) at syscall+0x34a/frame 0xedbbbcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbbbcdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284e8eff, esp = 0xbfbfe88c, ebp = 0xbfbfe8b0 --- Tracing command moused pid 698 tid 100137 td 0xc9417c40 sched_switch(c9417c40,0,104,1ba,f88d3918,...) at sched_switch+0x4e2/frame 0xf88d38e0 mi_switch(104,0,c11f2745,200,246,...) at mi_switch+0x1bf/frame 0xf88d3918 sleepq_switch(c9417c40,0,c11f2745,1b6,f88d3990,...) at sleepq_switch+0x1c5/frame 0xf88d394c sleepq_catch_signals(f88d39ac,c0b473c9,c9abf7a0,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf88d3988 sleepq_wait_sig(c9abf7a4,0,f88d39e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88d39ac _cv_wait_sig(c9abf7a4,c9abf790,c11f5c27,72e,1,...) at _cv_wait_sig+0x214/frame 0xf88d39f8 seltdwait(ffffffff,0,0,c9417c40,0,...) at seltdwait+0xbb/frame 0xf88d3a28 kern_select(c9417c40,400,bfbfeba0,0,0,...) at kern_select+0x914/frame 0xf88d3bd0 sys_select(c9417c40,f88d3ca8,c11e4fcd,4,c1073da7,...) at sys_select+0x66/frame 0xf88d3c18 syscall(f88d3ce8) at syscall+0x34a/frame 0xf88d3cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf88d3cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281e2eff, esp = 0xbfbfea54, ebp = 0xbfbfee24 --- Tracing command smartd pid 691 tid 100082 td 0xc942c310 sched_switch(c942c310,0,104,1ba,edb32a84,...) at sched_switch+0x4e2/frame 0xedb32a4c mi_switch(104,0,c11f2745,200,484a,...) at mi_switch+0x1bf/frame 0xedb32a84 sleepq_switch(c942c310,0,c11f2745,1b6,8,...) at sleepq_switch+0x1c5/frame 0xedb32ab8 sleepq_catch_signals(c0baf1d0,c942c310,1,201,1,...) at sleepq_catch_signals+0x382/frame 0xedb32af4 sleepq_timedwait_sig(c156bbe1,6c,484a,80000000,70,...) at sleepq_timedwait_sig+0x14/frame 0xedb32b1c _sleep(c156bbe1,0,16c,c11ed6da,b31431af,...) at _sleep+0x326/frame 0xedb32b78 kern_nanosleep(bfbf8c00,edb32bf0,edb32bf8,edb32ce8,708,...) at kern_nanosleep+0x14b/frame 0xedb32bd8 sys_nanosleep(c942c310,edb32ca8,c11e4fcd,4,c1578c10,...) at sys_nanosleep+0x68/frame 0xedb32c18 syscall(edb32ce8) at syscall+0x34a/frame 0xedb32cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedb32cdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x282b684f, esp = 0xbfbf8bd8, ebp = 0xbfbf8bf0 --- Tracing command powerd pid 672 tid 100139 td 0xca486620 sched_switch(ca486620,0,104,1ba,f88d9910,...) at sched_switch+0x4e2/frame 0xf88d98d8 mi_switch(104,0,c11f2745,200,c1640190,...) at mi_switch+0x1bf/frame 0xf88d9910 sleepq_switch(ca486620,0,c11f2745,1b6,c9abf650,...) at sleepq_switch+0x1c5/frame 0xf88d9944 sleepq_catch_signals(c1461ad0,f88d99a8,c0b473c9,c9abf660,0,...) at sleepq_catch_signals+0x382/frame 0xf88d9980 sleepq_timedwait_sig(c9abf664,0,f88d99e4,3ffffff,0,...) at sleepq_timedwait_sig+0x14/frame 0xf88d99a8 _cv_timedwait_sig_sbt(c9abf664,c9abf650,53156e17,448c,3ffffff,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xf88d99f8 seltdwait(448c,3ffffff,0,f88d9a40,ffffffff,...) at seltdwait+0xad/frame 0xf88d9a28 kern_select(ca486620,0,bfbfeda0,0,bfbfeda0,...) at kern_select+0x914/frame 0xf88d9bd0 sys_select(ca486620,f88d9ca8,c11e4fcd,4,f88d9c6c,...) at sys_select+0x66/frame 0xf88d9c18 syscall(f88d9ce8) at syscall+0x34a/frame 0xf88d9cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf88d9cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281b5eff, esp = 0xbfbfed1c, ebp = 0xbfbfee44 --- Tracing command ntpd pid 669 tid 100138 td 0xca486930 sched_switch(ca486930,0,104,1ba,f88d6918,...) at sched_switch+0x4e2/frame 0xf88d68e0 mi_switch(104,0,c11f2745,200,f88d6984,...) at mi_switch+0x1bf/frame 0xf88d6918 sleepq_switch(ca486930,0,c11f2745,1b6,f88d6990,...) at sleepq_switch+0x1c5/frame 0xf88d694c sleepq_catch_signals(f88d69ac,c0b473c9,c9abf5e0,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf88d6988 sleepq_wait_sig(c9abf5e4,0,f88d69e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88d69ac _cv_wait_sig(c9abf5e4,c9abf5d0,c11f5c27,72e,c9ad9c78,...) at _cv_wait_sig+0x214/frame 0xf88d69f8 seltdwait(ffffffff,0,0,ca486930,0,...) at seltdwait+0xbb/frame 0xf88d6a28 kern_select(ca486930,1c,bfbfde08,0,0,...) at kern_select+0x914/frame 0xf88d6bd0 sys_select(ca486930,f88d6ca8,c11e4fcd,4,ca4b0000,...) at sys_select+0x66/frame 0xf88d6c18 syscall(f88d6ce8) at syscall+0x34a/frame 0xf88d6cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf88d6cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2843eeff, esp = 0xbfbfdd6c, ebp = 0xbfbfdd90 --- Tracing command nfsd pid 615 tid 100081 td 0xc942c620 sched_switch(c942c620,0,104,1ba,edb2e310,...) at sched_switch+0x4e2/frame 0xedb2e2d8 mi_switch(104,0,c11f2745,200,c1640490,...) at mi_switch+0x1bf/frame 0xedb2e310 sleepq_switch(c942c620,0,c11f2745,1b6,c8e35100,...) at sleepq_switch+0x1c5/frame 0xedb2e344 sleepq_catch_signals(c1461ad0,edb2e3a8,c0b473c9,c8e35110,0,...) at sleepq_catch_signals+0x382/frame 0xedb2e380 sleepq_timedwait_sig(c8ef8e90,0,edb2e3e4,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xedb2e3a8 _cv_timedwait_sig_sbt(c8ef8e90,c8e35100,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedb2e3f8 svc_run_internal(c0d94c60,c8e35100,c9412680,edb2e514,0,...) at svc_run_internal+0xc42/frame 0xedb2e4dc svc_run(c8e35000,0,c11d6648,1e5,c1462d2c,...) at svc_run+0x1bf/frame 0xedb2e524 nfsrvd_nfsd(c942c620,edb2e690,c,c0b3f186,c9aac7a8,...) at nfsrvd_nfsd+0x1ba/frame 0xedb2e660 nfssvc_nfsd(c942c620,edb2eca8,edb2eca0,c942c620,edb2ecdc,...) at nfssvc_nfsd+0x11b/frame 0xedb2ec00 sys_nfssvc(c942c620,edb2eca8,c11e4fcd,4,c1073da7,...) at sys_nfssvc+0xc4/frame 0xedb2ec18 syscall(edb2ece8) at syscall+0x34a/frame 0xedb2ecdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedb2ecdc --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280db1fb, esp = 0xbfbfe7e4, ebp = 0xbfbfea58 --- Tracing command nfsd pid 615 tid 100105 td 0xca3c8930 sched_switch(ca3c8930,0,104,1ba,edbf5ae0,...) at sched_switch+0x4e2/frame 0xedbf5aa8 mi_switch(104,0,c11f2745,200,c158c25c,...) at mi_switch+0x1bf/frame 0xedbf5ae0 sleepq_switch(ca3c8930,0,c11f2745,1b6,edbf5b58,...) at sleepq_switch+0x1c5/frame 0xedbf5b14 sleepq_catch_signals(edbf5b74,c0b473c9,c8e35110,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xedbf5b50 sleepq_wait_sig(ca47f290,0,edbf5bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xedbf5b74 _cv_wait_sig(ca47f290,c8e35100,c121dd35,414,0,...) at _cv_wait_sig+0x214/frame 0xedbf5bc0 svc_run_internal(edbf5cd4,c0b2938e,c8e35100,edbf5ce8,c11e53ac,...) at svc_run_internal+0xc71/frame 0xedbf5ca4 svc_thread_start(c8e35100,edbf5ce8,c11e53ac,3dc,0,...) at svc_thread_start+0xd/frame 0xedbf5cac fork_exit(c0d94c60,c8e35100,edbf5ce8) at fork_exit+0x7e/frame 0xedbf5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedbf5cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 615 tid 100106 td 0xca3c8620 sched_switch(ca3c8620,0,104,1ba,edbf8ae0,...) at sched_switch+0x4e2/frame 0xedbf8aa8 mi_switch(104,0,c11f2745,200,c158c25c,...) at mi_switch+0x1bf/frame 0xedbf8ae0 sleepq_switch(ca3c8620,0,c11f2745,1b6,edbf8b58,...) at sleepq_switch+0x1c5/frame 0xedbf8b14 sleepq_catch_signals(edbf8b74,c0b473c9,c8e35110,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xedbf8b50 sleepq_wait_sig(ca47eb90,0,edbf8bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xedbf8b74 _cv_wait_sig(ca47eb90,c8e35100,c121dd35,45c,0,...) at _cv_wait_sig+0x214/frame 0xedbf8bc0 svc_run_internal(edbf8cd4,c0b2938e,c8e35100,edbf8ce8,c11e53ac,...) at svc_run_internal+0xc71/frame 0xedbf8ca4 svc_thread_start(c8e35100,edbf8ce8,c11e53ac,3dc,0,...) at svc_thread_start+0xd/frame 0xedbf8cac fork_exit(c0d94c60,c8e35100,edbf8ce8) at fork_exit+0x7e/frame 0xedbf8cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedbf8cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 615 tid 100107 td 0xca3c8310 sched_switch(ca3c8310,0,104,1ba,edbfbae0,...) at sched_switch+0x4e2/frame 0xedbfbaa8 mi_switch(104,0,c11f2745,200,c158c25c,...) at mi_switch+0x1bf/frame 0xedbfbae0 sleepq_switch(ca3c8310,0,c11f2745,1b6,edbfbb58,...) at sleepq_switch+0x1c5/frame 0xedbfbb14 sleepq_catch_signals(edbfbb74,c0b473c9,c8e35110,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xedbfbb50 sleepq_wait_sig(ca47f190,0,edbfbbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xedbfbb74 _cv_wait_sig(ca47f190,c8e35100,c121dd35,45c,0,...) at _cv_wait_sig+0x214/frame 0xedbfbbc0 svc_run_internal(edbfbcd4,c0b2938e,c8e35100,edbfbce8,c11e53ac,...) at svc_run_internal+0xc71/frame 0xedbfbca4 svc_thread_start(c8e35100,edbfbce8,c11e53ac,3dc,0,...) at svc_thread_start+0xd/frame 0xedbfbcac fork_exit(c0d94c60,c8e35100,edbfbce8) at fork_exit+0x7e/frame 0xedbfbcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedbfbcd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 615 tid 100108 td 0xca3c8000 sched_switch(ca3c8000,0,104,1ba,edbfeae0,...) at sched_switch+0x4e2/frame 0xedbfeaa8 mi_switch(104,0,c11f2745,200,c158c25c,...) at mi_switch+0x1bf/frame 0xedbfeae0 sleepq_switch(ca3c8000,0,c11f2745,1b6,edbfeb58,...) at sleepq_switch+0x1c5/frame 0xedbfeb14 sleepq_catch_signals(edbfeb74,c0b473c9,c8e35110,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xedbfeb50 sleepq_wait_sig(ca47f090,0,edbfebac,101,0,...) at sleepq_wait_sig+0x14/frame 0xedbfeb74 _cv_wait_sig(ca47f090,c8e35100,c121dd35,45c,0,...) at _cv_wait_sig+0x214/frame 0xedbfebc0 svc_run_internal(edbfecd4,c0b2938e,c8e35100,edbfece8,c11e53ac,...) at svc_run_internal+0xc71/frame 0xedbfeca4 svc_thread_start(c8e35100,edbfece8,c11e53ac,3dc,0,...) at svc_thread_start+0xd/frame 0xedbfecac fork_exit(c0d94c60,c8e35100,edbfece8) at fork_exit+0x7e/frame 0xedbfecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedbfecd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 615 tid 100109 td 0xca3c7c40 sched_switch(ca3c7c40,0,104,1ba,f887cae0,...) at sched_switch+0x4e2/frame 0xf887caa8 mi_switch(104,0,c11f2745,200,c158c25c,...) at mi_switch+0x1bf/frame 0xf887cae0 sleepq_switch(ca3c7c40,0,c11f2745,1b6,f887cb58,...) at sleepq_switch+0x1c5/frame 0xf887cb14 sleepq_catch_signals(f887cb74,c0b473c9,c8e35110,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf887cb50 sleepq_wait_sig(ca47ee90,0,f887cbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf887cb74 _cv_wait_sig(ca47ee90,c8e35100,c121dd35,45c,0,...) at _cv_wait_sig+0x214/frame 0xf887cbc0 svc_run_internal(f887ccd4,c0b2938e,c8e35100,f887cce8,c11e53ac,...) at svc_run_internal+0xc71/frame 0xf887cca4 svc_thread_start(c8e35100,f887cce8,c11e53ac,3dc,0,...) at svc_thread_start+0xd/frame 0xf887ccac fork_exit(c0d94c60,c8e35100,f887cce8) at fork_exit+0x7e/frame 0xf887ccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf887ccd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 615 tid 100110 td 0xca3c7930 sched_switch(ca3c7930,0,104,1ba,f887fae0,...) at sched_switch+0x4e2/frame 0xf887faa8 mi_switch(104,0,c11f2745,200,c158c25c,...) at mi_switch+0x1bf/frame 0xf887fae0 sleepq_switch(ca3c7930,0,c11f2745,1b6,f887fb58,...) at sleepq_switch+0x1c5/frame 0xf887fb14 sleepq_catch_signals(f887fb74,c0b473c9,c8e35110,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf887fb50 sleepq_wait_sig(ca47ed90,0,f887fbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf887fb74 _cv_wait_sig(ca47ed90,c8e35100,c121dd35,45c,0,...) at _cv_wait_sig+0x214/frame 0xf887fbc0 svc_run_internal(f887fcd4,c0b2938e,c8e35100,f887fce8,c11e53ac,...) at svc_run_internal+0xc71/frame 0xf887fca4 svc_thread_start(c8e35100,f887fce8,c11e53ac,3dc,0,...) at svc_thread_start+0xd/frame 0xf887fcac fork_exit(c0d94c60,c8e35100,f887fce8) at fork_exit+0x7e/frame 0xf887fcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf887fcd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 615 tid 100111 td 0xca3c7620 sched_switch(ca3c7620,0,104,1ba,f8882ae0,...) at sched_switch+0x4e2/frame 0xf8882aa8 mi_switch(104,0,c11f2745,200,c158c25c,...) at mi_switch+0x1bf/frame 0xf8882ae0 sleepq_switch(ca3c7620,0,c11f2745,1b6,f8882b58,...) at sleepq_switch+0x1c5/frame 0xf8882b14 sleepq_catch_signals(f8882b74,c0b473c9,c8e35110,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf8882b50 sleepq_wait_sig(ca47ec90,0,f8882bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8882b74 _cv_wait_sig(ca47ec90,c8e35100,c121dd35,45c,0,...) at _cv_wait_sig+0x214/frame 0xf8882bc0 svc_run_internal(f8882cd4,c0b2938e,c8e35100,f8882ce8,c11e53ac,...) at svc_run_internal+0xc71/frame 0xf8882ca4 svc_thread_start(c8e35100,f8882ce8,c11e53ac,3dc,0,...) at svc_thread_start+0xd/frame 0xf8882cac fork_exit(c0d94c60,c8e35100,f8882ce8) at fork_exit+0x7e/frame 0xf8882cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf8882cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 615 tid 100112 td 0xca3c7310 sched_switch(ca3c7310,0,104,1ba,f8885ae0,...) at sched_switch+0x4e2/frame 0xf8885aa8 mi_switch(104,0,c11f2745,200,c158c25c,...) at mi_switch+0x1bf/frame 0xf8885ae0 sleepq_switch(ca3c7310,0,c11f2745,1b6,f8885b58,...) at sleepq_switch+0x1c5/frame 0xf8885b14 sleepq_catch_signals(f8885b74,c0b473c9,c8e35110,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf8885b50 sleepq_wait_sig(ca47ea90,0,f8885bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8885b74 _cv_wait_sig(ca47ea90,c8e35100,c121dd35,45c,0,...) at _cv_wait_sig+0x214/frame 0xf8885bc0 svc_run_internal(f8885cd4,c0b2938e,c8e35100,f8885ce8,c11e53ac,...) at svc_run_internal+0xc71/frame 0xf8885ca4 svc_thread_start(c8e35100,f8885ce8,c11e53ac,3dc,0,...) at svc_thread_start+0xd/frame 0xf8885cac fork_exit(c0d94c60,c8e35100,f8885ce8) at fork_exit+0x7e/frame 0xf8885cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf8885cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 615 tid 100113 td 0xca3c7000 sched_switch(ca3c7000,0,104,1ba,f8888ae0,...) at sched_switch+0x4e2/frame 0xf8888aa8 mi_switch(104,0,c11f2745,200,c158c25c,...) at mi_switch+0x1bf/frame 0xf8888ae0 sleepq_switch(ca3c7000,0,c11f2745,1b6,f8888b58,...) at sleepq_switch+0x1c5/frame 0xf8888b14 sleepq_catch_signals(f8888b74,c0b473c9,c8e35110,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf8888b50 sleepq_wait_sig(ca47e990,0,f8888bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8888b74 _cv_wait_sig(ca47e990,c8e35100,c121dd35,45c,0,...) at _cv_wait_sig+0x214/frame 0xf8888bc0 svc_run_internal(f8888cd4,c0b2938e,c8e35100,f8888ce8,c11e53ac,...) at svc_run_internal+0xc71/frame 0xf8888ca4 svc_thread_start(c8e35100,f8888ce8,c11e53ac,3dc,0,...) at svc_thread_start+0xd/frame 0xf8888cac fork_exit(c0d94c60,c8e35100,f8888ce8) at fork_exit+0x7e/frame 0xf8888cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf8888cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 615 tid 100114 td 0xc944bc40 sched_switch(c944bc40,0,104,1ba,f888bae0,...) at sched_switch+0x4e2/frame 0xf888baa8 mi_switch(104,0,c11f2745,200,c158c25c,...) at mi_switch+0x1bf/frame 0xf888bae0 sleepq_switch(c944bc40,0,c11f2745,1b6,f888bb58,...) at sleepq_switch+0x1c5/frame 0xf888bb14 sleepq_catch_signals(f888bb74,c0b473c9,c8e35110,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf888bb50 sleepq_wait_sig(ca47e890,0,f888bbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf888bb74 _cv_wait_sig(ca47e890,c8e35100,c121dd35,45c,0,...) at _cv_wait_sig+0x214/frame 0xf888bbc0 svc_run_internal(f888bcd4,c0b2938e,c8e35100,f888bce8,c11e53ac,...) at svc_run_internal+0xc71/frame 0xf888bca4 svc_thread_start(c8e35100,f888bce8,c11e53ac,3dc,0,...) at svc_thread_start+0xd/frame 0xf888bcac fork_exit(c0d94c60,c8e35100,f888bce8) at fork_exit+0x7e/frame 0xf888bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf888bcd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 615 tid 100115 td 0xc944b930 sched_switch(c944b930,0,104,1ba,f888eae0,...) at sched_switch+0x4e2/frame 0xf888eaa8 mi_switch(104,0,c11f2745,200,c158c25c,...) at mi_switch+0x1bf/frame 0xf888eae0 sleepq_switch(c944b930,0,c11f2745,1b6,f888eb58,...) at sleepq_switch+0x1c5/frame 0xf888eb14 sleepq_catch_signals(f888eb74,c0b473c9,c8e35110,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf888eb50 sleepq_wait_sig(ca47e790,0,f888ebac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf888eb74 _cv_wait_sig(ca47e790,c8e35100,c121dd35,45c,0,...) at _cv_wait_sig+0x214/frame 0xf888ebc0 svc_run_internal(f888ecd4,c0b2938e,c8e35100,f888ece8,c11e53ac,...) at svc_run_internal+0xc71/frame 0xf888eca4 svc_thread_start(c8e35100,f888ece8,c11e53ac,3dc,0,...) at svc_thread_start+0xd/frame 0xf888ecac fork_exit(c0d94c60,c8e35100,f888ece8) at fork_exit+0x7e/frame 0xf888ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf888ecd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 615 tid 100116 td 0xc944b620 sched_switch(c944b620,0,104,1ba,f8891ae0,...) at sched_switch+0x4e2/frame 0xf8891aa8 mi_switch(104,0,c11f2745,200,c158c25c,...) at mi_switch+0x1bf/frame 0xf8891ae0 sleepq_switch(c944b620,0,c11f2745,1b6,f8891b58,...) at sleepq_switch+0x1c5/frame 0xf8891b14 sleepq_catch_signals(f8891b74,c0b473c9,c8e35110,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf8891b50 sleepq_wait_sig(ca47e690,0,f8891bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8891b74 _cv_wait_sig(ca47e690,c8e35100,c121dd35,45c,0,...) at _cv_wait_sig+0x214/frame 0xf8891bc0 svc_run_internal(f8891cd4,c0b2938e,c8e35100,f8891ce8,c11e53ac,...) at svc_run_internal+0xc71/frame 0xf8891ca4 svc_thread_start(c8e35100,f8891ce8,c11e53ac,3dc,0,...) at svc_thread_start+0xd/frame 0xf8891cac fork_exit(c0d94c60,c8e35100,f8891ce8) at fork_exit+0x7e/frame 0xf8891cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf8891cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 615 tid 100117 td 0xca485620 sched_switch(ca485620,0,104,1ba,f8894ae0,...) at sched_switch+0x4e2/frame 0xf8894aa8 mi_switch(104,0,c11f2745,200,c158c25c,...) at mi_switch+0x1bf/frame 0xf8894ae0 sleepq_switch(ca485620,0,c11f2745,1b6,f8894b58,...) at sleepq_switch+0x1c5/frame 0xf8894b14 sleepq_catch_signals(f8894b74,c0b473c9,c8e35110,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf8894b50 sleepq_wait_sig(ca47e590,0,f8894bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8894b74 _cv_wait_sig(ca47e590,c8e35100,c121dd35,45c,0,...) at _cv_wait_sig+0x214/frame 0xf8894bc0 svc_run_internal(f8894cd4,c0b2938e,c8e35100,f8894ce8,c11e53ac,...) at svc_run_internal+0xc71/frame 0xf8894ca4 svc_thread_start(c8e35100,f8894ce8,c11e53ac,3dc,0,...) at svc_thread_start+0xd/frame 0xf8894cac fork_exit(c0d94c60,c8e35100,f8894ce8) at fork_exit+0x7e/frame 0xf8894cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf8894cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 615 tid 100118 td 0xca485310 sched_switch(ca485310,0,104,1ba,f8897ae0,...) at sched_switch+0x4e2/frame 0xf8897aa8 mi_switch(104,0,c11f2745,200,c158c25c,...) at mi_switch+0x1bf/frame 0xf8897ae0 sleepq_switch(ca485310,0,c11f2745,1b6,f8897b58,...) at sleepq_switch+0x1c5/frame 0xf8897b14 sleepq_catch_signals(f8897b74,c0b473c9,c8e35110,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf8897b50 sleepq_wait_sig(ca47e490,0,f8897bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8897b74 _cv_wait_sig(ca47e490,c8e35100,c121dd35,45c,0,...) at _cv_wait_sig+0x214/frame 0xf8897bc0 svc_run_internal(f8897cd4,c0b2938e,c8e35100,f8897ce8,c11e53ac,...) at svc_run_internal+0xc71/frame 0xf8897ca4 svc_thread_start(c8e35100,f8897ce8,c11e53ac,3dc,0,...) at svc_thread_start+0xd/frame 0xf8897cac fork_exit(c0d94c60,c8e35100,f8897ce8) at fork_exit+0x7e/frame 0xf8897cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf8897cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 615 tid 100119 td 0xca485000 sched_switch(ca485000,0,104,1ba,f889aae0,...) at sched_switch+0x4e2/frame 0xf889aaa8 mi_switch(104,0,c11f2745,200,c158c25c,...) at mi_switch+0x1bf/frame 0xf889aae0 sleepq_switch(ca485000,0,c11f2745,1b6,f889ab58,...) at sleepq_switch+0x1c5/frame 0xf889ab14 sleepq_catch_signals(f889ab74,c0b473c9,c8e35110,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf889ab50 sleepq_wait_sig(ca47e390,0,f889abac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf889ab74 _cv_wait_sig(ca47e390,c8e35100,c121dd35,45c,0,...) at _cv_wait_sig+0x214/frame 0xf889abc0 svc_run_internal(f889acd4,c0b2938e,c8e35100,f889ace8,c11e53ac,...) at svc_run_internal+0xc71/frame 0xf889aca4 svc_thread_start(c8e35100,f889ace8,c11e53ac,3dc,0,...) at svc_thread_start+0xd/frame 0xf889acac fork_exit(c0d94c60,c8e35100,f889ace8) at fork_exit+0x7e/frame 0xf889acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf889acd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 615 tid 100120 td 0xca484c40 sched_switch(ca484c40,0,104,1ba,f889dae0,...) at sched_switch+0x4e2/frame 0xf889daa8 mi_switch(104,0,c11f2745,200,c158c25c,...) at mi_switch+0x1bf/frame 0xf889dae0 sleepq_switch(ca484c40,0,c11f2745,1b6,f889db58,...) at sleepq_switch+0x1c5/frame 0xf889db14 sleepq_catch_signals(f889db74,c0b473c9,c8e35110,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf889db50 sleepq_wait_sig(ca47e290,0,f889dbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf889db74 _cv_wait_sig(ca47e290,c8e35100,c121dd35,45c,0,...) at _cv_wait_sig+0x214/frame 0xf889dbc0 svc_run_internal(f889dcd4,c0b2938e,c8e35100,f889dce8,c11e53ac,...) at svc_run_internal+0xc71/frame 0xf889dca4 svc_thread_start(c8e35100,f889dce8,c11e53ac,3dc,0,...) at svc_thread_start+0xd/frame 0xf889dcac fork_exit(c0d94c60,c8e35100,f889dce8) at fork_exit+0x7e/frame 0xf889dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf889dcd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 615 tid 100121 td 0xca484930 sched_switch(ca484930,0,104,1ba,f88a0ae0,...) at sched_switch+0x4e2/frame 0xf88a0aa8 mi_switch(104,0,c11f2745,200,c158c25c,...) at mi_switch+0x1bf/frame 0xf88a0ae0 sleepq_switch(ca484930,0,c11f2745,1b6,f88a0b58,...) at sleepq_switch+0x1c5/frame 0xf88a0b14 sleepq_catch_signals(f88a0b74,c0b473c9,c8e35110,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf88a0b50 sleepq_wait_sig(ca47e190,0,f88a0bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88a0b74 _cv_wait_sig(ca47e190,c8e35100,c121dd35,45c,0,...) at _cv_wait_sig+0x214/frame 0xf88a0bc0 svc_run_internal(f88a0cd4,c0b2938e,c8e35100,f88a0ce8,c11e53ac,...) at svc_run_internal+0xc71/frame 0xf88a0ca4 svc_thread_start(c8e35100,f88a0ce8,c11e53ac,3dc,0,...) at svc_thread_start+0xd/frame 0xf88a0cac fork_exit(c0d94c60,c8e35100,f88a0ce8) at fork_exit+0x7e/frame 0xf88a0cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88a0cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 615 tid 100122 td 0xca484620 sched_switch(ca484620,0,104,1ba,f88a3ae0,...) at sched_switch+0x4e2/frame 0xf88a3aa8 mi_switch(104,0,c11f2745,200,c158c25c,...) at mi_switch+0x1bf/frame 0xf88a3ae0 sleepq_switch(ca484620,0,c11f2745,1b6,f88a3b58,...) at sleepq_switch+0x1c5/frame 0xf88a3b14 sleepq_catch_signals(f88a3b74,c0b473c9,c8e35110,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf88a3b50 sleepq_wait_sig(ca47e090,0,f88a3bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88a3b74 _cv_wait_sig(ca47e090,c8e35100,c121dd35,45c,0,...) at _cv_wait_sig+0x214/frame 0xf88a3bc0 svc_run_internal(f88a3cd4,c0b2938e,c8e35100,f88a3ce8,c11e53ac,...) at svc_run_internal+0xc71/frame 0xf88a3ca4 svc_thread_start(c8e35100,f88a3ce8,c11e53ac,3dc,0,...) at svc_thread_start+0xd/frame 0xf88a3cac fork_exit(c0d94c60,c8e35100,f88a3ce8) at fork_exit+0x7e/frame 0xf88a3cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88a3cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 615 tid 100123 td 0xca484310 sched_switch(ca484310,0,104,1ba,f88a6ae0,...) at sched_switch+0x4e2/frame 0xf88a6aa8 mi_switch(104,0,c11f2745,200,c158c25c,...) at mi_switch+0x1bf/frame 0xf88a6ae0 sleepq_switch(ca484310,0,c11f2745,1b6,f88a6b58,...) at sleepq_switch+0x1c5/frame 0xf88a6b14 sleepq_catch_signals(f88a6b74,c0b473c9,c8e35110,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf88a6b50 sleepq_wait_sig(ca47de90,0,f88a6bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88a6b74 _cv_wait_sig(ca47de90,c8e35100,c121dd35,45c,0,...) at _cv_wait_sig+0x214/frame 0xf88a6bc0 svc_run_internal(f88a6cd4,c0b2938e,c8e35100,f88a6ce8,c11e53ac,...) at svc_run_internal+0xc71/frame 0xf88a6ca4 svc_thread_start(c8e35100,f88a6ce8,c11e53ac,3dc,0,...) at svc_thread_start+0xd/frame 0xf88a6cac fork_exit(c0d94c60,c8e35100,f88a6ce8) at fork_exit+0x7e/frame 0xf88a6cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88a6cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 615 tid 100124 td 0xca484000 sched_switch(ca484000,0,104,1ba,f88a9ae0,...) at sched_switch+0x4e2/frame 0xf88a9aa8 mi_switch(104,0,c11f2745,200,c158c25c,...) at mi_switch+0x1bf/frame 0xf88a9ae0 sleepq_switch(ca484000,0,c11f2745,1b6,f88a9b58,...) at sleepq_switch+0x1c5/frame 0xf88a9b14 sleepq_catch_signals(f88a9b74,c0b473c9,c8e35110,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf88a9b50 sleepq_wait_sig(ca47dd90,0,f88a9bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88a9b74 _cv_wait_sig(ca47dd90,c8e35100,c121dd35,45c,0,...) at _cv_wait_sig+0x214/frame 0xf88a9bc0 svc_run_internal(f88a9cd4,c0b2938e,c8e35100,f88a9ce8,c11e53ac,...) at svc_run_internal+0xc71/frame 0xf88a9ca4 svc_thread_start(c8e35100,f88a9ce8,c11e53ac,3dc,0,...) at svc_thread_start+0xd/frame 0xf88a9cac fork_exit(c0d94c60,c8e35100,f88a9ce8) at fork_exit+0x7e/frame 0xf88a9cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88a9cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 615 tid 100125 td 0xca483c40 sched_switch(ca483c40,0,104,1ba,f88acae0,...) at sched_switch+0x4e2/frame 0xf88acaa8 mi_switch(104,0,c11f2745,200,c158c25c,...) at mi_switch+0x1bf/frame 0xf88acae0 sleepq_switch(ca483c40,0,c11f2745,1b6,f88acb58,...) at sleepq_switch+0x1c5/frame 0xf88acb14 sleepq_catch_signals(f88acb74,c0b473c9,c8e35110,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf88acb50 sleepq_wait_sig(ca47dc90,0,f88acbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88acb74 _cv_wait_sig(ca47dc90,c8e35100,c121dd35,45c,0,...) at _cv_wait_sig+0x214/frame 0xf88acbc0 svc_run_internal(f88accd4,c0b2938e,c8e35100,f88acce8,c11e53ac,...) at svc_run_internal+0xc71/frame 0xf88acca4 svc_thread_start(c8e35100,f88acce8,c11e53ac,3dc,0,...) at svc_thread_start+0xd/frame 0xf88accac fork_exit(c0d94c60,c8e35100,f88acce8) at fork_exit+0x7e/frame 0xf88accd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88accd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 615 tid 100126 td 0xca483930 sched_switch(ca483930,0,104,1ba,f88afae0,...) at sched_switch+0x4e2/frame 0xf88afaa8 mi_switch(104,0,c11f2745,200,c158c25c,...) at mi_switch+0x1bf/frame 0xf88afae0 sleepq_switch(ca483930,0,c11f2745,1b6,f88afb58,...) at sleepq_switch+0x1c5/frame 0xf88afb14 sleepq_catch_signals(f88afb74,c0b473c9,c8e35110,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf88afb50 sleepq_wait_sig(ca47db90,0,f88afbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88afb74 _cv_wait_sig(ca47db90,c8e35100,c121dd35,45c,0,...) at _cv_wait_sig+0x214/frame 0xf88afbc0 svc_run_internal(f88afcd4,c0b2938e,c8e35100,f88afce8,c11e53ac,...) at svc_run_internal+0xc71/frame 0xf88afca4 svc_thread_start(c8e35100,f88afce8,c11e53ac,3dc,0,...) at svc_thread_start+0xd/frame 0xf88afcac fork_exit(c0d94c60,c8e35100,f88afce8) at fork_exit+0x7e/frame 0xf88afcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88afcd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 615 tid 100127 td 0xca483620 sched_switch(ca483620,0,104,1ba,f88b2ae0,...) at sched_switch+0x4e2/frame 0xf88b2aa8 mi_switch(104,0,c11f2745,200,c158c25c,...) at mi_switch+0x1bf/frame 0xf88b2ae0 sleepq_switch(ca483620,0,c11f2745,1b6,f88b2b58,...) at sleepq_switch+0x1c5/frame 0xf88b2b14 sleepq_catch_signals(f88b2b74,c0b473c9,c8e35110,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf88b2b50 sleepq_wait_sig(ca47da90,0,f88b2bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88b2b74 _cv_wait_sig(ca47da90,c8e35100,c121dd35,45c,0,...) at _cv_wait_sig+0x214/frame 0xf88b2bc0 svc_run_internal(f88b2cd4,c0b2938e,c8e35100,f88b2ce8,c11e53ac,...) at svc_run_internal+0xc71/frame 0xf88b2ca4 svc_thread_start(c8e35100,f88b2ce8,c11e53ac,3dc,0,...) at svc_thread_start+0xd/frame 0xf88b2cac fork_exit(c0d94c60,c8e35100,f88b2ce8) at fork_exit+0x7e/frame 0xf88b2cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88b2cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 615 tid 100128 td 0xca483310 sched_switch(ca483310,0,104,1ba,f88b5ae0,...) at sched_switch+0x4e2/frame 0xf88b5aa8 mi_switch(104,0,c11f2745,200,c158c25c,...) at mi_switch+0x1bf/frame 0xf88b5ae0 sleepq_switch(ca483310,0,c11f2745,1b6,f88b5b58,...) at sleepq_switch+0x1c5/frame 0xf88b5b14 sleepq_catch_signals(f88b5b74,c0b473c9,c8e35110,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf88b5b50 sleepq_wait_sig(ca47d990,0,f88b5bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88b5b74 _cv_wait_sig(ca47d990,c8e35100,c121dd35,45c,0,...) at _cv_wait_sig+0x214/frame 0xf88b5bc0 svc_run_internal(f88b5cd4,c0b2938e,c8e35100,f88b5ce8,c11e53ac,...) at svc_run_internal+0xc71/frame 0xf88b5ca4 svc_thread_start(c8e35100,f88b5ce8,c11e53ac,3dc,0,...) at svc_thread_start+0xd/frame 0xf88b5cac fork_exit(c0d94c60,c8e35100,f88b5ce8) at fork_exit+0x7e/frame 0xf88b5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88b5cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 615 tid 100129 td 0xca483000 sched_switch(ca483000,0,104,1ba,f88b8ae0,...) at sched_switch+0x4e2/frame 0xf88b8aa8 mi_switch(104,0,c11f2745,200,c158c25c,...) at mi_switch+0x1bf/frame 0xf88b8ae0 sleepq_switch(ca483000,0,c11f2745,1b6,f88b8b58,...) at sleepq_switch+0x1c5/frame 0xf88b8b14 sleepq_catch_signals(f88b8b74,c0b473c9,c8e35110,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf88b8b50 sleepq_wait_sig(ca47d890,0,f88b8bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88b8b74 _cv_wait_sig(ca47d890,c8e35100,c121dd35,45c,0,...) at _cv_wait_sig+0x214/frame 0xf88b8bc0 svc_run_internal(f88b8cd4,c0b2938e,c8e35100,f88b8ce8,c11e53ac,...) at svc_run_internal+0xc71/frame 0xf88b8ca4 svc_thread_start(c8e35100,f88b8ce8,c11e53ac,3dc,0,...) at svc_thread_start+0xd/frame 0xf88b8cac fork_exit(c0d94c60,c8e35100,f88b8ce8) at fork_exit+0x7e/frame 0xf88b8cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88b8cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 615 tid 100130 td 0xca488000 sched_switch(ca488000,0,104,1ba,f88bbae0,...) at sched_switch+0x4e2/frame 0xf88bbaa8 mi_switch(104,0,c11f2745,200,c158c25c,...) at mi_switch+0x1bf/frame 0xf88bbae0 sleepq_switch(ca488000,0,c11f2745,1b6,f88bbb58,...) at sleepq_switch+0x1c5/frame 0xf88bbb14 sleepq_catch_signals(f88bbb74,c0b473c9,c8e35110,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf88bbb50 sleepq_wait_sig(ca47d790,0,f88bbbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88bbb74 _cv_wait_sig(ca47d790,c8e35100,c121dd35,45c,0,...) at _cv_wait_sig+0x214/frame 0xf88bbbc0 svc_run_internal(f88bbcd4,c0b2938e,c8e35100,f88bbce8,c11e53ac,...) at svc_run_internal+0xc71/frame 0xf88bbca4 svc_thread_start(c8e35100,f88bbce8,c11e53ac,3dc,0,...) at svc_thread_start+0xd/frame 0xf88bbcac fork_exit(c0d94c60,c8e35100,f88bbce8) at fork_exit+0x7e/frame 0xf88bbcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88bbcd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 615 tid 100131 td 0xca487c40 sched_switch(ca487c40,0,104,1ba,f88beae0,...) at sched_switch+0x4e2/frame 0xf88beaa8 mi_switch(104,0,c11f2745,200,c158c25c,...) at mi_switch+0x1bf/frame 0xf88beae0 sleepq_switch(ca487c40,0,c11f2745,1b6,f88beb58,...) at sleepq_switch+0x1c5/frame 0xf88beb14 sleepq_catch_signals(f88beb74,c0b473c9,c8e35110,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf88beb50 sleepq_wait_sig(ca47d690,0,f88bebac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88beb74 _cv_wait_sig(ca47d690,c8e35100,c121dd35,45c,0,...) at _cv_wait_sig+0x214/frame 0xf88bebc0 svc_run_internal(f88becd4,c0b2938e,c8e35100,f88bece8,c11e53ac,...) at svc_run_internal+0xc71/frame 0xf88beca4 svc_thread_start(c8e35100,f88bece8,c11e53ac,3dc,0,...) at svc_thread_start+0xd/frame 0xf88becac fork_exit(c0d94c60,c8e35100,f88bece8) at fork_exit+0x7e/frame 0xf88becd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88becd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 615 tid 100132 td 0xca487930 sched_switch(ca487930,0,104,1ba,f88c1ae0,...) at sched_switch+0x4e2/frame 0xf88c1aa8 mi_switch(104,0,c11f2745,200,0,...) at mi_switch+0x1bf/frame 0xf88c1ae0 sleepq_switch(ca487930,0,c11f2745,1b6,f88c1b58,...) at sleepq_switch+0x1c5/frame 0xf88c1b14 sleepq_catch_signals(f88c1b74,c0b473c9,c8e35110,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf88c1b50 sleepq_wait_sig(ca47d590,0,f88c1bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88c1b74 _cv_wait_sig(ca47d590,c8e35100,c121dd35,4f9,0,...) at _cv_wait_sig+0x214/frame 0xf88c1bc0 svc_run_internal(f88c1cd4,c0b2938e,c8e35100,f88c1ce8,c11e53ac,...) at svc_run_internal+0xc71/frame 0xf88c1ca4 svc_thread_start(c8e35100,f88c1ce8,c11e53ac,3dc,0,...) at svc_thread_start+0xd/frame 0xf88c1cac fork_exit(c0d94c60,c8e35100,f88c1ce8) at fork_exit+0x7e/frame 0xf88c1cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88c1cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 615 tid 100133 td 0xca487620 sched_switch(ca487620,0,104,1ba,f88c4ae0,...) at sched_switch+0x4e2/frame 0xf88c4aa8 mi_switch(104,0,c11f2745,200,c1643268,...) at mi_switch+0x1bf/frame 0xf88c4ae0 sleepq_switch(ca487620,0,c11f2745,1b6,f88c4b58,...) at sleepq_switch+0x1c5/frame 0xf88c4b14 sleepq_catch_signals(f88c4b74,c0b473c9,c8e35110,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf88c4b50 sleepq_wait_sig(ca47d490,0,f88c4bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88c4b74 _cv_wait_sig(ca47d490,c8e35100,c121dd35,4f9,0,...) at _cv_wait_sig+0x214/frame 0xf88c4bc0 svc_run_internal(f88c4cd4,c0b2938e,c8e35100,f88c4ce8,c11e53ac,...) at svc_run_internal+0xc71/frame 0xf88c4ca4 svc_thread_start(c8e35100,f88c4ce8,c11e53ac,3dc,0,...) at svc_thread_start+0xd/frame 0xf88c4cac fork_exit(c0d94c60,c8e35100,f88c4ce8) at fork_exit+0x7e/frame 0xf88c4cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88c4cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 615 tid 100134 td 0xca487310 sched_switch(ca487310,0,104,1ba,f88c7ae0,...) at sched_switch+0x4e2/frame 0xf88c7aa8 mi_switch(104,0,c11f2745,200,82e29,...) at mi_switch+0x1bf/frame 0xf88c7ae0 sleepq_switch(ca487310,0,c11f2745,1b6,f88c7b58,...) at sleepq_switch+0x1c5/frame 0xf88c7b14 sleepq_catch_signals(f88c7b74,c0b473c9,c8e35110,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf88c7b50 sleepq_wait_sig(ca47d390,0,f88c7bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88c7b74 _cv_wait_sig(ca47d390,c8e35100,c121dd35,4f9,0,...) at _cv_wait_sig+0x214/frame 0xf88c7bc0 svc_run_internal(f88c7cd4,c0b2938e,c8e35100,f88c7ce8,c11e53ac,...) at svc_run_internal+0xc71/frame 0xf88c7ca4 svc_thread_start(c8e35100,f88c7ce8,c11e53ac,3dc,0,...) at svc_thread_start+0xd/frame 0xf88c7cac fork_exit(c0d94c60,c8e35100,f88c7ce8) at fork_exit+0x7e/frame 0xf88c7cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88c7cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 615 tid 100135 td 0xca487000 sched_switch(ca487000,0,104,1ba,f88caae0,...) at sched_switch+0x4e2/frame 0xf88caaa8 mi_switch(104,0,c11f2745,200,0,...) at mi_switch+0x1bf/frame 0xf88caae0 sleepq_switch(ca487000,0,c11f2745,1b6,f88cab58,...) at sleepq_switch+0x1c5/frame 0xf88cab14 sleepq_catch_signals(f88cab74,c0b473c9,c8e35110,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xf88cab50 sleepq_wait_sig(ca47d290,0,f88cabac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88cab74 _cv_wait_sig(ca47d290,c8e35100,c121dd35,4f9,0,...) at _cv_wait_sig+0x214/frame 0xf88cabc0 svc_run_internal(f88cacd4,c0b2938e,c8e35100,f88cace8,c11e53ac,...) at svc_run_internal+0xc71/frame 0xf88caca4 svc_thread_start(c8e35100,f88cace8,c11e53ac,3dc,0,...) at svc_thread_start+0xd/frame 0xf88cacac fork_exit(c0d94c60,c8e35100,f88cace8) at fork_exit+0x7e/frame 0xf88cacd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88cacd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 610 tid 100099 td 0xca3c8c40 sched_switch(ca3c8c40,0,104,1ba,edbc9918,...) at sched_switch+0x4e2/frame 0xedbc98e0 mi_switch(104,0,c11f2745,200,edbc9984,...) at mi_switch+0x1bf/frame 0xedbc9918 sleepq_switch(ca3c8c40,0,c11f2745,1b6,edbc9990,...) at sleepq_switch+0x1c5/frame 0xedbc994c sleepq_catch_signals(edbc99ac,c0b473c9,c9abf8a0,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xedbc9988 sleepq_wait_sig(c9abf8a4,0,edbc99e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xedbc99ac _cv_wait_sig(c9abf8a4,c9abf890,c11f5c27,72e,c9b1b000,...) at _cv_wait_sig+0x214/frame 0xedbc99f8 seltdwait(ffffffff,0,0,ca3c8c40,0,...) at seltdwait+0xbb/frame 0xedbc9a28 kern_select(ca3c8c40,7,bfbfec30,0,0,...) at kern_select+0x914/frame 0xedbc9bd0 sys_select(ca3c8c40,edbc9ca8,c11e4fcd,4,c1073da7,...) at sys_select+0x66/frame 0xedbc9c18 syscall(edbc9ce8) at syscall+0x34a/frame 0xedbc9cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbc9cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a4eff, esp = 0xbfbfea5c, ebp = 0xbfbfee34 --- Tracing command mountd pid 604 tid 100091 td 0xc9363310 sched_switch(c9363310,0,104,1ba,edb70918,...) at sched_switch+0x4e2/frame 0xedb708e0 mi_switch(104,0,c11f2745,200,edb70984,...) at mi_switch+0x1bf/frame 0xedb70918 sleepq_switch(c9363310,0,c11f2745,1b6,edb70990,...) at sleepq_switch+0x1c5/frame 0xedb7094c sleepq_catch_signals(edb709ac,c0b473c9,c9abf9e0,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xedb70988 sleepq_wait_sig(c9abf9e4,0,edb709e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xedb709ac _cv_wait_sig(c9abf9e4,c9abf9d0,c11f5c27,72e,c9b11ab0,...) at _cv_wait_sig+0x214/frame 0xedb709f8 seltdwait(ffffffff,0,0,c9363310,0,...) at seltdwait+0xbb/frame 0xedb70a28 kern_select(c9363310,9,bfbfed50,0,0,...) at kern_select+0x914/frame 0xedb70bd0 sys_select(c9363310,edb70ca8,c11e4fcd,4,c1073da7,...) at sys_select+0x66/frame 0xedb70c18 syscall(edb70ce8) at syscall+0x34a/frame 0xedb70cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedb70cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281bbeff, esp = 0xbfbfed0c, ebp = 0xbfbfee34 --- Tracing command nfsuserd pid 597 tid 100104 td 0xc935a310 sched_switch(c935a310,0,104,1ba,edbef910,...) at sched_switch+0x4e2/frame 0xedbef8d8 mi_switch(104,0,c11f2745,200,c1640310,...) at mi_switch+0x1bf/frame 0xedbef910 sleepq_switch(c935a310,0,c11f2745,1b6,c9abf8d0,...) at sleepq_switch+0x1c5/frame 0xedbef944 sleepq_catch_signals(c1461ad0,edbef9a8,c0b473c9,c9abf8e0,0,...) at sleepq_catch_signals+0x382/frame 0xedbef980 sleepq_timedwait_sig(c9abf8e4,0,edbef9e4,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xedbef9a8 _cv_timedwait_sig_sbt(c9abf8e4,c9abf8d0,267e31dd,449d,e0000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedbef9f8 seltdwait(449d,e0000000,1,c935a310,0,...) at seltdwait+0xad/frame 0xedbefa28 kern_select(c935a310,4,bfbfec10,0,0,...) at kern_select+0x914/frame 0xedbefbd0 sys_select(c935a310,edbefca8,c11e4fcd,4,c1073da7,...) at sys_select+0x66/frame 0xedbefc18 syscall(edbefce8) at syscall+0x34a/frame 0xedbefcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbefcdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a3eff, esp = 0xbfbfeb64, ebp = 0xbfbfeca8 --- Tracing command nfsuserd pid 596 tid 100103 td 0xc935a620 sched_switch(c935a620,0,104,1ba,edbeb910,...) at sched_switch+0x4e2/frame 0xedbeb8d8 mi_switch(104,0,c11f2745,200,c1640310,...) at mi_switch+0x1bf/frame 0xedbeb910 sleepq_switch(c935a620,0,c11f2745,1b6,c8c083d0,...) at sleepq_switch+0x1c5/frame 0xedbeb944 sleepq_catch_signals(c1461ad0,edbeb9a8,c0b473c9,c8c083e0,0,...) at sleepq_catch_signals+0x382/frame 0xedbeb980 sleepq_timedwait_sig(c8c083e4,0,edbeb9e4,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xedbeb9a8 _cv_timedwait_sig_sbt(c8c083e4,c8c083d0,9b3a2d41,449e,e0000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedbeb9f8 seltdwait(449e,e0000000,1,c935a620,0,...) at seltdwait+0xad/frame 0xedbeba28 kern_select(c935a620,4,bfbfec10,0,0,...) at kern_select+0x914/frame 0xedbebbd0 sys_select(c935a620,edbebca8,c11e4fcd,4,0,...) at sys_select+0x66/frame 0xedbebc18 syscall(edbebce8) at syscall+0x34a/frame 0xedbebcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbebcdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a3eff, esp = 0xbfbfeb64, ebp = 0xbfbfeca8 --- Tracing command nfsuserd pid 595 tid 100102 td 0xc935a930 sched_switch(c935a930,0,104,1ba,edbe7910,...) at sched_switch+0x4e2/frame 0xedbe78d8 mi_switch(104,0,c11f2745,200,c1640010,...) at mi_switch+0x1bf/frame 0xedbe7910 sleepq_switch(c935a930,0,c11f2745,1b6,c8c08410,...) at sleepq_switch+0x1c5/frame 0xedbe7944 sleepq_catch_signals(c1461ad0,edbe79a8,c0b473c9,c8c08420,0,...) at sleepq_catch_signals+0x382/frame 0xedbe7980 sleepq_timedwait_sig(c8c08424,0,edbe79e4,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xedbe79a8 _cv_timedwait_sig_sbt(c8c08424,c8c08410,f8386c57,449d,e0000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedbe79f8 seltdwait(449d,e0000000,1,c935a930,0,...) at seltdwait+0xad/frame 0xedbe7a28 kern_select(c935a930,4,bfbfec10,0,0,...) at kern_select+0x914/frame 0xedbe7bd0 sys_select(c935a930,edbe7ca8,c11e4fcd,4,c1073da7,...) at sys_select+0x66/frame 0xedbe7c18 syscall(edbe7ce8) at syscall+0x34a/frame 0xedbe7cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbe7cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a3eff, esp = 0xbfbfeb64, ebp = 0xbfbfeca8 --- Tracing command nfsuserd pid 594 tid 100101 td 0xc935ac40 sched_switch(c935ac40,0,104,1ba,edbe3910,...) at sched_switch+0x4e2/frame 0xedbe38d8 mi_switch(104,0,c11f2745,200,c1640310,...) at mi_switch+0x1bf/frame 0xedbe3910 sleepq_switch(c935ac40,0,c11f2745,1b6,c9abf910,...) at sleepq_switch+0x1c5/frame 0xedbe3944 sleepq_catch_signals(c1461ad0,edbe39a8,c0b473c9,c9abf920,0,...) at sleepq_catch_signals+0x382/frame 0xedbe3980 sleepq_timedwait_sig(c9abf924,0,edbe39e4,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xedbe39a8 _cv_timedwait_sig_sbt(c9abf924,c9abf910,ffd643c2,449c,e0000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedbe39f8 seltdwait(449c,e0000000,1,c935ac40,0,...) at seltdwait+0xad/frame 0xedbe3a28 kern_select(c935ac40,4,bfbfec10,0,0,...) at kern_select+0x914/frame 0xedbe3bd0 sys_select(c935ac40,edbe3ca8,c11e4fcd,4,c1073da7,...) at sys_select+0x66/frame 0xedbe3c18 syscall(edbe3ce8) at syscall+0x34a/frame 0xedbe3cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbe3cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a3eff, esp = 0xbfbfeb64, ebp = 0xbfbfeca8 --- Tracing command nfsuserd pid 593 tid 100098 td 0xc9441310 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c11f072c,c8a2d930,e4741424,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xe4741408 kdb_backtrace(c11f07a9,280,e47415bc,c106b620,8,...) at kdb_backtrace+0x2d/frame 0xe4741470 kdb_reenter(8,c11f3166,225,e47414a8,c8a2d930,...) at kdb_reenter+0x31/frame 0xe4741480 trap(e47415c8) at trap+0x50/frame 0xe47415bc calltrap() at calltrap+0x6/frame 0xe47415bc --- trap 0xc, eip = 0xc1055676, esp = 0xe4741608, ebp = 0xe4741618 --- db_trace_thread(c9441310,ffffffff,251,18702,c9441310,...) at db_trace_thread+0x16/frame 0xe4741618 db_stack_trace_all(c0b9d632,0,ffffffff,e47416b8,0,...) at db_stack_trace_all+0xa2/frame 0xe4741684 db_command(c14a5682,0,c1635bd8,c14a5681,a,...) at db_command+0x39f/frame 0xe4741740 db_script_exec(e47417f0,0,c8b44250,e47417dc,1,...) at db_script_exec+0x168/frame 0xe47417a8 db_command(c10ba61b,e47418c8,c0532ceb,c10ba713,c079bb27,...) at db_command+0x39f/frame 0xe4741864 db_command_loop(c10ba713,c079bb27,c15eaa24,1,c88d6e00,...) at db_command_loop+0x50/frame 0xe4741870 db_trap(3,0,28,46,1,...) at db_trap+0xdb/frame 0xe47418c8 kdb_trap(3,0,e4741a48,e4741a90,0,...) at kdb_trap+0x117/frame 0xe4741900 trap(e4741a48) at trap+0x87f/frame 0xe4741a3c calltrap() at calltrap+0x6/frame 0xe4741a3c --- trap 0x3, eip = 0xc0b9d632, esp = 0xe4741a88, ebp = 0xe4741a9c --- kdb_alt_break_internal(0,e4741ac8,c097fa37,2,c8c6f684,...) at kdb_alt_break_internal+0x162/frame 0xe4741a9c kdb_alt_break(2,c8c6f684,c11b4431,c8c6f600,40000,...) at kdb_alt_break+0x16/frame 0xe4741aa8 uart_intr_rxready(c8c6f600,c13afc53,df,448c,1,...) at uart_intr_rxready+0x87/frame 0xe4741ac8 uart_intr(c8c6f600,0,b,0,0,...) at uart_intr+0x100/frame 0xe4741b04 intr_event_handle(c8a26680,e4741b80,0,2,0,...) at intr_event_handle+0x7a/frame 0xe4741b30 intr_execute_handlers(c8a7a108,e4741b80,2) at intr_execute_handlers+0x42/frame 0xe4741b50 lapic_handle_intr(30,e4741b80) at lapic_handle_intr+0x5d/frame 0xe4741b70 Xapic_isr1() at Xapic_isr1+0x4a/frame 0xe4741b70 --- interrupt, eip = 0xc1051d75, esp = 0xe4741bc0, ebp = 0xe4741bc0 --- acpi_cpu_c1(e472ec90,0,c13afc53,2ec,448c,...) at acpi_cpu_c1+0x5/frame 0xe4741bc0 acpi_cpu_idle(caed182,0,caed182,e4741c30,c105a5bd,...) at acpi_cpu_idle+0x166/frame 0xe4741c00 cpu_idle_acpi(caed182,0,1,c1578c88,c1578c84,...) at cpu_idle_acpi+0x3f/frame 0xe4741c14 cpu_idle(0,e4741c80,c11ee7a6,a48,c1578c88,...) at cpu_idle+0x9d/frame 0xe4741c30 sched_idletd(0,e4741ce8,c11e53ac,3dc,0,...) at sched_idletd+0x3cb/frame 0xe4741cac fork_exit(c0b8b0b0,0,e4741ce8) at fork_exit+0x7e/frame 0xe4741cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4741cd4 --- trap 0, eip = 0, esp = 0xe4741d20, ebp = 0 --- Tracing command casperd pid 576 tid 100100 td 0xc9363000 sched_switch(c9363000,0,104,1ba,edbd8918,...) at sched_switch+0x4e2/frame 0xedbd88e0 mi_switch(104,0,c11f2745,200,edbd8984,...) at mi_switch+0x1bf/frame 0xedbd8918 sleepq_switch(c9363000,0,c11f2745,1b6,edbd8990,...) at sleepq_switch+0x1c5/frame 0xedbd894c sleepq_catch_signals(edbd89ac,c0b473c9,c9abf960,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xedbd8988 sleepq_wait_sig(c9abf964,0,edbd89e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xedbd89ac _cv_wait_sig(c9abf964,c9abf950,c11f5c27,72e,c9ad0000,...) at _cv_wait_sig+0x214/frame 0xedbd89f8 seltdwait(ffffffff,0,0,c9363000,0,...) at seltdwait+0xbb/frame 0xedbd8a28 kern_select(c9363000,7,bfbfe9c8,0,0,...) at kern_select+0x914/frame 0xedbd8bd0 sys_select(c9363000,edbd8ca8,c11e4fcd,4,0,...) at sys_select+0x66/frame 0xedbd8c18 syscall(edbd8ce8) at syscall+0x34a/frame 0xedbd8cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbd8cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281d1eff, esp = 0xbfbfe984, ebp = 0xbfbfee44 --- Tracing command casperd pid 575 tid 100076 td 0xc8edc930 sched_switch(c8edc930,0,104,1ba,edb10918,...) at sched_switch+0x4e2/frame 0xedb108e0 mi_switch(104,0,c11f2745,200,edb10984,...) at mi_switch+0x1bf/frame 0xedb10918 sleepq_switch(c8edc930,0,c11f2745,1b6,edb10990,...) at sleepq_switch+0x1c5/frame 0xedb1094c sleepq_catch_signals(edb109ac,c0b473c9,c92fd920,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xedb10988 sleepq_wait_sig(c92fd924,0,edb109e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xedb109ac _cv_wait_sig(c92fd924,c92fd910,c11f5c27,72e,c9adac78,...) at _cv_wait_sig+0x214/frame 0xedb109f8 seltdwait(ffffffff,0,0,c8edc930,0,...) at seltdwait+0xbb/frame 0xedb10a28 kern_select(c8edc930,6,bfbfe858,0,0,...) at kern_select+0x914/frame 0xedb10bd0 sys_select(c8edc930,edb10ca8,c11e4fcd,4,c1073da7,...) at sys_select+0x66/frame 0xedb10c18 syscall(edb10ce8) at syscall+0x34a/frame 0xedb10cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedb10cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281d1eff, esp = 0xbfbfe82c, ebp = 0xbfbfe8f0 --- Tracing command rpcbind pid 561 tid 100090 td 0xc9363620 sched_switch(c9363620,0,104,1ba,edb6d948,...) at sched_switch+0x4e2/frame 0xedb6d910 mi_switch(104,0,c11f2745,200,c1640010,...) at mi_switch+0x1bf/frame 0xedb6d948 sleepq_switch(c9363620,0,c11f2745,1b6,c9abf990,...) at sleepq_switch+0x1c5/frame 0xedb6d97c sleepq_catch_signals(c1461ad0,edb6d9e0,c0b473c9,c9abf9a0,0,...) at sleepq_catch_signals+0x382/frame 0xedb6d9b8 sleepq_timedwait_sig(c9abf9a4,0,edb6da1c,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xedb6d9e0 _cv_timedwait_sig_sbt(c9abf9a4,c9abf990,7827febe,4494,e0000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedb6da30 seltdwait(4494,e0000000,1,c9363620,0,...) at seltdwait+0xad/frame 0xedb6da60 kern_poll(c9363620,bfbfccc0,7,edb6dc00,0,...) at kern_poll+0x4f0/frame 0xedb6dbe0 sys_poll(c9363620,edb6dca8,c11e4fcd,4,8,...) at sys_poll+0x71/frame 0xedb6dc18 syscall(edb6dce8) at syscall+0x34a/frame 0xedb6dcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedb6dcdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x28150c53, esp = 0xbfbfcbfc, ebp = 0xbfbfedd8 --- Tracing command watchdogd pid 489 tid 100078 td 0xc942c930 sched_switch(c942c930,0,104,1ba,edb1ba84,...) at sched_switch+0x4e2/frame 0xedb1ba4c mi_switch(104,0,c11f2745,200,449a,...) at mi_switch+0x1bf/frame 0xedb1ba84 sleepq_switch(c942c930,0,c11f2745,1b6,8,...) at sleepq_switch+0x1c5/frame 0xedb1bab8 sleepq_catch_signals(c0baf1d0,c942c930,1,201,1,...) at sleepq_catch_signals+0x382/frame 0xedb1baf4 sleepq_timedwait_sig(c156bbe1,6c,449a,c0000000,3,...) at sleepq_timedwait_sig+0x14/frame 0xedb1bb1c _sleep(c156bbe1,0,16c,c11ed6da,84b2e977,...) at _sleep+0x326/frame 0xedb1bb78 kern_nanosleep(bfbfece0,edb1bbf0,edb1bbf8,edb1bce8,3c,...) at kern_nanosleep+0x14b/frame 0xedb1bbd8 sys_nanosleep(c942c930,edb1bca8,c11e4fcd,4,0,...) at sys_nanosleep+0x68/frame 0xedb1bc18 syscall(edb1bce8) at syscall+0x34a/frame 0xedb1bcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedb1bcdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2814984f, esp = 0xbfbfecd4, ebp = 0xbfbfed08 --- Tracing command syslogd pid 485 tid 100083 td 0xc942c000 sched_switch(c942c000,0,104,1ba,edb38918,...) at sched_switch+0x4e2/frame 0xedb388e0 mi_switch(104,0,c11f2745,200,edb38984,...) at mi_switch+0x1bf/frame 0xedb38918 sleepq_switch(c942c000,0,c11f2745,1b6,edb38990,...) at sleepq_switch+0x1c5/frame 0xedb3894c sleepq_catch_signals(edb389ac,c0b473c9,c9cbabe0,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xedb38988 sleepq_wait_sig(c9cbabe4,0,edb389e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xedb389ac _cv_wait_sig(c9cbabe4,c9cbabd0,c11f5c27,72e,0,...) at _cv_wait_sig+0x214/frame 0xedb389f8 seltdwait(ffffffff,0,0,c942c000,0,...) at seltdwait+0xbb/frame 0xedb38a28 kern_select(c942c000,9,2882d118,0,0,...) at kern_select+0x914/frame 0xedb38bd0 sys_select(c942c000,edb38ca8,c11e4fcd,4,c945b000,...) at sys_select+0x66/frame 0xedb38c18 syscall(edb38ce8) at syscall+0x34a/frame 0xedb38cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedb38cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281bbeff, esp = 0xbfbfdfdc, ebp = 0xbfbfee34 --- Tracing command rtsold pid 365 tid 100092 td 0xc9441c40 sched_switch(c9441c40,0,104,1ba,edba7950,...) at sched_switch+0x4e2/frame 0xedba7918 mi_switch(104,0,c11f2745,200,edba79bc,...) at mi_switch+0x1bf/frame 0xedba7950 sleepq_switch(c9441c40,0,c11f2745,1b6,edba79c8,...) at sleepq_switch+0x1c5/frame 0xedba7984 sleepq_catch_signals(edba79e4,c0b473c9,c9abfaa0,0,c1461ad0,...) at sleepq_catch_signals+0x382/frame 0xedba79c0 sleepq_wait_sig(c9abfaa4,0,edba7a1c,101,0,...) at sleepq_wait_sig+0x14/frame 0xedba79e4 _cv_wait_sig(c9abfaa4,c9abfa90,c11f5c27,72e,629,...) at _cv_wait_sig+0x214/frame 0xedba7a30 seltdwait(ffffffff,0,0,c9441c40,0,...) at seltdwait+0xbb/frame 0xedba7a60 kern_poll(c9441c40,bfbfee08,2,0,0,...) at kern_poll+0x4f0/frame 0xedba7be0 sys_poll(c9441c40,edba7ca8,c11e4fcd,4,2820a880,...) at sys_poll+0x71/frame 0xedba7c18 syscall(edba7ce8) at syscall+0x34a/frame 0xedba7cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedba7cdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2814fc53, esp = 0xbfbfedcc, ebp = 0xbfbfee34 --- Tracing command devd pid 325 tid 100079 td 0xc944b310 sched_switch(c944b310,0,104,1ba,edb1e910,...) at sched_switch+0x4e2/frame 0xedb1e8d8 mi_switch(104,0,c11f2745,200,c1640490,...) at mi_switch+0x1bf/frame 0xedb1e910 sleepq_switch(c944b310,0,c11f2745,1b6,c92fd990,...) at sleepq_switch+0x1c5/frame 0xedb1e944 sleepq_catch_signals(c1461ad0,edb1e9a8,c0b473c9,c92fd9a0,0,...) at sleepq_catch_signals+0x382/frame 0xedb1e980 sleepq_timedwait_sig(c92fd9a4,0,edb1e9e4,c0000000,3,...) at sleepq_timedwait_sig+0x14/frame 0xedb1e9a8 _cv_timedwait_sig_sbt(c92fd9a4,c92fd990,cb5b22b5,44a5,c0000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedb1e9f8 seltdwait(44a5,c0000000,3,c944b310,0,...) at seltdwait+0xad/frame 0xedb1ea28 kern_select(c944b310,6,bfbfcda8,0,0,...) at kern_select+0x914/frame 0xedb1ebd0 sys_select(c944b310,edb1eca8,c11e4fcd,4,c1073da7,...) at sys_select+0x66/frame 0xedb1ec18 syscall(edb1ece8) at syscall+0x34a/frame 0xedb1ecdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedb1ecdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x80e1bc3, esp = 0xbfbfcd4c, ebp = 0xbfbfee54 --- Tracing command syncer pid 16 tid 100074 td 0xc8edcc40 sched_switch(c8edcc40,0,104,1ba,edb09b90,...) at sched_switch+0x4e2/frame 0xedb09b58 mi_switch(104,0,c11f2745,200,c15e4434,...) at mi_switch+0x1bf/frame 0xedb09b90 sleepq_switch(c8edcc40,0,c11f2745,299,0,...) at sleepq_switch+0x1c5/frame 0xedb09bc4 sleepq_timedwait(c15e4454,0,edb09c24,0,0,...) at sleepq_timedwait+0x48/frame 0xedb09be8 _cv_timedwait_sbt(c15e4454,c15e4434,fffffed8,0,0,...) at _cv_timedwait_sbt+0x23c/frame 0xedb09c38 sched_sync(0,edb09ce8,c11e53ac,3dc,0,...) at sched_sync+0x712/frame 0xedb09cac fork_exit(c0c1f4e0,0,edb09ce8) at fork_exit+0x7e/frame 0xedb09cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedb09cd4 --- trap 0, eip = 0, esp = 0xedb09d20, ebp = 0 --- Tracing command vnlru pid 9 tid 100073 td 0xc8edd000 sched_switch(c8edd000,0,104,1ba,edb06b8c,...) at sched_switch+0x4e2/frame 0xedb06b54 mi_switch(104,0,c11f2745,200,101,...) at mi_switch+0x1bf/frame 0xedb06b8c sleepq_switch(c8edd000,0,c11f2745,299,c8edd000,...) at sleepq_switch+0x1c5/frame 0xedb06bc0 sleepq_timedwait(c9167000,60,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedb06be4 _sleep(c9167000,c15e440c,260,c11ff2f0,fffffed8,...) at _sleep+0x33d/frame 0xedb06c40 vnlru_proc(0,edb06ce8,c11e53ac,3dc,0,...) at vnlru_proc+0xcf/frame 0xedb06cac fork_exit(c0c1fd10,0,edb06ce8) at fork_exit+0x7e/frame 0xedb06cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedb06cd4 --- trap 0, eip = 0, esp = 0xedb06d20, ebp = 0 --- Tracing command bufdaemon pid 8 tid 100072 td 0xc8edd310 sched_switch(c8edd310,0,104,1ba,edb03bc4,...) at sched_switch+0x4e2/frame 0xedb03b8c mi_switch(104,0,c11f2745,200,101,...) at mi_switch+0x1bf/frame 0xedb03bc4 sleepq_switch(c8edd310,0,c11f2745,299,c8edd310,...) at sleepq_switch+0x1c5/frame 0xedb03bf8 sleepq_timedwait(c15e3b84,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedb03c1c _sleep(c15e3b84,c15e3b00,54,c11fbbbf,fffffed8,...) at _sleep+0x33d/frame 0xedb03c78 buf_daemon(0,edb03ce8,c11e53ac,3dc,0,...) at buf_daemon+0x8c/frame 0xedb03cac fork_exit(c0c01d10,0,edb03ce8) at fork_exit+0x7e/frame 0xedb03cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedb03cd4 --- trap 0, eip = 0, esp = 0xedb03d20, ebp = 0 --- Tracing command bufdaemon pid 8 tid 100084 td 0xc944ac40 sched_switch(c944ac40,0,104,1ba,edb3cbb4,...) at sched_switch+0x4e2/frame 0xedb3cb7c mi_switch(104,0,c11f2745,200,101,...) at mi_switch+0x1bf/frame 0xedb3cbb4 sleepq_switch(c944ac40,0,c11f2745,299,c944ac40,...) at sleepq_switch+0x1c5/frame 0xedb3cbe8 sleepq_timedwait(c9464684,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedb3cc0c _sleep(c9464684,c9464600,54,c12269fb,7fffff6c,...) at _sleep+0x33d/frame 0xedb3cc68 softdep_flush(c9300000,edb3cce8,c11e53ac,3dc,0,...) at softdep_flush+0x1a2/frame 0xedb3ccac fork_exit(c0dd93d0,c9300000,edb3cce8) at fork_exit+0x7e/frame 0xedb3ccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedb3ccd4 --- trap 0, eip = 0, esp = 0xedb3cd20, ebp = 0 --- Tracing command bufdaemon pid 8 tid 100086 td 0xc944a620 sched_switch(c944a620,0,104,1ba,edb42bb4,...) at sched_switch+0x4e2/frame 0xedb42b7c mi_switch(104,0,c11f2745,200,101,...) at mi_switch+0x1bf/frame 0xedb42bb4 sleepq_switch(c944a620,0,c11f2745,299,c944a620,...) at sleepq_switch+0x1c5/frame 0xedb42be8 sleepq_timedwait(c9464284,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedb42c0c _sleep(c9464284,c9464200,54,c12269fb,7fffff6c,...) at _sleep+0x33d/frame 0xedb42c68 softdep_flush(c97ecbb0,edb42ce8,c11e53ac,3dc,0,...) at softdep_flush+0x1a2/frame 0xedb42cac fork_exit(c0dd93d0,c97ecbb0,edb42ce8) at fork_exit+0x7e/frame 0xedb42cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedb42cd4 --- trap 0, eip = 0, esp = 0xedb42d20, ebp = 0 --- Tracing command bufdaemon pid 8 tid 100087 td 0xc944a310 sched_switch(c944a310,0,104,1ba,edb45bb4,...) at sched_switch+0x4e2/frame 0xedb45b7c mi_switch(104,0,c11f2745,200,101,...) at mi_switch+0x1bf/frame 0xedb45bb4 sleepq_switch(c944a310,0,c11f2745,299,c944a310,...) at sleepq_switch+0x1c5/frame 0xedb45be8 sleepq_timedwait(c9464084,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedb45c0c _sleep(c9464084,c9464000,54,c12269fb,7fffff6c,...) at _sleep+0x33d/frame 0xedb45c68 softdep_flush(c97ec8c4,edb45ce8,c11e53ac,3dc,0,...) at softdep_flush+0x1a2/frame 0xedb45cac fork_exit(c0dd93d0,c97ec8c4,edb45ce8) at fork_exit+0x7e/frame 0xedb45cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedb45cd4 --- trap 0, eip = 0, esp = 0xedb45d20, ebp = 0 --- Tracing command bufdaemon pid 8 tid 100173 td 0xc935a000 sched_switch(c935a000,0,104,1ba,f8961bb4,...) at sched_switch+0x4e2/frame 0xf8961b7c mi_switch(104,0,c11f2745,200,101,...) at mi_switch+0x1bf/frame 0xf8961bb4 sleepq_switch(c935a000,0,c11f2745,299,c935a000,...) at sleepq_switch+0x1c5/frame 0xf8961be8 sleepq_timedwait(c9463e84,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xf8961c0c _sleep(c9463e84,c9463e00,54,c12269fb,7fffff6c,...) at _sleep+0x33d/frame 0xf8961c68 softdep_flush(c97ec2ec,f8961ce8,c11e53ac,3dc,0,...) at softdep_flush+0x1a2/frame 0xf8961cac fork_exit(c0dd93d0,c97ec2ec,f8961ce8) at fork_exit+0x7e/frame 0xf8961cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf8961cd4 --- trap 0, eip = 0, esp = 0xf8961d20, ebp = 0 --- Tracing command pagezero pid 7 tid 100071 td 0xc8edd620 sched_switch(c8edd620,0,104,1ba,edb00bc0,...) at sched_switch+0x4e2/frame 0xedb00b88 mi_switch(104,0,c11f2745,200,101,...) at mi_switch+0x1bf/frame 0xedb00bc0 sleepq_switch(c8edd620,0,c11f2745,299,c8edd620,...) at sleepq_switch+0x1c5/frame 0xedb00bf4 sleepq_timedwait(c15e96bc,0,12b,0,0,...) at sleepq_timedwait+0x48/frame 0xedb00c18 _sleep(c15e96bc,c1646f80,0,c122ea19,fffea520,...) at _sleep+0x33d/frame 0xedb00c74 vm_pagezero(0,edb00ce8,c11e53ac,3dc,0,...) at vm_pagezero+0xc2/frame 0xedb00cac fork_exit(c0e3afe0,0,edb00ce8) at fork_exit+0x7e/frame 0xedb00cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedb00cd4 --- trap 0, eip = 0, esp = 0xedb00d20, ebp = 0 --- Tracing command vmdaemon pid 6 tid 100070 td 0xc8edd930 sched_switch(c8edd930,0,104,1ba,edafdb8c,...) at sched_switch+0x4e2/frame 0xedafdb54 mi_switch(104,0,c11f2745,200,c15e9420,...) at mi_switch+0x1bf/frame 0xedafdb8c sleepq_switch(c8edd930,0,c11f2745,276,c8edd930,...) at sleepq_switch+0x1c5/frame 0xedafdbc0 sleepq_wait(c15e9438,74,c11fbbbf,0,0,...) at sleepq_wait+0x48/frame 0xedafdbe4 _sleep(c15e9438,c15e9420,74,c11fbbbf,0,...) at _sleep+0x3a1/frame 0xedafdc40 vm_daemon(0,edafdce8,c11e53ac,3dc,0,...) at vm_daemon+0x9c/frame 0xedafdcac fork_exit(c0e32550,0,edafdce8) at fork_exit+0x7e/frame 0xedafdcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedafdcd4 --- trap 0, eip = 0, esp = 0xedafdd20, ebp = 0 --- Tracing command pagedaemon pid 5 tid 100069 td 0xc8eddc40 sched_switch(c8eddc40,0,104,1ba,edafab44,...) at sched_switch+0x4e2/frame 0xedafab0c mi_switch(104,0,c11f2745,200,101,...) at mi_switch+0x1bf/frame 0xedafab44 sleepq_switch(c8eddc40,0,c11f2745,299,c8eddc40,...) at sleepq_switch+0x1c5/frame 0xedafab78 sleepq_timedwait(c1647004,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedafab9c _sleep(c1647004,c1646f80,54,c11fbbbf,fffffed8,...) at _sleep+0x33d/frame 0xedafabf8 vm_pageout(0,edaface8,c11e53ac,3dc,0,...) at vm_pageout+0x1a1/frame 0xedafacac fork_exit(c0e32d70,0,edaface8) at fork_exit+0x7e/frame 0xedafacd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedafacd4 --- trap 0, eip = 0, esp = 0xedafad20, ebp = 0 --- Tracing command sctp_iterator pid 4 tid 100066 td 0xc8ede620 sched_switch(c8ede620,0,104,1ba,ed971bcc,...) at sched_switch+0x4e2/frame 0xed971b94 mi_switch(104,0,c11f2745,200,c1643964,...) at mi_switch+0x1bf/frame 0xed971bcc sleepq_switch(c8ede620,0,c11f2745,276,c8ede620,...) at sleepq_switch+0x1c5/frame 0xed971c00 sleepq_wait(c164399c,0,c1212c05,0,0,...) at sleepq_wait+0x48/frame 0xed971c24 _sleep(c164399c,c1643964,0,c1212c05,0,...) at _sleep+0x3a1/frame 0xed971c80 sctp_iterator_thread(0,ed971ce8,c11e53ac,3dc,0,...) at sctp_iterator_thread+0x7c/frame 0xed971cac fork_exit(c0cc7160,0,ed971ce8) at fork_exit+0x7e/frame 0xed971cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed971cd4 --- trap 0, eip = 0, esp = 0xed971d20, ebp = 0 --- Tracing command fdc0 pid 3 tid 100061 td 0xc8c8f310 sched_switch(c8c8f310,0,104,1ba,ed961b60,...) at sched_switch+0x4e2/frame 0xed961b28 mi_switch(104,0,c11f2745,200,101,...) at mi_switch+0x1bf/frame 0xed961b60 sleepq_switch(c8c8f310,0,c11f2745,299,c8c8f310,...) at sleepq_switch+0x1c5/frame 0xed961b94 sleepq_timedwait(c8bfb43c,5c,0,0,0,...) at sleepq_timedwait+0x48/frame 0xed961bb8 _sleep(c8bfb43c,c8bfb4f0,5c,c11d729a,fffffed8,...) at _sleep+0x33d/frame 0xed961c14 fdc_thread(c8bfb400,ed961ce8,c11e53ac,3dc,0,...) at fdc_thread+0x95a/frame 0xed961cac fork_exit(c0ff0160,c8bfb400,ed961ce8) at fork_exit+0x7e/frame 0xed961cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed961cd4 --- trap 0, eip = 0, esp = 0xed961d20, ebp = 0 --- Tracing command usb pid 15 tid 100032 td 0xc8bd5930 sched_switch(c8bd5930,0,104,1ba,ed8e8be8,...) at sched_switch+0x4e2/frame 0xed8e8bb0 mi_switch(104,0,c11f2745,200,c8c21cc8,...) at mi_switch+0x1bf/frame 0xed8e8be8 sleepq_switch(c8bd5930,0,c11f2745,276,c8c21acc,...) at sleepq_switch+0x1c5/frame 0xed8e8c1c sleepq_wait(c8c21acc,0,ed8e8c70,1,0,...) at sleepq_wait+0x48/frame 0xed8e8c40 _cv_wait(c8c21acc,c8c21cc8,c11bd523,76,c8c21ad4,...) at _cv_wait+0x1fe/frame 0xed8e8c84 usb_process(c8c21ac4,ed8e8ce8,c11e53ac,3dc,0,...) at usb_process+0x140/frame 0xed8e8cac fork_exit(c09bba80,c8c21ac4,ed8e8ce8) at fork_exit+0x7e/frame 0xed8e8cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed8e8cd4 --- trap 0, eip = 0, esp = 0xed8e8d20, ebp = 0 --- Tracing command usb pid 15 tid 100033 td 0xc8bd5620 sched_switch(c8bd5620,0,104,1ba,ed8ebbe8,...) at sched_switch+0x4e2/frame 0xed8ebbb0 mi_switch(104,0,c11f2745,200,c8c21cc8,...) at mi_switch+0x1bf/frame 0xed8ebbe8 sleepq_switch(c8bd5620,0,c11f2745,276,c8c21afc,...) at sleepq_switch+0x1c5/frame 0xed8ebc1c sleepq_wait(c8c21afc,0,ed8ebc70,1,0,...) at sleepq_wait+0x48/frame 0xed8ebc40 _cv_wait(c8c21afc,c8c21cc8,c11bd523,76,c8c21b04,...) at _cv_wait+0x1fe/frame 0xed8ebc84 usb_process(c8c21af4,ed8ebce8,c11e53ac,3dc,0,...) at usb_process+0x140/frame 0xed8ebcac fork_exit(c09bba80,c8c21af4,ed8ebce8) at fork_exit+0x7e/frame 0xed8ebcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed8ebcd4 --- trap 0, eip = 0, esp = 0xed8ebd20, ebp = 0 --- Tracing command usb pid 15 tid 100034 td 0xc8bd5310 sched_switch(c8bd5310,0,104,1ba,ed8eebe8,...) at sched_switch+0x4e2/frame 0xed8eebb0 mi_switch(104,0,c11f2745,200,c8c21cc8,...) at mi_switch+0x1bf/frame 0xed8eebe8 sleepq_switch(c8bd5310,0,c11f2745,276,c8c21b2c,...) at sleepq_switch+0x1c5/frame 0xed8eec1c sleepq_wait(c8c21b2c,0,ed8eec70,1,0,...) at sleepq_wait+0x48/frame 0xed8eec40 _cv_wait(c8c21b2c,c8c21cc8,c11bd523,76,c8c21b34,...) at _cv_wait+0x1fe/frame 0xed8eec84 usb_process(c8c21b24,ed8eece8,c11e53ac,3dc,0,...) at usb_process+0x140/frame 0xed8eecac fork_exit(c09bba80,c8c21b24,ed8eece8) at fork_exit+0x7e/frame 0xed8eecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed8eecd4 --- trap 0, eip = 0, esp = 0xed8eed20, ebp = 0 --- Tracing command usb pid 15 tid 100035 td 0xc8bd5000 sched_switch(c8bd5000,0,104,1ba,ed8f1be8,...) at sched_switch+0x4e2/frame 0xed8f1bb0 mi_switch(104,0,c11f2745,200,c8c21cc8,...) at mi_switch+0x1bf/frame 0xed8f1be8 sleepq_switch(c8bd5000,0,c11f2745,276,c8c21b5c,...) at sleepq_switch+0x1c5/frame 0xed8f1c1c sleepq_wait(c8c21b5c,0,ed8f1c70,1,0,...) at sleepq_wait+0x48/frame 0xed8f1c40 _cv_wait(c8c21b5c,c8c21cc8,c11bd523,76,c8c21b64,...) at _cv_wait+0x1fe/frame 0xed8f1c84 usb_process(c8c21b54,ed8f1ce8,c11e53ac,3dc,0,...) at usb_process+0x140/frame 0xed8f1cac fork_exit(c09bba80,c8c21b54,ed8f1ce8) at fork_exit+0x7e/frame 0xed8f1cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed8f1cd4 --- trap 0, eip = 0, esp = 0xed8f1d20, ebp = 0 --- Tracing command usb pid 15 tid 100037 td 0xc8adf930 sched_switch(c8adf930,0,104,1ba,ed8f8be8,...) at sched_switch+0x4e2/frame 0xed8f8bb0 mi_switch(104,0,c11f2745,200,c8c76cc8,...) at mi_switch+0x1bf/frame 0xed8f8be8 sleepq_switch(c8adf930,0,c11f2745,276,c8c76acc,...) at sleepq_switch+0x1c5/frame 0xed8f8c1c sleepq_wait(c8c76acc,0,ed8f8c70,1,0,...) at sleepq_wait+0x48/frame 0xed8f8c40 _cv_wait(c8c76acc,c8c76cc8,c11bd523,76,c8c76ad4,...) at _cv_wait+0x1fe/frame 0xed8f8c84 usb_process(c8c76ac4,ed8f8ce8,c11e53ac,3dc,0,...) at usb_process+0x140/frame 0xed8f8cac fork_exit(c09bba80,c8c76ac4,ed8f8ce8) at fork_exit+0x7e/frame 0xed8f8cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed8f8cd4 --- trap 0, eip = 0, esp = 0xed8f8d20, ebp = 0 --- Tracing command usb pid 15 tid 100038 td 0xc8adf620 sched_switch(c8adf620,0,104,1ba,ed8fbbe8,...) at sched_switch+0x4e2/frame 0xed8fbbb0 mi_switch(104,0,c11f2745,200,c8c76cc8,...) at mi_switch+0x1bf/frame 0xed8fbbe8 sleepq_switch(c8adf620,0,c11f2745,276,c8c76afc,...) at sleepq_switch+0x1c5/frame 0xed8fbc1c sleepq_wait(c8c76afc,0,ed8fbc70,1,0,...) at sleepq_wait+0x48/frame 0xed8fbc40 _cv_wait(c8c76afc,c8c76cc8,c11bd523,76,c8c76b04,...) at _cv_wait+0x1fe/frame 0xed8fbc84 usb_process(c8c76af4,ed8fbce8,c11e53ac,3dc,0,...) at usb_process+0x140/frame 0xed8fbcac fork_exit(c09bba80,c8c76af4,ed8fbce8) at fork_exit+0x7e/frame 0xed8fbcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed8fbcd4 --- trap 0, eip = 0, esp = 0xed8fbd20, ebp = 0 --- Tracing command usb pid 15 tid 100039 td 0xc8adf310 sched_switch(c8adf310,0,104,1ba,ed8febe8,...) at sched_switch+0x4e2/frame 0xed8febb0 mi_switch(104,0,c11f2745,200,c8c76cc8,...) at mi_switch+0x1bf/frame 0xed8febe8 sleepq_switch(c8adf310,0,c11f2745,276,c8c76b2c,...) at sleepq_switch+0x1c5/frame 0xed8fec1c sleepq_wait(c8c76b2c,0,ed8fec70,1,0,...) at sleepq_wait+0x48/frame 0xed8fec40 _cv_wait(c8c76b2c,c8c76cc8,c11bd523,76,c8c76b34,...) at _cv_wait+0x1fe/frame 0xed8fec84 usb_process(c8c76b24,ed8fece8,c11e53ac,3dc,0,...) at usb_process+0x140/frame 0xed8fecac fork_exit(c09bba80,c8c76b24,ed8fece8) at fork_exit+0x7e/frame 0xed8fecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed8fecd4 --- trap 0, eip = 0, esp = 0xed8fed20, ebp = 0 --- Tracing command usb pid 15 tid 100040 td 0xc8c7a310 sched_switch(c8c7a310,0,104,1ba,ed901be8,...) at sched_switch+0x4e2/frame 0xed901bb0 mi_switch(104,0,c11f2745,200,c8c76cc8,...) at mi_switch+0x1bf/frame 0xed901be8 sleepq_switch(c8c7a310,0,c11f2745,276,c8c76b5c,...) at sleepq_switch+0x1c5/frame 0xed901c1c sleepq_wait(c8c76b5c,0,ed901c70,1,0,...) at sleepq_wait+0x48/frame 0xed901c40 _cv_wait(c8c76b5c,c8c76cc8,c11bd523,76,c8c76b64,...) at _cv_wait+0x1fe/frame 0xed901c84 usb_process(c8c76b54,ed901ce8,c11e53ac,3dc,0,...) at usb_process+0x140/frame 0xed901cac fork_exit(c09bba80,c8c76b54,ed901ce8) at fork_exit+0x7e/frame 0xed901cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed901cd4 --- trap 0, eip = 0, esp = 0xed901d20, ebp = 0 --- Tracing command usb pid 15 tid 100042 td 0xc8c79c40 sched_switch(c8c79c40,0,104,1ba,ed908be8,...) at sched_switch+0x4e2/frame 0xed908bb0 mi_switch(104,0,c11f2745,200,c8c7fcc8,...) at mi_switch+0x1bf/frame 0xed908be8 sleepq_switch(c8c79c40,0,c11f2745,276,c8c7facc,...) at sleepq_switch+0x1c5/frame 0xed908c1c sleepq_wait(c8c7facc,0,ed908c70,1,0,...) at sleepq_wait+0x48/frame 0xed908c40 _cv_wait(c8c7facc,c8c7fcc8,c11bd523,76,c8c7fad4,...) at _cv_wait+0x1fe/frame 0xed908c84 usb_process(c8c7fac4,ed908ce8,c11e53ac,3dc,0,...) at usb_process+0x140/frame 0xed908cac fork_exit(c09bba80,c8c7fac4,ed908ce8) at fork_exit+0x7e/frame 0xed908cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed908cd4 --- trap 0, eip = 0, esp = 0xed908d20, ebp = 0 --- Tracing command usb pid 15 tid 100043 td 0xc8c79930 sched_switch(c8c79930,0,104,1ba,ed90bbe8,...) at sched_switch+0x4e2/frame 0xed90bbb0 mi_switch(104,0,c11f2745,200,c8c7fcc8,...) at mi_switch+0x1bf/frame 0xed90bbe8 sleepq_switch(c8c79930,0,c11f2745,276,c8c7fafc,...) at sleepq_switch+0x1c5/frame 0xed90bc1c sleepq_wait(c8c7fafc,0,ed90bc70,1,0,...) at sleepq_wait+0x48/frame 0xed90bc40 _cv_wait(c8c7fafc,c8c7fcc8,c11bd523,76,c8c7fb04,...) at _cv_wait+0x1fe/frame 0xed90bc84 usb_process(c8c7faf4,ed90bce8,c11e53ac,3dc,0,...) at usb_process+0x140/frame 0xed90bcac fork_exit(c09bba80,c8c7faf4,ed90bce8) at fork_exit+0x7e/frame 0xed90bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed90bcd4 --- trap 0, eip = 0, esp = 0xed90bd20, ebp = 0 --- Tracing command usb pid 15 tid 100044 td 0xc8c79620 sched_switch(c8c79620,0,104,1ba,ed90ebe8,...) at sched_switch+0x4e2/frame 0xed90ebb0 mi_switch(104,0,c11f2745,200,c8c7fcc8,...) at mi_switch+0x1bf/frame 0xed90ebe8 sleepq_switch(c8c79620,0,c11f2745,276,c8c7fb2c,...) at sleepq_switch+0x1c5/frame 0xed90ec1c sleepq_wait(c8c7fb2c,0,ed90ec70,1,0,...) at sleepq_wait+0x48/frame 0xed90ec40 _cv_wait(c8c7fb2c,c8c7fcc8,c11bd523,76,c8c7fb34,...) at _cv_wait+0x1fe/frame 0xed90ec84 usb_process(c8c7fb24,ed90ece8,c11e53ac,3dc,0,...) at usb_process+0x140/frame 0xed90ecac fork_exit(c09bba80,c8c7fb24,ed90ece8) at fork_exit+0x7e/frame 0xed90ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed90ecd4 --- trap 0, eip = 0, esp = 0xed90ed20, ebp = 0 --- Tracing command usb pid 15 tid 100045 td 0xc8c79310 sched_switch(c8c79310,0,104,1ba,ed911be8,...) at sched_switch+0x4e2/frame 0xed911bb0 mi_switch(104,0,c11f2745,200,c8c7fcc8,...) at mi_switch+0x1bf/frame 0xed911be8 sleepq_switch(c8c79310,0,c11f2745,276,c8c7fb5c,...) at sleepq_switch+0x1c5/frame 0xed911c1c sleepq_wait(c8c7fb5c,0,ed911c70,1,0,...) at sleepq_wait+0x48/frame 0xed911c40 _cv_wait(c8c7fb5c,c8c7fcc8,c11bd523,76,c8c7fb64,...) at _cv_wait+0x1fe/frame 0xed911c84 usb_process(c8c7fb54,ed911ce8,c11e53ac,3dc,0,...) at usb_process+0x140/frame 0xed911cac fork_exit(c09bba80,c8c7fb54,ed911ce8) at fork_exit+0x7e/frame 0xed911cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed911cd4 --- trap 0, eip = 0, esp = 0xed911d20, ebp = 0 --- Tracing command usb pid 15 tid 100046 td 0xc8c79000 sched_switch(c8c79000,0,104,1ba,ed915be8,...) at sched_switch+0x4e2/frame 0xed915bb0 mi_switch(104,0,c11f2745,200,c8c85cc8,...) at mi_switch+0x1bf/frame 0xed915be8 sleepq_switch(c8c79000,0,c11f2745,276,c8c85acc,...) at sleepq_switch+0x1c5/frame 0xed915c1c sleepq_wait(c8c85acc,0,ed915c70,1,0,...) at sleepq_wait+0x48/frame 0xed915c40 _cv_wait(c8c85acc,c8c85cc8,c11bd523,76,c8c85ad4,...) at _cv_wait+0x1fe/frame 0xed915c84 usb_process(c8c85ac4,ed915ce8,c11e53ac,3dc,0,...) at usb_process+0x140/frame 0xed915cac fork_exit(c09bba80,c8c85ac4,ed915ce8) at fork_exit+0x7e/frame 0xed915cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed915cd4 --- trap 0, eip = 0, esp = 0xed915d20, ebp = 0 --- Tracing command usb pid 15 tid 100047 td 0xc8c78c40 sched_switch(c8c78c40,0,104,1ba,ed918be8,...) at sched_switch+0x4e2/frame 0xed918bb0 mi_switch(104,0,c11f2745,200,c8c85cc8,...) at mi_switch+0x1bf/frame 0xed918be8 sleepq_switch(c8c78c40,0,c11f2745,276,c8c85afc,...) at sleepq_switch+0x1c5/frame 0xed918c1c sleepq_wait(c8c85afc,0,ed918c70,1,0,...) at sleepq_wait+0x48/frame 0xed918c40 _cv_wait(c8c85afc,c8c85cc8,c11bd523,76,c8c85b04,...) at _cv_wait+0x1fe/frame 0xed918c84 usb_process(c8c85af4,ed918ce8,c11e53ac,3dc,0,...) at usb_process+0x140/frame 0xed918cac fork_exit(c09bba80,c8c85af4,ed918ce8) at fork_exit+0x7e/frame 0xed918cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed918cd4 --- trap 0, eip = 0, esp = 0xed918d20, ebp = 0 --- Tracing command usb pid 15 tid 100048 td 0xc8c78930 sched_switch(c8c78930,0,104,1ba,ed91bbe8,...) at sched_switch+0x4e2/frame 0xed91bbb0 mi_switch(104,0,c11f2745,200,c8c85cc8,...) at mi_switch+0x1bf/frame 0xed91bbe8 sleepq_switch(c8c78930,0,c11f2745,276,c8c85b2c,...) at sleepq_switch+0x1c5/frame 0xed91bc1c sleepq_wait(c8c85b2c,0,ed91bc70,1,0,...) at sleepq_wait+0x48/frame 0xed91bc40 _cv_wait(c8c85b2c,c8c85cc8,c11bd523,76,c8c85b34,...) at _cv_wait+0x1fe/frame 0xed91bc84 usb_process(c8c85b24,ed91bce8,c11e53ac,3dc,0,...) at usb_process+0x140/frame 0xed91bcac fork_exit(c09bba80,c8c85b24,ed91bce8) at fork_exit+0x7e/frame 0xed91bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed91bcd4 --- trap 0, eip = 0, esp = 0xed91bd20, ebp = 0 --- Tracing command usb pid 15 tid 100049 td 0xc8c78620 sched_switch(c8c78620,0,104,1ba,ed91ebe8,...) at sched_switch+0x4e2/frame 0xed91ebb0 mi_switch(104,0,c11f2745,200,c8c85cc8,...) at mi_switch+0x1bf/frame 0xed91ebe8 sleepq_switch(c8c78620,0,c11f2745,276,c8c85b5c,...) at sleepq_switch+0x1c5/frame 0xed91ec1c sleepq_wait(c8c85b5c,0,ed91ec70,1,0,...) at sleepq_wait+0x48/frame 0xed91ec40 _cv_wait(c8c85b5c,c8c85cc8,c11bd523,76,c8c85b64,...) at _cv_wait+0x1fe/frame 0xed91ec84 usb_process(c8c85b54,ed91ece8,c11e53ac,3dc,0,...) at usb_process+0x140/frame 0xed91ecac fork_exit(c09bba80,c8c85b54,ed91ece8) at fork_exit+0x7e/frame 0xed91ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed91ecd4 --- trap 0, eip = 0, esp = 0xed91ed20, ebp = 0 --- Tracing command usb pid 15 tid 100050 td 0xc8c78310 sched_switch(c8c78310,0,104,1ba,ed922be8,...) at sched_switch+0x4e2/frame 0xed922bb0 mi_switch(104,0,c11f2745,200,c8c89cc8,...) at mi_switch+0x1bf/frame 0xed922be8 sleepq_switch(c8c78310,0,c11f2745,276,c8c89acc,...) at sleepq_switch+0x1c5/frame 0xed922c1c sleepq_wait(c8c89acc,0,ed922c70,1,0,...) at sleepq_wait+0x48/frame 0xed922c40 _cv_wait(c8c89acc,c8c89cc8,c11bd523,76,c8c89ad4,...) at _cv_wait+0x1fe/frame 0xed922c84 usb_process(c8c89ac4,ed922ce8,c11e53ac,3dc,0,...) at usb_process+0x140/frame 0xed922cac fork_exit(c09bba80,c8c89ac4,ed922ce8) at fork_exit+0x7e/frame 0xed922cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed922cd4 --- trap 0, eip = 0, esp = 0xed922d20, ebp = 0 --- Tracing command usb pid 15 tid 100051 td 0xc8c78000 sched_switch(c8c78000,0,104,1ba,ed925be8,...) at sched_switch+0x4e2/frame 0xed925bb0 mi_switch(104,0,c11f2745,200,c8c89cc8,...) at mi_switch+0x1bf/frame 0xed925be8 sleepq_switch(c8c78000,0,c11f2745,276,c8c89afc,...) at sleepq_switch+0x1c5/frame 0xed925c1c sleepq_wait(c8c89afc,0,ed925c70,1,0,...) at sleepq_wait+0x48/frame 0xed925c40 _cv_wait(c8c89afc,c8c89cc8,c11bd523,76,c8c89b04,...) at _cv_wait+0x1fe/frame 0xed925c84 usb_process(c8c89af4,ed925ce8,c11e53ac,3dc,0,...) at usb_process+0x140/frame 0xed925cac fork_exit(c09bba80,c8c89af4,ed925ce8) at fork_exit+0x7e/frame 0xed925cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed925cd4 --- trap 0, eip = 0, esp = 0xed925d20, ebp = 0 --- Tracing command usb pid 15 tid 100052 td 0xc8bd6c40 sched_switch(c8bd6c40,0,104,1ba,ed928be8,...) at sched_switch+0x4e2/frame 0xed928bb0 mi_switch(104,0,c11f2745,200,c8c89cc8,...) at mi_switch+0x1bf/frame 0xed928be8 sleepq_switch(c8bd6c40,0,c11f2745,276,c8c89b2c,...) at sleepq_switch+0x1c5/frame 0xed928c1c sleepq_wait(c8c89b2c,0,ed928c70,1,0,...) at sleepq_wait+0x48/frame 0xed928c40 _cv_wait(c8c89b2c,c8c89cc8,c11bd523,76,c8c89b34,...) at _cv_wait+0x1fe/frame 0xed928c84 usb_process(c8c89b24,ed928ce8,c11e53ac,3dc,0,...) at usb_process+0x140/frame 0xed928cac fork_exit(c09bba80,c8c89b24,ed928ce8) at fork_exit+0x7e/frame 0xed928cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed928cd4 --- trap 0, eip = 0, esp = 0xed928d20, ebp = 0 --- Tracing command usb pid 15 tid 100053 td 0xc8c90c40 sched_switch(c8c90c40,0,104,1ba,ed92bbe8,...) at sched_switch+0x4e2/frame 0xed92bbb0 mi_switch(104,0,c11f2745,200,c8c89cc8,...) at mi_switch+0x1bf/frame 0xed92bbe8 sleepq_switch(c8c90c40,0,c11f2745,276,c8c89b5c,...) at sleepq_switch+0x1c5/frame 0xed92bc1c sleepq_wait(c8c89b5c,0,ed92bc70,1,0,...) at sleepq_wait+0x48/frame 0xed92bc40 _cv_wait(c8c89b5c,c8c89cc8,c11bd523,76,c8c89b64,...) at _cv_wait+0x1fe/frame 0xed92bc84 usb_process(c8c89b54,ed92bce8,c11e53ac,3dc,0,...) at usb_process+0x140/frame 0xed92bcac fork_exit(c09bba80,c8c89b54,ed92bce8) at fork_exit+0x7e/frame 0xed92bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed92bcd4 --- trap 0, eip = 0, esp = 0xed92bd20, ebp = 0 --- Tracing command usb pid 15 tid 100055 td 0xc8c90620 sched_switch(c8c90620,0,104,1ba,ed934be8,...) at sched_switch+0x4e2/frame 0xed934bb0 mi_switch(104,0,c11f2745,200,c8c26ea0,...) at mi_switch+0x1bf/frame 0xed934be8 sleepq_switch(c8c90620,0,c11f2745,276,c8c26ca4,...) at sleepq_switch+0x1c5/frame 0xed934c1c sleepq_wait(c8c26ca4,0,ed934c70,1,0,...) at sleepq_wait+0x48/frame 0xed934c40 _cv_wait(c8c26ca4,c8c26ea0,c11bd523,76,c8c26cac,...) at _cv_wait+0x1fe/frame 0xed934c84 usb_process(c8c26c9c,ed934ce8,c11e53ac,3dc,0,...) at usb_process+0x140/frame 0xed934cac fork_exit(c09bba80,c8c26c9c,ed934ce8) at fork_exit+0x7e/frame 0xed934cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed934cd4 --- trap 0, eip = 0, esp = 0xed934d20, ebp = 0 --- Tracing command usb pid 15 tid 100056 td 0xc8c90310 sched_switch(c8c90310,0,104,1ba,ed937be8,...) at sched_switch+0x4e2/frame 0xed937bb0 mi_switch(104,0,c11f2745,200,c8c26ea0,...) at mi_switch+0x1bf/frame 0xed937be8 sleepq_switch(c8c90310,0,c11f2745,276,c8c26cd4,...) at sleepq_switch+0x1c5/frame 0xed937c1c sleepq_wait(c8c26cd4,0,ed937c70,1,0,...) at sleepq_wait+0x48/frame 0xed937c40 _cv_wait(c8c26cd4,c8c26ea0,c11bd523,76,c8c26cdc,...) at _cv_wait+0x1fe/frame 0xed937c84 usb_process(c8c26ccc,ed937ce8,c11e53ac,3dc,0,...) at usb_process+0x140/frame 0xed937cac fork_exit(c09bba80,c8c26ccc,ed937ce8) at fork_exit+0x7e/frame 0xed937cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed937cd4 --- trap 0, eip = 0, esp = 0xed937d20, ebp = 0 --- Tracing command usb pid 15 tid 100057 td 0xc8c90000 sched_switch(c8c90000,0,104,1ba,ed93abe8,...) at sched_switch+0x4e2/frame 0xed93abb0 mi_switch(104,0,c11f2745,200,c8c26ea0,...) at mi_switch+0x1bf/frame 0xed93abe8 sleepq_switch(c8c90000,0,c11f2745,276,c8c26d04,...) at sleepq_switch+0x1c5/frame 0xed93ac1c sleepq_wait(c8c26d04,0,ed93ac70,1,0,...) at sleepq_wait+0x48/frame 0xed93ac40 _cv_wait(c8c26d04,c8c26ea0,c11bd523,76,c8c26d0c,...) at _cv_wait+0x1fe/frame 0xed93ac84 usb_process(c8c26cfc,ed93ace8,c11e53ac,3dc,0,...) at usb_process+0x140/frame 0xed93acac fork_exit(c09bba80,c8c26cfc,ed93ace8) at fork_exit+0x7e/frame 0xed93acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed93acd4 --- trap 0, eip = 0, esp = 0xed93ad20, ebp = 0 --- Tracing command usb pid 15 tid 100058 td 0xc8c8fc40 sched_switch(c8c8fc40,0,104,1ba,ed93dbe8,...) at sched_switch+0x4e2/frame 0xed93dbb0 mi_switch(104,0,c11f2745,200,c8c26ea0,...) at mi_switch+0x1bf/frame 0xed93dbe8 sleepq_switch(c8c8fc40,0,c11f2745,276,c8c26d34,...) at sleepq_switch+0x1c5/frame 0xed93dc1c sleepq_wait(c8c26d34,0,ed93dc70,1,0,...) at sleepq_wait+0x48/frame 0xed93dc40 _cv_wait(c8c26d34,c8c26ea0,c11bd523,76,c8c26d3c,...) at _cv_wait+0x1fe/frame 0xed93dc84 usb_process(c8c26d2c,ed93dce8,c11e53ac,3dc,0,...) at usb_process+0x140/frame 0xed93dcac fork_exit(c09bba80,c8c26d2c,ed93dce8) at fork_exit+0x7e/frame 0xed93dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed93dcd4 --- trap 0, eip = 0, esp = 0xed93dd20, ebp = 0 --- Tracing command cam pid 2 tid 100026 td 0xc8a2e930 sched_switch(c8a2e930,0,104,1ba,e4781ba4,...) at sched_switch+0x4e2/frame 0xe4781b6c mi_switch(104,0,c11f2745,200,c14a1c00,...) at mi_switch+0x1bf/frame 0xe4781ba4 sleepq_switch(c8a2e930,0,c11f2745,276,c8a2e930,...) at sleepq_switch+0x1c5/frame 0xe4781bd8 sleepq_wait(c14a1c80,5c,c11d729a,0,0,...) at sleepq_wait+0x48/frame 0xe4781bfc _sleep(c14a1c80,c14a1c00,5c,c11d729a,0,...) at _sleep+0x3a1/frame 0xe4781c58 xpt_done_td(c14a1c00,e4781ce8,c11e53ac,3dc,0,...) at xpt_done_td+0x17e/frame 0xe4781cac fork_exit(c04c7fa0,c14a1c00,e4781ce8) at fork_exit+0x7e/frame 0xe4781cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4781cd4 --- trap 0, eip = 0, esp = 0xe4781d20, ebp = 0 --- Tracing command cam pid 2 tid 100068 td 0xc8ede000 sched_switch(c8ede000,0,104,1ba,ed977ba4,...) at sched_switch+0x4e2/frame 0xed977b6c mi_switch(104,0,c11f2745,200,c14a1b7c,...) at mi_switch+0x1bf/frame 0xed977ba4 sleepq_switch(c8ede000,0,c11f2745,276,c8ede000,...) at sleepq_switch+0x1c5/frame 0xed977bd8 sleepq_wait(c14a1b2c,5c,c11d729a,0,0,...) at sleepq_wait+0x48/frame 0xed977bfc _sleep(c14a1b2c,c14a1b7c,5c,c11d729a,0,...) at _sleep+0x3a1/frame 0xed977c58 xpt_scanner_thread(0,ed977ce8,c11e53ac,3dc,0,...) at xpt_scanner_thread+0xa2/frame 0xed977cac fork_exit(c04c8360,0,ed977ce8) at fork_exit+0x7e/frame 0xed977cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed977cd4 --- trap 0, eip = 0, esp = 0xed977d20, ebp = 0 --- Tracing command rand_harvestq pid 14 tid 100017 td 0xc8ade620 sched_switch(c8ade620,0,104,1ba,e4766bc8,...) at sched_switch+0x4e2/frame 0xe4766b90 mi_switch(104,0,c11f2745,200,5,...) at mi_switch+0x1bf/frame 0xe4766bc8 sleepq_switch(c8ade620,0,c11f2745,299,c8ade620,...) at sleepq_switch+0x1c5/frame 0xe4766bfc sleepq_timedwait(c14bc870,0,0,0,0,...) at sleepq_timedwait+0x48/frame 0xe4766c20 _sleep(c14bc870,0,0,c11d729a,19999999,...) at _sleep+0x33d/frame 0xe4766c7c random_kthread(0,e4766ce8,c11e53ac,3dc,0,...) at random_kthread+0x5c/frame 0xe4766cac fork_exit(c089a8c0,0,e4766ce8) at fork_exit+0x7e/frame 0xe4766cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4766cd4 --- trap 0, eip = 0, esp = 0xe4766d20, ebp = 0 --- Tracing command geom pid 13 tid 100014 td 0xc8adf000 sched_switch(c8adf000,0,104,1ba,e475dbbc,...) at sched_switch+0x4e2/frame 0xe475db84 mi_switch(104,0,c11f2745,200,c156875c,...) at mi_switch+0x1bf/frame 0xe475dbbc sleepq_switch(c8adf000,0,c11f2745,276,c8adf000,...) at sleepq_switch+0x1c5/frame 0xe475dbf0 sleepq_wait(c163eb18,5c,c11d729a,0,0,...) at sleepq_wait+0x48/frame 0xe475dc14 _sleep(c163eb18,c156875c,25c,c11d729a,0,...) at _sleep+0x3a1/frame 0xe475dc70 g_run_events(0,e475dce8,c11e53ac,3dc,0,...) at g_run_events+0x67/frame 0xe475dcac fork_exit(c0ab33b0,0,e475dce8) at fork_exit+0x7e/frame 0xe475dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe475dcd4 --- trap 0, eip = 0, esp = 0xe475dd20, ebp = 0 --- Tracing command geom pid 13 tid 100015 td 0xc8adec40 sched_switch(c8adec40,0,104,1ba,e4760bac,...) at sched_switch+0x4e2/frame 0xe4760b74 mi_switch(104,0,c11f2745,200,c15687a4,...) at mi_switch+0x1bf/frame 0xe4760bac sleepq_switch(c8adec40,0,c11f2745,276,c8adec40,...) at sleepq_switch+0x1c5/frame 0xe4760be0 sleepq_wait(c163eb1c,5c,c11d729a,0,0,...) at sleepq_wait+0x48/frame 0xe4760c04 _sleep(c163eb1c,c15687a4,25c,c11d729a,0,...) at _sleep+0x3a1/frame 0xe4760c60 g_io_schedule_up(c8adec40,0,c11d9071,60,e4760cd4,...) at g_io_schedule_up+0x12a/frame 0xe4760c94 g_up_procbody(0,e4760ce8,c11e53ac,3dc,0,...) at g_up_procbody+0x9d/frame 0xe4760cac fork_exit(c0ab3450,0,e4760ce8) at fork_exit+0x7e/frame 0xe4760cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4760cd4 --- trap 0, eip = 0, esp = 0xe4760d20, ebp = 0 --- Tracing command geom pid 13 tid 100016 td 0xc8ade930 sched_switch(c8ade930,0,104,1ba,e4763ba8,...) at sched_switch+0x4e2/frame 0xe4763b70 mi_switch(104,0,c11f2745,200,c1568784,...) at mi_switch+0x1bf/frame 0xe4763ba8 sleepq_switch(c8ade930,0,c11f2745,276,c8ade930,...) at sleepq_switch+0x1c5/frame 0xe4763bdc sleepq_wait(c163eb20,5c,c11d729a,0,0,...) at sleepq_wait+0x48/frame 0xe4763c00 _sleep(c163eb20,c1568784,25c,c11d729a,0,...) at _sleep+0x3a1/frame 0xe4763c5c g_io_schedule_down(c8ade930,0,c11d9071,6d,e4763cd4,...) at g_io_schedule_down+0x16c/frame 0xe4763c94 g_down_procbody(0,e4763ce8,c11e53ac,3dc,0,...) at g_down_procbody+0x9d/frame 0xe4763cac fork_exit(c0ab34f0,0,e4763ce8) at fork_exit+0x7e/frame 0xe4763cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4763cd4 --- trap 0, eip = 0, esp = 0xe4763d20, ebp = 0 --- Tracing command intr pid 12 tid 100007 td 0xc8a2d310 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100008 td 0xc8a2d000 sched_switch(c8a2d000,0,109,1ba,c15b9528,...) at sched_switch+0x4e2/frame 0xe474bc3c mi_switch(109,0,c11e561d,544,8,...) at mi_switch+0x1bf/frame 0xe474bc74 ithread_loop(c88d8f90,e474bce8,c11e53ac,3dc,0,...) at ithread_loop+0x1e1/frame 0xe474bcac fork_exit(c0b2c2a0,c88d8f90,e474bce8) at fork_exit+0x7e/frame 0xe474bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe474bcd4 --- trap 0, eip = 0, esp = 0xe474bd20, ebp = 0 --- Tracing command intr pid 12 tid 100009 td 0xc8a22c40 sched_switch(c8a22c40,0,109,1ba,c1640180,...) at sched_switch+0x4e2/frame 0xe474ec3c mi_switch(109,0,c11e561d,544,8,...) at mi_switch+0x1bf/frame 0xe474ec74 ithread_loop(c88d8f80,e474ece8,c11e53ac,3dc,0,...) at ithread_loop+0x1e1/frame 0xe474ecac fork_exit(c0b2c2a0,c88d8f80,e474ece8) at fork_exit+0x7e/frame 0xe474ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe474ecd4 --- trap 0, eip = 0, esp = 0xe474ed20, ebp = 0 --- Tracing command intr pid 12 tid 100010 td 0xc8a22930 sched_switch(c8a22930,0,109,1ba,c1640300,...) at sched_switch+0x4e2/frame 0xe4751c3c mi_switch(109,0,c11e561d,544,8,...) at mi_switch+0x1bf/frame 0xe4751c74 ithread_loop(c88d8f70,e4751ce8,c11e53ac,3dc,0,...) at ithread_loop+0x1e1/frame 0xe4751cac fork_exit(c0b2c2a0,c88d8f70,e4751ce8) at fork_exit+0x7e/frame 0xe4751cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4751cd4 --- trap 0, eip = 0, esp = 0xe4751d20, ebp = 0 --- Tracing command intr pid 12 tid 100011 td 0xc8a22620 sched_switch(c8a22620,0,109,1ba,c1640480,...) at sched_switch+0x4e2/frame 0xe4754c3c mi_switch(109,0,c11e561d,544,8,...) at mi_switch+0x1bf/frame 0xe4754c74 ithread_loop(c88d8f60,e4754ce8,c11e53ac,3dc,0,...) at ithread_loop+0x1e1/frame 0xe4754cac fork_exit(c0b2c2a0,c88d8f60,e4754ce8) at fork_exit+0x7e/frame 0xe4754cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4754cd4 --- trap 0, eip = 0, esp = 0xe4754d20, ebp = 0 --- Tracing command intr pid 12 tid 100012 td 0xc8a22310 sched_switch(c8a22310,0,109,1ba,c15b8298,...) at sched_switch+0x4e2/frame 0xe4757c3c mi_switch(109,0,c11e561d,544,8,...) at mi_switch+0x1bf/frame 0xe4757c74 ithread_loop(c88d8f50,e4757ce8,c11e53ac,3dc,0,...) at ithread_loop+0x1e1/frame 0xe4757cac fork_exit(c0b2c2a0,c88d8f50,e4757ce8) at fork_exit+0x7e/frame 0xe4757cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4757cd4 --- trap 0, eip = 0, esp = 0xe4757d20, ebp = 0 --- Tracing command intr pid 12 tid 100018 td 0xc8ade310 sched_switch(c8ade310,0,109,1ba,c15b8240,...) at sched_switch+0x4e2/frame 0xe4769c3c mi_switch(109,0,c11e561d,544,8,...) at mi_switch+0x1bf/frame 0xe4769c74 ithread_loop(c88d8e60,e4769ce8,c11e53ac,3dc,0,...) at ithread_loop+0x1e1/frame 0xe4769cac fork_exit(c0b2c2a0,c88d8e60,e4769ce8) at fork_exit+0x7e/frame 0xe4769cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4769cd4 --- trap 0, eip = 0, esp = 0xe4769d20, ebp = 0 --- Tracing command intr pid 12 tid 100021 td 0xc8add930 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100027 td 0xc8bd6930 sched_switch(c8bd6930,0,109,1ba,c15b7fd8,...) at sched_switch+0x4e2/frame 0xe4784c3c mi_switch(109,0,c11e561d,544,8,...) at mi_switch+0x1bf/frame 0xe4784c74 ithread_loop(c88d8df0,e4784ce8,c11e53ac,3dc,0,...) at ithread_loop+0x1e1/frame 0xe4784cac fork_exit(c0b2c2a0,c88d8df0,e4784ce8) at fork_exit+0x7e/frame 0xe4784cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4784cd4 --- trap 0, eip = 0, esp = 0xe4784d20, ebp = 0 --- Tracing command intr pid 12 tid 100028 td 0xc8bd6620 sched_switch(c8bd6620,0,109,1ba,c15b95d8,...) at sched_switch+0x4e2/frame 0xe47b6c3c mi_switch(109,0,c11e561d,544,8,...) at mi_switch+0x1bf/frame 0xe47b6c74 ithread_loop(c88d8210,e47b6ce8,c11e53ac,3dc,0,...) at ithread_loop+0x1e1/frame 0xe47b6cac fork_exit(c0b2c2a0,c88d8210,e47b6ce8) at fork_exit+0x7e/frame 0xe47b6cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe47b6cd4 --- trap 0, eip = 0, esp = 0xe47b6d20, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc8bd6310 sched_switch(c8bd6310,0,109,1ba,c15b7ed0,...) at sched_switch+0x4e2/frame 0xf0ebfc3c mi_switch(109,0,c11e561d,544,8,...) at mi_switch+0x1bf/frame 0xf0ebfc74 ithread_loop(c88d9ec0,f0ebfce8,c11e53ac,3dc,0,...) at ithread_loop+0x1e1/frame 0xf0ebfcac fork_exit(c0b2c2a0,c88d9ec0,f0ebfce8) at fork_exit+0x7e/frame 0xf0ebfcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf0ebfcd4 --- trap 0, eip = 0, esp = 0xf0ebfd20, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc8bd6000 sched_switch(c8bd6000,0,109,1ba,c15b8660,...) at sched_switch+0x4e2/frame 0xf0ec3c3c mi_switch(109,0,c11e561d,544,8,...) at mi_switch+0x1bf/frame 0xf0ec3c74 ithread_loop(c88d9e70,f0ec3ce8,c11e53ac,3dc,0,...) at ithread_loop+0x1e1/frame 0xf0ec3cac fork_exit(c0b2c2a0,c88d9e70,f0ec3ce8) at fork_exit+0x7e/frame 0xf0ec3cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf0ec3cd4 --- trap 0, eip = 0, esp = 0xf0ec3d20, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xc8bd5c40 sched_switch(c8bd5c40,0,109,1ba,c15b9580,...) at sched_switch+0x4e2/frame 0xed8e5c3c mi_switch(109,0,c11e561d,544,8,...) at mi_switch+0x1bf/frame 0xed8e5c74 ithread_loop(c88d9cb0,ed8e5ce8,c11e53ac,3dc,0,...) at ithread_loop+0x1e1/frame 0xed8e5cac fork_exit(c0b2c2a0,c88d9cb0,ed8e5ce8) at fork_exit+0x7e/frame 0xed8e5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed8e5cd4 --- trap 0, eip = 0, esp = 0xed8e5d20, ebp = 0 --- Tracing command intr pid 12 tid 100036 td 0xc8adfc40 sched_switch(c8adfc40,0,109,1ba,c15b8920,...) at sched_switch+0x4e2/frame 0xed8f5c3c mi_switch(109,0,c11e561d,544,8,...) at mi_switch+0x1bf/frame 0xed8f5c74 ithread_loop(c88d9c30,ed8f5ce8,c11e53ac,3dc,0,...) at ithread_loop+0x1e1/frame 0xed8f5cac fork_exit(c0b2c2a0,c88d9c30,ed8f5ce8) at fork_exit+0x7e/frame 0xed8f5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed8f5cd4 --- trap 0, eip = 0, esp = 0xed8f5d20, ebp = 0 --- Tracing command intr pid 12 tid 100041 td 0xc8c7a000 sched_switch(c8c7a000,0,109,1ba,c15b88c8,...) at sched_switch+0x4e2/frame 0xed905c3c mi_switch(109,0,c11e561d,544,8,...) at mi_switch+0x1bf/frame 0xed905c74 ithread_loop(c88d9bb0,ed905ce8,c11e53ac,3dc,0,...) at ithread_loop+0x1e1/frame 0xed905cac fork_exit(c0b2c2a0,c88d9bb0,ed905ce8) at fork_exit+0x7e/frame 0xed905cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed905cd4 --- trap 0, eip = 0, esp = 0xed905d20, ebp = 0 --- Tracing command intr pid 12 tid 100054 td 0xc8c90930 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xc8c8f930 sched_switch(c8c8f930,0,109,1ba,c15b8608,...) at sched_switch+0x4e2/frame 0xed943c3c mi_switch(109,0,c11e561d,544,8,...) at mi_switch+0x1bf/frame 0xed943c74 ithread_loop(c88d99c0,ed943ce8,c11e53ac,3dc,0,...) at ithread_loop+0x1e1/frame 0xed943cac fork_exit(c0b2c2a0,c88d99c0,ed943ce8) at fork_exit+0x7e/frame 0xed943cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed943cd4 --- trap 0, eip = 0, esp = 0xed943d20, ebp = 0 --- Tracing command intr pid 12 tid 100060 td 0xc8c8f620 sched_switch(c8c8f620,0,109,1ba,c15b81e8,...) at sched_switch+0x4e2/frame 0xed954c3c mi_switch(109,0,c11e561d,544,8,...) at mi_switch+0x1bf/frame 0xed954c74 ithread_loop(c88d96d0,ed954ce8,c11e53ac,3dc,0,...) at ithread_loop+0x1e1/frame 0xed954cac fork_exit(c0b2c2a0,c88d96d0,ed954ce8) at fork_exit+0x7e/frame 0xed954cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed954cd4 --- trap 0, eip = 0, esp = 0xed954d20, ebp = 0 --- Tracing command intr pid 12 tid 100062 td 0xc8c8f000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100063 td 0xc8c7ac40 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xc8a2e000 cpustop_handler(0,13,e473bb74,c106b607,0,...) at cpustop_handler+0x25/frame 0xe473ba28 ipi_nmi_handler(0,0,30a1fa,0,e473ba7c,...) at ipi_nmi_handler+0x36/frame 0xe473ba38 trap(e473bb80) at trap+0x37/frame 0xe473bb74 calltrap() at calltrap+0x6/frame 0xe473bb74 --- trap 0x13, eip = 0xc1051d75, esp = 0xe473bbc0, ebp = 0xe473bbc0 --- acpi_cpu_c1(c1c25c90,0,c13afc53,2ec,448c,...) at acpi_cpu_c1+0x5/frame 0xe473bbc0 acpi_cpu_idle(632674c,0,632674c,e473bc30,c105a5bd,...) at acpi_cpu_idle+0x166/frame 0xe473bc00 cpu_idle_acpi(632674c,0,2,c1577e88,c1577e84,...) at cpu_idle_acpi+0x3f/frame 0xe473bc14 cpu_idle(0,e473bc80,c11ee7a6,407,c1577e88,...) at cpu_idle+0x9d/frame 0xe473bc30 sched_idletd(0,e473bce8,c11e53ac,3dc,0,...) at sched_idletd+0x3cb/frame 0xe473bcac fork_exit(c0b8b0b0,0,e473bce8) at fork_exit+0x7e/frame 0xe473bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe473bcd4 --- trap 0, eip = 0, esp = 0xe473bd20, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc8a2dc40 cpustop_handler(1,13,e473eb74,c106b607,1,...) at cpustop_handler+0x25/frame 0xe473ea28 ipi_nmi_handler(1,0,30524d,0,e473ea7c,...) at ipi_nmi_handler+0x36/frame 0xe473ea38 trap(e473eb80) at trap+0x37/frame 0xe473eb74 calltrap() at calltrap+0x6/frame 0xe473eb74 --- trap 0x13, eip = 0xc1051d75, esp = 0xe473ebc0, ebp = 0xe473ebc0 --- acpi_cpu_c1(e472bc90,0,c13afc53,2ec,448c,...) at acpi_cpu_c1+0x5/frame 0xe473ebc0 acpi_cpu_idle(218723d3,0,218723d3,e473ec30,c105a5bd,...) at acpi_cpu_idle+0x166/frame 0xe473ec00 cpu_idle_acpi(218723d3,0,3,c1578588,c1578584,...) at cpu_idle_acpi+0x3f/frame 0xe473ec14 cpu_idle(0,e473ec80,c11ee7a6,a48,c1578588,...) at cpu_idle+0x9d/frame 0xe473ec30 sched_idletd(0,e473ece8,c11e53ac,3dc,0,...) at sched_idletd+0x3cb/frame 0xe473ecac fork_exit(c0b8b0b0,0,e473ece8) at fork_exit+0x7e/frame 0xe473ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe473ecd4 --- trap 0, eip = 0, esp = 0xe473ed20, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc8a2d930 kdb_alt_break_internal(0,e4741ac8,c097fa37,2,c8c6f684,...) at kdb_alt_break_internal+0x162/frame 0xe4741a9c kdb_alt_break(2,c8c6f684,c11b4431,c8c6f600,40000,...) at kdb_alt_break+0x16/frame 0xe4741aa8 uart_intr_rxready(c8c6f600,c13afc53,df,448c,1,...) at uart_intr_rxready+0x87/frame 0xe4741ac8 uart_intr(c8c6f600,0,b,0,0,...) at uart_intr+0x100/frame 0xe4741b04 intr_event_handle(c8a26680,e4741b80,0,2,0,...) at intr_event_handle+0x7a/frame 0xe4741b30 intr_execute_handlers(c8a7a108,e4741b80,2) at intr_execute_handlers+0x42/frame 0xe4741b50 lapic_handle_intr(30,e4741b80) at lapic_handle_intr+0x5d/frame 0xe4741b70 Xapic_isr1() at Xapic_isr1+0x4a/frame 0xe4741b70 --- interrupt, eip = 0xc1051d75, esp = 0xe4741bc0, ebp = 0xe4741bc0 --- acpi_cpu_c1(e472ec90,0,c13afc53,2ec,448c,...) at acpi_cpu_c1+0x5/frame 0xe4741bc0 acpi_cpu_idle(caed182,0,caed182,e4741c30,c105a5bd,...) at acpi_cpu_idle+0x166/frame 0xe4741c00 cpu_idle_acpi(caed182,0,1,c1578c88,c1578c84,...) at cpu_idle_acpi+0x3f/frame 0xe4741c14 cpu_idle(0,e4741c80,c11ee7a6,a48,c1578c88,...) at cpu_idle+0x9d/frame 0xe4741c30 sched_idletd(0,e4741ce8,c11e53ac,3dc,0,...) at sched_idletd+0x3cb/frame 0xe4741cac fork_exit(c0b8b0b0,0,e4741ce8) at fork_exit+0x7e/frame 0xe4741cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4741cd4 --- trap 0, eip = 0, esp = 0xe4741d20, ebp = 0 --- Tracing command idle pid 11 tid 100006 td 0xc8a2d620 cpustop_handler(3,13,e4744b74,c106b607,3,...) at cpustop_handler+0x25/frame 0xe4744a28 ipi_nmi_handler(3,0,4177cb,0,e4744a7c,...) at ipi_nmi_handler+0x36/frame 0xe4744a38 trap(e4744b80) at trap+0x37/frame 0xe4744b74 calltrap() at calltrap+0x6/frame 0xe4744b74 --- trap 0x13, eip = 0xc1051d75, esp = 0xe4744bc0, ebp = 0xe4744bc0 --- acpi_cpu_c1(e4731c90,0,c13afc53,2ec,448c,...) at acpi_cpu_c1+0x5/frame 0xe4744bc0 acpi_cpu_idle(669913bf,0,669913bf,e4744c30,c105a5bd,...) at acpi_cpu_idle+0x166/frame 0xe4744c00 cpu_idle_acpi(669913bf,0,4,c1579388,c1579384,...) at cpu_idle_acpi+0x3f/frame 0xe4744c14 cpu_idle(0,e4744c80,c11ee7a6,407,c1579388,...) at cpu_idle+0x9d/frame 0xe4744c30 sched_idletd(0,e4744ce8,c11e53ac,3dc,0,...) at sched_idletd+0x3cb/frame 0xe4744cac fork_exit(c0b8b0b0,0,e4744ce8) at fork_exit+0x7e/frame 0xe4744cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4744cd4 --- trap 0, eip = 0, esp = 0xe4744d20, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc8a2e310 sched_switch(c8a2e310,0,104,1ba,e47379a0,...) at sched_switch+0x4e2/frame 0xe4737968 mi_switch(104,0,c11f2745,200,c88e8f1c,...) at mi_switch+0x1bf/frame 0xe47379a0 sleepq_switch(c8a2e310,0,c11f2745,1b6,c11f2745,...) at sleepq_switch+0x1c5/frame 0xe47379d4 sleepq_catch_signals(c11f2745,16d,c8a20a78,12d8,c8a2e310,...) at sleepq_catch_signals+0x382/frame 0xe4737a10 sleepq_wait_sig(c8a209c0,6c,c11f64d5,100,0,...) at sleepq_wait_sig+0x14/frame 0xe4737a34 _sleep(c8a209c0,c8a20a68,16c,c11f64d5,0,...) at _sleep+0x356/frame 0xe4737a90 kern_wait6(c8a2e310,7,0,0,e4737b24,...) at kern_wait6+0x45b/frame 0xe4737af8 sys_wait4(c8a2e310,e4737ca8,c11e4fcd,4,c1073da7,...) at sys_wait4+0x8b/frame 0xe4737c18 syscall(e4737ce8) at syscall+0x34a/frame 0xe4737cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xe4737cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x80653ef, esp = 0xbfbfe904, ebp = 0xbfbfe918 --- Tracing command audit pid 10 tid 100001 td 0xc8a2e620 sched_switch(c8a2e620,0,104,1ba,e4734bbc,...) at sched_switch+0x4e2/frame 0xe4734b84 mi_switch(104,0,c11f2745,200,c164585c,...) at mi_switch+0x1bf/frame 0xe4734bbc sleepq_switch(c8a2e620,0,c11f2745,276,c16458d0,...) at sleepq_switch+0x1c5/frame 0xe4734bf0 sleepq_wait(c16458d0,0,e4734c44,1,0,...) at sleepq_wait+0x48/frame 0xe4734c14 _cv_wait(c16458d0,c164585c,c121f596,18d,0,...) at _cv_wait+0x1fe/frame 0xe4734c58 audit_worker(0,e4734ce8,c11e53ac,3dc,0,...) at audit_worker+0x94/frame 0xe4734cac fork_exit(c0da2db0,0,e4734ce8) at fork_exit+0x7e/frame 0xe4734cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4734cd4 --- trap 0, eip = 0, esp = 0xe4734d20, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc163ee80 sched_switch(c163ee80,0,104,1ba,c1c20c3c,...) at sched_switch+0x4e2/frame 0xc1c20c04 mi_switch(104,0,c11f2745,200,101,...) at mi_switch+0x1bf/frame 0xc1c20c3c sleepq_switch(c163ee80,0,c11f2745,299,c163ee80,...) at sleepq_switch+0x1c5/frame 0xc1c20c70 sleepq_timedwait(c163eb34,54,9,0,0,...) at sleepq_timedwait+0x48/frame 0xc1c20c94 _sleep(c163eb34,0,54,c122b6be,fffff470,...) at _sleep+0x33d/frame 0xc1c20cf0 swapper() at swapper+0x2c6/frame 0xc1c20d38 begin() at begin+0x22 Tracing command kernel pid 0 tid 100013 td 0xc8a22000 sched_switch(c8a22000,0,104,1ba,e475abc0,...) at sched_switch+0x4e2/frame 0xe475ab88 mi_switch(104,0,c11f2745,200,c8a25918,...) at mi_switch+0x1bf/frame 0xe475abc0 sleepq_switch(c8a22000,0,c11f2745,276,c8a22000,...) at sleepq_switch+0x1c5/frame 0xe475abf4 sleepq_wait(c8a25900,0,c11d729a,0,0,...) at sleepq_wait+0x48/frame 0xe475ac18 _sleep(c8a25900,c8a25918,0,c11d729a,0,...) at _sleep+0x3a1/frame 0xe475ac74 taskqueue_thread_loop(c1585f44,e475ace8,c11e53ac,3dc,0,...) at taskqueue_thread_loop+0x144/frame 0xe475acac fork_exit(c0bb3aa0,c1585f44,e475ace8) at fork_exit+0x7e/frame 0xe475acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe475acd4 --- trap 0, eip = 0, esp = 0xe475ad20, ebp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xc8ade000 sched_switch(c8ade000,0,104,1ba,e476cbc0,...) at sched_switch+0x4e2/frame 0xe476cb88 mi_switch(104,0,c11f2745,200,c8a24e18,...) at mi_switch+0x1bf/frame 0xe476cbc0 sleepq_switch(c8ade000,0,c11f2745,276,c8ade000,...) at sleepq_switch+0x1c5/frame 0xe476cbf4 sleepq_wait(c8a24e00,0,c11d729a,0,0,...) at sleepq_wait+0x48/frame 0xe476cc18 _sleep(c8a24e00,c8a24e18,0,c11d729a,0,...) at _sleep+0x3a1/frame 0xe476cc74 taskqueue_thread_loop(c1645904,e476cce8,c11e53ac,3dc,0,...) at taskqueue_thread_loop+0x144/frame 0xe476ccac fork_exit(c0bb3aa0,c1645904,e476cce8) at fork_exit+0x7e/frame 0xe476ccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe476ccd4 --- trap 0, eip = 0, esp = 0xe476cd20, ebp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xc8addc40 sched_switch(c8addc40,0,104,1ba,e476fbc0,...) at sched_switch+0x4e2/frame 0xe476fb88 mi_switch(104,0,c11f2745,200,c8a24d98,...) at mi_switch+0x1bf/frame 0xe476fbc0 sleepq_switch(c8addc40,0,c11f2745,276,c8addc40,...) at sleepq_switch+0x1c5/frame 0xe476fbf4 sleepq_wait(c8a24d80,0,c11d729a,0,0,...) at sleepq_wait+0x48/frame 0xe476fc18 _sleep(c8a24d80,c8a24d98,0,c11d729a,0,...) at _sleep+0x3a1/frame 0xe476fc74 taskqueue_thread_loop(c1643210,e476fce8,c11e53ac,3dc,0,...) at taskqueue_thread_loop+0x144/frame 0xe476fcac fork_exit(c0bb3aa0,c1643210,e476fce8) at fork_exit+0x7e/frame 0xe476fcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe476fcd4 --- trap 0, eip = 0, esp = 0xe476fd20, ebp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xc8add620 sched_switch(c8add620,0,104,1ba,e4775bc0,...) at sched_switch+0x4e2/frame 0xe4775b88 mi_switch(104,0,c11f2745,200,c8a24c18,...) at mi_switch+0x1bf/frame 0xe4775bc0 sleepq_switch(c8add620,0,c11f2745,276,c8add620,...) at sleepq_switch+0x1c5/frame 0xe4775bf4 sleepq_wait(c8a24c00,0,c11d729a,0,0,...) at sleepq_wait+0x48/frame 0xe4775c18 _sleep(c8a24c00,c8a24c18,0,c11d729a,0,...) at _sleep+0x3a1/frame 0xe4775c74 taskqueue_thread_loop(c163f388,e4775ce8,c11e53ac,3dc,0,...) at taskqueue_thread_loop+0x144/frame 0xe4775cac fork_exit(c0bb3aa0,c163f388,e4775ce8) at fork_exit+0x7e/frame 0xe4775cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4775cd4 --- trap 0, eip = 0, esp = 0xe4775d20, ebp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xc8add310 sched_switch(c8add310,0,104,1ba,e4778bd4,...) at sched_switch+0x4e2/frame 0xe4778b9c mi_switch(104,0,c11f2745,200,c1587b94,...) at mi_switch+0x1bf/frame 0xe4778bd4 sleepq_switch(c8add310,0,c11f2745,276,c8a24b80,...) at sleepq_switch+0x1c5/frame 0xe4778c08 sleepq_wait(c8a24b80,0,c11ecaff,c11d729a,0,...) at sleepq_wait+0x48/frame 0xe4778c2c msleep_spin_sbt(c8a24b80,c8a24b98,c11d729a,0,0,...) at msleep_spin_sbt+0x241/frame 0xe4778c74 taskqueue_thread_loop(c1635e70,e4778ce8,c11e53ac,3dc,0,...) at taskqueue_thread_loop+0xf3/frame 0xe4778cac fork_exit(c0bb3aa0,c1635e70,e4778ce8) at fork_exit+0x7e/frame 0xe4778cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4778cd4 --- trap 0, eip = 0, esp = 0xe4778d20, ebp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xc8add000 sched_switch(c8add000,0,104,1ba,e477bbd4,...) at sched_switch+0x4e2/frame 0xe477bb9c mi_switch(104,0,c11f2745,200,c1587b94,...) at mi_switch+0x1bf/frame 0xe477bbd4 sleepq_switch(c8add000,0,c11f2745,276,c8a24b80,...) at sleepq_switch+0x1c5/frame 0xe477bc08 sleepq_wait(c8a24b80,0,c11ecaff,c11d729a,0,...) at sleepq_wait+0x48/frame 0xe477bc2c msleep_spin_sbt(c8a24b80,c8a24b98,c11d729a,0,0,...) at msleep_spin_sbt+0x241/frame 0xe477bc74 taskqueue_thread_loop(c1635e70,e477bce8,c11e53ac,3dc,0,...) at taskqueue_thread_loop+0xf3/frame 0xe477bcac fork_exit(c0bb3aa0,c1635e70,e477bce8) at fork_exit+0x7e/frame 0xe477bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe477bcd4 --- trap 0, eip = 0, esp = 0xe477bd20, ebp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xc8a2ec40 sched_switch(c8a2ec40,0,104,1ba,e477ebd4,...) at sched_switch+0x4e2/frame 0xe477eb9c mi_switch(104,0,c11f2745,200,c1587b94,...) at mi_switch+0x1bf/frame 0xe477ebd4 sleepq_switch(c8a2ec40,0,c11f2745,276,c8a24b80,...) at sleepq_switch+0x1c5/frame 0xe477ec08 sleepq_wait(c8a24b80,0,c11ecaff,c11d729a,0,...) at sleepq_wait+0x48/frame 0xe477ec2c msleep_spin_sbt(c8a24b80,c8a24b98,c11d729a,0,0,...) at msleep_spin_sbt+0x241/frame 0xe477ec74 taskqueue_thread_loop(c1635e70,e477ece8,c11e53ac,3dc,0,...) at taskqueue_thread_loop+0xf3/frame 0xe477ecac fork_exit(c0bb3aa0,c1635e70,e477ece8) at fork_exit+0x7e/frame 0xe477ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe477ecd4 --- trap 0, eip = 0, esp = 0xe477ed20, ebp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xc8c7a930 sched_switch(c8c7a930,0,104,1ba,ed96abd4,...) at sched_switch+0x4e2/frame 0xed96ab9c mi_switch(104,0,c11f2745,200,c15872ac,...) at mi_switch+0x1bf/frame 0xed96abd4 sleepq_switch(c8c7a930,0,c11f2745,276,c8c8ec80,...) at sleepq_switch+0x1c5/frame 0xed96ac08 sleepq_wait(c8c8ec80,0,c11ecaff,c11d729a,0,...) at sleepq_wait+0x48/frame 0xed96ac2c msleep_spin_sbt(c8c8ec80,c8c8ec98,c11d729a,0,0,...) at msleep_spin_sbt+0x241/frame 0xed96ac74 taskqueue_thread_loop(c163431c,ed96ace8,c11e53ac,3dc,0,...) at taskqueue_thread_loop+0xf3/frame 0xed96acac fork_exit(c0bb3aa0,c163431c,ed96ace8) at fork_exit+0x7e/frame 0xed96acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed96acd4 --- trap 0, eip = 0, esp = 0xed96ad20, ebp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xc8c7a620 sched_switch(c8c7a620,0,104,1ba,ed96db80,...) at sched_switch+0x4e2/frame 0xed96db48 mi_switch(104,0,c11f2745,200,101,...) at mi_switch+0x1bf/frame 0xed96db80 sleepq_switch(c8c7a620,0,c11f2745,299,c8c7a620,...) at sleepq_switch+0x1c5/frame 0xed96dbb4 sleepq_timedwait(c156aaed,0,2,0,0,...) at sleepq_timedwait+0x48/frame 0xed96dbd8 _sleep(c156aaed,0,0,c11d729a,fffffc88,...) at _sleep+0x33d/frame 0xed96dc34 pause_sbt(c11d729a,fffffc88,2,0,0,...) at pause_sbt+0x112/frame 0xed96dc70 deadlkres(0,ed96dce8,c11e53ac,3dc,0,...) at deadlkres+0x81/frame 0xed96dcac fork_exit(c0b07210,0,ed96dce8) at fork_exit+0x7e/frame 0xed96dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed96dcd4 --- trap 0, eip = 0, esp = 0xed96dd20, ebp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xc8ede310 sched_switch(c8ede310,0,104,1ba,ed974bc0,...) at sched_switch+0x4e2/frame 0xed974b88 mi_switch(104,0,c11f2745,200,c8a24b18,...) at mi_switch+0x1bf/frame 0xed974bc0 sleepq_switch(c8ede310,0,c11f2745,276,c8ede310,...) at sleepq_switch+0x1c5/frame 0xed974bf4 sleepq_wait(c8a24b00,0,c11d729a,0,0,...) at sleepq_wait+0x48/frame 0xed974c18 _sleep(c8a24b00,c8a24b18,0,c11d729a,0,...) at _sleep+0x3a1/frame 0xed974c74 taskqueue_thread_loop(c14a1ba4,ed974ce8,c11e53ac,3dc,0,...) at taskqueue_thread_loop+0x144/frame 0xed974cac fork_exit(c0bb3aa0,c14a1ba4,ed974ce8) at fork_exit+0x7e/frame 0xed974cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed974cd4 --- trap 0, eip = 0, esp = 0xed974d20, ebp = 0 --- db:0:allt> call doadump Physical memory: 3431 MB Dumping 535 MB: 520 504 488 472 456 440 424 408 392 376 360 344 328 312 296 280 264 248 232 216 200 184 168 152 136 120 104 88 72 56 40 24 8 Dump complete = 0 db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 2 (kgdb) proc 5992 [Switching to thread 154 (Thread 101339)]#0 sched_switch (td=0xce54f310, newtd=, flags=) at ../../../kern/sched_ule.c:1956 1956 cpuid = PCPU_GET(cpuid); Current language: auto; currently minimal (kgdb) bt #0 sched_switch (td=0xce54f310, newtd=, flags=) at ../../../kern/sched_ule.c:1956 #1 0xc0b6945f in mi_switch (flags=, newtd=0xc1579310) at ../../../kern/kern_synch.c:492 #2 0xc0baf725 in sleepq_switch (wchan=, pri=0x0) at ../../../kern/subr_sleepqueue.c:552 #3 0xc0baf508 in sleepq_wait (wchan=0xc1589400, pri=0x0) at ../../../kern/subr_sleepqueue.c:631 #4 0xc0b07abe in _cv_wait (cvp=0xc1589400, lock=0xc1589380) at ../../../kern/kern_condvar.c:139 #5 0xc0bbb67f in vmem_xalloc (vm=0xc1589380, size0=0x1000, align=, phase=0xc15b43b0, nocross=, minaddr=0xc15b43d0, maxaddr=0xc15b43b0, flags=0x2002, addrp=) at ../../../kern/subr_vmem.c:1211 #6 0xc0bbb434 in vmem_alloc (vm=0xc1589380, size=0x1000, flags=0x2002, addrp=) at ../../../kern/subr_vmem.c:1097 #7 0xc0e1cd2b in kmem_malloc (vmem=0xc1589380, size=0x1000, flags=0x102) at ../../../vm/vm_kern.c:317 #8 0xc0e14c58 in page_alloc (zone=0xc916b780, bytes=0x1000, pflag=0xc8080883 "\002", wait=0x102) at ../../../vm/uma_core.c:1106 #9 0xc0e14092 in keg_alloc_slab (keg=0xc9324100, zone=0xc916b780, wait=) at ../../../vm/uma_core.c:980 #10 0xc0e1583f in keg_fetch_slab (keg=0xc9324100, zone=0xc916b780, flags=) at ../../../vm/uma_core.c:2394 #11 0xc0e15bbd in zone_fetch_slab (keg=, flags=0x102) at ../../../vm/uma_core.c:2426 #12 0xc0e15c37 in zone_import (zone=0x74, max=0xc9324100, flags=) at ../../../vm/uma_core.c:2551 #13 0xc0e12d9f in uma_zalloc_arg (zone=0xc916b780, flags=) at ../../../vm/uma_core.c:2581 #14 0xc07a83d6 in mdctlioctl (dev=, cmd=, addr=, td=) at uma.h:336 #15 0xc0a36261 in devfs_ioctl_f (fp=, com=0xc1b46d00, data=, cred=, td=0xce54f310) at ../../../fs/devfs/devfs_vnops.c:801 #16 0xc0bc4e4c in kern_ioctl (td=0x2, fd=, com=0x9, data=) at file.h:320 #17 0xc0bc4afb in sys_ioctl (td=, uap=) at ../../../kern/sys_generic.c:718 #18 0xc106cb6a in syscall (frame=) at subr_syscall.c:133 #19 0xc1056211 in Xint0x80_syscall () at ../../../i386/i386/exception.s:269 #20 0x00000033 in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb) f 5 #5 0xc0bbb67f in vmem_xalloc (vm=0xc1589380, size0=0x1000, align=, phase=0xc15b43b0, nocross=, minaddr=0xc15b43d0, maxaddr=0xc15b43b0, flags=0x2002, addrp=) at ../../../kern/subr_vmem.c:1211 1211 VMEM_CONDVAR_WAIT(vm); (kgdb) l 1206 } 1207 if ((flags & M_NOWAIT) != 0) { 1208 error = ENOMEM; 1209 break; 1210 } 1211 VMEM_CONDVAR_WAIT(vm); 1212 } 1213 out: 1214 VMEM_UNLOCK(vm); 1215 if (error != 0 && (flags & M_NOWAIT) == 0) (kgdb) p *vm $1 = {vm_lock = {lock_object = {lo_name = 0xc11e81f9 "kmem arena", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc8584428}, mtx_lock = 0x4}, vm_cv = {cv_description = 0xc11e81f9 "kmem arena", cv_waiters = 0x2}, vm_name = 0xc1589408 "kmem arena", vm_alllist = {le_next = 0xc1588f80, le_prev = 0xc158981c}, vm_hash0 = 0xc1589424, vm_freelist = 0xc1589464, vm_seglist = {tqh_first = 0xc1fb31c0, tqh_last = 0xd8f2a55c}, vm_hashlist = 0xd998e000, vm_hashsize = 0x20000, vm_qcache_max = 0x0, vm_quantum_mask = 0xfff, vm_import_quantum = 0x0, vm_quantum_shift = 0xc, vm_freetags = {lh_first = 0xe1fb6604}, vm_nfreetags = 0x4, vm_nbusytag = 0x18a9e, vm_inuse = 0x19c00000, vm_size = 0x19c00000, vm_importfn = 0, vm_releasefn = 0, vm_arg = 0x0, vm_reclaimfn = 0xc0b43ba0 , vm_qcache = 0xc1589590} (kgdb) $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/vm/vm_kern.c =================================================================== --- /usr/src/sys/vm/vm_kern.c (revision 281351) +++ /usr/src/sys/vm/vm_kern.c (working copy) @@ -162,7 +162,7 @@ kmem_alloc_attr(vmem_t *vmem, vm_size_t size, int vm_offset_t addr; vm_ooffset_t offset; vm_page_t m; - int pflags, tries; + int pflags, level; int i; size = round_page(size); @@ -172,16 +172,17 @@ kmem_alloc_attr(vmem_t *vmem, vm_size_t size, int pflags = malloc2vm_flags(flags) | VM_ALLOC_NOBUSY | VM_ALLOC_WIRED; VM_OBJECT_WLOCK(object); for (i = 0; i < size; i += PAGE_SIZE) { - tries = 0; + level = 0; retry: m = vm_page_alloc_contig(object, OFF_TO_IDX(offset + i), pflags, 1, low, high, PAGE_SIZE, 0, memattr); if (m == NULL) { VM_OBJECT_WUNLOCK(object); - if (tries < ((flags & M_NOWAIT) != 0 ? 1 : 3)) { - vm_pageout_grow_cache(tries, low, high); + if (level < ((flags & M_NOWAIT) != 0 ? 1 : 3)) { + vm_pageout_reclaim_contig(1, low, high, + PAGE_SIZE, 0, level); VM_OBJECT_WLOCK(object); - tries++; + level++; goto retry; } /* @@ -226,7 +227,7 @@ kmem_alloc_contig(struct vmem *vmem, vm_size_t siz vm_offset_t addr, tmp; vm_ooffset_t offset; vm_page_t end_m, m; - int pflags, tries; + int pflags, level; size = round_page(size); if (vmem_alloc(vmem, size, flags | M_BESTFIT, &addr)) @@ -234,16 +235,17 @@ kmem_alloc_contig(struct vmem *vmem, vm_size_t siz offset = addr - VM_MIN_KERNEL_ADDRESS; pflags = malloc2vm_flags(flags) | VM_ALLOC_NOBUSY | VM_ALLOC_WIRED; VM_OBJECT_WLOCK(object); - tries = 0; + level = 0; retry: m = vm_page_alloc_contig(object, OFF_TO_IDX(offset), pflags, atop(size), low, high, alignment, boundary, memattr); if (m == NULL) { VM_OBJECT_WUNLOCK(object); - if (tries < ((flags & M_NOWAIT) != 0 ? 1 : 3)) { - vm_pageout_grow_cache(tries, low, high); + if (level < ((flags & M_NOWAIT) != 0 ? 1 : 3)) { + vm_pageout_reclaim_contig(atop(size), low, high, + alignment, boundary, level); VM_OBJECT_WLOCK(object); - tries++; + level++; goto retry; } vmem_free(vmem, addr, size); Index: /usr/src/sys/vm/vm_pageout.c =================================================================== --- /usr/src/sys/vm/vm_pageout.c (revision 281351) +++ /usr/src/sys/vm/vm_pageout.c (working copy) @@ -107,6 +107,7 @@ __FBSDID("$FreeBSD$"); #include #include #include +#include #include #include #include @@ -122,6 +123,8 @@ static int vm_pageout_clean(vm_page_t m); static int vm_pageout_cluster(vm_page_t m); static void vm_pageout_scan(struct vm_domain *vmd, int pass); static void vm_pageout_mightbe_oom(struct vm_domain *vmd, int pass); +static boolean_t vm_pageout_candidate(vm_page_t); +static boolean_t vm_pageout_contig(vm_page_t p_start, u_long npages, int level); SYSINIT(pagedaemon_init, SI_SUB_KTHREAD_PAGE, SI_ORDER_FIRST, vm_pageout_init, NULL); @@ -231,8 +234,6 @@ SYSCTL_INT(_vm, OID_AUTO, max_wired, CTLFLAG_RW, &vm_page_max_wired, 0, "System-wide limit to wired page count"); static boolean_t vm_pageout_fallback_object_lock(vm_page_t, vm_page_t *); -static boolean_t vm_pageout_launder(struct vm_pagequeue *pq, int, vm_paddr_t, - vm_paddr_t); #if !defined(NO_SWAPPING) static void vm_pageout_map_deactivate_pages(vm_map_t, long); static void vm_pageout_object_deactivate_pages(pmap_t, vm_object_t, long); @@ -578,107 +579,187 @@ vm_pageout_flush(vm_page_t *mc, int count, int fla return (numpagedout); } +static __noinline boolean_t +vm_pageout_candidate(vm_page_t p) +{ + /* Can't pageout wired, busy, or held pages */ + if (p->wire_count || p->hold_count || + (p->oflags & VPO_UNMANAGED) != 0 || + vm_page_busied(p)) + return (FALSE); + return (TRUE); +} + +/* + * Count the number of pages requiring pageout processing to create + * a contiguous free block. + * + * The interpretation of level is as follows: + * 0: only inactive or free pages + * 1: include dirty pages + * 2: include active pages + * + * Held, busy, or wired pages cause a return of -1. + */ +int +vm_pageout_count_pages(vm_page_t p_start, u_long npages, int level) +{ + vm_page_t p; + int i, workpages; + + workpages = 0; + for (i = 0; i < npages; i++) { + /* + * All of these checks are done locklessly + * because the results can change as soon + * as we return. This is a best-effort + * interface. + */ + p = &p_start[i]; + if (!vm_pageout_candidate(p)) + return (-1); + /* Dirty is not coherent until we check pmap. */ + if (p->dirty) { + if (level < 1) + return (-1); + workpages++; + continue; + } + if (p->queue == PQ_ACTIVE) { + if (level < 2) + return (-1); + workpages++; + continue; + } + /* + * Only count INACTIVE and reservations against level 0. + */ + if (level > 0) + continue; + if (p->queue == PQ_INACTIVE) + workpages++; + else if (p->order == VM_NFREEORDER && p->queue == PQ_NONE) + workpages++; + } + + return (workpages); +} + static boolean_t -vm_pageout_launder(struct vm_pagequeue *pq, int tries, vm_paddr_t low, - vm_paddr_t high) +vm_pageout_contig(vm_page_t p_start, u_long npages, int level) { - struct mount *mp; - struct vnode *vp; vm_object_t object; - vm_paddr_t pa; - vm_page_t m, m_tmp, next; - int lockmode; + vm_page_t p; + int i; - vm_pagequeue_lock(pq); - TAILQ_FOREACH_SAFE(m, &pq->pq_pl, plinks.q, next) { - if ((m->flags & PG_MARKER) != 0) + if (level > 1) { + /* Scan and deactivate. */ + for (i = 0; i < npages; i++) { + p = &p_start[i]; + vm_page_lock(p); + if (!vm_pageout_candidate(p)) { + vm_page_unlock(p); + return (FALSE); + } + if (p->queue != PQ_ACTIVE) { + vm_page_unlock(p); + continue; + } + vm_page_deactivate(p); + vm_page_unlock(p); + } + } + /* Scan and free, cleaning if allowed. */ + for (i = 0; i < npages; i++) { + p = &p_start[i]; + object = p->object; + if (object == NULL) { + vm_page_lock(p); + if (p->object != NULL) { + vm_page_unlock(p); + i--; /* Retry */ + continue; + } + if (!vm_pageout_candidate(p)) { + vm_page_unlock(p); + return (FALSE); + } +#if VM_NRESERVLEVEL > 0 + if (p->order == VM_NFREEORDER && p->queue == PQ_NONE) { + mtx_lock(&vm_page_queue_free_mtx); + vm_page_unlock(p); + vm_reserv_reclaim_page(p); + mtx_unlock(&vm_page_queue_free_mtx); + } else +#endif + vm_page_unlock(p); continue; - pa = VM_PAGE_TO_PHYS(m); - if (pa < low || pa + PAGE_SIZE > high) + } + VM_OBJECT_WLOCK(object); + if (object != p->object) { + VM_OBJECT_WUNLOCK(object); + i--; /* Retry this page. */ continue; - if (!vm_pageout_page_lock(m, &next) || m->hold_count != 0) { - vm_page_unlock(m); - continue; } - object = m->object; - if ((!VM_OBJECT_TRYWLOCK(object) && - (!vm_pageout_fallback_object_lock(m, &next) || - m->hold_count != 0)) || vm_page_busied(m)) { - vm_page_unlock(m); + vm_page_lock(p); + if (!vm_pageout_candidate(p) || p->queue == PQ_ACTIVE) + goto fail; + if (p->queue == PQ_NONE) { + vm_page_unlock(p); VM_OBJECT_WUNLOCK(object); continue; } - vm_page_test_dirty(m); - if (m->dirty == 0 && object->ref_count != 0) - pmap_remove_all(m); - if (m->dirty != 0) { - vm_page_unlock(m); - if (tries == 0 || (object->flags & OBJ_DEAD) != 0) { - VM_OBJECT_WUNLOCK(object); - continue; - } - if (object->type == OBJT_VNODE) { - vm_pagequeue_unlock(pq); - vp = object->handle; - vm_object_reference_locked(object); - VM_OBJECT_WUNLOCK(object); - (void)vn_start_write(vp, &mp, V_WAIT); - lockmode = MNT_SHARED_WRITES(vp->v_mount) ? - LK_SHARED : LK_EXCLUSIVE; - vn_lock(vp, lockmode | LK_RETRY); - VM_OBJECT_WLOCK(object); - vm_object_page_clean(object, 0, 0, OBJPC_SYNC); - VM_OBJECT_WUNLOCK(object); - VOP_UNLOCK(vp, 0); - vm_object_deallocate(object); - vn_finished_write(mp); - return (TRUE); - } else if (object->type == OBJT_SWAP || - object->type == OBJT_DEFAULT) { - vm_pagequeue_unlock(pq); - m_tmp = m; - vm_pageout_flush(&m_tmp, 1, VM_PAGER_PUT_SYNC, - 0, NULL, NULL); - VM_OBJECT_WUNLOCK(object); - return (TRUE); - } - } else { + pmap_remove_all(p); + if (p->dirty) { + /* Have we been asked to clean dirty pages? */ + if (level < 1) + goto fail; /* - * Dequeue here to prevent lock recursion in - * vm_page_cache(). + * We don't bother paging objects that are "dead". */ - vm_page_dequeue_locked(m); - vm_page_cache(m); - vm_page_unlock(m); + if (object->flags & OBJ_DEAD) + goto fail; + if (disable_swap_pageouts && + (object->type == OBJT_SWAP || + object->type == OBJT_DEFAULT)) + goto fail; + if (vm_pageout_clean(p)) + return (FALSE); + } else { + vm_page_free(p); + vm_page_unlock(p); + VM_OBJECT_WUNLOCK(object); } - VM_OBJECT_WUNLOCK(object); } - vm_pagequeue_unlock(pq); + return (TRUE); + +fail: + vm_page_unlock(p); + VM_OBJECT_WUNLOCK(object); return (FALSE); } - /* - * Increase the number of cached pages. The specified value, "tries", - * determines which categories of pages are cached: + * Attempt to free a contiguous region of physical memory within the + * specified boundaries. * * 0: All clean, inactive pages within the specified physical address range - * are cached. Will not sleep. + * are freed. Will not sleep. * 1: The vm_lowmem handlers are called. All inactive pages within - * the specified physical address range are cached. May sleep. + * the specified physical address range are reclaimed. May sleep. * 2: The vm_lowmem handlers are called. All inactive and active pages - * within the specified physical address range are cached. May sleep. + * within the specified physical address range are freed. May sleep. */ -void -vm_pageout_grow_cache(int tries, vm_paddr_t low, vm_paddr_t high) +int +vm_pageout_reclaim_contig(u_long npages, vm_paddr_t low, vm_paddr_t high, + u_long alignment, vm_paddr_t boundary, int level) { - int actl, actmax, inactl, inactmax, dom, initial_dom; - static int start_dom = 0; + vm_page_t p, lastp; - if (tries > 0) { + if (level > 0) { /* * Decrease registered cache sizes. The vm_lowmem handlers * may acquire locks and/or sleep, so they can only be invoked - * when "tries" is greater than zero. + * when "level" is greater than zero. */ SDT_PROBE0(vm, , , vm__lowmem_cache); EVENTHANDLER_INVOKE(vm_lowmem, 0); @@ -689,56 +770,25 @@ static boolean_t */ uma_reclaim(); } - - /* - * Make the next scan start on the next domain. - */ - initial_dom = atomic_fetchadd_int(&start_dom, 1) % vm_ndomains; - - inactl = 0; - inactmax = vm_cnt.v_inactive_count; - actl = 0; - actmax = tries < 2 ? 0 : vm_cnt.v_active_count; - dom = initial_dom; - - /* - * Scan domains in round-robin order, first inactive queues, - * then active. Since domain usually owns large physically - * contiguous chunk of memory, it makes sense to completely - * exhaust one domain before switching to next, while growing - * the pool of contiguous physical pages. - * - * Do not even start launder a domain which cannot contain - * the specified address range, as indicated by segments - * constituting the domain. - */ -again: - if (inactl < inactmax) { - if (vm_phys_domain_intersects(vm_dom[dom].vmd_segs, - low, high) && - vm_pageout_launder(&vm_dom[dom].vmd_pagequeues[PQ_INACTIVE], - tries, low, high)) { - inactl++; - goto again; - } - if (++dom == vm_ndomains) - dom = 0; - if (dom != initial_dom) - goto again; + lastp = NULL; + for (;;) { + mtx_lock(&vm_page_queue_free_mtx); + p = vm_phys_find_contig(npages, low, high, alignment, boundary, + level); + mtx_unlock(&vm_page_queue_free_mtx); + if (p == NULL) + break; + if (vm_pageout_contig(p, npages, level) == 0) + return (0); + /* + * Prevent looping if pageout_pages failed but the same + * group was selected again. + */ + if (p == lastp) + break; + lastp = p; } - if (actl < actmax) { - if (vm_phys_domain_intersects(vm_dom[dom].vmd_segs, - low, high) && - vm_pageout_launder(&vm_dom[dom].vmd_pagequeues[PQ_ACTIVE], - tries, low, high)) { - actl++; - goto again; - } - if (++dom == vm_ndomains) - dom = 0; - if (dom != initial_dom) - goto again; - } + return (ENOENT); } #if !defined(NO_SWAPPING) Index: /usr/src/sys/vm/vm_pageout.h =================================================================== --- /usr/src/sys/vm/vm_pageout.h (revision 281351) +++ /usr/src/sys/vm/vm_pageout.h (working copy) @@ -102,7 +102,9 @@ extern void vm_waitpfault(void); #ifdef _KERNEL int vm_pageout_flush(vm_page_t *, int, int, int, int *, boolean_t *); -void vm_pageout_grow_cache(int, vm_paddr_t, vm_paddr_t); +int vm_pageout_reclaim_contig(u_long, vm_paddr_t, vm_paddr_t, u_long, + vm_paddr_t, int); +int vm_pageout_count_pages(vm_page_t, u_long, int); void vm_pageout_oom(int shortage); #endif #endif /* _VM_VM_PAGEOUT_H_ */ Index: /usr/src/sys/vm/vm_phys.c =================================================================== --- /usr/src/sys/vm/vm_phys.c (revision 281351) +++ /usr/src/sys/vm/vm_phys.c (working copy) @@ -66,6 +66,7 @@ __FBSDID("$FreeBSD$"); #include #include #include +#include _Static_assert(sizeof(long) * NBBY >= VM_PHYSSEG_MAX, "Too many physsegs."); @@ -1213,6 +1214,91 @@ done: return (m_ret); } +/* + * Find a range of contiguous free pages that can be easily reclaimed + * with the set of properties matching those defined by + * vm_phys_alloc_contig(). + */ +vm_page_t +vm_phys_find_contig(u_long npages, vm_paddr_t low, vm_paddr_t high, + u_long alignment, vm_paddr_t boundary, int level) +{ + struct vm_freelist *fl; + struct vm_phys_seg *seg; + vm_paddr_t pa, size; + vm_page_t m_ret, m_min; + u_long min_workpages, workpages; + int dom, domain, flind, oind, order, pind; + + mtx_assert(&vm_page_queue_free_mtx, MA_OWNED); + size = npages << PAGE_SHIFT; + KASSERT(size != 0, + ("vm_phys_reclaim_contig: size must not be 0")); + KASSERT((alignment & (alignment - 1)) == 0, + ("vm_phys_reclaim_contig: alignment must be a power of 2")); + KASSERT((boundary & (boundary - 1)) == 0, + ("vm_phys_reclaim_contig: boundary must be a power of 2")); + /* Compute the queue that is the best fit for npages. */ + for (order = 0; (1 << order) < npages; order++); + order--; + m_min = NULL; + workpages = 0; + dom = 0; +restartdom: + domain = vm_rr_selectdomain(); + for (flind = 0; flind < vm_nfreelists; flind++) { + for (oind = min(order, VM_NFREEORDER-1); oind >= 0; oind--) { + for (pind = 0; pind < VM_NFREEPOOL; pind++) { + fl = &vm_phys_free_queues[domain][flind][pind][0]; + TAILQ_FOREACH(m_ret, &fl[oind].pl, plinks.q) { + /* + * A free list may contain physical + * pages from one or more segments. + */ + seg = &vm_phys_segs[m_ret->segind]; + if (seg->start > high || + low >= seg->end) + continue; + + /* + * Determine if the blocks are within + * the range, satisfy the alignment, + * and do not cross the boundary. + */ + pa = VM_PAGE_TO_PHYS(m_ret); + if (pa < low || + pa + size > high || + pa + size > seg->end || + (pa & (alignment - 1)) != 0 || + ((pa ^ (pa + size - 1)) & + ~(boundary - 1)) != 0) + continue; + + workpages = vm_pageout_count_pages( + &m_ret[1 << oind], + npages - (1 << oind), level); + /* + * Don't scan further if we found an + * easy match. + */ + if (workpages == 0) + return (m_ret); + if (workpages != -1 && + (m_min == NULL || + workpages < min_workpages)) { + m_min = m_ret; + min_workpages = workpages; + } + } + } + } + } + if (++dom < vm_ndomains) + goto restartdom; + return (m_min); +} + + #ifdef DDB /* * Show the number of physical pages in each of the free lists. Index: /usr/src/sys/vm/vm_phys.h =================================================================== --- /usr/src/sys/vm/vm_phys.h (revision 281351) +++ /usr/src/sys/vm/vm_phys.h (working copy) @@ -72,6 +72,8 @@ void vm_phys_add_page(vm_paddr_t pa); void vm_phys_add_seg(vm_paddr_t start, vm_paddr_t end); vm_page_t vm_phys_alloc_contig(u_long npages, vm_paddr_t low, vm_paddr_t high, u_long alignment, vm_paddr_t boundary); +vm_page_t vm_phys_find_contig(u_long npages, vm_paddr_t low, vm_paddr_t high, + u_long alignment, vm_paddr_t boundary, int level); vm_page_t vm_phys_alloc_freelist_pages(int freelist, int pool, int order); vm_page_t vm_phys_alloc_pages(int pool, int order); boolean_t vm_phys_domain_intersects(long mask, vm_paddr_t low, vm_paddr_t high); Index: /usr/src/sys/vm/vm_reserv.c =================================================================== --- /usr/src/sys/vm/vm_reserv.c (revision 281351) +++ /usr/src/sys/vm/vm_reserv.c (working copy) @@ -1011,6 +1011,24 @@ vm_reserv_reclaim_contig(u_long npages, vm_paddr_t } /* + * Breaks the reservation holding the page as long as it is partially + * populated. + */ +boolean_t +vm_reserv_reclaim_page(vm_page_t m) +{ + mtx_assert(&vm_page_queue_free_mtx, MA_OWNED); + vm_reserv_t rv; + + rv = vm_reserv_from_page(m); + if (rv->object == NULL || !rv->inpartpopq) + return (FALSE); + vm_reserv_reclaim(rv); + + return (TRUE); +} + +/* * Transfers the reservation underlying the given page to a new object. * * The object must be locked. Index: /usr/src/sys/vm/vm_reserv.h =================================================================== --- /usr/src/sys/vm/vm_reserv.h (revision 281351) +++ /usr/src/sys/vm/vm_reserv.h (working copy) @@ -57,6 +57,7 @@ int vm_reserv_level_iffullpop(vm_page_t m); boolean_t vm_reserv_reactivate_page(vm_page_t m); boolean_t vm_reserv_reclaim_contig(u_long npages, vm_paddr_t low, vm_paddr_t high, u_long alignment, vm_paddr_t boundary); +boolean_t vm_reserv_reclaim_page(vm_page_t m); boolean_t vm_reserv_reclaim_inactive(void); void vm_reserv_rename(vm_page_t m, vm_object_t new_object, vm_object_t old_object, vm_pindex_t old_object_offset); -- Type InUse MemUse HighUse Requests Size(s) scsi_cd 0 0K - 5 16 hdaa 9 56K - 9 256,512,1024,2048,16384,32768 hdac 2 1K - 2 64,512 hdacc 2 1K - 2 16 feeder 21 1K - 27 16,64 mixer 4 16K - 4 4096 UART 3 2K - 3 16,512,1024 USB 36 15K - 36 16,64,256,2048 USBdev 30 3K - 30 32,128,256 ddb_capture 1 64K - 1 65536 acpiintr 1 1K - 1 32 acpica 2578 135K - 48191 16,32,64,128,256,512,1024 acpitask 1 4K - 1 4096 acpisem 32 4K - 32 64,128 vtbuf 24 1944K - 46 2048 vt 11 3K - 11 256 acpidev 31 1K - 31 32 DEVFS3 184 23K - 415631 128 DEVFS1 161 41K - 415604 256 DEVFS_RULE 55 13K - 55 32,256 DEVFS 32 1K - 33 16,64 DEVFSP 1 1K - 100011 32 NFSD srvcache 0 0K - 686840 128 NFSD string 1 1K - 1 16 NFSD usrgroup 88 6K - 89 64 NFS fh 0 0K - 15086 32 NFSCL diroffdiroff 0 0K - 8 512 newnfsmnt 0 0K - 1 512 pfs_nodes 21 3K - 21 128 pfs_vncache 1 1K - 775 32 GEOM 253 45K - 1298000 16,32,64,128,256,512,1024,2048,8192 raid_data 0 0K - 277914 16,128 isadev 8 1K - 8 64 CAM SIM 6 1K - 6 128 CAM XPT 29 3K - 379 16,32,128,256,512,1024,2048,65536 CAM DEV 8 16K - 28 2048 CAM CCB 0 0K - 4508316 2048 CAM path 10 1K - 89 16 CAM periph 6 1K - 26 16,32,64,128 cdev 4 1K - 4 128 filedesc 12 85K - 19846 16,32,64,128,256,512,1024,2048,4096,8192,16384,32768,65536 sigio 1 1K - 7 32 filecaps 0 0K - 7 16,64 kdtrace 480 107K - 321553 64,256 kenv 98 8K - 118 16,32,64,128,4096 kqueue 2 2K - 1546 128,256,1024 proc-args 50 3K - 256678 16,32,64,128,256 hhook 9 2K - 9 128 ithread 83 7K - 83 16,64,128 KTRACE 100 13K - 100 128 linker 167 606K - 254 16,32,64,256,512,1024,2048,4096,8192,32768,65536 lockf 38 2K - 1105256 32,64 loginclass 3 1K - 3 64 devbuf 2515 2872K - 2578 16,32,64,128,256,512,1024,2048,4096,8192,65536 temp 31 227K - 7349791 16,32,64,128,256,512,1024,2048,4096,16384,32768,65536 ip6opt 4 1K - 7 32,256 ip6ndp 4 1K - 5 64,128 pci_link 16 2K - 16 64,128 module 531 34K - 534 64,128 mtx_pool 2 8K - 2 4096 osd 2 1K - 2 16,32 pmchooks 1 1K - 1 64 pgrp 39 3K - 178 64 session 35 5K - 152 128 proc 2 8K - 2 4096 subproc 387 360K - 306080 256,4096 cred 61 16K - 848452 256 plimit 19 5K - 144 256 uidinfo 4 2K - 134 64,1024 sysctl 0 0K - 496024 16,32 sysctloid 3717 118K - 3810 16,32,64,128 sysctltmp 0 0K - 498 16,64,256,1024 kbdmux 6 22K - 6 16,256,1024,2048,16384 tidhash 1 8K - 1 8192 callout 5 1308K - 5 umtx 910 86K - 910 64,128 p1003.1b 1 1K - 1 16 SWAP 2 2189K - 2 64 bus 1311 57K - 1852642 16,32,64,128,256,1024 bus-sc 78 128K - 3321 16,32,64,128,256,512,1024,2048,4096,8192,16384,32768,65536 devstat 28 57K - 28 16,4096 eventhandler 89 5K - 89 32,64,128 kobj 370 740K - 278411 2048 Per-cpu 1 1K - 1 16 rman 239 15K - 587 16,32,64 sbuf 0 0K - 1066305 16,32,64,128,256,512,1024,2048,4096,8192,16384,32768,65536 taskqueue 17 2K - 17 16,128 terminal 11 3K - 11 256 Unitno 43 2K - 2237920 16,64 vmem 3 521K - 187 64,128,256,512,1024,2048,4096,8192,16384,32768,65536 Witness 1539 3238K - 1539 2048,8192 ioctlops 1 1K - 621 256,512,1024,2048 select 47 3K - 47 64 iov 0 0K - 218809058 16,64,128,256,512 msg 4 25K - 4 1024,4096,16384 sem 4 101K - 4 1024,4096 shm 1 16K - 1 16384 tty 44 22K - 400016 512 pts 31 4K - 400003 128 mbuf_tag 0 0K - 11 32 shmfd 1 4K - 1 4096 soname 7 1K - 1992840 16,32,128 pcb 36 332K - 340 16,32,64,512,1024,4096,65536 acl 0 0K - 22 4096 biobuf 1 2K - 7680 1024,2048 vfscache 1 512K - 1 cl_savebuf 0 0K - 1491626 32,64 export_host 10 2K - 96210 128 vfs_hash 1 256K - 1 vnodes 1 1K - 389 16,128 mount 104 5K - 11438633 16,32,64,128,256 md_disk 160 5K - 184 16,2048 vnodemarker 0 0K - 1653143 512 BPF 2 1K - 2 64 ifnet 3 3K - 3 64,1024 ifaddr 43 8K - 43 16,32,64,128,256,1024,2048 ether_multi 47 2K - 47 16,32,64 clone 6 1K - 6 128 lltable 8 2K - 20 256 routetbl 32102 8022K - 64171 16,32,64,128,256 igmp 2 1K - 2 128 in_mfilter 1 1K - 1 512 in_multi 2 1K - 2 128 ip_moptions 2 1K - 2 32,128 sctp_a_it 0 0K - 2 16 sctp_vrf 1 1K - 1 64 sctp_ifa 4 1K - 4 128 sctp_ifn 2 1K - 2 128 sctp_iter 0 0K - 2 256 hostcache 1 16K - 1 16384 syncache 1 64K - 1 65536 in6_mfilter 1 1K - 1 512 in6_multi 27 2K - 27 16,128 ip6_moptions 2 1K - 2 32,128 mld 2 1K - 2 64 NFS FHA 0 0K - 687373 64 rpc 47 27K - 710740 16,32,64,256,512,1024,2048,8192 audit_evclass 187 3K - 231 16 pagedep 6 257K - 9111896 128,65536 inodedep 6 1025K - 52119760 256 bmsafemap 5 17K - 28871734 128,4096 newblk 5 2049K - 39061187 128 indirdep 0 0K - 229187 64,16384,32768 freefrag 0 0K - 3676802 64 freeblks 0 0K - 24929101 128 freefile 0 0K - 28584271 32 diradd 1 1K - 51246877 64 mkdir 0 0K - 11635450 64 dirrem 1 1K - 51242925 64 newdirblk 0 0K - 5943508 32 freework 4 1K - 25238200 64,128 freedep 0 0K - 1257 32 jaddref 0 0K - 1386 64 jremref 0 0K - 1381 64 jmvref 0 0K - 1 64 jnewblk 0 0K - 1290026 64 jfreefrag 0 0K - 513195 64 jseg 0 0K - 2778 128 jsegdep 0 0K - 1805988 32 sbdep 0 0K - 100800 32 savedino 0 0K - 32722358 256 jblocks 2 5K - 9 128,256,512,1024,2048,4096 softdep 4 2K - 15373 512 ufs_dirhash 65 18K - 919448 16,32,64,128,256,512,1024,2048,4096 ufs_quota 1 256K - 1 ufs_mount 15 64K - 46123 256,2048,4096,8192,16384,32768 vm_pgdata 2 257K - 2 64 UMAHash 5 19K - 22 256,512,1024,2048,4096,8192 md_sectors 159 636K - 159 4096 atkbddev 2 1K - 2 32 CAM queue 14 3K - 76 16,256 CAM dev queue 6 1K - 6 64 memdesc 1 4K - 1 4096 apmdev 2 1K - 2 64 madt_table 0 0K - 1 2048 io_apic 1 2K - 1 2048 entropy 2 1K - 40 16,4096 MCA 6 1K - 6 128 msi 2 1K - 2 64 nexusdev 4 1K - 4 16 linux 15 1K - 15 32,64 nullfs_hash 1 256K - 1 nullfs_node 0 0K - 773765 32 nullfs_mount 0 0K - 1 16 tmpfs mount 0 0K - 15360 128 tmpfs name 0 0K - 122880 16 ITEM SIZE LIMIT USED FREE REQ FAIL SLEEP UMA Kegs: 256, 0, 197, 43, 30917, 0, 0 UMA Zones: 456, 0, 197, 35, 30917, 0, 0 UMA Slabs: 88, 0, 26836, 29, 63259, 0, 0 UMA RCntSlabs: 96, 0, 930, 13, 930, 0, 0 UMA Hash: 128, 0, 3, 28, 8, 0, 0 4 Bucket: 16, 0, 223, 1777, 93624, 0, 0 6 Bucket: 24, 0, 50, 1119, 10370, 0, 0 8 Bucket: 32, 0, 512, 1613, 467759, 0, 0 12 Bucket: 48, 0, 22, 1555, 26345, 0, 0 16 Bucket: 64, 0, 121, 1181, 105456, 8, 0 32 Bucket: 128, 0, 2831, 672, 120365,9224, 0 64 Bucket: 256, 0, 658, 992, 162290, 0, 0 128 Bucket: 512, 0, 1566, 1450, 332797, 0, 0 256 Bucket: 1024, 0, 7300, 824, 576987,434099, 0 vmem btag: 28, 0, 102765, 338, 1084937, 721, 0 VM OBJECT: 156, 0, 1653, 107597,30834928, 0, 0 RADIX NODE: 44, 854399, 18562, 123762,43957878, 0, 0 MAP: 144, 0, 3, 78, 3, 0, 0 KMAP ENTRY: 76, 0, 5, 151, 5, 0, 0 MAP ENTRY: 76, 0, 1237, 3495,12340478, 0, 0 VMSPACE: 240, 0, 53, 411, 305721, 0, 0 fakepg: 68, 0, 0, 522, 254, 0, 0 mt_zone: 2060, 0, 371, 4, 372, 0, 0 16: 16, 0, 15, 1235, 1158, 0, 0 16: 16, 0, 2277, 723, 2372, 0, 0 16: 16, 0, 3, 497, 3, 0, 0 16: 16, 0, 332, 1418, 343066, 0, 0 16: 16, 0, 47, 1203, 1374152, 0, 0 16: 16, 0, 399, 2601, 3023396, 0, 0 16: 16, 0, 111, 1639, 8656207, 0, 0 16: 16, 0, 47, 1703, 227307, 0, 0 32: 32, 0, 52, 1073, 1181, 0, 0 32: 32, 0, 507, 368, 513, 0, 0 32: 32, 0, 20, 355, 20, 0, 0 32: 32, 0, 1013, 1862, 774499, 0, 0 32: 32, 0, 122, 35878, 8825901, 0, 0 32: 32, 0, 1441, 1684, 1593450, 0, 0 32: 32, 0, 30, 188595,32450096, 0, 0 32: 32, 0, 59, 1566, 254993, 0, 0 64: 64, 0, 57, 997, 199, 0, 0 64: 64, 0, 1167, 4165,12455505, 0, 0 64: 64, 0, 216, 5612, 1400681, 0, 0 64: 64, 0, 1732, 18666, 1122700, 0, 0 64: 64, 0, 566, 101734,51380631, 0, 0 64: 64, 0, 1220, 293590,52107859, 0, 0 64: 64, 0, 22, 40712, 4379689, 0, 0 64: 64, 0, 203, 1347,218639927, 0, 0 128: 128, 0, 29, 746, 111643, 0, 0 128: 128, 0, 41, 827,28856518, 0, 0 128: 128, 0, 0, 132618,24931879, 0, 0 128: 128, 0, 341, 1426, 1416789, 0, 0 128: 128, 0, 88, 132499,48836907, 0, 0 128: 128, 0, 1186, 581, 82936, 0, 0 128: 128, 0, 19, 756, 64148, 0, 0 128: 128, 0, 101, 132610,25897097, 0, 0 256: 256, 0, 38, 217, 94, 0, 0 256: 256, 0, 440, 235, 15950, 0, 0 256: 256, 0, 325, 110, 337, 0, 0 256: 256, 0, 244, 1106, 1268029, 0, 0 256: 256, 0, 59, 20101,32791129, 0, 0 256: 256, 0, 32379, 161901,52170110, 0, 0 256: 256, 0, 22, 353, 1105512, 0, 0 256: 256, 0, 0, 315, 17323, 0, 0 512: 512, 0, 5, 147, 19364, 0, 0 512: 512, 0, 1, 63, 5, 0, 0 512: 512, 0, 0, 0, 0, 0, 0 512: 512, 0, 42, 1894, 658417, 0, 0 512: 512, 0, 49, 999, 5466609, 0, 0 512: 512, 0, 37, 83, 38, 0, 0 512: 512, 0, 1, 119, 27, 0, 0 512: 512, 0, 0, 184, 2055767, 0, 0 1024: 1024, 0, 3, 49, 69, 0, 0 1024: 1024, 0, 0, 28, 4, 0, 0 1024: 1024, 0, 0, 0, 0, 0, 0 1024: 1024, 0, 7, 85, 21211, 0, 0 1024: 1024, 0, 2, 78, 900609, 0, 0 1024: 1024, 0, 20, 136, 391, 0, 0 1024: 1024, 0, 2, 50, 30, 0, 0 1024: 1024, 0, 3, 77, 15555, 0, 0 2048: 2048, 0, 3, 57, 689230, 0, 0 2048: 2048, 0, 2, 24, 29, 0, 0 2048: 2048, 0, 0, 0, 0, 0, 0 2048: 2048, 0, 379, 69, 4789741, 0, 0 2048: 2048, 0, 9, 21, 1042, 0, 0 2048: 2048, 0, 1559, 2297, 9242, 0, 0 2048: 2048, 0, 5, 15, 40, 0, 0 2048: 2048, 0, 0, 30, 46329, 0, 0 4096: 4096, 0, 4, 0, 4, 0, 0 4096: 4096, 0, 6, 17, 15376, 0, 0 4096: 4096, 0, 229, 65, 305922, 0, 0 4096: 4096, 0, 10, 9, 1644, 0, 0 4096: 4096, 0, 16, 14, 4871, 0, 0 4096: 4096, 0, 32, 3, 37, 0, 0 4096: 4096, 0, 4, 21, 15414, 0, 0 4096: 4096, 0, 0, 5, 38, 0, 0 8192: 8192, 0, 2, 0, 2, 0, 0 8192: 8192, 0, 2, 0, 2, 166, 0 8192: 8192, 0, 0, 0, 0, 0, 0 8192: 8192, 0, 6, 4, 355, 0, 0 8192: 8192, 0, 0, 12, 1800, 0, 0 8192: 8192, 0, 2, 2, 4, 0, 0 8192: 8192, 0, 2, 20, 15405, 0, 0 8192: 8192, 0, 3, 22, 200917, 0, 0 16384: 16384, 0, 3, 0, 3, 0, 0 16384: 16384, 0, 0, 0, 0, 0, 0 16384: 16384, 0, 0, 7, 21, 0, 0 16384: 16384, 0, 2, 8, 469, 0, 0 16384: 16384, 0, 6, 8, 4087, 0, 0 16384: 16384, 0, 1, 0, 1, 0, 0 16384: 16384, 0, 0, 5, 14, 0, 0 16384: 16384, 0, 0, 0, 0, 0, 0 32768: 32768, 0, 1, 0, 1, 0, 0 32768: 32768, 0, 0, 0, 0, 0, 0 32768: 32768, 0, 0, 21, 121842, 0, 0 32768: 32768, 0, 1, 8, 323, 0, 0 32768: 32768, 0, 0, 37, 2272, 0, 0 32768: 32768, 0, 1, 0, 1, 0, 0 32768: 32768, 0, 1, 2, 5, 0, 0 32768: 32768, 0, 0, 0, 0, 0, 0 65536: 65536, 0, 0, 4, 108, 0, 0 65536: 65536, 0, 1, 0, 1, 0, 0 65536: 65536, 0, 1, 0, 1, 0, 0 65536: 65536, 0, 1, 8, 195, 0, 0 65536: 65536, 0, 4, 29, 16454, 0, 0 65536: 65536, 0, 9, 0, 10, 0, 0 65536: 65536, 0, 0, 1, 1, 0, 0 65536: 65536, 0, 0, 0, 0, 0, 0 SLEEPQUEUE: 48, 0, 456, 598, 456, 0, 0 64 pcpu: 8, 0, 1745, 303, 1745, 0, 0 ptr pcpu: 4, 0, 0, 0, 0, 0, 0 Files: 56, 0, 154, 1408,32807624, 0, 0 filedesc0: 884, 0, 70, 242, 305763, 0, 0 TURNSTILE: 72, 0, 456, 195, 456, 0, 0 rl_entry: 28, 0, 292, 852, 292, 0, 0 umtx pi: 52, 0, 0, 0, 0, 0, 0 MAC labels: 20, 0, 0, 0, 0, 0, 0 PROC: 832, 0, 69, 247, 305762, 0, 0 THREAD: 784, 0, 409, 46, 15789, 0, 0 cpuset: 40, 0, 111, 989, 15505, 0, 0 audit_record: 1112, 0, 0, 0, 0, 0, 0 mbuf_packet: 256, 168765, 256, 1527, 975669, 0, 0 mbuf: 256, 168765, 3, 3549, 7311157, 0, 0 mbuf_cluster: 2048, 26368, 1774, 52, 693372, 0, 0 mbuf_jumbo_page: 4096, 13184, 0, 17, 246, 0, 0 mbuf_jumbo_9k: 9216, 11718, 0, 0, 0, 0, 0 mbuf_jumbo_16k: 16384, 8788, 0, 0, 0, 0, 0 mbuf_ext_refcnt: 4, 0, 0, 0, 0, 0, 0 ttyinq: 152, 0, 855, 315, 6240015, 0, 0 ttyoutq: 256, 0, 450, 285, 3327993, 0, 0 g_bio: 164, 0, 0, 4776,66894028, 0, 0 ata_request: 220, 0, 0, 288, 5838, 0, 0 vtnet_tx_hdr: 16, 0, 0, 0, 0, 0, 0 vtnet_tx_hdr: 16, 0, 0, 0, 0, 0, 0 FPU_save_area: 512, 0, 0, 0, 0, 0, 0 VNODE: 360, 0, 1789, 116351,40544740, 0, 0 VNODEPOLL: 60, 0, 0, 0, 0, 0, 0 BUF TRIE: 44, 0, 112, 5712,19594103, 0, 0 NAMEI: 1024, 0, 0, 300,160929934, 0, 0 S VFS Cache: 72, 0, 1745, 119200,15747277, 0, 0 STS VFS Cache: 92, 0, 0, 9761, 9794, 0, 0 L VFS Cache: 292, 0, 10, 30007, 368324, 0, 0 LTS VFS Cache: 312, 0, 0, 4296, 4233, 0, 0 NCLNODE: 360, 0, 0, 14124, 14025, 0, 0 DIRHASH: 1024, 0, 415, 1885, 3118091, 0, 0 procdesc: 76, 0, 0, 0, 0, 0, 0 pipe: 408, 0, 11, 169, 111400, 0, 0 Mountpoints: 748, 0, 7, 88, 30738, 0, 0 ksiginfo: 80, 0, 307, 943, 52063, 0, 0 itimer: 232, 0, 0, 0, 0, 0, 0 KNOTE: 72, 0, 1, 549, 2313, 0, 0 socket: 456, 109808, 61, 91, 6130, 0, 0 unpcb: 172, 109825, 19, 234, 3501, 0, 0 ipq: 32, 875, 0, 0, 0, 0, 0 udp_inpcb: 256, 109815, 20, 235, 945, 0, 0 udpcb: 16, 110000, 20, 1230, 945, 0, 0 tcp_inpcb: 256, 109815, 18, 237, 1675, 0, 0 tcpcb: 768, 109810, 18, 47, 1675, 0, 0 tcptw: 60, 21978, 0, 264, 4, 0, 0 syncache: 128, 15376, 0, 403, 1602, 0, 0 hostcache: 80, 15400, 2, 248, 4, 0, 0 sackhole: 20, 0, 0, 400, 3, 0, 0 sctp_ep: 984, 109808, 0, 0, 0, 0, 0 sctp_asoc: 1660, 40000, 0, 0, 0, 0, 0 sctp_laddr: 24, 80160, 0, 668, 3, 0, 0 sctp_raddr: 536, 80003, 0, 0, 0, 0, 0 sctp_chunk: 96, 400037, 0, 0, 0, 0, 0 sctp_readq: 76, 400036, 0, 0, 0, 0, 0 sctp_stream_msg_out: 68, 400026, 0, 0, 0, 0, 0 sctp_asconf: 24, 400132, 0, 0, 0, 0, 0 sctp_asconf_ack: 24, 400132, 0, 0, 0, 0, 0 udplite_inpcb: 256, 109815, 0, 0, 0, 0, 0 ripcb: 256, 109815, 2, 73, 2, 0, 0 rtentry: 108, 0, 13, 394, 13, 0, 0 selfd: 28, 0, 106, 1467, 6969799, 0, 0 SWAPMETA: 276, 431788, 822, 55080, 168131, 0, 0 FFS inode: 116, 0, 1664, 116078,38853022, 0, 0 FFS1 dinode: 128, 0, 0, 0, 0, 0, 0 FFS2 dinode: 256, 0, 1664, 115516,38841322, 0, 0 md5: 512, 0, 161708, 28, 161708, 0, 0