GENERIC HEAD from 2015-05-02 22:48:56 UTC, r282366M, vmcore.809 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb 4718592K of memory above 4GB ignored Copyright (c) 1992-2015 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.0-CURRENT #0 r282366M: Mon May 4 12:50:45 CEST 2015 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 FreeBSD clang version 3.6.0 (tags/RELEASE_360/final 230434) 20150225 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT: running with driver "vga". CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin="AuthenticAMD" Id=0x100f23 Family=0x10 Model=0x2 Stepping=3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff SVM: NP,NAsids=64 TSC: P-state invariant real memory = 8589934592 (8192 MB) avail memory = 3528859648 (3365 MB) : Trying to mount root from ufs:/dev/ad4s1a [rw]... WARNING: / was not properly dismounted Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Starting file system checks: /dev/ad4s1a: 6827 files, 981804 used, 31211 free (1275 frags, 3742 blocks, 0.1% fragmentation) /dev/ad4s1f: 21001 files, 279362 used, 733653 free (9349 frags, 90538 blocks, 0.9% fragmentation) /dev/label/tmp: UNREF FILE I=852 OWNER=root MODE=100755 /dev/label/tmp: SIZE=13138 MTIME=May 4 23:52 2015 (CLEARED) /dev/label/tmp: FREE BLK COUNT(S) WRONG IN SUPERBLK (SALVAGED) /dev/label/tmp: SUMMARY INFORMATION BAD (SALVAGED) /dev/label/tmp: BLK(S) MISSING IN BIT MAPS (SALVAGED) /dev/label/tmp: 388828 files, 65002865 used, 53311116 free (18484 frags, 6661579 blocks, 0.0% fragmentation) /dev/ad4s1d: 459571 files, 6237342 used, 3916857 free (267217 frags, 456205 blocks, 2.6% fragmentation) ** SU+J Recovering /dev/ad4s1e ** Reading 33554432 byte journal from inode 6. ** Building recovery table. ** Resolving unreferenced inode list. ** Processing journal entries. ** 19 journal records in 1536 bytes for 39.58% utilization ** Freed 0 inodes (0 dirs) 0 blocks, and 2 frags. ***** FILE SYSTEM MARKED CLEAN ***** Mounting local file systems:. Setting hostname: x4.osted.lan. Feeding entropy:. re0: link state changed to DOWN Starting Network: lo0 re0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 groups: lo re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 scopeid 0x1 nd6 options=23 media: Ethernet autoselect (none) status: no carrier Starting devd. Starting pflogd: add net default: gateway 192.168.1.1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Starting rtsold. re0: link state changed to UP ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/gcc46 /usr/local/lib/gcc48 /usr/local/lib/mysql /usr/local/lib/nss /usr/local/lib/pth /usr/local/lib/qt4 a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. Starting watchdogd. savecore: reboot May 5 07:55:19 x4 savecore: reboot lock order reversal: 1st 0xe44c8698 bufwait (bufwait) @ kern/vfs_bio.c:3134 2nd 0xc93df200 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:285 KDB: stack backtrace: db_trace_self_wrapper(c11e3878,c9e45d68,e44c8648,edbc06b8,c0bf8f7a,...) at db_trace_self_wrapper+0x2a/frame 0xedbc0688 kdb_backtrace(c11e79a5,c93df200,c121b3ad,c858b8c0,c121aff2,...) at kdb_backtrace+0x2d/frame 0xedbc06f0 witness_checkorder(c93df200,9,c121afe9,11d,0,...) at witness_checkorder+0xd2e/frame 0xedbc0744 _sx_xlock(c93df200,0,c121afe9,11d,0,...) at _sx_xlock+0x74/frame 0xedbc0774 ufsdirhash_add(c940fd20,edbc0890,758,edbc0800,edbc0804,...) at ufsdirhash_add+0x4a/frame 0xedbc07a8 ufs_direnter(c9e45ca8,c9e24ca8,edbc0890,edbc0b9c,0,...) at ufs_direnter+0x654/frame 0xedbc0830 ufs_makeinode(edbc0b88,edbc0b9c,c9e45ca8,c1490394,c9e45ca8,...) at ufs_makeinode+0x533/frame 0xedbc09ac ufs_create(edbc0aa8,c13abb8b,c1214106,c9e45ca8,edbc0aa4,...) at ufs_create+0x30/frame 0xedbc09d0 VOP_CREATE_APV(c147cef0,edbc0aa8,edbc0b9c,edbc0a38,c1f9b900,...) at VOP_CREATE_APV+0x12f/frame 0xedbc0a00 vn_open_cred(edbc0b40,edbc0bcc,180,0,c933dd00,c93b04d0) at vn_open_cred+0x282/frame 0xedbc0ad0 vn_open(edbc0b40,edbc0bcc,180,c93b04d0,804cad5,...) at vn_open+0x3d/frame 0xedbc0af8 kern_openat(c8efb000,ffffff9c,804cad5,0,601,180) at kern_openat+0x2ec/frame 0xedbc0bf0 sys_openat(c8efb000,edbc0ca8,c11d816d,4,c10657b7,...) at sys_openat+0x3a/frame 0xedbc0c18 syscall(edbc0ce8) at syscall+0x34a/frame 0xedbc0cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbc0cdc --- syscall (499, FreeBSD ELF32, sys_openat), eip = 0x2815b83f, esp = 0xbfbfe664, ebp = 0xbfbfe680 --- savecore: writing core to /var/crash/vmcore.808 Writing crash summary to /var/crash/core.txt.808. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 rpc.umntall: t1: MOUNTPROG: RPC: Port mapper failure - RPC: Timed out Starting casperd. Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Recovering vi editor sessions:. Updating motd:. Mounting late file systems:. Starting ntpd. Starting powerd. Starting smartd. May 5 07:56:04 x4 smartd[690]: Device: /dev/ada0, WARNING: A firmware update for this drive may be available, May 5 07:56:04 x4 smartd[690]: see the following Seagate web pages: May 5 07:56:04 x4 smartd[690]: http://knowledge.seagate.com/articles/en_US/FAQ/207931en May 5 07:56:04 x4 smartd[690]: http://knowledge.seagate.com/articles/en_US/FAQ/213891en Starting default moused. Configuring vt: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting sendmail_submit. Starting sendmail_msp_queue. Starting cron. Local package initialization: backuplock order reversal: 1st 0xc94aab74 ufs (ufs) @ kern/vfs_subr.c:2176 2nd 0xe45228f0 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:263 3rd 0xca3ab034 ufs (ufs) @ kern/vfs_subr.c:2176 KDB: stack backtrace: db_trace_self_wrapper(c11e3878,f891b630,c0ab05ff,4000,0,...) at db_trace_self_wrapper+0x2a/frame 0xf891b5d8 kdb_backtrace(c11e79be,ca3ab034,c11cdcd9,c858b858,c11f1005,...) at kdb_backtrace+0x2d/frame 0xf891b63c witness_checkorder(ca3ab034,9,c11f0ffc,880,ca3ab0a0,...) at witness_checkorder+0xd2e/frame 0xf891b690 __lockmgr_args(ca3ab034,80100,ca3ab0a0,0,0,...) at __lockmgr_args+0x935/frame 0xf891b76c ffs_lock(f891b7e8,c8589978,c15aabb0,c8589978,c8583178,...) at ffs_lock+0x98/frame 0xf891b7a4 VOP_LOCK1_APV(c147cef0,f891b7e8,0,ca58c310,c149229c,...) at VOP_LOCK1_APV+0x10a/frame 0xf891b7d0 _vn_lock(ca3ab000,80100,c11f0ffc,880,c11f021c,...) at _vn_lock+0xba/frame 0xf891b810 vget(ca3ab000,80100,ca58c310,57,80100,...) at vget+0x74/frame 0xf891b848 vfs_hash_get(c933a000,9bf800,80000,ca58c310,f891b940,...) at vfs_hash_get+0xe7/frame 0xf891b874 ffs_vgetf(c933a000,9bf800,80000,f891b940,1,...) at ffs_vgetf+0x44/frame 0xf891b8d0 softdep_sync_buf(c94aab40,e45228a0,1,0,0,...) at softdep_sync_buf+0x36b/frame 0xf891b958 ffs_syncvnode(c94aab40,1,0,5fa,c8583588,...) at ffs_syncvnode+0x2aa/frame 0xf891b9b0 ffs_sync(c933a000,4,c11f2ac0,733,ca58c310,...) at ffs_sync+0x1e9/frame 0xf891ba38 vfs_write_suspend(c933a000,0,c121b59a,79,72,...) at vfs_write_suspend+0x1bf/frame 0xf891ba74 vfs_write_suspend_umnt(c933a000,ca58c310,f891bac0,c11f0ffc,8ce,...) at vfs_write_suspend_umnt+0x42/frame 0xf891ba9c ffs_unmount(c933a000,8080000,f891bb20,510,c15aabb0,...) at ffs_unmount+0xa7/frame 0xf891bae8 dounmount(c933a000,8080000,ca58c310,492,14f,...) at dounmount+0x4c9/frame 0xf891bb48 sys_unmount(ca58c310,f891bca8,c11d816d,4,c10657b7,...) at sys_unmount+0x2d4/frame 0xf891bc18 syscall(f891bce8) at syscall+0x34a/frame 0xf891bcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf891bcdc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280da46b, esp = 0xbfbfe69c, ebp = 0xbfbfe768 --- lock order reversal: 1st 0xc9369034 ufs (ufs) @ kern/vfs_mount.c:1229 2nd 0xc9369a0c devfs (devfs) @ ufs/ffs/ffs_softdep.c:1904 KDB: stack backtrace: db_trace_self_wrapper(c11e3878,c15aabb0,8,10,c1455bf0,...) at db_trace_self_wrapper+0x2a/frame 0xf891b740 kdb_backtrace(c11e79a5,c9369a0c,c11d9fff,c858b6b8,c1216bc4,...) at kdb_backtrace+0x2d/frame 0xf891b7a4 witness_checkorder(c9369a0c,9,c1216bbb,770,0,...) at witness_checkorder+0xd2e/frame 0xf891b7f8 __lockmgr_args(c9369a0c,80400,c9369a78,0,0,0,c1216bbb,770) at __lockmgr_args+0x935/frame 0xf891b8d4 vop_stdlock(f891b948,c8fcf800,f891b940,c0b5b069,c8fcf800,...) at vop_stdlock+0x53/frame 0xf891b904 VOP_LOCK1_APV(c14453b8,f891b948,f891b970,c0dd36e5,c149229c,...) at VOP_LOCK1_APV+0x10a/frame 0xf891b930 _vn_lock(c93699d8,80400,c1216bbb,770,f891ba0c,...) at _vn_lock+0xba/frame 0xf891b970 softdep_flushworklist(c933a000,f891ba08,ca58c310,60e,c8583588,...) at softdep_flushworklist+0x68/frame 0xf891b9b0 ffs_sync(c933a000,4,c11f2ac0,733,ca58c310,...) at ffs_sync+0x2ae/frame 0xf891ba38 vfs_write_suspend(c933a000,0,c121b59a,79,72,...) at vfs_write_suspend+0x1bf/frame 0xf891ba74 vfs_write_suspend_umnt(c933a000,ca58c310,f891bac0,c11f0ffc,8ce,...) at vfs_write_suspend_umnt+0x42/frame 0xf891ba9c ffs_unmount(c933a000,8080000,f891bb20,510,c15aabb0,...) at ffs_unmount+0xa7/frame 0xf891bae8 dounmount(c933a000,8080000,ca58c310,492,14f,...) at dounmount+0x4c9/frame 0xf891bb48 sys_unmount(ca58c310,f891bca8,c11d816d,4,c10657b7,...) at sys_unmount+0x2d4/frame 0xf891bc18 syscall(f891bce8) at syscall+0x34a/frame 0xf891bcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf891bcdc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280da46b, esp = 0xbfbfe69c, ebp = 0xbfbfe768 --- ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes lock order reversal: 1st 0xccf50b74 ufs (ufs) @ kern/vfs_vnops.c:883 2nd 0xc1633f20 proctree (proctree) @ kern/subr_prf.c:146 KDB: stack backtrace: db_trace_self_wrapper(c11e3878,b5b069,33373639,3231,c121a32d,...) at db_trace_self_wrapper+0x2a/frame 0xf891e538 kdb_backtrace(c11e79a5,c1633f20,c11dd61c,c8582068,c11e4a14,...) at kdb_backtrace+0x2d/frame 0xf891e5a0 witness_checkorder(c1633f20,1,c11e4a0b,92,0,...) at witness_checkorder+0xd2e/frame 0xf891e5f4 _sx_slock(c1633f20,0,c11e4a0b,92,10,...) at _sx_slock+0x6e/frame 0xf891e620 uprintf(c121536e,c92928d4,3b1,c938c5a8,3e9,...) at uprintf+0x46/frame 0xf891e678 ffs_alloc(ccf21d98,0,0,cf780,0,...) at ffs_alloc+0x469/frame 0xf891e6e0 ffs_balloc_ufs2(ccf50b40,0,0,1,ca47ec00,...) at ffs_balloc_ufs2+0xc97/frame 0xf891e82c ffs_write(f891e9b0,c13abef5,ccf50b74,ccf50b40,c1490394,...) at ffs_write+0x592/frame 0xf891e8b8 VOP_WRITE_APV(c147cef0,f891e9b0,ccf50b40,373,2,...) at VOP_WRITE_APV+0x1ac/frame 0xf891e978 vn_write(c94237a8,f891ebe8,ca47ec00,1,c9259c40,...) at vn_write+0x328/frame 0xf891e9e0 vn_io_fault_doio(c9259c40,f891eMay 5 08:04:24 a4cx4 kernel: pid 9,c045 (svn), uid 10bac01 inumber 21376839 on /: filesystc,em full c157afec,0,...) at vn_io_fault_doio+0x34/frame 0xf891ea28 vn_io_fault1(c9259c40,0,0,ffffffff,7fffffff,...) at vn_io_fault1+0x6d/frame 0xf891eaf8 vn_io_fault(c94237a8,f891ebe8,ca47ec00,0,c9259c40,...) at vn_io_fault+0x1fa/frame 0xf891eb4c dofilewrite(c94237a8,f891ebe8,ffffffff,ffffffff,0,...) at dofilewrite+0xa0/frame 0xf891eb80 kern_writev(c9259c40,4,f891ebe8,c15aa840,bfbfdfef,...) at kern_writev+0x93/frame 0xf891ebc8 sys_write(c9259c40,f891eca8,c11d816d,4,c10657b7,...) at sys_write+0x59/frame 0xf891ec18 syscall(f891ece8) at syscall+0x34a/frame 0xf891ecdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf891ecdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x285f9eef, esp = 0xbfbfdf88, ebp = 0xbfbfdfa4 --- May 5 08:05:17 x4 su: pho to root on /dev/pts/0 ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 388828 files, 65002865 used, 53311116 free (18484 frags, 6661579 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmp. Starting inetd. Tue May 5 08:06:52 CEST 2015 FreeBSD/i386 (x4.osted.lan) (ttyu0) login: lock order reversal: 1st 0xc9e425d4 ufs (ufs) @ kern/vfs_mount.c:848 2nd 0xcd2498a4 nfs (nfs) @ kern/vfs_subr.c:2176 KDB: stack backtrace: db_trace_self_wrapper(c11e3878,ca3096e2,f895c728,f895c708,c0b42f36,...) at db_trace_self_wrapper+0x2a/frame 0xf895c6d8 kdb_backtrace(c11e79a5,cd2498a4,c11c7e50,c858c078,c11f1005,...) at kdb_backtrace+0x2d/frame 0xf895c73c witness_checkorder(cd2498a4,9,c11f0ffc,880,cd249910,...) at witness_checkorder+0xd2e/frame 0xf895c790 __lockmgr_args(cd2498a4,80100,cd249910,0,0,0,c11f0ffc,880) at __lockmgr_args+0x935/frame 0xf895c86c nfs_lock1(f895c8e0,c8589978,c15aa8f0,c8589978,c8583178,...) at nfs_lock1+0x9c/frame 0xf895c89c VOP_LOCK1_APV(c1446834,f895c8e0,0,ca309620,c149229c,...) at VOP_LOCK1_APV+0x10a/frame 0xf895c8c8 _vn_lock(cd249870,80100,c11f0ffc,880,c11f021c,...) at _vn_lock+0xba/frame 0xf895c908 vget(cd249870,80100,ca484c40,57,80100,...) at vget+0x74/frame 0xf895c940 vfs_hash_get(c933a000,3a941847,80000,ca484c40,f895c9ac,...) at vfs_hash_get+0xe7/frame 0xf895c96c ncl_nget(c933a000,c8fcec8c,1c,f895c9d8,80000,...) at ncl_nget+0xc2/frame 0xf895c9bc nfs_root(c933a000,80000,f895cbd0,359,c9308d00,...) at nfs_root+0x3c/frame 0xf895c9e8 vfs_donmount(ca484c40,0,0,c927ec00,c927ec00,...) at vfs_donmount+0x15f6/frame 0xf895cbf0 sys_nmount(ca484c40,f895cca8,c11d816d,4,c10657b7,...) at sys_nmount+0x7a/frame 0xf895cc18 syscall(f895cce8) at syscall+0x34a/frame 0xf895ccdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf895ccdc --- syscall (378, FreeBSD ELF32, sys_nmount), eip = 0x280dbabb, esp = 0xbfbfe4fc, ebp = 0xbfbfedd4 --- lock order reversal: 1st 0xe45ab9f0 bufwait (bufwait) @ kern/vfs_bio.c:2362 2nd 0xc9b45bdc so_snd_sx (so_snd_sx) @ kern/uipc_sockbuf.c:265 KDB: stack backtrace: db_trace_self_wrapper(c11e3878,c15aa8f0,c8587140,c8583930,f895c2a4,...) at db_trace_self_wrapper+0x2a/frame 0xf895c238 kdb_backtrace(c11e79a5,c9b45bdc,c11d5f34,c858ba60,c11ecba2,...) at kdb_backtrace+0x2d/frame 0xf895c29c witness_checkorder(c9b45bdc,9,c11ecb99,109,0,...) at witness_checkorder+0xd2e/frame 0xf895c2f0 _sx_xlock(c9b45bdc,40,c11ecb99,109,0,...) at _sx_xlock+0x74/frame 0xf895c320 sblock(c9b45ba4,1,30,f895c398,c0e3fb76,...) at sblock+0x56/frame 0xf895c33c sosend_generic(c9b45ab0,0,0,c9c79500,0,...) at sosend_generic+0xd3/frame 0xf895c3b0 clnt_vc_call(ca309720,f895c570,10,c9c85d00,f895c758,...) at clnt_vc_call+0x4a2/frame 0xf895c488 clnt_reconnect_call(ca3096c0,f895c570,10,c9c85d00,f895c758,...) at clnt_reconnect_call+0xcc/frame 0xf895c4f0 newnfs_request(f895c758,c8fcec00,0,c8fced10,cd249168,ca484c40,c933dd00,186a3,3,0,1,0,0) at newnfs_request+0x8e5/frame 0xf895c5b8 nfscl_request(f895c758,cd249168,ca484c40,c933dd00,0,...) at nfscl_request+0x8c/frame 0xf895c600 nfsrpc_readdir(cd249168,f895c928,f895c848,c933dd00,ca484c40,...) at nfsrpc_readdir+0x371/frame 0xf895c810 ncl_readdirrpc(cd249168,f895c928,c933dd00,ca484c40,8,...) at ncl_readdirrpc+0xff/frame 0xf895c8f0 ncl_doio(cd249168,e45ab9a0,c933dd00,ca484c40,0,...) at ncl_doio+0x13d/frame 0xf895c968 ncl_bioread(cd249168,f895cb98,0,c933dd00,c11df0b7,...) at ncl_bioread+0xadc/frame 0xf895ca68 nfs_readdir(f895cbb8,c13ac28c,c1214270,c11f2848,ff3,...) at nfs_readdir+0x1a8/frame 0xf895cb18 VOP_READDIR_APV(c1446834,f895cbb8,c11f2848,ff3,0,...) at VOP_READDIR_APV+0x12f/frame 0xf895cb48 kern_getdirentries(ca484c40,0,2887f000,1000,f895cc08,...) at kern_getdirentries+0x1e3/frame 0xf895cbe4 sys_getdirentries(ca484c40,f895cca8,c11d816d,4,c10657b7,...) at sys_getdirentries+0x42/frame 0xf895cc18 syscall(f895cce8) at syscall+0x34a/frame 0xf895ccdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf895ccdc --- syscall (196, FreeBSD ELF32, sys_getdirentries), eip = 0x281549bb, esp = 0xbfbfcb28, ebp = 0xbfbfcb5c --- May 5 08:17:53 x4 su: pho to root on /dev/pts/1 20150505 08:18:01 all (1/1): pfl.sh 20150505 09:02:52 all (1/1): crossmp3.sh 20150505 09:08:28 all (1/3): crossmp3.sh pho = 0 0 0 20150505 09:15:40 all (2/3): pfl.sh Expensive timeout(9) function: 0xc099db00(0xc8c3eaa0) 0.010919182 s pho = 0 0 0 *** Excessive run time: pfl.sh, 75 min 20150505 10:31:31 all (3/3): fifo2.sh pho = 0 0 0 20150505 10:33:45 all (1/316): nullfs14.sh pho = 0 0 0 20150505 10:33:46 all (2/316): crossmp4.sh lock order reversal: 1st 0xcd5d5304 ufs (ufs) @ /usr/src/sys/modules/nullfs/../../fs/nullfs/null_vnops.c:660 2nd 0xc1633f64 allproc (allproc) @ kern/kern_descrip.c:2887 KDB: stack backtrace: db_trace_self_wrapper(c11e3878,6c6c756e,6f6e765f,632e7370,3036363a,...) at db_trace_self_wrapper+0x2a/frame 0xc80fb9d0 kdb_backtrace(c11e79a5,c1633f64,c11d5ed1,c85820d0,c11d72da,...) at kdb_backtrace+0x2d/frame 0xc80fba38 witness_checkorder(c1633f64,1,c11d72d1,b47,0,...) at witness_checkorder+0xd2e/frame 0xc80fba8c _sx_slock(c1633f64,0,c11d72d1,b47,cda4d9d8,...) at _sx_slock+0x6e/frame 0xc80fbab8 mountcheckdirs(cda4d9d8,cc4deb40,c80fbb20,510,c15a63d8,...) at mountcheckdirs+0x41/frame 0xc80fbae8 dounmount(cd0de000,8080000,d5856c40,492,14f,...) at dounmount+0x413/frame 0xc80fbb48 sys_unmount(d5856c40,c80fbca8,c11d816d,4,c156cd90,...) at sys_unmount+0x2d4/frame 0xc80fbc18 syscall(c80fbce8) at syscall+0x34a/frame 0xc80fbcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xc80fbcdc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280da46b, esp = 0xbfbfe09c, ebp = 0xbfbfe168 --- pho = 0 0 0 20150505 10:41:50 all (3/316): ffs_syncvnode.sh lock order reversal: 1st 0xd88dbe44 pseudofs (pseudofs) @ kern/vfs_syscalls.c:4083 2nd 0xc1633f64 allproc (allproc) @ fs/pseudofs/pseudofs_vnops.c:790 KDB: stack backtrace: db_trace_self_wrapper(c11e3878,c0b3cd7a,d88dbe64,8,c11f2848,...) at db_trace_self_wrapper+0x2a/frame 0xf8ac99c8 kdb_backtrace(c11e79a5,c1633f64,c11d5ed1,c85820d0,c11ca901,...) at kdb_backtrace+0x2d/frame 0xf8ac9a30 witness_checkorder(c1633f64,1,c11ca8f8,316,0,...) at witness_checkorder+0xd2e/frame 0xf8ac9a84 _sx_slock(c1633f64,0,c11ca8f8,316,c108af7e,...) at _sx_slock+0x6e/frame 0xf8ac9ab0 pfs_readdir(f8ac9bb8,c13ac28c,c1214270,c11f2848,ff3,...) at pfs_readdir+0x10d/frame 0xf8ac9b18 VOP_READDIR_APV(c144870c,f8ac9bb8,c11f2848,ff3,0,...) at VOP_READDIR_APV+0x12f/frame 0xf8ac9b48 kern_getdirentries(d40dfc40,5,2888c000,1000,f8ac9c08,...) at kern_getdirentries+0x1e3/frame 0xf8ac9be4 sys_getdirentries(d40dfc40,f8ac9ca8,c11d816d,4,c10657b7,...) at sys_getdirentries+0x42/frame 0xf8ac9c18 syscall(f8ac9ce8) at syscall+0x34a/frame 0xf8ac9cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8ac9cdc --- syscall (196, FreeBSD ELF32, sys_getdirentries), eip = 0x280fd9bb, esp = 0xbfbfe75c, ebp = 0xbfbfe790 --- pho = 0 0 0 *** Excessive run time: ffs_syncvnode.sh, 36 min 20150505 11:18:10 all (4/316): lockf.sh pho = 0 0 0 20150505 11:18:12 all (5/316): mmap3.sh lock order reversal: 1st 0xccff1b74 syncer (syncer) @ kern/vfs_subr.c:1769 2nd 0xcc1d6b74 ufs (ufs) @ kern/vfs_subr.c:2176 KDB: stack backtrace: db_trace_self_wrapper(c11e3878,c11de50c,246,c15ac648,c1456e4c,...) at db_trace_self_wrapper+0x2a/frame 0xedb06928 kdb_backtrace(c11e79a5,cc1d6b74,c11cdcd9,c858b858,c11f1005,...) at kdb_backtrace+0x2d/frame 0xedb0698c witness_checkorder(cc1d6b74,9,c11f0ffc,880,cc1d6be0,...) at witness_checkorder+0xd2e/frame 0xedb069e0 __lockmgr_args(cc1d6b74,80500,cc1d6be0,0,0,...) at __lockmgr_args+0x935/frame 0xedb06abc ffs_lock(edb06b38,c858b928,c15ac628,c858b928,c85898a8,...) at ffs_lock+0x98/frame 0xedb06af4 VOP_LOCK1_APV(c147cef0,edb06b38,c8efc000,c15d859c,c149229c,...) at VOP_LOCK1_APV+0x10a/frame 0xedb06b20 _vn_lock(cc1d6b40,80500,c11f0ffc,880,c11f0ffc,...) at _vn_lock+0xba/frame 0xedb06b60 vget(cc1d6b40,80500,c8efc000,12f7,edb06be4,...) at vget+0x74/frame 0xedb06b98 vfs_msync(cd0de8c4,2,2,cd0de8c4,c1460174,...) at vfs_msync+0xca/frame 0xedb06be4 sync_fsync(edb06c88,c13ac078,80400,c11f0ffc,6e9,...) at sync_fsync+0xe2/frame 0xedb06c08 VOP_FSYNC_APV(c1460174,edb06c88,c11f0ffc,6e9,0,...) at VOP_FSYNC_APV+0x12f/frame 0xedb06c38 sched_sync(0,edb06ce8,c11d854c,3dc,0,...) at sched_sync+0x441/frame 0xedb06cac fork_exit(c0c1d1e0,0,edb06ce8) at fork_exit+0x7e/frame 0xedb06cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedb06cd4 --- trap 0, eip = 0, esp = 0xedb06d20, ebp = 0 --- May 5 11:25:26 x4 kernel: Failed to write core file for process mmap3 (error 14) May 5 11:26:46 x4 kernel: Failed to write core file for process mmap3 (error 14) pho = 0 0 0 20150505 11:28:47 all (6/316): vm_reserv_populate.sh pho = 0 0 0 20150505 11:33:31 all (7/316): mac_chkexec.sh pho = 0 0 0 20150505 11:33:35 all (8/316): linger3.sh pho = 0 0 0 20150505 11:33:50 all (9/316): swappedout.sh pho = 0 0 0 20150505 11:33:58 all (10/316): kern_umtx_inf_loop.sh pho = 0 0 0 20150505 11:33:59 all (11/316): signal.sh pho = 0 0 0 20150505 11:34:02 all (12/316): tcp2.sh witness_lock_list_get: witness exhausted Expensive timeout(9) function: 0xc0d35e30(0xde2f4308) 0.014095469 s Expensive timeout(9) function: 0xc0d36820(0xdcd27610) 0.057788155 s Expensive timeout(9) function: 0xc0d35e30(0xde5a3000) 0.075458265 s Expensive timeout(9) function: 0xc0f786e0(0xc15deba4) 2.139038387 s [zone: mbuf_jumbo_page] kern.ipc.nmbjumbop limit reached [zone: mbuf_jumbo_page] kern.ipc.nmbjumbop limit reached [zone: mbuf_cluster] kern.ipc.nmbclusters limit reached [zone: mbuf_jumbo_page] kern.ipc.nmbjumbop limit reached [zone: mbuf_cluster] kern.ipc.nmbclusters limit reached [zone: mbuf_jumbo_page] kern.ipc.nmbjumbop limit reached [zone: mbuf_cluster] kern.ipc.nmbclusters limit reached pho = 2 0 1 20150505 11:59:52 all (13/316): nullfs3.sh pho = 2 0 1 20150505 11:59:54 all (14/316): nullfs6.sh pho = 2 0 1 20150505 11:59:54 all (15/316): mmap7.sh pho = 2 0 1 20150505 12:01:02 all (16/316): nbufkv.sh pho = 2 0 1 20150505 12:02:14 all (17/316): trim5.sh pho = 2 0 1 20150505 12:02:14 all (18/316): mmap4.sh vnode_pager_putpages: I/O error 28 vnode_pager_putpages: residual I/O 32768 at 9776 May 5 12:02:15 x4 kernel: pid 80415 (mmap4), uid 0 inumber 4 on /mnt: filesystem full pho = 2 0 1 20150505 12:02:17 all (19/316): truncate.sh pho = 2 0 1 20150505 12:13:09 all (20/316): core5.sh pho = 2 0 1 20150505 12:23:13 all (21/316): linger2.sh May 5 12:23:16 x4 kernel: pid 86405 (linger2), uid 1004 inumber 889 on /mnt: filesystem full pho = 2 0 1 20150505 12:23:20 all (22/316): vnodes.sh pho = 2 0 1 20150505 12:24:04 all (23/316): rename5.sh pho = 2 0 1 20150505 12:24:35 all (24/316): snap7.sh May 5 12:33:34 x4 mountd[605]: can't delete exports for /mnt: Device busy May 5 12:35:32 x4 mountd[605]: can't delete exports for /mnt: Device busy May 5 12:38:04 x4 mountd[605]: can't delete exports for /mnt: Device busy May 5 12:43:10 x4 last message repeated 2 times pho = 2 0 1 *** Excessive run time: snap7.sh, 31 min 20150505 12:56:49 all (25/316): namecache.sh May 5 12:56:15 x4 last message repeated 7 times pho = 2 0 1 20150505 13:08:33 all (26/316): sendfile4.sh pho = 2 0 1 20150505 13:08:34 all (27/316): jail4.sh pho = 2 0 1 20150505 13:08:35 all (28/316): snap4.sh pho = 2 0 1 20150505 13:38:40 all (29/316): mlockall.sh pho = 2 0 1 20150505 13:38:51 all (30/316): union.sh pho = 2 0 1 20150505 13:49:22 all (31/316): sendfile2.sh pho = 2 0 1 20150505 13:49:26 all (32/316): rename8.sh pho = 2 0 1 20150505 13:49:58 all (33/316): udp.sh pho = 2 0 1 20150505 14:00:25 all (34/316): truncate3.sh pho = 2 0 1 20150505 14:00:35 all (35/316): tmpfs13.sh pho = 9 0 2 20150505 14:04:29 all (36/316): flock_open_close.sh pho = 9 0 2 20150505 14:09:51 all (37/316): ptrace2.sh pho = 9 0 2 20150505 14:09:58 all (38/316): rename6.sh pho = 9 0 2 20150505 14:10:02 all (39/316): recursiveflushes.sh pho = 9 0 2 20150505 14:10:07 all (40/316): datamove.sh pho = 9 0 2 20150505 14:10:08 all (41/316): zfs3.sh pho = 9 0 2 20150505 14:10:08 all (42/316): cmp.sh pho = 9 0 2 20150505 14:12:56 all (43/316): linger4.sh pho = 9 0 2 *** Excessive run time: linger4.sh, 42 min 20150505 14:55:47 all (44/316): mountro.sh pho = 9 0 2 20150505 14:57:33 all (45/316): tmpfs2.sh May 5 14:57:46 x4 mountd[605]: can't delete exports for /mnt10: Device busy May 5 14:58:30 x4 mountd[605]: can't delete exports for /mnt14: Device busy May 5 14:59:51 x4 mountd[605]: can't delete exports for /mnt9: Device busy pho = 9 0 2 20150505 15:00:51 all (46/316): rename2.sh pho = 9 0 2 20150505 15:20:51 all (47/316): trim2.sh pho = 9 0 2 20150505 15:20:58 all (48/316): extattrctl.sh pho = 9 0 2 20150505 15:20:59 all (49/316): mlockall3.sh pho = 9 0 2 20150505 15:23:59 all (50/316): nullfs11.sh pho = 9 0 2 20150505 15:27:21 all (51/316): nfsrename.sh pho = 9 0 2 20150505 15:27:34 all (52/316): dup2.sh FreeBSD/i386 (x4.osted.lan) (ttyu0) login: KDB: enter: Break to debugger [ thread pid 11 tid 100005 ] Stopped at kdb_alt_break_internal+0x162: movl $0,kdb_why db> set $lines 0 db> x kmem_arena kmem_arena: c157d500 db> show vmem 0xc157d500 vmem 0xc157d500 'kmem arena' quantum: 4096 size: 432013312 inuse: 88080384 free: 343932928 busy tags: 17633 free tags: 32 inuse size free size 4096 17540 71843840 140 573440 8192 15 122880 363 2973696 12288 0 0 338 4153344 16384 17 278528 249 4079616 20480 0 0 155 3174400 24576 0 0 147 3612672 28672 0 0 144 4128768 32768 4 131072 148 4849664 36864 0 0 111 4091904 40960 0 0 85 3481600 45056 0 0 106 4775936 49152 0 0 95 4669440 53248 0 0 63 3354624 57344 0 0 74 4243456 61440 0 0 75 4608000 65536 17 1114112 63 4128768 69632 0 0 54 3760128 73728 0 0 45 3317760 77824 0 0 39 3035136 81920 0 0 43 3522560 86016 0 0 44 3784704 90112 0 0 33 2973696 94208 1 94208 30 2826240 98304 0 0 33 3244032 102400 0 0 23 2355200 106496 0 0 25 2662400 110592 0 0 25 2764800 114688 0 0 20 2293760 118784 0 0 29 3444736 122880 0 0 20 2457600 126976 1 126976 21 2666496 131072 21 3256320 361 65843200 262144 9 2400256 188 67571712 524288 6 3436544 86 61468672 1048576 0 0 25 34664448 2097152 2 5275648 3 8376320 db> run pho db:0:pho> bt Tracing pid 11 tid 100005 td 0xc8a39930 kdb_alt_break_internal(0,e4741ac8,c097ded7,2,c8cd7884,...) at kdb_alt_break_internal+0x162/frame 0xe4741a9c kdb_alt_break(2,c8cd7884,c11a75b9,c8cd7800,40000,...) at kdb_alt_break+0x16/frame 0xe4741aa8 uart_intr_rxready(c8cd7800,e472ec80,8,c13a3113,342,...) at uart_intr_rxready+0x87/frame 0xe4741ac8 uart_intr(c8cd7800,c0b462c8,c1634400,a,0,...) at uart_intr+0x100/frame 0xe4741b04 intr_event_handle(c88e2900,e4741b80,0,2,0,...) at intr_event_handle+0x7a/frame 0xe4741b30 intr_execute_handlers(c8a90108,e4741b80,2) at intr_execute_handlers+0x42/frame 0xe4741b50 lapic_handle_intr(30,e4741b80) at lapic_handle_intr+0x5d/frame 0xe4741b70 Xapic_isr1() at Xapic_isr1+0x4a/frame 0xe4741b70 --- interrupt, eip = 0xc1045375, esp = 0xe4741bc0, ebp = 0xe4741bc0 --- acpi_cpu_c1(e472ec90,0,c13a3113,2ec,7dca,...) at acpi_cpu_c1+0x5/frame 0xe4741bc0 acpi_cpu_idle(7fcf3e80,0,7fcf3e80,e4741c30,c107656d,...) at acpi_cpu_idle+0x166/frame 0xe4741c00 cpu_idle_acpi(7fcf3e80,0,4,c156ce08,c156ce04,...) at cpu_idle_acpi+0x3f/frame 0xe4741c14 cpu_idle(0,e4741c80,c11e18f2,a48,c156ce08,...) at cpu_idle+0x9d/frame 0xe4741c30 sched_idletd(0,e4741ce8,c11d854c,3dc,0,...) at sched_idletd+0x3cb/frame 0xe4741cac fork_exit(c0b89380,0,e4741ce8) at fork_exit+0x7e/frame 0xe4741cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4741cd4 --- trap 0, eip = 0, esp = 0xe4741d20, ebp = 0 --- db:0:bt> show allpcpu Current CPU: 2 cpuid = 0 dynamic pcpu = 0x790200 curthread = 0xc8a3a000: pid 11 "idle: cpu0" curpcb = 0xe473bd40 fpcurthread = none idlethread = 0xc8a3a000: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x23296200 curthread = 0xc8a39c40: pid 11 "idle: cpu1" curpcb = 0xe473ed40 fpcurthread = none idlethread = 0xc8a39c40: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x23299200 curthread = 0xc8a39930: pid 11 "idle: cpu2" curpcb = 0xe4741d40 fpcurthread = none idlethread = 0xc8a39930: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x2329c200 curthread = 0xc8a39620: pid 11 "idle: cpu3" curpcb = 0xe4744d40 fpcurthread = none idlethread = 0xc8a39620: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks db:0:alllocks> show lockedvnods Locked vnodes db:0:lockedvnods> show mount 0xc933a2ec /dev/ad4s1a on / (ufs) 0xc933a5d8 devfs on /dev (devfs) 0xc973c000 /dev/ad4s1f on /home (ufs) 0xc9339bb0 /dev/ad4s1d on /usr (ufs) 0xc93398c4 /dev/ad4s1e on /var (ufs) 0xc93395d8 procfs on /proc (procfs) 0xcd0de8c4 /dev/label/tmp on /tmp (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 86159 1444 1441 1001 S nanslp 0xc155fd43 sleep 77767 77755 21701 0 D+ kmem are 0xc157d580 dup2 77756 21701 21701 0 S+ piperd 0xc949d7f8 tee 77755 21701 21701 0 S+ wait 0xcefe5000 sh 21701 1153 21701 0 S+ wait 0xd53ad000 sh 1445 1441 1441 1001 S piperd 0xc9ca54c8 awk 1444 1441 1441 1001 S wait 0xd2a36340 sh 1443 1442 1443 1001 Ss+ select 0xc93eda24 top 1442 1433 1433 1001 S select 0xc93edaa4 sshd 1441 1440 1441 1001 SWs wait 0xd2a36680 sh 1440 1432 1432 1001 S select 0xc9395ce4 sshd 1439 1438 1439 1001 Ss kqread 0xc948dc80 tail 1438 1434 1434 1001 S select 0xc93951a4 sshd 1434 746 1434 0 Ss select 0xc88e9324 sshd 1433 746 1433 0 Ss select 0xc93edae4 sshd 1432 746 1432 0 Ss select 0xc93951e4 sshd 1153 1151 1153 0 SW+ wait 0xcb039340 bash 1151 1150 1151 0 SW+ pause 0xc938c6e4 csh 1150 1145 1150 1001 SW+ wait 0xcca5a340 su 1145 1144 1145 1001 SWs+ wait 0xc947f680 bash 1144 1142 1142 1001 S select 0xc9395924 sshd 1142 746 1142 0 Ss select 0xc93964e4 sshd 1037 1 1037 0 Ss+ ttyin 0xc8c77e70 getty 1036 1 1036 0 Ss+ ttyin 0xc8c77870 getty 1035 1 1035 0 Ss+ ttyin 0xc8c77a70 getty 1034 1 1034 0 Ss+ ttyin 0xc8c77c70 getty 1033 1 1033 0 Ss+ ttyin 0xc8c78870 getty 1032 1 1032 0 Ss+ ttyin 0xc8c78670 getty 1031 1 1031 0 Ss+ ttyin 0xc8c78470 getty 1030 1 1030 0 Ss+ ttyin 0xc8c78270 getty 1029 1 1029 0 Ss+ ttyin 0xc8c78070 getty 1010 1 1010 0 Ss select 0xc9395aa4 inetd 954 952 954 0 S+ ttyin 0xc9714670 bash 952 950 952 0 SW+ pause 0xc93913a4 csh 950 913 950 1001 SW+ wait 0xc947f000 su 913 912 913 1001 SWs+ wait 0xcca5b9c0 bash 912 910 910 1001 S select 0xc88e9764 sshd 910 746 910 0 Ss select 0xc9396324 sshd 757 1 757 0 Ss nanslp 0xc155fd42 cron 752 1 752 25 Ss pause 0xc93e53a4 sendmail 749 1 749 0 Ss select 0xc9483564 sendmail 746 1 746 0 Ss select 0xc94835a4 sshd 699 1 699 0 Ss select 0xc93ee2e4 moused 692 1 691 0 S nanslp 0xc155fd42 smartd 673 1 673 0 Ss select 0xc9395f64 powerd 670 1 670 0 Ss (threaded) ntpd 100101 S select 0xc94836e4 ntpd 616 611 611 0 S (threaded) nfsd 100109 S rpcsvc 0xc933d490 nfsd: master 100113 S rpcsvc 0xc89f6b90 nfsd: service 100114 S rpcsvc 0xc89f6c90 nfsd: service 100115 S rpcsvc 0xc89f6d90 nfsd: service 100116 S rpcsvc 0xc89f6e90 nfsd: service 100117 S rpcsvc 0xc89f7090 nfsd: service 100118 S rpcsvc 0xc89f7190 nfsd: service 100119 S rpcsvc 0xc89f7290 nfsd: service 100120 S rpcsvc 0xc89f7390 nfsd: service 100121 S rpcsvc 0xca481390 nfsd: service 100122 S rpcsvc 0xca481190 nfsd: service 100123 S rpcsvc 0xca481290 nfsd: service 100124 S rpcsvc 0xca480e90 nfsd: service 100125 S rpcsvc 0xca481090 nfsd: service 100126 S rpcsvc 0xca480d90 nfsd: service 100127 S rpcsvc 0xca480c90 nfsd: service 100128 S rpcsvc 0xca480b90 nfsd: service 100129 S rpcsvc 0xca480a90 nfsd: service 100130 S rpcsvc 0xca480990 nfsd: service 100131 S rpcsvc 0xca480890 nfsd: service 100132 S rpcsvc 0xca480790 nfsd: service 100133 S rpcsvc 0xca480690 nfsd: service 100134 S rpcsvc 0xca480590 nfsd: service 100135 S rpcsvc 0xca480490 nfsd: service 100136 S rpcsvc 0xca480390 nfsd: service 100137 S rpcsvc 0xca480290 nfsd: service 100138 S rpcsvc 0xca480190 nfsd: service 100139 S rpcsvc 0xca480090 nfsd: service 100140 S rpcsvc 0xca47fe90 nfsd: service 100141 S rpcsvc 0xca47fd90 nfsd: service 100142 S rpcsvc 0xca47fc90 nfsd: service 100143 S rpcsvc 0xca47fb90 nfsd: service 611 1 611 0 Ss select 0xc88e9924 nfsd 605 1 605 0 Ss select 0xc9396064 mountd 598 594 594 0 S select 0xc88e9c24 nfsuserd 597 594 594 0 S select 0xc93960a4 nfsuserd 596 594 594 0 S select 0xc93960e4 nfsuserd 595 594 594 0 S select 0xc88e9e24 nfsuserd 594 1 594 0 SWs pause 0xc9391064 nfsuserd 577 1 577 0 Ss select 0xc93ee3a4 casperd 576 1 576 0 Ss select 0xc88e9de4 casperd 561 1 561 0 Ss select 0xc93ee464 rpcbind 489 1 489 0 Ss nanslp 0xc155fd40 watchdogd 485 1 485 0 Ss select 0xc9396424 syslogd 361 1 361 0 Ss select 0xc88e9f24 rtsold 325 1 325 0 Ss select 0xc93ee624 devd 16 0 0 0 DL vlruwt 0xc91749c0 [vnlru] 9 0 0 0 DL syncer 0xc15d85d4 [syncer] 8 0 0 0 DL (threaded) [bufdaemon] 100072 D psleep 0xc15d7d04 [bufdaemon] 100085 D sdflush 0xc8fcee84 [/home worker] 100087 D sdflush 0xc98ecc84 [/usr worker] 100088 D sdflush 0xc98eca84 [/var worker] 100182 D sdflush 0xc8fcf284 [/tmp worker] 7 0 0 0 DL pgzero 0xc15dd848 [pagezero] 6 0 0 0 DL psleep 0xc15dd5c4 [vmdaemon] 5 0 0 0 DL (threaded) [pagedaemon] 100069 D psleep 0xc163b104 [pagedaemon] 100075 D umarcl 0xc15dd1a4 [uma] 4 0 0 0 DL waiting_ 0xc1637a9c [sctp_iterator] 3 0 0 0 DL - 0xc8c2ca3c [fdc0] 15 0 0 0 DL (threaded) [usb] 100032 D - 0xc8c3eacc [usbus0] 100033 D - 0xc8c3eafc [usbus0] 100034 D - 0xc8c3eb2c [usbus0] 100035 D - 0xc8c3eb5c [usbus0] 100037 D - 0xc8c8bacc [usbus1] 100038 D - 0xc8c8bafc [usbus1] 100039 D - 0xc8c8bb2c [usbus1] 100040 D - 0xc8c8bb5c [usbus1] 100042 D - 0xc8c94acc [usbus2] 100043 D - 0xc8c94afc [usbus2] 100044 D - 0xc8c94b2c [usbus2] 100045 D - 0xc8c94b5c [usbus2] 100046 D - 0xc8c9aacc [usbus3] 100047 D - 0xc8c9aafc [usbus3] 100048 D - 0xc8c9ab2c [usbus3] 100049 D - 0xc8c9ab5c [usbus3] 100050 D - 0xc8ca2acc [usbus4] 100051 D - 0xc8ca2afc [usbus4] 100052 D - 0xc8ca2b2c [usbus4] 100053 D - 0xc8ca2b5c [usbus4] 100055 D - 0xc8c44ca4 [usbus5] 100056 D - 0xc8c44cd4 [usbus5] 100057 D - 0xc8c44d04 [usbus5] 100058 D - 0xc8c44d34 [usbus5] 2 0 0 0 DL (threaded) [cam] 100024 D - 0xc1495e00 [doneq0] 100068 D - 0xc1495cac [scanner] 14 0 0 0 DL - 0xc14b09d0 [rand_harvestq] 13 0 0 0 DL (threaded) [geom] 100013 D - 0xc1632c20 [g_event] 100014 D - 0xc1632c24 [g_up] 100015 D - 0xc1632c28 [g_down] 12 0 0 0 WL (threaded) [intr] 100007 I [swi4: clock (0)] 100008 I [swi4: clock (1)] 100009 I [swi4: clock (2)] 100010 I [swi4: clock (3)] 100011 I [swi1: netisr 0] 100012 I [swi3: vm] 100019 I [swi5: fast taskq] 100025 I [swi6: task queue] 100026 I [swi6: Giant taskq] 100028 I [irq256: hdac0] 100029 I [irq257: re0] 100030 I [irq22: ahci0] 100031 I [irq16: hdac1 ohci0] 100036 I [irq17: ohci1 ohci3] 100041 I [irq18: ohci2 ohci4] 100054 I [irq19: ehci0] 100059 I [irq14: ata0] 100060 I [swi0: uart] 100062 I [irq1: atkbd0] 100063 I [irq12: psm0] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 1 0 1 0 SLs wait 0xc8a2c9c0 [init] 10 0 0 0 DL audit_wo 0xc16399d0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xc1632c44 [swapper] 100016 D - 0xc857be80 [firmware taskq] 100018 D - 0xc857bb80 [thread taskq] 100020 D - 0xc857ba80 [kqueue taskq] 100021 D - 0xc857ba00 [acpi_task_0] 100022 D - 0xc857ba00 [acpi_task_1] 100023 D - 0xc857ba00 [acpi_task_2] 100027 D - 0xc857b800 [ffs_trim taskq] 100064 D - 0xc8cf3780 [mca taskq] 100065 D - 0xc155ec4d [deadlkres] 100067 D - 0xc857b980 [CAM taskq] db:0:ps> allt Tracing command sleep pid 86159 tid 100083 td 0xc9496000 sched_switch(c9496000,0,104,1a9,edb32a84,...) at sched_switch+0x4e2/frame 0xedb32a4c mi_switch(104,0,c11e58c5,200,7dcf,...) at mi_switch+0x1bf/frame 0xedb32a84 sleepq_switch(c9496000,0,c11e58c5,1b6,8,...) at sleepq_switch+0x1c5/frame 0xedb32ab8 sleepq_catch_signals(c0bacdb0,c9496000,3,201,3,...) at sleepq_catch_signals+0x382/frame 0xedb32af4 sleepq_timedwait_sig(c155fd43,6c,7dcf,a0000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xedb32b1c _sleep(c155fd43,0,16c,c11e0826,9d87bc59,...) at _sleep+0x326/frame 0xedb32b78 kern_nanosleep(bfbfed00,edb32bf0,edb32bf8,edb32ce8,a,...) at kern_nanosleep+0x14b/frame 0xedb32bd8 sys_nanosleep(c9496000,edb32ca8,c11d816d,4,c10657b7,...) at sys_nanosleep+0x68/frame 0xedb32c18 syscall(edb32ce8) at syscall+0x34a/frame 0xedb32cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedb32cdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2813584f, esp = 0xbfbfeccc, ebp = 0xbfbfed14 --- Tracing command dup2 pid 77767 tid 104066 td 0xcc138000 sched_switch(cc138000,0,104,1a9,fa5f9998,...) at sched_switch+0x4e2/frame 0xfa5f9960 mi_switch(104,0,c11e58c5,200,c157d500,...) at mi_switch+0x1bf/frame 0xfa5f9998 sleepq_switch(cc138000,0,c11e58c5,276,c157d580,...) at sleepq_switch+0x1c5/frame 0xfa5f99cc sleepq_wait(c157d580,0,fa5f9a20,1,0,...) at sleepq_wait+0x48/frame 0xfa5f99f0 _cv_wait(c157d580,c157d500,c11e6ebd,4b2,c1455bf0,...) at _cv_wait+0x1fe/frame 0xfa5f9a34 vmem_xalloc(c157d500,5ca000,0,0,0,...) at vmem_xalloc+0x1df/frame 0xfa5f9aa8 vmem_alloc(c157d500,5ca000,2102,fa5f9af8,0,...) at vmem_alloc+0xc4/frame 0xfa5f9ae0 kmem_malloc(c157d500,5ca000,102,2,5ca000,...) at kmem_malloc+0x3b/frame 0xfa5f9b08 uma_large_malloc(5ca000,102,102,c0b69e90,0,...) at uma_large_malloc+0x40/frame 0xfa5f9b28 malloc(5c9e0c,c1451538,102,5fb,8,...) at malloc+0xb7/frame 0xfa5f9b74 fdgrowtable(db408a80,14,c11d72d1,5e0,28,...) at fdgrowtable+0x7e/frame 0xfa5f9bb0 do_dup(1,14ce8) at do_dup+0x207/frame 0xfa5f9c08 sys_dup2(cc138000,fa5f9ca8,c11d816d,4,c10657b7,...) at sys_dup2+0x22/frame 0xfa5f9c18 syscall(fa5f9ce8) at syscall+0x34a/frame 0xfa5f9cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfa5f9cdc --- syscall (90, FreeBSD ELF32, sys_dup2), eip = 0x2811b82f, esp = 0xbfbfe868, ebp = 0xbfbfe894 --- Tracing command tee pid 77756 tid 102409 td 0xdc788620 sched_switch(dc788620,0,104,1a9,f9cc5a18,...) at sched_switch+0x4e2/frame 0xf9cc59e0 mi_switch(104,0,c11e58c5,200,dc02d528,...) at mi_switch+0x1bf/frame 0xf9cc5a18 sleepq_switch(dc788620,0,c11e58c5,1b6,c11e58c5,...) at sleepq_switch+0x1c5/frame 0xf9cc5a4c sleepq_catch_signals(c11e58c5,16d,c949d988,468,dc788620,...) at sleepq_catch_signals+0x382/frame 0xf9cc5a88 sleepq_wait_sig(c949d7f8,5c,c11e9024,100,0,...) at sleepq_wait_sig+0x14/frame 0xf9cc5aac _sleep(c949d7f8,c949d978,15c,c11e9024,0,...) at _sleep+0x356/frame 0xf9cc5b08 pipe_read(d7bcdce8,f9cc5be8,ca47e700,0,dc788620,...) at pipe_read+0x2da/frame 0xf9cc5b4c dofileread(d7bcdce8,f9cc5be8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xf9cc5b80 kern_readv(dc788620,0,f9cc5be8,c0e24d69,28803000,...) at kern_readv+0x93/frame 0xf9cc5bc8 sys_read(dc788620,f9cc5ca8,c11d816d,4,c10657b7,...) at sys_read+0x59/frame 0xf9cc5c18 syscall(f9cc5ce8) at syscall+0x34a/frame 0xf9cc5cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf9cc5cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a1f0f, esp = 0xbfbfe858, ebp = 0xbfbfe884 --- Tracing command sh pid 77755 tid 104661 td 0xd3870c40 sched_switch(d3870c40,0,104,1a9,fbf2f9a0,...) at sched_switch+0x4e2/frame 0xfbf2f968 mi_switch(104,0,c11e58c5,200,c11f0073,...) at mi_switch+0x1bf/frame 0xfbf2f9a0 sleepq_switch(d3870c40,0,c11e58c5,1b6,c11e58c5,...) at sleepq_switch+0x1c5/frame 0xfbf2f9d4 sleepq_catch_signals(c11e58c5,16d,cefe50b8,780,d3870c40,...) at sleepq_catch_signals+0x382/frame 0xfbf2fa10 sleepq_wait_sig(cefe5000,6c,c11e965d,100,0,...) at sleepq_wait_sig+0x14/frame 0xfbf2fa34 _sleep(cefe5000,cefe50a8,16c,c11e965d,0,...) at _sleep+0x356/frame 0xfbf2fa90 kern_wait6(d3870c40,7,0,0,fbf2fb24,...) at kern_wait6+0x45b/frame 0xfbf2faf8 sys_wait4(d3870c40,fbf2fca8,c11d816d,4,0,...) at sys_wait4+0x8b/frame 0xfbf2fc18 syscall(fbf2fce8) at syscall+0x34a/frame 0xfbf2fcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfbf2fcdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2817f7af, esp = 0xbfbfe588, ebp = 0xbfbfe5a0 --- Tracing command sh pid 21701 tid 100389 td 0xcdda1310 sched_switch(cdda1310,0,104,1a9,c80f59a0,...) at sched_switch+0x4e2/frame 0xc80f5968 mi_switch(104,0,c11e58c5,200,c121d5ac,...) at mi_switch+0x1bf/frame 0xc80f59a0 sleepq_switch(cdda1310,0,c11e58c5,1b6,c11e58c5,...) at sleepq_switch+0x1c5/frame 0xc80f59d4 sleepq_catch_signals(c11e58c5,16d,d53ad0b8,1380,cdda1310,...) at sleepq_catch_signals+0x382/frame 0xc80f5a10 sleepq_wait_sig(d53ad000,6c,c11e965d,100,0,...) at sleepq_wait_sig+0x14/frame 0xc80f5a34 _sleep(d53ad000,d53ad0a8,16c,c11e965d,0,...) at _sleep+0x356/frame 0xc80f5a90 kern_wait6(cdda1310,7,0,0,c80f5b24,...) at kern_wait6+0x45b/frame 0xc80f5af8 sys_wait4(cdda1310,c80f5ca8,c11d816d,4,0,...) at sys_wait4+0x8b/frame 0xc80f5c18 syscall(c80f5ce8) at syscall+0x34a/frame 0xc80f5cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xc80f5cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2817f7af, esp = 0xbfbfe780, ebp = 0xbfbfe798 --- Tracing command awk pid 1445 tid 100221 td 0xd2771930 sched_switch(d2771930,0,104,1a9,f8a66a18,...) at sched_switch+0x4e2/frame 0xf8a669e0 mi_switch(104,0,c11e58c5,200,c156c680,...) at mi_switch+0x1bf/frame 0xf8a66a18 sleepq_switch(d2771930,0,c11e58c5,1b6,c11e58c5,...) at sleepq_switch+0x1c5/frame 0xf8a66a4c sleepq_catch_signals(c11e58c5,16d,c9ca5658,ea0,d2771930,...) at sleepq_catch_signals+0x382/frame 0xf8a66a88 sleepq_wait_sig(c9ca54c8,5c,c11e9024,100,0,...) at sleepq_wait_sig+0x14/frame 0xf8a66aac _sleep(c9ca54c8,c9ca5648,15c,c11e9024,0,...) at _sleep+0x356/frame 0xf8a66b08 pipe_read(c9422930,f8a66be8,ca35a900,0,d2771930,...) at pipe_read+0x2da/frame 0xf8a66b4c dofileread(c9422930,f8a66be8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xf8a66b80 kern_readv(d2771930,0,f8a66be8,40c092,2882e000,...) at kern_readv+0x93/frame 0xf8a66bc8 sys_read(d2771930,f8a66ca8,c11d816d,4,c10657b7,...) at sys_read+0x59/frame 0xf8a66c18 syscall(f8a66ce8) at syscall+0x34a/frame 0xf8a66cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8a66cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281f1f0f, esp = 0xbfbfea28, ebp = 0xbfbfea3c --- Tracing command sh pid 1444 tid 100220 td 0xd2771c40 sched_switch(d2771c40,0,104,1a9,f8a639a0,...) at sched_switch+0x4e2/frame 0xf8a63968 mi_switch(104,0,c11e58c5,200,28,...) at mi_switch+0x1bf/frame 0xf8a639a0 sleepq_switch(d2771c40,0,c11e58c5,1b6,c11e58c5,...) at sleepq_switch+0x1c5/frame 0xf8a639d4 sleepq_catch_signals(c11e58c5,16d,d2a363f8,348,d2771c40,...) at sleepq_catch_signals+0x382/frame 0xf8a63a10 sleepq_wait_sig(d2a36340,6c,c11e965d,100,0,...) at sleepq_wait_sig+0x14/frame 0xf8a63a34 _sleep(d2a36340,d2a363e8,16c,c11e965d,0,...) at _sleep+0x356/frame 0xf8a63a90 kern_wait6(d2771c40,7,0,0,f8a63b24,...) at kern_wait6+0x45b/frame 0xf8a63af8 sys_wait4(d2771c40,f8a63ca8,c11d816d,4,0,...) at sys_wait4+0x8b/frame 0xf8a63c18 syscall(f8a63ce8) at syscall+0x34a/frame 0xf8a63cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8a63cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2817f7af, esp = 0xbfbfe980, ebp = 0xbfbfe998 --- Tracing command top pid 1443 tid 100219 td 0xca58a620 sched_switch(ca58a620,0,104,1a9,f8a60910,...) at sched_switch+0x4e2/frame 0xf8a608d8 mi_switch(104,0,c11e58c5,200,c1634590,...) at mi_switch+0x1bf/frame 0xf8a60910 sleepq_switch(ca58a620,0,c11e58c5,1b6,c93eda10,...) at sleepq_switch+0x1c5/frame 0xf8a60944 sleepq_catch_signals(c1455bf0,f8a609a8,c0b454f9,c93eda20,0,...) at sleepq_catch_signals+0x382/frame 0xf8a60980 sleepq_timedwait_sig(c93eda24,0,f8a609e4,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf8a609a8 _cv_timedwait_sig_sbt(c93eda24,c93eda10,5f528f68,7dca,10000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xf8a609f8 seltdwait(7dca,10000000,0,ca58a620,0,...) at seltdwait+0xad/frame 0xf8a60a28 kern_select(ca58a620,2,bfbfebf8,0,0,...) at kern_select+0x914/frame 0xf8a60bd0 sys_select(ca58a620,f8a60ca8,c11d816d,4,c10657b7,...) at sys_select+0x66/frame 0xf8a60c18 syscall(f8a60ce8) at syscall+0x34a/frame 0xf8a60cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8a60cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2822deff, esp = 0xbfbfeb8c, ebp = 0xbfbfed04 --- Tracing command sshd pid 1442 tid 100217 td 0xca58a930 sched_switch(ca58a930,0,104,1a9,f8a5a918,...) at sched_switch+0x4e2/frame 0xf8a5a8e0 mi_switch(104,0,c11e58c5,200,26,...) at mi_switch+0x1bf/frame 0xf8a5a918 sleepq_switch(ca58a930,0,c11e58c5,1b6,f8a5a990,...) at sleepq_switch+0x1c5/frame 0xf8a5a94c sleepq_catch_signals(f8a5a9ac,c0b454f9,c93edaa0,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf8a5a988 sleepq_wait_sig(c93edaa4,0,f8a5a9e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8a5a9ac _cv_wait_sig(c93edaa4,c93eda90,c11e8daf,732,1ae,...) at _cv_wait_sig+0x214/frame 0xf8a5a9f8 seltdwait(ffffffff,0,0,ca58a930,0,...) at seltdwait+0xbb/frame 0xf8a5aa28 kern_select(ca58a930,a,28c0c1e0,28c0c1e8,0,...) at kern_select+0x914/frame 0xf8a5abd0 sys_select(ca58a930,f8a5aca8,c11d816d,4,c10657b7,...) at sys_select+0x66/frame 0xf8a5ac18 syscall(f8a5ace8) at syscall+0x34a/frame 0xf8a5acdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8a5acdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284e8eff, esp = 0xbfbfe7cc, ebp = 0xbfbfe7f0 --- Tracing command sh pid 1441 tid 100218 td 0xd2772000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c11e3878,c8a39930,e4741424,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xe4741408 kdb_backtrace(c11e38f5,280,e47415bc,c105d030,8,...) at kdb_backtrace+0x2d/frame 0xe4741470 kdb_reenter(8,c11e62e6,225,e47414a8,c8a39930,...) at kdb_reenter+0x31/frame 0xe4741480 trap(e47415c8) at trap+0x50/frame 0xe47415bc calltrap() at calltrap+0x6/frame 0xe47415bc --- trap 0xc, eip = 0xc1048c56, esp = 0xe4741608, ebp = 0xe4741618 --- db_trace_thread(d2772000,ffffffff,5a1,1877a,d2772000,...) at db_trace_thread+0x16/frame 0xe4741618 db_stack_trace_all(c157d500,0,ffffffff,e47416b8,0,...) at db_stack_trace_all+0xa2/frame 0xe4741684 db_command(c1499802,0,c1629ce0,c1499801,a,...) at db_command+0x39f/frame 0xe4741740 db_script_exec(e47417f0,0,c8b58250,e47417dc,1,...) at db_script_exec+0x168/frame 0xe47417a8 db_command(c10ad9c3,e47418c8,c053337b,c10adab4,c079a0d7,...) at db_command+0x39f/frame 0xe4741864 db_command_loop(c10adab4,c079a0d7,c15deba4,1,c8a12d00,...) at db_command_loop+0x50/frame 0xe4741870 db_trap(3,0,c8afb620,46,1,...) at db_trap+0xdb/frame 0xe47418c8 kdb_trap(3,0,e4741a48,e4741a90,0,...) at kdb_trap+0x117/frame 0xe4741900 trap(e4741a48) at trap+0x87f/frame 0xe4741a3c calltrap() at calltrap+0x6/frame 0xe4741a3c --- trap 0x3, eip = 0xc0b9b912, esp = 0xe4741a88, ebp = 0xe4741a9c --- kdb_alt_break_internal(0,e4741ac8,c097ded7,2,c8cd7884,...) at kdb_alt_break_internal+0x162/frame 0xe4741a9c kdb_alt_break(2,c8cd7884,c11a75b9,c8cd7800,40000,...) at kdb_alt_break+0x16/frame 0xe4741aa8 uart_intr_rxready(c8cd7800,e472ec80,8,c13a3113,342,...) at uart_intr_rxready+0x87/frame 0xe4741ac8 uart_intr(c8cd7800,c0b462c8,c1634400,a,0,...) at uart_intr+0x100/frame 0xe4741b04 intr_event_handle(c88e2900,e4741b80,0,2,0,...) at intr_event_handle+0x7a/frame 0xe4741b30 intr_execute_handlers(c8a90108,e4741b80,2) at intr_execute_handlers+0x42/frame 0xe4741b50 lapic_handle_intr(30,e4741b80) at lapic_handle_intr+0x5d/frame 0xe4741b70 Xapic_isr1() at Xapic_isr1+0x4a/frame 0xe4741b70 --- interrupt, eip = 0xc1045375, esp = 0xe4741bc0, ebp = 0xe4741bc0 --- acpi_cpu_c1(e472ec90,0,c13a3113,2ec,7dca,...) at acpi_cpu_c1+0x5/frame 0xe4741bc0 acpi_cpu_idle(7fcf3e80,0,7fcf3e80,e4741c30,c107656d,...) at acpi_cpu_idle+0x166/frame 0xe4741c00 cpu_idle_acpi(7fcf3e80,0,4,c156ce08,c156ce04,...) at cpu_idle_acpi+0x3f/frame 0xe4741c14 cpu_idle(0,e4741c80,c11e18f2,a48,c156ce08,...) at cpu_idle+0x9d/frame 0xe4741c30 sched_idletd(0,e4741ce8,c11d854c,3dc,0,...) at sched_idletd+0x3cb/frame 0xe4741cac fork_exit(c0b89380,0,e4741ce8) at fork_exit+0x7e/frame 0xe4741cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4741cd4 --- trap 0, eip = 0, esp = 0xe4741d20, ebp = 0 --- Tracing command sshd pid 1440 tid 100194 td 0xcdda0930 sched_switch(cdda0930,0,104,1a9,f8a15918,...) at sched_switch+0x4e2/frame 0xf8a158e0 mi_switch(104,0,c11e58c5,200,26,...) at mi_switch+0x1bf/frame 0xf8a15918 sleepq_switch(cdda0930,0,c11e58c5,1b6,f8a15990,...) at sleepq_switch+0x1c5/frame 0xf8a1594c sleepq_catch_signals(f8a159ac,c0b454f9,c9395ce0,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf8a15988 sleepq_wait_sig(c9395ce4,0,f8a159e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8a159ac _cv_wait_sig(c9395ce4,c9395cd0,c11e8daf,732,c11e8e69,...) at _cv_wait_sig+0x214/frame 0xf8a159f8 seltdwait(ffffffff,0,0,cdda0930,0,...) at seltdwait+0xbb/frame 0xf8a15a28 kern_select(cdda0930,c,28c0c1e0,28c0c1e8,0,...) at kern_select+0x914/frame 0xf8a15bd0 sys_select(cdda0930,f8a15ca8,c11d816d,4,8,...) at sys_select+0x66/frame 0xf8a15c18 syscall(f8a15ce8) at syscall+0x34a/frame 0xf8a15cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8a15cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284e8eff, esp = 0xbfbfe7cc, ebp = 0xbfbfe7f0 --- Tracing command tail pid 1439 tid 100149 td 0xca56c930 sched_switch(ca56c930,0,104,1a9,f8906954,...) at sched_switch+0x4e2/frame 0xf890691c mi_switch(104,0,c11e58c5,200,7dcb,...) at mi_switch+0x1bf/frame 0xf8906954 sleepq_switch(ca56c930,0,c11e58c5,1b6,8,...) at sleepq_switch+0x1c5/frame 0xf8906988 sleepq_catch_signals(c0bacdb0,ca56c930,0,201,0,...) at sleepq_catch_signals+0x382/frame 0xf89069c4 sleepq_timedwait_sig(c948dc80,68,7dcb,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf89069ec _sleep(c948dc80,c948dc80,168,c11d7f44,4cc37d04,...) at _sleep+0x326/frame 0xf8906a48 kern_kevent(ca56c930,4,0,1,f8906be8,...) at kern_kevent+0x49d/frame 0xf8906b98 sys_kevent(ca56c930,f8906ca8,c11d816d,4,c10657b7,...) at sys_kevent+0x12c/frame 0xf8906c18 syscall(f8906ce8) at syscall+0x34a/frame 0xf8906cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8906cdc --- syscall (363, FreeBSD ELF32, sys_kevent), eip = 0x28181fbf, esp = 0xbfbfebbc, ebp = 0xbfbfec68 --- Tracing command sshd pid 1438 tid 100184 td 0xcca5cc40 sched_switch(cca5cc40,0,104,1a9,f898c918,...) at sched_switch+0x4e2/frame 0xf898c8e0 mi_switch(104,0,c11e58c5,200,26,...) at mi_switch+0x1bf/frame 0xf898c918 sleepq_switch(cca5cc40,0,c11e58c5,1b6,f898c990,...) at sleepq_switch+0x1c5/frame 0xf898c94c sleepq_catch_signals(f898c9ac,c0b454f9,c93951a0,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf898c988 sleepq_wait_sig(c93951a4,0,f898c9e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xf898c9ac _cv_wait_sig(c93951a4,c9395190,c11e8daf,732,c11e8e69,...) at _cv_wait_sig+0x214/frame 0xf898c9f8 seltdwait(ffffffff,0,0,cca5cc40,0,...) at seltdwait+0xbb/frame 0xf898ca28 kern_select(cca5cc40,c,28c0c1e0,28c0c1e8,0,...) at kern_select+0x914/frame 0xf898cbd0 sys_select(cca5cc40,f898cca8,c11d816d,4,c10657b7,...) at sys_select+0x66/frame 0xf898cc18 syscall(f898cce8) at syscall+0x34a/frame 0xf898ccdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf898ccdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284e8eff, esp = 0xbfbfe7cc, ebp = 0xbfbfe7f0 --- Tracing command sshd pid 1434 tid 100216 td 0xd2772310 sched_switch(d2772310,0,104,1a9,f8a57950,...) at sched_switch+0x4e2/frame 0xf8a57918 mi_switch(104,0,c11e58c5,200,f8a579bc,...) at mi_switch+0x1bf/frame 0xf8a57950 sleepq_switch(d2772310,0,c11e58c5,1b6,f8a579c8,...) at sleepq_switch+0x1c5/frame 0xf8a57984 sleepq_catch_signals(f8a579e4,c0b454f9,c88e9320,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf8a579c0 sleepq_wait_sig(c88e9324,0,f8a57a1c,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8a579e4 _cv_wait_sig(c88e9324,c88e9310,c11e8daf,732,62d,...) at _cv_wait_sig+0x214/frame 0xf8a57a30 seltdwait(ffffffff,0,0,d2772310,0,...) at seltdwait+0xbb/frame 0xf8a57a60 kern_poll(d2772310,bfbfe860,1,0,0,...) at kern_poll+0x4f0/frame 0xf8a57be0 sys_poll(d2772310,f8a57ca8,c11d816d,4,c10657b7,...) at sys_poll+0x71/frame 0xf8a57c18 syscall(f8a57ce8) at syscall+0x34a/frame 0xf8a57cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8a57cdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x28487c53, esp = 0xbfbfe82c, ebp = 0xbfbfe848 --- Tracing command sshd pid 1433 tid 100215 td 0xca58ac40 sched_switch(ca58ac40,0,104,1a9,f8a54950,...) at sched_switch+0x4e2/frame 0xf8a54918 mi_switch(104,0,c11e58c5,200,f8a549bc,...) at mi_switch+0x1bf/frame 0xf8a54950 sleepq_switch(ca58ac40,0,c11e58c5,1b6,f8a549c8,...) at sleepq_switch+0x1c5/frame 0xf8a54984 sleepq_catch_signals(f8a549e4,c0b454f9,c93edae0,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf8a549c0 sleepq_wait_sig(c93edae4,0,f8a54a1c,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8a549e4 _cv_wait_sig(c93edae4,c93edad0,c11e8daf,732,62d,...) at _cv_wait_sig+0x214/frame 0xf8a54a30 seltdwait(ffffffff,0,0,ca58ac40,0,...) at seltdwait+0xbb/frame 0xf8a54a60 kern_poll(ca58ac40,bfbfe860,1,0,0,...) at kern_poll+0x4f0/frame 0xf8a54be0 sys_poll(ca58ac40,f8a54ca8,c11d816d,4,c156bf90,...) at sys_poll+0x71/frame 0xf8a54c18 syscall(f8a54ce8) at syscall+0x34a/frame 0xf8a54cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8a54cdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x28487c53, esp = 0xbfbfe82c, ebp = 0xbfbfe848 --- Tracing command sshd pid 1432 tid 100191 td 0xca58b310 sched_switch(ca58b310,0,104,1a9,f89a1950,...) at sched_switch+0x4e2/frame 0xf89a1918 mi_switch(104,0,c11e58c5,200,f89a19bc,...) at mi_switch+0x1bf/frame 0xf89a1950 sleepq_switch(ca58b310,0,c11e58c5,1b6,f89a19c8,...) at sleepq_switch+0x1c5/frame 0xf89a1984 sleepq_catch_signals(f89a19e4,c0b454f9,c93951e0,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf89a19c0 sleepq_wait_sig(c93951e4,0,f89a1a1c,101,0,...) at sleepq_wait_sig+0x14/frame 0xf89a19e4 _cv_wait_sig(c93951e4,c93951d0,c11e8daf,732,62d,...) at _cv_wait_sig+0x214/frame 0xf89a1a30 seltdwait(ffffffff,0,0,ca58b310,0,...) at seltdwait+0xbb/frame 0xf89a1a60 kern_poll(ca58b310,bfbfe860,1,0,0,...) at kern_poll+0x4f0/frame 0xf89a1be0 sys_poll(ca58b310,f89a1ca8,c11d816d,4,c156c690,...) at sys_poll+0x71/frame 0xf89a1c18 syscall(f89a1ce8) at syscall+0x34a/frame 0xf89a1cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf89a1cdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x28487c53, esp = 0xbfbfe82c, ebp = 0xbfbfe848 --- Tracing command bash pid 1153 tid 100171 td 0xca56b310 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c11e3878,c8a39930,e4741424,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xe4741408 kdb_backtrace(c11e38f5,280,e47415bc,c105d030,8,...) at kdb_backtrace+0x2d/frame 0xe4741470 kdb_reenter(8,c11e62e6,225,e47414a8,c8a39930,...) at kdb_reenter+0x31/frame 0xe4741480 trap(e47415c8) at trap+0x50/frame 0xe47415bc calltrap() at calltrap+0x6/frame 0xe47415bc --- trap 0xc, eip = 0xc1048c56, esp = 0xe4741608, ebp = 0xe4741618 --- db_trace_thread(ca56b310,ffffffff,481,1874b,ca56b310,...) at db_trace_thread+0x16/frame 0xe4741618 db_stack_trace_all(c157d500,0,ffffffff,e47416b8,0,...) at db_stack_trace_all+0xa2/frame 0xe4741684 db_command(c1499802,0,c1629ce0,c1499801,a,...) at db_command+0x39f/frame 0xe4741740 db_script_exec(e47417f0,0,c8b58250,e47417dc,1,...) at db_script_exec+0x168/frame 0xe47417a8 db_command(c10ad9c3,e47418c8,c053337b,c10adab4,c079a0d7,...) at db_command+0x39f/frame 0xe4741864 db_command_loop(c10adab4,c079a0d7,c15deba4,1,c8a12d00,...) at db_command_loop+0x50/frame 0xe4741870 db_trap(3,0,c8afb620,46,1,...) at db_trap+0xdb/frame 0xe47418c8 kdb_trap(3,0,e4741a48,e4741a90,0,...) at kdb_trap+0x117/frame 0xe4741900 trap(e4741a48) at trap+0x87f/frame 0xe4741a3c calltrap() at calltrap+0x6/frame 0xe4741a3c --- trap 0x3, eip = 0xc0b9b912, esp = 0xe4741a88, ebp = 0xe4741a9c --- kdb_alt_break_internal(0,e4741ac8,c097ded7,2,c8cd7884,...) at kdb_alt_break_internal+0x162/frame 0xe4741a9c kdb_alt_break(2,c8cd7884,c11a75b9,c8cd7800,40000,...) at kdb_alt_break+0x16/frame 0xe4741aa8 uart_intr_rxready(c8cd7800,e472ec80,8,c13a3113,342,...) at uart_intr_rxready+0x87/frame 0xe4741ac8 uart_intr(c8cd7800,c0b462c8,c1634400,a,0,...) at uart_intr+0x100/frame 0xe4741b04 intr_event_handle(c88e2900,e4741b80,0,2,0,...) at intr_event_handle+0x7a/frame 0xe4741b30 intr_execute_handlers(c8a90108,e4741b80,2) at intr_execute_handlers+0x42/frame 0xe4741b50 lapic_handle_intr(30,e4741b80) at lapic_handle_intr+0x5d/frame 0xe4741b70 Xapic_isr1() at Xapic_isr1+0x4a/frame 0xe4741b70 --- interrupt, eip = 0xc1045375, esp = 0xe4741bc0, ebp = 0xe4741bc0 --- acpi_cpu_c1(e472ec90,0,c13a3113,2ec,7dca,...) at acpi_cpu_c1+0x5/frame 0xe4741bc0 acpi_cpu_idle(7fcf3e80,0,7fcf3e80,e4741c30,c107656d,...) at acpi_cpu_idle+0x166/frame 0xe4741c00 cpu_idle_acpi(7fcf3e80,0,4,c156ce08,c156ce04,...) at cpu_idle_acpi+0x3f/frame 0xe4741c14 cpu_idle(0,e4741c80,c11e18f2,a48,c156ce08,...) at cpu_idle+0x9d/frame 0xe4741c30 sched_idletd(0,e4741ce8,c11d854c,3dc,0,...) at sched_idletd+0x3cb/frame 0xe4741cac fork_exit(c0b89380,0,e4741ce8) at fork_exit+0x7e/frame 0xe4741cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4741cd4 --- trap 0, eip = 0, esp = 0xe4741d20, ebp = 0 --- Tracing command csh pid 1151 tid 100153 td 0xc9397000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c11e3878,c8a39930,e4741424,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xe4741408 kdb_backtrace(c11e38f5,280,e47415bc,c105d030,8,...) at kdb_backtrace+0x2d/frame 0xe4741470 kdb_reenter(8,c11e62e6,225,e47414a8,c8a39930,...) at kdb_reenter+0x31/frame 0xe4741480 trap(e47415c8) at trap+0x50/frame 0xe47415bc calltrap() at calltrap+0x6/frame 0xe47415bc --- trap 0xc, eip = 0xc1048c56, esp = 0xe4741608, ebp = 0xe4741618 --- db_trace_thread(c9397000,ffffffff,47f,18739,c9397000,...) at db_trace_thread+0x16/frame 0xe4741618 db_stack_trace_all(c157d500,0,ffffffff,e47416b8,0,...) at db_stack_trace_all+0xa2/frame 0xe4741684 db_command(c1499802,0,c1629ce0,c1499801,a,...) at db_command+0x39f/frame 0xe4741740 db_script_exec(e47417f0,0,c8b58250,e47417dc,1,...) at db_script_exec+0x168/frame 0xe47417a8 db_command(c10ad9c3,e47418c8,c053337b,c10adab4,c079a0d7,...) at db_command+0x39f/frame 0xe4741864 db_command_loop(c10adab4,c079a0d7,c15deba4,1,c8a12d00,...) at db_command_loop+0x50/frame 0xe4741870 db_trap(3,0,c8afb620,46,1,...) at db_trap+0xdb/frame 0xe47418c8 kdb_trap(3,0,e4741a48,e4741a90,0,...) at kdb_trap+0x117/frame 0xe4741900 trap(e4741a48) at trap+0x87f/frame 0xe4741a3c calltrap() at calltrap+0x6/frame 0xe4741a3c --- trap 0x3, eip = 0xc0b9b912, esp = 0xe4741a88, ebp = 0xe4741a9c --- kdb_alt_break_internal(0,e4741ac8,c097ded7,2,c8cd7884,...) at kdb_alt_break_internal+0x162/frame 0xe4741a9c kdb_alt_break(2,c8cd7884,c11a75b9,c8cd7800,40000,...) at kdb_alt_break+0x16/frame 0xe4741aa8 uart_intr_rxready(c8cd7800,e472ec80,8,c13a3113,342,...) at uart_intr_rxready+0x87/frame 0xe4741ac8 uart_intr(c8cd7800,c0b462c8,c1634400,a,0,...) at uart_intr+0x100/frame 0xe4741b04 intr_event_handle(c88e2900,e4741b80,0,2,0,...) at intr_event_handle+0x7a/frame 0xe4741b30 intr_execute_handlers(c8a90108,e4741b80,2) at intr_execute_handlers+0x42/frame 0xe4741b50 lapic_handle_intr(30,e4741b80) at lapic_handle_intr+0x5d/frame 0xe4741b70 Xapic_isr1() at Xapic_isr1+0x4a/frame 0xe4741b70 --- interrupt, eip = 0xc1045375, esp = 0xe4741bc0, ebp = 0xe4741bc0 --- acpi_cpu_c1(e472ec90,0,c13a3113,2ec,7dca,...) at acpi_cpu_c1+0x5/frame 0xe4741bc0 acpi_cpu_idle(7fcf3e80,0,7fcf3e80,e4741c30,c107656d,...) at acpi_cpu_idle+0x166/frame 0xe4741c00 cpu_idle_acpi(7fcf3e80,0,4,c156ce08,c156ce04,...) at cpu_idle_acpi+0x3f/frame 0xe4741c14 cpu_idle(0,e4741c80,c11e18f2,a48,c156ce08,...) at cpu_idle+0x9d/frame 0xe4741c30 sched_idletd(0,e4741ce8,c11d854c,3dc,0,...) at sched_idletd+0x3cb/frame 0xe4741cac fork_exit(c0b89380,0,e4741ce8) at fork_exit+0x7e/frame 0xe4741cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4741cd4 --- trap 0, eip = 0, esp = 0xe4741d20, ebp = 0 --- Tracing command su pid 1150 tid 100181 td 0xcca5d310 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c11e3878,c8a39930,e4741424,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xe4741408 kdb_backtrace(c11e38f5,280,e47415bc,c105d030,8,...) at kdb_backtrace+0x2d/frame 0xe4741470 kdb_reenter(8,c11e62e6,225,e47414a8,c8a39930,...) at kdb_reenter+0x31/frame 0xe4741480 trap(e47415c8) at trap+0x50/frame 0xe47415bc calltrap() at calltrap+0x6/frame 0xe47415bc --- trap 0xc, eip = 0xc1048c56, esp = 0xe4741608, ebp = 0xe4741618 --- db_trace_thread(cca5d310,ffffffff,47e,18755,cca5d310,...) at db_trace_thread+0x16/frame 0xe4741618 db_stack_trace_all(c157d500,0,ffffffff,e47416b8,0,...) at db_stack_trace_all+0xa2/frame 0xe4741684 db_command(c1499802,0,c1629ce0,c1499801,a,...) at db_command+0x39f/frame 0xe4741740 db_script_exec(e47417f0,0,c8b58250,e47417dc,1,...) at db_script_exec+0x168/frame 0xe47417a8 db_command(c10ad9c3,e47418c8,c053337b,c10adab4,c079a0d7,...) at db_command+0x39f/frame 0xe4741864 db_command_loop(c10adab4,c079a0d7,c15deba4,1,c8a12d00,...) at db_command_loop+0x50/frame 0xe4741870 db_trap(3,0,c8afb620,46,1,...) at db_trap+0xdb/frame 0xe47418c8 kdb_trap(3,0,e4741a48,e4741a90,0,...) at kdb_trap+0x117/frame 0xe4741900 trap(e4741a48) at trap+0x87f/frame 0xe4741a3c calltrap() at calltrap+0x6/frame 0xe4741a3c --- trap 0x3, eip = 0xc0b9b912, esp = 0xe4741a88, ebp = 0xe4741a9c --- kdb_alt_break_internal(0,e4741ac8,c097ded7,2,c8cd7884,...) at kdb_alt_break_internal+0x162/frame 0xe4741a9c kdb_alt_break(2,c8cd7884,c11a75b9,c8cd7800,40000,...) at kdb_alt_break+0x16/frame 0xe4741aa8 uart_intr_rxready(c8cd7800,e472ec80,8,c13a3113,342,...) at uart_intr_rxready+0x87/frame 0xe4741ac8 uart_intr(c8cd7800,c0b462c8,c1634400,a,0,...) at uart_intr+0x100/frame 0xe4741b04 intr_event_handle(c88e2900,e4741b80,0,2,0,...) at intr_event_handle+0x7a/frame 0xe4741b30 intr_execute_handlers(c8a90108,e4741b80,2) at intr_execute_handlers+0x42/frame 0xe4741b50 lapic_handle_intr(30,e4741b80) at lapic_handle_intr+0x5d/frame 0xe4741b70 Xapic_isr1() at Xapic_isr1+0x4a/frame 0xe4741b70 --- interrupt, eip = 0xc1045375, esp = 0xe4741bc0, ebp = 0xe4741bc0 --- acpi_cpu_c1(e472ec90,0,c13a3113,2ec,7dca,...) at acpi_cpu_c1+0x5/frame 0xe4741bc0 acpi_cpu_idle(7fcf3e80,0,7fcf3e80,e4741c30,c107656d,...) at acpi_cpu_idle+0x166/frame 0xe4741c00 cpu_idle_acpi(7fcf3e80,0,4,c156ce08,c156ce04,...) at cpu_idle_acpi+0x3f/frame 0xe4741c14 cpu_idle(0,e4741c80,c11e18f2,a48,c156ce08,...) at cpu_idle+0x9d/frame 0xe4741c30 sched_idletd(0,e4741ce8,c11d854c,3dc,0,...) at sched_idletd+0x3cb/frame 0xe4741cac fork_exit(c0b89380,0,e4741ce8) at fork_exit+0x7e/frame 0xe4741cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4741cd4 --- trap 0, eip = 0, esp = 0xe4741d20, ebp = 0 --- Tracing command bash pid 1145 tid 100163 td 0xca56bc40 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c11e3878,c8a39930,e4741424,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xe4741408 kdb_backtrace(c11e38f5,280,e47415bc,c105d030,8,...) at kdb_backtrace+0x2d/frame 0xe4741470 kdb_reenter(8,c11e62e6,225,e47414a8,c8a39930,...) at kdb_reenter+0x31/frame 0xe4741480 trap(e47415c8) at trap+0x50/frame 0xe47415bc calltrap() at calltrap+0x6/frame 0xe47415bc --- trap 0xc, eip = 0xc1048c56, esp = 0xe4741608, ebp = 0xe4741618 --- db_trace_thread(ca56bc40,ffffffff,479,18743,ca56bc40,...) at db_trace_thread+0x16/frame 0xe4741618 db_stack_trace_all(c157d500,0,ffffffff,e47416b8,0,...) at db_stack_trace_all+0xa2/frame 0xe4741684 db_command(c1499802,0,c1629ce0,c1499801,a,...) at db_command+0x39f/frame 0xe4741740 db_script_exec(e47417f0,0,c8b58250,e47417dc,1,...) at db_script_exec+0x168/frame 0xe47417a8 db_command(c10ad9c3,e47418c8,c053337b,c10adab4,c079a0d7,...) at db_command+0x39f/frame 0xe4741864 db_command_loop(c10adab4,c079a0d7,c15deba4,1,c8a12d00,...) at db_command_loop+0x50/frame 0xe4741870 db_trap(3,0,c8afb620,46,1,...) at db_trap+0xdb/frame 0xe47418c8 kdb_trap(3,0,e4741a48,e4741a90,0,...) at kdb_trap+0x117/frame 0xe4741900 trap(e4741a48) at trap+0x87f/frame 0xe4741a3c calltrap() at calltrap+0x6/frame 0xe4741a3c --- trap 0x3, eip = 0xc0b9b912, esp = 0xe4741a88, ebp = 0xe4741a9c --- kdb_alt_break_internal(0,e4741ac8,c097ded7,2,c8cd7884,...) at kdb_alt_break_internal+0x162/frame 0xe4741a9c kdb_alt_break(2,c8cd7884,c11a75b9,c8cd7800,40000,...) at kdb_alt_break+0x16/frame 0xe4741aa8 uart_intr_rxready(c8cd7800,e472ec80,8,c13a3113,342,...) at uart_intr_rxready+0x87/frame 0xe4741ac8 uart_intr(c8cd7800,c0b462c8,c1634400,a,0,...) at uart_intr+0x100/frame 0xe4741b04 intr_event_handle(c88e2900,e4741b80,0,2,0,...) at intr_event_handle+0x7a/frame 0xe4741b30 intr_execute_handlers(c8a90108,e4741b80,2) at intr_execute_handlers+0x42/frame 0xe4741b50 lapic_handle_intr(30,e4741b80) at lapic_handle_intr+0x5d/frame 0xe4741b70 Xapic_isr1() at Xapic_isr1+0x4a/frame 0xe4741b70 --- interrupt, eip = 0xc1045375, esp = 0xe4741bc0, ebp = 0xe4741bc0 --- acpi_cpu_c1(e472ec90,0,c13a3113,2ec,7dca,...) at acpi_cpu_c1+0x5/frame 0xe4741bc0 acpi_cpu_idle(7fcf3e80,0,7fcf3e80,e4741c30,c107656d,...) at acpi_cpu_idle+0x166/frame 0xe4741c00 cpu_idle_acpi(7fcf3e80,0,4,c156ce08,c156ce04,...) at cpu_idle_acpi+0x3f/frame 0xe4741c14 cpu_idle(0,e4741c80,c11e18f2,a48,c156ce08,...) at cpu_idle+0x9d/frame 0xe4741c30 sched_idletd(0,e4741ce8,c11d854c,3dc,0,...) at sched_idletd+0x3cb/frame 0xe4741cac fork_exit(c0b89380,0,e4741ce8) at fork_exit+0x7e/frame 0xe4741cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4741cd4 --- trap 0, eip = 0, esp = 0xe4741d20, ebp = 0 --- Tracing command sshd pid 1144 tid 100187 td 0xcca5c310 sched_switch(cca5c310,0,104,1a9,f8995918,...) at sched_switch+0x4e2/frame 0xf89958e0 mi_switch(104,0,c11e58c5,200,26,...) at mi_switch+0x1bf/frame 0xf8995918 sleepq_switch(cca5c310,0,c11e58c5,1b6,f8995990,...) at sleepq_switch+0x1c5/frame 0xf899594c sleepq_catch_signals(f89959ac,c0b454f9,c9395920,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf8995988 sleepq_wait_sig(c9395924,0,f89959e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xf89959ac _cv_wait_sig(c9395924,c9395910,c11e8daf,732,1ae,...) at _cv_wait_sig+0x214/frame 0xf89959f8 seltdwait(ffffffff,0,0,cca5c310,0,...) at seltdwait+0xbb/frame 0xf8995a28 kern_select(cca5c310,c,28c0c1e0,28c0c1e8,0,...) at kern_select+0x914/frame 0xf8995bd0 sys_select(cca5c310,f8995ca8,c11d816d,4,c10657b7,...) at sys_select+0x66/frame 0xf8995c18 syscall(f8995ce8) at syscall+0x34a/frame 0xf8995cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8995cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284e8eff, esp = 0xbfbfe7cc, ebp = 0xbfbfe7f0 --- Tracing command sshd pid 1142 tid 100173 td 0xca484c40 sched_switch(ca484c40,0,104,1a9,f895c950,...) at sched_switch+0x4e2/frame 0xf895c918 mi_switch(104,0,c11e58c5,200,f895c9bc,...) at mi_switch+0x1bf/frame 0xf895c950 sleepq_switch(ca484c40,0,c11e58c5,1b6,f895c9c8,...) at sleepq_switch+0x1c5/frame 0xf895c984 sleepq_catch_signals(f895c9e4,c0b454f9,c93964e0,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf895c9c0 sleepq_wait_sig(c93964e4,0,f895ca1c,101,0,...) at sleepq_wait_sig+0x14/frame 0xf895c9e4 _cv_wait_sig(c93964e4,c93964d0,c11e8daf,732,62d,...) at _cv_wait_sig+0x214/frame 0xf895ca30 seltdwait(ffffffff,0,0,ca484c40,0,...) at seltdwait+0xbb/frame 0xf895ca60 kern_poll(ca484c40,bfbfe860,1,0,0,...) at kern_poll+0x4f0/frame 0xf895cbe0 sys_poll(ca484c40,f895cca8,c11d816d,4,c10657b7,...) at sys_poll+0x71/frame 0xf895cc18 syscall(f895cce8) at syscall+0x34a/frame 0xf895ccdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf895ccdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x28487c53, esp = 0xbfbfe82c, ebp = 0xbfbfe848 --- Tracing command getty pid 1037 tid 100157 td 0xca597c40 sched_switch(ca597c40,0,104,1a9,f89279a4,...) at sched_switch+0x4e2/frame 0xf892796c mi_switch(104,0,c11e58c5,200,c11eb4b1,...) at mi_switch+0x1bf/frame 0xf89279a4 sleepq_switch(ca597c40,0,c11e58c5,1b6,f8927a1c,...) at sleepq_switch+0x1c5/frame 0xf89279d8 sleepq_catch_signals(f8927a38,c0b454f9,c8c77e14,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf8927a14 sleepq_wait_sig(c8c77e70,0,f8927a70,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8927a38 _cv_wait_sig(c8c77e70,c8c77e04,c11eaee1,567,1,...) at _cv_wait_sig+0x214/frame 0xf8927a84 tty_wait(c8c77e00,c8c77e70,f8927be8,1,0,...) at tty_wait+0x4b/frame 0xf8927aa8 ttydisc_read(c8c77e00,f8927be8,0,b2,f8927be8,...) at ttydisc_read+0x3d4/frame 0xf8927af0 ttydev_read(c8cbca00,f8927be8,0,0,f8927b40,...) at ttydev_read+0x55/frame 0xf8927b10 devfs_read_f(c9405b98,f8927be8,ca47f400,0,ca597c40,...) at devfs_read_f+0xa8/frame 0xf8927b4c dofileread(c9405b98,f8927be8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xf8927b80 kern_readv(ca597c40,0,f8927be8,0,bfbfedf7,...) at kern_readv+0x93/frame 0xf8927bc8 sys_read(ca597c40,f8927ca8,c11d816d,4,c10657b7,...) at sys_read+0x59/frame 0xf8927c18 syscall(f8927ce8) at syscall+0x34a/frame 0xf8927cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8927cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b7f0f, esp = 0xbfbfedd8, ebp = 0xbfbfee08 --- Tracing command getty pid 1036 tid 100158 td 0xca597930 sched_switch(ca597930,0,104,1a9,f892a9a4,...) at sched_switch+0x4e2/frame 0xf892a96c mi_switch(104,0,c11e58c5,200,c15aa9a0,...) at mi_switch+0x1bf/frame 0xf892a9a4 sleepq_switch(ca597930,0,c11e58c5,1b6,f892aa1c,...) at sleepq_switch+0x1c5/frame 0xf892a9d8 sleepq_catch_signals(f892aa38,c0b454f9,c8c77814,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf892aa14 sleepq_wait_sig(c8c77870,0,f892aa70,101,0,...) at sleepq_wait_sig+0x14/frame 0xf892aa38 _cv_wait_sig(c8c77870,c8c77804,c11eaee1,567,1,...) at _cv_wait_sig+0x214/frame 0xf892aa84 tty_wait(c8c77800,c8c77870,f892abe8,1,0,...) at tty_wait+0x4b/frame 0xf892aaa8 ttydisc_read(c8c77800,f892abe8,0,b2,f892abe8,...) at ttydisc_read+0x3d4/frame 0xf892aaf0 ttydev_read(c9025c00,f892abe8,0,0,f892ab40,...) at ttydev_read+0x55/frame 0xf892ab10 devfs_read_f(c93f8a10,f892abe8,ca35b200,0,ca597930,...) at devfs_read_f+0xa8/frame 0xf892ab4c dofileread(c93f8a10,f892abe8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xf892ab80 kern_readv(ca597930,0,f892abe8,c15aa9a0,bfbfedf7,...) at kern_readv+0x93/frame 0xf892abc8 sys_read(ca597930,f892aca8,c11d816d,4,f892ac6c,...) at sys_read+0x59/frame 0xf892ac18 syscall(f892ace8) at syscall+0x34a/frame 0xf892acdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf892acdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b7f0f, esp = 0xbfbfedd8, ebp = 0xbfbfee08 --- Tracing command getty pid 1035 tid 100176 td 0xcca5e310 sched_switch(cca5e310,0,104,1a9,f89629a4,...) at sched_switch+0x4e2/frame 0xf896296c mi_switch(104,0,c11e58c5,200,c15aad10,...) at mi_switch+0x1bf/frame 0xf89629a4 sleepq_switch(cca5e310,0,c11e58c5,1b6,f8962a1c,...) at sleepq_switch+0x1c5/frame 0xf89629d8 sleepq_catch_signals(f8962a38,c0b454f9,c8c77a14,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf8962a14 sleepq_wait_sig(c8c77a70,0,f8962a70,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8962a38 _cv_wait_sig(c8c77a70,c8c77a04,c11eaee1,567,1,...) at _cv_wait_sig+0x214/frame 0xf8962a84 tty_wait(c8c77a00,c8c77a70,f8962be8,1,0,...) at tty_wait+0x4b/frame 0xf8962aa8 ttydisc_read(c8c77a00,f8962be8,0,b2,f8962be8,...) at ttydisc_read+0x3d4/frame 0xf8962af0 ttydev_read(c9025e00,f8962be8,0,0,f8962b40,...) at ttydev_read+0x55/frame 0xf8962b10 devfs_read_f(c93b0850,f8962be8,ca35ad00,0,cca5e310,...) at devfs_read_f+0xa8/frame 0xf8962b4c dofileread(c93b0850,f8962be8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xf8962b80 kern_readv(cca5e310,0,f8962be8,c15aad10,bfbfedf7,...) at kern_readv+0x93/frame 0xf8962bc8 sys_read(cca5e310,f8962ca8,c11d816d,4,c10657b7,...) at sys_read+0x59/frame 0xf8962c18 syscall(f8962ce8) at syscall+0x34a/frame 0xf8962cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8962cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b7f0f, esp = 0xbfbfedd8, ebp = 0xbfbfee08 --- Tracing command getty pid 1034 tid 100166 td 0xc9258000 sched_switch(c9258000,0,104,1a9,edb3e9a4,...) at sched_switch+0x4e2/frame 0xedb3e96c mi_switch(104,0,c11e58c5,200,c15aad68,...) at mi_switch+0x1bf/frame 0xedb3e9a4 sleepq_switch(c9258000,0,c11e58c5,1b6,edb3ea1c,...) at sleepq_switch+0x1c5/frame 0xedb3e9d8 sleepq_catch_signals(edb3ea38,c0b454f9,c8c77c14,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xedb3ea14 sleepq_wait_sig(c8c77c70,0,edb3ea70,101,0,...) at sleepq_wait_sig+0x14/frame 0xedb3ea38 _cv_wait_sig(c8c77c70,c8c77c04,c11eaee1,567,1,...) at _cv_wait_sig+0x214/frame 0xedb3ea84 tty_wait(c8c77c00,c8c77c70,edb3ebe8,1,0,...) at tty_wait+0x4b/frame 0xedb3eaa8 ttydisc_read(c8c77c00,edb3ebe8,0,b2,edb3ebe8,...) at ttydisc_read+0x3d4/frame 0xedb3eaf0 ttydev_read(c9026100,edb3ebe8,0,0,edb3eb40,...) at ttydev_read+0x55/frame 0xedb3eb10 devfs_read_f(c9406380,edb3ebe8,ca47f600,0,c9258000,...) at devfs_read_f+0xa8/frame 0xedb3eb4c dofileread(c9406380,edb3ebe8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xedb3eb80 kern_readv(c9258000,0,edb3ebe8,c15aad68,bfbfedf7,...) at kern_readv+0x93/frame 0xedb3ebc8 sys_read(c9258000,edb3eca8,c11d816d,4,c10657b7,...) at sys_read+0x59/frame 0xedb3ec18 syscall(edb3ece8) at syscall+0x34a/frame 0xedb3ecdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedb3ecdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b7f0f, esp = 0xbfbfedd8, ebp = 0xbfbfee08 --- Tracing command getty pid 1033 tid 100151 td 0xca47d930 sched_switch(ca47d930,0,104,1a9,f890e9a4,...) at sched_switch+0x4e2/frame 0xf890e96c mi_switch(104,0,c11e58c5,200,c15aa738,...) at mi_switch+0x1bf/frame 0xf890e9a4 sleepq_switch(ca47d930,0,c11e58c5,1b6,f890ea1c,...) at sleepq_switch+0x1c5/frame 0xf890e9d8 sleepq_catch_signals(f890ea38,c0b454f9,c8c78814,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf890ea14 sleepq_wait_sig(c8c78870,0,f890ea70,101,0,...) at sleepq_wait_sig+0x14/frame 0xf890ea38 _cv_wait_sig(c8c78870,c8c78804,c11eaee1,567,1,...) at _cv_wait_sig+0x214/frame 0xf890ea84 tty_wait(c8c78800,c8c78870,f890ebe8,1,0,...) at tty_wait+0x4b/frame 0xf890eaa8 ttydisc_read(c8c78800,f890ebe8,0,b2,f890ebe8,...) at ttydisc_read+0x3d4/frame 0xf890eaf0 ttydev_read(c9026300,f890ebe8,0,0,f890eb40,...) at ttydev_read+0x55/frame 0xf890eb10 devfs_read_f(c93b0348,f890ebe8,ca35ba00,0,ca47d930,...) at devfs_read_f+0xa8/frame 0xf890eb4c dofileread(c93b0348,f890ebe8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xf890eb80 kern_readv(ca47d930,0,f890ebe8,c15aa738,bfbfedf7,...) at kern_readv+0x93/frame 0xf890ebc8 sys_read(ca47d930,f890eca8,c11d816d,4,c156cd90,...) at sys_read+0x59/frame 0xf890ec18 syscall(f890ece8) at syscall+0x34a/frame 0xf890ecdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf890ecdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b7f0f, esp = 0xbfbfedd8, ebp = 0xbfbfee08 --- Tracing command getty pid 1032 tid 100174 td 0xca484930 sched_switch(ca484930,0,104,1a9,f895f9a4,...) at sched_switch+0x4e2/frame 0xf895f96c mi_switch(104,0,c11e58c5,200,c15aa948,...) at mi_switch+0x1bf/frame 0xf895f9a4 sleepq_switch(ca484930,0,c11e58c5,1b6,f895fa1c,...) at sleepq_switch+0x1c5/frame 0xf895f9d8 sleepq_catch_signals(f895fa38,c0b454f9,c8c78614,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf895fa14 sleepq_wait_sig(c8c78670,0,f895fa70,101,0,...) at sleepq_wait_sig+0x14/frame 0xf895fa38 _cv_wait_sig(c8c78670,c8c78604,c11eaee1,567,1,...) at _cv_wait_sig+0x214/frame 0xf895fa84 tty_wait(c8c78600,c8c78670,f895fbe8,1,0,...) at tty_wait+0x4b/frame 0xf895faa8 ttydisc_read(c8c78600,f895fbe8,0,b2,f895fbe8,...) at ttydisc_read+0x3d4/frame 0xf895faf0 ttydev_read(c9026500,f895fbe8,0,0,f895fb40,...) at ttydev_read+0x55/frame 0xf895fb10 devfs_read_f(c94061c0,f895fbe8,ca47f800,0,ca484930,...) at devfs_read_f+0xa8/frame 0xf895fb4c dofileread(c94061c0,f895fbe8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xf895fb80 kern_readv(ca484930,0,f895fbe8,c15aa948,bfbfedf7,...) at kern_readv+0x93/frame 0xf895fbc8 sys_read(ca484930,f895fca8,c11d816d,4,c10657b7,...) at sys_read+0x59/frame 0xf895fc18 syscall(f895fce8) at syscall+0x34a/frame 0xf895fcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf895fcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b7f0f, esp = 0xbfbfedd8, ebp = 0xbfbfee08 --- Tracing command getty pid 1031 tid 100154 td 0xca58c310 sched_switch(ca58c310,0,104,1a9,f891b9a4,...) at sched_switch+0x4e2/frame 0xf891b96c mi_switch(104,0,c11e58c5,200,c15aab58,...) at mi_switch+0x1bf/frame 0xf891b9a4 sleepq_switch(ca58c310,0,c11e58c5,1b6,f891ba1c,...) at sleepq_switch+0x1c5/frame 0xf891b9d8 sleepq_catch_signals(f891ba38,c0b454f9,c8c78414,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf891ba14 sleepq_wait_sig(c8c78470,0,f891ba70,101,0,...) at sleepq_wait_sig+0x14/frame 0xf891ba38 _cv_wait_sig(c8c78470,c8c78404,c11eaee1,567,1,...) at _cv_wait_sig+0x214/frame 0xf891ba84 tty_wait(c8c78400,c8c78470,f891bbe8,1,0,...) at tty_wait+0x4b/frame 0xf891baa8 ttydisc_read(c8c78400,f891bbe8,0,b2,f891bbe8,...) at ttydisc_read+0x3d4/frame 0xf891baf0 ttydev_read(c8cc0500,f891bbe8,0,0,f891bb40,...) at ttydev_read+0x55/frame 0xf891bb10 devfs_read_f(c9405ee0,f891bbe8,ca47f500,0,ca58c310,...) at devfs_read_f+0xa8/frame 0xf891bb4c dofileread(c9405ee0,f891bbe8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xf891bb80 kern_readv(ca58c310,0,f891bbe8,c15aab58,bfbfedf7,...) at kern_readv+0x93/frame 0xf891bbc8 sys_read(ca58c310,f891bca8,c11d816d,4,c10657b7,...) at sys_read+0x59/frame 0xf891bc18 syscall(f891bce8) at syscall+0x34a/frame 0xf891bcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf891bcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b7f0f, esp = 0xbfbfedd8, ebp = 0xbfbfee08 --- Tracing command getty pid 1030 tid 100102 td 0xca39b620 sched_switch(ca39b620,0,104,1a9,edbcc9a4,...) at sched_switch+0x4e2/frame 0xedbcc96c mi_switch(104,0,c11e58c5,200,c15abd90,...) at mi_switch+0x1bf/frame 0xedbcc9a4 sleepq_switch(ca39b620,0,c11e58c5,1b6,edbcca1c,...) at sleepq_switch+0x1c5/frame 0xedbcc9d8 sleepq_catch_signals(edbcca38,c0b454f9,c8c78214,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xedbcca14 sleepq_wait_sig(c8c78270,0,edbcca70,101,0,...) at sleepq_wait_sig+0x14/frame 0xedbcca38 _cv_wait_sig(c8c78270,c8c78204,c11eaee1,567,1,...) at _cv_wait_sig+0x214/frame 0xedbcca84 tty_wait(c8c78200,c8c78270,edbccbe8,1,0,...) at tty_wait+0x4b/frame 0xedbccaa8 ttydisc_read(c8c78200,edbccbe8,0,b2,edbccbe8,...) at ttydisc_read+0x3d4/frame 0xedbccaf0 ttydev_read(c8cc0700,edbccbe8,0,0,edbccb40,...) at ttydev_read+0x55/frame 0xedbccb10 devfs_read_f(c9423850,edbccbe8,ca35b900,0,ca39b620,...) at devfs_read_f+0xa8/frame 0xedbccb4c dofileread(c9423850,edbccbe8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xedbccb80 kern_readv(ca39b620,0,edbccbe8,c15abd90,bfbfedf7,...) at kern_readv+0x93/frame 0xedbccbc8 sys_read(ca39b620,edbccca8,c11d816d,4,c156c690,...) at sys_read+0x59/frame 0xedbccc18 syscall(edbccce8) at syscall+0x34a/frame 0xedbcccdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbcccdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b7f0f, esp = 0xbfbfedd8, ebp = 0xbfbfee08 --- Tracing command getty pid 1029 tid 100167 td 0xc9259620 sched_switch(c9259620,0,104,1a9,f89429a4,...) at sched_switch+0x4e2/frame 0xf894296c mi_switch(104,0,c11e58c5,200,c15ac418,...) at mi_switch+0x1bf/frame 0xf89429a4 sleepq_switch(c9259620,0,c11e58c5,1b6,f8942a1c,...) at sleepq_switch+0x1c5/frame 0xf89429d8 sleepq_catch_signals(f8942a38,c0b454f9,c8c78014,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf8942a14 sleepq_wait_sig(c8c78070,0,f8942a70,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8942a38 _cv_wait_sig(c8c78070,c8c78004,c11eaee1,567,1,...) at _cv_wait_sig+0x214/frame 0xf8942a84 tty_wait(c8c78000,c8c78070,f8942be8,1,0,...) at tty_wait+0x4b/frame 0xf8942aa8 ttydisc_read(c8c78000,f8942be8,0,b2,f8942be8,...) at ttydisc_read+0x3d4/frame 0xf8942af0 ttydev_read(c8cc0900,f8942be8,0,0,f8942b40,...) at ttydev_read+0x55/frame 0xf8942b10 devfs_read_f(c9423cb0,f8942be8,ca35b800,0,c9259620,...) at devfs_read_f+0xa8/frame 0xf8942b4c dofileread(c9423cb0,f8942be8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xf8942b80 kern_readv(c9259620,0,f8942be8,c15ac418,bfbfedf7,...) at kern_readv+0x93/frame 0xf8942bc8 sys_read(c9259620,f8942ca8,c11d816d,4,c10657b7,...) at sys_read+0x59/frame 0xf8942c18 syscall(f8942ce8) at syscall+0x34a/frame 0xf8942cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8942cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b7f0f, esp = 0xbfbfedd8, ebp = 0xbfbfee08 --- Tracing command inetd pid 1010 tid 100178 td 0xcca5dc40 sched_switch(cca5dc40,0,104,1a9,f896c918,...) at sched_switch+0x4e2/frame 0xf896c8e0 mi_switch(104,0,c11e58c5,200,f896c984,...) at mi_switch+0x1bf/frame 0xf896c918 sleepq_switch(cca5dc40,0,c11e58c5,1b6,f896c990,...) at sleepq_switch+0x1c5/frame 0xf896c94c sleepq_catch_signals(f896c9ac,c0b454f9,c9395aa0,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf896c988 sleepq_wait_sig(c9395aa4,0,f896c9e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xf896c9ac _cv_wait_sig(c9395aa4,c9395a90,c11e8daf,732,c9b12c78,...) at _cv_wait_sig+0x214/frame 0xf896c9f8 seltdwait(ffffffff,0,0,cca5dc40,0,...) at seltdwait+0xbb/frame 0xf896ca28 kern_select(cca5dc40,a,bfbfe078,0,0,...) at kern_select+0x914/frame 0xf896cbd0 sys_select(cca5dc40,f896cca8,c11d816d,4,c10657b7,...) at sys_select+0x66/frame 0xf896cc18 syscall(f896cce8) at syscall+0x34a/frame 0xf896ccdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf896ccdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281cbeff, esp = 0xbfbfe014, ebp = 0xbfbfee34 --- Tracing command bash pid 954 tid 100155 td 0xc9259c40 sched_switch(c9259c40,0,104,1a9,f891e9a4,...) at sched_switch+0x4e2/frame 0xf891e96c mi_switch(104,0,c11e58c5,200,0,...) at mi_switch+0x1bf/frame 0xf891e9a4 sleepq_switch(c9259c40,0,c11e58c5,1b6,f891ea1c,...) at sleepq_switch+0x1c5/frame 0xf891e9d8 sleepq_catch_signals(f891ea38,c0b454f9,c9714614,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf891ea14 sleepq_wait_sig(c9714670,0,f891ea70,101,0,...) at sleepq_wait_sig+0x14/frame 0xf891ea38 _cv_wait_sig(c9714670,c9714604,c11eaee1,567,1,...) at _cv_wait_sig+0x214/frame 0xf891ea84 tty_wait(c9714600,c9714670,f891ebe8,1,0,...) at tty_wait+0x4b/frame 0xf891eaa8 ttydisc_read(c9714600,f891ebe8,0,b2,f891ebe8,...) at ttydisc_read+0x3d4/frame 0xf891eaf0 ttydev_read(c927ed00,f891ebe8,0,0,f891eb40,...) at ttydev_read+0x55/frame 0xf891eb10 devfs_read_f(c9405cb0,f891ebe8,ca47f300,0,c9259c40,...) at devfs_read_f+0xa8/frame 0xf891eb4c dofileread(c9405cb0,f891ebe8,ffffffff,ffffffff,0,...) at dofileread+0x97/frame 0xf891eb80 kern_readv(c9259c40,0,f891ebe8,0,bfbfdea3,...) at kern_readv+0x93/frame 0xf891ebc8 sys_read(c9259c40,f891eca8,c11d816d,4,c10657b7,...) at sys_read+0x59/frame 0xf891ec18 syscall(f891ece8) at syscall+0x34a/frame 0xf891ecdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf891ecdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2829ff0f, esp = 0xbfbfde90, ebp = 0xbfbfdeb0 --- Tracing command csh pid 952 tid 100095 td 0xc9397930 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c11e3878,c8a39930,e4741424,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xe4741408 kdb_backtrace(c11e38f5,280,e47415bc,c105d030,8,...) at kdb_backtrace+0x2d/frame 0xe4741470 kdb_reenter(8,c11e62e6,225,e47414a8,c8a39930,...) at kdb_reenter+0x31/frame 0xe4741480 trap(e47415c8) at trap+0x50/frame 0xe47415bc calltrap() at calltrap+0x6/frame 0xe47415bc --- trap 0xc, eip = 0xc1048c56, esp = 0xe4741608, ebp = 0xe4741618 --- db_trace_thread(c9397930,ffffffff,3b8,186ff,c9397930,...) at db_trace_thread+0x16/frame 0xe4741618 db_stack_trace_all(c157d500,0,ffffffff,e47416b8,0,...) at db_stack_trace_all+0xa2/frame 0xe4741684 db_command(c1499802,0,c1629ce0,c1499801,a,...) at db_command+0x39f/frame 0xe4741740 db_script_exec(e47417f0,0,c8b58250,e47417dc,1,...) at db_script_exec+0x168/frame 0xe47417a8 db_command(c10ad9c3,e47418c8,c053337b,c10adab4,c079a0d7,...) at db_command+0x39f/frame 0xe4741864 db_command_loop(c10adab4,c079a0d7,c15deba4,1,c8a12d00,...) at db_command_loop+0x50/frame 0xe4741870 db_trap(3,0,c8afb620,46,1,...) at db_trap+0xdb/frame 0xe47418c8 kdb_trap(3,0,e4741a48,e4741a90,0,...) at kdb_trap+0x117/frame 0xe4741900 trap(e4741a48) at trap+0x87f/frame 0xe4741a3c calltrap() at calltrap+0x6/frame 0xe4741a3c --- trap 0x3, eip = 0xc0b9b912, esp = 0xe4741a88, ebp = 0xe4741a9c --- kdb_alt_break_internal(0,e4741ac8,c097ded7,2,c8cd7884,...) at kdb_alt_break_internal+0x162/frame 0xe4741a9c kdb_alt_break(2,c8cd7884,c11a75b9,c8cd7800,40000,...) at kdb_alt_break+0x16/frame 0xe4741aa8 uart_intr_rxready(c8cd7800,e472ec80,8,c13a3113,342,...) at uart_intr_rxready+0x87/frame 0xe4741ac8 uart_intr(c8cd7800,c0b462c8,c1634400,a,0,...) at uart_intr+0x100/frame 0xe4741b04 intr_event_handle(c88e2900,e4741b80,0,2,0,...) at intr_event_handle+0x7a/frame 0xe4741b30 intr_execute_handlers(c8a90108,e4741b80,2) at intr_execute_handlers+0x42/frame 0xe4741b50 lapic_handle_intr(30,e4741b80) at lapic_handle_intr+0x5d/frame 0xe4741b70 Xapic_isr1() at Xapic_isr1+0x4a/frame 0xe4741b70 --- interrupt, eip = 0xc1045375, esp = 0xe4741bc0, ebp = 0xe4741bc0 --- acpi_cpu_c1(e472ec90,0,c13a3113,2ec,7dca,...) at acpi_cpu_c1+0x5/frame 0xe4741bc0 acpi_cpu_idle(7fcf3e80,0,7fcf3e80,e4741c30,c107656d,...) at acpi_cpu_idle+0x166/frame 0xe4741c00 cpu_idle_acpi(7fcf3e80,0,4,c156ce08,c156ce04,...) at cpu_idle_acpi+0x3f/frame 0xe4741c14 cpu_idle(0,e4741c80,c11e18f2,a48,c156ce08,...) at cpu_idle+0x9d/frame 0xe4741c30 sched_idletd(0,e4741ce8,c11d854c,3dc,0,...) at sched_idletd+0x3cb/frame 0xe4741cac fork_exit(c0b89380,0,e4741ce8) at fork_exit+0x7e/frame 0xe4741cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4741cd4 --- trap 0, eip = 0, esp = 0xe4741d20, ebp = 0 --- Tracing command su pid 950 tid 100079 td 0xc9496310 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c11e3878,c8a39930,e4741424,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xe4741408 kdb_backtrace(c11e38f5,280,e47415bc,c105d030,8,...) at kdb_backtrace+0x2d/frame 0xe4741470 kdb_reenter(8,c11e62e6,225,e47414a8,c8a39930,...) at kdb_reenter+0x31/frame 0xe4741480 trap(e47415c8) at trap+0x50/frame 0xe47415bc calltrap() at calltrap+0x6/frame 0xe47415bc --- trap 0xc, eip = 0xc1048c56, esp = 0xe4741608, ebp = 0xe4741618 --- db_trace_thread(c9496310,ffffffff,3b6,186ef,c9496310,...) at db_trace_thread+0x16/frame 0xe4741618 db_stack_trace_all(c157d500,0,ffffffff,e47416b8,0,...) at db_stack_trace_all+0xa2/frame 0xe4741684 db_command(c1499802,0,c1629ce0,c1499801,a,...) at db_command+0x39f/frame 0xe4741740 db_script_exec(e47417f0,0,c8b58250,e47417dc,1,...) at db_script_exec+0x168/frame 0xe47417a8 db_command(c10ad9c3,e47418c8,c053337b,c10adab4,c079a0d7,...) at db_command+0x39f/frame 0xe4741864 db_command_loop(c10adab4,c079a0d7,c15deba4,1,c8a12d00,...) at db_command_loop+0x50/frame 0xe4741870 db_trap(3,0,c8afb620,46,1,...) at db_trap+0xdb/frame 0xe47418c8 kdb_trap(3,0,e4741a48,e4741a90,0,...) at kdb_trap+0x117/frame 0xe4741900 trap(e4741a48) at trap+0x87f/frame 0xe4741a3c calltrap() at calltrap+0x6/frame 0xe4741a3c --- trap 0x3, eip = 0xc0b9b912, esp = 0xe4741a88, ebp = 0xe4741a9c --- kdb_alt_break_internal(0,e4741ac8,c097ded7,2,c8cd7884,...) at kdb_alt_break_internal+0x162/frame 0xe4741a9c kdb_alt_break(2,c8cd7884,c11a75b9,c8cd7800,40000,...) at kdb_alt_break+0x16/frame 0xe4741aa8 uart_intr_rxready(c8cd7800,e472ec80,8,c13a3113,342,...) at uart_intr_rxready+0x87/frame 0xe4741ac8 uart_intr(c8cd7800,c0b462c8,c1634400,a,0,...) at uart_intr+0x100/frame 0xe4741b04 intr_event_handle(c88e2900,e4741b80,0,2,0,...) at intr_event_handle+0x7a/frame 0xe4741b30 intr_execute_handlers(c8a90108,e4741b80,2) at intr_execute_handlers+0x42/frame 0xe4741b50 lapic_handle_intr(30,e4741b80) at lapic_handle_intr+0x5d/frame 0xe4741b70 Xapic_isr1() at Xapic_isr1+0x4a/frame 0xe4741b70 --- interrupt, eip = 0xc1045375, esp = 0xe4741bc0, ebp = 0xe4741bc0 --- acpi_cpu_c1(e472ec90,0,c13a3113,2ec,7dca,...) at acpi_cpu_c1+0x5/frame 0xe4741bc0 acpi_cpu_idle(7fcf3e80,0,7fcf3e80,e4741c30,c107656d,...) at acpi_cpu_idle+0x166/frame 0xe4741c00 cpu_idle_acpi(7fcf3e80,0,4,c156ce08,c156ce04,...) at cpu_idle_acpi+0x3f/frame 0xe4741c14 cpu_idle(0,e4741c80,c11e18f2,a48,c156ce08,...) at cpu_idle+0x9d/frame 0xe4741c30 sched_idletd(0,e4741ce8,c11d854c,3dc,0,...) at sched_idletd+0x3cb/frame 0xe4741cac fork_exit(c0b89380,0,e4741ce8) at fork_exit+0x7e/frame 0xe4741cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4741cd4 --- trap 0, eip = 0, esp = 0xe4741d20, ebp = 0 --- Tracing command bash pid 913 tid 100175 td 0xcca5e620 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c11e3878,c8a39930,e4741424,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xe4741408 kdb_backtrace(c11e38f5,280,e47415bc,c105d030,8,...) at kdb_backtrace+0x2d/frame 0xe4741470 kdb_reenter(8,c11e62e6,225,e47414a8,c8a39930,...) at kdb_reenter+0x31/frame 0xe4741480 trap(e47415c8) at trap+0x50/frame 0xe47415bc calltrap() at calltrap+0x6/frame 0xe47415bc --- trap 0xc, eip = 0xc1048c56, esp = 0xe4741608, ebp = 0xe4741618 --- db_trace_thread(cca5e620,ffffffff,391,1874f,cca5e620,...) at db_trace_thread+0x16/frame 0xe4741618 db_stack_trace_all(c157d500,0,ffffffff,e47416b8,0,...) at db_stack_trace_all+0xa2/frame 0xe4741684 db_command(c1499802,0,c1629ce0,c1499801,a,...) at db_command+0x39f/frame 0xe4741740 db_script_exec(e47417f0,0,c8b58250,e47417dc,1,...) at db_script_exec+0x168/frame 0xe47417a8 db_command(c10ad9c3,e47418c8,c053337b,c10adab4,c079a0d7,...) at db_command+0x39f/frame 0xe4741864 db_command_loop(c10adab4,c079a0d7,c15deba4,1,c8a12d00,...) at db_command_loop+0x50/frame 0xe4741870 db_trap(3,0,c8afb620,46,1,...) at db_trap+0xdb/frame 0xe47418c8 kdb_trap(3,0,e4741a48,e4741a90,0,...) at kdb_trap+0x117/frame 0xe4741900 trap(e4741a48) at trap+0x87f/frame 0xe4741a3c calltrap() at calltrap+0x6/frame 0xe4741a3c --- trap 0x3, eip = 0xc0b9b912, esp = 0xe4741a88, ebp = 0xe4741a9c --- kdb_alt_break_internal(0,e4741ac8,c097ded7,2,c8cd7884,...) at kdb_alt_break_internal+0x162/frame 0xe4741a9c kdb_alt_break(2,c8cd7884,c11a75b9,c8cd7800,40000,...) at kdb_alt_break+0x16/frame 0xe4741aa8 uart_intr_rxready(c8cd7800,e472ec80,8,c13a3113,342,...) at uart_intr_rxready+0x87/frame 0xe4741ac8 uart_intr(c8cd7800,c0b462c8,c1634400,a,0,...) at uart_intr+0x100/frame 0xe4741b04 intr_event_handle(c88e2900,e4741b80,0,2,0,...) at intr_event_handle+0x7a/frame 0xe4741b30 intr_execute_handlers(c8a90108,e4741b80,2) at intr_execute_handlers+0x42/frame 0xe4741b50 lapic_handle_intr(30,e4741b80) at lapic_handle_intr+0x5d/frame 0xe4741b70 Xapic_isr1() at Xapic_isr1+0x4a/frame 0xe4741b70 --- interrupt, eip = 0xc1045375, esp = 0xe4741bc0, ebp = 0xe4741bc0 --- acpi_cpu_c1(e472ec90,0,c13a3113,2ec,7dca,...) at acpi_cpu_c1+0x5/frame 0xe4741bc0 acpi_cpu_idle(7fcf3e80,0,7fcf3e80,e4741c30,c107656d,...) at acpi_cpu_idle+0x166/frame 0xe4741c00 cpu_idle_acpi(7fcf3e80,0,4,c156ce08,c156ce04,...) at cpu_idle_acpi+0x3f/frame 0xe4741c14 cpu_idle(0,e4741c80,c11e18f2,a48,c156ce08,...) at cpu_idle+0x9d/frame 0xe4741c30 sched_idletd(0,e4741ce8,c11d854c,3dc,0,...) at sched_idletd+0x3cb/frame 0xe4741cac fork_exit(c0b89380,0,e4741ce8) at fork_exit+0x7e/frame 0xe4741cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4741cd4 --- trap 0, eip = 0, esp = 0xe4741d20, ebp = 0 --- Tracing command sshd pid 912 tid 100169 td 0xca56b930 sched_switch(ca56b930,0,104,1a9,f8949918,...) at sched_switch+0x4e2/frame 0xf89498e0 mi_switch(104,0,c11e58c5,200,26,...) at mi_switch+0x1bf/frame 0xf8949918 sleepq_switch(ca56b930,0,c11e58c5,1b6,f8949990,...) at sleepq_switch+0x1c5/frame 0xf894994c sleepq_catch_signals(f89499ac,c0b454f9,c88e9760,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf8949988 sleepq_wait_sig(c88e9764,0,f89499e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xf89499ac _cv_wait_sig(c88e9764,c88e9750,c11e8daf,732,1ae,...) at _cv_wait_sig+0x214/frame 0xf89499f8 seltdwait(ffffffff,0,0,ca56b930,0,...) at seltdwait+0xbb/frame 0xf8949a28 kern_select(ca56b930,c,28c0c1e0,28c0c1e8,0,...) at kern_select+0x914/frame 0xf8949bd0 sys_select(ca56b930,f8949ca8,c11d816d,4,c10657b7,...) at sys_select+0x66/frame 0xf8949c18 syscall(f8949ce8) at syscall+0x34a/frame 0xf8949cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8949cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284e8eff, esp = 0xbfbfe7cc, ebp = 0xbfbfe7f0 --- Tracing command sshd pid 910 tid 100089 td 0xc9186620 sched_switch(c9186620,0,104,1a9,edb4f950,...) at sched_switch+0x4e2/frame 0xedb4f918 mi_switch(104,0,c11e58c5,200,edb4f9bc,...) at mi_switch+0x1bf/frame 0xedb4f950 sleepq_switch(c9186620,0,c11e58c5,1b6,edb4f9c8,...) at sleepq_switch+0x1c5/frame 0xedb4f984 sleepq_catch_signals(edb4f9e4,c0b454f9,c9396320,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xedb4f9c0 sleepq_wait_sig(c9396324,0,edb4fa1c,101,0,...) at sleepq_wait_sig+0x14/frame 0xedb4f9e4 _cv_wait_sig(c9396324,c9396310,c11e8daf,732,62d,...) at _cv_wait_sig+0x214/frame 0xedb4fa30 seltdwait(ffffffff,0,0,c9186620,0,...) at seltdwait+0xbb/frame 0xedb4fa60 kern_poll(c9186620,bfbfe860,1,0,0,...) at kern_poll+0x4f0/frame 0xedb4fbe0 sys_poll(c9186620,edb4fca8,c11d816d,4,c10657b7,...) at sys_poll+0x71/frame 0xedb4fc18 syscall(edb4fce8) at syscall+0x34a/frame 0xedb4fcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedb4fcdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x28487c53, esp = 0xbfbfe82c, ebp = 0xbfbfe848 --- Tracing command cron pid 757 tid 100152 td 0xc9397310 sched_switch(c9397310,0,104,1a9,f8911a84,...) at sched_switch+0x4e2/frame 0xf8911a4c mi_switch(104,0,c11e58c5,200,7dea,...) at mi_switch+0x1bf/frame 0xf8911a84 sleepq_switch(c9397310,0,c11e58c5,1b6,8,...) at sleepq_switch+0x1c5/frame 0xf8911ab8 sleepq_catch_signals(c0bacdb0,c9397310,2,201,2,...) at sleepq_catch_signals+0x382/frame 0xf8911af4 sleepq_timedwait_sig(c155fd42,6c,7dea,bf71408c,3,...) at sleepq_timedwait_sig+0x14/frame 0xf8911b1c _sleep(c155fd42,0,16c,c11e0826,e74c1636,...) at _sleep+0x326/frame 0xf8911b78 kern_nanosleep(bfbfee28,f8911bf0,f8911bf8,f8911ce8,3b,...) at kern_nanosleep+0x14b/frame 0xf8911bd8 sys_nanosleep(c9397310,f8911ca8,c11d816d,4,ca585000,...) at sys_nanosleep+0x68/frame 0xf8911c18 syscall(f8911ce8) at syscall+0x34a/frame 0xf8911cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8911cdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2815984f, esp = 0xbfbfecb4, ebp = 0xbfbfee44 --- Tracing command sendmail pid 752 tid 100145 td 0xc8efdc40 sched_switch(c8efdc40,0,104,1a9,f88e3ab8,...) at sched_switch+0x4e2/frame 0xf88e3a80 mi_switch(104,0,c11e58c5,200,0,...) at mi_switch+0x1bf/frame 0xf88e3ab8 sleepq_switch(c8efdc40,0,c11e58c5,1b6,c11e58c5,...) at sleepq_switch+0x1c5/frame 0xf88e3aec sleepq_catch_signals(c11e58c5,16d,c93e53f8,1728,c8efdc40,...) at sleepq_catch_signals+0x382/frame 0xf88e3b28 sleepq_wait_sig(c93e53a4,74,c10c0acc,100,0,...) at sleepq_wait_sig+0x14/frame 0xf88e3b4c _sleep(c93e53a4,c93e53e8,174,c10c0acc,0,...) at _sleep+0x356/frame 0xf88e3ba8 kern_sigsuspend(c8efdc40,0,0,0,0,...) at kern_sigsuspend+0xd4/frame 0xf88e3be8 sys_sigsuspend(c8efdc40,f88e3ca8,c11d816d,4,c156d490,...) at sys_sigsuspend+0x55/frame 0xf88e3c18 syscall(f88e3ce8) at syscall+0x34a/frame 0xf88e3cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf88e3cdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x283d57ef, esp = 0xbfbfda94, ebp = 0xbfbfdac0 --- Tracing command sendmail pid 749 tid 100112 td 0xc9495310 sched_switch(c9495310,0,104,1a9,edbfc910,...) at sched_switch+0x4e2/frame 0xedbfc8d8 mi_switch(104,0,c11e58c5,200,c1634290,...) at mi_switch+0x1bf/frame 0xedbfc910 sleepq_switch(c9495310,0,c11e58c5,1b6,c9483550,...) at sleepq_switch+0x1c5/frame 0xedbfc944 sleepq_catch_signals(c1455bf0,edbfc9a8,c0b454f9,c9483560,0,...) at sleepq_catch_signals+0x382/frame 0xedbfc980 sleepq_timedwait_sig(c9483564,0,edbfc9e4,50000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xedbfc9a8 _cv_timedwait_sig_sbt(c9483564,c9483550,4d77e0fe,7dcd,50000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedbfc9f8 seltdwait(7dcd,50000000,0,c9495310,0,...) at seltdwait+0xad/frame 0xedbfca28 kern_select(c9495310,5,bfbfd118,0,0,...) at kern_select+0x914/frame 0xedbfcbd0 sys_select(c9495310,edbfcca8,c11d816d,4,edbfcc6c,...) at sys_select+0x66/frame 0xedbfcc18 syscall(edbfcce8) at syscall+0x34a/frame 0xedbfccdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbfccdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28441eff, esp = 0xbfbfcfec, ebp = 0xbfbfdaa0 --- Tracing command sshd pid 746 tid 100150 td 0xc8efd930 sched_switch(c8efd930,0,104,1a9,f890a918,...) at sched_switch+0x4e2/frame 0xf890a8e0 mi_switch(104,0,c11e58c5,200,f890a984,...) at mi_switch+0x1bf/frame 0xf890a918 sleepq_switch(c8efd930,0,c11e58c5,1b6,f890a990,...) at sleepq_switch+0x1c5/frame 0xf890a94c sleepq_catch_signals(f890a9ac,c0b454f9,c94835a0,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf890a988 sleepq_wait_sig(c94835a4,0,f890a9e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xf890a9ac _cv_wait_sig(c94835a4,c9483590,c11e8daf,732,c9b21390,...) at _cv_wait_sig+0x214/frame 0xf890a9f8 seltdwait(ffffffff,0,0,c8efd930,0,...) at seltdwait+0xbb/frame 0xf890aa28 kern_select(c8efd930,9,28c0c158,0,0,...) at kern_select+0x914/frame 0xf890abd0 sys_select(c8efd930,f890aca8,c11d816d,4,ca545000,...) at sys_select+0x66/frame 0xf890ac18 syscall(f890ace8) at syscall+0x34a/frame 0xf890acdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf890acdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284e8eff, esp = 0xbfbfe88c, ebp = 0xbfbfe8b0 --- Tracing command moused pid 699 tid 100144 td 0xc9496c40 sched_switch(c9496c40,0,104,1a9,f88e0918,...) at sched_switch+0x4e2/frame 0xf88e08e0 mi_switch(104,0,c11e58c5,200,246,...) at mi_switch+0x1bf/frame 0xf88e0918 sleepq_switch(c9496c40,0,c11e58c5,1b6,f88e0990,...) at sleepq_switch+0x1c5/frame 0xf88e094c sleepq_catch_signals(f88e09ac,c0b454f9,c93ee2e0,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf88e0988 sleepq_wait_sig(c93ee2e4,0,f88e09e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88e09ac _cv_wait_sig(c93ee2e4,c93ee2d0,c11e8daf,732,1,...) at _cv_wait_sig+0x214/frame 0xf88e09f8 seltdwait(ffffffff,0,0,c9496c40,0,...) at seltdwait+0xbb/frame 0xf88e0a28 kern_select(c9496c40,400,bfbfeba0,0,0,...) at kern_select+0x914/frame 0xf88e0bd0 sys_select(c9496c40,f88e0ca8,c11d816d,4,c10657b7,...) at sys_select+0x66/frame 0xf88e0c18 syscall(f88e0ce8) at syscall+0x34a/frame 0xf88e0cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf88e0cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281e2eff, esp = 0xbfbfea54, ebp = 0xbfbfee24 --- Tracing command smartd pid 692 tid 100146 td 0xc9496930 sched_switch(c9496930,0,104,1a9,f88e6a84,...) at sched_switch+0x4e2/frame 0xf88e6a4c mi_switch(104,0,c11e58c5,200,8083,...) at mi_switch+0x1bf/frame 0xf88e6a84 sleepq_switch(c9496930,0,c11e58c5,1b6,8,...) at sleepq_switch+0x1c5/frame 0xf88e6ab8 sleepq_catch_signals(c0bacdb0,c9496930,2,201,2,...) at sleepq_catch_signals+0x382/frame 0xf88e6af4 sleepq_timedwait_sig(c155fd42,6c,8083,80000000,70,...) at sleepq_timedwait_sig+0x14/frame 0xf88e6b1c _sleep(c155fd42,0,16c,c11e0826,1bdf44f6,...) at _sleep+0x326/frame 0xf88e6b78 kern_nanosleep(bfbf8c00,f88e6bf0,f88e6bf8,f88e6ce8,708,...) at kern_nanosleep+0x14b/frame 0xf88e6bd8 sys_nanosleep(c9496930,f88e6ca8,c11d816d,4,c10657b7,...) at sys_nanosleep+0x68/frame 0xf88e6c18 syscall(f88e6ce8) at syscall+0x34a/frame 0xf88e6cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf88e6cdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x282b684f, esp = 0xbfbf8bd8, ebp = 0xbfbf8bf0 --- Tracing command powerd pid 673 tid 100147 td 0xc9496620 sched_switch(c9496620,0,104,1a9,f88e9910,...) at sched_switch+0x4e2/frame 0xf88e98d8 mi_switch(104,0,c11e58c5,200,c1634110,...) at mi_switch+0x1bf/frame 0xf88e9910 sleepq_switch(c9496620,0,c11e58c5,1b6,c9395f50,...) at sleepq_switch+0x1c5/frame 0xf88e9944 sleepq_catch_signals(c1455bf0,f88e99a8,c0b454f9,c9395f60,0,...) at sleepq_catch_signals+0x382/frame 0xf88e9980 sleepq_timedwait_sig(c9395f64,0,f88e99e4,3ffffff,0,...) at sleepq_timedwait_sig+0x14/frame 0xf88e99a8 _cv_timedwait_sig_sbt(c9395f64,c9395f50,6f6c8365,7dca,3ffffff,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xf88e99f8 seltdwait(7dca,3ffffff,0,f88e9a40,ffffffff,...) at seltdwait+0xad/frame 0xf88e9a28 kern_select(c9496620,0,bfbfeda0,0,bfbfeda0,...) at kern_select+0x914/frame 0xf88e9bd0 sys_select(c9496620,f88e9ca8,c11d816d,4,c10657b7,...) at sys_select+0x66/frame 0xf88e9c18 syscall(f88e9ce8) at syscall+0x34a/frame 0xf88e9cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf88e9cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281b5eff, esp = 0xbfbfed1c, ebp = 0xbfbfee44 --- Tracing command ntpd pid 670 tid 100101 td 0xca39b930 sched_switch(ca39b930,0,104,1a9,edbc9918,...) at sched_switch+0x4e2/frame 0xedbc98e0 mi_switch(104,0,c11e58c5,200,0,...) at mi_switch+0x1bf/frame 0xedbc9918 sleepq_switch(ca39b930,0,c11e58c5,1b6,edbc9990,...) at sleepq_switch+0x1c5/frame 0xedbc994c sleepq_catch_signals(edbc99ac,c0b454f9,c94836e0,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xedbc9988 sleepq_wait_sig(c94836e4,0,edbc99e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xedbc99ac _cv_wait_sig(c94836e4,c94836d0,c11e8daf,732,c9b21ab0,...) at _cv_wait_sig+0x214/frame 0xedbc99f8 seltdwait(ffffffff,0,0,ca39b930,0,...) at seltdwait+0xbb/frame 0xedbc9a28 kern_select(ca39b930,1c,bfbfde08,0,0,...) at kern_select+0x914/frame 0xedbc9bd0 sys_select(ca39b930,edbc9ca8,c11d816d,4,ca474000,...) at sys_select+0x66/frame 0xedbc9c18 syscall(edbc9ce8) at syscall+0x34a/frame 0xedbc9cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbc9cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2843eeff, esp = 0xbfbfdd6c, ebp = 0xbfbfdd90 --- Tracing command nfsd pid 616 tid 100109 td 0xca39a000 sched_switch(ca39a000,0,104,1a9,edbec310,...) at sched_switch+0x4e2/frame 0xedbec2d8 mi_switch(104,0,c11e58c5,200,c1634110,...) at mi_switch+0x1bf/frame 0xedbec310 sleepq_switch(ca39a000,0,c11e58c5,1b6,c8e4f100,...) at sleepq_switch+0x1c5/frame 0xedbec344 sleepq_catch_signals(c1455bf0,edbec3a8,c0b454f9,c8e4f110,0,...) at sleepq_catch_signals+0x382/frame 0xedbec380 sleepq_timedwait_sig(c933d490,0,edbec3e4,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xedbec3a8 _cv_timedwait_sig_sbt(c933d490,c8e4f100,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedbec3f8 svc_run_internal(c0d93060,c8e4f100,ca3c6680,edbec514,0,...) at svc_run_internal+0xc42/frame 0xedbec4dc svc_run(c8e4f000,0,c11c97dc,1e6,1,...) at svc_run+0x1bf/frame 0xedbec524 nfsrvd_nfsd(ca39a000,edbec690,c,8,246,...) at nfsrvd_nfsd+0x1ba/frame 0xedbec660 nfssvc_nfsd(ca39a000,edbecca8,edbecca0,ca39a000,edbeccdc,...) at nfssvc_nfsd+0x11b/frame 0xedbecc00 sys_nfssvc(ca39a000,edbecca8,c11d816d,4,c10657b7,...) at sys_nfssvc+0xc4/frame 0xedbecc18 syscall(edbecce8) at syscall+0x34a/frame 0xedbeccdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbeccdc --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280db1fb, esp = 0xbfbfe7e4, ebp = 0xbfbfea58 --- Tracing command nfsd pid 616 tid 100113 td 0xc9495000 sched_switch(c9495000,0,104,1a9,f887dae0,...) at sched_switch+0x4e2/frame 0xf887daa8 mi_switch(104,0,c11e58c5,200,c15803dc,...) at mi_switch+0x1bf/frame 0xf887dae0 sleepq_switch(c9495000,0,c11e58c5,1b6,f887db58,...) at sleepq_switch+0x1c5/frame 0xf887db14 sleepq_catch_signals(f887db74,c0b454f9,c8e4f110,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf887db50 sleepq_wait_sig(c89f6b90,0,f887dbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf887db74 _cv_wait_sig(c89f6b90,c8e4f100,c1211095,414,0,...) at _cv_wait_sig+0x214/frame 0xf887dbc0 svc_run_internal(f887dcd4,c0b2781e,c8e4f100,f887dce8,c11d854c,...) at svc_run_internal+0xc71/frame 0xf887dca4 svc_thread_start(c8e4f100,f887dce8,c11d854c,3dc,0,...) at svc_thread_start+0xd/frame 0xf887dcac fork_exit(c0d93060,c8e4f100,f887dce8) at fork_exit+0x7e/frame 0xf887dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf887dcd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 616 tid 100114 td 0xc9484c40 sched_switch(c9484c40,0,104,1a9,f8880ae0,...) at sched_switch+0x4e2/frame 0xf8880aa8 mi_switch(104,0,c11e58c5,200,c15803dc,...) at mi_switch+0x1bf/frame 0xf8880ae0 sleepq_switch(c9484c40,0,c11e58c5,1b6,f8880b58,...) at sleepq_switch+0x1c5/frame 0xf8880b14 sleepq_catch_signals(f8880b74,c0b454f9,c8e4f110,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf8880b50 sleepq_wait_sig(c89f6c90,0,f8880bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8880b74 _cv_wait_sig(c89f6c90,c8e4f100,c1211095,45c,0,...) at _cv_wait_sig+0x214/frame 0xf8880bc0 svc_run_internal(f8880cd4,c0b2781e,c8e4f100,f8880ce8,c11d854c,...) at svc_run_internal+0xc71/frame 0xf8880ca4 svc_thread_start(c8e4f100,f8880ce8,c11d854c,3dc,0,...) at svc_thread_start+0xd/frame 0xf8880cac fork_exit(c0d93060,c8e4f100,f8880ce8) at fork_exit+0x7e/frame 0xf8880cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf8880cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 616 tid 100115 td 0xc9484930 sched_switch(c9484930,0,104,1a9,f8883ae0,...) at sched_switch+0x4e2/frame 0xf8883aa8 mi_switch(104,0,c11e58c5,200,c15803dc,...) at mi_switch+0x1bf/frame 0xf8883ae0 sleepq_switch(c9484930,0,c11e58c5,1b6,f8883b58,...) at sleepq_switch+0x1c5/frame 0xf8883b14 sleepq_catch_signals(f8883b74,c0b454f9,c8e4f110,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf8883b50 sleepq_wait_sig(c89f6d90,0,f8883bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8883b74 _cv_wait_sig(c89f6d90,c8e4f100,c1211095,45c,0,...) at _cv_wait_sig+0x214/frame 0xf8883bc0 svc_run_internal(f8883cd4,c0b2781e,c8e4f100,f8883ce8,c11d854c,...) at svc_run_internal+0xc71/frame 0xf8883ca4 svc_thread_start(c8e4f100,f8883ce8,c11d854c,3dc,0,...) at svc_thread_start+0xd/frame 0xf8883cac fork_exit(c0d93060,c8e4f100,f8883ce8) at fork_exit+0x7e/frame 0xf8883cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf8883cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 616 tid 100116 td 0xc9484620 sched_switch(c9484620,0,104,1a9,f8886ae0,...) at sched_switch+0x4e2/frame 0xf8886aa8 mi_switch(104,0,c11e58c5,200,c15803dc,...) at mi_switch+0x1bf/frame 0xf8886ae0 sleepq_switch(c9484620,0,c11e58c5,1b6,f8886b58,...) at sleepq_switch+0x1c5/frame 0xf8886b14 sleepq_catch_signals(f8886b74,c0b454f9,c8e4f110,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf8886b50 sleepq_wait_sig(c89f6e90,0,f8886bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8886b74 _cv_wait_sig(c89f6e90,c8e4f100,c1211095,45c,0,...) at _cv_wait_sig+0x214/frame 0xf8886bc0 svc_run_internal(f8886cd4,c0b2781e,c8e4f100,f8886ce8,c11d854c,...) at svc_run_internal+0xc71/frame 0xf8886ca4 svc_thread_start(c8e4f100,f8886ce8,c11d854c,3dc,0,...) at svc_thread_start+0xd/frame 0xf8886cac fork_exit(c0d93060,c8e4f100,f8886ce8) at fork_exit+0x7e/frame 0xf8886cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf8886cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 616 tid 100117 td 0xc9484310 sched_switch(c9484310,0,104,1a9,f8889ae0,...) at sched_switch+0x4e2/frame 0xf8889aa8 mi_switch(104,0,c11e58c5,200,c15803dc,...) at mi_switch+0x1bf/frame 0xf8889ae0 sleepq_switch(c9484310,0,c11e58c5,1b6,f8889b58,...) at sleepq_switch+0x1c5/frame 0xf8889b14 sleepq_catch_signals(f8889b74,c0b454f9,c8e4f110,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf8889b50 sleepq_wait_sig(c89f7090,0,f8889bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8889b74 _cv_wait_sig(c89f7090,c8e4f100,c1211095,45c,0,...) at _cv_wait_sig+0x214/frame 0xf8889bc0 svc_run_internal(f8889cd4,c0b2781e,c8e4f100,f8889ce8,c11d854c,...) at svc_run_internal+0xc71/frame 0xf8889ca4 svc_thread_start(c8e4f100,f8889ce8,c11d854c,3dc,0,...) at svc_thread_start+0xd/frame 0xf8889cac fork_exit(c0d93060,c8e4f100,f8889ce8) at fork_exit+0x7e/frame 0xf8889cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf8889cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 616 tid 100118 td 0xc9484000 sched_switch(c9484000,0,104,1a9,f888cae0,...) at sched_switch+0x4e2/frame 0xf888caa8 mi_switch(104,0,c11e58c5,200,c15803dc,...) at mi_switch+0x1bf/frame 0xf888cae0 sleepq_switch(c9484000,0,c11e58c5,1b6,f888cb58,...) at sleepq_switch+0x1c5/frame 0xf888cb14 sleepq_catch_signals(f888cb74,c0b454f9,c8e4f110,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf888cb50 sleepq_wait_sig(c89f7190,0,f888cbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf888cb74 _cv_wait_sig(c89f7190,c8e4f100,c1211095,45c,0,...) at _cv_wait_sig+0x214/frame 0xf888cbc0 svc_run_internal(f888ccd4,c0b2781e,c8e4f100,f888cce8,c11d854c,...) at svc_run_internal+0xc71/frame 0xf888cca4 svc_thread_start(c8e4f100,f888cce8,c11d854c,3dc,0,...) at svc_thread_start+0xd/frame 0xf888ccac fork_exit(c0d93060,c8e4f100,f888cce8) at fork_exit+0x7e/frame 0xf888ccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf888ccd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 616 tid 100119 td 0xc93a8c40 sched_switch(c93a8c40,0,104,1a9,f888fae0,...) at sched_switch+0x4e2/frame 0xf888faa8 mi_switch(104,0,c11e58c5,200,c15803dc,...) at mi_switch+0x1bf/frame 0xf888fae0 sleepq_switch(c93a8c40,0,c11e58c5,1b6,f888fb58,...) at sleepq_switch+0x1c5/frame 0xf888fb14 sleepq_catch_signals(f888fb74,c0b454f9,c8e4f110,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf888fb50 sleepq_wait_sig(c89f7290,0,f888fbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf888fb74 _cv_wait_sig(c89f7290,c8e4f100,c1211095,45c,0,...) at _cv_wait_sig+0x214/frame 0xf888fbc0 svc_run_internal(f888fcd4,c0b2781e,c8e4f100,f888fce8,c11d854c,...) at svc_run_internal+0xc71/frame 0xf888fca4 svc_thread_start(c8e4f100,f888fce8,c11d854c,3dc,0,...) at svc_thread_start+0xd/frame 0xf888fcac fork_exit(c0d93060,c8e4f100,f888fce8) at fork_exit+0x7e/frame 0xf888fcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf888fcd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 616 tid 100120 td 0xca47d620 sched_switch(ca47d620,0,104,1a9,f8892ae0,...) at sched_switch+0x4e2/frame 0xf8892aa8 mi_switch(104,0,c11e58c5,200,c15803dc,...) at mi_switch+0x1bf/frame 0xf8892ae0 sleepq_switch(ca47d620,0,c11e58c5,1b6,f8892b58,...) at sleepq_switch+0x1c5/frame 0xf8892b14 sleepq_catch_signals(f8892b74,c0b454f9,c8e4f110,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf8892b50 sleepq_wait_sig(c89f7390,0,f8892bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8892b74 _cv_wait_sig(c89f7390,c8e4f100,c1211095,45c,0,...) at _cv_wait_sig+0x214/frame 0xf8892bc0 svc_run_internal(f8892cd4,c0b2781e,c8e4f100,f8892ce8,c11d854c,...) at svc_run_internal+0xc71/frame 0xf8892ca4 svc_thread_start(c8e4f100,f8892ce8,c11d854c,3dc,0,...) at svc_thread_start+0xd/frame 0xf8892cac fork_exit(c0d93060,c8e4f100,f8892ce8) at fork_exit+0x7e/frame 0xf8892cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf8892cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 616 tid 100121 td 0xca47d310 sched_switch(ca47d310,0,104,1a9,f8895ae0,...) at sched_switch+0x4e2/frame 0xf8895aa8 mi_switch(104,0,c11e58c5,200,c15803dc,...) at mi_switch+0x1bf/frame 0xf8895ae0 sleepq_switch(ca47d310,0,c11e58c5,1b6,f8895b58,...) at sleepq_switch+0x1c5/frame 0xf8895b14 sleepq_catch_signals(f8895b74,c0b454f9,c8e4f110,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf8895b50 sleepq_wait_sig(ca481390,0,f8895bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8895b74 _cv_wait_sig(ca481390,c8e4f100,c1211095,45c,0,...) at _cv_wait_sig+0x214/frame 0xf8895bc0 svc_run_internal(f8895cd4,c0b2781e,c8e4f100,f8895ce8,c11d854c,...) at svc_run_internal+0xc71/frame 0xf8895ca4 svc_thread_start(c8e4f100,f8895ce8,c11d854c,3dc,0,...) at svc_thread_start+0xd/frame 0xf8895cac fork_exit(c0d93060,c8e4f100,f8895ce8) at fork_exit+0x7e/frame 0xf8895cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf8895cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 616 tid 100122 td 0xca47d000 sched_switch(ca47d000,0,104,1a9,f8898ae0,...) at sched_switch+0x4e2/frame 0xf8898aa8 mi_switch(104,0,c11e58c5,200,c15803dc,...) at mi_switch+0x1bf/frame 0xf8898ae0 sleepq_switch(ca47d000,0,c11e58c5,1b6,f8898b58,...) at sleepq_switch+0x1c5/frame 0xf8898b14 sleepq_catch_signals(f8898b74,c0b454f9,c8e4f110,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf8898b50 sleepq_wait_sig(ca481190,0,f8898bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8898b74 _cv_wait_sig(ca481190,c8e4f100,c1211095,45c,0,...) at _cv_wait_sig+0x214/frame 0xf8898bc0 svc_run_internal(f8898cd4,c0b2781e,c8e4f100,f8898ce8,c11d854c,...) at svc_run_internal+0xc71/frame 0xf8898ca4 svc_thread_start(c8e4f100,f8898ce8,c11d854c,3dc,0,...) at svc_thread_start+0xd/frame 0xf8898cac fork_exit(c0d93060,c8e4f100,f8898ce8) at fork_exit+0x7e/frame 0xf8898cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf8898cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 616 tid 100123 td 0xca47cc40 sched_switch(ca47cc40,0,104,1a9,f889bae0,...) at sched_switch+0x4e2/frame 0xf889baa8 mi_switch(104,0,c11e58c5,200,c15803dc,...) at mi_switch+0x1bf/frame 0xf889bae0 sleepq_switch(ca47cc40,0,c11e58c5,1b6,f889bb58,...) at sleepq_switch+0x1c5/frame 0xf889bb14 sleepq_catch_signals(f889bb74,c0b454f9,c8e4f110,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf889bb50 sleepq_wait_sig(ca481290,0,f889bbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf889bb74 _cv_wait_sig(ca481290,c8e4f100,c1211095,45c,0,...) at _cv_wait_sig+0x214/frame 0xf889bbc0 svc_run_internal(f889bcd4,c0b2781e,c8e4f100,f889bce8,c11d854c,...) at svc_run_internal+0xc71/frame 0xf889bca4 svc_thread_start(c8e4f100,f889bce8,c11d854c,3dc,0,...) at svc_thread_start+0xd/frame 0xf889bcac fork_exit(c0d93060,c8e4f100,f889bce8) at fork_exit+0x7e/frame 0xf889bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf889bcd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 616 tid 100124 td 0xca47c930 sched_switch(ca47c930,0,104,1a9,f889eae0,...) at sched_switch+0x4e2/frame 0xf889eaa8 mi_switch(104,0,c11e58c5,200,c15803dc,...) at mi_switch+0x1bf/frame 0xf889eae0 sleepq_switch(ca47c930,0,c11e58c5,1b6,f889eb58,...) at sleepq_switch+0x1c5/frame 0xf889eb14 sleepq_catch_signals(f889eb74,c0b454f9,c8e4f110,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf889eb50 sleepq_wait_sig(ca480e90,0,f889ebac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf889eb74 _cv_wait_sig(ca480e90,c8e4f100,c1211095,45c,0,...) at _cv_wait_sig+0x214/frame 0xf889ebc0 svc_run_internal(f889ecd4,c0b2781e,c8e4f100,f889ece8,c11d854c,...) at svc_run_internal+0xc71/frame 0xf889eca4 svc_thread_start(c8e4f100,f889ece8,c11d854c,3dc,0,...) at svc_thread_start+0xd/frame 0xf889ecac fork_exit(c0d93060,c8e4f100,f889ece8) at fork_exit+0x7e/frame 0xf889ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf889ecd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 616 tid 100125 td 0xca47c620 sched_switch(ca47c620,0,104,1a9,f88a1ae0,...) at sched_switch+0x4e2/frame 0xf88a1aa8 mi_switch(104,0,c11e58c5,200,c15803dc,...) at mi_switch+0x1bf/frame 0xf88a1ae0 sleepq_switch(ca47c620,0,c11e58c5,1b6,f88a1b58,...) at sleepq_switch+0x1c5/frame 0xf88a1b14 sleepq_catch_signals(f88a1b74,c0b454f9,c8e4f110,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf88a1b50 sleepq_wait_sig(ca481090,0,f88a1bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88a1b74 _cv_wait_sig(ca481090,c8e4f100,c1211095,45c,0,...) at _cv_wait_sig+0x214/frame 0xf88a1bc0 svc_run_internal(f88a1cd4,c0b2781e,c8e4f100,f88a1ce8,c11d854c,...) at svc_run_internal+0xc71/frame 0xf88a1ca4 svc_thread_start(c8e4f100,f88a1ce8,c11d854c,3dc,0,...) at svc_thread_start+0xd/frame 0xf88a1cac fork_exit(c0d93060,c8e4f100,f88a1ce8) at fork_exit+0x7e/frame 0xf88a1cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88a1cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 616 tid 100126 td 0xca47c310 sched_switch(ca47c310,0,104,1a9,f88a4ae0,...) at sched_switch+0x4e2/frame 0xf88a4aa8 mi_switch(104,0,c11e58c5,200,c15803dc,...) at mi_switch+0x1bf/frame 0xf88a4ae0 sleepq_switch(ca47c310,0,c11e58c5,1b6,f88a4b58,...) at sleepq_switch+0x1c5/frame 0xf88a4b14 sleepq_catch_signals(f88a4b74,c0b454f9,c8e4f110,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf88a4b50 sleepq_wait_sig(ca480d90,0,f88a4bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88a4b74 _cv_wait_sig(ca480d90,c8e4f100,c1211095,45c,0,...) at _cv_wait_sig+0x214/frame 0xf88a4bc0 svc_run_internal(f88a4cd4,c0b2781e,c8e4f100,f88a4ce8,c11d854c,...) at svc_run_internal+0xc71/frame 0xf88a4ca4 svc_thread_start(c8e4f100,f88a4ce8,c11d854c,3dc,0,...) at svc_thread_start+0xd/frame 0xf88a4cac fork_exit(c0d93060,c8e4f100,f88a4ce8) at fork_exit+0x7e/frame 0xf88a4cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88a4cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 616 tid 100127 td 0xca47c000 sched_switch(ca47c000,0,104,1a9,f88a7ae0,...) at sched_switch+0x4e2/frame 0xf88a7aa8 mi_switch(104,0,c11e58c5,200,c15803dc,...) at mi_switch+0x1bf/frame 0xf88a7ae0 sleepq_switch(ca47c000,0,c11e58c5,1b6,f88a7b58,...) at sleepq_switch+0x1c5/frame 0xf88a7b14 sleepq_catch_signals(f88a7b74,c0b454f9,c8e4f110,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf88a7b50 sleepq_wait_sig(ca480c90,0,f88a7bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88a7b74 _cv_wait_sig(ca480c90,c8e4f100,c1211095,45c,0,...) at _cv_wait_sig+0x214/frame 0xf88a7bc0 svc_run_internal(f88a7cd4,c0b2781e,c8e4f100,f88a7ce8,c11d854c,...) at svc_run_internal+0xc71/frame 0xf88a7ca4 svc_thread_start(c8e4f100,f88a7ce8,c11d854c,3dc,0,...) at svc_thread_start+0xd/frame 0xf88a7cac fork_exit(c0d93060,c8e4f100,f88a7ce8) at fork_exit+0x7e/frame 0xf88a7cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88a7cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 616 tid 100128 td 0xca47bc40 sched_switch(ca47bc40,0,104,1a9,f88aaae0,...) at sched_switch+0x4e2/frame 0xf88aaaa8 mi_switch(104,0,c11e58c5,200,c15803dc,...) at mi_switch+0x1bf/frame 0xf88aaae0 sleepq_switch(ca47bc40,0,c11e58c5,1b6,f88aab58,...) at sleepq_switch+0x1c5/frame 0xf88aab14 sleepq_catch_signals(f88aab74,c0b454f9,c8e4f110,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf88aab50 sleepq_wait_sig(ca480b90,0,f88aabac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88aab74 _cv_wait_sig(ca480b90,c8e4f100,c1211095,45c,0,...) at _cv_wait_sig+0x214/frame 0xf88aabc0 svc_run_internal(f88aacd4,c0b2781e,c8e4f100,f88aace8,c11d854c,...) at svc_run_internal+0xc71/frame 0xf88aaca4 svc_thread_start(c8e4f100,f88aace8,c11d854c,3dc,0,...) at svc_thread_start+0xd/frame 0xf88aacac fork_exit(c0d93060,c8e4f100,f88aace8) at fork_exit+0x7e/frame 0xf88aacd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88aacd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 616 tid 100129 td 0xca47b930 sched_switch(ca47b930,0,104,1a9,f88adae0,...) at sched_switch+0x4e2/frame 0xf88adaa8 mi_switch(104,0,c11e58c5,200,c15803dc,...) at mi_switch+0x1bf/frame 0xf88adae0 sleepq_switch(ca47b930,0,c11e58c5,1b6,f88adb58,...) at sleepq_switch+0x1c5/frame 0xf88adb14 sleepq_catch_signals(f88adb74,c0b454f9,c8e4f110,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf88adb50 sleepq_wait_sig(ca480a90,0,f88adbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88adb74 _cv_wait_sig(ca480a90,c8e4f100,c1211095,45c,0,...) at _cv_wait_sig+0x214/frame 0xf88adbc0 svc_run_internal(f88adcd4,c0b2781e,c8e4f100,f88adce8,c11d854c,...) at svc_run_internal+0xc71/frame 0xf88adca4 svc_thread_start(c8e4f100,f88adce8,c11d854c,3dc,0,...) at svc_thread_start+0xd/frame 0xf88adcac fork_exit(c0d93060,c8e4f100,f88adce8) at fork_exit+0x7e/frame 0xf88adcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88adcd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 616 tid 100130 td 0xca47b620 sched_switch(ca47b620,0,104,1a9,f88b0ae0,...) at sched_switch+0x4e2/frame 0xf88b0aa8 mi_switch(104,0,c11e58c5,200,c15803dc,...) at mi_switch+0x1bf/frame 0xf88b0ae0 sleepq_switch(ca47b620,0,c11e58c5,1b6,f88b0b58,...) at sleepq_switch+0x1c5/frame 0xf88b0b14 sleepq_catch_signals(f88b0b74,c0b454f9,c8e4f110,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf88b0b50 sleepq_wait_sig(ca480990,0,f88b0bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88b0b74 _cv_wait_sig(ca480990,c8e4f100,c1211095,45c,0,...) at _cv_wait_sig+0x214/frame 0xf88b0bc0 svc_run_internal(f88b0cd4,c0b2781e,c8e4f100,f88b0ce8,c11d854c,...) at svc_run_internal+0xc71/frame 0xf88b0ca4 svc_thread_start(c8e4f100,f88b0ce8,c11d854c,3dc,0,...) at svc_thread_start+0xd/frame 0xf88b0cac fork_exit(c0d93060,c8e4f100,f88b0ce8) at fork_exit+0x7e/frame 0xf88b0cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88b0cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 616 tid 100131 td 0xca47b310 sched_switch(ca47b310,0,104,1a9,f88b3ae0,...) at sched_switch+0x4e2/frame 0xf88b3aa8 mi_switch(104,0,c11e58c5,200,c15803dc,...) at mi_switch+0x1bf/frame 0xf88b3ae0 sleepq_switch(ca47b310,0,c11e58c5,1b6,f88b3b58,...) at sleepq_switch+0x1c5/frame 0xf88b3b14 sleepq_catch_signals(f88b3b74,c0b454f9,c8e4f110,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf88b3b50 sleepq_wait_sig(ca480890,0,f88b3bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88b3b74 _cv_wait_sig(ca480890,c8e4f100,c1211095,45c,0,...) at _cv_wait_sig+0x214/frame 0xf88b3bc0 svc_run_internal(f88b3cd4,c0b2781e,c8e4f100,f88b3ce8,c11d854c,...) at svc_run_internal+0xc71/frame 0xf88b3ca4 svc_thread_start(c8e4f100,f88b3ce8,c11d854c,3dc,0,...) at svc_thread_start+0xd/frame 0xf88b3cac fork_exit(c0d93060,c8e4f100,f88b3ce8) at fork_exit+0x7e/frame 0xf88b3cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88b3cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 616 tid 100132 td 0xca47b000 sched_switch(ca47b000,0,104,1a9,f88b6ae0,...) at sched_switch+0x4e2/frame 0xf88b6aa8 mi_switch(104,0,c11e58c5,200,c15803dc,...) at mi_switch+0x1bf/frame 0xf88b6ae0 sleepq_switch(ca47b000,0,c11e58c5,1b6,f88b6b58,...) at sleepq_switch+0x1c5/frame 0xf88b6b14 sleepq_catch_signals(f88b6b74,c0b454f9,c8e4f110,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf88b6b50 sleepq_wait_sig(ca480790,0,f88b6bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88b6b74 _cv_wait_sig(ca480790,c8e4f100,c1211095,45c,0,...) at _cv_wait_sig+0x214/frame 0xf88b6bc0 svc_run_internal(f88b6cd4,c0b2781e,c8e4f100,f88b6ce8,c11d854c,...) at svc_run_internal+0xc71/frame 0xf88b6ca4 svc_thread_start(c8e4f100,f88b6ce8,c11d854c,3dc,0,...) at svc_thread_start+0xd/frame 0xf88b6cac fork_exit(c0d93060,c8e4f100,f88b6ce8) at fork_exit+0x7e/frame 0xf88b6cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88b6cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 616 tid 100133 td 0xca484000 sched_switch(ca484000,0,104,1a9,f88b9ae0,...) at sched_switch+0x4e2/frame 0xf88b9aa8 mi_switch(104,0,c11e58c5,200,c15803dc,...) at mi_switch+0x1bf/frame 0xf88b9ae0 sleepq_switch(ca484000,0,c11e58c5,1b6,f88b9b58,...) at sleepq_switch+0x1c5/frame 0xf88b9b14 sleepq_catch_signals(f88b9b74,c0b454f9,c8e4f110,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf88b9b50 sleepq_wait_sig(ca480690,0,f88b9bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88b9b74 _cv_wait_sig(ca480690,c8e4f100,c1211095,45c,0,...) at _cv_wait_sig+0x214/frame 0xf88b9bc0 svc_run_internal(f88b9cd4,c0b2781e,c8e4f100,f88b9ce8,c11d854c,...) at svc_run_internal+0xc71/frame 0xf88b9ca4 svc_thread_start(c8e4f100,f88b9ce8,c11d854c,3dc,0,...) at svc_thread_start+0xd/frame 0xf88b9cac fork_exit(c0d93060,c8e4f100,f88b9ce8) at fork_exit+0x7e/frame 0xf88b9cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88b9cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 616 tid 100134 td 0xca483c40 sched_switch(ca483c40,0,104,1a9,f88bcae0,...) at sched_switch+0x4e2/frame 0xf88bcaa8 mi_switch(104,0,c11e58c5,200,c15803dc,...) at mi_switch+0x1bf/frame 0xf88bcae0 sleepq_switch(ca483c40,0,c11e58c5,1b6,f88bcb58,...) at sleepq_switch+0x1c5/frame 0xf88bcb14 sleepq_catch_signals(f88bcb74,c0b454f9,c8e4f110,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf88bcb50 sleepq_wait_sig(ca480590,0,f88bcbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88bcb74 _cv_wait_sig(ca480590,c8e4f100,c1211095,45c,0,...) at _cv_wait_sig+0x214/frame 0xf88bcbc0 svc_run_internal(f88bccd4,c0b2781e,c8e4f100,f88bcce8,c11d854c,...) at svc_run_internal+0xc71/frame 0xf88bcca4 svc_thread_start(c8e4f100,f88bcce8,c11d854c,3dc,0,...) at svc_thread_start+0xd/frame 0xf88bccac fork_exit(c0d93060,c8e4f100,f88bcce8) at fork_exit+0x7e/frame 0xf88bccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88bccd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 616 tid 100135 td 0xca483930 sched_switch(ca483930,0,104,1a9,f88bfae0,...) at sched_switch+0x4e2/frame 0xf88bfaa8 mi_switch(104,0,c11e58c5,200,c15803dc,...) at mi_switch+0x1bf/frame 0xf88bfae0 sleepq_switch(ca483930,0,c11e58c5,1b6,f88bfb58,...) at sleepq_switch+0x1c5/frame 0xf88bfb14 sleepq_catch_signals(f88bfb74,c0b454f9,c8e4f110,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf88bfb50 sleepq_wait_sig(ca480490,0,f88bfbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88bfb74 _cv_wait_sig(ca480490,c8e4f100,c1211095,45c,0,...) at _cv_wait_sig+0x214/frame 0xf88bfbc0 svc_run_internal(f88bfcd4,c0b2781e,c8e4f100,f88bfce8,c11d854c,...) at svc_run_internal+0xc71/frame 0xf88bfca4 svc_thread_start(c8e4f100,f88bfce8,c11d854c,3dc,0,...) at svc_thread_start+0xd/frame 0xf88bfcac fork_exit(c0d93060,c8e4f100,f88bfce8) at fork_exit+0x7e/frame 0xf88bfcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88bfcd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 616 tid 100136 td 0xca483620 sched_switch(ca483620,0,104,1a9,f88c2ae0,...) at sched_switch+0x4e2/frame 0xf88c2aa8 mi_switch(104,0,c11e58c5,200,c15803dc,...) at mi_switch+0x1bf/frame 0xf88c2ae0 sleepq_switch(ca483620,0,c11e58c5,1b6,f88c2b58,...) at sleepq_switch+0x1c5/frame 0xf88c2b14 sleepq_catch_signals(f88c2b74,c0b454f9,c8e4f110,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf88c2b50 sleepq_wait_sig(ca480390,0,f88c2bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88c2b74 _cv_wait_sig(ca480390,c8e4f100,c1211095,45c,0,...) at _cv_wait_sig+0x214/frame 0xf88c2bc0 svc_run_internal(f88c2cd4,c0b2781e,c8e4f100,f88c2ce8,c11d854c,...) at svc_run_internal+0xc71/frame 0xf88c2ca4 svc_thread_start(c8e4f100,f88c2ce8,c11d854c,3dc,0,...) at svc_thread_start+0xd/frame 0xf88c2cac fork_exit(c0d93060,c8e4f100,f88c2ce8) at fork_exit+0x7e/frame 0xf88c2cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88c2cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 616 tid 100137 td 0xca483310 sched_switch(ca483310,0,104,1a9,f88c5ae0,...) at sched_switch+0x4e2/frame 0xf88c5aa8 mi_switch(104,0,c11e58c5,200,c15803dc,...) at mi_switch+0x1bf/frame 0xf88c5ae0 sleepq_switch(ca483310,0,c11e58c5,1b6,f88c5b58,...) at sleepq_switch+0x1c5/frame 0xf88c5b14 sleepq_catch_signals(f88c5b74,c0b454f9,c8e4f110,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf88c5b50 sleepq_wait_sig(ca480290,0,f88c5bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88c5b74 _cv_wait_sig(ca480290,c8e4f100,c1211095,45c,0,...) at _cv_wait_sig+0x214/frame 0xf88c5bc0 svc_run_internal(f88c5cd4,c0b2781e,c8e4f100,f88c5ce8,c11d854c,...) at svc_run_internal+0xc71/frame 0xf88c5ca4 svc_thread_start(c8e4f100,f88c5ce8,c11d854c,3dc,0,...) at svc_thread_start+0xd/frame 0xf88c5cac fork_exit(c0d93060,c8e4f100,f88c5ce8) at fork_exit+0x7e/frame 0xf88c5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88c5cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 616 tid 100138 td 0xca483000 sched_switch(ca483000,0,104,1a9,f88c8ae0,...) at sched_switch+0x4e2/frame 0xf88c8aa8 mi_switch(104,0,c11e58c5,200,c15803dc,...) at mi_switch+0x1bf/frame 0xf88c8ae0 sleepq_switch(ca483000,0,c11e58c5,1b6,f88c8b58,...) at sleepq_switch+0x1c5/frame 0xf88c8b14 sleepq_catch_signals(f88c8b74,c0b454f9,c8e4f110,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf88c8b50 sleepq_wait_sig(ca480190,0,f88c8bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88c8b74 _cv_wait_sig(ca480190,c8e4f100,c1211095,45c,0,...) at _cv_wait_sig+0x214/frame 0xf88c8bc0 svc_run_internal(f88c8cd4,c0b2781e,c8e4f100,f88c8ce8,c11d854c,...) at svc_run_internal+0xc71/frame 0xf88c8ca4 svc_thread_start(c8e4f100,f88c8ce8,c11d854c,3dc,0,...) at svc_thread_start+0xd/frame 0xf88c8cac fork_exit(c0d93060,c8e4f100,f88c8ce8) at fork_exit+0x7e/frame 0xf88c8cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88c8cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 616 tid 100139 td 0xca482c40 sched_switch(ca482c40,0,104,1a9,f88cbae0,...) at sched_switch+0x4e2/frame 0xf88cbaa8 mi_switch(104,0,c11e58c5,200,c15803dc,...) at mi_switch+0x1bf/frame 0xf88cbae0 sleepq_switch(ca482c40,0,c11e58c5,1b6,f88cbb58,...) at sleepq_switch+0x1c5/frame 0xf88cbb14 sleepq_catch_signals(f88cbb74,c0b454f9,c8e4f110,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf88cbb50 sleepq_wait_sig(ca480090,0,f88cbbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88cbb74 _cv_wait_sig(ca480090,c8e4f100,c1211095,45c,0,...) at _cv_wait_sig+0x214/frame 0xf88cbbc0 svc_run_internal(f88cbcd4,c0b2781e,c8e4f100,f88cbce8,c11d854c,...) at svc_run_internal+0xc71/frame 0xf88cbca4 svc_thread_start(c8e4f100,f88cbce8,c11d854c,3dc,0,...) at svc_thread_start+0xd/frame 0xf88cbcac fork_exit(c0d93060,c8e4f100,f88cbce8) at fork_exit+0x7e/frame 0xf88cbcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88cbcd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 616 tid 100140 td 0xca482930 sched_switch(ca482930,0,104,1a9,f88ceae0,...) at sched_switch+0x4e2/frame 0xf88ceaa8 mi_switch(104,0,c11e58c5,200,c15803dc,...) at mi_switch+0x1bf/frame 0xf88ceae0 sleepq_switch(ca482930,0,c11e58c5,1b6,f88ceb58,...) at sleepq_switch+0x1c5/frame 0xf88ceb14 sleepq_catch_signals(f88ceb74,c0b454f9,c8e4f110,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf88ceb50 sleepq_wait_sig(ca47fe90,0,f88cebac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88ceb74 _cv_wait_sig(ca47fe90,c8e4f100,c1211095,45c,0,...) at _cv_wait_sig+0x214/frame 0xf88cebc0 svc_run_internal(f88cecd4,c0b2781e,c8e4f100,f88cece8,c11d854c,...) at svc_run_internal+0xc71/frame 0xf88ceca4 svc_thread_start(c8e4f100,f88cece8,c11d854c,3dc,0,...) at svc_thread_start+0xd/frame 0xf88cecac fork_exit(c0d93060,c8e4f100,f88cece8) at fork_exit+0x7e/frame 0xf88cecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88cecd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 616 tid 100141 td 0xca482620 sched_switch(ca482620,0,104,1a9,f88d1ae0,...) at sched_switch+0x4e2/frame 0xf88d1aa8 mi_switch(104,0,c11e58c5,200,c15803dc,...) at mi_switch+0x1bf/frame 0xf88d1ae0 sleepq_switch(ca482620,0,c11e58c5,1b6,f88d1b58,...) at sleepq_switch+0x1c5/frame 0xf88d1b14 sleepq_catch_signals(f88d1b74,c0b454f9,c8e4f110,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf88d1b50 sleepq_wait_sig(ca47fd90,0,f88d1bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88d1b74 _cv_wait_sig(ca47fd90,c8e4f100,c1211095,45c,0,...) at _cv_wait_sig+0x214/frame 0xf88d1bc0 svc_run_internal(f88d1cd4,c0b2781e,c8e4f100,f88d1ce8,c11d854c,...) at svc_run_internal+0xc71/frame 0xf88d1ca4 svc_thread_start(c8e4f100,f88d1ce8,c11d854c,3dc,0,...) at svc_thread_start+0xd/frame 0xf88d1cac fork_exit(c0d93060,c8e4f100,f88d1ce8) at fork_exit+0x7e/frame 0xf88d1cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88d1cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 616 tid 100142 td 0xca482310 sched_switch(ca482310,0,104,1a9,f88d4ae0,...) at sched_switch+0x4e2/frame 0xf88d4aa8 mi_switch(104,0,c11e58c5,200,c15803dc,...) at mi_switch+0x1bf/frame 0xf88d4ae0 sleepq_switch(ca482310,0,c11e58c5,1b6,f88d4b58,...) at sleepq_switch+0x1c5/frame 0xf88d4b14 sleepq_catch_signals(f88d4b74,c0b454f9,c8e4f110,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf88d4b50 sleepq_wait_sig(ca47fc90,0,f88d4bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88d4b74 _cv_wait_sig(ca47fc90,c8e4f100,c1211095,45c,0,...) at _cv_wait_sig+0x214/frame 0xf88d4bc0 svc_run_internal(f88d4cd4,c0b2781e,c8e4f100,f88d4ce8,c11d854c,...) at svc_run_internal+0xc71/frame 0xf88d4ca4 svc_thread_start(c8e4f100,f88d4ce8,c11d854c,3dc,0,...) at svc_thread_start+0xd/frame 0xf88d4cac fork_exit(c0d93060,c8e4f100,f88d4ce8) at fork_exit+0x7e/frame 0xf88d4cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88d4cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 616 tid 100143 td 0xca482000 sched_switch(ca482000,0,104,1a9,f88d7ae0,...) at sched_switch+0x4e2/frame 0xf88d7aa8 mi_switch(104,0,c11e58c5,200,c15803dc,...) at mi_switch+0x1bf/frame 0xf88d7ae0 sleepq_switch(ca482000,0,c11e58c5,1b6,f88d7b58,...) at sleepq_switch+0x1c5/frame 0xf88d7b14 sleepq_catch_signals(f88d7b74,c0b454f9,c8e4f110,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xf88d7b50 sleepq_wait_sig(ca47fb90,0,f88d7bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf88d7b74 _cv_wait_sig(ca47fb90,c8e4f100,c1211095,45c,0,...) at _cv_wait_sig+0x214/frame 0xf88d7bc0 svc_run_internal(f88d7cd4,c0b2781e,c8e4f100,f88d7ce8,c11d854c,...) at svc_run_internal+0xc71/frame 0xf88d7ca4 svc_thread_start(c8e4f100,f88d7ce8,c11d854c,3dc,0,...) at svc_thread_start+0xd/frame 0xf88d7cac fork_exit(c0d93060,c8e4f100,f88d7ce8) at fork_exit+0x7e/frame 0xf88d7cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf88d7cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 611 tid 100090 td 0xc93a8310 sched_switch(c93a8310,0,104,1a9,edb6a918,...) at sched_switch+0x4e2/frame 0xedb6a8e0 mi_switch(104,0,c11e58c5,200,edb6a984,...) at mi_switch+0x1bf/frame 0xedb6a918 sleepq_switch(c93a8310,0,c11e58c5,1b6,edb6a990,...) at sleepq_switch+0x1c5/frame 0xedb6a94c sleepq_catch_signals(edb6a9ac,c0b454f9,c88e9920,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xedb6a988 sleepq_wait_sig(c88e9924,0,edb6a9e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xedb6a9ac _cv_wait_sig(c88e9924,c88e9910,c11e8daf,732,c9b238e8,...) at _cv_wait_sig+0x214/frame 0xedb6a9f8 seltdwait(ffffffff,0,0,c93a8310,0,...) at seltdwait+0xbb/frame 0xedb6aa28 kern_select(c93a8310,7,bfbfec30,0,0,...) at kern_select+0x914/frame 0xedb6abd0 sys_select(c93a8310,edb6aca8,c11d816d,4,c10657b7,...) at sys_select+0x66/frame 0xedb6ac18 syscall(edb6ace8) at syscall+0x34a/frame 0xedb6acdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedb6acdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a4eff, esp = 0xbfbfea5c, ebp = 0xbfbfee34 --- Tracing command mountd pid 605 tid 100104 td 0xca39b000 sched_switch(ca39b000,0,104,1a9,edbd2918,...) at sched_switch+0x4e2/frame 0xedbd28e0 mi_switch(104,0,c11e58c5,200,60,...) at mi_switch+0x1bf/frame 0xedbd2918 sleepq_switch(ca39b000,0,c11e58c5,1b6,edbd2990,...) at sleepq_switch+0x1c5/frame 0xedbd294c sleepq_catch_signals(edbd29ac,c0b454f9,c9396060,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xedbd2988 sleepq_wait_sig(c9396064,0,edbd29e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xedbd29ac _cv_wait_sig(c9396064,c9396050,c11e8daf,732,c9b11390,...) at _cv_wait_sig+0x214/frame 0xedbd29f8 seltdwait(ffffffff,0,0,ca39b000,0,...) at seltdwait+0xbb/frame 0xedbd2a28 kern_select(ca39b000,9,bfbfed50,0,0,...) at kern_select+0x914/frame 0xedbd2bd0 sys_select(ca39b000,edbd2ca8,c11d816d,4,c10657b7,...) at sys_select+0x66/frame 0xedbd2c18 syscall(edbd2ce8) at syscall+0x34a/frame 0xedbd2cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbd2cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281bbeff, esp = 0xbfbfed0c, ebp = 0xbfbfee34 --- Tracing command nfsuserd pid 598 tid 100111 td 0xc9495620 sched_switch(c9495620,0,104,1a9,edbf9910,...) at sched_switch+0x4e2/frame 0xedbf98d8 mi_switch(104,0,c11e58c5,200,c1634110,...) at mi_switch+0x1bf/frame 0xedbf9910 sleepq_switch(c9495620,0,c11e58c5,1b6,c88e9c10,...) at sleepq_switch+0x1c5/frame 0xedbf9944 sleepq_catch_signals(c1455bf0,edbf99a8,c0b454f9,c88e9c20,0,...) at sleepq_catch_signals+0x382/frame 0xedbf9980 sleepq_timedwait_sig(c88e9c24,0,edbf99e4,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xedbf99a8 _cv_timedwait_sig_sbt(c88e9c24,c88e9c10,755eb0f1,7dd3,e0000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedbf99f8 seltdwait(7dd3,e0000000,1,c9495620,0,...) at seltdwait+0xad/frame 0xedbf9a28 kern_select(c9495620,4,bfbfec10,0,0,...) at kern_select+0x914/frame 0xedbf9bd0 sys_select(c9495620,edbf9ca8,c11d816d,4,c10657b7,...) at sys_select+0x66/frame 0xedbf9c18 syscall(edbf9ce8) at syscall+0x34a/frame 0xedbf9cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbf9cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a3eff, esp = 0xbfbfeb64, ebp = 0xbfbfeca8 --- Tracing command nfsuserd pid 597 tid 100110 td 0xc9495930 sched_switch(c9495930,0,104,1a9,edbf6910,...) at sched_switch+0x4e2/frame 0xedbf68d8 mi_switch(104,0,c11e58c5,200,c1634290,...) at mi_switch+0x1bf/frame 0xedbf6910 sleepq_switch(c9495930,0,c11e58c5,1b6,c9396090,...) at sleepq_switch+0x1c5/frame 0xedbf6944 sleepq_catch_signals(c1455bf0,edbf69a8,c0b454f9,c93960a0,0,...) at sleepq_catch_signals+0x382/frame 0xedbf6980 sleepq_timedwait_sig(c93960a4,0,edbf69e4,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xedbf69a8 _cv_timedwait_sig_sbt(c93960a4,c9396090,f8c77344,7dd3,e0000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedbf69f8 seltdwait(7dd3,e0000000,1,c9495930,0,...) at seltdwait+0xad/frame 0xedbf6a28 kern_select(c9495930,4,bfbfec10,0,0,...) at kern_select+0x914/frame 0xedbf6bd0 sys_select(c9495930,edbf6ca8,c11d816d,4,8,...) at sys_select+0x66/frame 0xedbf6c18 syscall(edbf6ce8) at syscall+0x34a/frame 0xedbf6cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbf6cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a3eff, esp = 0xbfbfeb64, ebp = 0xbfbfeca8 --- Tracing command nfsuserd pid 596 tid 100082 td 0xc9258930 sched_switch(c9258930,0,104,1a9,edb2f910,...) at sched_switch+0x4e2/frame 0xedb2f8d8 mi_switch(104,0,c11e58c5,200,c1634290,...) at mi_switch+0x1bf/frame 0xedb2f910 sleepq_switch(c9258930,0,c11e58c5,1b6,c93960d0,...) at sleepq_switch+0x1c5/frame 0xedb2f944 sleepq_catch_signals(c1455bf0,edb2f9a8,c0b454f9,c93960e0,0,...) at sleepq_catch_signals+0x382/frame 0xedb2f980 sleepq_timedwait_sig(c93960e4,0,edb2f9e4,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xedb2f9a8 _cv_timedwait_sig_sbt(c93960e4,c93960d0,4d25c2c3,7dd2,e0000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedb2f9f8 seltdwait(7dd2,e0000000,1,c9258930,0,...) at seltdwait+0xad/frame 0xedb2fa28 kern_select(c9258930,4,bfbfec10,0,0,...) at kern_select+0x914/frame 0xedb2fbd0 sys_select(c9258930,edb2fca8,c11d816d,4,c11e18f2,...) at sys_select+0x66/frame 0xedb2fc18 syscall(edb2fce8) at syscall+0x34a/frame 0xedb2fcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedb2fcdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a3eff, esp = 0xbfbfeb64, ebp = 0xbfbfeca8 --- Tracing command nfsuserd pid 595 tid 100099 td 0xc9186000 sched_switch(c9186000,0,104,1a9,edbc3910,...) at sched_switch+0x4e2/frame 0xedbc38d8 mi_switch(104,0,c11e58c5,200,c1634110,...) at mi_switch+0x1bf/frame 0xedbc3910 sleepq_switch(c9186000,0,c11e58c5,1b6,c88e9e10,...) at sleepq_switch+0x1c5/frame 0xedbc3944 sleepq_catch_signals(c1455bf0,edbc39a8,c0b454f9,c88e9e20,0,...) at sleepq_catch_signals+0x382/frame 0xedbc3980 sleepq_timedwait_sig(c88e9e24,0,edbc39e4,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xedbc39a8 _cv_timedwait_sig_sbt(c88e9e24,c88e9e10,4b7bf4bb,7dd2,e0000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedbc39f8 seltdwait(7dd2,e0000000,1,c9186000,0,...) at seltdwait+0xad/frame 0xedbc3a28 kern_select(c9186000,4,bfbfec10,0,0,...) at kern_select+0x914/frame 0xedbc3bd0 sys_select(c9186000,edbc3ca8,c11d816d,4,c10657b7,...) at sys_select+0x66/frame 0xedbc3c18 syscall(edbc3ce8) at syscall+0x34a/frame 0xedbc3cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbc3cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a3eff, esp = 0xbfbfeb64, ebp = 0xbfbfeca8 --- Tracing command nfsuserd pid 594 tid 100096 td 0xc9397620 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c11e3878,c8a39930,e4741424,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xe4741408 kdb_backtrace(c11e38f5,280,e47415bc,c105d030,8,...) at kdb_backtrace+0x2d/frame 0xe4741470 kdb_reenter(8,c11e62e6,225,e47414a8,c8a39930,...) at kdb_reenter+0x31/frame 0xe4741480 trap(e47415c8) at trap+0x50/frame 0xe47415bc calltrap() at calltrap+0x6/frame 0xe47415bc --- trap 0xc, eip = 0xc1048c56, esp = 0xe4741608, ebp = 0xe4741618 --- db_trace_thread(c9397620,ffffffff,252,18700,c9397620,...) at db_trace_thread+0x16/frame 0xe4741618 db_stack_trace_all(c157d500,0,ffffffff,e47416b8,0,...) at db_stack_trace_all+0xa2/frame 0xe4741684 db_command(c1499802,0,c1629ce0,c1499801,a,...) at db_command+0x39f/frame 0xe4741740 db_script_exec(e47417f0,0,c8b58250,e47417dc,1,...) at db_script_exec+0x168/frame 0xe47417a8 db_command(c10ad9c3,e47418c8,c053337b,c10adab4,c079a0d7,...) at db_command+0x39f/frame 0xe4741864 db_command_loop(c10adab4,c079a0d7,c15deba4,1,c8a12d00,...) at db_command_loop+0x50/frame 0xe4741870 db_trap(3,0,c8afb620,46,1,...) at db_trap+0xdb/frame 0xe47418c8 kdb_trap(3,0,e4741a48,e4741a90,0,...) at kdb_trap+0x117/frame 0xe4741900 trap(e4741a48) at trap+0x87f/frame 0xe4741a3c calltrap() at calltrap+0x6/frame 0xe4741a3c --- trap 0x3, eip = 0xc0b9b912, esp = 0xe4741a88, ebp = 0xe4741a9c --- kdb_alt_break_internal(0,e4741ac8,c097ded7,2,c8cd7884,...) at kdb_alt_break_internal+0x162/frame 0xe4741a9c kdb_alt_break(2,c8cd7884,c11a75b9,c8cd7800,40000,...) at kdb_alt_break+0x16/frame 0xe4741aa8 uart_intr_rxready(c8cd7800,e472ec80,8,c13a3113,342,...) at uart_intr_rxready+0x87/frame 0xe4741ac8 uart_intr(c8cd7800,c0b462c8,c1634400,a,0,...) at uart_intr+0x100/frame 0xe4741b04 intr_event_handle(c88e2900,e4741b80,0,2,0,...) at intr_event_handle+0x7a/frame 0xe4741b30 intr_execute_handlers(c8a90108,e4741b80,2) at intr_execute_handlers+0x42/frame 0xe4741b50 lapic_handle_intr(30,e4741b80) at lapic_handle_intr+0x5d/frame 0xe4741b70 Xapic_isr1() at Xapic_isr1+0x4a/frame 0xe4741b70 --- interrupt, eip = 0xc1045375, esp = 0xe4741bc0, ebp = 0xe4741bc0 --- acpi_cpu_c1(e472ec90,0,c13a3113,2ec,7dca,...) at acpi_cpu_c1+0x5/frame 0xe4741bc0 acpi_cpu_idle(7fcf3e80,0,7fcf3e80,e4741c30,c107656d,...) at acpi_cpu_idle+0x166/frame 0xe4741c00 cpu_idle_acpi(7fcf3e80,0,4,c156ce08,c156ce04,...) at cpu_idle_acpi+0x3f/frame 0xe4741c14 cpu_idle(0,e4741c80,c11e18f2,a48,c156ce08,...) at cpu_idle+0x9d/frame 0xe4741c30 sched_idletd(0,e4741ce8,c11d854c,3dc,0,...) at sched_idletd+0x3cb/frame 0xe4741cac fork_exit(c0b89380,0,e4741ce8) at fork_exit+0x7e/frame 0xe4741cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4741cd4 --- trap 0, eip = 0, esp = 0xe4741d20, ebp = 0 --- Tracing command casperd pid 577 tid 100108 td 0xca39a310 sched_switch(ca39a310,0,104,1a9,edbe8918,...) at sched_switch+0x4e2/frame 0xedbe88e0 mi_switch(104,0,c11e58c5,200,c15abc88,...) at mi_switch+0x1bf/frame 0xedbe8918 sleepq_switch(ca39a310,0,c11e58c5,1b6,edbe8990,...) at sleepq_switch+0x1c5/frame 0xedbe894c sleepq_catch_signals(edbe89ac,c0b454f9,c93ee3a0,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xedbe8988 sleepq_wait_sig(c93ee3a4,0,edbe89e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xedbe89ac _cv_wait_sig(c93ee3a4,c93ee390,c11e8daf,732,c9b468e8,...) at _cv_wait_sig+0x214/frame 0xedbe89f8 seltdwait(ffffffff,0,0,ca39a310,0,...) at seltdwait+0xbb/frame 0xedbe8a28 kern_select(ca39a310,7,bfbfe9c8,0,0,...) at kern_select+0x914/frame 0xedbe8bd0 sys_select(ca39a310,edbe8ca8,c11d816d,4,0,...) at sys_select+0x66/frame 0xedbe8c18 syscall(edbe8ce8) at syscall+0x34a/frame 0xedbe8cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbe8cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281d1eff, esp = 0xbfbfe984, ebp = 0xbfbfee44 --- Tracing command casperd pid 576 tid 100107 td 0xca39a620 sched_switch(ca39a620,0,104,1a9,edbe5918,...) at sched_switch+0x4e2/frame 0xedbe58e0 mi_switch(104,0,c11e58c5,200,0,...) at mi_switch+0x1bf/frame 0xedbe5918 sleepq_switch(ca39a620,0,c11e58c5,1b6,edbe5990,...) at sleepq_switch+0x1c5/frame 0xedbe594c sleepq_catch_signals(edbe59ac,c0b454f9,c88e9de0,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xedbe5988 sleepq_wait_sig(c88e9de4,0,edbe59e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xedbe59ac _cv_wait_sig(c88e9de4,c88e9dd0,c11e8daf,732,c9ad3c78,...) at _cv_wait_sig+0x214/frame 0xedbe59f8 seltdwait(ffffffff,0,0,ca39a620,0,...) at seltdwait+0xbb/frame 0xedbe5a28 kern_select(ca39a620,6,bfbfe858,0,0,...) at kern_select+0x914/frame 0xedbe5bd0 sys_select(ca39a620,edbe5ca8,c11d816d,4,c10657b7,...) at sys_select+0x66/frame 0xedbe5c18 syscall(edbe5ce8) at syscall+0x34a/frame 0xedbe5cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbe5cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281d1eff, esp = 0xbfbfe82c, ebp = 0xbfbfe8f0 --- Tracing command rpcbind pid 561 tid 100103 td 0xca39b310 sched_switch(ca39b310,0,104,1a9,edbcf948,...) at sched_switch+0x4e2/frame 0xedbcf910 mi_switch(104,0,c11e58c5,200,c1634590,...) at mi_switch+0x1bf/frame 0xedbcf948 sleepq_switch(ca39b310,0,c11e58c5,1b6,c93ee450,...) at sleepq_switch+0x1c5/frame 0xedbcf97c sleepq_catch_signals(c1455bf0,edbcf9e0,c0b454f9,c93ee460,0,...) at sleepq_catch_signals+0x382/frame 0xedbcf9b8 sleepq_timedwait_sig(c93ee464,0,edbcfa1c,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xedbcf9e0 _cv_timedwait_sig_sbt(c93ee464,c93ee450,cf00d6c3,7dd0,e0000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedbcfa30 seltdwait(7dd0,e0000000,1,ca39b310,0,...) at seltdwait+0xad/frame 0xedbcfa60 kern_poll(ca39b310,bfbfccc0,7,edbcfc00,0,...) at kern_poll+0x4f0/frame 0xedbcfbe0 sys_poll(ca39b310,edbcfca8,c11d816d,4,c10657b7,...) at sys_poll+0x71/frame 0xedbcfc18 syscall(edbcfce8) at syscall+0x34a/frame 0xedbcfcdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbcfcdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x28150c53, esp = 0xbfbfcbfc, ebp = 0xbfbfedd8 --- Tracing command watchdogd pid 489 tid 100097 td 0xc8efb310 sched_switch(c8efb310,0,104,1a9,edbbaa84,...) at sched_switch+0x4e2/frame 0xedbbaa4c mi_switch(104,0,c11e58c5,200,7df3,...) at mi_switch+0x1bf/frame 0xedbbaa84 sleepq_switch(c8efb310,0,c11e58c5,1b6,8,...) at sleepq_switch+0x1c5/frame 0xedbbaab8 sleepq_catch_signals(c0bacdb0,c8efb310,0,201,0,...) at sleepq_catch_signals+0x382/frame 0xedbbaaf4 sleepq_timedwait_sig(c155fd40,6c,7df3,c0000000,3,...) at sleepq_timedwait_sig+0x14/frame 0xedbbab1c _sleep(c155fd40,0,16c,c11e0826,2a633da,...) at _sleep+0x326/frame 0xedbbab78 kern_nanosleep(bfbfece0,edbbabf0,edbbabf8,edbbace8,3c,...) at kern_nanosleep+0x14b/frame 0xedbbabd8 sys_nanosleep(c8efb310,edbbaca8,c11d816d,4,0,...) at sys_nanosleep+0x68/frame 0xedbbac18 syscall(edbbace8) at syscall+0x34a/frame 0xedbbacdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedbbacdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2814984f, esp = 0xbfbfecd4, ebp = 0xbfbfed08 --- Tracing command syslogd pid 485 tid 100080 td 0xc8efb930 sched_switch(c8efb930,0,104,1a9,edb22918,...) at sched_switch+0x4e2/frame 0xedb228e0 mi_switch(104,0,c11e58c5,200,0,...) at mi_switch+0x1bf/frame 0xedb22918 sleepq_switch(c8efb930,0,c11e58c5,1b6,edb22990,...) at sleepq_switch+0x1c5/frame 0xedb2294c sleepq_catch_signals(edb229ac,c0b454f9,c9396420,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xedb22988 sleepq_wait_sig(c9396424,0,edb229e4,101,0,...) at sleepq_wait_sig+0x14/frame 0xedb229ac _cv_wait_sig(c9396424,c9396410,c11e8daf,732,0,...) at _cv_wait_sig+0x214/frame 0xedb229f8 seltdwait(ffffffff,0,0,c8efb930,0,...) at seltdwait+0xbb/frame 0xedb22a28 kern_select(c8efb930,9,2882d118,0,0,...) at kern_select+0x914/frame 0xedb22bd0 sys_select(c8efb930,edb22ca8,c11d816d,4,c949b000,...) at sys_select+0x66/frame 0xedb22c18 syscall(edb22ce8) at syscall+0x34a/frame 0xedb22cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedb22cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281bbeff, esp = 0xbfbfdfdc, ebp = 0xbfbfee34 --- Tracing command rtsold pid 361 tid 100092 td 0xc93a8000 sched_switch(c93a8000,0,104,1a9,edba9950,...) at sched_switch+0x4e2/frame 0xedba9918 mi_switch(104,0,c11e58c5,200,edba99bc,...) at mi_switch+0x1bf/frame 0xedba9950 sleepq_switch(c93a8000,0,c11e58c5,1b6,edba99c8,...) at sleepq_switch+0x1c5/frame 0xedba9984 sleepq_catch_signals(edba99e4,c0b454f9,c88e9f20,0,c1455bf0,...) at sleepq_catch_signals+0x382/frame 0xedba99c0 sleepq_wait_sig(c88e9f24,0,edba9a1c,101,0,...) at sleepq_wait_sig+0x14/frame 0xedba99e4 _cv_wait_sig(c88e9f24,c88e9f10,c11e8daf,732,62d,...) at _cv_wait_sig+0x214/frame 0xedba9a30 seltdwait(ffffffff,0,0,c93a8000,0,...) at seltdwait+0xbb/frame 0xedba9a60 kern_poll(c93a8000,bfbfee08,2,0,0,...) at kern_poll+0x4f0/frame 0xedba9be0 sys_poll(c93a8000,edba9ca8,c11d816d,4,c10657b7,...) at sys_poll+0x71/frame 0xedba9c18 syscall(edba9ce8) at syscall+0x34a/frame 0xedba9cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedba9cdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2814fc53, esp = 0xbfbfedcc, ebp = 0xbfbfee34 --- Tracing command devd pid 325 tid 100078 td 0xc93a8620 sched_switch(c93a8620,0,104,1a9,edb1a910,...) at sched_switch+0x4e2/frame 0xedb1a8d8 mi_switch(104,0,c11e58c5,200,c1634290,...) at mi_switch+0x1bf/frame 0xedb1a910 sleepq_switch(c93a8620,0,c11e58c5,1b6,c93ee610,...) at sleepq_switch+0x1c5/frame 0xedb1a944 sleepq_catch_signals(c1455bf0,edb1a9a8,c0b454f9,c93ee620,0,...) at sleepq_catch_signals+0x382/frame 0xedb1a980 sleepq_timedwait_sig(c93ee624,0,edb1a9e4,c0000000,3,...) at sleepq_timedwait_sig+0x14/frame 0xedb1a9a8 _cv_timedwait_sig_sbt(c93ee624,c93ee610,19b10f94,7e04,c0000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedb1a9f8 seltdwait(7e04,c0000000,3,c93a8620,0,...) at seltdwait+0xad/frame 0xedb1aa28 kern_select(c93a8620,6,bfbfcda8,0,0,...) at kern_select+0x914/frame 0xedb1abd0 sys_select(c93a8620,edb1aca8,c11d816d,4,c156d490,...) at sys_select+0x66/frame 0xedb1ac18 syscall(edb1ace8) at syscall+0x34a/frame 0xedb1acdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xedb1acdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x80e1bc3, esp = 0xbfbfcd4c, ebp = 0xbfbfee54 --- Tracing command vnlru pid 16 tid 100074 td 0xc8efbc40 sched_switch(c8efbc40,0,104,1a9,edb09b8c,...) at sched_switch+0x4e2/frame 0xedb09b54 mi_switch(104,0,c11e58c5,200,101,...) at mi_switch+0x1bf/frame 0xedb09b8c sleepq_switch(c8efbc40,0,c11e58c5,299,c8efbc40,...) at sleepq_switch+0x1c5/frame 0xedb09bc0 sleepq_timedwait(c91749c0,60,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedb09be4 _sleep(c91749c0,c15d858c,260,c11f245d,fffffed8,...) at _sleep+0x33d/frame 0xedb09c40 vnlru_proc(0,edb09ce8,c11d854c,3dc,0,...) at vnlru_proc+0xcf/frame 0xedb09cac fork_exit(c0c1da10,0,edb09ce8) at fork_exit+0x7e/frame 0xedb09cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedb09cd4 --- trap 0, eip = 0, esp = 0xedb09d20, ebp = 0 --- Tracing command syncer pid 9 tid 100073 td 0xc8efc000 sched_switch(c8efc000,0,104,1a9,edb06b90,...) at sched_switch+0x4e2/frame 0xedb06b58 mi_switch(104,0,c11e58c5,200,c15d85b4,...) at mi_switch+0x1bf/frame 0xedb06b90 sleepq_switch(c8efc000,0,c11e58c5,299,0,...) at sleepq_switch+0x1c5/frame 0xedb06bc4 sleepq_timedwait(c15d85d4,0,edb06c24,0,0,...) at sleepq_timedwait+0x48/frame 0xedb06be8 _cv_timedwait_sbt(c15d85d4,c15d85b4,fffffed8,0,0,...) at _cv_timedwait_sbt+0x23c/frame 0xedb06c38 sched_sync(0,edb06ce8,c11d854c,3dc,0,...) at sched_sync+0x712/frame 0xedb06cac fork_exit(c0c1d1e0,0,edb06ce8) at fork_exit+0x7e/frame 0xedb06cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedb06cd4 --- trap 0, eip = 0, esp = 0xedb06d20, ebp = 0 --- Tracing command bufdaemon pid 8 tid 100072 td 0xc8efc310 sched_switch(c8efc310,0,104,1a9,edb03bc4,...) at sched_switch+0x4e2/frame 0xedb03b8c mi_switch(104,0,c11e58c5,200,101,...) at mi_switch+0x1bf/frame 0xedb03bc4 sleepq_switch(c8efc310,0,c11e58c5,299,c8efc310,...) at sleepq_switch+0x1c5/frame 0xedb03bf8 sleepq_timedwait(c15d7d04,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedb03c1c _sleep(c15d7d04,c15d7c80,54,c11eed42,fffffed8,...) at _sleep+0x33d/frame 0xedb03c78 buf_daemon(0,edb03ce8,c11d854c,3dc,0,...) at buf_daemon+0x8c/frame 0xedb03cac fork_exit(c0c00050,0,edb03ce8) at fork_exit+0x7e/frame 0xedb03cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedb03cd4 --- trap 0, eip = 0, esp = 0xedb03d20, ebp = 0 --- Tracing command bufdaemon pid 8 tid 100085 td 0xc9258310 sched_switch(c9258310,0,104,1a9,edb3bbb4,...) at sched_switch+0x4e2/frame 0xedb3bb7c mi_switch(104,0,c11e58c5,200,101,...) at mi_switch+0x1bf/frame 0xedb3bbb4 sleepq_switch(c9258310,0,c11e58c5,299,c9258310,...) at sleepq_switch+0x1c5/frame 0xedb3bbe8 sleepq_timedwait(c8fcee84,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedb3bc0c _sleep(c8fcee84,c8fcee00,54,c1219df8,7fffff6c,...) at _sleep+0x33d/frame 0xedb3bc68 softdep_flush(c973c000,edb3bce8,c11d854c,3dc,0,...) at softdep_flush+0x1a2/frame 0xedb3bcac fork_exit(c0dd7940,c973c000,edb3bce8) at fork_exit+0x7e/frame 0xedb3bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedb3bcd4 --- trap 0, eip = 0, esp = 0xedb3bd20, ebp = 0 --- Tracing command bufdaemon pid 8 tid 100087 td 0xc9186c40 sched_switch(c9186c40,0,104,1a9,edb41bb4,...) at sched_switch+0x4e2/frame 0xedb41b7c mi_switch(104,0,c11e58c5,200,101,...) at mi_switch+0x1bf/frame 0xedb41bb4 sleepq_switch(c9186c40,0,c11e58c5,299,c9186c40,...) at sleepq_switch+0x1c5/frame 0xedb41be8 sleepq_timedwait(c98ecc84,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedb41c0c _sleep(c98ecc84,c98ecc00,54,c1219df8,7fffff6c,...) at _sleep+0x33d/frame 0xedb41c68 softdep_flush(c9339bb0,edb41ce8,c11d854c,3dc,0,...) at softdep_flush+0x1a2/frame 0xedb41cac fork_exit(c0dd7940,c9339bb0,edb41ce8) at fork_exit+0x7e/frame 0xedb41cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedb41cd4 --- trap 0, eip = 0, esp = 0xedb41d20, ebp = 0 --- Tracing command bufdaemon pid 8 tid 100088 td 0xc9186930 sched_switch(c9186930,0,104,1a9,edb44bb4,...) at sched_switch+0x4e2/frame 0xedb44b7c mi_switch(104,0,c11e58c5,200,101,...) at mi_switch+0x1bf/frame 0xedb44bb4 sleepq_switch(c9186930,0,c11e58c5,299,c9186930,...) at sleepq_switch+0x1c5/frame 0xedb44be8 sleepq_timedwait(c98eca84,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedb44c0c _sleep(c98eca84,c98eca00,54,c1219df8,7fffff6c,...) at _sleep+0x33d/frame 0xedb44c68 softdep_flush(c93398c4,edb44ce8,c11d854c,3dc,0,...) at softdep_flush+0x1a2/frame 0xedb44cac fork_exit(c0dd7940,c93398c4,edb44ce8) at fork_exit+0x7e/frame 0xedb44cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedb44cd4 --- trap 0, eip = 0, esp = 0xedb44d20, ebp = 0 --- Tracing command bufdaemon pid 8 tid 100182 td 0xcca5d000 sched_switch(cca5d000,0,104,1a9,f897ebb4,...) at sched_switch+0x4e2/frame 0xf897eb7c mi_switch(104,0,c11e58c5,200,101,...) at mi_switch+0x1bf/frame 0xf897ebb4 sleepq_switch(cca5d000,0,c11e58c5,299,cca5d000,...) at sleepq_switch+0x1c5/frame 0xf897ebe8 sleepq_timedwait(c8fcf284,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xf897ec0c _sleep(c8fcf284,c8fcf200,54,c1219df8,7fffff6c,...) at _sleep+0x33d/frame 0xf897ec68 softdep_flush(cd0de8c4,f897ece8,c11d854c,3dc,0,...) at softdep_flush+0x1a2/frame 0xf897ecac fork_exit(c0dd7940,cd0de8c4,f897ece8) at fork_exit+0x7e/frame 0xf897ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf897ecd4 --- trap 0, eip = 0, esp = 0xf897ed20, ebp = 0 --- Tracing command pagezero pid 7 tid 100071 td 0xc8efc620 sched_switch(c8efc620,0,104,1a9,edb00bc0,...) at sched_switch+0x4e2/frame 0xedb00b88 mi_switch(104,0,c11e58c5,200,101,...) at mi_switch+0x1bf/frame 0xedb00bc0 sleepq_switch(c8efc620,0,c11e58c5,299,c8efc620,...) at sleepq_switch+0x1c5/frame 0xedb00bf4 sleepq_timedwait(c15dd848,0,12b,0,0,...) at sleepq_timedwait+0x48/frame 0xedb00c18 _sleep(c15dd848,c163b080,0,c1221e24,fffea520,...) at _sleep+0x33d/frame 0xedb00c74 vm_pagezero(0,edb00ce8,c11d854c,3dc,0,...) at vm_pagezero+0xc2/frame 0xedb00cac fork_exit(c0e39590,0,edb00ce8) at fork_exit+0x7e/frame 0xedb00cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedb00cd4 --- trap 0, eip = 0, esp = 0xedb00d20, ebp = 0 --- Tracing command vmdaemon pid 6 tid 100070 td 0xc8efc930 sched_switch(c8efc930,0,104,1a9,edafdb8c,...) at sched_switch+0x4e2/frame 0xedafdb54 mi_switch(104,0,c11e58c5,200,c15dd5ac,...) at mi_switch+0x1bf/frame 0xedafdb8c sleepq_switch(c8efc930,0,c11e58c5,276,c8efc930,...) at sleepq_switch+0x1c5/frame 0xedafdbc0 sleepq_wait(c15dd5c4,74,c11eed42,0,0,...) at sleepq_wait+0x48/frame 0xedafdbe4 _sleep(c15dd5c4,c15dd5ac,74,c11eed42,0,...) at _sleep+0x3a1/frame 0xedafdc40 vm_daemon(0,edafdce8,c11d854c,3dc,0,...) at vm_daemon+0x9c/frame 0xedafdcac fork_exit(c0e30b30,0,edafdce8) at fork_exit+0x7e/frame 0xedafdcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedafdcd4 --- trap 0, eip = 0, esp = 0xedafdd20, ebp = 0 --- Tracing command pagedaemon pid 5 tid 100069 td 0xc8efcc40 sched_switch(c8efcc40,0,104,1a9,edafab8c,...) at sched_switch+0x4e2/frame 0xedafab54 mi_switch(104,0,c11e58c5,200,101,...) at mi_switch+0x1bf/frame 0xedafab8c sleepq_switch(c8efcc40,0,c11e58c5,299,c8efcc40,...) at sleepq_switch+0x1c5/frame 0xedafabc0 sleepq_timedwait(c163b104,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedafabe4 _sleep(c163b104,c163b080,54,c11eed42,fffffed8,...) at _sleep+0x33d/frame 0xedafac40 vm_pageout(0,edaface8,c11d854c,3dc,0,...) at vm_pageout+0x1e1/frame 0xedafacac fork_exit(c0e31350,0,edaface8) at fork_exit+0x7e/frame 0xedafacd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedafacd4 --- trap 0, eip = 0, esp = 0xedafad20, ebp = 0 --- Tracing command pagedaemon pid 5 tid 100075 td 0xc9259000 sched_switch(c9259000,0,104,1a9,edb0cbcc,...) at sched_switch+0x4e2/frame 0xedb0cb94 mi_switch(104,0,c11e58c5,200,c157b504,...) at mi_switch+0x1bf/frame 0xedb0cbcc sleepq_switch(c9259000,0,c11e58c5,276,c9259000,...) at sleepq_switch+0x1c5/frame 0xedb0cc00 sleepq_wait(c15dd1a4,54,edb0cc6c,0,0,...) at sleepq_wait+0x48/frame 0xedb0cc24 _sleep(c15dd1a4,c15dd190,54,c121cef4,0,...) at _sleep+0x3a1/frame 0xedb0cc80 uma_reclaim_worker(0,edb0cce8,c11d854c,3dc,0,...) at uma_reclaim_worker+0x82/frame 0xedb0ccac fork_exit(c0e13160,0,edb0cce8) at fork_exit+0x7e/frame 0xedb0ccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedb0ccd4 --- trap 0, eip = 0, esp = 0xedb0cd20, ebp = 0 --- Tracing command sctp_iterator pid 4 tid 100066 td 0xc8efd620 sched_switch(c8efd620,0,104,1a9,ed971bcc,...) at sched_switch+0x4e2/frame 0xed971b94 mi_switch(104,0,c11e58c5,200,c1637a64,...) at mi_switch+0x1bf/frame 0xed971bcc sleepq_switch(c8efd620,0,c11e58c5,276,c8efd620,...) at sleepq_switch+0x1c5/frame 0xed971c00 sleepq_wait(c1637a9c,0,c1205d95,0,0,...) at sleepq_wait+0x48/frame 0xed971c24 _sleep(c1637a9c,c1637a64,0,c1205d95,0,...) at _sleep+0x3a1/frame 0xed971c80 sctp_iterator_thread(0,ed971ce8,c11d854c,3dc,0,...) at sctp_iterator_thread+0x7c/frame 0xed971cac fork_exit(c0cc4e30,0,ed971ce8) at fork_exit+0x7e/frame 0xed971cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed971cd4 --- trap 0, eip = 0, esp = 0xed971d20, ebp = 0 --- Tracing command fdc0 pid 3 tid 100061 td 0xc8ca4310 sched_switch(c8ca4310,0,104,1a9,ed961b60,...) at sched_switch+0x4e2/frame 0xed961b28 mi_switch(104,0,c11e58c5,200,101,...) at mi_switch+0x1bf/frame 0xed961b60 sleepq_switch(c8ca4310,0,c11e58c5,299,c8ca4310,...) at sleepq_switch+0x1c5/frame 0xed961b94 sleepq_timedwait(c8c2ca3c,5c,0,0,0,...) at sleepq_timedwait+0x48/frame 0xed961bb8 _sleep(c8c2ca3c,c8c2caf0,5c,c11ca416,fffffed8,...) at _sleep+0x33d/frame 0xed961c14 fdc_thread(c8c2ca00,ed961ce8,c11d854c,3dc,0,...) at fdc_thread+0x95a/frame 0xed961cac fork_exit(c0fdfa00,c8c2ca00,ed961ce8) at fork_exit+0x7e/frame 0xed961cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed961cd4 --- trap 0, eip = 0, esp = 0xed961d20, ebp = 0 --- Tracing command usb pid 15 tid 100032 td 0xc8be5930 sched_switch(c8be5930,0,104,1a9,ed8e8be8,...) at sched_switch+0x4e2/frame 0xed8e8bb0 mi_switch(104,0,c11e58c5,200,c8c3ecc8,...) at mi_switch+0x1bf/frame 0xed8e8be8 sleepq_switch(c8be5930,0,c11e58c5,276,c8c3eacc,...) at sleepq_switch+0x1c5/frame 0xed8e8c1c sleepq_wait(c8c3eacc,0,ed8e8c70,1,0,...) at sleepq_wait+0x48/frame 0xed8e8c40 _cv_wait(c8c3eacc,c8c3ecc8,c11b06ab,76,c8c3ead4,...) at _cv_wait+0x1fe/frame 0xed8e8c84 usb_process(c8c3eac4,ed8e8ce8,c11d854c,3dc,0,...) at usb_process+0x140/frame 0xed8e8cac fork_exit(c09b9f40,c8c3eac4,ed8e8ce8) at fork_exit+0x7e/frame 0xed8e8cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed8e8cd4 --- trap 0, eip = 0, esp = 0xed8e8d20, ebp = 0 --- Tracing command usb pid 15 tid 100033 td 0xc8be5620 sched_switch(c8be5620,0,104,1a9,ed8ebbe8,...) at sched_switch+0x4e2/frame 0xed8ebbb0 mi_switch(104,0,c11e58c5,200,c8c3ecc8,...) at mi_switch+0x1bf/frame 0xed8ebbe8 sleepq_switch(c8be5620,0,c11e58c5,276,c8c3eafc,...) at sleepq_switch+0x1c5/frame 0xed8ebc1c sleepq_wait(c8c3eafc,0,ed8ebc70,1,0,...) at sleepq_wait+0x48/frame 0xed8ebc40 _cv_wait(c8c3eafc,c8c3ecc8,c11b06ab,76,c8c3eb04,...) at _cv_wait+0x1fe/frame 0xed8ebc84 usb_process(c8c3eaf4,ed8ebce8,c11d854c,3dc,0,...) at usb_process+0x140/frame 0xed8ebcac fork_exit(c09b9f40,c8c3eaf4,ed8ebce8) at fork_exit+0x7e/frame 0xed8ebcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed8ebcd4 --- trap 0, eip = 0, esp = 0xed8ebd20, ebp = 0 --- Tracing command usb pid 15 tid 100034 td 0xc8be5310 sched_switch(c8be5310,0,104,1a9,ed8eebe8,...) at sched_switch+0x4e2/frame 0xed8eebb0 mi_switch(104,0,c11e58c5,200,c8c3ecc8,...) at mi_switch+0x1bf/frame 0xed8eebe8 sleepq_switch(c8be5310,0,c11e58c5,276,c8c3eb2c,...) at sleepq_switch+0x1c5/frame 0xed8eec1c sleepq_wait(c8c3eb2c,0,ed8eec70,1,0,...) at sleepq_wait+0x48/frame 0xed8eec40 _cv_wait(c8c3eb2c,c8c3ecc8,c11b06ab,76,c8c3eb34,...) at _cv_wait+0x1fe/frame 0xed8eec84 usb_process(c8c3eb24,ed8eece8,c11d854c,3dc,0,...) at usb_process+0x140/frame 0xed8eecac fork_exit(c09b9f40,c8c3eb24,ed8eece8) at fork_exit+0x7e/frame 0xed8eecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed8eecd4 --- trap 0, eip = 0, esp = 0xed8eed20, ebp = 0 --- Tracing command usb pid 15 tid 100035 td 0xc8be5000 sched_switch(c8be5000,0,104,1a9,ed8f1be8,...) at sched_switch+0x4e2/frame 0xed8f1bb0 mi_switch(104,0,c11e58c5,200,c8c3ecc8,...) at mi_switch+0x1bf/frame 0xed8f1be8 sleepq_switch(c8be5000,0,c11e58c5,276,c8c3eb5c,...) at sleepq_switch+0x1c5/frame 0xed8f1c1c sleepq_wait(c8c3eb5c,0,ed8f1c70,1,0,...) at sleepq_wait+0x48/frame 0xed8f1c40 _cv_wait(c8c3eb5c,c8c3ecc8,c11b06ab,76,c8c3eb64,...) at _cv_wait+0x1fe/frame 0xed8f1c84 usb_process(c8c3eb54,ed8f1ce8,c11d854c,3dc,0,...) at usb_process+0x140/frame 0xed8f1cac fork_exit(c09b9f40,c8c3eb54,ed8f1ce8) at fork_exit+0x7e/frame 0xed8f1cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed8f1cd4 --- trap 0, eip = 0, esp = 0xed8f1d20, ebp = 0 --- Tracing command usb pid 15 tid 100037 td 0xc8afc930 sched_switch(c8afc930,0,104,1a9,ed8f8be8,...) at sched_switch+0x4e2/frame 0xed8f8bb0 mi_switch(104,0,c11e58c5,200,c8c8bcc8,...) at mi_switch+0x1bf/frame 0xed8f8be8 sleepq_switch(c8afc930,0,c11e58c5,276,c8c8bacc,...) at sleepq_switch+0x1c5/frame 0xed8f8c1c sleepq_wait(c8c8bacc,0,ed8f8c70,1,0,...) at sleepq_wait+0x48/frame 0xed8f8c40 _cv_wait(c8c8bacc,c8c8bcc8,c11b06ab,76,c8c8bad4,...) at _cv_wait+0x1fe/frame 0xed8f8c84 usb_process(c8c8bac4,ed8f8ce8,c11d854c,3dc,0,...) at usb_process+0x140/frame 0xed8f8cac fork_exit(c09b9f40,c8c8bac4,ed8f8ce8) at fork_exit+0x7e/frame 0xed8f8cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed8f8cd4 --- trap 0, eip = 0, esp = 0xed8f8d20, ebp = 0 --- Tracing command usb pid 15 tid 100038 td 0xc8afc620 sched_switch(c8afc620,0,104,1a9,ed8fbbe8,...) at sched_switch+0x4e2/frame 0xed8fbbb0 mi_switch(104,0,c11e58c5,200,c8c8bcc8,...) at mi_switch+0x1bf/frame 0xed8fbbe8 sleepq_switch(c8afc620,0,c11e58c5,276,c8c8bafc,...) at sleepq_switch+0x1c5/frame 0xed8fbc1c sleepq_wait(c8c8bafc,0,ed8fbc70,1,0,...) at sleepq_wait+0x48/frame 0xed8fbc40 _cv_wait(c8c8bafc,c8c8bcc8,c11b06ab,76,c8c8bb04,...) at _cv_wait+0x1fe/frame 0xed8fbc84 usb_process(c8c8baf4,ed8fbce8,c11d854c,3dc,0,...) at usb_process+0x140/frame 0xed8fbcac fork_exit(c09b9f40,c8c8baf4,ed8fbce8) at fork_exit+0x7e/frame 0xed8fbcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed8fbcd4 --- trap 0, eip = 0, esp = 0xed8fbd20, ebp = 0 --- Tracing command usb pid 15 tid 100039 td 0xc8afc310 sched_switch(c8afc310,0,104,1a9,ed8febe8,...) at sched_switch+0x4e2/frame 0xed8febb0 mi_switch(104,0,c11e58c5,200,c8c8bcc8,...) at mi_switch+0x1bf/frame 0xed8febe8 sleepq_switch(c8afc310,0,c11e58c5,276,c8c8bb2c,...) at sleepq_switch+0x1c5/frame 0xed8fec1c sleepq_wait(c8c8bb2c,0,ed8fec70,1,0,...) at sleepq_wait+0x48/frame 0xed8fec40 _cv_wait(c8c8bb2c,c8c8bcc8,c11b06ab,76,c8c8bb34,...) at _cv_wait+0x1fe/frame 0xed8fec84 usb_process(c8c8bb24,ed8fece8,c11d854c,3dc,0,...) at usb_process+0x140/frame 0xed8fecac fork_exit(c09b9f40,c8c8bb24,ed8fece8) at fork_exit+0x7e/frame 0xed8fecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed8fecd4 --- trap 0, eip = 0, esp = 0xed8fed20, ebp = 0 --- Tracing command usb pid 15 tid 100040 td 0xc8c93310 sched_switch(c8c93310,0,104,1a9,ed901be8,...) at sched_switch+0x4e2/frame 0xed901bb0 mi_switch(104,0,c11e58c5,200,c8c8bcc8,...) at mi_switch+0x1bf/frame 0xed901be8 sleepq_switch(c8c93310,0,c11e58c5,276,c8c8bb5c,...) at sleepq_switch+0x1c5/frame 0xed901c1c sleepq_wait(c8c8bb5c,0,ed901c70,1,0,...) at sleepq_wait+0x48/frame 0xed901c40 _cv_wait(c8c8bb5c,c8c8bcc8,c11b06ab,76,c8c8bb64,...) at _cv_wait+0x1fe/frame 0xed901c84 usb_process(c8c8bb54,ed901ce8,c11d854c,3dc,0,...) at usb_process+0x140/frame 0xed901cac fork_exit(c09b9f40,c8c8bb54,ed901ce8) at fork_exit+0x7e/frame 0xed901cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed901cd4 --- trap 0, eip = 0, esp = 0xed901d20, ebp = 0 --- Tracing command usb pid 15 tid 100042 td 0xc8c92c40 sched_switch(c8c92c40,0,104,1a9,ed908be8,...) at sched_switch+0x4e2/frame 0xed908bb0 mi_switch(104,0,c11e58c5,200,c8c94cc8,...) at mi_switch+0x1bf/frame 0xed908be8 sleepq_switch(c8c92c40,0,c11e58c5,276,c8c94acc,...) at sleepq_switch+0x1c5/frame 0xed908c1c sleepq_wait(c8c94acc,0,ed908c70,1,0,...) at sleepq_wait+0x48/frame 0xed908c40 _cv_wait(c8c94acc,c8c94cc8,c11b06ab,76,c8c94ad4,...) at _cv_wait+0x1fe/frame 0xed908c84 usb_process(c8c94ac4,ed908ce8,c11d854c,3dc,0,...) at usb_process+0x140/frame 0xed908cac fork_exit(c09b9f40,c8c94ac4,ed908ce8) at fork_exit+0x7e/frame 0xed908cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed908cd4 --- trap 0, eip = 0, esp = 0xed908d20, ebp = 0 --- Tracing command usb pid 15 tid 100043 td 0xc8c92930 sched_switch(c8c92930,0,104,1a9,ed90bbe8,...) at sched_switch+0x4e2/frame 0xed90bbb0 mi_switch(104,0,c11e58c5,200,c8c94cc8,...) at mi_switch+0x1bf/frame 0xed90bbe8 sleepq_switch(c8c92930,0,c11e58c5,276,c8c94afc,...) at sleepq_switch+0x1c5/frame 0xed90bc1c sleepq_wait(c8c94afc,0,ed90bc70,1,0,...) at sleepq_wait+0x48/frame 0xed90bc40 _cv_wait(c8c94afc,c8c94cc8,c11b06ab,76,c8c94b04,...) at _cv_wait+0x1fe/frame 0xed90bc84 usb_process(c8c94af4,ed90bce8,c11d854c,3dc,0,...) at usb_process+0x140/frame 0xed90bcac fork_exit(c09b9f40,c8c94af4,ed90bce8) at fork_exit+0x7e/frame 0xed90bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed90bcd4 --- trap 0, eip = 0, esp = 0xed90bd20, ebp = 0 --- Tracing command usb pid 15 tid 100044 td 0xc8c92620 sched_switch(c8c92620,0,104,1a9,ed90ebe8,...) at sched_switch+0x4e2/frame 0xed90ebb0 mi_switch(104,0,c11e58c5,200,c8c94cc8,...) at mi_switch+0x1bf/frame 0xed90ebe8 sleepq_switch(c8c92620,0,c11e58c5,276,c8c94b2c,...) at sleepq_switch+0x1c5/frame 0xed90ec1c sleepq_wait(c8c94b2c,0,ed90ec70,1,0,...) at sleepq_wait+0x48/frame 0xed90ec40 _cv_wait(c8c94b2c,c8c94cc8,c11b06ab,76,c8c94b34,...) at _cv_wait+0x1fe/frame 0xed90ec84 usb_process(c8c94b24,ed90ece8,c11d854c,3dc,0,...) at usb_process+0x140/frame 0xed90ecac fork_exit(c09b9f40,c8c94b24,ed90ece8) at fork_exit+0x7e/frame 0xed90ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed90ecd4 --- trap 0, eip = 0, esp = 0xed90ed20, ebp = 0 --- Tracing command usb pid 15 tid 100045 td 0xc8c92310 sched_switch(c8c92310,0,104,1a9,ed911be8,...) at sched_switch+0x4e2/frame 0xed911bb0 mi_switch(104,0,c11e58c5,200,c8c94cc8,...) at mi_switch+0x1bf/frame 0xed911be8 sleepq_switch(c8c92310,0,c11e58c5,276,c8c94b5c,...) at sleepq_switch+0x1c5/frame 0xed911c1c sleepq_wait(c8c94b5c,0,ed911c70,1,0,...) at sleepq_wait+0x48/frame 0xed911c40 _cv_wait(c8c94b5c,c8c94cc8,c11b06ab,76,c8c94b64,...) at _cv_wait+0x1fe/frame 0xed911c84 usb_process(c8c94b54,ed911ce8,c11d854c,3dc,0,...) at usb_process+0x140/frame 0xed911cac fork_exit(c09b9f40,c8c94b54,ed911ce8) at fork_exit+0x7e/frame 0xed911cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed911cd4 --- trap 0, eip = 0, esp = 0xed911d20, ebp = 0 --- Tracing command usb pid 15 tid 100046 td 0xc8c92000 sched_switch(c8c92000,0,104,1a9,ed915be8,...) at sched_switch+0x4e2/frame 0xed915bb0 mi_switch(104,0,c11e58c5,200,c8c9acc8,...) at mi_switch+0x1bf/frame 0xed915be8 sleepq_switch(c8c92000,0,c11e58c5,276,c8c9aacc,...) at sleepq_switch+0x1c5/frame 0xed915c1c sleepq_wait(c8c9aacc,0,ed915c70,1,0,...) at sleepq_wait+0x48/frame 0xed915c40 _cv_wait(c8c9aacc,c8c9acc8,c11b06ab,76,c8c9aad4,...) at _cv_wait+0x1fe/frame 0xed915c84 usb_process(c8c9aac4,ed915ce8,c11d854c,3dc,0,...) at usb_process+0x140/frame 0xed915cac fork_exit(c09b9f40,c8c9aac4,ed915ce8) at fork_exit+0x7e/frame 0xed915cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed915cd4 --- trap 0, eip = 0, esp = 0xed915d20, ebp = 0 --- Tracing command usb pid 15 tid 100047 td 0xc8c91c40 sched_switch(c8c91c40,0,104,1a9,ed918be8,...) at sched_switch+0x4e2/frame 0xed918bb0 mi_switch(104,0,c11e58c5,200,c8c9acc8,...) at mi_switch+0x1bf/frame 0xed918be8 sleepq_switch(c8c91c40,0,c11e58c5,276,c8c9aafc,...) at sleepq_switch+0x1c5/frame 0xed918c1c sleepq_wait(c8c9aafc,0,ed918c70,1,0,...) at sleepq_wait+0x48/frame 0xed918c40 _cv_wait(c8c9aafc,c8c9acc8,c11b06ab,76,c8c9ab04,...) at _cv_wait+0x1fe/frame 0xed918c84 usb_process(c8c9aaf4,ed918ce8,c11d854c,3dc,0,...) at usb_process+0x140/frame 0xed918cac fork_exit(c09b9f40,c8c9aaf4,ed918ce8) at fork_exit+0x7e/frame 0xed918cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed918cd4 --- trap 0, eip = 0, esp = 0xed918d20, ebp = 0 --- Tracing command usb pid 15 tid 100048 td 0xc8c91930 sched_switch(c8c91930,0,104,1a9,ed91bbe8,...) at sched_switch+0x4e2/frame 0xed91bbb0 mi_switch(104,0,c11e58c5,200,c8c9acc8,...) at mi_switch+0x1bf/frame 0xed91bbe8 sleepq_switch(c8c91930,0,c11e58c5,276,c8c9ab2c,...) at sleepq_switch+0x1c5/frame 0xed91bc1c sleepq_wait(c8c9ab2c,0,ed91bc70,1,0,...) at sleepq_wait+0x48/frame 0xed91bc40 _cv_wait(c8c9ab2c,c8c9acc8,c11b06ab,76,c8c9ab34,...) at _cv_wait+0x1fe/frame 0xed91bc84 usb_process(c8c9ab24,ed91bce8,c11d854c,3dc,0,...) at usb_process+0x140/frame 0xed91bcac fork_exit(c09b9f40,c8c9ab24,ed91bce8) at fork_exit+0x7e/frame 0xed91bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed91bcd4 --- trap 0, eip = 0, esp = 0xed91bd20, ebp = 0 --- Tracing command usb pid 15 tid 100049 td 0xc8c91620 sched_switch(c8c91620,0,104,1a9,ed91ebe8,...) at sched_switch+0x4e2/frame 0xed91ebb0 mi_switch(104,0,c11e58c5,200,c8c9acc8,...) at mi_switch+0x1bf/frame 0xed91ebe8 sleepq_switch(c8c91620,0,c11e58c5,276,c8c9ab5c,...) at sleepq_switch+0x1c5/frame 0xed91ec1c sleepq_wait(c8c9ab5c,0,ed91ec70,1,0,...) at sleepq_wait+0x48/frame 0xed91ec40 _cv_wait(c8c9ab5c,c8c9acc8,c11b06ab,76,c8c9ab64,...) at _cv_wait+0x1fe/frame 0xed91ec84 usb_process(c8c9ab54,ed91ece8,c11d854c,3dc,0,...) at usb_process+0x140/frame 0xed91ecac fork_exit(c09b9f40,c8c9ab54,ed91ece8) at fork_exit+0x7e/frame 0xed91ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed91ecd4 --- trap 0, eip = 0, esp = 0xed91ed20, ebp = 0 --- Tracing command usb pid 15 tid 100050 td 0xc8c91310 sched_switch(c8c91310,0,104,1a9,ed922be8,...) at sched_switch+0x4e2/frame 0xed922bb0 mi_switch(104,0,c11e58c5,200,c8ca2cc8,...) at mi_switch+0x1bf/frame 0xed922be8 sleepq_switch(c8c91310,0,c11e58c5,276,c8ca2acc,...) at sleepq_switch+0x1c5/frame 0xed922c1c sleepq_wait(c8ca2acc,0,ed922c70,1,0,...) at sleepq_wait+0x48/frame 0xed922c40 _cv_wait(c8ca2acc,c8ca2cc8,c11b06ab,76,c8ca2ad4,...) at _cv_wait+0x1fe/frame 0xed922c84 usb_process(c8ca2ac4,ed922ce8,c11d854c,3dc,0,...) at usb_process+0x140/frame 0xed922cac fork_exit(c09b9f40,c8ca2ac4,ed922ce8) at fork_exit+0x7e/frame 0xed922cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed922cd4 --- trap 0, eip = 0, esp = 0xed922d20, ebp = 0 --- Tracing command usb pid 15 tid 100051 td 0xc8c91000 sched_switch(c8c91000,0,104,1a9,ed925be8,...) at sched_switch+0x4e2/frame 0xed925bb0 mi_switch(104,0,c11e58c5,200,c8ca2cc8,...) at mi_switch+0x1bf/frame 0xed925be8 sleepq_switch(c8c91000,0,c11e58c5,276,c8ca2afc,...) at sleepq_switch+0x1c5/frame 0xed925c1c sleepq_wait(c8ca2afc,0,ed925c70,1,0,...) at sleepq_wait+0x48/frame 0xed925c40 _cv_wait(c8ca2afc,c8ca2cc8,c11b06ab,76,c8ca2b04,...) at _cv_wait+0x1fe/frame 0xed925c84 usb_process(c8ca2af4,ed925ce8,c11d854c,3dc,0,...) at usb_process+0x140/frame 0xed925cac fork_exit(c09b9f40,c8ca2af4,ed925ce8) at fork_exit+0x7e/frame 0xed925cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed925cd4 --- trap 0, eip = 0, esp = 0xed925d20, ebp = 0 --- Tracing command usb pid 15 tid 100052 td 0xc8be6c40 sched_switch(c8be6c40,0,104,1a9,ed928be8,...) at sched_switch+0x4e2/frame 0xed928bb0 mi_switch(104,0,c11e58c5,200,c8ca2cc8,...) at mi_switch+0x1bf/frame 0xed928be8 sleepq_switch(c8be6c40,0,c11e58c5,276,c8ca2b2c,...) at sleepq_switch+0x1c5/frame 0xed928c1c sleepq_wait(c8ca2b2c,0,ed928c70,1,0,...) at sleepq_wait+0x48/frame 0xed928c40 _cv_wait(c8ca2b2c,c8ca2cc8,c11b06ab,76,c8ca2b34,...) at _cv_wait+0x1fe/frame 0xed928c84 usb_process(c8ca2b24,ed928ce8,c11d854c,3dc,0,...) at usb_process+0x140/frame 0xed928cac fork_exit(c09b9f40,c8ca2b24,ed928ce8) at fork_exit+0x7e/frame 0xed928cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed928cd4 --- trap 0, eip = 0, esp = 0xed928d20, ebp = 0 --- Tracing command usb pid 15 tid 100053 td 0xc8ca5c40 sched_switch(c8ca5c40,0,104,1a9,ed92bbe8,...) at sched_switch+0x4e2/frame 0xed92bbb0 mi_switch(104,0,c11e58c5,200,c8ca2cc8,...) at mi_switch+0x1bf/frame 0xed92bbe8 sleepq_switch(c8ca5c40,0,c11e58c5,276,c8ca2b5c,...) at sleepq_switch+0x1c5/frame 0xed92bc1c sleepq_wait(c8ca2b5c,0,ed92bc70,1,0,...) at sleepq_wait+0x48/frame 0xed92bc40 _cv_wait(c8ca2b5c,c8ca2cc8,c11b06ab,76,c8ca2b64,...) at _cv_wait+0x1fe/frame 0xed92bc84 usb_process(c8ca2b54,ed92bce8,c11d854c,3dc,0,...) at usb_process+0x140/frame 0xed92bcac fork_exit(c09b9f40,c8ca2b54,ed92bce8) at fork_exit+0x7e/frame 0xed92bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed92bcd4 --- trap 0, eip = 0, esp = 0xed92bd20, ebp = 0 --- Tracing command usb pid 15 tid 100055 td 0xc8ca5620 sched_switch(c8ca5620,0,104,1a9,ed934be8,...) at sched_switch+0x4e2/frame 0xed934bb0 mi_switch(104,0,c11e58c5,200,c8c44ea0,...) at mi_switch+0x1bf/frame 0xed934be8 sleepq_switch(c8ca5620,0,c11e58c5,276,c8c44ca4,...) at sleepq_switch+0x1c5/frame 0xed934c1c sleepq_wait(c8c44ca4,0,ed934c70,1,0,...) at sleepq_wait+0x48/frame 0xed934c40 _cv_wait(c8c44ca4,c8c44ea0,c11b06ab,76,c8c44cac,...) at _cv_wait+0x1fe/frame 0xed934c84 usb_process(c8c44c9c,ed934ce8,c11d854c,3dc,0,...) at usb_process+0x140/frame 0xed934cac fork_exit(c09b9f40,c8c44c9c,ed934ce8) at fork_exit+0x7e/frame 0xed934cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed934cd4 --- trap 0, eip = 0, esp = 0xed934d20, ebp = 0 --- Tracing command usb pid 15 tid 100056 td 0xc8ca5310 sched_switch(c8ca5310,0,104,1a9,ed937be8,...) at sched_switch+0x4e2/frame 0xed937bb0 mi_switch(104,0,c11e58c5,200,c8c44ea0,...) at mi_switch+0x1bf/frame 0xed937be8 sleepq_switch(c8ca5310,0,c11e58c5,276,c8c44cd4,...) at sleepq_switch+0x1c5/frame 0xed937c1c sleepq_wait(c8c44cd4,0,ed937c70,1,0,...) at sleepq_wait+0x48/frame 0xed937c40 _cv_wait(c8c44cd4,c8c44ea0,c11b06ab,76,c8c44cdc,...) at _cv_wait+0x1fe/frame 0xed937c84 usb_process(c8c44ccc,ed937ce8,c11d854c,3dc,0,...) at usb_process+0x140/frame 0xed937cac fork_exit(c09b9f40,c8c44ccc,ed937ce8) at fork_exit+0x7e/frame 0xed937cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed937cd4 --- trap 0, eip = 0, esp = 0xed937d20, ebp = 0 --- Tracing command usb pid 15 tid 100057 td 0xc8ca5000 sched_switch(c8ca5000,0,104,1a9,ed93abe8,...) at sched_switch+0x4e2/frame 0xed93abb0 mi_switch(104,0,c11e58c5,200,c8c44ea0,...) at mi_switch+0x1bf/frame 0xed93abe8 sleepq_switch(c8ca5000,0,c11e58c5,276,c8c44d04,...) at sleepq_switch+0x1c5/frame 0xed93ac1c sleepq_wait(c8c44d04,0,ed93ac70,1,0,...) at sleepq_wait+0x48/frame 0xed93ac40 _cv_wait(c8c44d04,c8c44ea0,c11b06ab,76,c8c44d0c,...) at _cv_wait+0x1fe/frame 0xed93ac84 usb_process(c8c44cfc,ed93ace8,c11d854c,3dc,0,...) at usb_process+0x140/frame 0xed93acac fork_exit(c09b9f40,c8c44cfc,ed93ace8) at fork_exit+0x7e/frame 0xed93acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed93acd4 --- trap 0, eip = 0, esp = 0xed93ad20, ebp = 0 --- Tracing command usb pid 15 tid 100058 td 0xc8ca4c40 sched_switch(c8ca4c40,0,104,1a9,ed93dbe8,...) at sched_switch+0x4e2/frame 0xed93dbb0 mi_switch(104,0,c11e58c5,200,c8c44ea0,...) at mi_switch+0x1bf/frame 0xed93dbe8 sleepq_switch(c8ca4c40,0,c11e58c5,276,c8c44d34,...) at sleepq_switch+0x1c5/frame 0xed93dc1c sleepq_wait(c8c44d34,0,ed93dc70,1,0,...) at sleepq_wait+0x48/frame 0xed93dc40 _cv_wait(c8c44d34,c8c44ea0,c11b06ab,76,c8c44d3c,...) at _cv_wait+0x1fe/frame 0xed93dc84 usb_process(c8c44d2c,ed93dce8,c11d854c,3dc,0,...) at usb_process+0x140/frame 0xed93dcac fork_exit(c09b9f40,c8c44d2c,ed93dce8) at fork_exit+0x7e/frame 0xed93dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed93dcd4 --- trap 0, eip = 0, esp = 0xed93dd20, ebp = 0 --- Tracing command cam pid 2 tid 100024 td 0xc8afa000 sched_switch(c8afa000,0,104,1a9,e477bba4,...) at sched_switch+0x4e2/frame 0xe477bb6c mi_switch(104,0,c11e58c5,200,c1495d80,...) at mi_switch+0x1bf/frame 0xe477bba4 sleepq_switch(c8afa000,0,c11e58c5,276,c8afa000,...) at sleepq_switch+0x1c5/frame 0xe477bbd8 sleepq_wait(c1495e00,5c,c11ca416,0,0,...) at sleepq_wait+0x48/frame 0xe477bbfc _sleep(c1495e00,c1495d80,5c,c11ca416,0,...) at _sleep+0x3a1/frame 0xe477bc58 xpt_done_td(c1495d80,e477bce8,c11d854c,3dc,0,...) at xpt_done_td+0x17e/frame 0xe477bcac fork_exit(c04c7fa0,c1495d80,e477bce8) at fork_exit+0x7e/frame 0xe477bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe477bcd4 --- trap 0, eip = 0, esp = 0xe477bd20, ebp = 0 --- Tracing command cam pid 2 tid 100068 td 0xc8efd000 sched_switch(c8efd000,0,104,1a9,ed977ba4,...) at sched_switch+0x4e2/frame 0xed977b6c mi_switch(104,0,c11e58c5,200,c1495cfc,...) at mi_switch+0x1bf/frame 0xed977ba4 sleepq_switch(c8efd000,0,c11e58c5,276,c8efd000,...) at sleepq_switch+0x1c5/frame 0xed977bd8 sleepq_wait(c1495cac,5c,c11ca416,0,0,...) at sleepq_wait+0x48/frame 0xed977bfc _sleep(c1495cac,c1495cfc,5c,c11ca416,0,...) at _sleep+0x3a1/frame 0xed977c58 xpt_scanner_thread(0,ed977ce8,c11d854c,3dc,0,...) at xpt_scanner_thread+0xa2/frame 0xed977cac fork_exit(c04c8360,0,ed977ce8) at fork_exit+0x7e/frame 0xed977cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed977cd4 --- trap 0, eip = 0, esp = 0xed977d20, ebp = 0 --- Tracing command rand_harvestq pid 14 tid 100017 td 0xc8afb620 sched_switch(c8afb620,0,104,1a9,e4766bc8,...) at sched_switch+0x4e2/frame 0xe4766b90 mi_switch(104,0,c11e58c5,200,5,...) at mi_switch+0x1bf/frame 0xe4766bc8 sleepq_switch(c8afb620,0,c11e58c5,299,c8afb620,...) at sleepq_switch+0x1c5/frame 0xe4766bfc sleepq_timedwait(c14b09d0,0,0,0,0,...) at sleepq_timedwait+0x48/frame 0xe4766c20 _sleep(c14b09d0,0,0,c11ca416,19999999,...) at _sleep+0x33d/frame 0xe4766c7c random_kthread(0,e4766ce8,c11d854c,3dc,0,...) at random_kthread+0x5c/frame 0xe4766cac fork_exit(c0898cf0,0,e4766ce8) at fork_exit+0x7e/frame 0xe4766cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4766cd4 --- trap 0, eip = 0, esp = 0xe4766d20, ebp = 0 --- Tracing command geom pid 13 tid 100013 td 0xc8a2e000 sched_switch(c8a2e000,0,104,1a9,e475abbc,...) at sched_switch+0x4e2/frame 0xe475ab84 mi_switch(104,0,c11e58c5,200,c155c8bc,...) at mi_switch+0x1bf/frame 0xe475abbc sleepq_switch(c8a2e000,0,c11e58c5,276,c8a2e000,...) at sleepq_switch+0x1c5/frame 0xe475abf0 sleepq_wait(c1632c20,5c,c11ca416,0,0,...) at sleepq_wait+0x48/frame 0xe475ac14 _sleep(c1632c20,c155c8bc,25c,c11ca416,0,...) at _sleep+0x3a1/frame 0xe475ac70 g_run_events(0,e475ace8,c11d854c,3dc,0,...) at g_run_events+0x67/frame 0xe475acac fork_exit(c0ab1740,0,e475ace8) at fork_exit+0x7e/frame 0xe475acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe475acd4 --- trap 0, eip = 0, esp = 0xe475ad20, ebp = 0 --- Tracing command geom pid 13 tid 100014 td 0xc8afc000 sched_switch(c8afc000,0,104,1a9,e475dbac,...) at sched_switch+0x4e2/frame 0xe475db74 mi_switch(104,0,c11e58c5,200,c155c904,...) at mi_switch+0x1bf/frame 0xe475dbac sleepq_switch(c8afc000,0,c11e58c5,276,c8afc000,...) at sleepq_switch+0x1c5/frame 0xe475dbe0 sleepq_wait(c1632c24,5c,c11ca416,0,0,...) at sleepq_wait+0x48/frame 0xe475dc04 _sleep(c1632c24,c155c904,25c,c11ca416,0,...) at _sleep+0x3a1/frame 0xe475dc60 g_io_schedule_up(c8afc000,0,c11cc1ed,60,e475dcd4,...) at g_io_schedule_up+0x12a/frame 0xe475dc94 g_up_procbody(0,e475dce8,c11d854c,3dc,0,...) at g_up_procbody+0x9d/frame 0xe475dcac fork_exit(c0ab17e0,0,e475dce8) at fork_exit+0x7e/frame 0xe475dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe475dcd4 --- trap 0, eip = 0, esp = 0xe475dd20, ebp = 0 --- Tracing command geom pid 13 tid 100015 td 0xc8afbc40 sched_switch(c8afbc40,0,104,1a9,e4760ba8,...) at sched_switch+0x4e2/frame 0xe4760b70 mi_switch(104,0,c11e58c5,200,c155c8e4,...) at mi_switch+0x1bf/frame 0xe4760ba8 sleepq_switch(c8afbc40,0,c11e58c5,276,c8afbc40,...) at sleepq_switch+0x1c5/frame 0xe4760bdc sleepq_wait(c1632c28,5c,c11ca416,0,0,...) at sleepq_wait+0x48/frame 0xe4760c00 _sleep(c1632c28,c155c8e4,25c,c11ca416,0,...) at _sleep+0x3a1/frame 0xe4760c5c g_io_schedule_down(c8afbc40,0,c11cc1ed,6d,e4760cd4,...) at g_io_schedule_down+0x16c/frame 0xe4760c94 g_down_procbody(0,e4760ce8,c11d854c,3dc,0,...) at g_down_procbody+0x9d/frame 0xe4760cac fork_exit(c0ab1880,0,e4760ce8) at fork_exit+0x7e/frame 0xe4760cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4760cd4 --- trap 0, eip = 0, esp = 0xe4760d20, ebp = 0 --- Tracing command intr pid 12 tid 100007 td 0xc8a39310 sched_switch(c8a39310,0,109,1a9,c1634100,...) at sched_switch+0x4e2/frame 0xe4748c3c mi_switch(109,0,c11d87bd,544,8,...) at mi_switch+0x1bf/frame 0xe4748c74 ithread_loop(c8a92020,e4748ce8,c11d854c,3dc,0,...) at ithread_loop+0x1e1/frame 0xe4748cac fork_exit(c0b2a730,c8a92020,e4748ce8) at fork_exit+0x7e/frame 0xe4748cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4748cd4 --- trap 0, eip = 0, esp = 0xe4748d20, ebp = 0 --- Tracing command intr pid 12 tid 100008 td 0xc8a39000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100009 td 0xc8a2ec40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100010 td 0xc8a2e930 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100011 td 0xc8a2e620 sched_switch(c8a2e620,0,109,1a9,c1c25880,...) at sched_switch+0x4e2/frame 0xe4754c3c mi_switch(109,0,c11d87bd,544,8,...) at mi_switch+0x1bf/frame 0xe4754c74 ithread_loop(c8a91f80,e4754ce8,c11d854c,3dc,0,...) at ithread_loop+0x1e1/frame 0xe4754cac fork_exit(c0b2a730,c8a91f80,e4754ce8) at fork_exit+0x7e/frame 0xe4754cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4754cd4 --- trap 0, eip = 0, esp = 0xe4754d20, ebp = 0 --- Tracing command intr pid 12 tid 100012 td 0xc8a2e310 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100019 td 0xc8afb000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100025 td 0xc8a3ac40 sched_switch(c8a3ac40,0,109,1a9,c15ac0a8,...) at sched_switch+0x4e2/frame 0xe477ec3c mi_switch(109,0,c11d87bd,544,8,...) at mi_switch+0x1bf/frame 0xe477ec74 ithread_loop(c8a91f50,e477ece8,c11d854c,3dc,0,...) at ithread_loop+0x1e1/frame 0xe477ecac fork_exit(c0b2a730,c8a91f50,e477ece8) at fork_exit+0x7e/frame 0xe477ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe477ecd4 --- trap 0, eip = 0, esp = 0xe477ed20, ebp = 0 --- Tracing command intr pid 12 tid 100026 td 0xc8a3a930 sched_switch(c8a3a930,0,109,1a9,c16335d0,...) at sched_switch+0x4e2/frame 0xe4781c3c mi_switch(109,0,c11d87bd,544,8,...) at mi_switch+0x1bf/frame 0xe4781c74 ithread_loop(c8a91f40,e4781ce8,c11d854c,3dc,0,...) at ithread_loop+0x1e1/frame 0xe4781cac fork_exit(c0b2a730,c8a91f40,e4781ce8) at fork_exit+0x7e/frame 0xe4781cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4781cd4 --- trap 0, eip = 0, esp = 0xe4781d20, ebp = 0 --- Tracing command intr pid 12 tid 100028 td 0xc8be6620 sched_switch(c8be6620,0,109,1a9,c15ad758,...) at sched_switch+0x4e2/frame 0xe47b6c3c mi_switch(109,0,c11d87bd,544,8,...) at mi_switch+0x1bf/frame 0xe47b6c74 ithread_loop(c8a91f20,e47b6ce8,c11d854c,3dc,0,...) at ithread_loop+0x1e1/frame 0xe47b6cac fork_exit(c0b2a730,c8a91f20,e47b6ce8) at fork_exit+0x7e/frame 0xe47b6cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe47b6cd4 --- trap 0, eip = 0, esp = 0xe47b6d20, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc8be6310 sched_switch(c8be6310,0,109,1a9,c8c2e000,...) at sched_switch+0x4e2/frame 0xf0ebfc3c mi_switch(109,0,c11d87bd,544,8,...) at mi_switch+0x1bf/frame 0xf0ebfc74 ithread_loop(c8a91ef0,f0ebfce8,c11d854c,3dc,0,...) at ithread_loop+0x1e1/frame 0xf0ebfcac fork_exit(c0b2a730,c8a91ef0,f0ebfce8) at fork_exit+0x7e/frame 0xf0ebfcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf0ebfcd4 --- trap 0, eip = 0, esp = 0xf0ebfd20, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc8be6000 sched_switch(c8be6000,0,109,1a9,c1644b34,...) at sched_switch+0x4e2/frame 0xf0ec3c3c mi_switch(109,0,c11d87bd,544,8,...) at mi_switch+0x1bf/frame 0xf0ec3c74 ithread_loop(c8a91ee0,f0ec3ce8,c11d854c,3dc,0,...) at ithread_loop+0x1e1/frame 0xf0ec3cac fork_exit(c0b2a730,c8a91ee0,f0ec3ce8) at fork_exit+0x7e/frame 0xf0ec3cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf0ec3cd4 --- trap 0, eip = 0, esp = 0xf0ec3d20, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xc8be5c40 sched_switch(c8be5c40,0,109,1a9,c15ad700,...) at sched_switch+0x4e2/frame 0xed8e5c3c mi_switch(109,0,c11d87bd,544,8,...) at mi_switch+0x1bf/frame 0xed8e5c74 ithread_loop(c8a91ed0,ed8e5ce8,c11d854c,3dc,0,...) at ithread_loop+0x1e1/frame 0xed8e5cac fork_exit(c0b2a730,c8a91ed0,ed8e5ce8) at fork_exit+0x7e/frame 0xed8e5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed8e5cd4 --- trap 0, eip = 0, esp = 0xed8e5d20, ebp = 0 --- Tracing command intr pid 12 tid 100036 td 0xc8afcc40 sched_switch(c8afcc40,0,109,1a9,c15acaa0,...) at sched_switch+0x4e2/frame 0xed8f5c3c mi_switch(109,0,c11d87bd,544,8,...) at mi_switch+0x1bf/frame 0xed8f5c74 ithread_loop(c8a91ec0,ed8f5ce8,c11d854c,3dc,0,...) at ithread_loop+0x1e1/frame 0xed8f5cac fork_exit(c0b2a730,c8a91ec0,ed8f5ce8) at fork_exit+0x7e/frame 0xed8f5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed8f5cd4 --- trap 0, eip = 0, esp = 0xed8f5d20, ebp = 0 --- Tracing command intr pid 12 tid 100041 td 0xc8c93000 sched_switch(c8c93000,0,109,1a9,c15aca48,...) at sched_switch+0x4e2/frame 0xed905c3c mi_switch(109,0,c11d87bd,544,8,...) at mi_switch+0x1bf/frame 0xed905c74 ithread_loop(c8a91eb0,ed905ce8,c11d854c,3dc,0,...) at ithread_loop+0x1e1/frame 0xed905cac fork_exit(c0b2a730,c8a91eb0,ed905ce8) at fork_exit+0x7e/frame 0xed905cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed905cd4 --- trap 0, eip = 0, esp = 0xed905d20, ebp = 0 --- Tracing command intr pid 12 tid 100054 td 0xc8ca5930 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xc8ca4930 sched_switch(c8ca4930,0,109,1a9,c1644b34,...) at sched_switch+0x4e2/frame 0xed943c3c mi_switch(109,0,c11d87bd,544,8,...) at mi_switch+0x1bf/frame 0xed943c74 ithread_loop(c8a91e90,ed943ce8,c11d854c,3dc,0,...) at ithread_loop+0x1e1/frame 0xed943cac fork_exit(c0b2a730,c8a91e90,ed943ce8) at fork_exit+0x7e/frame 0xed943cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed943cd4 --- trap 0, eip = 0, esp = 0xed943d20, ebp = 0 --- Tracing command intr pid 12 tid 100060 td 0xc8ca4620 sched_switch(c8ca4620,0,109,1a9,c16335d0,...) at sched_switch+0x4e2/frame 0xed954c3c mi_switch(109,0,c11d87bd,544,8,...) at mi_switch+0x1bf/frame 0xed954c74 ithread_loop(c8a91e80,ed954ce8,c11d854c,3dc,0,...) at ithread_loop+0x1e1/frame 0xed954cac fork_exit(c0b2a730,c8a91e80,ed954ce8) at fork_exit+0x7e/frame 0xed954cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed954cd4 --- trap 0, eip = 0, esp = 0xed954d20, ebp = 0 --- Tracing command intr pid 12 tid 100062 td 0xc8ca4000 sched_switch(c8ca4000,0,109,1a9,c15ac470,...) at sched_switch+0x4e2/frame 0xed964c3c mi_switch(109,0,c11d87bd,544,8,...) at mi_switch+0x1bf/frame 0xed964c74 ithread_loop(c8a91e70,ed964ce8,c11d854c,3dc,0,...) at ithread_loop+0x1e1/frame 0xed964cac fork_exit(c0b2a730,c8a91e70,ed964ce8) at fork_exit+0x7e/frame 0xed964cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed964cd4 --- trap 0, eip = 0, esp = 0xed964d20, ebp = 0 --- Tracing command intr pid 12 tid 100063 td 0xc8c93c40 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xc8a3a000 cpustop_handler(0,13,e473bb74,c105d017,e473ba68,...) at cpustop_handler+0x25/frame 0xe473ba28 ipi_nmi_handler(e473ba68,c0b29d3e,e473ba58,8,0,...) at ipi_nmi_handler+0x36/frame 0xe473ba38 trap(e473bb80) at trap+0x37/frame 0xe473bb74 calltrap() at calltrap+0x6/frame 0xe473bb74 --- trap 0x13, eip = 0xc1045375, esp = 0xe473bbc0, ebp = 0xe473bbc0 --- acpi_cpu_c1(c1c25c90,0,c13a3113,2ec,7dca,...) at acpi_cpu_c1+0x5/frame 0xe473bbc0 acpi_cpu_idle(811ebf4,0,811ebf4,e473bc30,c107656d,...) at acpi_cpu_idle+0x166/frame 0xe473bc00 cpu_idle_acpi(811ebf4,0,1,c156c008,c156c004,...) at cpu_idle_acpi+0x3f/frame 0xe473bc14 cpu_idle(0,e473bc80,c11e18f2,a48,c156c008,...) at cpu_idle+0x9d/frame 0xe473bc30 sched_idletd(0,e473bce8,c11d854c,3dc,0,...) at sched_idletd+0x3cb/frame 0xe473bcac fork_exit(c0b89380,0,e473bce8) at fork_exit+0x7e/frame 0xe473bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe473bcd4 --- trap 0, eip = 0, esp = 0xe473bd20, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc8a39c40 cpustop_handler(1,13,e473eb74,c105d017,1,...) at cpustop_handler+0x25/frame 0xe473ea28 ipi_nmi_handler(1,0,3034d1,0,e473ea7c,...) at ipi_nmi_handler+0x36/frame 0xe473ea38 trap(e473eb80) at trap+0x37/frame 0xe473eb74 calltrap() at calltrap+0x6/frame 0xe473eb74 --- trap 0x13, eip = 0xc1045375, esp = 0xe473ebc0, ebp = 0xe473ebc0 --- acpi_cpu_c1(e472bc90,0,c13a3113,2ec,7dca,...) at acpi_cpu_c1+0x5/frame 0xe473ebc0 acpi_cpu_idle(5def46d9,0,5def46d9,e473ec30,c107656d,...) at acpi_cpu_idle+0x166/frame 0xe473ec00 cpu_idle_acpi(5def46d9,0,3,c156c708,c156c704,...) at cpu_idle_acpi+0x3f/frame 0xe473ec14 cpu_idle(0,e473ec80,c11e18f2,407,c156c708,...) at cpu_idle+0x9d/frame 0xe473ec30 sched_idletd(0,e473ece8,c11d854c,3dc,0,...) at sched_idletd+0x3cb/frame 0xe473ecac fork_exit(c0b89380,0,e473ece8) at fork_exit+0x7e/frame 0xe473ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe473ecd4 --- trap 0, eip = 0, esp = 0xe473ed20, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc8a39930 kdb_alt_break_internal(0,e4741ac8,c097ded7,2,c8cd7884,...) at kdb_alt_break_internal+0x162/frame 0xe4741a9c kdb_alt_break(2,c8cd7884,c11a75b9,c8cd7800,40000,...) at kdb_alt_break+0x16/frame 0xe4741aa8 uart_intr_rxready(c8cd7800,e472ec80,8,c13a3113,342,...) at uart_intr_rxready+0x87/frame 0xe4741ac8 uart_intr(c8cd7800,c0b462c8,c1634400,a,0,...) at uart_intr+0x100/frame 0xe4741b04 intr_event_handle(c88e2900,e4741b80,0,2,0,...) at intr_event_handle+0x7a/frame 0xe4741b30 intr_execute_handlers(c8a90108,e4741b80,2) at intr_execute_handlers+0x42/frame 0xe4741b50 lapic_handle_intr(30,e4741b80) at lapic_handle_intr+0x5d/frame 0xe4741b70 Xapic_isr1() at Xapic_isr1+0x4a/frame 0xe4741b70 --- interrupt, eip = 0xc1045375, esp = 0xe4741bc0, ebp = 0xe4741bc0 --- acpi_cpu_c1(e472ec90,0,c13a3113,2ec,7dca,...) at acpi_cpu_c1+0x5/frame 0xe4741bc0 acpi_cpu_idle(7fcf3e80,0,7fcf3e80,e4741c30,c107656d,...) at acpi_cpu_idle+0x166/frame 0xe4741c00 cpu_idle_acpi(7fcf3e80,0,4,c156ce08,c156ce04,...) at cpu_idle_acpi+0x3f/frame 0xe4741c14 cpu_idle(0,e4741c80,c11e18f2,a48,c156ce08,...) at cpu_idle+0x9d/frame 0xe4741c30 sched_idletd(0,e4741ce8,c11d854c,3dc,0,...) at sched_idletd+0x3cb/frame 0xe4741cac fork_exit(c0b89380,0,e4741ce8) at fork_exit+0x7e/frame 0xe4741cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4741cd4 --- trap 0, eip = 0, esp = 0xe4741d20, ebp = 0 --- Tracing command idle pid 11 tid 100006 td 0xc8a39620 cpustop_handler(3,13,e4744b74,c105d017,3,...) at cpustop_handler+0x25/frame 0xe4744a28 ipi_nmi_handler(3,0,409042,0,e4744a7c,...) at ipi_nmi_handler+0x36/frame 0xe4744a38 trap(e4744b80) at trap+0x37/frame 0xe4744b74 calltrap() at calltrap+0x6/frame 0xe4744b74 --- trap 0x13, eip = 0xc1045375, esp = 0xe4744bc0, ebp = 0xe4744bc0 --- acpi_cpu_c1(e4731c90,0,c13a3113,2ec,7dca,...) at acpi_cpu_c1+0x5/frame 0xe4744bc0 acpi_cpu_idle(24a92c53,0,24a92c53,e4744c30,c107656d,...) at acpi_cpu_idle+0x166/frame 0xe4744c00 cpu_idle_acpi(24a92c53,0,1,c156d508,c156d504,...) at cpu_idle_acpi+0x3f/frame 0xe4744c14 cpu_idle(0,e4744c80,c11e18f2,a48,c156d508,...) at cpu_idle+0x9d/frame 0xe4744c30 sched_idletd(0,e4744ce8,c11d854c,3dc,0,...) at sched_idletd+0x3cb/frame 0xe4744cac fork_exit(c0b89380,0,e4744ce8) at fork_exit+0x7e/frame 0xe4744cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4744cd4 --- trap 0, eip = 0, esp = 0xe4744d20, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc8a3a310 sched_switch(c8a3a310,0,104,1a9,e47379a0,...) at sched_switch+0x4e2/frame 0xe4737968 mi_switch(104,0,c11e58c5,200,c88eaf1c,...) at mi_switch+0x1bf/frame 0xe47379a0 sleepq_switch(c8a3a310,0,c11e58c5,1b6,c11e58c5,...) at sleepq_switch+0x1c5/frame 0xe47379d4 sleepq_catch_signals(c11e58c5,16d,c8a2ca78,d8,c8a3a310,...) at sleepq_catch_signals+0x382/frame 0xe4737a10 sleepq_wait_sig(c8a2c9c0,6c,c11e965d,100,0,...) at sleepq_wait_sig+0x14/frame 0xe4737a34 _sleep(c8a2c9c0,c8a2ca68,16c,c11e965d,0,...) at _sleep+0x356/frame 0xe4737a90 kern_wait6(c8a3a310,7,0,0,e4737b24,...) at kern_wait6+0x45b/frame 0xe4737af8 sys_wait4(c8a3a310,e4737ca8,c11d816d,4,df,...) at sys_wait4+0x8b/frame 0xe4737c18 syscall(e4737ce8) at syscall+0x34a/frame 0xe4737cdc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xe4737cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x80653ef, esp = 0xbfbfe904, ebp = 0xbfbfe918 --- Tracing command audit pid 10 tid 100001 td 0xc8a3a620 sched_switch(c8a3a620,0,104,1a9,e4734bbc,...) at sched_switch+0x4e2/frame 0xe4734b84 mi_switch(104,0,c11e58c5,200,c163995c,...) at mi_switch+0x1bf/frame 0xe4734bbc sleepq_switch(c8a3a620,0,c11e58c5,276,c16399d0,...) at sleepq_switch+0x1c5/frame 0xe4734bf0 sleepq_wait(c16399d0,0,e4734c44,1,0,...) at sleepq_wait+0x48/frame 0xe4734c14 _cv_wait(c16399d0,c163995c,c12128f6,18d,0,...) at _cv_wait+0x1fe/frame 0xe4734c58 audit_worker(0,e4734ce8,c11d854c,3dc,0,...) at audit_worker+0x94/frame 0xe4734cac fork_exit(c0da11b0,0,e4734ce8) at fork_exit+0x7e/frame 0xe4734cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4734cd4 --- trap 0, eip = 0, esp = 0xe4734d20, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc1632f90 sched_switch(c1632f90,0,104,1a9,c1c20c3c,...) at sched_switch+0x4e2/frame 0xc1c20c04 mi_switch(104,0,c11e58c5,200,101,...) at mi_switch+0x1bf/frame 0xc1c20c3c sleepq_switch(c1632f90,0,c11e58c5,299,c1632f90,...) at sleepq_switch+0x1c5/frame 0xc1c20c70 sleepq_timedwait(c1632c44,54,9,0,0,...) at sleepq_timedwait+0x48/frame 0xc1c20c94 _sleep(c1632c44,0,54,c121eaca,fffff470,...) at _sleep+0x33d/frame 0xc1c20cf0 swapper() at swapper+0x2c6/frame 0xc1c20d38 begin() at begin+0x22 Tracing command kernel pid 0 tid 100016 td 0xc8afb930 sched_switch(c8afb930,0,104,1a9,e4763bc0,...) at sched_switch+0x4e2/frame 0xe4763b88 mi_switch(104,0,c11e58c5,200,c857be98,...) at mi_switch+0x1bf/frame 0xe4763bc0 sleepq_switch(c8afb930,0,c11e58c5,276,c8afb930,...) at sleepq_switch+0x1c5/frame 0xe4763bf4 sleepq_wait(c857be80,0,c11ca416,0,0,...) at sleepq_wait+0x48/frame 0xe4763c18 _sleep(c857be80,c857be98,0,c11ca416,0,...) at _sleep+0x3a1/frame 0xe4763c74 taskqueue_thread_loop(c157a0c4,e4763ce8,c11d854c,3dc,0,...) at taskqueue_thread_loop+0x144/frame 0xe4763cac fork_exit(c0bb1680,c157a0c4,e4763ce8) at fork_exit+0x7e/frame 0xe4763cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4763cd4 --- trap 0, eip = 0, esp = 0xe4763d20, ebp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xc8afb310 sched_switch(c8afb310,0,104,1a9,e4769bc0,...) at sched_switch+0x4e2/frame 0xe4769b88 mi_switch(104,0,c11e58c5,200,c857bb98,...) at mi_switch+0x1bf/frame 0xe4769bc0 sleepq_switch(c8afb310,0,c11e58c5,276,c8afb310,...) at sleepq_switch+0x1c5/frame 0xe4769bf4 sleepq_wait(c857bb80,0,c11ca416,0,0,...) at sleepq_wait+0x48/frame 0xe4769c18 _sleep(c857bb80,c857bb98,0,c11ca416,0,...) at _sleep+0x3a1/frame 0xe4769c74 taskqueue_thread_loop(c1637310,e4769ce8,c11d854c,3dc,0,...) at taskqueue_thread_loop+0x144/frame 0xe4769cac fork_exit(c0bb1680,c1637310,e4769ce8) at fork_exit+0x7e/frame 0xe4769cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4769cd4 --- trap 0, eip = 0, esp = 0xe4769d20, ebp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xc8afac40 sched_switch(c8afac40,0,104,1a9,e476fbc0,...) at sched_switch+0x4e2/frame 0xe476fb88 mi_switch(104,0,c11e58c5,200,c857ba98,...) at mi_switch+0x1bf/frame 0xe476fbc0 sleepq_switch(c8afac40,0,c11e58c5,276,c8afac40,...) at sleepq_switch+0x1c5/frame 0xe476fbf4 sleepq_wait(c857ba80,0,c11ca416,0,0,...) at sleepq_wait+0x48/frame 0xe476fc18 _sleep(c857ba80,c857ba98,0,c11ca416,0,...) at _sleep+0x3a1/frame 0xe476fc74 taskqueue_thread_loop(c1633498,e476fce8,c11d854c,3dc,0,...) at taskqueue_thread_loop+0x144/frame 0xe476fcac fork_exit(c0bb1680,c1633498,e476fce8) at fork_exit+0x7e/frame 0xe476fcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe476fcd4 --- trap 0, eip = 0, esp = 0xe476fd20, ebp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xc8afa930 sched_switch(c8afa930,0,104,1a9,e4772bd4,...) at sched_switch+0x4e2/frame 0xe4772b9c mi_switch(104,0,c11e58c5,200,c157bb7c,...) at mi_switch+0x1bf/frame 0xe4772bd4 sleepq_switch(c8afa930,0,c11e58c5,276,c857ba00,...) at sleepq_switch+0x1c5/frame 0xe4772c08 sleepq_wait(c857ba00,0,c11dfc4a,c11ca416,0,...) at sleepq_wait+0x48/frame 0xe4772c2c msleep_spin_sbt(c857ba00,c857ba18,c11ca416,0,0,...) at msleep_spin_sbt+0x241/frame 0xe4772c74 taskqueue_thread_loop(c1629f78,e4772ce8,c11d854c,3dc,0,...) at taskqueue_thread_loop+0xf3/frame 0xe4772cac fork_exit(c0bb1680,c1629f78,e4772ce8) at fork_exit+0x7e/frame 0xe4772cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4772cd4 --- trap 0, eip = 0, esp = 0xe4772d20, ebp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xc8afa620 sched_switch(c8afa620,0,104,1a9,e4775bd4,...) at sched_switch+0x4e2/frame 0xe4775b9c mi_switch(104,0,c11e58c5,200,c157bb7c,...) at mi_switch+0x1bf/frame 0xe4775bd4 sleepq_switch(c8afa620,0,c11e58c5,276,c857ba00,...) at sleepq_switch+0x1c5/frame 0xe4775c08 sleepq_wait(c857ba00,0,c11dfc4a,c11ca416,0,...) at sleepq_wait+0x48/frame 0xe4775c2c msleep_spin_sbt(c857ba00,c857ba18,c11ca416,0,0,...) at msleep_spin_sbt+0x241/frame 0xe4775c74 taskqueue_thread_loop(c1629f78,e4775ce8,c11d854c,3dc,0,...) at taskqueue_thread_loop+0xf3/frame 0xe4775cac fork_exit(c0bb1680,c1629f78,e4775ce8) at fork_exit+0x7e/frame 0xe4775cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4775cd4 --- trap 0, eip = 0, esp = 0xe4775d20, ebp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xc8afa310 sched_switch(c8afa310,0,104,1a9,e4778bd4,...) at sched_switch+0x4e2/frame 0xe4778b9c mi_switch(104,0,c11e58c5,200,c157bb7c,...) at mi_switch+0x1bf/frame 0xe4778bd4 sleepq_switch(c8afa310,0,c11e58c5,276,c857ba00,...) at sleepq_switch+0x1c5/frame 0xe4778c08 sleepq_wait(c857ba00,0,c11dfc4a,c11ca416,0,...) at sleepq_wait+0x48/frame 0xe4778c2c msleep_spin_sbt(c857ba00,c857ba18,c11ca416,0,0,...) at msleep_spin_sbt+0x241/frame 0xe4778c74 taskqueue_thread_loop(c1629f78,e4778ce8,c11d854c,3dc,0,...) at taskqueue_thread_loop+0xf3/frame 0xe4778cac fork_exit(c0bb1680,c1629f78,e4778ce8) at fork_exit+0x7e/frame 0xe4778cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4778cd4 --- trap 0, eip = 0, esp = 0xe4778d20, ebp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xc8be6930 sched_switch(c8be6930,0,104,1a9,e4784bc0,...) at sched_switch+0x4e2/frame 0xe4784b88 mi_switch(104,0,c11e58c5,200,c857b818,...) at mi_switch+0x1bf/frame 0xe4784bc0 sleepq_switch(c8be6930,0,c11e58c5,276,c8be6930,...) at sleepq_switch+0x1c5/frame 0xe4784bf4 sleepq_wait(c857b800,0,c11ca416,0,0,...) at sleepq_wait+0x48/frame 0xe4784c18 _sleep(c857b800,c857b818,0,c11ca416,0,...) at _sleep+0x3a1/frame 0xe4784c74 taskqueue_thread_loop(c1639a04,e4784ce8,c11d854c,3dc,0,...) at taskqueue_thread_loop+0x144/frame 0xe4784cac fork_exit(c0bb1680,c1639a04,e4784ce8) at fork_exit+0x7e/frame 0xe4784cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4784cd4 --- trap 0, eip = 0, esp = 0xe4784d20, ebp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xc8c93930 sched_switch(c8c93930,0,104,1a9,ed96abd4,...) at sched_switch+0x4e2/frame 0xed96ab9c mi_switch(104,0,c11e58c5,200,c157bb34,...) at mi_switch+0x1bf/frame 0xed96abd4 sleepq_switch(c8c93930,0,c11e58c5,276,c8cf3780,...) at sleepq_switch+0x1c5/frame 0xed96ac08 sleepq_wait(c8cf3780,0,c11dfc4a,c11ca416,0,...) at sleepq_wait+0x48/frame 0xed96ac2c msleep_spin_sbt(c8cf3780,c8cf3798,c11ca416,0,0,...) at msleep_spin_sbt+0x241/frame 0xed96ac74 taskqueue_thread_loop(c1628414,ed96ace8,c11d854c,3dc,0,...) at taskqueue_thread_loop+0xf3/frame 0xed96acac fork_exit(c0bb1680,c1628414,ed96ace8) at fork_exit+0x7e/frame 0xed96acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed96acd4 --- trap 0, eip = 0, esp = 0xed96ad20, ebp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xc8c93620 sched_switch(c8c93620,0,104,1a9,ed96db80,...) at sched_switch+0x4e2/frame 0xed96db48 mi_switch(104,0,c11e58c5,200,101,...) at mi_switch+0x1bf/frame 0xed96db80 sleepq_switch(c8c93620,0,c11e58c5,299,c8c93620,...) at sleepq_switch+0x1c5/frame 0xed96dbb4 sleepq_timedwait(c155ec4d,0,2,0,0,...) at sleepq_timedwait+0x48/frame 0xed96dbd8 _sleep(c155ec4d,0,0,c11ca416,fffffc88,...) at _sleep+0x33d/frame 0xed96dc34 pause_sbt(c11ca416,fffffc88,2,0,0,...) at pause_sbt+0x112/frame 0xed96dc70 deadlkres(0,ed96dce8,c11d854c,3dc,0,...) at deadlkres+0x81/frame 0xed96dcac fork_exit(c0b055c0,0,ed96dce8) at fork_exit+0x7e/frame 0xed96dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed96dcd4 --- trap 0, eip = 0, esp = 0xed96dd20, ebp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xc8efd310 sched_switch(c8efd310,0,104,1a9,ed974bc0,...) at sched_switch+0x4e2/frame 0xed974b88 mi_switch(104,0,c11e58c5,200,c857b998,...) at mi_switch+0x1bf/frame 0xed974bc0 sleepq_switch(c8efd310,0,c11e58c5,276,c8efd310,...) at sleepq_switch+0x1c5/frame 0xed974bf4 sleepq_wait(c857b980,0,c11ca416,0,0,...) at sleepq_wait+0x48/frame 0xed974c18 _sleep(c857b980,c857b998,0,c11ca416,0,...) at _sleep+0x3a1/frame 0xed974c74 taskqueue_thread_loop(c1495d24,ed974ce8,c11d854c,3dc,0,...) at taskqueue_thread_loop+0x144/frame 0xed974cac fork_exit(c0bb1680,c1495d24,ed974ce8) at fork_exit+0x7e/frame 0xed974cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xed974cd4 --- trap 0, eip = 0, esp = 0xed974d20, ebp = 0 --- db:0:allt> call doadump Physical memory: 3431 MB Dumping 257 MB: 242 226 210 194 178 162 146 130 114 98 82 66 50 34 18 2 Dump complete = 0 db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 2 (kgdb) proc 77767 [Switching to thread 171 (Thread 104066)]#0 sched_switch (td=0xcc138000, newtd=, flags=) at ../../../kern/sched_ule.c:1956 1956 cpuid = PCPU_GET(cpuid); Current language: auto; currently minimal (kgdb) bt #0 sched_switch (td=0xcc138000, newtd=, flags=) at ../../../kern/sched_ule.c:1956 #1 0xc0b676ef in mi_switch (flags=, newtd=0xc156bf90) at ../../../kern/kern_synch.c:472 #2 0xc0bad305 in sleepq_switch (wchan=, pri=0x0) at ../../../kern/subr_sleepqueue.c:552 #3 0xc0bad0e8 in sleepq_wait (wchan=0xc157d580, pri=0x0) at ../../../kern/subr_sleepqueue.c:631 #4 0xc0b05e6e in _cv_wait (cvp=0xc157d580, lock=0xc157d500) at ../../../kern/kern_condvar.c:139 #5 0xc0bb925f in vmem_xalloc (vm=0xc157d500, size0=0x5ca000, align=, phase=0xc1fb7110, nocross=, minaddr=0xc1455bf0, maxaddr=0xcc138000, flags=0x2002, addrp=) at ../../../kern/subr_vmem.c:1211 #6 0xc0bb9014 in vmem_alloc (vm=0xc157d500, size=0x5ca000, flags=0x2002, addrp=) at ../../../kern/subr_vmem.c:1097 #7 0xc0e1b43b in kmem_malloc (vmem=0xc157d500, size=0x5ca000, flags=0x102) at ../../../vm/vm_kern.c:315 #8 0xc0e132f0 in uma_large_malloc (size=, wait=0x102) at ../../../vm/uma_core.c:1105 #9 0xc0b41667 in malloc (size=0x5ca000, mtp=, flags=) at ../../../kern/kern_malloc.c:511 #10 0xc0b140be in fdgrowtable (fdp=0xdb408a5c, nfd=) at ../../../kern/kern_descrip.c:1553 #11 0xc0b109d7 in do_dup (td=0xcc138000, flags=0x1, old=, new=) at ../../../kern/kern_descrip.c:1509 #12 0xc0b107c2 in sys_dup2 (td=0xcc138000, uap=0xfa5f9ca8) at ../../../kern/kern_descrip.c:364 #13 0xc105e57a in syscall (frame=) at subr_syscall.c:133 #14 0xc10497f1 in Xint0x80_syscall () at ../../../i386/i386/exception.s:269 #15 0x00000033 in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb) f 5 #5 0xc0bb925f in vmem_xalloc (vm=0xc157d500, size0=0x5ca000, align=, phase=0xc1fb7110, nocross=, minaddr=0xc1455bf0, maxaddr=0xcc138000, flags=0x2002, addrp=) at ../../../kern/subr_vmem.c:1211 1211 VMEM_CONDVAR_WAIT(vm); (kgdb) p *vm $1 = {vm_lock = {lock_object = {lo_name = 0xc11db399 "kmem arena", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc8584428}, mtx_lock = 0x4}, vm_cv = {cv_description = 0xc11db399 "kmem arena", cv_waiters = 0x1}, vm_name = 0xc157d588 "kmem arena", vm_alllist = {le_next = 0xc157d100, le_prev = 0xc157d99c}, vm_hash0 = 0xc157d5a4, vm_freelist = 0xc157d5e4, vm_seglist = {tqh_first = 0xc1fb31c0, tqh_last = 0xcfff65b0}, vm_hashlist = 0xd720b000, vm_hashsize = 0x8000, vm_qcache_max = 0x0, vm_quantum_mask = 0xfff, vm_import_quantum = 0x0, vm_quantum_shift = 0xc, vm_freetags = {lh_first = 0xdd16e230}, vm_nfreetags = 0x20, vm_nbusytag = 0x44e1, vm_inuse = 0x5400000, vm_size = 0x19c00000, vm_importfn = 0, vm_releasefn = 0, vm_arg = 0x0, vm_reclaimfn = 0xc0b41cd0 , vm_qcache = 0xc157d710} (kgdb) printf "pho %d %d %d\n", pho1, pho2, pho3 pho 181973 0 668 (kgdb) $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/kern/kern_malloc.c =================================================================== --- /usr/src/sys/kern/kern_malloc.c (revision 282366) +++ /usr/src/sys/kern/kern_malloc.c (working copy) @@ -665,13 +665,15 @@ reallocf(void *addr, unsigned long size, struct ma } /* - * Wake the page daemon when we exhaust KVA. It will call the lowmem handler - * and uma_reclaim() callbacks in a context that is safe. + * Wake the uma reclamation pagedaemon thread when we exhaust KVA. It + * will call the lowmem handler and uma_reclaim() callbacks in a + * context that is safe. */ static void kmem_reclaim(vmem_t *vm, int flags) { + uma_reclaim_wakeup(); pagedaemon_wakeup(); } Index: /usr/src/sys/vm/uma.h =================================================================== --- /usr/src/sys/vm/uma.h (revision 282366) +++ /usr/src/sys/vm/uma.h (working copy) @@ -690,4 +690,7 @@ struct uma_percpu_stat { uint64_t _ups_reserved[5]; /* Reserved. */ }; +void uma_reclaim_wakeup(void); +void uma_reclaim_worker(void *); + #endif /* _VM_UMA_H_ */ Index: /usr/src/sys/vm/uma_core.c =================================================================== --- /usr/src/sys/vm/uma_core.c (revision 282366) +++ /usr/src/sys/vm/uma_core.c (working copy) @@ -3221,17 +3221,21 @@ uma_find_refcnt(uma_zone_t zone, void *item) return refcnt; } +int pho1, pho2, pho3; + /* See uma.h */ -void -uma_reclaim(void) +static void +uma_reclaim_locked(bool kmem_danger) { + #ifdef UMA_DEBUG printf("UMA: vm asked us to release pages!\n"); #endif - sx_xlock(&uma_drain_lock); + sx_assert(&uma_drain_lock, SA_XLOCKED); bucket_enable(); zone_foreach(zone_drain); - if (vm_page_count_min()) { + if (vm_page_count_min() || kmem_danger) { + pho3++; cache_drain_safe(NULL); zone_foreach(zone_drain); } @@ -3243,9 +3247,45 @@ uma_find_refcnt(uma_zone_t zone, void *item) zone_drain(slabzone); zone_drain(slabrefzone); bucket_zone_drain(); +} + +void +uma_reclaim(void) +{ + + sx_xlock(&uma_drain_lock); + uma_reclaim_locked(false); sx_xunlock(&uma_drain_lock); + pho2++; } +static int uma_reclaim_needed; + +void +uma_reclaim_wakeup(void) +{ + + uma_reclaim_needed = 1; + wakeup(&uma_reclaim_needed); + pho1++; +} + +void +uma_reclaim_worker(void *arg __unused) +{ + + sx_xlock(&uma_drain_lock); + for (;;) { + sx_sleep(&uma_reclaim_needed, &uma_drain_lock, PVM, + "umarcl", 0); + if (uma_reclaim_needed) { + uma_reclaim_needed = 0; + uma_reclaim_locked(true); + } + pho1++; + } +} + /* See uma.h */ int uma_zone_exhausted(uma_zone_t zone) Index: /usr/src/sys/vm/vm_pageout.c =================================================================== --- /usr/src/sys/vm/vm_pageout.c (revision 282366) +++ /usr/src/sys/vm/vm_pageout.c (working copy) @@ -1724,8 +1724,9 @@ vm_pageout_init(void) static void vm_pageout(void) { + int error; #if MAXMEMDOM > 1 - int error, i; + int i; #endif swap_pager_swap_init(); @@ -1739,6 +1740,10 @@ vm_pageout(void) } } #endif + error = kthread_add(uma_reclaim_worker, NULL, curproc, NULL, + 0, 0, "uma"); + if (error != 0) + panic("starting uma_reclaim helper, error %d\n", error); vm_pageout_worker((void *)(uintptr_t)0); }