GENERIC HEAD from 2013-02-14 15:17:53 UTC, r246798M, vmcore.536 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb SMAP type=01 base=0000000000000000 len=000000000009fc00 SMAP type=02 base=000000000009fc00 len=0000000000000400 SMAP type=02 base=00000000000e4000 len=000000000001c000 SMAP type=01 base=0000000000100000 len=00000000d7ed0000 SMAP type=03 base=00000000d7fd0000 len=000000000000e000 SMAP type=04 base=00000000d7fde000 len=0000000000022000 SMAP type=02 base=00000000fff00000 len=0000000000100000 SMAP type=01 base=0000000100000000 len=0000000120000000 4718592K of memory above 4GB ignored MP Configuration Table version 1.4 found at 0xc00fc630 Table 'FACP' at 0xd7fd0200 Table 'APIC' at 0xd7fd0390 APIC: Found table at 0xd7fd0390 APIC: Using the MADT enumerator. MADT: Found CPU APIC ID 0 ACPI ID 1: enabled SMP: Added CPU 0 (AP) MADT: Found CPU APIC ID 1 ACPI ID 2: enabled SMP: Added CPU 1 (AP) MADT: Found CPU APIC ID 2 ACPI ID 3: enabled SMP: Added CPU 2 (AP) MADT: Found CPU APIC ID 3 ACPI ID 4: enabled SMP: Added CPU 3 (AP) Copyright (c) 1992-2013 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #1 r246798M: Thu Feb 14 19:12:09 CET 2013 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 FreeBSD clang version 3.2 (tags/RELEASE_32/final 170710) 20121221 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Preloaded elf kernel "/boot/kernel/kernel" at 0xc16c2000. Calibrating TSC clock ... TSC clock: 1800029606 Hz CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.03-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 0x10 Model = 0x2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant Data TLB: 48 entries, fully associative Instruction TLB: 32 entries, fully associative L1 data cache: 64 kbytes, 64 bytes/line, 1 lines/tag, 2-way associative L1 instruction cache: 64 kbytes, 64 bytes/line, 1 lines/tag, 2-way associative L2 internal cache: 512 kbytes, 64 bytes/line, 1 lines/tag, 8-way associative real memory = 8589934592 (8192 MB) Physical memory chunk(s): 0x0000000000001000 - 0x000000000009efff, 647168 bytes (158 pages) 0x0000000000100000 - 0x00000000003fffff, 3145728 bytes (768 pages) 0x0000000001826000 - 0x00000000d4954fff, 3541233664 bytes (864559 pages) avail memory = 3495530496 (3333 MB) : Trying to mount root from ufs:/dev/ad4s1a [rw]... start_init: trying /sbin/init Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/ad4s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1a: clean, 702410 free (1458 frags, 87619 blocks, 0.1% fragmentation) /dev/ad4s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1f: clean, 115212 free (5332 frags, 13735 blocks, 0.5% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 30169307 free (8579 frags, 3770091 blocks, 0.0% fragmentation) /dev/ad4s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1d: clean, 2414071 free (193583 frags, 277561 blocks, 1.9% fragmentation) /dev/ad4s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1e: clean, 12288815 free (77031 frags, 1526473 blocks, 0.3% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN Starting Network: lo0 re0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 scopeid 0x1 nd6 options=29 media: Ethernet autoselect (100baseTX ) status: active Starting devd. add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/kde4/lib /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/gcc46 /usr/local/lib/mysql /usr/local/lib/nss /usr/local/lib/pth /usr/local/lib/qt4 /usr/local/lib/virtualbox a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. savecore: couldn't find media and/or sector size of /var/crash: Inappropriate ioctl for device Feb 14 19:23:31 x4 savecore: couldn't find media and/or sector size of /var/crash: Inappropriate ioctl for device No core dumps found. Additional ABI support: linuxLinux ELF exec handler installed . Starting rpcbind. NFS access cache time=60 lock order reversal: 1st 0xe111e1c0 bufwait (bufwait) @ kern/vfs_bio.c:2631 2nd 0xca121c00 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper(c10829d8,e111e160,f36427f0,c0a7ca87,ccc10660,...) at db_trace_self_wrapper+0x2d/frame 0xf36427b0 kdb_backtrace(c1085a82,ca121c00,c10b7591,c9eaa610,c10b71d6,...) at kdb_backtrace+0x30/frame 0xf3642818 witness_checkorder(ca121c00,9,c10b71cd,11c,0,...) at witness_checkorder+0xbad/frame 0xf3642868 _sx_xlock(ca121c00,0,c10b71cd,11c,cc7d2000,...) at _sx_xlock+0x75/frame 0xf3642898 ufsdirhash_add(cc88be80,f3642990,376c,f3642918,f364291c,...) at ufsdirhash_add+0x4a/frame 0xf36428c8 ufs_direnter(ccc105a0,ccea79d8,f3642990,f3642b68,e1121d80,...) at ufs_direnter+0x63b/frame 0xf3642948 ufs_mkdir(f3642c00,c10dc7d9,ccc105a0,f3642bfc,0,...) at ufs_mkdir+0x884/frame 0xf3642ae4 VOP_MKDIR_APV(c11dd470,f3642c00,f3642b68,f3642b90,28803020,...) at VOP_MKDIR_APV+0x103/frame 0xf3642b10 kern_mkdirat(cc860bc0,ffffff9c,28803020,0,1c0) at kern_mkdirat+0x1ef/frame 0xf3642c24 sys_mkdir(cc860bc0,f3642cc8,f3642d08,1,1,...) at sys_mkdir+0x31/frame 0xf3642c40 syscall(f3642d08) at syscall+0x2ed/frame 0xf3642cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3642cfc --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x28168593, esp = 0xbfbfd92c, ebp = 0xbfbfddd0 --- Clearing /tmp (X related). Starting mountd. Starting nfsuserd. Starting nfsd. Recovering vi editor sessions:lock order reversal: 1st 0xcd010cdc ufs (ufs) @ kern/vfs_lookup.c:516 2nd 0xe1126be0 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:261 3rd 0xcd010a0c ufs (ufs) @ kern/vfs_subr.c:2176 KDB: stack backtrace: db_trace_self_wrapper(c10829d8,0,0,0,0,...) at db_trace_self_wrapper+0x2d/frame 0xf36be2c0 kdb_backtrace(c1085a9b,cd010a0c,c106dfdc,c9eaa5a8,c108ebc4,...) at kdb_backtrace+0x30/frame 0xf36be328 witness_checkorder(cd010a0c,9,c108ebbb,880,cd010a78,...) at witness_checkorder+0xbad/frame 0xf36be378 __lockmgr_args(cd010a0c,80100,cd010a78,0,0,...) at __lockmgr_args+0x87c/frame 0xf36be458 ffs_lock(f36be4d8,c9ea8a70,c9ea31e0,c9ea8a70,c1376820,...) at ffs_lock+0xad/frame 0xf36be498 VOP_LOCK1_APV(c11dd470,f36be4d8,c11b2dc4,200246,c11f1c80,...) at VOP_LOCK1_APV+0xe5/frame 0xf36be4c0 _vn_lock(cd0109d8,80100,c108ebbb,880,c108de31,...) at _vn_lock+0xca/frame 0xf36be500 vget(cd0109d8,80100,cb6332f0,57,0,...) at vget+0x77/frame 0xf36be538 vfs_hash_get(cc82cbb0,15ee4b,80000,cb6332f0,f36be618,...) at vfs_hash_get+0xff/frame 0xf36be564 ffs_vgetf(cc82cbb0,15ee4b,80000,f36be618,1,...) at ffs_vgetf+0x47/frame 0xf36be5c0 softdep_sync_buf(cd010ca8,e1126b80,1,107,0,...) at softdep_sync_buf+0x977/frame 0xf36be628 ffs_syncvnode(cd010ca8,1,0,f36be6e4,c0adcb1f,...) at ffs_syncvnode+0x2a3/frame 0xf36be680 ffs_truncate(cd010ca8,200,0,880,cc826380,...) at ffs_truncate+0x6c8/frame 0xf36be838 ufs_direnter(cd010ca8,cd0109d8,f36be8f8,f36bebc8,0,...) at ufs_direnter+0x7ed/frame 0xf36be8b8 ufs_makeinode(f36bebb4,f36bebc8) at ufs_makeinode+0x537/frame 0xf36bea30 ufs_create(f36beb18,c10dc1c7,cc82cbc0,2,2,...) at ufs_create+0x2f/frame 0xf36bea44 VOP_CREATE_APV(c11dd470,f36beb18,f36bebc8,f36beaa8,c11f1df0,...) at VOP_CREATE_APV+0x103/frame 0xf36bea70 vn_open_cred(f36beb88,f36bebfc,1b0,0,cc826380,cc8a57a8) at vn_open_cred+0x2cf/frame 0xf36beb40 vn_open(f36beb88,f36bebfc,1b0,cc8a57a8,0,...) at vn_open+0x3b/frame 0xf36beb60 kern_openat(cb6332f0,ffffff9c,28c57f60,0,a02,1b0) at kern_openat+0x1da/frame 0xf36bec20 sys_open(cb6332f0,f36becc8,f36bed08,1,1,...) at sys_open+0x38/frame 0xf36bec40 syscall(f36bed08) at syscall+0x2ed/frame 0xf36becfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf36becfc --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x28405867, esp = 0xbfbfb50c, ebp = 0xbfbfb598 --- . Updating motd:. Starting ntpd. Removing stale Samba tdb files: ....... done Starting nmbd. Starting smbd. Starting winbindd. Starting default moused. Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Local package initialization: backuplock order reversal: 1st 0xcc88ccdc ufs (ufs) @ kern/vfs_mount.c:1236 2nd 0xcc8ae19c devfs (devfs) @ ufs/ffs/ffs_softdep.c:1866 KDB: stack backtrace: db_trace_self_wrapper(c10829d8,0,33,c106dfdc,c9ea3998,...) at db_trace_self_wrapper+0x2d/frame 0xf3668850 kdb_backtrace(c1085a82,cc8ae19c,c1079afd,c9eaa408,c10b38c7,...) at kdb_backtrace+0x30/frame 0xf36688b8 witness_checkorder(cc8ae19c,9,c10b38be,74a,cc8ae208,...) at witness_checkorder+0xbad/frame 0xf3668908 __lockmgr_args(cc8ae19c,80400,cc8ae208,0,0,0,c10b38be,74a) at __lockmgr_args+0x87c/frame 0xf36689e8 vop_stdlock(f3668a58,f3668a54,c0a7ca87,c13a6934,8,...) at vop_stdlock+0x53/frame 0xf3668a18 VOP_LOCK1_APV(c11a32a0,f3668a58,4,f3668a80,c11f1c80,...) at VOP_LOCK1_APV+0xe5/frame 0xf3668a40 _vn_lock(cc8ae168,80400,c10b38be,74a,f3668ac0,...) at _vn_lock+0xca/frame 0xf3668a80 softdep_flushworklist(ccbfb2ec,f3668b14,cc90bbc0,61a,0,...) at softdep_flushworklist+0x6e/frame 0xf3668ac0 ffs_sync(ccbfb2ec,1,f3668b70,50e,c9f50580,...) at ffs_sync+0x2e5/frame 0xf3668b48 dounmount(ccbfb2ec,8080000,cc90bbc0,493,0,...) at dounmount+0x38a/frame 0xf3668b98 sys_unmount(cc90bbc0,f3668cc8,f3668d08,1,1,...) at sys_unmount+0x3dd/frame 0xf3668c40 syscall(f3668d08) at syscall+0x2ed/frame 0xf3668cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3668cfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c0ee7, esp = 0xbfbfd6a4, ebp = 0xbfbfd770 --- ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 58088 files, 88144674 used, 30169307 free (8579 frags, 3770091 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 58088 files, 88144674 used, 30169307 free (8579 frags, 3770091 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmp watchdogd. Starting inetd. Thu Feb 14 19:28:14 CET 2013 FreeBSD/i386 (x4.osted.lan) (console) login: lock order reversal: 1st 0xccc1019c syncer (syncer) @ kern/vfs_subr.c:1795 2nd 0xcd0a046c ufs (ufs) @ kern/vfs_subr.c:2176 KDB: stack backtrace: db_trace_self_wrapper(c10829d8,0,0,f,0,...) at db_trace_self_wrapper+0x2d/frame 0xee118940 kdb_backtrace(c1085a82,cd0a046c,c106dfdc,c9eaa5a8,c108ebc4,...) at kdb_backtrace+0x30/frame 0xee1189a8 witness_checkorder(cd0a046c,9,c108ebbb,880,cd0a04d8,...) at witness_checkorder+0xbad/frame 0xee1189f8 __lockmgr_args(cd0a046c,80500,cd0a04d8,0,0,...) at __lockmgr_args+0x87c/frame 0xee118ad8 ffs_lock(ee118b58,246,c9ea8798,c9eaa678,c1377060,...) at ffs_lock+0xad/frame 0xee118b18 VOP_LOCK1_APV(c11dd470,ee118b58,246,c13a2788,c11f1c80,...) at VOP_LOCK1_APV+0xe5/frame 0xee118b40 _vn_lock(cd0a0438,80500,c108ebbb,880,ee118be0,...) at _vn_lock+0xca/frame 0xee118b80 vget(cd0a0438,80500,cb631000,12bb,ccbfb010,...) at vget+0x77/frame 0xee118bb8 vfs_msync(ccbfb000,2,2,e7a,0,...) at vfs_msync+0xa0/frame 0xee118c00 sync_fsync(ee118ca8,c10dc6b4,c108ebbb,703,713,...) at sync_fsync+0x12c/frame 0xee118c2c VOP_FSYNC_APV(c11bd820,ee118ca8,c108ebbb,703,4e20,...) at VOP_FSYNC_APV+0x103/frame 0xee118c58 sched_sync(0,ee118d08,c1078230,3d7,0,...) at sched_sync+0x38f/frame 0xee118ccc fork_exit(c0b364d0,0,ee118d08) at fork_exit+0x7f/frame 0xee118cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee118cf4 --- trap 0, eip = 0, esp = 0xee118d40, ebp = 0 --- Feb 14 19:55:55 x4 su: pho to root on /dev/pts/0 20130214 19:56:16 all: nfs5.sh lock order reversal: 1st 0xe135e120 bufwait (bufwait) @ kern/vfs_bio.c:1898 2nd 0xcfad6e20 so_snd_sx (so_snd_sx) @ kern/uipc_sockbuf.c:148 KDB: stack backtrace: db_trace_self_wrapper(c10829d8,cdca45e0,c9ea6440,f38a6324,c0e8c890,...) at db_trace_self_wrapper+0x2d/frame 0xf38a62c0 kdb_backtrace(c1085a82,cfad6e20,c1075fdd,c9eaa748,c108ac63,...) at kdb_backtrace+0x30/frame 0xf38a6324 witness_checkorder(cfad6e20,9,c108ac5a,94,0,...) at witness_checkorder+0xbad/frame 0xf38a6374 _sx_xlock(cfad6e20,40,c108ac5a,94,0,...) at _sx_xlock+0x75/frame 0xf38a63a4 sblock(cfad6de8,1,cf70d100,c13747e4,c13747d0,...) at sblock+0xa3/frame 0xf38a63c0 sosend_generic(cfad6d00,0,0,cf70d100,0,...) at sosend_generic+0xb6/frame 0xf38a6430 clnt_vc_call(cc7db5a0,f38a65c8,10,cccd5400,f38a6720,...) at clnt_vc_call+0x45a/frame 0xf38a64f8 clnt_reconnect_call(cc7db5e0,f38a65c8,10,cccd5400,f38a6720,...) at clnt_reconnect_call+0x53a/frame 0xf38a6558 newnfs_request(f38a6720,cc7aa600,0,cc7aa710,d0534168,cdca45e0,cea4f600,186a3,3,0,1,0,0) at newnfs_request+0x77b/frame 0xf38a6618 nfscl_request(f38a6720,d0534168,cdca45e0,cea4f600,0,...) at nfscl_request+0x8c/frame 0xf38a6660 nfsrpc_readdir(d0534168,f38a6970,f38a6890,cea4f600,cdca45e0,...) at nfsrpc_readdir+0x352/frame 0xf38a6858 ncl_readdirrpc(d0534168,f38a6970,cea4f600,cdca45e0,c108bf90,...) at ncl_readdirrpc+0x10f/frame 0xf38a6938 ncl_doio(d0534168,e135e0c0,cea4f600,cdca45e0,0,...) at ncl_doio+0x144/frame 0xf38a69b0 ncl_bioread(d0534168,f38a6bb8,0,cea4f600,d0534168,...) at ncl_bioread+0x69b/frame 0xf38a6aa0 nfs_readdir(f38a6be0,c10dc8c8,c10902d4,fac,0,...) at nfs_readdir+0x19c/frame 0xf38a6b4c VOP_READDIR_APV(c11a46c4,f38a6be0,c10902d4,fac,f38a6bdc,...) at VOP_READDIR_APV+0x103/frame 0xf38a6b78 kern_getdirentries(cdca45e0,5,2888c000,1000,f38a6c34,...) at kern_getdirentries+0x19e/frame 0xf38a6c10 sys_getdirentries(cdca45e0,f38a6cc8,f38a6d08,1,1,...) at sys_getdirentries+0x41/frame 0xf38a6c40 syscall(f38a6d08) at syscall+0x2ed/frame 0xf38a6cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf38a6cfc --- syscall (196, FreeBSD ELF32, sys_getdirentries), eip = 0x280dfb9b, esp = 0xbfbfd7c4, ebp = 0xbfbfd7f4 --- Feb 14 19:56:34 x4 kernel: pid 598 (nfsd), uid 0 inumber 695 on /mnt: filesystem full 20130214 19:57:27 all: suj16.sh lock order reversal: 1st 0xcdcb082c filedesc structure (filedesc structure) @ kern/kern_descrip.c:840 2nd 0xccc2573c ufs (ufs) @ kern/vfs_subr.c:4401 KDB: stack backtrace: db_trace_self_wrapper(c10829d8,63736564,2e706972,34383a63,a30,...) at db_trace_self_wrapper+0x2d/frame 0xf378e8f0 kdb_backtrace(c1085a82,ccc2573c,c106dfdc,c9eaa5a8,c108ebc4,...) at kdb_backtrace+0x30/frame 0xf378e958 witness_checkorder(ccc2573c,9,c108ebbb,1131,ccc257a8,...) at witness_checkorder+0xbad/frame 0xf378e9a8 __lockmgr_args(ccc2573c,80400,ccc257a8,0,0,...) at __lockmgr_args+0x87c/frame 0xf378ea88 ffs_lock(f378eb08,c11b2dc4,c0b1f218,ccc2573c,f378eb08,...) at ffs_lock+0xad/frame 0xf378eac8 VOP_LOCK1_APV(c11dd470,f378eb08,ccc25708,cdccb01c,c11f1c80,...) at VOP_LOCK1_APV+0xe5/frame 0xf378eaf0 _vn_lock(ccc25708,80400,c108ebbb,1131) at _vn_lock+0xca/frame 0xf378eb2c vfs_knllock(ccc25708,0,c1077b40,72f,cd016750,...) at vfs_knllock+0x29/frame 0xf378eb44 knlist_remove_kq(0,0) at knlist_remove_kq+0x87/frame 0xf378eb68 knlist_remove(cdccb01c,cd016750,0) at knlist_remove+0x1f/frame 0xf378eb78 filt_vfsdetach(cd016750,0,c1077b40,839,c11b515c,...) at filt_vfsdetach+0x2f/frame 0xf378eb94 knote_fdclose(cdca32f0,3,c10773e8,47d,0,...) at knote_fdclose+0xde/frame 0xf378ebc0 closefp(cc8abcb0,cdca32f0,1,91,cdcb082c,...) at closefp+0x6d/frame 0xf378ebf0 do_dup(5,3,cdca3544) at do_dup+0x29b/frame 0xf378ec28 sys_dup2(cdca32f0,f378ecc8,14,c1080bb9,7b3,...) at sys_dup2+0x2d/frame 0xf378ec40 syscall(f378ed08) at syscall+0x2ed/frame 0xf378ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf378ecfc --- syscall (90, FreeBSD ELF32, sys_dup2), eip = 0x280ffe67, esp = 0xbfbfdb60, ebp = 0xbfbfdb98 --- Feb 14 20:09:41 x4 kernel: pid 39796 (openat), uid 1004 inumber 32830 on /mnt: out of inodes 20130214 20:38:15 all: extattrctl.sh lock order reversal: 1st 0xca10c41c ufs_extattr_sx (ufs_extattr_sx) @ ufs/ufs/ufs_extattr.c:114 2nd 0xd0946304 ufs (ufs) @ ufs/ffs/ffs_vfsops.c:1690 KDB: stack backtrace: db_trace_self_wrapper(c10829d8,3a632e72,a343131,c123a000,17,...) at db_trace_self_wrapper+0x2d/frame 0xf38706a0 kdb_backtrace(c1085a82,d0946304,c106dfdc,c9eaa5a8,c10b64f2,...) at kdb_backtrace+0x30/frame 0xf3870708 witness_checkorder(d0946304,9,c10b64e9,69a,0,...) at witness_checkorder+0xbad/frame 0xf3870758 __lockmgr_args(d0946304,80000,0,0,0,...) at __lockmgr_args+0x87c/frame 0xf3870834 ffs_vgetf(cc82b000,2,80000,f38708c4,0) at ffs_vgetf+0x165/frame 0xf3870890 ffs_vget(cc82b000,2,80000,f38708c4,0,...) at ffs_vget+0x2e/frame 0xf38708ac ufs_root(cc82b000,80000,f38708f0,72,ca10c41c,...) at ufs_root+0x28/frame 0xf38708c8 ufs_extattr_autostart(cc82b000,cdee9bc0,c10b64e9,438,0,...) at ufs_extattr_autostart+0x64/frame 0xf3870900 ffs_mount(cc82b000,c11dd178,cc83e800,cea4f600,2,...) at ffs_mount+0x23b9/frame 0xf3870a48 vfs_donmount(cdee9bc0,0,0,ccbe5080,ccbe5080,...) at vfs_donmount+0xc61/frame 0xf3870c18 sys_nmount(cdee9bc0,f3870cc8,f3870d08,1,1,...) at sys_nmount+0x78/frame 0xf3870c40 syscall(f3870d08) at syscall+0x2ed/frame 0xf3870cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3870cfc --- syscall (378, FreeBSD ELF32, sys_nmount), eip = 0x280d34e7, esp = 0xbfbfc8f8, ebp = 0xbfbfce50 --- UFS autostarted EA posix1e.acl_access UFS autostarted EA posix1e.acl_default 20130214 20:38:18 all: rename7.sh 20130214 20:39:38 all: mlockall2.sh 20130214 22:03:37 all: jail2.sh 20130214 22:03:40 all: mountro3.sh 20130214 22:03:44 all: namecache.sh 20130214 22:34:21 all: fdescfs.sh Feb 14 22:35:09 x4 mountd[574]: can't delete exports for /mnt13: Invalid argument Feb 14 22:35:09 x4 mountd[574]: can't delete exports for /mnt10: Invalid argument Feb 14 22:35:23 x4 mountd[574]: can't delete exports for /mnt9: Invalid argument Feb 14 22:35:40 x4 mountd[574]: can't delete exports for /mnt5: Invalid argument : : Feb 14 22:36:39 x4 mountd[574]: can't delete exports for /mnt3: Invalid argument Feb 14 22:36:47 x4 mountd[574]: can't delete exports for /mnt12: Invalid argument Feb 14 22:36:53 x4 mountd[574]: can't delete exports for /mnt7: Invalid argument 20130214 22:36:59 all: ldt.sh 20130214 22:37:02 all: tmpfs7.sh 20130214 22:37:05 all: quota8.sh lock order reversal: 1st 0xe110cd80 bufwait (bufwait) @ kern/vfs_bio.c:2631 2nd 0xcc94081c snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:2298 KDB: stack backtrace: db_trace_self_wrapper(c10829d8,c0a7ca87,0,c124a66c,246,...) at db_trace_self_wrapper+0x2d/frame 0xf3b714f8 kdb_backtrace(c1085a82,cc94081c,c10b3425,c9eab1d8,c10b3047,...) at kdb_backtrace+0x30/frame 0xf3b71560 witness_checkorder(cc94081c,9,c10b303e,8fa,d05c1208,...) at witness_checkorder+0xbad/frame 0xf3b715b0 __lockmgr_args(cc94081c,80900,d05c1208,0,0,...) at __lockmgr_args+0x87c/frame 0xf3b7168c ffs_copyonwrite(d05c1168,e1311c60,e10e3140,84ac4,0,...) at ffs_copyonwrite+0x1d1/frame 0xf3b716fc ffs_geom_strategy(d05c1228,e10e3140,c0e9f9dc,cf160e84,cf7c5438,...) at ffs_geom_strategy+0x8f/frame 0xf3b71718 ufs_strategy(f3b717a8,c10dcaeb,c0ad4959,e10e31c0,4c,...) at ufs_strategy+0xce/frame 0xf3b71764 VOP_STRATEGY_APV(c11dd470,f3b717a8,c0a7490b,e10e31c0,c11f20d0,...) at VOP_STRATEGY_APV+0x111/frame 0xf3b71790 bufstrategy(cf7c54f8,e10e3140,39f,f33,8,...) at bufstrategy+0x50/frame 0xf3b717c0 bufwrite(e10e3140,e10e3248,18,3af,0,...) at bufwrite+0x161/frame 0xf3b717f0 cluster_wbuild(cf7c5438,8000,4,0,3,...) at cluster_wbuild+0x1f0/frame 0xf3b71850 cluster_write(cf7c5438,e110cd20,40000,0,41,...) at cluster_write+0x514/frame 0xf3b718f0 ffs_write(f3b71a80,c10dc531,c11dd470,f3b719a0,f3b719d8,...) at ffs_write+0x524/frame 0xf3b71980 VOP_WRITE_APV(c11dd470,f3b71a80,cf7c5438,31b,cedb5000,...) at VOP_WRITE_APV+0x178/frame 0xf3b71a40 vn_write(d1e1ed58,f3b71c10,cdfec380,1,cedb5000,...) at vn_write+0x379/frame 0xf3b71ab0 vn_io_fault(d1e1ed58,f3b71c10,cdfec380,0,cedb5000,...) at vn_io_fault+0x24b/frame 0xf3b71b8c dofilewrite(d1e1ed58,f3b71c10,ffffffff,ffffffff,0,...) at dofilewrite+0x86/frame 0xf3b71bc4 kern_writev(cedb5000,4,f3b71c10,0,bfbfd770,...) at kern_writev+0x66/frame 0xf3b71bf0 sys_write(cedb5000,f3b71cc8,14,c1080bb9,7b3,...) at sys_write+0x5c/frame 0xf3b71c40 syscall(f3b71d08) at syscall+0x2ed/frame 0xf3b71cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3b71cfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2818f357, esp = 0xbfbfc758, ebp = 0xbfbfd800 --- lock order reversal: 1st 0xcc94081c snaplk (snaplk) @ ufs/ufs/ufs_vnops.c:968 2nd 0xce990304 ufs (ufs) @ ufs/ffs/ffs_snapshot.c:1627 KDB: stack backtrace: db_trace_self_wrapper(c10829d8,0,1,f37f8748,0,...) at db_trace_self_wrapper+0x2d/frame 0xf37f8678 kdb_backtrace(c1085a82,ce990304,c106dfdc,c9eaa5a8,c10b3047,...) at kdb_backtrace+0x30/frame 0xf37f86e0 witness_checkorder(ce990304,9,c10b303e,65b,0,...) at witness_checkorder+0xbad/frame 0xf37f8730 __lockmgr_args(ce990304,80000,0,0,0,...) at __lockmgr_args+0x87c/frame 0xf37f8810 ffs_snapremove(ce9902d0,c10b2f0f,cdee83a4,c136eb00,c11b2dc4,...) at ffs_snapremove+0x118/frame 0xf37f8870 ffs_truncate(ce9902d0,0,0,c00,0,...) at ffs_truncate+0x293/frame 0xf37f8a24 ufs_inactive(f37f8aa8,c10dc975,9d0,c11ef148,ce9902d0,...) at ufs_inactive+0x1fc/frame 0xf37f8a54 VOP_INACTIVE_APV(c11dd470,f37f8aa8,c108ebbb,9d0,c0b1f218,...) at VOP_INACTIVE_APV+0x103/frame 0xf37f8a80 vinactive(ce9902d0,cdee82f0,c108ebbb,8ce,ce990380,...) at vinactive+0x191/frame 0xf37f8ac8 vputx(ce9902d0,ffffffdf,ce9902d0,f37f8bd0,0,...) at vputx+0x38a/frame 0xf37f8b10 kern_unlinkat(cdee82f0,ffffff9c,bfbfda9a,0,0) at kern_unlinkat+0x29f/frame 0xf37f8c24 sys_unlink(cdee82f0,f37f8cc8,14,c1080bb9,7b3,...) at sys_unlink+0x32/frame 0xf37f8c40 syscall(f37f8d08) at syscall+0x2ed/frame 0xf37f8cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf37f8cfc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28167b13, esp = 0xbfbfd7cc, ebp = 0xbfbfd854 --- 20130214 22:39:35 all: umountf5.sh 20130214 22:40:48 all: crossmp.sh Feb 14 22:41:02 x4 mountd[574]: can't delete exports for /mnt6: Invalid argument Feb 14 22:41:13 x4 mountd[574]: can't delete exports for /mnt14: Invalid argument Feb 14 22:41:14 x4 mountd[574]: can't delete exports for /mnt13: Invalid argument Feb 14 22:41:14 x4 mountd[574]: can't delete exports for /mnt8: Invalid argument : : Feb 14 23:14:36 x4 mountd[574]: can't delete exports for /mnt9: Invalid argument Feb 14 23:15:51 x4 mountd[574]: can't delete exports for /mnt10: Invalid argument Feb 14 23:16:13 x4 mountd[574]: can't delete exports for /mnt16: Invalid argument Feb 14 23:16:38 x4 mountd[574]: can't delete exports for /mnt18: Invalid argument Feb 14 23:17:01 x4 last message repeated 2 times Feb 14 23:18:35 x4 mountd[574]: can't delete exports for /mnt14: Invalid argument Feb 14 23:18:41 x4 mountd[574]: can't delete exports for /mnt17: Invalid argument 20130214 23:19:02 all: recursiveflushes.sh 20130214 23:22:39 all: suj15.sh 20130214 23:54:07 all: syscall5.sh 20130215 00:25:01 all: truncate4.sh 20130215 00:25:04 all: suj4.sh 20130215 01:25:33 all: ucom.sh 20130215 01:28:37 all: callout_reset_on.sh 20130215 01:36:17 all: mmap3.sh Feb 15 01:40:36 x4 kernel: Failed to write core file for process mmap3 (error 14) Feb 15 01:41:09 x4 last message repeated 8 times Feb 15 01:43:18 x4 last message repeated 20 times 20130215 01:47:53 all: crossmp2.sh 20130215 01:49:21 all: kevent5.sh Feb 15 01:47:51 x4 last message repeated 32 times 20130215 01:53:34 all: kevent.sh 20130215 01:54:47 all: devfs2.sh 20130215 01:54:49 all: tmpfs8.sh 20130215 01:55:32 all: rot.sh 20130215 02:27:18 all: md2.sh 20130215 02:51:59 all: procfs4.sh Feb 15 03:06:54 x4 sshd[14413]: error: PAM: authentication error for pho from x2.osted.lan Feb 15 03:06:54 x4 last message repeated 2 times 20130215 03:10:35 all: socketpair.sh kern.maxfiles limit exceeded by uid 0, please see tuning(7). 20130215 03:10:41 all: zfs5.sh panic: kmem_malloc(1585152): kmem_map too small: 310595584 total allocated cpuid = 1 KDB: enter: panic [ thread pid 42014 tid 101811 ] Stopped at kdb_enter+0x3d: movl $0,kdb_why db> run pho db:0:pho> bt Tracing pid 42014 tid 101811 td 0xce99d8d0 kdb_enter(c107e6ab,c107e6ab,c10b9b0e,f4228878,0,...) at kdb_enter+0x3d/frame 0xf4228820 vpanic(f4228878,f42288a0,c0d0da1a,c10b9b0e,183000,...) at vpanic+0x142/frame 0xf4228860 panic(c10b9b0e,183000,12835000,c10b9b08,7d0,...) at panic+0x12/frame 0xf422886c kmem_malloc(c1bb508c,183000,2,183000,2,...) at kmem_malloc+0x2ca/frame 0xf42288a0 uma_large_malloc(183000,2,c0a70116,c1229c50,2,...) at uma_large_malloc+0x40/frame 0xf42288c0 malloc(183000,c11b0db8,2,1000,0,...) at malloc+0x130/frame 0xf42288f0 link_elf_load_file(c11b5ef4,d339a620,f4228bc0,185,c1b9ab14,...) at link_elf_load_file+0x4a9/frame 0xf42289f8 linker_load_module(0,0,f4228bf4,410,6,...) at linker_load_module+0xa7b/frame 0xf4228bd8 kern_kldload(ce99d8d0,cd478000,f4228c30,0,d63e55a0,...) at kern_kldload+0xca/frame 0xf4228c18 sys_kldload(ce99d8d0,f4228cc8,f4228d08,1,1,...) at sys_kldload+0x6e/frame 0xf4228c40 syscall(f4228d08) at syscall+0x2ed/frame 0xf4228cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4228cfc --- syscall (304, FreeBSD ELF32, sys_kldload), eip = 0x280bf807, esp = 0xbfbfd3ec, ebp = 0xbfbfd8c4 --- db:0:bt> show allpcpu Current CPU: 1 cpuid = 0 dynamic pcpu = 0x62dd80 curthread = 0xc9f028d0: pid 11 "idle: cpu0" curpcb = 0xc71ead60 fpcurthread = none idlethread = 0xc9f028d0: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x5fe2d80 curthread = 0xce99d8d0: pid 42014 "kldload" curpcb = 0xf4228d60 fpcurthread = none idlethread = 0xc9f025e0: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x5fe5d80 curthread = 0xc9f022f0: pid 11 "idle: cpu2" curpcb = 0xc71f0d60 fpcurthread = none idlethread = 0xc9f022f0: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x5fe8d80 curthread = 0xc9f02000: pid 11 "idle: cpu3" curpcb = 0xc71f3d60 fpcurthread = none idlethread = 0xc9f02000: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks Process 42014 (kldload) thread 0xce99d8d0 (101811) shared lockmgr ufs (ufs) r = 0 (0xd0306b74) locked @ kern/vfs_subr.c:2176 exclusive sx kernel linker (kernel linker) r = 0 (0xc1229c50) locked @ kern/kern_linker.c:1040 Process 54595 (find) thread 0xd17fa2f0 (101782) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1101c60) locked @ kern/vfs_bio.c:1898 shared lockmgr ufs (ufs) r = 0 (0xd0e17a0c) locked @ kern/vfs_syscalls.c:4012 db:0:alllocks> show lockedvnods Locked vnodes 0xd0306b40: tag ufs, type VREG usecount 1, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xd4c7b4a0 ref 0 pages 4 lock type ufs: SHARED (count 1) #0 0xc0a74300 at __lockmgr_args+0xf60 #1 0xc0ce924d at ffs_lock+0xad #2 0xc0ec9425 at VOP_LOCK1_APV+0xe5 #3 0xc0b416da at _vn_lock+0xca #4 0xc0b2f6d7 at vget+0x77 #5 0xc0b1ad88 at cache_lookup+0x5a8 #6 0xc0b1bebc at vfs_cache_lookup+0xbc #7 0xc0ec62b3 at VOP_LOOKUP_APV+0x103 #8 0xc0b24b8e at lookup+0x52e #9 0xc0b2427d at namei+0x47d #10 0xc0b40e0d at vn_open_cred+0x24d #11 0xc0b40bbb at vn_open+0x3b #12 0xc0ab1319 at link_elf_load_file+0xc9 #13 0xc0a6f5bb at linker_load_module+0xa7b #14 0xc0a70a3a at kern_kldload+0xca #15 0xc0a70b9e at sys_kldload+0x6e #16 0xc0ea3d3d at syscall+0x2ed #17 0xc0e8c381 at Xint0x80_syscall+0x21 ino 213429, on dev ada0s1a 0xd0e179d8: tag ufs, type VDIR usecount 2, writecount 0, refcount 4 mountedhere 0 flags (VI_ACTIVE) v_object 0xd5b8d9d4 ref 0 pages 1 lock type ufs: SHARED (count 1) #0 0xc0a74300 at __lockmgr_args+0xf60 #1 0xc0ce924d at ffs_lock+0xad #2 0xc0ec9425 at VOP_LOCK1_APV+0xe5 #3 0xc0b416da at _vn_lock+0xca #4 0xc0b3e866 at kern_getdirentries+0x116 #5 0xc0b3e721 at sys_getdirentries+0x41 #6 0xc0ea3d3d at syscall+0x2ed #7 0xc0e8c381 at Xint0x80_syscall+0x21 ino 1483810, on dev ada0s1d db:0:lockedvnods> show mount 0xcc82bbb0 /dev/ad4s1a on / (ufs) 0xcc82c000 devfs on /dev (devfs) 0xccbfb5d8 /dev/ad4s1f on /home (ufs) 0xccbfb000 /dev/ad4s1d on /usr (ufs) 0xcc82cbb0 /dev/ad4s1e on /var (ufs) 0xcc82c8c4 procfs on /proc (procfs) 0xcc82b8c4 /dev/label/tmp on /tmp (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 42014 42005 45106 0 R+ CPU 1 kldload 42005 45106 45106 0 S+ wait 0xd67232d0 sh 42003 814 810 1001 S nanslp 0xc122c520 sleep 54597 54589 90807 0 S piperd 0xd1e23b28 wc 54596 54589 90807 0 S piperd 0xcc8ec330 tee 54595 54589 90807 0 D biord 0xe1101c00 find 54589 54516 90807 0 S wait 0xd64de2d0 sh 54516 18443 90807 0 S piperd 0xccc194c8 sh 18445 18285 90807 0 S piperd 0xd12d1cc0 mail 18443 18285 90807 0 S wait 0xd67252d0 sh 18285 18265 90807 0 S wait 0xd63e32d0 sh 18265 18170 90807 0 S wait 0xd659a5a0 lockf 18170 18130 90807 0 S wait 0xd67c62d0 sh 18130 91026 90807 0 S wait 0xce79e2d0 sh 91027 90927 90807 0 S piperd 0xd1e194c8 mail 91026 90927 90807 0 S wait 0xd65be870 sh 90927 90901 90807 0 S wait 0xccd0f000 sh 90901 90807 90807 0 S wait 0xd66c5000 lockf 90807 90805 90807 0 Ss wait 0xd6613870 sh 90805 746 746 0 S piperd 0xcdcd8cc0 cron 45106 3162 45106 0 S+ wait 0xd1e33000 sh 3162 3159 3162 0 SW+ wait 0xd1271000 bash 3159 3158 3159 0 SW+ pause 0xcdee3328 csh 3158 795 3158 1001 SW+ wait 0xd1271870 su 1142 1 1142 0 Ss+ ttyin 0xca1de270 getty 1141 1 1141 0 Ss+ ttyin 0xca1de470 getty 1140 1 1140 0 Ss+ ttyin 0xca02b070 getty 1139 1 1139 0 Ss+ ttyin 0xca02b270 getty 1138 1 1138 0 Ss+ ttyin 0xca02b470 getty 1137 1 1137 0 Ss+ ttyin 0xca02b670 getty 1136 1 1136 0 Ss+ ttyin 0xca02b870 getty 1135 1 1135 0 Ss+ ttyin 0xca02ba70 getty 1134 1 1134 0 Ss+ ttyin 0xca02bc70 getty 1117 1 1117 0 Ss select 0xcc74ade4 inetd 1092 1 1092 0 Ss nanslp 0xc122c520 watchdogd 815 810 810 1001 S piperd 0xcc8a8660 awk 814 810 810 1001 S wait 0xccd3eb40 sh 813 812 813 1001 Ss kqread 0xcd3bcb00 tail 812 804 804 1001 S select 0xcc85f464 sshd 811 809 811 1001 Ss+ select 0xcc89cb64 top 810 808 810 1001 SWs wait 0xccff45a0 sh 809 803 803 1001 S select 0xcc85f5e4 sshd 808 802 802 1001 S select 0xcc74a7a4 sshd 804 735 804 0 Ss select 0xccff8224 sshd 803 735 803 0 Ss select 0xccff85e4 sshd 802 735 802 0 Ss select 0xcc85f664 sshd 795 794 795 1001 SWs+ wait 0xcd2672d0 bash 794 792 792 1001 S select 0xcc85f8a4 sshd 792 735 792 0 Ss select 0xcc74a224 sshd 746 1 746 0 Ss nanslp 0xc122c520 cron 741 1 741 25 Ss pause 0xcc906b98 sendmail 738 1 738 0 Ss select 0xcc74ac64 sendmail 735 1 735 0 Ss select 0xcc74ab64 sshd 703 1 703 0 Ss select 0xcc74aca4 moused 698 685 685 0 S select 0xcc74aea4 winbindd 691 683 683 0 S select 0xc9f089e4 smbd 685 1 685 0 Ss select 0xc9f08ba4 winbindd 683 1 683 0 Ss select 0xcc89c264 smbd 681 1 681 0 Ss select 0xcc89c3e4 nmbd 657 1 657 0 Ss select 0xcc90aa64 ntpd 598 596 596 0 S (threaded) nfsd 100135 S rpcsvc 0xcc7f2a90 nfsd: service 100134 S rpcsvc 0xcc7f2ad0 nfsd: service 100133 S rpcsvc 0xcc7f2b10 nfsd: service 100132 S rpcsvc 0xcc7f1450 nfsd: master 596 1 596 0 Ss select 0xc9f08da4 nfsd 594 590 590 0 S select 0xcc74a0a4 nfsuserd 593 590 590 0 S select 0xcc89ca24 nfsuserd 592 590 590 0 S select 0xccff87e4 nfsuserd 591 590 590 0 S select 0xcc85f924 nfsuserd 590 1 590 0 SWs pause 0xcc908058 nfsuserd 574 1 574 0 Ss select 0xcc89caa4 mountd 541 1 541 0 Ss select 0xcc74a4a4 rpcbind 526 1 526 0 Ss select 0xcc89cda4 syslogd 423 1 423 0 Ss select 0xcc89ca64 devd 18 0 0 0 DL sdflush 0xc13a69a8 [softdepflush] 17 0 0 0 DL syncer 0xc13a27d0 [syncer] 16 0 0 0 DL vlruwt 0xcc752870 [vnlru] 9 0 0 0 DL psleep 0xc13a2568 [bufdaemon] 8 0 0 0 DL pgzero 0xc13c777c [pagezero] 7 0 0 0 DL psleep 0xc13a6fa0 [vmdaemon] 6 0 0 0 DL psleep 0xc141b204 [pagedaemon] 5 0 0 0 DL ccb_scan 0xc11f7fa4 [xpt_thrd] 4 0 0 0 DL waiting_ 0xc1416ef0 [sctp_iterator] 3 0 0 0 DL ctl_work 0xca1e0000 [ctl_thrd] 2 0 0 0 DL - 0xca13823c [fdc0] 15 0 0 0 DL (threaded) [usb] 100058 D - 0xca1a5d34 [usbus5] 100057 D - 0xca1a5d04 [usbus5] 100056 D - 0xca1a5cd4 [usbus5] 100055 D - 0xca1a5ca4 [usbus5] 100053 D - 0xca198b5c [usbus4] 100052 D - 0xca198b2c [usbus4] 100051 D - 0xca198afc [usbus4] 100050 D - 0xca198acc [usbus4] 100049 D - 0xca192b5c [usbus3] 100048 D - 0xca192b2c [usbus3] 100047 D - 0xca192afc [usbus3] 100046 D - 0xca192acc [usbus3] 100045 D - 0xca18bb5c [usbus2] 100044 D - 0xca18bb2c [usbus2] 100043 D - 0xca18bafc [usbus2] 100042 D - 0xca18bacc [usbus2] 100040 D - 0xca186b5c [usbus1] 100039 D - 0xca186b2c [usbus1] 100038 D - 0xca186afc [usbus1] 100037 D - 0xca186acc [usbus1] 100035 D - 0xca17ab5c [usbus0] 100034 D - 0xca17ab2c [usbus0] 100033 D - 0xca17aafc [usbus0] 100032 D - 0xca17aacc [usbus0] 14 0 0 0 DL - 0xc122b440 [yarrow] 13 0 0 0 DL (threaded) [geom] 100016 D - 0xc1413014 [g_down] 100015 D - 0xc1413010 [g_up] 100014 D - 0xc141300c [g_event] 12 0 0 0 WL (threaded) [intr] 100063 I [irq12: psm0] 100062 I [irq1: atkbd0] 100060 I [swi0: uart] 100059 I [irq14: ata0] 100054 I [irq19: ehci0] 100041 I [irq18: ohci2 ohci4] 100036 I [irq17: ohci1 ohci3] 100031 I [irq16: hdac1 ohci0] 100030 I [irq22: ahci0] 100029 I [irq257: re0] 100028 I [irq256: hdac0] 100026 I [swi2: cambio] 100024 I [swi5: fast taskq] 100022 I [swi6: Giant taskq] 100021 I [swi6: task queue] 100012 I [swi3: vm] 100011 I [swi4: clock] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 I [swi4: clock] 100007 I [swi1: netisr 0] 11 0 0 0 RL (threaded) [idle] 100006 Run CPU 3 [idle: cpu3] 100005 Run CPU 2 [idle: cpu2] 100004 CanRun [idle: cpu1] 100003 Run CPU 0 [idle: cpu0] 1 0 1 0 SLs wait 0xc9f00b40 [init] 10 0 0 0 DL audit_wo 0xc1419cb8 [audit] 0 0 0 0 DLs (threaded) [kernel] 100066 D - 0xc122b440 [deadlkres] 100065 D - 0xcc45f580 [mca taskq] 100027 D - 0xca1034c0 [ffs_trim taskq] 100025 D - 0xca086280 [kqueue taskq] 100023 D - 0xca086300 [thread taskq] 100020 D - 0xca0863c0 [acpi_task_2] 100019 D - 0xca0863c0 [acpi_task_1] 100018 D - 0xca0863c0 [acpi_task_0] 100013 D - 0xc9e9e7c0 [firmware taskq] 100000 D sched 0xc1413094 [swapper] db:0:ps> allt Tracing command kldload pid 42014 tid 101811 td 0xce99d8d0 kdb_enter(c107e6ab,c107e6ab,c10b9b0e,f4228878,0,...) at kdb_enter+0x3d/frame 0xf4228820 vpanic(f4228878,f42288a0,c0d0da1a,c10b9b0e,183000,...) at vpanic+0x142/frame 0xf4228860 panic(c10b9b0e,183000,12835000,c10b9b08,7d0,...) at panic+0x12/frame 0xf422886c kmem_malloc(c1bb508c,183000,2,183000,2,...) at kmem_malloc+0x2ca/frame 0xf42288a0 uma_large_malloc(183000,2,c0a70116,c1229c50,2,...) at uma_large_malloc+0x40/frame 0xf42288c0 malloc(183000,c11b0db8,2,1000,0,...) at malloc+0x130/frame 0xf42288f0 link_elf_load_file(c11b5ef4,d339a620,f4228bc0,185,c1b9ab14,...) at link_elf_load_file+0x4a9/frame 0xf42289f8 linker_load_module(0,0,f4228bf4,410,6,...) at linker_load_module+0xa7b/frame 0xf4228bd8 kern_kldload(ce99d8d0,cd478000,f4228c30,0,d63e55a0,...) at kern_kldload+0xca/frame 0xf4228c18 sys_kldload(ce99d8d0,f4228cc8,f4228d08,1,1,...) at sys_kldload+0x6e/frame 0xf4228c40 syscall(f4228d08) at syscall+0x2ed/frame 0xf4228cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4228cfc --- syscall (304, FreeBSD ELF32, sys_kldload), eip = 0x280bf807, esp = 0xbfbfd3ec, ebp = 0xbfbfd8c4 --- Tracing command sh pid 42005 tid 102161 td 0xd66ebbc0 sched_switch(d66ebbc0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf47a0998 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xf47a09cc sleepq_switch(d66ebbc0,0,c1084241,1ab,f47a0a44,...) at sleepq_switch+0x1b9/frame 0xf47a0a00 sleepq_catch_signals(0,c1084241,164,4b0,d66ebbc0,...) at sleepq_catch_signals+0x3b1/frame 0xf47a0a48 sleepq_wait_sig(d67232d0,6c,c10876f5,100,0,...) at sleepq_wait_sig+0x14/frame 0xf47a0a6c _sleep(d67232d0,d6723358,16c,c10876f5,0,...) at _sleep+0x32d/frame 0xf47a0ac4 kern_wait6(d66ebbc0,7,0,0,f47a0b4c,...) at kern_wait6+0x43c/frame 0xf47a0b20 sys_wait4(d66ebbc0,f47a0cc8,c10d5a33,e9,1,...) at sys_wait4+0x94/frame 0xf47a0c40 syscall(f47a0d08) at syscall+0x2ed/frame 0xf47a0cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf47a0cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281502ef, esp = 0xbfbfd808, ebp = 0xbfbfd820 --- Tracing command sleep pid 42003 tid 101011 td 0xcf2a75e0 sched_switch(cf2a75e0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf39b5a80 mi_switch(104,0,c1084241,1f7,c1414580,...) at mi_switch+0x1c9/frame 0xf39b5ab4 sleepq_switch(cf2a75e0,0,c1084241,1ab,f39b5b2c,...) at sleepq_switch+0x1b9/frame 0xf39b5ae8 sleepq_catch_signals(2711,c0ad1d10,cf2a75e0,1,1,...) at sleepq_catch_signals+0x3b1/frame 0xf39b5b30 sleepq_timedwait_sig(c122c520,6c,c107fd72,100,0,...) at sleepq_timedwait_sig+0x14/frame 0xf39b5b58 _sleep(c122c520,0,16c,c107fd72,2711,...) at _sleep+0x303/frame 0xf39b5bb0 kern_nanosleep(bfbfdce0,f39b5c18,f39b5c20,2,a,...) at kern_nanosleep+0xd9/frame 0xf39b5c00 sys_nanosleep(cf2a75e0,f39b5cc8,f39b5d08,1,1,...) at sys_nanosleep+0x6b/frame 0xf39b5c40 syscall(f39b5d08) at syscall+0x2ed/frame 0xf39b5cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf39b5cfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x281579bf, esp = 0xbfbfdcac, ebp = 0xbfbfdcf4 --- Tracing command wc pid 54597 tid 101552 td 0xcd9c52f0 sched_switch(cd9c52f0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf3e6fa30 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xf3e6fa64 sleepq_switch(cd9c52f0,0,c1084241,1ab,f3e6fadc,...) at sleepq_switch+0x1b9/frame 0xf3e6fa98 sleepq_catch_signals(0,c1084241,164,588,cd9c52f0,...) at sleepq_catch_signals+0x3b1/frame 0xf3e6fae0 sleepq_wait_sig(d1e23b28,5c,c1087205,100,0,...) at sleepq_wait_sig+0x14/frame 0xf3e6fb04 _sleep(d1e23b28,d1e23ca8,15c,c1087205,0,...) at _sleep+0x32d/frame 0xf3e6fb5c pipe_read(d5734230,f3e6fc10,ce8fd880,0,cd9c52f0,...) at pipe_read+0x29c/frame 0xf3e6fb90 dofileread(d5734230,f3e6fc10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf3e6fbc4 kern_readv(cd9c52f0,0,f3e6fc10,0,bfbedda0,...) at kern_readv+0x66/frame 0xf3e6fbf0 sys_read(cd9c52f0,f3e6fcc8,f3e6fd08,1,1,...) at sys_read+0x5c/frame 0xf3e6fc40 syscall(f3e6fd08) at syscall+0x2ed/frame 0xf3e6fcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3e6fcfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2817b367, esp = 0xbfbedc54, ebp = 0xbfbfddb8 --- Tracing command tee pid 54596 tid 102093 td 0xd65cb2f0 sched_switch(d65cb2f0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf4690a30 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xf4690a64 sleepq_switch(d65cb2f0,0,c1084241,1ab,f4690adc,...) at sleepq_switch+0x1b9/frame 0xf4690a98 sleepq_catch_signals(0,c1084241,164,648,d65cb2f0,...) at sleepq_catch_signals+0x3b1/frame 0xf4690ae0 sleepq_wait_sig(cc8ec330,5c,c1087205,100,0,...) at sleepq_wait_sig+0x14/frame 0xf4690b04 _sleep(cc8ec330,cc8ec4b0,15c,c1087205,0,...) at _sleep+0x32d/frame 0xf4690b5c pipe_read(cda07e00,f4690c10,ce8fd880,0,d65cb2f0,...) at pipe_read+0x29c/frame 0xf4690b90 dofileread(cda07e00,f4690c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf4690bc4 kern_readv(d65cb2f0,0,f4690c10,0,28803000,...) at kern_readv+0x66/frame 0xf4690bf0 sys_read(d65cb2f0,f4690cc8,7b3,0,f4690cc4,...) at sys_read+0x5c/frame 0xf4690c40 syscall(f4690d08) at syscall+0x2ed/frame 0xf4690cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4690cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2817a367, esp = 0xbfbfddb8, ebp = 0xbfbfdde4 --- Tracing command find pid 54595 tid 101782 td 0xd17fa2f0 sched_switch(d17fa2f0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf41b48b0 mi_switch(104,0,c1084241,1f7,164,...) at mi_switch+0x1c9/frame 0xf41b48e4 sleepq_switch(d17fa2f0,0,c1084241,26d,d17fa2f0,...) at sleepq_switch+0x1b9/frame 0xf41b4918 sleepq_wait(e1101c00,5c,c108c3ee,0,0,...) at sleepq_wait+0x48/frame 0xf41b493c _sleep(e1101c00,c9ebd2b8,5c,c108c3ee,0,...) at _sleep+0x34e/frame 0xf41b4994 bwait(e1101c00,5c,c108c3ee,0,0,...) at bwait+0x7f/frame 0xf41b49c0 breadn_flags(d0e179d8,0,0,800,0,...) at breadn_flags+0x160/frame 0xf41b49f0 ffs_read(f41b4b28,c10dc4e7,60,0,0,...) at ffs_read+0x3da/frame 0xf41b4a9c VOP_READ_APV(c11dd470,f41b4b28,c11ef148,d0e179d8,d0e17a78,...) at VOP_READ_APV+0x103/frame 0xf41b4ac8 ufs_readdir(f41b4be0,c10dc8c8,c10902d4,fac,0,...) at ufs_readdir+0xa1/frame 0xf41b4b4c VOP_READDIR_APV(c11dd470,f41b4be0,c10902d4,fac,f41b4bdc,...) at VOP_READDIR_APV+0x103/frame 0xf41b4b78 kern_getdirentries(d17fa2f0,5,28b0f000,1000,f41b4c34,...) at kern_getdirentries+0x19e/frame 0xf41b4c10 sys_getdirentries(d17fa2f0,f41b4cc8,f41b4d08,1,1,...) at sys_getdirentries+0x41/frame 0xf41b4c40 syscall(f41b4d08) at syscall+0x2ed/frame 0xf41b4cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf41b4cfc --- syscall (196, FreeBSD ELF32, sys_getdirentries), eip = 0x280dfb9b, esp = 0xbfbfdb64, ebp = 0xbfbfdb94 --- Tracing command sh pid 54589 tid 101881 td 0xd64c35e0 sched_switch(d64c35e0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf4340998 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xf43409cc sleepq_switch(d64c35e0,0,c1084241,1ab,f4340a44,...) at sleepq_switch+0x1b9/frame 0xf4340a00 sleepq_catch_signals(0,c1084241,164,930,d64c35e0,...) at sleepq_catch_signals+0x3b1/frame 0xf4340a48 sleepq_wait_sig(d64de2d0,6c,c10876f5,100,0,...) at sleepq_wait_sig+0x14/frame 0xf4340a6c _sleep(d64de2d0,d64de358,16c,c10876f5,0,...) at _sleep+0x32d/frame 0xf4340ac4 kern_wait6(d64c35e0,7,0,0,f4340b4c,...) at kern_wait6+0x43c/frame 0xf4340b20 sys_wait4(d64c35e0,f4340cc8,1,0,d64c35e0,...) at sys_wait4+0x94/frame 0xf4340c40 syscall(f4340d08) at syscall+0x2ed/frame 0xf4340cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4340cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281502ef, esp = 0xbfbfd850, ebp = 0xbfbfd868 --- Tracing command sh pid 54516 tid 101890 td 0xd64c18d0 sched_switch(d64c18d0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf4364a30 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xf4364a64 sleepq_switch(d64c18d0,0,c1084241,1ab,f4364adc,...) at sleepq_switch+0x1b9/frame 0xf4364a98 sleepq_catch_signals(0,c1084241,164,1e0,d64c18d0,...) at sleepq_catch_signals+0x3b1/frame 0xf4364ae0 sleepq_wait_sig(ccc194c8,5c,c1087205,100,0,...) at sleepq_wait_sig+0x14/frame 0xf4364b04 _sleep(ccc194c8,ccc19648,15c,c1087205,0,...) at _sleep+0x32d/frame 0xf4364b5c pipe_read(d56f0a48,f4364c10,ce8fd880,0,d64c18d0,...) at pipe_read+0x29c/frame 0xf4364b90 dofileread(d56f0a48,f4364c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf4364bc4 kern_readv(d64c18d0,3,f4364c10,0,bfbfda98,...) at kern_readv+0x66/frame 0xf4364bf0 sys_read(d64c18d0,f4364cc8,f4364d08,1,1,...) at sys_read+0x5c/frame 0xf4364c40 syscall(f4364d08) at syscall+0x2ed/frame 0xf4364cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4364cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281f4367, esp = 0xbfbfda04, ebp = 0xbfbfdb2c --- Tracing command mail pid 18445 tid 101137 td 0xcf280bc0 sched_switch(cf280bc0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf3ec6a30 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xf3ec6a64 sleepq_switch(cf280bc0,0,c1084241,1ab,f3ec6adc,...) at sleepq_switch+0x1b9/frame 0xf3ec6a98 sleepq_catch_signals(0,c1084241,164,2a0,cf280bc0,...) at sleepq_catch_signals+0x3b1/frame 0xf3ec6ae0 sleepq_wait_sig(d12d1cc0,5c,c1087205,100,0,...) at sleepq_wait_sig+0x14/frame 0xf3ec6b04 _sleep(d12d1cc0,d12d1e40,15c,c1087205,0,...) at _sleep+0x32d/frame 0xf3ec6b5c pipe_read(cd25c348,f3ec6c10,ce8fd880,0,cf280bc0,...) at pipe_read+0x29c/frame 0xf3ec6b90 dofileread(cd25c348,f3ec6c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf3ec6bc4 kern_readv(cf280bc0,0,f3ec6c10,0,28808000,...) at kern_readv+0x66/frame 0xf3ec6bf0 sys_read(cf280bc0,f3ec6cc8,14,c1080bb9,7b3,...) at sys_read+0x5c/frame 0xf3ec6c40 syscall(f3ec6d08) at syscall+0x2ed/frame 0xf3ec6cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3ec6cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2818c367, esp = 0xbfbfcfc8, ebp = 0xbfbfcfdc --- Tracing command sh pid 18443 tid 102151 td 0xd66edbc0 sched_switch(d66edbc0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf4778998 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xf47789cc sleepq_switch(d66edbc0,0,c1084241,1ab,f4778a44,...) at sleepq_switch+0x1b9/frame 0xf4778a00 sleepq_catch_signals(0,c1084241,164,7b0,d66edbc0,...) at sleepq_catch_signals+0x3b1/frame 0xf4778a48 sleepq_wait_sig(d67252d0,6c,c10876f5,100,0,...) at sleepq_wait_sig+0x14/frame 0xf4778a6c _sleep(d67252d0,d6725358,16c,c10876f5,0,...) at _sleep+0x32d/frame 0xf4778ac4 kern_wait6(d66edbc0,7,0,0,f4778b4c,...) at kern_wait6+0x43c/frame 0xf4778b20 sys_wait4(d66edbc0,f4778cc8,c10d5a33,e9,1,...) at sys_wait4+0x94/frame 0xf4778c40 syscall(f4778d08) at syscall+0x2ed/frame 0xf4778cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4778cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281502ef, esp = 0xbfbfd900, ebp = 0xbfbfd918 --- Tracing command sh pid 18285 tid 101822 td 0xd5715000 sched_switch(d5715000,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf4254998 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xf42549cc sleepq_switch(d5715000,0,c1084241,1ab,f4254a44,...) at sleepq_switch+0x1b9/frame 0xf4254a00 sleepq_catch_signals(0,c1084241,164,4b0,d5715000,...) at sleepq_catch_signals+0x3b1/frame 0xf4254a48 sleepq_wait_sig(d63e32d0,6c,c10876f5,100,0,...) at sleepq_wait_sig+0x14/frame 0xf4254a6c _sleep(d63e32d0,d63e3358,16c,c10876f5,0,...) at _sleep+0x32d/frame 0xf4254ac4 kern_wait6(d5715000,7,0,0,f4254b4c,...) at kern_wait6+0x43c/frame 0xf4254b20 sys_wait4(d5715000,f4254cc8,f4254d08,1,1,...) at sys_wait4+0x94/frame 0xf4254c40 syscall(f4254d08) at syscall+0x2ed/frame 0xf4254cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4254cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281502ef, esp = 0xbfbfdc10, ebp = 0xbfbfdc28 --- Tracing command lockf pid 18265 tid 101940 td 0xd64b78d0 sched_switch(d64b78d0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf442c998 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xf442c9cc sleepq_switch(d64b78d0,0,c1084241,1ab,f442ca44,...) at sleepq_switch+0x1b9/frame 0xf442ca00 sleepq_catch_signals(0,c1084241,164,378,d64b78d0,...) at sleepq_catch_signals+0x3b1/frame 0xf442ca48 sleepq_wait_sig(d659a5a0,6c,c10876f5,100,0,...) at sleepq_wait_sig+0x14/frame 0xf442ca6c _sleep(d659a5a0,d659a628,16c,c10876f5,0,...) at _sleep+0x32d/frame 0xf442cac4 kern_wait6(d64b78d0,0,476d,0,f442cb4c,...) at kern_wait6+0x43c/frame 0xf442cb20 sys_wait4(d64b78d0,f442ccc8,f442cd08,1,1,...) at sys_wait4+0x94/frame 0xf442cc40 syscall(f442cd08) at syscall+0x2ed/frame 0xf442ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf442ccfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x280d72ef, esp = 0xbfbfdd18, ebp = 0xbfbfdd30 --- Tracing command sh pid 18170 tid 102246 td 0xd680a000 sched_switch(d680a000,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf48f4998 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xf48f49cc sleepq_switch(d680a000,0,c1084241,1ab,f48f4a44,...) at sleepq_switch+0x1b9/frame 0xf48f4a00 sleepq_catch_signals(0,c1084241,164,930,d680a000,...) at sleepq_catch_signals+0x3b1/frame 0xf48f4a48 sleepq_wait_sig(d67c62d0,6c,c10876f5,100,0,...) at sleepq_wait_sig+0x14/frame 0xf48f4a6c _sleep(d67c62d0,d67c6358,16c,c10876f5,0,...) at _sleep+0x32d/frame 0xf48f4ac4 kern_wait6(d680a000,7,0,0,f48f4b4c,...) at kern_wait6+0x43c/frame 0xf48f4b20 sys_wait4(d680a000,f48f4cc8,c10d5a33,e9,1,...) at sys_wait4+0x94/frame 0xf48f4c40 syscall(f48f4d08) at syscall+0x2ed/frame 0xf48f4cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf48f4cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281502ef, esp = 0xbfbfd9e0, ebp = 0xbfbfd9f8 --- Tracing command sh pid 18130 tid 100202 td 0xcc8fdbc0 sched_switch(cc8fdbc0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf3846998 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xf38469cc sleepq_switch(cc8fdbc0,0,c1084241,1ab,f3846a44,...) at sleepq_switch+0x1b9/frame 0xf3846a00 sleepq_catch_signals(0,c1084241,164,930,cc8fdbc0,...) at sleepq_catch_signals+0x3b1/frame 0xf3846a48 sleepq_wait_sig(ce79e2d0,6c,c10876f5,100,0,...) at sleepq_wait_sig+0x14/frame 0xf3846a6c _sleep(ce79e2d0,ce79e358,16c,c10876f5,0,...) at _sleep+0x32d/frame 0xf3846ac4 kern_wait6(cc8fdbc0,7,0,0,f3846b4c,...) at kern_wait6+0x43c/frame 0xf3846b20 sys_wait4(cc8fdbc0,f3846cc8,c10d5a33,e9,1,...) at sys_wait4+0x94/frame 0xf3846c40 syscall(f3846d08) at syscall+0x2ed/frame 0xf3846cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3846cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281502ef, esp = 0xbfbfdac0, ebp = 0xbfbfdad8 --- Tracing command mail pid 91027 tid 102307 td 0xd67f8bc0 sched_switch(d67f8bc0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf49e8a30 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xf49e8a64 sleepq_switch(d67f8bc0,0,c1084241,1ab,f49e8adc,...) at sleepq_switch+0x1b9/frame 0xf49e8a98 sleepq_catch_signals(0,c1084241,164,1e0,d67f8bc0,...) at sleepq_catch_signals+0x3b1/frame 0xf49e8ae0 sleepq_wait_sig(d1e194c8,5c,c1087205,100,0,...) at sleepq_wait_sig+0x14/frame 0xf49e8b04 _sleep(d1e194c8,d1e19648,15c,c1087205,0,...) at _sleep+0x32d/frame 0xf49e8b5c pipe_read(d683b6c8,f49e8c10,ce8fd880,0,d67f8bc0,...) at pipe_read+0x29c/frame 0xf49e8b90 dofileread(d683b6c8,f49e8c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf49e8bc4 kern_readv(d67f8bc0,0,f49e8c10,0,28808000,...) at kern_readv+0x66/frame 0xf49e8bf0 sys_read(d67f8bc0,f49e8cc8,f49e8d08,1,1,...) at sys_read+0x5c/frame 0xf49e8c40 syscall(f49e8d08) at syscall+0x2ed/frame 0xf49e8cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf49e8cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2818c367, esp = 0xbfbfcfe8, ebp = 0xbfbfcffc --- Tracing command sh pid 91026 tid 102011 td 0xd65e18d0 sched_switch(d65e18d0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf4548998 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xf45489cc sleepq_switch(d65e18d0,0,c1084241,1ab,f4548a44,...) at sleepq_switch+0x1b9/frame 0xf4548a00 sleepq_catch_signals(0,c1084241,164,9c0,d65e18d0,...) at sleepq_catch_signals+0x3b1/frame 0xf4548a48 sleepq_wait_sig(d65be870,6c,c10876f5,100,0,...) at sleepq_wait_sig+0x14/frame 0xf4548a6c _sleep(d65be870,d65be8f8,16c,c10876f5,0,...) at _sleep+0x32d/frame 0xf4548ac4 kern_wait6(d65e18d0,7,0,0,f4548b4c,...) at kern_wait6+0x43c/frame 0xf4548b20 sys_wait4(d65e18d0,f4548cc8,c10d5a33,e9,1,...) at sys_wait4+0x94/frame 0xf4548c40 syscall(f4548d08) at syscall+0x2ed/frame 0xf4548cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4548cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281502ef, esp = 0xbfbfd920, ebp = 0xbfbfd938 --- Tracing command sh pid 90927 tid 101184 td 0xcee0ebc0 sched_switch(cee0ebc0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf3ae2998 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xf3ae29cc sleepq_switch(cee0ebc0,0,c1084241,1ab,f3ae2a44,...) at sleepq_switch+0x1b9/frame 0xf3ae2a00 sleepq_catch_signals(0,c1084241,164,a80,cee0ebc0,...) at sleepq_catch_signals+0x3b1/frame 0xf3ae2a48 sleepq_wait_sig(ccd0f000,6c,c10876f5,100,0,...) at sleepq_wait_sig+0x14/frame 0xf3ae2a6c _sleep(ccd0f000,ccd0f088,16c,c10876f5,0,...) at _sleep+0x32d/frame 0xf3ae2ac4 kern_wait6(cee0ebc0,7,0,0,f3ae2b4c,...) at kern_wait6+0x43c/frame 0xf3ae2b20 sys_wait4(cee0ebc0,f3ae2cc8,c10d5a33,e9,1,...) at sys_wait4+0x94/frame 0xf3ae2c40 syscall(f3ae2d08) at syscall+0x2ed/frame 0xf3ae2cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3ae2cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281502ef, esp = 0xbfbfdc30, ebp = 0xbfbfdc48 --- Tracing command lockf pid 90901 tid 102134 td 0xd66f12f0 sched_switch(d66f12f0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf4734998 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xf47349cc sleepq_switch(d66f12f0,0,c1084241,1ab,f4734a44,...) at sleepq_switch+0x1b9/frame 0xf4734a00 sleepq_catch_signals(0,c1084241,164,780,d66f12f0,...) at sleepq_catch_signals+0x3b1/frame 0xf4734a48 sleepq_wait_sig(d66c5000,6c,c10876f5,100,0,...) at sleepq_wait_sig+0x14/frame 0xf4734a6c _sleep(d66c5000,d66c5088,16c,c10876f5,0,...) at _sleep+0x32d/frame 0xf4734ac4 kern_wait6(d66f12f0,0,1632f,0,f4734b4c,...) at kern_wait6+0x43c/frame 0xf4734b20 sys_wait4(d66f12f0,f4734cc8,f4734d08,1,1,...) at sys_wait4+0x94/frame 0xf4734c40 syscall(f4734d08) at syscall+0x2ed/frame 0xf4734cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4734cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x280d72ef, esp = 0xbfbfdd38, ebp = 0xbfbfdd50 --- Tracing command sh pid 90807 tid 102050 td 0xd65d9bc0 sched_switch(d65d9bc0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf45e4998 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xf45e49cc sleepq_switch(d65d9bc0,0,c1084241,1ab,f45e4a44,...) at sleepq_switch+0x1b9/frame 0xf45e4a00 sleepq_catch_signals(0,c1084241,164,540,d65d9bc0,...) at sleepq_catch_signals+0x3b1/frame 0xf45e4a48 sleepq_wait_sig(d6613870,6c,c10876f5,100,0,...) at sleepq_wait_sig+0x14/frame 0xf45e4a6c _sleep(d6613870,d66138f8,16c,c10876f5,0,...) at _sleep+0x32d/frame 0xf45e4ac4 kern_wait6(d65d9bc0,7,0,0,f45e4b4c,...) at kern_wait6+0x43c/frame 0xf45e4b20 sys_wait4(d65d9bc0,f45e4cc8,c10d5a33,e9,1,...) at sys_wait4+0x94/frame 0xf45e4c40 syscall(f45e4d08) at syscall+0x2ed/frame 0xf45e4cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf45e4cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281502ef, esp = 0xbfbfda10, ebp = 0xbfbfda28 --- Tracing command cron pid 90805 tid 102223 td 0xd66da5e0 sched_switch(d66da5e0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf4898a30 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xf4898a64 sleepq_switch(d66da5e0,0,c1084241,1ab,f4898adc,...) at sleepq_switch+0x1b9/frame 0xf4898a98 sleepq_catch_signals(0,c1084241,164,120,d66da5e0,...) at sleepq_catch_signals+0x3b1/frame 0xf4898ae0 sleepq_wait_sig(cdcd8cc0,5c,c1087205,100,0,...) at sleepq_wait_sig+0x14/frame 0xf4898b04 _sleep(cdcd8cc0,cdcd8e40,15c,c1087205,0,...) at _sleep+0x32d/frame 0xf4898b5c pipe_read(d6719d90,f4898c10,cc82d100,0,d66da5e0,...) at pipe_read+0x29c/frame 0xf4898b90 dofileread(d6719d90,f4898c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf4898bc4 kern_readv(d66da5e0,5,f4898c10,0,2881b000,...) at kern_readv+0x66/frame 0xf4898bf0 sys_read(d66da5e0,f4898cc8,c10d5a33,e9,d66da5e0,...) at sys_read+0x5c/frame 0xf4898c40 syscall(f4898d08) at syscall+0x2ed/frame 0xf4898cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf4898cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819c367, esp = 0xbfbfd634, ebp = 0xbfbfd648 --- Tracing command sh pid 45106 tid 101021 td 0xcd9eb8d0 sched_switch(cd9eb8d0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf39c8998 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xf39c89cc sleepq_switch(cd9eb8d0,0,c1084241,1ab,f39c8a44,...) at sleepq_switch+0x1b9/frame 0xf39c8a00 sleepq_catch_signals(0,c1084241,164,480,cd9eb8d0,...) at sleepq_catch_signals+0x3b1/frame 0xf39c8a48 sleepq_wait_sig(d1e33000,6c,c10876f5,100,0,...) at sleepq_wait_sig+0x14/frame 0xf39c8a6c _sleep(d1e33000,d1e33088,16c,c10876f5,0,...) at _sleep+0x32d/frame 0xf39c8ac4 kern_wait6(cd9eb8d0,7,0,0,f39c8b4c,...) at kern_wait6+0x43c/frame 0xf39c8b20 sys_wait4(cd9eb8d0,f39c8cc8,c10d5a33,e9,1,...) at sys_wait4+0x94/frame 0xf39c8c40 syscall(f39c8d08) at syscall+0x2ed/frame 0xf39c8cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf39c8cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281502ef, esp = 0xbfbfd738, ebp = 0xbfbfd750 --- Tracing command bash pid 3162 tid 100710 td 0xce8f88d0 Tracing command csh pid 3159 tid 100174 td 0xcdee88d0 Tracing command su pid 3158 tid 100653 td 0xcf63d5e0 Tracing command getty pid 1142 tid 100110 td 0xcb633bc0 sched_switch(cb633bc0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf36b59b8 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xf36b59ec sleepq_switch(cb633bc0,0,c1084241,1ab,f36b5a64,...) at sleepq_switch+0x1b9/frame 0xf36b5a20 sleepq_catch_signals(0,c1084241,164,930,1,...) at sleepq_catch_signals+0x3b1/frame 0xf36b5a68 sleepq_wait_sig(ca1de270,0,c1088f85,101,0,...) at sleepq_wait_sig+0x14/frame 0xf36b5a8c _cv_wait_sig(ca1de270,c14139a4,c1088f71,531,f36b5c10,...) at _cv_wait_sig+0x200/frame 0xf36b5ad4 tty_wait(ca1de200,ca1de270,f36b5c10,1,0,...) at tty_wait+0x4b/frame 0xf36b5af8 ttydisc_read(ca1de200,f36b5c10,0,a1,f36b5c10,...) at ttydisc_read+0x377/frame 0xf36b5b3c ttydev_read(ca1b7500,f36b5c10,0,1,0,...) at ttydev_read+0x81/frame 0xf36b5b5c devfs_read_f(cc870738,f36b5c10,c9ea0e00,0,cb633bc0,...) at devfs_read_f+0x87/frame 0xf36b5b90 dofileread(cc870738,f36b5c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf36b5bc4 kern_readv(cb633bc0,0,f36b5c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf36b5bf0 sys_read(cb633bc0,f36b5cc8,f36b5d08,1,1,...) at sys_read+0x5c/frame 0xf36b5c40 syscall(f36b5d08) at syscall+0x2ed/frame 0xf36b5cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf36b5cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28190367, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1141 tid 100093 td 0xcc8642f0 sched_switch(cc8642f0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf36329b8 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xf36329ec sleepq_switch(cc8642f0,0,c1084241,1ab,f3632a64,...) at sleepq_switch+0x1b9/frame 0xf3632a20 sleepq_catch_signals(0,c1084241,164,960,1,...) at sleepq_catch_signals+0x3b1/frame 0xf3632a68 sleepq_wait_sig(ca1de470,0,c1088f85,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3632a8c _cv_wait_sig(ca1de470,c14139a4,c1088f71,531,f3632c10,...) at _cv_wait_sig+0x200/frame 0xf3632ad4 tty_wait(ca1de400,ca1de470,f3632c10,1,0,...) at tty_wait+0x4b/frame 0xf3632af8 ttydisc_read(ca1de400,f3632c10,0,a1,f3632c10,...) at ttydisc_read+0x377/frame 0xf3632b3c ttydev_read(ca1b7600,f3632c10,0,1,0,...) at ttydev_read+0x81/frame 0xf3632b5c devfs_read_f(cc8aba10,f3632c10,c9ea0e00,0,cc8642f0,...) at devfs_read_f+0x87/frame 0xf3632b90 dofileread(cc8aba10,f3632c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf3632bc4 kern_readv(cc8642f0,0,f3632c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf3632bf0 sys_read(cc8642f0,f3632cc8,f3632d08,1,1,...) at sys_read+0x5c/frame 0xf3632c40 syscall(f3632d08) at syscall+0x2ed/frame 0xf3632cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3632cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28190367, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1140 tid 100119 td 0xccd4f8d0 sched_switch(ccd4f8d0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf36d09b8 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xf36d09ec sleepq_switch(ccd4f8d0,0,c1084241,1ab,f36d0a64,...) at sleepq_switch+0x1b9/frame 0xf36d0a20 sleepq_catch_signals(0,c1084241,164,480,1,...) at sleepq_catch_signals+0x3b1/frame 0xf36d0a68 sleepq_wait_sig(ca02b070,0,c1088f85,101,0,...) at sleepq_wait_sig+0x14/frame 0xf36d0a8c _cv_wait_sig(ca02b070,c14139a4,c1088f71,531,f36d0c10,...) at _cv_wait_sig+0x200/frame 0xf36d0ad4 tty_wait(ca02b000,ca02b070,f36d0c10,1,0,...) at tty_wait+0x4b/frame 0xf36d0af8 ttydisc_read(ca02b000,f36d0c10,0,a1,f36d0c10,...) at ttydisc_read+0x377/frame 0xf36d0b3c ttydev_read(ca1b7700,f36d0c10,0,1,0,...) at ttydev_read+0x81/frame 0xf36d0b5c devfs_read_f(cc8a5a10,f36d0c10,c9ea0e00,0,ccd4f8d0,...) at devfs_read_f+0x87/frame 0xf36d0b90 dofileread(cc8a5a10,f36d0c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf36d0bc4 kern_readv(ccd4f8d0,0,f36d0c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf36d0bf0 sys_read(ccd4f8d0,f36d0cc8,f36d0d08,1,1,...) at sys_read+0x5c/frame 0xf36d0c40 syscall(f36d0d08) at syscall+0x2ed/frame 0xf36d0cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf36d0cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28190367, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1139 tid 100141 td 0xcd2702f0 sched_switch(cd2702f0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf37459b8 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xf37459ec sleepq_switch(cd2702f0,0,c1084241,1ab,f3745a64,...) at sleepq_switch+0x1b9/frame 0xf3745a20 sleepq_catch_signals(0,c1084241,164,4b0,1,...) at sleepq_catch_signals+0x3b1/frame 0xf3745a68 sleepq_wait_sig(ca02b270,0,c1088f85,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3745a8c _cv_wait_sig(ca02b270,c14139a4,c1088f71,531,f3745c10,...) at _cv_wait_sig+0x200/frame 0xf3745ad4 tty_wait(ca02b200,ca02b270,f3745c10,1,0,...) at tty_wait+0x4b/frame 0xf3745af8 ttydisc_read(ca02b200,f3745c10,0,a1,f3745c10,...) at ttydisc_read+0x377/frame 0xf3745b3c ttydev_read(ca1b7800,f3745c10,0,1,0,...) at ttydev_read+0x81/frame 0xf3745b5c devfs_read_f(cd085310,f3745c10,c9ea0e00,0,cd2702f0,...) at devfs_read_f+0x87/frame 0xf3745b90 dofileread(cd085310,f3745c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf3745bc4 kern_readv(cd2702f0,0,f3745c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf3745bf0 sys_read(cd2702f0,f3745cc8,f3745d08,1,1,...) at sys_read+0x5c/frame 0xf3745c40 syscall(f3745d08) at syscall+0x2ed/frame 0xf3745cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3745cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28190367, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1138 tid 100144 td 0xccd4f000 sched_switch(ccd4f000,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf374f9b8 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xf374f9ec sleepq_switch(ccd4f000,0,c1084241,1ab,f374fa64,...) at sleepq_switch+0x1b9/frame 0xf374fa20 sleepq_catch_signals(0,c1084241,164,4e0,1,...) at sleepq_catch_signals+0x3b1/frame 0xf374fa68 sleepq_wait_sig(ca02b470,0,c1088f85,101,0,...) at sleepq_wait_sig+0x14/frame 0xf374fa8c _cv_wait_sig(ca02b470,c14139a4,c1088f71,531,f374fc10,...) at _cv_wait_sig+0x200/frame 0xf374fad4 tty_wait(ca02b400,ca02b470,f374fc10,1,0,...) at tty_wait+0x4b/frame 0xf374faf8 ttydisc_read(ca02b400,f374fc10,0,a1,f374fc10,...) at ttydisc_read+0x377/frame 0xf374fb3c ttydev_read(ca1b7900,f374fc10,0,1,0,...) at ttydev_read+0x81/frame 0xf374fb5c devfs_read_f(cd25c1f8,f374fc10,c9ea0e00,0,ccd4f000,...) at devfs_read_f+0x87/frame 0xf374fb90 dofileread(cd25c1f8,f374fc10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf374fbc4 kern_readv(ccd4f000,0,f374fc10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf374fbf0 sys_read(ccd4f000,f374fcc8,f374fd08,1,1,...) at sys_read+0x5c/frame 0xf374fc40 syscall(f374fd08) at syscall+0x2ed/frame 0xf374fcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf374fcfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28190367, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1137 tid 100118 td 0xccd4fbc0 sched_switch(ccd4fbc0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf36cd9b8 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xf36cd9ec sleepq_switch(ccd4fbc0,0,c1084241,1ab,f36cda64,...) at sleepq_switch+0x1b9/frame 0xf36cda20 sleepq_catch_signals(0,c1084241,164,510,1,...) at sleepq_catch_signals+0x3b1/frame 0xf36cda68 sleepq_wait_sig(ca02b670,0,c1088f85,101,0,...) at sleepq_wait_sig+0x14/frame 0xf36cda8c _cv_wait_sig(ca02b670,c14139a4,c1088f71,531,f36cdc10,...) at _cv_wait_sig+0x200/frame 0xf36cdad4 tty_wait(ca02b600,ca02b670,f36cdc10,1,0,...) at tty_wait+0x4b/frame 0xf36cdaf8 ttydisc_read(ca02b600,f36cdc10,0,a1,f36cdc10,...) at ttydisc_read+0x377/frame 0xf36cdb3c ttydev_read(ca1b7a00,f36cdc10,0,1,0,...) at ttydev_read+0x81/frame 0xf36cdb5c devfs_read_f(cd25c6c8,f36cdc10,c9ea0e00,0,ccd4fbc0,...) at devfs_read_f+0x87/frame 0xf36cdb90 dofileread(cd25c6c8,f36cdc10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf36cdbc4 kern_readv(ccd4fbc0,0,f36cdc10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf36cdbf0 sys_read(ccd4fbc0,f36cdcc8,f36cdd08,1,1,...) at sys_read+0x5c/frame 0xf36cdc40 syscall(f36cdd08) at syscall+0x2ed/frame 0xf36cdcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf36cdcfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28190367, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1136 tid 100109 td 0xcc860000 sched_switch(cc860000,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf36b29b8 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xf36b29ec sleepq_switch(cc860000,0,c1084241,1ab,f36b2a64,...) at sleepq_switch+0x1b9/frame 0xf36b2a20 sleepq_catch_signals(0,c1084241,164,540,1,...) at sleepq_catch_signals+0x3b1/frame 0xf36b2a68 sleepq_wait_sig(ca02b870,0,c1088f85,101,0,...) at sleepq_wait_sig+0x14/frame 0xf36b2a8c _cv_wait_sig(ca02b870,c14139a4,c1088f71,531,f36b2c10,...) at _cv_wait_sig+0x200/frame 0xf36b2ad4 tty_wait(ca02b800,ca02b870,f36b2c10,1,0,...) at tty_wait+0x4b/frame 0xf36b2af8 ttydisc_read(ca02b800,f36b2c10,0,a1,f36b2c10,...) at ttydisc_read+0x377/frame 0xf36b2b3c ttydev_read(ca1b7b00,f36b2c10,0,1,0,...) at ttydev_read+0x81/frame 0xf36b2b5c devfs_read_f(cc8aba80,f36b2c10,c9ea0e00,0,cc860000,...) at devfs_read_f+0x87/frame 0xf36b2b90 dofileread(cc8aba80,f36b2c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf36b2bc4 kern_readv(cc860000,0,f36b2c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf36b2bf0 sys_read(cc860000,f36b2cc8,f36b2d08,1,1,...) at sys_read+0x5c/frame 0xf36b2c40 syscall(f36b2d08) at syscall+0x2ed/frame 0xf36b2cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf36b2cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28190367, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1135 tid 100154 td 0xcc9118d0 sched_switch(cc9118d0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf37709b8 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xf37709ec sleepq_switch(cc9118d0,0,c1084241,1ab,f3770a64,...) at sleepq_switch+0x1b9/frame 0xf3770a20 sleepq_catch_signals(0,c1084241,164,570,1,...) at sleepq_catch_signals+0x3b1/frame 0xf3770a68 sleepq_wait_sig(ca02ba70,0,c1088f85,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3770a8c _cv_wait_sig(ca02ba70,c14139a4,c1088f71,531,f3770c10,...) at _cv_wait_sig+0x200/frame 0xf3770ad4 tty_wait(ca02ba00,ca02ba70,f3770c10,1,0,...) at tty_wait+0x4b/frame 0xf3770af8 ttydisc_read(ca02ba00,f3770c10,0,a1,f3770c10,...) at ttydisc_read+0x377/frame 0xf3770b3c ttydev_read(ca1b7c00,f3770c10,0,1,0,...) at ttydev_read+0x81/frame 0xf3770b5c devfs_read_f(cc8917e0,f3770c10,c9ea0e00,0,cc9118d0,...) at devfs_read_f+0x87/frame 0xf3770b90 dofileread(cc8917e0,f3770c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf3770bc4 kern_readv(cc9118d0,0,f3770c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf3770bf0 sys_read(cc9118d0,f3770cc8,f3770d08,1,1,...) at sys_read+0x5c/frame 0xf3770c40 syscall(f3770d08) at syscall+0x2ed/frame 0xf3770cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3770cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28190367, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1134 tid 100090 td 0xcc9112f0 sched_switch(cc9112f0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf36269b8 mi_switch(104,0,c1084241,1f7,46,...) at mi_switch+0x1c9/frame 0xf36269ec sleepq_switch(cc9112f0,0,c1084241,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf3626a20 sleepq_catch_signals(f3626a8c,c0a7c409,ca02bc14,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3626a68 sleepq_wait_sig(ca02bc70,0,f3626ac0,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3626a8c _cv_wait_sig(ca02bc70,ca02bc04,c1088f71,531,f3626c10,...) at _cv_wait_sig+0x200/frame 0xf3626ad4 tty_wait(ca02bc00,ca02bc70,f3626c10,1,0,...) at tty_wait+0x4b/frame 0xf3626af8 ttydisc_read(ca02bc00,f3626c10,0,a1,f3626c10,...) at ttydisc_read+0x377/frame 0xf3626b3c ttydev_read(ca012d00,f3626c10,0,1,0,...) at ttydev_read+0x81/frame 0xf3626b5c devfs_read_f(cc891000,f3626c10,c9ea0e00,0,cc9112f0,...) at devfs_read_f+0x87/frame 0xf3626b90 dofileread(cc891000,f3626c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf3626bc4 kern_readv(cc9112f0,0,f3626c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf3626bf0 sys_read(cc9112f0,f3626cc8,f3626d08,1,1,...) at sys_read+0x5c/frame 0xf3626c40 syscall(f3626d08) at syscall+0x2ed/frame 0xf3626cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3626cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28190367, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command inetd pid 1117 tid 100136 td 0xcc8f82f0 sched_switch(cc8f82f0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf371f918 mi_switch(104,0,c1084241,1f7,46,...) at mi_switch+0x1c9/frame 0xf371f94c sleepq_switch(cc8f82f0,0,c1084241,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf371f980 sleepq_catch_signals(f371f9ec,c0a7c409,cc74ade0,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf371f9c8 sleepq_wait_sig(cc74ade4,0,f371fa20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf371f9ec _cv_wait_sig(cc74ade4,cc74add0,c1086fc0,677,8,...) at _cv_wait_sig+0x200/frame 0xf371fa34 seltdwait(cd25c9d8,58,c9ea0e00,cc8f82f0,ccd408f8,...) at seltdwait+0x8c/frame 0xf371fa58 kern_select(cc8f82f0,8,bfbfd008,0,0,...) at kern_select+0x85f/frame 0xf371fbf8 sys_select(cc8f82f0,f371fcc8,f371fc8c,c0a61d70,c1238710,...) at sys_select+0x69/frame 0xf371fc40 syscall(f371fd08) at syscall+0x2ed/frame 0xf371fcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf371fcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a3327, esp = 0xbfbfcf84, ebp = 0xbfbfde34 --- Tracing command watchdogd pid 1092 tid 100094 td 0xcc8a3000 sched_switch(cc8a3000,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf3636a80 mi_switch(104,0,c1084241,1f7,c1414480,...) at mi_switch+0x1c9/frame 0xf3636ab4 sleepq_switch(cc8a3000,0,c1084241,1ab,f3636b2c,...) at sleepq_switch+0x1b9/frame 0xf3636ae8 sleepq_catch_signals(ea61,c0ad1d10,cc8a3000,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3636b30 sleepq_timedwait_sig(c122c520,6c,c107fd72,100,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3636b58 _sleep(c122c520,0,16c,c107fd72,ea61,...) at _sleep+0x303/frame 0xf3636bb0 kern_nanosleep(bfbfdd08,f3636c18,f3636c20,de350030,3c,...) at kern_nanosleep+0xd9/frame 0xf3636c00 sys_nanosleep(cc8a3000,f3636cc8,14,c1080bb9,7b3,...) at sys_nanosleep+0x6b/frame 0xf3636c40 syscall(f3636d08) at syscall+0x2ed/frame 0xf3636cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3636cfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2816a9bf, esp = 0xbfbfdcfc, ebp = 0xbfbfdd40 --- Tracing command awk pid 815 tid 100086 td 0xcc8648d0 sched_switch(cc8648d0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf3615a30 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xf3615a64 sleepq_switch(cc8648d0,0,c1084241,1ab,f3615adc,...) at sleepq_switch+0x1b9/frame 0xf3615a98 sleepq_catch_signals(0,c1084241,164,90,cc8648d0,...) at sleepq_catch_signals+0x3b1/frame 0xf3615ae0 sleepq_wait_sig(cc8a8660,5c,c1087205,100,0,...) at sleepq_wait_sig+0x14/frame 0xf3615b04 _sleep(cc8a8660,cc8a87e0,15c,c1087205,0,...) at _sleep+0x32d/frame 0xf3615b5c pipe_read(cd0852a0,f3615c10,cc8bd800,0,cc8648d0,...) at pipe_read+0x29c/frame 0xf3615b90 dofileread(cd0852a0,f3615c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf3615bc4 kern_readv(cc8648d0,0,f3615c10,0,28855000,...) at kern_readv+0x66/frame 0xf3615bf0 sys_read(cc8648d0,f3615cc8,f3615d08,1,1,...) at sys_read+0x5c/frame 0xf3615c40 syscall(f3615d08) at syscall+0x2ed/frame 0xf3615cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3615cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b6367, esp = 0xbfbfd9e4, ebp = 0xbfbfd9f8 --- Tracing command sh pid 814 tid 100112 td 0xcb6335e0 sched_switch(cb6335e0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf36bb998 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xf36bb9cc sleepq_switch(cb6335e0,0,c1084241,1ab,f36bba44,...) at sleepq_switch+0x1b9/frame 0xf36bba00 sleepq_catch_signals(0,c1084241,164,a08,cb6335e0,...) at sleepq_catch_signals+0x3b1/frame 0xf36bba48 sleepq_wait_sig(ccd3eb40,6c,c10876f5,100,0,...) at sleepq_wait_sig+0x14/frame 0xf36bba6c _sleep(ccd3eb40,ccd3ebc8,16c,c10876f5,0,...) at _sleep+0x32d/frame 0xf36bbac4 kern_wait6(cb6335e0,7,0,0,f36bbb4c,...) at kern_wait6+0x43c/frame 0xf36bbb20 sys_wait4(cb6335e0,f36bbcc8,c10d5a33,e9,1,...) at sys_wait4+0x94/frame 0xf36bbc40 syscall(f36bbd08) at syscall+0x2ed/frame 0xf36bbcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf36bbcfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281502ef, esp = 0xbfbfd958, ebp = 0xbfbfd970 --- Tracing command tail pid 813 tid 100163 td 0xcdca32f0 sched_switch(cdca32f0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf378e948 mi_switch(104,0,c1084241,1f7,c1414580,...) at mi_switch+0x1c9/frame 0xf378e97c sleepq_switch(cdca32f0,0,c1084241,1ab,f378e9f4,...) at sleepq_switch+0x1b9/frame 0xf378e9b0 sleepq_catch_signals(3e9,c0ad1d10,cdca32f0,1,1,...) at sleepq_catch_signals+0x3b1/frame 0xf378e9f8 sleepq_timedwait_sig(cd3bcb00,68,c1077d40,100,0,...) at sleepq_timedwait_sig+0x14/frame 0xf378ea20 _sleep(cd3bcb00,cd3bcb00,168,c1077d40,3e9,...) at _sleep+0x303/frame 0xf378ea78 kern_kevent(cdca32f0,4,0,1,f378ec10,...) at kern_kevent+0x444/frame 0xf378ebb8 sys_kevent(cdca32f0,f378ecc8,14,c1080bb9,7b3,...) at sys_kevent+0x12b/frame 0xf378ec40 syscall(f378ed08) at syscall+0x2ed/frame 0xf378ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf378ecfc --- syscall (363, FreeBSD ELF32, sys_kevent), eip = 0x2815bb1f, esp = 0xbfbfdb9c, ebp = 0xbfbfdc48 --- Tracing command sshd pid 812 tid 100113 td 0xcb6332f0 sched_switch(cb6332f0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf36be918 mi_switch(104,0,c1084241,1f7,200046,...) at mi_switch+0x1c9/frame 0xf36be94c sleepq_switch(cb6332f0,0,c1084241,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf36be980 sleepq_catch_signals(f36be9ec,c0a7c409,cc85f460,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf36be9c8 sleepq_wait_sig(cc85f464,0,f36bea20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf36be9ec _cv_wait_sig(cc85f464,cc85f450,c1086fc0,677,c,...) at _cv_wait_sig+0x200/frame 0xf36bea34 seltdwait(cd0858f8,58,cc72ca80,cb6332f0,c1376400,...) at seltdwait+0x8c/frame 0xf36bea58 kern_select(cb6332f0,c,28c0c1c8,28c0c1d0,0,...) at kern_select+0x85f/frame 0xf36bebf8 sys_select(cb6332f0,f36becc8,f36bed08,1,1,...) at sys_select+0x69/frame 0xf36bec40 syscall(f36bed08) at syscall+0x2ed/frame 0xf36becfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf36becfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28516327, esp = 0xbfbfd3cc, ebp = 0xbfbfd418 --- Tracing command top pid 811 tid 100088 td 0xcc8fabc0 sched_switch(cc8fabc0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf361d914 mi_switch(104,0,c1084241,1f7,c1414580,...) at mi_switch+0x1c9/frame 0xf361d948 sleepq_switch(cc8fabc0,0,c1084241,1ab,cc89cb50,...) at sleepq_switch+0x1b9/frame 0xf361d97c sleepq_catch_signals(c11b2dc4,f361d9ec,c0a7c409,cc89cb60,0,...) at sleepq_catch_signals+0x3b1/frame 0xf361d9c4 sleepq_timedwait_sig(cc89cb64,0,f361da20,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf361d9ec _cv_timedwait_sig(cc89cb64,cc89cb50,3e9,677,f361dac0,...) at _cv_timedwait_sig+0x20c/frame 0xf361da34 seltdwait(f361dac0,f361dac8,cc82d480,cc8fabc0,31204830,...) at seltdwait+0x7e/frame 0xf361da58 kern_select(cc8fabc0,2,bfbfdbe8,0,0,...) at kern_select+0x85f/frame 0xf361dbf8 sys_select(cc8fabc0,f361dcc8,f361dd08,1,1,...) at sys_select+0x69/frame 0xf361dc40 syscall(f361dd08) at syscall+0x2ed/frame 0xf361dcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf361dcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281e8327, esp = 0xbfbfdb7c, ebp = 0xbfbfdcf4 --- Tracing command sh pid 810 tid 100162 td 0xcd26d8d0 Tracing command sshd pid 809 tid 100082 td 0xcc8a3bc0 sched_switch(cc8a3bc0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf3605918 mi_switch(104,0,c1084241,1f7,200046,...) at mi_switch+0x1c9/frame 0xf360594c sleepq_switch(cc8a3bc0,0,c1084241,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf3605980 sleepq_catch_signals(f36059ec,c0a7c409,cc85f5e0,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf36059c8 sleepq_wait_sig(cc85f5e4,0,f3605a20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf36059ec _cv_wait_sig(cc85f5e4,cc85f5d0,c1086fc0,677,a,...) at _cv_wait_sig+0x200/frame 0xf3605a34 seltdwait(cc871540,58,cc826d80,cc8a3bc0,c1376770,...) at seltdwait+0x8c/frame 0xf3605a58 kern_select(cc8a3bc0,a,28c0c1c8,28c0c1d0,0,...) at kern_select+0x85f/frame 0xf3605bf8 sys_select(cc8a3bc0,f3605cc8,f3605d08,1,1,...) at sys_select+0x69/frame 0xf3605c40 syscall(f3605d08) at syscall+0x2ed/frame 0xf3605cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3605cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28516327, esp = 0xbfbfd3cc, ebp = 0xbfbfd418 --- Tracing command sshd pid 808 tid 100099 td 0xcc8608d0 sched_switch(cc8608d0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf3650918 mi_switch(104,0,c1084241,1f7,200046,...) at mi_switch+0x1c9/frame 0xf365094c sleepq_switch(cc8608d0,0,c1084241,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf3650980 sleepq_catch_signals(f36509ec,c0a7c409,cc74a7a0,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf36509c8 sleepq_wait_sig(cc74a7a4,0,f3650a20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf36509ec _cv_wait_sig(cc74a7a4,cc74a790,c1086fc0,677,c,...) at _cv_wait_sig+0x200/frame 0xf3650a34 seltdwait(cc891770,58,cc72cb80,cc8608d0,c1375f30,...) at seltdwait+0x8c/frame 0xf3650a58 kern_select(cc8608d0,c,28c0c1c8,28c0c1d0,0,...) at kern_select+0x85f/frame 0xf3650bf8 sys_select(cc8608d0,f3650cc8,f3650d08,1,1,...) at sys_select+0x69/frame 0xf3650c40 syscall(f3650d08) at syscall+0x2ed/frame 0xf3650cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3650cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28516327, esp = 0xbfbfd3cc, ebp = 0xbfbfd418 --- Tracing command sshd pid 804 tid 100159 td 0xcd26dbc0 sched_switch(cd26dbc0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf377f988 mi_switch(104,0,c1084241,1f7,200046,...) at mi_switch+0x1c9/frame 0xf377f9bc sleepq_switch(cd26dbc0,0,c1084241,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf377f9f0 sleepq_catch_signals(f377fa5c,c0a7c409,ccff8220,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf377fa38 sleepq_wait_sig(ccff8224,0,f377fa90,101,0,...) at sleepq_wait_sig+0x14/frame 0xf377fa5c _cv_wait_sig(ccff8224,ccff8210,c1086fc0,677,cd26dbc0,...) at _cv_wait_sig+0x200/frame 0xf377faa4 seltdwait(ccf9222c,c1086fc0,5ac,cd26dbc0,cd26dbc0,...) at seltdwait+0x8c/frame 0xf377fac8 sys_poll(cd26dbc0,f377fcc8,14,c1080bb9,7b3,...) at sys_poll+0x3e5/frame 0xf377fc40 syscall(f377fd08) at syscall+0x2ed/frame 0xf377fcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf377fcfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284ad06f, esp = 0xbfbfd414, ebp = 0xbfbfd460 --- Tracing command sshd pid 803 tid 100158 td 0xcd26f000 sched_switch(cd26f000,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf377c988 mi_switch(104,0,c1084241,1f7,200046,...) at mi_switch+0x1c9/frame 0xf377c9bc sleepq_switch(cd26f000,0,c1084241,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf377c9f0 sleepq_catch_signals(f377ca5c,c0a7c409,ccff85e0,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf377ca38 sleepq_wait_sig(ccff85e4,0,f377ca90,101,0,...) at sleepq_wait_sig+0x14/frame 0xf377ca5c _cv_wait_sig(ccff85e4,ccff85d0,c1086fc0,677,cd26f000,...) at _cv_wait_sig+0x200/frame 0xf377caa4 seltdwait(cc75412c,c1086fc0,5ac,cd26f000,c9f093a0,...) at seltdwait+0x8c/frame 0xf377cac8 sys_poll(cd26f000,f377ccc8,f377cc8c,c0a61d70,c1238710,...) at sys_poll+0x3e5/frame 0xf377cc40 syscall(f377cd08) at syscall+0x2ed/frame 0xf377ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf377ccfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284ad06f, esp = 0xbfbfd414, ebp = 0xbfbfd460 --- Tracing command sshd pid 802 tid 100157 td 0xcd26f2f0 sched_switch(cd26f2f0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf3779988 mi_switch(104,0,c1084241,1f7,200046,...) at mi_switch+0x1c9/frame 0xf37799bc sleepq_switch(cd26f2f0,0,c1084241,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf37799f0 sleepq_catch_signals(f3779a5c,c0a7c409,cc85f660,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3779a38 sleepq_wait_sig(cc85f664,0,f3779a90,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3779a5c _cv_wait_sig(cc85f664,cc85f650,c1086fc0,677,cd26f2f0,...) at _cv_wait_sig+0x200/frame 0xf3779aa4 seltdwait(ccf9172c,c1086fc0,5ac,cd26f2f0,cd26f2f0,...) at seltdwait+0x8c/frame 0xf3779ac8 sys_poll(cd26f2f0,f3779cc8,f3779d08,1,1,...) at sys_poll+0x3e5/frame 0xf3779c40 syscall(f3779d08) at syscall+0x2ed/frame 0xf3779cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3779cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284ad06f, esp = 0xbfbfd414, ebp = 0xbfbfd460 --- Tracing command bash pid 795 tid 100153 td 0xcd26f5e0 Tracing command sshd pid 794 tid 100152 td 0xcc911bc0 sched_switch(cc911bc0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf3769918 mi_switch(104,0,c1084241,1f7,200046,...) at mi_switch+0x1c9/frame 0xf376994c sleepq_switch(cc911bc0,0,c1084241,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf3769980 sleepq_catch_signals(f37699ec,c0a7c409,cc85f8a0,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf37699c8 sleepq_wait_sig(cc85f8a4,0,f3769a20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf37699ec _cv_wait_sig(cc85f8a4,cc85f890,c1086fc0,677,c,...) at _cv_wait_sig+0x200/frame 0xf3769a34 seltdwait(cc871888,58,cc826100,cc911bc0,c1376198,...) at seltdwait+0x8c/frame 0xf3769a58 kern_select(cc911bc0,c,28c0c1c8,28c0c1d0,0,...) at kern_select+0x85f/frame 0xf3769bf8 sys_select(cc911bc0,f3769cc8,7b3,0,f3769cc4,...) at sys_select+0x69/frame 0xf3769c40 syscall(f3769d08) at syscall+0x2ed/frame 0xf3769cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3769cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28516327, esp = 0xbfbfd3cc, ebp = 0xbfbfd418 --- Tracing command sshd pid 792 tid 100150 td 0xccd4e2f0 sched_switch(ccd4e2f0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf3763988 mi_switch(104,0,c1084241,1f7,200046,...) at mi_switch+0x1c9/frame 0xf37639bc sleepq_switch(ccd4e2f0,0,c1084241,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf37639f0 sleepq_catch_signals(f3763a5c,c0a7c409,cc74a220,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3763a38 sleepq_wait_sig(cc74a224,0,f3763a90,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3763a5c _cv_wait_sig(cc74a224,cc74a210,c1086fc0,677,ccd4e2f0,...) at _cv_wait_sig+0x200/frame 0xf3763aa4 seltdwait(ccf9132c,c1086fc0,5ac,ccd4e2f0,ffffff80,...) at seltdwait+0x8c/frame 0xf3763ac8 sys_poll(ccd4e2f0,f3763cc8,f3763d08,1,1,...) at sys_poll+0x3e5/frame 0xf3763c40 syscall(f3763d08) at syscall+0x2ed/frame 0xf3763cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3763cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284ad06f, esp = 0xbfbfd414, ebp = 0xbfbfd460 --- Tracing command cron pid 746 tid 100124 td 0xcc8fa000 sched_switch(cc8fa000,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf36f2a80 mi_switch(104,0,c1084241,1f7,c1414680,...) at mi_switch+0x1c9/frame 0xf36f2ab4 sleepq_switch(cc8fa000,0,c1084241,1ab,f36f2b2c,...) at sleepq_switch+0x1b9/frame 0xf36f2ae8 sleepq_catch_signals(a7be,c0ad1d10,cc8fa000,2,2,...) at sleepq_catch_signals+0x3b1/frame 0xf36f2b30 sleepq_timedwait_sig(c122c520,6c,c107fd72,100,0,...) at sleepq_timedwait_sig+0x14/frame 0xf36f2b58 _sleep(c122c520,0,16c,c107fd72,a7be,...) at _sleep+0x303/frame 0xf36f2bb0 kern_nanosleep(bfbfde28,f36f2c18,f36f2c20,f36f2cc8,2a,...) at kern_nanosleep+0xd9/frame 0xf36f2c00 sys_nanosleep(cc8fa000,f36f2cc8,f36f2d08,1,1,...) at sys_nanosleep+0x6b/frame 0xf36f2c40 syscall(f36f2d08) at syscall+0x2ed/frame 0xf36f2cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf36f2cfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x281799bf, esp = 0xbfbfdcb4, ebp = 0xbfbfde44 --- Tracing command sendmail pid 741 tid 100102 td 0xcc9102f0 sched_switch(cc9102f0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf365cab4 mi_switch(104,0,c1084241,1f7,c1084241,...) at mi_switch+0x1c9/frame 0xf365cae8 sleepq_switch(cc9102f0,0,c1084241,1ab,f365cb60,...) at sleepq_switch+0x1b9/frame 0xf365cb1c sleepq_catch_signals(0,c1084241,164,a08,cc9102f0,...) at sleepq_catch_signals+0x3b1/frame 0xf365cb64 sleepq_wait_sig(cc906b98,74,c0efdc28,100,0,...) at sleepq_wait_sig+0x14/frame 0xf365cb88 _sleep(cc906b98,cc906bc8,174,c0efdc28,0,...) at _sleep+0x32d/frame 0xf365cbe0 kern_sigsuspend(cc9102f0,0,0,0,0,...) at kern_sigsuspend+0xdb/frame 0xf365cc10 sys_sigsuspend(cc9102f0,f365ccc8,1,0,cc9102f0,...) at sys_sigsuspend+0x58/frame 0xf365cc40 syscall(f365cd08) at syscall+0x2ed/frame 0xf365ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf365ccfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x28352637, esp = 0xbfbfbf8c, ebp = 0xbfbfbfb8 --- Tracing command sendmail pid 738 tid 100131 td 0xcc8f88d0 sched_switch(cc8f88d0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf3707914 mi_switch(104,0,c1084241,1f7,c1414780,...) at mi_switch+0x1c9/frame 0xf3707948 sleepq_switch(cc8f88d0,0,c1084241,1ab,cc74ac50,...) at sleepq_switch+0x1b9/frame 0xf370797c sleepq_catch_signals(c11b2dc4,f37079ec,c0a7c409,cc74ac60,0,...) at sleepq_catch_signals+0x3b1/frame 0xf37079c4 sleepq_timedwait_sig(cc74ac64,0,f3707a20,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf37079ec _cv_timedwait_sig(cc74ac64,cc74ac50,1389,677,f3707ac0,...) at _cv_timedwait_sig+0x20c/frame 0xf3707a34 seltdwait(f3707ac0,f3707ac8,cc72c780,cc8f88d0,f3707aa0,...) at seltdwait+0x7e/frame 0xf3707a58 kern_select(cc8f88d0,5,bfbfb478,0,0,...) at kern_select+0x85f/frame 0xf3707bf8 sys_select(cc8f88d0,f3707cc8,0,0,cc8f88d0,...) at sys_select+0x69/frame 0xf3707c40 syscall(f3707d08) at syscall+0x2ed/frame 0xf3707cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3707cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2840e327, esp = 0xbfbfb36c, ebp = 0xbfbfbf98 --- Tracing command sshd pid 735 tid 100116 td 0xccd502f0 sched_switch(ccd502f0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf36c7918 mi_switch(104,0,c1084241,1f7,200046,...) at mi_switch+0x1c9/frame 0xf36c794c sleepq_switch(ccd502f0,0,c1084241,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf36c7980 sleepq_catch_signals(f36c79ec,c0a7c409,cc74ab60,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf36c79c8 sleepq_wait_sig(cc74ab64,0,f36c7a20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf36c79ec _cv_wait_sig(cc74ab64,cc74ab50,c1086fc0,677,5,...) at _cv_wait_sig+0x200/frame 0xf36c7a34 seltdwait(cc8917a8,58,cc82d600,ccd502f0,0,...) at seltdwait+0x8c/frame 0xf36c7a58 kern_select(ccd502f0,9,28c0c140,0,0,...) at kern_select+0x85f/frame 0xf36c7bf8 sys_select(ccd502f0,f36c7cc8,0,0,ccd502f0,...) at sys_select+0x69/frame 0xf36c7c40 syscall(f36c7d08) at syscall+0x2ed/frame 0xf36c7cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf36c7cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28516327, esp = 0xbfbfd47c, ebp = 0xbfbfde44 --- Tracing command moused pid 703 tid 100103 td 0xcc910000 sched_switch(cc910000,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf3660918 mi_switch(104,0,c1084241,1f7,46,...) at mi_switch+0x1c9/frame 0xf366094c sleepq_switch(cc910000,0,c1084241,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf3660980 sleepq_catch_signals(f36609ec,c0a7c409,cc74aca0,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf36609c8 sleepq_wait_sig(cc74aca4,0,f3660a20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf36609ec _cv_wait_sig(cc74aca4,cc74ac90,c1086fc0,677,6,...) at _cv_wait_sig+0x200/frame 0xf3660a34 seltdwait(cc8707a8,58,c9ea0e00,cc910000,0,...) at seltdwait+0x8c/frame 0xf3660a58 kern_select(cc910000,400,bfbfdcb0,0,0,...) at kern_select+0x85f/frame 0xf3660bf8 sys_select(cc910000,f3660cc8,f3660d08,1,1,...) at sys_select+0x69/frame 0xf3660c40 syscall(f3660d08) at syscall+0x2ed/frame 0xf3660cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3660cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281b1327, esp = 0xbfbfd88c, ebp = 0xbfbfde24 --- Tracing command winbindd pid 698 tid 100114 td 0xccd508d0 sched_switch(ccd508d0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf36c1984 mi_switch(104,0,c1084241,1f7,c1414780,...) at mi_switch+0x1c9/frame 0xf36c19b8 sleepq_switch(ccd508d0,0,c1084241,1ab,cc74ae90,...) at sleepq_switch+0x1b9/frame 0xf36c19ec sleepq_catch_signals(c11b2dc4,f36c1a5c,c0a7c409,cc74aea0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf36c1a34 sleepq_timedwait_sig(cc74aea4,0,f36c1a90,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf36c1a5c _cv_timedwait_sig(cc74aea4,cc74ae90,5265c00,677,ccd508d0,...) at _cv_timedwait_sig+0x20c/frame 0xf36c1aa4 seltdwait(f36c1b10,f36c1b18,5ac,ccd508d0,cd0b3c80,...) at seltdwait+0x7e/frame 0xf36c1ac8 sys_poll(ccd508d0,f36c1cc8,f36c1d08,1,1,...) at sys_poll+0x3e5/frame 0xf36c1c40 syscall(f36c1d08) at syscall+0x2ed/frame 0xf36c1cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf36c1cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2192c06f, esp = 0xbfbfc47c, ebp = 0xbfbfc4b8 --- Tracing command smbd pid 691 tid 100092 td 0xcc8a32f0 sched_switch(cc8a32f0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf362e984 mi_switch(104,0,c1084241,1f7,c1414480,...) at mi_switch+0x1c9/frame 0xf362e9b8 sleepq_switch(cc8a32f0,0,c1084241,1ab,c9f089d0,...) at sleepq_switch+0x1b9/frame 0xf362e9ec sleepq_catch_signals(c11b2dc4,f362ea5c,c0a7c409,c9f089e0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf362ea34 sleepq_timedwait_sig(c9f089e4,0,f362ea90,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf362ea5c _cv_timedwait_sig(c9f089e4,c9f089d0,5265c00,677,cc8a32f0,...) at _cv_timedwait_sig+0x20c/frame 0xf362eaa4 seltdwait(f362eb10,f362eb18,5ac,cc8a32f0,c9f0a658,...) at seltdwait+0x7e/frame 0xf362eac8 sys_poll(cc8a32f0,f362ecc8,f362ed08,1,1,...) at sys_poll+0x3e5/frame 0xf362ec40 syscall(f362ed08) at syscall+0x2ed/frame 0xf362ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf362ecfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x21b5506f, esp = 0xbfbfd9ec, ebp = 0xbfbfda28 --- Tracing command winbindd pid 685 tid 100111 td 0xcb6338d0 sched_switch(cb6338d0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf36b8984 mi_switch(104,0,c1084241,1f7,c1414780,...) at mi_switch+0x1c9/frame 0xf36b89b8 sleepq_switch(cb6338d0,0,c1084241,1ab,c9f08b90,...) at sleepq_switch+0x1b9/frame 0xf36b89ec sleepq_catch_signals(c11b2dc4,f36b8a5c,c0a7c409,c9f08ba0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf36b8a34 sleepq_timedwait_sig(c9f08ba4,0,f36b8a90,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf36b8a5c _cv_timedwait_sig(c9f08ba4,c9f08b90,49394,677,cb6338d0,...) at _cv_timedwait_sig+0x20c/frame 0xf36b8aa4 seltdwait(f36b8b10,f36b8b18,5ac,cb6338d0,c9eaa338,...) at seltdwait+0x7e/frame 0xf36b8ac8 sys_poll(cb6338d0,f36b8cc8,14,c1080bb9,7b3,...) at sys_poll+0x3e5/frame 0xf36b8c40 syscall(f36b8d08) at syscall+0x2ed/frame 0xf36b8cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf36b8cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2192c06f, esp = 0xbfbfdbcc, ebp = 0xbfbfdc08 --- Tracing command smbd pid 683 tid 100089 td 0xcc9115e0 sched_switch(cc9115e0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf3622984 mi_switch(104,0,c1084241,1f7,c1414580,...) at mi_switch+0x1c9/frame 0xf36229b8 sleepq_switch(cc9115e0,0,c1084241,1ab,cc89c250,...) at sleepq_switch+0x1b9/frame 0xf36229ec sleepq_catch_signals(c11b2dc4,f3622a5c,c0a7c409,cc89c260,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3622a34 sleepq_timedwait_sig(cc89c264,0,f3622a90,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3622a5c _cv_timedwait_sig(cc89c264,cc89c250,ea61,677,cc9115e0,...) at _cv_timedwait_sig+0x20c/frame 0xf3622aa4 seltdwait(f3622b10,f3622b18,5ac,cc9115e0,0,...) at seltdwait+0x7e/frame 0xf3622ac8 sys_poll(cc9115e0,f3622cc8,0,0,cc9115e0,...) at sys_poll+0x3e5/frame 0xf3622c40 syscall(f3622d08) at syscall+0x2ed/frame 0xf3622cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3622cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x21b5506f, esp = 0xbfbfda9c, ebp = 0xbfbfdad8 --- Tracing command nmbd pid 681 tid 100107 td 0xcc8605e0 sched_switch(cc8605e0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf3678984 mi_switch(104,0,c1084241,1f7,c1414580,...) at mi_switch+0x1c9/frame 0xf36789b8 sleepq_switch(cc8605e0,0,c1084241,1ab,cc89c3d0,...) at sleepq_switch+0x1b9/frame 0xf36789ec sleepq_catch_signals(c11b2dc4,f3678a5c,c0a7c409,cc89c3e0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3678a34 sleepq_timedwait_sig(cc89c3e4,0,f3678a90,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3678a5c _cv_timedwait_sig(cc89c3e4,cc89c3d0,2711,677,cc8605e0,...) at _cv_timedwait_sig+0x20c/frame 0xf3678aa4 seltdwait(f3678b10,f3678b18,5ac,cc8605e0,0,...) at seltdwait+0x7e/frame 0xf3678ac8 sys_poll(cc8605e0,f3678cc8,f3678d08,1,1,...) at sys_poll+0x3e5/frame 0xf3678c40 syscall(f3678d08) at syscall+0x2ed/frame 0xf3678cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3678cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2155706f, esp = 0xbfbfdb1c, ebp = 0xbfbfdb58 --- Tracing command ntpd pid 657 tid 100079 td 0xcc8a45e0 sched_switch(cc8a45e0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf35f9918 mi_switch(104,0,c1084241,1f7,200046,...) at mi_switch+0x1c9/frame 0xf35f994c sleepq_switch(cc8a45e0,0,c1084241,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf35f9980 sleepq_catch_signals(f35f99ec,c0a7c409,cc90aa60,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf35f99c8 sleepq_wait_sig(cc90aa64,0,f35f9a20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf35f99ec _cv_wait_sig(cc90aa64,cc90aa50,c1086fc0,677,1c,...) at _cv_wait_sig+0x200/frame 0xf35f9a34 seltdwait(cc871b28,58,c9ea0e00,cc8a45e0,0,...) at seltdwait+0x8c/frame 0xf35f9a58 kern_select(cc8a45e0,1c,bfbfdd48,0,0,...) at kern_select+0x85f/frame 0xf35f9bf8 sys_select(cc8a45e0,f35f9cc8,0,0,cc8a45e0,...) at sys_select+0x69/frame 0xf35f9c40 syscall(f35f9d08) at syscall+0x2ed/frame 0xf35f9cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf35f9cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2838a327, esp = 0xbfbfdd24, ebp = 0xbfbfdde4 --- Tracing command nfsd pid 598 tid 100135 td 0xcc89e5e0 sched_switch(cc89e5e0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf3713a90 mi_switch(104,0,c1084241,1f7,c1414680,...) at mi_switch+0x1c9/frame 0xf3713ac4 sleepq_switch(cc89e5e0,0,c1084241,1ab,ca160980,...) at sleepq_switch+0x1b9/frame 0xf3713af8 sleepq_catch_signals(c11b2dc4,f3713b68,c0a7c409,ca160990,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3713b40 sleepq_timedwait_sig(cc7f2a90,0,f3713b9c,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3713b68 _cv_timedwait_sig(cc7f2a90,ca160980,1388,3b1,0,...) at _cv_timedwait_sig+0x20c/frame 0xf3713bb0 svc_run_internal(f3713cf4,c0a5f8af,ca160980,f3713d08,c1078230,...) at svc_run_internal+0xa50/frame 0xf3713cc4 svc_thread_start(ca160980,f3713d08,c1078230,3d7,0,...) at svc_thread_start+0xd/frame 0xf3713ccc fork_exit(c0c8a5c0,ca160980,f3713d08) at fork_exit+0x7f/frame 0xf3713cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf3713cf4 --- trap 0, eip = 0xc, esp = 0x33, ebp = 0xbfbfd9ef --- Tracing command nfsd pid 598 tid 100134 td 0xcc89e8d0 sched_switch(cc89e8d0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf3710a90 mi_switch(104,0,c1084241,1f7,c1414680,...) at mi_switch+0x1c9/frame 0xf3710ac4 sleepq_switch(cc89e8d0,0,c1084241,1ab,ca160980,...) at sleepq_switch+0x1b9/frame 0xf3710af8 sleepq_catch_signals(c11b2dc4,f3710b68,c0a7c409,ca160990,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3710b40 sleepq_timedwait_sig(cc7f2ad0,0,f3710b9c,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3710b68 _cv_timedwait_sig(cc7f2ad0,ca160980,1388,3b1,0,...) at _cv_timedwait_sig+0x20c/frame 0xf3710bb0 svc_run_internal(f3710cf4,c0a5f8af,ca160980,f3710d08,c1078230,...) at svc_run_internal+0xa50/frame 0xf3710cc4 svc_thread_start(ca160980,f3710d08,c1078230,3d7,0,...) at svc_thread_start+0xd/frame 0xf3710ccc fork_exit(c0c8a5c0,ca160980,f3710d08) at fork_exit+0x7f/frame 0xf3710cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf3710cf4 --- trap 0, eip = 0xc, esp = 0x33, ebp = 0xbfbfd9ef --- Tracing command nfsd pid 598 tid 100133 td 0xcc89ebc0 sched_switch(cc89ebc0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf370da90 mi_switch(104,0,c1084241,1f7,c1414580,...) at mi_switch+0x1c9/frame 0xf370dac4 sleepq_switch(cc89ebc0,0,c1084241,1ab,ca160980,...) at sleepq_switch+0x1b9/frame 0xf370daf8 sleepq_catch_signals(c11b2dc4,f370db68,c0a7c409,ca160990,0,...) at sleepq_catch_signals+0x3b1/frame 0xf370db40 sleepq_timedwait_sig(cc7f2b10,0,f370db9c,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf370db68 _cv_timedwait_sig(cc7f2b10,ca160980,1388,3b1,0,...) at _cv_timedwait_sig+0x20c/frame 0xf370dbb0 svc_run_internal(f370dcf4,c0a5f8af,ca160980,f370dd08,c1078230,...) at svc_run_internal+0xa50/frame 0xf370dcc4 svc_thread_start(ca160980,f370dd08,c1078230,3d7,0,...) at svc_thread_start+0xd/frame 0xf370dccc fork_exit(c0c8a5c0,ca160980,f370dd08) at fork_exit+0x7f/frame 0xf370dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf370dcf4 --- trap 0, eip = 0xc, esp = 0x33, ebp = 0xbfbfd9ef --- Tracing command nfsd pid 598 tid 100132 td 0xcc8f85e0 sched_switch(cc8f85e0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf370a318 mi_switch(104,0,c1084241,1f7,c1414480,...) at mi_switch+0x1c9/frame 0xf370a34c sleepq_switch(cc8f85e0,0,c1084241,1ab,ca160980,...) at sleepq_switch+0x1b9/frame 0xf370a380 sleepq_catch_signals(c11b2dc4,f370a3f0,c0a7c409,ca160990,0,...) at sleepq_catch_signals+0x3b1/frame 0xf370a3c8 sleepq_timedwait_sig(cc7f1450,0,f370a424,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf370a3f0 _cv_timedwait_sig(cc7f1450,ca160980,1388,3b1,c9ea2340,...) at _cv_timedwait_sig+0x20c/frame 0xf370a438 svc_run_internal(c0c8a5c0,ca160980,ccd40b40,f370a578,0,...) at svc_run_internal+0xa50/frame 0xf370a550 svc_run(ca160980,0,c106a01b,1b2,99,...) at svc_run+0xc3/frame 0xf370a588 nfsrvd_nfsd(cc8f85e0,f370a6e0,c,0,c0eaca1e,...) at nfsrvd_nfsd+0x1a2/frame 0xf370a6c0 nfssvc_nfsd(cc8f85e0,f370acc8,0,cc8f85e0,f370acfc,...) at nfssvc_nfsd+0xf4/frame 0xf370ac28 sys_nfssvc(cc8f85e0,f370acc8,0,0,0,...) at sys_nfssvc+0xbf/frame 0xf370ac40 syscall(f370ad08) at syscall+0x2ed/frame 0xf370acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf370acfc --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280c2c67, esp = 0xbfbfd89c, ebp = 0xbfbfdb10 --- Tracing command nfsd pid 596 tid 100130 td 0xcc8f8bc0 sched_switch(cc8f8bc0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf3704918 mi_switch(104,0,c1084241,1f7,46,...) at mi_switch+0x1c9/frame 0xf370494c sleepq_switch(cc8f8bc0,0,c1084241,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf3704980 sleepq_catch_signals(f37049ec,c0a7c409,c9f08da0,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf37049c8 sleepq_wait_sig(c9f08da4,0,f3704a20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf37049ec _cv_wait_sig(c9f08da4,c9f08d90,c1086fc0,677,7,...) at _cv_wait_sig+0x200/frame 0xf3704a34 seltdwait(cc871620,58,c9ea0e00,cc8f8bc0,c1238700,...) at seltdwait+0x8c/frame 0xf3704a58 kern_select(cc8f8bc0,7,bfbfdcf8,0,0,...) at kern_select+0x85f/frame 0xf3704bf8 sys_select(cc8f8bc0,f3704cc8,f3704d08,1,1,...) at sys_select+0x69/frame 0xf3704c40 syscall(f3704d08) at syscall+0x2ed/frame 0xf3704cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3704cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2817e327, esp = 0xbfbfdb14, ebp = 0xbfbfde34 --- Tracing command nfsuserd pid 594 tid 100129 td 0xcc8f9000 sched_switch(cc8f9000,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf3701914 mi_switch(104,0,c1084241,1f7,c1414780,...) at mi_switch+0x1c9/frame 0xf3701948 sleepq_switch(cc8f9000,0,c1084241,1ab,cc74a090,...) at sleepq_switch+0x1b9/frame 0xf370197c sleepq_catch_signals(c11b2dc4,f37019ec,c0a7c409,cc74a0a0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf37019c4 sleepq_timedwait_sig(cc74a0a4,0,f3701a20,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf37019ec _cv_timedwait_sig(cc74a0a4,cc74a090,7531,677,f3701ac0,...) at _cv_timedwait_sig+0x20c/frame 0xf3701a34 seltdwait(f3701ac0,f3701ac8,c9ea0e00,cc8f9000,c0a7d18b,...) at seltdwait+0x7e/frame 0xf3701a58 kern_select(cc8f9000,4,bfbfdc10,0,0,...) at kern_select+0x85f/frame 0xf3701bf8 sys_select(cc8f9000,f3701cc8,7b3,0,f3701cc4,...) at sys_select+0x69/frame 0xf3701c40 syscall(f3701d08) at syscall+0x2ed/frame 0xf3701cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3701cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2817c327, esp = 0xbfbfdb64, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 593 tid 100128 td 0xcc8f92f0 sched_switch(cc8f92f0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf36fe914 mi_switch(104,0,c1084241,1f7,c1414780,...) at mi_switch+0x1c9/frame 0xf36fe948 sleepq_switch(cc8f92f0,0,c1084241,1ab,cc89ca10,...) at sleepq_switch+0x1b9/frame 0xf36fe97c sleepq_catch_signals(c11b2dc4,f36fe9ec,c0a7c409,cc89ca20,0,...) at sleepq_catch_signals+0x3b1/frame 0xf36fe9c4 sleepq_timedwait_sig(cc89ca24,0,f36fea20,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf36fe9ec _cv_timedwait_sig(cc89ca24,cc89ca10,7531,677,f36feac0,...) at _cv_timedwait_sig+0x20c/frame 0xf36fea34 seltdwait(f36feac0,f36feac8,c9ea0e00,cc8f92f0,f36fea84,...) at seltdwait+0x7e/frame 0xf36fea58 kern_select(cc8f92f0,4,bfbfdc10,0,0,...) at kern_select+0x85f/frame 0xf36febf8 sys_select(cc8f92f0,f36fecc8,f36fed08,1,1,...) at sys_select+0x69/frame 0xf36fec40 syscall(f36fed08) at syscall+0x2ed/frame 0xf36fecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf36fecfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2817c327, esp = 0xbfbfdb64, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 592 tid 100127 td 0xcc8f95e0 sched_switch(cc8f95e0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf36fb914 mi_switch(104,0,c1084241,1f7,c1414680,...) at mi_switch+0x1c9/frame 0xf36fb948 sleepq_switch(cc8f95e0,0,c1084241,1ab,ccff87d0,...) at sleepq_switch+0x1b9/frame 0xf36fb97c sleepq_catch_signals(c11b2dc4,f36fb9ec,c0a7c409,ccff87e0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf36fb9c4 sleepq_timedwait_sig(ccff87e4,0,f36fba20,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf36fb9ec _cv_timedwait_sig(ccff87e4,ccff87d0,7531,677,f36fbac0,...) at _cv_timedwait_sig+0x20c/frame 0xf36fba34 seltdwait(f36fbac0,f36fbac8,c9ea0e00,cc8f95e0,cc8f95e0,...) at seltdwait+0x7e/frame 0xf36fba58 kern_select(cc8f95e0,4,bfbfdc10,0,0,...) at kern_select+0x85f/frame 0xf36fbbf8 sys_select(cc8f95e0,f36fbcc8,7b3,0,f36fbcc4,...) at sys_select+0x69/frame 0xf36fbc40 syscall(f36fbd08) at syscall+0x2ed/frame 0xf36fbcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf36fbcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2817c327, esp = 0xbfbfdb64, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 591 tid 100126 td 0xcc8f98d0 sched_switch(cc8f98d0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf36f8914 mi_switch(104,0,c1084241,1f7,c1414680,...) at mi_switch+0x1c9/frame 0xf36f8948 sleepq_switch(cc8f98d0,0,c1084241,1ab,cc85f910,...) at sleepq_switch+0x1b9/frame 0xf36f897c sleepq_catch_signals(c11b2dc4,f36f89ec,c0a7c409,cc85f920,0,...) at sleepq_catch_signals+0x3b1/frame 0xf36f89c4 sleepq_timedwait_sig(cc85f924,0,f36f8a20,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf36f89ec _cv_timedwait_sig(cc85f924,cc85f910,7531,677,f36f8ac0,...) at _cv_timedwait_sig+0x20c/frame 0xf36f8a34 seltdwait(f36f8ac0,f36f8ac8,c9ea0e00,cc8f98d0,c13dc9f0,...) at seltdwait+0x7e/frame 0xf36f8a58 kern_select(cc8f98d0,4,bfbfdc10,0,0,...) at kern_select+0x85f/frame 0xf36f8bf8 sys_select(cc8f98d0,f36f8cc8,f36f8c8c,c0a61d70,c1239510,...) at sys_select+0x69/frame 0xf36f8c40 syscall(f36f8d08) at syscall+0x2ed/frame 0xf36f8cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf36f8cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2817c327, esp = 0xbfbfdb64, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 590 tid 100101 td 0xcc9105e0 Tracing command mountd pid 574 tid 100097 td 0xcc860bc0 sched_switch(cc860bc0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf3642918 mi_switch(104,0,c1084241,1f7,46,...) at mi_switch+0x1c9/frame 0xf364294c sleepq_switch(cc860bc0,0,c1084241,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf3642980 sleepq_catch_signals(f36429ec,c0a7c409,cc89caa0,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf36429c8 sleepq_wait_sig(cc89caa4,0,f3642a20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf36429ec _cv_wait_sig(cc89caa4,cc89ca90,c1086fc0,677,9,...) at _cv_wait_sig+0x200/frame 0xf3642a34 seltdwait(cc8a57e0,58,c9ea0e00,cc860bc0,c108ebbb,...) at seltdwait+0x8c/frame 0xf3642a58 kern_select(cc860bc0,9,bfbfdd50,0,0,...) at kern_select+0x85f/frame 0xf3642bf8 sys_select(cc860bc0,f3642cc8,0,0,cc860bc0,...) at sys_select+0x69/frame 0xf3642c40 syscall(f3642d08) at syscall+0x2ed/frame 0xf3642cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3642cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28194327, esp = 0xbfbfdd0c, ebp = 0xbfbfde34 --- Tracing command rpcbind pid 541 tid 100087 td 0xcc8645e0 sched_switch(cc8645e0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf3619984 mi_switch(104,0,c1084241,1f7,c1414580,...) at mi_switch+0x1c9/frame 0xf36199b8 sleepq_switch(cc8645e0,0,c1084241,1ab,cc74a490,...) at sleepq_switch+0x1b9/frame 0xf36199ec sleepq_catch_signals(c11b2dc4,f3619a5c,c0a7c409,cc74a4a0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3619a34 sleepq_timedwait_sig(cc74a4a4,0,f3619a90,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3619a5c _cv_timedwait_sig(cc74a4a4,cc74a490,7531,677,cc8645e0,...) at _cv_timedwait_sig+0x20c/frame 0xf3619aa4 seltdwait(f3619b10,f3619b18,5ac,cc8645e0,c9f09e80,...) at seltdwait+0x7e/frame 0xf3619ac8 sys_poll(cc8645e0,f3619cc8,f3619d08,1,1,...) at sys_poll+0x3e5/frame 0xf3619c40 syscall(f3619d08) at syscall+0x2ed/frame 0xf3619cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3619cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2813306f, esp = 0xbfbfbbfc, ebp = 0xbfbfddd8 --- Tracing command syslogd pid 526 tid 100091 td 0xcc8a35e0 sched_switch(cc8a35e0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf362a918 mi_switch(104,0,c1084241,1f7,46,...) at mi_switch+0x1c9/frame 0xf362a94c sleepq_switch(cc8a35e0,0,c1084241,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf362a980 sleepq_catch_signals(f362a9ec,c0a7c409,cc89cda0,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf362a9c8 sleepq_wait_sig(cc89cda4,0,f362aa20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf362a9ec _cv_wait_sig(cc89cda4,cc89cd90,c1086fc0,677,9,...) at _cv_wait_sig+0x200/frame 0xf362aa34 seltdwait(cc8911c0,58,c9ea0e00,cc8a35e0,0,...) at seltdwait+0x8c/frame 0xf362aa58 kern_select(cc8a35e0,9,28849100,0,0,...) at kern_select+0x85f/frame 0xf362abf8 sys_select(cc8a35e0,f362acc8,0,0,cc8a35e0,...) at sys_select+0x69/frame 0xf362ac40 syscall(f362ad08) at syscall+0x2ed/frame 0xf362acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf362acfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28193327, esp = 0xbfbfceac, ebp = 0xbfbfde34 --- Tracing command devd pid 423 tid 100115 td 0xccd505e0 sched_switch(ccd505e0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xf36c4918 mi_switch(104,0,c1084241,1f7,46,...) at mi_switch+0x1c9/frame 0xf36c494c sleepq_switch(ccd505e0,0,c1084241,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf36c4980 sleepq_catch_signals(f36c49ec,c0a7c409,cc89ca60,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf36c49c8 sleepq_wait_sig(cc89ca64,0,f36c4a20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf36c49ec _cv_wait_sig(cc89ca64,cc89ca50,c1086fc0,677,5,...) at _cv_wait_sig+0x200/frame 0xf36c4a34 seltdwait(cc8a56c8,58,c9ea0e00,ccd505e0,cc7ebcb8,...) at seltdwait+0x8c/frame 0xf36c4a58 kern_select(ccd505e0,5,bfbfd998,0,0,...) at kern_select+0x85f/frame 0xf36c4bf8 sys_select(ccd505e0,f36c4cc8,f36c4d08,1,1,...) at sys_select+0x69/frame 0xf36c4c40 syscall(f36c4d08) at syscall+0x2ed/frame 0xf36c4cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf36c4cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x808c2a3, esp = 0xbfbfd93c, ebp = 0xbfbfde54 --- Tracing command softdepflush pid 18 tid 100075 td 0xca19fbc0 sched_switch(ca19fbc0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xee11bbb8 mi_switch(104,0,c1084241,1f7,1,...) at mi_switch+0x1c9/frame 0xee11bbec sleepq_switch(ca19fbc0,0,c1084241,290,ca19fbc0,...) at sleepq_switch+0x1b9/frame 0xee11bc20 sleepq_timedwait(c13a69a8,54,c10b6160,0,0,...) at sleepq_timedwait+0x48/frame 0xee11bc44 _sleep(c13a69a8,c13a6934,54,c10b6160,3e8,...) at _sleep+0x317/frame 0xee11bc9c softdep_flush(0,ee11bd08,c1078230,3d7,0,...) at softdep_flush+0x23e/frame 0xee11bccc fork_exit(c0ce2570,0,ee11bd08) at fork_exit+0x7f/frame 0xee11bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee11bcf4 --- trap 0, eip = 0, esp = 0xee11bd40, ebp = 0 --- Tracing command syncer pid 17 tid 100074 td 0xcb631000 sched_switch(cb631000,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xee118b84 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xee118bb8 sleepq_switch(cb631000,0,c1084241,290,0,...) at sleepq_switch+0x1b9/frame 0xee118bec sleepq_timedwait(c13a27d0,0,ee118c44,1,0,...) at sleepq_timedwait+0x48/frame 0xee118c10 _cv_timedwait(c13a27d0,c13a27b0,3e8,795,4e20,...) at _cv_timedwait+0x20c/frame 0xee118c58 sched_sync(0,ee118d08,c1078230,3d7,0,...) at sched_sync+0x641/frame 0xee118ccc fork_exit(c0b364d0,0,ee118d08) at fork_exit+0x7f/frame 0xee118cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee118cf4 --- trap 0, eip = 0, esp = 0xee118d40, ebp = 0 --- Tracing command vnlru pid 16 tid 100073 td 0xcb6312f0 sched_switch(cb6312f0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xee115b8c mi_switch(104,0,c1084241,1f7,3,...) at mi_switch+0x1c9/frame 0xee115bc0 sleepq_switch(cb6312f0,0,c1084241,290,cb6312f0,...) at sleepq_switch+0x1b9/frame 0xee115bf4 sleepq_timedwait(cc752870,60,c108ff52,0,0,...) at sleepq_timedwait+0x48/frame 0xee115c18 _sleep(cc752870,c13a2788,260,c108ff52,3e8,...) at _sleep+0x317/frame 0xee115c70 vnlru_proc(0,ee115d08,c1078230,3d7,0,...) at vnlru_proc+0x95/frame 0xee115ccc fork_exit(c0b36ca0,0,ee115d08) at fork_exit+0x7f/frame 0xee115cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee115cf4 --- trap 0, eip = 0, esp = 0xee115d40, ebp = 0 --- Tracing command bufdaemon pid 9 tid 100072 td 0xcb6315e0 sched_switch(cb6315e0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xee112bc8 mi_switch(104,0,c1084241,1f7,0,...) at mi_switch+0x1c9/frame 0xee112bfc sleepq_switch(cb6315e0,0,c1084241,290,cb6315e0,...) at sleepq_switch+0x1b9/frame 0xee112c30 sleepq_timedwait(c13a2568,54,c108cb76,0,0,...) at sleepq_timedwait+0x48/frame 0xee112c54 _sleep(c13a2568,c13a2550,54,c108cb76,3e8,...) at _sleep+0x317/frame 0xee112cac buf_daemon(0,ee112d08,c1078230,3d7,0,...) at buf_daemon+0x8c/frame 0xee112ccc fork_exit(c0b1a610,0,ee112d08) at fork_exit+0x7f/frame 0xee112cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee112cf4 --- trap 0, eip = 0, esp = 0xee112d40, ebp = 0 --- Tracing command pagezero pid 8 tid 100071 td 0xcb6318d0 sched_switch(cb6318d0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xee10fbc0 mi_switch(104,0,c1084241,1f7,2,...) at mi_switch+0x1c9/frame 0xee10fbf4 sleepq_switch(cb6318d0,0,c1084241,290,cb6318d0,...) at sleepq_switch+0x1b9/frame 0xee10fc28 sleepq_timedwait(c13c777c,0,c10bd3a2,0,0,...) at sleepq_timedwait+0x48/frame 0xee10fc4c _sleep(c13c777c,c141b180,0,c10bd3a2,493e0,...) at _sleep+0x317/frame 0xee10fca4 vm_pagezero(0,ee10fd08,c1078230,3d7,0,...) at vm_pagezero+0x89/frame 0xee10fccc fork_exit(c0d29720,0,ee10fd08) at fork_exit+0x7f/frame 0xee10fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee10fcf4 --- trap 0, eip = 0, esp = 0xee10fd40, ebp = 0 --- Tracing command vmdaemon pid 7 tid 100070 td 0xcb631bc0 sched_switch(cb631bc0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xee10cb8c mi_switch(104,0,c1084241,1f7,164,...) at mi_switch+0x1c9/frame 0xee10cbc0 sleepq_switch(cb631bc0,0,c1084241,26d,cb631bc0,...) at sleepq_switch+0x1b9/frame 0xee10cbf4 sleepq_wait(c13a6fa0,74,c108cb76,0,0,...) at sleepq_wait+0x48/frame 0xee10cc18 _sleep(c13a6fa0,c13a6f88,74,c108cb76,0,...) at _sleep+0x34e/frame 0xee10cc70 vm_daemon(0,ee10cd08,c1078230,3d7,0,...) at vm_daemon+0x8c/frame 0xee10cccc fork_exit(c0d20fe0,0,ee10cd08) at fork_exit+0x7f/frame 0xee10ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee10ccf4 --- trap 0, eip = 0, esp = 0xee10cd40, ebp = 0 --- Tracing command pagedaemon pid 6 tid 100069 td 0xcb632000 sched_switch(cb632000,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xee109b44 mi_switch(104,0,c1084241,1f7,2,...) at mi_switch+0x1c9/frame 0xee109b78 sleepq_switch(cb632000,0,c1084241,290,cb632000,...) at sleepq_switch+0x1b9/frame 0xee109bac sleepq_timedwait(c141b204,54,c108cb76,0,0,...) at sleepq_timedwait+0x48/frame 0xee109bd0 _sleep(c141b204,c141b180,54,c108cb76,1388,...) at _sleep+0x317/frame 0xee109c28 vm_pageout(0,ee109d08,c1078230,3d7,0,...) at vm_pageout+0x256/frame 0xee109ccc fork_exit(c0d21840,0,ee109d08) at fork_exit+0x7f/frame 0xee109cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee109cf4 --- trap 0, eip = 0, esp = 0xee109d40, ebp = 0 --- Tracing command xpt_thrd pid 5 tid 100068 td 0xcb6322f0 sched_switch(cb6322f0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xedf86bc4 mi_switch(104,0,c1084241,1f7,164,...) at mi_switch+0x1c9/frame 0xedf86bf8 sleepq_switch(cb6322f0,0,c1084241,26d,cb6322f0,...) at sleepq_switch+0x1b9/frame 0xedf86c2c sleepq_wait(c11f7fa4,5c,c0ed12e0,0,0,...) at sleepq_wait+0x48/frame 0xedf86c50 _sleep(c11f7fa4,c11f7fe8,5c,c0ed12e0,0,...) at _sleep+0x34e/frame 0xedf86ca8 xpt_scanner_thread(0,edf86d08,c1078230,3d7,0,...) at xpt_scanner_thread+0xfc/frame 0xedf86ccc fork_exit(c04b2d30,0,edf86d08) at fork_exit+0x7f/frame 0xedf86cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf86cf4 --- trap 0, eip = 0, esp = 0xedf86d40, ebp = 0 --- Tracing command sctp_iterator pid 4 tid 100067 td 0xcb6325e0 sched_switch(cb6325e0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xedf83bcc mi_switch(104,0,c1084241,1f7,164,...) at mi_switch+0x1c9/frame 0xedf83c00 sleepq_switch(cb6325e0,0,c1084241,26d,cb6325e0,...) at sleepq_switch+0x1b9/frame 0xedf83c34 sleepq_wait(c1416ef0,0,c10a3465,0,0,...) at sleepq_wait+0x48/frame 0xedf83c58 _sleep(c1416ef0,c1416eb8,0,c10a3465,0,...) at _sleep+0x34e/frame 0xedf83cb0 sctp_iterator_thread(0,edf83d08,c1078230,3d7,0,...) at sctp_iterator_thread+0x5c/frame 0xedf83ccc fork_exit(c0bd1df0,0,edf83d08) at fork_exit+0x7f/frame 0xedf83cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf83cf4 --- trap 0, eip = 0, esp = 0xedf83d40, ebp = 0 --- Tracing command ctl_thrd pid 3 tid 100064 td 0xcb633000 sched_switch(cb633000,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xedf7964c mi_switch(104,0,c1084241,1f7,164,...) at mi_switch+0x1c9/frame 0xedf79680 sleepq_switch(cb633000,0,c1084241,26d,cb633000,...) at sleepq_switch+0x1b9/frame 0xedf796b4 sleepq_wait(ca1e0000,5c,c0edbec7,0,0,...) at sleepq_wait+0x48/frame 0xedf796d8 _sleep(ca1e0000,ca1e0000,5c,c0edbec7,0,...) at _sleep+0x34e/frame 0xedf79730 ctl_work_thread(ca1e0000,edf79d08,c1078230,3d7,0,...) at ctl_work_thread+0x110/frame 0xedf79ccc fork_exit(c04d5a20,ca1e0000,edf79d08) at fork_exit+0x7f/frame 0xedf79cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf79cf4 --- trap 0, eip = 0, esp = 0xedf79d40, ebp = 0 --- Tracing command fdc0 pid 2 tid 100061 td 0xca1918d0 sched_switch(ca1918d0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xedf70b50 mi_switch(104,0,c1084241,1f7,3,...) at mi_switch+0x1c9/frame 0xedf70b84 sleepq_switch(ca1918d0,0,c1084241,290,ca1918d0,...) at sleepq_switch+0x1b9/frame 0xedf70bb8 sleepq_timedwait(ca13823c,5c,c106aa4a,0,0,...) at sleepq_timedwait+0x48/frame 0xedf70bdc _sleep(ca13823c,ca1382f0,5c,c106aa4a,3e8,...) at _sleep+0x317/frame 0xedf70c34 fdc_thread(ca138200,edf70d08,c1078230,3d7,0,...) at fdc_thread+0x74a/frame 0xedf70ccc fork_exit(c0e33270,ca138200,edf70d08) at fork_exit+0x7f/frame 0xedf70cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf70cf4 --- trap 0, eip = 0, esp = 0xedf70d40, ebp = 0 --- Tracing command usb pid 15 tid 100058 td 0xca19c2f0 sched_switch(ca19c2f0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xedf4cbd4 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xedf4cc08 sleepq_switch(ca19c2f0,0,c1084241,26d,ca19c2f0,...) at sleepq_switch+0x1b9/frame 0xedf4cc3c sleepq_wait(ca1a5d34,0,edf4cc90,1,0,...) at sleepq_wait+0x48/frame 0xedf4cc60 _cv_wait(ca1a5d34,ca1a5e4c,c105c2a3,77,ca1a5d3c,...) at _cv_wait+0x1f9/frame 0xedf4cca4 usb_process(ca1a5d2c,edf4cd08,c1078230,3d7,0,...) at usb_process+0xe6/frame 0xedf4cccc fork_exit(c09456a0,ca1a5d2c,edf4cd08) at fork_exit+0x7f/frame 0xedf4ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf4ccf4 --- trap 0, eip = 0, esp = 0xedf4cd40, ebp = 0 --- Tracing command usb pid 15 tid 100057 td 0xca19c5e0 sched_switch(ca19c5e0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xedf49bd4 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xedf49c08 sleepq_switch(ca19c5e0,0,c1084241,26d,ca19c5e0,...) at sleepq_switch+0x1b9/frame 0xedf49c3c sleepq_wait(ca1a5d04,0,edf49c90,1,0,...) at sleepq_wait+0x48/frame 0xedf49c60 _cv_wait(ca1a5d04,ca1a5e4c,c105c2a3,77,ca1a5d0c,...) at _cv_wait+0x1f9/frame 0xedf49ca4 usb_process(ca1a5cfc,edf49d08,c1078230,3d7,0,...) at usb_process+0xe6/frame 0xedf49ccc fork_exit(c09456a0,ca1a5cfc,edf49d08) at fork_exit+0x7f/frame 0xedf49cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf49cf4 --- trap 0, eip = 0, esp = 0xedf49d40, ebp = 0 --- Tracing command usb pid 15 tid 100056 td 0xca19c8d0 sched_switch(ca19c8d0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xedf46bd4 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xedf46c08 sleepq_switch(ca19c8d0,0,c1084241,26d,ca19c8d0,...) at sleepq_switch+0x1b9/frame 0xedf46c3c sleepq_wait(ca1a5cd4,0,edf46c90,1,0,...) at sleepq_wait+0x48/frame 0xedf46c60 _cv_wait(ca1a5cd4,ca1a5e4c,c105c2a3,77,ca1a5cdc,...) at _cv_wait+0x1f9/frame 0xedf46ca4 usb_process(ca1a5ccc,edf46d08,c1078230,3d7,0,...) at usb_process+0xe6/frame 0xedf46ccc fork_exit(c09456a0,ca1a5ccc,edf46d08) at fork_exit+0x7f/frame 0xedf46cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf46cf4 --- trap 0, eip = 0, esp = 0xedf46d40, ebp = 0 --- Tracing command usb pid 15 tid 100055 td 0xca19cbc0 sched_switch(ca19cbc0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xedf43bd4 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xedf43c08 sleepq_switch(ca19cbc0,0,c1084241,26d,ca19cbc0,...) at sleepq_switch+0x1b9/frame 0xedf43c3c sleepq_wait(ca1a5ca4,0,edf43c90,1,0,...) at sleepq_wait+0x48/frame 0xedf43c60 _cv_wait(ca1a5ca4,ca1a5e4c,c105c2a3,77,ca1a5cac,...) at _cv_wait+0x1f9/frame 0xedf43ca4 usb_process(ca1a5c9c,edf43d08,c1078230,3d7,0,...) at usb_process+0xe6/frame 0xedf43ccc fork_exit(c09456a0,ca1a5c9c,edf43d08) at fork_exit+0x7f/frame 0xedf43cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf43cf4 --- trap 0, eip = 0, esp = 0xedf43d40, ebp = 0 --- Tracing command usb pid 15 tid 100053 td 0xca19f2f0 sched_switch(ca19f2f0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xedf3abd4 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xedf3ac08 sleepq_switch(ca19f2f0,0,c1084241,26d,ca19f2f0,...) at sleepq_switch+0x1b9/frame 0xedf3ac3c sleepq_wait(ca198b5c,0,edf3ac90,1,0,...) at sleepq_wait+0x48/frame 0xedf3ac60 _cv_wait(ca198b5c,ca198c74,c105c2a3,77,ca198b64,...) at _cv_wait+0x1f9/frame 0xedf3aca4 usb_process(ca198b54,edf3ad08,c1078230,3d7,0,...) at usb_process+0xe6/frame 0xedf3accc fork_exit(c09456a0,ca198b54,edf3ad08) at fork_exit+0x7f/frame 0xedf3acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf3acf4 --- trap 0, eip = 0, esp = 0xedf3ad40, ebp = 0 --- Tracing command usb pid 15 tid 100052 td 0xca19f5e0 sched_switch(ca19f5e0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xedf37bd4 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xedf37c08 sleepq_switch(ca19f5e0,0,c1084241,26d,ca19f5e0,...) at sleepq_switch+0x1b9/frame 0xedf37c3c sleepq_wait(ca198b2c,0,edf37c90,1,0,...) at sleepq_wait+0x48/frame 0xedf37c60 _cv_wait(ca198b2c,ca198c74,c105c2a3,77,ca198b34,...) at _cv_wait+0x1f9/frame 0xedf37ca4 usb_process(ca198b24,edf37d08,c1078230,3d7,0,...) at usb_process+0xe6/frame 0xedf37ccc fork_exit(c09456a0,ca198b24,edf37d08) at fork_exit+0x7f/frame 0xedf37cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf37cf4 --- trap 0, eip = 0, esp = 0xedf37d40, ebp = 0 --- Tracing command usb pid 15 tid 100051 td 0xca18f000 sched_switch(ca18f000,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xedf34bd4 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xedf34c08 sleepq_switch(ca18f000,0,c1084241,26d,ca18f000,...) at sleepq_switch+0x1b9/frame 0xedf34c3c sleepq_wait(ca198afc,0,edf34c90,1,0,...) at sleepq_wait+0x48/frame 0xedf34c60 _cv_wait(ca198afc,ca198c74,c105c2a3,77,ca198b04,...) at _cv_wait+0x1f9/frame 0xedf34ca4 usb_process(ca198af4,edf34d08,c1078230,3d7,0,...) at usb_process+0xe6/frame 0xedf34ccc fork_exit(c09456a0,ca198af4,edf34d08) at fork_exit+0x7f/frame 0xedf34cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf34cf4 --- trap 0, eip = 0, esp = 0xedf34d40, ebp = 0 --- Tracing command usb pid 15 tid 100050 td 0xca18f2f0 sched_switch(ca18f2f0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xedf31bd4 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xedf31c08 sleepq_switch(ca18f2f0,0,c1084241,26d,ca18f2f0,...) at sleepq_switch+0x1b9/frame 0xedf31c3c sleepq_wait(ca198acc,0,edf31c90,1,0,...) at sleepq_wait+0x48/frame 0xedf31c60 _cv_wait(ca198acc,ca198c74,c105c2a3,77,ca198ad4,...) at _cv_wait+0x1f9/frame 0xedf31ca4 usb_process(ca198ac4,edf31d08,c1078230,3d7,0,...) at usb_process+0xe6/frame 0xedf31ccc fork_exit(c09456a0,ca198ac4,edf31d08) at fork_exit+0x7f/frame 0xedf31cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf31cf4 --- trap 0, eip = 0, esp = 0xedf31d40, ebp = 0 --- Tracing command usb pid 15 tid 100049 td 0xca18f5e0 sched_switch(ca18f5e0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xedf2dbd4 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xedf2dc08 sleepq_switch(ca18f5e0,0,c1084241,26d,ca18f5e0,...) at sleepq_switch+0x1b9/frame 0xedf2dc3c sleepq_wait(ca192b5c,0,edf2dc90,1,0,...) at sleepq_wait+0x48/frame 0xedf2dc60 _cv_wait(ca192b5c,ca192c74,c105c2a3,77,ca192b64,...) at _cv_wait+0x1f9/frame 0xedf2dca4 usb_process(ca192b54,edf2dd08,c1078230,3d7,0,...) at usb_process+0xe6/frame 0xedf2dccc fork_exit(c09456a0,ca192b54,edf2dd08) at fork_exit+0x7f/frame 0xedf2dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf2dcf4 --- trap 0, eip = 0, esp = 0xedf2dd40, ebp = 0 --- Tracing command usb pid 15 tid 100048 td 0xca18f8d0 sched_switch(ca18f8d0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xedf2abd4 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xedf2ac08 sleepq_switch(ca18f8d0,0,c1084241,26d,ca18f8d0,...) at sleepq_switch+0x1b9/frame 0xedf2ac3c sleepq_wait(ca192b2c,0,edf2ac90,1,0,...) at sleepq_wait+0x48/frame 0xedf2ac60 _cv_wait(ca192b2c,ca192c74,c105c2a3,77,ca192b34,...) at _cv_wait+0x1f9/frame 0xedf2aca4 usb_process(ca192b24,edf2ad08,c1078230,3d7,0,...) at usb_process+0xe6/frame 0xedf2accc fork_exit(c09456a0,ca192b24,edf2ad08) at fork_exit+0x7f/frame 0xedf2acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf2acf4 --- trap 0, eip = 0, esp = 0xedf2ad40, ebp = 0 --- Tracing command usb pid 15 tid 100047 td 0xca18fbc0 sched_switch(ca18fbc0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xedf27bd4 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xedf27c08 sleepq_switch(ca18fbc0,0,c1084241,26d,ca18fbc0,...) at sleepq_switch+0x1b9/frame 0xedf27c3c sleepq_wait(ca192afc,0,edf27c90,1,0,...) at sleepq_wait+0x48/frame 0xedf27c60 _cv_wait(ca192afc,ca192c74,c105c2a3,77,ca192b04,...) at _cv_wait+0x1f9/frame 0xedf27ca4 usb_process(ca192af4,edf27d08,c1078230,3d7,0,...) at usb_process+0xe6/frame 0xedf27ccc fork_exit(c09456a0,ca192af4,edf27d08) at fork_exit+0x7f/frame 0xedf27cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf27cf4 --- trap 0, eip = 0, esp = 0xedf27d40, ebp = 0 --- Tracing command usb pid 15 tid 100046 td 0xca190000 sched_switch(ca190000,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xedf24bd4 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xedf24c08 sleepq_switch(ca190000,0,c1084241,26d,ca190000,...) at sleepq_switch+0x1b9/frame 0xedf24c3c sleepq_wait(ca192acc,0,edf24c90,1,0,...) at sleepq_wait+0x48/frame 0xedf24c60 _cv_wait(ca192acc,ca192c74,c105c2a3,77,ca192ad4,...) at _cv_wait+0x1f9/frame 0xedf24ca4 usb_process(ca192ac4,edf24d08,c1078230,3d7,0,...) at usb_process+0xe6/frame 0xedf24ccc fork_exit(c09456a0,ca192ac4,edf24d08) at fork_exit+0x7f/frame 0xedf24cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf24cf4 --- trap 0, eip = 0, esp = 0xedf24d40, ebp = 0 --- Tracing command usb pid 15 tid 100045 td 0xca1902f0 sched_switch(ca1902f0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xedf20bd4 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xedf20c08 sleepq_switch(ca1902f0,0,c1084241,26d,ca1902f0,...) at sleepq_switch+0x1b9/frame 0xedf20c3c sleepq_wait(ca18bb5c,0,edf20c90,1,0,...) at sleepq_wait+0x48/frame 0xedf20c60 _cv_wait(ca18bb5c,ca18bc74,c105c2a3,77,ca18bb64,...) at _cv_wait+0x1f9/frame 0xedf20ca4 usb_process(ca18bb54,edf20d08,c1078230,3d7,0,...) at usb_process+0xe6/frame 0xedf20ccc fork_exit(c09456a0,ca18bb54,edf20d08) at fork_exit+0x7f/frame 0xedf20cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf20cf4 --- trap 0, eip = 0, esp = 0xedf20d40, ebp = 0 --- Tracing command usb pid 15 tid 100044 td 0xca1905e0 sched_switch(ca1905e0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xedf1dbd4 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xedf1dc08 sleepq_switch(ca1905e0,0,c1084241,26d,ca1905e0,...) at sleepq_switch+0x1b9/frame 0xedf1dc3c sleepq_wait(ca18bb2c,0,edf1dc90,1,0,...) at sleepq_wait+0x48/frame 0xedf1dc60 _cv_wait(ca18bb2c,ca18bc74,c105c2a3,77,ca18bb34,...) at _cv_wait+0x1f9/frame 0xedf1dca4 usb_process(ca18bb24,edf1dd08,c1078230,3d7,0,...) at usb_process+0xe6/frame 0xedf1dccc fork_exit(c09456a0,ca18bb24,edf1dd08) at fork_exit+0x7f/frame 0xedf1dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf1dcf4 --- trap 0, eip = 0, esp = 0xedf1dd40, ebp = 0 --- Tracing command usb pid 15 tid 100043 td 0xca1908d0 sched_switch(ca1908d0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xedf1abd4 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xedf1ac08 sleepq_switch(ca1908d0,0,c1084241,26d,ca1908d0,...) at sleepq_switch+0x1b9/frame 0xedf1ac3c sleepq_wait(ca18bafc,0,edf1ac90,1,0,...) at sleepq_wait+0x48/frame 0xedf1ac60 _cv_wait(ca18bafc,ca18bc74,c105c2a3,77,ca18bb04,...) at _cv_wait+0x1f9/frame 0xedf1aca4 usb_process(ca18baf4,edf1ad08,c1078230,3d7,0,...) at usb_process+0xe6/frame 0xedf1accc fork_exit(c09456a0,ca18baf4,edf1ad08) at fork_exit+0x7f/frame 0xedf1acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf1acf4 --- trap 0, eip = 0, esp = 0xedf1ad40, ebp = 0 --- Tracing command usb pid 15 tid 100042 td 0xca190bc0 sched_switch(ca190bc0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xedf17bd4 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xedf17c08 sleepq_switch(ca190bc0,0,c1084241,26d,ca190bc0,...) at sleepq_switch+0x1b9/frame 0xedf17c3c sleepq_wait(ca18bacc,0,edf17c90,1,0,...) at sleepq_wait+0x48/frame 0xedf17c60 _cv_wait(ca18bacc,ca18bc74,c105c2a3,77,ca18bad4,...) at _cv_wait+0x1f9/frame 0xedf17ca4 usb_process(ca18bac4,edf17d08,c1078230,3d7,0,...) at usb_process+0xe6/frame 0xedf17ccc fork_exit(c09456a0,ca18bac4,edf17d08) at fork_exit+0x7f/frame 0xedf17cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf17cf4 --- trap 0, eip = 0, esp = 0xedf17d40, ebp = 0 --- Tracing command usb pid 15 tid 100040 td 0xca17f000 sched_switch(ca17f000,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xedf10bd4 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xedf10c08 sleepq_switch(ca17f000,0,c1084241,26d,ca17f000,...) at sleepq_switch+0x1b9/frame 0xedf10c3c sleepq_wait(ca186b5c,0,edf10c90,1,0,...) at sleepq_wait+0x48/frame 0xedf10c60 _cv_wait(ca186b5c,ca186c74,c105c2a3,77,ca186b64,...) at _cv_wait+0x1f9/frame 0xedf10ca4 usb_process(ca186b54,edf10d08,c1078230,3d7,0,...) at usb_process+0xe6/frame 0xedf10ccc fork_exit(c09456a0,ca186b54,edf10d08) at fork_exit+0x7f/frame 0xedf10cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf10cf4 --- trap 0, eip = 0, esp = 0xedf10d40, ebp = 0 --- Tracing command usb pid 15 tid 100039 td 0xca17f2f0 sched_switch(ca17f2f0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xedf0dbd4 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xedf0dc08 sleepq_switch(ca17f2f0,0,c1084241,26d,ca17f2f0,...) at sleepq_switch+0x1b9/frame 0xedf0dc3c sleepq_wait(ca186b2c,0,edf0dc90,1,0,...) at sleepq_wait+0x48/frame 0xedf0dc60 _cv_wait(ca186b2c,ca186c74,c105c2a3,77,ca186b34,...) at _cv_wait+0x1f9/frame 0xedf0dca4 usb_process(ca186b24,edf0dd08,c1078230,3d7,0,...) at usb_process+0xe6/frame 0xedf0dccc fork_exit(c09456a0,ca186b24,edf0dd08) at fork_exit+0x7f/frame 0xedf0dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf0dcf4 --- trap 0, eip = 0, esp = 0xedf0dd40, ebp = 0 --- Tracing command usb pid 15 tid 100038 td 0xca17f5e0 sched_switch(ca17f5e0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xedf0abd4 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xedf0ac08 sleepq_switch(ca17f5e0,0,c1084241,26d,ca17f5e0,...) at sleepq_switch+0x1b9/frame 0xedf0ac3c sleepq_wait(ca186afc,0,edf0ac90,1,0,...) at sleepq_wait+0x48/frame 0xedf0ac60 _cv_wait(ca186afc,ca186c74,c105c2a3,77,ca186b04,...) at _cv_wait+0x1f9/frame 0xedf0aca4 usb_process(ca186af4,edf0ad08,c1078230,3d7,0,...) at usb_process+0xe6/frame 0xedf0accc fork_exit(c09456a0,ca186af4,edf0ad08) at fork_exit+0x7f/frame 0xedf0acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf0acf4 --- trap 0, eip = 0, esp = 0xedf0ad40, ebp = 0 --- Tracing command usb pid 15 tid 100037 td 0xca17f8d0 sched_switch(ca17f8d0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xedf07bd4 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xedf07c08 sleepq_switch(ca17f8d0,0,c1084241,26d,ca17f8d0,...) at sleepq_switch+0x1b9/frame 0xedf07c3c sleepq_wait(ca186acc,0,edf07c90,1,0,...) at sleepq_wait+0x48/frame 0xedf07c60 _cv_wait(ca186acc,ca186c74,c105c2a3,77,ca186ad4,...) at _cv_wait+0x1f9/frame 0xedf07ca4 usb_process(ca186ac4,edf07d08,c1078230,3d7,0,...) at usb_process+0xe6/frame 0xedf07ccc fork_exit(c09456a0,ca186ac4,edf07d08) at fork_exit+0x7f/frame 0xedf07cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf07cf4 --- trap 0, eip = 0, esp = 0xedf07d40, ebp = 0 --- Tracing command usb pid 15 tid 100035 td 0xca182000 sched_switch(ca182000,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xedf00bd4 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xedf00c08 sleepq_switch(ca182000,0,c1084241,26d,ca182000,...) at sleepq_switch+0x1b9/frame 0xedf00c3c sleepq_wait(ca17ab5c,0,edf00c90,1,0,...) at sleepq_wait+0x48/frame 0xedf00c60 _cv_wait(ca17ab5c,ca17ac74,c105c2a3,77,ca17ab64,...) at _cv_wait+0x1f9/frame 0xedf00ca4 usb_process(ca17ab54,edf00d08,c1078230,3d7,0,...) at usb_process+0xe6/frame 0xedf00ccc fork_exit(c09456a0,ca17ab54,edf00d08) at fork_exit+0x7f/frame 0xedf00cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf00cf4 --- trap 0, eip = 0, esp = 0xedf00d40, ebp = 0 --- Tracing command usb pid 15 tid 100034 td 0xca1822f0 sched_switch(ca1822f0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xedefdbd4 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xedefdc08 sleepq_switch(ca1822f0,0,c1084241,26d,ca1822f0,...) at sleepq_switch+0x1b9/frame 0xedefdc3c sleepq_wait(ca17ab2c,0,edefdc90,1,0,...) at sleepq_wait+0x48/frame 0xedefdc60 _cv_wait(ca17ab2c,ca17ac74,c105c2a3,77,ca17ab34,...) at _cv_wait+0x1f9/frame 0xedefdca4 usb_process(ca17ab24,edefdd08,c1078230,3d7,0,...) at usb_process+0xe6/frame 0xedefdccc fork_exit(c09456a0,ca17ab24,edefdd08) at fork_exit+0x7f/frame 0xedefdcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedefdcf4 --- trap 0, eip = 0, esp = 0xedefdd40, ebp = 0 --- Tracing command usb pid 15 tid 100033 td 0xca1825e0 sched_switch(ca1825e0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xedefabd4 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xedefac08 sleepq_switch(ca1825e0,0,c1084241,26d,ca1825e0,...) at sleepq_switch+0x1b9/frame 0xedefac3c sleepq_wait(ca17aafc,0,edefac90,1,0,...) at sleepq_wait+0x48/frame 0xedefac60 _cv_wait(ca17aafc,ca17ac74,c105c2a3,77,ca17ab04,...) at _cv_wait+0x1f9/frame 0xedefaca4 usb_process(ca17aaf4,edefad08,c1078230,3d7,0,...) at usb_process+0xe6/frame 0xedefaccc fork_exit(c09456a0,ca17aaf4,edefad08) at fork_exit+0x7f/frame 0xedefacf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedefacf4 --- trap 0, eip = 0, esp = 0xedefad40, ebp = 0 --- Tracing command usb pid 15 tid 100032 td 0xca1828d0 sched_switch(ca1828d0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xedef7bd4 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xedef7c08 sleepq_switch(ca1828d0,0,c1084241,26d,ca1828d0,...) at sleepq_switch+0x1b9/frame 0xedef7c3c sleepq_wait(ca17aacc,0,edef7c90,1,0,...) at sleepq_wait+0x48/frame 0xedef7c60 _cv_wait(ca17aacc,ca17ac74,c105c2a3,77,ca17aad4,...) at _cv_wait+0x1f9/frame 0xedef7ca4 usb_process(ca17aac4,edef7d08,c1078230,3d7,0,...) at usb_process+0xe6/frame 0xedef7ccc fork_exit(c09456a0,ca17aac4,edef7d08) at fork_exit+0x7f/frame 0xedef7cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedef7cf4 --- trap 0, eip = 0, esp = 0xedef7d40, ebp = 0 --- Tracing command yarrow pid 14 tid 100017 td 0xca0145e0 sched_switch(ca0145e0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xc7216b90 mi_switch(104,0,c1084241,1f7,0,...) at mi_switch+0x1c9/frame 0xc7216bc4 sleepq_switch(ca0145e0,0,c1084241,290,ca0145e0,...) at sleepq_switch+0x1b9/frame 0xc7216bf8 sleepq_timedwait(c122b440,0,c106aa4a,2,0,...) at sleepq_timedwait+0x48/frame 0xc7216c1c _sleep(c122b440,0,0,c106aa4a,64) at _sleep+0x317/frame 0xc7216c74 pause(c106aa4a,64,c1037c5e,111,0,...) at pause+0x85/frame 0xc7216c98 random_kthread(0,c7216d08,c1078230,3d7,0,...) at random_kthread+0x30f/frame 0xc7216ccc fork_exit(c0835840,0,c7216d08) at fork_exit+0x7f/frame 0xc7216cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7216cf4 --- trap 0, eip = 0, esp = 0xc7216d40, ebp = 0 --- Tracing command geom pid 13 tid 100016 td 0xca0148d0 sched_switch(ca0148d0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xc7212b88 mi_switch(104,0,c1084241,1f7,164,...) at mi_switch+0x1c9/frame 0xc7212bbc sleepq_switch(ca0148d0,0,c1084241,26d,ca0148d0,...) at sleepq_switch+0x1b9/frame 0xc7212bf0 sleepq_wait(c1413014,5c,c106aa4a,0,0,...) at sleepq_wait+0x48/frame 0xc7212c14 _sleep(c1413014,c1229788,25c,c106aa4a,0,...) at _sleep+0x34e/frame 0xc7212c6c g_io_schedule_down(ca0148d0,0,c106c4d4,6c,c7212cf4,...) at g_io_schedule_down+0x3c/frame 0xc7212cb4 g_down_procbody(0,c7212d08,c1078230,3d7,0,...) at g_down_procbody+0x9d/frame 0xc7212ccc fork_exit(c09f1ae0,0,c7212d08) at fork_exit+0x7f/frame 0xc7212cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7212cf4 --- trap 0, eip = 0, esp = 0xc7212d40, ebp = 0 --- Tracing command geom pid 13 tid 100015 td 0xca014bc0 sched_switch(ca014bc0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xc720fbac mi_switch(104,0,c1084241,1f7,164,...) at mi_switch+0x1c9/frame 0xc720fbe0 sleepq_switch(ca014bc0,0,c1084241,26d,ca014bc0,...) at sleepq_switch+0x1b9/frame 0xc720fc14 sleepq_wait(c1413010,5c,c106aa4a,0,0,...) at sleepq_wait+0x48/frame 0xc720fc38 _sleep(c1413010,c12297a8,25c,c106aa4a,0,...) at _sleep+0x34e/frame 0xc720fc90 g_io_schedule_up(ca014bc0,0,c106c4d4,5f,c720fcf4,...) at g_io_schedule_up+0x8f/frame 0xc720fcb4 g_up_procbody(0,c720fd08,c1078230,3d7,0,...) at g_up_procbody+0x9d/frame 0xc720fccc fork_exit(c09f1a40,0,c720fd08) at fork_exit+0x7f/frame 0xc720fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc720fcf4 --- trap 0, eip = 0, esp = 0xc720fd40, ebp = 0 --- Tracing command geom pid 13 tid 100014 td 0xca015000 sched_switch(ca015000,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xc720cbbc mi_switch(104,0,c1084241,1f7,164,...) at mi_switch+0x1c9/frame 0xc720cbf0 sleepq_switch(ca015000,0,c1084241,26d,ca015000,...) at sleepq_switch+0x1b9/frame 0xc720cc24 sleepq_wait(c141300c,5c,c106aa4a,0,0,...) at sleepq_wait+0x48/frame 0xc720cc48 _sleep(c141300c,c1229760,25c,c106aa4a,0,...) at _sleep+0x34e/frame 0xc720cca0 g_run_events(0,c720cd08,c1078230,3d7,0,...) at g_run_events+0x4f3/frame 0xc720cccc fork_exit(c09f19a0,0,c720cd08) at fork_exit+0x7f/frame 0xc720ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc720ccf4 --- trap 0, eip = 0, esp = 0xc720cd40, ebp = 0 --- Tracing command intr pid 12 tid 100063 td 0xca1912f0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100062 td 0xca1915e0 sched_switch(ca1915e0,0,109,1b3,0,...) at sched_switch+0x4b4/frame 0xedf73c64 mi_switch(109,0,c10784cd,563,ca1915e0,...) at mi_switch+0x1c9/frame 0xedf73c98 ithread_loop(c9f4e670,edf73d08,c1078230,3d7,0,...) at ithread_loop+0x100/frame 0xedf73ccc fork_exit(c0a625f0,c9f4e670,edf73d08) at fork_exit+0x7f/frame 0xedf73cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf73cf4 --- trap 0, eip = 0, esp = 0xedf73d40, ebp = 0 --- Tracing command intr pid 12 tid 100060 td 0xca191bc0 sched_switch(ca191bc0,0,109,1b3,0,...) at sched_switch+0x4b4/frame 0xedf63c64 mi_switch(109,0,c10784cd,563,ca191bc0,...) at mi_switch+0x1c9/frame 0xedf63c98 ithread_loop(c9f4e680,edf63d08,c1078230,3d7,0,...) at ithread_loop+0x100/frame 0xedf63ccc fork_exit(c0a625f0,c9f4e680,edf63d08) at fork_exit+0x7f/frame 0xedf63cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf63cf4 --- trap 0, eip = 0, esp = 0xedf63d40, ebp = 0 --- Tracing command intr pid 12 tid 100059 td 0xca19c000 sched_switch(ca19c000,0,109,1b3,0,...) at sched_switch+0x4b4/frame 0xedf52c64 mi_switch(109,0,c10784cd,563,ca19c000,...) at mi_switch+0x1c9/frame 0xedf52c98 ithread_loop(c9f4e690,edf52d08,c1078230,3d7,0,...) at ithread_loop+0x100/frame 0xedf52ccc fork_exit(c0a625f0,c9f4e690,edf52d08) at fork_exit+0x7f/frame 0xedf52cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf52cf4 --- trap 0, eip = 0, esp = 0xedf52d40, ebp = 0 --- Tracing command intr pid 12 tid 100054 td 0xca19f000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xca191000 sched_switch(ca191000,0,109,1b3,0,...) at sched_switch+0x4b4/frame 0xedf14c64 mi_switch(109,0,c10784cd,563,ca191000,...) at mi_switch+0x1c9/frame 0xedf14c98 ithread_loop(c9f4e6b0,edf14d08,c1078230,3d7,0,...) at ithread_loop+0x100/frame 0xedf14ccc fork_exit(c0a625f0,c9f4e6b0,edf14d08) at fork_exit+0x7f/frame 0xedf14cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf14cf4 --- trap 0, eip = 0, esp = 0xedf14d40, ebp = 0 --- Tracing command intr pid 12 tid 100036 td 0xca17fbc0 sched_switch(ca17fbc0,0,109,1b3,0,...) at sched_switch+0x4b4/frame 0xedf04c64 mi_switch(109,0,c10784cd,563,ca17fbc0,...) at mi_switch+0x1c9/frame 0xedf04c98 ithread_loop(c9f4e6c0,edf04d08,c1078230,3d7,0,...) at ithread_loop+0x100/frame 0xedf04ccc fork_exit(c0a625f0,c9f4e6c0,edf04d08) at fork_exit+0x7f/frame 0xedf04cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf04cf4 --- trap 0, eip = 0, esp = 0xedf04d40, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xca182bc0 sched_switch(ca182bc0,0,109,1b3,0,...) at sched_switch+0x4b4/frame 0xedef4c64 mi_switch(109,0,c10784cd,563,ca182bc0,...) at mi_switch+0x1c9/frame 0xedef4c98 ithread_loop(c9f4e6d0,edef4d08,c1078230,3d7,0,...) at ithread_loop+0x100/frame 0xedef4ccc fork_exit(c0a625f0,c9f4e6d0,edef4d08) at fork_exit+0x7f/frame 0xedef4cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedef4cf4 --- trap 0, eip = 0, esp = 0xedef4d40, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xca0152f0 sched_switch(ca0152f0,0,109,1b3,0,...) at sched_switch+0x4b4/frame 0xc7373c64 mi_switch(109,0,c10784cd,563,ca0152f0,...) at mi_switch+0x1c9/frame 0xc7373c98 ithread_loop(c9f4e6e0,c7373d08,c1078230,3d7,0,...) at ithread_loop+0x100/frame 0xc7373ccc fork_exit(c0a625f0,c9f4e6e0,c7373d08) at fork_exit+0x7f/frame 0xc7373cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7373cf4 --- trap 0, eip = 0, esp = 0xc7373d40, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xca0155e0 sched_switch(ca0155e0,0,109,1b3,0,...) at sched_switch+0x4b4/frame 0xc736fc64 mi_switch(109,0,c10784cd,563,ca0155e0,...) at mi_switch+0x1c9/frame 0xc736fc98 ithread_loop(c9f4e6f0,c736fd08,c1078230,3d7,0,...) at ithread_loop+0x100/frame 0xc736fccc fork_exit(c0a625f0,c9f4e6f0,c736fd08) at fork_exit+0x7f/frame 0xc736fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc736fcf4 --- trap 0, eip = 0, esp = 0xc736fd40, ebp = 0 --- Tracing command intr pid 12 tid 100028 td 0xca0158d0 sched_switch(ca0158d0,0,109,1b3,0,...) at sched_switch+0x4b4/frame 0xc7266c64 mi_switch(109,0,c10784cd,563,ca0158d0,...) at mi_switch+0x1c9/frame 0xc7266c98 ithread_loop(c9f4e740,c7266d08,c1078230,3d7,0,...) at ithread_loop+0x100/frame 0xc7266ccc fork_exit(c0a625f0,c9f4e740,c7266d08) at fork_exit+0x7f/frame 0xc7266cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7266cf4 --- trap 0, eip = 0, esp = 0xc7266d40, ebp = 0 --- Tracing command intr pid 12 tid 100026 td 0xca0ff000 sched_switch(ca0ff000,0,109,1b3,0,...) at sched_switch+0x4b4/frame 0xc7231c64 mi_switch(109,0,c10784cd,563,ca0ff000,...) at mi_switch+0x1c9/frame 0xc7231c98 ithread_loop(c9f4e760,c7231d08,c1078230,3d7,0,...) at ithread_loop+0x100/frame 0xc7231ccc fork_exit(c0a625f0,c9f4e760,c7231d08) at fork_exit+0x7f/frame 0xc7231cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7231cf4 --- trap 0, eip = 0, esp = 0xc7231d40, ebp = 0 --- Tracing command intr pid 12 tid 100024 td 0xca0ff5e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100022 td 0xca0ffbc0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100021 td 0xc9f4f8d0 sched_switch(c9f4f8d0,0,109,1b3,0,...) at sched_switch+0x4b4/frame 0xc7222c64 mi_switch(109,0,c10784cd,563,c9f4f8d0,...) at mi_switch+0x1c9/frame 0xc7222c98 ithread_loop(c9f4e790,c7222d08,c1078230,3d7,0,...) at ithread_loop+0x100/frame 0xc7222ccc fork_exit(c0a625f0,c9f4e790,c7222d08) at fork_exit+0x7f/frame 0xc7222cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7222cf4 --- trap 0, eip = 0, esp = 0xc7222d40, ebp = 0 --- Tracing command intr pid 12 tid 100012 td 0xc9f075e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100011 td 0xc9f078d0 sched_switch(c9f078d0,0,109,1b3,c10784cd,...) at sched_switch+0x4b4/frame 0xc7203c64 mi_switch(109,0,c10784cd,563,c9f078d0,...) at mi_switch+0x1c9/frame 0xc7203c98 ithread_loop(c9f4e7b0,c7203d08,c1078230,3d7,0,...) at ithread_loop+0x100/frame 0xc7203ccc fork_exit(c0a625f0,c9f4e7b0,c7203d08) at fork_exit+0x7f/frame 0xc7203cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7203cf4 --- trap 0, eip = 0, esp = 0xc7203d40, ebp = 0 --- Tracing command intr pid 12 tid 100010 td 0xc9f07bc0 sched_switch(c9f07bc0,0,109,1b3,c10784cd,...) at sched_switch+0x4b4/frame 0xc7200c64 mi_switch(109,0,c10784cd,563,c9f07bc0,...) at mi_switch+0x1c9/frame 0xc7200c98 ithread_loop(c9f4e7c0,c7200d08,c1078230,3d7,0,...) at ithread_loop+0x100/frame 0xc7200ccc fork_exit(c0a625f0,c9f4e7c0,c7200d08) at fork_exit+0x7f/frame 0xc7200cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7200cf4 --- trap 0, eip = 0, esp = 0xc7200d40, ebp = 0 --- Tracing command intr pid 12 tid 100009 td 0xc9f4f000 sched_switch(c9f4f000,0,109,1b3,c10784cd,...) at sched_switch+0x4b4/frame 0xc71fdc64 mi_switch(109,0,c10784cd,563,c9f4f000,...) at mi_switch+0x1c9/frame 0xc71fdc98 ithread_loop(c9f4e7d0,c71fdd08,c1078230,3d7,0,...) at ithread_loop+0x100/frame 0xc71fdccc fork_exit(c0a625f0,c9f4e7d0,c71fdd08) at fork_exit+0x7f/frame 0xc71fdcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc71fdcf4 --- trap 0, eip = 0, esp = 0xc71fdd40, ebp = 0 --- Tracing command intr pid 12 tid 100008 td 0xc9f4f2f0 sched_switch(c9f4f2f0,0,109,1b3,0,...) at sched_switch+0x4b4/frame 0xc71fac64 mi_switch(109,0,c10784cd,563,c9f4f2f0,...) at mi_switch+0x1c9/frame 0xc71fac98 ithread_loop(c9f4e7e0,c71fad08,c1078230,3d7,0,...) at ithread_loop+0x100/frame 0xc71faccc fork_exit(c0a625f0,c9f4e7e0,c71fad08) at fork_exit+0x7f/frame 0xc71facf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc71facf4 --- trap 0, eip = 0, esp = 0xc71fad40, ebp = 0 --- Tracing command intr pid 12 tid 100007 td 0xc9f4f5e0 sched_switch(c9f4f5e0,0,109,1b3,0,...) at sched_switch+0x4b4/frame 0xc71f7c64 mi_switch(109,0,c10784cd,563,c9f4f5e0,...) at mi_switch+0x1c9/frame 0xc71f7c98 ithread_loop(c9f4e7f0,c71f7d08,c1078230,3d7,0,...) at ithread_loop+0x100/frame 0xc71f7ccc fork_exit(c0a625f0,c9f4e7f0,c71f7d08) at fork_exit+0x7f/frame 0xc71f7cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc71f7cf4 --- trap 0, eip = 0, esp = 0xc71f7d40, ebp = 0 --- Tracing command idle pid 11 tid 100006 td 0xc9f02000 cpustop_handler(3,13,c71f3ba8,c0ea292b,c71f3aa8,...) at cpustop_handler+0x2f/frame 0xc71f3a58 ipi_nmi_handler(c71f3aa8,40a82c,c71f3b68,fb7e0101,c71f3ad8,...) at ipi_nmi_handler+0x37/frame 0xc71f3a68 trap(c71f3bb4) at trap+0x3b/frame 0xc71f3ba8 calltrap() at calltrap+0x6/frame 0xc71f3ba8 --- trap 0x13, eip = 0xc0e882c2, esp = 0xc71f3bf4, ebp = 0xc71f3c34 --- acpi_cpu_c1(0,c71f3c50,c0e9250d,0,7,...) at acpi_cpu_c1+0x2/frame 0xc71f3c34 cpu_idle_acpi(0,7,c71f3ccc,c0ab75da,0,...) at cpu_idle_acpi+0x2f/frame 0xc71f3c40 cpu_idle(0,2,c1080bb9,396,c1239c88,...) at cpu_idle+0x7d/frame 0xc71f3c50 sched_idletd(0,c71f3d08,c1078230,3d7,0,...) at sched_idletd+0x1fa/frame 0xc71f3ccc fork_exit(c0ab73e0,0,c71f3d08) at fork_exit+0x7f/frame 0xc71f3cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc71f3cf4 --- trap 0, eip = 0, esp = 0xc71f3d40, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc9f022f0 cpustop_handler(2,13,c71f0ba8,c0ea292b,c71f0aa8,...) at cpustop_handler+0x2f/frame 0xc71f0a58 ipi_nmi_handler(c71f0aa8,175410,c71f0b68,26800101,c71f0ad8,...) at ipi_nmi_handler+0x37/frame 0xc71f0a68 trap(c71f0bb4) at trap+0x3b/frame 0xc71f0ba8 calltrap() at calltrap+0x6/frame 0xc71f0ba8 --- trap 0x13, eip = 0xc0e882c2, esp = 0xc71f0bf4, ebp = 0xc71f0c34 --- acpi_cpu_c1(0,c71f0c50,c0e9250d,0,6,...) at acpi_cpu_c1+0x2/frame 0xc71f0c34 cpu_idle_acpi(0,6,c71f0ccc,c0ab75da,0,...) at cpu_idle_acpi+0x2f/frame 0xc71f0c40 cpu_idle(0,2,c1080bb9,409,c1239588,...) at cpu_idle+0x7d/frame 0xc71f0c50 sched_idletd(0,c71f0d08,c1078230,3d7,0,...) at sched_idletd+0x1fa/frame 0xc71f0ccc fork_exit(c0ab73e0,0,c71f0d08) at fork_exit+0x7f/frame 0xc71f0cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc71f0cf4 --- trap 0, eip = 0, esp = 0xc71f0d40, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc9f025e0 sched_switch(c9f025e0,0,608,1ae,c71edc40,...) at sched_switch+0x4b4/frame 0xc71edc00 mi_switch(608,0,c107ede8,d3,7,...) at mi_switch+0x1c9/frame 0xc71edc34 critical_exit(0,2,c1080bb9,a46,c1238e88,...) at critical_exit+0xa3/frame 0xc71edc50 sched_idletd(0,c71edd08,c1078230,3d7,0,...) at sched_idletd+0x1fa/frame 0xc71edccc fork_exit(c0ab73e0,0,c71edd08) at fork_exit+0x7f/frame 0xc71edcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc71edcf4 --- trap 0, eip = 0, esp = 0xc71edd40, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xc9f028d0 cpustop_handler(0,13,c71eaba8,c0ea292b,c71eaaa8,...) at cpustop_handler+0x2f/frame 0xc71eaa58 ipi_nmi_handler(c71eaaa8,40a6f3,c71eab68,82a90101,c71eaad8,...) at ipi_nmi_handler+0x37/frame 0xc71eaa68 trap(c71eabb4) at trap+0x3b/frame 0xc71eaba8 calltrap() at calltrap+0x6/frame 0xc71eaba8 --- trap 0x13, eip = 0xc0e882c2, esp = 0xc71eabf4, ebp = 0xc71eac34 --- acpi_cpu_c1(0,c71eac50,c0e9250d,0,2,...) at acpi_cpu_c1+0x2/frame 0xc71eac34 cpu_idle_acpi(0,2,c71eaccc,c0ab75da,0,...) at cpu_idle_acpi+0x2f/frame 0xc71eac40 cpu_idle(0,2,c1080bb9,a46,c1238788,...) at cpu_idle+0x7d/frame 0xc71eac50 sched_idletd(0,c71ead08,c1078230,3d7,0,...) at sched_idletd+0x1fa/frame 0xc71eaccc fork_exit(c0ab73e0,0,c71ead08) at fork_exit+0x7f/frame 0xc71eacf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc71eacf4 --- trap 0, eip = 0, esp = 0xc71ead40, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc9f02bc0 sched_switch(c9f02bc0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xc71e6998 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xc71e69cc sleepq_switch(c9f02bc0,0,c1084241,1ab,c71e6a44,...) at sleepq_switch+0x1b9/frame 0xc71e6a00 sleepq_catch_signals(0,c1084241,164,108,c9f02bc0,...) at sleepq_catch_signals+0x3b1/frame 0xc71e6a48 sleepq_wait_sig(c9f00b40,6c,c10876f5,100,0,...) at sleepq_wait_sig+0x14/frame 0xc71e6a6c _sleep(c9f00b40,c9f00bc8,16c,c10876f5,0,...) at _sleep+0x32d/frame 0xc71e6ac4 kern_wait6(c9f02bc0,7,0,0,c71e6b4c,...) at kern_wait6+0x43c/frame 0xc71e6b20 sys_wait4(c9f02bc0,c71e6cc8,14,c1080bb9,7b3,...) at sys_wait4+0x94/frame 0xc71e6c40 syscall(c71e6d08) at syscall+0x2ed/frame 0xc71e6cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xc71e6cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x805dce7, esp = 0xbfbfd8f4, ebp = 0xbfbfd908 --- Tracing command audit pid 10 tid 100001 td 0xc9f07000 sched_switch(c9f07000,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xc71e3ba8 mi_switch(104,0,c1084241,1f7,8,...) at mi_switch+0x1c9/frame 0xc71e3bdc sleepq_switch(c9f07000,0,c1084241,26d,c9f07000,...) at sleepq_switch+0x1b9/frame 0xc71e3c10 sleepq_wait(c1419cb8,0,c71e3c64,1,0,...) at sleepq_wait+0x48/frame 0xc71e3c34 _cv_wait(c1419cb8,c1419c44,c10af682,18d,0,...) at _cv_wait+0x1f9/frame 0xc71e3c78 audit_worker(0,c71e3d08,c1078230,3d7,0,...) at audit_worker+0x94/frame 0xc71e3ccc fork_exit(c0c98350,0,c71e3d08) at fork_exit+0x7f/frame 0xc71e3cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc71e3cf4 --- trap 0, eip = 0, esp = 0xc71e3d40, ebp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xcb6328d0 sched_switch(cb6328d0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xedf7fb8c mi_switch(104,0,c1084241,1f7,0,...) at mi_switch+0x1c9/frame 0xedf7fbc0 sleepq_switch(cb6328d0,0,c1084241,290,cb6328d0,...) at sleepq_switch+0x1b9/frame 0xedf7fbf4 sleepq_timedwait(c122b440,0,c106aa4a,2,0,...) at sleepq_timedwait+0x48/frame 0xedf7fc18 _sleep(c122b440,0,0,c106aa4a,bb8) at _sleep+0x317/frame 0xedf7fc70 pause(c106aa4a,bb8,12b,129,c1413094,...) at pause+0x85/frame 0xedf7fc94 deadlkres(0,edf7fd08,c1078230,3d7,0,...) at deadlkres+0x48/frame 0xedf7fccc fork_exit(c0a41ab0,0,edf7fd08) at fork_exit+0x7f/frame 0xedf7fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf7fcf4 --- trap 0, eip = 0, esp = 0xedf7fd40, ebp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xcb632bc0 sched_switch(cb632bc0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xedf7cbd8 mi_switch(104,0,c1084241,1f7,c1247e64,...) at mi_switch+0x1c9/frame 0xedf7cc0c sleepq_switch(cb632bc0,0,c1084241,26d,cc45f580,...) at sleepq_switch+0x1b9/frame 0xedf7cc40 sleepq_wait(cc45f580,0,c107f389,c106aa4a,0,...) at sleepq_wait+0x48/frame 0xedf7cc64 msleep_spin(cc45f580,cc45f598,c106aa4a,0,cb632bc0,...) at msleep_spin+0x216/frame 0xedf7cca4 taskqueue_thread_loop(c140f750,edf7cd08,c1078230,3d7,0,...) at taskqueue_thread_loop+0x7c/frame 0xedf7cccc fork_exit(c0ad5e90,c140f750,edf7cd08) at fork_exit+0x7f/frame 0xedf7ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf7ccf4 --- trap 0, eip = 0, esp = 0xedf7cd40, ebp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xca015bc0 sched_switch(ca015bc0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xc7234bc0 mi_switch(104,0,c1084241,1f7,164,...) at mi_switch+0x1c9/frame 0xc7234bf4 sleepq_switch(ca015bc0,0,c1084241,26d,ca015bc0,...) at sleepq_switch+0x1b9/frame 0xc7234c28 sleepq_wait(ca1034c0,0,c106aa4a,0,0,...) at sleepq_wait+0x48/frame 0xc7234c4c _sleep(ca1034c0,ca1034d8,0,c106aa4a,0,...) at _sleep+0x34e/frame 0xc7234ca4 taskqueue_thread_loop(c1419cf0,c7234d08,c1078230,3d7,0,...) at taskqueue_thread_loop+0xb9/frame 0xc7234ccc fork_exit(c0ad5e90,c1419cf0,c7234d08) at fork_exit+0x7f/frame 0xc7234cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7234cf4 --- trap 0, eip = 0, esp = 0xc7234d40, ebp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xca0ff2f0 sched_switch(ca0ff2f0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xc722ebc0 mi_switch(104,0,c1084241,1f7,164,...) at mi_switch+0x1c9/frame 0xc722ebf4 sleepq_switch(ca0ff2f0,0,c1084241,26d,ca0ff2f0,...) at sleepq_switch+0x1b9/frame 0xc722ec28 sleepq_wait(ca086280,0,c106aa4a,0,0,...) at sleepq_wait+0x48/frame 0xc722ec4c _sleep(ca086280,ca086298,0,c106aa4a,0,...) at _sleep+0x34e/frame 0xc722eca4 taskqueue_thread_loop(c14137e8,c722ed08,c1078230,3d7,0,...) at taskqueue_thread_loop+0xb9/frame 0xc722eccc fork_exit(c0ad5e90,c14137e8,c722ed08) at fork_exit+0x7f/frame 0xc722ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc722ecf4 --- trap 0, eip = 0, esp = 0xc722ed40, ebp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xca0ff8d0 sched_switch(ca0ff8d0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xc7228bc0 mi_switch(104,0,c1084241,1f7,164,...) at mi_switch+0x1c9/frame 0xc7228bf4 sleepq_switch(ca0ff8d0,0,c1084241,26d,ca0ff8d0,...) at sleepq_switch+0x1b9/frame 0xc7228c28 sleepq_wait(ca086300,0,c106aa4a,0,0,...) at sleepq_wait+0x48/frame 0xc7228c4c _sleep(ca086300,ca086318,0,c106aa4a,0,...) at _sleep+0x34e/frame 0xc7228ca4 taskqueue_thread_loop(c14166a8,c7228d08,c1078230,3d7,0,...) at taskqueue_thread_loop+0xb9/frame 0xc7228ccc fork_exit(c0ad5e90,c14166a8,c7228d08) at fork_exit+0x7f/frame 0xc7228cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7228cf4 --- trap 0, eip = 0, esp = 0xc7228d40, ebp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xc9f4fbc0 sched_switch(c9f4fbc0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xc721fbd8 mi_switch(104,0,c1084241,1f7,c1247cb4,...) at mi_switch+0x1c9/frame 0xc721fc0c sleepq_switch(c9f4fbc0,0,c1084241,26d,ca0863c0,...) at sleepq_switch+0x1b9/frame 0xc721fc40 sleepq_wait(ca0863c0,0,c107f389,c106aa4a,0,...) at sleepq_wait+0x48/frame 0xc721fc64 msleep_spin(ca0863c0,ca0863d8,c106aa4a,0,c9f4fbc0,...) at msleep_spin+0x216/frame 0xc721fca4 taskqueue_thread_loop(c1410368,c721fd08,c1078230,3d7,0,...) at taskqueue_thread_loop+0x7c/frame 0xc721fccc fork_exit(c0ad5e90,c1410368,c721fd08) at fork_exit+0x7f/frame 0xc721fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc721fcf4 --- trap 0, eip = 0, esp = 0xc721fd40, ebp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xca014000 sched_switch(ca014000,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xc721cbd8 mi_switch(104,0,c1084241,1f7,c1247cb4,...) at mi_switch+0x1c9/frame 0xc721cc0c sleepq_switch(ca014000,0,c1084241,26d,ca0863c0,...) at sleepq_switch+0x1b9/frame 0xc721cc40 sleepq_wait(ca0863c0,0,c107f389,c106aa4a,0,...) at sleepq_wait+0x48/frame 0xc721cc64 msleep_spin(ca0863c0,ca0863d8,c106aa4a,0,ca014000,...) at msleep_spin+0x216/frame 0xc721cca4 taskqueue_thread_loop(c1410368,c721cd08,c1078230,3d7,0,...) at taskqueue_thread_loop+0x7c/frame 0xc721cccc fork_exit(c0ad5e90,c1410368,c721cd08) at fork_exit+0x7f/frame 0xc721ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc721ccf4 --- trap 0, eip = 0, esp = 0xc721cd40, ebp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xca0142f0 sched_switch(ca0142f0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xc7219bd8 mi_switch(104,0,c1084241,1f7,c1247cb4,...) at mi_switch+0x1c9/frame 0xc7219c0c sleepq_switch(ca0142f0,0,c1084241,26d,ca0863c0,...) at sleepq_switch+0x1b9/frame 0xc7219c40 sleepq_wait(ca0863c0,0,c107f389,c106aa4a,0,...) at sleepq_wait+0x48/frame 0xc7219c64 msleep_spin(ca0863c0,ca0863d8,c106aa4a,0,ca0142f0,...) at msleep_spin+0x216/frame 0xc7219ca4 taskqueue_thread_loop(c1410368,c7219d08,c1078230,3d7,0,...) at taskqueue_thread_loop+0x7c/frame 0xc7219ccc fork_exit(c0ad5e90,c1410368,c7219d08) at fork_exit+0x7f/frame 0xc7219cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7219cf4 --- trap 0, eip = 0, esp = 0xc7219d40, ebp = 0 --- Tracing command kernel pid 0 tid 100013 td 0xc9f072f0 sched_switch(c9f072f0,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xc7209bc0 mi_switch(104,0,c1084241,1f7,164,...) at mi_switch+0x1c9/frame 0xc7209bf4 sleepq_switch(c9f072f0,0,c1084241,26d,c9f072f0,...) at sleepq_switch+0x1b9/frame 0xc7209c28 sleepq_wait(c9e9e7c0,0,c106aa4a,0,0,...) at sleepq_wait+0x48/frame 0xc7209c4c _sleep(c9e9e7c0,c9e9e7d8,0,c106aa4a,0,...) at _sleep+0x34e/frame 0xc7209ca4 taskqueue_thread_loop(c1246840,c7209d08,c1078230,3d7,0,...) at taskqueue_thread_loop+0xb9/frame 0xc7209ccc fork_exit(c0ad5e90,c1246840,c7209d08) at fork_exit+0x7f/frame 0xc7209cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7209cf4 --- trap 0, eip = 0, esp = 0xc7209d40, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc1413370 sched_switch(c1413370,0,104,1b3,c0a7d9ee,...) at sched_switch+0x4b4/frame 0xc1820c20 mi_switch(104,0,c1084241,1f7,0,...) at mi_switch+0x1c9/frame 0xc1820c54 sleepq_switch(c1413370,0,c1084241,290,c1413370,...) at sleepq_switch+0x1b9/frame 0xc1820c88 sleepq_timedwait(c1413094,54,c10b0845,0,0,...) at sleepq_timedwait+0x48/frame 0xc1820cac _sleep(c1413094,0,54,c10b0845,2710,...) at _sleep+0x317/frame 0xc1820d04 scheduler(0,0,c10e31a8,181e000,1825000,...) at scheduler+0x274/frame 0xc1820d38 mi_startup() at mi_startup+0xf7/frame 0xc1820d58 begin() at begin+0x2c db:0:allt> call doadump Physical memory: 3435 MB Dumping 474 MB: 459 443 427 411 395 379 363 347 331 315 299 283 267 251 235 219 203 187 171 155 139 123 107 91 75 59 43 27 11 Dump complete = 0 db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 1 $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/vm/vm_object.c =================================================================== --- /usr/src/sys/vm/vm_object.c (revision 246798) +++ /usr/src/sys/vm/vm_object.c (working copy) @@ -93,6 +93,7 @@ __FBSDID("$FreeBSD$"); #include #include #include +#include #include #include @@ -172,7 +173,7 @@ vm_object_zdtor(void *mem, int size, void *arg) ("object %p has reservations", object)); #endif - KASSERT(object->cache == NULL, + KASSERT(vm_object_cache_is_empty(object), ("object %p has cached pages", object)); KASSERT(object->paging_in_progress == 0, @@ -210,7 +211,7 @@ _vm_object_allocate(objtype_t type, vm_pindex_t si TAILQ_INIT(&object->memq); LIST_INIT(&object->shadow_head); - object->root = NULL; + object->rtree.rt_root = 0; object->type = type; switch (type) { case OBJT_DEAD: @@ -248,7 +249,7 @@ _vm_object_allocate(objtype_t type, vm_pindex_t si #if VM_NRESERVLEVEL > 0 LIST_INIT(&object->rvq); #endif - object->cache = NULL; + object->cache.rt_root = 0; mtx_lock(&vm_object_list_mtx); TAILQ_INSERT_TAIL(&vm_object_list, object, object_list); @@ -736,13 +737,13 @@ vm_object_terminate(vm_object_t object) } vm_page_unlock(p); } + vm_radix_reclaim_allnodes(&object->rtree); /* * If the object contained any pages, then reset it to an empty state. * None of the object's fields, including "resident_page_count", were * modified by the preceding loop. */ if (object->resident_page_count != 0) { - object->root = NULL; TAILQ_INIT(&object->memq); object->resident_page_count = 0; if (object->type == OBJT_VNODE) @@ -753,7 +754,7 @@ vm_object_terminate(vm_object_t object) if (__predict_false(!LIST_EMPTY(&object->rvq))) vm_reserv_break_all(object); #endif - if (__predict_false(object->cache != NULL)) + if (!vm_object_cache_is_empty(object)) vm_page_cache_free(object, 0, 0); /* @@ -1379,7 +1380,7 @@ retry: * should still be OBJT_DEFAULT and orig_object should not * contain any cached pages within the specified range. */ - if (__predict_false(orig_object->cache != NULL)) + if (!vm_object_cache_is_empty(orig_object)) vm_page_cache_transfer(orig_object, offidxstart, new_object); } @@ -1728,7 +1729,7 @@ vm_object_collapse(vm_object_t object) /* * Free any cached pages from backing_object. */ - if (__predict_false(backing_object->cache != NULL)) + if (!vm_object_cache_is_empty(backing_object)) vm_page_cache_free(backing_object, 0, 0); } /* @@ -1922,7 +1923,7 @@ again: } vm_object_pip_wakeup(object); skipmemq: - if (__predict_false(object->cache != NULL)) + if (!vm_object_cache_is_empty(object)) vm_page_cache_free(object, start, end); } Index: /usr/src/sys/vm/vm_object.h =================================================================== --- /usr/src/sys/vm/vm_object.h (revision 246798) +++ /usr/src/sys/vm/vm_object.h (working copy) @@ -71,6 +71,8 @@ #include #include +#include + /* * Types defined: * @@ -78,10 +80,10 @@ * * The root of cached pages pool is protected by both the per-object mutex * and the free pages queue mutex. - * On insert in the cache splay tree, the per-object mutex is expected + * On insert in the cache radix trie, the per-object mutex is expected * to be already held and the free pages queue mutex will be * acquired during the operation too. - * On remove and lookup from the cache splay tree, only the free + * On remove and lookup from the cache radix trie, only the free * pages queue mutex is expected to be locked. * These rules allow for reliably checking for the presence of cached * pages with only the per-object lock held, thereby reducing contention @@ -100,7 +102,7 @@ struct vm_object { LIST_HEAD(, vm_object) shadow_head; /* objects that this is a shadow for */ LIST_ENTRY(vm_object) shadow_list; /* chain of shadow objects */ TAILQ_HEAD(, vm_page) memq; /* list of resident pages */ - vm_page_t root; /* root of the resident page splay tree */ + struct vm_radix rtree; /* root of the resident page radix trie*/ vm_pindex_t size; /* Object size */ int generation; /* generation ID */ int ref_count; /* How many refs?? */ @@ -115,7 +117,7 @@ struct vm_object { vm_ooffset_t backing_object_offset;/* Offset in backing object */ TAILQ_ENTRY(vm_object) pager_object_list; /* list of all objects of this pager type */ LIST_HEAD(, vm_reserv) rvq; /* list of reservations */ - vm_page_t cache; /* (o + f) root of the cache page splay tree */ + struct vm_radix cache; /* (o + f) root of the cache page radix trie */ void *handle; union { /* @@ -231,6 +233,13 @@ void vm_object_pip_wakeup(vm_object_t object); void vm_object_pip_wakeupn(vm_object_t object, short i); void vm_object_pip_wait(vm_object_t object, char *waitid); +static __inline boolean_t +vm_object_cache_is_empty(vm_object_t object) +{ + + return (__predict_true(object->cache.rt_root == 0)); +} + vm_object_t vm_object_allocate (objtype_t, vm_pindex_t); void _vm_object_allocate (objtype_t, vm_pindex_t, vm_object_t); boolean_t vm_object_coalesce(vm_object_t, vm_ooffset_t, vm_size_t, vm_size_t, Index: /usr/src/sys/vm/vm_page.c =================================================================== --- /usr/src/sys/vm/vm_page.c (revision 246798) +++ /usr/src/sys/vm/vm_page.c (working copy) @@ -109,6 +109,7 @@ __FBSDID("$FreeBSD$"); #include #include #include +#include #include #include #include @@ -793,63 +794,6 @@ vm_page_dirty_KBI(vm_page_t m) } /* - * vm_page_splay: - * - * Implements Sleator and Tarjan's top-down splay algorithm. Returns - * the vm_page containing the given pindex. If, however, that - * pindex is not found in the vm_object, returns a vm_page that is - * adjacent to the pindex, coming before or after it. - */ -vm_page_t -vm_page_splay(vm_pindex_t pindex, vm_page_t root) -{ - struct vm_page dummy; - vm_page_t lefttreemax, righttreemin, y; - - if (root == NULL) - return (root); - lefttreemax = righttreemin = &dummy; - for (;; root = y) { - if (pindex < root->pindex) { - if ((y = root->left) == NULL) - break; - if (pindex < y->pindex) { - /* Rotate right. */ - root->left = y->right; - y->right = root; - root = y; - if ((y = root->left) == NULL) - break; - } - /* Link into the new root's right tree. */ - righttreemin->left = root; - righttreemin = root; - } else if (pindex > root->pindex) { - if ((y = root->right) == NULL) - break; - if (pindex > y->pindex) { - /* Rotate left. */ - root->right = y->left; - y->left = root; - root = y; - if ((y = root->right) == NULL) - break; - } - /* Link into the new root's left tree. */ - lefttreemax->right = root; - lefttreemax = root; - } else - break; - } - /* Assemble the new root. */ - lefttreemax->right = root->left; - righttreemin->left = root->right; - root->left = dummy.right; - root->right = dummy.left; - return (root); -} - -/* * vm_page_insert: [ internal use only ] * * Inserts the given mem entry into the object and object list. @@ -864,7 +808,7 @@ vm_page_dirty_KBI(vm_page_t m) void vm_page_insert(vm_page_t m, vm_object_t object, vm_pindex_t pindex) { - vm_page_t root; + vm_page_t neighbor; VM_OBJECT_LOCK_ASSERT(object, MA_OWNED); if (m->object != NULL) @@ -876,31 +820,19 @@ vm_page_insert(vm_page_t m, vm_object_t object, vm m->object = object; m->pindex = pindex; - /* - * Now link into the object's ordered list of backed pages. - */ - root = object->root; - if (root == NULL) { - m->left = NULL; - m->right = NULL; + if (object->resident_page_count == 0) { TAILQ_INSERT_TAIL(&object->memq, m, listq); - } else { - root = vm_page_splay(pindex, root); - if (pindex < root->pindex) { - m->left = root->left; - m->right = root; - root->left = NULL; - TAILQ_INSERT_BEFORE(root, m, listq); - } else if (pindex == root->pindex) - panic("vm_page_insert: offset already allocated"); - else { - m->right = root->right; - m->left = root; - root->right = NULL; - TAILQ_INSERT_AFTER(&object->memq, root, m, listq); - } + } else { + neighbor = vm_radix_lookup_ge(&object->rtree, pindex); + if (neighbor != NULL) { + KASSERT(pindex < neighbor->pindex, + ("vm_page_insert: offset %ju not minor than %ju", + (uintmax_t)pindex, (uintmax_t)neighbor->pindex)); + TAILQ_INSERT_BEFORE(neighbor, m, listq); + } else + TAILQ_INSERT_TAIL(&object->memq, m, listq); } - object->root = m; + vm_radix_insert(&object->rtree, pindex, m); /* * Show that the object has one more resident page. @@ -936,7 +868,6 @@ void vm_page_remove(vm_page_t m) { vm_object_t object; - vm_page_t next, prev, root; if ((m->oflags & VPO_UNMANAGED) == 0) vm_page_lock_assert(m, MA_OWNED); @@ -948,45 +879,7 @@ vm_page_remove(vm_page_t m) vm_page_flash(m); } - /* - * Now remove from the object's list of backed pages. - */ - if ((next = TAILQ_NEXT(m, listq)) != NULL && next->left == m) { - /* - * Since the page's successor in the list is also its parent - * in the tree, its right subtree must be empty. - */ - next->left = m->left; - KASSERT(m->right == NULL, - ("vm_page_remove: page %p has right child", m)); - } else if ((prev = TAILQ_PREV(m, pglist, listq)) != NULL && - prev->right == m) { - /* - * Since the page's predecessor in the list is also its parent - * in the tree, its left subtree must be empty. - */ - KASSERT(m->left == NULL, - ("vm_page_remove: page %p has left child", m)); - prev->right = m->right; - } else { - if (m != object->root) - vm_page_splay(m->pindex, object->root); - if (m->left == NULL) - root = m->right; - else if (m->right == NULL) - root = m->left; - else { - /* - * Move the page's successor to the root, because - * pages are usually removed in ascending order. - */ - if (m->right != next) - vm_page_splay(m->pindex, m->right); - next->left = m->left; - root = next; - } - object->root = root; - } + vm_radix_remove(&object->rtree, m->pindex); TAILQ_REMOVE(&object->memq, m, listq); /* @@ -1014,15 +907,10 @@ vm_page_remove(vm_page_t m) vm_page_t vm_page_lookup(vm_object_t object, vm_pindex_t pindex) { - vm_page_t m; VM_OBJECT_LOCK_ASSERT(object, MA_OWNED); - if ((m = object->root) != NULL && m->pindex != pindex) { - m = vm_page_splay(pindex, m); - if ((object->root = m)->pindex != pindex) - m = NULL; - } - return (m); + + return (vm_radix_lookup(&object->rtree, pindex)); } /* @@ -1036,17 +924,9 @@ vm_page_lookup(vm_object_t object, vm_pindex_t pin vm_page_t vm_page_find_least(vm_object_t object, vm_pindex_t pindex) { - vm_page_t m; VM_OBJECT_LOCK_ASSERT(object, MA_OWNED); - if ((m = TAILQ_FIRST(&object->memq)) != NULL) { - if (m->pindex < pindex) { - m = vm_page_splay(pindex, object->root); - if ((object->root = m)->pindex < pindex) - m = TAILQ_NEXT(m, listq); - } - } - return (m); + return (vm_radix_lookup_ge(&object->rtree, pindex)); } /* @@ -1121,49 +1001,26 @@ vm_page_rename(vm_page_t m, vm_object_t new_object * infinity. If the given object is backed by a vnode and it * transitions from having one or more cached pages to none, the * vnode's hold count is reduced. + * + * The object must be locked. */ void vm_page_cache_free(vm_object_t object, vm_pindex_t start, vm_pindex_t end) { - vm_page_t m, m_next; + vm_page_t m; boolean_t empty; + VM_OBJECT_LOCK_ASSERT(object, MA_OWNED); + mtx_lock(&vm_page_queue_free_mtx); - if (__predict_false(object->cache == NULL)) { + if (vm_object_cache_is_empty(object)) { mtx_unlock(&vm_page_queue_free_mtx); return; } - m = object->cache = vm_page_splay(start, object->cache); - if (m->pindex < start) { - if (m->right == NULL) - m = NULL; - else { - m_next = vm_page_splay(start, m->right); - m_next->left = m; - m->right = NULL; - m = object->cache = m_next; - } - } - - /* - * At this point, "m" is either (1) a reference to the page - * with the least pindex that is greater than or equal to - * "start" or (2) NULL. - */ - for (; m != NULL && (m->pindex < end || end == 0); m = m_next) { - /* - * Find "m"'s successor and remove "m" from the - * object's cache. - */ - if (m->right == NULL) { - object->cache = m->left; - m_next = NULL; - } else { - m_next = vm_page_splay(start, m->right); - m_next->left = m->left; - object->cache = m_next; - } - /* Convert "m" to a free page. */ + while ((m = vm_radix_lookup_ge(&object->cache, start)) != NULL) { + if (end != 0 && m->pindex >= end) + break; + vm_radix_remove(&object->cache, m->pindex); m->object = NULL; m->valid = 0; /* Clear PG_CACHED and set PG_FREE. */ @@ -1173,7 +1030,7 @@ vm_page_cache_free(vm_object_t object, vm_pindex_t cnt.v_cache_count--; cnt.v_free_count++; } - empty = object->cache == NULL; + empty = vm_object_cache_is_empty(object); mtx_unlock(&vm_page_queue_free_mtx); if (object->type == OBJT_VNODE && empty) vdrop(object->handle); @@ -1183,20 +1040,17 @@ vm_page_cache_free(vm_object_t object, vm_pindex_t * Returns the cached page that is associated with the given * object and offset. If, however, none exists, returns NULL. * - * The free page queue must be locked. + * The free page queue and object must be locked. */ static inline vm_page_t vm_page_cache_lookup(vm_object_t object, vm_pindex_t pindex) { - vm_page_t m; + VM_OBJECT_LOCK_ASSERT(object, MA_OWNED); mtx_assert(&vm_page_queue_free_mtx, MA_OWNED); - if ((m = object->cache) != NULL && m->pindex != pindex) { - m = vm_page_splay(pindex, m); - if ((object->cache = m)->pindex != pindex) - m = NULL; - } - return (m); + if (!vm_object_cache_is_empty(object)) + return (vm_radix_lookup(&object->cache, pindex)); + return (NULL); } /* @@ -1208,28 +1062,11 @@ vm_page_cache_lookup(vm_object_t object, vm_pindex static void vm_page_cache_remove(vm_page_t m) { - vm_object_t object; - vm_page_t root; mtx_assert(&vm_page_queue_free_mtx, MA_OWNED); KASSERT((m->flags & PG_CACHED) != 0, ("vm_page_cache_remove: page %p is not cached", m)); - object = m->object; - if (m != object->cache) { - root = vm_page_splay(m->pindex, object->cache); - KASSERT(root == m, - ("vm_page_cache_remove: page %p is not cached in object %p", - m, object)); - } - if (m->left == NULL) - root = m->right; - else if (m->right == NULL) - root = m->left; - else { - root = vm_page_splay(m->pindex, m->left); - root->right = m->right; - } - object->cache = root; + vm_radix_remove(&m->object->cache, m->pindex); m->object = NULL; cnt.v_cache_count--; } @@ -1243,13 +1080,13 @@ vm_page_cache_remove(vm_page_t m) * empty. Offset 'offidxstart' in the original object must * correspond to offset zero in the new object. * - * The new object must be locked. + * The new object and original object must be locked. */ void vm_page_cache_transfer(vm_object_t orig_object, vm_pindex_t offidxstart, vm_object_t new_object) { - vm_page_t m, m_next; + vm_page_t m; /* * Insertion into an object's collection of cached pages @@ -1257,53 +1094,19 @@ vm_page_cache_transfer(vm_object_t orig_object, vm * not. */ VM_OBJECT_LOCK_ASSERT(new_object, MA_OWNED); - KASSERT(new_object->cache == NULL, + VM_OBJECT_LOCK_ASSERT(orig_object, MA_OWNED); + KASSERT(vm_object_cache_is_empty(new_object), ("vm_page_cache_transfer: object %p has cached pages", new_object)); mtx_lock(&vm_page_queue_free_mtx); - if ((m = orig_object->cache) != NULL) { - /* - * Transfer all of the pages with offset greater than or - * equal to 'offidxstart' from the original object's - * cache to the new object's cache. - */ - m = vm_page_splay(offidxstart, m); - if (m->pindex < offidxstart) { - orig_object->cache = m; - new_object->cache = m->right; - m->right = NULL; - } else { - orig_object->cache = m->left; - new_object->cache = m; - m->left = NULL; - } - while ((m = new_object->cache) != NULL) { - if ((m->pindex - offidxstart) >= new_object->size) { - /* - * Return all of the cached pages with - * offset greater than or equal to the - * new object's size to the original - * object's cache. - */ - new_object->cache = m->left; - m->left = orig_object->cache; - orig_object->cache = m; - break; - } - m_next = vm_page_splay(m->pindex, m->right); - /* Update the page's object and offset. */ - m->object = new_object; - m->pindex -= offidxstart; - if (m_next == NULL) - break; - m->right = NULL; - m_next->left = m; - new_object->cache = m_next; - } - KASSERT(new_object->cache == NULL || - new_object->type == OBJT_SWAP, - ("vm_page_cache_transfer: object %p's type is incompatible" - " with cached pages", new_object)); + while ((m = vm_radix_lookup_ge(&orig_object->cache, + offidxstart)) != NULL) { + if ((m->pindex - offidxstart) >= new_object->size) + break; + vm_radix_remove(&orig_object->cache, m->pindex); + vm_radix_insert(&new_object->cache, m->pindex - offidxstart, m); + m->object = new_object; + m->pindex -= offidxstart; } mtx_unlock(&vm_page_queue_free_mtx); } @@ -1327,7 +1130,7 @@ vm_page_is_cached(vm_object_t object, vm_pindex_t * exist. */ VM_OBJECT_LOCK_ASSERT(object, MA_OWNED); - if (__predict_true(object->cache == NULL)) + if (vm_object_cache_is_empty(object)) return (FALSE); mtx_lock(&vm_page_queue_free_mtx); m = vm_page_cache_lookup(object, pindex); @@ -1465,7 +1268,8 @@ vm_page_alloc(vm_object_t object, vm_pindex_t pind m->valid = 0; m_object = m->object; vm_page_cache_remove(m); - if (m_object->type == OBJT_VNODE && m_object->cache == NULL) + if (m_object->type == OBJT_VNODE && + vm_object_cache_is_empty(m_object)) vp = m_object->handle; } else { KASSERT(VM_PAGE_IS_FREE(m), @@ -1722,7 +1526,8 @@ vm_page_alloc_init(vm_page_t m) m->valid = 0; m_object = m->object; vm_page_cache_remove(m); - if (m_object->type == OBJT_VNODE && m_object->cache == NULL) + if (m_object->type == OBJT_VNODE && + vm_object_cache_is_empty(m_object)) drop = m_object->handle; } else { KASSERT(VM_PAGE_IS_FREE(m), @@ -2321,7 +2126,7 @@ void vm_page_cache(vm_page_t m) { vm_object_t object; - vm_page_t next, prev, root; + int old_empty_cache; vm_page_lock_assert(m, MA_OWNED); object = m->object; @@ -2352,46 +2157,7 @@ vm_page_cache(vm_page_t m) */ vm_page_remque(m); - /* - * Remove the page from the object's collection of resident - * pages. - */ - if ((next = TAILQ_NEXT(m, listq)) != NULL && next->left == m) { - /* - * Since the page's successor in the list is also its parent - * in the tree, its right subtree must be empty. - */ - next->left = m->left; - KASSERT(m->right == NULL, - ("vm_page_cache: page %p has right child", m)); - } else if ((prev = TAILQ_PREV(m, pglist, listq)) != NULL && - prev->right == m) { - /* - * Since the page's predecessor in the list is also its parent - * in the tree, its left subtree must be empty. - */ - KASSERT(m->left == NULL, - ("vm_page_cache: page %p has left child", m)); - prev->right = m->right; - } else { - if (m != object->root) - vm_page_splay(m->pindex, object->root); - if (m->left == NULL) - root = m->right; - else if (m->right == NULL) - root = m->left; - else { - /* - * Move the page's successor to the root, because - * pages are usually removed in ascending order. - */ - if (m->right != next) - vm_page_splay(m->pindex, m->right); - next->left = m->left; - root = next; - } - object->root = root; - } + vm_radix_remove(&object->rtree, m->pindex); TAILQ_REMOVE(&object->memq, m, listq); object->resident_page_count--; @@ -2408,26 +2174,9 @@ vm_page_cache(vm_page_t m) m->flags &= ~PG_ZERO; mtx_lock(&vm_page_queue_free_mtx); m->flags |= PG_CACHED; + old_empty_cache = vm_object_cache_is_empty(object); cnt.v_cache_count++; - root = object->cache; - if (root == NULL) { - m->left = NULL; - m->right = NULL; - } else { - root = vm_page_splay(m->pindex, root); - if (m->pindex < root->pindex) { - m->left = root->left; - m->right = root; - root->left = NULL; - } else if (__predict_false(m->pindex == root->pindex)) - panic("vm_page_cache: offset already cached"); - else { - m->right = root->right; - m->left = root; - root->right = NULL; - } - } - object->cache = m; + vm_radix_insert(&object->cache, m->pindex, m); #if VM_NRESERVLEVEL > 0 if (!vm_reserv_free_page(m)) { #else @@ -2445,9 +2194,10 @@ vm_page_cache(vm_page_t m) * the object's only resident page. */ if (object->type == OBJT_VNODE) { - if (root == NULL && object->resident_page_count != 0) + if (old_empty_cache != 0 && object->resident_page_count != 0) vhold(object->handle); - else if (root != NULL && object->resident_page_count == 0) + else if (old_empty_cache == 0 && + object->resident_page_count == 0) vdrop(object->handle); } } Index: /usr/src/sys/vm/vm_page.h =================================================================== --- /usr/src/sys/vm/vm_page.h (revision 246798) +++ /usr/src/sys/vm/vm_page.h (working copy) @@ -128,8 +128,6 @@ typedef uint64_t vm_page_bits_t; struct vm_page { TAILQ_ENTRY(vm_page) pageq; /* page queue or free list (Q) */ TAILQ_ENTRY(vm_page) listq; /* pages in same object (O) */ - struct vm_page *left; /* splay tree link (O) */ - struct vm_page *right; /* splay tree link (O) */ vm_object_t object; /* which object am I in (O,P)*/ vm_pindex_t pindex; /* offset into object (O,P) */ @@ -404,7 +402,6 @@ void vm_page_requeue(vm_page_t m); void vm_page_requeue_locked(vm_page_t m); void vm_page_set_valid_range(vm_page_t m, int base, int size); void vm_page_sleep(vm_page_t m, const char *msg); -vm_page_t vm_page_splay(vm_pindex_t, vm_page_t); vm_offset_t vm_page_startup(vm_offset_t vaddr); void vm_page_unhold_pages(vm_page_t *ma, int count); void vm_page_unwire (vm_page_t, int); Index: /usr/src/sys/vm/vm_reserv.c =================================================================== --- /usr/src/sys/vm/vm_reserv.c (revision 246798) +++ /usr/src/sys/vm/vm_reserv.c (working copy) @@ -56,6 +56,7 @@ __FBSDID("$FreeBSD$"); #include #include #include +#include #include /* @@ -341,34 +342,22 @@ vm_reserv_alloc_contig(vm_object_t object, vm_pind /* * Look for an existing reservation. */ - msucc = NULL; - mpred = object->root; - while (mpred != NULL) { - KASSERT(mpred->pindex != pindex, + mpred = vm_radix_lookup_le(&object->rtree, pindex); + if (mpred != NULL) { + KASSERT(mpred->pindex <= pindex, ("vm_reserv_alloc_contig: pindex already allocated")); rv = vm_reserv_from_page(mpred); if (rv->object == object && vm_reserv_has_pindex(rv, pindex)) goto found; - else if (mpred->pindex < pindex) { - if (msucc != NULL || - (msucc = TAILQ_NEXT(mpred, listq)) == NULL) - break; - KASSERT(msucc->pindex != pindex, - ("vm_reserv_alloc_contig: pindex already allocated")); - rv = vm_reserv_from_page(msucc); - if (rv->object == object && - vm_reserv_has_pindex(rv, pindex)) - goto found; - else if (pindex < msucc->pindex) - break; - } else if (msucc == NULL) { - msucc = mpred; - mpred = TAILQ_PREV(msucc, pglist, listq); - continue; - } - msucc = NULL; - mpred = object->root = vm_page_splay(pindex, object->root); } + msucc = vm_radix_lookup_ge(&object->rtree, pindex); + if (msucc != NULL) { + KASSERT(msucc->pindex >= pindex, + ("vm_reserv_alloc_page: pindex already allocated")); + rv = vm_reserv_from_page(msucc); + if (rv->object == object && vm_reserv_has_pindex(rv, pindex)) + goto found; + } /* * Could at least one reservation fit between the first index to the @@ -507,34 +496,22 @@ vm_reserv_alloc_page(vm_object_t object, vm_pindex /* * Look for an existing reservation. */ - msucc = NULL; - mpred = object->root; - while (mpred != NULL) { - KASSERT(mpred->pindex != pindex, + mpred = vm_radix_lookup_le(&object->rtree, pindex); + if (mpred != NULL) { + KASSERT(mpred->pindex <= pindex, ("vm_reserv_alloc_page: pindex already allocated")); rv = vm_reserv_from_page(mpred); if (rv->object == object && vm_reserv_has_pindex(rv, pindex)) goto found; - else if (mpred->pindex < pindex) { - if (msucc != NULL || - (msucc = TAILQ_NEXT(mpred, listq)) == NULL) - break; - KASSERT(msucc->pindex != pindex, - ("vm_reserv_alloc_page: pindex already allocated")); - rv = vm_reserv_from_page(msucc); - if (rv->object == object && - vm_reserv_has_pindex(rv, pindex)) - goto found; - else if (pindex < msucc->pindex) - break; - } else if (msucc == NULL) { - msucc = mpred; - mpred = TAILQ_PREV(msucc, pglist, listq); - continue; - } - msucc = NULL; - mpred = object->root = vm_page_splay(pindex, object->root); } + msucc = vm_radix_lookup_ge(&object->rtree, pindex); + if (msucc != NULL) { + KASSERT(msucc->pindex >= pindex, + ("vm_reserv_alloc_page: pindex already allocated")); + rv = vm_reserv_from_page(msucc); + if (rv->object == object && vm_reserv_has_pindex(rv, pindex)) + goto found; + } /* * Could a reservation fit between the first index to the left that Index: /usr/src/sys/i386/include/pmap.h =================================================================== --- /usr/src/sys/i386/include/pmap.h (revision 246798) +++ /usr/src/sys/i386/include/pmap.h (working copy) @@ -426,10 +426,20 @@ struct pv_entry; struct pv_chunk; struct md_page { - TAILQ_HEAD(,pv_entry) pv_list; - int pat_mode; + union { + TAILQ_HEAD(,pv_entry) pvi_list; + struct { + vm_page_t pii_left; + vm_page_t pii_right; + } pvi_siters; + } pv_structs; + int pat_mode; }; +#define pv_list pv_structs.pvi_list +#define pv_left pv_structs.pvi_siters.pii_left +#define pv_right pv_structs.pvi_siters.pii_right + struct pmap { struct mtx pm_mtx; pd_entry_t *pm_pdir; /* KVA of page directory */ @@ -468,7 +478,7 @@ extern struct pmap kernel_pmap_store; */ typedef struct pv_entry { vm_offset_t pv_va; /* virtual address for mapping */ - TAILQ_ENTRY(pv_entry) pv_list; + TAILQ_ENTRY(pv_entry) pv_next; } *pv_entry_t; /* Index: /usr/src/sys/i386/i386/pmap.c =================================================================== --- /usr/src/sys/i386/i386/pmap.c (revision 246798) +++ /usr/src/sys/i386/i386/pmap.c (working copy) @@ -330,6 +330,7 @@ static boolean_t pmap_try_insert_pv_entry(pmap_t p static void pmap_update_pde(pmap_t pmap, vm_offset_t va, pd_entry_t *pde, pd_entry_t newpde); static void pmap_update_pde_invalidate(vm_offset_t va, pd_entry_t newpde); +static vm_page_t pmap_vmpage_splay(vm_pindex_t pindex, vm_page_t root); static vm_page_t pmap_allocpte(pmap_t pmap, vm_offset_t va, int flags); @@ -1574,7 +1575,8 @@ pmap_free_zero_pages(vm_page_t free) while (free != NULL) { m = free; - free = m->right; + free = (void *)m->object; + m->object = NULL; /* Preserve the page's PG_ZERO setting. */ vm_page_free_toq(m); } @@ -1593,7 +1595,7 @@ pmap_add_delayed_free_list(vm_page_t m, vm_page_t m->flags |= PG_ZERO; else m->flags &= ~PG_ZERO; - m->right = *free; + m->object = (void *)*free; *free = m; } @@ -1611,20 +1613,20 @@ pmap_insert_pt_page(pmap_t pmap, vm_page_t mpte) PMAP_LOCK_ASSERT(pmap, MA_OWNED); root = pmap->pm_root; if (root == NULL) { - mpte->left = NULL; - mpte->right = NULL; + mpte->md.pv_left = NULL; + mpte->md.pv_right = NULL; } else { - root = vm_page_splay(mpte->pindex, root); + root = pmap_vmpage_splay(mpte->pindex, root); if (mpte->pindex < root->pindex) { - mpte->left = root->left; - mpte->right = root; - root->left = NULL; + mpte->md.pv_left = root->md.pv_left; + mpte->md.pv_right = root; + root->md.pv_left = NULL; } else if (mpte->pindex == root->pindex) panic("pmap_insert_pt_page: pindex already inserted"); else { - mpte->right = root->right; - mpte->left = root; - root->right = NULL; + mpte->md.pv_right = root->md.pv_right; + mpte->md.pv_left = root; + root->md.pv_right = NULL; } } pmap->pm_root = mpte; @@ -1643,7 +1645,7 @@ pmap_lookup_pt_page(pmap_t pmap, vm_offset_t va) PMAP_LOCK_ASSERT(pmap, MA_OWNED); if ((mpte = pmap->pm_root) != NULL && mpte->pindex != pindex) { - mpte = vm_page_splay(pindex, mpte); + mpte = pmap_vmpage_splay(pindex, mpte); if ((pmap->pm_root = mpte)->pindex != pindex) mpte = NULL; } @@ -1662,14 +1664,20 @@ pmap_remove_pt_page(pmap_t pmap, vm_page_t mpte) PMAP_LOCK_ASSERT(pmap, MA_OWNED); if (mpte != pmap->pm_root) - vm_page_splay(mpte->pindex, pmap->pm_root); - if (mpte->left == NULL) - root = mpte->right; + pmap_vmpage_splay(mpte->pindex, pmap->pm_root); + if (mpte->md.pv_left == NULL) + root = mpte->md.pv_right; else { - root = vm_page_splay(mpte->pindex, mpte->left); - root->right = mpte->right; + root = pmap_vmpage_splay(mpte->pindex, mpte->md.pv_left); + root->md.pv_right = mpte->md.pv_right; } pmap->pm_root = root; + + /* + * Reinitialize the pv_list which could be dirty now because of the + * splay tree work. + */ + TAILQ_INIT(&mpte->md.pv_list); } /* @@ -1723,6 +1731,61 @@ _pmap_unwire_ptp(pmap_t pmap, vm_page_t m, vm_page } /* + * Implements Sleator and Tarjan's top-down splay algorithm. Returns + * the vm_page containing the given pindex. If, however, that + * pindex is not found in the pmap, returns a vm_page that is + * adjacent to the pindex, coming before or after it. + */ +static vm_page_t +pmap_vmpage_splay(vm_pindex_t pindex, vm_page_t root) +{ + struct vm_page dummy; + vm_page_t lefttreemax, righttreemin, y; + + if (root == NULL) + return (root); + lefttreemax = righttreemin = &dummy; + for (;; root = y) { + if (pindex < root->pindex) { + if ((y = root->md.pv_left) == NULL) + break; + if (pindex < y->pindex) { + /* Rotate right. */ + root->md.pv_left = y->md.pv_right; + y->md.pv_right = root; + root = y; + if ((y = root->md.pv_left) == NULL) + break; + } + /* Link into the new root's right tree. */ + righttreemin->md.pv_left = root; + righttreemin = root; + } else if (pindex > root->pindex) { + if ((y = root->md.pv_right) == NULL) + break; + if (pindex > y->pindex) { + /* Rotate left. */ + root->md.pv_right = y->md.pv_left; + y->md.pv_left = root; + root = y; + if ((y = root->md.pv_right) == NULL) + break; + } + /* Link into the new root's left tree. */ + lefttreemax->md.pv_right = root; + lefttreemax = root; + } else + break; + } + /* Assemble the new root. */ + lefttreemax->md.pv_right = root->md.pv_left; + righttreemin->md.pv_left = root->md.pv_right; + root->md.pv_left = dummy.md.pv_right; + root->md.pv_right = dummy.md.pv_left; + return (root); +} + +/* * After removing a page table entry, this routine is used to * conditionally free the page, and manage the hold/wire counts. */ @@ -2286,7 +2349,7 @@ pmap_pv_reclaim(pmap_t locked_pmap) vm_page_dirty(m); if ((tpte & PG_A) != 0) vm_page_aflag_set(m, PGA_REFERENCED); - TAILQ_REMOVE(&m->md.pv_list, pv, pv_list); + TAILQ_REMOVE(&m->md.pv_list, pv, pv_next); if (TAILQ_EMPTY(&m->md.pv_list) && (m->flags & PG_FICTITIOUS) == 0) { pvh = pa_to_pvh(VM_PAGE_TO_PHYS(m)); @@ -2344,7 +2407,7 @@ out: } if (m_pc == NULL && pv_vafree != 0 && free != NULL) { m_pc = free; - free = m_pc->right; + free = (void *)m_pc->object; /* Recycle a freed page table page. */ m_pc->wire_count = 1; atomic_add_int(&cnt.v_wire_count, 1); @@ -2491,9 +2554,9 @@ pmap_pvh_remove(struct md_page *pvh, pmap_t pmap, pv_entry_t pv; rw_assert(&pvh_global_lock, RA_WLOCKED); - TAILQ_FOREACH(pv, &pvh->pv_list, pv_list) { + TAILQ_FOREACH(pv, &pvh->pv_list, pv_next) { if (pmap == PV_PMAP(pv) && va == pv->pv_va) { - TAILQ_REMOVE(&pvh->pv_list, pv, pv_list); + TAILQ_REMOVE(&pvh->pv_list, pv, pv_next); break; } } @@ -2521,7 +2584,7 @@ pmap_pv_demote_pde(pmap_t pmap, vm_offset_t va, vm pv = pmap_pvh_remove(pvh, pmap, va); KASSERT(pv != NULL, ("pmap_pv_demote_pde: pv not found")); m = PHYS_TO_VM_PAGE(pa); - TAILQ_INSERT_TAIL(&m->md.pv_list, pv, pv_list); + TAILQ_INSERT_TAIL(&m->md.pv_list, pv, pv_next); /* Instantiate the remaining NPTEPG - 1 pv entries. */ va_last = va + NBPDR - PAGE_SIZE; do { @@ -2557,7 +2620,7 @@ pmap_pv_promote_pde(pmap_t pmap, vm_offset_t va, v pv = pmap_pvh_remove(&m->md, pmap, va); KASSERT(pv != NULL, ("pmap_pv_promote_pde: pv not found")); pvh = pa_to_pvh(pa); - TAILQ_INSERT_TAIL(&pvh->pv_list, pv, pv_list); + TAILQ_INSERT_TAIL(&pvh->pv_list, pv, pv_next); /* Free the remaining NPTEPG - 1 pv entries. */ va_last = va + NBPDR - PAGE_SIZE; do { @@ -2604,7 +2667,7 @@ pmap_insert_entry(pmap_t pmap, vm_offset_t va, vm_ PMAP_LOCK_ASSERT(pmap, MA_OWNED); pv = get_pv_entry(pmap, FALSE); pv->pv_va = va; - TAILQ_INSERT_TAIL(&m->md.pv_list, pv, pv_list); + TAILQ_INSERT_TAIL(&m->md.pv_list, pv, pv_next); } /* @@ -2620,7 +2683,7 @@ pmap_try_insert_pv_entry(pmap_t pmap, vm_offset_t if (pv_entry_count < pv_entry_high_water && (pv = get_pv_entry(pmap, TRUE)) != NULL) { pv->pv_va = va; - TAILQ_INSERT_TAIL(&m->md.pv_list, pv, pv_list); + TAILQ_INSERT_TAIL(&m->md.pv_list, pv, pv_next); return (TRUE); } else return (FALSE); @@ -2640,7 +2703,7 @@ pmap_pv_insert_pde(pmap_t pmap, vm_offset_t va, vm (pv = get_pv_entry(pmap, TRUE)) != NULL) { pv->pv_va = va; pvh = pa_to_pvh(pa); - TAILQ_INSERT_TAIL(&pvh->pv_list, pv, pv_list); + TAILQ_INSERT_TAIL(&pvh->pv_list, pv, pv_next); return (TRUE); } else return (FALSE); @@ -3095,7 +3158,7 @@ small_mappings: vm_page_dirty(m); pmap_unuse_pt(pmap, pv->pv_va, &free); pmap_invalidate_page(pmap, pv->pv_va); - TAILQ_REMOVE(&m->md.pv_list, pv, pv_list); + TAILQ_REMOVE(&m->md.pv_list, pv, pv_next); free_pv_entry(pmap, pv); PMAP_UNLOCK(pmap); } @@ -3551,7 +3614,7 @@ pmap_enter(pmap_t pmap, vm_offset_t va, vm_prot_t if (pv == NULL) pv = get_pv_entry(pmap, FALSE); pv->pv_va = va; - TAILQ_INSERT_TAIL(&m->md.pv_list, pv, pv_list); + TAILQ_INSERT_TAIL(&m->md.pv_list, pv, pv_next); pa |= PG_MANAGED; } else if (pv != NULL) free_pv_entry(pmap, pv); @@ -4259,7 +4322,7 @@ pmap_page_exists_quick(pmap_t pmap, vm_page_t m) ("pmap_page_exists_quick: page %p is not managed", m)); rv = FALSE; rw_wlock(&pvh_global_lock); - TAILQ_FOREACH(pv, &m->md.pv_list, pv_list) { + TAILQ_FOREACH(pv, &m->md.pv_list, pv_next) { if (PV_PMAP(pv) == pmap) { rv = TRUE; break; @@ -4270,7 +4333,7 @@ pmap_page_exists_quick(pmap_t pmap, vm_page_t m) } if (!rv && loops < 16 && (m->flags & PG_FICTITIOUS) == 0) { pvh = pa_to_pvh(VM_PAGE_TO_PHYS(m)); - TAILQ_FOREACH(pv, &pvh->pv_list, pv_list) { + TAILQ_FOREACH(pv, &pvh->pv_list, pv_next) { if (PV_PMAP(pv) == pmap) { rv = TRUE; break; @@ -4322,7 +4385,7 @@ pmap_pvh_wired_mappings(struct md_page *pvh, int c rw_assert(&pvh_global_lock, RA_WLOCKED); sched_pin(); - TAILQ_FOREACH(pv, &pvh->pv_list, pv_list) { + TAILQ_FOREACH(pv, &pvh->pv_list, pv_next) { pmap = PV_PMAP(pv); PMAP_LOCK(pmap); pte = pmap_pte_quick(pmap, pv->pv_va); @@ -4449,7 +4512,7 @@ pmap_remove_pages(pmap_t pmap) if ((tpte & PG_PS) != 0) { pmap->pm_stats.resident_count -= NBPDR / PAGE_SIZE; pvh = pa_to_pvh(tpte & PG_PS_FRAME); - TAILQ_REMOVE(&pvh->pv_list, pv, pv_list); + TAILQ_REMOVE(&pvh->pv_list, pv, pv_next); if (TAILQ_EMPTY(&pvh->pv_list)) { for (mt = m; mt < &m[NBPDR / PAGE_SIZE]; mt++) if (TAILQ_EMPTY(&mt->md.pv_list)) @@ -4467,7 +4530,7 @@ pmap_remove_pages(pmap_t pmap) } } else { pmap->pm_stats.resident_count--; - TAILQ_REMOVE(&m->md.pv_list, pv, pv_list); + TAILQ_REMOVE(&m->md.pv_list, pv, pv_next); if (TAILQ_EMPTY(&m->md.pv_list) && (m->flags & PG_FICTITIOUS) == 0) { pvh = pa_to_pvh(VM_PAGE_TO_PHYS(m)); @@ -4537,7 +4600,7 @@ pmap_is_modified_pvh(struct md_page *pvh) rw_assert(&pvh_global_lock, RA_WLOCKED); rv = FALSE; sched_pin(); - TAILQ_FOREACH(pv, &pvh->pv_list, pv_list) { + TAILQ_FOREACH(pv, &pvh->pv_list, pv_next) { pmap = PV_PMAP(pv); PMAP_LOCK(pmap); pte = pmap_pte_quick(pmap, pv->pv_va); @@ -4610,7 +4673,7 @@ pmap_is_referenced_pvh(struct md_page *pvh) rw_assert(&pvh_global_lock, RA_WLOCKED); rv = FALSE; sched_pin(); - TAILQ_FOREACH(pv, &pvh->pv_list, pv_list) { + TAILQ_FOREACH(pv, &pvh->pv_list, pv_next) { pmap = PV_PMAP(pv); PMAP_LOCK(pmap); pte = pmap_pte_quick(pmap, pv->pv_va); @@ -4653,7 +4716,7 @@ pmap_remove_write(vm_page_t m) if ((m->flags & PG_FICTITIOUS) != 0) goto small_mappings; pvh = pa_to_pvh(VM_PAGE_TO_PHYS(m)); - TAILQ_FOREACH_SAFE(pv, &pvh->pv_list, pv_list, next_pv) { + TAILQ_FOREACH_SAFE(pv, &pvh->pv_list, pv_next, next_pv) { va = pv->pv_va; pmap = PV_PMAP(pv); PMAP_LOCK(pmap); @@ -4663,7 +4726,7 @@ pmap_remove_write(vm_page_t m) PMAP_UNLOCK(pmap); } small_mappings: - TAILQ_FOREACH(pv, &m->md.pv_list, pv_list) { + TAILQ_FOREACH(pv, &m->md.pv_list, pv_next) { pmap = PV_PMAP(pv); PMAP_LOCK(pmap); pde = pmap_pde(pmap, pv->pv_va); @@ -4722,7 +4785,7 @@ pmap_ts_referenced(vm_page_t m) sched_pin(); if ((m->flags & PG_FICTITIOUS) != 0) goto small_mappings; - TAILQ_FOREACH_SAFE(pv, &pvh->pv_list, pv_list, pvn) { + TAILQ_FOREACH_SAFE(pv, &pvh->pv_list, pv_next, pvn) { va = pv->pv_va; pmap = PV_PMAP(pv); PMAP_LOCK(pmap); @@ -4756,9 +4819,9 @@ small_mappings: if ((pv = TAILQ_FIRST(&m->md.pv_list)) != NULL) { pvf = pv; do { - pvn = TAILQ_NEXT(pv, pv_list); - TAILQ_REMOVE(&m->md.pv_list, pv, pv_list); - TAILQ_INSERT_TAIL(&m->md.pv_list, pv, pv_list); + pvn = TAILQ_NEXT(pv, pv_next); + TAILQ_REMOVE(&m->md.pv_list, pv, pv_next); + TAILQ_INSERT_TAIL(&m->md.pv_list, pv, pv_next); pmap = PV_PMAP(pv); PMAP_LOCK(pmap); pde = pmap_pde(pmap, pv->pv_va); @@ -4812,7 +4875,7 @@ pmap_clear_modify(vm_page_t m) if ((m->flags & PG_FICTITIOUS) != 0) goto small_mappings; pvh = pa_to_pvh(VM_PAGE_TO_PHYS(m)); - TAILQ_FOREACH_SAFE(pv, &pvh->pv_list, pv_list, next_pv) { + TAILQ_FOREACH_SAFE(pv, &pvh->pv_list, pv_next, next_pv) { va = pv->pv_va; pmap = PV_PMAP(pv); PMAP_LOCK(pmap); @@ -4849,7 +4912,7 @@ pmap_clear_modify(vm_page_t m) PMAP_UNLOCK(pmap); } small_mappings: - TAILQ_FOREACH(pv, &m->md.pv_list, pv_list) { + TAILQ_FOREACH(pv, &m->md.pv_list, pv_next) { pmap = PV_PMAP(pv); PMAP_LOCK(pmap); pde = pmap_pde(pmap, pv->pv_va); @@ -4893,7 +4956,7 @@ pmap_clear_reference(vm_page_t m) if ((m->flags & PG_FICTITIOUS) != 0) goto small_mappings; pvh = pa_to_pvh(VM_PAGE_TO_PHYS(m)); - TAILQ_FOREACH_SAFE(pv, &pvh->pv_list, pv_list, next_pv) { + TAILQ_FOREACH_SAFE(pv, &pvh->pv_list, pv_next, next_pv) { va = pv->pv_va; pmap = PV_PMAP(pv); PMAP_LOCK(pmap); @@ -4916,7 +4979,7 @@ pmap_clear_reference(vm_page_t m) PMAP_UNLOCK(pmap); } small_mappings: - TAILQ_FOREACH(pv, &m->md.pv_list, pv_list) { + TAILQ_FOREACH(pv, &m->md.pv_list, pv_next) { pmap = PV_PMAP(pv); PMAP_LOCK(pmap); pde = pmap_pde(pmap, pv->pv_va); @@ -5427,7 +5490,7 @@ pmap_pvdump(vm_paddr_t pa) printf("pa %x", pa); m = PHYS_TO_VM_PAGE(pa); - TAILQ_FOREACH(pv, &m->md.pv_list, pv_list) { + TAILQ_FOREACH(pv, &m->md.pv_list, pv_next) { pmap = PV_PMAP(pv); printf(" -> pmap %p, va %x", (void *)pmap, pv->pv_va); pads(pmap); Index: /usr/src/sys/cddl/compat/opensolaris/sys/vnode.h =================================================================== --- /usr/src/sys/cddl/compat/opensolaris/sys/vnode.h (revision 246798) +++ /usr/src/sys/cddl/compat/opensolaris/sys/vnode.h (working copy) @@ -76,7 +76,7 @@ vn_is_readonly(vnode_t *vp) #define vn_has_cached_data(vp) \ ((vp)->v_object != NULL && \ ((vp)->v_object->resident_page_count > 0 || \ - (vp)->v_object->cache != NULL)) + !vm_object_cache_is_empty((vp)->v_object))) #define vn_exists(vp) do { } while (0) #define vn_invalid(vp) do { } while (0) #define vn_renamepath(tdvp, svp, tnm, lentnm) do { } while (0) Index: /usr/src/sys/amd64/include/pmap.h =================================================================== --- /usr/src/sys/amd64/include/pmap.h (revision 246798) +++ /usr/src/sys/amd64/include/pmap.h (working copy) @@ -235,10 +235,20 @@ struct pv_entry; struct pv_chunk; struct md_page { - TAILQ_HEAD(,pv_entry) pv_list; - int pat_mode; + union { + TAILQ_HEAD(,pv_entry) pvi_list; + struct { + vm_page_t pii_left; + vm_page_t pii_right; + } pvi_siters; + } pv_structs; + int pat_mode; }; +#define pv_list pv_structs.pvi_list +#define pv_left pv_structs.pvi_siters.pii_left +#define pv_right pv_structs.pvi_siters.pii_right + /* * The kernel virtual address (KVA) of the level 4 page table page is always * within the direct map (DMAP) region. @@ -277,7 +287,7 @@ extern struct pmap kernel_pmap_store; */ typedef struct pv_entry { vm_offset_t pv_va; /* virtual address for mapping */ - TAILQ_ENTRY(pv_entry) pv_list; + TAILQ_ENTRY(pv_entry) pv_next; } *pv_entry_t; /* Index: /usr/src/sys/amd64/amd64/pmap.c =================================================================== --- /usr/src/sys/amd64/amd64/pmap.c (revision 246798) +++ /usr/src/sys/amd64/amd64/pmap.c (working copy) @@ -306,6 +306,7 @@ static boolean_t pmap_try_insert_pv_entry(pmap_t p static void pmap_update_pde(pmap_t pmap, vm_offset_t va, pd_entry_t *pde, pd_entry_t newpde); static void pmap_update_pde_invalidate(vm_offset_t va, pd_entry_t newpde); +static vm_page_t pmap_vmpage_splay(vm_pindex_t pindex, vm_page_t root); static vm_page_t _pmap_allocpte(pmap_t pmap, vm_pindex_t ptepindex, struct rwlock **lockp); @@ -1497,7 +1498,8 @@ pmap_free_zero_pages(vm_page_t free) while (free != NULL) { m = free; - free = m->right; + free = (void *)m->object; + m->object = NULL; /* Preserve the page's PG_ZERO setting. */ vm_page_free_toq(m); } @@ -1516,7 +1518,7 @@ pmap_add_delayed_free_list(vm_page_t m, vm_page_t m->flags |= PG_ZERO; else m->flags &= ~PG_ZERO; - m->right = *free; + m->object = (void *)*free; *free = m; } @@ -1534,20 +1536,20 @@ pmap_insert_pt_page(pmap_t pmap, vm_page_t mpte) PMAP_LOCK_ASSERT(pmap, MA_OWNED); root = pmap->pm_root; if (root == NULL) { - mpte->left = NULL; - mpte->right = NULL; + mpte->md.pv_left = NULL; + mpte->md.pv_right = NULL; } else { - root = vm_page_splay(mpte->pindex, root); + root = pmap_vmpage_splay(mpte->pindex, root); if (mpte->pindex < root->pindex) { - mpte->left = root->left; - mpte->right = root; - root->left = NULL; + mpte->md.pv_left = root->md.pv_left; + mpte->md.pv_right = root; + root->md.pv_left = NULL; } else if (mpte->pindex == root->pindex) panic("pmap_insert_pt_page: pindex already inserted"); else { - mpte->right = root->right; - mpte->left = root; - root->right = NULL; + mpte->md.pv_right = root->md.pv_right; + mpte->md.pv_left = root; + root->md.pv_right = NULL; } } pmap->pm_root = mpte; @@ -1566,7 +1568,7 @@ pmap_lookup_pt_page(pmap_t pmap, vm_offset_t va) PMAP_LOCK_ASSERT(pmap, MA_OWNED); if ((mpte = pmap->pm_root) != NULL && mpte->pindex != pindex) { - mpte = vm_page_splay(pindex, mpte); + mpte = pmap_vmpage_splay(pindex, mpte); if ((pmap->pm_root = mpte)->pindex != pindex) mpte = NULL; } @@ -1585,18 +1587,24 @@ pmap_remove_pt_page(pmap_t pmap, vm_page_t mpte) PMAP_LOCK_ASSERT(pmap, MA_OWNED); if (mpte != pmap->pm_root) { - root = vm_page_splay(mpte->pindex, pmap->pm_root); + root = pmap_vmpage_splay(mpte->pindex, pmap->pm_root); KASSERT(mpte == root, ("pmap_remove_pt_page: mpte %p is missing from pmap %p", mpte, pmap)); } - if (mpte->left == NULL) - root = mpte->right; + if (mpte->md.pv_left == NULL) + root = mpte->md.pv_right; else { - root = vm_page_splay(mpte->pindex, mpte->left); - root->right = mpte->right; + root = pmap_vmpage_splay(mpte->pindex, mpte->md.pv_left); + root->md.pv_right = mpte->md.pv_right; } pmap->pm_root = root; + + /* + * Reinitialize the pv_list which could be dirty now because of the + * splay tree work. + */ + TAILQ_INIT(&mpte->md.pv_list); } /* @@ -1672,6 +1680,61 @@ _pmap_unwire_ptp(pmap_t pmap, vm_offset_t va, vm_p } /* + * Implements Sleator and Tarjan's top-down splay algorithm. Returns + * the vm_page containing the given pindex. If, however, that + * pindex is not found in the pmap, returns a vm_page that is + * adjacent to the pindex, coming before or after it. + */ +static vm_page_t +pmap_vmpage_splay(vm_pindex_t pindex, vm_page_t root) +{ + struct vm_page dummy; + vm_page_t lefttreemax, righttreemin, y; + + if (root == NULL) + return (root); + lefttreemax = righttreemin = &dummy; + for (;; root = y) { + if (pindex < root->pindex) { + if ((y = root->md.pv_left) == NULL) + break; + if (pindex < y->pindex) { + /* Rotate right. */ + root->md.pv_left = y->md.pv_right; + y->md.pv_right = root; + root = y; + if ((y = root->md.pv_left) == NULL) + break; + } + /* Link into the new root's right tree. */ + righttreemin->md.pv_left = root; + righttreemin = root; + } else if (pindex > root->pindex) { + if ((y = root->md.pv_right) == NULL) + break; + if (pindex > y->pindex) { + /* Rotate left. */ + root->md.pv_right = y->md.pv_left; + y->md.pv_left = root; + root = y; + if ((y = root->md.pv_right) == NULL) + break; + } + /* Link into the new root's left tree. */ + lefttreemax->md.pv_right = root; + lefttreemax = root; + } else + break; + } + /* Assemble the new root. */ + lefttreemax->md.pv_right = root->md.pv_left; + righttreemin->md.pv_left = root->md.pv_right; + root->md.pv_left = dummy.md.pv_right; + root->md.pv_right = dummy.md.pv_left; + return (root); +} + +/* * After removing a page table entry, this routine is used to * conditionally free the page, and manage the hold/wire counts. */ @@ -2221,7 +2284,7 @@ reclaim_pv_chunk(pmap_t locked_pmap, struct rwlock if ((tpte & PG_A) != 0) vm_page_aflag_set(m, PGA_REFERENCED); CHANGE_PV_LIST_LOCK_TO_VM_PAGE(lockp, m); - TAILQ_REMOVE(&m->md.pv_list, pv, pv_list); + TAILQ_REMOVE(&m->md.pv_list, pv, pv_next); if (TAILQ_EMPTY(&m->md.pv_list) && (m->flags & PG_FICTITIOUS) == 0) { pvh = pa_to_pvh(VM_PAGE_TO_PHYS(m)); @@ -2273,7 +2336,7 @@ reclaim_pv_chunk(pmap_t locked_pmap, struct rwlock } if (m_pc == NULL && free != NULL) { m_pc = free; - free = m_pc->right; + free = (void *)m_pc->object; /* Recycle a freed page table page. */ m_pc->wire_count = 1; atomic_add_int(&cnt.v_wire_count, 1); @@ -2505,9 +2568,9 @@ pmap_pvh_remove(struct md_page *pvh, pmap_t pmap, pv_entry_t pv; rw_assert(&pvh_global_lock, RA_LOCKED); - TAILQ_FOREACH(pv, &pvh->pv_list, pv_list) { + TAILQ_FOREACH(pv, &pvh->pv_list, pv_next) { if (pmap == PV_PMAP(pv) && va == pv->pv_va) { - TAILQ_REMOVE(&pvh->pv_list, pv, pv_list); + TAILQ_REMOVE(&pvh->pv_list, pv, pv_next); break; } } @@ -2546,7 +2609,7 @@ pmap_pv_demote_pde(pmap_t pmap, vm_offset_t va, vm pv = pmap_pvh_remove(pvh, pmap, va); KASSERT(pv != NULL, ("pmap_pv_demote_pde: pv not found")); m = PHYS_TO_VM_PAGE(pa); - TAILQ_INSERT_TAIL(&m->md.pv_list, pv, pv_list); + TAILQ_INSERT_TAIL(&m->md.pv_list, pv, pv_next); /* Instantiate the remaining NPTEPG - 1 pv entries. */ PV_STAT(atomic_add_long(&pv_entry_allocs, NPTEPG - 1)); va_last = va + NBPDR - PAGE_SIZE; @@ -2564,7 +2627,7 @@ pmap_pv_demote_pde(pmap_t pmap, vm_offset_t va, vm m++; KASSERT((m->oflags & VPO_UNMANAGED) == 0, ("pmap_pv_demote_pde: page %p is not managed", m)); - TAILQ_INSERT_TAIL(&m->md.pv_list, pv, pv_list); + TAILQ_INSERT_TAIL(&m->md.pv_list, pv, pv_next); if (va == va_last) goto out; } @@ -2612,7 +2675,7 @@ pmap_pv_promote_pde(pmap_t pmap, vm_offset_t va, v pv = pmap_pvh_remove(&m->md, pmap, va); KASSERT(pv != NULL, ("pmap_pv_promote_pde: pv not found")); pvh = pa_to_pvh(pa); - TAILQ_INSERT_TAIL(&pvh->pv_list, pv, pv_list); + TAILQ_INSERT_TAIL(&pvh->pv_list, pv, pv_next); /* Free the remaining NPTEPG - 1 pv entries. */ va_last = va + NBPDR - PAGE_SIZE; do { @@ -2653,7 +2716,7 @@ pmap_try_insert_pv_entry(pmap_t pmap, vm_offset_t if ((pv = get_pv_entry(pmap, NULL)) != NULL) { pv->pv_va = va; CHANGE_PV_LIST_LOCK_TO_VM_PAGE(lockp, m); - TAILQ_INSERT_TAIL(&m->md.pv_list, pv, pv_list); + TAILQ_INSERT_TAIL(&m->md.pv_list, pv, pv_next); return (TRUE); } else return (FALSE); @@ -2677,7 +2740,7 @@ pmap_pv_insert_pde(pmap_t pmap, vm_offset_t va, vm pv->pv_va = va; CHANGE_PV_LIST_LOCK_TO_PHYS(lockp, pa); pvh = pa_to_pvh(pa); - TAILQ_INSERT_TAIL(&pvh->pv_list, pv, pv_list); + TAILQ_INSERT_TAIL(&pvh->pv_list, pv, pv_next); return (TRUE); } else return (FALSE); @@ -3156,7 +3219,7 @@ small_mappings: vm_page_dirty(m); pmap_unuse_pt(pmap, pv->pv_va, *pde, &free); pmap_invalidate_page(pmap, pv->pv_va); - TAILQ_REMOVE(&m->md.pv_list, pv, pv_list); + TAILQ_REMOVE(&m->md.pv_list, pv, pv_next); free_pv_entry(pmap, pv); PMAP_UNLOCK(pmap); } @@ -3602,7 +3665,7 @@ retry: pv = get_pv_entry(pmap, &lock); pv->pv_va = va; CHANGE_PV_LIST_LOCK_TO_PHYS(&lock, pa); - TAILQ_INSERT_TAIL(&m->md.pv_list, pv, pv_list); + TAILQ_INSERT_TAIL(&m->md.pv_list, pv, pv_next); if ((newpte & PG_RW) != 0) vm_page_aflag_set(m, PGA_WRITEABLE); } @@ -4295,7 +4358,7 @@ pmap_page_exists_quick(pmap_t pmap, vm_page_t m) rw_rlock(&pvh_global_lock); lock = VM_PAGE_TO_PV_LIST_LOCK(m); rw_rlock(lock); - TAILQ_FOREACH(pv, &m->md.pv_list, pv_list) { + TAILQ_FOREACH(pv, &m->md.pv_list, pv_next) { if (PV_PMAP(pv) == pmap) { rv = TRUE; break; @@ -4306,7 +4369,7 @@ pmap_page_exists_quick(pmap_t pmap, vm_page_t m) } if (!rv && loops < 16 && (m->flags & PG_FICTITIOUS) == 0) { pvh = pa_to_pvh(VM_PAGE_TO_PHYS(m)); - TAILQ_FOREACH(pv, &pvh->pv_list, pv_list) { + TAILQ_FOREACH(pv, &pvh->pv_list, pv_next) { if (PV_PMAP(pv) == pmap) { rv = TRUE; break; @@ -4358,7 +4421,7 @@ pmap_pvh_wired_mappings(struct md_page *pvh, int c pv_entry_t pv; rw_assert(&pvh_global_lock, RA_WLOCKED); - TAILQ_FOREACH(pv, &pvh->pv_list, pv_list) { + TAILQ_FOREACH(pv, &pvh->pv_list, pv_next) { pmap = PV_PMAP(pv); PMAP_LOCK(pmap); pte = pmap_pte(pmap, pv->pv_va); @@ -4487,7 +4550,7 @@ pmap_remove_pages(pmap_t pmap) if ((tpte & PG_PS) != 0) { pmap_resident_count_dec(pmap, NBPDR / PAGE_SIZE); pvh = pa_to_pvh(tpte & PG_PS_FRAME); - TAILQ_REMOVE(&pvh->pv_list, pv, pv_list); + TAILQ_REMOVE(&pvh->pv_list, pv, pv_next); if (TAILQ_EMPTY(&pvh->pv_list)) { for (mt = m; mt < &m[NBPDR / PAGE_SIZE]; mt++) if ((mt->aflags & PGA_WRITEABLE) != 0 && @@ -4506,7 +4569,7 @@ pmap_remove_pages(pmap_t pmap) } } else { pmap_resident_count_dec(pmap, 1); - TAILQ_REMOVE(&m->md.pv_list, pv, pv_list); + TAILQ_REMOVE(&m->md.pv_list, pv, pv_next); if ((m->aflags & PGA_WRITEABLE) != 0 && TAILQ_EMPTY(&m->md.pv_list) && (m->flags & PG_FICTITIOUS) == 0) { @@ -4581,7 +4644,7 @@ pmap_is_modified_pvh(struct md_page *pvh) rw_assert(&pvh_global_lock, RA_WLOCKED); rv = FALSE; - TAILQ_FOREACH(pv, &pvh->pv_list, pv_list) { + TAILQ_FOREACH(pv, &pvh->pv_list, pv_next) { pmap = PV_PMAP(pv); PMAP_LOCK(pmap); pte = pmap_pte(pmap, pv->pv_va); @@ -4652,7 +4715,7 @@ pmap_is_referenced_pvh(struct md_page *pvh) rw_assert(&pvh_global_lock, RA_WLOCKED); rv = FALSE; - TAILQ_FOREACH(pv, &pvh->pv_list, pv_list) { + TAILQ_FOREACH(pv, &pvh->pv_list, pv_next) { pmap = PV_PMAP(pv); PMAP_LOCK(pmap); pte = pmap_pte(pmap, pv->pv_va); @@ -4693,7 +4756,7 @@ pmap_remove_write(vm_page_t m) if ((m->flags & PG_FICTITIOUS) != 0) goto small_mappings; pvh = pa_to_pvh(VM_PAGE_TO_PHYS(m)); - TAILQ_FOREACH_SAFE(pv, &pvh->pv_list, pv_list, next_pv) { + TAILQ_FOREACH_SAFE(pv, &pvh->pv_list, pv_next, next_pv) { pmap = PV_PMAP(pv); PMAP_LOCK(pmap); va = pv->pv_va; @@ -4703,7 +4766,7 @@ pmap_remove_write(vm_page_t m) PMAP_UNLOCK(pmap); } small_mappings: - TAILQ_FOREACH(pv, &m->md.pv_list, pv_list) { + TAILQ_FOREACH(pv, &m->md.pv_list, pv_next) { pmap = PV_PMAP(pv); PMAP_LOCK(pmap); pde = pmap_pde(pmap, pv->pv_va); @@ -4756,7 +4819,7 @@ pmap_ts_referenced(vm_page_t m) if ((m->flags & PG_FICTITIOUS) != 0) goto small_mappings; pvh = pa_to_pvh(VM_PAGE_TO_PHYS(m)); - TAILQ_FOREACH_SAFE(pv, &pvh->pv_list, pv_list, pvn) { + TAILQ_FOREACH_SAFE(pv, &pvh->pv_list, pv_next, pvn) { pmap = PV_PMAP(pv); PMAP_LOCK(pmap); va = pv->pv_va; @@ -4790,9 +4853,9 @@ small_mappings: if ((pv = TAILQ_FIRST(&m->md.pv_list)) != NULL) { pvf = pv; do { - pvn = TAILQ_NEXT(pv, pv_list); - TAILQ_REMOVE(&m->md.pv_list, pv, pv_list); - TAILQ_INSERT_TAIL(&m->md.pv_list, pv, pv_list); + pvn = TAILQ_NEXT(pv, pv_next); + TAILQ_REMOVE(&m->md.pv_list, pv, pv_next); + TAILQ_INSERT_TAIL(&m->md.pv_list, pv, pv_next); pmap = PV_PMAP(pv); PMAP_LOCK(pmap); pde = pmap_pde(pmap, pv->pv_va); @@ -4844,7 +4907,7 @@ pmap_clear_modify(vm_page_t m) if ((m->flags & PG_FICTITIOUS) != 0) goto small_mappings; pvh = pa_to_pvh(VM_PAGE_TO_PHYS(m)); - TAILQ_FOREACH_SAFE(pv, &pvh->pv_list, pv_list, next_pv) { + TAILQ_FOREACH_SAFE(pv, &pvh->pv_list, pv_next, next_pv) { pmap = PV_PMAP(pv); PMAP_LOCK(pmap); va = pv->pv_va; @@ -4876,7 +4939,7 @@ pmap_clear_modify(vm_page_t m) PMAP_UNLOCK(pmap); } small_mappings: - TAILQ_FOREACH(pv, &m->md.pv_list, pv_list) { + TAILQ_FOREACH(pv, &m->md.pv_list, pv_next) { pmap = PV_PMAP(pv); PMAP_LOCK(pmap); pde = pmap_pde(pmap, pv->pv_va); @@ -4913,7 +4976,7 @@ pmap_clear_reference(vm_page_t m) if ((m->flags & PG_FICTITIOUS) != 0) goto small_mappings; pvh = pa_to_pvh(VM_PAGE_TO_PHYS(m)); - TAILQ_FOREACH_SAFE(pv, &pvh->pv_list, pv_list, next_pv) { + TAILQ_FOREACH_SAFE(pv, &pvh->pv_list, pv_next, next_pv) { pmap = PV_PMAP(pv); PMAP_LOCK(pmap); va = pv->pv_va; @@ -4936,7 +4999,7 @@ pmap_clear_reference(vm_page_t m) PMAP_UNLOCK(pmap); } small_mappings: - TAILQ_FOREACH(pv, &m->md.pv_list, pv_list) { + TAILQ_FOREACH(pv, &m->md.pv_list, pv_next) { pmap = PV_PMAP(pv); PMAP_LOCK(pmap); pde = pmap_pde(pmap, pv->pv_va); Index: /usr/src/sys/conf/files =================================================================== --- /usr/src/sys/conf/files (revision 246798) +++ /usr/src/sys/conf/files (working copy) @@ -3629,6 +3629,7 @@ vm/vm_page.c standard vm/vm_pageout.c standard vm/vm_pager.c standard vm/vm_phys.c standard +vm/vm_radix.c standard vm/vm_reserv.c standard vm/vm_unix.c standard vm/vm_zeroidle.c standard x4# vmstat -z -N /var/tmp/core.536 ITEM SIZE LIMIT USED FREE REQ FAIL SLEEP UMA Kegs: 128, 0, 153, 27, 153, 0, 0 UMA Zones: 236, 0, 153, 12, 153, 0, 0 UMA Slabs: 284, 0, 4293, 5, 5282, 0, 0 UMA RCntSlabs: 544, 0, 603, 6, 603, 0, 0 UMA Hash: 128, 0, 1, 29, 2, 0, 0 16 Bucket: 76, 0, 215, 35, 215, 0, 0 32 Bucket: 140, 0, 156, 12, 156, 0, 0 64 Bucket: 268, 0, 184, 12, 184, 11, 0 128 Bucket: 524, 0, 491, 6, 491,30816, 0 VM OBJECT: 148, 0, 4774, 140, 18100, 0, 0 MAP: 140, 0, 7, 49, 7, 0, 0 KMAP ENTRY: 72, 155078, 36, 494, 27672, 0, 0 MAP ENTRY: 72, 0, 1114, 317, 32363, 0, 0 fakepg: 64, 0, 0, 0, 0, 0, 0 mt_zone: 2060, 0, 349, 24, 349, 0, 0 16: 16, 0, 95, 514, 20126, 0, 0 16: 16, 0, 198, 614, 830, 0, 0 16: 16, 0, 46, 563, 161, 0, 0 16: 16, 0, 2664, 787, 6813, 0, 0 16: 16, 0, 310, 502, 1131, 0, 0 16: 16, 0, 42, 567, 142, 0, 0 16: 16, 0, 190, 419, 1597, 0, 0 16: 16, 0, 43, 566, 165, 0, 0 32: 32, 0, 929, 540, 21802, 0, 0 32: 32, 0, 23, 542, 74, 0, 0 32: 32, 0, 34, 192, 34, 0, 0 32: 32, 0, 1202, 380, 6812, 0, 0 32: 32, 0, 70, 495, 848, 0, 0 32: 32, 0, 49, 516, 132, 0, 0 32: 32, 0, 824, 419, 1331, 0, 0 32: 32, 0, 50, 515, 381, 0, 0 64: 64, 0, 1640, 307, 1833, 0, 0 64: 64, 0, 48, 247, 180, 0, 0 64: 64, 0, 223, 308, 1064, 0, 0 64: 64, 0, 1507, 263, 32837, 0, 0 64: 64, 0, 740, 204, 2706, 0, 0 64: 64, 0, 226, 187, 316, 0, 0 64: 64, 0, 1425, 345, 137995, 0, 0 64: 64, 0, 85, 328, 908, 0, 0 128: 128, 0, 21, 129, 1083, 0, 0 128: 128, 0, 22, 158, 384, 0, 0 128: 128, 0, 108, 132, 243, 0, 0 128: 128, 0, 203, 157, 14849, 0, 0 128: 128, 0, 62, 118, 254, 0, 0 128: 128, 0, 237, 123, 302, 0, 0 128: 128, 0, 691, 179, 1751, 0, 0 128: 128, 0, 93, 28857, 30186, 0, 0 256: 256, 0, 7, 23, 7, 0, 0 256: 256, 0, 22, 53, 397, 0, 0 256: 256, 0, 6, 24, 6, 0, 0 256: 256, 0, 16, 74, 1068, 0, 0 256: 256, 0, 222, 93, 1335, 0, 0 256: 256, 0, 102, 213, 735, 0, 0 256: 256, 0, 478, 152, 560, 0, 0 256: 256, 0, 0, 75, 16, 0, 0 512: 512, 0, 58, 46, 929, 0, 0 512: 512, 0, 27, 45, 77, 0, 0 512: 512, 0, 2, 46, 415, 0, 0 512: 512, 0, 13, 19, 378, 0, 0 512: 512, 0, 270, 98, 952, 0, 0 512: 512, 0, 1, 23, 2, 0, 0 512: 512, 0, 25, 23, 25, 0, 0 512: 512, 0, 0, 48, 399, 0, 0 1024: 1024, 0, 3, 17, 1454, 0, 0 1024: 1024, 0, 2, 18, 55, 0, 0 1024: 1024, 0, 1, 7, 1, 0, 0 1024: 1024, 0, 4, 176, 831, 0, 0 1024: 1024, 0, 1, 27, 65, 0, 0 1024: 1024, 0, 4, 24, 40, 0, 0 1024: 1024, 0, 19, 17, 24, 0, 0 1024: 1024, 0, 4, 16, 50, 0, 0 2048: 2048, 0, 4, 4, 6, 0, 0 2048: 2048, 0, 47, 17, 89, 0, 0 2048: 2048, 0, 6, 2, 6, 0, 0 2048: 2048, 0, 358, 96, 922, 0, 0 2048: 2048, 0, 5063, 399, 5098, 0, 0 2048: 2048, 0, 0, 4, 1, 0, 0 2048: 2048, 0, 10, 8, 11, 0, 0 2048: 2048, 0, 0, 12, 56, 0, 0 4096: 4096, 0, 4, 1, 4, 0, 0 4096: 4096, 0, 0, 0, 0, 0, 0 4096: 4096, 0, 2, 0, 2, 0, 0 4096: 4096, 0, 11, 16, 308, 0, 0 4096: 4096, 0, 200, 84, 29555, 0, 0 4096: 4096, 0, 75, 29, 1091, 0, 0 4096: 4096, 0, 37, 17, 42, 0, 0 4096: 4096, 0, 2, 0, 2, 0, 0 RADIX NODE: 44, 884688, 42138, 842550, 334434, 0, 0 Files: 56, 0, 190, 279, 15748, 0, 0 TURNSTILE: 72, 0, 191, 49, 191, 0, 0 rl_entry: 28, 0, 72, 563, 72, 0, 0 umtx pi: 52, 0, 0, 0, 0, 0, 0 MAC labels: 20, 0, 0, 0, 0, 0, 0 PROC: 720, 0, 60, 30, 1076, 0, 0 THREAD: 752, 0, 150, 40, 150, 0, 0 SLEEPQUEUE: 48, 0, 191, 163, 191, 0, 0 VMSPACE: 232, 0, 43, 110, 1060, 0, 0 cpuset: 40, 0, 79, 105, 79, 0, 0 audit_record: 1096, 0, 0, 0, 0, 0, 0 mbuf_packet: 256, 419850, 256, 768, 1624, 0, 0 mbuf: 256, 419850, 2, 639, 2859, 0, 0 mbuf_cluster: 2048, 65600, 1024, 112, 1024, 0, 0 mbuf_jumbo_page: 4096, 32800, 0, 35, 32, 0, 0 mbuf_jumbo_9k: 9216, 9718, 0, 0, 0, 0, 0 mbuf_jumbo_16k: 16384, 5466, 0, 0, 0, 0, 0 mbuf_ext_refcnt: 4, 0, 0, 0, 0, 0, 0 g_bio: 152, 0, 0, 2912, 2347918, 0, 0 ttyinq: 152, 0, 420, 152, 1170, 0, 0 ttyoutq: 256, 0, 218, 97, 610, 0, 0 ata_request: 208, 0, 0, 76, 9, 0, 0 ata_composite: 180, 0, 0, 0, 0, 0, 0 vtnet_tx_hdr: 16, 0, 0, 0, 0, 0, 0 VNODE: 360, 0, 30978, 20, 31167, 0, 0 VNODEPOLL: 60, 0, 0, 0, 0, 0, 0 S VFS Cache: 72, 0, 31587, 107, 34178, 0, 0 STS VFS Cache: 92, 0, 0, 0, 0, 0, 0 L VFS Cache: 292, 0, 1288, 142, 1288, 0, 0 LTS VFS Cache: 312, 0, 0, 0, 0, 0, 0 NAMEI: 1024, 0, 0, 56, 102317, 0, 0 NCLNODE: 356, 0, 0, 0, 0, 0, 0 DIRHASH: 1024, 0, 2015, 113, 2492, 0, 0 Mountpoints: 748, 0, 7, 18, 8, 0, 0 capability: 16, 0, 0, 0, 0, 0, 0 pipe: 408, 0, 14, 49, 495, 0, 0 ksiginfo: 80, 0, 81, 975, 123, 0, 0 itimer: 220, 0, 1, 35, 1, 0, 0 KNOTE: 72, 0, 0, 265, 70, 0, 0 socket: 416, 109935, 58, 50, 564, 0, 0 unpcb: 172, 109940, 14, 124, 140, 0, 0 ipq: 32, 2147, 0, 0, 0, 0, 0 udp_inpcb: 252, 109935, 26, 49, 344, 0, 0 udpcb: 8, 110026, 26, 583, 344, 0, 0 tcp_inpcb: 252, 109935, 17, 58, 74, 0, 0 tcpcb: 688, 109935, 17, 23, 74, 0, 0 tcptw: 52, 22032, 0, 144, 1, 0, 0 syncache: 120, 15360, 0, 96, 8, 0, 0 hostcache: 76, 15400, 2, 148, 2, 0, 0 tcpreass: 20, 4225, 0, 0, 0, 0, 0 sackhole: 20, 0, 0, 0, 0, 0, 0 sctp_ep: 936, 109936, 0, 0, 0, 0, 0 sctp_asoc: 1504, 40000, 0, 0, 0, 0, 0 sctp_laddr: 24, 80040, 0, 290, 4, 0, 0 sctp_raddr: 500, 80000, 0, 0, 0, 0, 0 sctp_chunk: 96, 400000, 0, 0, 0, 0, 0 sctp_readq: 76, 400000, 0, 0, 0, 0, 0 sctp_stream_msg_out: 68, 400008, 0, 0, 0, 0, 0 sctp_asconf: 24, 400055, 0, 0, 0, 0, 0 sctp_asconf_ack: 24, 400055, 0, 0, 0, 0, 0 ripcb: 252, 109935, 0, 0, 0, 0, 0 rtentry: 108, 0, 17, 127, 17, 0, 0 selfd: 28, 0, 116, 519, 20880, 0, 0 SWAPMETA: 276, 303940, 0, 0, 0, 0, 0 FFS inode: 116, 0, 30850, 137, 31020, 0, 0 FFS1 dinode: 128, 0, 0, 0, 0, 0, 0 FFS2 dinode: 256, 0, 30850, 50, 31020, 0, 0 x4# vmstat -m -N /var/tmp/core.536 Type InUse MemUse HighUse Requests Size(s) CAM path 10 1K - 60 16 isadev 7 1K - 7 64 CAM periph 5 1K - 29 16,32,64,128 acpitask 1 2K - 1 2048 acpisem 17 2K - 17 64,128 CAM queue 26 1K - 143 16,32,256 acpidev 31 1K - 31 32 CAM dev queue 7 1K - 7 128 cdev 8 1K - 8 128 filedesc 80 26K - 1128 16,32,256,512,2048 sigio 1 1K - 1 32 kdtrace 212 42K - 1229 64,256 kenv 87 8K - 108 16,32,64,128,4096 kqueue 0 0K - 70 128,1024 proc-args 41 3K - 1118 16,32,64,128,256 CAM SIM 7 1K - 7 128 hhook 2 1K - 2 128 ithread 86 7K - 86 16,64,128 ctlmem 5062 10113K - 5062 64,2048 KTRACE 100 13K - 100 128 USB 42 15K - 42 16,32,64,256,2048 USBdev 24 2K - 24 32,64,128 linker 162 911K - 207 16,32,512,1024,2048,4096 lockf 70 4K - 20127 32,64 loginclass 2 1K - 15 64 devbuf 2600 23842K - 2705 16,32,64,128,256,512,1024,2048,4096 temp 20 225K - 31320 16,32,64,128,256,512,1024,2048,4096 ip6ndp 4 1K - 5 64,128 CAM XPT 32 2K - 153 16,32,64,1024,2048 ctlblk 200 800K - 200 4096 module 504 32K - 504 64,128 mtx_pool 2 8K - 2 4096 ramdisk 1 4096K - 1 osd 2 1K - 2 16,32 ctlpool 532 138K - 532 16,512 pmchooks 1 1K - 1 64 pci_link 16 2K - 16 64,128 pgrp 35 3K - 83 64 session 30 4K - 59 128 proc 2 8K - 2 4096 subproc 153 267K - 1170 256,4096 cred 70 7K - 28340 64,128 plimit 18 5K - 393 256 uidinfo 4 2K - 114 64,1024 entropy 1024 64K - 1024 64 scsi_cd 0 0K - 1 16 CAM DEV 9 18K - 26 2048 CAM CCB 37 74K - 61 2048 sysctl 0 0K - 336 16,32,64 sysctloid 3951 122K - 4081 16,32,64,128 sysctltmp 0 0K - 479 16,32,64,128,4096 tidhash 1 8K - 1 callout 3 768K - 3 umtx 380 36K - 380 64,128 p1003.1b 1 1K - 1 16 SWAP 2 2189K - 2 64 bus 1238 54K - 5846 16,32,64,128,256,1024 bus-sc 81 116K - 3226 16,32,64,128,256,512,1024,2048,4096 devstat 12 25K - 12 16,4096 eventhandler 84 4K - 84 32,64,128 DEVFS3 159 20K - 172 128 DEVFS1 133 34K - 146 256 kobj 352 704K - 726 2048 Per-cpu 1 1K - 1 16 DEVFS 32 1K - 33 16,64 rman 228 14K - 641 16,32,64 sbuf 1 1K - 2067 16,32,64,128,256,512,1024,2048,4096 stack 0 0K - 2 128 taskqueue 15 1K - 15 16,64 Unitno 20 2K - 554 16,64 Witness 1 104K - 1 ioctlops 0 0K - 1559 16,32,64,128,256,512,1024 select 44 3K - 44 64 iov 0 0K - 136915 16,64,128,256 msg 4 25K - 4 1024,4096 sem 4 101K - 4 1024,4096 shm 1 12K - 1 tty 20 10K - 22 512,1024 pts 2 1K - 2 128 mbuf_tag 0 0K - 13 32,64 shmfd 1 4K - 1 4096 soname 8 1K - 1118 16,32,128 pcb 33 331K - 148 16,64,512,1024,4096 acl 0 0K - 34 4096 biobuf 0 0K - 6 2048 vfscache 1 512K - 1 cl_savebuf 0 0K - 142 32,64 export_host 4 1K - 4 128 vfs_hash 1 256K - 1 vnodes 1 1K - 1 128 NFSD string 1 1K - 1 16 NFSD usrgroup 77 5K - 78 64 mount 95 5K - 827 16,32,64,128,256 vnodemarker 0 0K - 413 512 BPF 2 1K - 2 64 ifnet 3 3K - 3 64,1024 ifaddr 39 9K - 39 16,32,64,128,256,512,1024,2048 ether_multi 40 2K - 46 16,32,64 clone 7 1K - 7 128 arpcom 1 1K - 1 16 lltable 10 3K - 10 128,256 routetbl 37 5K - 322 16,32,64,128,256 igmp 2 1K - 2 128 in_multi 2 1K - 2 128 sctp_a_it 0 0K - 3 16 sctp_vrf 1 1K - 1 64 sctp_ifa 5 1K - 5 128 sctp_ifn 2 1K - 2 128 sctp_iter 0 0K - 3 256 hostcache 1 16K - 1 syncache 1 72K - 1 in6_mfilter 1 1K - 1 512 in6_multi 22 3K - 22 16,256 ip6_moptions 2 1K - 2 32,128 mld 2 1K - 2 128 rpc 17 7K - 17 16,32,64,128,256,512,4096 audit_evclass 180 3K - 219 16 pagedep 2 65K - 109 128 inodedep 4 257K - 354 256 bmsafemap 2 5K - 229 128,4096 newblk 2 65K - 29519 128 indirdep 0 0K - 21 64 freefrag 0 0K - 609 64 freeblks 1 1K - 136 128 freefile 0 0K - 152 32 diradd 1 1K - 207 64 mkdir 0 0K - 12 64 dirrem 1 1K - 205 64 newdirblk 0 0K - 6 32 freework 3 1K - 184 32,128 savedino 0 0K - 39 256 ufs_dirhash 124 52K - 1038 16,32,64,128,256,512,1024,2048 ufs_quota 1 256K - 1 ufs_mount 15 64K - 19 256,2048,4096 vm_pgdata 2 257K - 2 64 UMAHash 1 4K - 5 256,512,1024,2048,4096 pfs_nodes 21 3K - 21 128 pfs_vncache 1 1K - 1 32 GEOM 218 42K - 1403 16,32,64,128,512,1024,2048 atkbddev 2 1K - 2 32 hdaa 9 44K - 9 256,512,1024,2048 hdac 2 1K - 2 64,512 hdacc 2 1K - 2 16 kbdmux 6 18K - 6 16,256,1024,2048 feeder 21 1K - 27 16,64 raid_data 0 0K - 306 16,128 memdesc 1 4K - 1 4096 mixer 4 16K - 4 4096 ddb_capture 1 48K - 1 md_nvidia_data 0 0K - 50 512 apmdev 1 1K - 1 64 madt_table 0 0K - 1 2048 md_sii_data 0 0K - 50 512 io_apic 1 1K - 1 1024 MCA 6 1K - 6 128 msi 2 1K - 2 64 nexusdev 4 1K - 4 16 acpiintr 1 1K - 1 32 UART 3 2K - 3 16,512,1024 acpica 2564 134K - 46012 16,32,64,128,256,512,1024 linux 15 1K - 15 32,64 NFS FHA 1 1K - 1 1024 x4# exit -- Test scenario: misc/all.sh