GENERIC HEAD from 2019-07-16 03:09:03 UTC, r350022M, vmcore.1153 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2019 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #2 r350022M: Wed Jul 17 05:40:31 CEST 2019 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 FreeBSD clang version 8.0.1 (branches/release_80 363030) (based on LLVM 8.0.1) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Entering uma_startup with 9 boot pages configured startup_alloc from "UMA Kegs", 8 boot pages left startup_alloc from "UMA Zones", 7 boot pages left startup_alloc from "UMA Hash", 6 boot pages left startup_alloc from "vmem btag", 5 boot pages left startup_alloc from "UMA Zones", 4 boot pages left startup_alloc from "MAP", 3 boot pages left startup_alloc from "KMAP ENTRY", 2 boot pages left startup_alloc from "vmem", 1 boot pages left Entering uma_startup2 with 0 boot pages left VT(vga): resolution 640x480 CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin="AuthenticAMD" Id=0x100f23 Family=0x10 Model=0x2 Stepping=3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff SVM: NP,NAsids=64 TSC: P-state invariant real memory = 8589934592 (8192 MB) avail memory = 8261353472 (7878 MB) : Trying to mount root from ufs:/dev/ada0s1a [rw]... WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. uhub1: 2 ports with 2 removable, self powered uhub2: 2 ports with 2 removable, self powered uhub0: 2 ports with 2 removable, self powered uhub5: 2 ports with 2 removable, self powered uhub4: 2 ports with 2 removable, self powered WARNING: / was not properly dismounted Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. warning: total configured swap (4194304 pages) exceeds maximum recommended amount (2009920 pages). warning: increase kern.maxswzone or reduce amount of swap. Starting file system checks: uhub3: 10 ports with 10 removable, self powered /dev/ada0s1a: 7905 files, 408269 used, 604746 free (2274 frags, 75309 blocks, 0.2% fragmentation) /dev/ada0s1f: 21133 files, 261908 used, 751107 free (11315 frags, 92474 blocks, 1.1% fragmentation) /dev/ada0s1d: 532773 files, 8856698 used, 1297501 free (244357 frags, 131643 blocks, 2.4% fragmentation) ** SU+J Recovering /dev/ada0s1e ** Reading 33554432 byte journal from inode 6. ** Building recovery table. ** Resolving unreferenced inode list. ** Processing journal entries. ** 10 journal records in 1536 bytes for 20.83% utilization ** Freed 0 inodes (0 dirs) 0 blocks, and 0 frags. ***** FILE SYSTEM MARKED CLEAN ***** /dev/label/tmp: 760942 files, 90108313 used, 28205668 free (36340 frags, 3521166 blocks, 0.0% fragmentation) Mounting local filesystems:. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/arduino/lib /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/e2fsprogs /usr/local/lib/gcc7 /usr/local/lib/gcc8 /usr/local/lib/mysql /usr/local/lib/nss /usr/local/lib/perl5/5.28/mach/CORE /usr/local/lib/pth /usr/local/lib/qt4 /usr/local/lib/qt5 /usr/local/llvm37/lib /usr/local/llvm39/lib a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Setting hostname: x4.osted.lan. Setting up harvesting: [UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . lo0: link state changed to UP re0: link state changed to DOWN Starting Network: lo0 re0. lo0: flags=8049 metric 0 mtu 16384 options=680003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 inet 127.0.0.1 netmask 0xff000000 groups: lo nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 media: Ethernet autoselect (none) status: no carrier nd6 options=29 Starting devd. add host 127.0.0.1: gateway lo0 fib 0: route already in table add net default: gateway 192.168.1.1 add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Starting rpcbind. NFS access cache time=60 Starting watchdogd. No core dumps found. lock order reversal: 1st 0x11c5c428 bufwait (bufwait) @ kern/vfs_bio.c:3867 2nd 0x249d8a00 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:289 stack backtrace: #0 0x1037b51 at witness_debugger+0x61 #1 0x1037929 at witness_checkorder+0x8a9 #2 0xfdfb9d at _sx_xlock+0x4d #3 0x12b4da5 at ufsdirhash_add+0x45 #4 0x12b761e at ufs_direnter+0x3fe #5 0x12bf0cc at ufs_mkdir+0x78c #6 0x15886ad at VOP_MKDIR_APV+0x6d #7 0x10abfc3 at kern_mkdirat+0x173 #8 0x10abe49 at sys_mkdir+0x19 #9 0x1557c48 at syscallenter+0x4d8 #10 0x15575f4 at syscall+0x84 #11 0xffc033b7 at _end+0xfdc28047 Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Starting statd. Starting lockd. Recovering vi editor sessions:. Updating motd:. Mounting late filesystems:. Starting ntpd. Starting powerd. Starting smartd. Jul 17 10:56:35 x4 smartd[637]: Device: /dev/ada0, WARNING: A firmware update for this drive may be available, Jul 17 10:56:35 x4 smartd[637]: see the following Seagate web pages: Jul 17 10:56:35 x4 smartd[637]: http://knowledge.seagate.com/articles/en_US/FAQ/207931en Jul 17 10:56:35 x4 smartd[637]: http://knowledge.seagate.com/articles/en_US/FAQ/213891en Configuring vt: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting sendmail_submit. Starting sendmail_msp_queue. Starting cron. Local package initialization: backup. Starting nfscbd. Starting default mousedmoused: unable to open /dev/psm0: No such file or directory . Starting inetd. Wed Jul 17 10:56 FreeBSD/i386 (x4.osted.lan) (ttyu0) login: lock order reversal: 1st 0x2dfefe6c ufs (ufs) @ kern/vfs_subr.c:2687 2nd 0x11c6f2b8 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:283 3rd 0x3150b8bc ufs (ufs) @ kern/vfs_subr.c:2687 stack backtrace: #0 0x1037b51 at witness_debugger+0x61 #1 0x1037929 at witness_checkorder+0x8a9 #2 0xfaa248 at lockmgr_xlock_hard+0x48 #3 0xfaa9b6 at __lockmgr_args+0x376 #4 0x12af7ef at ffs_lock+0x6f #5 0x1589058 at VOP_LOCK1_APV+0x58 #6 0x10af388 at _vn_lock+0x58 #7 0x109e13b at vget+0x7b #8 0x10915c3 at vfs_hash_get+0xa3 #9 0x12ab1e7 at ffs_vgetf+0x27 #10 0x12a1681 at softdep_sync_buf+0x8d1 #11 0x12b0511 at ffs_syncvnode+0x231 #12 0x12877cc at ffs_truncate+0x88c #13 0x12b779e at ufs_direnter+0x57e #14 0x12bfd4d at ufs_makeinode+0x51d #15 0x12bc2ab at ufs_create+0x2b #16 0x1586b4d at VOP_CREATE_APV+0x6d #17 0x10aed54 at vn_open_cred+0x234 Jul 17 11:06:09 x4 su[943]: pho to root on /dev/pts/0 20190717 11:06:27 all (1/2): su.sh witness_lock_list_get: witness exhausted 20190717 11:12:29 all (2/2): callout_reset_on.sh Expensive timeout(9) function: 0x11d02c0(0x2e1168ac) 0.011673969 s Expensive timeout(9) function: 0xfec790(0x338159fc) 0.012993644 s 20190717 11:18:00 all: done 20190717 11:18:38 all (1/654): ptrace.sh panic: vm_page_try_wire: page 0x9a94ac8 does not belong to an object cpuid = 3 time = 1563355119 KDB: stack backtrace: db_trace_self_wrapper(e6611d,1bffd64,0,3510989c,bd2e71,...) at db_trace_self_wrapper+0x2a/frame 0x35109870 kdb_backtrace(1674cef,5d2ee7ef,0,35109974,0,...) at kdb_backtrace+0x2e/frame 0x351098d0 vpanic(163cd59,35109974,163cd59,35109974,35109988,...) at vpanic+0x1ff/frame 0x35109950 panic(163cd59,9a94ac8,14e24067,9a94ac8,154e601,...) at panic+0x26/frame 0x35109968 vm_page_wire_mapped(9a94ac8) at vm_page_wire_mapped+0x3c/frame 0x35109988 pmap_pae_extract_and_hold(34e785dc,2069f000,11,b26f794,2,...) at pmap_pae_extract_and_hold+0x16d/frame 0x351099b4 vm_fault_quick_hold_pages(34e78530,2069f000,560,11,35109a54,2) at vm_fault_quick_hold_pages+0x119/frame 0x35109a34 cp_slow0(2069faa0,560,0,1530dd0,35109a88) at cp_slow0+0x56/frame 0x35109a6c copyinstr(2069faa0,1b8000c1,3ff4c,35109ae0,0,...) at copyinstr+0x6f/frame 0x35109ab0 exec_args_add_str(35109ba0,2069faa0,0,35109bc4,35109ba0,2069faa0,0) at exec_args_add_str+0xde/frame 0x35109af0 exec_args_add_env(35109ba0,2069faa0,0,0,0,...) at exec_args_add_env+0x55/frame 0x35109b18 exec_copyin_args(35109ba0,206c2714,0,206c2550,206c2628,...) at exec_copyin_args+0x198/frame 0x35109b68 sys_execve(34e86700,34e8698c,166aa5e,4,0,...) at sys_execve+0x7f/frame 0x35109be4 syscallenter(34e86700,c,0,0,34e7e354,...) at syscallenter+0x4d8/frame 0x35109c58 syscall(35109ce8,3b,3b,3b,206c2714,...) at syscall+0x84/frame 0x35109cdc Xint0x80_syscall() at 0xffc033b7/frame 0x35109cdc --- syscall (59, FreeBSD ELF32, sys_execve), eip = 0x20580547, esp = 0xffbfe324, ebp = 0xffbfe44c --- __bss_end() at 0x20580547 KDB: enter: panic [ thread pid 11475 tid 101381 ] Stopped at kdb_enter+0x35: movl $0,kdb_why db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> bt Tracing pid 11475 tid 101381 td 0x34e86700 kdb_enter(16792ff,16792ff,0,35109974,0,...) at kdb_enter+0x35/frame 0x351098d0 vpanic(163cd59,35109974,163cd59,35109974,35109988,...) at vpanic+0x21e/frame 0x35109950 panic(163cd59,9a94ac8,14e24067,9a94ac8,154e601,...) at panic+0x26/frame 0x35109968 vm_page_wire_mapped(9a94ac8) at vm_page_wire_mapped+0x3c/frame 0x35109988 pmap_pae_extract_and_hold(34e785dc,2069f000,11,b26f794,2,...) at pmap_pae_extract_and_hold+0x16d/frame 0x351099b4 vm_fault_quick_hold_pages(34e78530,2069f000,560,11,35109a54,2) at vm_fault_quick_hold_pages+0x119/frame 0x35109a34 cp_slow0(2069faa0,560,0,1530dd0,35109a88) at cp_slow0+0x56/frame 0x35109a6c copyinstr(2069faa0,1b8000c1,3ff4c,35109ae0,0,...) at copyinstr+0x6f/frame 0x35109ab0 exec_args_add_str(35109ba0,2069faa0,0,35109bc4,35109ba0,2069faa0,0) at exec_args_add_str+0xde/frame 0x35109af0 exec_args_add_env(35109ba0,2069faa0,0,0,0,...) at exec_args_add_env+0x55/frame 0x35109b18 exec_copyin_args(35109ba0,206c2714,0,206c2550,206c2628,...) at exec_copyin_args+0x198/frame 0x35109b68 sys_execve(34e86700,34e8698c,166aa5e,4,0,...) at sys_execve+0x7f/frame 0x35109be4 syscallenter(34e86700,c,0,0,34e7e354,...) at syscallenter+0x4d8/frame 0x35109c58 syscall(35109ce8,3b,3b,3b,206c2714,...) at syscall+0x84/frame 0x35109cdc Xint0x80_syscall() at 0xffc033b7/frame 0x35109cdc --- syscall (59, FreeBSD ELF32, sys_execve), eip = 0x20580547, esp = 0xffbfe324, ebp = 0xffbfe44c --- __bss_end() at 0x20580547 db:1:pho1> show allpcpu Current CPU: 3 cpuid = 0 dynamic pcpu = 0x895b00 curthread = 0x359d7a80: pid 11474 tid 101820 "sh" curpcb = 0x36648d40 fpcurthread = 0x359d7a80: pid 11474 "sh" idlethread = 0x11fd9700: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 trampstk = 0xffc07ff0 kesp0 = 0x36648d30 common_tssp = 0xffc01260 tlb gen = 549721 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0x101f2b00 curthread = 0x3610ca80: pid 11473 tid 101835 "vmstat" curpcb = 0x366cbd40 fpcurthread = none idlethread = 0x11fd9380: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 trampstk = 0xffc0aff0 kesp0 = 0x366cbd30 common_tssp = 0xffc012c8 tlb gen = 549723 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0x101f7b00 curthread = 0x2e41d380: pid 1088 tid 100203 "sh" curpcb = 0x2e6ced40 fpcurthread = 0x2e41d380: pid 1088 "sh" idlethread = 0x11fd9000: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 trampstk = 0xffc0bff0 kesp0 = 0x2e6ced30 common_tssp = 0xffc01330 tlb gen = 549723 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0x101fcb00 curthread = 0x34e86700: pid 11475 tid 101381 "sh" curpcb = 0x35109d40 fpcurthread = 0x34e86700: pid 11475 "sh" idlethread = 0x11fd8a80: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 trampstk = 0xffc0dff0 kesp0 = 0x35109d30 common_tssp = 0xffc01398 tlb gen = 549723 curvnet = 0 spin locks held: db:1:pho1> show alllocks db:1:pho1> show lockedvnods Locked vnodes db:1:pho1> show allchains chain 1: thread 100806 (pid 11211, sleep) sleeping on 0x1ef46f5 "nanslp" chain 2: thread 100116 (pid 7429, sh) sleeping on 0x23a7f000 "wait" chain 3: thread 100202 (pid 1091, sh) sleeping on 0x2d2276a0 "piperd" chain 4: thread 100112 (pid 1089, awk) sleeping on 0x2d2271a8 "piperd" chain 5: thread 100206 (pid 1067, sh) sleeping on 0x2d231354 "wait" chain 6: thread 100178 (pid 945, bash) sleeping on 0x2d22a354 "wait" chain 7: thread 100124 (pid 943, csh) sleeping on 0x24864064 "pause" chain 8: thread 100127 (pid 942, su) sleeping on 0x2d230000 "wait" chain 9: thread 100110 (pid 933, bash) sleeping on 0x23a7f9fc "wait" chain 10: thread 100179 (pid 932, sshd) sleeping on 0x246616a4 "select" chain 11: thread 100113 (pid 930, sshd) sleeping on 0x246617e4 "select" chain 12: thread 100196 (pid 785, getty) sleeping on 0x23d5f474 "ttyin" chain 13: thread 100195 (pid 784, getty) sleeping on 0x11bac074 "ttyin" chain 14: thread 100194 (pid 783, getty) sleeping on 0x11bac474 "ttyin" chain 15: thread 100193 (pid 782, getty) sleeping on 0x11bac874 "ttyin" chain 16: thread 100192 (pid 781, getty) sleeping on 0x11bacc74 "ttyin" chain 17: thread 100191 (pid 780, getty) sleeping on 0x11bad074 "ttyin" chain 18: thread 100189 (pid 779, getty) sleeping on 0x11bad474 "ttyin" chain 19: thread 100190 (pid 778, getty) sleeping on 0x11bad874 "ttyin" chain 20: thread 100105 (pid 777, getty) sleeping on 0x11badc74 "ttyin" chain 21: thread 100181 (pid 760, inetd) sleeping on 0x23eac9a4 "select" chain 22: thread 100176 (pid 726, nfscbd: master) sleeping on 0x239d25d0 "rpcsvc" chain 23: thread 100185 (pid 726, nfscbd: service) sleeping on 0x239d2550 "rpcsvc" chain 24: thread 100186 (pid 726, nfscbd: service) sleeping on 0x239d24d0 "rpcsvc" chain 25: thread 100187 (pid 726, nfscbd: service) sleeping on 0x239d2450 "rpcsvc" chain 26: thread 100184 (pid 725, nfscbd) sleeping on 0x2d912af0 "accept" chain 27: thread 100175 (pid 689, cron) sleeping on 0x1ef46f5 "nanslp" chain 28: thread 100122 (pid 685, sendmail) sleeping on 0x23a7a70c "pause" chain 29: thread 100167 (pid 682, sendmail) sleeping on 0x23eaca64 "select" chain 30: thread 100173 (pid 679, sshd) sleeping on 0x216a28a4 "select" chain 31: thread 100170 (pid 639, smartd) sleeping on 0x1ef46f4 "nanslp" chain 32: thread 100171 (pid 615, powerd) sleeping on 0x24661b24 "select" chain 33: thread 100169 (pid 612, ntpd) sleeping on 0x24661824 "select" chain 34: thread 100133 (pid 576, NLM: master) sleeping on 0x246599d0 "rpcsvc" chain 35: thread 100166 (pid 573, rpc.statd) sleeping on 0x24661b64 "select" chain 36: thread 100123 (pid 572, nfsd: master) sleeping on 0x11ad5c50 "rpcsvc" chain 37: thread 100135 (pid 572, nfsd: service) sleeping on 0x239d2650 "rpcsvc" chain 38: thread 100136 (pid 572, nfsd: service) sleeping on 0x2465a150 "rpcsvc" chain 39: thread 100137 (pid 572, nfsd: service) sleeping on 0x2465a0d0 "rpcsvc" chain 40: thread 100138 (pid 572, nfsd: service) sleeping on 0x2465a050 "rpcsvc" chain 41: thread 100139 (pid 572, nfsd: service) sleeping on 0x23eec7d0 "rpcsvc" chain 42: thread 100140 (pid 572, nfsd: service) sleeping on 0x24659f50 "rpcsvc" chain 43: thread 100141 (pid 572, nfsd: service) sleeping on 0x23eec750 "rpcsvc" chain 44: thread 100142 (pid 572, nfsd: service) sleeping on 0x24659ed0 "rpcsvc" chain 45: thread 100143 (pid 572, nfsd: service) sleeping on 0x23eec6d0 "rpcsvc" chain 46: thread 100144 (pid 572, nfsd: service) sleeping on 0x24659e50 "rpcsvc" chain 47: thread 100145 (pid 572, nfsd: service) sleeping on 0x24659dd0 "rpcsvc" chain 48: thread 100146 (pid 572, nfsd: service) sleeping on 0x23eec650 "rpcsvc" chain 49: thread 100147 (pid 572, nfsd: service) sleeping on 0x24659d50 "rpcsvc" chain 50: thread 100148 (pid 572, nfsd: service) sleeping on 0x24659cd0 "rpcsvc" chain 51: thread 100149 (pid 572, nfsd: service) sleeping on 0x24659c50 "rpcsvc" chain 52: thread 100150 (pid 572, nfsd: service) sleeping on 0x23eec5d0 "rpcsvc" chain 53: thread 100151 (pid 572, nfsd: service) sleeping on 0x23eec550 "rpcsvc" chain 54: thread 100152 (pid 572, nfsd: service) sleeping on 0x23eec4d0 "rpcsvc" chain 55: thread 100153 (pid 572, nfsd: service) sleeping on 0x23eec450 "rpcsvc" chain 56: thread 100154 (pid 572, nfsd: service) sleeping on 0x23eec3d0 "rpcsvc" chain 57: thread 100155 (pid 572, nfsd: service) sleeping on 0x24659bd0 "rpcsvc" chain 58: thread 100156 (pid 572, nfsd: service) sleeping on 0x23eec350 "rpcsvc" chain 59: thread 100157 (pid 572, nfsd: service) sleeping on 0x24659b50 "rpcsvc" chain 60: thread 100158 (pid 572, nfsd: service) sleeping on 0x23eec2d0 "rpcsvc" chain 61: thread 100159 (pid 572, nfsd: service) sleeping on 0x23eec250 "rpcsvc" chain 62: thread 100160 (pid 572, nfsd: service) sleeping on 0x23eec1d0 "rpcsvc" chain 63: thread 100161 (pid 572, nfsd: service) sleeping on 0x23eec150 "rpcsvc" chain 64: thread 100162 (pid 572, nfsd: service) sleeping on 0x24659ad0 "rpcsvc" chain 65: thread 100163 (pid 572, nfsd: service) sleeping on 0x24659a50 "rpcsvc" chain 66: thread 100164 (pid 572, nfsd: service) sleeping on 0x23eec0d0 "rpcsvc" chain 67: thread 100165 (pid 572, nfsd: service) sleeping on 0x23eec050 "rpcsvc" chain 68: thread 100134 (pid 569, nfsd) sleeping on 0x216a28e4 "select" chain 69: thread 100109 (pid 563, mountd) sleeping on 0x24661864 "select" chain 70: thread 100129 (pid 556, nfsuserd) sleeping on 0x11a337e4 "select" chain 71: thread 100108 (pid 555, nfsuserd) sleeping on 0x216a29a4 "select" chain 72: thread 100130 (pid 554, nfsuserd) sleeping on 0x216a2ae4 "select" chain 73: thread 100131 (pid 553, nfsuserd) sleeping on 0x216a2aa4 "select" chain 74: thread 100132 (pid 552, nfsuserd) sleeping on 0x2d22fa60 "pause" chain 75: thread 100115 (pid 509, watchdogd) sleeping on 0x1ef46f7 "nanslp" chain 76: thread 100111 (pid 424, rpcbind) sleeping on 0x216a29e4 "select" chain 77: thread 100114 (pid 411, syslogd) sleeping on 0x11a33824 "select" chain 78: thread 100117 (pid 339, devd) sleeping on 0x216a2a24 "select" chain 79: thread 100104 (pid 25, syncer) sleeping on 0x1f6ee64 "syncer" chain 80: thread 100103 (pid 24, vnlru) sleeping on 0x24866354 "vlruwt" chain 81: thread 100100 (pid 23, bufdaemon) sleeping on 0x1f6e7f4 "qsleep" chain 82: thread 100102 (pid 23, bufspacedaemon-0) sleeping on 0x1c22e80 "-" chain 83: thread 100118 (pid 23, /home worker) sleeping on 0x2d270684 "sdflush" chain 84: thread 100119 (pid 23, /tmp worker) sleeping on 0x2d270484 "sdflush" chain 85: thread 100120 (pid 23, /usr worker) sleeping on 0x2d270284 "sdflush" chain 86: thread 100121 (pid 23, /var worker) sleeping on 0x2d270084 "sdflush" chain 87: thread 100098 (pid 22, vmdaemon) sleeping on 0x1f842b8 "psleep" chain 88: thread 100097 (pid 21, dom0) sleeping on 0x1fb885c "psleep" chain 89: thread 100099 (pid 21, laundry: dom0) sleeping on 0x1fb8868 "launds" chain 90: thread 100101 (pid 21, uma) sleeping on 0x12cba90 "umarcl" chain 91: thread 100094 (pid 20, rand_harvestq) sleeping on 0x1d59d00 "-" chain 92: thread 100090 (pid 19, sctp_iterator) sleeping on 0x1fb793c "waiting_for_work" chain 93: thread 100089 (pid 18, soaiod4) sleeping on 0x1f6e428 "-" chain 94: thread 100088 (pid 17, soaiod3) sleeping on 0x1f6e428 "-" chain 95: thread 100087 (pid 16, soaiod2) sleeping on 0x1f6e428 "-" chain 96: thread 100086 (pid 9, soaiod1) sleeping on 0x1f6e428 "-" chain 97: thread 100083 (pid 8, fdc0) sleeping on 0x216c383c "-" chain 98: thread 100048 (pid 15, usbus0) sleeping on 0x216feacc "-" chain 99: thread 100049 (pid 15, usbus0) sleeping on 0x216feafc "-" chain 100: thread 100050 (pid 15, usbus0) sleeping on 0x216feb2c "-" chain 101: thread 100051 (pid 15, usbus0) sleeping on 0x216feb5c "-" chain 102: thread 100052 (pid 15, usbus0) sleeping on 0x216feb8c "-" chain 103: thread 100054 (pid 15, usbus1) sleeping on 0x23a85acc "-" chain 104: thread 100055 (pid 15, usbus1) sleeping on 0x23a85afc "-" chain 105: thread 100056 (pid 15, usbus1) sleeping on 0x23a85b2c "-" chain 106: thread 100057 (pid 15, usbus1) sleeping on 0x23a85b5c "-" chain 107: thread 100058 (pid 15, usbus1) sleeping on 0x23a85b8c "-" chain 108: thread 100060 (pid 15, usbus2) sleeping on 0x23ad1acc "-" chain 109: thread 100061 (pid 15, usbus2) sleeping on 0x23ad1afc "-" chain 110: thread 100062 (pid 15, usbus2) sleeping on 0x23ad1b2c "-" chain 111: thread 100063 (pid 15, usbus2) sleeping on 0x23ad1b5c "-" chain 112: thread 100064 (pid 15, usbus2) sleeping on 0x23ad1b8c "-" chain 113: thread 100065 (pid 15, usbus3) sleeping on 0x23b19acc "-" chain 114: thread 100066 (pid 15, usbus3) sleeping on 0x23b19afc "-" chain 115: thread 100067 (pid 15, usbus3) sleeping on 0x23b19b2c "-" chain 116: thread 100068 (pid 15, usbus3) sleeping on 0x23b19b5c "-" chain 117: thread 100069 (pid 15, usbus3) sleeping on 0x23b19b8c "-" chain 118: thread 100070 (pid 15, usbus4) sleeping on 0x23b61acc "-" chain 119: thread 100071 (pid 15, usbus4) sleeping on 0x23b61afc "-" chain 120: thread 100072 (pid 15, usbus4) sleeping on 0x23b61b2c "-" chain 121: thread 100073 (pid 15, usbus4) sleeping on 0x23b61b5c "-" chain 122: thread 100074 (pid 15, usbus4) sleeping on 0x23b61b8c "-" chain 123: thread 100076 (pid 15, usbus5) sleeping on 0x216f8ca4 "-" chain 124: thread 100077 (pid 15, usbus5) sleeping on 0x216f8cd4 "-" chain 125: thread 100078 (pid 15, usbus5) sleeping on 0x216f8d04 "-" chain 126: thread 100079 (pid 15, usbus5) sleeping on 0x216f8d34 "-" chain 127: thread 100080 (pid 15, usbus5) sleeping on 0x216f8d64 "-" chain 128: thread 100043 (pid 7, doneq0) sleeping on 0x1c931c0 "-" chain 129: thread 100096 (pid 7, scanner) sleeping on 0x1c930ec "-" chain 130: thread 100042 (pid 6, crypto returns 3) sleeping on 0x11bb40c4 "crypto_ret_wait" chain 131: thread 100041 (pid 5, crypto returns 2) sleeping on 0x11bb408c "crypto_ret_wait" chain 132: thread 100040 (pid 4, crypto returns 1) sleeping on 0x11bb4054 "crypto_ret_wait" chain 133: thread 100039 (pid 3, crypto returns 0) sleeping on 0x11bb401c "crypto_ret_wait" chain 134: thread 100038 (pid 2, crypto) sleeping on 0x1f83078 "crypto_wait" chain 135: thread 100033 (pid 14, sequencer 00) sleeping on 0x11a7e64c "seqstate" chain 136: thread 100030 (pid 13, g_event) sleeping on 0x1fa78e4 "-" chain 137: thread 100031 (pid 13, g_up) sleeping on 0x1fa78ec "-" chain 138: thread 100032 (pid 13, g_down) sleeping on 0x1fa78e0 "-" chain 139: thread 100002 (pid 1, init) sleeping on 0x11fcc9fc "wait" chain 140: thread 100001 (pid 10, audit) sleeping on 0x1fb8120 "audit_worker_cv" chain 141: thread 100000 (pid 0, swapper) sleeping on 0x1fa7904 "swapin" chain 142: thread 100007 (pid 0, aiod_kick taskq) sleeping on 0x11fefa00 "-" chain 143: thread 100010 (pid 0, thread taskq) sleeping on 0x11fef880 "-" chain 144: thread 100012 (pid 0, config_0) sleeping on 0x11fd2780 "-" chain 145: thread 100013 (pid 0, kqueue_ctx taskq) sleeping on 0x11fef780 "-" chain 146: thread 100014 (pid 0, if_config_tqg_0) sleeping on 0x11fd2700 "-" chain 147: thread 100015 (pid 0, if_io_tqg_0) sleeping on 0x11fd2080 "-" chain 148: thread 100016 (pid 0, if_io_tqg_1) sleeping on 0x11fd2000 "-" chain 149: thread 100017 (pid 0, if_io_tqg_2) sleeping on 0x11fd1f00 "-" chain 150: thread 100018 (pid 0, if_io_tqg_3) sleeping on 0x11fd1e80 "-" chain 151: thread 100019 (pid 0, softirq_0) sleeping on 0x11fd1e00 "-" chain 152: thread 100020 (pid 0, softirq_1) sleeping on 0x11fd1d80 "-" chain 153: thread 100021 (pid 0, softirq_2) sleeping on 0x11fd1d00 "-" chain 154: thread 100022 (pid 0, softirq_3) sleeping on 0x11fd1c80 "-" chain 155: thread 100029 (pid 0, firmware taskq) sleeping on 0x11fef700 "-" chain 156: thread 100034 (pid 0, crypto_0) sleeping on 0x11fef680 "-" chain 157: thread 100035 (pid 0, crypto_1) sleeping on 0x11fef680 "-" chain 158: thread 100036 (pid 0, crypto_2) sleeping on 0x11fef680 "-" chain 159: thread 100037 (pid 0, crypto_3) sleeping on 0x11fef680 "-" chain 160: thread 100085 (pid 0, mca taskq) sleeping on 0x23d63000 "-" chain 161: thread 100091 (pid 0, acpi_task_0) sleeping on 0x24406c80 "-" chain 162: thread 100092 (pid 0, acpi_task_1) sleeping on 0x24406c80 "-" chain 163: thread 100093 (pid 0, acpi_task_2) sleeping on 0x24406c80 "-" chain 164: thread 100095 (pid 0, CAM taskq) sleeping on 0x11fef600 "-" db:1:pho1> show mount 0x2497b000 /dev/ada0s1a on / (ufs) 0x2485c000 devfs on /dev (devfs) 0x2497a000 /dev/ada0s1f on /home (ufs) 0x24979000 /dev/label/tmp on /tmp (ufs) 0x2d5ac000 /dev/ada0s1d on /usr (ufs) 0x2d5ab000 /dev/ada0s1e on /var (ufs) 0x2d5aa000 procfs on /proc (procfs) More info: show mount db:1:pho1> show bufqueues bqempty: 211 Buf domain 0 freebufs 466 lofreebufs 311 hifreebufs 466 bufspace 69513216 maxbufspace 94683136 hibufspace 94027776 lobufspace 89326372 bufspacethresh 91677074 numdirtybuffers 12 lodirtybuffers 732 hidirtybuffers 1464 dirtybufthresh 1317 cleanq count 5258 (68651008) dirtyq count 12 (182272) wakeup 0 lim 28 CPU 0, 5, 20, 18, Locked buffers: 0 space 0 Total buffers: 5568 space 69513216 db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 11475 1088 1067 0 R CPU 3 sh 11474 1088 1067 0 R CPU 0 sh 11473 1088 1067 0 R CPU 1 vmstat 11211 7429 7429 0 S+ nanslp 0x1ef46f5 sleep 7429 945 7429 0 S+ wait 0x23a7f000 sh 1091 1067 1067 0 S piperd 0x2d2276a0 sh 1089 1067 1067 0 S piperd 0x2d2271a8 awk 1088 1067 1067 0 R CPU 2 sh 1067 1 1067 0 Ss wait 0x2d231354 sh 945 943 945 0 S+ wait 0x2d22a354 bash 943 942 943 0 S+ pause 0x24864064 csh 942 933 942 1001 S+ wait 0x2d230000 su 933 932 933 1001 Ss+ wait 0x23a7f9fc bash 932 930 930 1001 S select 0x246616a4 sshd 930 679 930 0 Ss select 0x246617e4 sshd 785 1 785 0 Ss+ ttyin 0x23d5f474 getty 784 1 784 0 Ss+ ttyin 0x11bac074 getty 783 1 783 0 Ss+ ttyin 0x11bac474 getty 782 1 782 0 Ss+ ttyin 0x11bac874 getty 781 1 781 0 Ss+ ttyin 0x11bacc74 getty 780 1 780 0 Ss+ ttyin 0x11bad074 getty 779 1 779 0 Ss+ ttyin 0x11bad474 getty 778 1 778 0 Ss+ ttyin 0x11bad874 getty 777 1 777 0 Ss+ ttyin 0x11badc74 getty 760 1 760 0 Ss select 0x23eac9a4 inetd 726 725 725 0 S (threaded) nfscbd 100176 S rpcsvc 0x239d25d0 nfscbd: master 100185 S rpcsvc 0x239d2550 nfscbd: service 100186 S rpcsvc 0x239d24d0 nfscbd: service 100187 S rpcsvc 0x239d2450 nfscbd: service 725 1 725 0 Ss accept 0x2d912af0 nfscbd 689 1 689 0 Ss nanslp 0x1ef46f5 cron 685 1 685 25 Ss pause 0x23a7a70c sendmail 682 1 682 0 Ss select 0x23eaca64 sendmail 679 1 679 0 Ss select 0x216a28a4 sshd 639 1 638 0 S nanslp 0x1ef46f4 smartd 615 1 615 0 Ss select 0x24661b24 powerd 612 1 612 0 Ss (threaded) ntpd 100169 S select 0x24661824 ntpd 576 1 576 0 Ss rpcsvc 0x246599d0 NLM: master 573 1 573 0 Ss select 0x24661b64 rpc.statd 572 569 569 0 S (threaded) nfsd 100123 S rpcsvc 0x11ad5c50 nfsd: master 100135 S rpcsvc 0x239d2650 nfsd: service 100136 S rpcsvc 0x2465a150 nfsd: service 100137 S rpcsvc 0x2465a0d0 nfsd: service 100138 S rpcsvc 0x2465a050 nfsd: service 100139 S rpcsvc 0x23eec7d0 nfsd: service 100140 S rpcsvc 0x24659f50 nfsd: service 100141 S rpcsvc 0x23eec750 nfsd: service 100142 S rpcsvc 0x24659ed0 nfsd: service 100143 S rpcsvc 0x23eec6d0 nfsd: service 100144 S rpcsvc 0x24659e50 nfsd: service 100145 S rpcsvc 0x24659dd0 nfsd: service 100146 S rpcsvc 0x23eec650 nfsd: service 100147 S rpcsvc 0x24659d50 nfsd: service 100148 S rpcsvc 0x24659cd0 nfsd: service 100149 S rpcsvc 0x24659c50 nfsd: service 100150 S rpcsvc 0x23eec5d0 nfsd: service 100151 S rpcsvc 0x23eec550 nfsd: service 100152 S rpcsvc 0x23eec4d0 nfsd: service 100153 S rpcsvc 0x23eec450 nfsd: service 100154 S rpcsvc 0x23eec3d0 nfsd: service 100155 S rpcsvc 0x24659bd0 nfsd: service 100156 S rpcsvc 0x23eec350 nfsd: service 100157 S rpcsvc 0x24659b50 nfsd: service 100158 S rpcsvc 0x23eec2d0 nfsd: service 100159 S rpcsvc 0x23eec250 nfsd: service 100160 S rpcsvc 0x23eec1d0 nfsd: service 100161 S rpcsvc 0x23eec150 nfsd: service 100162 S rpcsvc 0x24659ad0 nfsd: service 100163 S rpcsvc 0x24659a50 nfsd: service 100164 S rpcsvc 0x23eec0d0 nfsd: service 100165 S rpcsvc 0x23eec050 nfsd: service 569 1 569 0 Ss select 0x216a28e4 nfsd 563 1 563 0 Ss select 0x24661864 mountd 556 552 552 0 S select 0x11a337e4 nfsuserd 555 552 552 0 S select 0x216a29a4 nfsuserd 554 552 552 0 S select 0x216a2ae4 nfsuserd 553 552 552 0 S select 0x216a2aa4 nfsuserd 552 1 552 0 Ss pause 0x2d22fa60 nfsuserd 509 1 509 0 Ss nanslp 0x1ef46f7 watchdogd 424 1 424 0 Ss select 0x216a29e4 rpcbind 411 1 411 0 Ss select 0x11a33824 syslogd 339 1 339 0 Ss select 0x216a2a24 devd 25 0 0 0 DL syncer 0x1f6ee64 [syncer] 24 0 0 0 DL vlruwt 0x24866354 [vnlru] 23 0 0 0 DL (threaded) [bufdaemon] 100100 D qsleep 0x1f6e7f4 [bufdaemon] 100102 D - 0x1c22e80 [bufspacedaemon-0] 100118 D sdflush 0x2d270684 [/home worker] 100119 D sdflush 0x2d270484 [/tmp worker] 100120 D sdflush 0x2d270284 [/usr worker] 100121 D sdflush 0x2d270084 [/var worker] 22 0 0 0 DL psleep 0x1f842b8 [vmdaemon] 21 0 0 0 DL (threaded) [pagedaemon] 100097 D psleep 0x1fb885c [dom0] 100099 D launds 0x1fb8868 [laundry: dom0] 100101 D umarcl 0x12cba90 [uma] 20 0 0 0 DL - 0x1d59d00 [rand_harvestq] 19 0 0 0 DL waiting 0x1fb793c [sctp_iterator] 18 0 0 0 DL - 0x1f6e428 [soaiod4] 17 0 0 0 DL - 0x1f6e428 [soaiod3] 16 0 0 0 DL - 0x1f6e428 [soaiod2] 9 0 0 0 DL - 0x1f6e428 [soaiod1] 8 0 0 0 DL - 0x216c383c [fdc0] 15 0 0 0 DL (threaded) [usb] 100048 D - 0x216feacc [usbus0] 100049 D - 0x216feafc [usbus0] 100050 D - 0x216feb2c [usbus0] 100051 D - 0x216feb5c [usbus0] 100052 D - 0x216feb8c [usbus0] 100054 D - 0x23a85acc [usbus1] 100055 D - 0x23a85afc [usbus1] 100056 D - 0x23a85b2c [usbus1] 100057 D - 0x23a85b5c [usbus1] 100058 D - 0x23a85b8c [usbus1] 100060 D - 0x23ad1acc [usbus2] 100061 D - 0x23ad1afc [usbus2] 100062 D - 0x23ad1b2c [usbus2] 100063 D - 0x23ad1b5c [usbus2] 100064 D - 0x23ad1b8c [usbus2] 100065 D - 0x23b19acc [usbus3] 100066 D - 0x23b19afc [usbus3] 100067 D - 0x23b19b2c [usbus3] 100068 D - 0x23b19b5c [usbus3] 100069 D - 0x23b19b8c [usbus3] 100070 D - 0x23b61acc [usbus4] 100071 D - 0x23b61afc [usbus4] 100072 D - 0x23b61b2c [usbus4] 100073 D - 0x23b61b5c [usbus4] 100074 D - 0x23b61b8c [usbus4] 100076 D - 0x216f8ca4 [usbus5] 100077 D - 0x216f8cd4 [usbus5] 100078 D - 0x216f8d04 [usbus5] 100079 D - 0x216f8d34 [usbus5] 100080 D - 0x216f8d64 [usbus5] 7 0 0 0 DL (threaded) [cam] 100043 D - 0x1c931c0 [doneq0] 100096 D - 0x1c930ec [scanner] 6 0 0 0 DL crypto_ 0x11bb40c4 [crypto returns 3] 5 0 0 0 DL crypto_ 0x11bb408c [crypto returns 2] 4 0 0 0 DL crypto_ 0x11bb4054 [crypto returns 1] 3 0 0 0 DL crypto_ 0x11bb401c [crypto returns 0] 2 0 0 0 DL crypto_ 0x1f83078 [crypto] 14 0 0 0 DL seqstat 0x11a7e64c [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100030 D - 0x1fa78e4 [g_event] 100031 D - 0x1fa78ec [g_up] 100032 D - 0x1fa78e0 [g_down] 12 0 0 0 WL (threaded) [intr] 100008 I [swi6: task queue] 100009 I [swi6: Giant taskq] 100011 I [swi5: fast taskq] 100023 I [swi4: clock (0)] 100024 I [swi4: clock (1)] 100025 I [swi4: clock (2)] 100026 I [swi4: clock (3)] 100027 I [swi1: netisr 0] 100028 I [swi3: vm] 100044 I [irq24: hdac0] 100045 I [irq25: re0] 100046 I [irq22: ahci0] 100047 I [irq16: hdac1 ohci0] 100053 I [irq17: ohci1 ohci3] 100059 I [irq18: ohci2 ohci4] 100075 I [irq19: ehci0] 100081 I [irq14: ata0] 100082 I [swi0: uart] 100084 I [irq1: atkbd0] 11 0 0 0 RL (threaded) [idle] 100003 CanRun [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 CanRun [idle: cpu2] 100006 CanRun [idle: cpu3] 1 0 1 0 SLs wait 0x11fcc9fc [init] 10 0 0 0 DL audit_w 0x1fb8120 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0x1fa7904 [swapper] 100007 D - 0x11fefa00 [aiod_kick taskq] 100010 D - 0x11fef880 [thread taskq] 100012 D - 0x11fd2780 [config_0] 100013 D - 0x11fef780 [kqueue_ctx taskq] 100014 D - 0x11fd2700 [if_config_tqg_0] 100015 D - 0x11fd2080 [if_io_tqg_0] 100016 D - 0x11fd2000 [if_io_tqg_1] 100017 D - 0x11fd1f00 [if_io_tqg_2] 100018 D - 0x11fd1e80 [if_io_tqg_3] 100019 D - 0x11fd1e00 [softirq_0] 100020 D - 0x11fd1d80 [softirq_1] 100021 D - 0x11fd1d00 [softirq_2] 100022 D - 0x11fd1c80 [softirq_3] 100029 D - 0x11fef700 [firmware taskq] 100034 D - 0x11fef680 [crypto_0] 100035 D - 0x11fef680 [crypto_1] 100036 D - 0x11fef680 [crypto_2] 100037 D - 0x11fef680 [crypto_3] 100085 D - 0x23d63000 [mca taskq] 100091 D - 0x24406c80 [acpi_task_0] 100092 D - 0x24406c80 [acpi_task_1] 100093 D - 0x24406c80 [acpi_task_2] 100095 D - 0x11fef600 [CAM taskq] oops, ran out of processes early! db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 -- -- -- -- 09 (002048K) | 001540 08 (001024K) | 000111 07 (000512K) | 000260 06 (000256K) | 000482 05 (000128K) | 000792 04 (000064K) | 001334 03 (000032K) | 002322 02 (000016K) | 001621 01 (000008K) | 000055 00 (000004K) | 000456 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 -- -- -- -- 09 (002048K) | 001649 08 (001024K) | 000036 07 (000512K) | 000042 06 (000256K) | 000045 05 (000128K) | 000048 04 (000064K) | 000046 03 (000032K) | 000053 02 (000016K) | 000044 01 (000008K) | 000063 00 (000004K) | 000052 FREE LIST 2: ORDER (SIZE) | NUMBER | POOL 0 -- -- -- -- 09 (002048K) | 000000 08 (001024K) | 000000 07 (000512K) | 000000 06 (000256K) | 000001 05 (000128K) | 000001 04 (000064K) | 000001 03 (000032K) | 000002 02 (000016K) | 000003 01 (000008K) | 000003 00 (000004K) | 000001 db:0:pho> acttrace Tracing command sh pid 11475 tid 101381 td 0x34e86700 (CPU 3) kdb_enter(16792ff,16792ff,0,35109974,0,...) at kdb_enter+0x35/frame 0x351098d0 vpanic(163cd59,35109974,163cd59,35109974,35109988,...) at vpanic+0x21e/frame 0x35109950 panic(163cd59,9a94ac8,14e24067,9a94ac8,154e601,...) at panic+0x26/frame 0x35109968 vm_page_wire_mapped(9a94ac8) at vm_page_wire_mapped+0x3c/frame 0x35109988 pmap_pae_extract_and_hold(34e785dc,2069f000,11,b26f794,2,...) at pmap_pae_extract_and_hold+0x16d/frame 0x351099b4 vm_fault_quick_hold_pages(34e78530,2069f000,560,11,35109a54,2) at vm_fault_quick_hold_pages+0x119/frame 0x35109a34 cp_slow0(2069faa0,560,0,1530dd0,35109a88) at cp_slow0+0x56/frame 0x35109a6c copyinstr(2069faa0,1b8000c1,3ff4c,35109ae0,0,...) at copyinstr+0x6f/frame 0x35109ab0 exec_args_add_str(35109ba0,2069faa0,0,35109bc4,35109ba0,2069faa0,0) at exec_args_add_str+0xde/frame 0x35109af0 exec_args_add_env(35109ba0,2069faa0,0,0,0,...) at exec_args_add_env+0x55/frame 0x35109b18 exec_copyin_args(35109ba0,206c2714,0,206c2550,206c2628,...) at exec_copyin_args+0x198/frame 0x35109b68 sys_execve(34e86700,34e8698c,166aa5e,4,0,...) at sys_execve+0x7f/frame 0x35109be4 syscallenter(34e86700,c,0,0,34e7e354,...) at syscallenter+0x4d8/frame 0x35109c58 syscall(35109ce8,3b,3b,3b,206c2714,...) at syscall+0x84/frame 0x35109cdc Xint0x80_syscall() at 0xffc033b7/frame 0x35109cdc --- syscall (59, FreeBSD ELF32, sys_execve), eip = 0x20580547, esp = 0xffbfe324, ebp = 0xffbfe44c --- __bss_end() at 0x20580547 Tracing command sh pid 11474 tid 101820 td 0x359d7a80 (CPU 0) cpustop_handler(0,366484c4,36648478,1555254,145cbfb0,...) at cpustop_handler+0x27/frame 0x366482e8 ipi_nmi_handler(145cbfb0,1,0,313c0c40,4,...) at ipi_nmi_handler+0x34/frame 0x366482f8 trap(36648484,8,28,28,1,...) at trap+0xe4/frame 0x36648478 calltrap() at 0xffc0316d/frame 0x36648478 --- trap 0x13, eip = 0x12ede46, esp = 0x366484c4, ebp = 0x366484e8 --- vm_page_remove(9cda0f8,0,16af443,681,1,...) at vm_page_remove+0x116/frame 0x366484e8 vm_page_rename(9cda0f8,36d1d888,16,0,0,...) at vm_page_rename+0x1ec/frame 0x36648560 vm_object_collapse_scan(36d1d888,4,6aa,69b,fcdba0,...) at vm_object_collapse_scan+0x40f/frame 0x366485d8 vm_object_collapse(36d1d888,166d496,274,12cacf7,2de0b50,...) at vm_object_collapse+0x1a2/frame 0x36648610 vm_object_deallocate(36d1d888) at vm_object_deallocate+0x60f/frame 0x36648684 vm_map_process_deferred(36648a08,0,36648778,f8e8e2,378df3e4,...) at vm_map_process_deferred+0x6e/frame 0x36648698 vm_map_remove(378df3e4,1000,ffc00000,421,1,...) at vm_map_remove+0xa6/frame 0x366486a8 exec_new_vmspace(36648a08,1c5b880) at exec_new_vmspace+0x3a2/frame 0x36648778 exec_elf32_imgact(36648a08,2d8a916c,0,36648a08,1ba49000,...) at exec_elf32_imgact+0x7f6/frame 0x36648808 do_execve(359d7a80,36648ba0,0,206c2540,206c2604,0,0,0,359d7a80,36648ba0,0) at do_execve+0xa99/frame 0x36648b30 kern_execve(359d7a80,36648ba0,0,206c254c,206c2714,...) at kern_execve+0xf4/frame 0x36648b68 sys_execve(359d7a80,359d7d0c,166aa5e,4,0,...) at sys_execve+0xaf/frame 0x36648be4 syscallenter(359d7a80,c,0,0,364569fc,...) at syscallenter+0x4d8/frame 0x36648c58 syscall(36648ce8,3b,3b,3b,206c2714,...) at syscall+0x84/frame 0x36648cdc Xint0x80_syscall() at 0xffc033b7/frame 0x36648cdc --- syscall (59, FreeBSD ELF32, sys_execve), eip = 0x20580547, esp = 0xffbfe324, ebp = 0xffbfe44c --- __bss_end() at 0x20580547 Tracing command vmstat pid 11473 tid 101835 td 0x3610ca80 (CPU 1) cpustop_handler(1,0,366cb66c,1555254,145cbfb0,...) at cpustop_handler+0x27/frame 0x366cb4e0 ipi_nmi_handler(145cbfb0,1,0,0,360f3da8,...) at ipi_nmi_handler+0x34/frame 0x366cb4f0 trap(366cb678,8,28,28,40,...) at trap+0xe4/frame 0x366cb66c calltrap() at 0xffc0316d/frame 0x366cb66c --- trap 0x13, eip = 0x12ef0a4, esp = 0x366cb6b8, ebp = 0x366cb740 --- vm_page_alloc_domain_after(3601130c,3,0,0,40,...) at vm_page_alloc_domain_after+0x284/frame 0x366cb740 vm_page_alloc_after(3601130c,3,0,40,82715b4,...) at vm_page_alloc_after+0xb6/frame 0x366cb7c0 vm_page_alloc(3601130c,3,0,40,0,...) at vm_page_alloc+0xaa/frame 0x366cb818 vm_fault_hold(360f3cf8,2042a000,2,0,0,...) at vm_fault_hold+0xd36/frame 0x366cba4c vm_fault(360f3cf8,2042a000,2,0,0,...) at vm_fault+0xbd/frame 0x366cba90 trap_pfault(366cbce8,1,2042a01c,366cbbb0,102e134,...) at trap_pfault+0x307/frame 0x366cbb60 trap(366cbce8,3b,3b,3b,7e,...) at trap+0x691/frame 0x366cbcdc calltrap() at 0xffc0316d/frame 0x366cbcdc --- trap 0xc, eip = 0x20419583, esp = 0xffbfddac, ebp = 0xffbfddcc --- __bss_end() at 0x20419583 Tracing command sh pid 1088 tid 100203 td 0x2e41d380 (CPU 2) cpustop_handler(2,24998b20,2e6ce9d4,1555254,145cbfb0,...) at cpustop_handler+0x27/frame 0x2e6ce848 ipi_nmi_handler(145cbfb0,1,0,0,2e6ce8a8,...) at ipi_nmi_handler+0x34/frame 0x2e6ce858 trap(2e6ce9e0,8,28,28,2e41d380,...) at trap+0xe4/frame 0x2e6ce9d4 calltrap() at 0xffc0316d/frame 0x2e6ce9d4 --- trap 0x13, eip = 0xfb4296, esp = 0x2e6cea20, ebp = 0x2e6cea30 --- __mtx_lock_flags(24998b20,0,1606107,10f4) at __mtx_lock_flags+0x96/frame 0x2e6cea30 pmap_pae_copy(373b0c58,24998b0c,2048a000,1000,2048a000,...) at pmap_pae_copy+0x7b/frame 0x2e6cea88 vmspace_fork(24998a60,2e6ceb50,9,2e41d380,1f026c0,...) at vmspace_fork+0xacf/frame 0x2e6ceac8 fork1(2e41d380,2e6cebb8,1c,2e18f718,2e6cebb8,...) at fork1+0x5af/frame 0x2e6ceb88 sys_fork(2e41d380,2e41d60c,166aa5e,4,0,...) at sys_fork+0x64/frame 0x2e6cebe4 syscallenter(2e41d380,c,0,0,2e6cee00,...) at syscallenter+0x4d8/frame 0x2e6cec58 syscall(2e6cece8,3b,3b,3b,206b70a0,...) at syscall+0x84/frame 0x2e6cecdc Xint0x80_syscall() at 0xffc033b7/frame 0x2e6cecdc --- syscall (2, FreeBSD ELF32, sys_fork), eip = 0x205a0633, esp = 0xffbfe594, ebp = 0xffbfe59c --- __bss_end() at 0x205a0633 db:0:pho> alltrace Tracing command sh pid 11475 tid 101381 td 0x34e86700 (CPU 3) kdb_enter(16792ff,16792ff,0,35109974,0,...) at kdb_enter+0x35/frame 0x351098d0 vpanic(163cd59,35109974,163cd59,35109974,35109988,...) at vpanic+0x21e/frame 0x35109950 panic(163cd59,9a94ac8,14e24067,9a94ac8,154e601,...) at panic+0x26/frame 0x35109968 vm_page_wire_mapped(9a94ac8) at vm_page_wire_mapped+0x3c/frame 0x35109988 pmap_pae_extract_and_hold(34e785dc,2069f000,11,b26f794,2,...) at pmap_pae_extract_and_hold+0x16d/frame 0x351099b4 vm_fault_quick_hold_pages(34e78530,2069f000,560,11,35109a54,2) at vm_fault_quick_hold_pages+0x119/frame 0x35109a34 cp_slow0(2069faa0,560,0,1530dd0,35109a88) at cp_slow0+0x56/frame 0x35109a6c copyinstr(2069faa0,1b8000c1,3ff4c,35109ae0,0,...) at copyinstr+0x6f/frame 0x35109ab0 exec_args_add_str(35109ba0,2069faa0,0,35109bc4,35109ba0,2069faa0,0) at exec_args_add_str+0xde/frame 0x35109af0 exec_args_add_env(35109ba0,2069faa0,0,0,0,...) at exec_args_add_env+0x55/frame 0x35109b18 exec_copyin_args(35109ba0,206c2714,0,206c2550,206c2628,...) at exec_copyin_args+0x198/frame 0x35109b68 sys_execve(34e86700,34e8698c,166aa5e,4,0,...) at sys_execve+0x7f/frame 0x35109be4 syscallenter(34e86700,c,0,0,34e7e354,...) at syscallenter+0x4d8/frame 0x35109c58 syscall(35109ce8,3b,3b,3b,206c2714,...) at syscall+0x84/frame 0x35109cdc Xint0x80_syscall() at 0xffc033b7/frame 0x35109cdc --- syscall (59, FreeBSD ELF32, sys_execve), eip = 0x20580547, esp = 0xffbfe324, ebp = 0xffbfe44c --- __bss_end() at 0x20580547 Tracing command sh pid 11474 tid 101820 td 0x359d7a80 (CPU 0) cpustop_handler(0,366484c4,36648478,1555254,145cbfb0,...) at cpustop_handler+0x27/frame 0x366482e8 ipi_nmi_handler(145cbfb0,1,0,313c0c40,4,...) at ipi_nmi_handler+0x34/frame 0x366482f8 trap(36648484,8,28,28,1,...) at trap+0xe4/frame 0x36648478 calltrap() at 0xffc0316d/frame 0x36648478 --- trap 0x13, eip = 0x12ede46, esp = 0x366484c4, ebp = 0x366484e8 --- vm_page_remove(9cda0f8,0,16af443,681,1,...) at vm_page_remove+0x116/frame 0x366484e8 vm_page_rename(9cda0f8,36d1d888,16,0,0,...) at vm_page_rename+0x1ec/frame 0x36648560 vm_object_collapse_scan(36d1d888,4,6aa,69b,fcdba0,...) at vm_object_collapse_scan+0x40f/frame 0x366485d8 vm_object_collapse(36d1d888,166d496,274,12cacf7,2de0b50,...) at vm_object_collapse+0x1a2/frame 0x36648610 vm_object_deallocate(36d1d888) at vm_object_deallocate+0x60f/frame 0x36648684 vm_map_process_deferred(36648a08,0,36648778,f8e8e2,378df3e4,...) at vm_map_process_deferred+0x6e/frame 0x36648698 vm_map_remove(378df3e4,1000,ffc00000,421,1,...) at vm_map_remove+0xa6/frame 0x366486a8 exec_new_vmspace(36648a08,1c5b880) at exec_new_vmspace+0x3a2/frame 0x36648778 exec_elf32_imgact(36648a08,2d8a916c,0,36648a08,1ba49000,...) at exec_elf32_imgact+0x7f6/frame 0x36648808 do_execve(359d7a80,36648ba0,0,206c2540,206c2604,0,0,0,359d7a80,36648ba0,0) at do_execve+0xa99/frame 0x36648b30 kern_execve(359d7a80,36648ba0,0,206c254c,206c2714,...) at kern_execve+0xf4/frame 0x36648b68 sys_execve(359d7a80,359d7d0c,166aa5e,4,0,...) at sys_execve+0xaf/frame 0x36648be4 syscallenter(359d7a80,c,0,0,364569fc,...) at syscallenter+0x4d8/frame 0x36648c58 syscall(36648ce8,3b,3b,3b,206c2714,...) at syscall+0x84/frame 0x36648cdc Xint0x80_syscall() at 0xffc033b7/frame 0x36648cdc --- syscall (59, FreeBSD ELF32, sys_execve), eip = 0x20580547, esp = 0xffbfe324, ebp = 0xffbfe44c --- __bss_end() at 0x20580547 Tracing command vmstat pid 11473 tid 101835 td 0x3610ca80 (CPU 1) cpustop_handler(1,0,366cb66c,1555254,145cbfb0,...) at cpustop_handler+0x27/frame 0x366cb4e0 ipi_nmi_handler(145cbfb0,1,0,0,360f3da8,...) at ipi_nmi_handler+0x34/frame 0x366cb4f0 trap(366cb678,8,28,28,40,...) at trap+0xe4/frame 0x366cb66c calltrap() at 0xffc0316d/frame 0x366cb66c --- trap 0x13, eip = 0x12ef0a4, esp = 0x366cb6b8, ebp = 0x366cb740 --- vm_page_alloc_domain_after(3601130c,3,0,0,40,...) at vm_page_alloc_domain_after+0x284/frame 0x366cb740 vm_page_alloc_after(3601130c,3,0,40,82715b4,...) at vm_page_alloc_after+0xb6/frame 0x366cb7c0 vm_page_alloc(3601130c,3,0,40,0,...) at vm_page_alloc+0xaa/frame 0x366cb818 vm_fault_hold(360f3cf8,2042a000,2,0,0,...) at vm_fault_hold+0xd36/frame 0x366cba4c vm_fault(360f3cf8,2042a000,2,0,0,...) at vm_fault+0xbd/frame 0x366cba90 trap_pfault(366cbce8,1,2042a01c,366cbbb0,102e134,...) at trap_pfault+0x307/frame 0x366cbb60 trap(366cbce8,3b,3b,3b,7e,...) at trap+0x691/frame 0x366cbcdc calltrap() at 0xffc0316d/frame 0x366cbcdc --- trap 0xc, eip = 0x20419583, esp = 0xffbfddac, ebp = 0xffbfddcc --- __bss_end() at 0x20419583 Tracing command sleep pid 11211 tid 100806 td 0x32fff000 sched_switch(32fff000,0,104) at sched_switch+0x598/frame 0x330a1a44 mi_switch(104,0) at mi_switch+0x1de/frame 0x330a1a78 sleepq_switch(6c,8000000,0,32ff2354,1f128d4,...) at sleepq_switch+0xe1/frame 0x330a1a9c sleepq_catch_signals(1,177,32fff000,100,1ef46f5,...) at sleepq_catch_signals+0x3b7/frame 0x330a1ac8 sleepq_timedwait_sig(1ef46f5,6c,345fa424,0,163cc6f,...) at sleepq_timedwait_sig+0x17/frame 0x330a1af4 _sleep(1ef46f5,0,16c,1690818,e3c744b1,790,8000000,0,200) at _sleep+0x22c/frame 0x330a1b34 kern_clock_nanosleep(32fff000,0,0,330a1bc8,330a1bc0) at kern_clock_nanosleep+0x1ba/frame 0x330a1ba4 sys_nanosleep(32fff000,32fff28c,166aa5e,4,0,...) at sys_nanosleep+0x55/frame 0x330a1be4 syscallenter(32fff000,c,0,0,330a1e00,...) at syscallenter+0x4d8/frame 0x330a1c58 syscall(330a1ce8,3b,3b,3b,ffbfe7a0,...) at syscall+0x84/frame 0x330a1cdc Xint0x80_syscall() at 0xffc033b7/frame 0x330a1cdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x20555613, esp = 0xffbfe768, ebp = 0xffbfe778 --- __bss_end() at 0x20555613 Tracing command sh pid 7429 tid 100116 td 0x23d7e700 sched_switch(23d7e700,0,104) at sched_switch+0x598/frame 0x2d11e994 mi_switch(104,0) at mi_switch+0x1de/frame 0x2d11e9c8 sleepq_switch(6c,2d11ea20,1027aa7,23a7f000,1f13814,...) at sleepq_switch+0xe1/frame 0x2d11e9ec sleepq_catch_signals(23d7e700,0,23a7f000,2d11ea6c,fe182e,...) at sleepq_catch_signals+0x3b7/frame 0x2d11ea18 sleepq_wait_sig(23a7f000,6c) at sleepq_wait_sig+0x11/frame 0x2d11ea2c _sleep(23a7f000,23a7f0a8,36c,1699a39,0,0,0,0,100) at _sleep+0x28e/frame 0x2d11ea6c kern_wait6(23d7e700,7,0,0,2d11eaf4,30,0,0) at kern_wait6+0x3bd/frame 0x2d11eac8 sys_wait4(23d7e700,23d7e98c,166aa5e,4,0,...) at sys_wait4+0x78/frame 0x2d11ebe4 syscallenter(23d7e700,c,0,0,2d11ee00,...) at syscallenter+0x4d8/frame 0x2d11ec58 syscall(2d11ece8,3b,3b,3b,ffbfe6ac,...) at syscall+0x84/frame 0x2d11ecdc Xint0x80_syscall() at 0xffc033b7/frame 0x2d11ecdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x205a0553, esp = 0xffbfe664, ebp = 0xffbfe67c --- __bss_end() at 0x205a0553 Tracing command sh pid 1091 tid 100202 td 0x315a3380 sched_switch(315a3380,0,104) at sched_switch+0x598/frame 0x2e6c9a2c mi_switch(104,0) at mi_switch+0x1de/frame 0x2e6c9a5c sleepq_switch(5c,2e6c9ab4,1027aa7,2e1306a8,1f13194,...) at sleepq_switch+0xe1/frame 0x2e6c9a80 sleepq_catch_signals(315a3380,0,2d2276a0,2e6c9b00,fe182e,...) at sleepq_catch_signals+0x3b7/frame 0x2e6c9aac sleepq_wait_sig(2d2276a0,5c) at sleepq_wait_sig+0x11/frame 0x2e6c9ac0 _sleep(2d2276a0,2d227830,15c,167e2a6,0,0,0,0,100) at _sleep+0x28e/frame 0x2e6c9b00 pipe_read(2499faf0,2e6c9bb8,216bbd00,0,315a3380) at pipe_read+0x30e/frame 0x2e6c9b40 dofileread(2499faf0,2e6c9bb8,ffffffff,ffffffff,0) at dofileread+0x6d/frame 0x2e6c9b70 kern_readv(315a3380,0,2e6c9bb8) at kern_readv+0x3b/frame 0x2e6c9b9c sys_read(315a3380,315a360c,166aa5e,4,0,...) at sys_read+0x48/frame 0x2e6c9be4 syscallenter(315a3380,c,0,0,2e1306a8,...) at syscallenter+0x4d8/frame 0x2e6c9c58 syscall(2e6c9ce8,3b,3b,3b,0,...) at syscall+0x84/frame 0x2e6c9cdc Xint0x80_syscall() at 0xffc033b7/frame 0x2e6c9cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x20606ecb, esp = 0xffbfe440, ebp = 0xffbfe454 --- __bss_end() at 0x20606ecb Tracing command awk pid 1089 tid 100112 td 0x23d7f000 sched_switch(23d7f000,0,104) at sched_switch+0x598/frame 0x2d0f2a2c mi_switch(104,0) at mi_switch+0x1de/frame 0x2d0f2a5c sleepq_switch(5c,2d0f2ab4,1027aa7,23a7f6a8,1f13254,...) at sleepq_switch+0xe1/frame 0x2d0f2a80 sleepq_catch_signals(23d7f000,0,2d2271a8,2d0f2b00,fe182e,...) at sleepq_catch_signals+0x3b7/frame 0x2d0f2aac sleepq_wait_sig(2d2271a8,5c) at sleepq_wait_sig+0x11/frame 0x2d0f2ac0 _sleep(2d2271a8,2d227338,15c,167e2a6,0,0,0,0,100) at _sleep+0x28e/frame 0x2d0f2b00 pipe_read(2499ece8,2d0f2bb8,216bbd00,0,23d7f000) at pipe_read+0x30e/frame 0x2d0f2b40 dofileread(2499ece8,2d0f2bb8,ffffffff,ffffffff,0) at dofileread+0x6d/frame 0x2d0f2b70 kern_readv(23d7f000,0,2d0f2bb8) at kern_readv+0x3b/frame 0x2d0f2b9c sys_read(23d7f000,23d7f28c,166aa5e,4,0,...) at sys_read+0x48/frame 0x2d0f2be4 syscallenter(23d7f000,2d0f2ce8,1,0,2d0f2e00,...) at syscallenter+0x4d8/frame 0x2d0f2c58 syscall(2d0f2ce8,3b,3b,3b,2061f5cc,...) at syscall+0x84/frame 0x2d0f2cdc Xint0x80_syscall() at 0xffc033b7/frame 0x2d0f2cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x20616ecb, esp = 0xffbfe49c, ebp = 0xffbfe4b0 --- __bss_end() at 0x20616ecb Tracing command sh pid 1088 tid 100203 td 0x2e41d380 (CPU 2) cpustop_handler(2,24998b20,2e6ce9d4,1555254,145cbfb0,...) at cpustop_handler+0x27/frame 0x2e6ce848 ipi_nmi_handler(145cbfb0,1,0,0,2e6ce8a8,...) at ipi_nmi_handler+0x34/frame 0x2e6ce858 trap(2e6ce9e0,8,28,28,2e41d380,...) at trap+0xe4/frame 0x2e6ce9d4 calltrap() at 0xffc0316d/frame 0x2e6ce9d4 --- trap 0x13, eip = 0xfb4296, esp = 0x2e6cea20, ebp = 0x2e6cea30 --- __mtx_lock_flags(24998b20,0,1606107,10f4) at __mtx_lock_flags+0x96/frame 0x2e6cea30 pmap_pae_copy(373b0c58,24998b0c,2048a000,1000,2048a000,...) at pmap_pae_copy+0x7b/frame 0x2e6cea88 vmspace_fork(24998a60,2e6ceb50,9,2e41d380,1f026c0,...) at vmspace_fork+0xacf/frame 0x2e6ceac8 fork1(2e41d380,2e6cebb8,1c,2e18f718,2e6cebb8,...) at fork1+0x5af/frame 0x2e6ceb88 sys_fork(2e41d380,2e41d60c,166aa5e,4,0,...) at sys_fork+0x64/frame 0x2e6cebe4 syscallenter(2e41d380,c,0,0,2e6cee00,...) at syscallenter+0x4d8/frame 0x2e6cec58 syscall(2e6cece8,3b,3b,3b,206b70a0,...) at syscall+0x84/frame 0x2e6cecdc Xint0x80_syscall() at 0xffc033b7/frame 0x2e6cecdc --- syscall (2, FreeBSD ELF32, sys_fork), eip = 0x205a0633, esp = 0xffbfe594, ebp = 0xffbfe59c --- __bss_end() at 0x205a0633 Tracing command sh pid 1067 tid 100206 td 0x2e41c700 sched_switch(2e41c700,0,104) at sched_switch+0x598/frame 0x2e6dd994 mi_switch(104,0) at mi_switch+0x1de/frame 0x2e6dd9c8 sleepq_switch(6c,2e6dda20,1027aa7,2d231354,1f10dd4,...) at sleepq_switch+0xe1/frame 0x2e6dd9ec sleepq_catch_signals(2e41c700,0,2d231354,2e6dda6c,fe182e,...) at sleepq_catch_signals+0x3b7/frame 0x2e6dda18 sleepq_wait_sig(2d231354,6c) at sleepq_wait_sig+0x11/frame 0x2e6dda2c _sleep(2d231354,2d2313fc,36c,1699a39,0,0,0,0,100) at _sleep+0x28e/frame 0x2e6dda6c kern_wait6(2e41c700,7,0,0,2e6ddaf4,30,0,0) at kern_wait6+0x3bd/frame 0x2e6ddac8 sys_wait4(2e41c700,2e41c98c,166aa5e,4,0,...) at sys_wait4+0x78/frame 0x2e6ddbe4 syscallenter(2e41c700,c,0,0,2e6dde00,...) at syscallenter+0x4d8/frame 0x2e6ddc58 syscall(2e6ddce8,3b,3b,3b,ffbfe654,...) at syscall+0x84/frame 0x2e6ddcdc Xint0x80_syscall() at 0xffc033b7/frame 0x2e6ddcdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x205a0553, esp = 0xffbfe60c, ebp = 0xffbfe624 --- __bss_end() at 0x205a0553 Tracing command bash pid 945 tid 100178 td 0x243e9380 sched_switch(243e9380,0,104) at sched_switch+0x598/frame 0x2ddf0994 mi_switch(104,0) at mi_switch+0x1de/frame 0x2ddf09c8 sleepq_switch(6c,2ddf0a20,1027aa7,2d22a354,1f139d4,...) at sleepq_switch+0xe1/frame 0x2ddf09ec sleepq_catch_signals(243e9380,0,2d22a354,2ddf0a6c,fe182e,...) at sleepq_catch_signals+0x3b7/frame 0x2ddf0a18 sleepq_wait_sig(2d22a354,6c) at sleepq_wait_sig+0x11/frame 0x2ddf0a2c _sleep(2d22a354,2d22a3fc,36c,1699a39,0,0,0,0,100) at _sleep+0x28e/frame 0x2ddf0a6c kern_wait6(243e9380,7,0,0,2ddf0af4,36,0,0) at kern_wait6+0x3bd/frame 0x2ddf0ac8 sys_wait4(243e9380,243e960c,166aa5e,4,0,...) at sys_wait4+0x78/frame 0x2ddf0be4 syscallenter(243e9380,c,0,0,2ddf0e00,...) at syscallenter+0x4d8/frame 0x2ddf0c58 syscall(2ddf0ce8,3b,3b,3b,0,...) at syscall+0x84/frame 0x2ddf0cdc Xint0x80_syscall() at 0xffc033b7/frame 0x2ddf0cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x20686553, esp = 0xffbfe798, ebp = 0xffbfe7b0 --- __bss_end() at 0x20686553 Tracing command csh pid 943 tid 100124 td 0x11e5ca80 sched_switch(11e5ca80,0,104) at sched_switch+0x598/frame 0x2d1aea94 mi_switch(104,0) at mi_switch+0x1de/frame 0x2d1aeac8 sleepq_switch(74,2d1aeb20,1027aa7,24864000,1f10514,...) at sleepq_switch+0xe1/frame 0x2d1aeaec sleepq_catch_signals(11e5ca80,0,24864064,2d1aeb6c,fe182e,...) at sleepq_catch_signals+0x3b7/frame 0x2d1aeb18 sleepq_wait_sig(24864064,74) at sleepq_wait_sig+0x11/frame 0x2d1aeb2c _sleep(24864064,248640a8,174,15e1ecb,0,0,0,0,100) at _sleep+0x28e/frame 0x2d1aeb6c kern_sigsuspend(11e5ca80,2,0,0,0) at kern_sigsuspend+0x8e/frame 0x2d1aebac sys_sigsuspend(11e5ca80,11e5cd0c,166aa5e,4,0,...) at sys_sigsuspend+0x3b/frame 0x2d1aebe4 syscallenter(11e5ca80,c,0,0,24864000,...) at syscallenter+0x4d8/frame 0x2d1aec58 syscall(2d1aece8,3b,3b,3b,ffbfe158,...) at syscall+0x84/frame 0x2d1aecdc Xint0x80_syscall() at 0xffc033b7/frame 0x2d1aecdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x20611593, esp = 0xffbfe130, ebp = 0xffbfe13c --- __bss_end() at 0x20611593 Tracing command su pid 942 tid 100127 td 0x2d23f380 sched_switch(2d23f380,0,104) at sched_switch+0x598/frame 0x2dc8d994 mi_switch(104,0) at mi_switch+0x1de/frame 0x2dc8d9c8 sleepq_switch(6c,2dc8da20,1027aa7,2d230000,1f0fc14,...) at sleepq_switch+0xe1/frame 0x2dc8d9ec sleepq_catch_signals(2d23f380,0,2d230000,2dc8da6c,fe182e,...) at sleepq_catch_signals+0x3b7/frame 0x2dc8da18 sleepq_wait_sig(2d230000,6c) at sleepq_wait_sig+0x11/frame 0x2dc8da2c _sleep(2d230000,2d2300a8,36c,1699a39,0,0,0,0,100) at _sleep+0x28e/frame 0x2dc8da6c kern_wait6(2d23f380,0,3af,0,2dc8daf4,32,0,0) at kern_wait6+0x3bd/frame 0x2dc8dac8 sys_wait4(2d23f380,2d23f60c,166aa5e,4,0,...) at sys_wait4+0x78/frame 0x2dc8dbe4 syscallenter(2d23f380,c,0,0,2dc8de00,...) at syscallenter+0x4d8/frame 0x2dc8dc58 syscall(2dc8dce8,3b,3b,3b,ffbfe690,...) at syscall+0x84/frame 0x2dc8dcdc Xint0x80_syscall() at 0xffc033b7/frame 0x2dc8dcdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x20591553, esp = 0xffbfe63c, ebp = 0xffbfe654 --- __bss_end() at 0x20591553 Tracing command bash pid 933 tid 100110 td 0x23d7f380 sched_switch(23d7f380,0,104) at sched_switch+0x598/frame 0x2d0e0994 mi_switch(104,0) at mi_switch+0x1de/frame 0x2d0e09c8 sleepq_switch(6c,2d0e0a20,1027aa7,23a7f9fc,1f0fd54,...) at sleepq_switch+0xe1/frame 0x2d0e09ec sleepq_catch_signals(23d7f380,0,23a7f9fc,2d0e0a6c,fe182e,...) at sleepq_catch_signals+0x3b7/frame 0x2d0e0a18 sleepq_wait_sig(23a7f9fc,6c) at sleepq_wait_sig+0x11/frame 0x2d0e0a2c _sleep(23a7f9fc,23a7faa4,36c,1699a39,0,0,0,0,100) at _sleep+0x28e/frame 0x2d0e0a6c kern_wait6(23d7f380,7,0,0,2d0e0af4,36,0,0) at kern_wait6+0x3bd/frame 0x2d0e0ac8 sys_wait4(23d7f380,23d7f60c,166aa5e,4,0,...) at sys_wait4+0x78/frame 0x2d0e0be4 syscallenter(23d7f380,c,0,0,2d0e0e00,...) at syscallenter+0x4d8/frame 0x2d0e0c58 syscall(2d0e0ce8,3b,3b,3b,0,...) at syscall+0x84/frame 0x2d0e0cdc Xint0x80_syscall() at 0xffc033b7/frame 0x2d0e0cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x20686553, esp = 0xffbfe978, ebp = 0xffbfe990 --- __bss_end() at 0x20686553 Tracing command sshd pid 932 tid 100179 td 0x2e417a80 sched_switch(2e417a80,0,104) at sched_switch+0x598/frame 0x2ddf5944 mi_switch(104,0) at mi_switch+0x1de/frame 0x2ddf5974 sleepq_switch(0,24661690,8,2d22a000,1f12894,...) at sleepq_switch+0xe1/frame 0x2ddf5998 sleepq_catch_signals(246616a4,2e417a80,24661690,2ddf5a10,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2ddf59c4 sleepq_wait_sig(246616a4,0) at sleepq_wait_sig+0x11/frame 0x2ddf59d8 _cv_wait_sig(246616a4,24661690) at _cv_wait_sig+0x138/frame 0x2ddf5a10 seltdwait(ffffffff,0,0) at seltdwait+0x8a/frame 0x2ddf5a2c kern_select(2e417a80,e,2047f270,2047f278,0,0,20) at kern_select+0x826/frame 0x2ddf5bac sys_select(2e417a80,2e417d0c,166aa5e,4,0,...) at sys_select+0x41/frame 0x2ddf5be4 syscallenter(2e417a80,2ddf5ce8,1,0,2ddf5e00,...) at syscallenter+0x4d8/frame 0x2ddf5c58 syscall(2ddf5ce8,3b,3b,3b,20bf7000,...) at syscall+0x84/frame 0x2ddf5cdc Xint0x80_syscall() at 0xffc033b7/frame 0x2ddf5cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x20982ebb, esp = 0xffbfa770, ebp = 0xffbfa794 --- __bss_end() at 0x20982ebb Tracing command sshd pid 930 tid 100113 td 0x23d7ea80 sched_switch(23d7ea80,0,104) at sched_switch+0x598/frame 0x2d107974 mi_switch(104,0) at mi_switch+0x1de/frame 0x2d1079a4 sleepq_switch(0,246617d0,8,23a7f354,1f138d4,...) at sleepq_switch+0xe1/frame 0x2d1079c8 sleepq_catch_signals(246617e4,23d7ea80,246617d0,2d107a40,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2d1079f4 sleepq_wait_sig(246617e4,0) at sleepq_wait_sig+0x11/frame 0x2d107a08 _cv_wait_sig(246617e4,246617d0) at _cv_wait_sig+0x138/frame 0x2d107a40 seltdwait(ffffffff,0,0) at seltdwait+0x8a/frame 0x2d107a5c kern_poll(23d7ea80,ffbfe800,1,0,0) at kern_poll+0x466/frame 0x2d107bb4 sys_poll(23d7ea80,23d7ed0c,166aa5e,4,0,...) at sys_poll+0x50/frame 0x2d107be4 syscallenter(23d7ea80,c,0,0,2d107e00,...) at syscallenter+0x4d8/frame 0x2d107c58 syscall(2d107ce8,3b,3b,3b,20bf7000,...) at syscall+0x84/frame 0x2d107cdc Xint0x80_syscall() at 0xffc033b7/frame 0x2d107cdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2092d087, esp = 0xffbfe7b0, ebp = 0xffbfe7cc --- __bss_end() at 0x2092d087 Tracing command getty pid 785 tid 100196 td 0x2e415700 sched_switch(2e415700,0,104) at sched_switch+0x598/frame 0x2e65f9dc mi_switch(104,0) at mi_switch+0x1de/frame 0x2e65fa0c sleepq_switch(0,23d5f404,8,2e4676a8,1f11c14,...) at sleepq_switch+0xe1/frame 0x2e65fa30 sleepq_catch_signals(23d5f474,2e415700,23d5f404,2e65faa8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2e65fa5c sleepq_wait_sig(23d5f474,0) at sleepq_wait_sig+0x11/frame 0x2e65fa70 _cv_wait_sig(23d5f474,23d5f404) at _cv_wait_sig+0x138/frame 0x2e65faa8 tty_wait(23d5f400,23d5f474) at tty_wait+0x35/frame 0x2e65fac0 ttydisc_read(23d5f400,2e65fbb8,0) at ttydisc_read+0x1b9/frame 0x2e65faf4 ttydev_read(216c4400,2e65fbb8,0) at ttydev_read+0x3d/frame 0x2e65fb10 devfs_read_f(249e25e8,2e65fbb8,216bad00,0,2e415700) at devfs_read_f+0xaa/frame 0x2e65fb40 dofileread(249e25e8,2e65fbb8,ffffffff,ffffffff,0) at dofileread+0x6d/frame 0x2e65fb70 kern_readv(2e415700,0,2e65fbb8) at kern_readv+0x3b/frame 0x2e65fb9c sys_read(2e415700,2e41598c,166aa5e,4,0,...) at sys_read+0x48/frame 0x2e65fbe4 syscallenter(2e415700,2e65fce8,1,0,2e65fe00,...) at syscallenter+0x4d8/frame 0x2e65fc58 syscall(2e65fce8,3b,3b,3b,0,...) at syscall+0x84/frame 0x2e65fcdc Xint0x80_syscall() at 0xffc033b7/frame 0x2e65fcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x205d3ecb, esp = 0xffbfed44, ebp = 0xffbfed58 --- __bss_end() at 0x205d3ecb Tracing command getty pid 784 tid 100195 td 0x2e415a80 sched_switch(2e415a80,0,104) at sched_switch+0x598/frame 0x2e65a9dc mi_switch(104,0) at mi_switch+0x1de/frame 0x2e65aa0c sleepq_switch(0,11bac004,8,2e4679fc,1f12914,...) at sleepq_switch+0xe1/frame 0x2e65aa30 sleepq_catch_signals(11bac074,2e415a80,11bac004,2e65aaa8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2e65aa5c sleepq_wait_sig(11bac074,0) at sleepq_wait_sig+0x11/frame 0x2e65aa70 _cv_wait_sig(11bac074,11bac004) at _cv_wait_sig+0x138/frame 0x2e65aaa8 tty_wait(11bac000,11bac074) at tty_wait+0x35/frame 0x2e65aac0 ttydisc_read(11bac000,2e65abb8,0) at ttydisc_read+0x1b9/frame 0x2e65aaf4 ttydev_read(24746400,2e65abb8,0) at ttydev_read+0x3d/frame 0x2e65ab10 devfs_read_f(2d216d58,2e65abb8,11f97500,0,2e415a80) at devfs_read_f+0xaa/frame 0x2e65ab40 dofileread(2d216d58,2e65abb8,ffffffff,ffffffff,0) at dofileread+0x6d/frame 0x2e65ab70 kern_readv(2e415a80,0,2e65abb8) at kern_readv+0x3b/frame 0x2e65ab9c sys_read(2e415a80,2e415d0c,166aa5e,4,0,...) at sys_read+0x48/frame 0x2e65abe4 syscallenter(2e415a80,c,0,0,2e65ae00,...) at syscallenter+0x4d8/frame 0x2e65ac58 syscall(2e65ace8,3b,3b,3b,0,...) at syscall+0x84/frame 0x2e65acdc Xint0x80_syscall() at 0xffc033b7/frame 0x2e65acdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x205d3ecb, esp = 0xffbfed44, ebp = 0xffbfed58 --- __bss_end() at 0x205d3ecb Tracing command getty pid 783 tid 100194 td 0x2e416000 sched_switch(2e416000,0,104) at sched_switch+0x598/frame 0x2e6559dc mi_switch(104,0) at mi_switch+0x1de/frame 0x2e655a0c sleepq_switch(0,11bac404,8,2e468000,1f12814,...) at sleepq_switch+0xe1/frame 0x2e655a30 sleepq_catch_signals(11bac474,2e416000,11bac404,2e655aa8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2e655a5c sleepq_wait_sig(11bac474,0) at sleepq_wait_sig+0x11/frame 0x2e655a70 _cv_wait_sig(11bac474,11bac404) at _cv_wait_sig+0x138/frame 0x2e655aa8 tty_wait(11bac400,11bac474) at tty_wait+0x35/frame 0x2e655ac0 ttydisc_read(11bac400,2e655bb8,0) at ttydisc_read+0x1b9/frame 0x2e655af4 ttydev_read(24746600,2e655bb8,0) at ttydev_read+0x3d/frame 0x2e655b10 devfs_read_f(249e2700,2e655bb8,216bac00,0,2e416000) at devfs_read_f+0xaa/frame 0x2e655b40 dofileread(249e2700,2e655bb8,ffffffff,ffffffff,0) at dofileread+0x6d/frame 0x2e655b70 kern_readv(2e416000,0,2e655bb8) at kern_readv+0x3b/frame 0x2e655b9c sys_read(2e416000,2e41628c,166aa5e,4,0,...) at sys_read+0x48/frame 0x2e655be4 syscallenter(2e416000,2e655ca0,102e134,2,2e655e00,...) at syscallenter+0x4d8/frame 0x2e655c58 syscall(2e655ce8,3b,3b,3b,0,...) at syscall+0x84/frame 0x2e655cdc Xint0x80_syscall() at 0xffc033b7/frame 0x2e655cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x205d3ecb, esp = 0xffbfed44, ebp = 0xffbfed58 --- __bss_end() at 0x205d3ecb Tracing command getty pid 782 tid 100193 td 0x2e416380 sched_switch(2e416380,0,104) at sched_switch+0x598/frame 0x2e6509dc mi_switch(104,0) at mi_switch+0x1de/frame 0x2e650a0c sleepq_switch(0,11bac804,8,2e468354,1f12b14,...) at sleepq_switch+0xe1/frame 0x2e650a30 sleepq_catch_signals(11bac874,2e416380,11bac804,2e650aa8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2e650a5c sleepq_wait_sig(11bac874,0) at sleepq_wait_sig+0x11/frame 0x2e650a70 _cv_wait_sig(11bac874,11bac804) at _cv_wait_sig+0x138/frame 0x2e650aa8 tty_wait(11bac800,11bac874) at tty_wait+0x35/frame 0x2e650ac0 ttydisc_read(11bac800,2e650bb8,0) at ttydisc_read+0x1b9/frame 0x2e650af4 ttydev_read(24746800,2e650bb8,0) at ttydev_read+0x3d/frame 0x2e650b10 devfs_read_f(2499fb98,2e650bb8,11f97600,0,2e416380) at devfs_read_f+0xaa/frame 0x2e650b40 dofileread(2499fb98,2e650bb8,ffffffff,ffffffff,0) at dofileread+0x6d/frame 0x2e650b70 kern_readv(2e416380,0,2e650bb8) at kern_readv+0x3b/frame 0x2e650b9c sys_read(2e416380,2e41660c,166aa5e,4,0,...) at sys_read+0x48/frame 0x2e650be4 syscallenter(2e416380,2e650ce8,1,0,2e650e00,...) at syscallenter+0x4d8/frame 0x2e650c58 syscall(2e650ce8,3b,3b,3b,0,...) at syscall+0x84/frame 0x2e650cdc Xint0x80_syscall() at 0xffc033b7/frame 0x2e650cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x205d3ecb, esp = 0xffbfed44, ebp = 0xffbfed58 --- __bss_end() at 0x205d3ecb Tracing command getty pid 781 tid 100192 td 0x2e416700 sched_switch(2e416700,0,104) at sched_switch+0x598/frame 0x2e64b9dc mi_switch(104,0) at mi_switch+0x1de/frame 0x2e64ba0c sleepq_switch(0,11bacc04,8,2e4686a8,1f12a14,...) at sleepq_switch+0xe1/frame 0x2e64ba30 sleepq_catch_signals(11bacc74,2e416700,11bacc04,2e64baa8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2e64ba5c sleepq_wait_sig(11bacc74,0) at sleepq_wait_sig+0x11/frame 0x2e64ba70 _cv_wait_sig(11bacc74,11bacc04) at _cv_wait_sig+0x138/frame 0x2e64baa8 tty_wait(11bacc00,11bacc74) at tty_wait+0x35/frame 0x2e64bac0 ttydisc_read(11bacc00,2e64bbb8,0) at ttydisc_read+0x1b9/frame 0x2e64baf4 ttydev_read(24746a00,2e64bbb8,0) at ttydev_read+0x3d/frame 0x2e64bb10 devfs_read_f(249cec08,2e64bbb8,24424d00,0,2e416700) at devfs_read_f+0xaa/frame 0x2e64bb40 dofileread(249cec08,2e64bbb8,ffffffff,ffffffff,0) at dofileread+0x6d/frame 0x2e64bb70 kern_readv(2e416700,0,2e64bbb8) at kern_readv+0x3b/frame 0x2e64bb9c sys_read(2e416700,2e41698c,166aa5e,4,0,...) at sys_read+0x48/frame 0x2e64bbe4 syscallenter(2e416700,2e64bca0,102e134,2,2e64be00,...) at syscallenter+0x4d8/frame 0x2e64bc58 syscall(2e64bce8,3b,3b,3b,0,...) at syscall+0x84/frame 0x2e64bcdc Xint0x80_syscall() at 0xffc033b7/frame 0x2e64bcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x205d3ecb, esp = 0xffbfed44, ebp = 0xffbfed58 --- __bss_end() at 0x205d3ecb Tracing command getty pid 780 tid 100191 td 0x2e416a80 sched_switch(2e416a80,0,104) at sched_switch+0x598/frame 0x2e6469dc mi_switch(104,0) at mi_switch+0x1de/frame 0x2e646a0c sleepq_switch(0,11bad004,8,2e4689fc,1f12514,...) at sleepq_switch+0xe1/frame 0x2e646a30 sleepq_catch_signals(11bad074,2e416a80,11bad004,2e646aa8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2e646a5c sleepq_wait_sig(11bad074,0) at sleepq_wait_sig+0x11/frame 0x2e646a70 _cv_wait_sig(11bad074,11bad004) at _cv_wait_sig+0x138/frame 0x2e646aa8 tty_wait(11bad000,11bad074) at tty_wait+0x35/frame 0x2e646ac0 ttydisc_read(11bad000,2e646bb8,0) at ttydisc_read+0x1b9/frame 0x2e646af4 ttydev_read(11b79400,2e646bb8,0) at ttydev_read+0x3d/frame 0x2e646b10 devfs_read_f(2d216b98,2e646bb8,11f97a00,0,2e416a80) at devfs_read_f+0xaa/frame 0x2e646b40 dofileread(2d216b98,2e646bb8,ffffffff,ffffffff,0) at dofileread+0x6d/frame 0x2e646b70 kern_readv(2e416a80,0,2e646bb8) at kern_readv+0x3b/frame 0x2e646b9c sys_read(2e416a80,2e416d0c,166aa5e,4,0,...) at sys_read+0x48/frame 0x2e646be4 syscallenter(2e416a80,c,0,0,2e646e00,...) at syscallenter+0x4d8/frame 0x2e646c58 syscall(2e646ce8,3b,3b,3b,0,...) at syscall+0x84/frame 0x2e646cdc Xint0x80_syscall() at 0xffc033b7/frame 0x2e646cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x205d3ecb, esp = 0xffbfed44, ebp = 0xffbfed58 --- __bss_end() at 0x205d3ecb Tracing command getty pid 779 tid 100189 td 0x2e417380 sched_switch(2e417380,0,104) at sched_switch+0x598/frame 0x2e63c9dc mi_switch(104,0) at mi_switch+0x1de/frame 0x2e63ca0c sleepq_switch(0,11bad404,8,2e469354,1f12414,...) at sleepq_switch+0xe1/frame 0x2e63ca30 sleepq_catch_signals(11bad474,2e417380,11bad404,2e63caa8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2e63ca5c sleepq_wait_sig(11bad474,0) at sleepq_wait_sig+0x11/frame 0x2e63ca70 _cv_wait_sig(11bad474,11bad404) at _cv_wait_sig+0x138/frame 0x2e63caa8 tty_wait(11bad400,11bad474) at tty_wait+0x35/frame 0x2e63cac0 ttydisc_read(11bad400,2e63cbb8,0) at ttydisc_read+0x1b9/frame 0x2e63caf4 ttydev_read(11b79600,2e63cbb8,0) at ttydev_read+0x3d/frame 0x2e63cb10 devfs_read_f(2d216af0,2e63cbb8,216bab00,0,2e417380) at devfs_read_f+0xaa/frame 0x2e63cb40 dofileread(2d216af0,2e63cbb8,ffffffff,ffffffff,0) at dofileread+0x6d/frame 0x2e63cb70 kern_readv(2e417380,0,2e63cbb8) at kern_readv+0x3b/frame 0x2e63cb9c sys_read(2e417380,2e41760c,166aa5e,4,0,...) at sys_read+0x48/frame 0x2e63cbe4 syscallenter(2e417380,c,0,0,2e63ce00,...) at syscallenter+0x4d8/frame 0x2e63cc58 syscall(2e63cce8,3b,3b,3b,0,...) at syscall+0x84/frame 0x2e63ccdc Xint0x80_syscall() at 0xffc033b7/frame 0x2e63ccdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x205d3ecb, esp = 0xffbfed44, ebp = 0xffbfed58 --- __bss_end() at 0x205d3ecb Tracing command getty pid 778 tid 100190 td 0x2e417000 sched_switch(2e417000,0,104) at sched_switch+0x598/frame 0x2e6419dc mi_switch(104,0) at mi_switch+0x1de/frame 0x2e641a0c sleepq_switch(0,11bad804,8,2e469000,1f12714,...) at sleepq_switch+0xe1/frame 0x2e641a30 sleepq_catch_signals(11bad874,2e417000,11bad804,2e641aa8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2e641a5c sleepq_wait_sig(11bad874,0) at sleepq_wait_sig+0x11/frame 0x2e641a70 _cv_wait_sig(11bad874,11bad804) at _cv_wait_sig+0x138/frame 0x2e641aa8 tty_wait(11bad800,11bad874) at tty_wait+0x35/frame 0x2e641ac0 ttydisc_read(11bad800,2e641bb8,0) at ttydisc_read+0x1b9/frame 0x2e641af4 ttydev_read(11b79800,2e641bb8,0) at ttydev_read+0x3d/frame 0x2e641b10 devfs_read_f(249cf1c0,2e641bb8,24424b00,0,2e417000) at devfs_read_f+0xaa/frame 0x2e641b40 dofileread(249cf1c0,2e641bb8,ffffffff,ffffffff,0) at dofileread+0x6d/frame 0x2e641b70 kern_readv(2e417000,0,2e641bb8) at kern_readv+0x3b/frame 0x2e641b9c sys_read(2e417000,2e41728c,166aa5e,4,0,...) at sys_read+0x48/frame 0x2e641be4 syscallenter(2e417000,c,0,0,2e641e00,...) at syscallenter+0x4d8/frame 0x2e641c58 syscall(2e641ce8,3b,3b,3b,0,...) at syscall+0x84/frame 0x2e641cdc Xint0x80_syscall() at 0xffc033b7/frame 0x2e641cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x205d3ecb, esp = 0xffbfed44, ebp = 0xffbfed58 --- __bss_end() at 0x205d3ecb Tracing command getty pid 777 tid 100105 td 0x243d1380 sched_switch(243d1380,0,104) at sched_switch+0x598/frame 0x287ea9dc mi_switch(104,0) at mi_switch+0x1de/frame 0x287eaa0c sleepq_switch(0,11badc04,8,243cb000,1f12614,...) at sleepq_switch+0xe1/frame 0x287eaa30 sleepq_catch_signals(11badc74,243d1380,11badc04,287eaaa8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x287eaa5c sleepq_wait_sig(11badc74,0) at sleepq_wait_sig+0x11/frame 0x287eaa70 _cv_wait_sig(11badc74,11badc04) at _cv_wait_sig+0x138/frame 0x287eaaa8 tty_wait(11badc00,11badc74) at tty_wait+0x35/frame 0x287eaac0 ttydisc_read(11badc00,287eabb8,0) at ttydisc_read+0x1b9/frame 0x287eaaf4 ttydev_read(11b79a00,287eabb8,0) at ttydev_read+0x3d/frame 0x287eab10 devfs_read_f(2d216b28,287eabb8,11f97b00,0,243d1380) at devfs_read_f+0xaa/frame 0x287eab40 dofileread(2d216b28,287eabb8,ffffffff,ffffffff,0) at dofileread+0x6d/frame 0x287eab70 kern_readv(243d1380,0,287eabb8) at kern_readv+0x3b/frame 0x287eab9c sys_read(243d1380,243d160c,166aa5e,4,0,...) at sys_read+0x48/frame 0x287eabe4 syscallenter(243d1380,c,0,0,287eae00,...) at syscallenter+0x4d8/frame 0x287eac58 syscall(287eace8,3b,3b,3b,0,...) at syscall+0x84/frame 0x287eacdc Xint0x80_syscall() at 0xffc033b7/frame 0x287eacdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x205d3ecb, esp = 0xffbfed44, ebp = 0xffbfed58 --- __bss_end() at 0x205d3ecb Tracing command inetd pid 760 tid 100181 td 0x2e081a80 sched_switch(2e081a80,0,104) at sched_switch+0x598/frame 0x2e604944 mi_switch(104,0) at mi_switch+0x1de/frame 0x2e604974 sleepq_switch(0,23eac990,8,24862354,1f11754,...) at sleepq_switch+0xe1/frame 0x2e604998 sleepq_catch_signals(23eac9a4,2e081a80,23eac990,2e604a10,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2e6049c4 sleepq_wait_sig(23eac9a4,0) at sleepq_wait_sig+0x11/frame 0x2e6049d8 _cv_wait_sig(23eac9a4,23eac990) at _cv_wait_sig+0x138/frame 0x2e604a10 seltdwait(ffffffff,0,0) at seltdwait+0x8a/frame 0x2e604a2c kern_select(2e081a80,9,ffbfe5b8,0,0,0,20) at kern_select+0x826/frame 0x2e604bac sys_select(2e081a80,2e081d0c,166aa5e,4,0,...) at sys_select+0x41/frame 0x2e604be4 syscallenter(2e081a80,c,0,0,2e604e00,...) at syscallenter+0x4d8/frame 0x2e604c58 syscall(2e604ce8,3b,3b,3b,ffbfe638,...) at syscall+0x84/frame 0x2e604cdc Xint0x80_syscall() at 0xffc033b7/frame 0x2e604cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x205ecebb, esp = 0xffbfdff0, ebp = 0xffbfe00c --- __bss_end() at 0x205ecebb Tracing command nfscbd pid 726 tid 100176 td 0x2e082000 sched_switch(2e082000,0,104) at sched_switch+0x598/frame 0x2ddda874 mi_switch(104,0) at mi_switch+0x1de/frame 0x2ddda8a8 sleepq_switch(0,1c15538,1f3e770,248626a8,1f13954,...) at sleepq_switch+0xe1/frame 0x2ddda8cc sleepq_catch_signals(cb,2e082000,1c15538,2e082000,2ddda92c,...) at sleepq_catch_signals+0x3b7/frame 0x2ddda8f8 sleepq_timedwait_sig(239d25d0,0) at sleepq_timedwait_sig+0x17/frame 0x2ddda928 _cv_timedwait_sig_sbt(239d25d0,23dd70c0,fffffa38,4,0,0,100) at _cv_timedwait_sig_sbt+0x15a/frame 0x2ddda964 svc_run_internal(2e41e000,23dd70c0,23dd70d0,23dd711c,0,...) at svc_run_internal+0xa90/frame 0x2dddaa40 svc_run(23dd7000) at svc_run+0x1a6/frame 0x2dddaa70 nfscbd_nfsd(2e082000,2dddab28) at nfscbd_nfsd+0xd0/frame 0x2dddab00 nfssvc_nfscl(2e082000,2e08228c) at nfssvc_nfscl+0x1d6/frame 0x2dddabcc sys_nfssvc(2e082000,2e08228c,166aa5e,4,0,...) at sys_nfssvc+0x92/frame 0x2dddabe4 syscallenter(2e082000,c,0,0,2dddae00,...) at syscallenter+0x4d8/frame 0x2dddac58 syscall(2dddace8,3b,3b,3b,1,...) at syscall+0x84/frame 0x2dddacdc Xint0x80_syscall() at 0xffc033b7/frame 0x2dddacdc --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x2049123f, esp = 0xffbfeb0c, ebp = 0xffbfee1c --- __bss_end() at 0x2049123f Tracing command nfscbd pid 726 tid 100185 td 0x2e41e700 sched_switch(2e41e700,0,104) at sched_switch+0x598/frame 0x2e618adc mi_switch(104,0) at mi_switch+0x1de/frame 0x2e618b0c sleepq_switch(0,23dd70c0,8,248626a8,1f11954,...) at sleepq_switch+0xe1/frame 0x2e618b30 sleepq_catch_signals(239d2550,2e41e700,23dd70c0,2e618ba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2e618b5c sleepq_wait_sig(239d2550,0) at sleepq_wait_sig+0x11/frame 0x2e618b70 _cv_wait_sig(239d2550,23dd70c0) at _cv_wait_sig+0x138/frame 0x2e618ba8 svc_run_internal(2e618cd4,f9744f,23dd70c0,2e618ce8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2e618c70 svc_thread_start(23dd70c0,2e618ce8,163a3df,419,0,...) at svc_thread_start+0xd/frame 0x2e618c78 fork_exit(1258110,23dd70c0,2e618ce8,3b,3b,...) at fork_exit+0x12f/frame 0x2e618cd4 fork_trampoline() at 0xffc033ca/frame 0x2e618cd4 --- trap 0, eip = 0, esp = 0x2e618d20, ebp = 0x1 --- (null)() at 0 Tracing command nfscbd pid 726 tid 100186 td 0x2e41e380 sched_switch(2e41e380,0,104) at sched_switch+0x598/frame 0x2e61dadc mi_switch(104,0) at mi_switch+0x1de/frame 0x2e61db0c sleepq_switch(0,23dd70c0,8,248626a8,1f13914,...) at sleepq_switch+0xe1/frame 0x2e61db30 sleepq_catch_signals(239d24d0,2e41e380,23dd70c0,2e61dba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2e61db5c sleepq_wait_sig(239d24d0,0) at sleepq_wait_sig+0x11/frame 0x2e61db70 _cv_wait_sig(239d24d0,23dd70c0) at _cv_wait_sig+0x138/frame 0x2e61dba8 svc_run_internal(2e61dcd4,f9744f,23dd70c0,2e61dce8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2e61dc70 svc_thread_start(23dd70c0,2e61dce8,163a3df,419,0,...) at svc_thread_start+0xd/frame 0x2e61dc78 fork_exit(1258110,23dd70c0,2e61dce8,3b,3b,...) at fork_exit+0x12f/frame 0x2e61dcd4 fork_trampoline() at 0xffc033ca/frame 0x2e61dcd4 --- trap 0, eip = 0, esp = 0x2e61dd20, ebp = 0x1 --- (null)() at 0 Tracing command nfscbd pid 726 tid 100187 td 0x2e41e000 sched_switch(2e41e000,0,104) at sched_switch+0x598/frame 0x2e622adc mi_switch(104,0) at mi_switch+0x1de/frame 0x2e622b0c sleepq_switch(0,23dd70c0,8,248626a8,1f11914,...) at sleepq_switch+0xe1/frame 0x2e622b30 sleepq_catch_signals(239d2450,2e41e000,23dd70c0,2e622ba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2e622b5c sleepq_wait_sig(239d2450,0) at sleepq_wait_sig+0x11/frame 0x2e622b70 _cv_wait_sig(239d2450,23dd70c0) at _cv_wait_sig+0x138/frame 0x2e622ba8 svc_run_internal(2e622cd4,f9744f,23dd70c0,2e622ce8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2e622c70 svc_thread_start(23dd70c0,2e622ce8,163a3df,419,0,...) at svc_thread_start+0xd/frame 0x2e622c78 fork_exit(1258110,23dd70c0,2e622ce8,3b,3b,...) at fork_exit+0x12f/frame 0x2e622cd4 fork_trampoline() at 0xffc033ca/frame 0x2e622cd4 --- trap 0, eip = 0, esp = 0x2e622d20, ebp = 0x1 --- (null)() at 0 Tracing command nfscbd pid 725 tid 100184 td 0x2e41ea80 sched_switch(2e41ea80,0,104) at sched_switch+0x598/frame 0x2e613a1c mi_switch(104,0) at mi_switch+0x1de/frame 0x2e613a50 sleepq_switch(68,2e613aa8,1027aa7,2e12e9fc,1f13294,...) at sleepq_switch+0xe1/frame 0x2e613a74 sleepq_catch_signals(2e41ea80,0,2d912af0,2e613af4,fe182e,...) at sleepq_catch_signals+0x3b7/frame 0x2e613aa0 sleepq_wait_sig(2d912af0,68) at sleepq_wait_sig+0x11/frame 0x2e613ab4 _sleep(2d912af0,2d912a28,168,15efd5f,0,...) at _sleep+0x28e/frame 0x2e613af4 solisten_dequeue(2d912a28,2e613b54,1) at solisten_dequeue+0x77/frame 0x2e613b34 kern_accept4(2e41ea80,3,2e613bb4,2e613bb8,1,2e613bbc) at kern_accept4+0x17a/frame 0x2e613b94 accept1(ffbfeb78,ffbfeb24,1) at accept1+0x4c/frame 0x2e613bd0 sys_accept(2e41ea80,2e41ed0c,166aa5e,4,0,...) at sys_accept+0x18/frame 0x2e613be4 syscallenter(2e41ea80,c,0,0,2e613e00,...) at syscallenter+0x4d8/frame 0x2e613c58 syscall(2e613ce8,3b,3b,3b,ffbfec08,...) at syscall+0x84/frame 0x2e613cdc Xint0x80_syscall() at 0xffc033b7/frame 0x2e613cdc --- syscall (30, FreeBSD ELF32, sys_accept), eip = 0x20555683, esp = 0xffbfeaf0, ebp = 0xffbfeb04 --- __bss_end() at 0x20555683 Tracing command cron pid 689 tid 100175 td 0x243e9700 sched_switch(243e9700,0,104) at sched_switch+0x598/frame 0x2ddc5a44 mi_switch(104,0) at mi_switch+0x1de/frame 0x2ddc5a78 sleepq_switch(6c,bfe5f5a2,3,2d22a6a8,1f128d4,...) at sleepq_switch+0xe1/frame 0x2ddc5a9c sleepq_catch_signals(1,177,243e9700,100,1ef46f5,...) at sleepq_catch_signals+0x3b7/frame 0x2ddc5ac8 sleepq_timedwait_sig(1ef46f5,6c,0,0,34e9c3f0,...) at sleepq_timedwait_sig+0x17/frame 0x2ddc5af4 _sleep(1ef46f5,0,16c,1690818,17e989bc,7a5,bfe5f5a2,3,200) at _sleep+0x22c/frame 0x2ddc5b34 kern_clock_nanosleep(243e9700,0,0,2ddc5bc8,2ddc5bc0) at kern_clock_nanosleep+0x1ba/frame 0x2ddc5ba4 sys_nanosleep(243e9700,243e998c,166aa5e,4,0,...) at sys_nanosleep+0x55/frame 0x2ddc5be4 syscallenter(243e9700,c,0,0,2ddc5e00,...) at syscallenter+0x4d8/frame 0x2ddc5c58 syscall(2ddc5ce8,3b,3b,3b,ffbfed40,...) at syscall+0x84/frame 0x2ddc5cdc Xint0x80_syscall() at 0xffc033b7/frame 0x2ddc5cdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2057d613, esp = 0xffbfeca8, ebp = 0xffbfecb8 --- __bss_end() at 0x2057d613 Tracing command sendmail pid 685 tid 100122 td 0x2d5c1380 sched_switch(2d5c1380,0,104) at sched_switch+0x598/frame 0x2d150a94 mi_switch(104,0) at mi_switch+0x1de/frame 0x2d150ac8 sleepq_switch(74,2d150b20,1027aa7,23a7a6a8,1f126d4,...) at sleepq_switch+0xe1/frame 0x2d150aec sleepq_catch_signals(2d5c1380,0,23a7a70c,2d150b6c,fe182e,...) at sleepq_catch_signals+0x3b7/frame 0x2d150b18 sleepq_wait_sig(23a7a70c,74) at sleepq_wait_sig+0x11/frame 0x2d150b2c _sleep(23a7a70c,23a7a750,174,15e1ecb,0,0,0,0,100) at _sleep+0x28e/frame 0x2d150b6c kern_sigsuspend(2d5c1380,0,0,0,0) at kern_sigsuspend+0x8e/frame 0x2d150bac sys_sigsuspend(2d5c1380,2d5c160c,166aa5e,4,0,...) at sys_sigsuspend+0x3b/frame 0x2d150be4 syscallenter(2d5c1380,16,0,0,2d150e00,...) at syscallenter+0x4d8/frame 0x2d150c58 syscall(2d150ce8,3b,3b,3b,2096d000,...) at syscall+0x84/frame 0x2d150cdc Xint0x80_syscall() at 0xffc033b7/frame 0x2d150cdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2089e593, esp = 0xffbfda50, ebp = 0xffbfda7c --- __bss_end() at 0x2089e593 Tracing command sendmail pid 682 tid 100167 td 0x2d5bfa80 sched_switch(2d5bfa80,0,104) at sched_switch+0x598/frame 0x2dd5590c mi_switch(104,0) at mi_switch+0x1de/frame 0x2dd55940 sleepq_switch(0,1c15538,1f3e820,2e130354,1f12794,...) at sleepq_switch+0xe1/frame 0x2dd55964 sleepq_catch_signals(cb,2d5bfa80,1c15538,2d5bfa80,2dd559c4,...) at sleepq_catch_signals+0x3b7/frame 0x2dd55990 sleepq_timedwait_sig(23eaca64,0) at sleepq_timedwait_sig+0x17/frame 0x2dd559c0 _cv_timedwait_sig_sbt(23eaca64,23eaca50,36b9600c,792,50000000,0,200) at _cv_timedwait_sig_sbt+0x15a/frame 0x2dd559fc seltdwait(792,50000000,0) at seltdwait+0x5e/frame 0x2dd55a2c kern_select(2d5bfa80,5,ffbfd180,0,0,2dd55bd0,20) at kern_select+0x826/frame 0x2dd55bac sys_select(2d5bfa80,2d5bfd0c,166aa5e,4,0,...) at sys_select+0x41/frame 0x2dd55be4 syscallenter(2d5bfa80,2dd55ce8,1,0,2dd55e00,...) at syscallenter+0x4d8/frame 0x2dd55c58 syscall(2dd55ce8,3b,3b,3b,2096d000,...) at syscall+0x84/frame 0x2dd55cdc Xint0x80_syscall() at 0xffc033b7/frame 0x2dd55cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x20904ebb, esp = 0xffbfd080, ebp = 0xffbfd0a4 --- __bss_end() at 0x20904ebb Tracing command sshd pid 679 tid 100173 td 0x2d236000 sched_switch(2d236000,0,104) at sched_switch+0x598/frame 0x2ddb7944 mi_switch(104,0) at mi_switch+0x1de/frame 0x2ddb7974 sleepq_switch(0,216a2890,8,2d22a9fc,1f11f14,...) at sleepq_switch+0xe1/frame 0x2ddb7998 sleepq_catch_signals(216a28a4,2d236000,216a2890,2ddb7a10,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2ddb79c4 sleepq_wait_sig(216a28a4,0) at sleepq_wait_sig+0x11/frame 0x2ddb79d8 _cv_wait_sig(216a28a4,216a2890) at _cv_wait_sig+0x138/frame 0x2ddb7a10 seltdwait(ffffffff,0,0) at seltdwait+0x8a/frame 0x2ddb7a2c kern_select(2d236000,7,2047f180,0,0,0,20) at kern_select+0x826/frame 0x2ddb7bac sys_select(2d236000,2d23628c,166aa5e,4,0,...) at sys_select+0x41/frame 0x2ddb7be4 syscallenter(2d236000,c,0,0,2d22a9fc,...) at syscallenter+0x4d8/frame 0x2ddb7c58 syscall(2ddb7ce8,3b,3b,3b,20bf7000,...) at syscall+0x84/frame 0x2ddb7cdc Xint0x80_syscall() at 0xffc033b7/frame 0x2ddb7cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x20982ebb, esp = 0xffbfe7f8, ebp = 0xffbfe81c --- __bss_end() at 0x20982ebb Tracing command smartd pid 639 tid 100170 td 0x2d5bf380 sched_switch(2d5bf380,0,104) at sched_switch+0x598/frame 0x2dd6ca44 mi_switch(104,0) at mi_switch+0x1de/frame 0x2dd6ca78 sleepq_switch(6c,80000000,70,2e12f9fc,1f12894,...) at sleepq_switch+0xe1/frame 0x2dd6ca9c sleepq_catch_signals(0,177,2d5bf380,100,1ef46f4,...) at sleepq_catch_signals+0x3b7/frame 0x2dd6cac8 sleepq_timedwait_sig(1ef46f4,6c,1,1c15538,1f3e8d0,...) at sleepq_timedwait_sig+0x17/frame 0x2dd6caf4 _sleep(1ef46f4,0,16c,1690818,28ebf2ff,96d,80000000,70,200) at _sleep+0x22c/frame 0x2dd6cb34 kern_clock_nanosleep(2d5bf380,0,0,2dd6cbc8,2dd6cbc0) at kern_clock_nanosleep+0x1ba/frame 0x2dd6cba4 sys_nanosleep(2d5bf380,2d5bf60c,166aa5e,4,0,...) at sys_nanosleep+0x55/frame 0x2dd6cbe4 syscallenter(2d5bf380,c,0,0,2dd6ce00,...) at syscallenter+0x4d8/frame 0x2dd6cc58 syscall(2dd6cce8,3b,3b,3b,207e9000,...) at syscall+0x84/frame 0x2dd6ccdc Xint0x80_syscall() at 0xffc033b7/frame 0x2dd6ccdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2071a613, esp = 0xffbfbd90, ebp = 0xffbfbda8 --- __bss_end() at 0x2071a613 Tracing command powerd pid 615 tid 100171 td 0x2d236380 sched_switch(2d236380,0,104) at sched_switch+0x598/frame 0x2dd7190c mi_switch(104,0) at mi_switch+0x1de/frame 0x2dd71940 sleepq_switch(0,1c15538,1f3e980,2d22f000,1f10bd4,...) at sleepq_switch+0xe1/frame 0x2dd71964 sleepq_catch_signals(cb,2d236380,1c15538,2d236380,2dd719c4,...) at sleepq_catch_signals+0x3b7/frame 0x2dd71990 sleepq_timedwait_sig(24661b24,0) at sleepq_timedwait_sig+0x17/frame 0x2dd719c0 _cv_timedwait_sig_sbt(24661b24,24661b10,e863214d,790,4000000,0,200) at _cv_timedwait_sig_sbt+0x15a/frame 0x2dd719fc seltdwait(790,4000000,0) at seltdwait+0x5e/frame 0x2dd71a2c kern_select(2d236380,0,ffbfed88,0,ffbfed88,2dd71bd0,20) at kern_select+0x826/frame 0x2dd71bac sys_select(2d236380,2d23660c,166aa5e,4,0,...) at sys_select+0x41/frame 0x2dd71be4 syscallenter(2d236380,2dd71ce8,1,2d236380,2dd71e00,...) at syscallenter+0x4d8/frame 0x2dd71c58 syscall(2dd71ce8,3b,3b,3b,ffbfee08,...) at syscall+0x84/frame 0x2dd71cdc Xint0x80_syscall() at 0xffc033b7/frame 0x2dd71cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x205d1ebb, esp = 0xffbfecf8, ebp = 0xffbfed14 --- __bss_end() at 0x205d1ebb Tracing command ntpd pid 612 tid 100169 td 0x2d236700 sched_switch(2d236700,0,104) at sched_switch+0x598/frame 0x2dd5f944 mi_switch(104,0) at mi_switch+0x1de/frame 0x2dd5f974 sleepq_switch(0,24661810,8,2d22f354,1f10b14,...) at sleepq_switch+0xe1/frame 0x2dd5f998 sleepq_catch_signals(24661824,2d236700,24661810,2dd5fa10,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dd5f9c4 sleepq_wait_sig(24661824,0) at sleepq_wait_sig+0x11/frame 0x2dd5f9d8 _cv_wait_sig(24661824,24661810) at _cv_wait_sig+0x138/frame 0x2dd5fa10 seltdwait(ffffffff,0,0) at seltdwait+0x8a/frame 0x2dd5fa2c kern_select(2d236700,1b,ffbfe2d0,0,0,0,20) at kern_select+0x826/frame 0x2dd5fbac sys_select(2d236700,2d23698c,166aa5e,4,0,...) at sys_select+0x41/frame 0x2dd5fbe4 syscallenter(2d236700,16,0,0,2dd5fe00,...) at syscallenter+0x4d8/frame 0x2dd5fc58 syscall(2dd5fce8,3b,3b,3b,2091c000,...) at syscall+0x84/frame 0x2dd5fcdc Xint0x80_syscall() at 0xffc033b7/frame 0x2dd5fcdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x208dbebb, esp = 0xffbfe200, ebp = 0xffbfe224 --- __bss_end() at 0x208dbebb Tracing command rpc.lockd pid 576 tid 100133 td 0x2d236a80 sched_switch(2d236a80,0,104) at sched_switch+0x598/frame 0x2dcab8cc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dcab900 sleepq_switch(0,1c15538,1f3ea30,2d22f6a8,1f10e54,...) at sleepq_switch+0xe1/frame 0x2dcab924 sleepq_catch_signals(cb,2d236a80,1c15538,2d236a80,2dcab984,...) at sleepq_catch_signals+0x3b7/frame 0x2dcab950 sleepq_timedwait_sig(246599d0,0) at sleepq_timedwait_sig+0x17/frame 0x2dcab980 _cv_timedwait_sig_sbt(246599d0,249df0c0,fffffa38,4,0,0,100) at _cv_timedwait_sig_sbt+0x15a/frame 0x2dcab9bc svc_run_internal(4,249df000,2dcabbe4,123cb9d,24687020,...) at svc_run_internal+0xa90/frame 0x2dcaba94 svc_run(249df000) at svc_run+0x1a6/frame 0x2dcabac4 sys_nlm_syscall(2d236a80,2d236d0c,166aa5e,4,0,...) at sys_nlm_syscall+0x62d/frame 0x2dcabbe4 syscallenter(2d236a80,c,0,0,2dcabe00,...) at syscallenter+0x4d8/frame 0x2dcabc58 syscall(2dcabce8,3b,3b,3b,20a2e000,...) at syscall+0x84/frame 0x2dcabcdc Xint0x80_syscall() at 0xffc033b7/frame 0x2dcabcdc --- syscall (154, FreeBSD ELF32, sys_nlm_syscall), eip = 0x204a624f, esp = 0xffbfed74, ebp = 0xffbfee1c --- __bss_end() at 0x204a624f Tracing command rpc.statd pid 573 tid 100166 td 0x2d5c0000 sched_switch(2d5c0000,0,104) at sched_switch+0x598/frame 0x2dd5090c mi_switch(104,0) at mi_switch+0x1de/frame 0x2dd50940 sleepq_switch(0,1c15538,1f3ea88,11fcd354,1f11bd4,...) at sleepq_switch+0xe1/frame 0x2dd50964 sleepq_catch_signals(cb,2d5c0000,1c15538,2d5c0000,2dd509c4,...) at sleepq_catch_signals+0x3b7/frame 0x2dd50990 sleepq_timedwait_sig(24661b64,0) at sleepq_timedwait_sig+0x17/frame 0x2dd509c0 _cv_timedwait_sig_sbt(24661b64,24661b50,7e26187c,7a9,e0000000,1,200) at _cv_timedwait_sig_sbt+0x15a/frame 0x2dd509fc seltdwait(7a9,e0000000,1) at seltdwait+0x5e/frame 0x2dd50a2c kern_select(2d5c0000,8,ffbfecf8,0,0,2dd50bd0,20) at kern_select+0x826/frame 0x2dd50bac sys_select(2d5c0000,2d5c028c,166aa5e,4,0,...) at sys_select+0x41/frame 0x2dd50be4 syscallenter(2d5c0000,c,0,0,2dd50e00,...) at syscallenter+0x4d8/frame 0x2dd50c58 syscall(2dd50ce8,3b,3b,3b,ffbfecf8,...) at syscall+0x84/frame 0x2dd50cdc Xint0x80_syscall() at 0xffc033b7/frame 0x2dd50cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x205c8ebb, esp = 0xffbfec40, ebp = 0xffbfed90 --- __bss_end() at 0x205c8ebb Tracing command nfsd pid 572 tid 100123 td 0x11bb6000 sched_switch(11bb6000,0,104) at sched_switch+0x598/frame 0x2d169424 mi_switch(104,0) at mi_switch+0x1de/frame 0x2d169458 sleepq_switch(0,1c15538,1f3f5e0,24864354,1f0ff14,...) at sleepq_switch+0xe1/frame 0x2d16947c sleepq_catch_signals(cb,11bb6000,1c15538,11bb6000,2d1694dc,...) at sleepq_catch_signals+0x3b7/frame 0x2d1694a8 sleepq_timedwait_sig(11ad5c50,0) at sleepq_timedwait_sig+0x17/frame 0x2d1694d8 _cv_timedwait_sig_sbt(11ad5c50,243d60c0,fffffa38,4,0,0,100) at _cv_timedwait_sig_sbt+0x15a/frame 0x2d169514 svc_run_internal(2e082380,243d60c0,243d60d0,243d611c,0,...) at svc_run_internal+0xa90/frame 0x2d1695f0 svc_run(243d6000) at svc_run+0x1a6/frame 0x2d169620 nfsrvd_nfsd(11bb6000,2d1697b0) at nfsrvd_nfsd+0x2ec/frame 0x2d169750 nfssvc_nfsd(11bb6000,11bb628c) at nfssvc_nfsd+0x4f0/frame 0x2d169bcc sys_nfssvc(11bb6000,11bb628c,166aa5e,4,0,...) at sys_nfssvc+0x92/frame 0x2d169be4 syscallenter(11bb6000,c,0,0,2d169e00,...) at syscallenter+0x4d8/frame 0x2d169c58 syscall(2d169ce8,3b,3b,3b,ffbfebb0,...) at syscall+0x84/frame 0x2d169cdc Xint0x80_syscall() at 0xffc033b7/frame 0x2d169cdc --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x2049423f, esp = 0xffbfe84c, ebp = 0xffbfeaa4 --- __bss_end() at 0x2049423f Tracing command nfsd pid 572 tid 100135 td 0x2d958a80 sched_switch(2d958a80,0,104) at sched_switch+0x598/frame 0x2dcb5adc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dcb5b0c sleepq_switch(0,243d60c0,8,24864354,1f11994,...) at sleepq_switch+0xe1/frame 0x2dcb5b30 sleepq_catch_signals(239d2650,2d958a80,243d60c0,2dcb5ba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dcb5b5c sleepq_wait_sig(239d2650,0) at sleepq_wait_sig+0x11/frame 0x2dcb5b70 _cv_wait_sig(239d2650,243d60c0) at _cv_wait_sig+0x138/frame 0x2dcb5ba8 svc_run_internal(2dcb5cd4,f9744f,243d60c0,2dcb5ce8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2dcb5c70 svc_thread_start(243d60c0,2dcb5ce8,163a3df,419,0,...) at svc_thread_start+0xd/frame 0x2dcb5c78 fork_exit(1258110,243d60c0,2dcb5ce8,3b,3b,...) at fork_exit+0x12f/frame 0x2dcb5cd4 fork_trampoline() at 0xffc033ca/frame 0x2dcb5cd4 --- trap 0x20, eip = 0, esp = 0x2dcb5d20, ebp = 0xffbfebb0 --- (null)() at 0 Tracing command nfsd pid 572 tid 100136 td 0x2d958700 sched_switch(2d958700,0,104) at sched_switch+0x598/frame 0x2dcbaadc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dcbab0c sleepq_switch(0,243d60c0,8,24864354,1f13854,...) at sleepq_switch+0xe1/frame 0x2dcbab30 sleepq_catch_signals(2465a150,2d958700,243d60c0,2dcbaba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dcbab5c sleepq_wait_sig(2465a150,0) at sleepq_wait_sig+0x11/frame 0x2dcbab70 _cv_wait_sig(2465a150,243d60c0) at _cv_wait_sig+0x138/frame 0x2dcbaba8 svc_run_internal(2dcbacd4,f9744f,243d60c0,2dcbace8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2dcbac70 svc_thread_start(243d60c0,2dcbace8,163a3df,419,0,...) at svc_thread_start+0xd/frame 0x2dcbac78 fork_exit(1258110,243d60c0,2dcbace8,3b,3b,...) at fork_exit+0x12f/frame 0x2dcbacd4 fork_trampoline() at 0xffc033ca/frame 0x2dcbacd4 --- trap 0x20, eip = 0, esp = 0x2dcbad20, ebp = 0xffbfebb0 --- (null)() at 0 Tracing command nfsd pid 572 tid 100137 td 0x2d958380 sched_switch(2d958380,0,104) at sched_switch+0x598/frame 0x2dcbfadc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dcbfb0c sleepq_switch(0,243d60c0,8,24864354,1f11814,...) at sleepq_switch+0xe1/frame 0x2dcbfb30 sleepq_catch_signals(2465a0d0,2d958380,243d60c0,2dcbfba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dcbfb5c sleepq_wait_sig(2465a0d0,0) at sleepq_wait_sig+0x11/frame 0x2dcbfb70 _cv_wait_sig(2465a0d0,243d60c0) at _cv_wait_sig+0x138/frame 0x2dcbfba8 svc_run_internal(2dcbfcd4,f9744f,243d60c0,2dcbfce8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2dcbfc70 svc_thread_start(243d60c0,2dcbfce8,163a3df,419,0,...) at svc_thread_start+0xd/frame 0x2dcbfc78 fork_exit(1258110,243d60c0,2dcbfce8,3b,3b,...) at fork_exit+0x12f/frame 0x2dcbfcd4 fork_trampoline() at 0xffc033ca/frame 0x2dcbfcd4 --- trap 0x20, eip = 0, esp = 0x2dcbfd20, ebp = 0xffbfebb0 --- (null)() at 0 Tracing command nfsd pid 572 tid 100138 td 0x2d958000 sched_switch(2d958000,0,104) at sched_switch+0x598/frame 0x2dcc4adc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dcc4b0c sleepq_switch(0,243d60c0,8,24864354,1f13814,...) at sleepq_switch+0xe1/frame 0x2dcc4b30 sleepq_catch_signals(2465a050,2d958000,243d60c0,2dcc4ba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dcc4b5c sleepq_wait_sig(2465a050,0) at sleepq_wait_sig+0x11/frame 0x2dcc4b70 _cv_wait_sig(2465a050,243d60c0) at _cv_wait_sig+0x138/frame 0x2dcc4ba8 svc_run_internal(2dcc4cd4,f9744f,243d60c0,2dcc4ce8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2dcc4c70 svc_thread_start(243d60c0,2dcc4ce8,163a3df,419,0,...) at svc_thread_start+0xd/frame 0x2dcc4c78 fork_exit(1258110,243d60c0,2dcc4ce8,3b,3b,...) at fork_exit+0x12f/frame 0x2dcc4cd4 fork_trampoline() at 0xffc033ca/frame 0x2dcc4cd4 --- trap 0x20, eip = 0, esp = 0x2dcc4d20, ebp = 0xffbfebb0 --- (null)() at 0 Tracing command nfsd pid 572 tid 100139 td 0x2d957a80 sched_switch(2d957a80,0,104) at sched_switch+0x598/frame 0x2dcc9adc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dcc9b0c sleepq_switch(0,243d60c0,8,24864354,1f101d4,...) at sleepq_switch+0xe1/frame 0x2dcc9b30 sleepq_catch_signals(23eec7d0,2d957a80,243d60c0,2dcc9ba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dcc9b5c sleepq_wait_sig(23eec7d0,0) at sleepq_wait_sig+0x11/frame 0x2dcc9b70 _cv_wait_sig(23eec7d0,243d60c0) at _cv_wait_sig+0x138/frame 0x2dcc9ba8 svc_run_internal(2dcc9cd4,f9744f,243d60c0,2dcc9ce8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2dcc9c70 svc_thread_start(243d60c0,2dcc9ce8,163a3df,419,0,...) at svc_thread_start+0xd/frame 0x2dcc9c78 fork_exit(1258110,243d60c0,2dcc9ce8,3b,3b,...) at fork_exit+0x12f/frame 0x2dcc9cd4 fork_trampoline() at 0xffc033ca/frame 0x2dcc9cd4 --- trap 0x20, eip = 0, esp = 0x2dcc9d20, ebp = 0xffbfebb0 --- (null)() at 0 Tracing command nfsd pid 572 tid 100140 td 0x2d957700 sched_switch(2d957700,0,104) at sched_switch+0x598/frame 0x2dcceadc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dcceb0c sleepq_switch(0,243d60c0,8,24864354,1f12fd4,...) at sleepq_switch+0xe1/frame 0x2dcceb30 sleepq_catch_signals(24659f50,2d957700,243d60c0,2dcceba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dcceb5c sleepq_wait_sig(24659f50,0) at sleepq_wait_sig+0x11/frame 0x2dcceb70 _cv_wait_sig(24659f50,243d60c0) at _cv_wait_sig+0x138/frame 0x2dcceba8 svc_run_internal(2dccecd4,f9744f,243d60c0,2dccece8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2dccec70 svc_thread_start(243d60c0,2dccece8,163a3df,419,a5a5a5a5,...) at svc_thread_start+0xd/frame 0x2dccec78 fork_exit(1258110,243d60c0,2dccece8,3b,3b,...) at fork_exit+0x12f/frame 0x2dccecd4 fork_trampoline() at 0xffc033ca/frame 0x2dccecd4 --- trap 0x20, eip = 0, esp = 0x2dcced20, ebp = 0xffbfebb0 --- (null)() at 0 Tracing command nfsd pid 572 tid 100141 td 0x2d957380 sched_switch(2d957380,0,104) at sched_switch+0x598/frame 0x2dcd3adc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dcd3b0c sleepq_switch(0,243d60c0,8,24864354,1f121d4,...) at sleepq_switch+0xe1/frame 0x2dcd3b30 sleepq_catch_signals(23eec750,2d957380,243d60c0,2dcd3ba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dcd3b5c sleepq_wait_sig(23eec750,0) at sleepq_wait_sig+0x11/frame 0x2dcd3b70 _cv_wait_sig(23eec750,243d60c0) at _cv_wait_sig+0x138/frame 0x2dcd3ba8 svc_run_internal(2dcd3cd4,f9744f,243d60c0,2dcd3ce8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2dcd3c70 svc_thread_start(243d60c0,2dcd3ce8,163a3df,419,a5a5a5a5,...) at svc_thread_start+0xd/frame 0x2dcd3c78 fork_exit(1258110,243d60c0,2dcd3ce8,3b,3b,...) at fork_exit+0x12f/frame 0x2dcd3cd4 fork_trampoline() at 0xffc033ca/frame 0x2dcd3cd4 --- trap 0x20, eip = 0, esp = 0x2dcd3d20, ebp = 0xffbfebb0 --- (null)() at 0 Tracing command nfsd pid 572 tid 100142 td 0x2d957000 sched_switch(2d957000,0,104) at sched_switch+0x598/frame 0x2dcd8adc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dcd8b0c sleepq_switch(0,243d60c0,8,24864354,1f10f94,...) at sleepq_switch+0xe1/frame 0x2dcd8b30 sleepq_catch_signals(24659ed0,2d957000,243d60c0,2dcd8ba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dcd8b5c sleepq_wait_sig(24659ed0,0) at sleepq_wait_sig+0x11/frame 0x2dcd8b70 _cv_wait_sig(24659ed0,243d60c0) at _cv_wait_sig+0x138/frame 0x2dcd8ba8 svc_run_internal(2dcd8cd4,f9744f,243d60c0,2dcd8ce8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2dcd8c70 svc_thread_start(243d60c0,2dcd8ce8,163a3df,419,a5a5a5a5,...) at svc_thread_start+0xd/frame 0x2dcd8c78 fork_exit(1258110,243d60c0,2dcd8ce8,3b,3b,...) at fork_exit+0x12f/frame 0x2dcd8cd4 fork_trampoline() at 0xffc033ca/frame 0x2dcd8cd4 --- trap 0x20, eip = 0, esp = 0x2dcd8d20, ebp = 0xffbfebb0 --- (null)() at 0 Tracing command nfsd pid 572 tid 100143 td 0x2d956a80 sched_switch(2d956a80,0,104) at sched_switch+0x598/frame 0x2dcddadc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dcddb0c sleepq_switch(0,243d60c0,8,24864354,1f10194,...) at sleepq_switch+0xe1/frame 0x2dcddb30 sleepq_catch_signals(23eec6d0,2d956a80,243d60c0,2dcddba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dcddb5c sleepq_wait_sig(23eec6d0,0) at sleepq_wait_sig+0x11/frame 0x2dcddb70 _cv_wait_sig(23eec6d0,243d60c0) at _cv_wait_sig+0x138/frame 0x2dcddba8 svc_run_internal(2dcddcd4,f9744f,243d60c0,2dcddce8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2dcddc70 svc_thread_start(243d60c0,2dcddce8,163a3df,419,a5a5a5a5,...) at svc_thread_start+0xd/frame 0x2dcddc78 fork_exit(1258110,243d60c0,2dcddce8,3b,3b,...) at fork_exit+0x12f/frame 0x2dcddcd4 fork_trampoline() at 0xffc033ca/frame 0x2dcddcd4 --- trap 0x20, eip = 0, esp = 0x2dcddd20, ebp = 0xffbfebb0 --- (null)() at 0 Tracing command nfsd pid 572 tid 100144 td 0x2d956700 sched_switch(2d956700,0,104) at sched_switch+0x598/frame 0x2dce2adc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dce2b0c sleepq_switch(0,243d60c0,8,24864354,1f12f94,...) at sleepq_switch+0xe1/frame 0x2dce2b30 sleepq_catch_signals(24659e50,2d956700,243d60c0,2dce2ba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dce2b5c sleepq_wait_sig(24659e50,0) at sleepq_wait_sig+0x11/frame 0x2dce2b70 _cv_wait_sig(24659e50,243d60c0) at _cv_wait_sig+0x138/frame 0x2dce2ba8 svc_run_internal(2dce2cd4,f9744f,243d60c0,2dce2ce8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2dce2c70 svc_thread_start(243d60c0,2dce2ce8,163a3df,419,a5a5a5a5,...) at svc_thread_start+0xd/frame 0x2dce2c78 fork_exit(1258110,243d60c0,2dce2ce8,3b,3b,...) at fork_exit+0x12f/frame 0x2dce2cd4 fork_trampoline() at 0xffc033ca/frame 0x2dce2cd4 --- trap 0x20, eip = 0, esp = 0x2dce2d20, ebp = 0xffbfebb0 --- (null)() at 0 Tracing command nfsd pid 572 tid 100145 td 0x2d956380 sched_switch(2d956380,0,104) at sched_switch+0x598/frame 0x2dce7adc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dce7b0c sleepq_switch(0,243d60c0,8,24864354,1f10f54,...) at sleepq_switch+0xe1/frame 0x2dce7b30 sleepq_catch_signals(24659dd0,2d956380,243d60c0,2dce7ba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dce7b5c sleepq_wait_sig(24659dd0,0) at sleepq_wait_sig+0x11/frame 0x2dce7b70 _cv_wait_sig(24659dd0,243d60c0) at _cv_wait_sig+0x138/frame 0x2dce7ba8 svc_run_internal(2dce7cd4,f9744f,243d60c0,2dce7ce8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2dce7c70 svc_thread_start(243d60c0,2dce7ce8,163a3df,419,a5a5a5a5,...) at svc_thread_start+0xd/frame 0x2dce7c78 fork_exit(1258110,243d60c0,2dce7ce8,3b,3b,...) at fork_exit+0x12f/frame 0x2dce7cd4 fork_trampoline() at 0xffc033ca/frame 0x2dce7cd4 --- trap 0x20, eip = 0, esp = 0x2dce7d20, ebp = 0xffbfebb0 --- (null)() at 0 Tracing command nfsd pid 572 tid 100146 td 0x2d956000 sched_switch(2d956000,0,104) at sched_switch+0x598/frame 0x2dcecadc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dcecb0c sleepq_switch(0,243d60c0,8,24864354,1f12194,...) at sleepq_switch+0xe1/frame 0x2dcecb30 sleepq_catch_signals(23eec650,2d956000,243d60c0,2dcecba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dcecb5c sleepq_wait_sig(23eec650,0) at sleepq_wait_sig+0x11/frame 0x2dcecb70 _cv_wait_sig(23eec650,243d60c0) at _cv_wait_sig+0x138/frame 0x2dcecba8 svc_run_internal(2dceccd4,f9744f,243d60c0,2dcecce8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2dcecc70 svc_thread_start(243d60c0,2dcecce8,163a3df,419,a5a5a5a5,...) at svc_thread_start+0xd/frame 0x2dcecc78 fork_exit(1258110,243d60c0,2dcecce8,3b,3b,...) at fork_exit+0x12f/frame 0x2dceccd4 fork_trampoline() at 0xffc033ca/frame 0x2dceccd4 --- trap 0x20, eip = 0, esp = 0x2dcecd20, ebp = 0xffbfebb0 --- (null)() at 0 Tracing command nfsd pid 572 tid 100147 td 0x2e07e380 sched_switch(2e07e380,0,104) at sched_switch+0x598/frame 0x2dcf1adc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dcf1b0c sleepq_switch(0,243d60c0,8,24864354,1f12f54,...) at sleepq_switch+0xe1/frame 0x2dcf1b30 sleepq_catch_signals(24659d50,2e07e380,243d60c0,2dcf1ba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dcf1b5c sleepq_wait_sig(24659d50,0) at sleepq_wait_sig+0x11/frame 0x2dcf1b70 _cv_wait_sig(24659d50,243d60c0) at _cv_wait_sig+0x138/frame 0x2dcf1ba8 svc_run_internal(2dcf1cd4,f9744f,243d60c0,2dcf1ce8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2dcf1c70 svc_thread_start(243d60c0,2dcf1ce8,163a3df,419,a5a5a5a5,...) at svc_thread_start+0xd/frame 0x2dcf1c78 fork_exit(1258110,243d60c0,2dcf1ce8,3b,3b,...) at fork_exit+0x12f/frame 0x2dcf1cd4 fork_trampoline() at 0xffc033ca/frame 0x2dcf1cd4 --- trap 0x20, eip = 0, esp = 0x2dcf1d20, ebp = 0xffbfebb0 --- (null)() at 0 Tracing command nfsd pid 572 tid 100148 td 0x2e07e000 sched_switch(2e07e000,0,104) at sched_switch+0x598/frame 0x2dcf6adc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dcf6b0c sleepq_switch(0,243d60c0,8,24864354,1f10f14,...) at sleepq_switch+0xe1/frame 0x2dcf6b30 sleepq_catch_signals(24659cd0,2e07e000,243d60c0,2dcf6ba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dcf6b5c sleepq_wait_sig(24659cd0,0) at sleepq_wait_sig+0x11/frame 0x2dcf6b70 _cv_wait_sig(24659cd0,243d60c0) at _cv_wait_sig+0x138/frame 0x2dcf6ba8 svc_run_internal(2dcf6cd4,f9744f,243d60c0,2dcf6ce8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2dcf6c70 svc_thread_start(243d60c0,2dcf6ce8,163a3df,419,a5a5a5a5,...) at svc_thread_start+0xd/frame 0x2dcf6c78 fork_exit(1258110,243d60c0,2dcf6ce8,3b,3b,...) at fork_exit+0x12f/frame 0x2dcf6cd4 fork_trampoline() at 0xffc033ca/frame 0x2dcf6cd4 --- trap 0x20, eip = 0, esp = 0x2dcf6d20, ebp = 0xffbfebb0 --- (null)() at 0 Tracing command nfsd pid 572 tid 100149 td 0x2e07da80 sched_switch(2e07da80,0,104) at sched_switch+0x598/frame 0x2dcfbadc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dcfbb0c sleepq_switch(0,243d60c0,8,24864354,1f12f14,...) at sleepq_switch+0xe1/frame 0x2dcfbb30 sleepq_catch_signals(24659c50,2e07da80,243d60c0,2dcfbba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dcfbb5c sleepq_wait_sig(24659c50,0) at sleepq_wait_sig+0x11/frame 0x2dcfbb70 _cv_wait_sig(24659c50,243d60c0) at _cv_wait_sig+0x138/frame 0x2dcfbba8 svc_run_internal(2dcfbcd4,f9744f,243d60c0,2dcfbce8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2dcfbc70 svc_thread_start(243d60c0,2dcfbce8,163a3df,419,a5a5a5a5,...) at svc_thread_start+0xd/frame 0x2dcfbc78 fork_exit(1258110,243d60c0,2dcfbce8,3b,3b,...) at fork_exit+0x12f/frame 0x2dcfbcd4 fork_trampoline() at 0xffc033ca/frame 0x2dcfbcd4 --- trap 0x20, eip = 0, esp = 0x2dcfbd20, ebp = 0xffbfebb0 --- (null)() at 0 Tracing command nfsd pid 572 tid 100150 td 0x2e07d700 sched_switch(2e07d700,0,104) at sched_switch+0x598/frame 0x2dd00adc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dd00b0c sleepq_switch(0,243d60c0,8,24864354,1f10154,...) at sleepq_switch+0xe1/frame 0x2dd00b30 sleepq_catch_signals(23eec5d0,2e07d700,243d60c0,2dd00ba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dd00b5c sleepq_wait_sig(23eec5d0,0) at sleepq_wait_sig+0x11/frame 0x2dd00b70 _cv_wait_sig(23eec5d0,243d60c0) at _cv_wait_sig+0x138/frame 0x2dd00ba8 svc_run_internal(2dd00cd4,f9744f,243d60c0,2dd00ce8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2dd00c70 svc_thread_start(243d60c0,2dd00ce8,163a3df,419,a5a5a5a5,...) at svc_thread_start+0xd/frame 0x2dd00c78 fork_exit(1258110,243d60c0,2dd00ce8,3b,3b,...) at fork_exit+0x12f/frame 0x2dd00cd4 fork_trampoline() at 0xffc033ca/frame 0x2dd00cd4 --- trap 0x20, eip = 0, esp = 0x2dd00d20, ebp = 0xffbfebb0 --- (null)() at 0 Tracing command nfsd pid 572 tid 100151 td 0x2e07d380 sched_switch(2e07d380,0,104) at sched_switch+0x598/frame 0x2dd05adc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dd05b0c sleepq_switch(0,243d60c0,8,24864354,1f12154,...) at sleepq_switch+0xe1/frame 0x2dd05b30 sleepq_catch_signals(23eec550,2e07d380,243d60c0,2dd05ba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dd05b5c sleepq_wait_sig(23eec550,0) at sleepq_wait_sig+0x11/frame 0x2dd05b70 _cv_wait_sig(23eec550,243d60c0) at _cv_wait_sig+0x138/frame 0x2dd05ba8 svc_run_internal(2dd05cd4,f9744f,243d60c0,2dd05ce8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2dd05c70 svc_thread_start(243d60c0,2dd05ce8,163a3df,419,a5a5a5a5,...) at svc_thread_start+0xd/frame 0x2dd05c78 fork_exit(1258110,243d60c0,2dd05ce8,3b,3b,...) at fork_exit+0x12f/frame 0x2dd05cd4 fork_trampoline() at 0xffc033ca/frame 0x2dd05cd4 --- trap 0x20, eip = 0, esp = 0x2dd05d20, ebp = 0xffbfebb0 --- (null)() at 0 Tracing command nfsd pid 572 tid 100152 td 0x2e07d000 sched_switch(2e07d000,0,104) at sched_switch+0x598/frame 0x2dd0aadc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dd0ab0c sleepq_switch(0,243d60c0,8,24864354,1f10114,...) at sleepq_switch+0xe1/frame 0x2dd0ab30 sleepq_catch_signals(23eec4d0,2e07d000,243d60c0,2dd0aba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dd0ab5c sleepq_wait_sig(23eec4d0,0) at sleepq_wait_sig+0x11/frame 0x2dd0ab70 _cv_wait_sig(23eec4d0,243d60c0) at _cv_wait_sig+0x138/frame 0x2dd0aba8 svc_run_internal(2dd0acd4,f9744f,243d60c0,2dd0ace8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2dd0ac70 svc_thread_start(243d60c0,2dd0ace8,163a3df,419,a5a5a5a5,...) at svc_thread_start+0xd/frame 0x2dd0ac78 fork_exit(1258110,243d60c0,2dd0ace8,3b,3b,...) at fork_exit+0x12f/frame 0x2dd0acd4 fork_trampoline() at 0xffc033ca/frame 0x2dd0acd4 --- trap 0x20, eip = 0, esp = 0x2dd0ad20, ebp = 0xffbfebb0 --- (null)() at 0 Tracing command nfsd pid 572 tid 100153 td 0x2e07ca80 sched_switch(2e07ca80,0,104) at sched_switch+0x598/frame 0x2dd0fadc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dd0fb0c sleepq_switch(0,243d60c0,8,24864354,1f12114,...) at sleepq_switch+0xe1/frame 0x2dd0fb30 sleepq_catch_signals(23eec450,2e07ca80,243d60c0,2dd0fba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dd0fb5c sleepq_wait_sig(23eec450,0) at sleepq_wait_sig+0x11/frame 0x2dd0fb70 _cv_wait_sig(23eec450,243d60c0) at _cv_wait_sig+0x138/frame 0x2dd0fba8 svc_run_internal(2dd0fcd4,f9744f,243d60c0,2dd0fce8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2dd0fc70 svc_thread_start(243d60c0,2dd0fce8,163a3df,419,a5a5a5a5,...) at svc_thread_start+0xd/frame 0x2dd0fc78 fork_exit(1258110,243d60c0,2dd0fce8,3b,3b,...) at fork_exit+0x12f/frame 0x2dd0fcd4 fork_trampoline() at 0xffc033ca/frame 0x2dd0fcd4 --- trap 0x20, eip = 0, esp = 0x2dd0fd20, ebp = 0xffbfebb0 --- (null)() at 0 Tracing command nfsd pid 572 tid 100154 td 0x2e07c700 sched_switch(2e07c700,0,104) at sched_switch+0x598/frame 0x2dd14adc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dd14b0c sleepq_switch(0,243d60c0,8,24864354,1f100d4,...) at sleepq_switch+0xe1/frame 0x2dd14b30 sleepq_catch_signals(23eec3d0,2e07c700,243d60c0,2dd14ba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dd14b5c sleepq_wait_sig(23eec3d0,0) at sleepq_wait_sig+0x11/frame 0x2dd14b70 _cv_wait_sig(23eec3d0,243d60c0) at _cv_wait_sig+0x138/frame 0x2dd14ba8 svc_run_internal(2dd14cd4,f9744f,243d60c0,2dd14ce8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2dd14c70 svc_thread_start(243d60c0,2dd14ce8,163a3df,419,a5a5a5a5,...) at svc_thread_start+0xd/frame 0x2dd14c78 fork_exit(1258110,243d60c0,2dd14ce8,3b,3b,...) at fork_exit+0x12f/frame 0x2dd14cd4 fork_trampoline() at 0xffc033ca/frame 0x2dd14cd4 --- trap 0x20, eip = 0, esp = 0x2dd14d20, ebp = 0xffbfebb0 --- (null)() at 0 Tracing command nfsd pid 572 tid 100155 td 0x2e07c380 sched_switch(2e07c380,0,104) at sched_switch+0x598/frame 0x2dd19adc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dd19b0c sleepq_switch(0,243d60c0,8,24864354,1f10ed4,...) at sleepq_switch+0xe1/frame 0x2dd19b30 sleepq_catch_signals(24659bd0,2e07c380,243d60c0,2dd19ba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dd19b5c sleepq_wait_sig(24659bd0,0) at sleepq_wait_sig+0x11/frame 0x2dd19b70 _cv_wait_sig(24659bd0,243d60c0) at _cv_wait_sig+0x138/frame 0x2dd19ba8 svc_run_internal(2dd19cd4,f9744f,243d60c0,2dd19ce8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2dd19c70 svc_thread_start(243d60c0,2dd19ce8,163a3df,419,a5a5a5a5,...) at svc_thread_start+0xd/frame 0x2dd19c78 fork_exit(1258110,243d60c0,2dd19ce8,3b,3b,...) at fork_exit+0x12f/frame 0x2dd19cd4 fork_trampoline() at 0xffc033ca/frame 0x2dd19cd4 --- trap 0x20, eip = 0, esp = 0x2dd19d20, ebp = 0xffbfebb0 --- (null)() at 0 Tracing command nfsd pid 572 tid 100156 td 0x2e07c000 sched_switch(2e07c000,0,104) at sched_switch+0x598/frame 0x2dd1eadc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dd1eb0c sleepq_switch(0,243d60c0,8,24864354,1f120d4,...) at sleepq_switch+0xe1/frame 0x2dd1eb30 sleepq_catch_signals(23eec350,2e07c000,243d60c0,2dd1eba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dd1eb5c sleepq_wait_sig(23eec350,0) at sleepq_wait_sig+0x11/frame 0x2dd1eb70 _cv_wait_sig(23eec350,243d60c0) at _cv_wait_sig+0x138/frame 0x2dd1eba8 svc_run_internal(2dd1ecd4,f9744f,243d60c0,2dd1ece8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2dd1ec70 svc_thread_start(243d60c0,2dd1ece8,163a3df,419,a5a5a5a5,...) at svc_thread_start+0xd/frame 0x2dd1ec78 fork_exit(1258110,243d60c0,2dd1ece8,3b,3b,...) at fork_exit+0x12f/frame 0x2dd1ecd4 fork_trampoline() at 0xffc033ca/frame 0x2dd1ecd4 --- trap 0x20, eip = 0, esp = 0x2dd1ed20, ebp = 0xffbfebb0 --- (null)() at 0 Tracing command nfsd pid 572 tid 100157 td 0x2d959a80 sched_switch(2d959a80,0,104) at sched_switch+0x598/frame 0x2dd23adc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dd23b0c sleepq_switch(0,243d60c0,8,24864354,1f12ed4,...) at sleepq_switch+0xe1/frame 0x2dd23b30 sleepq_catch_signals(24659b50,2d959a80,243d60c0,2dd23ba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dd23b5c sleepq_wait_sig(24659b50,0) at sleepq_wait_sig+0x11/frame 0x2dd23b70 _cv_wait_sig(24659b50,243d60c0) at _cv_wait_sig+0x138/frame 0x2dd23ba8 svc_run_internal(2dd23cd4,f9744f,243d60c0,2dd23ce8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2dd23c70 svc_thread_start(243d60c0,2dd23ce8,163a3df,419,a5a5a5a5,...) at svc_thread_start+0xd/frame 0x2dd23c78 fork_exit(1258110,243d60c0,2dd23ce8,3b,3b,...) at fork_exit+0x12f/frame 0x2dd23cd4 fork_trampoline() at 0xffc033ca/frame 0x2dd23cd4 --- trap 0x20, eip = 0, esp = 0x2dd23d20, ebp = 0xffbfebb0 --- (null)() at 0 Tracing command nfsd pid 572 tid 100158 td 0x2d959700 sched_switch(2d959700,0,104) at sched_switch+0x598/frame 0x2dd28adc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dd28b0c sleepq_switch(0,243d60c0,8,24864354,1f10094,...) at sleepq_switch+0xe1/frame 0x2dd28b30 sleepq_catch_signals(23eec2d0,2d959700,243d60c0,2dd28ba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dd28b5c sleepq_wait_sig(23eec2d0,0) at sleepq_wait_sig+0x11/frame 0x2dd28b70 _cv_wait_sig(23eec2d0,243d60c0) at _cv_wait_sig+0x138/frame 0x2dd28ba8 svc_run_internal(2dd28cd4,f9744f,243d60c0,2dd28ce8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2dd28c70 svc_thread_start(243d60c0,2dd28ce8,163a3df,419,a5a5a5a5,...) at svc_thread_start+0xd/frame 0x2dd28c78 fork_exit(1258110,243d60c0,2dd28ce8,3b,3b,...) at fork_exit+0x12f/frame 0x2dd28cd4 fork_trampoline() at 0xffc033ca/frame 0x2dd28cd4 --- trap 0x20, eip = 0, esp = 0x2dd28d20, ebp = 0xffbfebb0 --- (null)() at 0 Tracing command nfsd pid 572 tid 100159 td 0x2d959380 sched_switch(2d959380,0,104) at sched_switch+0x598/frame 0x2dd2dadc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dd2db0c sleepq_switch(0,243d60c0,8,24864354,1f12094,...) at sleepq_switch+0xe1/frame 0x2dd2db30 sleepq_catch_signals(23eec250,2d959380,243d60c0,2dd2dba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dd2db5c sleepq_wait_sig(23eec250,0) at sleepq_wait_sig+0x11/frame 0x2dd2db70 _cv_wait_sig(23eec250,243d60c0) at _cv_wait_sig+0x138/frame 0x2dd2dba8 svc_run_internal(2dd2dcd4,f9744f,243d60c0,2dd2dce8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2dd2dc70 svc_thread_start(243d60c0,2dd2dce8,163a3df,419,a5a5a5a5,...) at svc_thread_start+0xd/frame 0x2dd2dc78 fork_exit(1258110,243d60c0,2dd2dce8,3b,3b,...) at fork_exit+0x12f/frame 0x2dd2dcd4 fork_trampoline() at 0xffc033ca/frame 0x2dd2dcd4 --- trap 0x20, eip = 0, esp = 0x2dd2dd20, ebp = 0xffbfebb0 --- (null)() at 0 Tracing command nfsd pid 572 tid 100160 td 0x2e083700 sched_switch(2e083700,0,104) at sched_switch+0x598/frame 0x2dd32adc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dd32b0c sleepq_switch(0,243d60c0,8,24864354,1f10054,...) at sleepq_switch+0xe1/frame 0x2dd32b30 sleepq_catch_signals(23eec1d0,2e083700,243d60c0,2dd32ba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dd32b5c sleepq_wait_sig(23eec1d0,0) at sleepq_wait_sig+0x11/frame 0x2dd32b70 _cv_wait_sig(23eec1d0,243d60c0) at _cv_wait_sig+0x138/frame 0x2dd32ba8 svc_run_internal(2dd32cd4,f9744f,243d60c0,2dd32ce8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2dd32c70 svc_thread_start(243d60c0,2dd32ce8,163a3df,419,a5a5a5a5,...) at svc_thread_start+0xd/frame 0x2dd32c78 fork_exit(1258110,243d60c0,2dd32ce8,3b,3b,...) at fork_exit+0x12f/frame 0x2dd32cd4 fork_trampoline() at 0xffc033ca/frame 0x2dd32cd4 --- trap 0x20, eip = 0, esp = 0x2dd32d20, ebp = 0xffbfebb0 --- (null)() at 0 Tracing command nfsd pid 572 tid 100161 td 0x2e083380 sched_switch(2e083380,0,104) at sched_switch+0x598/frame 0x2dd37adc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dd37b0c sleepq_switch(0,243d60c0,8,24864354,1f12054,...) at sleepq_switch+0xe1/frame 0x2dd37b30 sleepq_catch_signals(23eec150,2e083380,243d60c0,2dd37ba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dd37b5c sleepq_wait_sig(23eec150,0) at sleepq_wait_sig+0x11/frame 0x2dd37b70 _cv_wait_sig(23eec150,243d60c0) at _cv_wait_sig+0x138/frame 0x2dd37ba8 svc_run_internal(2dd37cd4,f9744f,243d60c0,2dd37ce8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2dd37c70 svc_thread_start(243d60c0,2dd37ce8,163a3df,419,a5a5a5a5,...) at svc_thread_start+0xd/frame 0x2dd37c78 fork_exit(1258110,243d60c0,2dd37ce8,3b,3b,...) at fork_exit+0x12f/frame 0x2dd37cd4 fork_trampoline() at 0xffc033ca/frame 0x2dd37cd4 --- trap 0x20, eip = 0, esp = 0x2dd37d20, ebp = 0xffbfebb0 --- (null)() at 0 Tracing command nfsd pid 572 tid 100162 td 0x2e083000 sched_switch(2e083000,0,104) at sched_switch+0x598/frame 0x2dd3cadc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dd3cb0c sleepq_switch(0,243d60c0,8,24864354,1f10e94,...) at sleepq_switch+0xe1/frame 0x2dd3cb30 sleepq_catch_signals(24659ad0,2e083000,243d60c0,2dd3cba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dd3cb5c sleepq_wait_sig(24659ad0,0) at sleepq_wait_sig+0x11/frame 0x2dd3cb70 _cv_wait_sig(24659ad0,243d60c0) at _cv_wait_sig+0x138/frame 0x2dd3cba8 svc_run_internal(2dd3ccd4,f9744f,243d60c0,2dd3cce8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2dd3cc70 svc_thread_start(243d60c0,2dd3cce8,163a3df,419,71726920,...) at svc_thread_start+0xd/frame 0x2dd3cc78 fork_exit(1258110,243d60c0,2dd3cce8,3b,3b,...) at fork_exit+0x12f/frame 0x2dd3ccd4 fork_trampoline() at 0xffc033ca/frame 0x2dd3ccd4 --- trap 0x20, eip = 0, esp = 0x2dd3cd20, ebp = 0xffbfebb0 --- (null)() at 0 Tracing command nfsd pid 572 tid 100163 td 0x2e082a80 sched_switch(2e082a80,0,104) at sched_switch+0x598/frame 0x2dd41adc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dd41b0c sleepq_switch(0,243d60c0,8,24864354,1f12e94,...) at sleepq_switch+0xe1/frame 0x2dd41b30 sleepq_catch_signals(24659a50,2e082a80,243d60c0,2dd41ba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dd41b5c sleepq_wait_sig(24659a50,0) at sleepq_wait_sig+0x11/frame 0x2dd41b70 _cv_wait_sig(24659a50,243d60c0) at _cv_wait_sig+0x138/frame 0x2dd41ba8 svc_run_internal(2dd41cd4,f9744f,243d60c0,2dd41ce8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2dd41c70 svc_thread_start(243d60c0,2dd41ce8,163a3df,419,0,...) at svc_thread_start+0xd/frame 0x2dd41c78 fork_exit(1258110,243d60c0,2dd41ce8,3b,3b,...) at fork_exit+0x12f/frame 0x2dd41cd4 fork_trampoline() at 0xffc033ca/frame 0x2dd41cd4 --- trap 0x20, eip = 0, esp = 0x2dd41d20, ebp = 0xffbfebb0 --- (null)() at 0 Tracing command nfsd pid 572 tid 100164 td 0x2e082700 sched_switch(2e082700,0,104) at sched_switch+0x598/frame 0x2dd46adc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dd46b0c sleepq_switch(0,243d60c0,8,24864354,1f10014,...) at sleepq_switch+0xe1/frame 0x2dd46b30 sleepq_catch_signals(23eec0d0,2e082700,243d60c0,2dd46ba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dd46b5c sleepq_wait_sig(23eec0d0,0) at sleepq_wait_sig+0x11/frame 0x2dd46b70 _cv_wait_sig(23eec0d0,243d60c0) at _cv_wait_sig+0x138/frame 0x2dd46ba8 svc_run_internal(2dd46cd4,f9744f,243d60c0,2dd46ce8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2dd46c70 svc_thread_start(243d60c0,2dd46ce8,163a3df,419,0,...) at svc_thread_start+0xd/frame 0x2dd46c78 fork_exit(1258110,243d60c0,2dd46ce8,3b,3b,...) at fork_exit+0x12f/frame 0x2dd46cd4 fork_trampoline() at 0xffc033ca/frame 0x2dd46cd4 --- trap 0x20, eip = 0, esp = 0x2dd46d20, ebp = 0xffbfebb0 --- (null)() at 0 Tracing command nfsd pid 572 tid 100165 td 0x2e082380 sched_switch(2e082380,0,104) at sched_switch+0x598/frame 0x2dd4badc mi_switch(104,0) at mi_switch+0x1de/frame 0x2dd4bb0c sleepq_switch(0,243d60c0,8,24864354,1f12014,...) at sleepq_switch+0xe1/frame 0x2dd4bb30 sleepq_catch_signals(23eec050,2e082380,243d60c0,2dd4bba8,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dd4bb5c sleepq_wait_sig(23eec050,0) at sleepq_wait_sig+0x11/frame 0x2dd4bb70 _cv_wait_sig(23eec050,243d60c0) at _cv_wait_sig+0x138/frame 0x2dd4bba8 svc_run_internal(2dd4bcd4,f9744f,243d60c0,2dd4bce8,163a3df,...) at svc_run_internal+0xbb2/frame 0x2dd4bc70 svc_thread_start(243d60c0,2dd4bce8,163a3df,419,0,...) at svc_thread_start+0xd/frame 0x2dd4bc78 fork_exit(1258110,243d60c0,2dd4bce8,3b,3b,...) at fork_exit+0x12f/frame 0x2dd4bcd4 fork_trampoline() at 0xffc033ca/frame 0x2dd4bcd4 --- trap 0x20, eip = 0, esp = 0x2dd4bd20, ebp = 0xffbfebb0 --- (null)() at 0 Tracing command nfsd pid 569 tid 100134 td 0x2d254380 sched_switch(2d254380,0,104) at sched_switch+0x598/frame 0x2dcb0944 mi_switch(104,0) at mi_switch+0x1de/frame 0x2dcb0974 sleepq_switch(0,216a28d0,8,23dfc354,1f12f14,...) at sleepq_switch+0xe1/frame 0x2dcb0998 sleepq_catch_signals(216a28e4,2d254380,216a28d0,2dcb0a10,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2dcb09c4 sleepq_wait_sig(216a28e4,0) at sleepq_wait_sig+0x11/frame 0x2dcb09d8 _cv_wait_sig(216a28e4,216a28d0) at _cv_wait_sig+0x138/frame 0x2dcb0a10 seltdwait(ffffffff,0,0) at seltdwait+0x8a/frame 0x2dcb0a2c kern_select(2d254380,7,ffbfec68,0,0,0,20) at kern_select+0x826/frame 0x2dcb0bac sys_select(2d254380,2d25460c,166aa5e,4,0,...) at sys_select+0x41/frame 0x2dcb0be4 syscallenter(2d254380,c,0,0,2dcb0e00,...) at syscallenter+0x4d8/frame 0x2dcb0c58 syscall(2dcb0ce8,3b,3b,3b,ffbfece8,...) at syscall+0x84/frame 0x2dcb0cdc Xint0x80_syscall() at 0xffc033b7/frame 0x2dcb0cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x205beebb, esp = 0xffbfea78, ebp = 0xffbfea94 --- __bss_end() at 0x205beebb Tracing command mountd pid 563 tid 100109 td 0x2d254700 sched_switch(2d254700,0,104) at sched_switch+0x598/frame 0x22df8944 mi_switch(104,0) at mi_switch+0x1de/frame 0x22df8974 sleepq_switch(0,24661850,8,23dfc6a8,1f11b14,...) at sleepq_switch+0xe1/frame 0x22df8998 sleepq_catch_signals(24661864,2d254700,24661850,22df8a10,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x22df89c4 sleepq_wait_sig(24661864,0) at sleepq_wait_sig+0x11/frame 0x22df89d8 _cv_wait_sig(24661864,24661850) at _cv_wait_sig+0x138/frame 0x22df8a10 seltdwait(ffffffff,0,0) at seltdwait+0x8a/frame 0x22df8a2c kern_select(2d254700,a,ffbfe8d8,0,0,0,20) at kern_select+0x826/frame 0x22df8bac sys_select(2d254700,2d25498c,166aa5e,4,0,...) at sys_select+0x41/frame 0x22df8be4 syscallenter(2d254700,22df8ca0,102e134,2,22df8e00,...) at syscallenter+0x4d8/frame 0x22df8c58 syscall(22df8ce8,3b,3b,3b,ffbfe958,...) at syscall+0x84/frame 0x22df8cdc Xint0x80_syscall() at 0xffc033b7/frame 0x22df8cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x205d8ebb, esp = 0xffbfe848, ebp = 0xffbfe864 --- __bss_end() at 0x205d8ebb Tracing command nfsuserd pid 556 tid 100129 td 0x2d5c0a80 sched_switch(2d5c0a80,0,104) at sched_switch+0x598/frame 0x2dc9790c mi_switch(104,0) at mi_switch+0x1de/frame 0x2dc97940 sleepq_switch(0,1c15538,1f3f8f8,23a7a000,1f130d4,...) at sleepq_switch+0xe1/frame 0x2dc97964 sleepq_catch_signals(cb,2d5c0a80,1c15538,2d5c0a80,2dc979c4,...) at sleepq_catch_signals+0x3b7/frame 0x2dc97990 sleepq_timedwait_sig(11a337e4,0) at sleepq_timedwait_sig+0x17/frame 0x2dc979c0 _cv_timedwait_sig_sbt(11a337e4,11a337d0,70940f0b,7a8,e0000000,1,200) at _cv_timedwait_sig_sbt+0x15a/frame 0x2dc979fc seltdwait(7a8,e0000000,1) at seltdwait+0x5e/frame 0x2dc97a2c kern_select(2d5c0a80,4,ffbfdbf0,0,0,2dc97bd0,20) at kern_select+0x826/frame 0x2dc97bac sys_select(2d5c0a80,2d5c0d0c,166aa5e,4,0,...) at sys_select+0x41/frame 0x2dc97be4 syscallenter(2d5c0a80,c,0,0,2dc97e00,...) at syscallenter+0x4d8/frame 0x2dc97c58 syscall(2dc97ce8,3b,3b,3b,ffbfdbf0,...) at syscall+0x84/frame 0x2dc97cdc Xint0x80_syscall() at 0xffc033b7/frame 0x2dc97cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x205bdebb, esp = 0xffbfdb38, ebp = 0xffbfdc88 --- __bss_end() at 0x205bdebb Tracing command nfsuserd pid 555 tid 100108 td 0x2d241380 sched_switch(2d241380,0,104) at sched_switch+0x598/frame 0x22df390c mi_switch(104,0) at mi_switch+0x1de/frame 0x22df3940 sleepq_switch(0,1c15538,1f3f848,2d231000,1f11f54,...) at sleepq_switch+0xe1/frame 0x22df3964 sleepq_catch_signals(cb,2d241380,1c15538,2d241380,22df39c4,...) at sleepq_catch_signals+0x3b7/frame 0x22df3990 sleepq_timedwait_sig(216a29a4,0) at sleepq_timedwait_sig+0x17/frame 0x22df39c0 _cv_timedwait_sig_sbt(216a29a4,216a2990,ac39ee0f,7a8,e0000000,1,200) at _cv_timedwait_sig_sbt+0x15a/frame 0x22df39fc seltdwait(7a8,e0000000,1) at seltdwait+0x5e/frame 0x22df3a2c kern_select(2d241380,4,ffbfdbf0,0,0,22df3bd0,20) at kern_select+0x826/frame 0x22df3bac sys_select(2d241380,2d24160c,166aa5e,4,0,...) at sys_select+0x41/frame 0x22df3be4 syscallenter(2d241380,c,0,0,22df3e00,...) at syscallenter+0x4d8/frame 0x22df3c58 syscall(22df3ce8,3b,3b,3b,ffbfdbf0,...) at syscall+0x84/frame 0x22df3cdc Xint0x80_syscall() at 0xffc033b7/frame 0x22df3cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x205bdebb, esp = 0xffbfdb38, ebp = 0xffbfdc88 --- __bss_end() at 0x205bdebb Tracing command nfsuserd pid 554 tid 100130 td 0x2d5c0700 sched_switch(2d5c0700,0,104) at sched_switch+0x598/frame 0x2dc9c90c mi_switch(104,0) at mi_switch+0x1de/frame 0x2dc9c940 sleepq_switch(0,1c15538,1f3f690,11fcd9fc,1f12f94,...) at sleepq_switch+0xe1/frame 0x2dc9c964 sleepq_catch_signals(cb,2d5c0700,1c15538,2d5c0700,2dc9c9c4,...) at sleepq_catch_signals+0x3b7/frame 0x2dc9c990 sleepq_timedwait_sig(216a2ae4,0) at sleepq_timedwait_sig+0x17/frame 0x2dc9c9c0 _cv_timedwait_sig_sbt(216a2ae4,216a2ad0,b73c2ef4,7a8,e0000000,1,200) at _cv_timedwait_sig_sbt+0x15a/frame 0x2dc9c9fc seltdwait(7a8,e0000000,1) at seltdwait+0x5e/frame 0x2dc9ca2c kern_select(2d5c0700,4,ffbfdbf0,0,0,2dc9cbd0,20) at kern_select+0x826/frame 0x2dc9cbac sys_select(2d5c0700,2d5c098c,166aa5e,4,0,...) at sys_select+0x41/frame 0x2dc9cbe4 syscallenter(2d5c0700,c,0,0,2dc9ce00,...) at syscallenter+0x4d8/frame 0x2dc9cc58 syscall(2dc9cce8,3b,3b,3b,ffbfdbf0,...) at syscall+0x84/frame 0x2dc9ccdc Xint0x80_syscall() at 0xffc033b7/frame 0x2dc9ccdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x205bdebb, esp = 0xffbfdb38, ebp = 0xffbfdc88 --- __bss_end() at 0x205bdebb Tracing command nfsuserd pid 553 tid 100131 td 0x2d5c0380 sched_switch(2d5c0380,0,104) at sched_switch+0x598/frame 0x2dca190c mi_switch(104,0) at mi_switch+0x1de/frame 0x2dca1940 sleepq_switch(0,1c15538,1f3f6e8,11fcd6a8,1f11f94,...) at sleepq_switch+0xe1/frame 0x2dca1964 sleepq_catch_signals(cb,2d5c0380,1c15538,2d5c0380,2dca19c4,...) at sleepq_catch_signals+0x3b7/frame 0x2dca1990 sleepq_timedwait_sig(216a2aa4,0) at sleepq_timedwait_sig+0x17/frame 0x2dca19c0 _cv_timedwait_sig_sbt(216a2aa4,216a2a90,70940f0b,7a8,e0000000,1,200) at _cv_timedwait_sig_sbt+0x15a/frame 0x2dca19fc seltdwait(7a8,e0000000,1) at seltdwait+0x5e/frame 0x2dca1a2c kern_select(2d5c0380,4,ffbfdbf0,0,0,2dca1bd0,20) at kern_select+0x826/frame 0x2dca1bac sys_select(2d5c0380,2d5c060c,166aa5e,4,0,...) at sys_select+0x41/frame 0x2dca1be4 syscallenter(2d5c0380,9,2d5c0380,1f02d80,2dca1e00,...) at syscallenter+0x4d8/frame 0x2dca1c58 syscall(2dca1ce8,3b,3b,3b,ffbfdbf0,...) at syscall+0x84/frame 0x2dca1cdc Xint0x80_syscall() at 0xffc033b7/frame 0x2dca1cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x205bdebb, esp = 0xffbfdb38, ebp = 0xffbfdc88 --- __bss_end() at 0x205bdebb Tracing command nfsuserd pid 552 tid 100132 td 0x2d23f000 sched_switch(2d23f000,0,104) at sched_switch+0x598/frame 0x2dca6a94 mi_switch(104,0) at mi_switch+0x1de/frame 0x2dca6ac8 sleepq_switch(74,2dca6b20,1027aa7,2d22f9fc,1f12294,...) at sleepq_switch+0xe1/frame 0x2dca6aec sleepq_catch_signals(2d23f000,0,2d22fa60,2dca6b6c,fe182e,...) at sleepq_catch_signals+0x3b7/frame 0x2dca6b18 sleepq_wait_sig(2d22fa60,74) at sleepq_wait_sig+0x11/frame 0x2dca6b2c _sleep(2d22fa60,2d22faa4,174,15e1ecb,0,0,0,0,100) at _sleep+0x28e/frame 0x2dca6b6c kern_sigsuspend(2d23f000,0,0,0,0) at kern_sigsuspend+0x8e/frame 0x2dca6bac sys_sigsuspend(2d23f000,2d23f28c,166aa5e,4,0,...) at sys_sigsuspend+0x3b/frame 0x2dca6be4 syscallenter(2d23f000,c,0,0,2dca6e00,...) at syscallenter+0x4d8/frame 0x2dca6c58 syscall(2dca6ce8,3b,3b,3b,4,...) at syscall+0x84/frame 0x2dca6cdc Xint0x80_syscall() at 0xffc033b7/frame 0x2dca6cdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x20557593, esp = 0xffbfdc78, ebp = 0xffbfdc84 --- __bss_end() at 0x20557593 Tracing command watchdogd pid 509 tid 100115 td 0x2d23fa80 sched_switch(2d23fa80,0,104) at sched_switch+0x598/frame 0x2d115a44 mi_switch(104,0) at mi_switch+0x1de/frame 0x2d115a78 sleepq_switch(6c,c0000000,3,2d2306a8,1f12854,...) at sleepq_switch+0xe1/frame 0x2d115a9c sleepq_catch_signals(3,177,2d23fa80,100,1ef46f7,...) at sleepq_catch_signals+0x3b7/frame 0x2d115ac8 sleepq_timedwait_sig(1ef46f7,6c,2d5f8028,0,159bbde,...) at sleepq_timedwait_sig+0x17/frame 0x2d115af4 _sleep(1ef46f7,0,16c,1690818,9800bb39,7c1,c0000000,3,200) at _sleep+0x22c/frame 0x2d115b34 kern_clock_nanosleep(2d23fa80,0,0,2d115bc8,2d115bc0) at kern_clock_nanosleep+0x1ba/frame 0x2d115ba4 sys_nanosleep(2d23fa80,2d23fd0c,166aa5e,4,0,...) at sys_nanosleep+0x55/frame 0x2d115be4 syscallenter(2d23fa80,c,0,0,2d115e00,...) at syscallenter+0x4d8/frame 0x2d115c58 syscall(2d115ce8,3b,3b,3b,3c,...) at syscall+0x84/frame 0x2d115cdc Xint0x80_syscall() at 0xffc033b7/frame 0x2d115cdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2056b613, esp = 0xffbfec7c, ebp = 0xffbfecac --- __bss_end() at 0x2056b613 Tracing command rpcbind pid 424 tid 100111 td 0x11bb6380 sched_switch(11bb6380,0,104) at sched_switch+0x598/frame 0x2d0ed93c mi_switch(104,0) at mi_switch+0x1de/frame 0x2d0ed970 sleepq_switch(0,1c15538,1f3fb08,248646a8,1f12f54,...) at sleepq_switch+0xe1/frame 0x2d0ed994 sleepq_catch_signals(cb,11bb6380,1c15538,11bb6380,2d0ed9f4,...) at sleepq_catch_signals+0x3b7/frame 0x2d0ed9c0 sleepq_timedwait_sig(216a29e4,0) at sleepq_timedwait_sig+0x17/frame 0x2d0ed9f0 _cv_timedwait_sig_sbt(216a29e4,216a29d0,75b2c965,7a9,e0000000,1,200) at _cv_timedwait_sig_sbt+0x15a/frame 0x2d0eda2c seltdwait(7a9,e0000000,1) at seltdwait+0x5e/frame 0x2d0eda5c kern_poll(11bb6380,ffbfcdb8,8,2d0edbd0,0) at kern_poll+0x466/frame 0x2d0edbb4 sys_poll(11bb6380,11bb660c,166aa5e,4,0,...) at sys_poll+0x50/frame 0x2d0edbe4 syscallenter(11bb6380,c,0,0,2d0ede00,...) at syscallenter+0x4d8/frame 0x2d0edc58 syscall(2d0edce8,3b,3b,3b,ffbfcd38,...) at syscall+0x84/frame 0x2d0edcdc Xint0x80_syscall() at 0xffc033b7/frame 0x2d0edcdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x20578087, esp = 0xffbfcbf0, ebp = 0xffbfcc04 --- __bss_end() at 0x20578087 Tracing command syslogd pid 411 tid 100114 td 0x2d241000 sched_switch(2d241000,0,104) at sched_switch+0x598/frame 0x2d110944 mi_switch(104,0) at mi_switch+0x1de/frame 0x2d110974 sleepq_switch(0,11a33810,8,2d2309fc,1f10314,...) at sleepq_switch+0xe1/frame 0x2d110998 sleepq_catch_signals(11a33824,2d241000,11a33810,2d110a10,f724f8,...) at sleepq_catch_signals+0x3b7/frame 0x2d1109c4 sleepq_wait_sig(11a33824,0) at sleepq_wait_sig+0x11/frame 0x2d1109d8 _cv_wait_sig(11a33824,11a33810) at _cv_wait_sig+0x138/frame 0x2d110a10 seltdwait(ffffffff,0,0) at seltdwait+0x8a/frame 0x2d110a2c kern_select(2d241000,a,20649000,0,0,0,20) at kern_select+0x826/frame 0x2d110bac sys_select(2d241000,2d24128c,166aa5e,4,0,...) at sys_select+0x41/frame 0x2d110be4 syscallenter(2d241000,2d110ca0,102e134,2,2d110e00,...) at syscallenter+0x4d8/frame 0x2d110c58 syscall(2d110ce8,3b,3b,3b,20649000,...) at syscall+0x84/frame 0x2d110cdc Xint0x80_syscall() at 0xffc033b7/frame 0x2d110cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x205d8ebb, esp = 0xffbfe940, ebp = 0xffbfe95c --- __bss_end() at 0x205d8ebb Tracing command devd pid 339 tid 100117 td 0x23d7e380 sched_switch(23d7e380,0,104) at sched_switch+0x598/frame 0x2d12390c mi_switch(104,0) at mi_switch+0x1de/frame 0x2d123940 sleepq_switch(0,1c15538,1f3fd70,23a7a9fc,1f0ff94,...) at sleepq_switch+0xe1/frame 0x2d123964 sleepq_catch_signals(cb,23d7e380,1c15538,23d7e380,2d1239c4,...) at sleepq_catch_signals+0x3b7/frame 0x2d123990 sleepq_timedwait_sig(216a2a24,0) at sleepq_timedwait_sig+0x17/frame 0x2d1239c0 _cv_timedwait_sig_sbt(216a2a24,216a2a10,33e80679,7ca,c0000000,3,200) at _cv_timedwait_sig_sbt+0x15a/frame 0x2d1239fc seltdwait(7ca,c0000000,3) at seltdwait+0x5e/frame 0x2d123a2c kern_select(23d7e380,6,ffbfcd98,0,0,2d123bd0,20) at kern_select+0x826/frame 0x2d123bac sys_select(23d7e380,23d7e60c,166aa5e,4,0,...) at sys_select+0x41/frame 0x2d123be4 syscallenter(23d7e380,2d123ce8,1,0,2d123e00,...) at syscallenter+0x4d8/frame 0x2d123c58 syscall(2d123ce8,3b,3b,3b,ffbfce18,...) at syscall+0x84/frame 0x2d123cdc Xint0x80_syscall() at 0xffc033b7/frame 0x2d123cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x4c42b7, esp = 0xffbfcd08, ebp = 0xffbfee2c --- (null)() at 0x4c42b7 Tracing command syncer pid 25 tid 100104 td 0x11bb6a80 sched_switch(11bb6a80,0,104) at sched_switch+0x598/frame 0x271f9b4c mi_switch(104,0) at mi_switch+0x1de/frame 0x271f9b7c sleepq_switch(cb,11bb6a80,1c15538,11bb6a80,271f9bd4,...) at sleepq_switch+0xe1/frame 0x271f9ba0 sleepq_timedwait(1f6ee64,0) at sleepq_timedwait+0x47/frame 0x271f9bd0 _cv_timedwait_sbt(1f6ee64,1f6ee44,fffffed8,0,0,0,100) at _cv_timedwait_sbt+0x157/frame 0x271f9c0c sched_sync(0,271f9ce8,163a3df,419,0,...) at sched_sync+0x5e3/frame 0x271f9c78 fork_exit(10a2c60,0,271f9ce8,0,0,...) at fork_exit+0x12f/frame 0x271f9cd4 fork_trampoline() at 0xffc033ca/frame 0x271f9cd4 --- trap 0, eip = 0, esp = 0x271f9d20, ebp = 0 --- (null)() at 0 Tracing command vnlru pid 24 tid 100103 td 0x11bb7000 sched_switch(11bb7000,0,104) at sched_switch+0x598/frame 0x271f4b34 mi_switch(104,0) at mi_switch+0x1de/frame 0x271f4b64 sleepq_switch(0,11bb7000,11bb7000,0,24866354,...) at sleepq_switch+0xe1/frame 0x271f4b88 sleepq_timedwait(24866354,60,271f4be8,fb4f35,1f10a84,...) at sleepq_timedwait+0x47/frame 0x271f4bb4 _sleep(24866354,1f6ee10,260,16a44de,fffffed8,0,0,0,100) at _sleep+0x23c/frame 0x271f4bf4 vnlru_proc(0,271f4ce8,163a3df,419,0,...) at vnlru_proc+0x8f/frame 0x271f4c78 fork_exit(10a2420,0,271f4ce8,0,0,...) at fork_exit+0x12f/frame 0x271f4cd4 fork_trampoline() at 0xffc033ca/frame 0x271f4cd4 --- trap 0, eip = 0, esp = 0x271f4d20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 23 tid 100100 td 0x11bb7380 sched_switch(11bb7380,0,104) at sched_switch+0x598/frame 0x2879bb24 mi_switch(104,0) at mi_switch+0x1de/frame 0x2879bb54 sleepq_switch(0,11bb7380,11bb7380,0,1f6e7f4,...) at sleepq_switch+0xe1/frame 0x2879bb78 sleepq_timedwait(1f6e7f4,54,11bb7380,8,2879bbe4,...) at sleepq_timedwait+0x47/frame 0x2879bba4 _sleep(1f6e7f4,1c21b80,54,15ca929,1999997c,...) at _sleep+0x23c/frame 0x2879bbe4 buf_daemon(0,2879bce8,163a3df,419,0,...) at buf_daemon+0x402/frame 0x2879bc78 fork_exit(1082910,0,2879bce8,0,0,...) at fork_exit+0x12f/frame 0x2879bcd4 fork_trampoline() at 0xffc033ca/frame 0x2879bcd4 --- trap 0, eip = 0, esp = 0x2879bd20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 23 tid 100102 td 0x23d7f700 sched_switch(23d7f700,0,104) at sched_switch+0x598/frame 0x287a5afc mi_switch(104,0) at mi_switch+0x1de/frame 0x287a5b2c sleepq_switch(1,23d7f700,23d7f700,0,1c22e80,...) at sleepq_switch+0xe1/frame 0x287a5b50 sleepq_timedwait(1c22e80,5c,23d7f700,8,287a5bbc,...) at sleepq_timedwait+0x47/frame 0x287a5b7c _sleep(1c22e80,1c22dc0,25c,15ce0ac,fffffed8,...) at _sleep+0x23c/frame 0x287a5bbc bufspace_daemon_wait(1c21c80,0,fd4e90,23d7f700,4e84,...) at bufspace_daemon_wait+0xf5/frame 0x287a5c0c bufspace_daemon(1c21c80,287a5ce8,163a3df,419,0,...) at bufspace_daemon+0x205/frame 0x287a5c78 fork_exit(1082d20,1c21c80,287a5ce8,0,0,...) at fork_exit+0x12f/frame 0x287a5cd4 fork_trampoline() at 0xffc033ca/frame 0x287a5cd4 --- trap 0, eip = 0, esp = 0x287a5d20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 23 tid 100118 td 0x23d7e000 sched_switch(23d7e000,0,104) at sched_switch+0x598/frame 0x2d128b7c mi_switch(104,0) at mi_switch+0x1de/frame 0x2d128bac sleepq_switch(2,23d7e000,23d7e000,0,2d270684,...) at sleepq_switch+0xe1/frame 0x2d128bd0 sleepq_timedwait(2d270684,54,2d128c30,fcdba0,2d270600,...) at sleepq_timedwait+0x47/frame 0x2d128bfc _sleep(2d270684,2d270600,54,15fb499,7fffff6c,0,0,0,100) at _sleep+0x23c/frame 0x2d128c3c softdep_flush(2497a000,2d128ce8,163a3df,419,0,...) at softdep_flush+0x15c/frame 0x2d128c78 fork_exit(12934e0,2497a000,2d128ce8,0,0,...) at fork_exit+0x12f/frame 0x2d128cd4 fork_trampoline() at 0xffc033ca/frame 0x2d128cd4 --- trap 0, eip = 0, esp = 0x2d128d20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 23 tid 100119 td 0x23ba9a80 sched_switch(23ba9a80,0,104) at sched_switch+0x598/frame 0x2d12db7c mi_switch(104,0) at mi_switch+0x1de/frame 0x2d12dbac sleepq_switch(0,23ba9a80,23ba9a80,0,2d270484,...) at sleepq_switch+0xe1/frame 0x2d12dbd0 sleepq_timedwait(2d270484,54,2d12dc30,fcdba0,2d270400,...) at sleepq_timedwait+0x47/frame 0x2d12dbfc _sleep(2d270484,2d270400,54,15fb499,7fffff6c,0,0,0,100) at _sleep+0x23c/frame 0x2d12dc3c softdep_flush(24979000,2d12dce8,163a3df,419,0,...) at softdep_flush+0x15c/frame 0x2d12dc78 fork_exit(12934e0,24979000,2d12dce8,0,0,...) at fork_exit+0x12f/frame 0x2d12dcd4 fork_trampoline() at 0xffc033ca/frame 0x2d12dcd4 --- trap 0, eip = 0, esp = 0x2d12dd20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 23 tid 100120 td 0x2d5c1a80 sched_switch(2d5c1a80,0,104) at sched_switch+0x598/frame 0x2d132b7c mi_switch(104,0) at mi_switch+0x1de/frame 0x2d132bac sleepq_switch(1,2d5c1a80,2d5c1a80,0,2d270284,...) at sleepq_switch+0xe1/frame 0x2d132bd0 sleepq_timedwait(2d270284,54,2d132c30,fcdba0,2d270200,...) at sleepq_timedwait+0x47/frame 0x2d132bfc _sleep(2d270284,2d270200,54,15fb499,7fffff6c,0,0,0,100) at _sleep+0x23c/frame 0x2d132c3c softdep_flush(2d5ac000,2d132ce8,163a3df,419,0,...) at softdep_flush+0x15c/frame 0x2d132c78 fork_exit(12934e0,2d5ac000,2d132ce8,0,0,...) at fork_exit+0x12f/frame 0x2d132cd4 fork_trampoline() at 0xffc033ca/frame 0x2d132cd4 --- trap 0, eip = 0, esp = 0x2d132d20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 23 tid 100121 td 0x2d5c1700 sched_switch(2d5c1700,0,104) at sched_switch+0x598/frame 0x2d137b7c mi_switch(104,0) at mi_switch+0x1de/frame 0x2d137bac sleepq_switch(3,2d5c1700,2d5c1700,0,2d270084,...) at sleepq_switch+0xe1/frame 0x2d137bd0 sleepq_timedwait(2d270084,54,2d137c30,fcdba0,2d270000,...) at sleepq_timedwait+0x47/frame 0x2d137bfc _sleep(2d270084,2d270000,54,15fb499,7fffff6c,0,0,0,100) at _sleep+0x23c/frame 0x2d137c3c softdep_flush(2d5ab000,2d137ce8,163a3df,419,0,...) at softdep_flush+0x15c/frame 0x2d137c78 fork_exit(12934e0,2d5ab000,2d137ce8,0,0,...) at fork_exit+0x12f/frame 0x2d137cd4 fork_trampoline() at 0xffc033ca/frame 0x2d137cd4 --- trap 0, eip = 0, esp = 0x2d137d20, ebp = 0 --- (null)() at 0 Tracing command vmdaemon pid 22 tid 100098 td 0x11bb7700 sched_switch(11bb7700,0,104) at sched_switch+0x598/frame 0x22d21aa4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22d21ad8 sleepq_switch(11bb7700,0,1f842b8,22d21b50,fe18a7,...) at sleepq_switch+0xe1/frame 0x22d21afc sleepq_wait(1f842b8,74) at sleepq_wait+0x3a/frame 0x22d21b10 _sleep(1f842b8,1f842a4,74,15ca922,0,...) at _sleep+0x307/frame 0x22d21b50 vm_daemon(0,22d21ce8,163a3df,419,0,...) at vm_daemon+0x104/frame 0x22d21c78 fork_exit(1307b90,0,22d21ce8,0,0,...) at fork_exit+0x12f/frame 0x22d21cd4 fork_trampoline() at 0xffc033ca/frame 0x22d21cd4 --- trap 0, eip = 0, esp = 0x22d21d20, ebp = 0 --- (null)() at 0 Tracing command pagedaemon pid 21 tid 100097 td 0x11bb7a80 sched_switch(11bb7a80,0,104) at sched_switch+0x598/frame 0x22d1cae4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22d1cb14 sleepq_switch(3,11bb7a80,11bb7a80,0,1fb885c,...) at sleepq_switch+0xe1/frame 0x22d1cb38 sleepq_timedwait(1fb885c,54,11bb7a80,8,22d1cba4,...) at sleepq_timedwait+0x47/frame 0x22d1cb64 _sleep(1fb885c,1fb8580,254,15ca922,1999997c,...) at _sleep+0x23c/frame 0x22d1cba4 vm_pageout_worker(0,14,1617cf4,0,0,0,160e492,0,4,0,0,22d1cc78,fb4f35,1,0,0,11bb7a80,11fca000) at vm_pageout_worker+0x21d/frame 0x22d1cc20 vm_pageout(0,22d1cce8,163a3df,419,0,...) at vm_pageout+0x233/frame 0x22d1cc78 fork_exit(12f9b10,0,22d1cce8,0,0,...) at fork_exit+0x12f/frame 0x22d1ccd4 fork_trampoline() at 0xffc033ca/frame 0x22d1ccd4 --- trap 0, eip = 0, esp = 0x22d1cd20, ebp = 0 --- (null)() at 0 Tracing command pagedaemon pid 21 tid 100099 td 0x23d80000 sched_switch(23d80000,0,104) at sched_switch+0x598/frame 0x28796b04 mi_switch(104,0) at mi_switch+0x1de/frame 0x28796b38 sleepq_switch(23d80000,0,1fb8868,28796bb0,fe18a7,...) at sleepq_switch+0xe1/frame 0x28796b5c sleepq_wait(1fb8868,54) at sleepq_wait+0x3a/frame 0x28796b70 _sleep(1fb8868,1fb84c0,54,16b9354,0,...) at _sleep+0x307/frame 0x28796bb0 vm_pageout_laundry_worker(0,28796ce8,163a3df,419,0,...) at vm_pageout_laundry_worker+0x560/frame 0x28796c78 fork_exit(12fa080,0,28796ce8,0,0,...) at fork_exit+0x12f/frame 0x28796cd4 fork_trampoline() at 0xffc033ca/frame 0x28796cd4 --- trap 0, eip = 0, esp = 0x28796d20, ebp = 0 --- (null)() at 0 Tracing command pagedaemon pid 21 tid 100101 td 0x23d7fa80 sched_switch(23d7fa80,0,104) at sched_switch+0x598/frame 0x287a0b7c mi_switch(104,0) at mi_switch+0x1de/frame 0x287a0bac sleepq_switch(105,23d7fa80,23d7fa80,0,1f83ecc,...) at sleepq_switch+0xe1/frame 0x287a0bd0 sleepq_timedwait(12cba90,54,1f15ba8,0,1617a63,...) at sleepq_timedwait+0x47/frame 0x287a0c00 _sleep(12cba90,1f83ecc,54,162a454,fffffed8,0,0,0,100) at _sleep+0x23c/frame 0x287a0c40 uma_reclaim_worker(0,287a0ce8,163a3df,419,0,...) at uma_reclaim_worker+0x104/frame 0x287a0c78 fork_exit(12cc160,0,287a0ce8,0,0,...) at fork_exit+0x12f/frame 0x287a0cd4 fork_trampoline() at 0xffc033ca/frame 0x287a0cd4 --- trap 0, eip = 0, esp = 0x287a0d20, ebp = 0 --- (null)() at 0 Tracing command rand_harvestq pid 20 tid 100094 td 0x243e7000 sched_switch(243e7000,0,104) at sched_switch+0x598/frame 0x22d0db54 mi_switch(104,0) at mi_switch+0x1de/frame 0x22d0db84 sleepq_switch(3,243e7000,243e7000,0,1d59d00,...) at sleepq_switch+0xe1/frame 0x22d0dba8 sleepq_timedwait(1d59d00,0,1d5edf4,0,22d0dc10,...) at sleepq_timedwait+0x47/frame 0x22d0dbd4 _sleep(1d59d00,0,0,15ce0ac,19999999,0,0,0,4) at _sleep+0x23c/frame 0x22d0dc14 random_kthread(0,22d0dce8,163a3df,419,0,...) at random_kthread+0x23e/frame 0x22d0dc78 fork_exit(d42fd0,0,22d0dce8,0,0,...) at fork_exit+0x12f/frame 0x22d0dcd4 fork_trampoline() at 0xffc033ca/frame 0x22d0dcd4 --- trap 0, eip = 0, esp = 0x22d0dd20, ebp = 0 --- (null)() at 0 Tracing command sctp_iterator pid 19 tid 100090 td 0x243e8000 sched_switch(243e8000,0,104) at sched_switch+0x598/frame 0x22cf5ba4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22cf5bd4 sleepq_switch(243e8000,0,1fb793c,22cf5c4c,fe18a7,...) at sleepq_switch+0xe1/frame 0x22cf5bf8 sleepq_wait(1fb793c,0) at sleepq_wait+0x3a/frame 0x22cf5c0c _sleep(1fb793c,1fb7904,0,15c2c8b,0,0,0,0,100) at _sleep+0x307/frame 0x22cf5c4c sctp_iterator_thread(0,22cf5ce8,163a3df,419,0,...) at sctp_iterator_thread+0x43/frame 0x22cf5c78 fork_exit(115cab0,0,22cf5ce8,0,0,...) at fork_exit+0x12f/frame 0x22cf5cd4 fork_trampoline() at 0xffc033ca/frame 0x22cf5cd4 --- trap 0, eip = 0, esp = 0x22cf5d20, ebp = 0 --- (null)() at 0 Tracing command soaiod4 pid 18 tid 100089 td 0x243e8380 sched_switch(243e8380,0,104) at sched_switch+0x598/frame 0x22cebb7c mi_switch(104,0) at mi_switch+0x1de/frame 0x22cebbac sleepq_switch(3,243e8380,243e8380,0,1f6e428,...) at sleepq_switch+0xe1/frame 0x22cebbd0 sleepq_timedwait(1f6e428,0,0,15d448c,1644f32,...) at sleepq_timedwait+0x47/frame 0x22cebbfc _sleep(1f6e428,1f6e408,0,15ce0ac,ffffdd50,1d,0,0,100) at _sleep+0x23c/frame 0x22cebc3c soaio_kproc_loop(4,22cebce8,163a3df,419,0,...) at soaio_kproc_loop+0x14b/frame 0x22cebc78 fork_exit(1045d40,4,22cebce8,0,0,...) at fork_exit+0x12f/frame 0x22cebcd4 fork_trampoline() at 0xffc033ca/frame 0x22cebcd4 --- trap 0, eip = 0, esp = 0x22cebd20, ebp = 0 --- (null)() at 0 Tracing command soaiod3 pid 17 tid 100088 td 0x243e8700 sched_switch(243e8700,0,104) at sched_switch+0x598/frame 0x22ce6b7c mi_switch(104,0) at mi_switch+0x1de/frame 0x22ce6bac sleepq_switch(2,243e8700,243e8700,0,1f6e428,...) at sleepq_switch+0xe1/frame 0x22ce6bd0 sleepq_timedwait(1f6e428,0,0,15d448c,1644f32,...) at sleepq_timedwait+0x47/frame 0x22ce6bfc _sleep(1f6e428,1f6e408,0,15ce0ac,ffffdd50,1d,0,0,100) at _sleep+0x23c/frame 0x22ce6c3c soaio_kproc_loop(3,22ce6ce8,163a3df,419,0,...) at soaio_kproc_loop+0x14b/frame 0x22ce6c78 fork_exit(1045d40,3,22ce6ce8,0,0,...) at fork_exit+0x12f/frame 0x22ce6cd4 fork_trampoline() at 0xffc033ca/frame 0x22ce6cd4 --- trap 0, eip = 0, esp = 0x22ce6d20, ebp = 0 --- (null)() at 0 Tracing command soaiod2 pid 16 tid 100087 td 0x243e8a80 sched_switch(243e8a80,0,104) at sched_switch+0x598/frame 0x22ce1b7c mi_switch(104,0) at mi_switch+0x1de/frame 0x22ce1bac sleepq_switch(3,243e8a80,243e8a80,0,1f6e428,...) at sleepq_switch+0xe1/frame 0x22ce1bd0 sleepq_timedwait(1f6e428,0,0,15d448c,1644f32,...) at sleepq_timedwait+0x47/frame 0x22ce1bfc _sleep(1f6e428,1f6e408,0,15ce0ac,ffffdd50,1d,0,0,100) at _sleep+0x23c/frame 0x22ce1c3c soaio_kproc_loop(2,22ce1ce8,163a3df,419,0,...) at soaio_kproc_loop+0x14b/frame 0x22ce1c78 fork_exit(1045d40,2,22ce1ce8,0,0,...) at fork_exit+0x12f/frame 0x22ce1cd4 fork_trampoline() at 0xffc033ca/frame 0x22ce1cd4 --- trap 0, eip = 0, esp = 0x22ce1d20, ebp = 0 --- (null)() at 0 Tracing command soaiod1 pid 9 tid 100086 td 0x243e9000 sched_switch(243e9000,0,104) at sched_switch+0x598/frame 0x22cdcb7c mi_switch(104,0) at mi_switch+0x1de/frame 0x22cdcbac sleepq_switch(0,243e9000,243e9000,0,1f6e428,...) at sleepq_switch+0xe1/frame 0x22cdcbd0 sleepq_timedwait(1f6e428,0,0,15d448c,1644f32,...) at sleepq_timedwait+0x47/frame 0x22cdcbfc _sleep(1f6e428,1f6e408,0,15ce0ac,ffffdd50,1d,0,0,100) at _sleep+0x23c/frame 0x22cdcc3c soaio_kproc_loop(1,22cdcce8,163a3df,419,0,...) at soaio_kproc_loop+0x14b/frame 0x22cdcc78 fork_exit(1045d40,1,22cdcce8,0,0,...) at fork_exit+0x12f/frame 0x22cdccd4 fork_trampoline() at 0xffc033ca/frame 0x22cdccd4 --- trap 0, eip = 0, esp = 0x22cdcd20, ebp = 0 --- (null)() at 0 Tracing command fdc0 pid 8 tid 100083 td 0x23d80a80 sched_switch(23d80a80,0,104) at sched_switch+0x598/frame 0x22ccdb54 mi_switch(104,0) at mi_switch+0x1de/frame 0x22ccdb88 sleepq_switch(23d80a80,0,216c383c,22ccdc00,fe18a7,...) at sleepq_switch+0xe1/frame 0x22ccdbac sleepq_wait(216c383c,5c) at sleepq_wait+0x3a/frame 0x22ccdbc0 _sleep(216c383c,216c38f8,5c,15ce0ac,0,0,0,0,100) at _sleep+0x307/frame 0x22ccdc00 fdc_thread(216c3800,22ccdce8,163a3df,419,0,...) at fdc_thread+0x10f1/frame 0x22ccdc78 fork_exit(14cd4b0,216c3800,22ccdce8,0,0,...) at fork_exit+0x12f/frame 0x22ccdcd4 fork_trampoline() at 0xffc033ca/frame 0x22ccdcd4 --- trap 0, eip = 0, esp = 0x22ccdd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100048 td 0x2171c000 sched_switch(2171c000,0,104) at sched_switch+0x598/frame 0x22c15bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22c15be8 sleepq_switch(2171c000,216fecf8,216feacc,22c15c58,f72005,...) at sleepq_switch+0xe1/frame 0x22c15c0c sleepq_wait(216feacc,0) at sleepq_wait+0x3a/frame 0x22c15c20 _cv_wait(216feacc,216fecf8) at _cv_wait+0x135/frame 0x22c15c58 usb_process(216feac4,22c15ce8,163a3df,419,0,...) at usb_process+0x104/frame 0x22c15c78 fork_exit(e3ce40,216feac4,22c15ce8,0,0,...) at fork_exit+0x12f/frame 0x22c15cd4 fork_trampoline() at 0xffc033ca/frame 0x22c15cd4 --- trap 0, eip = 0, esp = 0x22c15d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100049 td 0x2171ba80 sched_switch(2171ba80,0,104) at sched_switch+0x598/frame 0x22c1abb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22c1abe8 sleepq_switch(2171ba80,216fecf8,216feafc,22c1ac58,f72005,...) at sleepq_switch+0xe1/frame 0x22c1ac0c sleepq_wait(216feafc,0) at sleepq_wait+0x3a/frame 0x22c1ac20 _cv_wait(216feafc,216fecf8) at _cv_wait+0x135/frame 0x22c1ac58 usb_process(216feaf4,22c1ace8,163a3df,419,0,...) at usb_process+0x104/frame 0x22c1ac78 fork_exit(e3ce40,216feaf4,22c1ace8,0,0,...) at fork_exit+0x12f/frame 0x22c1acd4 fork_trampoline() at 0xffc033ca/frame 0x22c1acd4 --- trap 0, eip = 0, esp = 0x22c1ad20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100050 td 0x2171b700 sched_switch(2171b700,0,104) at sched_switch+0x598/frame 0x22c1fbb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22c1fbe8 sleepq_switch(2171b700,216fecf8,216feb2c,22c1fc58,f72005,...) at sleepq_switch+0xe1/frame 0x22c1fc0c sleepq_wait(216feb2c,0) at sleepq_wait+0x3a/frame 0x22c1fc20 _cv_wait(216feb2c,216fecf8) at _cv_wait+0x135/frame 0x22c1fc58 usb_process(216feb24,22c1fce8,163a3df,419,0,...) at usb_process+0x104/frame 0x22c1fc78 fork_exit(e3ce40,216feb24,22c1fce8,0,0,...) at fork_exit+0x12f/frame 0x22c1fcd4 fork_trampoline() at 0xffc033ca/frame 0x22c1fcd4 --- trap 0, eip = 0, esp = 0x22c1fd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100051 td 0x2171b380 sched_switch(2171b380,0,104) at sched_switch+0x598/frame 0x22c24bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22c24be8 sleepq_switch(2171b380,216fecf8,216feb5c,22c24c58,f72005,...) at sleepq_switch+0xe1/frame 0x22c24c0c sleepq_wait(216feb5c,0) at sleepq_wait+0x3a/frame 0x22c24c20 _cv_wait(216feb5c,216fecf8) at _cv_wait+0x135/frame 0x22c24c58 usb_process(216feb54,22c24ce8,163a3df,419,0,...) at usb_process+0x104/frame 0x22c24c78 fork_exit(e3ce40,216feb54,22c24ce8,0,0,...) at fork_exit+0x12f/frame 0x22c24cd4 fork_trampoline() at 0xffc033ca/frame 0x22c24cd4 --- trap 0, eip = 0, esp = 0x22c24d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100052 td 0x2171b000 sched_switch(2171b000,0,104) at sched_switch+0x598/frame 0x22c29bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22c29be8 sleepq_switch(2171b000,216fecf8,216feb8c,22c29c58,f72005,...) at sleepq_switch+0xe1/frame 0x22c29c0c sleepq_wait(216feb8c,0) at sleepq_wait+0x3a/frame 0x22c29c20 _cv_wait(216feb8c,216fecf8) at _cv_wait+0x135/frame 0x22c29c58 usb_process(216feb84,22c29ce8,163a3df,419,0,...) at usb_process+0x104/frame 0x22c29c78 fork_exit(e3ce40,216feb84,22c29ce8,0,0,...) at fork_exit+0x12f/frame 0x22c29cd4 fork_trampoline() at 0xffc033ca/frame 0x22c29cd4 --- trap 0, eip = 0, esp = 0x22c29d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100054 td 0x21711700 sched_switch(21711700,0,104) at sched_switch+0x598/frame 0x22c34bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22c34be8 sleepq_switch(21711700,23a85cf8,23a85acc,22c34c58,f72005,...) at sleepq_switch+0xe1/frame 0x22c34c0c sleepq_wait(23a85acc,0) at sleepq_wait+0x3a/frame 0x22c34c20 _cv_wait(23a85acc,23a85cf8) at _cv_wait+0x135/frame 0x22c34c58 usb_process(23a85ac4,22c34ce8,163a3df,419,0,...) at usb_process+0x104/frame 0x22c34c78 fork_exit(e3ce40,23a85ac4,22c34ce8,0,0,...) at fork_exit+0x12f/frame 0x22c34cd4 fork_trampoline() at 0xffc033ca/frame 0x22c34cd4 --- trap 0, eip = 0, esp = 0x22c34d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100055 td 0x21711380 sched_switch(21711380,0,104) at sched_switch+0x598/frame 0x22c39bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22c39be8 sleepq_switch(21711380,23a85cf8,23a85afc,22c39c58,f72005,...) at sleepq_switch+0xe1/frame 0x22c39c0c sleepq_wait(23a85afc,0) at sleepq_wait+0x3a/frame 0x22c39c20 _cv_wait(23a85afc,23a85cf8) at _cv_wait+0x135/frame 0x22c39c58 usb_process(23a85af4,22c39ce8,163a3df,419,0,...) at usb_process+0x104/frame 0x22c39c78 fork_exit(e3ce40,23a85af4,22c39ce8,0,0,...) at fork_exit+0x12f/frame 0x22c39cd4 fork_trampoline() at 0xffc033ca/frame 0x22c39cd4 --- trap 0, eip = 0, esp = 0x22c39d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100056 td 0x21711000 sched_switch(21711000,0,104) at sched_switch+0x598/frame 0x22c3ebb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22c3ebe8 sleepq_switch(21711000,23a85cf8,23a85b2c,22c3ec58,f72005,...) at sleepq_switch+0xe1/frame 0x22c3ec0c sleepq_wait(23a85b2c,0) at sleepq_wait+0x3a/frame 0x22c3ec20 _cv_wait(23a85b2c,23a85cf8) at _cv_wait+0x135/frame 0x22c3ec58 usb_process(23a85b24,22c3ece8,163a3df,419,0,...) at usb_process+0x104/frame 0x22c3ec78 fork_exit(e3ce40,23a85b24,22c3ece8,0,0,...) at fork_exit+0x12f/frame 0x22c3ecd4 fork_trampoline() at 0xffc033ca/frame 0x22c3ecd4 --- trap 0, eip = 0, esp = 0x22c3ed20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100057 td 0x23ad0380 sched_switch(23ad0380,0,104) at sched_switch+0x598/frame 0x22c43bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22c43be8 sleepq_switch(23ad0380,23a85cf8,23a85b5c,22c43c58,f72005,...) at sleepq_switch+0xe1/frame 0x22c43c0c sleepq_wait(23a85b5c,0) at sleepq_wait+0x3a/frame 0x22c43c20 _cv_wait(23a85b5c,23a85cf8) at _cv_wait+0x135/frame 0x22c43c58 usb_process(23a85b54,22c43ce8,163a3df,419,0,...) at usb_process+0x104/frame 0x22c43c78 fork_exit(e3ce40,23a85b54,22c43ce8,0,0,...) at fork_exit+0x12f/frame 0x22c43cd4 fork_trampoline() at 0xffc033ca/frame 0x22c43cd4 --- trap 0, eip = 0, esp = 0x22c43d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100058 td 0x23ad0000 sched_switch(23ad0000,0,104) at sched_switch+0x598/frame 0x22c48bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22c48be8 sleepq_switch(23ad0000,23a85cf8,23a85b8c,22c48c58,f72005,...) at sleepq_switch+0xe1/frame 0x22c48c0c sleepq_wait(23a85b8c,0) at sleepq_wait+0x3a/frame 0x22c48c20 _cv_wait(23a85b8c,23a85cf8) at _cv_wait+0x135/frame 0x22c48c58 usb_process(23a85b84,22c48ce8,163a3df,419,0,...) at usb_process+0x104/frame 0x22c48c78 fork_exit(e3ce40,23a85b84,22c48ce8,0,0,...) at fork_exit+0x12f/frame 0x22c48cd4 fork_trampoline() at 0xffc033ca/frame 0x22c48cd4 --- trap 0, eip = 0, esp = 0x22c48d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100060 td 0x23acf700 sched_switch(23acf700,0,104) at sched_switch+0x598/frame 0x22c53bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22c53be8 sleepq_switch(23acf700,23ad1cf8,23ad1acc,22c53c58,f72005,...) at sleepq_switch+0xe1/frame 0x22c53c0c sleepq_wait(23ad1acc,0) at sleepq_wait+0x3a/frame 0x22c53c20 _cv_wait(23ad1acc,23ad1cf8) at _cv_wait+0x135/frame 0x22c53c58 usb_process(23ad1ac4,22c53ce8,163a3df,419,0,...) at usb_process+0x104/frame 0x22c53c78 fork_exit(e3ce40,23ad1ac4,22c53ce8,0,0,...) at fork_exit+0x12f/frame 0x22c53cd4 fork_trampoline() at 0xffc033ca/frame 0x22c53cd4 --- trap 0, eip = 0, esp = 0x22c53d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100061 td 0x23acf380 sched_switch(23acf380,0,104) at sched_switch+0x598/frame 0x22c58bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22c58be8 sleepq_switch(23acf380,23ad1cf8,23ad1afc,22c58c58,f72005,...) at sleepq_switch+0xe1/frame 0x22c58c0c sleepq_wait(23ad1afc,0) at sleepq_wait+0x3a/frame 0x22c58c20 _cv_wait(23ad1afc,23ad1cf8) at _cv_wait+0x135/frame 0x22c58c58 usb_process(23ad1af4,22c58ce8,163a3df,419,0,...) at usb_process+0x104/frame 0x22c58c78 fork_exit(e3ce40,23ad1af4,22c58ce8,0,0,...) at fork_exit+0x12f/frame 0x22c58cd4 fork_trampoline() at 0xffc033ca/frame 0x22c58cd4 --- trap 0, eip = 0, esp = 0x22c58d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100062 td 0x23acf000 sched_switch(23acf000,0,104) at sched_switch+0x598/frame 0x22c5dbb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22c5dbe8 sleepq_switch(23acf000,23ad1cf8,23ad1b2c,22c5dc58,f72005,...) at sleepq_switch+0xe1/frame 0x22c5dc0c sleepq_wait(23ad1b2c,0) at sleepq_wait+0x3a/frame 0x22c5dc20 _cv_wait(23ad1b2c,23ad1cf8) at _cv_wait+0x135/frame 0x22c5dc58 usb_process(23ad1b24,22c5dce8,163a3df,419,0,...) at usb_process+0x104/frame 0x22c5dc78 fork_exit(e3ce40,23ad1b24,22c5dce8,0,0,...) at fork_exit+0x12f/frame 0x22c5dcd4 fork_trampoline() at 0xffc033ca/frame 0x22c5dcd4 --- trap 0, eip = 0, esp = 0x22c5dd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100063 td 0x23acea80 sched_switch(23acea80,0,104) at sched_switch+0x598/frame 0x22c62bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22c62be8 sleepq_switch(23acea80,23ad1cf8,23ad1b5c,22c62c58,f72005,...) at sleepq_switch+0xe1/frame 0x22c62c0c sleepq_wait(23ad1b5c,0) at sleepq_wait+0x3a/frame 0x22c62c20 _cv_wait(23ad1b5c,23ad1cf8) at _cv_wait+0x135/frame 0x22c62c58 usb_process(23ad1b54,22c62ce8,163a3df,419,0,...) at usb_process+0x104/frame 0x22c62c78 fork_exit(e3ce40,23ad1b54,22c62ce8,0,0,...) at fork_exit+0x12f/frame 0x22c62cd4 fork_trampoline() at 0xffc033ca/frame 0x22c62cd4 --- trap 0, eip = 0, esp = 0x22c62d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100064 td 0x23ace700 sched_switch(23ace700,0,104) at sched_switch+0x598/frame 0x22c67bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22c67be8 sleepq_switch(23ace700,23ad1cf8,23ad1b8c,22c67c58,f72005,...) at sleepq_switch+0xe1/frame 0x22c67c0c sleepq_wait(23ad1b8c,0) at sleepq_wait+0x3a/frame 0x22c67c20 _cv_wait(23ad1b8c,23ad1cf8) at _cv_wait+0x135/frame 0x22c67c58 usb_process(23ad1b84,22c67ce8,163a3df,419,0,...) at usb_process+0x104/frame 0x22c67c78 fork_exit(e3ce40,23ad1b84,22c67ce8,0,0,...) at fork_exit+0x12f/frame 0x22c67cd4 fork_trampoline() at 0xffc033ca/frame 0x22c67cd4 --- trap 0, eip = 0, esp = 0x22c67d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100065 td 0x23ace380 sched_switch(23ace380,0,104) at sched_switch+0x598/frame 0x22c6dbb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22c6dbe8 sleepq_switch(23ace380,23b19cf8,23b19acc,22c6dc58,f72005,...) at sleepq_switch+0xe1/frame 0x22c6dc0c sleepq_wait(23b19acc,0) at sleepq_wait+0x3a/frame 0x22c6dc20 _cv_wait(23b19acc,23b19cf8) at _cv_wait+0x135/frame 0x22c6dc58 usb_process(23b19ac4,22c6dce8,163a3df,419,0,...) at usb_process+0x104/frame 0x22c6dc78 fork_exit(e3ce40,23b19ac4,22c6dce8,0,0,...) at fork_exit+0x12f/frame 0x22c6dcd4 fork_trampoline() at 0xffc033ca/frame 0x22c6dcd4 --- trap 0, eip = 0, esp = 0x22c6dd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100066 td 0x23ace000 sched_switch(23ace000,0,104) at sched_switch+0x598/frame 0x22c72bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22c72be8 sleepq_switch(23ace000,23b19cf8,23b19afc,22c72c58,f72005,...) at sleepq_switch+0xe1/frame 0x22c72c0c sleepq_wait(23b19afc,0) at sleepq_wait+0x3a/frame 0x22c72c20 _cv_wait(23b19afc,23b19cf8) at _cv_wait+0x135/frame 0x22c72c58 usb_process(23b19af4,22c72ce8,163a3df,419,0,...) at usb_process+0x104/frame 0x22c72c78 fork_exit(e3ce40,23b19af4,22c72ce8,0,0,...) at fork_exit+0x12f/frame 0x22c72cd4 fork_trampoline() at 0xffc033ca/frame 0x22c72cd4 --- trap 0, eip = 0, esp = 0x22c72d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100067 td 0x2171da80 sched_switch(2171da80,0,104) at sched_switch+0x598/frame 0x22c77bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22c77be8 sleepq_switch(2171da80,23b19cf8,23b19b2c,22c77c58,f72005,...) at sleepq_switch+0xe1/frame 0x22c77c0c sleepq_wait(23b19b2c,0) at sleepq_wait+0x3a/frame 0x22c77c20 _cv_wait(23b19b2c,23b19cf8) at _cv_wait+0x135/frame 0x22c77c58 usb_process(23b19b24,22c77ce8,163a3df,419,0,...) at usb_process+0x104/frame 0x22c77c78 fork_exit(e3ce40,23b19b24,22c77ce8,0,0,...) at fork_exit+0x12f/frame 0x22c77cd4 fork_trampoline() at 0xffc033ca/frame 0x22c77cd4 --- trap 0, eip = 0, esp = 0x22c77d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100068 td 0x2171d700 sched_switch(2171d700,0,104) at sched_switch+0x598/frame 0x22c7cbb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22c7cbe8 sleepq_switch(2171d700,23b19cf8,23b19b5c,22c7cc58,f72005,...) at sleepq_switch+0xe1/frame 0x22c7cc0c sleepq_wait(23b19b5c,0) at sleepq_wait+0x3a/frame 0x22c7cc20 _cv_wait(23b19b5c,23b19cf8) at _cv_wait+0x135/frame 0x22c7cc58 usb_process(23b19b54,22c7cce8,163a3df,419,0,...) at usb_process+0x104/frame 0x22c7cc78 fork_exit(e3ce40,23b19b54,22c7cce8,0,0,...) at fork_exit+0x12f/frame 0x22c7ccd4 fork_trampoline() at 0xffc033ca/frame 0x22c7ccd4 --- trap 0, eip = 0, esp = 0x22c7cd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100069 td 0x2171d380 sched_switch(2171d380,0,104) at sched_switch+0x598/frame 0x22c81bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22c81be8 sleepq_switch(2171d380,23b19cf8,23b19b8c,22c81c58,f72005,...) at sleepq_switch+0xe1/frame 0x22c81c0c sleepq_wait(23b19b8c,0) at sleepq_wait+0x3a/frame 0x22c81c20 _cv_wait(23b19b8c,23b19cf8) at _cv_wait+0x135/frame 0x22c81c58 usb_process(23b19b84,22c81ce8,163a3df,419,0,...) at usb_process+0x104/frame 0x22c81c78 fork_exit(e3ce40,23b19b84,22c81ce8,0,0,...) at fork_exit+0x12f/frame 0x22c81cd4 fork_trampoline() at 0xffc033ca/frame 0x22c81cd4 --- trap 0, eip = 0, esp = 0x22c81d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100070 td 0x23ba9700 sched_switch(23ba9700,0,104) at sched_switch+0x598/frame 0x22c87bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22c87be8 sleepq_switch(23ba9700,23b61cf8,23b61acc,22c87c58,f72005,...) at sleepq_switch+0xe1/frame 0x22c87c0c sleepq_wait(23b61acc,0) at sleepq_wait+0x3a/frame 0x22c87c20 _cv_wait(23b61acc,23b61cf8) at _cv_wait+0x135/frame 0x22c87c58 usb_process(23b61ac4,22c87ce8,163a3df,419,0,...) at usb_process+0x104/frame 0x22c87c78 fork_exit(e3ce40,23b61ac4,22c87ce8,0,0,...) at fork_exit+0x12f/frame 0x22c87cd4 fork_trampoline() at 0xffc033ca/frame 0x22c87cd4 --- trap 0, eip = 0, esp = 0x22c87d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100071 td 0x23ba9380 sched_switch(23ba9380,0,104) at sched_switch+0x598/frame 0x22c8cbb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22c8cbe8 sleepq_switch(23ba9380,23b61cf8,23b61afc,22c8cc58,f72005,...) at sleepq_switch+0xe1/frame 0x22c8cc0c sleepq_wait(23b61afc,0) at sleepq_wait+0x3a/frame 0x22c8cc20 _cv_wait(23b61afc,23b61cf8) at _cv_wait+0x135/frame 0x22c8cc58 usb_process(23b61af4,22c8cce8,163a3df,419,0,...) at usb_process+0x104/frame 0x22c8cc78 fork_exit(e3ce40,23b61af4,22c8cce8,0,0,...) at fork_exit+0x12f/frame 0x22c8ccd4 fork_trampoline() at 0xffc033ca/frame 0x22c8ccd4 --- trap 0, eip = 0, esp = 0x22c8cd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100072 td 0x23ba9000 sched_switch(23ba9000,0,104) at sched_switch+0x598/frame 0x22c91bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22c91be8 sleepq_switch(23ba9000,23b61cf8,23b61b2c,22c91c58,f72005,...) at sleepq_switch+0xe1/frame 0x22c91c0c sleepq_wait(23b61b2c,0) at sleepq_wait+0x3a/frame 0x22c91c20 _cv_wait(23b61b2c,23b61cf8) at _cv_wait+0x135/frame 0x22c91c58 usb_process(23b61b24,22c91ce8,163a3df,419,0,...) at usb_process+0x104/frame 0x22c91c78 fork_exit(e3ce40,23b61b24,22c91ce8,0,0,...) at fork_exit+0x12f/frame 0x22c91cd4 fork_trampoline() at 0xffc033ca/frame 0x22c91cd4 --- trap 0, eip = 0, esp = 0x22c91d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100073 td 0x23ba8a80 sched_switch(23ba8a80,0,104) at sched_switch+0x598/frame 0x22c96bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22c96be8 sleepq_switch(23ba8a80,23b61cf8,23b61b5c,22c96c58,f72005,...) at sleepq_switch+0xe1/frame 0x22c96c0c sleepq_wait(23b61b5c,0) at sleepq_wait+0x3a/frame 0x22c96c20 _cv_wait(23b61b5c,23b61cf8) at _cv_wait+0x135/frame 0x22c96c58 usb_process(23b61b54,22c96ce8,163a3df,419,0,...) at usb_process+0x104/frame 0x22c96c78 fork_exit(e3ce40,23b61b54,22c96ce8,0,0,...) at fork_exit+0x12f/frame 0x22c96cd4 fork_trampoline() at 0xffc033ca/frame 0x22c96cd4 --- trap 0, eip = 0, esp = 0x22c96d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100074 td 0x23ba8700 sched_switch(23ba8700,0,104) at sched_switch+0x598/frame 0x22c9bbb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22c9bbe8 sleepq_switch(23ba8700,23b61cf8,23b61b8c,22c9bc58,f72005,...) at sleepq_switch+0xe1/frame 0x22c9bc0c sleepq_wait(23b61b8c,0) at sleepq_wait+0x3a/frame 0x22c9bc20 _cv_wait(23b61b8c,23b61cf8) at _cv_wait+0x135/frame 0x22c9bc58 usb_process(23b61b84,22c9bce8,163a3df,419,0,...) at usb_process+0x104/frame 0x22c9bc78 fork_exit(e3ce40,23b61b84,22c9bce8,0,0,...) at fork_exit+0x12f/frame 0x22c9bcd4 fork_trampoline() at 0xffc033ca/frame 0x22c9bcd4 --- trap 0, eip = 0, esp = 0x22c9bd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100076 td 0x23ba8000 sched_switch(23ba8000,0,104) at sched_switch+0x598/frame 0x22ca6bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22ca6be8 sleepq_switch(23ba8000,216f8ed0,216f8ca4,22ca6c58,f72005,...) at sleepq_switch+0xe1/frame 0x22ca6c0c sleepq_wait(216f8ca4,0) at sleepq_wait+0x3a/frame 0x22ca6c20 _cv_wait(216f8ca4,216f8ed0) at _cv_wait+0x135/frame 0x22ca6c58 usb_process(216f8c9c,22ca6ce8,163a3df,419,0,...) at usb_process+0x104/frame 0x22ca6c78 fork_exit(e3ce40,216f8c9c,22ca6ce8,0,0,...) at fork_exit+0x12f/frame 0x22ca6cd4 fork_trampoline() at 0xffc033ca/frame 0x22ca6cd4 --- trap 0, eip = 0, esp = 0x22ca6d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100077 td 0x23ba7a80 sched_switch(23ba7a80,0,104) at sched_switch+0x598/frame 0x22cabbb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22cabbe8 sleepq_switch(23ba7a80,216f8ed0,216f8cd4,22cabc58,f72005,...) at sleepq_switch+0xe1/frame 0x22cabc0c sleepq_wait(216f8cd4,0) at sleepq_wait+0x3a/frame 0x22cabc20 _cv_wait(216f8cd4,216f8ed0) at _cv_wait+0x135/frame 0x22cabc58 usb_process(216f8ccc,22cabce8,163a3df,419,0,...) at usb_process+0x104/frame 0x22cabc78 fork_exit(e3ce40,216f8ccc,22cabce8,0,0,...) at fork_exit+0x12f/frame 0x22cabcd4 fork_trampoline() at 0xffc033ca/frame 0x22cabcd4 --- trap 0, eip = 0, esp = 0x22cabd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100078 td 0x23ba7700 sched_switch(23ba7700,0,104) at sched_switch+0x598/frame 0x22cb0bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22cb0be8 sleepq_switch(23ba7700,216f8ed0,216f8d04,22cb0c58,f72005,...) at sleepq_switch+0xe1/frame 0x22cb0c0c sleepq_wait(216f8d04,0) at sleepq_wait+0x3a/frame 0x22cb0c20 _cv_wait(216f8d04,216f8ed0) at _cv_wait+0x135/frame 0x22cb0c58 usb_process(216f8cfc,22cb0ce8,163a3df,419,0,...) at usb_process+0x104/frame 0x22cb0c78 fork_exit(e3ce40,216f8cfc,22cb0ce8,0,0,...) at fork_exit+0x12f/frame 0x22cb0cd4 fork_trampoline() at 0xffc033ca/frame 0x22cb0cd4 --- trap 0, eip = 0, esp = 0x22cb0d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100079 td 0x23ba7380 sched_switch(23ba7380,0,104) at sched_switch+0x598/frame 0x22cb5bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22cb5be8 sleepq_switch(23ba7380,216f8ed0,216f8d34,22cb5c58,f72005,...) at sleepq_switch+0xe1/frame 0x22cb5c0c sleepq_wait(216f8d34,0) at sleepq_wait+0x3a/frame 0x22cb5c20 _cv_wait(216f8d34,216f8ed0) at _cv_wait+0x135/frame 0x22cb5c58 usb_process(216f8d2c,22cb5ce8,163a3df,419,0,...) at usb_process+0x104/frame 0x22cb5c78 fork_exit(e3ce40,216f8d2c,22cb5ce8,0,0,...) at fork_exit+0x12f/frame 0x22cb5cd4 fork_trampoline() at 0xffc033ca/frame 0x22cb5cd4 --- trap 0, eip = 0, esp = 0x22cb5d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100080 td 0x23ba7000 sched_switch(23ba7000,0,104) at sched_switch+0x598/frame 0x22cbabb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22cbabe8 sleepq_switch(23ba7000,216f8ed0,216f8d64,22cbac58,f72005,...) at sleepq_switch+0xe1/frame 0x22cbac0c sleepq_wait(216f8d64,0) at sleepq_wait+0x3a/frame 0x22cbac20 _cv_wait(216f8d64,216f8ed0) at _cv_wait+0x135/frame 0x22cbac58 usb_process(216f8d5c,22cbace8,163a3df,419,0,...) at usb_process+0x104/frame 0x22cbac78 fork_exit(e3ce40,216f8d5c,22cbace8,0,0,...) at fork_exit+0x12f/frame 0x22cbacd4 fork_trampoline() at 0xffc033ca/frame 0x22cbacd4 --- trap 0, eip = 0, esp = 0x22cbad20, ebp = 0 --- (null)() at 0 Tracing command cam pid 7 tid 100043 td 0x11bb8000 sched_switch(11bb8000,0,104) at sched_switch+0x598/frame 0x1b7c8b84 mi_switch(104,0) at mi_switch+0x1de/frame 0x1b7c8bb4 sleepq_switch(11bb8000,0,1c931c0,1b7c8c2c,fe18a7,...) at sleepq_switch+0xe1/frame 0x1b7c8bd8 sleepq_wait(1c931c0,5c) at sleepq_wait+0x3a/frame 0x1b7c8bec _sleep(1c931c0,1c93180,5c,15ce0ac,0,0,0,0,100) at _sleep+0x307/frame 0x1b7c8c2c xpt_done_td(1c93180,1b7c8ce8,163a3df,419,0,...) at xpt_done_td+0x72/frame 0x1b7c8c78 fork_exit(90a1f0,1c93180,1b7c8ce8,0,0,...) at fork_exit+0x12f/frame 0x1b7c8cd4 fork_trampoline() at 0xffc033ca/frame 0x1b7c8cd4 --- trap 0, eip = 0, esp = 0x1b7c8d20, ebp = 0 --- (null)() at 0 Tracing command cam pid 7 tid 100096 td 0x243d1700 sched_switch(243d1700,0,104) at sched_switch+0x598/frame 0x22d17b7c mi_switch(104,0) at mi_switch+0x1de/frame 0x22d17bac sleepq_switch(243d1700,0,1c930ec,22d17c24,fe18a7,...) at sleepq_switch+0xe1/frame 0x22d17bd0 sleepq_wait(1c930ec,5c) at sleepq_wait+0x3a/frame 0x22d17be4 _sleep(1c930ec,1c9314c,5c,15ce0ac,0,0,0,0,100) at _sleep+0x307/frame 0x22d17c24 xpt_scanner_thread(0,22d17ce8,163a3df,419,0,...) at xpt_scanner_thread+0x63/frame 0x22d17c78 fork_exit(90a490,0,22d17ce8,0,0,...) at fork_exit+0x12f/frame 0x22d17cd4 fork_trampoline() at 0xffc033ca/frame 0x22d17cd4 --- trap 0, eip = 0, esp = 0x22d17d20, ebp = 0 --- (null)() at 0 Tracing command crypto returns 3 pid 6 tid 100042 td 0x11bb8380 sched_switch(11bb8380,0,104) at sched_switch+0x598/frame 0x1b7c3b7c mi_switch(104,0) at mi_switch+0x1de/frame 0x1b7c3bac sleepq_switch(11bb8380,0,11bb40c4,1b7c3c24,fe18a7,...) at sleepq_switch+0xe1/frame 0x1b7c3bd0 sleepq_wait(11bb40c4,6c) at sleepq_wait+0x3a/frame 0x1b7c3be4 _sleep(11bb40c4,11bb40a8,6c,16aecc9,0,0,0,0,100) at _sleep+0x307/frame 0x1b7c3c24 crypto_ret_proc(11bb40a8,1b7c3ce8,163a3df,419,0,...) at crypto_ret_proc+0x1e9/frame 0x1b7c3c78 fork_exit(1245010,11bb40a8,1b7c3ce8,0,0,...) at fork_exit+0x12f/frame 0x1b7c3cd4 fork_trampoline() at 0xffc033ca/frame 0x1b7c3cd4 --- trap 0, eip = 0, esp = 0x1b7c3d20, ebp = 0 --- (null)() at 0 Tracing command crypto returns 2 pid 5 tid 100041 td 0x11bb8700 sched_switch(11bb8700,0,104) at sched_switch+0x598/frame 0x1b7beb7c mi_switch(104,0) at mi_switch+0x1de/frame 0x1b7bebac sleepq_switch(11bb8700,0,11bb408c,1b7bec24,fe18a7,...) at sleepq_switch+0xe1/frame 0x1b7bebd0 sleepq_wait(11bb408c,6c) at sleepq_wait+0x3a/frame 0x1b7bebe4 _sleep(11bb408c,11bb4070,6c,16aecc9,0,0,0,0,100) at _sleep+0x307/frame 0x1b7bec24 crypto_ret_proc(11bb4070,1b7bece8,163a3df,419,0,...) at crypto_ret_proc+0x1e9/frame 0x1b7bec78 fork_exit(1245010,11bb4070,1b7bece8,0,0,...) at fork_exit+0x12f/frame 0x1b7becd4 fork_trampoline() at 0xffc033ca/frame 0x1b7becd4 --- trap 0, eip = 0, esp = 0x1b7bed20, ebp = 0 --- (null)() at 0 Tracing command crypto returns 1 pid 4 tid 100040 td 0x11bb8a80 sched_switch(11bb8a80,0,104) at sched_switch+0x598/frame 0x1b7b9b7c mi_switch(104,0) at mi_switch+0x1de/frame 0x1b7b9bac sleepq_switch(11bb8a80,0,11bb4054,1b7b9c24,fe18a7,...) at sleepq_switch+0xe1/frame 0x1b7b9bd0 sleepq_wait(11bb4054,6c) at sleepq_wait+0x3a/frame 0x1b7b9be4 _sleep(11bb4054,11bb4038,6c,16aecc9,0,0,0,0,100) at _sleep+0x307/frame 0x1b7b9c24 crypto_ret_proc(11bb4038,1b7b9ce8,163a3df,419,0,...) at crypto_ret_proc+0x1e9/frame 0x1b7b9c78 fork_exit(1245010,11bb4038,1b7b9ce8,0,0,...) at fork_exit+0x12f/frame 0x1b7b9cd4 fork_trampoline() at 0xffc033ca/frame 0x1b7b9cd4 --- trap 0, eip = 0, esp = 0x1b7b9d20, ebp = 0 --- (null)() at 0 Tracing command crypto returns 0 pid 3 tid 100039 td 0x11ad9700 sched_switch(11ad9700,0,104) at sched_switch+0x598/frame 0x1b7b4b7c mi_switch(104,0) at mi_switch+0x1de/frame 0x1b7b4bac sleepq_switch(11ad9700,0,11bb401c,1b7b4c24,fe18a7,...) at sleepq_switch+0xe1/frame 0x1b7b4bd0 sleepq_wait(11bb401c,6c) at sleepq_wait+0x3a/frame 0x1b7b4be4 _sleep(11bb401c,11bb4000,6c,16aecc9,0,0,0,0,100) at _sleep+0x307/frame 0x1b7b4c24 crypto_ret_proc(11bb4000,1b7b4ce8,163a3df,419,0,...) at crypto_ret_proc+0x1e9/frame 0x1b7b4c78 fork_exit(1245010,11bb4000,1b7b4ce8,0,0,...) at fork_exit+0x12f/frame 0x1b7b4cd4 fork_trampoline() at 0xffc033ca/frame 0x1b7b4cd4 --- trap 0, eip = 0, esp = 0x1b7b4d20, ebp = 0 --- (null)() at 0 Tracing command crypto pid 2 tid 100038 td 0x11ad9a80 sched_switch(11ad9a80,0,104) at sched_switch+0x598/frame 0x1b7afb8c mi_switch(104,0) at mi_switch+0x1de/frame 0x1b7afbc0 sleepq_switch(11ad9a80,0,1f83078,1b7afc38,fe18a7,...) at sleepq_switch+0xe1/frame 0x1b7afbe4 sleepq_wait(1f83078,6c) at sleepq_wait+0x3a/frame 0x1b7afbf8 _sleep(1f83078,1f83060,6c,1663508,0,0,0,0,100) at _sleep+0x307/frame 0x1b7afc38 crypto_proc(0,1b7afce8,163a3df,419,0,...) at crypto_proc+0x250/frame 0x1b7afc78 fork_exit(1244c90,0,1b7afce8,0,0,...) at fork_exit+0x12f/frame 0x1b7afcd4 fork_trampoline() at 0xffc033ca/frame 0x1b7afcd4 --- trap 0, eip = 0, esp = 0x1b7afd20, ebp = 0 --- (null)() at 0 Tracing command sequencer 00 pid 14 tid 100033 td 0x11e62000 sched_switch(11e62000,0,104) at sched_switch+0x598/frame 0x1b796b8c mi_switch(104,0) at mi_switch+0x1de/frame 0x1b796bc0 sleepq_switch(11e62000,11a7e604,11a7e64c,1b796c30,f72005,...) at sleepq_switch+0xe1/frame 0x1b796be4 sleepq_wait(11a7e64c,0) at sleepq_wait+0x3a/frame 0x1b796bf8 _cv_wait(11a7e64c,11a7e604) at _cv_wait+0x135/frame 0x1b796c30 seq_eventthread(11a7e600,1b796ce8,163a3df,419,0,...) at seq_eventthread+0xcb/frame 0x1b796c78 fork_exit(dc5340,11a7e600,1b796ce8,0,0,...) at fork_exit+0x12f/frame 0x1b796cd4 fork_trampoline() at 0xffc033ca/frame 0x1b796cd4 --- trap 0, eip = 0, esp = 0x1b796d20, ebp = 0 --- (null)() at 0 Tracing command geom pid 13 tid 100030 td 0x11e62a80 sched_switch(11e62a80,0,104) at sched_switch+0x598/frame 0x1b783b94 mi_switch(104,0) at mi_switch+0x1de/frame 0x1b783bc8 sleepq_switch(11e62a80,0,1fa78e4,1b783c40,fe18a7,...) at sleepq_switch+0xe1/frame 0x1b783bec sleepq_wait(1fa78e4,5c) at sleepq_wait+0x3a/frame 0x1b783c00 _sleep(1fa78e4,1eef06c,25c,15ce0ac,0,0,0,0,100) at _sleep+0x307/frame 0x1b783c40 g_run_events(0,1b783ce8,163a3df,419,0,...) at g_run_events+0x47/frame 0x1b783c78 fork_exit(f28100,0,1b783ce8,0,0,...) at fork_exit+0x12f/frame 0x1b783cd4 fork_trampoline() at 0xffc033ca/frame 0x1b783cd4 --- trap 0, eip = 0, esp = 0x1b783d20, ebp = 0 --- (null)() at 0 Tracing command geom pid 13 tid 100031 td 0x11e62700 sched_switch(11e62700,0,104) at sched_switch+0x598/frame 0x1b788b8c mi_switch(104,0) at mi_switch+0x1de/frame 0x1b788bc0 sleepq_switch(11e62700,0,1fa78ec,1b788c38,fe18a7,...) at sleepq_switch+0xe1/frame 0x1b788be4 sleepq_wait(1fa78ec,5c) at sleepq_wait+0x3a/frame 0x1b788bf8 _sleep(1fa78ec,1eef0b4,25c,15ce0ac,0,0,0,0,100) at _sleep+0x307/frame 0x1b788c38 g_io_schedule_up(11e62700) at g_io_schedule_up+0x8e/frame 0x1b788c6c g_up_procbody(0,1b788ce8,163a3df,419,0,...) at g_up_procbody+0x5b/frame 0x1b788c78 fork_exit(f28150,0,1b788ce8,0,0,...) at fork_exit+0x12f/frame 0x1b788cd4 fork_trampoline() at 0xffc033ca/frame 0x1b788cd4 --- trap 0, eip = 0, esp = 0x1b788d20, ebp = 0 --- (null)() at 0 Tracing command geom pid 13 tid 100032 td 0x11e62380 sched_switch(11e62380,0,104) at sched_switch+0x598/frame 0x1b78db8c mi_switch(104,0) at mi_switch+0x1de/frame 0x1b78dbbc sleepq_switch(11e62380,0,1fa78e0,1b78dc34,fe18a7,...) at sleepq_switch+0xe1/frame 0x1b78dbe0 sleepq_wait(1fa78e0,5c) at sleepq_wait+0x3a/frame 0x1b78dbf4 _sleep(1fa78e0,1eef094,25c,15ce0ac,0,0,0,0,100) at _sleep+0x307/frame 0x1b78dc34 g_io_schedule_down(11e62380) at g_io_schedule_down+0xa6/frame 0x1b78dc6c g_down_procbody(0,1b78dce8,163a3df,419,0,...) at g_down_procbody+0x5b/frame 0x1b78dc78 fork_exit(f281b0,0,1b78dce8,0,0,...) at fork_exit+0x12f/frame 0x1b78dcd4 fork_trampoline() at 0xffc033ca/frame 0x1b78dcd4 --- trap 0, eip = 0, esp = 0x1b78dd20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100008 td 0x11fd8380 sched_switch(11fd8380,0,109) at sched_switch+0x598/frame 0x1b6f1c14 mi_switch(109,0) at mi_switch+0x1de/frame 0x1b6f1c44 ithread_loop(11ad0020,1b6f1ce8,163a3df,419,0,...) at ithread_loop+0x2f5/frame 0x1b6f1c78 fork_exit(f9a940,11ad0020,1b6f1ce8,0,0,...) at fork_exit+0x12f/frame 0x1b6f1cd4 fork_trampoline() at 0xffc033ca/frame 0x1b6f1cd4 --- trap 0, eip = 0, esp = 0x1b6f1d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100009 td 0x11fd8000 sched_switch(11fd8000,0,109) at sched_switch+0x598/frame 0x1b6f6c14 mi_switch(109,0) at mi_switch+0x1de/frame 0x1b6f6c44 ithread_loop(11ad0010,1b6f6ce8,163a3df,419,0,...) at ithread_loop+0x2f5/frame 0x1b6f6c78 fork_exit(f9a940,11ad0010,1b6f6ce8,0,0,...) at fork_exit+0x12f/frame 0x1b6f6cd4 fork_trampoline() at 0xffc033ca/frame 0x1b6f6cd4 --- trap 0, eip = 0, esp = 0x1b6f6d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100011 td 0x11fce700 __bss_end() at 0xffc033c0 Tracing command intr pid 12 tid 100023 td 0x11ad7000 sched_switch(11ad7000,0,109) at sched_switch+0x598/frame 0x1b748c14 mi_switch(109,0) at mi_switch+0x1de/frame 0x1b748c44 ithread_loop(11acff90,1b748ce8,163a3df,419,0,...) at ithread_loop+0x2f5/frame 0x1b748c78 fork_exit(f9a940,11acff90,1b748ce8,0,0,...) at fork_exit+0x12f/frame 0x1b748cd4 fork_trampoline() at 0xffc033ca/frame 0x1b748cd4 --- trap 0, eip = 0, esp = 0x1b748d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100024 td 0x11fdaa80 __bss_end() at 0xffc033c0 Tracing command intr pid 12 tid 100025 td 0x11fda700 __bss_end() at 0xffc033c0 Tracing command intr pid 12 tid 100026 td 0x11fda380 __bss_end() at 0xffc033c0 Tracing command intr pid 12 tid 100027 td 0x11e5c700 sched_switch(11e5c700,0,109) at sched_switch+0x598/frame 0x1b75cc14 mi_switch(109,0) at mi_switch+0x1de/frame 0x1b75cc44 ithread_loop(11acff50,1b75cce8,163a3df,419,0,...) at ithread_loop+0x2f5/frame 0x1b75cc78 fork_exit(f9a940,11acff50,1b75cce8,0,0,...) at fork_exit+0x12f/frame 0x1b75ccd4 fork_trampoline() at 0xffc033ca/frame 0x1b75ccd4 --- trap 0, eip = 0, esp = 0x1b75cd20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100028 td 0x11e5c380 __bss_end() at 0xffc033c0 Tracing command intr pid 12 tid 100044 td 0x2171d000 sched_switch(2171d000,0,109) at sched_switch+0x598/frame 0x1b7fac14 mi_switch(109,0) at mi_switch+0x1de/frame 0x1b7fac44 ithread_loop(21710050,1b7face8,163a3df,419,0,...) at ithread_loop+0x2f5/frame 0x1b7fac78 fork_exit(f9a940,21710050,1b7face8,0,0,...) at fork_exit+0x12f/frame 0x1b7facd4 fork_trampoline() at 0xffc033ca/frame 0x1b7facd4 --- trap 0, eip = 0, esp = 0x1b7fad20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100045 td 0x2171ca80 sched_switch(2171ca80,0,109) at sched_switch+0x598/frame 0x22c04c14 mi_switch(109,0) at mi_switch+0x1de/frame 0x22c04c44 ithread_loop(21710040,22c04ce8,163a3df,419,0,...) at ithread_loop+0x2f5/frame 0x22c04c78 fork_exit(f9a940,21710040,22c04ce8,0,0,...) at fork_exit+0x12f/frame 0x22c04cd4 fork_trampoline() at 0xffc033ca/frame 0x22c04cd4 --- trap 0, eip = 0, esp = 0x22c04d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100046 td 0x2171c700 sched_switch(2171c700,0,109) at sched_switch+0x598/frame 0x22c0ac14 mi_switch(109,0) at mi_switch+0x1de/frame 0x22c0ac44 ithread_loop(21710030,22c0ace8,163a3df,419,0,...) at ithread_loop+0x2f5/frame 0x22c0ac78 fork_exit(f9a940,21710030,22c0ace8,0,0,...) at fork_exit+0x12f/frame 0x22c0acd4 fork_trampoline() at 0xffc033ca/frame 0x22c0acd4 --- trap 0, eip = 0, esp = 0x22c0ad20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100047 td 0x2171c380 sched_switch(2171c380,0,109) at sched_switch+0x598/frame 0x22c10c14 mi_switch(109,0) at mi_switch+0x1de/frame 0x22c10c44 ithread_loop(21710020,22c10ce8,163a3df,419,0,...) at ithread_loop+0x2f5/frame 0x22c10c78 fork_exit(f9a940,21710020,22c10ce8,0,0,...) at fork_exit+0x12f/frame 0x22c10cd4 fork_trampoline() at 0xffc033ca/frame 0x22c10cd4 --- trap 0, eip = 0, esp = 0x22c10d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100053 td 0x21711a80 sched_switch(21711a80,0,109) at sched_switch+0x598/frame 0x22c2fc14 mi_switch(109,0) at mi_switch+0x1de/frame 0x22c2fc44 ithread_loop(21710010,22c2fce8,163a3df,419,0,...) at ithread_loop+0x2f5/frame 0x22c2fc78 fork_exit(f9a940,21710010,22c2fce8,0,0,...) at fork_exit+0x12f/frame 0x22c2fcd4 fork_trampoline() at 0xffc033ca/frame 0x22c2fcd4 --- trap 0, eip = 0, esp = 0x22c2fd20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100059 td 0x23acfa80 sched_switch(23acfa80,0,109) at sched_switch+0x598/frame 0x22c4ec14 mi_switch(109,0) at mi_switch+0x1de/frame 0x22c4ec44 ithread_loop(21710000,22c4ece8,163a3df,419,0,...) at ithread_loop+0x2f5/frame 0x22c4ec78 fork_exit(f9a940,21710000,22c4ece8,0,0,...) at fork_exit+0x12f/frame 0x22c4ecd4 fork_trampoline() at 0xffc033ca/frame 0x22c4ecd4 --- trap 0, eip = 0, esp = 0x22c4ed20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100075 td 0x23ba8380 __bss_end() at 0xffc033c0 Tracing command intr pid 12 tid 100081 td 0x23ad0a80 sched_switch(23ad0a80,0,109) at sched_switch+0x598/frame 0x22cbfc14 mi_switch(109,0) at mi_switch+0x1de/frame 0x22cbfc44 ithread_loop(11ad0f60,22cbfce8,163a3df,419,0,...) at ithread_loop+0x2f5/frame 0x22cbfc78 fork_exit(f9a940,11ad0f60,22cbfce8,0,0,...) at fork_exit+0x12f/frame 0x22cbfcd4 fork_trampoline() at 0xffc033ca/frame 0x22cbfcd4 --- trap 0, eip = 0, esp = 0x22cbfd20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100082 td 0x23ad0700 sched_switch(23ad0700,0,109) at sched_switch+0x598/frame 0x22cc8c14 mi_switch(109,0) at mi_switch+0x1de/frame 0x22cc8c44 ithread_loop(11ad0f40,22cc8ce8,163a3df,419,0,...) at ithread_loop+0x2f5/frame 0x22cc8c78 fork_exit(f9a940,11ad0f40,22cc8ce8,0,0,...) at fork_exit+0x12f/frame 0x22cc8cd4 fork_trampoline() at 0xffc033ca/frame 0x22cc8cd4 --- trap 0, eip = 0, esp = 0x22cc8d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100084 td 0x23d80700 __bss_end() at 0xffc033c0 Tracing command idle pid 11 tid 100003 td 0x11fd9700 sched_switch(11fd9700,0,608) at sched_switch+0x598/frame 0x1b6d4bd4 mi_switch(608,0) at mi_switch+0x1de/frame 0x1b6d4c08 critical_exit_preempt(0) at critical_exit_preempt+0x5d/frame 0x1b6d4c1c sched_idletd(0,1b6d4ce8,163a3df,419,0,...) at sched_idletd+0x3ee/frame 0x1b6d4c78 fork_exit(1003330,0,1b6d4ce8,0,0,...) at fork_exit+0x12f/frame 0x1b6d4cd4 fork_trampoline() at 0xffc033ca/frame 0x1b6d4cd4 --- trap 0, eip = 0, esp = 0x1b6d4d20, ebp = 0 --- (null)() at 0 Tracing command idle pid 11 tid 100004 td 0x11fd9380 sched_switch(11fd9380,0,608) at sched_switch+0x598/frame 0x1b6d9bd4 mi_switch(608,0) at mi_switch+0x1de/frame 0x1b6d9c08 critical_exit_preempt(0) at critical_exit_preempt+0x5d/frame 0x1b6d9c1c sched_idletd(0,1b6d9ce8,163a3df,419,0,...) at sched_idletd+0x3ee/frame 0x1b6d9c78 fork_exit(1003330,0,1b6d9ce8,0,0,...) at fork_exit+0x12f/frame 0x1b6d9cd4 fork_trampoline() at 0xffc033ca/frame 0x1b6d9cd4 --- trap 0, eip = 0, esp = 0x1b6d9d20, ebp = 0 --- (null)() at 0 Tracing command idle pid 11 tid 100005 td 0x11fd9000 sched_switch(11fd9000,0,608) at sched_switch+0x598/frame 0x1b6debd4 mi_switch(608,0) at mi_switch+0x1de/frame 0x1b6dec08 critical_exit_preempt(0) at critical_exit_preempt+0x5d/frame 0x1b6dec1c sched_idletd(0,1b6dece8,163a3df,419,0,...) at sched_idletd+0x3ee/frame 0x1b6dec78 fork_exit(1003330,0,1b6dece8,0,0,...) at fork_exit+0x12f/frame 0x1b6decd4 fork_trampoline() at 0xffc033ca/frame 0x1b6decd4 --- trap 0, eip = 0, esp = 0x1b6ded20, ebp = 0 --- (null)() at 0 Tracing command idle pid 11 tid 100006 td 0x11fd8a80 sched_switch(11fd8a80,0,608) at sched_switch+0x598/frame 0x1b6e3bd4 mi_switch(608,0) at mi_switch+0x1de/frame 0x1b6e3c08 critical_exit_preempt(0) at critical_exit_preempt+0x5d/frame 0x1b6e3c1c sched_idletd(0,1b6e3ce8,163a3df,419,0,...) at sched_idletd+0x3ee/frame 0x1b6e3c78 fork_exit(1003330,0,1b6e3ce8,0,0,...) at fork_exit+0x12f/frame 0x1b6e3cd4 fork_trampoline() at 0xffc033ca/frame 0x1b6e3cd4 --- trap 0, eip = 0, esp = 0x1b6e3d20, ebp = 0 --- (null)() at 0 Tracing command init pid 1 tid 100002 td 0x11fd9a80 sched_switch(11fd9a80,0,104) at sched_switch+0x598/frame 0x119fd994 mi_switch(104,0) at mi_switch+0x1de/frame 0x119fd9c8 sleepq_switch(6c,119fda20,1027aa7,11fcc9fc,1f10954,...) at sleepq_switch+0xe1/frame 0x119fd9ec sleepq_catch_signals(11fd9a80,0,11fcc9fc,119fda6c,fe182e,...) at sleepq_catch_signals+0x3b7/frame 0x119fda18 sleepq_wait_sig(11fcc9fc,6c) at sleepq_wait_sig+0x11/frame 0x119fda2c _sleep(11fcc9fc,11fccaa4,36c,1699a39,0,0,0,0,100) at _sleep+0x28e/frame 0x119fda6c kern_wait6(11fd9a80,7,0,0,119fdaf4,30,0,0) at kern_wait6+0x3bd/frame 0x119fdac8 sys_wait4(11fd9a80,11fd9d0c,166aa5e,4,0,...) at sys_wait4+0x78/frame 0x119fdbe4 syscallenter(11fd9a80,119fdce8,1,0,119fde00,...) at syscallenter+0x4d8/frame 0x119fdc58 syscall(119fdce8,3b,3b,3b,ffbfe928,...) at syscall+0x84/frame 0x119fdcdc Xint0x80_syscall() at 0xffc033b7/frame 0x119fdcdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x47f57f, esp = 0xffbfe8e8, ebp = 0xffbfe8fc --- (null)() at 0x47f57f Tracing command audit pid 10 tid 100001 td 0x11fda000 sched_switch(11fda000,0,104) at sched_switch+0x598/frame 0x119f8b8c mi_switch(104,0) at mi_switch+0x1de/frame 0x119f8bc0 sleepq_switch(11fda000,1fb80cc,1fb8120,119f8c30,f72005,...) at sleepq_switch+0xe1/frame 0x119f8be4 sleepq_wait(1fb8120,0) at sleepq_wait+0x3a/frame 0x119f8bf8 _cv_wait(1fb8120,1fb80cc) at _cv_wait+0x135/frame 0x119f8c30 audit_worker(0,119f8ce8,163a3df,419,0,...) at audit_worker+0x7f/frame 0x119f8c78 fork_exit(1263be0,0,119f8ce8,0,0,...) at fork_exit+0x12f/frame 0x119f8cd4 fork_trampoline() at 0xffc033ca/frame 0x119f8cd4 --- trap 0, eip = 0, esp = 0x119f8d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100000 td 0x1fa7c60 sched_switch(1fa7c60,0,104) at sched_switch+0x598/frame 0x24f9bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0x24f9c24 sleepq_switch(1,1fa7c60,177,1fa7c60,0,...) at sleepq_switch+0xe1/frame 0x24f9c48 sleepq_timedwait(1fa7904,54,1c16700,15df869,2fd,...) at sleepq_timedwait+0x47/frame 0x24f9c78 _sleep(1fa7904,0,54,169c688,fffff470,...) at _sleep+0x23c/frame 0x24f9cb8 swapper(0,0,0,1c678b4) at swapper+0x100/frame 0x24f9d14 mi_startup() at mi_startup+0x2b5/frame 0x24f9d38 btext() at btext+0x5f Tracing command kernel pid 0 tid 100007 td 0x11fd8700 sched_switch(11fd8700,0,104) at sched_switch+0x598/frame 0x1b6ecb94 mi_switch(104,0) at mi_switch+0x1de/frame 0x1b6ecbc8 sleepq_switch(11fd8700,0,11fefa00,1b6ecc40,fe18a7,...) at sleepq_switch+0xe1/frame 0x1b6ecbec sleepq_wait(11fefa00,0) at sleepq_wait+0x3a/frame 0x1b6ecc00 _sleep(11fefa00,11fefa1c,0,15ce0ac,0,0,0,0,100) at _sleep+0x307/frame 0x1b6ecc40 taskqueue_thread_loop(1fb74b0,1b6ecce8,163a3df,419,0,...) at taskqueue_thread_loop+0xcb/frame 0x1b6ecc78 fork_exit(102ca30,1fb74b0,1b6ecce8,0,0,...) at fork_exit+0x12f/frame 0x1b6eccd4 fork_trampoline() at 0xffc033ca/frame 0x1b6eccd4 --- trap 0, eip = 0, esp = 0x1b6ecd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100010 td 0x11fcea80 sched_switch(11fcea80,0,104) at sched_switch+0x598/frame 0x1b6fbb94 mi_switch(104,0) at mi_switch+0x1de/frame 0x1b6fbbc8 sleepq_switch(11fcea80,0,11fef880,1b6fbc40,fe18a7,...) at sleepq_switch+0xe1/frame 0x1b6fbbec sleepq_wait(11fef880,0) at sleepq_wait+0x3a/frame 0x1b6fbc00 _sleep(11fef880,11fef89c,0,15ce0ac,0,0,0,0,100) at _sleep+0x307/frame 0x1b6fbc40 taskqueue_thread_loop(1fb7460,1b6fbce8,163a3df,419,0,...) at taskqueue_thread_loop+0xcb/frame 0x1b6fbc78 fork_exit(102ca30,1fb7460,1b6fbce8,0,0,...) at fork_exit+0x12f/frame 0x1b6fbcd4 fork_trampoline() at 0xffc033ca/frame 0x1b6fbcd4 --- trap 0, eip = 0, esp = 0x1b6fbd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100012 td 0x11fce380 sched_switch(11fce380,0,104) at sched_switch+0x598/frame 0x1b705ba4 mi_switch(104,0) at mi_switch+0x1de/frame 0x1b705bd4 sleepq_switch(0,11fd2780,11fce380,1b705c44,fe1af2,...) at sleepq_switch+0xe1/frame 0x1b705bf8 sleepq_wait(11fd2780,0) at sleepq_wait+0x3a/frame 0x1b705c0c msleep_spin_sbt(11fd2780,11fd279c,15ce0ac,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x1b705c44 gtaskqueue_thread_loop(11ffe804,1b705ce8,163a3df,419,0,...) at gtaskqueue_thread_loop+0x9c/frame 0x1b705c78 fork_exit(1018d90,11ffe804,1b705ce8,0,0,...) at fork_exit+0x12f/frame 0x1b705cd4 fork_trampoline() at 0xffc033ca/frame 0x1b705cd4 --- trap 0, eip = 0, esp = 0x1b705d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100013 td 0x11fce000 sched_switch(11fce000,0,104) at sched_switch+0x598/frame 0x1b70ab94 mi_switch(104,0) at mi_switch+0x1de/frame 0x1b70abc8 sleepq_switch(11fce000,0,11fef780,1b70ac40,fe18a7,...) at sleepq_switch+0xe1/frame 0x1b70abec sleepq_wait(11fef780,0) at sleepq_wait+0x3a/frame 0x1b70ac00 _sleep(11fef780,11fef79c,0,15ce0ac,0,0,0,0,100) at _sleep+0x307/frame 0x1b70ac40 taskqueue_thread_loop(1fa82b8,1b70ace8,163a3df,419,0,...) at taskqueue_thread_loop+0xcb/frame 0x1b70ac78 fork_exit(102ca30,1fa82b8,1b70ace8,0,0,...) at fork_exit+0x12f/frame 0x1b70acd4 fork_trampoline() at 0xffc033ca/frame 0x1b70acd4 --- trap 0, eip = 0, esp = 0x1b70ad20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100014 td 0x11ad9380 sched_switch(11ad9380,0,104) at sched_switch+0x598/frame 0x1b71bba4 mi_switch(104,0) at mi_switch+0x1de/frame 0x1b71bbd4 sleepq_switch(0,11fd2700,11ad9380,1b71bc44,fe1af2,...) at sleepq_switch+0xe1/frame 0x1b71bbf8 sleepq_wait(11fd2700,0) at sleepq_wait+0x3a/frame 0x1b71bc0c msleep_spin_sbt(11fd2700,11fd271c,15ce0ac,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x1b71bc44 gtaskqueue_thread_loop(11ffec04,1b71bce8,163a3df,419,0,...) at gtaskqueue_thread_loop+0x9c/frame 0x1b71bc78 fork_exit(1018d90,11ffec04,1b71bce8,0,0,...) at fork_exit+0x12f/frame 0x1b71bcd4 fork_trampoline() at 0xffc033ca/frame 0x1b71bcd4 --- trap 0, eip = 0, esp = 0x1b71bd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100015 td 0x11ad9000 sched_switch(11ad9000,0,104) at sched_switch+0x598/frame 0x1b720ba4 mi_switch(104,0) at mi_switch+0x1de/frame 0x1b720bd4 sleepq_switch(0,11fd2080,11ad9000,1b720c44,fe1af2,...) at sleepq_switch+0xe1/frame 0x1b720bf8 sleepq_wait(11fd2080,0) at sleepq_wait+0x3a/frame 0x1b720c0c msleep_spin_sbt(11fd2080,11fd209c,15ce0ac,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x1b720c44 gtaskqueue_thread_loop(11fff004,1b720ce8,163a3df,419,0,...) at gtaskqueue_thread_loop+0x9c/frame 0x1b720c78 fork_exit(1018d90,11fff004,1b720ce8,0,0,...) at fork_exit+0x12f/frame 0x1b720cd4 fork_trampoline() at 0xffc033ca/frame 0x1b720cd4 --- trap 0, eip = 0, esp = 0x1b720d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100016 td 0x11ad8a80 sched_switch(11ad8a80,0,104) at sched_switch+0x598/frame 0x1b725ba4 mi_switch(104,0) at mi_switch+0x1de/frame 0x1b725bd4 sleepq_switch(0,11fd2000,11ad8a80,1b725c44,fe1af2,...) at sleepq_switch+0xe1/frame 0x1b725bf8 sleepq_wait(11fd2000,0) at sleepq_wait+0x3a/frame 0x1b725c0c msleep_spin_sbt(11fd2000,11fd201c,15ce0ac,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x1b725c44 gtaskqueue_thread_loop(11fff014,1b725ce8,163a3df,419,0,...) at gtaskqueue_thread_loop+0x9c/frame 0x1b725c78 fork_exit(1018d90,11fff014,1b725ce8,0,0,...) at fork_exit+0x12f/frame 0x1b725cd4 fork_trampoline() at 0xffc033ca/frame 0x1b725cd4 --- trap 0, eip = 0, esp = 0x1b725d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100017 td 0x11ad8700 sched_switch(11ad8700,0,104) at sched_switch+0x598/frame 0x1b72aba4 mi_switch(104,0) at mi_switch+0x1de/frame 0x1b72abd4 sleepq_switch(0,11fd1f00,11ad8700,1b72ac44,fe1af2,...) at sleepq_switch+0xe1/frame 0x1b72abf8 sleepq_wait(11fd1f00,0) at sleepq_wait+0x3a/frame 0x1b72ac0c msleep_spin_sbt(11fd1f00,11fd1f1c,15ce0ac,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x1b72ac44 gtaskqueue_thread_loop(11fff024,1b72ace8,163a3df,419,0,...) at gtaskqueue_thread_loop+0x9c/frame 0x1b72ac78 fork_exit(1018d90,11fff024,1b72ace8,0,0,...) at fork_exit+0x12f/frame 0x1b72acd4 fork_trampoline() at 0xffc033ca/frame 0x1b72acd4 --- trap 0, eip = 0, esp = 0x1b72ad20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100018 td 0x11ad8380 sched_switch(11ad8380,0,104) at sched_switch+0x598/frame 0x1b72fba4 mi_switch(104,0) at mi_switch+0x1de/frame 0x1b72fbd4 sleepq_switch(0,11fd1e80,11ad8380,1b72fc44,fe1af2,...) at sleepq_switch+0xe1/frame 0x1b72fbf8 sleepq_wait(11fd1e80,0) at sleepq_wait+0x3a/frame 0x1b72fc0c msleep_spin_sbt(11fd1e80,11fd1e9c,15ce0ac,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x1b72fc44 gtaskqueue_thread_loop(11fff034,1b72fce8,163a3df,419,0,...) at gtaskqueue_thread_loop+0x9c/frame 0x1b72fc78 fork_exit(1018d90,11fff034,1b72fce8,0,0,...) at fork_exit+0x12f/frame 0x1b72fcd4 fork_trampoline() at 0xffc033ca/frame 0x1b72fcd4 --- trap 0, eip = 0, esp = 0x1b72fd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100019 td 0x11ad8000 sched_switch(11ad8000,0,104) at sched_switch+0x598/frame 0x1b734ba4 mi_switch(104,0) at mi_switch+0x1de/frame 0x1b734bd4 sleepq_switch(0,11fd1e00,11ad8000,1b734c44,fe1af2,...) at sleepq_switch+0xe1/frame 0x1b734bf8 sleepq_wait(11fd1e00,0) at sleepq_wait+0x3a/frame 0x1b734c0c msleep_spin_sbt(11fd1e00,11fd1e1c,15ce0ac,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x1b734c44 gtaskqueue_thread_loop(11ffe404,1b734ce8,163a3df,419,0,...) at gtaskqueue_thread_loop+0x9c/frame 0x1b734c78 fork_exit(1018d90,11ffe404,1b734ce8,0,0,...) at fork_exit+0x12f/frame 0x1b734cd4 fork_trampoline() at 0xffc033ca/frame 0x1b734cd4 --- trap 0, eip = 0, esp = 0x1b734d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100020 td 0x11ad7a80 sched_switch(11ad7a80,0,104) at sched_switch+0x598/frame 0x1b739ba4 mi_switch(104,0) at mi_switch+0x1de/frame 0x1b739bd4 sleepq_switch(0,11fd1d80,11ad7a80,1b739c44,fe1af2,...) at sleepq_switch+0xe1/frame 0x1b739bf8 sleepq_wait(11fd1d80,0) at sleepq_wait+0x3a/frame 0x1b739c0c msleep_spin_sbt(11fd1d80,11fd1d9c,15ce0ac,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x1b739c44 gtaskqueue_thread_loop(11ffe414,1b739ce8,163a3df,419,0,...) at gtaskqueue_thread_loop+0x9c/frame 0x1b739c78 fork_exit(1018d90,11ffe414,1b739ce8,0,0,...) at fork_exit+0x12f/frame 0x1b739cd4 fork_trampoline() at 0xffc033ca/frame 0x1b739cd4 --- trap 0, eip = 0, esp = 0x1b739d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100021 td 0x11ad7700 sched_switch(11ad7700,0,104) at sched_switch+0x598/frame 0x1b73eba4 mi_switch(104,0) at mi_switch+0x1de/frame 0x1b73ebd4 sleepq_switch(0,11fd1d00,11ad7700,1b73ec44,fe1af2,...) at sleepq_switch+0xe1/frame 0x1b73ebf8 sleepq_wait(11fd1d00,0) at sleepq_wait+0x3a/frame 0x1b73ec0c msleep_spin_sbt(11fd1d00,11fd1d1c,15ce0ac,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x1b73ec44 gtaskqueue_thread_loop(11ffe424,1b73ece8,163a3df,419,0,...) at gtaskqueue_thread_loop+0x9c/frame 0x1b73ec78 fork_exit(1018d90,11ffe424,1b73ece8,0,0,...) at fork_exit+0x12f/frame 0x1b73ecd4 fork_trampoline() at 0xffc033ca/frame 0x1b73ecd4 --- trap 0, eip = 0, esp = 0x1b73ed20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100022 td 0x11ad7380 sched_switch(11ad7380,0,104) at sched_switch+0x598/frame 0x1b743ba4 mi_switch(104,0) at mi_switch+0x1de/frame 0x1b743bd4 sleepq_switch(0,11fd1c80,11ad7380,1b743c44,fe1af2,...) at sleepq_switch+0xe1/frame 0x1b743bf8 sleepq_wait(11fd1c80,0) at sleepq_wait+0x3a/frame 0x1b743c0c msleep_spin_sbt(11fd1c80,11fd1c9c,15ce0ac,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x1b743c44 gtaskqueue_thread_loop(11ffe434,1b743ce8,163a3df,419,0,...) at gtaskqueue_thread_loop+0x9c/frame 0x1b743c78 fork_exit(1018d90,11ffe434,1b743ce8,0,0,...) at fork_exit+0x12f/frame 0x1b743cd4 fork_trampoline() at 0xffc033ca/frame 0x1b743cd4 --- trap 0, eip = 0, esp = 0x1b743d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100029 td 0x11e5c000 sched_switch(11e5c000,0,104) at sched_switch+0x598/frame 0x1b77eb94 mi_switch(104,0) at mi_switch+0x1de/frame 0x1b77ebc8 sleepq_switch(11e5c000,0,11fef700,1b77ec40,fe18a7,...) at sleepq_switch+0xe1/frame 0x1b77ebec sleepq_wait(11fef700,0) at sleepq_wait+0x3a/frame 0x1b77ec00 _sleep(11fef700,11fef71c,0,15ce0ac,0,0,0,0,100) at _sleep+0x307/frame 0x1b77ec40 taskqueue_thread_loop(1f0f28c,1b77ece8,163a3df,419,0,...) at taskqueue_thread_loop+0xcb/frame 0x1b77ec78 fork_exit(102ca30,1f0f28c,1b77ece8,0,0,...) at fork_exit+0x12f/frame 0x1b77ecd4 fork_trampoline() at 0xffc033ca/frame 0x1b77ecd4 --- trap 0, eip = 0, esp = 0x1b77ed20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100034 td 0x11e61a80 sched_switch(11e61a80,0,104) at sched_switch+0x598/frame 0x1b79bb94 mi_switch(104,0) at mi_switch+0x1de/frame 0x1b79bbc8 sleepq_switch(11e61a80,0,11fef680,1b79bc40,fe18a7,...) at sleepq_switch+0xe1/frame 0x1b79bbec sleepq_wait(11fef680,0) at sleepq_wait+0x3a/frame 0x1b79bc00 _sleep(11fef680,11fef69c,0,15ce0ac,0,0,0,0,100) at _sleep+0x307/frame 0x1b79bc40 taskqueue_thread_loop(1f8311c,1b79bce8,163a3df,419,0,...) at taskqueue_thread_loop+0xcb/frame 0x1b79bc78 fork_exit(102ca30,1f8311c,1b79bce8,0,0,...) at fork_exit+0x12f/frame 0x1b79bcd4 fork_trampoline() at 0xffc033ca/frame 0x1b79bcd4 --- trap 0, eip = 0, esp = 0x1b79bd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100035 td 0x11e61700 sched_switch(11e61700,0,104) at sched_switch+0x598/frame 0x1b7a0b94 mi_switch(104,0) at mi_switch+0x1de/frame 0x1b7a0bc8 sleepq_switch(11e61700,0,11fef680,1b7a0c40,fe18a7,...) at sleepq_switch+0xe1/frame 0x1b7a0bec sleepq_wait(11fef680,0) at sleepq_wait+0x3a/frame 0x1b7a0c00 _sleep(11fef680,11fef69c,0,15ce0ac,0,0,0,0,100) at _sleep+0x307/frame 0x1b7a0c40 taskqueue_thread_loop(1f8311c,1b7a0ce8,163a3df,419,0,...) at taskqueue_thread_loop+0xcb/frame 0x1b7a0c78 fork_exit(102ca30,1f8311c,1b7a0ce8,0,0,...) at fork_exit+0x12f/frame 0x1b7a0cd4 fork_trampoline() at 0xffc033ca/frame 0x1b7a0cd4 --- trap 0, eip = 0, esp = 0x1b7a0d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100036 td 0x11e61380 sched_switch(11e61380,0,104) at sched_switch+0x598/frame 0x1b7a5b94 mi_switch(104,0) at mi_switch+0x1de/frame 0x1b7a5bc8 sleepq_switch(11e61380,0,11fef680,1b7a5c40,fe18a7,...) at sleepq_switch+0xe1/frame 0x1b7a5bec sleepq_wait(11fef680,0) at sleepq_wait+0x3a/frame 0x1b7a5c00 _sleep(11fef680,11fef69c,0,15ce0ac,0,0,0,0,100) at _sleep+0x307/frame 0x1b7a5c40 taskqueue_thread_loop(1f8311c,1b7a5ce8,163a3df,419,0,...) at taskqueue_thread_loop+0xcb/frame 0x1b7a5c78 fork_exit(102ca30,1f8311c,1b7a5ce8,0,0,...) at fork_exit+0x12f/frame 0x1b7a5cd4 fork_trampoline() at 0xffc033ca/frame 0x1b7a5cd4 --- trap 0, eip = 0, esp = 0x1b7a5d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100037 td 0x11e61000 sched_switch(11e61000,0,104) at sched_switch+0x598/frame 0x1b7aab94 mi_switch(104,0) at mi_switch+0x1de/frame 0x1b7aabc8 sleepq_switch(11e61000,0,11fef680,1b7aac40,fe18a7,...) at sleepq_switch+0xe1/frame 0x1b7aabec sleepq_wait(11fef680,0) at sleepq_wait+0x3a/frame 0x1b7aac00 _sleep(11fef680,11fef69c,0,15ce0ac,0,0,0,0,100) at _sleep+0x307/frame 0x1b7aac40 taskqueue_thread_loop(1f8311c,1b7aace8,163a3df,419,0,...) at taskqueue_thread_loop+0xcb/frame 0x1b7aac78 fork_exit(102ca30,1f8311c,1b7aace8,0,0,...) at fork_exit+0x12f/frame 0x1b7aacd4 fork_trampoline() at 0xffc033ca/frame 0x1b7aacd4 --- trap 0, eip = 0, esp = 0x1b7aad20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100085 td 0x23d80380 sched_switch(23d80380,0,104) at sched_switch+0x598/frame 0x22cd7ba4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22cd7bd4 sleepq_switch(0,23d63000,23d80380,22cd7c44,fe1af2,...) at sleepq_switch+0xe1/frame 0x22cd7bf8 sleepq_wait(23d63000,0) at sleepq_wait+0x3a/frame 0x22cd7c0c msleep_spin_sbt(23d63000,23d6301c,15ce0ac,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x22cd7c44 taskqueue_thread_loop(1f9bd88,22cd7ce8,163a3df,419,0,...) at taskqueue_thread_loop+0x9c/frame 0x22cd7c78 fork_exit(102ca30,1f9bd88,22cd7ce8,0,0,...) at fork_exit+0x12f/frame 0x22cd7cd4 fork_trampoline() at 0xffc033ca/frame 0x22cd7cd4 --- trap 0, eip = 0, esp = 0x22cd7d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100091 td 0x243e7a80 sched_switch(243e7a80,0,104) at sched_switch+0x598/frame 0x22cfeba4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22cfebd4 sleepq_switch(0,24406c80,243e7a80,22cfec44,fe1af2,...) at sleepq_switch+0xe1/frame 0x22cfebf8 sleepq_wait(24406c80,0) at sleepq_wait+0x3a/frame 0x22cfec0c msleep_spin_sbt(24406c80,24406c9c,15ce0ac,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x22cfec44 taskqueue_thread_loop(1f9d9c0,22cfece8,163a3df,419,0,...) at taskqueue_thread_loop+0x9c/frame 0x22cfec78 fork_exit(102ca30,1f9d9c0,22cfece8,0,0,...) at fork_exit+0x12f/frame 0x22cfecd4 fork_trampoline() at 0xffc033ca/frame 0x22cfecd4 --- trap 0, eip = 0, esp = 0x22cfed20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100092 td 0x243e7700 sched_switch(243e7700,0,104) at sched_switch+0x598/frame 0x22d03ba4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22d03bd4 sleepq_switch(0,24406c80,243e7700,22d03c44,fe1af2,...) at sleepq_switch+0xe1/frame 0x22d03bf8 sleepq_wait(24406c80,0) at sleepq_wait+0x3a/frame 0x22d03c0c msleep_spin_sbt(24406c80,24406c9c,15ce0ac,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x22d03c44 taskqueue_thread_loop(1f9d9c0,22d03ce8,163a3df,419,0,...) at taskqueue_thread_loop+0x9c/frame 0x22d03c78 fork_exit(102ca30,1f9d9c0,22d03ce8,0,0,...) at fork_exit+0x12f/frame 0x22d03cd4 fork_trampoline() at 0xffc033ca/frame 0x22d03cd4 --- trap 0, eip = 0, esp = 0x22d03d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100093 td 0x243e7380 sched_switch(243e7380,0,104) at sched_switch+0x598/frame 0x22d08ba4 mi_switch(104,0) at mi_switch+0x1de/frame 0x22d08bd4 sleepq_switch(0,24406c80,243e7380,22d08c44,fe1af2,...) at sleepq_switch+0xe1/frame 0x22d08bf8 sleepq_wait(24406c80,0) at sleepq_wait+0x3a/frame 0x22d08c0c msleep_spin_sbt(24406c80,24406c9c,15ce0ac,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x22d08c44 taskqueue_thread_loop(1f9d9c0,22d08ce8,163a3df,419,0,...) at taskqueue_thread_loop+0x9c/frame 0x22d08c78 fork_exit(102ca30,1f9d9c0,22d08ce8,0,0,...) at fork_exit+0x12f/frame 0x22d08cd4 fork_trampoline() at 0xffc033ca/frame 0x22d08cd4 --- trap 0, eip = 0, esp = 0x22d08d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100095 td 0x243d1a80 sched_switch(243d1a80,0,104) at sched_switch+0x598/frame 0x22d12b94 mi_switch(104,0) at mi_switch+0x1de/frame 0x22d12bc8 sleepq_switch(243d1a80,0,11fef600,22d12c40,fe18a7,...) at sleepq_switch+0xe1/frame 0x22d12bec sleepq_wait(11fef600,0) at sleepq_wait+0x3a/frame 0x22d12c00 _sleep(11fef600,11fef61c,0,15ce0ac,0,0,0,0,100) at _sleep+0x307/frame 0x22d12c40 taskqueue_thread_loop(1c93174,22d12ce8,163a3df,419,0,...) at taskqueue_thread_loop+0xcb/frame 0x22d12c78 fork_exit(102ca30,1c93174,22d12ce8,0,0,...) at fork_exit+0x12f/frame 0x22d12cd4 fork_trampoline() at 0xffc033ca/frame 0x22d12cd4 --- trap 0, eip = 0, esp = 0x22d12d20, ebp = 0 --- (null)() at 0 db:0:pho> dump Physical memory: 8034 MB Dumping 557 MB: 542 526 510 494 478 462 446 430 414 398 382 366 350 334 318 302 286 270 254 238 222 206 190 174 158 142 126 110 94 78 62 46 30 14 Dump complete db> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 3 (kgdb) bt #0 0x00fd48f3 in doadump (textdump=0x0) at ../../../kern/kern_shutdown.c:391 #1 0x00a01ab4 in db_dump (dummy=0x101a155, dummy2=, dummy3=0xffffffff, dummy4=0x351094dc "") at ../../../ddb/db_command.c:575 #2 0x00a0188f in db_command (last_cmdp=, cmd_table=0x1c94d88 , dopager=0x0) at ../../../ddb/db_command.c:482 #3 0x00a060a6 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #4 0x00a0188f in db_command (last_cmdp=, cmd_table=0x1c94d88 , dopager=0x1) at ../../../ddb/db_command.c:482 #5 0x00a01612 in db_command_loop () at ../../../ddb/db_command.c:535 #6 0x00a0449a in db_trap (type=0x3, code=0x0) at ../../../ddb/db_main.c:252 #7 0x0101a8ca in kdb_trap (type=0x3, code=0x0, tf=0x3510988c) at ../../../kern/subr_kdb.c:692 #8 0x01555ec1 in trap (frame=0x3510988c) at ../../../i386/i386/trap.c:713 #9 0xffc0316d in ?? () #10 0x3510988c in ?? () #11 0x00fd4d6e in vpanic (fmt=0x163cd59 "vm_page_try_wire: page %p does not belong to an object", ap=0x35109974 "ÈJ\251\tg@â\024ÈJ\251\t\001æT\001\264\231\020\065\264\231\020\065\rçT\001ÈJ\251\t`ÏHÿ") at ../../../kern/kern_shutdown.c:894 #12 0x00fd4896 in panic (fmt=0x163cd59 "vm_page_try_wire: page %p does not belong to an object") at ../../../kern/kern_shutdown.c:832 #13 0x012f460c in vm_page_wire_mapped (m=0x9a94ac8) at ../../../vm/vm_page.c:3578 #14 0x0154e70d in pmap_pae_extract_and_hold (pmap=0x34e785dc, va=0x2069f000, prot=0x11) at ../../../i386/i386/pmap.c:1708 #15 0x012d3789 in vm_fault_quick_hold_pages (map=0x34e78530, addr=0x2069f000, len=0x560, prot=0x11, ma=0x35109a54, max_count=0x2) at ../../../vm/vm_fault.c:1560 #16 0x01530bc6 in cp_slow0 (uva=0x2069faa0, len=0x560, write=, f=0x1530dd0 , arg=0x35109a88) at ../../../i386/i386/copyout.c:107 #17 0x01530d6f in copyinstr (udaddr=0x2069faa0, kaddr=0x1b8000c1, maxlen=0x3ff4c, lencopied=0x35109ae0) at ../../../i386/i386/copyout.c:179 #18 0x00f8f63e in exec_args_add_str (args=0x35109ba0, str=0x2069faa0 "uäÿ0j\004hPßZ\001è\260\066\016", segflg=UIO_USERSPACE, countp=0x35109bc4) at ../../../kern/kern_exec.c:1471 #19 0x00f8f075 in exec_args_add_env (args=0x35109ba0, envp=0x2069faa0 "uäÿ0j\004hPßZ\001è\260\066\016", segflg=UIO_USERSPACE) at ../../../kern/kern_exec.c:1499 #20 0x00f8bb28 in exec_copyin_args (args=0x35109ba0, fname=0x206c2714 "\211ÇÿuÔè\242rüÿ\203Ä\004\205À\017\204R\002", segflg=UIO_USERSPACE, argv=0x206c2550, envv=0x206c2628) at ../../../kern/kern_exec.c:1200 #21 0x00f8b7af in sys_execve (td=0x34e86700, uap=0x34e8698c) at ../../../kern/kern_exec.c:220 #22 0x01557c48 in syscallenter (td=0x34e86700) at ../../../i386/i386/../../kern/subr_syscall.c:144 #23 0x015575f4 in syscall (frame=0x35109ce8) at ../../../i386/i386/trap.c:1159 #24 0xffc033b7 in ?? () #25 0x35109ce8 in ?? () Backtrace stopped: Cannot access memory at address 0xffbfe450 (kgdb) f 13 #13 0x012f460c in vm_page_wire_mapped (m=0x9a94ac8) at ../../../vm/vm_page.c:3578 3578 KASSERT(m->object != NULL, (kgdb) l 3573 bool 3574 vm_page_wire_mapped(vm_page_t m) 3575 { 3576 u_int old; 3577 3578 KASSERT(m->object != NULL, 3579 ("vm_page_try_wire: page %p does not belong to an object", m)); 3580 3581 old = m->ref_count; 3582 do { (kgdb) info loc old = 0x154e601 (kgdb) p *m $1 = {plinks = {q = {tqe_next = 0xaa6877c, tqe_prev = 0x8231f48}, s = {ss = {sle_next = 0xaa6877c}, pv = 0x8231f48}, memguard = {p = 0xaa6877c, v = 0x8231f48}}, listq = {tqe_next = 0xaf04e7c, tqe_prev = 0x36d1d8b0}, object = 0x36d1d888, pindex = 0xe, phys_addr = 0x185993000, md = {pv_list = {tqh_first = 0x12073bbc, tqh_last = 0x128b3bc0}, pat_mode = 0x6}, {wire_count = 0x40000000, ref_count = 0x40000000}, busy_lock = 0x1, flags = 0x1, order = 0xa, pool = 0x0, aflags = 0xb, oflags = 0x0, queue = 0x1, psind = 0x0, segind = 0x5, act_count = 0x9, valid = 0xff, dirty = 0xff} (kgdb) p *m->object $2 = {lock = {lock_object = {lo_name = 0x15e6c47 "vm object", lo_flags = 0x25630000, lo_data = 0x0, lo_witness = 0x2de9318}, rw_lock = 0x359d7a80}, object_list = {tqe_next = 0x36d1d924, tqe_prev = 0x36d1d800}, shadow_head = {lh_first = 0x38382c30}, shadow_list = {le_next = 0x0, le_prev = 0x38a8e328}, memq = {tqh_first = 0x9a94ac8, tqh_last = 0xa4d5224}, rtree = {rt_root = 0xc64ad68}, size = 0x32, domain = { dr_policy = 0x0, dr_iter = 0x0}, generation = 0x1, ref_count = 0x3, shadow_count = 0x2, memattr = 0x6, type = 0x0, flags = 0x1000, pg_color = 0x91, paging_in_progress = 0x1, resident_page_count = 0x3, backing_object = 0x38a8e30c, backing_object_offset = 0x0, pager_object_list = {tqe_next = 0x0, tqe_prev = 0x0}, rvq = {lh_first = 0x0}, handle = 0x0, un_pager = {vnp = {vnp_size = 0x0, writemappings = 0x0}, devp = {devp_pglist = {tqh_first = 0x0, tqh_last = 0x0}, ops = 0x0, dev = 0x0}, sgp = {sgp_pglist = {tqh_first = 0x0, tqh_last = 0x0}}, swp = {swp_tmpfs = 0x0, swp_blks = {pt_root = 0x0}}}, cred = 0x216bbd00, charge = 0x32000, umtx_data = 0x0} (kgdb) $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/amd64/amd64/pmap.c =================================================================== --- /usr/src/sys/amd64/amd64/pmap.c (revision 350022) +++ /usr/src/sys/amd64/amd64/pmap.c (working copy) @@ -3013,31 +3013,23 @@ pmap_extract_and_hold(pmap_t pmap, vm_offset_t va, m = NULL; PG_RW = pmap_rw_bit(pmap); PG_V = pmap_valid_bit(pmap); + PMAP_LOCK(pmap); -retry: pdep = pmap_pde(pmap, va); if (pdep != NULL && (pde = *pdep)) { if (pde & PG_PS) { - if ((pde & PG_RW) || (prot & VM_PROT_WRITE) == 0) { - if (vm_page_pa_tryrelock(pmap, (pde & - PG_PS_FRAME) | (va & PDRMASK), &pa)) - goto retry; - m = PHYS_TO_VM_PAGE(pa); - } + if ((pde & PG_RW) != 0 || (prot & VM_PROT_WRITE) == 0) + m = PHYS_TO_VM_PAGE((pde & PG_PS_FRAME) | + (va & PDRMASK)); } else { pte = *pmap_pde_to_pte(pdep, va); - if ((pte & PG_V) && - ((pte & PG_RW) || (prot & VM_PROT_WRITE) == 0)) { - if (vm_page_pa_tryrelock(pmap, pte & PG_FRAME, - &pa)) - goto retry; - m = PHYS_TO_VM_PAGE(pa); - } + if ((pte & PG_V) != 0 && + ((pte & PG_RW) != 0 || (prot & VM_PROT_WRITE) == 0)) + m = PHYS_TO_VM_PAGE(pte & PG_FRAME); } - if (m != NULL) - vm_page_wire(m); + if (m != NULL && !vm_page_wire_mapped(m)) + m = NULL; } - PA_UNLOCK_COND(pa); PMAP_UNLOCK(pmap); return (m); } Index: /usr/src/sys/arm/arm/pmap-v4.c =================================================================== --- /usr/src/sys/arm/arm/pmap-v4.c (revision 350022) +++ /usr/src/sys/arm/arm/pmap-v4.c (working copy) @@ -3415,14 +3415,14 @@ pmap_extract_and_hold(pmap_t pmap, vm_offset_t va, struct l2_dtable *l2; pd_entry_t l1pd; pt_entry_t *ptep, pte; - vm_paddr_t pa, paddr; - vm_page_t m = NULL; + vm_paddr_t pa; + vm_page_t m; u_int l1idx; + l1idx = L1_IDX(va); - paddr = 0; + m = NULL; PMAP_LOCK(pmap); -retry: l1pd = pmap->pm_l1->l1_kva[l1idx]; if (l1pte_section_p(l1pd)) { /* @@ -3434,11 +3434,10 @@ pmap_extract_and_hold(pmap_t pmap, vm_offset_t va, pa = (l1pd & L1_SUP_FRAME) | (va & L1_SUP_OFFSET); else pa = (l1pd & L1_S_FRAME) | (va & L1_S_OFFSET); - if (vm_page_pa_tryrelock(pmap, pa & PG_FRAME, &paddr)) - goto retry; if (l1pd & L1_S_PROT_W || (prot & VM_PROT_WRITE) == 0) { m = PHYS_TO_VM_PAGE(pa); - vm_page_wire(m); + if (!vm_page_wire_mapped(m)) + m = NULL; } } else { /* @@ -3466,15 +3465,12 @@ pmap_extract_and_hold(pmap_t pmap, vm_offset_t va, pa = (pte & L2_L_FRAME) | (va & L2_L_OFFSET); else pa = (pte & L2_S_FRAME) | (va & L2_S_OFFSET); - if (vm_page_pa_tryrelock(pmap, pa & PG_FRAME, &paddr)) - goto retry; m = PHYS_TO_VM_PAGE(pa); - vm_page_wire(m); + if (!vm_page_wire_mapped(m)) + m = NULL; } } - PMAP_UNLOCK(pmap); - PA_UNLOCK_COND(paddr); return (m); } Index: /usr/src/sys/arm/arm/pmap-v6.c =================================================================== --- /usr/src/sys/arm/arm/pmap-v6.c (revision 350022) +++ /usr/src/sys/arm/arm/pmap-v6.c (working copy) @@ -1986,23 +1986,20 @@ pmap_extract(pmap_t pmap, vm_offset_t va) vm_page_t pmap_extract_and_hold(pmap_t pmap, vm_offset_t va, vm_prot_t prot) { - vm_paddr_t pa, lockpa; + vm_paddr_t pa; pt1_entry_t pte1; pt2_entry_t pte2, *pte2p; vm_page_t m; - lockpa = 0; m = NULL; PMAP_LOCK(pmap); -retry: pte1 = pte1_load(pmap_pte1(pmap, va)); if (pte1_is_section(pte1)) { if (!(pte1 & PTE1_RO) || !(prot & VM_PROT_WRITE)) { pa = pte1_pa(pte1) | (va & PTE1_OFFSET); - if (vm_page_pa_tryrelock(pmap, pa, &lockpa)) - goto retry; m = PHYS_TO_VM_PAGE(pa); - vm_page_wire(m); + if (!vm_page_wire_mapped(m)) + m = NULL; } } else if (pte1_is_link(pte1)) { pte2p = pmap_pte2(pmap, va); @@ -2011,13 +2008,11 @@ pmap_extract_and_hold(pmap_t pmap, vm_offset_t va, if (pte2_is_valid(pte2) && (!(pte2 & PTE2_RO) || !(prot & VM_PROT_WRITE))) { pa = pte2_pa(pte2); - if (vm_page_pa_tryrelock(pmap, pa, &lockpa)) - goto retry; m = PHYS_TO_VM_PAGE(pa); - vm_page_wire(m); + if (!vm_page_wire_mapped(m)) + m = NULL; } } - PA_UNLOCK_COND(lockpa); PMAP_UNLOCK(pmap); return (m); } Index: /usr/src/sys/arm64/arm64/pmap.c =================================================================== --- /usr/src/sys/arm64/arm64/pmap.c (revision 350022) +++ /usr/src/sys/arm64/arm64/pmap.c (working copy) @@ -1081,14 +1081,11 @@ pmap_extract_and_hold(pmap_t pmap, vm_offset_t va, { pt_entry_t *pte, tpte; vm_offset_t off; - vm_paddr_t pa; vm_page_t m; int lvl; - pa = 0; m = NULL; PMAP_LOCK(pmap); -retry: pte = pmap_pte(pmap, va, &lvl); if (pte != NULL) { tpte = pmap_load(pte); @@ -1113,14 +1110,11 @@ pmap_extract_and_hold(pmap_t pmap, vm_offset_t va, default: off = 0; } - if (vm_page_pa_tryrelock(pmap, - (tpte & ~ATTR_MASK) | off, &pa)) - goto retry; m = PHYS_TO_VM_PAGE((tpte & ~ATTR_MASK) | off); - vm_page_wire(m); + if (!vm_page_wire_mapped(m)) + m = NULL; } } - PA_UNLOCK_COND(pa); PMAP_UNLOCK(pmap); return (m); } Index: /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c =================================================================== --- /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c (revision 350022) +++ /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c (working copy) @@ -481,9 +481,7 @@ page_wire(vnode_t *vp, int64_t start) } ASSERT3U(pp->valid, ==, VM_PAGE_BITS_ALL); - vm_page_lock(pp); vm_page_wire(pp); - vm_page_unlock(pp); } else pp = NULL; break; Index: /usr/src/sys/compat/linuxkpi/common/include/linux/mm.h =================================================================== --- /usr/src/sys/compat/linuxkpi/common/include/linux/mm.h (revision 350022) +++ /usr/src/sys/compat/linuxkpi/common/include/linux/mm.h (working copy) @@ -227,9 +227,7 @@ mark_page_accessed(struct vm_page *page) static inline void get_page(struct vm_page *page) { - vm_page_lock(page); vm_page_wire(page); - vm_page_unlock(page); } extern long @@ -251,8 +249,7 @@ static inline void put_page(struct vm_page *page) { vm_page_lock(page); - if (vm_page_unwire(page, PQ_ACTIVE) && page->object == NULL) - vm_page_free(page); + vm_page_unwire(page, PQ_ACTIVE); vm_page_unlock(page); } Index: /usr/src/sys/compat/linuxkpi/common/src/linux_page.c =================================================================== --- /usr/src/sys/compat/linuxkpi/common/src/linux_page.c (revision 350022) +++ /usr/src/sys/compat/linuxkpi/common/src/linux_page.c (working copy) @@ -154,10 +154,8 @@ linux_free_pages(vm_page_t page, unsigned int orde for (x = 0; x != npages; x++) { vm_page_t pgo = page + x; - vm_page_lock(pgo); if (vm_page_unwire_noq(pgo)) vm_page_free(pgo); - vm_page_unlock(pgo); } } else { vm_offset_t vaddr; Index: /usr/src/sys/contrib/vchiq/interface/vchiq_arm/vchiq_2835_arm.c =================================================================== --- /usr/src/sys/contrib/vchiq/interface/vchiq_arm/vchiq_2835_arm.c (revision 350022) +++ /usr/src/sys/contrib/vchiq/interface/vchiq_arm/vchiq_2835_arm.c (working copy) @@ -378,8 +378,7 @@ static void pagelist_page_free(vm_page_t pp) { vm_page_lock(pp); - if (vm_page_unwire(pp, PQ_INACTIVE) && pp->object == NULL) - vm_page_free(pp); + vm_page_unwire(pp, PQ_INACTIVE); vm_page_unlock(pp); } Index: /usr/src/sys/i386/i386/pmap.c =================================================================== --- /usr/src/sys/i386/i386/pmap.c (revision 350022) +++ /usr/src/sys/i386/i386/pmap.c (working copy) @@ -1690,35 +1690,24 @@ __CONCAT(PMTYPE, extract_and_hold)(pmap_t pmap, vm pd_entry_t pde; pt_entry_t pte; vm_page_t m; - vm_paddr_t pa; - pa = 0; m = NULL; PMAP_LOCK(pmap); -retry: pde = *pmap_pde(pmap, va); if (pde != 0) { if (pde & PG_PS) { - if ((pde & PG_RW) || (prot & VM_PROT_WRITE) == 0) { - if (vm_page_pa_tryrelock(pmap, (pde & - PG_PS_FRAME) | (va & PDRMASK), &pa)) - goto retry; - m = PHYS_TO_VM_PAGE(pa); - } + if ((pde & PG_RW) || (prot & VM_PROT_WRITE) == 0) + m = PHYS_TO_VM_PAGE((pde & PG_PS_FRAME) | + (va & PDRMASK)); } else { pte = pmap_pte_ufast(pmap, va, pde); if (pte != 0 && - ((pte & PG_RW) || (prot & VM_PROT_WRITE) == 0)) { - if (vm_page_pa_tryrelock(pmap, pte & PG_FRAME, - &pa)) - goto retry; - m = PHYS_TO_VM_PAGE(pa); - } + ((pte & PG_RW) || (prot & VM_PROT_WRITE) == 0)) + m = PHYS_TO_VM_PAGE(pte & PG_FRAME); } - if (m != NULL) - vm_page_wire(m); + if (m != NULL && !vm_page_wire_mapped(m)) + m = NULL; } - PA_UNLOCK_COND(pa); PMAP_UNLOCK(pmap); return (m); } Index: /usr/src/sys/kern/kern_exec.c =================================================================== --- /usr/src/sys/kern/kern_exec.c (revision 350022) +++ /usr/src/sys/kern/kern_exec.c (working copy) @@ -976,9 +976,7 @@ exec_map_first_page(struct image_params *imgp) if (ma[0]->valid != VM_PAGE_BITS_ALL) { vm_page_xbusy(ma[0]); if (!vm_pager_has_page(object, 0, NULL, &after)) { - vm_page_lock(ma[0]); vm_page_free(ma[0]); - vm_page_unlock(ma[0]); VM_OBJECT_WUNLOCK(object); return (EIO); } @@ -1002,11 +1000,8 @@ exec_map_first_page(struct image_params *imgp) initial_pagein = i; rv = vm_pager_get_pages(object, ma, initial_pagein, NULL, NULL); if (rv != VM_PAGER_OK) { - for (i = 0; i < initial_pagein; i++) { - vm_page_lock(ma[i]); + for (i = 0; i < initial_pagein; i++) vm_page_free(ma[i]); - vm_page_unlock(ma[i]); - } VM_OBJECT_WUNLOCK(object); return (EIO); } @@ -1014,9 +1009,7 @@ exec_map_first_page(struct image_params *imgp) for (i = 1; i < initial_pagein; i++) vm_page_readahead_finish(ma[i]); } - vm_page_lock(ma[0]); vm_page_wire(ma[0]); - vm_page_unlock(ma[0]); VM_OBJECT_WUNLOCK(object); imgp->firstpage = sf_buf_alloc(ma[0], 0); Index: /usr/src/sys/kern/kern_sendfile.c =================================================================== --- /usr/src/sys/kern/kern_sendfile.c (revision 350022) +++ /usr/src/sys/kern/kern_sendfile.c (working copy) @@ -121,66 +121,11 @@ sfstat_sysctl(SYSCTL_HANDLER_ARGS) SYSCTL_PROC(_kern_ipc, OID_AUTO, sfstat, CTLTYPE_OPAQUE | CTLFLAG_RW, NULL, 0, sfstat_sysctl, "I", "sendfile statistics"); -/* - * Detach mapped page and release resources back to the system. Called - * by mbuf(9) code when last reference to a page is freed. - */ static void -sendfile_free_page(vm_page_t pg, bool nocache) -{ - bool freed; - - vm_page_lock(pg); - /* - * In either case check for the object going away on us. This can - * happen since we don't hold a reference to it. If so, we're - * responsible for freeing the page. In 'noncache' case try to free - * the page, but only if it is cheap to. - */ - if (vm_page_unwire_noq(pg)) { - vm_object_t obj; - - if ((obj = pg->object) == NULL) - vm_page_free(pg); - else { - freed = false; - if (nocache && !vm_page_xbusied(pg) && - VM_OBJECT_TRYWLOCK(obj)) { - /* Only free unmapped pages. */ - if (obj->ref_count == 0 || - !pmap_page_is_mapped(pg)) - /* - * The busy test before the object is - * locked cannot be relied upon. - */ - freed = vm_page_try_to_free(pg); - VM_OBJECT_WUNLOCK(obj); - } - if (!freed) { - /* - * If we were asked to not cache the page, place - * it near the head of the inactive queue so - * that it is reclaimed sooner. Otherwise, - * maintain LRU. - */ - if (nocache) - vm_page_deactivate_noreuse(pg); - else if (vm_page_active(pg)) - vm_page_reference(pg); - else - vm_page_deactivate(pg); - } - } - } - vm_page_unlock(pg); -} - -static void sendfile_free_mext(struct mbuf *m) { struct sf_buf *sf; vm_page_t pg; - bool nocache; KASSERT(m->m_flags & M_EXT && m->m_ext.ext_type == EXT_SFBUF, ("%s: m %p !M_EXT or !EXT_SFBUF", __func__, m)); @@ -187,10 +132,9 @@ sendfile_free_mext(struct mbuf *m) sf = m->m_ext.ext_arg1; pg = sf_buf_page(sf); - nocache = m->m_ext.ext_flags & EXT_FLAG_NOCACHE; sf_buf_free(sf); - sendfile_free_page(pg, nocache); + vm_page_release(pg, (m->m_ext.ext_flags & EXT_FLAG_NOCACHE) != 0); if (m->m_ext.ext_flags & EXT_FLAG_SYNC) { struct sendfile_sync *sfs = m->m_ext.ext_arg2; @@ -222,7 +166,7 @@ sendfile_free_mext_pg(struct mbuf *m) if (cache_last && i == ext_pgs->npgs - 1) nocache = false; pg = PHYS_TO_VM_PAGE(ext_pgs->pa[i]); - sendfile_free_page(pg, nocache); + vm_page_release(pg, nocache); } if (m->m_ext.ext_flags & EXT_FLAG_SYNC) { Index: /usr/src/sys/kern/sys_process.c =================================================================== --- /usr/src/sys/kern/sys_process.c (revision 350022) +++ /usr/src/sys/kern/sys_process.c (working copy) @@ -312,8 +312,7 @@ proc_rwmem(struct proc *p, struct uio *uio) * Release the page. */ vm_page_lock(m); - if (vm_page_unwire(m, PQ_ACTIVE) && m->object == NULL) - vm_page_free(m); + vm_page_unwire(m, PQ_ACTIVE); vm_page_unlock(m); } while (error == 0 && uio->uio_resid > 0); Index: /usr/src/sys/kern/uipc_shm.c =================================================================== --- /usr/src/sys/kern/uipc_shm.c (revision 350022) +++ /usr/src/sys/kern/uipc_shm.c (working copy) @@ -196,9 +196,7 @@ uiomove_object_page(vm_object_t obj, size_t len, s printf( "uiomove_object: vm_obj %p idx %jd valid %x pager error %d\n", obj, idx, m->valid, rv); - vm_page_lock(m); vm_page_free(m); - vm_page_unlock(m); VM_OBJECT_WUNLOCK(obj); return (EIO); } @@ -206,9 +204,7 @@ uiomove_object_page(vm_object_t obj, size_t len, s vm_page_zero_invalid(m, TRUE); vm_page_xunbusy(m); } - vm_page_lock(m); vm_page_wire(m); - vm_page_unlock(m); VM_OBJECT_WUNLOCK(obj); error = uiomove_fromphys(&m, offset, tlen, uio); if (uio->uio_rw == UIO_WRITE && error == 0) { Index: /usr/src/sys/kern/vfs_bio.c =================================================================== --- /usr/src/sys/kern/vfs_bio.c (revision 350022) +++ /usr/src/sys/kern/vfs_bio.c (working copy) @@ -2895,47 +2895,6 @@ vfs_vmio_iodone(struct buf *bp) } /* - * Unwire a page held by a buf and either free it or update the page queues to - * reflect its recent use. - */ -static void -vfs_vmio_unwire(struct buf *bp, vm_page_t m) -{ - bool freed; - - vm_page_lock(m); - if (vm_page_unwire_noq(m)) { - if ((bp->b_flags & B_DIRECT) != 0) - freed = vm_page_try_to_free(m); - else - freed = false; - if (!freed) { - /* - * Use a racy check of the valid bits to determine - * whether we can accelerate reclamation of the page. - * The valid bits will be stable unless the page is - * being mapped or is referenced by multiple buffers, - * and in those cases we expect races to be rare. At - * worst we will either accelerate reclamation of a - * valid page and violate LRU, or unnecessarily defer - * reclamation of an invalid page. - * - * The B_NOREUSE flag marks data that is not expected to - * be reused, so accelerate reclamation in that case - * too. Otherwise, maintain LRU. - */ - if (m->valid == 0 || (bp->b_flags & B_NOREUSE) != 0) - vm_page_deactivate_noreuse(m); - else if (vm_page_active(m)) - vm_page_reference(m); - else - vm_page_deactivate(m); - } - } - vm_page_unlock(m); -} - -/* * Perform page invalidation when a buffer is released. The fully invalid * pages will be reclaimed later in vfs_vmio_truncate(). */ @@ -2984,7 +2943,8 @@ vfs_vmio_invalidate(struct buf *bp) } if (pmap_page_wired_mappings(m) == 0) vm_page_set_invalid(m, poffset, presid); - vfs_vmio_unwire(bp, m); + vm_page_release_locked(m, + (bp->b_flags & (B_NOREUSE | B_DIRECT)) != 0); resid -= presid; poffset = 0; } @@ -3022,7 +2982,10 @@ vfs_vmio_truncate(struct buf *bp, int desiredpages m = bp->b_pages[i]; KASSERT(m != bogus_page, ("allocbuf: bogus page found")); bp->b_pages[i] = NULL; - vfs_vmio_unwire(bp, m); + if (obj != NULL) + vm_page_release_locked(m, true); + else + vm_page_release(m, (bp->b_flags & B_NOREUSE) != 0); } if (obj != NULL) VM_OBJECT_WUNLOCK(obj); Index: /usr/src/sys/mips/mips/pmap.c =================================================================== --- /usr/src/sys/mips/mips/pmap.c (revision 350022) +++ /usr/src/sys/mips/mips/pmap.c (working copy) @@ -795,26 +795,22 @@ vm_page_t pmap_extract_and_hold(pmap_t pmap, vm_offset_t va, vm_prot_t prot) { pt_entry_t pte, *ptep; - vm_paddr_t pa, pte_pa; + vm_paddr_t pa; vm_page_t m; m = NULL; - pa = 0; PMAP_LOCK(pmap); -retry: ptep = pmap_pte(pmap, va); if (ptep != NULL) { pte = *ptep; if (pte_test(&pte, PTE_V) && (!pte_test(&pte, PTE_RO) || (prot & VM_PROT_WRITE) == 0)) { - pte_pa = TLBLO_PTE_TO_PA(pte); - if (vm_page_pa_tryrelock(pmap, pte_pa, &pa)) - goto retry; - m = PHYS_TO_VM_PAGE(pte_pa); - vm_page_wire(m); + pa = TLBLO_PTE_TO_PA(pte); + m = PHYS_TO_VM_PAGE(pa); + if (!vm_page_wire_mapped(m)) + m = NULL; } } - PA_UNLOCK_COND(pa); PMAP_UNLOCK(pmap); return (m); } Index: /usr/src/sys/net/bpf_zerocopy.c =================================================================== --- /usr/src/sys/net/bpf_zerocopy.c (revision 350022) +++ /usr/src/sys/net/bpf_zerocopy.c (working copy) @@ -116,8 +116,7 @@ zbuf_page_free(vm_page_t pp) { vm_page_lock(pp); - if (vm_page_unwire(pp, PQ_INACTIVE) && pp->object == NULL) - vm_page_free(pp); + vm_page_unwire(pp, PQ_INACTIVE); vm_page_unlock(pp); } Index: /usr/src/sys/powerpc/aim/mmu_oea.c =================================================================== --- /usr/src/sys/powerpc/aim/mmu_oea.c (revision 350022) +++ /usr/src/sys/powerpc/aim/mmu_oea.c (working copy) @@ -1262,22 +1262,17 @@ moea_extract_and_hold(mmu_t mmu, pmap_t pmap, vm_o { struct pvo_entry *pvo; vm_page_t m; - vm_paddr_t pa; m = NULL; - pa = 0; PMAP_LOCK(pmap); -retry: pvo = moea_pvo_find_va(pmap, va & ~ADDR_POFF, NULL); if (pvo != NULL && (pvo->pvo_pte.pte.pte_hi & PTE_VALID) && ((pvo->pvo_pte.pte.pte_lo & PTE_PP) == PTE_RW || (prot & VM_PROT_WRITE) == 0)) { - if (vm_page_pa_tryrelock(pmap, pvo->pvo_pte.pte.pte_lo & PTE_RPGN, &pa)) - goto retry; m = PHYS_TO_VM_PAGE(pvo->pvo_pte.pte.pte_lo & PTE_RPGN); - vm_page_wire(m); + if (!vm_page_wire_mapped(m)) + m = NULL; } - PA_UNLOCK_COND(pa); PMAP_UNLOCK(pmap); return (m); } Index: /usr/src/sys/powerpc/aim/mmu_oea64.c =================================================================== --- /usr/src/sys/powerpc/aim/mmu_oea64.c (revision 350022) +++ /usr/src/sys/powerpc/aim/mmu_oea64.c (working copy) @@ -1583,21 +1583,15 @@ moea64_extract_and_hold(mmu_t mmu, pmap_t pmap, vm { struct pvo_entry *pvo; vm_page_t m; - vm_paddr_t pa; m = NULL; - pa = 0; PMAP_LOCK(pmap); -retry: pvo = moea64_pvo_find_va(pmap, va & ~ADDR_POFF); if (pvo != NULL && (pvo->pvo_pte.prot & prot) == prot) { - if (vm_page_pa_tryrelock(pmap, - pvo->pvo_pte.pa & LPTE_RPGN, &pa)) - goto retry; m = PHYS_TO_VM_PAGE(pvo->pvo_pte.pa & LPTE_RPGN); - vm_page_wire(m); + if (!vm_page_wire_mapped(m)) + m = NULL; } - PA_UNLOCK_COND(pa); PMAP_UNLOCK(pmap); return (m); } Index: /usr/src/sys/powerpc/booke/pmap.c =================================================================== --- /usr/src/sys/powerpc/booke/pmap.c (revision 350022) +++ /usr/src/sys/powerpc/booke/pmap.c (working copy) @@ -2934,12 +2934,9 @@ mmu_booke_extract_and_hold(mmu_t mmu, pmap_t pmap, pte_t *pte; vm_page_t m; uint32_t pte_wbit; - vm_paddr_t pa; - + m = NULL; - pa = 0; PMAP_LOCK(pmap); -retry: pte = pte_find(mmu, pmap, va); if ((pte != NULL) && PTE_ISVALID(pte)) { if (pmap == kernel_pmap) @@ -2948,14 +2945,11 @@ mmu_booke_extract_and_hold(mmu_t mmu, pmap_t pmap, pte_wbit = PTE_UW; if ((*pte & pte_wbit) || ((prot & VM_PROT_WRITE) == 0)) { - if (vm_page_pa_tryrelock(pmap, PTE_PA(pte), &pa)) - goto retry; m = PHYS_TO_VM_PAGE(PTE_PA(pte)); - vm_page_wire(m); + if (!vm_page_wire_mapped(m)) + m = NULL; } } - - PA_UNLOCK_COND(pa); PMAP_UNLOCK(pmap); return (m); } Index: /usr/src/sys/riscv/riscv/pmap.c =================================================================== --- /usr/src/sys/riscv/riscv/pmap.c (revision 350022) +++ /usr/src/sys/riscv/riscv/pmap.c (working copy) @@ -870,24 +870,19 @@ pmap_extract_and_hold(pmap_t pmap, vm_offset_t va, { pt_entry_t *l3p, l3; vm_paddr_t phys; - vm_paddr_t pa; vm_page_t m; - pa = 0; m = NULL; PMAP_LOCK(pmap); -retry: l3p = pmap_l3(pmap, va); if (l3p != NULL && (l3 = pmap_load(l3p)) != 0) { if ((l3 & PTE_W) != 0 || (prot & VM_PROT_WRITE) == 0) { phys = PTE_TO_PHYS(l3); - if (vm_page_pa_tryrelock(pmap, phys, &pa)) - goto retry; m = PHYS_TO_VM_PAGE(phys); - vm_page_wire(m); + if (!vm_page_wire_mapped(m)) + m = NULL; } } - PA_UNLOCK_COND(pa); PMAP_UNLOCK(pmap); return (m); } Index: /usr/src/sys/sparc64/sparc64/pmap.c =================================================================== --- /usr/src/sys/sparc64/sparc64/pmap.c (revision 350022) +++ /usr/src/sys/sparc64/sparc64/pmap.c (working copy) @@ -847,19 +847,15 @@ pmap_extract_and_hold(pmap_t pm, vm_offset_t va, v { struct tte *tp; vm_page_t m; - vm_paddr_t pa; m = NULL; - pa = 0; PMAP_LOCK(pm); -retry: if (pm == kernel_pmap) { if (va >= VM_MIN_DIRECT_ADDRESS) { tp = NULL; m = PHYS_TO_VM_PAGE(TLB_DIRECT_TO_PHYS(va)); - (void)vm_page_pa_tryrelock(pm, TLB_DIRECT_TO_PHYS(va), - &pa); - vm_page_wire(m); + if (!vm_page_wire_mapped(m)) + m = NULL; } else { tp = tsb_kvtotte(va); if ((tp->tte_data & TD_V) == 0) @@ -869,12 +865,10 @@ pmap_extract_and_hold(pmap_t pm, vm_offset_t va, v tp = tsb_tte_lookup(pm, va); if (tp != NULL && ((tp->tte_data & TD_SW) || (prot & VM_PROT_WRITE) == 0)) { - if (vm_page_pa_tryrelock(pm, TTE_GET_PA(tp), &pa)) - goto retry; m = PHYS_TO_VM_PAGE(TTE_GET_PA(tp)); - vm_page_wire(m); + if (!vm_page_wire_mapped(m)) + m = NULL; } - PA_UNLOCK_COND(pa); PMAP_UNLOCK(pm); return (m); } Index: /usr/src/sys/vm/device_pager.c =================================================================== --- /usr/src/sys/vm/device_pager.c (revision 350022) +++ /usr/src/sys/vm/device_pager.c (working copy) @@ -235,9 +235,7 @@ cdev_pager_free_page(vm_object_t object, vm_page_t if (object->type == OBJT_MGTDEVICE) { KASSERT((m->oflags & VPO_UNMANAGED) == 0, ("unmanaged %p", m)); pmap_remove_all(m); - vm_page_lock(m); (void)vm_page_remove(m); - vm_page_unlock(m); } else if (object->type == OBJT_DEVICE) dev_pager_free_page(object, m); } Index: /usr/src/sys/vm/vm_fault.c =================================================================== --- /usr/src/sys/vm/vm_fault.c (revision 350022) +++ /usr/src/sys/vm/vm_fault.c (working copy) @@ -251,18 +251,6 @@ vm_fault_dirty(vm_map_entry_t entry, vm_page_t m, vm_pager_page_unswapped(m); } -static void -vm_fault_fill_hold(vm_page_t *m_hold, vm_page_t m) -{ - - if (m_hold != NULL) { - *m_hold = m; - vm_page_lock(m); - vm_page_wire(m); - vm_page_unlock(m); - } -} - /* * Unlocks fs.first_object and fs.map on success. */ @@ -323,7 +311,10 @@ vm_fault_soft_fast(struct faultstate *fs, vm_offse PMAP_ENTER_NOSLEEP | (wired ? PMAP_ENTER_WIRED : 0), psind); if (rv != KERN_SUCCESS) return (rv); - vm_fault_fill_hold(m_hold, m); + if (m_hold != NULL) { + *m_hold = m; + vm_page_wire(m); + } vm_fault_dirty(fs->entry, m, prot, fault_type, fault_flags, false); if (psind == 0 && !wired) vm_fault_prefault(fs, vaddr, PFBAK, PFFOR, true); @@ -499,11 +490,12 @@ vm_fault_populate(struct faultstate *fs, vm_prot_t VM_OBJECT_WLOCK(fs->first_object); m_mtx = NULL; for (i = 0; i < npages; i++) { - vm_page_change_lock(&m[i], &m_mtx); - if ((fault_flags & VM_FAULT_WIRE) != 0) + if ((fault_flags & VM_FAULT_WIRE) != 0) { vm_page_wire(&m[i]); - else + } else { + vm_page_change_lock(&m[i], &m_mtx); vm_page_activate(&m[i]); + } if (m_hold != NULL && m[i].pindex == fs->first_pindex) { *m_hold = &m[i]; vm_page_wire(&m[i]); @@ -1150,9 +1142,10 @@ readrest: * daemon, while it is disassociated from an * object. */ + vm_page_wire(fs.m); + mtx = NULL; vm_page_change_lock(fs.m, &mtx); - vm_page_wire(fs.m); (void)vm_page_remove(fs.m); vm_page_change_lock(fs.first_m, &mtx); vm_page_replace_checked(fs.m, fs.first_object, @@ -1186,10 +1179,8 @@ readrest: fs.first_m->valid = VM_PAGE_BITS_ALL; if (wired && (fault_flags & VM_FAULT_WIRE) == 0) { - vm_page_lock(fs.first_m); vm_page_wire(fs.first_m); - vm_page_unlock(fs.first_m); - + vm_page_lock(fs.m); vm_page_unwire(fs.m, PQ_INACTIVE); vm_page_unlock(fs.m); @@ -1325,21 +1316,22 @@ readrest: faultcount > 0 ? behind : PFBAK, faultcount > 0 ? ahead : PFFOR, false); VM_OBJECT_WLOCK(fs.object); - vm_page_lock(fs.m); /* * If the page is not wired down, then put it where the pageout daemon * can find it. */ - if ((fault_flags & VM_FAULT_WIRE) != 0) + if ((fault_flags & VM_FAULT_WIRE) != 0) { vm_page_wire(fs.m); - else + } else { + vm_page_lock(fs.m); vm_page_activate(fs.m); + vm_page_unlock(fs.m); + } if (m_hold != NULL) { *m_hold = fs.m; vm_page_wire(fs.m); } - vm_page_unlock(fs.m); vm_page_xunbusy(fs.m); /* @@ -1610,9 +1602,7 @@ error: for (mp = ma; mp < ma + count; mp++) if (*mp != NULL) { vm_page_lock(*mp); - if (vm_page_unwire(*mp, PQ_INACTIVE) && - (*mp)->object == NULL) - vm_page_free(*mp); + vm_page_unwire(*mp, PQ_INACTIVE); vm_page_unlock(*mp); } return (-1); @@ -1813,9 +1803,7 @@ again: vm_page_lock(src_m); vm_page_unwire(src_m, PQ_INACTIVE); vm_page_unlock(src_m); - vm_page_lock(dst_m); vm_page_wire(dst_m); - vm_page_unlock(dst_m); } else { KASSERT(vm_page_wired(dst_m), ("dst_m %p is not wired", dst_m)); Index: /usr/src/sys/vm/vm_glue.c =================================================================== --- /usr/src/sys/vm/vm_glue.c (revision 350022) +++ /usr/src/sys/vm/vm_glue.c (working copy) @@ -405,10 +405,8 @@ vm_thread_stack_dispose(vm_object_t ksobj, vm_offs m = vm_page_lookup(ksobj, i); if (m == NULL) panic("vm_thread_dispose: kstack already missing?"); - vm_page_lock(m); vm_page_unwire_noq(m); vm_page_free(m); - vm_page_unlock(m); } VM_OBJECT_WUNLOCK(ksobj); vm_object_deallocate(ksobj); Index: /usr/src/sys/vm/vm_object.c =================================================================== --- /usr/src/sys/vm/vm_object.c (revision 350022) +++ /usr/src/sys/vm/vm_object.c (working copy) @@ -699,12 +699,9 @@ static void vm_object_terminate_pages(vm_object_t object) { vm_page_t p, p_next; - struct mtx *mtx; VM_OBJECT_ASSERT_WLOCKED(object); - mtx = NULL; - /* * Free any remaining pageable pages. This also removes them from the * paging queues. However, don't free wired pages, just remove them @@ -713,20 +710,15 @@ vm_object_terminate_pages(vm_object_t object) */ TAILQ_FOREACH_SAFE(p, &object->memq, listq, p_next) { vm_page_assert_unbusied(p); - if ((object->flags & OBJ_UNMANAGED) == 0) - /* - * vm_page_free_prep() only needs the page - * lock for managed pages. - */ - vm_page_change_lock(p, &mtx); + KASSERT(p->object == object && p->ref_count > 0, + ("vm_object_terminate_pages: page %p is inconsistent", p)); + p->object = NULL; - if (vm_page_wired(p)) - continue; - VM_CNT_INC(v_pfree); - vm_page_free(p); + if (vm_page_drop(p, -VPRC_OBJREF) == VPRC_OBJREF) { + VM_CNT_INC(v_pfree); + vm_page_free(p); + } } - if (mtx != NULL) - mtx_unlock(mtx); /* * If the object contained any pages, then reset it to an empty state. @@ -1588,16 +1580,10 @@ vm_object_collapse_scan(vm_object_t object, int op swap_pager_freespace(backing_object, p->pindex, 1); - /* - * Page is out of the parent object's range, we can - * simply destroy it. - */ - vm_page_lock(p); KASSERT(!pmap_page_is_mapped(p), ("freeing mapped page %p", p)); if (vm_page_remove(p)) vm_page_free(p); - vm_page_unlock(p); continue; } @@ -1634,12 +1620,10 @@ vm_object_collapse_scan(vm_object_t object, int op if (backing_object->type == OBJT_SWAP) swap_pager_freespace(backing_object, p->pindex, 1); - vm_page_lock(p); KASSERT(!pmap_page_is_mapped(p), ("freeing mapped page %p", p)); if (vm_page_remove(p)) vm_page_free(p); - vm_page_unlock(p); continue; } @@ -1940,6 +1924,7 @@ again: VM_OBJECT_WLOCK(object); goto again; } +wired: if (vm_page_wired(p)) { if ((options & OBJPR_NOTMAPPED) == 0 && object->ref_count != 0) @@ -1960,14 +1945,17 @@ again: ("vm_object_page_remove: page %p is fictitious", p)); if ((options & OBJPR_CLEANONLY) != 0 && p->valid != 0) { if ((options & OBJPR_NOTMAPPED) == 0 && - object->ref_count != 0) - pmap_remove_write(p); + object->ref_count != 0 && + !vm_page_try_remove_write(p)) + goto wired; if (p->dirty != 0) continue; } - if ((options & OBJPR_NOTMAPPED) == 0 && object->ref_count != 0) - pmap_remove_all(p); - vm_page_free(p); + if ((options & OBJPR_NOTMAPPED) == 0 && + object->ref_count != 0 && !vm_page_try_remove_all(p)) + goto wired; + if (vm_page_remove(p)) + vm_page_free(p); } if (mtx != NULL) mtx_unlock(mtx); Index: /usr/src/sys/vm/vm_page.c =================================================================== --- /usr/src/sys/vm/vm_page.c (revision 350022) +++ /usr/src/sys/vm/vm_page.c (working copy) @@ -161,16 +161,17 @@ static void vm_page_dequeue_complete(vm_page_t m); static void vm_page_enqueue(vm_page_t m, uint8_t queue); static void vm_page_init(void *dummy); static int vm_page_insert_after(vm_page_t m, vm_object_t object, - vm_pindex_t pindex, vm_page_t mpred); + vm_pindex_t pindex, vm_page_t mpred, const bool alloc); static void vm_page_insert_radixdone(vm_page_t m, vm_object_t object, vm_page_t mpred); +static void vm_page_mvqueue(vm_page_t m, int queue); static int vm_page_reclaim_run(int req_class, int domain, u_long npages, vm_page_t m_run, vm_paddr_t high); static int vm_domain_alloc_fail(struct vm_domain *vmd, vm_object_t object, int req); -static int vm_page_import(void *arg, void **store, int cnt, int domain, +static int vm_page_zone_import(void *arg, void **store, int cnt, int domain, int flags); -static void vm_page_release(void *arg, void **store, int cnt); +static void vm_page_zone_release(void *arg, void **store, int cnt); SYSINIT(vm_page, SI_SUB_VM, SI_ORDER_SECOND, vm_page_init, NULL); @@ -210,7 +211,7 @@ vm_page_init_cache_zones(void *dummy __unused) pgcache->pool = pool; pgcache->zone = uma_zcache_create("vm pgcache", sizeof(struct vm_page), NULL, NULL, NULL, NULL, - vm_page_import, vm_page_release, pgcache, + vm_page_zone_import, vm_page_zone_release, pgcache, UMA_ZONE_MAXBUCKET | UMA_ZONE_VM); (void)uma_zone_set_maxcache(pgcache->zone, 0); } @@ -509,7 +510,7 @@ vm_page_init_page(vm_page_t m, vm_paddr_t pa, int { m->object = NULL; - m->wire_count = 0; + m->ref_count = 0; m->busy_lock = VPB_UNBUSIED; m->flags = m->aflags = 0; m->phys_addr = pa; @@ -1105,8 +1106,7 @@ vm_page_unhold_pages(vm_page_t *ma, int count) mtx = NULL; for (; count != 0; count--) { vm_page_change_lock(*ma, &mtx); - if (vm_page_unwire(*ma, PQ_ACTIVE) && (*ma)->object == NULL) - vm_page_free(*ma); + vm_page_unwire(*ma, PQ_ACTIVE); ma++; } if (mtx != NULL) @@ -1173,7 +1173,8 @@ vm_page_initfake(vm_page_t m, vm_paddr_t paddr, vm /* Fictitious pages don't use "order" or "pool". */ m->oflags = VPO_UNMANAGED; m->busy_lock = VPB_SINGLE_EXCLUSIVER; - m->wire_count = 1; + /* Fictitious pages are unevictable. */ + m->ref_count = 1; pmap_page_init(m); memattr: pmap_page_set_memattr(m, memattr); @@ -1333,7 +1334,7 @@ vm_page_insert(vm_page_t m, vm_object_t object, vm VM_OBJECT_ASSERT_WLOCKED(object); mpred = vm_radix_lookup_le(&object->rtree, pindex); - return (vm_page_insert_after(m, object, pindex, mpred)); + return (vm_page_insert_after(m, object, pindex, mpred, false)); } /* @@ -1344,11 +1345,14 @@ vm_page_insert(vm_page_t m, vm_object_t object, vm * The page "mpred" must immediately precede the offset "pindex" within * the specified object. * + * "alloc" should be true if the page is being allocated and false + * otherwise. + * * The object must be locked. */ static int vm_page_insert_after(vm_page_t m, vm_object_t object, vm_pindex_t pindex, - vm_page_t mpred) + vm_page_t mpred, const bool alloc) { vm_page_t msucc; @@ -1368,10 +1372,14 @@ vm_page_insert_after(vm_page_t m, vm_object_t obje ("vm_page_insert_after: msucc doesn't succeed pindex")); /* - * Record the object/offset pair in this page + * Record the object/offset pair in this page. */ m->object = object; m->pindex = pindex; + if (alloc) + m->ref_count |= VPRC_OBJREF; + else + atomic_set_int(&m->ref_count, VPRC_OBJREF); /* * Now link into the object's ordered list of backed pages. @@ -1379,6 +1387,10 @@ vm_page_insert_after(vm_page_t m, vm_object_t obje if (vm_radix_insert(&object->rtree, m)) { m->object = NULL; m->pindex = 0; + if (alloc) + m->ref_count &= ~VPRC_OBJREF; + else + atomic_clear_int(&m->ref_count, VPRC_OBJREF); return (1); } vm_page_insert_radixdone(m, object, mpred); @@ -1403,11 +1415,13 @@ vm_page_insert_radixdone(vm_page_t m, vm_object_t VM_OBJECT_ASSERT_WLOCKED(object); KASSERT(object != NULL && m->object == object, ("vm_page_insert_radixdone: page %p has inconsistent object", m)); + KASSERT((m->ref_count & VPRC_OBJREF) != 0, + ("vm_page_insert_radixdone: page %p is missing object ref", m)); if (mpred != NULL) { KASSERT(mpred->object == object, - ("vm_page_insert_after: object doesn't contain mpred")); + ("vm_page_insert_radixdone: object doesn't contain mpred")); KASSERT(mpred->pindex < m->pindex, - ("vm_page_insert_after: mpred doesn't precede pindex")); + ("vm_page_insert_radixdone: mpred doesn't precede pindex")); } if (mpred != NULL) @@ -1438,10 +1452,10 @@ vm_page_insert_radixdone(vm_page_t m, vm_object_t * vm_page_remove: * * Removes the specified page from its containing object, but does not - * invalidate any backing storage. Return true if the page may be safely - * freed and false otherwise. + * invalidate any backing storage. Returns true if the object's reference + * was the last reference to the page, and false otherwise. * - * The object must be locked. The page must be locked if it is managed. + * The object must be locked. */ bool vm_page_remove(vm_page_t m) @@ -1450,10 +1464,9 @@ vm_page_remove(vm_page_t m) vm_page_t mrem; object = m->object; - - if ((m->oflags & VPO_UNMANAGED) == 0) - vm_page_assert_locked(m); VM_OBJECT_ASSERT_WLOCKED(object); + KASSERT((m->ref_count & VPRC_OBJREF) != 0, + ("page %p is missing its object ref", m)); if (vm_page_xbusied(m)) vm_page_xunbusy_maybelocked(m); mrem = vm_radix_remove(&object->rtree, m->pindex); @@ -1475,8 +1488,12 @@ vm_page_remove(vm_page_t m) if (object->resident_page_count == 0 && object->type == OBJT_VNODE) vdrop(object->handle); + /* + * Release the object reference. The caller may free the page + * after this point. + */ m->object = NULL; - return (!vm_page_wired(m)); + return (vm_page_drop(m, -VPRC_OBJREF) == VPRC_OBJREF); } /* @@ -1557,8 +1574,6 @@ vm_page_prev(vm_page_t m) /* * Uses the page mnew as a replacement for an existing page at index * pindex which must be already present in the object. - * - * The existing page must not be on a paging queue. */ vm_page_t vm_page_replace(vm_page_t mnew, vm_object_t object, vm_pindex_t pindex) @@ -1568,8 +1583,6 @@ vm_page_replace(vm_page_t mnew, vm_object_t object VM_OBJECT_ASSERT_WLOCKED(object); KASSERT(mnew->object == NULL, ("vm_page_replace: page %p already in object", mnew)); - KASSERT(mnew->queue == PQ_NONE || vm_page_wired(mnew), - ("vm_page_replace: new page %p is on a paging queue", mnew)); /* * This function mostly follows vm_page_insert() and @@ -1579,6 +1592,7 @@ vm_page_replace(vm_page_t mnew, vm_object_t object mnew->object = object; mnew->pindex = pindex; + atomic_set_int(&mnew->ref_count, VPRC_OBJREF); mold = vm_radix_replace(&object->rtree, mnew); KASSERT(mold->queue == PQ_NONE, ("vm_page_replace: old page %p is on a paging queue", mold)); @@ -1588,6 +1602,7 @@ vm_page_replace(vm_page_t mnew, vm_object_t object TAILQ_REMOVE(&object->memq, mold, listq); mold->object = NULL; + atomic_clear_int(&mold->ref_count, VPRC_OBJREF); vm_page_xunbusy_maybelocked(mold); /* @@ -1625,6 +1640,7 @@ vm_page_rename(vm_page_t m, vm_object_t new_object VM_OBJECT_ASSERT_WLOCKED(new_object); + KASSERT(m->ref_count != 0, ("vm_page_rename: page %p has no refs", m)); mpred = vm_radix_lookup_le(&new_object->rtree, new_pindex); KASSERT(mpred == NULL || mpred->pindex != new_pindex, ("vm_page_rename: pindex already renamed")); @@ -1652,6 +1668,8 @@ vm_page_rename(vm_page_t m, vm_object_t new_object /* Return back to the new pindex to complete vm_page_insert(). */ m->pindex = new_pindex; m->object = new_object; + atomic_set_int(&m->ref_count, VPRC_OBJREF); + vm_page_unlock(m); vm_page_insert_radixdone(m, new_object, mpred); vm_page_dirty(m); @@ -1869,15 +1887,15 @@ found: * page is inserted into the object. */ vm_wire_add(1); - m->wire_count = 1; + m->ref_count = 1; } m->act_count = 0; if (object != NULL) { - if (vm_page_insert_after(m, object, pindex, mpred)) { + if (vm_page_insert_after(m, object, pindex, mpred, true)) { if (req & VM_ALLOC_WIRED) { vm_wire_sub(1); - m->wire_count = 0; + m->ref_count = 0; } KASSERT(m->object == NULL, ("page %p has object", m)); m->oflags = VPO_UNMANAGED; @@ -2069,11 +2087,12 @@ found: m->flags = (m->flags | PG_NODUMP) & flags; m->busy_lock = busy_lock; if ((req & VM_ALLOC_WIRED) != 0) - m->wire_count = 1; + m->ref_count = 1; m->act_count = 0; m->oflags = oflags; if (object != NULL) { - if (vm_page_insert_after(m, object, pindex, mpred)) { + if (vm_page_insert_after(m, object, pindex, mpred, + true)) { if ((req & VM_ALLOC_WIRED) != 0) vm_wire_sub(npages); KASSERT(m->object == NULL, @@ -2082,7 +2101,7 @@ found: for (m = m_ret; m < &m_ret[npages]; m++) { if (m <= mpred && (req & VM_ALLOC_WIRED) != 0) - m->wire_count = 0; + m->ref_count = 0; m->oflags = VPO_UNMANAGED; m->busy_lock = VPB_UNBUSIED; /* Don't change PG_ZERO. */ @@ -2116,7 +2135,7 @@ vm_page_alloc_check(vm_page_t m) KASSERT(m->queue == PQ_NONE && (m->aflags & PGA_QUEUE_STATE_MASK) == 0, ("page %p has unexpected queue %d, flags %#x", m, m->queue, (m->aflags & PGA_QUEUE_STATE_MASK))); - KASSERT(!vm_page_wired(m), ("page %p is wired", m)); + KASSERT(m->ref_count == 0, ("page %p has references", m)); KASSERT(!vm_page_busied(m), ("page %p is busy", m)); KASSERT(m->dirty == 0, ("page %p is dirty", m)); KASSERT(pmap_page_get_memattr(m) == VM_MEMATTR_DEFAULT, @@ -2200,7 +2219,7 @@ again: * not belong to an object. */ vm_wire_add(1); - m->wire_count = 1; + m->ref_count = 1; } /* Unmanaged pages don't use "act_count". */ m->oflags = VPO_UNMANAGED; @@ -2208,7 +2227,7 @@ again: } static int -vm_page_import(void *arg, void **store, int cnt, int domain, int flags) +vm_page_zone_import(void *arg, void **store, int cnt, int domain, int flags) { struct vm_domain *vmd; struct vm_pgcache *pgcache; @@ -2231,7 +2250,7 @@ static int } static void -vm_page_release(void *arg, void **store, int cnt) +vm_page_zone_release(void *arg, void **store, int cnt) { struct vm_domain *vmd; struct vm_pgcache *pgcache; @@ -2293,8 +2312,8 @@ vm_page_scan_contig(u_long npages, vm_page_t m_sta for (m = m_start; m < m_end && run_len < npages; m += m_inc) { KASSERT((m->flags & PG_MARKER) == 0, ("page %p is PG_MARKER", m)); - KASSERT((m->flags & PG_FICTITIOUS) == 0 || m->wire_count == 1, - ("fictitious page %p has invalid wire count", m)); + KASSERT((m->flags & PG_FICTITIOUS) == 0 || m->ref_count >= 1, + ("fictitious page %p has invalid ref count", m)); /* * If the current page would be the start of a run, check its @@ -2351,9 +2370,6 @@ retry: */ VM_OBJECT_RUNLOCK(object); goto retry; - } else if (vm_page_wired(m)) { - run_ext = 0; - goto unlock; } } /* Don't care: PG_NODUMP, PG_ZERO. */ @@ -2371,7 +2387,8 @@ retry: vm_reserv_size(level)) - pa); #endif } else if (object->memattr == VM_MEMATTR_DEFAULT && - vm_page_queue(m) != PQ_NONE && !vm_page_busied(m)) { + vm_page_queue(m) != PQ_NONE && !vm_page_busied(m) && + !vm_page_wired(m)) { /* * The page is allocated but eligible for * relocation. Extend the current run by one @@ -2387,7 +2404,6 @@ retry: run_ext = 1; } else run_ext = 0; -unlock: VM_OBJECT_RUNLOCK(object); #if VM_NRESERVLEVEL > 0 } else if (level >= 0) { @@ -2508,9 +2524,6 @@ retry: */ VM_OBJECT_WUNLOCK(object); goto retry; - } else if (vm_page_wired(m)) { - error = EBUSY; - goto unlock; } } /* Don't care: PG_NODUMP, PG_ZERO. */ @@ -2521,7 +2534,7 @@ retry: else if (object->memattr != VM_MEMATTR_DEFAULT) error = EINVAL; else if (vm_page_queue(m) != PQ_NONE && - !vm_page_busied(m)) { + !vm_page_busied(m) && !vm_page_wired(m)) { KASSERT(pmap_page_get_memattr(m) == VM_MEMATTR_DEFAULT, ("page %p has an unexpected memattr", m)); @@ -2570,8 +2583,6 @@ retry: error = ENOMEM; goto unlock; } - KASSERT(!vm_page_wired(m_new), - ("page %p is wired", m_new)); /* * Replace "m" with the new page. For @@ -2579,8 +2590,11 @@ retry: * and dequeued. Finally, change "m" * as if vm_page_free() was called. */ - if (object->ref_count != 0) - pmap_remove_all(m); + if (object->ref_count != 0 && + !vm_page_try_remove_all(m)) { + error = EBUSY; + goto unlock; + } m_new->aflags = m->aflags & ~PGA_QUEUE_STATE_MASK; KASSERT(m_new->oflags == VPO_UNMANAGED, @@ -3140,8 +3154,7 @@ vm_pqbatch_submit_page(vm_page_t m, uint8_t queue) KASSERT((m->oflags & VPO_UNMANAGED) == 0, ("page %p is unmanaged", m)); - KASSERT(mtx_owned(vm_page_lockptr(m)) || - (m->object == NULL && (m->aflags & PGA_DEQUEUE) != 0), + KASSERT(mtx_owned(vm_page_lockptr(m)) || m->object == NULL, ("missing synchronization for page %p", m)); KASSERT(queue < PQ_COUNT, ("invalid queue %d", queue)); @@ -3270,7 +3283,7 @@ vm_page_dequeue_deferred_free(vm_page_t m) { uint8_t queue; - KASSERT(m->object == NULL, ("page %p has an object reference", m)); + KASSERT(m->ref_count == 0, ("page %p has references", m)); if ((m->aflags & PGA_DEQUEUE) != 0) return; @@ -3395,6 +3408,12 @@ bool vm_page_free_prep(vm_page_t m) { + /* + * Synchronize with vm_page_drop(): ensure that all page modifications + * are visible before proceeding. + */ + atomic_thread_fence_acq(); + #if defined(DIAGNOSTIC) && defined(PHYS_TO_DMAP) if (PMAP_HAS_DMAP && (m->flags & PG_ZERO) != 0) { uint64_t *p; @@ -3405,11 +3424,10 @@ vm_page_free_prep(vm_page_t m) m, i, (uintmax_t)*p)); } #endif - if ((m->oflags & VPO_UNMANAGED) == 0) { - vm_page_lock_assert(m, MA_OWNED); + if ((m->oflags & VPO_UNMANAGED) == 0) KASSERT(!pmap_page_is_mapped(m), ("vm_page_free_prep: freeing mapped page %p", m)); - } else + else KASSERT(m->queue == PQ_NONE, ("vm_page_free_prep: unmanaged page %p is queued", m)); VM_CNT_INC(v_tfree); @@ -3425,8 +3443,8 @@ vm_page_free_prep(vm_page_t m) * return. */ if ((m->flags & PG_FICTITIOUS) != 0) { - KASSERT(m->wire_count == 1, - ("fictitious page %p is not wired", m)); + KASSERT(m->ref_count == 1, + ("fictitious page %p is referenced", m)); KASSERT(m->queue == PQ_NONE, ("fictitious page %p is queued", m)); return (false); @@ -3443,8 +3461,8 @@ vm_page_free_prep(vm_page_t m) m->valid = 0; vm_page_undirty(m); - if (vm_page_wired(m) != 0) - panic("vm_page_free_prep: freeing wired page %p", m); + if (m->ref_count != 0) + panic("vm_page_free_prep: page %p has references", m); /* * Restore the default memory attribute to the page. @@ -3526,161 +3544,187 @@ vm_page_free_pages_toq(struct spglist *free, bool } /* - * vm_page_wire: - * - * Mark this page as wired down. If the page is fictitious, then - * its wire count must remain one. - * - * The page must be locked. + * Mark this page as wired down, preventing reclamation by the page daemon + * or when the containing object is destroyed. */ void vm_page_wire(vm_page_t m) { + u_int old; - vm_page_assert_locked(m); - if ((m->flags & PG_FICTITIOUS) != 0) { - KASSERT(m->wire_count == 1, - ("vm_page_wire: fictitious page %p's wire count isn't one", - m)); - return; - } - if (!vm_page_wired(m)) { - KASSERT((m->oflags & VPO_UNMANAGED) == 0 || - m->queue == PQ_NONE, - ("vm_page_wire: unmanaged page %p is queued", m)); + KASSERT(m->object != NULL, + ("vm_page_wire: page %p does not belong to an object", m)); + if (!vm_page_busied(m)) + VM_OBJECT_ASSERT_LOCKED(m->object); + KASSERT((m->flags & PG_FICTITIOUS) == 0 || m->ref_count >= 1, + ("vm_page_wire: fictitious page %p has zero refs", m)); + + old = atomic_fetchadd_int(&m->ref_count, 1); + KASSERT(VPRC_WIRE_COUNT(old) != VPRC_WIRE_COUNT_MAX, + ("vm_page_wire: counter overflow for page %p", m)); + if (VPRC_WIRE_COUNT(old) == 0) vm_wire_add(1); - } - m->wire_count++; - KASSERT(m->wire_count != 0, ("vm_page_wire: wire_count overflow m=%p", m)); } /* - * vm_page_unwire: - * + * Attempt to wire a mapped page following a pmap lookup of that page. + * This may fail if a thread is concurrently tearing down mappings of the page. + */ +bool +vm_page_wire_mapped(vm_page_t m) +{ + u_int old; + + KASSERT(m->object != NULL, + ("vm_page_try_wire: page %p does not belong to an object", m)); + + old = m->ref_count; + do { + KASSERT(old > 0, + ("vm_page_try_wire: wiring unreferenced page %p", m)); + if ((old & VPRC_BLOCKED) != 0) + return (false); + } while (!atomic_fcmpset_int(&m->ref_count, &old, old + 1)); + + if (VPRC_WIRE_COUNT(old) == 0) + vm_wire_add(1); + return (true); +} + +/* * Release one wiring of the specified page, potentially allowing it to be - * paged out. Returns TRUE if the number of wirings transitions to zero and - * FALSE otherwise. + * paged out. * * Only managed pages belonging to an object can be paged out. If the number * of wirings transitions to zero and the page is eligible for page out, then - * the page is added to the specified paging queue (unless PQ_NONE is - * specified, in which case the page is dequeued if it belongs to a paging - * queue). + * the page is added to the specified paging queue. If the released wiring + * represented the last reference to the page, the page is freed. * - * If a page is fictitious, then its wire count must always be one. - * * A managed page must be locked. */ -bool +void vm_page_unwire(vm_page_t m, uint8_t queue) { - bool unwired; + u_int old; + bool queued; - KASSERT(queue < PQ_COUNT || queue == PQ_NONE, - ("vm_page_unwire: invalid queue %u request for page %p", - queue, m)); - if ((m->oflags & VPO_UNMANAGED) == 0) - vm_page_assert_locked(m); + KASSERT(queue < PQ_COUNT, + ("vm_page_unwire: invalid queue %u request for page %p", queue, m)); - unwired = vm_page_unwire_noq(m); - if (!unwired || (m->oflags & VPO_UNMANAGED) != 0 || m->object == NULL) - return (unwired); + if ((m->oflags & VPO_UNMANAGED) != 0) { + if (vm_page_unwire_noq(m) && m->ref_count == 0) + vm_page_free(m); + return; + } - if (vm_page_queue(m) == queue) { - if (queue == PQ_ACTIVE) - vm_page_reference(m); - else if (queue != PQ_NONE) - vm_page_requeue(m); - } else { - vm_page_dequeue(m); - if (queue != PQ_NONE) { - vm_page_enqueue(m, queue); - if (queue == PQ_ACTIVE) - /* Initialize act_count. */ - vm_page_activate(m); + vm_page_assert_locked(m); + + /* + * Update LRU state before releasing the wiring reference. + * We only need to do this once since we hold the page lock. + * Use a release store when updating the reference count to + * synchronize with vm_page_free_prep(). + */ + old = m->ref_count; + queued = false; + do { + KASSERT(VPRC_WIRE_COUNT(old) > 0, + ("vm_page_unwire: wire count underflow for page %p", m)); + if (!queued && VPRC_WIRE_COUNT(old) == 1) { + if (queue == PQ_ACTIVE && vm_page_queue(m) == PQ_ACTIVE) + vm_page_reference(m); + else + vm_page_mvqueue(m, queue); + queued = true; } + } while (!atomic_fcmpset_rel_int(&m->ref_count, &old, old - 1)); + + if (VPRC_WIRE_COUNT(old) == 1) { + vm_wire_sub(1); + if (old == 1) + vm_page_free(m); } - return (unwired); } /* - * - * vm_page_unwire_noq: - * * Unwire a page without (re-)inserting it into a page queue. It is up * to the caller to enqueue, requeue, or free the page as appropriate. - * In most cases, vm_page_unwire() should be used instead. + * In most cases involving managed pages, vm_page_unwire() should be used + * instead. */ bool vm_page_unwire_noq(vm_page_t m) { + u_int old; - if ((m->oflags & VPO_UNMANAGED) == 0) - vm_page_assert_locked(m); - if ((m->flags & PG_FICTITIOUS) != 0) { - KASSERT(m->wire_count == 1, - ("vm_page_unwire: fictitious page %p's wire count isn't one", m)); + old = vm_page_drop(m, -1); + KASSERT(VPRC_WIRE_COUNT(old) != 0, + ("vm_page_unref: counter underflow for page %p", m)); + KASSERT((m->flags & PG_FICTITIOUS) == 0 || VPRC_WIRE_COUNT(old) > 1, + ("vm_page_unref: missing ref on fictitious page %p", m)); + + if (VPRC_WIRE_COUNT(old) > 1) return (false); - } - if (!vm_page_wired(m)) - panic("vm_page_unwire: page %p's wire count is zero", m); - m->wire_count--; - if (m->wire_count == 0) { - vm_wire_sub(1); - return (true); - } else - return (false); + vm_wire_sub(1); + return (true); } /* - * vm_page_activate: + * Ensure that the page is in the specified page queue. If the page is + * active or being moved to the active queue, ensure that its act_count is + * at least ACT_INIT but do not otherwise mess with it. Otherwise, ensure that + * the page is at the tail of its page queue. * - * Put the specified page on the active list (if appropriate). - * Ensure that act_count is at least ACT_INIT but do not otherwise - * mess with it. - * - * The page must be locked. + * The page may be wired. The caller should release any wiring references + * before releasing the page lock, otherwise the page daemon may immediately + * dequeue the page. */ -void -vm_page_activate(vm_page_t m) +static __always_inline void +vm_page_mvqueue(vm_page_t m, const int nqueue) { vm_page_assert_locked(m); + KASSERT((m->oflags & VPO_UNMANAGED) == 0, + ("vm_page_mvqueue: page %p is unmanaged", m)); - if (vm_page_wired(m) || (m->oflags & VPO_UNMANAGED) != 0) - return; - if (vm_page_queue(m) == PQ_ACTIVE) { - if (m->act_count < ACT_INIT) - m->act_count = ACT_INIT; - return; + if (vm_page_queue(m) != nqueue) { + vm_page_dequeue(m); + vm_page_enqueue(m, nqueue); + } else if (nqueue != PQ_ACTIVE) { + vm_page_requeue(m); } - vm_page_dequeue(m); - if (m->act_count < ACT_INIT) + if (nqueue == PQ_ACTIVE && m->act_count < ACT_INIT) m->act_count = ACT_INIT; - vm_page_enqueue(m, PQ_ACTIVE); } /* + * Put the specified page on the active list (if appropriate). + * + * A managed page must be locked. + */ +void +vm_page_activate(vm_page_t m) +{ + + if ((m->oflags & VPO_UNMANAGED) != 0 || vm_page_wired(m)) + return; + vm_page_mvqueue(m, PQ_ACTIVE); +} + +/* * Move the specified page to the tail of the inactive queue, or requeue * the page if it is already in the inactive queue. * - * The page must be locked. + * A managed page must be locked. */ void vm_page_deactivate(vm_page_t m) { - vm_page_assert_locked(m); - - if (vm_page_wired(m) || (m->oflags & VPO_UNMANAGED) != 0) + if ((m->oflags & VPO_UNMANAGED) != 0 || vm_page_wired(m)) return; - - if (!vm_page_inactive(m)) { - vm_page_dequeue(m); - vm_page_enqueue(m, PQ_INACTIVE); - } else - vm_page_requeue(m); + vm_page_mvqueue(m, PQ_INACTIVE); } /* @@ -3688,18 +3732,13 @@ vm_page_deactivate(vm_page_t m) * bypassing LRU. A marker page is used to maintain FIFO ordering. * As with regular enqueues, we use a per-CPU batch queue to reduce * contention on the page queue lock. - * - * The page must be locked. */ -void -vm_page_deactivate_noreuse(vm_page_t m) +static void +_vm_page_deactivate_noreuse(vm_page_t m) { vm_page_assert_locked(m); - if (vm_page_wired(m) || (m->oflags & VPO_UNMANAGED) != 0) - return; - if (!vm_page_inactive(m)) { vm_page_dequeue(m); m->queue = PQ_INACTIVE; @@ -3709,31 +3748,33 @@ vm_page_deactivate(vm_page_t m) vm_pqbatch_submit_page(m, PQ_INACTIVE); } +void +vm_page_deactivate_noreuse(vm_page_t m) +{ + + KASSERT(m->object != NULL, + ("vm_page_deactivate_noreuse: page %p has no object", m)); + + if ((m->oflags & VPO_UNMANAGED) == 0 && !vm_page_wired(m)) + _vm_page_deactivate_noreuse(m); +} + /* - * vm_page_launder + * Put a page in the laundry, or requeue it if it is already there. * - * Put a page in the laundry, or requeue it if it is already there. + * The page must be locked. */ void vm_page_launder(vm_page_t m) { - vm_page_assert_locked(m); - if (vm_page_wired(m) || (m->oflags & VPO_UNMANAGED) != 0) + if ((m->oflags & VPO_UNMANAGED) != 0 || vm_page_wired(m)) return; - - if (vm_page_in_laundry(m)) - vm_page_requeue(m); - else { - vm_page_dequeue(m); - vm_page_enqueue(m, PQ_LAUNDRY); - } + vm_page_mvqueue(m, PQ_LAUNDRY); } /* - * vm_page_unswappable - * - * Put a page in the PQ_UNSWAPPABLE holding queue. + * Put a page in the PQ_UNSWAPPABLE holding queue. */ void vm_page_unswappable(vm_page_t m) @@ -3748,30 +3789,158 @@ vm_page_unswappable(vm_page_t m) } /* - * Attempt to free the page. If it cannot be freed, do nothing. Returns true - * if the page is freed and false otherwise. - * - * The page must be managed. The page and its containing object must be - * locked. + * Release a wired page to the page cache, and optionally attempt to free it. + * The page's object must be locked. See the comment above vm_page_release(). */ -bool -vm_page_try_to_free(vm_page_t m) +void +vm_page_release_locked(vm_page_t m, bool nocache) { + vm_object_t object; + object = m->object; + VM_OBJECT_ASSERT_WLOCKED(object); + KASSERT((m->oflags & VPO_UNMANAGED) == 0, + ("vm_page_release_locked: page %p is unmanaged", m)); + + if (!vm_page_unwire_noq(m)) + return; + if (m->valid == 0 || nocache) { + if ((object->ref_count == 0 || !pmap_page_is_mapped(m)) && + m->dirty == 0 && !vm_page_busied(m) && !vm_page_wired(m)) { + vm_page_free(m); + } else { + vm_page_lock(m); + vm_page_deactivate_noreuse(m); + vm_page_unlock(m); + } + } else { + vm_page_lock(m); + if (vm_page_active(m)) + vm_page_reference(m); + else + vm_page_deactivate(m); + vm_page_unlock(m); + } +} + +/* + * Release a wired page to the page cache, and optionally attempt to free it. + * If the caller wishes to attempt to free the page, and the page is mapped, + * dirty, busy or wired, we do not free it but instead place it near the head of + * the inactive queue to accelerate reclamation. + */ +void +vm_page_release(vm_page_t m, bool nocache) +{ + vm_object_t object; + u_int old; + + KASSERT((m->oflags & VPO_UNMANAGED) == 0, + ("vm_page_release: page %p is unmanaged", m)); + + if (nocache) { + /* + * Attempt to free the page. The page may be renamed between + * objects so we must verify the page's object pointer after + * acquiring the lock and retry if they do not match. + */ + while ((object = m->object) != NULL) { + if (!VM_OBJECT_TRYWLOCK(object)) { + object = NULL; + break; + } + if (m->object == object) + break; + VM_OBJECT_WUNLOCK(object); + } + if (object != NULL) { + vm_page_release_locked(m, nocache); + VM_OBJECT_WUNLOCK(object); + return; + } + } + + /* + * Update LRU state before releasing the wiring reference. + * Use a release store when updating the reference count to + * synchronize with vm_page_free_prep(). + */ + old = m->ref_count; + do { + if (VPRC_WIRE_COUNT(old) == 1) { + vm_page_lock(m); + + /* + * Use a racy check of the valid bits to determine + * whether we can accelerate reclamation of the page. + * The valid bits will be stable unless the page is + * being mapped or is referenced by multiple buffers, + * and in those cases we expect races to be rare. At + * worst we will either accelerate reclamation of a + * valid page and violate LRU, or unnecessarily defer + * reclamation of an invalid page. + */ + if (m->valid == 0 || nocache) + _vm_page_deactivate_noreuse(m); + else if (vm_page_active(m)) + vm_page_reference(m); + else + vm_page_mvqueue(m, PQ_INACTIVE); + vm_page_unlock(m); + } + } while (!atomic_fcmpset_rel_int(&m->ref_count, &old, old - 1)); + + if (VPRC_WIRE_COUNT(old) == 1) { + vm_wire_sub(1); + if (old == 1) + vm_page_free(m); + } +} + +/* + * Attempt to invoke the requested operation while blocking new wirings of the + * page. + */ +static bool +vm_page_try_blocked_op(vm_page_t m, void (*op)(vm_page_t)) +{ + u_int old; + vm_page_assert_locked(m); - VM_OBJECT_ASSERT_WLOCKED(m->object); - KASSERT((m->oflags & VPO_UNMANAGED) == 0, ("page %p is unmanaged", m)); - if (m->dirty != 0 || vm_page_wired(m) || vm_page_busied(m)) - return (false); - if (m->object->ref_count != 0) { - pmap_remove_all(m); - if (m->dirty != 0) + KASSERT(m->object != NULL && (m->oflags & VPO_UNMANAGED) == 0, + ("vm_page_try_blocked_op: page %p has no object", m)); + KASSERT(!vm_page_busied(m), + ("vm_page_try_blocked_op: page %p is busy", m)); + VM_OBJECT_ASSERT_LOCKED(m->object); + + old = m->ref_count; + do { + KASSERT(old != 0, + ("vm_page_try_blocked_op: page %p has no references", m)); + if (VPRC_WIRE_COUNT(old) != 0) return (false); - } - vm_page_free(m); + } while (!atomic_fcmpset_int(&m->ref_count, &old, old | VPRC_BLOCKED)); + + (op)(m); + + atomic_clear_int(&m->ref_count, VPRC_BLOCKED); return (true); } +bool +vm_page_try_remove_all(vm_page_t m) +{ + + return (vm_page_try_blocked_op(m, pmap_remove_all)); +} + +bool +vm_page_try_remove_write(vm_page_t m) +{ + + return (vm_page_try_blocked_op(m, pmap_remove_write)); +} + /* * vm_page_advise * @@ -3866,11 +4035,8 @@ retrylookup: VM_OBJECT_WLOCK(object); goto retrylookup; } else { - if ((allocflags & VM_ALLOC_WIRED) != 0) { - vm_page_lock(m); + if ((allocflags & VM_ALLOC_WIRED) != 0) vm_page_wire(m); - vm_page_unlock(m); - } if ((allocflags & (VM_ALLOC_NOBUSY | VM_ALLOC_SBUSY)) == 0) vm_page_xbusy(m); @@ -3968,11 +4134,8 @@ retrylookup: VM_OBJECT_WLOCK(object); goto retrylookup; } - if ((allocflags & VM_ALLOC_WIRED) != 0) { - vm_page_lock(m); + if ((allocflags & VM_ALLOC_WIRED) != 0) vm_page_wire(m); - vm_page_unlock(m); - } if ((allocflags & (VM_ALLOC_NOBUSY | VM_ALLOC_SBUSY)) == 0) vm_page_xbusy(m); @@ -4501,10 +4664,10 @@ DB_SHOW_COMMAND(pginfo, vm_page_print_pginfo) else m = (vm_page_t)addr; db_printf( - "page %p obj %p pidx 0x%jx phys 0x%jx q %d wire %d\n" + "page %p obj %p pidx 0x%jx phys 0x%jx q %d ref %u\n" " af 0x%x of 0x%x f 0x%x act %d busy %x valid 0x%x dirty 0x%x\n", m, m->object, (uintmax_t)m->pindex, (uintmax_t)m->phys_addr, - m->queue, m->wire_count, m->aflags, m->oflags, + m->queue, m->ref_count, m->aflags, m->oflags, m->flags, m->act_count, m->busy_lock, m->valid, m->dirty); } #endif /* DDB */ Index: /usr/src/sys/vm/vm_page.h =================================================================== --- /usr/src/sys/vm/vm_page.h (revision 350022) +++ /usr/src/sys/vm/vm_page.h (working copy) @@ -115,25 +115,20 @@ * the implementation of read-modify-write operations on the * field is encapsulated in vm_page_clear_dirty_mask(). * - * The page structure contains two counters which prevent page reuse. - * Both counters are protected by the page lock (P). The hold - * counter counts transient references obtained via a pmap lookup, and - * is also used to prevent page reclamation in situations where it is - * undesirable to block other accesses to the page. The wire counter - * is used to implement mlock(2) and is non-zero for pages containing - * kernel memory. Pages that are wired or held will not be reclaimed - * or laundered by the page daemon, but are treated differently during - * a page queue scan: held pages remain at their position in the queue, - * while wired pages are removed from the queue and must later be - * re-enqueued appropriately by the unwiring thread. It is legal to - * call vm_page_free() on a held page; doing so causes it to be removed - * from its object and page queue, and the page is released to the - * allocator once the last hold reference is dropped. In contrast, - * wired pages may not be freed. + * The ref_count field tracks references to the page. References that + * prevent the page from being reclaimable are called wirings and are + * counted in the low bits of ref_count. Upper bits are reserved for + * special references that do not prevent reclamation of the page. + * Specifically, the containing object, if any, holds such a reference, + * and the page daemon takes a transient reference when it is scanning + * a page. Updates to ref_count are atomic unless the page is + * unallocated. To wire a page after it has been allocated, the object + * lock must be held, or the page must be busy, or the wiring thread + * must atomically take a reference and verify that the VPRC_BLOCKED + * bit is not set. No locks are required to unwire a page, but care + * must be taken to free the page if that wiring represented the last + * reference to the page. * - * In some pmap implementations, the wire count of a page table page is - * used to track the number of populated entries. - * * The busy lock is an embedded reader-writer lock which protects the * page's contents and identity (i.e., its tuple) and * interlocks with the object lock (O). In particular, a page may be @@ -155,7 +150,11 @@ * be held. It is invalid for a page's queue field to transition * between two distinct page queue indices. That is, when updating * the queue field, either the new value or the old value must be - * PQ_NONE. + * PQ_NONE. There is one exception to this rule: the page daemon may + * transition the queue field from PQ_INACTIVE to PQ_NONE immediately + * prior to freeing a page during an inactive queue scan. At that + * point the page will have already been physically dequeued, and it + * is known that no other references to that vm_page structure exist. * * To avoid contention on page queue locks, page queue operations * (enqueue, dequeue, requeue) are batched using per-CPU queues. @@ -168,7 +167,9 @@ * may be freed before its pending batch queue entries have been * processed. The page lock (P) must be held to schedule a batched * queue operation, and the page queue lock must be held in order to - * process batch queue entries for the page queue. + * process batch queue entries for the page queue. When the page is + * being freed, the thread freeing the page is permitted to schedule + * a dequeue of the page without the page lock held. */ #if PAGE_SIZE == 4096 @@ -198,11 +199,14 @@ struct vm_page { } memguard; } plinks; TAILQ_ENTRY(vm_page) listq; /* pages in same object (O) */ - vm_object_t object; /* which object am I in (O,P) */ + vm_object_t object; /* which object am I in (O) */ vm_pindex_t pindex; /* offset into object (O,P) */ vm_paddr_t phys_addr; /* physical address of page (C) */ struct md_page md; /* machine dependent stuff */ - u_int wire_count; /* wired down maps refs (P) */ + union { + u_int wire_count; + u_int ref_count; /* page references */ + }; volatile u_int busy_lock; /* busy owners lock */ uint16_t flags; /* page PG_* flags (P) */ uint8_t order; /* index of the buddy queue (F) */ @@ -220,6 +224,34 @@ struct vm_page { }; /* + * Special bits used in the ref_count field. + * + * ref_count is normally used to count wirings that prevent the page from being + * reclaimed, but also supports several special types of references that do not + * prevent reclamation. Accesses to the ref_count field must be atomic unless + * the page is unallocated. + * + * VPRC_PDREF is a transient reference acquired by the page daemon when + * scanning. Pages may be dequeued without the page lock held when they are + * being freed, and this reference ensures that the page daemon is not + * simultaneously manipulating the queue state of the page. The page lock must + * be held to set or clear this bit. + * + * VPRC_OBJREF is the reference held by the containing object. It can set or + * cleared only when the corresponding object's write lock is held. + * + * VPRC_BLOCKED is used to atomically block wirings via pmap lookups while + * attempting to tear down all mappings of a given page. The page lock and + * object write lock must both be held in order to set or clear this bit. + */ +#define VPRC_BLOCKED 0x20000000u /* mappings are being removed */ +#define VPRC_OBJREF 0x40000000u /* object reference, cleared with (O) */ +#define VPRC_PDREF 0x80000000u /* page daemon reference for scanning */ +#define _VPRC_REFMASK (VPRC_BLOCKED | VPRC_OBJREF | VPRC_PDREF) +#define VPRC_WIRE_COUNT(c) ((c) & ~_VPRC_REFMASK) +#define VPRC_WIRE_COUNT_MAX (~_VPRC_REFMASK) + +/* * Page flags stored in oflags: * * Access to these page flags is synchronized by the lock on the object @@ -562,8 +594,10 @@ bool vm_page_reclaim_contig(int req, u_long npages bool vm_page_reclaim_contig_domain(int domain, int req, u_long npages, vm_paddr_t low, vm_paddr_t high, u_long alignment, vm_paddr_t boundary); void vm_page_reference(vm_page_t m); +void vm_page_release(vm_page_t m, bool nocache); +void vm_page_release_locked(vm_page_t m, bool nocache); bool vm_page_remove(vm_page_t); -int vm_page_rename (vm_page_t, vm_object_t, vm_pindex_t); +int vm_page_rename(vm_page_t, vm_object_t, vm_pindex_t); vm_page_t vm_page_replace(vm_page_t mnew, vm_object_t object, vm_pindex_t pindex); void vm_page_requeue(vm_page_t m); @@ -574,14 +608,16 @@ void vm_page_set_valid_range(vm_page_t m, int base int vm_page_sleep_if_busy(vm_page_t m, const char *msg); vm_offset_t vm_page_startup(vm_offset_t vaddr); void vm_page_sunbusy(vm_page_t m); -bool vm_page_try_to_free(vm_page_t m); +bool vm_page_try_remove_all(vm_page_t m); +bool vm_page_try_remove_write(vm_page_t m); int vm_page_trysbusy(vm_page_t m); void vm_page_unhold_pages(vm_page_t *ma, int count); void vm_page_unswappable(vm_page_t m); -bool vm_page_unwire(vm_page_t m, uint8_t queue); +void vm_page_unwire(vm_page_t m, uint8_t queue); bool vm_page_unwire_noq(vm_page_t m); void vm_page_updatefake(vm_page_t m, vm_paddr_t paddr, vm_memattr_t memattr); -void vm_page_wire (vm_page_t); +void vm_page_wire(vm_page_t); +bool vm_page_wire_mapped(vm_page_t m); void vm_page_xunbusy_hard(vm_page_t m); void vm_page_xunbusy_maybelocked(vm_page_t m); void vm_page_set_validclean (vm_page_t, int, int); @@ -812,6 +848,23 @@ vm_page_in_laundry(vm_page_t m) } /* + * vm_page_drop: + * + * Release a reference to a page and return the old reference count. + */ +static inline u_int +vm_page_drop(vm_page_t m, u_int val) +{ + + /* + * Synchronize with vm_page_free_prep(): ensure that all updates to the + * page structure are visible before it is freed. + */ + atomic_thread_fence_rel(); + return (atomic_fetchadd_int(&m->ref_count, val)); +} + +/* * vm_page_wired: * * Return true if a reference prevents the page from being reclaimable. @@ -820,7 +873,7 @@ static inline bool vm_page_wired(vm_page_t m) { - return (m->wire_count > 0); + return (VPRC_WIRE_COUNT(m->ref_count) > 0); } #endif /* _KERNEL */ Index: /usr/src/sys/vm/vm_pageout.c =================================================================== --- /usr/src/sys/vm/vm_pageout.c (revision 350022) +++ /usr/src/sys/vm/vm_pageout.c (working copy) @@ -250,6 +250,20 @@ vm_pageout_end_scan(struct scan_state *ss) pq->pq_pdpages += ss->scanned; } +static bool +vm_pageout_hold_page(vm_page_t m) +{ + u_int ref_count; + + ref_count = m->ref_count; + do { + if ((ref_count & VPRC_OBJREF) == 0) + return (false); + } while (!atomic_fcmpset_int(&m->ref_count, &ref_count, ref_count | + VPRC_PDREF)); + return (true); +} + /* * Add a small number of queued pages to a batch queue for later processing * without the corresponding queue lock held. The caller must have enqueued a @@ -286,6 +300,13 @@ vm_pageout_collect_batch(struct scan_state *ss, co ("Fictitious page %p cannot be in page queue", m)); KASSERT((m->oflags & VPO_UNMANAGED) == 0, ("Unmanaged page %p cannot be in page queue", m)); + + /* + * We must acquire the page daemon reference with the + * page queue lock held. + */ + if (!vm_pageout_hold_page(m)) + continue; } else if (dequeue) continue; @@ -316,6 +337,34 @@ vm_pageout_next(struct scan_state *ss, const bool } /* + * Drop the page daemon's transient page reference and determine whether we need + * to free the page. + */ +static bool +vm_pageout_drop_page(vm_page_t m) +{ + + KASSERT((m->ref_count & VPRC_PDREF) != 0, + ("vm_pageout_drop_page: page %p missing pagedaemon ref", m)); + return (vm_page_drop(m, -VPRC_PDREF) == VPRC_PDREF); +} + +/* + * Drop the page daemon's transient reference once we know that the page's + * identity is stable. + */ +static void +vm_pageout_drop_page_quick(vm_page_t m) +{ + + VM_OBJECT_ASSERT_LOCKED(m->object); + KASSERT((m->ref_count & (VPRC_OBJREF | VPRC_PDREF)) == + (VPRC_OBJREF | VPRC_PDREF), + ("vm_pageout_drop_page_quick: page %p missing refs", m)); + atomic_clear_int(&m->ref_count, VPRC_PDREF); +} + +/* * Scan for pages at adjacent offsets within the given page's object that are * eligible for laundering, form a cluster of these pages and the given page, * and launder that cluster. @@ -328,17 +377,12 @@ vm_pageout_cluster(vm_page_t m) vm_pindex_t pindex; int ib, is, page_base, pageout_count; - vm_page_assert_locked(m); object = m->object; VM_OBJECT_ASSERT_WLOCKED(object); pindex = m->pindex; vm_page_assert_unbusied(m); - KASSERT(!vm_page_wired(m), ("page %p is wired", m)); - pmap_remove_write(m); - vm_page_unlock(m); - mc[vm_pageout_page_count] = pb = ps = m; pageout_count = 1; page_base = vm_pageout_page_count; @@ -363,7 +407,8 @@ more: ib = 0; break; } - if ((p = vm_page_prev(pb)) == NULL || vm_page_busied(p)) { + if ((p = vm_page_prev(pb)) == NULL || vm_page_busied(p) || + vm_page_wired(p)) { ib = 0; break; } @@ -373,12 +418,11 @@ more: break; } vm_page_lock(p); - if (vm_page_wired(p) || !vm_page_in_laundry(p)) { + if (!vm_page_in_laundry(p) || !vm_page_try_remove_write(p)) { vm_page_unlock(p); ib = 0; break; } - pmap_remove_write(p); vm_page_unlock(p); mc[--page_base] = pb = p; ++pageout_count; @@ -393,17 +437,17 @@ more: } while (pageout_count < vm_pageout_page_count && pindex + is < object->size) { - if ((p = vm_page_next(ps)) == NULL || vm_page_busied(p)) + if ((p = vm_page_next(ps)) == NULL || vm_page_busied(p) || + vm_page_wired(p)) break; vm_page_test_dirty(p); if (p->dirty == 0) break; vm_page_lock(p); - if (vm_page_wired(p) || !vm_page_in_laundry(p)) { + if (!vm_page_in_laundry(p) || !vm_page_try_remove_write(p)) { vm_page_unlock(p); break; } - pmap_remove_write(p); vm_page_unlock(p); mc[page_base + pageout_count] = ps = p; ++pageout_count; @@ -658,6 +702,13 @@ vm_pageout_clean(vm_page_t m, int *numpagedout) } } + if (!vm_page_try_remove_write(m)) { + vm_page_unlock(m); + error = EBUSY; + goto unlock_all; + } + vm_page_unlock(m); + /* * If a page is dirty, then it is either being washed * (but not yet cleaned) or it is still in the @@ -735,7 +786,7 @@ recheck: * while locks were dropped. */ if (vm_page_queue(m) != queue) - continue; + goto drop; /* * A requeue was requested, so this page gets a second @@ -743,17 +794,19 @@ recheck: */ if ((m->aflags & PGA_REQUEUE) != 0) { vm_page_requeue(m); - continue; + goto drop; } /* * Wired pages may not be freed. Complete their removal * from the queue now to avoid needless revisits during - * future scans. + * future scans. This check is racy and must be reverified once + * we hold the object lock and have verified that the page + * is not busy. */ if (vm_page_wired(m)) { vm_page_dequeue_deferred(m); - continue; + goto drop; } if (object != m->object) { @@ -768,11 +821,37 @@ recheck: goto recheck; } } + if (__predict_false(m->object == NULL)) + /* + * The page has been removed from its object. + * Drop our reference and move on. + */ + goto drop; + KASSERT(m->object == object, ("page %p does not belong to %p", + m, object)); + + /* + * We can drop our transient reference now that we hold + * the object lock. + */ + vm_pageout_drop_page_quick(m); + if (vm_page_busied(m)) continue; /* + * Re-check for wirings now that we hold the object lock. If + * the page is mapped, it may still be wired by pmap lookups. + * The call to vm_page_try_remove_all() below atomically checks + * for such wirings and removes mappings. + */ + if (__predict_false(vm_page_wired(m))) { + vm_page_dequeue_deferred(m); + continue; + } + + /* * Invalid pages can be easily freed. They cannot be * mapped; vm_page_free() asserts this. */ @@ -839,8 +918,10 @@ recheck: */ if (object->ref_count != 0) { vm_page_test_dirty(m); - if (m->dirty == 0) - pmap_remove_all(m); + if (m->dirty == 0 && !vm_page_try_remove_all(m)) { + vm_page_dequeue_deferred(m); + continue; + } } /* @@ -890,6 +971,11 @@ free_page: mtx = NULL; object = NULL; } + + continue; +drop: + if (vm_pageout_drop_page(m)) + goto free_page; } if (mtx != NULL) { mtx_unlock(mtx); @@ -1132,6 +1218,7 @@ vm_pageout_scan_active(struct vm_domain *vmd, int { struct scan_state ss; struct mtx *mtx; + vm_object_t object; vm_page_t m, marker; struct vm_pagequeue *pq; long min_scan; @@ -1195,7 +1282,7 @@ act_scan: * while locks were dropped. */ if (vm_page_queue(m) != PQ_ACTIVE) - continue; + goto drop; /* * Wired pages are dequeued lazily. @@ -1202,9 +1289,16 @@ act_scan: */ if (vm_page_wired(m)) { vm_page_dequeue_deferred(m); - continue; + goto drop; } + if (__predict_false((object = m->object) == NULL)) + /* + * The page has been removed from its object. + * Drop our reference and move on. + */ + goto drop; + /* * Check to see "how much" the page has been used. * @@ -1224,7 +1318,7 @@ act_scan: * This race delays the detection of a new reference. At * worst, we will deactivate and reactivate the page. */ - if (m->object->ref_count != 0) + if (object->ref_count != 0) act_delta = pmap_ts_referenced(m); else act_delta = 0; @@ -1279,6 +1373,9 @@ act_scan: } } } +drop: + if (vm_pageout_drop_page(m)) + vm_page_free(m); } if (mtx != NULL) { mtx_unlock(mtx); @@ -1402,7 +1499,7 @@ recheck: */ if (vm_page_queue(m) != PQ_INACTIVE) { addl_page_shortage++; - continue; + goto drop; } /* @@ -1411,17 +1508,21 @@ recheck: * chance. */ if ((m->aflags & (PGA_ENQUEUED | PGA_REQUEUE | - PGA_REQUEUE_HEAD)) != 0) - goto reinsert; + PGA_REQUEUE_HEAD)) != 0) { + vm_pageout_reinsert_inactive(&ss, &rq, m); + goto drop; + } /* * Wired pages may not be freed. Complete their removal * from the queue now to avoid needless revisits during - * future scans. + * future scans. This check is racy and must be reverified once + * we hold the object lock and have verified that the page + * is not busy. */ if (vm_page_wired(m)) { vm_page_dequeue_deferred(m); - continue; + goto drop; } if (object != m->object) { @@ -1428,7 +1529,7 @@ recheck: if (object != NULL) VM_OBJECT_WUNLOCK(object); object = m->object; - if (!VM_OBJECT_TRYWLOCK(object)) { + if (object != NULL && !VM_OBJECT_TRYWLOCK(object)) { mtx_unlock(mtx); /* Depends on type-stability. */ VM_OBJECT_WLOCK(object); @@ -1436,7 +1537,22 @@ recheck: goto recheck; } } + if (__predict_false(m->object == NULL)) + /* + * The page has been removed from its object. + * Drop our reference and move on. + */ + goto drop; + KASSERT(m->object == object, ("page %p does not belong to %p", + m, object)); + + /* + * We can drop our transient reference now that we hold + * the object lock. + */ + vm_pageout_drop_page_quick(m); + if (vm_page_busied(m)) { /* * Don't mess with busy pages. Leave them at @@ -1447,10 +1563,22 @@ recheck: * inactive count. */ addl_page_shortage++; - goto reinsert; + vm_pageout_reinsert_inactive(&ss, &rq, m); + continue; } /* + * Re-check for wirings now that we hold the object lock. If + * the page is mapped, it may still be wired by pmap lookups. + * The call to vm_page_try_remove_all() below atomically checks + * for such wirings and removes mappings. + */ + if (__predict_false(vm_page_wired(m))) { + vm_page_dequeue_deferred(m); + continue; + } + + /* * Invalid pages can be easily freed. They cannot be * mapped, vm_page_free() asserts this. */ @@ -1493,7 +1621,8 @@ recheck: continue; } else if ((object->flags & OBJ_DEAD) == 0) { vm_page_aflag_set(m, PGA_REQUEUE); - goto reinsert; + vm_pageout_reinsert_inactive(&ss, &rq, m); + continue; } } @@ -1506,8 +1635,10 @@ recheck: */ if (object->ref_count != 0) { vm_page_test_dirty(m); - if (m->dirty == 0) - pmap_remove_all(m); + if (m->dirty == 0 && !vm_page_try_remove_all(m)) { + vm_page_dequeue_deferred(m); + continue; + } } /* @@ -1533,8 +1664,13 @@ free_page: } else if ((object->flags & OBJ_DEAD) == 0) vm_page_launder(m); continue; -reinsert: - vm_pageout_reinsert_inactive(&ss, &rq, m); + +drop: + /* + * Drop our transient reference. + */ + if (vm_pageout_drop_page(m)) + goto free_page; } if (mtx != NULL) mtx_unlock(mtx); Index: /usr/src/sys/vm/vm_swapout.c =================================================================== --- /usr/src/sys/vm/vm_swapout.c (revision 350022) +++ /usr/src/sys/vm/vm_swapout.c (working copy) @@ -208,12 +208,12 @@ vm_swapout_object_deactivate_pages(pmap_t pmap, vm goto unlock_return; if (should_yield()) goto unlock_return; - if (vm_page_busied(p)) + + if (vm_page_busied(p) || vm_page_wired(p)) continue; VM_CNT_INC(v_pdpages); vm_page_lock(p); - if (vm_page_wired(p) || - !pmap_page_exists_quick(pmap, p)) { + if (!pmap_page_exists_quick(pmap, p)) { vm_page_unlock(p); continue; } @@ -231,8 +231,8 @@ vm_swapout_object_deactivate_pages(pmap_t pmap, vm p->act_count -= min(p->act_count, ACT_DECLINE); if (!remove_mode && p->act_count == 0) { - pmap_remove_all(p); - vm_page_deactivate(p); + if (vm_page_try_remove_all(p)) + vm_page_deactivate(p); } else vm_page_requeue(p); } else { @@ -243,7 +243,7 @@ vm_swapout_object_deactivate_pages(pmap_t pmap, vm vm_page_requeue(p); } } else if (vm_page_inactive(p)) - pmap_remove_all(p); + (void)vm_page_try_remove_all(p); vm_page_unlock(p); } if ((backing_object = object->backing_object) == NULL) -- Test scenario: misc/ptrace.sh