GENERIC HEAD from 2011-07-22 18:03:33 UTC, r224282M, No vmcore KDB: debugger backends: ddb KDB: current backend: ddb 524288K of memory above 4GB ignored Copyright (c) 1992-2011 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 9.0-CURRENT #0 r224282M: Sat Jul 23 22:13:32 CEST 2011 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 10 Model = 2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 4294967296 (4096 MB) avail memory = 3531759616 (3368 MB) : Trying to mount root from ufs:/dev/ad4s1a [rw]... WARNING: / was not properly dismounted Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/ad4s1a: 3823 files, 809768 used, 203247 free (1647 frags, 25200 blocks, 0.2% fragmentation) /dev/ad4s1f: 17238 files, 821670 used, 191345 free (4401 frags, 23368 blocks, 0.4% fragmentation) /dev/label/tmp: LINK COUNT DIR I=2 OWNER=root MODE=41777 /dev/label/tmp: SIZE=22528 MTIME=Jul 24 05:45 2011 COUNT 32 SHOULD BE 29 (ADJUSTED) /dev/label/tmp: ZERO LENGTH DIR I=14837760 OWNER=root MODE=40770 /dev/label/tmp: SIZE=0 MTIME=Jul 24 05:45 2011 (CLEARED) /dev/label/tmp: UNREF DIR I=19053568 OWNER=root MODE=40777 /dev/label/tmp: SIZE=512 MTIME=Jul 24 05:45 2011 (CLEARED) /dev/label/tmp: ZERO LENGTH DIR I=30264320 OWNER=root MODE=40777 /dev/label/tmp: SIZE=0 MTIME=Jul 24 05:45 2011 (CLEARED) /dev/label/tmp: FREE BLK COUNT(S) WRONG IN SUPERBLK (SALVAGED) /dev/label/tmp: SUMMARY INFORMATION BAD (SALVAGED) /dev/label/tmp: BLK(S) MISSING IN BIT MAPS (SALVAGED) /dev/label/tmp: 93645 files, 24484124 used, 93829857 free (2689 frags, 11728396 blocks, 0.0% fragmentation) /dev/ad4s1d: 856673 files, 8615124 used, 1539075 free (262251 frags, 159603 blocks, 2.6% fragmentation) /dev/ad4s1e: 818948 files, 20895965 used, 4492552 free (79456 frags, 551637 blocks, 0.3% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN Starting Network: lo0 re0 fwe0 fwip0. lo0: flags=8049 metric 0 mtu 16384 options=3 inet 127.0.0.1 netmask 0xff000000 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0xa nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=389b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 tentative scopeid 0x1 nd6 options=29 media: Ethernet autoselect (none) status: no carrier fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 Starting devd. Starting Network: usbus0. Starting Network: usbus1. Starting Network: usbus2. Starting Network: usbus3. Starting Network: usbus4. Starting Network: usbus5. re0: link state changed to UP Starting Network: fwe0. fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 Starting Network: fwip0. fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/kde4/lib /usr/local/lib /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/nss /usr/local/lib/qt4 /usr/local/lib/virtualbox /usr/local/lib/wine a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. No core dumps found. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered lock order reversal: 1st 0xe0b1b2a0 bufwait (bufwait) @ kern/vfs_bio.c:2658 2nd 0xc7937200 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper(c0efa6d6,2e687361,38323a63,c7000a34,a7a,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a3f2cb,c0efe09f,c7165370,c71693a0,f185e894,...) at kdb_backtrace+0x2a _witness_debugger(c0efe09f,c7937200,c0f2d8a6,c71693a0,c0f2d538,...) at _witness_debugger+0x25 witness_checkorder(c7937200,9,c0f2d52f,11c,0,...) at witness_checkorder+0x839 _sx_xlock(c7937200,0,c0f2d52f,11c,c7912910,...) at _sx_xlock+0x85 ufsdirhash_acquire(e0b1b240,f185e9ec,30,e1779de4,f185e964,...) at ufsdirhash_acquire+0x48 ufsdirhash_add(c7912910,f185e9ec,1de4,f185e950,f185e954,...) at ufsdirhash_add+0x13 ufs_direnter(c7bd4d98,c7d8d414,f185e9ec,f185ebd0,e0b1b8c0,...) at ufs_direnter+0x749 ufs_mkdir(f185ebf8,c0f4b90e,0,0,f185eb3c,...) at ufs_mkdir+0x936 VOP_MKDIR_APV(c1045120,f185ebf8,f185ebd0,f185eb3c,0,...) at VOP_MKDIR_APV+0xc5 kern_mkdirat(c79232e0,ffffff9c,28404020,0,1c0,...) at kern_mkdirat+0x225 kern_mkdir(c79232e0,28404020,0,1c0,f185ec7c,...) at kern_mkdir+0x2e mkdir(c79232e0,f185ecec,f185ed28,c0efc8ea,0,...) at mkdir+0x29 syscallenter(c79232e0,f185ece4,f185ece4,0,0,...) at syscallenter+0x263 syscall(f185ed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, mkdir), eip = 0x28173173, esp = 0xbfbfe8cc, ebp = 0xbfbfed78 --- Clearing /tmp (X related). Starting mountd. NFSv4 is disabled Starting nfsd. Recovering vi editor sessions:. Updating motd:. Starting ntpd. Starting default moused. Expensive timeout(9) function: 0xc0850e40(0xc123b400) 0.013935290 s Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Local package initialization: backuplock order reversal: 1st 0xc7bd4df0 ufs (ufs) @ kern/vfs_subr.c:2134 2nd 0xe0b1b2a0 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:261 3rd 0xc7cfac94 ufs (ufs) @ kern/vfs_subr.c:2134 KDB: stack backtrace: db_trace_self_wrapper(c0efa6d6,3a632e73,a313632,f188a800,c0a50cdb,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a3f2cb,c0efe0b8,c7165370,c7169338,f188a8a4,...) at kdb_backtrace+0x2a _witness_debugger(c0efe0b8,c7cfac94,c0eed384,c7169338,c0f05d37,...) at _witness_debugger+0x25 witness_checkorder(c7cfac94,9,c0f05d2e,856,0,...) at witness_checkorder+0x839 __lockmgr_args(c7cfac94,80100,c7cfad00,0,0,...) at __lockmgr_args+0x814 ffs_lock(f188a9c8,c0a50cdb,c0f05093,80100,c7cfac3c,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c1045120,f188a9c8,c78f0670,c1055920,c7cfac3c,...) at VOP_LOCK1_APV+0xb5 _vn_lock(c7cfac3c,80100,c0f05d2e,856,4,...) at _vn_lock+0x78 vget(c7cfac3c,80100,c78f05c0,50,0,...) at vget+0xbb vfs_hash_get(c7bdf000,1cdcc00,80000,c78f05c0,f188ab0c,...) at vfs_hash_get+0xed ffs_vgetf(c7bdf000,1cdcc00,80000,f188ab0c,1,...) at ffs_vgetf+0x49 softdep_sync_buf(c7bd4d98,e0b1b240,1,107,0,...) at softdep_sync_buf+0x4a3 ffs_syncvnode(c7bd4d98,1,c78f05c0,5ce,0,...) at ffs_syncvnode+0x238 ffs_sync(c7bdf000,1,f188ac14,4ef,80,...) at ffs_sync+0x26f dounmount(c7bdf000,8080000,c78f05c0,474,5b85c5ea,...) at dounmount+0x447 unmount(c78f05c0,f188acec,28177215,1,0,...) at unmount+0x310 syscallenter(c78f05c0,f188ace4,c0d3976d,c1090770,0,...) at syscallenter+0x263 syscall(f188ad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (22, FreeBSD ELF32, unmount), eip = 0x280dd82b, esp = 0xbfbfe64c, ebp = 0xbfbfe718 --- lock order reversal: 1st 0xc795f880 ufs (ufs) @ kern/vfs_mount.c:1194 2nd 0xc78ac1b4 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1833 KDB: stack backtrace: db_trace_self_wrapper(c0efa6d6,38313a63,a3333,c0f2ef09,c19b4888,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a3f2cb,c0efe09f,c7169338,c7169200,f188aa04,...) at kdb_backtrace+0x2a _witness_debugger(c0efe09f,c78ac1b4,c0ee51e7,c7169200,c0f29a39,...) at _witness_debugger+0x25 witness_checkorder(c78ac1b4,9,c0f29a30,729,c78ac220,...) at witness_checkorder+0x839 __lockmgr_args(c78ac1b4,80400,c78ac220,0,0,...) at __lockmgr_args+0x814 vop_stdlock(f188ab24,4,c0ef4da7,80400,c78ac15c,...) at vop_stdlock+0x65 VOP_LOCK1_APV(c101abe0,f188ab24,c120e910,c1055920,c78ac15c,...) at VOP_LOCK1_APV+0xb5 _vn_lock(c78ac15c,80400,c0f29a30,729,c7bdf000,...) at _vn_lock+0x78 softdep_flushworklist(c7bdf000,f188abd0,c78f05c0,5dc,0,...) at softdep_flushworklist+0x47 ffs_sync(c7bdf000,1,f188ac14,4ef,80,...) at ffs_sync+0x2fd dounmount(c7bdf000,8080000,c78f05c0,474,5b85c5ea,...) at dounmount+0x447 unmount(c78f05c0,f188acec,28177215,1,0,...) at unmount+0x310 syscallenter(c78f05c0,f188ace4,c0d3976d,c1090770,0,...) at syscallenter+0x263 syscall(f188ad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (22, FreeBSD ELF32, unmount), eip = 0x280dd82b, esp = 0xbfbfe64c, ebp = 0xbfbfe718 --- ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 93645 files, 24484124 used, 93829857 free (2689 frags, 11728396 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 93645 files, 24484124 used, 93829857 free (2689 frags, 11728396 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmp watchdogd. Starting inetd. Sun Jul 24 19:24:29 CEST 2011 FreeBSD/i386 (x4.osted.lan) (console) login: Jul 24 19:26:19 x4 su: pho to root on /dev/pts/0 Expensive timeout(9) function: 0xc0b9c8a0(0xcfab8000) 1.713117944 s Expensive timeout(9) function: 0xc0b9c8a0(0xcfab7000) 1.733103075 s Expensive timeout(9) function: 0xc0b9c8a0(0xcf51f810) 0.802753827 s System call open returning with the following locks held: exclusive lockmgr newnfs (newnfs) r = 0 (0xcb82b058) locked @ fs/nfsclient/nfs_clport.c:256 panic: witness_warn cpuid = 0 KDB: enter: panic [ thread pid 16210 tid 100116 ] Stopped at kdb_enter+0x3a: movl $0,kdb_why db> run pho db:0:pho> bt Tracing pid 16210 tid 100116 td 0xc7c0b000 kdb_enter(c0ef67ba,c0ef67ba,c0d774ce,f18b7c28,0,...) at kdb_enter+0x3a panic(c0d774ce,c0efe526,0,0,0,...) at panic+0x134 witness_warn(2,0,c0efc8ea,c0ee6b45,0,...) at witness_warn+0x1f1 syscallret(c7c0b000,d,f18b7ce4,d,0,...) at syscallret+0x40 syscall(f18b7d28) at syscall+0x11b Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (13, FreeBSD ELF32, fchdir), eip = 0x281731b3, esp = 0xbfbfdf3c, ebp = 0xbfbfe3e8 --- db:0:bt> show allpcpu Current CPU: 0 cpuid = 0 dynamic pcpu = 0x7cef80 curthread = 0xc7c0b000: pid 16210 "nfsrename" curpcb = 0xf18b7d80 fpcurthread = none idlethread = 0xc71b98a0: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x5ed0f80 curthread = 0xc71b95c0: pid 11 "idle: cpu1" curpcb = 0xc6f3ad80 fpcurthread = none idlethread = 0xc71b95c0: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x5ed3f80 curthread = 0xc71b92e0: pid 11 "idle: cpu2" curpcb = 0xc6f3dd80 fpcurthread = none idlethread = 0xc71b92e0: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x5ed6f80 curthread = 0xc78ecb80: pid 1860 "nfsd: service" curpcb = 0xf18f0d80 fpcurthread = none idlethread = 0xc71b9000: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks Process 16211 (nfsrename) thread 0xcf268000 (100188) exclusive lockmgr newnfs (newnfs) r = 0 (0xcbf02880) locked @ kern/vfs_subr.c:2134 Process 16210 (nfsrename) thread 0xc7c0b000 (100116) exclusive lockmgr newnfs (newnfs) r = 0 (0xcb82b058) locked @ fs/nfsclient/nfs_clport.c:256 Process 11118 (sshd) thread 0xc792a8a0 (100157) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xc7f3208c) locked @ kern/uipc_sockbuf.c:148 Process 2160 (sshd) thread 0xc7929b80 (100080) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xc7edc08c) locked @ kern/uipc_sockbuf.c:148 Process 1860 (nfsd) thread 0xc78ecb80 (100124) exclusive sleep mutex sp_lock (sp_lock) r = 0 (0xc73dfa80) locked @ rpc/svc.c:1172 Process 12 (intr) thread 0xc739f000 (100026) exclusive sleep mutex g_disk_done (g_disk_done) r = 0 (0xc108e9b4) locked @ geom/geom_disk.c:247 exclusive sleep mutex AHCI channel lock (AHCI channel lock) r = 0 (0xc73eb804) locked @ cam/cam_xpt.c:4820 db:0:alllocks> show lockedvnods Locked vnodes 0xcbf02828: 0xcbf02828: tag newnfs, type VDIR tag newnfs, type VDIR usecount 6, writecount 0, refcount 16 mountedhere 0 usecount 6, writecount 0, refcount 16 mountedhere 0 flags (VV_ROOT) flags (VV_ROOT) lock type newnfs: EXCL by thread 0xcf268000 (pid 16211) lock type newnfs: EXCL by thread 0xcf268000 (pid 16211) with shared waiters pending with shared waiters pending #0 0xc09ee215 at __lockmgr_args+0x5a5 #0 0xc09ee215 at __lockmgr_args+0x5a5 #1 0xc095959d at nfs_lock1+0xcd #1 0xc095959d at nfs_lock1+0xcd #2 0xc0d5bfa5 at VOP_LOCK1_APV+0xb5 #2 0xc0d5bfa5 at VOP_LOCK1_APV+0xb5 #3 0xc0aaec08 at _vn_lock+0x78 #3 0xc0aaec08 at _vn_lock+0x78 #4 0xc0aa1d3b at vget+0xbb #4 0xc0aa1d3b at vget+0xbb #5 0xc0a92ced at vfs_hash_get+0xed #5 0xc0a92ced at vfs_hash_get+0xed #6 0xc0960a5f at ncl_nget+0xcf #6 0xc0960a5f at ncl_nget+0xcf #7 0xc0963812 at nfs_root+0x42 #7 0xc0963812 at nfs_root+0x42 #8 0xc0a94351 at lookup+0x9a1 #8 0xc0a94351 at lookup+0x9a1 #9 0xc0a94e92 at namei+0x592 #9 0xc0a94e92 at namei+0x592 #10 0xc0aae330 at vn_open_cred+0x90 #10 0xc0aae330 at vn_open_cred+0x90 #11 0xc0aae8bb at vn_open+0x3b #11 0xc0aae8bb at vn_open+0x3b #12 0xc0aad53f at kern_openat+0x12f #12 0xc0aad53f at kern_openat+0x12f #13 0xc0aad985 at kern_open+0x35 #13 0xc0aad985 at kern_open+0x35 #14 0xc0aad9c0 at open+0x30 #14 0xc0aad9c0 at open+0x30 #15 0xc0a495a3 at syscallenter+0x263 #15 0xc0a495a3 at syscallenter+0x263 #16 0xc0d38f0f at syscall+0x4f #16 0xc0d38f0f at syscall+0x4f #17 0xc0d22591 at Xint0x80_syscall+0x21 #17 0xc0d22591 at Xint0x80_syscall+0x21 fileid 2 fsid 0x400ff23 fileid 2 fsid 0x400ff23 0xcb82b000: 0xcb82b000: tag newnfs, type VREG tag newnfs, type VREG usecount 1, writecount 0, refcount 1 mountedhere 0 usecount 1, writecount 0, refcount 1 mountedhere 0 flags () flags () lock type newnfs: EXCL by thread 0xc7c0b000 (pid 16210) lock type newnfs: EXCL by thread 0xc7c0b000 (pid 16210) #0 0xc09ee86e at __lockmgr_args+0xbfe #0 0xc09ee86e at __lockmgr_args+0xbfe #1 0xc0965320 at nfscl_nget+0x5d0 #1 0xc0965320 at nfscl_nget+0x5d0 #2 0xc095e5b5 at nfs_create+0x315 #2 0xc095e5b5 at nfs_create+0x315 #3 0xc0d5cf75 at VOP_CREATE_APV+0xc5 #3 0xc0d5cf75 at VOP_CREATE_APV+0xc5 #4 0xc0aae4a5 at vn_open_cred+0x205 #4 0xc0aae4a5 at vn_open_cred+0x205 #5 0xc0aae8bb at vn_open+0x3b #5 0xc0aae8bb at vn_open+0x3b #6 0xc0aad53f at kern_openat+0x12f #6 0xc0aad53f at kern_openat+0x12f #7 0xc0aad985 at kern_open+0x35 #7 0xc0aad985 at kern_open+0x35 #8 0xc0aad9c0 at open+0x30 #8 0xc0aad9c0 at open+0x30 #9 0xc0a495a3 at syscallenter+0x263 #9 0xc0a495a3 at syscallenter+0x263 #10 0xc0d38f0f at syscall+0x4f #10 0xc0d38f0f at syscall+0x4f #11 0xc0d22591 at Xint0x80_syscall+0x21 #11 0xc0d22591 at Xint0x80_syscall+0x21 fileid 302 fsid 0x400ff23 fileid 302 fsid 0x400ff23 db:0:lockedvnods> show mount 0xc78a7b50 /dev/ad4s1a on / (ufs) 0xc78a8000 devfs on /dev (devfs) 0xc7bd95a8 /dev/ad4s1f on /home (ufs) 0xc7bdeb50 /dev/ad4s1d on /usr (ufs) 0xc7bde87c /dev/ad4s1e on /var (ufs) 0xc7bde5a8 procfs on /proc (procfs) 0xc7bd92d4 /dev/label/tmp on /tmp (ufs) 0xc78a82d4 127.0.0.1:/tmp on /mnt (nfs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 16213 16205 10217 0 D+ newnfs 0xcbf02880 nfsrename 16211 16181 10217 0 S+ newnfsre 0xcaee8e00 nfsrename 16210 16181 10217 0 R+ CPU 0 nfsrename 16209 16181 10217 0 R+ nfsrename 16208 16181 10217 0 D+ newnfs 0xcbf02880 nfsrename 16207 16181 10217 0 R+ nfsrename 16206 16181 10217 0 D+ newnfs 0xcbf02880 nfsrename 16205 16181 10217 0 D+ newnfs 0xcbf02880 nfsrename 16204 16181 10217 0 D+ newnfs 0xcbf02880 nfsrename 16203 16181 10217 0 D+ newnfs 0xcbf02880 nfsrename 16202 16181 10217 0 D+ newnfs 0xcbf02880 nfsrename 16181 10217 10217 0 S+ wait 0xcfaab580 sh 16080 16069 16068 1001 R+ swap 16079 16069 16068 1001 R+ swap 16078 16069 16068 1001 R+ swap 16077 16069 16068 1001 R+ swap 16076 16069 16068 1001 R+ swap 16075 16069 16068 1001 R+ swap 16074 16069 16068 1001 R+ swap 16073 16069 16068 1001 RL+ swap 16072 16069 16068 1001 R+ swap 16071 16069 16068 1001 R+ swap 16070 16069 16068 1001 RL+ swap 16069 16068 16068 1001 SW+ wait 0xc7c01b00 swap 16068 11121 16068 1001 R+ swap 16021 0 0 0 SL - 0xc1089028 [newnfs 2] 15780 0 0 0 SL - 0xc1089024 [newnfs 1] 11121 11120 11121 1001 SWs+ wait 0xc80eb580 bash 11120 11118 11118 1001 S select 0xc73d5c64 sshd 11118 2097 11118 0 SWs sbwait 0xc7f320b8 sshd 10342 0 0 0 SL - 0xc1089020 [newnfs 0] 10217 10213 10217 0 S+ wait 0xc80eb840 sh 10213 10209 10213 0 SW+ wait 0xc80e7840 bash 10209 10208 10209 0 SW+ pause 0xc78eb058 csh 10208 2163 10208 1001 SW+ wait 0xc80e7000 su 5827 1 5827 0 Ss+ ttyin 0xc756b070 getty 5826 1 5826 0 Ss+ ttyin 0xc756b270 getty 5825 1 5825 0 Ss+ ttyin 0xc756b470 getty 5824 1 5824 0 Ss+ ttyin 0xc72d6070 getty 5822 1 5822 0 Ss+ ttyin 0xc72d6270 getty 5820 1 5820 0 Ss+ ttyin 0xc72d6470 getty 5819 1 5819 0 Ss+ ttyin 0xc72d6670 getty 5818 1 5818 0 Ss+ ttyin 0xc72d6870 getty 5817 1 5817 0 Ss+ ttyin 0xc72d6a70 getty 5754 1 5754 0 Ss select 0xc791ac64 inetd 5716 1 5716 0 Ss nanslp 0xc1092084 watchdogd 2163 2162 2163 1001 SWs+ wait 0xc7ee9580 bash 2162 2160 2160 1001 S select 0xc73d57e4 sshd 2160 2097 2160 0 SWs sbwait 0xc7edc0b8 sshd 2119 1 2119 0 Ss nanslp 0xc1092084 cron 2111 1 2111 25 SWs pause 0xc80ddb58 sendmail 2105 1 2105 0 Ss select 0xc73d50e4 sendmail 2097 1 2097 0 Ss select 0xc73d5c24 sshd 2037 1 2037 0 Ss select 0xc7919664 moused 1959 1 1959 0 Ss select 0xc77c2524 ntpd 1860 1854 1854 0 R (threaded) nfsd 100125 S rpcsvc 0xc7d34090 nfsd: service 100124 Run CPU 3 nfsd: service 100123 S rpcsvc 0xc7ee1250 nfsd: service 100081 CanRun nfsd: master 1854 1 1854 0 Ss select 0xc7919164 nfsd 1844 1 1844 0 Ss select 0xc73d5864 mountd 1744 1 1744 0 Ss select 0xc7919764 rpcbind 1716 1 1716 0 Ss select 0xc77c21a4 syslogd 1516 1 1516 0 Ss select 0xc7919ba4 devd 18 0 0 0 DL sdflush 0xc120e960 [softdepflush] 17 0 0 0 DL vlruwt 0xc77f8580 [vnlru] 16 0 0 0 DL syncer 0xc1208274 [syncer] 9 0 0 0 DL psleep 0xc1207f08 [bufdaemon] 8 0 0 0 DL pgzero 0xc12107dc [pagezero] 7 0 0 0 DL psleep 0xc12103c8 [vmdaemon] 6 0 0 0 DL psleep 0xc1210390 [pagedaemon] 5 0 0 0 DL ccb_scan 0xc1056dd4 [xpt_thrd] 4 0 0 0 DL waiting_ 0xc1209d98 [sctp_iterator] 3 0 0 0 DL - 0xc73c3c3c [fdc0] 2 0 0 0 SL - 0xc7461000 [fw0_probe] 15 0 0 0 DL (threaded) [usb] 100058 D - 0xc7443d34 [usbus5] 100057 D - 0xc7443d04 [usbus5] 100056 D - 0xc7443cd4 [usbus5] 100055 D - 0xc7443ca4 [usbus5] 100053 D - 0xc7436b5c [usbus4] 100052 D - 0xc7436b2c [usbus4] 100051 D - 0xc7436afc [usbus4] 100050 D - 0xc7436acc [usbus4] 100049 D - 0xc7431b5c [usbus3] 100048 D - 0xc7431b2c [usbus3] 100047 D - 0xc7431afc [usbus3] 100046 D - 0xc7431acc [usbus3] 100045 D - 0xc7428b5c [usbus2] 100044 D - 0xc7428b2c [usbus2] 100043 D - 0xc7428afc [usbus2] 100042 D - 0xc7428acc [usbus2] 100040 D - 0xc7422b5c [usbus1] 100039 D - 0xc7422b2c [usbus1] 100038 D - 0xc7422afc [usbus1] 100037 D - 0xc7422acc [usbus1] 100035 D - 0xc7416b5c [usbus0] 100034 D - 0xc7416b2c [usbus0] 100033 D - 0xc7416afc [usbus0] 100032 D - 0xc7416acc [usbus0] 14 0 0 0 DL - 0xc1090e84 [yarrow] 13 0 0 0 DL (threaded) [geom] 100015 D - 0xc108eaa8 [g_down] 100014 D - 0xc108eaa4 [g_up] 100013 D - 0xc108ea9c [g_event] 12 0 0 0 RL (threaded) [intr] 100066 I [irq12: psm0] 100065 I [irq1: atkbd0] 100063 I [swi0: uart] 100060 I [irq20: fwohci0] 100059 I [irq14: ata0] 100054 I [irq19: ehci0] 100041 I [irq18: ohci2 ohci4] 100036 I [irq17: ohci1 ohci3] 100031 I [irq16: hdac1 ohci0] 100030 I [irq22: ahci0] 100029 I [irq257: re0] 100028 I [irq256: hdac0] 100027 I [swi5: +] 100026 I [swi2: cambio] 100021 I [swi6: task queue] 100019 I [swi6: Giant taskq] 100012 I [swi3: vm] 100011 RunQ [swi4: clock] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 I [swi4: clock] 100007 RunQ [swi1: netisr 0] 11 0 0 0 RL (threaded) [idle] 100006 CanRun [idle: cpu3] 100005 CanRun [idle: cpu2] 100004 CanRun [idle: cpu1] 100003 CanRun [idle: cpu0] 1 0 1 0 SLs wait 0xc71b7b00 [init] 10 0 0 0 DL audit_wo 0xc120e080 [audit] 0 0 0 0 DLs (threaded) [kernel] 100077 D - 0xc77fc080 [mca taskq] 100067 D - 0xc1090e84 [deadlkres] 100061 D - 0xc719c900 [fw0_taskq] 100025 D - 0xc719ccc0 [acpi_task_2] 100024 D - 0xc719ccc0 [acpi_task_1] 100023 D - 0xc719ccc0 [acpi_task_0] 100022 D - 0xc719cd00 [kqueue taskq] 100020 D - 0xc719cd80 [ffs_trim taskq] 100018 D - 0xc719ce00 [thread taskq] 100016 D - 0xc719ce40 [firmware taskq] 100000 D sched 0xc108eb80 [swapper] db:0:ps> allt Tracing command nfsrename pid 16213 tid 100083 td 0xc79292e0 sched_switch(c79292e0,0,104,191,860cde5a,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,60,...) at mi_switch+0x1eb sleepq_switch(c79292e0,0,c0efbf60,268,cbf02880,...) at sleepq_switch+0x162 sleepq_wait(cbf02880,60,c0ee7b13,4,1,...) at sleepq_wait+0x63 __lockmgr_args(cbf02880,200100,cbf028ec,0,0,...) at __lockmgr_args+0x4cf nfs_lock1(f1801878,c0a50cdb,c0f05093,200100,cbf02828,...) at nfs_lock1+0xcd VOP_LOCK1_APV(c101bd40,f1801878,c7929390,c1055920,cbf02828,...) at VOP_LOCK1_APV+0xb5 _vn_lock(cbf02828,200100,c0f05d2e,856,4,...) at _vn_lock+0x78 vget(cbf02828,200100,c79292e0,50,0,...) at vget+0xbb vfs_hash_get(c78a82d4,7cee4531,200000,c79292e0,f1801938,...) at vfs_hash_get+0xed ncl_nget(c78a82d4,c7f3108c,1c,f1801964,200000,...) at ncl_nget+0xcf nfs_root(c78a82d4,200000,f18019dc,1f5,f1801b90,...) at nfs_root+0x42 lookup(f1801b78,c0f05179,ee,c9,c7922000,...) at lookup+0x9a1 namei(f1801b78,246,c7161340,c7929390,0,...) at namei+0x592 vn_open_cred(f1801b78,f1801c2c,1a4,0,c7bce400,...) at vn_open_cred+0x31f vn_open(f1801b78,f1801c2c,1a4,c7969738,11d,...) at vn_open+0x3b kern_openat(c79292e0,ffffff9c,bfbfea83,0,1,...) at kern_openat+0x12f kern_open(c79292e0,bfbfea83,0,0,1b6,...) at kern_open+0x35 open(c79292e0,f1801cec,281ae44c,1,0,...) at open+0x30 syscallenter(c79292e0,f1801ce4,c0d3976d,c1090770,0,...) at syscallenter+0x263 syscall(f1801d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, open), eip = 0x281731b3, esp = 0xbfbfd7bc, ebp = 0xbfbfd7f8 --- Tracing command nfsrename pid 16211 tid 100188 td 0xcf268000 sched_switch(cf268000,0,104,191,86123365,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(cf268000,0,c0efbf60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(493e1,c0a45aa0,cf268000,3,300,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(caee8e00,0,c0ee63e7,300,0,...) at sleepq_timedwait_sig+0x1a _sleep(caee8e00,ca07e200,500,c0ee63e7,493e1,...) at _sleep+0x328 clnt_vc_call(ca07d740,f1a165a0,8,c7cf8900,f1a16720,...) at clnt_vc_call+0x815 clnt_reconnect_call(ca07d760,f1a165a0,8,c7cf8900,f1a16720,...) at clnt_reconnect_call+0x670 newnfs_request(f1a16720,c7f31000,0,c7f31110,cbf02828,cf268000,c7bce400,186a3,3,0,1,0) at newnfs_request+0xc03 nfscl_request(f1a16720,cbf02828,cf268000,c7bce400,0,...) at nfscl_request+0x82 nfsrpc_create(cbf02828,cc038805,10,f1a16a98,597be1c2,...) at nfsrpc_create+0x188e nfs_create(f1a16b00,c0f4bad4,0,0,f1a16b78,...) at nfs_create+0x26d VOP_CREATE_APV(c101bd40,f1a16b00,f1a16ba4,f1a16a98,0,...) at VOP_CREATE_APV+0xc5 vn_open_cred(f1a16b78,f1a16c2c,180,0,c7bce400,...) at vn_open_cred+0x205 vn_open(f1a16b78,f1a16c2c,180,c78f4428,0,...) at vn_open+0x3b kern_openat(cf268000,ffffff9c,bfbfe430,0,a03,...) at kern_openat+0x12f kern_open(cf268000,bfbfe430,0,a02,180,...) at kern_open+0x35 open(cf268000,f1a16cec,f1a16d28,c0efc8ea,0,...) at open+0x30 syscallenter(cf268000,f1a16ce4,f1a16ce4,0,0,...) at syscallenter+0x263 syscall(f1a16d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, open), eip = 0x281731b3, esp = 0xbfbfdf3c, ebp = 0xbfbfe3e8 --- Tracing command nfsrename pid 16210 tid 100116 td 0xc7c0b000 kdb_enter(c0ef67ba,c0ef67ba,c0d774ce,f18b7c28,0,...) at kdb_enter+0x3a panic(c0d774ce,c0efe526,0,0,0,...) at panic+0x134 witness_warn(2,0,c0efc8ea,c0ee6b45,0,...) at witness_warn+0x1f1 syscallret(c7c0b000,d,f18b7ce4,d,0,...) at syscallret+0x40 syscall(f18b7d28) at syscall+0x11b Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (13, FreeBSD ELF32, fchdir), eip = 0x281731b3, esp = 0xbfbfdf3c, ebp = 0xbfbfe3e8 --- Tracing command nfsrename pid 16209 tid 100138 td 0xc7d2cb80 sched_switch(c7d2cb80,0,104,191,839c19ce,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,60,...) at mi_switch+0x1eb sleepq_switch(c7d2cb80,0,c0efbf60,268,cbf02880,...) at sleepq_switch+0x162 sleepq_wait(cbf02880,60,c0ee7b13,4,1,...) at sleepq_wait+0x63 __lockmgr_args(cbf02880,200100,cbf028ec,0,0,...) at __lockmgr_args+0x4cf nfs_lock1(f194b92c,c0a50cdb,c0f05093,200100,cbf02828,...) at nfs_lock1+0xcd VOP_LOCK1_APV(c101bd40,f194b92c,c7d2cc30,c1055920,cbf02828,...) at VOP_LOCK1_APV+0xb5 _vn_lock(cbf02828,200100,c0f05d2e,856,4,...) at _vn_lock+0x78 vget(cbf02828,200100,c7d2cb80,50,0,...) at vget+0xbb vfs_hash_get(c78a82d4,7cee4531,200000,c7d2cb80,f194b9ec,...) at vfs_hash_get+0xed ncl_nget(c78a82d4,c7f3108c,1c,f194ba18,200000,...) at ncl_nget+0xcf nfs_root(c78a82d4,200000,f194ba90,1f5,f194bbb0,...) at nfs_root+0x42 lookup(f194bb98,c0f05179,ee,c9,c80dd2c0,...) at lookup+0x9a1 namei(f194bb98,c0a50cdb,c0f30ad1,c0eec2c0,3,...) at namei+0x592 kern_renameat(c7d2cb80,ffffff9c,bfbfe430,ffffff9c,bfbfea83,...) at kern_renameat+0x57 kern_rename(c7d2cb80,bfbfe430,bfbfea83,0,f194bc7c,...) at kern_rename+0x36 rename(c7d2cb80,f194bcec,f194bd28,c0efc8ea,0,...) at rename+0x29 syscallenter(c7d2cb80,f194bce4,f194bce4,0,0,...) at syscallenter+0x263 syscall(f194bd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (128, FreeBSD ELF32, rename), eip = 0x280db44b, esp = 0xbfbfe40c, ebp = 0xbfbfe838 --- Tracing command nfsrename pid 16208 tid 100232 td 0xcca475c0 sched_switch(cca475c0,0,104,191,85b57a3f,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,60,...) at mi_switch+0x1eb sleepq_switch(cca475c0,0,c0efbf60,268,cbf02880,...) at sleepq_switch+0x162 sleepq_wait(cbf02880,60,c0ee7b13,4,1,...) at sleepq_wait+0x63 __lockmgr_args(cbf02880,200100,cbf028ec,0,0,...) at __lockmgr_args+0x4cf nfs_lock1(f1a9a92c,c0a50cdb,c0f05093,200100,cbf02828,...) at nfs_lock1+0xcd VOP_LOCK1_APV(c101bd40,f1a9a92c,cca47670,c1055920,cbf02828,...) at VOP_LOCK1_APV+0xb5 _vn_lock(cbf02828,200100,c0f05d2e,856,4,...) at _vn_lock+0x78 vget(cbf02828,200100,cca475c0,50,0,...) at vget+0xbb vfs_hash_get(c78a82d4,7cee4531,200000,cca475c0,f1a9a9ec,...) at vfs_hash_get+0xed ncl_nget(c78a82d4,c7f3108c,1c,f1a9aa18,200000,...) at ncl_nget+0xcf nfs_root(c78a82d4,200000,f1a9aa90,1f5,f1a9abb0,...) at nfs_root+0x42 lookup(f1a9ab98,c0f05179,ee,c9,cca412c0,...) at lookup+0x9a1 namei(f1a9ab98,c0a50cdb,c0f30ad1,c0eec2c0,3,...) at namei+0x592 kern_renameat(cca475c0,ffffff9c,bfbfe430,ffffff9c,bfbfea83,...) at kern_renameat+0x57 kern_rename(cca475c0,bfbfe430,bfbfea83,0,f1a9ac7c,...) at kern_rename+0x36 rename(cca475c0,f1a9acec,f1a9ad28,c0efc8ea,0,...) at rename+0x29 syscallenter(cca475c0,f1a9ace4,f1a9ace4,0,0,...) at syscallenter+0x263 syscall(f1a9ad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (128, FreeBSD ELF32, rename), eip = 0x280db44b, esp = 0xbfbfe40c, ebp = 0xbfbfe838 --- Tracing command nfsrename pid 16207 tid 100132 td 0xc78208a0 sched_switch(c78208a0,0,104,191,835ff30d,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,60,...) at mi_switch+0x1eb sleepq_switch(c78208a0,0,c0efbf60,268,cbf02880,...) at sleepq_switch+0x162 sleepq_wait(cbf02880,60,c0ee7b13,4,1,...) at sleepq_wait+0x63 __lockmgr_args(cbf02880,200100,cbf028ec,0,0,...) at __lockmgr_args+0x4cf nfs_lock1(f193992c,c0a50cdb,c0f05093,200100,cbf02828,...) at nfs_lock1+0xcd VOP_LOCK1_APV(c101bd40,f193992c,c7820950,c1055920,cbf02828,...) at VOP_LOCK1_APV+0xb5 _vn_lock(cbf02828,200100,c0f05d2e,856,4,...) at _vn_lock+0x78 vget(cbf02828,200100,c78208a0,50,0,...) at vget+0xbb vfs_hash_get(c78a82d4,7cee4531,200000,c78208a0,f19399ec,...) at vfs_hash_get+0xed ncl_nget(c78a82d4,c7f3108c,1c,f1939a18,200000,...) at ncl_nget+0xcf nfs_root(c78a82d4,200000,f1939a90,1f5,f1939bb0,...) at nfs_root+0x42 lookup(f1939b98,c0f05179,ee,c9,c7ee8000,...) at lookup+0x9a1 namei(f1939b98,c0a50cdb,c0f30ad1,c0eec2c0,3,...) at namei+0x592 kern_renameat(c78208a0,ffffff9c,bfbfe430,ffffff9c,bfbfea83,...) at kern_renameat+0x57 kern_rename(c78208a0,bfbfe430,bfbfea83,0,f1939c7c,...) at kern_rename+0x36 rename(c78208a0,f1939cec,f1939d28,c0efc8ea,0,...) at rename+0x29 syscallenter(c78208a0,f1939ce4,f1939ce4,0,0,...) at syscallenter+0x263 syscall(f1939d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (128, FreeBSD ELF32, rename), eip = 0x280db44b, esp = 0xbfbfe40c, ebp = 0xbfbfe838 --- Tracing command nfsrename pid 16206 tid 100239 td 0xcca46000 sched_switch(cca46000,0,104,191,85ba9757,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,60,...) at mi_switch+0x1eb sleepq_switch(cca46000,0,c0efbf60,268,cbf02880,...) at sleepq_switch+0x162 sleepq_wait(cbf02880,60,c0ee7b13,4,1,...) at sleepq_wait+0x63 __lockmgr_args(cbf02880,200100,cbf028ec,0,0,...) at __lockmgr_args+0x4cf nfs_lock1(f1aaf878,c0a50cdb,c0f05093,200100,cbf02828,...) at nfs_lock1+0xcd VOP_LOCK1_APV(c101bd40,f1aaf878,cca460b0,c1055920,cbf02828,...) at VOP_LOCK1_APV+0xb5 _vn_lock(cbf02828,200100,c0f05d2e,856,4,...) at _vn_lock+0x78 vget(cbf02828,200100,cca46000,50,0,...) at vget+0xbb vfs_hash_get(c78a82d4,7cee4531,200000,cca46000,f1aaf938,...) at vfs_hash_get+0xed ncl_nget(c78a82d4,c7f3108c,1c,f1aaf964,200000,...) at ncl_nget+0xcf nfs_root(c78a82d4,200000,f1aaf9dc,1f5,f1aafb90,...) at nfs_root+0x42 lookup(f1aafb78,c0f05179,ee,c9,cca3fb00,...) at lookup+0x9a1 namei(f1aafb78,246,c7161340,cca460b0,0,...) at namei+0x592 vn_open_cred(f1aafb78,f1aafc2c,180,0,c7bce400,...) at vn_open_cred+0x90 vn_open(f1aafb78,f1aafc2c,180,cb27d9d8,0,...) at vn_open+0x3b kern_openat(cca46000,ffffff9c,bfbfe430,0,a03,...) at kern_openat+0x12f kern_open(cca46000,bfbfe430,0,a02,180,...) at kern_open+0x35 open(cca46000,f1aafcec,f1aafd28,c0efc8ea,0,...) at open+0x30 syscallenter(cca46000,f1aafce4,f1aafce4,0,0,...) at syscallenter+0x263 syscall(f1aafd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, open), eip = 0x281731b3, esp = 0xbfbfdf3c, ebp = 0xbfbfe3e8 --- Tracing command nfsrename pid 16205 tid 100230 td 0xcca47b80 sched_switch(cca47b80,0,104,191,86278485,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,60,...) at mi_switch+0x1eb sleepq_switch(cca47b80,0,c0efbf60,268,cbf02880,...) at sleepq_switch+0x162 sleepq_wait(cbf02880,60,c0ee7b13,4,1,...) at sleepq_wait+0x63 __lockmgr_args(cbf02880,200100,cbf028ec,0,0,...) at __lockmgr_args+0x4cf nfs_lock1(f1a948cc,c0a50cdb,c0f05093,200100,cbf02828,...) at nfs_lock1+0xcd VOP_LOCK1_APV(c101bd40,f1a948cc,cca47c30,c1055920,cbf02828,...) at VOP_LOCK1_APV+0xb5 _vn_lock(cbf02828,200100,c0f05d2e,856,4,...) at _vn_lock+0x78 vget(cbf02828,200100,cca47b80,50,0,...) at vget+0xbb vfs_hash_get(c78a82d4,7cee4531,200000,cca47b80,f1a9498c,...) at vfs_hash_get+0xed ncl_nget(c78a82d4,c7f3108c,1c,f1a949b8,200000,...) at ncl_nget+0xcf nfs_root(c78a82d4,200000,f1a94a30,1f5,f1a94b44,...) at nfs_root+0x42 lookup(f1a94b2c,c0f05179,ee,c9,cca41840,...) at lookup+0x9a1 namei(f1a94b2c,a1,cac89770,f1a94c2c,c0c67e0a,...) at namei+0x592 kern_statat_vnhook(cca47b80,0,ffffff9c,bfbfe430,0,...) at kern_statat_vnhook+0x72 kern_statat(cca47b80,0,ffffff9c,bfbfe430,0,...) at kern_statat+0x3c kern_stat(cca47b80,bfbfe430,0,f1a94be8,f1a94c24,...) at kern_stat+0x36 stat(cca47b80,f1a94cec,281ad79a,1,0,...) at stat+0x2f syscallenter(cca47b80,f1a94ce4,c0d3976d,c1090770,0,...) at syscallenter+0x263 syscall(f1a94d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (188, FreeBSD ELF32, stat), eip = 0x28173153, esp = 0xbfbfdf3c, ebp = 0xbfbfe3e8 --- Tracing command nfsrename pid 16204 tid 100177 td 0xc81918a0 sched_switch(c81918a0,0,104,191,85b568d8,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,60,...) at mi_switch+0x1eb sleepq_switch(c81918a0,0,c0efbf60,268,cbf02880,...) at sleepq_switch+0x162 sleepq_wait(cbf02880,60,c0ee7b13,4,1,...) at sleepq_wait+0x63 __lockmgr_args(cbf02880,200100,cbf028ec,0,0,...) at __lockmgr_args+0x4cf nfs_lock1(f19da92c,c0a50cdb,c0f05093,200100,cbf02828,...) at nfs_lock1+0xcd VOP_LOCK1_APV(c101bd40,f19da92c,c8191950,c1055920,cbf02828,...) at VOP_LOCK1_APV+0xb5 _vn_lock(cbf02828,200100,c0f05d2e,856,4,...) at _vn_lock+0x78 vget(cbf02828,200100,c81918a0,50,0,...) at vget+0xbb vfs_hash_get(c78a82d4,7cee4531,200000,c81918a0,f19da9ec,...) at vfs_hash_get+0xed ncl_nget(c78a82d4,c7f3108c,1c,f19daa18,200000,...) at ncl_nget+0xcf nfs_root(c78a82d4,200000,f19daa90,1f5,f19dab5c,...) at nfs_root+0x42 lookup(f19dab44,c0f05179,ee,c9,c9ebd2c0,...) at lookup+0x9a1 namei(f19dab44,f19dac08,101,f19dabc4,3,...) at namei+0x592 kern_renameat(c81918a0,ffffff9c,bfbfe430,ffffff9c,bfbfea83,...) at kern_renameat+0x1b3 kern_rename(c81918a0,bfbfe430,bfbfea83,0,f19dac7c,...) at kern_rename+0x36 rename(c81918a0,f19dacec,f19dad28,c0efc8ea,0,...) at rename+0x29 syscallenter(c81918a0,f19dace4,f19dace4,0,0,...) at syscallenter+0x263 syscall(f19dad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (128, FreeBSD ELF32, rename), eip = 0x280db44b, esp = 0xbfbfe40c, ebp = 0xbfbfe838 --- Tracing command nfsrename pid 16203 tid 100227 td 0xcf268b80 sched_switch(cf268b80,0,104,191,85baba76,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,60,...) at mi_switch+0x1eb sleepq_switch(cf268b80,0,c0efbf60,268,cbf02880,...) at sleepq_switch+0x162 sleepq_wait(cbf02880,60,c0ee7b13,4,1,...) at sleepq_wait+0x63 __lockmgr_args(cbf02880,200100,cbf028ec,0,0,...) at __lockmgr_args+0x4cf nfs_lock1(f1a8b92c,c0a50cdb,c0f05093,200100,cbf02828,...) at nfs_lock1+0xcd VOP_LOCK1_APV(c101bd40,f1a8b92c,cf268c30,c1055920,cbf02828,...) at VOP_LOCK1_APV+0xb5 _vn_lock(cbf02828,200100,c0f05d2e,856,4,...) at _vn_lock+0x78 vget(cbf02828,200100,cf268b80,50,0,...) at vget+0xbb vfs_hash_get(c78a82d4,7cee4531,200000,cf268b80,f1a8b9ec,...) at vfs_hash_get+0xed ncl_nget(c78a82d4,c7f3108c,1c,f1a8ba18,200000,...) at ncl_nget+0xcf nfs_root(c78a82d4,200000,f1a8ba90,1f5,f1a8bbb0,...) at nfs_root+0x42 lookup(f1a8bb98,c0f05179,ee,c9,cca422c0,...) at lookup+0x9a1 namei(f1a8bb98,c0a50cdb,c0f30ad1,c0eec2c0,3,...) at namei+0x592 kern_renameat(cf268b80,ffffff9c,bfbfe430,ffffff9c,bfbfea83,...) at kern_renameat+0x57 kern_rename(cf268b80,bfbfe430,bfbfea83,0,f1a8bc7c,...) at kern_rename+0x36 rename(cf268b80,f1a8bcec,f1a8bd28,c0efc8ea,0,...) at rename+0x29 syscallenter(cf268b80,f1a8bce4,f1a8bce4,0,0,...) at syscallenter+0x263 syscall(f1a8bd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (128, FreeBSD ELF32, rename), eip = 0x280db44b, esp = 0xbfbfe40c, ebp = 0xbfbfe838 --- Tracing command nfsrename pid 16202 tid 100212 td 0xcfaad8a0 sched_switch(cfaad8a0,0,104,191,85baa3d6,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,60,...) at mi_switch+0x1eb sleepq_switch(cfaad8a0,0,c0efbf60,268,cbf02880,...) at sleepq_switch+0x162 sleepq_wait(cbf02880,60,c0ee7b13,4,1,...) at sleepq_wait+0x63 __lockmgr_args(cbf02880,200100,cbf028ec,0,0,...) at __lockmgr_args+0x4cf nfs_lock1(f1a5e92c,c0a50cdb,c0f05093,200100,cbf02828,...) at nfs_lock1+0xcd VOP_LOCK1_APV(c101bd40,f1a5e92c,cfaad950,c1055920,cbf02828,...) at VOP_LOCK1_APV+0xb5 _vn_lock(cbf02828,200100,c0f05d2e,856,4,...) at _vn_lock+0x78 vget(cbf02828,200100,cfaad8a0,50,0,...) at vget+0xbb vfs_hash_get(c78a82d4,7cee4531,200000,cfaad8a0,f1a5e9ec,...) at vfs_hash_get+0xed ncl_nget(c78a82d4,c7f3108c,1c,f1a5ea18,200000,...) at ncl_nget+0xcf nfs_root(c78a82d4,200000,f1a5ea90,1f5,f1a5eb5c,...) at nfs_root+0x42 lookup(f1a5eb44,c0f05179,ee,c9,cfaa7000,...) at lookup+0x9a1 namei(f1a5eb44,f1a5ec08,101,f1a5ebc4,3,...) at namei+0x592 kern_renameat(cfaad8a0,ffffff9c,bfbfe430,ffffff9c,bfbfea83,...) at kern_renameat+0x1b3 kern_rename(cfaad8a0,bfbfe430,bfbfea83,0,f1a5ec7c,...) at kern_rename+0x36 rename(cfaad8a0,f1a5ecec,f1a5ed28,c0efc8ea,0,...) at rename+0x29 syscallenter(cfaad8a0,f1a5ece4,f1a5ece4,0,0,...) at syscallenter+0x263 syscall(f1a5ed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (128, FreeBSD ELF32, rename), eip = 0x280db44b, esp = 0xbfbfe40c, ebp = 0xbfbfe838 --- Tracing command sh pid 16181 tid 100205 td 0xcfab0000 sched_switch(cfab0000,0,104,191,8338f172,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(cfab0000,0,c0efbf60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0efbf60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cfaab580,6c,c0efed7a,100,0,...) at sleepq_wait_sig+0x17 _sleep(cfaab580,cfaab608,16c,c0efed7a,0,...) at _sleep+0x35c kern_wait(cfab0000,ffffffff,f1a49c44,2,0,...) at kern_wait+0xb96 wait4(cfab0000,f1a49cec,2843e010,1,0,...) at wait4+0x3b syscallenter(cfab0000,f1a49ce4,c0d3976d,c1090770,0,...) at syscallenter+0x263 syscall(f1a49d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2816b44b, esp = 0xbfbfe7bc, ebp = 0xbfbfe7d8 --- Tracing command swap pid 16080 tid 100217 td 0xc8e3c8a0 sched_switch(c8e3c8a0,0,602,18c,88c076db,...) at sched_switch+0x3bc mi_switch(602,0,c0ef6fff,cd,4,...) at mi_switch+0x1eb critical_exit(c8e3c8a0,0,1,8ab8000,28800000,...) at critical_exit+0xa8 ipi_bitmap_handler(3b,3b,3b,0,28800000,...) at ipi_bitmap_handler+0x82 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x2f --- interrupt, eip = 0x804915c, esp = 0xbfbfe9d0, ebp = 0xbfbfe9f8 --- Tracing command swap pid 16079 tid 100097 td 0xc79232e0 sched_switch(c79232e0,0,602,18c,83a48f37,...) at sched_switch+0x3bc mi_switch(602,0,c0ef6fff,cd,0,...) at mi_switch+0x1eb critical_exit(c79232e0,0,0,13f19000,28800000,...) at critical_exit+0xa8 ipi_bitmap_handler(3b,3b,3b,0,28800000,...) at ipi_bitmap_handler+0x82 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x2f --- interrupt, eip = 0x804915c, esp = 0xbfbfe9d0, ebp = 0xbfbfe9f8 --- Tracing command swap pid 16078 tid 100152 td 0xc79628a0 sched_switch(c79628a0,0,207,18c,8104a86e,...) at sched_switch+0x3bc mi_switch(207,0,c0efc8a9,d4,c1270380,...) at mi_switch+0x1eb ast(f1975d28) at ast+0x2b6 doreti_ast() at doreti_ast+0x17 Tracing command swap pid 16077 tid 100195 td 0xcf2668a0 sched_switch(cf2668a0,0,207,18c,860a4c44,...) at sched_switch+0x3bc mi_switch(207,0,c0efc8a9,d4,c1270380,...) at mi_switch+0x1eb ast(f1a2bd28) at ast+0x2b6 doreti_ast() at doreti_ast+0x17 Tracing command swap pid 16076 tid 100085 td 0xc79642e0 sched_switch(c79642e0,0,207,18c,815a6feb,...) at sched_switch+0x3bc mi_switch(207,0,c0efc8a9,d4,c0d51f16,...) at mi_switch+0x1eb ast(f1809d28) at ast+0x2b6 doreti_ast() at doreti_ast+0x17 Tracing command swap pid 16075 tid 100240 td 0xcca43b80 sched_switch(cca43b80,0,207,18c,8625ba3b,...) at sched_switch+0x3bc mi_switch(207,0,c0efc8a9,d4,c1270380,...) at mi_switch+0x1eb ast(f1ab2d28) at ast+0x2b6 doreti_ast() at doreti_ast+0x17 Tracing command swap pid 16074 tid 100150 td 0xc7820000 sched_switch(c7820000,0,207,18c,837e4012,...) at sched_switch+0x3bc mi_switch(207,0,c0efc8a9,d4,c0d51f16,...) at mi_switch+0x1eb ast(f196fd28) at ast+0x2b6 doreti_ast() at doreti_ast+0x17 Tracing command swap pid 16073 tid 100251 td 0xc8e315c0 sched_switch(c8e315c0,0,104,191,810a4c85,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,50,...) at mi_switch+0x1eb sleepq_switch(c8e315c0,0,c0efbf60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c3fb9b78,50,c0f2eaf0,0,0,...) at sleepq_timedwait+0x6b _sleep(c3fb9b78,cd41eb28,50,c0f2eaf0,4e20,...) at _sleep+0x342 swap_pager_getpages(cd41eb28,f1ad3b8c,8,0,f1ad3c10,...) at swap_pager_getpages+0x3a1 vm_fault_hold(c7f171d0,2ab10000,2,0,0,...) at vm_fault_hold+0x103f vm_fault(c7f171d0,2ab10000,2,0,2ab10000,...) at vm_fault+0x46 trap_pfault(5,0,c0f45276,30d,c7721b00,...) at trap_pfault+0x10d trap(f1ad3d28) at trap+0x2c9 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x8049158, esp = 0xbfbfe9d0, ebp = 0xbfbfe9f8 --- Tracing command swap pid 16072 tid 100221 td 0xc8e33b80 sched_switch(c8e33b80,0,602,18c,88c0d7cd,...) at sched_switch+0x3bc mi_switch(602,0,c0ef6fff,cd,c,...) at mi_switch+0x1eb critical_exit(c8e33b80,0,3,b0d4000,28800000,...) at critical_exit+0xa8 ipi_bitmap_handler(3b,3b,3b,0,28800000,...) at ipi_bitmap_handler+0x82 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x2f --- interrupt, eip = 0x804915c, esp = 0xbfbfe9d0, ebp = 0xbfbfe9f8 --- Tracing command swap pid 16071 tid 100079 td 0xc792a000 sched_switch(c792a000,0,602,18c,8a484988,...) at sched_switch+0x3bc mi_switch(602,0,c0ef6fff,cd,8,...) at mi_switch+0x1eb critical_exit(c792a000,0,2,8afa000,28800000,...) at critical_exit+0xa8 ipi_bitmap_handler(3b,3b,3b,0,28800000,...) at ipi_bitmap_handler+0x82 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x2f --- interrupt, eip = 0x804915c, esp = 0xbfbfe9d0, ebp = 0xbfbfe9f8 --- Tracing command swap pid 16070 tid 100172 td 0xc81928a0 sched_switch(c81928a0,0,104,191,86101b95,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,50,...) at mi_switch+0x1eb sleepq_switch(c81928a0,0,c0efbf60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c39acbb8,50,c0f2eaf0,0,0,...) at sleepq_timedwait+0x6b _sleep(c39acbb8,cd41e088,50,c0f2eaf0,4e20,...) at _sleep+0x342 swap_pager_getpages(cd41e088,f19cbb8c,8,0,f19cbc10,...) at swap_pager_getpages+0x3a1 vm_fault_hold(c9eb4d98,2d76d000,2,0,0,...) at vm_fault_hold+0x103f vm_fault(c9eb4d98,2d76d000,2,0,2d76d000,...) at vm_fault+0x46 trap_pfault(5,0,c0f45276,30d,c9ebe2c0,...) at trap_pfault+0x10d trap(f19cbd28) at trap+0x2c9 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x8049158, esp = 0xbfbfe9d0, ebp = 0xbfbfe9f8 --- Tracing command swap pid 16069 tid 100099 td 0xc7c0d5c0 Tracing command swap pid 16068 tid 100084 td 0xc7929000 sched_switch(c7929000,0,104,191,1fcaeb94,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c7929000,0,c0efbf60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(3e9,c0a45aa0,c7929000,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1092084,6c,c0ef7cf7,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1092084,0,16c,c0ef7cf7,3e9,...) at _sleep+0x328 kern_nanosleep(c7929000,f1805c34,f1805c3c,1,0,...) at kern_nanosleep+0xc1 nanosleep(c7929000,f1805cec,f1805d28,c0efc8ea,0,...) at nanosleep+0x6f syscallenter(c7929000,f1805ce4,f1805ce4,0,74b,...) at syscallenter+0x263 syscall(f1805d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2817a687, esp = 0xbfbfe9cc, ebp = 0xbfbfe9f8 --- Tracing command newnfs 2 pid 16021 tid 100167 td 0xc755b2e0 sched_switch(c755b2e0,0,104,191,4517ade8,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c755b2e0,0,c0efbf60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(1d4c0,c0a45aa0,c755b2e0,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1089028,6c,c0ee9792,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1089028,c1088fd4,16c,c0ee9792,1d4c0,...) at _sleep+0x328 nfssvc_iod(c1089248,f19a2d28,c0ef1110,3a5,c7d0b840,...) at nfssvc_iod+0xd0 fork_exit(c096b240,c1089248,f19a2d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf19a2d60, ebp = 0 --- Tracing command newnfs 1 pid 15780 tid 100257 td 0xc99a4000 sched_switch(c99a4000,0,104,191,8f60f098,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c99a4000,0,c0efbf60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(1d4c0,c0a45aa0,c99a4000,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1089024,6c,c0ee9792,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1089024,c1088fd4,16c,c0ee9792,1d4c0,...) at _sleep+0x328 nfssvc_iod(c1089244,f1ae5d28,c0ef1110,3a5,cca42840,...) at nfssvc_iod+0xd0 fork_exit(c096b240,c1089244,f1ae5d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf1ae5d60, ebp = 0 --- Tracing command bash pid 11121 tid 100154 td 0xc79622e0 Tracing command sshd pid 11120 tid 100133 td 0xc78205c0 sched_switch(c78205c0,0,104,191,8cd35358,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c78205c0,0,c0efbf60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c09f672a,c73d5c50,0,c0ef4da7,c78205c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c73d5c64,0,f193ca4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c73d5c64,c73d5c50,c0efe5ee,627,c9f0e188,...) at _cv_wait_sig+0x243 seltdwait(c9f0e188,58,ca7bbd00,c78205c0,246,...) at seltdwait+0xa2 kern_select(c78205c0,c,288060b4,288060bc,0,0,20,c7ee5b00,c7ee5b00) at kern_select+0x504 select(c78205c0,f193ccec,f193cd28,c0efc8ea,0,...) at select+0x66 syscallenter(c78205c0,f193cce4,f193cce4,0,0,...) at syscallenter+0x263 syscall(f193cd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x284c50d3, esp = 0xbfbfe19c, ebp = 0xbfbfe1e8 --- Tracing command sshd pid 11118 tid 100157 td 0xc792a8a0 Tracing command newnfs 0 pid 10342 tid 100100 td 0xc7c0d2e0 sched_switch(c7c0d2e0,0,104,191,839dc352,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c7c0d2e0,0,c0efbf60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(1d4c0,c0a45aa0,c7c0d2e0,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1089020,6c,c0ee9792,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1089020,c1088fd4,16c,c0ee9792,1d4c0,...) at _sleep+0x328 nfssvc_iod(c1089240,f1868d28,c0ef1110,3a5,c7c01840,...) at nfssvc_iod+0xd0 fork_exit(c096b240,c1089240,f1868d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf1868d60, ebp = 0 --- Tracing command sh pid 10217 tid 100153 td 0xc79625c0 sched_switch(c79625c0,0,104,191,4012bde2,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c79625c0,0,c0efbf60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0efbf60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c80eb840,6c,c0efed7a,100,0,...) at sleepq_wait_sig+0x17 _sleep(c80eb840,c80eb8c8,16c,c0efed7a,0,...) at _sleep+0x35c kern_wait(c79625c0,ffffffff,f1978c44,2,0,...) at kern_wait+0xb96 wait4(c79625c0,f1978cec,f1978d28,c0efc8ea,0,...) at wait4+0x3b syscallenter(c79625c0,f1978ce4,f1978ce4,0,0,...) at syscallenter+0x263 syscall(f1978d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2816b44b, esp = 0xbfbfe6ec, ebp = 0xbfbfe708 --- Tracing command bash pid 10213 tid 100159 td 0xc792a5c0 Tracing command csh pid 10209 tid 100106 td 0xc78f0000 Tracing command su pid 10208 tid 100162 td 0xc81938a0 Tracing command getty pid 5827 tid 100144 td 0xc7d2ab80 sched_switch(c7d2ab80,0,104,191,7fe9eac7,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7d2ab80,0,c0efbf60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0efbf60,160,0,c7d2ab80,c7d2ab80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c756b070,0,c0f00cb6,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c756b070,c1090770,c0f0062c,522,0,...) at _cv_wait_sig+0x243 tty_wait(c756b000,c756b070,f195dc28,1,0,...) at tty_wait+0x71 ttydisc_read(c756b000,f195dc28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c7556000,f195dc28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c9ef1a80,f195dc28,c71b4e80,0,c7d2ab80,...) at devfs_read_f+0x7e dofileread(f195dc28,ffffffff,ffffffff,0,c9ef1a80,...) at dofileread+0x9e kern_readv(c7d2ab80,0,f195dc28,f195dc48,1,...) at kern_readv+0x58 read(c7d2ab80,f195dcec,f195dd28,c0efc8ea,0,...) at read+0x4f syscallenter(c7d2ab80,f195dce4,f195dce4,0,0,...) at syscallenter+0x263 syscall(f195dd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28197153, esp = 0xbfbfed8c, ebp = 0xbfbfedb8 --- Tracing command getty pid 5826 tid 100122 td 0xc78ef2e0 sched_switch(c78ef2e0,0,104,191,7fd05b7a,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c78ef2e0,0,c0efbf60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0efbf60,160,0,c78ef2e0,c78ef2e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c756b270,0,c0f00cb6,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c756b270,c1090770,c0f0062c,522,0,...) at _cv_wait_sig+0x243 tty_wait(c756b200,c756b270,f18e1c28,1,0,...) at tty_wait+0x71 ttydisc_read(c756b200,f18e1c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c739ee00,f18e1c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c9f0eb28,f18e1c28,c71b4e80,0,c78ef2e0,...) at devfs_read_f+0x7e dofileread(f18e1c28,ffffffff,ffffffff,0,c9f0eb28,...) at dofileread+0x9e kern_readv(c78ef2e0,0,f18e1c28,f18e1c48,1,...) at kern_readv+0x58 read(c78ef2e0,f18e1cec,f18e1d28,c0efc8ea,0,...) at read+0x4f syscallenter(c78ef2e0,f18e1ce4,f18e1ce4,0,0,...) at syscallenter+0x263 syscall(f18e1d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28197153, esp = 0xbfbfed8c, ebp = 0xbfbfedb8 --- Tracing command getty pid 5825 tid 100094 td 0xc7923b80 sched_switch(c7923b80,0,104,191,800f337f,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7923b80,0,c0efbf60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0efbf60,160,0,c7923b80,c7923b80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c756b470,0,c0f00cb6,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c756b470,c1090770,c0f0062c,522,0,...) at _cv_wait_sig+0x243 tty_wait(c756b400,c756b470,f1852c28,1,0,...) at tty_wait+0x71 ttydisc_read(c756b400,f1852c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c739eb00,f1852c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c78f3cb0,f1852c28,c71b4e80,0,c7923b80,...) at devfs_read_f+0x7e dofileread(f1852c28,ffffffff,ffffffff,0,c78f3cb0,...) at dofileread+0x9e kern_readv(c7923b80,0,f1852c28,f1852c48,1,...) at kern_readv+0x58 read(c7923b80,f1852cec,f1852d28,c0efc8ea,0,...) at read+0x4f syscallenter(c7923b80,f1852ce4,f1852ce4,0,0,...) at syscallenter+0x263 syscall(f1852d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28197153, esp = 0xbfbfed8c, ebp = 0xbfbfedb8 --- Tracing command getty pid 5824 tid 100155 td 0xc7962000 sched_switch(c7962000,0,104,191,7fd8b7b8,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7962000,0,c0efbf60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0efbf60,160,0,c7962000,c7962000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c72d6070,0,c0f00cb6,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c72d6070,c1090770,c0f0062c,522,0,...) at _cv_wait_sig+0x243 tty_wait(c72d6000,c72d6070,f197ec28,1,0,...) at tty_wait+0x71 ttydisc_read(c72d6000,f197ec28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c739ea00,f197ec28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c9f32770,f197ec28,c71b4e80,0,c7962000,...) at devfs_read_f+0x7e dofileread(f197ec28,ffffffff,ffffffff,0,c9f32770,...) at dofileread+0x9e kern_readv(c7962000,0,f197ec28,f197ec48,1,...) at kern_readv+0x58 read(c7962000,f197ecec,f197ed28,c0efc8ea,0,...) at read+0x4f syscallenter(c7962000,f197ece4,f197ece4,0,0,...) at syscallenter+0x263 syscall(f197ed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28197153, esp = 0xbfbfed8c, ebp = 0xbfbfedb8 --- Tracing command getty pid 5822 tid 100182 td 0xc9ec6000 sched_switch(c9ec6000,0,104,191,7fecf151,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c9ec6000,0,c0efbf60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0efbf60,160,0,c9ec6000,c9ec6000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c72d6270,0,c0f00cb6,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c72d6270,c1090770,c0f0062c,522,0,...) at _cv_wait_sig+0x243 tty_wait(c72d6200,c72d6270,f19e9c28,1,0,...) at tty_wait+0x71 ttydisc_read(c72d6200,f19e9c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c739e300,f19e9c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7d2ebd0,f19e9c28,c71b4e80,0,c9ec6000,...) at devfs_read_f+0x7e dofileread(f19e9c28,ffffffff,ffffffff,0,c7d2ebd0,...) at dofileread+0x9e kern_readv(c9ec6000,0,f19e9c28,f19e9c48,1,...) at kern_readv+0x58 read(c9ec6000,f19e9cec,f19e9d28,c0efc8ea,0,...) at read+0x4f syscallenter(c9ec6000,f19e9ce4,f19e9ce4,0,0,...) at syscallenter+0x263 syscall(f19e9d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28197153, esp = 0xbfbfed8c, ebp = 0xbfbfedb8 --- Tracing command getty pid 5820 tid 100151 td 0xc7962b80 sched_switch(c7962b80,0,104,191,7ffc419b,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7962b80,0,c0efbf60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0efbf60,160,0,c7962b80,c7962b80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c72d6470,0,c0f00cb6,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c72d6470,c1090770,c0f0062c,522,0,...) at _cv_wait_sig+0x243 tty_wait(c72d6400,c72d6470,f1972c28,1,0,...) at tty_wait+0x71 ttydisc_read(c72d6400,f1972c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c739e400,f1972c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7d2e428,f1972c28,c71b4e80,0,c7962b80,...) at devfs_read_f+0x7e dofileread(f1972c28,ffffffff,ffffffff,0,c7d2e428,...) at dofileread+0x9e kern_readv(c7962b80,0,f1972c28,f1972c48,1,...) at kern_readv+0x58 read(c7962b80,f1972cec,f1972d28,c0efc8ea,0,...) at read+0x4f syscallenter(c7962b80,f1972ce4,f1972ce4,0,0,...) at syscallenter+0x263 syscall(f1972d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28197153, esp = 0xbfbfed8c, ebp = 0xbfbfedb8 --- Tracing command getty pid 5819 tid 100147 td 0xc7d2a5c0 sched_switch(c7d2a5c0,0,104,191,80013545,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7d2a5c0,0,c0efbf60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0efbf60,160,0,c7d2a5c0,c7d2a5c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c72d6670,0,c0f00cb6,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c72d6670,c1090770,c0f0062c,522,0,...) at _cv_wait_sig+0x243 tty_wait(c72d6600,c72d6670,f1966c28,1,0,...) at tty_wait+0x71 ttydisc_read(c72d6600,f1966c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c739e500,f1966c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c79691c0,f1966c28,c71b4e80,0,c7d2a5c0,...) at devfs_read_f+0x7e dofileread(f1966c28,ffffffff,ffffffff,0,c79691c0,...) at dofileread+0x9e kern_readv(c7d2a5c0,0,f1966c28,f1966c48,1,...) at kern_readv+0x58 read(c7d2a5c0,f1966cec,f1966d28,c0efc8ea,0,...) at read+0x4f syscallenter(c7d2a5c0,f1966ce4,f1966ce4,0,0,...) at syscallenter+0x263 syscall(f1966d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28197153, esp = 0xbfbfed8c, ebp = 0xbfbfedb8 --- Tracing command getty pid 5818 tid 100149 td 0xc7d2a2e0 sched_switch(c7d2a2e0,0,104,191,80032fbd,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7d2a2e0,0,c0efbf60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0efbf60,160,0,c7d2a2e0,c7d2a2e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c72d6870,0,c0f00cb6,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c72d6870,c1090770,c0f0062c,522,0,...) at _cv_wait_sig+0x243 tty_wait(c72d6800,c72d6870,f196cc28,1,0,...) at tty_wait+0x71 ttydisc_read(c72d6800,f196cc28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c739e600,f196cc28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7bcd038,f196cc28,c71b4e80,0,c7d2a2e0,...) at devfs_read_f+0x7e dofileread(f196cc28,ffffffff,ffffffff,0,c7bcd038,...) at dofileread+0x9e kern_readv(c7d2a2e0,0,f196cc28,f196cc48,1,...) at kern_readv+0x58 read(c7d2a2e0,f196ccec,f196cd28,c0efc8ea,0,...) at read+0x4f syscallenter(c7d2a2e0,f196cce4,f196cce4,0,0,...) at syscallenter+0x263 syscall(f196cd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28197153, esp = 0xbfbfed8c, ebp = 0xbfbfedb8 --- Tracing command getty pid 5817 tid 100110 td 0xc7c0c2e0 sched_switch(c7c0c2e0,0,104,191,61945411,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7c0c2e0,0,c0efbf60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c09f672a,c72d6a04,0,c0ef4da7,c7c0c2e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c72d6a70,0,f18a5ad8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c72d6a70,c72d6a04,c0f0062c,522,0,...) at _cv_wait_sig+0x243 tty_wait(c72d6a00,c72d6a70,f18a5c28,1,0,...) at tty_wait+0x71 ttydisc_read(c72d6a00,f18a5c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c71fcc00,f18a5c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7969ab8,f18a5c28,c71b4e80,0,c7c0c2e0,...) at devfs_read_f+0x7e dofileread(f18a5c28,ffffffff,ffffffff,0,c7969ab8,...) at dofileread+0x9e kern_readv(c7c0c2e0,0,f18a5c28,f18a5c48,1,...) at kern_readv+0x58 read(c7c0c2e0,f18a5cec,f18a5d28,c0efc8ea,0,...) at read+0x4f syscallenter(c7c0c2e0,f18a5ce4,f18a5ce4,0,0,...) at syscallenter+0x263 syscall(f18a5d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28197153, esp = 0xbfbfed8c, ebp = 0xbfbfedb8 --- Tracing command inetd pid 5754 tid 100134 td 0xc79638a0 sched_switch(c79638a0,0,104,191,4a234c44,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c79638a0,0,c0efbf60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c09f672a,c791ac50,0,c0ef4da7,c79638a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c791ac64,0,f193fa4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c791ac64,c791ac50,c0efe5ee,627,c9f0e268,...) at _cv_wait_sig+0x243 seltdwait(c9f0e268,58,c71b4e80,c79638a0,c7963950,...) at seltdwait+0xa2 kern_select(c79638a0,6,bfbfdfa0,0,0,0,20,c80ecb00,c80ecb00) at kern_select+0x504 select(c79638a0,f193fcec,f193fd28,c0efc8ea,0,...) at select+0x66 syscallenter(c79638a0,f193fce4,f193fce4,0,0,...) at syscallenter+0x263 syscall(f193fd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x281a90d3, esp = 0xbfbfdf5c, ebp = 0xbfbfede8 --- Tracing command watchdogd pid 5716 tid 100140 td 0xc7d2c5c0 sched_switch(c7d2c5c0,0,104,191,62c9fe3f,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c7d2c5c0,0,c0efbf60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(ea61,c0a45aa0,c7d2c5c0,2,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1092084,6c,c0ef7cf7,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1092084,0,16c,c0ef7cf7,ea61,...) at _sleep+0x328 kern_nanosleep(c7d2c5c0,f1951c34,f1951c3c,3c,0,...) at kern_nanosleep+0xc1 nanosleep(c7d2c5c0,f1951cec,f1951d28,c0efc8ea,0,...) at nanosleep+0x6f syscallenter(c7d2c5c0,f1951ce4,f1951ce4,0,0,...) at syscallenter+0x263 syscall(f1951d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28192687, esp = 0xbfbfecbc, ebp = 0xbfbfece8 --- Tracing command bash pid 2163 tid 100163 td 0xc7d2a000 Tracing command sshd pid 2162 tid 100164 td 0xc7c0db80 sched_switch(c7c0db80,0,104,191,85cd52bf,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7c0db80,0,c0efbf60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c09f672a,c73d57d0,0,c0ef4da7,c7c0db80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c73d57e4,0,f1999a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c73d57e4,c73d57d0,c0efe5ee,627,c7bcd968,...) at _cv_wait_sig+0x243 seltdwait(c7bcd968,58,c7917580,c7c0db80,246,...) at seltdwait+0xa2 kern_select(c7c0db80,c,288060b4,288060bc,0,0,20,c7ee92c0,c7ee92c0) at kern_select+0x504 select(c7c0db80,f1999cec,f1999d28,c0efc8ea,0,...) at select+0x66 syscallenter(c7c0db80,f1999ce4,f1999ce4,0,0,...) at syscallenter+0x263 syscall(f1999d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x284c50d3, esp = 0xbfbfe19c, ebp = 0xbfbfe1e8 --- Tracing command sshd pid 2160 tid 100080 td 0xc7929b80 Tracing command cron pid 2119 tid 100107 td 0xc78efb80 sched_switch(c78efb80,0,104,191,df66ab71,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c78efb80,0,c0efbf60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(ea61,c0a45aa0,c78efb80,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1092084,6c,c0ef7cf7,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1092084,0,16c,c0ef7cf7,ea61,...) at _sleep+0x328 kern_nanosleep(c78efb80,f189ac34,f189ac3c,3c,0,...) at kern_nanosleep+0xc1 nanosleep(c78efb80,f189acec,f189ad28,c0efc8ea,0,...) at nanosleep+0x6f syscallenter(c78efb80,f189ace4,f189ace4,0,0,...) at syscallenter+0x263 syscall(f189ad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28185687, esp = 0xbfbfec4c, ebp = 0xbfbfec78 --- Tracing command sendmail pid 2111 tid 100131 td 0xc7d2d5c0 Tracing command sendmail pid 2105 tid 100130 td 0xc7820b80 sched_switch(c7820b80,0,104,191,32af5207,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7820b80,0,c0efbf60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f1930a14,c09f672a,c73d50d0,0,c7820b80,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c73d50e4,0,f1930a4c,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c73d50e4,c73d50d0,1389,627,c78f3000,...) at _cv_timedwait_sig+0x252 seltdwait(f1930bf8,f1930c00,c7917800,c7820b80,f1930af8,...) at seltdwait+0x8a kern_select(c7820b80,5,bfbfc510,0,0,f1930c40,20,5,0) at kern_select+0x504 select(c7820b80,f1930cec,f1930d28,c0efc8ea,0,...) at select+0x66 syscallenter(c7820b80,f1930ce4,f1930ce4,0,0,...) at syscallenter+0x263 syscall(f1930d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x283e40d3, esp = 0xbfbfc47c, ebp = 0xbfbfcfa8 --- Tracing command sshd pid 2097 tid 100118 td 0xc79648a0 sched_switch(c79648a0,0,104,191,b2050659,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c79648a0,0,c0efbf60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c09f672a,c73d5c10,0,c0ef4da7,c79648a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c73d5c24,0,f18bda4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c73d5c24,c73d5c10,c0efe5ee,627,c7ce9c78,...) at _cv_wait_sig+0x243 seltdwait(c7ce9c78,58,c7917700,c79648a0,c792b910,...) at seltdwait+0xa2 kern_select(c79648a0,5,288cc0b4,0,0,0,20,c7c03840,c7c03840) at kern_select+0x504 select(c79648a0,f18bdcec,2880a070,1,0,...) at select+0x66 syscallenter(c79648a0,f18bdce4,c0d3976d,c1090770,0,...) at syscallenter+0x263 syscall(f18bdd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x284c50d3, esp = 0xbfbfe25c, ebp = 0xbfbfedf8 --- Tracing command moused pid 2037 tid 100117 td 0xc7964b80 sched_switch(c7964b80,0,104,191,f062dd0e,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7964b80,0,c0efbf60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c09f672a,c7919650,0,c0ef4da7,c7964b80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7919664,0,f18baa4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7919664,c7919650,c0efe5ee,627,c7bcd930,...) at _cv_wait_sig+0x243 seltdwait(c7bcd930,58,c71b4e80,c7964b80,14,...) at seltdwait+0xa2 kern_select(c7964b80,6,bfbfea04,0,0,0,20,c7c03b00,c7c03b00) at kern_select+0x504 select(c7964b80,f18bacec,f18bad28,c0efc8ea,0,...) at select+0x66 syscallenter(c7964b80,f18bace4,f18bace4,0,0,...) at syscallenter+0x263 syscall(f18bad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x281b40d3, esp = 0xbfbfe99c, ebp = 0xbfbfeb28 --- Tracing command ntpd pid 1959 tid 100101 td 0xc7c0d000 sched_switch(c7c0d000,0,104,191,7f12ba3a,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7c0d000,0,c0efbf60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c09f672a,c77c2510,0,c0ef4da7,c7c0d000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c77c2524,0,f186ba4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c77c2524,c77c2510,c0efe5ee,627,c7d2e2a0,...) at _cv_wait_sig+0x243 seltdwait(c7d2e2a0,58,c71b4e80,c7c0d000,0,...) at seltdwait+0xa2 kern_select(c7c0d000,1c,bfbfece8,0,0,0,20,c7c01580,c7c01580) at kern_select+0x504 select(c7c0d000,f186bcec,f186bd80,f186bc88,0,...) at select+0x66 syscallenter(c7c0d000,f186bce4,c0d39426,fffffffe,246,...) at syscallenter+0x263 syscall(f186bd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x283630d3, esp = 0xbfbfecbc, ebp = 0xbfbfed88 --- Tracing command nfsd pid 1860 tid 100125 td 0xc78ec8a0 sched_switch(c78ec8a0,0,104,191,839a77e0,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c78ec8a0,0,c0efbf60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f18f3be0,c09f672a,c73dfa80,0,c78ec8a0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c7d34090,0,f18f3c18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7d34090,c73dfa80,1388,48a,0,...) at _cv_timedwait_sig+0x252 svc_run_internal(f18f3d14,c09d9a78,c73dfa80,f18f3d28,c0ef1110,...) at svc_run_internal+0x356 svc_thread_start(c73dfa80,f18f3d28,c0ef1110,3a5,c7922580,...) at svc_thread_start+0x10 fork_exit(c0bed7b0,c73dfa80,f18f3d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x804c12e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1860 tid 100124 td 0xc78ecb80 cpustop_handler(3,13,f18f0be8,c0d39026,cb9550a6,...) at cpustop_handler+0x28 ipi_nmi_handler(cb9550a6,6a1d755b,2cb2,42a726f2,c7922580,...) at ipi_nmi_handler+0x47 trap(f18f0bf4) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0becca6, esp = 0xf18f0c34, ebp = 0xf18f0ce0 --- svc_run_internal(f18f0d14,c09d9a78,c73dfa80,f18f0d28,c0ef1110,...) at svc_run_internal+0x116 svc_thread_start(c73dfa80,f18f0d28,c0ef1110,3a5,c7922580,...) at svc_thread_start+0x10 fork_exit(c0bed7b0,c73dfa80,f18f0d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x804c12e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1860 tid 100123 td 0xc78ef000 sched_switch(c78ef000,0,104,191,878c083a,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c78ef000,0,c0efbf60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f18edbe0,c09f672a,c73dfa80,0,c78ef000,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c7ee1250,0,f18edc18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7ee1250,c73dfa80,1388,3b1,0,...) at _cv_timedwait_sig+0x252 svc_run_internal(f18edd14,c09d9a78,c73dfa80,f18edd28,c0ef1110,...) at svc_run_internal+0x356 svc_thread_start(c73dfa80,f18edd28,c0ef1110,3a5,c7922580,...) at svc_thread_start+0x10 fork_exit(c0bed7b0,c73dfa80,f18edd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x804c12e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1860 tid 100081 td 0xc79298a0 sched_switch(c79298a0,0,104,191,85f82127,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c79298a0,0,c0efbf60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f17f9494,c09f672a,c73dfa80,0,c79298a0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c78e8050,0,f17f94cc,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c78e8050,c73dfa80,1388,48a,f17f9514,...) at _cv_timedwait_sig+0x252 svc_run_internal(c7929a50,14,c0f24f3a,c0ee8cfb,f17f97f4,...) at svc_run_internal+0x356 svc_run(c73dfa80,0,c0ee8cd6,19f,f17f9610,...) at svc_run+0x7b nfsrvd_nfsd(c79298a0,f17f97f4,c,c0f31079,c0eec2c0,...) at nfsrvd_nfsd+0x1c3 nfssvc_nfsd(c79298a0,f17f9cec,c7922580,0,f17f9c7c,...) at nfssvc_nfsd+0x167 nfssvc(c79298a0,f17f9cec,f17f9d28,c0efc8ea,0,...) at nfssvc+0xeb syscallenter(c79298a0,f17f9ce4,f17f9ce4,0,0,...) at syscallenter+0x263 syscall(f17f9d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (155, FreeBSD ELF32, nfssvc), eip = 0x280de32b, esp = 0xbfbfe82c, ebp = 0xbfbfea98 --- Tracing command nfsd pid 1854 tid 100090 td 0xc79285c0 sched_switch(c79285c0,0,104,191,7eeee570,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c79285c0,0,c0efbf60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c09f672a,c7919150,0,c0ef4da7,c79285c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7919164,0,f1820a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7919164,c7919150,c0efe5ee,627,c78f3738,...) at _cv_wait_sig+0x243 seltdwait(c78f3738,58,c71b4e80,c79285c0,c7928670,...) at seltdwait+0xa2 kern_select(c79285c0,7,bfbfecb4,0,0,0,20,c791e2c0,c791e2c0) at kern_select+0x504 select(c79285c0,f1820cec,f1820d28,c0efc8ea,0,...) at select+0x66 syscallenter(c79285c0,f1820ce4,f1820ce4,0,0,...) at syscallenter+0x263 syscall(f1820d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x281850d3, esp = 0xbfbfea9c, ebp = 0xbfbfede8 --- Tracing command mountd pid 1844 tid 100102 td 0xc7c0cb80 sched_switch(c7c0cb80,0,104,191,85ba9fa4,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7c0cb80,0,c0efbf60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c09f672a,c73d5850,0,c0ef4da7,c7c0cb80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c73d5864,0,f186ea4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c73d5864,c73d5850,c0efe5ee,627,c78f3c78,...) at _cv_wait_sig+0x243 seltdwait(c78f3c78,58,c71b4e80,c7c0cb80,c11db1b8,...) at seltdwait+0xa2 kern_select(c7c0cb80,9,bfbfecf4,0,0,0,20,c7c012c0,c7c012c0) at kern_select+0x504 select(c7c0cb80,f186ecec,f186ed28,c0efc8ea,0,...) at select+0x66 syscallenter(c7c0cb80,f186ece4,f186ece4,0,0,...) at syscallenter+0x263 syscall(f186ed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x2819b0d3, esp = 0xbfbfec8c, ebp = 0xbfbfedd8 --- Tracing command rpcbind pid 1744 tid 100113 td 0xc7c0b8a0 sched_switch(c7c0b8a0,0,104,191,7e3a4bd2,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7c0b8a0,0,c0efbf60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f18aea6c,c09f672a,c7919750,0,c7c0b8a0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c7919764,0,f18aeaa4,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7919764,c7919750,7531,627,f18aeb5c,...) at _cv_timedwait_sig+0x252 seltdwait(f18aec2c,f18aec34,535,c7c0b8a0,f18aeb2c,...) at seltdwait+0x8a poll(c7c0b8a0,f18aecec,f18aed28,c0efc8ea,0,...) at poll+0x300 syscallenter(c7c0b8a0,f18aece4,f18aece4,0,0,...) at syscallenter+0x263 syscall(f18aed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, poll), eip = 0x281402bb, esp = 0xbfbfcbac, ebp = 0xbfbfed78 --- Tracing command syslogd pid 1716 tid 100105 td 0xc78f02e0 sched_switch(c78f02e0,0,104,191,d3bbf2e0,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c78f02e0,0,c0efbf60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c09f672a,c77c2190,0,c0ef4da7,c78f02e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c77c21a4,0,f1892a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c77c21a4,c77c2190,c0efe5ee,627,c7ce9230,...) at _cv_wait_sig+0x243 seltdwait(c7ce9230,58,c71b4e80,c78f02e0,c71be570,...) at seltdwait+0xa2 kern_select(c78f02e0,9,2847f0ac,0,0,0,20,c78eb2c0,c78eb2c0) at kern_select+0x504 select(c78f02e0,f1892cec,804e728,1,0,...) at select+0x66 syscallenter(c78f02e0,f1892ce4,c0d3976d,c1090770,0,...) at syscallenter+0x263 syscall(f1892d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x2819a0d3, esp = 0xbfbfe29c, ebp = 0xbfbfede8 --- Tracing command devd pid 1516 tid 100093 td 0xc7928000 sched_switch(c7928000,0,104,191,b31c9e78,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7928000,0,c0efbf60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c09f672a,c7919b90,0,c0ef4da7,c7928000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7919ba4,0,f184ea4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7919ba4,c7919b90,c0efe5ee,627,c7bcde00,...) at _cv_wait_sig+0x243 seltdwait(c7bcde00,58,c71b4e80,c7928000,c0f2ef09,...) at seltdwait+0xa2 kern_select(c7928000,5,bfbfe960,0,0,0,20,c7c03000,c7c03000) at kern_select+0x504 select(c7928000,f184ecec,f184ed28,c0efc8ea,0,...) at select+0x66 syscallenter(c7928000,f184ece4,f184ece4,0,0,...) at syscallenter+0x263 syscall(f184ed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x808b98b, esp = 0xbfbfe92c, ebp = 0xbfbfee08 --- Tracing command softdepflush pid 18 tid 100076 td 0xc743e8a0 sched_switch(c743e8a0,0,104,191,5f862d16,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,54,...) at mi_switch+0x1eb sleepq_switch(c743e8a0,0,c0efbf60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c120e960,54,c0f2c085,0,0,...) at sleepq_timedwait+0x6b _sleep(c120e960,c120e910,54,c0f2c085,3e8,...) at _sleep+0x342 softdep_flush(0,ed40ed28,c0ef1110,3a5,c77f82c0,...) at softdep_flush+0x256 fork_exit(c0c3d790,0,ed40ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed40ed60, ebp = 0 --- Tracing command vnlru pid 17 tid 100075 td 0xc743eb80 sched_switch(c743eb80,0,104,191,82121095,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,60,...) at mi_switch+0x1eb sleepq_switch(c743eb80,0,c0efbf60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c77f8580,60,c0f06ca0,0,0,...) at sleepq_timedwait+0x6b _sleep(c77f8580,c1208234,260,c0f06ca0,3e8,...) at _sleep+0x342 vnlru_proc(0,ed40bd28,c0ef1110,3a5,c77f8580,...) at vnlru_proc+0xe7 fork_exit(c0aa35a0,0,ed40bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed40bd60, ebp = 0 --- Tracing command syncer pid 16 tid 100074 td 0xc7559000 sched_switch(c7559000,0,104,191,602aa086,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7559000,0,c0efbf60,28b,c7559000,...) at sleepq_switch+0x162 sleepq_timedwait(c1208274,0,ed408c78,1,0,...) at sleepq_timedwait+0x6b _cv_timedwait(c1208274,c1208260,3e8,76a,4e20,...) at _cv_timedwait+0x252 sched_sync(0,ed408d28,c0ef1110,3a5,c77f8840,...) at sched_sync+0x595 fork_exit(c0aa1540,0,ed408d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed408d60, ebp = 0 --- Tracing command bufdaemon pid 9 tid 100073 td 0xc75592e0 sched_switch(c75592e0,0,104,191,5177b4b7,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,54,...) at mi_switch+0x1eb sleepq_switch(c75592e0,0,c0efbf60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1207f08,54,c0f03ccf,0,0,...) at sleepq_timedwait+0x6b _sleep(c1207f08,c1207f10,54,c0f03ccf,3e8,...) at _sleep+0x342 buf_daemon(0,ed405d28,c0ef1110,3a5,c77f8b00,...) at buf_daemon+0x175 fork_exit(c0a88cb0,0,ed405d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed405d60, ebp = 0 --- Tracing command pagezero pid 8 tid 100072 td 0xc75595c0 sched_switch(c75595c0,0,104,191,9ed2b040,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c75595c0,0,c0efbf60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c12107dc,0,c0f32994,0,0,...) at sleepq_timedwait+0x6b _sleep(c12107dc,c120f280,0,c0f32994,493e0,...) at _sleep+0x342 vm_pagezero(0,ed402d28,c0ef1110,3a5,c77fa000,...) at vm_pagezero+0xdc fork_exit(c0c81670,0,ed402d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed402d60, ebp = 0 --- Tracing command vmdaemon pid 7 tid 100071 td 0xc75598a0 sched_switch(c75598a0,0,104,191,8f60c2ca,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,74,...) at mi_switch+0x1eb sleepq_switch(c75598a0,0,c0efbf60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c12103c8,74,c0f03ccf,0,0,...) at sleepq_wait+0x63 _sleep(c12103c8,c12103cc,74,c0f03ccf,0,...) at _sleep+0x372 vm_daemon(0,ed3ffd28,c0ef1110,3a5,c71b82c0,...) at vm_daemon+0x59 fork_exit(c0c7b440,0,ed3ffd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed3ffd60, ebp = 0 --- Tracing command pagedaemon pid 6 tid 100070 td 0xc7559b80 sched_switch(c7559b80,0,104,191,153d7180,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,54,...) at mi_switch+0x1eb sleepq_switch(c7559b80,0,c0efbf60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1210390,54,c0f03ccf,0,0,...) at sleepq_timedwait+0x6b _sleep(c1210390,c120f280,54,c0f03ccf,1388,...) at _sleep+0x342 vm_pageout(0,ed3fcd28,c0ef1110,3a5,c71b8580,...) at vm_pageout+0x2c7 fork_exit(c0c7c520,0,ed3fcd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed3fcd60, ebp = 0 --- Tracing command xpt_thrd pid 5 tid 100069 td 0xc755a000 sched_switch(c755a000,0,104,191,90349f8a,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,5c,...) at mi_switch+0x1eb sleepq_switch(c755a000,0,c0efbf60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c1056dd4,5c,c0d60f72,0,0,...) at sleepq_wait+0x63 _sleep(c1056dd4,c1056e18,5c,c0d60f72,0,...) at _sleep+0x372 xpt_scanner_thread(0,ed399d28,c0ef1110,3a5,c71b8840,...) at xpt_scanner_thread+0x47 fork_exit(c0491100,0,ed399d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed399d60, ebp = 0 --- Tracing command sctp_iterator pid 4 tid 100068 td 0xc755a2e0 sched_switch(c755a2e0,0,104,191,639dcd3c,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c755a2e0,0,c0efbf60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c1209d98,0,c0f19f3f,0,0,...) at sleepq_wait+0x63 _sleep(c1209d98,c1209d60,0,c0f19f3f,0,...) at _sleep+0x372 sctp_iterator_thread(0,ed396d28,c0ef1110,3a5,c71b8b00,...) at sctp_iterator_thread+0x5c fork_exit(c0b33030,0,ed396d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed396d60, ebp = 0 --- Tracing command fdc0 pid 3 tid 100064 td 0xc755b000 sched_switch(c755b000,0,104,191,62a255ab,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,5c,...) at mi_switch+0x1eb sleepq_switch(c755b000,0,c0efbf60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c73c3c3c,5c,c0ee9792,0,0,...) at sleepq_timedwait+0x6b _sleep(c73c3c3c,c73c3cf0,5c,c0ee9792,3e8,...) at _sleep+0x342 fdc_thread(c73c3c00,ed38ad28,c0ef1110,3a5,c7421000,...) at fdc_thread+0x27d fork_exit(c0d00920,c73c3c00,ed38ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed38ad60, ebp = 0 --- Tracing command fw0_probe pid 2 tid 100062 td 0xc742f5c0 sched_switch(c742f5c0,0,104,191,903502a6,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c742f5c0,0,c0efbf60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0efbf60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7461000,6c,c0ee9792,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7461000,c7465488,16c,c0ee9792,0,...) at _sleep+0x35c fw_bus_probe_thread(c7461000,ed37ad28,c0ef1110,3a5,c74212c0,...) at fw_bus_probe_thread+0xa08 fork_exit(c06b4d80,c7461000,ed37ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed37ad60, ebp = 0 --- Tracing command usb pid 15 tid 100058 td 0xc743b2e0 sched_switch(c743b2e0,0,104,191,7dac0ff0,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c743b2e0,0,c0efbf60,268,c743b2e0,...) at sleepq_switch+0x162 sleepq_wait(c7443d34,0,ed363cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7443d34,c7443dd4,c0ed093e,6b,c7443d3c,...) at _cv_wait+0x243 usb_process(c7443d2c,ed363d28,c0ef1110,3a5,c7421580,...) at usb_process+0x193 fork_exit(c08ac1b0,c7443d2c,ed363d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed363d60, ebp = 0 --- Tracing command usb pid 15 tid 100057 td 0xc743b5c0 sched_switch(c743b5c0,0,104,191,5b0ad346,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c743b5c0,0,c0efbf60,268,c743b5c0,...) at sleepq_switch+0x162 sleepq_wait(c7443d04,0,ed360cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7443d04,c7443dd4,c0ed093e,6b,c7443d0c,...) at _cv_wait+0x243 usb_process(c7443cfc,ed360d28,c0ef1110,3a5,c7421580,...) at usb_process+0x193 fork_exit(c08ac1b0,c7443cfc,ed360d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed360d60, ebp = 0 --- Tracing command usb pid 15 tid 100056 td 0xc743b8a0 sched_switch(c743b8a0,0,104,191,7d458f5e,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c743b8a0,0,c0efbf60,268,c743b8a0,...) at sleepq_switch+0x162 sleepq_wait(c7443cd4,0,ed35dcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7443cd4,c7443dd4,c0ed093e,6b,c7443cdc,...) at _cv_wait+0x243 usb_process(c7443ccc,ed35dd28,c0ef1110,3a5,c7421580,...) at usb_process+0x193 fork_exit(c08ac1b0,c7443ccc,ed35dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed35dd60, ebp = 0 --- Tracing command usb pid 15 tid 100055 td 0xc743bb80 sched_switch(c743bb80,0,104,191,7d457d3a,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c743bb80,0,c0efbf60,268,c743bb80,...) at sleepq_switch+0x162 sleepq_wait(c7443ca4,0,ed35acac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7443ca4,c7443dd4,c0ed093e,6b,c7443cac,...) at _cv_wait+0x243 usb_process(c7443c9c,ed35ad28,c0ef1110,3a5,c7421580,...) at usb_process+0x193 fork_exit(c08ac1b0,c7443c9c,ed35ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed35ad60, ebp = 0 --- Tracing command usb pid 15 tid 100053 td 0xc743e2e0 sched_switch(c743e2e0,0,104,191,7d456a17,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c743e2e0,0,c0efbf60,268,c743e2e0,...) at sleepq_switch+0x162 sleepq_wait(c7436b5c,0,ed351cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7436b5c,c7436bfc,c0ed093e,6b,c7436b64,...) at _cv_wait+0x243 usb_process(c7436b54,ed351d28,c0ef1110,3a5,c7421580,...) at usb_process+0x193 fork_exit(c08ac1b0,c7436b54,ed351d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed351d60, ebp = 0 --- Tracing command usb pid 15 tid 100052 td 0xc743e5c0 sched_switch(c743e5c0,0,104,191,5b09a9e1,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c743e5c0,0,c0efbf60,268,c743e5c0,...) at sleepq_switch+0x162 sleepq_wait(c7436b2c,0,ed34ecac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7436b2c,c7436bfc,c0ed093e,6b,c7436b34,...) at _cv_wait+0x243 usb_process(c7436b24,ed34ed28,c0ef1110,3a5,c7421580,...) at usb_process+0x193 fork_exit(c08ac1b0,c7436b24,ed34ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed34ed60, ebp = 0 --- Tracing command usb pid 15 tid 100051 td 0xc742d000 sched_switch(c742d000,0,104,191,7ce17905,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c742d000,0,c0efbf60,268,c742d000,...) at sleepq_switch+0x162 sleepq_wait(c7436afc,0,ed34bcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7436afc,c7436bfc,c0ed093e,6b,c7436b04,...) at _cv_wait+0x243 usb_process(c7436af4,ed34bd28,c0ef1110,3a5,c7421580,...) at usb_process+0x193 fork_exit(c08ac1b0,c7436af4,ed34bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed34bd60, ebp = 0 --- Tracing command usb pid 15 tid 100050 td 0xc742d2e0 sched_switch(c742d2e0,0,104,191,7ce16554,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c742d2e0,0,c0efbf60,268,c742d2e0,...) at sleepq_switch+0x162 sleepq_wait(c7436acc,0,ed348cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7436acc,c7436bfc,c0ed093e,6b,c7436ad4,...) at _cv_wait+0x243 usb_process(c7436ac4,ed348d28,c0ef1110,3a5,c7421580,...) at usb_process+0x193 fork_exit(c08ac1b0,c7436ac4,ed348d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed348d60, ebp = 0 --- Tracing command usb pid 15 tid 100049 td 0xc742d5c0 sched_switch(c742d5c0,0,104,191,7ce14eeb,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c742d5c0,0,c0efbf60,268,c742d5c0,...) at sleepq_switch+0x162 sleepq_wait(c7431b5c,0,ed345cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7431b5c,c7431bfc,c0ed093e,6b,c7431b64,...) at _cv_wait+0x243 usb_process(c7431b54,ed345d28,c0ef1110,3a5,c7421580,...) at usb_process+0x193 fork_exit(c08ac1b0,c7431b54,ed345d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed345d60, ebp = 0 --- Tracing command usb pid 15 tid 100048 td 0xc742d8a0 sched_switch(c742d8a0,0,104,191,5b08f109,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c742d8a0,0,c0efbf60,268,c742d8a0,...) at sleepq_switch+0x162 sleepq_wait(c7431b2c,0,ed342cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7431b2c,c7431bfc,c0ed093e,6b,c7431b34,...) at _cv_wait+0x243 usb_process(c7431b24,ed342d28,c0ef1110,3a5,c7421580,...) at usb_process+0x193 fork_exit(c08ac1b0,c7431b24,ed342d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed342d60, ebp = 0 --- Tracing command usb pid 15 tid 100047 td 0xc742db80 sched_switch(c742db80,0,104,191,77176b49,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c742db80,0,c0efbf60,268,c742db80,...) at sleepq_switch+0x162 sleepq_wait(c7431afc,0,ed33fcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7431afc,c7431bfc,c0ed093e,6b,c7431b04,...) at _cv_wait+0x243 usb_process(c7431af4,ed33fd28,c0ef1110,3a5,c7421580,...) at usb_process+0x193 fork_exit(c08ac1b0,c7431af4,ed33fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed33fd60, ebp = 0 --- Tracing command usb pid 15 tid 100046 td 0xc742e000 sched_switch(c742e000,0,104,191,771759e2,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c742e000,0,c0efbf60,268,c742e000,...) at sleepq_switch+0x162 sleepq_wait(c7431acc,0,ed33ccac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7431acc,c7431bfc,c0ed093e,6b,c7431ad4,...) at _cv_wait+0x243 usb_process(c7431ac4,ed33cd28,c0ef1110,3a5,c7421580,...) at usb_process+0x193 fork_exit(c08ac1b0,c7431ac4,ed33cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed33cd60, ebp = 0 --- Tracing command usb pid 15 tid 100045 td 0xc742e2e0 sched_switch(c742e2e0,0,104,191,77174661,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c742e2e0,0,c0efbf60,268,c742e2e0,...) at sleepq_switch+0x162 sleepq_wait(c7428b5c,0,ed339cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7428b5c,c7428bfc,c0ed093e,6b,c7428b64,...) at _cv_wait+0x243 usb_process(c7428b54,ed339d28,c0ef1110,3a5,c7421580,...) at usb_process+0x193 fork_exit(c08ac1b0,c7428b54,ed339d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed339d60, ebp = 0 --- Tracing command usb pid 15 tid 100044 td 0xc742e5c0 sched_switch(c742e5c0,0,104,191,5b087340,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c742e5c0,0,c0efbf60,268,c742e5c0,...) at sleepq_switch+0x162 sleepq_wait(c7428b2c,0,ed336cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7428b2c,c7428bfc,c0ed093e,6b,c7428b34,...) at _cv_wait+0x243 usb_process(c7428b24,ed336d28,c0ef1110,3a5,c7421580,...) at usb_process+0x193 fork_exit(c08ac1b0,c7428b24,ed336d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed336d60, ebp = 0 --- Tracing command usb pid 15 tid 100043 td 0xc742e8a0 sched_switch(c742e8a0,0,104,191,76b2e77e,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c742e8a0,0,c0efbf60,268,c742e8a0,...) at sleepq_switch+0x162 sleepq_wait(c7428afc,0,ed333cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7428afc,c7428bfc,c0ed093e,6b,c7428b04,...) at _cv_wait+0x243 usb_process(c7428af4,ed333d28,c0ef1110,3a5,c7421580,...) at usb_process+0x193 fork_exit(c08ac1b0,c7428af4,ed333d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed333d60, ebp = 0 --- Tracing command usb pid 15 tid 100042 td 0xc742eb80 sched_switch(c742eb80,0,104,191,76b2d35e,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c742eb80,0,c0efbf60,268,c742eb80,...) at sleepq_switch+0x162 sleepq_wait(c7428acc,0,e0ffdcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7428acc,c7428bfc,c0ed093e,6b,c7428ad4,...) at _cv_wait+0x243 usb_process(c7428ac4,e0ffdd28,c0ef1110,3a5,c7421580,...) at usb_process+0x193 fork_exit(c08ac1b0,c7428ac4,e0ffdd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0ffdd60, ebp = 0 --- Tracing command usb pid 15 tid 100040 td 0xc741c000 sched_switch(c741c000,0,104,191,76b2bdd6,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c741c000,0,c0efbf60,268,c741c000,...) at sleepq_switch+0x162 sleepq_wait(c7422b5c,0,e0ff6cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7422b5c,c7422bfc,c0ed093e,6b,c7422b64,...) at _cv_wait+0x243 usb_process(c7422b54,e0ff6d28,c0ef1110,3a5,c7421580,...) at usb_process+0x193 fork_exit(c08ac1b0,c7422b54,e0ff6d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0ff6d60, ebp = 0 --- Tracing command usb pid 15 tid 100039 td 0xc741c2e0 sched_switch(c741c2e0,0,104,191,5b079309,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c741c2e0,0,c0efbf60,268,c741c2e0,...) at sleepq_switch+0x162 sleepq_wait(c7422b2c,0,e0ff3cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7422b2c,c7422bfc,c0ed093e,6b,c7422b34,...) at _cv_wait+0x243 usb_process(c7422b24,e0ff3d28,c0ef1110,3a5,c7421580,...) at usb_process+0x193 fork_exit(c08ac1b0,c7422b24,e0ff3d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0ff3d60, ebp = 0 --- Tracing command usb pid 15 tid 100038 td 0xc741c5c0 sched_switch(c741c5c0,0,104,191,764ea46b,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c741c5c0,0,c0efbf60,268,c741c5c0,...) at sleepq_switch+0x162 sleepq_wait(c7422afc,0,e0ff0cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7422afc,c7422bfc,c0ed093e,6b,c7422b04,...) at _cv_wait+0x243 usb_process(c7422af4,e0ff0d28,c0ef1110,3a5,c7421580,...) at usb_process+0x193 fork_exit(c08ac1b0,c7422af4,e0ff0d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0ff0d60, ebp = 0 --- Tracing command usb pid 15 tid 100037 td 0xc741c8a0 sched_switch(c741c8a0,0,104,191,764e924d,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c741c8a0,0,c0efbf60,268,c741c8a0,...) at sleepq_switch+0x162 sleepq_wait(c7422acc,0,e0fedcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7422acc,c7422bfc,c0ed093e,6b,c7422ad4,...) at _cv_wait+0x243 usb_process(c7422ac4,e0fedd28,c0ef1110,3a5,c7421580,...) at usb_process+0x193 fork_exit(c08ac1b0,c7422ac4,e0fedd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0fedd60, ebp = 0 --- Tracing command usb pid 15 tid 100035 td 0xc741e000 sched_switch(c741e000,0,104,191,764e7cc9,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c741e000,0,c0efbf60,268,c741e000,...) at sleepq_switch+0x162 sleepq_wait(c7416b5c,0,e0fe6cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7416b5c,c7416bfc,c0ed093e,6b,c7416b64,...) at _cv_wait+0x243 usb_process(c7416b54,e0fe6d28,c0ef1110,3a5,c7421580,...) at usb_process+0x193 fork_exit(c08ac1b0,c7416b54,e0fe6d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0fe6d60, ebp = 0 --- Tracing command usb pid 15 tid 100034 td 0xc741e2e0 sched_switch(c741e2e0,0,104,191,5b06c2fa,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c741e2e0,0,c0efbf60,268,c741e2e0,...) at sleepq_switch+0x162 sleepq_wait(c7416b2c,0,e0fe3cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7416b2c,c7416bfc,c0ed093e,6b,c7416b34,...) at _cv_wait+0x243 usb_process(c7416b24,e0fe3d28,c0ef1110,3a5,c7421580,...) at usb_process+0x193 fork_exit(c08ac1b0,c7416b24,e0fe3d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0fe3d60, ebp = 0 --- Tracing command usb pid 15 tid 100033 td 0xc741e5c0 sched_switch(c741e5c0,0,104,191,75ea242d,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c741e5c0,0,c0efbf60,268,c741e5c0,...) at sleepq_switch+0x162 sleepq_wait(c7416afc,0,e0fe0cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7416afc,c7416bfc,c0ed093e,6b,c7416b04,...) at _cv_wait+0x243 usb_process(c7416af4,e0fe0d28,c0ef1110,3a5,c7421580,...) at usb_process+0x193 fork_exit(c08ac1b0,c7416af4,e0fe0d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0fe0d60, ebp = 0 --- Tracing command usb pid 15 tid 100032 td 0xc741e8a0 sched_switch(c741e8a0,0,104,191,75ea0fbc,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c741e8a0,0,c0efbf60,268,c741e8a0,...) at sleepq_switch+0x162 sleepq_wait(c7416acc,0,e0fddcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7416acc,c7416bfc,c0ed093e,6b,c7416ad4,...) at _cv_wait+0x243 usb_process(c7416ac4,e0fddd28,c0ef1110,3a5,c7421580,...) at usb_process+0x193 fork_exit(c08ac1b0,c7416ac4,e0fddd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0fddd60, ebp = 0 --- Tracing command yarrow pid 14 tid 100017 td 0xc72c15c0 sched_switch(c72c15c0,0,104,191,7e50dda9,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c72c15c0,0,c0efbf60,28b,2,...) at sleepq_switch+0x162 sleepq_timedwait(c1090e84,0,c0ee9792,2,0,...) at sleepq_timedwait+0x6b _sleep(c1090e84,0,0,c0ee9792,64,...) at _sleep+0x342 pause(c0ee9792,64,c0eb05ce,111,0,...) at pause+0x47 random_kthread(0,c6f62d28,c0ef1110,3a5,c71b7000,...) at random_kthread+0x1ef fork_exit(c07c6210,0,c6f62d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f62d60, ebp = 0 --- Tracing command geom pid 13 tid 100015 td 0xc72c1b80 sched_switch(c72c1b80,0,104,191,8610f009,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,5c,...) at mi_switch+0x1eb sleepq_switch(c72c1b80,0,c0efbf60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c108eaa8,5c,c0ee9792,0,0,...) at sleepq_wait+0x63 _sleep(c108eaa8,c108ea08,25c,c0ee9792,0,...) at _sleep+0x372 g_io_schedule_down(c72c1b80,0,c0eeb2d9,6c,c6f5cd14,...) at g_io_schedule_down+0x5b g_down_procbody(0,c6f5cd28,c0ef1110,3a5,c71b72c0,...) at g_down_procbody+0x9d fork_exit(c099c130,0,c6f5cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f5cd60, ebp = 0 --- Tracing command geom pid 13 tid 100014 td 0xc72c2000 sched_switch(c72c2000,0,104,191,8a487dd3,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,5c,...) at mi_switch+0x1eb sleepq_switch(c72c2000,0,c0efbf60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c108eaa4,5c,c0ee9792,0,0,...) at sleepq_wait+0x63 _sleep(c108eaa4,c108ea28,25c,c0ee9792,0,...) at _sleep+0x372 g_io_schedule_up(c72c2000,0,c0eeb2d9,5f,c6f59d14,...) at g_io_schedule_up+0x134 g_up_procbody(0,c6f59d28,c0ef1110,3a5,c71b72c0,...) at g_up_procbody+0x9d fork_exit(c099c1d0,0,c6f59d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f59d60, ebp = 0 --- Tracing command geom pid 13 tid 100013 td 0xc71bc2e0 sched_switch(c71bc2e0,0,104,191,772b92c6,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,5c,...) at mi_switch+0x1eb sleepq_switch(c71bc2e0,0,c0efbf60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c108ea9c,5c,c0ee9792,0,0,...) at sleepq_wait+0x63 _sleep(c108ea9c,c108e9cc,25c,c0ee9792,0,...) at _sleep+0x372 g_run_events(c109ed00,0,c0eeb2d9,79,c6f56d14,...) at g_run_events+0x526 g_event_procbody(0,c6f56d28,c0ef1110,3a5,c71b72c0,...) at g_event_procbody+0x90 fork_exit(c099c270,0,c6f56d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f56d60, ebp = 0 --- Tracing command intr pid 12 tid 100066 td 0xc755a8a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100065 td 0xc755ab80 sched_switch(c755ab80,0,109,191,75e4e30f,...) at sched_switch+0x3bc mi_switch(109,0,c0ef1433,554,c755ab80,...) at mi_switch+0x1eb ithread_loop(c7551900,ed38dd28,c0ef1110,3a5,c71b7580,...) at ithread_loop+0x1fb fork_exit(c09dd510,c7551900,ed38dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed38dd60, ebp = 0 --- Tracing command intr pid 12 tid 100063 td 0xc742f2e0 sched_switch(c742f2e0,0,109,191,619413b3,...) at sched_switch+0x3bc mi_switch(109,0,c0ef1433,554,c742f2e0,...) at mi_switch+0x1eb ithread_loop(c754f9b0,ed37dd28,c0ef1110,3a5,c71b7580,...) at ithread_loop+0x1fb fork_exit(c09dd510,c754f9b0,ed37dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed37dd60, ebp = 0 --- Tracing command intr pid 12 tid 100060 td 0xc742fb80 sched_switch(c742fb80,0,109,191,6b8b069e,...) at sched_switch+0x3bc mi_switch(109,0,c0ef1433,554,c742fb80,...) at mi_switch+0x1eb ithread_loop(c7418990,ed371d28,c0ef1110,3a5,c71b7580,...) at ithread_loop+0x1fb fork_exit(c09dd510,c7418990,ed371d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed371d60, ebp = 0 --- Tracing command intr pid 12 tid 100059 td 0xc743b000 sched_switch(c743b000,0,109,191,91c176ca,...) at sched_switch+0x3bc mi_switch(109,0,c0ef1433,554,c743b000,...) at mi_switch+0x1eb ithread_loop(c7418110,ed369d28,c0ef1110,3a5,c71b7580,...) at ithread_loop+0x1fb fork_exit(c09dd510,c7418110,ed369d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed369d60, ebp = 0 --- Tracing command intr pid 12 tid 100054 td 0xc743e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xc742f000 sched_switch(c742f000,0,109,191,9a8daeeb,...) at sched_switch+0x3bc mi_switch(109,0,c0ef1433,554,c742f000,...) at mi_switch+0x1eb ithread_loop(c7401820,e0ffad28,c0ef1110,3a5,c71b7580,...) at ithread_loop+0x1fb fork_exit(c09dd510,c7401820,e0ffad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0ffad60, ebp = 0 --- Tracing command intr pid 12 tid 100036 td 0xc741cb80 sched_switch(c741cb80,0,109,191,9567375e,...) at sched_switch+0x3bc mi_switch(109,0,c0ef1433,554,c741cb80,...) at mi_switch+0x1eb ithread_loop(c7401a50,e0fead28,c0ef1110,3a5,c71b7580,...) at ithread_loop+0x1fb fork_exit(c09dd510,c7401a50,e0fead28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0fead60, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xc741eb80 sched_switch(c741eb80,0,109,191,393ac516,...) at sched_switch+0x3bc mi_switch(109,0,c0ef1433,554,c741eb80,...) at mi_switch+0x1eb ithread_loop(c7418040,e0fdad28,c0ef1110,3a5,c71b7580,...) at ithread_loop+0x1fb fork_exit(c09dd510,c7418040,e0fdad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0fdad60, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc72c22e0 sched_switch(c72c22e0,0,109,191,88c075aa,...) at sched_switch+0x3bc mi_switch(109,0,c0ef1433,554,c72c22e0,...) at mi_switch+0x1eb ithread_loop(c7401240,e0e84d28,c0ef1110,3a5,c71b7580,...) at ithread_loop+0x1fb fork_exit(c09dd510,c7401240,e0e84d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0e84d60, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc72c25c0 sched_switch(c72c25c0,0,109,191,86102058,...) at sched_switch+0x3bc mi_switch(109,0,c0ef1433,554,c72c25c0,...) at mi_switch+0x1eb ithread_loop(c74013e0,e0e80d28,c0ef1110,3a5,c71b7580,...) at ithread_loop+0x1fb fork_exit(c09dd510,c74013e0,e0e80d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0e80d60, ebp = 0 --- Tracing command intr pid 12 tid 100028 td 0xc72c28a0 sched_switch(c72c28a0,0,109,191,6c2d0e96,...) at sched_switch+0x3bc mi_switch(109,0,c0ef1433,554,c72c28a0,...) at mi_switch+0x1eb ithread_loop(c73e8910,c6fb1d28,c0ef1110,3a5,c71b7580,...) at ithread_loop+0x1fb fork_exit(c09dd510,c73e8910,c6fb1d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6fb1d60, ebp = 0 --- Tracing command intr pid 12 tid 100027 td 0xc72c2b80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100026 td 0xc739f000 sched_switch(c739f000,0,109,191,88c0fff9,...) at sched_switch+0x3bc mi_switch(109,0,c0ef1433,554,c739f000,...) at mi_switch+0x1eb ithread_loop(c71914a0,c6f7dd28,c0ef1110,3a5,c71b7580,...) at ithread_loop+0x1fb fork_exit(c09dd510,c71914a0,c6f7dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f7dd60, ebp = 0 --- Tracing command intr pid 12 tid 100021 td 0xc72008a0 sched_switch(c72008a0,0,109,191,3a324ce4,...) at sched_switch+0x3bc mi_switch(109,0,c0ef1433,554,c72008a0,...) at mi_switch+0x1eb ithread_loop(c71914b0,c6f6ed28,c0ef1110,3a5,c71b7580,...) at ithread_loop+0x1fb fork_exit(c09dd510,c71914b0,c6f6ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f6ed60, ebp = 0 --- Tracing command intr pid 12 tid 100019 td 0xc72c1000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100012 td 0xc71bc5c0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100011 td 0xc71bc8a0 sched_switch(c71bc8a0,0,109,191,8625b08a,...) at sched_switch+0x3bc mi_switch(109,0,c0ef1433,554,c71bc8a0,...) at mi_switch+0x1eb ithread_loop(c7191700,c6f50d28,c0ef1110,3a5,c71b7580,...) at ithread_loop+0x1fb fork_exit(c09dd510,c7191700,c6f50d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f50d60, ebp = 0 --- Tracing command intr pid 12 tid 100010 td 0xc71bcb80 sched_switch(c71bcb80,0,109,191,53668654,...) at sched_switch+0x3bc mi_switch(109,0,c0ef1433,554,c71bcb80,...) at mi_switch+0x1eb ithread_loop(c7191710,c6f4dd28,c0ef1110,3a5,c71b7580,...) at ithread_loop+0x1fb fork_exit(c09dd510,c7191710,c6f4dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f4dd60, ebp = 0 --- Tracing command intr pid 12 tid 100009 td 0xc7200000 sched_switch(c7200000,0,109,191,860a4322,...) at sched_switch+0x3bc mi_switch(109,0,c0ef1433,554,c7200000,...) at mi_switch+0x1eb ithread_loop(c7191720,c6f4ad28,c0ef1110,3a5,c71b7580,...) at ithread_loop+0x1fb fork_exit(c09dd510,c7191720,c6f4ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f4ad60, ebp = 0 --- Tracing command intr pid 12 tid 100008 td 0xc72002e0 sched_switch(c72002e0,0,109,191,8bd11a8f,...) at sched_switch+0x3bc mi_switch(109,0,c0ef1433,554,c72002e0,...) at mi_switch+0x1eb ithread_loop(c7191730,c6f47d28,c0ef1110,3a5,c71b7580,...) at ithread_loop+0x1fb fork_exit(c09dd510,c7191730,c6f47d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f47d60, ebp = 0 --- Tracing command intr pid 12 tid 100007 td 0xc72005c0 sched_switch(c72005c0,0,109,191,88c0e3f4,...) at sched_switch+0x3bc mi_switch(109,0,c0ef1433,554,c72005c0,...) at mi_switch+0x1eb ithread_loop(c7191740,c6f44d28,c0ef1110,3a5,c71b7580,...) at ithread_loop+0x1fb fork_exit(c09dd510,c7191740,c6f44d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f44d60, ebp = 0 --- Tracing command idle pid 11 tid 100006 td 0xc71b9000 sched_switch(c71b9000,0,108,18c,140f60ec,...) at sched_switch+0x3bc mi_switch(108,0,c0ef87cb,3b9,c71b9000,...) at mi_switch+0x1eb sched_idletd(0,c6f40d28,c0ef1110,3a5,c71b7840,...) at sched_idletd+0x19f fork_exit(c0a2c530,0,c6f40d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f40d60, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc71b92e0 cpustop_handler(2,13,c6f3dbf8,c0d39026,c6f3db78,...) at cpustop_handler+0x28 ipi_nmi_handler(c6f3db78,46,c6f2ac80,c6f3db94,c71b7840,...) at ipi_nmi_handler+0x47 trap(c6f3dc04) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0a2dd42, esp = 0xc6f3dc44, ebp = 0xc6f3dc70 --- sched_switch(c71b92e0,0,108,18c,8d58ee36,...) at sched_switch+0x352 mi_switch(108,0,c0ef87cb,3b9,c71b92e0,...) at mi_switch+0x1eb sched_idletd(0,c6f3dd28,c0ef1110,3a5,c71b7840,...) at sched_idletd+0x19f fork_exit(c0a2c530,0,c6f3dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f3dd60, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc71b95c0 cpustop_handler(1,13,c6f3aba0,c0d39026,c71b95c0,...) at cpustop_handler+0x28 ipi_nmi_handler(c71b95c0,182dc,c123ddcc,c6f3ab78,c71b7840,...) at ipi_nmi_handler+0x47 trap(c6f3abac) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0a0d76d, esp = 0xc6f3abec, ebp = 0xc6f3abf0 --- runq_choose(c109f3b0,4,c0ef87cb,4c1,c71b9870,...) at runq_choose+0xd tdq_choose(c109f380,4,c0ef87cb,8b6,1,...) at tdq_choose+0x34 sched_choose(c6f3ac70,c0a2dd5f,c109f380,14,c0ef87cb,...) at sched_choose+0x4b choosethread(c109f380,14,c0ef87cb,721,c109f380,...) at choosethread+0x8 sched_switch(c71b95c0,0,108,18c,8d58ebce,...) at sched_switch+0x36f mi_switch(108,0,c0ef87cb,3b9,c71b95c0,...) at mi_switch+0x1eb sched_idletd(0,c6f3ad28,c0ef1110,3a5,c71b7840,...) at sched_idletd+0x19f fork_exit(c0a2c530,0,c6f3ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f3ad60, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xc71b98a0 sched_switch(c71b98a0,0,108,18c,9ed2d2bd,...) at sched_switch+0x3bc mi_switch(108,0,c0ef87cb,3b9,c71b98a0,...) at mi_switch+0x1eb sched_idletd(0,c6f37d28,c0ef1110,3a5,c71b7840,...) at sched_idletd+0x19f fork_exit(c0a2c530,0,c6f37d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f37d60, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc71b9b80 sched_switch(c71b9b80,0,104,191,d490283f,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c71b9b80,0,c0efbf60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0efbf60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c71b7b00,6c,c0efed7a,100,0,...) at sleepq_wait_sig+0x17 _sleep(c71b7b00,c71b7b88,16c,c0efed7a,0,...) at _sleep+0x35c kern_wait(c71b9b80,ffffffff,c6f33c44,0,0,...) at kern_wait+0xb96 wait4(c71b9b80,c6f33cec,c6f33d28,c0efc8ea,0,...) at wait4+0x3b syscallenter(c71b9b80,c6f33ce4,c6f33ce4,0,0,...) at syscallenter+0x263 syscall(c6f33d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x8060df7, esp = 0xbfbfe8bc, ebp = 0xbfbfe8d8 --- Tracing command audit pid 10 tid 100001 td 0xc71bc000 sched_switch(c71bc000,0,104,191,75e780c1,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c71bc000,0,c0efbf60,268,c71bc000,...) at sleepq_switch+0x162 sleepq_wait(c120e080,0,c6f30c8c,1,0,...) at sleepq_wait+0x63 _cv_wait(c120e080,c120e064,c0f269b7,194,0,...) at _cv_wait+0x243 audit_worker(0,c6f30d28,c0ef1110,3a5,c71b8000,...) at audit_worker+0x84 fork_exit(c0bfdab0,0,c6f30d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f30d60, ebp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xc7827b80 sched_switch(c7827b80,0,104,191,d998c91c,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7827b80,0,c0efbf60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c77fc080,0,c0ee9792,0,0,...) at sleepq_wait+0x63 _sleep(c77fc080,c77fc098,0,c0ee9792,0,...) at _sleep+0x372 taskqueue_thread_loop(c1270420,f17e9d28,c0ef1110,3a5,c108eb80,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a491e0,c1270420,f17e9d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf17e9d60, ebp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xc755a5c0 sched_switch(c755a5c0,0,104,191,3b44c6b7,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c755a5c0,0,c0efbf60,28b,2,...) at sleepq_switch+0x162 sleepq_timedwait(c1090e84,0,c0ee9792,2,0,...) at sleepq_timedwait+0x6b _sleep(c1090e84,0,0,c0ee9792,bb8,...) at _sleep+0x342 pause(c0ee9792,bb8,124,122,c108ec08,...) at pause+0x47 deadlkres(0,ed393d28,c0ef1110,3a5,c108eb80,...) at deadlkres+0x324 fork_exit(c09bdb60,0,ed393d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed393d60, ebp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xc742f8a0 sched_switch(c742f8a0,0,104,191,8a4987b6,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c742f8a0,0,c0efbf60,268,c72002e0,...) at sleepq_switch+0x162 sleepq_wait(c719c900,0,c0ef7521,c0ee9792,0,...) at sleepq_wait+0x63 msleep_spin(c719c900,c719c918,c0ee9792,0,c0ef4da7,...) at msleep_spin+0x21d taskqueue_thread_loop(c746549c,ed377d28,c0ef1110,3a5,c108eb80,...) at taskqueue_thread_loop+0x8f fork_exit(c0a491e0,c746549c,ed377d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed377d60, ebp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xc739f2e0 sched_switch(c739f2e0,0,104,191,903bfa8e,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c739f2e0,0,c0efbf60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c719ccc0,0,c0ef7521,c0ee9792,0,...) at sleepq_wait+0x63 msleep_spin(c719ccc0,c719ccd8,c0ee9792,0,c0ef4da7,...) at msleep_spin+0x21d taskqueue_thread_loop(c1059cb8,c6f7ad28,c0ef1110,3a5,c108eb80,...) at taskqueue_thread_loop+0x8f fork_exit(c0a491e0,c1059cb8,c6f7ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f7ad60, ebp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xc739f5c0 sched_switch(c739f5c0,0,104,191,903bebeb,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c739f5c0,0,c0efbf60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c719ccc0,0,c0ef7521,c0ee9792,0,...) at sleepq_wait+0x63 msleep_spin(c719ccc0,c719ccd8,c0ee9792,0,c0ef4da7,...) at msleep_spin+0x21d taskqueue_thread_loop(c1059cb8,c6f77d28,c0ef1110,3a5,c108eb80,...) at taskqueue_thread_loop+0x8f fork_exit(c0a491e0,c1059cb8,c6f77d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f77d60, ebp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xc739f8a0 sched_switch(c739f8a0,0,104,191,903bdc69,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c739f8a0,0,c0efbf60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c719ccc0,0,c0ef7521,c0ee9792,0,...) at sleepq_wait+0x63 msleep_spin(c719ccc0,c719ccd8,c0ee9792,0,c0ef4da7,...) at msleep_spin+0x21d taskqueue_thread_loop(c1059cb8,c6f74d28,c0ef1110,3a5,c108eb80,...) at taskqueue_thread_loop+0x8f fork_exit(c0a491e0,c1059cb8,c6f74d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f74d60, ebp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xc739fb80 sched_switch(c739fb80,0,104,191,90355c2b,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c739fb80,0,c0efbf60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c719cd00,0,c0ee9792,0,0,...) at sleepq_wait+0x63 _sleep(c719cd00,c719cd18,0,c0ee9792,0,...) at _sleep+0x372 taskqueue_thread_loop(c108f518,c6f71d28,c0ef1110,3a5,c108eb80,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a491e0,c108f518,c6f71d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f71d60, ebp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xc7200b80 sched_switch(c7200b80,0,104,191,90354bb6,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7200b80,0,c0efbf60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c719cd80,0,c0ee9792,0,0,...) at sleepq_wait+0x63 _sleep(c719cd80,c719cd98,0,c0ee9792,0,...) at _sleep+0x372 taskqueue_thread_loop(c120e664,c6f6bd28,c0ef1110,3a5,c108eb80,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a491e0,c120e664,c6f6bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f6bd60, ebp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xc72c12e0 sched_switch(c72c12e0,0,104,191,46b67ef7,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c72c12e0,0,c0efbf60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c719ce00,0,c0ee9792,0,0,...) at sleepq_wait+0x63 _sleep(c719ce00,c719ce18,0,c0ee9792,0,...) at _sleep+0x372 taskqueue_thread_loop(c10ada88,c6f65d28,c0ef1110,3a5,c108eb80,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a491e0,c10ada88,c6f65d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f65d60, ebp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xc72c18a0 sched_switch(c72c18a0,0,104,191,a8eae610,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c72c18a0,0,c0efbf60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c719ce40,0,c0ee9792,0,0,...) at sleepq_wait+0x63 _sleep(c719ce40,c719ce58,0,c0ee9792,0,...) at _sleep+0x372 taskqueue_thread_loop(c10ac4a0,c6f5fd28,c0ef1110,3a5,c108eb80,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a491e0,c10ac4a0,c6f5fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f5fd60, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc108ee40 sched_switch(c108ee40,0,104,191,c6c0962c,...) at sched_switch+0x3bc mi_switch(104,0,c0efbf60,1f3,54,...) at mi_switch+0x1eb sleepq_switch(c108ee40,0,c0efbf60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c108eb80,54,c0ef90dd,0,0,...) at sleepq_timedwait+0x6b _sleep(c108eb80,0,54,c0ef90dd,2710,...) at _sleep+0x342 scheduler(0,181ec00,181ec00,181e000,1825000,...) at scheduler+0x240 mi_startup() at mi_startup+0xac begin() at begin+0x2c db:0:allt> call doadump Physical memory: 3435 MB Physical memory: 3435 MB Dumping 176 MB:Dumping 176 MB: $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/fs/nfsclient/nfsnode.h =================================================================== --- /usr/src/sys/fs/nfsclient/nfsnode.h (revision 224282) +++ /usr/src/sys/fs/nfsclient/nfsnode.h (working copy) @@ -35,11 +35,14 @@ #ifndef _NFSCLIENT_NFSNODE_H_ #define _NFSCLIENT_NFSNODE_H_ +#include + /* * Silly rename structure that hangs off the nfsnode until the name * can be removed by nfs_inactive() */ struct sillyrename { + struct task s_task; struct ucred *s_cred; struct vnode *s_dvp; long s_namlen; Index: /usr/src/sys/fs/nfsclient/nfs_clnode.c =================================================================== --- /usr/src/sys/fs/nfsclient/nfs_clnode.c (revision 224282) +++ /usr/src/sys/fs/nfsclient/nfs_clnode.c (working copy) @@ -47,6 +47,7 @@ __FBSDID("$FreeBSD$"); #include #include #include +#include #include #include @@ -65,6 +66,8 @@ MALLOC_DECLARE(M_NEWNFSREQ); uma_zone_t newnfsnode_zone; +static void nfs_freesillyrename(void *arg, __unused int pending); + void ncl_nhinit(void) { @@ -186,6 +189,20 @@ ncl_nget(struct mount *mntp, u_int8_t *fhp, int fh return (0); } +/* + * Do the vrele(sp->s_dvp) as a separate task in order to avoid a + * deadlock because of a LOR when vrele() locks the directory vnode. + */ +static void +nfs_freesillyrename(void *arg, __unused int pending) +{ + struct sillyrename *sp; + + sp = arg; + vrele(sp->s_dvp); + free(sp, M_NEWNFSREQ); +} + int ncl_inactive(struct vop_inactive_args *ap) { @@ -220,8 +237,8 @@ ncl_inactive(struct vop_inactive_args *ap) */ ncl_removeit(sp, vp); crfree(sp->s_cred); - vrele(sp->s_dvp); - FREE((caddr_t)sp, M_NEWNFSREQ); + TASK_INIT(&sp->s_task, 0, nfs_freesillyrename, sp); + taskqueue_enqueue(taskqueue_thread, &sp->s_task); mtx_lock(&np->n_mtx); } np->n_flag &= NMODIFIED; -- Test scenario: nfsrename.sh + VM pressure.