GENERIC HEAD from 2012-02-22 20:01:38 UTC, r232002M, vmcore.293 KDB: debugger backends: ddb KDB: current backend: ddb 524288K of memory above 4GB ignored Copyright (c) 1992-2012 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #0 r232002M: Fri Feb 24 17:16:56 CET 2012 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.01-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 10 Model = 2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 4294967296 (4096 MB) avail memory = 3531640832 (3368 MB) : Trying to mount root from ufs:/dev/ad4s1a [rw]... Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/ad4s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1a: clean, 116781 free (1373 frags, 14426 blocks, 0.1% fragmentation) /dev/ad4s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1f: clean, 143606 free (4766 frags, 17355 blocks, 0.5% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 116403150 free (2238 frags, 14550114 blocks, 0.0% fragmentation) /dev/ad4s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1d: clean, 3912729 free (266809 frags, 455740 blocks, 2.6% fragmentation) /dev/ad4s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1e: clean, 11111280 free (45840 frags, 1383180 blocks, 0.2% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN re0: link state changed to UP Starting Network: lo0 re0 fwe0 fwip0. lo0: flags=8049 metric 0 mtu 16384 options=3 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0xa inet 127.0.0.1 netmask 0xff000000 nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 scopeid 0x1 nd6 options=29 media: Ethernet autoselect (100baseTX ) status: active fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 Starting devd. Starting Network: fwe0. fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 Starting Network: fwip0. fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/kde4/lib /usr/local/lib/compat /usr/local/lib/gcc46 /usr/local/lib/qt4 /usr/local/lib/virtualbox a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. No core dumps found. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered lock order reversal: 1st 0xe191e020 bufwait (bufwait) @ kern/vfs_bio.c:2658 2nd 0xca7e0800 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper(c0f92573,2e687361,38323a63,a34,f271f7e8,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a9645b,c0f96040,c1274f78,11c,f271f878,...) at kdb_backtrace+0x2a _witness_debugger(c0f96040,ca7e0800,c0fc61da,c7d79678,c0fc5e6c,...) at _witness_debugger+0x25 witness_checkorder(ca7e0800,9,c0fc5e63,11c,0,...) at witness_checkorder+0x86f _sx_xlock(ca7e0800,0,c0fc5e63,11c,cab3f000,...) at _sx_xlock+0xa0 ufsdirhash_acquire(e191dfc0,cab3f000,f271f9f4,e23ea64c,f271f948,...) at ufsdirhash_acquire+0x48 ufsdirhash_add(cab3f000,f271f9f4,264c,f271f934,f271f938,...) at ufsdirhash_add+0x13 ufs_direnter(cab30984,cacf0ae0,f271f9f4,f271fb84,e191e640,...) at ufs_direnter+0x7a9 ufs_mkdir(f271fc14,c0fe7445,0,0,f271fbac,...) at ufs_mkdir+0xa6f VOP_MKDIR_APV(c10de2e0,f271fc14,f271fb84,f271fbac,0,...) at VOP_MKDIR_APV+0xc5 kern_mkdirat(ca82ab80,ffffff9c,28404020,0,1c0,...) at kern_mkdirat+0x291 kern_mkdir(ca82ab80,28404020,0,1c0,f271fd1c,...) at kern_mkdir+0x2e sys_mkdir(ca82ab80,f271fcec,c0fe02ca,c0f96d4e,202,...) at sys_mkdir+0x29 syscall(f271fd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x2817fba3, esp = 0xbfbfe8cc, ebp = 0xbfbfed78 --- Clearing /tmp (X related). lock order reversal: 1st 0xcab6d310 ufs (ufs) @ kern/vfs_subr.c:2167 2nd 0xe190b040 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:260 3rd 0xcacefb38 ufs (ufs) @ kern/vfs_subr.c:2167 KDB: stack backtrace: db_trace_self_wrapper(c0f92573,3a632e73,a303632,0,0,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a9645b,c0f96059,c1274f58,877,f270b33c,...) at kdb_backtrace+0x2a _witness_debugger(c0f96059,cacefb38,c0f84b37,c7d79610,c0f9e015,...) at _witness_debugger+0x25 witness_checkorder(cacefb38,9,c0f9e00c,877,0,...) at witness_checkorder+0x86f __lockmgr_args(cacefb38,80100,cacefba4,0,0,...) at __lockmgr_args+0x834 ffs_lock(f270b460,60,0,80100,cacefae0,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10de2e0,f270b460,c7d721e0,c10ef300,cacefae0,...) at VOP_LOCK1_APV+0xb5 _vn_lock(cacefae0,80100,c0f9e00c,877,4,...) at _vn_lock+0x78 vget(cacefae0,80100,ca82b8a0,50,0,...) at vget+0xbb vfs_hash_get(cab5087c,1a98fa,80000,ca82b8a0,f270b5a4,...) at vfs_hash_get+0xed ffs_vgetf(cab5087c,1a98fa,80000,f270b5a4,1,...) at ffs_vgetf+0x49 softdep_sync_buf(cab6d2b8,e190afe0,1,106,0,...) at softdep_sync_buf+0xac9 ffs_syncvnode(cab6d2b8,1,c1274f48,cab6d3b0,c7d75370,...) at ffs_syncvnode+0x24c ffs_truncate(cab6d2b8,200,0,880,c7dc4e80,...) at ffs_truncate+0x827 ufs_direnter(cab6d2b8,cacefae0,f270b918,f270bbc0,0,...) at ufs_direnter+0x9a1 ufs_makeinode(f270bbc0,c10de860,f270bb04,f270ba60,c0de5455,...) at ufs_makeinode+0x65d ufs_create(f270bb04,c0fe760b,0,0,f270bb80,...) at ufs_create+0x30 VOP_CREATE_APV(c10de2e0,f270bb04,f270bbc0,f270ba9c,0,...) at VOP_CREATE_APV+0xc5 vn_open_cred(f270bb80,f270bc48,1a4,0,c7dc4e80,...) at vn_open_cred+0x205 vn_open(f270bb80,f270bc48,1a4,ca842230,1ff,...) at vn_open+0x3b kern_openat(ca82b8a0,ffffff9c,2842d604,0,602,...) at kern_openat+0x1ec kern_open(ca82b8a0,2842d604,0,601,1b6,...) at kern_open+0x35 sys_open(ca82b8a0,f270bcec,c0fe02ca,c0f96ef3,246,...) at sys_open+0x30 syscall(f270bd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x28201203, esp = 0xbfbfdc3c, ebp = 0xbfbfdcf8 --- Starting mountd. Feb 24 17:30:37 x4 mountd[1009]: can't delete exports for /dev: Invalid argument mount option is unknown Starting nfsuserd. Starting nfsd. Recovering vi editor sessions:. Updating motd:. Starting ntpd. Starting default moused. Expensive timeout(9) function: 0xc089c160(0xc12d4de0) 0.012805538 s Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Local package initialization: backuplock order reversal: 1st 0xcab33310 ufs (ufs) @ kern/vfs_mount.c:1249 2nd 0xcab3046c devfs (devfs) @ ufs/ffs/ffs_softdep.c:1835 KDB: stack backtrace: db_trace_self_wrapper(c0f92573,38313a63,a3533,c0aa8a4c,8,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a9645b,c0f96040,c12746b0,72b,f27529a0,...) at kdb_backtrace+0x2a _witness_debugger(c0f96040,cab3046c,c0f7ca67,c7d79470,c0fc22e6,...) at _witness_debugger+0x25 witness_checkorder(cab3046c,9,c0fc22dd,72b,cab304d8,...) at witness_checkorder+0x86f __lockmgr_args(cab3046c,80400,cab304d8,0,0,...) at __lockmgr_args+0x834 vop_stdlock(f2752ac0,4,c0f8c94f,80400,cab30414,...) at vop_stdlock+0x65 VOP_LOCK1_APV(c10b3e40,f2752ac0,c12a8500,c10ef300,cab30414,...) at VOP_LOCK1_APV+0xb5 _vn_lock(cab30414,80400,c0fc22dd,72b,cab51000,...) at _vn_lock+0x78 softdep_flushworklist(cab51000,f2752b6c,ca6cdb80,5e9,0,...) at softdep_flushworklist+0x47 ffs_sync(cab51000,1,f2752bc0,51a,c7c31000,...) at ffs_sync+0x32d dounmount(cab51000,8080000,ca6cdb80,49c,0,...) at dounmount+0x3f8 sys_unmount(ca6cdb80,f2752cec,c,c,206,...) at sys_unmount+0x421 syscall(f2752d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280e800b, esp = 0xbfbfe64c, ebp = 0xbfbfe718 --- ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes lock order reversal: 1st 0xcab305c8 syncer (syncer) @ kern/vfs_subr.c:1767 2nd 0xcab33b38 devfs (devfs) @ ufs/ffs/ffs_vfsops.c:1536 KDB: stack backtrace: db_trace_self_wrapper(c0f92573,3335313a,c0000a36,246,c7d72998,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a9645b,c0f96040,c12753c0,600,ee31aa5c,...) at kdb_backtrace+0x2a _witness_debugger(c0f96040,cab33b38,c0f7ca67,c7d79470,c0fc51b9,...) at _witness_debugger+0x25 witness_checkorder(cab33b38,9,c0fc51b0,600,cab33ba4,...) at witness_checkorder+0x86f __lockmgr_args(cab33b38,80400,cab33ba4,0,0,...) at __lockmgr_args+0x834 vop_stdlock(ee31ab7c,c0aa661a,c12753d0,80400,cab33ae0,...) at vop_stdlock+0x65 VOP_LOCK1_APV(c10b3e40,ee31ab7c,ee31ab9c,c10ef300,cab33ae0,...) at VOP_LOCK1_APV+0xb5 _vn_lock(cab33ae0,80400,c0fc51b0,600,c0f8c94f,...) at _vn_lock+0x78 ffs_sync(cab50b50,3,2,dd9,cab50b50,...) at ffs_sync+0x3f7 sync_fsync(ee31ac6c,c0fe6fa3,cab30634,ee31ac6c,cab30570,...) at sync_fsync+0x156 VOP_FSYNC_APV(c10ccc40,ee31ac6c,c0f9e00c,6e7,c805eb80,...) at VOP_FSYNC_APV+0xc5 sync_vnode(c12a2234,c12a2220,3e8,78b,4e20,...) at sync_vnode+0x16b sched_sync(0,ee31ad28,c0f88c30,3db,ca6c1588,...) at sched_sync+0x282 fork_exit(c0afcd30,0,ee31ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee31ad60, ebp = 0 --- ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 81678 files, 1910831 used, 116403150 free (2238 frags, 14550114 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes Feb 24 17:32:26 x4 su: pho to root on /dev/pts/0 ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 81678 files, 1910831 used, 116403150 free (2238 frags, 14550114 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmpFeb 24 17:33:48 x4 mountd[1010]: can't delete exports for /dev: Invalid argument mount option is unknown watchdogd. Starting inetd. Fri Feb 24 17:33:48 CET 2012 FreeBSD/i386 (x4.osted.lan) (console) login: Fatal trap 12: page fault while in kernel mode cpuid = 0; apic id = 00 fault virtual address = 0xa fault code = supervisor read, page not present instruction pointer = 0x20:0xcb2c5964 stack pointer = 0x28:0xf2839964 frame pointer = 0x28:0xf2839998 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, def32 1, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 1386 (mount_nullfs) [ thread pid 1386 tid 100149 ] Stopped at null_nodeget+0x74: movl 0x8(%edx),%eax db> run pho db:0:pho> bt Tracing pid 1386 tid 100149 td 0xcadc35c0 null_nodeget(cab42000,cb026414,f2839a3c,f2839a34,c10bf488,...) at null_nodeget+0x74 nullfs_mount(cab42000,cb2c8700,c807a180,cae69b00,f37,...) at nullfs_mount+0x23c vfs_donmount(cadc35c0,0,0,c7e09a00,c7e09a00,...) at vfs_donmount+0xbee sys_nmount(cadc35c0,f2839cec,c,c,202,...) at sys_nmount+0x7f syscall(f2839d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (378, FreeBSD ELF32, sys_nmount), eip = 0x280e5c2b, esp = 0xbfbfdffc, ebp = 0xbfbfe868 --- db:0:bt> show allpcpu Current CPU: 0 cpuid = 0 dynamic pcpu = 0x735500 curthread = 0xcadc35c0: pid 1386 "mount_nullfs" curpcb = 0xf2839d80 fpcurthread = none idlethread = 0xc7dc98a0: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x6a26500 curthread = 0xc7e13000: pid 12 "swi4: clock" curpcb = 0xc7b39d80 fpcurthread = none idlethread = 0xc7dc95c0: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x6a29500 curthread = 0xc7dc92e0: pid 11 "idle: cpu2" curpcb = 0xc7b2cd80 fpcurthread = none idlethread = 0xc7dc92e0: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x6a2c500 curthread = 0xc7dc9000: pid 11 "idle: cpu3" curpcb = 0xc7b2fd80 fpcurthread = none idlethread = 0xc7dc9000: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks Process 1386 (mount_nullfs) thread 0xcadc35c0 (100149) exclusive lockmgr ufs (ufs) r = 0 (0xcb02646c) locked @ kern/vfs_subr.c:2167 exclusive sleep mutex Giant (Giant) r = 0 (0xc112a710) locked @ kern/vfs_mount.c:1102 db:0:alllocks> show lockedvnods Locked vnodes 0xcb026414: tag ufs, type VDIR usecount 1, writecount 0, refcount 5 mountedhere 0 flags (VV_ROOT) v_object 0xcb104870 ref 0 pages 6 lock type ufs: EXCL by thread 0xcadc35c0 (pid 1386) #0 0xc0a43cde at __lockmgr_args+0xc1e #1 0xc0ca6491 at ffs_lock+0xa1 #2 0xc0de4485 at VOP_LOCK1_APV+0xb5 #3 0xc0b09f38 at _vn_lock+0x78 #4 0xc0afc9eb at vget+0xbb #5 0xc0aec3fd at vfs_hash_get+0xed #6 0xc0c9f7f9 at ffs_vgetf+0x49 #7 0xc0c9fd7e at ffs_vget+0x2e #8 0xc0cb4b28 at ufs_root+0x28 #9 0xc0aedb91 at lookup+0xa21 #10 0xc0aee87f at namei+0x6bf #11 0xcb2c60f0 at nullfs_mount+0x100 #12 0xc0af192e at vfs_donmount+0xbee #13 0xc0af26cf at sys_nmount+0x7f #14 0xc0dc1127 at syscall+0x2c7 #15 0xc0daa451 at Xint0x80_syscall+0x21 ino 2, on dev label/tmp db:0:lockedvnods> show mount 0xca7b2b50 /dev/ad4s1a on / (ufs) 0xca7b3000 devfs on /dev (devfs) 0xcab425a8 /dev/ad4s1f on /home (ufs) 0xcab50b50 /dev/ad4s1d on /usr (ufs) 0xcab5087c /dev/ad4s1e on /var (ufs) 0xcab505a8 procfs on /proc (procfs) 0xcab422d4 /dev/label/tmp on /tmp (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 1386 1385 1274 0 R+ CPU 0 mount_nullfs 1385 1376 1274 0 S+ wait 0xcb1a5b10 mount 1376 1274 1274 0 S+ wait 0xcb1a62c4 sh 1274 1203 1274 0 S+ wait 0xcb1a6000 sh 1273 1 1273 0 Ss+ ttyin 0xc7d97470 getty 1272 1 1272 0 Ss+ ttyin 0xc7d97670 getty 1271 1 1271 0 Ss+ ttyin 0xc7d97870 getty 1270 1 1270 0 Ss+ ttyin 0xc7d97a70 getty 1269 1 1269 0 Ss+ ttyin 0xc7d97c70 getty 1268 1 1268 0 Ss+ ttyin 0xc7d97e70 getty 1267 1 1267 0 Ss+ ttyin 0xc8181070 getty 1266 1 1266 0 Ss+ ttyin 0xc8181270 getty 1265 1 1265 0 Ss+ ttyin 0xc8181470 getty 1248 1 1248 0 Ss select 0xcb16f164 inetd 1223 1 1223 0 Ss nanslp 0xc112c064 watchdogd 1203 1199 1203 0 S+ wait 0xcab7cb10 bash 1199 1198 1199 0 S+ pause 0xca6c2b68 csh 1198 1193 1198 1001 S+ wait 0xca82484c su 1193 1192 1193 1001 Ss+ wait 0xcae75000 bash 1192 1190 1190 1001 S select 0xca6c0da4 sshd 1190 1140 1190 0 Ss select 0xca7b1264 sshd 1163 1160 20 0 S+ nanslp 0xc112c064 sleep 1160 1 20 0 S+ wait 0xcab7d000 sh 1151 1 1151 0 Ss nanslp 0xc112c064 cron 1146 1 1146 25 Ss pause 0xcae7531c sendmail 1143 1 1143 0 Ss select 0xca7b1be4 sendmail 1140 1 1140 0 Ss select 0xca7b1a64 sshd 1112 1 1112 0 Ss select 0xca7b19e4 moused 1092 1 1092 0 Ss select 0xca89b1e4 ntpd 1038 1032 1032 0 S (threaded) nfsd 100131 S rpcsvc 0xca790290 nfsd: service 100130 S rpcsvc 0xca7902d0 nfsd: service 100129 S rpcsvc 0xcaded210 nfsd: service 100083 S rpcsvc 0xca7903d0 nfsd: master 1032 1 1032 0 Ss select 0xca7b1de4 nfsd 1030 1026 1026 0 S select 0xca6c07e4 nfsuserd 1029 1026 1026 0 S select 0xca6bf864 nfsuserd 1028 1026 1026 0 S select 0xca6c0824 nfsuserd 1027 1026 1026 0 S select 0xca6bf8a4 nfsuserd 1026 1 1026 0 Ss pause 0xca82231c nfsuserd 1010 1 1010 0 Ss select 0xca80e324 mountd 976 1 976 0 Ss select 0xca6bf924 rpcbind 961 1 961 0 Ss select 0xca6bf724 syslogd 838 1 838 0 Ss select 0xca80e7a4 devd 19 0 0 0 DL sdflush 0xc12a8540 [softdepflush] 18 0 0 0 DL vlruwt 0xca6c12c4 [vnlru] 17 0 0 0 DL syncer 0xc12a2234 [syncer] 16 0 0 0 DL psleep 0xc12a1ec8 [bufdaemon] 9 0 0 0 DL pgzero 0xc12aa3dc [pagezero] 8 0 0 0 DL psleep 0xc12a9fc8 [vmdaemon] 7 0 0 0 DL psleep 0xc12a9f90 [pagedaemon] 6 0 0 0 DL ccb_scan 0xc10f0854 [xpt_thrd] 5 0 0 0 DL waiting_ 0xc12a3d58 [sctp_iterator] 4 0 0 0 DL ctl_work 0xc819a000 [ctl_thrd] 3 0 0 0 DL - 0xc7ffa03c [fdc0] 2 0 0 0 SL - 0xc808f000 [fw0_probe] 15 0 0 0 DL (threaded) [usb] 100058 D - 0xc8063d34 [usbus5] 100057 D - 0xc8063d04 [usbus5] 100056 D - 0xc8063cd4 [usbus5] 100055 D - 0xc8063ca4 [usbus5] 100053 D - 0xc8056b5c [usbus4] 100052 D - 0xc8056b2c [usbus4] 100051 D - 0xc8056afc [usbus4] 100050 D - 0xc8056acc [usbus4] 100049 D - 0xc8052b5c [usbus3] 100048 D - 0xc8052b2c [usbus3] 100047 D - 0xc8052afc [usbus3] 100046 D - 0xc8052acc [usbus3] 100045 D - 0xc804ab5c [usbus2] 100044 D - 0xc804ab2c [usbus2] 100043 D - 0xc804aafc [usbus2] 100042 D - 0xc804aacc [usbus2] 100040 D - 0xc8044b5c [usbus1] 100039 D - 0xc8044b2c [usbus1] 100038 D - 0xc8044afc [usbus1] 100037 D - 0xc8044acc [usbus1] 100035 D - 0xc8038b5c [usbus0] 100034 D - 0xc8038b2c [usbus0] 100033 D - 0xc8038afc [usbus0] 100032 D - 0xc8038acc [usbus0] 14 0 0 0 DL - 0xc112ae64 [yarrow] 13 0 0 0 DL (threaded) [geom] 100015 D - 0xc1128a68 [g_down] 100014 D - 0xc1128a64 [g_up] 100013 D - 0xc1128a5c [g_event] 12 0 0 0 RL (threaded) [intr] 100066 I [irq12: psm0] 100065 I [irq1: atkbd0] 100063 I [swi0: uart] 100060 I [irq20: fwohci0] 100059 I [irq14: ata0] 100054 I [irq19: ehci0] 100041 I [irq18: ohci2 ohci4] 100036 I [irq17: ohci1 ohci3] 100031 I [irq16: hdac1 ohci0] 100030 I [irq22: ahci0] 100029 I [irq257: re0] 100028 I [irq256: hdac0] 100027 I [swi6: task queue] 100026 I [swi6: Giant taskq] 100024 I [swi5: +] 100023 I [swi2: cambio] 100012 I [swi4: clock] 100011 I [swi4: clock] 100010 I [swi4: clock] 100009 Run CPU 1 [swi4: clock] 100008 I [swi3: vm] 100007 I [swi1: netisr 0] 11 0 0 0 RL (threaded) [idle] 100006 Run CPU 3 [idle: cpu3] 100005 Run CPU 2 [idle: cpu2] 100004 CanRun [idle: cpu1] 100003 CanRun [idle: cpu0] 1 0 1 0 SLs wait 0xc7dc7b10 [init] 10 0 0 0 DL audit_wo 0xc12a7c80 [audit] 0 0 0 0 DLs (threaded) [kernel] 100078 D - 0xc8035380 [mca taskq] 100068 D - 0xc112ae64 [deadlkres] 100061 D - 0xc80356c0 [fw0_taskq] 100025 D - 0xc7f9de80 [thread taskq] 100022 D - 0xc7f9e040 [acpi_task_2] 100021 D - 0xc7f9e040 [acpi_task_1] 100020 D - 0xc7f9e040 [acpi_task_0] 100019 D - 0xc7f9e080 [ffs_trim taskq] 100018 D - 0xc7f9e0c0 [kqueue taskq] 100016 D - 0xc7dade80 [firmware taskq] 100000 D sched 0xc1128b40 [swapper] db:0:ps> allt Tracing command mount_nullfs pid 1386 tid 100149 td 0xcadc35c0 null_nodeget(cab42000,cb026414,f2839a3c,f2839a34,c10bf488,...) at null_nodeget+0x74 nullfs_mount(cab42000,cb2c8700,c807a180,cae69b00,f37,...) at nullfs_mount+0x23c vfs_donmount(cadc35c0,0,0,c7e09a00,c7e09a00,...) at vfs_donmount+0xbee sys_nmount(cadc35c0,f2839cec,c,c,202,...) at sys_nmount+0x7f syscall(f2839d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (378, FreeBSD ELF32, sys_nmount), eip = 0x280e5c2b, esp = 0xbfbfdffc, ebp = 0xbfbfe868 --- Tracing command mount pid 1385 tid 100171 td 0xcae7e5c0 sched_switch(cae7e5c0,0,104,1a3,4aa1a542,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cae7e5c0,0,c0f93f60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f93f60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb1a5b10,6c,c0f96ea7,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb1a5b10,cb1a5b98,16c,c0f96ea7,0,...) at _sleep+0x385 kern_wait(cae7e5c0,56a,f288cc60,0,0,...) at kern_wait+0x626 sys_wait4(cae7e5c0,f288ccec,c1139340,f288cc88,216,...) at sys_wait4+0x3b syscall(f288cd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2811266b, esp = 0xbfbfdd9c, ebp = 0xbfbfddb8 --- Tracing command sh pid 1376 tid 100165 td 0xcae7eb80 sched_switch(cae7eb80,0,104,1a3,4a7a105a,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cae7eb80,0,c0f93f60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f93f60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb1a62c4,6c,c0f96ea7,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb1a62c4,cb1a634c,16c,c0f96ea7,0,...) at _sleep+0x385 kern_wait(cae7eb80,ffffffff,f287ac60,2,0,...) at kern_wait+0x626 sys_wait4(cae7eb80,f287acec,c0fe02ca,c0f96e86,216,...) at sys_wait4+0x3b syscall(f287ad28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2817666b, esp = 0xbfbfe7ec, ebp = 0xbfbfe808 --- Tracing command sh pid 1274 tid 100167 td 0xcae7e8a0 sched_switch(cae7e8a0,0,104,1a3,482f836a,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cae7e8a0,0,c0f93f60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f93f60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb1a6000,6c,c0f96ea7,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb1a6000,cb1a6088,16c,c0f96ea7,0,...) at _sleep+0x385 kern_wait(cae7e8a0,ffffffff,f2880c60,2,0,...) at kern_wait+0x626 sys_wait4(cae7e8a0,f2880cec,c0fe02ca,c0f96e86,216,...) at sys_wait4+0x3b syscall(f2880d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2817666b, esp = 0xbfbfe70c, ebp = 0xbfbfe728 --- Tracing command getty pid 1273 tid 100104 td 0xca7ee5c0 sched_switch(ca7ee5c0,0,104,1a3,47387c7f,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca7ee5c0,0,c0f93f60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f93f60,160,0,ca7ee5c0,ca7ee5c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7d97470,0,c0f98dc8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7d97470,c112a710,c0f987a0,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7d97400,c7d97470,f2773c44,1,0,...) at tty_wait+0x71 ttydisc_read(c7d97400,f2773c44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c8193400,f2773c44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca7f9508,f2773c44,c7dc4e80,0,ca7ee5c0,...) at devfs_read_f+0x7e dofileread(f2773c44,ffffffff,ffffffff,0,f2773c20,...) at dofileread+0x9e kern_readv(ca7ee5c0,0,f2773c44,f2773c64,1,...) at kern_readv+0x68 sys_read(ca7ee5c0,f2773cec,c0fe02ca,c0df39d6,246,...) at sys_read+0x4f syscall(f2773d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6753, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1272 tid 100133 td 0xcac76000 sched_switch(cac76000,0,104,1a3,47184c60,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cac76000,0,c0f93f60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f93f60,160,0,cac76000,cac76000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7d97670,0,c0f98dc8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7d97670,c112a710,c0f987a0,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7d97600,c7d97670,f2806c44,1,0,...) at tty_wait+0x71 ttydisc_read(c7d97600,f2806c44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c8193500,f2806c44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca83b460,f2806c44,c7dc4e80,0,cac76000,...) at devfs_read_f+0x7e dofileread(f2806c44,ffffffff,ffffffff,0,f2806c20,...) at dofileread+0x9e kern_readv(cac76000,0,f2806c44,f2806c64,1,...) at kern_readv+0x68 sys_read(cac76000,f2806cec,c0fe02ca,c0df39d6,246,...) at sys_read+0x4f syscall(f2806d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6753, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1271 tid 100135 td 0xcac758a0 sched_switch(cac758a0,0,104,1a3,47372e88,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cac758a0,0,c0f93f60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f93f60,160,0,cac758a0,cac758a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7d97870,0,c0f98dc8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7d97870,c112a710,c0f987a0,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7d97800,c7d97870,f280cc44,1,0,...) at tty_wait+0x71 ttydisc_read(c7d97800,f280cc44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c8193600,f280cc44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca7fa6c8,f280cc44,c7dc4e80,0,cac758a0,...) at devfs_read_f+0x7e dofileread(f280cc44,ffffffff,ffffffff,0,f280cc20,...) at dofileread+0x9e kern_readv(cac758a0,0,f280cc44,f280cc64,1,...) at kern_readv+0x68 sys_read(cac758a0,f280ccec,c0fe02ca,c0df39d6,246,...) at sys_read+0x4f syscall(f280cd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6753, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1270 tid 100137 td 0xcac752e0 sched_switch(cac752e0,0,104,1a3,472826de,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cac752e0,0,c0f93f60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f93f60,160,0,cac752e0,cac752e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7d97a70,0,c0f98dc8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7d97a70,c112a710,c0f987a0,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7d97a00,c7d97a70,f2812c44,1,0,...) at tty_wait+0x71 ttydisc_read(c7d97a00,f2812c44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c8075500,f2812c44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca83b5b0,f2812c44,c7dc4e80,0,cac752e0,...) at devfs_read_f+0x7e dofileread(f2812c44,ffffffff,ffffffff,0,f2812c20,...) at dofileread+0x9e kern_readv(cac752e0,0,f2812c44,f2812c64,1,...) at kern_readv+0x68 sys_read(cac752e0,f2812cec,c0fe02ca,c0df39d6,246,...) at sys_read+0x4f syscall(f2812d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6753, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1269 tid 100079 td 0xca7eeb80 sched_switch(ca7eeb80,0,104,1a3,472d9949,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca7eeb80,0,c0f93f60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f93f60,160,0,ca7eeb80,ca7eeb80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7d97c70,0,c0f98dc8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7d97c70,c112a710,c0f987a0,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7d97c00,c7d97c70,f26ffc44,1,0,...) at tty_wait+0x71 ttydisc_read(c7d97c00,f26ffc44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c8075600,f26ffc44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca83b038,f26ffc44,c7dc4e80,0,ca7eeb80,...) at devfs_read_f+0x7e dofileread(f26ffc44,ffffffff,ffffffff,0,f26ffc20,...) at dofileread+0x9e kern_readv(ca7eeb80,0,f26ffc44,f26ffc64,1,...) at kern_readv+0x68 sys_read(ca7eeb80,f26ffcec,c0fe02ca,c0df39d6,246,...) at sys_read+0x4f syscall(f26ffd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6753, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1268 tid 100085 td 0xca6ce5c0 sched_switch(ca6ce5c0,0,104,1a3,4715f1cc,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca6ce5c0,0,c0f93f60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f93f60,160,0,ca6ce5c0,ca6ce5c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7d97e70,0,c0f98dc8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7d97e70,c112a710,c0f987a0,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7d97e00,c7d97e70,f2717c44,1,0,...) at tty_wait+0x71 ttydisc_read(c7d97e00,f2717c44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c8075700,f2717c44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca842968,f2717c44,c7dc4e80,0,ca6ce5c0,...) at devfs_read_f+0x7e dofileread(f2717c44,ffffffff,ffffffff,0,f2717c20,...) at dofileread+0x9e kern_readv(ca6ce5c0,0,f2717c44,f2717c64,1,...) at kern_readv+0x68 sys_read(ca6ce5c0,f2717cec,c0fe02ca,c0df39d6,246,...) at sys_read+0x4f syscall(f2717d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6753, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1267 tid 100084 td 0xca82b2e0 sched_switch(ca82b2e0,0,104,1a3,47384eb0,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca82b2e0,0,c0f93f60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f93f60,160,0,ca82b2e0,ca82b2e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c8181070,0,c0f98dc8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c8181070,c112a710,c0f987a0,527,0,...) at _cv_wait_sig+0x260 tty_wait(c8181000,c8181070,f2713c44,1,0,...) at tty_wait+0x71 ttydisc_read(c8181000,f2713c44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c8075800,f2713c44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca83b0e0,f2713c44,c7dc4e80,0,ca82b2e0,...) at devfs_read_f+0x7e dofileread(f2713c44,ffffffff,ffffffff,0,f2713c20,...) at dofileread+0x9e kern_readv(ca82b2e0,0,f2713c44,f2713c64,1,...) at kern_readv+0x68 sys_read(ca82b2e0,f2713cec,c0fe02ca,c0df39d6,246,...) at sys_read+0x4f syscall(f2713d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6753, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1266 tid 100091 td 0xca82a2e0 sched_switch(ca82a2e0,0,104,1a3,4735e77a,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca82a2e0,0,c0f93f60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f93f60,160,0,ca82a2e0,ca82a2e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c8181270,0,c0f98dc8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c8181270,c112a710,c0f987a0,527,0,...) at _cv_wait_sig+0x260 tty_wait(c8181200,c8181270,f2731c44,1,0,...) at tty_wait+0x71 ttydisc_read(c8181200,f2731c44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c8075900,f2731c44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca7f9c40,f2731c44,c7dc4e80,0,ca82a2e0,...) at devfs_read_f+0x7e dofileread(f2731c44,ffffffff,ffffffff,0,f2731c20,...) at dofileread+0x9e kern_readv(ca82a2e0,0,f2731c44,f2731c64,1,...) at kern_readv+0x68 sys_read(ca82a2e0,f2731cec,c0fe02ca,c0df39d6,246,...) at sys_read+0x4f syscall(f2731d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6753, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1265 tid 100112 td 0xca825b80 sched_switch(ca825b80,0,104,1a3,47ad421d,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca825b80,0,c0f93f60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4bc7a,c8181404,0,c0f8c94f,ca825b80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c8181470,0,f27c4af0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c8181470,c8181404,c0f987a0,527,0,...) at _cv_wait_sig+0x260 tty_wait(c8181400,c8181470,f27c4c44,1,0,...) at tty_wait+0x71 ttydisc_read(c8181400,f27c4c44,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c7ed4e00,f27c4c44,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca7f9e38,f27c4c44,c7dc4e80,0,ca825b80,...) at devfs_read_f+0x7e dofileread(f27c4c44,ffffffff,ffffffff,0,f27c4c20,...) at dofileread+0x9e kern_readv(ca825b80,0,f27c4c44,f27c4c64,1,...) at kern_readv+0x68 sys_read(ca825b80,f27c4cec,c0fe02ca,c0df39d6,246,...) at sys_read+0x4f syscall(f27c4d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a6753, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command inetd pid 1248 tid 100153 td 0xcab8a5c0 sched_switch(cab8a5c0,0,104,1a3,356f3152,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab8a5c0,0,c0f93f60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4bc7a,cb16f150,0,c0f8c94f,cab8a5c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb16f164,0,f2856a58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cb16f164,cb16f150,c0f966b0,6b2,cac6b888,...) at _cv_wait_sig+0x260 seltdwait(cac6b888,58,c7dc4e80,cab8a5c0,cab8a670,...) at seltdwait+0xa2 kern_select(cab8a5c0,8,bfbfdfa0,0,0,0,20,cb192b10,4) at kern_select+0x655 sys_select(cab8a5c0,f2856cec,c0fe02ca,c0f96ef3,202,...) at sys_select+0x66 syscall(f2856d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281b86d3, esp = 0xbfbfdf5c, ebp = 0xbfbfede8 --- Tracing command watchdogd pid 1223 tid 100102 td 0xcab8b2e0 sched_switch(cab8b2e0,0,104,1a3,6d6b3fe6,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cab8b2e0,0,c0f93f60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(ea61,c0a9cc90,cab8b2e0,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c112c064,6c,c0f8fa77,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c112c064,0,16c,c0f8fa77,ea61,...) at _sleep+0x34f kern_nanosleep(cab8b2e0,f276dc50,f276dc58,3c,0,...) at kern_nanosleep+0xc1 sys_nanosleep(cab8b2e0,f276dcec,c,c,206,...) at sys_nanosleep+0x6f syscall(f276dd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2819e293, esp = 0xbfbfecbc, ebp = 0xbfbfece8 --- Tracing command bash pid 1203 tid 100093 td 0xca6cdb80 sched_switch(ca6cdb80,0,104,1a3,a55ada9,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(ca6cdb80,0,c0f93f60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f93f60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cab7cb10,6c,c0f96ea7,100,0,...) at sleepq_wait_sig+0x17 _sleep(cab7cb10,cab7cb98,16c,c0f96ea7,0,...) at _sleep+0x385 kern_wait(ca6cdb80,ffffffff,f2752c60,6,0,...) at kern_wait+0x626 sys_wait4(ca6cdb80,f2752cec,c0fe02ca,c0f96d96,216,...) at sys_wait4+0x3b syscall(f2752d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282d566b, esp = 0xbfbfe76c, ebp = 0xbfbfe788 --- Tracing command csh pid 1199 tid 100107 td 0xca7edb80 sched_switch(ca7edb80,0,104,1a3,11eafc9d,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,74,...) at mi_switch+0x1ff sleepq_switch(ca7edb80,0,c0f93f60,1a7,74,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f93f60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6c2b68,74,c0e1558e,100,0,...) at sleepq_wait_sig+0x17 _sleep(ca6c2b68,ca6c2b98,174,c0e1558e,0,...) at _sleep+0x385 kern_sigsuspend(ca7edb80,0,0,0,0,...) at kern_sigsuspend+0xba sys_sigsuspend(ca7edb80,f277fcec,c0fe02ca,c0f96d96,202,...) at sys_sigsuspend+0x4d syscall(f277fd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x28195ecb, esp = 0xbfbfe58c, ebp = 0xbfbfe5f8 --- Tracing command su pid 1198 tid 100081 td 0xca82bb80 sched_switch(ca82bb80,0,104,1a3,b7362edb,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(ca82bb80,0,c0f93f60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f93f60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca82484c,6c,c0f96ea7,100,0,...) at sleepq_wait_sig+0x17 _sleep(ca82484c,ca8248d4,16c,c0f96ea7,0,...) at _sleep+0x385 kern_wait(ca82bb80,4af,f2707c60,2,0,...) at kern_wait+0x626 sys_wait4(ca82bb80,f2707cec,c,c,216,...) at sys_wait4+0x3b syscall(f2707d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2813266b, esp = 0xbfbfe5bc, ebp = 0xbfbfe5d8 --- Tracing command bash pid 1193 tid 100141 td 0xcab8b5c0 sched_switch(cab8b5c0,0,104,1a3,b3f0706a,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cab8b5c0,0,c0f93f60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f93f60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cae75000,6c,c0f96ea7,100,0,...) at sleepq_wait_sig+0x17 _sleep(cae75000,cae75088,16c,c0f96ea7,0,...) at _sleep+0x385 kern_wait(cab8b5c0,ffffffff,f281ec60,6,0,...) at kern_wait+0x626 sys_wait4(cab8b5c0,f281ecec,c0fe02ca,c0f96d96,216,...) at sys_wait4+0x3b syscall(f281ed28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282d566b, esp = 0xbfbfe97c, ebp = 0xbfbfe998 --- Tracing command sshd pid 1192 tid 100082 td 0xca82b8a0 sched_switch(ca82b8a0,0,104,1a3,3fd5ed71,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca82b8a0,0,c0f93f60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4bc7a,ca6c0d90,0,c0f8c94f,ca82b8a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6c0da4,0,f270ba58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca6c0da4,ca6c0d90,c0f966b0,6b2,ca83b230,...) at _cv_wait_sig+0x260 seltdwait(ca83b230,58,cb0eb080,ca82b8a0,f270bacc,...) at seltdwait+0xa2 kern_select(ca82b8a0,c,288060b8,288060c0,0,0,20,ca824588,0) at kern_select+0x655 sys_select(ca82b8a0,f270bcec,c0fe02ca,c0f96ffb,206,...) at sys_select+0x66 syscall(f270bd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d66d3, esp = 0xbfbfde2c, ebp = 0xbfbfde78 --- Tracing command sshd pid 1190 tid 100139 td 0xcab8bb80 sched_switch(cab8bb80,0,104,1a3,d021bcac,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab8bb80,0,c0f93f60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4bc7a,ca7b1250,0,c0f8c94f,cab8bb80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca7b1264,0,f2818abc,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca7b1264,ca7b1250,c0f966b0,6b2,f2818b44,...) at _cv_wait_sig+0x260 seltdwait(c7db222c,c0f966b0,5af,cab8bb80,8,...) at seltdwait+0xa2 sys_poll(cab8bb80,f2818cec,c0fe02ca,c0f7efd9,202,...) at sys_poll+0x321 syscall(f2818d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2846f3ab, esp = 0xbfbfde8c, ebp = 0xbfbfdec8 --- Tracing command sleep pid 1163 tid 100138 td 0xcac75000 sched_switch(cac75000,0,104,1a3,176da0a0,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cac75000,0,c0f93f60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(30d41,c0a9cc90,cac75000,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c112c064,6c,c0f8fa77,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c112c064,0,16c,c0f8fa77,30d41,...) at _sleep+0x34f kern_nanosleep(cac75000,f2815c50,f2815c58,c8,0,...) at kern_nanosleep+0xc1 sys_nanosleep(cac75000,f2815cec,c0fe02ca,c0f97728,246,...) at sys_nanosleep+0x6f syscall(f2815d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2816e293, esp = 0xbfbfedbc, ebp = 0xbfbfee08 --- Tracing command sh pid 1160 tid 100092 td 0xca6ce000 sched_switch(ca6ce000,0,104,1a3,17581763,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(ca6ce000,0,c0f93f60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f93f60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cab7d000,6c,c0f96ea7,100,0,...) at sleepq_wait_sig+0x17 _sleep(cab7d000,cab7d088,16c,c0f96ea7,0,...) at _sleep+0x385 kern_wait(ca6ce000,ffffffff,f274fc60,2,0,...) at kern_wait+0x626 sys_wait4(ca6ce000,f274fcec,c,c,216,...) at sys_wait4+0x3b syscall(f274fd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2817666b, esp = 0xbfbfeb6c, ebp = 0xbfbfeb88 --- Tracing command cron pid 1151 tid 100136 td 0xcac755c0 sched_switch(cac755c0,0,104,1a3,32bdc81e,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cac755c0,0,c0f93f60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(ea61,c0a9cc90,cac755c0,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c112c064,6c,c0f8fa77,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c112c064,0,16c,c0f8fa77,ea61,...) at _sleep+0x34f kern_nanosleep(cac755c0,f280fc50,f280fc58,3c,0,...) at kern_nanosleep+0xc1 sys_nanosleep(cac755c0,f280fcec,c0fe02ca,c0f97354,206,...) at sys_nanosleep+0x6f syscall(f280fd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28190293, esp = 0xbfbfec4c, ebp = 0xbfbfec78 --- Tracing command sendmail pid 1146 tid 100140 td 0xcab8b8a0 sched_switch(cab8b8a0,0,104,1a3,bb99c50e,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,74,...) at mi_switch+0x1ff sleepq_switch(cab8b8a0,0,c0f93f60,1a7,74,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f93f60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cae7531c,74,c0e1558e,100,0,...) at sleepq_wait_sig+0x17 _sleep(cae7531c,cae7534c,174,c0e1558e,0,...) at _sleep+0x385 kern_sigsuspend(cab8b8a0,0,0,0,0,...) at kern_sigsuspend+0xba sys_sigsuspend(cab8b8a0,f281bcec,c0fe02ca,c0f96d96,202,...) at sys_sigsuspend+0x4d syscall(f281bd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x28349ecb, esp = 0xbfbfcf9c, ebp = 0xbfbfcfc8 --- Tracing command sendmail pid 1143 tid 100134 td 0xcac75b80 sched_switch(cac75b80,0,104,1a3,798fdf89,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cac75b80,0,c0f93f60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f2809a20,c0a4bc7a,ca7b1bd0,0,cac75b80,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca7b1be4,0,f2809a58,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca7b1be4,ca7b1bd0,1389,6b2,ca83b8f8,...) at _cv_timedwait_sig+0x270 seltdwait(f2809c10,f2809c18,cae69c00,cac75b80,c0a484bd,...) at seltdwait+0x8a kern_select(cac75b80,5,bfbfc510,0,0,f2809c5c,20,5,0) at kern_select+0x655 sys_select(cac75b80,f2809cec,c0fe02ca,c0f972b3,206,...) at sys_select+0x66 syscall(f2809d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x283f46d3, esp = 0xbfbfc47c, ebp = 0xbfbfcfa8 --- Tracing command sshd pid 1140 tid 100144 td 0xcae84000 sched_switch(cae84000,0,104,1a3,c7a178d0,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cae84000,0,c0f93f60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4bc7a,ca7b1a50,0,c0f8c94f,cae84000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca7b1a64,0,f2827a58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca7b1a64,ca7b1a50,c0f966b0,6b2,ca7f9460,...) at _cv_wait_sig+0x260 seltdwait(ca7f9460,58,cae69480,cae84000,cac67000,...) at seltdwait+0xa2 kern_select(cae84000,7,2880c0b8,0,0,0,20,cadbd588,a) at kern_select+0x655 sys_select(cae84000,f2827cec,c,c,202,...) at sys_select+0x66 syscall(f2827d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d66d3, esp = 0xbfbfdeec, ebp = 0xbfbfedf8 --- Tracing command moused pid 1112 tid 100089 td 0xca82a8a0 sched_switch(ca82a8a0,0,104,1a3,c94ff567,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca82a8a0,0,c0f93f60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4bc7a,ca7b19d0,0,c0f8c94f,ca82a8a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca7b19e4,0,f2727a58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca7b19e4,ca7b19d0,c0f966b0,6b2,ca7fae70,...) at _cv_wait_sig+0x260 seltdwait(ca7fae70,58,c7dc4e80,ca82a8a0,f6,...) at seltdwait+0xa2 kern_select(ca82a8a0,400,bfbfea04,0,0,0,20,ca822588,1) at kern_select+0x655 sys_select(ca82a8a0,f2727cec,c0fe02ca,c0df39d6,246,...) at sys_select+0x66 syscall(f2727d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281c56d3, esp = 0xbfbfe99c, ebp = 0xbfbfeb28 --- Tracing command ntpd pid 1092 tid 100145 td 0xcae83b80 sched_switch(cae83b80,0,104,1a3,1d85df73,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cae83b80,0,c0f93f60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4bc7a,ca89b1d0,0,c0f8c94f,cae83b80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca89b1e4,0,f282aa58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca89b1e4,ca89b1d0,c0f966b0,6b2,ca7fa0e0,...) at _cv_wait_sig+0x260 seltdwait(ca7fa0e0,58,c7dc4e80,cae83b80,c0a4bbf1,...) at seltdwait+0xa2 kern_select(cae83b80,1c,bfbfece8,0,0,0,20,cadbd2c4,0) at kern_select+0x655 sys_select(cae83b80,f282acec,c0fe02ca,c0f97354,202,...) at sys_select+0x66 syscall(f282ad28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x283736d3, esp = 0xbfbfecbc, ebp = 0xbfbfed88 --- Tracing command nfsd pid 1038 tid 100131 td 0xcab8a8a0 sched_switch(cab8a8a0,0,104,1a3,cc7e8d54,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab8a8a0,0,c0f93f60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f2800be0,c0a4bc7a,c800f900,0,cab8a8a0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca790290,0,f2800c18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca790290,c800f900,1388,3b1,0,...) at _cv_timedwait_sig+0x270 svc_run_internal(f2800d14,c0a2e7b8,c800f900,f2800d28,c0f88c30,...) at svc_run_internal+0x356 svc_thread_start(c800f900,f2800d28,c0f88c30,3db,ca8242c4,...) at svc_thread_start+0x10 fork_exit(c0c4c550,c800f900,f2800d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1038 tid 100130 td 0xcab8ab80 sched_switch(cab8ab80,0,104,1a3,cc7f6e42,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab8ab80,0,c0f93f60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f27fdbe0,c0a4bc7a,c800f900,0,cab8ab80,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca7902d0,0,f27fdc18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca7902d0,c800f900,1388,3b1,0,...) at _cv_timedwait_sig+0x270 svc_run_internal(f27fdd14,c0a2e7b8,c800f900,f27fdd28,c0f88c30,...) at svc_run_internal+0x356 svc_thread_start(c800f900,f27fdd28,c0f88c30,3db,ca8242c4,...) at svc_thread_start+0x10 fork_exit(c0c4c550,c800f900,f27fdd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1038 tid 100129 td 0xcab8b000 sched_switch(cab8b000,0,104,1a3,cc7ea1ae,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cab8b000,0,c0f93f60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f27fabe0,c0a4bc7a,c800f900,0,cab8b000,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(caded210,0,f27fac18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(caded210,c800f900,1388,3b1,0,...) at _cv_timedwait_sig+0x270 svc_run_internal(f27fad14,c0a2e7b8,c800f900,f27fad28,c0f88c30,...) at svc_run_internal+0x356 svc_thread_start(c800f900,f27fad28,c0f88c30,3db,ca8242c4,...) at svc_thread_start+0x10 fork_exit(c0c4c550,c800f900,f27fad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1038 tid 100083 td 0xca82b5c0 sched_switch(ca82b5c0,0,104,1a3,cc7ec772,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca82b5c0,0,c0f93f60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f270f498,c0a4bc7a,c800f900,0,ca82b5c0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca7903d0,0,f270f4d0,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca7903d0,c800f900,1388,3b1,f270f518,...) at _cv_timedwait_sig+0x270 svc_run_internal(ca82b770,14,c0fbd7ba,c0f804bb,f270f810,...) at svc_run_internal+0x356 svc_run(c800f900,0,c0f80496,19f,4,...) at svc_run+0x7b nfsrvd_nfsd(ca82b5c0,f270f810,c,c10c3058,ca82b5c0,...) at nfsrvd_nfsd+0x1c3 nfssvc_nfsd(ca82b5c0,f270fcec,bfbfe870,ca82b5c0,f270fd1c,...) at nfssvc_nfsd+0x177 sys_nfssvc(ca82b5c0,f270fcec,c0fe02ca,c0f972b3,206,...) at sys_nfssvc+0xeb syscall(f270fd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280e8b0b, esp = 0xbfbfe82c, ebp = 0xbfbfea98 --- Tracing command nfsd pid 1032 tid 100100 td 0xc81855c0 sched_switch(c81855c0,0,104,1a3,fe94acf7,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c81855c0,0,c0f93f60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4bc7a,ca7b1dd0,0,c0f8c94f,c81855c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca7b1de4,0,f2767a58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca7b1de4,ca7b1dd0,c0f966b0,6b2,ca7f9c78,...) at _cv_wait_sig+0x260 seltdwait(ca7f9c78,58,c7dc4e80,c81855c0,cadd52b8,...) at seltdwait+0xa2 kern_select(c81855c0,7,bfbfecb4,0,0,0,20,cab7b588,1) at kern_select+0x655 sys_select(c81855c0,f2767cec,c,c,202,...) at sys_select+0x66 syscall(f2767d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281926d3, esp = 0xbfbfea9c, ebp = 0xbfbfede8 --- Tracing command nfsuserd pid 1030 tid 100111 td 0xca82a000 sched_switch(ca82a000,0,104,1a3,67242400,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca82a000,0,c0f93f60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f27c1a20,c0a4bc7a,ca6c07d0,0,ca82a000,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca6c07e4,0,f27c1a58,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca6c07e4,ca6c07d0,7531,6b2,ca7f9af0,...) at _cv_timedwait_sig+0x270 seltdwait(f27c1c10,f27c1c18,c7dc4e80,ca82a000,cac6a000,...) at seltdwait+0x8a kern_select(ca82a000,4,bfbfebc4,0,0,f27c1c5c,20,1e,0) at kern_select+0x655 sys_select(ca82a000,f27c1cec,c0fe02ca,c0f96fe4,202,...) at sys_select+0x66 syscall(f27c1d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281916d3, esp = 0xbfbfeb1c, ebp = 0xbfbfec58 --- Tracing command nfsuserd pid 1029 tid 100096 td 0xca6cd2e0 sched_switch(ca6cd2e0,0,104,1a3,6723f234,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca6cd2e0,0,c0f93f60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f275ba20,c0a4bc7a,ca6bf850,0,ca6cd2e0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca6bf864,0,f275ba58,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca6bf864,ca6bf850,7531,6b2,ca7f9af0,...) at _cv_timedwait_sig+0x270 seltdwait(f275bc10,f275bc18,c7dc4e80,ca6cd2e0,cac6a0e8,...) at seltdwait+0x8a kern_select(ca6cd2e0,4,bfbfebc4,0,0,f275bc5c,20,1e,0) at kern_select+0x655 sys_select(ca6cd2e0,f275bcec,c0fe02ca,c0f96fe4,202,...) at sys_select+0x66 syscall(f275bd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281916d3, esp = 0xbfbfeb1c, ebp = 0xbfbfec58 --- Tracing command nfsuserd pid 1028 tid 100121 td 0xcac768a0 sched_switch(cac768a0,0,104,1a3,6723efe5,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cac768a0,0,c0f93f60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f27dfa20,c0a4bc7a,ca6c0810,0,cac768a0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca6c0824,0,f27dfa58,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca6c0824,ca6c0810,7531,6b2,ca7f9af0,...) at _cv_timedwait_sig+0x270 seltdwait(f27dfc10,f27dfc18,c7dc4e80,cac768a0,cac6a1d0,...) at seltdwait+0x8a kern_select(cac768a0,4,bfbfebc4,0,0,f27dfc5c,20,1e,0) at kern_select+0x655 sys_select(cac768a0,f27dfcec,c0fe02ca,c0f96fe4,202,...) at sys_select+0x66 syscall(f27dfd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281916d3, esp = 0xbfbfeb1c, ebp = 0xbfbfec58 --- Tracing command nfsuserd pid 1027 tid 100117 td 0xcac775c0 sched_switch(cac775c0,0,104,1a3,67243a05,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cac775c0,0,c0f93f60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f27d3a20,c0a4bc7a,ca6bf890,0,cac775c0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca6bf8a4,0,f27d3a58,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca6bf8a4,ca6bf890,7531,6b2,ca7f9af0,...) at _cv_timedwait_sig+0x270 seltdwait(f27d3c10,f27d3c18,c7dc4e80,cac775c0,cac6a2b8,...) at seltdwait+0x8a kern_select(cac775c0,4,bfbfebc4,0,0,f27d3c5c,20,1e,0) at kern_select+0x655 sys_select(cac775c0,f27d3cec,c0fe02ca,c0f96fe4,202,...) at sys_select+0x66 syscall(f27d3d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281916d3, esp = 0xbfbfeb1c, ebp = 0xbfbfec58 --- Tracing command nfsuserd pid 1026 tid 100090 td 0xca82a5c0 sched_switch(ca82a5c0,0,104,1a3,f63e23be,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,74,...) at mi_switch+0x1ff sleepq_switch(ca82a5c0,0,c0f93f60,1a7,74,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f93f60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca82231c,74,c0e1558e,100,0,...) at sleepq_wait_sig+0x17 _sleep(ca82231c,ca82234c,174,c0e1558e,0,...) at _sleep+0x385 kern_sigsuspend(ca82a5c0,0,0,0,0,...) at kern_sigsuspend+0xba sys_sigsuspend(ca82a5c0,f272bcec,c,c,246,...) at sys_sigsuspend+0x4d syscall(f272bd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x280e6ecb, esp = 0xbfbfec5c, ebp = 0xbfbfedf8 --- Tracing command mountd pid 1010 tid 100094 td 0xca6cd8a0 sched_switch(ca6cd8a0,0,104,1a3,bd01bf2,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca6cd8a0,0,c0f93f60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4bc7a,ca80e310,0,c0f8c94f,ca6cd8a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca80e324,0,f2755a58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca80e324,ca80e310,c0f966b0,6b2,ca7f9cb0,...) at _cv_wait_sig+0x260 seltdwait(ca7f9cb0,58,c7dc4e80,ca6cd8a0,c1274e40,...) at seltdwait+0xa2 kern_select(ca6cd8a0,a,bfbfed04,0,0,0,20,cab7c84c,bfbfed04) at kern_select+0x655 sys_select(ca6cd8a0,f2755cec,c0fe02ca,c0f7e277,206,...) at sys_select+0x66 syscall(f2755d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281aa6d3, esp = 0xbfbfec9c, ebp = 0xbfbfede8 --- Tracing command rpcbind pid 976 tid 100122 td 0xcac765c0 sched_switch(cac765c0,0,104,1a3,6f81fbe9,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cac765c0,0,c0f93f60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f27e2a84,c0a4bc7a,ca6bf910,0,cac765c0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca6bf924,0,f27e2abc,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca6bf924,ca6bf910,7531,6b2,f27e2b74,...) at _cv_timedwait_sig+0x270 seltdwait(f27e2c44,f27e2c4c,5af,cac765c0,c7d75ac0,...) at seltdwait+0x8a sys_poll(cac765c0,f27e2cec,c0fe02ca,c0f96fe4,212,...) at sys_poll+0x321 syscall(f27e2d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2814a3ab, esp = 0xbfbfcbac, ebp = 0xbfbfed78 --- Tracing command syslogd pid 961 tid 100115 td 0xca8252e0 sched_switch(ca8252e0,0,104,1a3,400ef7df,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca8252e0,0,c0f93f60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4bc7a,ca6bf710,0,c0f8c94f,ca8252e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6bf724,0,f27cda58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca6bf724,ca6bf710,c0f966b0,6b2,ca7f95e8,...) at _cv_wait_sig+0x260 seltdwait(ca7f95e8,58,c7dc4e80,ca8252e0,8,...) at seltdwait+0xa2 kern_select(ca8252e0,9,2847f0ac,0,0,0,20,cac6e84c,0) at kern_select+0x655 sys_select(ca8252e0,f27cdcec,c0fe02ca,c0f96d96,246,...) at sys_select+0x66 syscall(f27cdd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a96d3, esp = 0xbfbfe29c, ebp = 0xbfbfede8 --- Tracing command devd pid 838 tid 100099 td 0xc81858a0 sched_switch(c81858a0,0,104,1a3,cd769a86,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c81858a0,0,c0f93f60,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a4bc7a,ca80e790,0,c0f8c94f,c81858a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca80e7a4,0,f2764a58,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca80e7a4,ca80e790,c0f966b0,6b2,ca8429d8,...) at _cv_wait_sig+0x260 seltdwait(ca8429d8,58,c7dc4e80,c81858a0,ca7e3e80,...) at seltdwait+0xa2 kern_select(c81858a0,5,bfbfe960,0,0,0,20,cab7b84c,34) at kern_select+0x655 sys_select(c81858a0,f2764cec,c,c,206,...) at sys_select+0x66 syscall(f2764d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x809169b, esp = 0xbfbfe92c, ebp = 0xbfbfee08 --- Tracing command softdepflush pid 19 tid 100077 td 0xca6ceb80 sched_switch(ca6ceb80,0,104,1a3,423150dd,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,54,...) at mi_switch+0x1ff sleepq_switch(ca6ceb80,0,c0f93f60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c12a8540,54,c0fc481d,0,0,...) at sleepq_timedwait+0x6b _sleep(c12a8540,c12a8500,54,c0fc481d,3e8,...) at _sleep+0x36a softdep_flush(0,ee320d28,c0f88c30,3db,ca6c1000,...) at softdep_flush+0x266 fork_exit(c0c9b9f0,0,ee320d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee320d60, ebp = 0 --- Tracing command vnlru pid 18 tid 100076 td 0xc805e8a0 sched_switch(c805e8a0,0,104,1a3,21933791,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,60,...) at mi_switch+0x1ff sleepq_switch(c805e8a0,0,c0f93f60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(ca6c12c4,60,c0f9ef7d,0,0,...) at sleepq_timedwait+0x6b _sleep(ca6c12c4,c12a21f4,260,c0f9ef7d,3e8,...) at _sleep+0x36a vnlru_proc(0,ee31dd28,c0f88c30,3db,ca6c12c4,...) at vnlru_proc+0xe7 fork_exit(c0afd9c0,0,ee31dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee31dd60, ebp = 0 --- Tracing command syncer pid 17 tid 100075 td 0xc805eb80 sched_switch(c805eb80,0,104,1a3,47a9acf3,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c805eb80,0,c0f93f60,28b,c805eb80,...) at sleepq_switch+0x162 sleepq_timedwait(c12a2234,0,ee31ac78,1,0,...) at sleepq_timedwait+0x6b _cv_timedwait(c12a2234,c12a2220,3e8,78b,4e20,...) at _cv_timedwait+0x270 sched_sync(0,ee31ad28,c0f88c30,3db,ca6c1588,...) at sched_sync+0x595 fork_exit(c0afcd30,0,ee31ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee31ad60, ebp = 0 --- Tracing command bufdaemon pid 16 tid 100074 td 0xc8183000 sched_switch(c8183000,0,104,1a3,20d2b884,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,54,...) at mi_switch+0x1ff sleepq_switch(c8183000,0,c0f93f60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c12a1ec8,54,c0f9beb1,0,0,...) at sleepq_timedwait+0x6b _sleep(c12a1ec8,c12a1ed0,54,c0f9beb1,3e8,...) at _sleep+0x36a buf_daemon(0,ee317d28,c0f88c30,3db,ca6c184c,...) at buf_daemon+0x175 fork_exit(c0ae1500,0,ee317d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee317d60, ebp = 0 --- Tracing command pagezero pid 9 tid 100073 td 0xc81832e0 sched_switch(c81832e0,0,104,1a3,1de4bf13,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c81832e0,0,c0f93f60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c12aa3dc,0,c0fcb83e,0,0,...) at sleepq_timedwait+0x6b _sleep(c12aa3dc,c12a8e80,0,c0fcb83e,493e0,...) at _sleep+0x36a vm_pagezero(0,ee314d28,c0f88c30,3db,ca6c1b10,...) at vm_pagezero+0xdc fork_exit(c0ce2b90,0,ee314d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee314d60, ebp = 0 --- Tracing command vmdaemon pid 8 tid 100072 td 0xc81835c0 sched_switch(c81835c0,0,104,1a3,1dd52a29,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,74,...) at mi_switch+0x1ff sleepq_switch(c81835c0,0,c0f93f60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c12a9fc8,74,c0f9beb1,0,0,...) at sleepq_wait+0x63 _sleep(c12a9fc8,c12a9fcc,74,c0f9beb1,0,...) at _sleep+0x39c vm_daemon(0,ee311d28,c0f88c30,3db,ca6c2000,...) at vm_daemon+0x59 fork_exit(c0cdc4a0,0,ee311d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee311d60, ebp = 0 --- Tracing command pagedaemon pid 7 tid 100071 td 0xc81838a0 sched_switch(c81838a0,0,104,1a3,20d2fd0b,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,54,...) at mi_switch+0x1ff sleepq_switch(c81838a0,0,c0f93f60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c12a9f90,54,c0f9beb1,0,0,...) at sleepq_timedwait+0x6b _sleep(c12a9f90,c12a8e80,54,c0f9beb1,1388,...) at _sleep+0x36a vm_pageout(0,ee30ed28,c0f88c30,3db,c7dc82c4,...) at vm_pageout+0x2c7 fork_exit(c0cdd560,0,ee30ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee30ed60, ebp = 0 --- Tracing command xpt_thrd pid 6 tid 100070 td 0xc8183b80 sched_switch(c8183b80,0,104,1a3,94cad03f,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c8183b80,0,c0f93f60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c10f0854,5c,c0de94a7,0,0,...) at sleepq_wait+0x63 _sleep(c10f0854,c10f0898,5c,c0de94a7,0,...) at _sleep+0x39c xpt_scanner_thread(0,ee18bd28,c0f88c30,3db,c7dc8588,...) at xpt_scanner_thread+0x47 fork_exit(c049d5e0,0,ee18bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee18bd60, ebp = 0 --- Tracing command sctp_iterator pid 5 tid 100069 td 0xc8184000 sched_switch(c8184000,0,104,1a3,e9995fef,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8184000,0,c0f93f60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c12a3d58,0,c0fb261f,0,0,...) at sleepq_wait+0x63 _sleep(c12a3d58,c12a3d20,0,c0fb261f,0,...) at _sleep+0x39c sctp_iterator_thread(0,ee188d28,c0f88c30,3db,c7dc884c,...) at sctp_iterator_thread+0x5c fork_exit(c0b8f1f0,0,ee188d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee188d60, ebp = 0 --- Tracing command ctl_thrd pid 4 tid 100067 td 0xc81845c0 sched_switch(c81845c0,0,104,1a3,83a74e35,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c81845c0,0,c0f93f60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c819a000,5c,c0df3eb2,0,0,...) at sleepq_wait+0x63 _sleep(c819a000,c819a000,5c,c0df3eb2,0,...) at _sleep+0x39c ctl_work_thread(c819a000,ee182d28,c0f88c30,3db,c7dc8b10,...) at ctl_work_thread+0x22f6 fork_exit(c04c6a00,c819a000,ee182d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee182d60, ebp = 0 --- Tracing command fdc0 pid 3 tid 100064 td 0xc8185000 sched_switch(c8185000,0,104,1a3,33b5189a,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c8185000,0,c0f93f60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c7ffa03c,5c,c0f80f32,0,0,...) at sleepq_timedwait+0x6b _sleep(c7ffa03c,c7ffa0f0,5c,c0f80f32,3e8,...) at _sleep+0x36a fdc_thread(c7ffa000,ee179d28,c0f88c30,3db,c8042000,...) at fdc_thread+0x27d fork_exit(c0d61dd0,c7ffa000,ee179d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee179d60, ebp = 0 --- Tracing command fw0_probe pid 2 tid 100062 td 0xc80515c0 sched_switch(c80515c0,0,104,1a3,94caef02,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(c80515c0,0,c0f93f60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f93f60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c808f000,6c,c0f80f32,100,0,...) at sleepq_wait_sig+0x17 _sleep(c808f000,c8093488,16c,c0f80f32,0,...) at _sleep+0x385 fw_bus_probe_thread(c808f000,ee169d28,c0f88c30,3db,c80422c4,...) at fw_bus_probe_thread+0xa08 fork_exit(c06f10c0,c808f000,ee169d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee169d60, ebp = 0 --- Tracing command usb pid 15 tid 100058 td 0xc805c2e0 sched_switch(c805c2e0,0,104,1a3,83a2256a,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c805c2e0,0,c0f93f60,268,c805c2e0,...) at sleepq_switch+0x162 sleepq_wait(c8063d34,0,ee152cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8063d34,c8063e4c,c0f675f1,74,c8063d3c,...) at _cv_wait+0x260 usb_process(c8063d2c,ee152d28,c0f88c30,3db,c8042588,...) at usb_process+0x1a3 fork_exit(c08fe090,c8063d2c,ee152d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee152d60, ebp = 0 --- Tracing command usb pid 15 tid 100057 td 0xc805c5c0 sched_switch(c805c5c0,0,104,1a3,81edbe9d,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c805c5c0,0,c0f93f60,268,c805c5c0,...) at sleepq_switch+0x162 sleepq_wait(c8063d04,0,ee14fcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8063d04,c8063e4c,c0f675f1,74,c8063d0c,...) at _cv_wait+0x260 usb_process(c8063cfc,ee14fd28,c0f88c30,3db,c8042588,...) at usb_process+0x1a3 fork_exit(c08fe090,c8063cfc,ee14fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee14fd60, ebp = 0 --- Tracing command usb pid 15 tid 100056 td 0xc805c8a0 sched_switch(c805c8a0,0,104,1a3,833b6856,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c805c8a0,0,c0f93f60,268,c805c8a0,...) at sleepq_switch+0x162 sleepq_wait(c8063cd4,0,ee14ccac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8063cd4,c8063e4c,c0f675f1,74,c8063cdc,...) at _cv_wait+0x260 usb_process(c8063ccc,ee14cd28,c0f88c30,3db,c8042588,...) at usb_process+0x1a3 fork_exit(c08fe090,c8063ccc,ee14cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee14cd60, ebp = 0 --- Tracing command usb pid 15 tid 100055 td 0xc805cb80 sched_switch(c805cb80,0,104,1a3,833b548c,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c805cb80,0,c0f93f60,268,c805cb80,...) at sleepq_switch+0x162 sleepq_wait(c8063ca4,0,ee149cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8063ca4,c8063e4c,c0f675f1,74,c8063cac,...) at _cv_wait+0x260 usb_process(c8063c9c,ee149d28,c0f88c30,3db,c8042588,...) at usb_process+0x1a3 fork_exit(c08fe090,c8063c9c,ee149d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee149d60, ebp = 0 --- Tracing command usb pid 15 tid 100053 td 0xc805e2e0 sched_switch(c805e2e0,0,104,1a3,833b3d6f,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c805e2e0,0,c0f93f60,268,c805e2e0,...) at sleepq_switch+0x162 sleepq_wait(c8056b5c,0,ee140cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8056b5c,c8056c74,c0f675f1,74,c8056b64,...) at _cv_wait+0x260 usb_process(c8056b54,ee140d28,c0f88c30,3db,c8042588,...) at usb_process+0x1a3 fork_exit(c08fe090,c8056b54,ee140d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee140d60, ebp = 0 --- Tracing command usb pid 15 tid 100052 td 0xc805e5c0 sched_switch(c805e5c0,0,104,1a3,77f2cea9,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c805e5c0,0,c0f93f60,268,c805e5c0,...) at sleepq_switch+0x162 sleepq_wait(c8056b2c,0,ee13dcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8056b2c,c8056c74,c0f675f1,74,c8056b34,...) at _cv_wait+0x260 usb_process(c8056b24,ee13dd28,c0f88c30,3db,c8042588,...) at usb_process+0x1a3 fork_exit(c08fe090,c8056b24,ee13dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee13dd60, ebp = 0 --- Tracing command usb pid 15 tid 100051 td 0xc804e000 sched_switch(c804e000,0,104,1a3,7c250aed,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c804e000,0,c0f93f60,268,c804e000,...) at sleepq_switch+0x162 sleepq_wait(c8056afc,0,ee13acac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8056afc,c8056c74,c0f675f1,74,c8056b04,...) at _cv_wait+0x260 usb_process(c8056af4,ee13ad28,c0f88c30,3db,c8042588,...) at usb_process+0x1a3 fork_exit(c08fe090,c8056af4,ee13ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee13ad60, ebp = 0 --- Tracing command usb pid 15 tid 100050 td 0xc804e2e0 sched_switch(c804e2e0,0,104,1a3,7c24f98c,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c804e2e0,0,c0f93f60,268,c804e2e0,...) at sleepq_switch+0x162 sleepq_wait(c8056acc,0,ee137cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8056acc,c8056c74,c0f675f1,74,c8056ad4,...) at _cv_wait+0x260 usb_process(c8056ac4,ee137d28,c0f88c30,3db,c8042588,...) at usb_process+0x1a3 fork_exit(c08fe090,c8056ac4,ee137d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee137d60, ebp = 0 --- Tracing command usb pid 15 tid 100049 td 0xc804e5c0 sched_switch(c804e5c0,0,104,1a3,7c24e44a,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c804e5c0,0,c0f93f60,268,c804e5c0,...) at sleepq_switch+0x162 sleepq_wait(c8052b5c,0,ee133cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8052b5c,c8052c74,c0f675f1,74,c8052b64,...) at _cv_wait+0x260 usb_process(c8052b54,ee133d28,c0f88c30,3db,c8042588,...) at usb_process+0x1a3 fork_exit(c08fe090,c8052b54,ee133d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee133d60, ebp = 0 --- Tracing command usb pid 15 tid 100048 td 0xc804e8a0 sched_switch(c804e8a0,0,104,1a3,76724c06,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c804e8a0,0,c0f93f60,268,c804e8a0,...) at sleepq_switch+0x162 sleepq_wait(c8052b2c,0,ee130cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8052b2c,c8052c74,c0f675f1,74,c8052b34,...) at _cv_wait+0x260 usb_process(c8052b24,ee130d28,c0f88c30,3db,c8042588,...) at usb_process+0x1a3 fork_exit(c08fe090,c8052b24,ee130d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee130d60, ebp = 0 --- Tracing command usb pid 15 tid 100047 td 0xc804eb80 sched_switch(c804eb80,0,104,1a3,7bc12ce8,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c804eb80,0,c0f93f60,268,c804eb80,...) at sleepq_switch+0x162 sleepq_wait(c8052afc,0,ee12dcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8052afc,c8052c74,c0f675f1,74,c8052b04,...) at _cv_wait+0x260 usb_process(c8052af4,ee12dd28,c0f88c30,3db,c8042588,...) at usb_process+0x1a3 fork_exit(c08fe090,c8052af4,ee12dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee12dd60, ebp = 0 --- Tracing command usb pid 15 tid 100046 td 0xc804f000 sched_switch(c804f000,0,104,1a3,7bc119f6,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c804f000,0,c0f93f60,268,c804f000,...) at sleepq_switch+0x162 sleepq_wait(c8052acc,0,ee12acac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8052acc,c8052c74,c0f675f1,74,c8052ad4,...) at _cv_wait+0x260 usb_process(c8052ac4,ee12ad28,c0f88c30,3db,c8042588,...) at usb_process+0x1a3 fork_exit(c08fe090,c8052ac4,ee12ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee12ad60, ebp = 0 --- Tracing command usb pid 15 tid 100045 td 0xc804f2e0 sched_switch(c804f2e0,0,104,1a3,7bc1070a,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c804f2e0,0,c0f93f60,268,c804f2e0,...) at sleepq_switch+0x162 sleepq_wait(c804ab5c,0,ee126cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c804ab5c,c804ac74,c0f675f1,74,c804ab64,...) at _cv_wait+0x260 usb_process(c804ab54,ee126d28,c0f88c30,3db,c8042588,...) at usb_process+0x1a3 fork_exit(c08fe090,c804ab54,ee126d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee126d60, ebp = 0 --- Tracing command usb pid 15 tid 100044 td 0xc804f5c0 sched_switch(c804f5c0,0,104,1a3,7544430a,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c804f5c0,0,c0f93f60,268,c804f5c0,...) at sleepq_switch+0x162 sleepq_wait(c804ab2c,0,ee123cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c804ab2c,c804ac74,c0f675f1,74,c804ab34,...) at _cv_wait+0x260 usb_process(c804ab24,ee123d28,c0f88c30,3db,c8042588,...) at usb_process+0x1a3 fork_exit(c08fe090,c804ab24,ee123d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee123d60, ebp = 0 --- Tracing command usb pid 15 tid 100043 td 0xc804f8a0 sched_switch(c804f8a0,0,104,1a3,7b5d9d7c,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c804f8a0,0,c0f93f60,268,c804f8a0,...) at sleepq_switch+0x162 sleepq_wait(c804aafc,0,ee120cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c804aafc,c804ac74,c0f675f1,74,c804ab04,...) at _cv_wait+0x260 usb_process(c804aaf4,ee120d28,c0f88c30,3db,c8042588,...) at usb_process+0x1a3 fork_exit(c08fe090,c804aaf4,ee120d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee120d60, ebp = 0 --- Tracing command usb pid 15 tid 100042 td 0xc804fb80 sched_switch(c804fb80,0,104,1a3,7b5d871b,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c804fb80,0,c0f93f60,268,c804fb80,...) at sleepq_switch+0x162 sleepq_wait(c804aacc,0,ee11dcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c804aacc,c804ac74,c0f675f1,74,c804aad4,...) at _cv_wait+0x260 usb_process(c804aac4,ee11dd28,c0f88c30,3db,c8042588,...) at usb_process+0x1a3 fork_exit(c08fe090,c804aac4,ee11dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee11dd60, ebp = 0 --- Tracing command usb pid 15 tid 100040 td 0xc803e000 sched_switch(c803e000,0,104,1a3,7b5d720a,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c803e000,0,c0f93f60,268,c803e000,...) at sleepq_switch+0x162 sleepq_wait(c8044b5c,0,ee116cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8044b5c,c8044c74,c0f675f1,74,c8044b64,...) at _cv_wait+0x260 usb_process(c8044b54,ee116d28,c0f88c30,3db,c8042588,...) at usb_process+0x1a3 fork_exit(c08fe090,c8044b54,ee116d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee116d60, ebp = 0 --- Tracing command usb pid 15 tid 100039 td 0xc803e2e0 sched_switch(c803e2e0,0,104,1a3,73fa8ec2,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c803e2e0,0,c0f93f60,268,c803e2e0,...) at sleepq_switch+0x162 sleepq_wait(c8044b2c,0,ee113cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8044b2c,c8044c74,c0f675f1,74,c8044b34,...) at _cv_wait+0x260 usb_process(c8044b24,ee113d28,c0f88c30,3db,c8042588,...) at usb_process+0x1a3 fork_exit(c08fe090,c8044b24,ee113d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee113d60, ebp = 0 --- Tracing command usb pid 15 tid 100038 td 0xc803e5c0 sched_switch(c803e5c0,0,104,1a3,7af9f126,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c803e5c0,0,c0f93f60,268,c803e5c0,...) at sleepq_switch+0x162 sleepq_wait(c8044afc,0,ee110cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8044afc,c8044c74,c0f675f1,74,c8044b04,...) at _cv_wait+0x260 usb_process(c8044af4,ee110d28,c0f88c30,3db,c8042588,...) at usb_process+0x1a3 fork_exit(c08fe090,c8044af4,ee110d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee110d60, ebp = 0 --- Tracing command usb pid 15 tid 100037 td 0xc803e8a0 sched_switch(c803e8a0,0,104,1a3,7af9dde6,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c803e8a0,0,c0f93f60,268,c803e8a0,...) at sleepq_switch+0x162 sleepq_wait(c8044acc,0,ee10dcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8044acc,c8044c74,c0f675f1,74,c8044ad4,...) at _cv_wait+0x260 usb_process(c8044ac4,ee10dd28,c0f88c30,3db,c8042588,...) at usb_process+0x1a3 fork_exit(c08fe090,c8044ac4,ee10dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee10dd60, ebp = 0 --- Tracing command usb pid 15 tid 100035 td 0xc8040000 sched_switch(c8040000,0,104,1a3,7af9c8cd,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8040000,0,c0f93f60,268,c8040000,...) at sleepq_switch+0x162 sleepq_wait(c8038b5c,0,ee106cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8038b5c,c8038c74,c0f675f1,74,c8038b64,...) at _cv_wait+0x260 usb_process(c8038b54,ee106d28,c0f88c30,3db,c8042588,...) at usb_process+0x1a3 fork_exit(c08fe090,c8038b54,ee106d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee106d60, ebp = 0 --- Tracing command usb pid 15 tid 100034 td 0xc80402e0 sched_switch(c80402e0,0,104,1a3,72279f59,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80402e0,0,c0f93f60,268,c80402e0,...) at sleepq_switch+0x162 sleepq_wait(c8038b2c,0,ee103cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8038b2c,c8038c74,c0f675f1,74,c8038b34,...) at _cv_wait+0x260 usb_process(c8038b24,ee103d28,c0f88c30,3db,c8042588,...) at usb_process+0x1a3 fork_exit(c08fe090,c8038b24,ee103d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee103d60, ebp = 0 --- Tracing command usb pid 15 tid 100033 td 0xc80405c0 sched_switch(c80405c0,0,104,1a3,7a951a2b,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80405c0,0,c0f93f60,268,c80405c0,...) at sleepq_switch+0x162 sleepq_wait(c8038afc,0,ee100cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8038afc,c8038c74,c0f675f1,74,c8038b04,...) at _cv_wait+0x260 usb_process(c8038af4,ee100d28,c0f88c30,3db,c8042588,...) at usb_process+0x1a3 fork_exit(c08fe090,c8038af4,ee100d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee100d60, ebp = 0 --- Tracing command usb pid 15 tid 100032 td 0xc80408a0 sched_switch(c80408a0,0,104,1a3,7a950672,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80408a0,0,c0f93f60,268,c80408a0,...) at sleepq_switch+0x162 sleepq_wait(c8038acc,0,ee0fdcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8038acc,c8038c74,c0f675f1,74,c8038ad4,...) at _cv_wait+0x260 usb_process(c8038ac4,ee0fdd28,c0f88c30,3db,c8042588,...) at usb_process+0x1a3 fork_exit(c08fe090,c8038ac4,ee0fdd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee0fdd60, ebp = 0 --- Tracing command yarrow pid 14 tid 100017 td 0xc7eda5c0 sched_switch(c7eda5c0,0,104,1a3,48002e46,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7eda5c0,0,c0f93f60,28b,2,...) at sleepq_switch+0x162 sleepq_timedwait(c112ae64,0,c0f80f32,2,0,...) at sleepq_timedwait+0x6b _sleep(c112ae64,0,0,c0f80f32,64) at _sleep+0x36a pause(c0f80f32,64,c0f433b0,111,0,...) at pause+0xa0 random_kthread(0,c7b51d28,c0f88c30,3db,c7dc7000,...) at random_kthread+0x1ef fork_exit(c0806320,0,c7b51d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b51d60, ebp = 0 --- Tracing command geom pid 13 tid 100015 td 0xc7edab80 sched_switch(c7edab80,0,104,1a3,4ca793d3,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c7edab80,0,c0f93f60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c1128a68,5c,c0f80f32,0,0,...) at sleepq_wait+0x63 _sleep(c1128a68,c11289c8,25c,c0f80f32,0,...) at _sleep+0x39c g_io_schedule_down(c7edab80,0,c0f82a81,6c,c7b4bd14,...) at g_io_schedule_down+0x5b g_down_procbody(0,c7b4bd28,c0f88c30,3db,c7dc72c4,...) at g_down_procbody+0x9d fork_exit(c09ef790,0,c7b4bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b4bd60, ebp = 0 --- Tracing command geom pid 13 tid 100014 td 0xc7edb000 sched_switch(c7edb000,0,104,1a3,4d57b624,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c7edb000,0,c0f93f60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c1128a64,5c,c0f80f32,0,0,...) at sleepq_wait+0x63 _sleep(c1128a64,c11289e8,25c,c0f80f32,0,...) at _sleep+0x39c g_io_schedule_up(c7edb000,0,c0f82a81,5f,c7b48d14,...) at g_io_schedule_up+0x134 g_up_procbody(0,c7b48d28,c0f88c30,3db,c7dc72c4,...) at g_up_procbody+0x9d fork_exit(c09ef830,0,c7b48d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b48d60, ebp = 0 --- Tracing command geom pid 13 tid 100013 td 0xc7dca2e0 sched_switch(c7dca2e0,0,104,1a3,3dfa5cda,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c7dca2e0,0,c0f93f60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c1128a5c,5c,c0f80f32,0,0,...) at sleepq_wait+0x63 _sleep(c1128a5c,c112898c,25c,c0f80f32,0,...) at _sleep+0x39c g_run_events(c1138cc0,0,c0f82a81,79,c7b45d14,...) at g_run_events+0x54b g_event_procbody(0,c7b45d28,c0f88c30,3db,c7dc72c4,...) at g_event_procbody+0x90 fork_exit(c09ef8d0,0,c7b45d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b45d60, ebp = 0 --- Tracing command intr pid 12 tid 100066 td 0xc81848a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100065 td 0xc8184b80 sched_switch(c8184b80,0,109,1a3,7a90ae2f,...) at sched_switch+0x3ec mi_switch(109,0,c0f88f53,554,c8184b80,...) at mi_switch+0x1ff ithread_loop(c7e12680,ee17cd28,c0f88c30,3db,c7dc7588,...) at ithread_loop+0x1fb fork_exit(c0a322d0,c7e12680,ee17cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee17cd60, ebp = 0 --- Tracing command intr pid 12 tid 100063 td 0xc80512e0 sched_switch(c80512e0,0,109,1a3,47ad37e2,...) at sched_switch+0x3ec mi_switch(109,0,c0f88f53,554,c80512e0,...) at mi_switch+0x1ff ithread_loop(c7e12690,ee16cd28,c0f88c30,3db,c7dc7588,...) at ithread_loop+0x1fb fork_exit(c0a322d0,c7e12690,ee16cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee16cd60, ebp = 0 --- Tracing command intr pid 12 tid 100060 td 0xc8051b80 sched_switch(c8051b80,0,109,1a3,6a8253e3,...) at sched_switch+0x3ec mi_switch(109,0,c0f88f53,554,c8051b80,...) at mi_switch+0x1ff ithread_loop(c7e126a0,ee160d28,c0f88c30,3db,c7dc7588,...) at ithread_loop+0x1fb fork_exit(c0a322d0,c7e126a0,ee160d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee160d60, ebp = 0 --- Tracing command intr pid 12 tid 100059 td 0xc805c000 sched_switch(c805c000,0,109,1a3,1be43507,...) at sched_switch+0x3ec mi_switch(109,0,c0f88f53,554,c805c000,...) at mi_switch+0x1ff ithread_loop(c7e126b0,ee158d28,c0f88c30,3db,c7dc7588,...) at ithread_loop+0x1fb fork_exit(c0a322d0,c7e126b0,ee158d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee158d60, ebp = 0 --- Tracing command intr pid 12 tid 100054 td 0xc805e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xc8051000 sched_switch(c8051000,0,109,1a3,9bc5cad5,...) at sched_switch+0x3ec mi_switch(109,0,c0f88f53,554,c8051000,...) at mi_switch+0x1ff ithread_loop(c7e126d0,ee11ad28,c0f88c30,3db,c7dc7588,...) at ithread_loop+0x1fb fork_exit(c0a322d0,c7e126d0,ee11ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee11ad60, ebp = 0 --- Tracing command intr pid 12 tid 100036 td 0xc803eb80 sched_switch(c803eb80,0,109,1a3,9a7c329a,...) at sched_switch+0x3ec mi_switch(109,0,c0f88f53,554,c803eb80,...) at mi_switch+0x1ff ithread_loop(c7e126e0,ee10ad28,c0f88c30,3db,c7dc7588,...) at ithread_loop+0x1fb fork_exit(c0a322d0,c7e126e0,ee10ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee10ad60, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xc8040b80 sched_switch(c8040b80,0,109,1a3,27a93ee8,...) at sched_switch+0x3ec mi_switch(109,0,c0f88f53,554,c8040b80,...) at mi_switch+0x1ff ithread_loop(c7e126f0,ee0fad28,c0f88c30,3db,c7dc7588,...) at ithread_loop+0x1fb fork_exit(c0a322d0,c7e126f0,ee0fad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee0fad60, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc7edb2e0 sched_switch(c7edb2e0,0,109,1a3,4d55f866,...) at sched_switch+0x3ec mi_switch(109,0,c0f88f53,554,c7edb2e0,...) at mi_switch+0x1ff ithread_loop(c7e12700,edfa4d28,c0f88c30,3db,c7dc7588,...) at ithread_loop+0x1fb fork_exit(c0a322d0,c7e12700,edfa4d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xedfa4d60, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc7edb5c0 sched_switch(c7edb5c0,0,109,1a3,4a7ff186,...) at sched_switch+0x3ec mi_switch(109,0,c0f88f53,554,c7edb5c0,...) at mi_switch+0x1ff ithread_loop(c7e12710,edfa0d28,c0f88c30,3db,c7dc7588,...) at ithread_loop+0x1fb fork_exit(c0a322d0,c7e12710,edfa0d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xedfa0d60, ebp = 0 --- Tracing command intr pid 12 tid 100028 td 0xc7edb8a0 sched_switch(c7edb8a0,0,109,1a3,6c614954,...) at sched_switch+0x3ec mi_switch(109,0,c0f88f53,554,c7edb8a0,...) at mi_switch+0x1ff ithread_loop(c7e12720,c7ba0d28,c0f88c30,3db,c7dc7588,...) at ithread_loop+0x1fb fork_exit(c0a322d0,c7e12720,c7ba0d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7ba0d60, ebp = 0 --- Tracing command intr pid 12 tid 100027 td 0xc7edbb80 sched_switch(c7edbb80,0,109,1a3,c03b96ad,...) at sched_switch+0x3ec mi_switch(109,0,c0f88f53,554,c7edbb80,...) at mi_switch+0x1ff ithread_loop(c7e12730,c7b6fd28,c0f88c30,3db,c7dc7588,...) at ithread_loop+0x1fb fork_exit(c0a322d0,c7e12730,c7b6fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b6fd60, ebp = 0 --- Tracing command intr pid 12 tid 100026 td 0xc7fc3000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100024 td 0xc7fc35c0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100023 td 0xc7fc38a0 sched_switch(c7fc38a0,0,109,1a3,4d56d6bc,...) at sched_switch+0x3ec mi_switch(109,0,c0f88f53,554,c7fc38a0,...) at mi_switch+0x1ff ithread_loop(c7e12760,c7b63d28,c0f88c30,3db,c7dc7588,...) at ithread_loop+0x1fb fork_exit(c0a322d0,c7e12760,c7b63d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b63d60, ebp = 0 --- Tracing command intr pid 12 tid 100012 td 0xc7dca5c0 sched_switch(c7dca5c0,0,109,1a3,47fbfb16,...) at sched_switch+0x3ec mi_switch(109,0,c0f88f53,554,c7dca5c0,...) at mi_switch+0x1ff ithread_loop(c7e127a0,c7b42d28,c0f88c30,3db,c7dc7588,...) at ithread_loop+0x1fb fork_exit(c0a322d0,c7e127a0,c7b42d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b42d60, ebp = 0 --- Tracing command intr pid 12 tid 100011 td 0xc7dca8a0 sched_switch(c7dca8a0,0,109,1a3,3d417628,...) at sched_switch+0x3ec mi_switch(109,0,c0f88f53,554,c7dca8a0,...) at mi_switch+0x1ff ithread_loop(c7e127b0,c7b3fd28,c0f88c30,3db,c7dc7588,...) at ithread_loop+0x1fb fork_exit(c0a322d0,c7e127b0,c7b3fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b3fd60, ebp = 0 --- Tracing command intr pid 12 tid 100010 td 0xc7dcab80 sched_switch(c7dcab80,0,109,1a3,34c7beee,...) at sched_switch+0x3ec mi_switch(109,0,c0f88f53,554,c7dcab80,...) at mi_switch+0x1ff ithread_loop(c7e127c0,c7b3cd28,c0f88c30,3db,c7dc7588,...) at ithread_loop+0x1fb fork_exit(c0a322d0,c7e127c0,c7b3cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b3cd60, ebp = 0 --- Tracing command intr pid 12 tid 100009 td 0xc7e13000 cpustop_handler(1,13,c7b39b50,c0dc1526,f5,...) at cpustop_handler+0x28 ipi_nmi_handler(f5,0,108f1f0,c0a4be50,c7dc7588,...) at ipi_nmi_handler+0x47 trap(c7b39b5c) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0a4be6f, esp = 0xc7b39b9c, ebp = 0xc7b39bb8 --- _mtx_lock_sleep(c112a710,c7e13000,0,c0f8c94f,94,...) at _mtx_lock_sleep+0xbf _mtx_lock_flags(c112a710,0,c0f8c94f,94,c7b39c90,...) at _mtx_lock_flags+0xff lock_mtx(c112a710,1,c0f8fc1e,216,23,...) at lock_mtx+0x29 softclock(c112c0a0,c7b39cb8,c0a4b81d,c1139340,c7e0e2b8,...) at softclock+0x1ea intr_event_execute_handlers(c7dc7588,c7e0e280,c0f88f53,55e,c7e13000,...) at intr_event_execute_handlers+0x125 ithread_loop(c7e127d0,c7b39d28,c0f88c30,3db,c7dc7588,...) at ithread_loop+0xa9 fork_exit(c0a322d0,c7e127d0,c7b39d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b39d60, ebp = 0 --- Tracing command intr pid 12 tid 100008 td 0xc7e132e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100007 td 0xc7e135c0 sched_switch(c7e135c0,0,109,1a3,be43aa7a,...) at sched_switch+0x3ec mi_switch(109,0,c0f88f53,554,c7e135c0,...) at mi_switch+0x1ff ithread_loop(c7e127f0,c7b33d28,c0f88c30,3db,c7dc7588,...) at ithread_loop+0x1fb fork_exit(c0a322d0,c7e127f0,c7b33d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b33d60, ebp = 0 --- Tracing command idle pid 11 tid 100006 td 0xc7dc9000 cpustop_handler(3,13,c7b2fc04,c0dc1526,417f44,...) at cpustop_handler+0x28 ipi_nmi_handler(417f44,c7b2fb98,0,c12d74e4,c7dc784c,...) at ipi_nmi_handler+0x47 trap(c7b2fc10) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0da5db5, esp = 0xc7b2fc50, ebp = 0xc7b2fc50 --- acpi_cpu_c1(c7b2fc6c,c10f0e30,3,301,d7,...) at acpi_cpu_c1+0x5 acpi_cpu_idle(0,c7b2fca0,c0db4049,0,ffffffff,...) at acpi_cpu_idle+0x122 cpu_idle_acpi(0,ffffffff,c113a040,2,c7b2fce8,...) at cpu_idle_acpi+0x2f cpu_idle(0,c7b2fcc4,c0f905e2,a0b,c7dc9000,...) at cpu_idle+0x89 sched_idletd(0,c7b2fd28,c0f88c30,3db,c7dc784c,...) at sched_idletd+0x263 fork_exit(c0a83100,0,c7b2fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b2fd60, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc7dc92e0 cpustop_handler(2,13,c7b2cc04,c0dc1526,0,...) at cpustop_handler+0x28 ipi_nmi_handler(0,16526d0,0,c12d71b8,c7dc784c,...) at ipi_nmi_handler+0x47 trap(c7b2cc10) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0da5db5, esp = 0xc7b2cc50, ebp = 0xc7b2cc50 --- acpi_cpu_c1(c7b2cc6c,c10f0e30,2,301,d7,...) at acpi_cpu_c1+0x5 acpi_cpu_idle(0,c7b2cca0,c0db4049,0,ffffffff,...) at acpi_cpu_idle+0x122 cpu_idle_acpi(0,ffffffff,c11399c0,2,c7b2cce8,...) at cpu_idle_acpi+0x2f cpu_idle(0,c7b2ccc4,c0f905e2,a0b,c7dc92e0,...) at cpu_idle+0x89 sched_idletd(0,c7b2cd28,c0f88c30,3db,c7dc784c,...) at sched_idletd+0x263 fork_exit(c0a83100,0,c7b2cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b2cd60, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc7dc95c0 sched_switch(c7dc95c0,0,608,19e,503a80ef,...) at sched_switch+0x3ec mi_switch(608,0,c0f8ed5f,cd,0,...) at mi_switch+0x1ff critical_exit(0,ffffffff,c1139340,2,c7b29ce8,...) at critical_exit+0xb5 cpu_idle(0,c7b29cc4,c0f905e2,a0b,c7dc95c0,...) at cpu_idle+0x97 sched_idletd(0,c7b29d28,c0f88c30,3db,c7dc784c,...) at sched_idletd+0x263 fork_exit(c0a83100,0,c7b29d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b29d60, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xc7dc98a0 sched_switch(c7dc98a0,0,608,19e,4d582f0d,...) at sched_switch+0x3ec mi_switch(608,0,c0f8ed5f,cd,0,...) at mi_switch+0x1ff critical_exit(0,ffffffff,c1138cc0,2,c7b26ce8,...) at critical_exit+0xb5 cpu_idle(0,c7b26cc4,c0f905e2,a0b,c7dc98a0,...) at cpu_idle+0x97 sched_idletd(0,c7b26d28,c0f88c30,3db,c7dc784c,...) at sched_idletd+0x263 fork_exit(c0a83100,0,c7b26d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b26d60, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc7dc9b80 sched_switch(c7dc9b80,0,104,1a3,3e0d0530,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(c7dc9b80,0,c0f93f60,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f93f60,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7dc7b10,6c,c0f96ea7,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7dc7b10,c7dc7b98,16c,c0f96ea7,0,...) at _sleep+0x385 kern_wait(c7dc9b80,ffffffff,c7b22c60,0,0,...) at kern_wait+0x626 sys_wait4(c7dc9b80,c7b22cec,c,c,286,...) at sys_wait4+0x3b syscall(c7b22d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x806020f, esp = 0xbfbfe8bc, ebp = 0xbfbfe8d8 --- Tracing command audit pid 10 tid 100001 td 0xc7dca000 sched_switch(c7dca000,0,104,1a3,7a933865,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7dca000,0,c0f93f60,268,c7dca000,...) at sleepq_switch+0x162 sleepq_wait(c12a7c80,0,c7b1fc8c,1,0,...) at sleepq_wait+0x63 _cv_wait(c12a7c80,c12a7c64,c0fbf237,194,0,...) at _cv_wait+0x260 audit_worker(0,c7b1fd28,c0f88c30,3db,c7dc8000,...) at audit_worker+0x84 fork_exit(c0c5c8a0,0,c7b1fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b1fd60, ebp = 0 --- Tracing command kernel pid 0 tid 100078 td 0xca6ce8a0 sched_switch(ca6ce8a0,0,104,1a3,1dd55020,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca6ce8a0,0,c0f93f60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c8035380,0,c0f80f32,0,0,...) at sleepq_wait+0x63 _sleep(c8035380,c8035398,0,c0f80f32,0,...) at _sleep+0x39c taskqueue_thread_loop(c13094e0,ee323d28,c0f88c30,3db,c1128b40,...) at taskqueue_thread_loop+0xb5 fork_exit(c0aa0390,c13094e0,ee323d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee323d60, ebp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xc81842e0 sched_switch(c81842e0,0,104,1a3,c86bbe05,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c81842e0,0,c0f93f60,28b,2,...) at sleepq_switch+0x162 sleepq_timedwait(c112ae64,0,c0f80f32,2,0,...) at sleepq_timedwait+0x6b _sleep(c112ae64,0,0,c0f80f32,bb8) at _sleep+0x36a pause(c0f80f32,bb8,124,122,c1128bc8,...) at pause+0xa0 deadlkres(0,ee185d28,c0f88c30,3db,c1128b40,...) at deadlkres+0x324 fork_exit(c0a11aa0,0,ee185d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee185d60, ebp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xc80518a0 sched_switch(c80518a0,0,104,1a3,497d5b8a,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80518a0,0,c0f93f60,268,c80518a0,...) at sleepq_switch+0x162 sleepq_wait(c80356c0,0,c0f8f281,c0f80f32,0,...) at sleepq_wait+0x63 msleep_spin(c80356c0,c80356d8,c0f80f32,0,c0f8c94f,...) at msleep_spin+0x259 taskqueue_thread_loop(c809349c,ee166d28,c0f88c30,3db,c1128b40,...) at taskqueue_thread_loop+0x8f fork_exit(c0aa0390,c809349c,ee166d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee166d60, ebp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xc7fc32e0 sched_switch(c7fc32e0,0,104,1a3,1c61bd7a,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7fc32e0,0,c0f93f60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7f9de80,0,c0f80f32,0,0,...) at sleepq_wait+0x63 _sleep(c7f9de80,c7f9de98,0,c0f80f32,0,...) at _sleep+0x39c taskqueue_thread_loop(c1147a2c,c7b69d28,c0f88c30,3db,c1128b40,...) at taskqueue_thread_loop+0xb5 fork_exit(c0aa0390,c1147a2c,c7b69d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b69d60, ebp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xc7fc3b80 sched_switch(c7fc3b80,0,104,1a3,94ceddef,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7fc3b80,0,c0f93f60,268,c7fc3b80,...) at sleepq_switch+0x162 sleepq_wait(c7f9e040,0,c0f8f281,c0f80f32,0,...) at sleepq_wait+0x63 msleep_spin(c7f9e040,c7f9e058,c0f80f32,0,c0f8c94f,...) at msleep_spin+0x259 taskqueue_thread_loop(c10f3ab8,c7b60d28,c0f88c30,3db,c1128b40,...) at taskqueue_thread_loop+0x8f fork_exit(c0aa0390,c10f3ab8,c7b60d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b60d60, ebp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xc7e138a0 sched_switch(c7e138a0,0,104,1a3,94cecfb5,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7e138a0,0,c0f93f60,268,c7e138a0,...) at sleepq_switch+0x162 sleepq_wait(c7f9e040,0,c0f8f281,c0f80f32,0,...) at sleepq_wait+0x63 msleep_spin(c7f9e040,c7f9e058,c0f80f32,0,c0f8c94f,...) at msleep_spin+0x259 taskqueue_thread_loop(c10f3ab8,c7b5dd28,c0f88c30,3db,c1128b40,...) at taskqueue_thread_loop+0x8f fork_exit(c0aa0390,c10f3ab8,c7b5dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b5dd60, ebp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xc7e13b80 sched_switch(c7e13b80,0,104,1a3,94cebeff,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7e13b80,0,c0f93f60,268,c7e13b80,...) at sleepq_switch+0x162 sleepq_wait(c7f9e040,0,c0f8f281,c0f80f32,0,...) at sleepq_wait+0x63 msleep_spin(c7f9e040,c7f9e058,c0f80f32,0,c0f8c94f,...) at msleep_spin+0x259 taskqueue_thread_loop(c10f3ab8,c7b5ad28,c0f88c30,3db,c1128b40,...) at taskqueue_thread_loop+0x8f fork_exit(c0aa0390,c10f3ab8,c7b5ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b5ad60, ebp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xc7eda000 sched_switch(c7eda000,0,104,1a3,94cb3d88,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7eda000,0,c0f93f60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7f9e080,0,c0f80f32,0,0,...) at sleepq_wait+0x63 _sleep(c7f9e080,c7f9e098,0,c0f80f32,0,...) at _sleep+0x39c taskqueue_thread_loop(c12a8264,c7b57d28,c0f88c30,3db,c1128b40,...) at taskqueue_thread_loop+0xb5 fork_exit(c0aa0390,c12a8264,c7b57d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b57d60, ebp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xc7eda2e0 sched_switch(c7eda2e0,0,104,1a3,94cb2e40,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7eda2e0,0,c0f93f60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7f9e0c0,0,c0f80f32,0,0,...) at sleepq_wait+0x63 _sleep(c7f9e0c0,c7f9e0d8,0,c0f80f32,0,...) at _sleep+0x39c taskqueue_thread_loop(c11294b8,c7b54d28,c0f88c30,3db,c1128b40,...) at taskqueue_thread_loop+0xb5 fork_exit(c0aa0390,c11294b8,c7b54d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b54d60, ebp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xc7eda8a0 sched_switch(c7eda8a0,0,104,1a3,58cefe63,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7eda8a0,0,c0f93f60,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7dade80,0,c0f80f32,0,0,...) at sleepq_wait+0x63 _sleep(c7dade80,c7dade98,0,c0f80f32,0,...) at _sleep+0x39c taskqueue_thread_loop(c1146440,c7b4ed28,c0f88c30,3db,c1128b40,...) at taskqueue_thread_loop+0xb5 fork_exit(c0aa0390,c1146440,c7b4ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b4ed60, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc1128e10 sched_switch(c1128e10,0,104,1a3,23142c3f,...) at sched_switch+0x3ec mi_switch(104,0,c0f93f60,1f3,54,...) at mi_switch+0x1ff sleepq_switch(c1128e10,0,c0f93f60,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1128b40,54,c0f90ef4,0,0,...) at sleepq_timedwait+0x6b _sleep(c1128b40,0,54,c0f90ef4,2710,...) at _sleep+0x36a scheduler(0,181ec00,181ec00,181e000,1825000,...) at scheduler+0x240 mi_startup() at mi_startup+0xac begin() at begin+0x2c db:0:allt> call doadump Physical memory: 3435 MB Dumping 162 MB: 147 131 115 99 83 67 51 35 19 3 Dump complete = 0 db:0:doadump> reset (kgdb) bt #0 doadump (textdump=0xf2839520) at pcpu.h:244 #1 0xc0510ec9 in db_fncall (dummy1=0xcb2c5964, dummy2=0x0, dummy3=0xffffffff, dummy4=0xf28395b4 "È\225\203ò") at ../../../ddb/db_command.c:573 #2 0xc05112ff in db_command (last_cmdp=0xc10f1c7c, cmd_table=0x0, dopager=0x0) at ../../../ddb/db_command.c:449 #3 0xc05113b4 in db_command_script (command=0xc10f2b88 "call doadump") at ../../../ddb/db_command.c:520 #4 0xc05157a0 in db_script_exec (scriptname=0xc10f24e0 "doadump", warnifnotfound=Variable "warnifnotfound" is not available. ) at ../../../ddb/db_script.c:302 #5 0xc0515831 in db_run_cmd (addr=0x1, have_addr=0x0, count=0xc12d4de0, modif=0xf28396ec "") at ../../../ddb/db_script.c:375 #6 0xc05112c1 in db_command (last_cmdp=0xc10f1c7c, cmd_table=0x0, dopager=0x1) at ../../../ddb/db_command.c:449 #7 0xc051141a in db_command_loop () at ../../../ddb/db_command.c:502 #8 0xc051340d in db_trap (type=0xc, code=0x0) at ../../../ddb/db_main.c:229 #9 0xc0a91b56 in kdb_trap (type=0xc, code=0x0, tf=0xf2839924) at ../../../kern/subr_kdb.c:629 #10 0xc0dc0bdf in trap_fatal (frame=0xf2839924, eva=0xa) at ../../../i386/i386/trap.c:966 #11 0xc0dc0cdc in trap_pfault (frame=0xf2839924, usermode=0x0, eva=0xa) at ../../../i386/i386/trap.c:839 #12 0xc0dc19b5 in trap (frame=0xf2839924) at ../../../i386/i386/trap.c:558 #13 0xc0daa3ec in calltrap () at ../../../i386/i386/exception.s:168 #14 0xcb2c5964 in null_nodeget (mp=0xcab42000, lowervp=0xcb026414, vpp=0xf2839a3c) at vnode_if.h:27 #15 0xcb2c622c in nullfs_mount (mp=0xcab42000) at /usr/src/sys/modules/nullfs/../../fs/nullfs/null_vfsops.c:155 #16 0xc0af192e in vfs_donmount (td=0xcadc35c0, fsflags=0x0, fsoptions=0xc7e09a00) at ../../../kern/vfs_mount.c:818 #17 0xc0af26cf in sys_nmount (td=0xcadc35c0, uap=0xf2839cec) at ../../../kern/vfs_mount.c:420 #18 0xc0dc1127 in syscall (frame=0xf2839d28) at subr_syscall.c:135 #19 0xc0daa451 in Xint0x80_syscall () at ../../../i386/i386/exception.s:266 #20 0x00000033 in ?? () (kgdb) f 14 #14 0xcb2c5964 in null_nodeget (mp=0xcab42000, lowervp=0xcb026414, vpp=0xf2839a3c) at vnode_if.h:27 27 a.a_vp = vp; (kgdb) l 22 struct vnode *vp) 23 { 24 struct vop_islocked_args a; 25 26 a.a_gen.a_desc = &vop_islocked_desc; 27 a.a_vp = vp; 28 return (VOP_ISLOCKED_APV(vp->v_op, &a)); 29 } 30 31 struct vop_lookup_args { (kgdb) p vp $5 = (struct vnode *) 0x2 (kgdb) up #15 0xcb2c622c in nullfs_mount (mp=0xcab42000) at /usr/src/sys/modules/nullfs/../../fs/nullfs/null_vfsops.c:155 155 error = null_nodeget(mp, lowerrootvp, &vp); (kgdb) info loc error = Variable "error" is not available. (kgdb) p lowerrootvp $6 = (struct vnode *) 0xcb026414 (kgdb) p *lowerrootvp $7 = {v_type = VDIR, v_tag = 0xc0f84b37 "ufs", v_op = 0xc10de2e0, v_data = 0xcace8d24, v_mount = 0xcab422d4, v_nmntvnodes = {tqe_next = 0xcb0262b8, tqe_prev = 0xcab42308}, v_un = {vu_mount = 0x0, vu_socket = 0x0, vu_cdev = 0x0, vu_fifoinfo = 0x0}, v_hashlist = {le_next = 0x0, le_prev = 0xca4477fc}, v_hash = 0x2, v_cache_src = {lh_first = 0xcb26f630}, v_cache_dst = {tqh_first = 0x0, tqh_last = 0xcb026444}, v_cache_dd = 0x0, v_cstart = 0x0, v_lasta = 0x0, v_lastw = 0x0, v_clen = 0x0, v_lock = {lock_object = {lo_name = 0xc0f84b37 "ufs", lo_flags = 0x57b0000, lo_data = 0x0, lo_witness = 0xc7d79610}, lk_lock = 0xcadc35c0, lk_exslpfail = 0x0, lk_timo = 0x33, lk_pri = 0x60, lk_stack = {depth = 0x10, pcs = {0xc0a43cde, 0xc0ca6491, 0xc0de4485, 0xc0b09f38, 0xc0afc9eb, 0xc0aec3fd, 0xc0c9f7f9, 0xc0c9fd7e, 0xc0cb4b28, 0xc0aedb91, 0xc0aee87f, 0xcb2c60f0, 0xc0af192e, 0xc0af26cf, 0xc0dc1127, 0xc0daa451, 0x0, 0x0}}}, v_interlock = {lock_object = {lo_name = 0xc0f96218 "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc7d721e0}, mtx_lock = 0x4}, v_vnlock = 0xcb02646c, v_holdcnt = 0x5, v_usecount = 0x1, v_iflag = 0x0, v_vflag = 0x1, v_writecount = 0x0, v_freelist = {tqe_next = 0x0, tqe_prev = 0xcb177918}, v_bufobj = {bo_mtx = {lock_object = {lo_name = 0xc0f9ef52 "bufobj interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc7d77c10}, mtx_lock = 0x4}, bo_clean = {bv_hd = {tqh_first = 0xe1944c80, tqh_last = 0xe1944cb8}, bv_root = 0xe1944c80, bv_cnt = 0x1}, bo_dirty = {bv_hd = {tqh_first = 0xe19447a0, tqh_last = 0xe19447d8}, bv_root = 0xe19447a0, bv_cnt = 0x1}, bo_numoutput = 0x0, bo_flag = 0x1, bo_ops = 0xc10cb500, bo_bsize = 0x4000, bo_object = 0xcb104870, bo_synclist = {le_next = 0x0, le_prev = 0xcab33968}, bo_private = 0xcb026414, __bo_vnode = 0xcb026414}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0} (kgdb) p *mp $8 = {mnt_mtx = {lock_object = {lo_name = 0xc0f806f1 "struct mount mtx", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc7d72450}, mtx_lock = 0x4}, mnt_gen = 0x1, mnt_list = {tqe_next = 0x0, tqe_prev = 0x0}, mnt_op = 0xcb2c8740, mnt_vfc = 0xcb2c8700, mnt_vnodecovered = 0xcace3828, mnt_syncer = 0x0, mnt_ref = 0x1, mnt_nvnodelist = {tqh_first = 0x0, tqh_last = 0xcab42034}, mnt_nvnodelistsize = 0x0, mnt_writeopcount = 0x0, mnt_kern_flag = 0x0, mnt_flag = 0x0, mnt_noasync = 0x0, mnt_opt = 0x0, mnt_optnew = 0xc7ee1390, mnt_maxsymlinklen = 0x0, mnt_stat = {f_version = 0x0, f_type = 0x29, f_flags = 0x0, f_bsize = 0x0, f_iosize = 0x0, f_blocks = 0x0, f_bfree = 0x0, f_bavail = 0x0, f_files = 0x0, f_ffree = 0x0, f_syncwrites = 0x0, f_asyncwrites = 0x0, f_syncreads = 0x0, f_asyncreads = 0x0, f_spare = {0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}, f_namemax = 0x0, f_owner = 0x0, f_fsid = {val = {0x0, 0x0}}, f_charspare = '\0' , f_fstypename = "nullfs\000\000\000\000\000\000\000\000\000", f_mntfromname = '\0' , f_mntonname = "/mnt", '\0' }, mnt_cred = 0xcae69880, mnt_data = 0x0, mnt_time = 0x0, mnt_iosize_max = 0x10000, mnt_export = 0x0, mnt_label = 0x0, mnt_hashseed = 0xc6f3666f, mnt_lockref = 0x1, mnt_secondary_writes = 0x0, mnt_secondary_accwrites = 0x0, mnt_susp_owner = 0x0, mnt_gjprovider = 0x0, mnt_explock = {lock_object = {lo_name = 0xc0f80702 "explock", lo_flags = 0x5730000, lo_data = 0x0, lo_witness = 0xc7d77ee8}, lk_lock = 0x1, lk_exslpfail = 0x0, lk_timo = 0x0, lk_pri = 0x60, lk_stack = {depth = 0x0, pcs = {0x0 }}}} (kgdb) $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/fs/nullfs/null_vnops.c =================================================================== --- /usr/src/sys/fs/nullfs/null_vnops.c (revision 232002) +++ /usr/src/sys/fs/nullfs/null_vnops.c (working copy) @@ -697,12 +697,18 @@ null_inactive(struct vop_inactive_args *ap) static int null_reclaim(struct vop_reclaim_args *ap) { - struct vnode *vp = ap->a_vp; - struct null_node *xp = VTONULL(vp); - struct vnode *lowervp = xp->null_lowervp; + struct vnode *vp; + struct null_node *xp; + struct vnode *lowervp; - if (lowervp) - null_hashrem(xp); + vp = ap->a_vp; + xp = VTONULL(vp); + lowervp = xp->null_lowervp; + + KASSERT(lowervp != NULL && vp->v_vnlock != &vp->v_lock, + ("Reclaiming inclomplete null vnode %p", vp)); + + null_hashrem(xp); /* * Use the interlock to protect the clearing of v_data to * prevent faults in null_lock(). @@ -713,10 +719,7 @@ null_reclaim(struct vop_reclaim_args *ap) vp->v_object = NULL; vp->v_vnlock = &vp->v_lock; VI_UNLOCK(vp); - if (lowervp) - vput(lowervp); - else - panic("null_reclaim: reclaiming a node with no lowervp"); + vput(lowervp); free(xp, M_NULLFSNODE); return (0); Index: /usr/src/sys/fs/nullfs/null_subr.c =================================================================== --- /usr/src/sys/fs/nullfs/null_subr.c (revision 232002) +++ /usr/src/sys/fs/nullfs/null_subr.c (working copy) @@ -169,19 +169,28 @@ null_hashins(mp, xp) } static void -null_insmntque_dtr(struct vnode *vp, void *xp) +null_destroy_proto(struct vnode *vp, void *xp) { - vput(((struct null_node *)xp)->null_lowervp); + VI_LOCK(vp); vp->v_data = NULL; vp->v_vnlock = &vp->v_lock; - free(xp, M_NULLFSNODE); vp->v_op = &dead_vnodeops; + VI_UNLOCK(vp); (void) vn_lock(vp, LK_EXCLUSIVE | LK_RETRY); vgone(vp); vput(vp); + free(xp, M_NULLFSNODE); } +static void +null_insmntque_dtr(struct vnode *vp, void *xp) +{ + + vput(((struct null_node *)xp)->null_lowervp); + null_destroy_proto(vp, xp); +} + /* * Make a new or get existing nullfs node. * Vp is the alias vnode, lowervp is the lower vnode. @@ -211,14 +220,34 @@ null_nodeget(mp, lowervp, vpp) } /* + * The insmntque1() call below requires the exclusive lock on + * the nullfs vnode, and since vnode lock for upper and lower + * vnodes are the same, upgrade the lower vnode lock. + */ + if (VOP_ISLOCKED(vp) != LK_EXCLUSIVE) { + vn_lock(vp, LK_UPGRADE | LK_RETRY); + if ((vp->v_iflag & VI_DOOMED) != 0) { + vput(lowervp); + return (EBADF); + } + + /* + * And recheck the hash, since lower vnode might have + * been unlocked duuring the upgrade. + */ + *vpp = null_hashget(mp, lowervp); + if (*vpp != NULL) { + vrele(lowervp); + return (0); + } + } + + /* * We do not serialize vnode creation, instead we will check for * duplicates later, when adding new vnode to hash. - * * Note that duplicate can only appear in hash if the lowervp is * locked LK_SHARED. - */ - - /* + * * Do the MALLOC before the getnewvnode since doing so afterward * might cause a bogus v_data pointer to get dereferenced * elsewhere if MALLOC should block. @@ -250,9 +279,7 @@ null_nodeget(mp, lowervp, vpp) *vpp = null_hashins(mp, xp); if (*vpp != NULL) { vrele(lowervp); - vp->v_vnlock = &vp->v_lock; - xp->null_lowervp = NULL; - vrele(vp); + null_destroy_proto(vp, xp); return (0); } *vpp = vp; Index: /usr/src/sys/fs/nullfs/null_vfsops.c =================================================================== --- /usr/src/sys/fs/nullfs/null_vfsops.c (revision 232002) +++ /usr/src/sys/fs/nullfs/null_vfsops.c (working copy) @@ -180,7 +180,9 @@ nullfs_mount(struct mount *mp) MNT_IUNLOCK(mp); } MNT_ILOCK(mp); - mp->mnt_kern_flag |= lowerrootvp->v_mount->mnt_kern_flag & MNTK_MPSAFE; + mp->mnt_kern_flag |= lowerrootvp->v_mount->mnt_kern_flag & + (MNTK_MPSAFE | MNTK_EXTENDED_SHARED | MNTK_SHARED_WRITES | + MNTK_LOOKUP_SHARED); MNT_IUNLOCK(mp); mp->mnt_data = xmp; vfs_getnewfsid(mp); @@ -307,6 +309,12 @@ nullfs_vget(mp, ino, flags, vpp) struct vnode **vpp; { int error; + + KASSERT((flags & LK_TYPE_MASK) != 0, + ("nullfs_vget: no lock requested")); + flags &= ~LK_TYPE_MASK; + flags |= LK_EXCLUSIVE; + error = VFS_VGET(MOUNTTONULLMOUNT(mp)->nullm_vfs, ino, flags, vpp); if (error) return (error); -- Test scenario: nullfs8.sh