GENERIC HEAD from 2013-05-08 12:53:21 UTC, r250363M, vmcore.624 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb 4718592K of memory above 4GB ignored Copyright (c) 1992-2013 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #1 r250363M: Wed May 8 21:29:39 CEST 2013 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 FreeBSD clang version 3.3 (trunk 178860) 20130405 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 0x10 Model = 0x2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 8589934592 (8192 MB) avail memory = 3498315776 (3336 MB) : Trying to mount root from ufs:/dev/ad4s1a [rw]... Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/ad4s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1a: clean, 617590 free (1118 frags, 77059 blocks, 0.1% fragmentation) /dev/ad4s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1f: clean, 184387 free (4387 frags, 22500 blocks, 0.4% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 49110325 free (3245 frags, 6138385 blocks, 0.0% fragmentation) /dev/ad4s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1d: clean, 3621012 free (257804 frags, 420401 blocks, 2.5% fragmentation) /dev/ad4s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1e: clean, 9215295 free (165471 frags, 1131228 blocks, 0.7% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN re0: link state changed to UP Starting Network: lo0 re0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 scopeid 0x1 nd6 options=29 media: Ethernet autoselect (100baseTX ) status: active Starting devd. add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/kde4/lib /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/gcc46 /usr/local/lib/mysql /usr/local/lib/nss /usr/local/lib/pth /usr/local/lib/qt4 /usr/local/lib/virtualbox a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. savecore: couldn't find media and/or sector size of /var/crash: Inappropriate ioctl for device May 8 21:37:08 x4 savecore: couldn't find media and/or sector size of /var/crash: Inappropriate ioctl for device No core dumps found. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 lock order reversal: 1st 0xe381f8b0 bufwait (bufwait) @ kern/vfs_bio.c:3070 2nd 0xc7caa800 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper(c10d0f10,c10da64c,c1c,c0b39260,c7df8d78,...) at db_trace_self_wrapper+0x2d/frame 0xf5cc5798 kdb_backtrace(c10d413f,c7caa800,c11062bd,c7586268,c1105f02,...) at kdb_backtrace+0x30/frame 0xf5cc5800 witness_checkorder(c7caa800,9,c1105ef9,11c,0,...) at witness_checkorder+0xbaa/frame 0xf5cc5850 _sx_xlock(c7caa800,0,c1105ef9,11c,c7d5b800,...) at _sx_xlock+0x77/frame 0xf5cc5880 ufsdirhash_add(c7dd4910,f5cc5978,53c8,f5cc5900,f5cc5904,...) at ufsdirhash_add+0x4a/frame 0xf5cc58b0 ufs_direnter(c7df8ca8,c8337ca8,f5cc5978,f5cc5b64,e3823360,...) at ufs_direnter+0x63b/frame 0xf5cc5930 ufs_mkdir(f5cc5c00,c112b973,c10ffbc6,c7df8ca8,f5cc5bfc,...) at ufs_mkdir+0x884/frame 0xf5cc5ad0 VOP_MKDIR_APV(c122fbec,f5cc5c00,f5cc5b64,f5cc5b90,28803020,...) at VOP_MKDIR_APV+0x124/frame 0xf5cc5b00 kern_mkdirat(c7d77c00,ffffff9c,28803020,0,1c0) at kern_mkdirat+0x1fc/frame 0xf5cc5c24 sys_mkdir(c7d77c00,f5cc5cc8,14,c10cf0fd,7b3,...) at sys_mkdir+0x31/frame 0xf5cc5c40 syscall(f5cc5d08) at syscall+0x2ed/frame 0xf5cc5cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cc5cfc --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x28174f57, esp = 0xbfbfd92c, ebp = 0xbfbfddd0 --- Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Recovering vi editor sessions:. Updating motd:. Starting ntpd. Removing stale Samba tdb files: ....... done Starting nmbd. Starting smbd. Starting winbindd. Starting smartd. Starting default moused. Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Local package initialization: backuplock order reversal: 1st 0xc7df8cdc ufs (ufs) @ kern/vfs_subr.c:2168 2nd 0xe381f70c bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:262 3rd 0xc7deb19c ufs (ufs) @ kern/vfs_subr.c:2168 KDB: stack backtrace: db_trace_self_wrapper(c10d0f10,f5d22770,c7da07a8,0,0,...) at db_trace_self_wrapper+0x2d/frame 0xf5d226e0 kdb_backtrace(c10d4158,c7deb19c,c10bc232,c7586200,c10dd570,...) at kdb_backtrace+0x30/frame 0xf5d22748 witness_checkorder(c7deb19c,9,c10dd567,878,c7deb208,...) at witness_checkorder+0xbaa/frame 0xf5d22798 __lockmgr_args(c7deb19c,80100,c7deb208,0,0,...) at __lockmgr_args+0x816/frame 0xf5d22878 ffs_lock(f5d22900,6a4,c757f1e0,c7584798,c757f1e0,...) at ffs_lock+0xad/frame 0xf5d228b8 VOP_LOCK1_APV(c122fbec,f5d22900,0,f5d2293c,c1244430,...) at VOP_LOCK1_APV+0x112/frame 0xf5d228e8 _vn_lock(c7deb168,80100,c10dd567,878,c10dc7dd,...) at _vn_lock+0xca/frame 0xf5d22928 vget(c7deb168,80100,c7e75900,57,0,...) at vget+0x77/frame 0xf5d22960 vfs_hash_get(c80c72ec,164800,80000,c7e75900,f5d22a40,...) at vfs_hash_get+0xff/frame 0xf5d2298c ffs_vgetf(c80c72ec,164800,80000,f5d22a40,1,...) at ffs_vgetf+0x47/frame 0xf5d229e8 softdep_sync_buf(c7df8ca8,e381f6ac,1,108,0,...) at softdep_sync_buf+0x2ea/frame 0xf5d22a50 ffs_syncvnode(c7df8ca8,1,0,619,0,...) at ffs_syncvnode+0x2a3/frame 0xf5d22aa8 ffs_sync(c80c72ec,1,f5d22b68,50f,c1baec14,...) at ffs_sync+0x23e/frame 0xf5d22b30 dounmount(c80c72ec,8080000,c7e75900,493,c0af9ee5,...) at dounmount+0x43c/frame 0xf5d22b90 sys_unmount(c7e75900,f5d22cc8,c0edd3d0,c1825c90,0,...) at sys_unmount+0x3cd/frame 0xf5d22c40 syscall(f5d22d08) at syscall+0x2ed/frame 0xf5d22cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d22cfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c1a0b, esp = 0xbfbfd6a4, ebp = 0xbfbfd770 --- lock order reversal: 1st 0xc7e28304 ufs (ufs) @ kern/vfs_mount.c:1236 2nd 0xc7e2873c devfs (devfs) @ ufs/ffs/ffs_softdep.c:1866 KDB: stack backtrace: db_trace_self_wrapper(c10d0f10,0,33,c10bc232,67d,...) at db_trace_self_wrapper+0x2d/frame 0xf5d22830 kdb_backtrace(c10d413f,c7e2873c,c10c7f55,c7586060,c11025e7,...) at kdb_backtrace+0x30/frame 0xf5d22898 witness_checkorder(c7e2873c,9,c11025de,74a,c7e287a8,...) at witness_checkorder+0xbaa/frame 0xf5d228e8 __lockmgr_args(c7e2873c,80400,c7e287a8,0,0,0,c11025de,74a) at __lockmgr_args+0x816/frame 0xf5d229c8 vop_stdlock(f5d22a40,632,4,f5d22a3c,c0a9e037,...) at vop_stdlock+0x53/frame 0xf5d229f8 VOP_LOCK1_APV(c11f53c0,f5d22a40,4,f5d22a68,c1244430,...) at VOP_LOCK1_APV+0x112/frame 0xf5d22a28 _vn_lock(c7e28708,80400,c11025de,74a,f5d22aa8,...) at _vn_lock+0xca/frame 0xf5d22a68 softdep_flushworklist(c80c72ec,f5d22afc,c7e75900,62d,0,...) at softdep_flushworklist+0x6e/frame 0xf5d22aa8 ffs_sync(c80c72ec,1,f5d22b68,50f,c1baec14,...) at ffs_sync+0x2e5/frame 0xf5d22b30 dounmount(c80c72ec,8080000,c7e75900,493,c0af9ee5,...) at dounmount+0x43c/frame 0xf5d22b90 sys_unmount(c7e75900,f5d22cc8,c0edd3d0,c1825c90,0,...) at sys_unmount+0x3cd/frame 0xf5d22c40 syscall(f5d22d08) at syscall+0x2ed/frame 0xf5d22cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d22cfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c1a0b, esp = 0xbfbfd6a4, ebp = 0xbfbfd770 --- lock order reversal: 1st 0xc7df75d4 syncer (syncer) @ kern/vfs_subr.c:1787 2nd 0xc84f619c ufs (ufs) @ kern/vfs_subr.c:2168 KDB: stack backtrace: db_trace_self_wrapper(c10d0f10,8,c1123662,246,0,...) at db_trace_self_wrapper+0x2d/frame 0xf0796930 kdb_backtrace(c10d413f,c84f619c,c10bc232,c7586200,c10dd570,...) at kdb_backtrace+0x30/frame 0xf0796998 witness_checkorder(c84f619c,9,c10dd567,878,c84f6208,...) at witness_checkorder+0xbaa/frame 0xf07969e8 __lockmgr_args(c84f619c,80500,c84f6208,0,0,...) at __lockmgr_args+0x816/frame 0xf0796ac8 ffs_lock(f0796b50,0,c75845f8,246,c75845f8,...) at ffs_lock+0xad/frame 0xf0796b08 VOP_LOCK1_APV(c122fbec,f0796b50,246,c13f655c,c1244430,...) at VOP_LOCK1_APV+0x112/frame 0xf0796b38 _vn_lock(c84f6168,80500,c10dd567,878,c13f656c,...) at _vn_lock+0xca/frame 0xf0796b78 vget(c84f6168,80500,c7948300,12be,c7d448d4,...) at vget+0x77/frame 0xf0796bb0 vfs_msync(c7d448c4,2,2,e7d,c7d448c4,...) at vfs_msync+0xa0/frame 0xf0796bf8 sync_fsync(f0796ca8,c112b84e,80400,c10dd567,6fb,...) at sync_fsync+0x12e/frame 0xf0796c20 VOP_FSYNC_APV(c120ff14,f0796ca8,c10dd567,6fb,0,...) at VOP_FSYNC_APV+0x124/frame 0xf0796c50 sched_sync(0,f0796d08,c10c6680,3d7,0,...) at sched_sync+0x38f/frame 0xf0796ccc fork_exit(c0b5cdd0,0,f0796d08) at fork_exit+0x7f/frame 0xf0796cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf0796cf4 --- trap 0, eip = 0, esp = 0xf0796d40, ebp = 0 --- ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes May 8 21:37:35 x4 su: pho to root on /dev/pts/0 ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 49707 files, 69203656 used, 49110325 free (3245 frags, 6138385 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 49707 files, 69203656 used, 49110325 free (3245 frags, 6138385 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmp watchdogd. Starting inetd. Wed May 8 21:41:20 CEST 2013 FreeBSD/i386 (x4.osted.lan) (console) login: May 8 21:45:33 x4 su: pho to root on /dev/pts/2 Fatal trap 12: page fault while in kernel mode cpuid = 3; apic id = 03 fault virtual address = 0x0 fault code = supervisor read, page not present instruction pointer = 0x20:0xc099d388 stack pointer = 0x28:0xf5f168f0 frame pointer = 0x28:0xf5f16934 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, def32 1, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 40414 (rm) [ thread pid 40414 tid 100240 ] Stopped at fifo_close+0x28: movl 0(%eax),%eax db> run pho db:0:pho> bt Tracing pid 40414 tid 100240 td 0xc91afc00 fifo_close(f5f16a78,c112b496,c91afc00,cf29b3e0,c8e8c708,...) at fifo_close+0x28/frame 0xf5f16934 VOP_CLOSE_APV(c122fd0c,f5f16a78) at VOP_CLOSE_APV+0x124/frame 0xf5f16964 VOP_CLOSE_AP(f5f16a78,cf4c2cf9,107,f5f169d8,c0b00400,...) at VOP_CLOSE_AP+0x1b/frame 0xf5f16974 null_bypass(f5f16a78,c112b496,1,c8e8c7d8,c8e8c7f4,...) at null_bypass+0xfd/frame 0xf5f16a20 VOP_CLOSE_APV(cf4c3200,f5f16a78,0,0,1,...) at VOP_CLOSE_APV+0x12c/frame 0xf5f16a50 vgonel(c8e8c7b8,0,c10dd567,a89,c8e8c708,...) at vgonel+0x1e7/frame 0xf5f16a9c vgone(c8e8c708,c8b7e000,c80d28c4,f5f16b08,c0b585f8,...) at vgone+0x38/frame 0xf5f16abc nullfs_unlink_lowervp(c80d28c4,c8b7e000,c10dd567,ab3,c12449f0,...) at nullfs_unlink_lowervp+0x37/frame 0xf5f16ad0 vfs_notify_upper(c8b7e000,2,c8b7e000,f5f16bd4,2,...) at vfs_notify_upper+0x1e8/frame 0xf5f16b08 kern_unlinkat(c91afc00,ffffff9c,288283d8,0,0) at kern_unlinkat+0x23d/frame 0xf5f16c24 sys_unlink(c91afc00,f5f16cc8,c0edd3d0,c1825c90,0,...) at sys_unlink+0x32/frame 0xf5f16c40 syscall(f5f16d08) at syscall+0x2ed/frame 0xf5f16cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5f16cfc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x281744d7, esp = 0xbfbfd7dc, ebp = 0xbfbfd874 --- db:0:bt> show allpcpu Current CPU: 3 cpuid = 0 dynamic pcpu = 0x5db600 curthread = 0xc76c5900: pid 11 "idle: cpu0" curpcb = 0xc720ad60 fpcurthread = none idlethread = 0xc76c5900: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x5fb0600 curthread = 0xc7773c00: pid 13 "g_up" curpcb = 0xc722fd60 fpcurthread = none idlethread = 0xc76c5600: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x5fb3600 curthread = 0xc76c5300: pid 11 "idle: cpu2" curpcb = 0xc7210d60 fpcurthread = none idlethread = 0xc76c5300: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x5fb6600 curthread = 0xc91afc00: pid 40414 "rm" curpcb = 0xf5f16d60 fpcurthread = none idlethread = 0xc76c5000: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks Process 40414 (rm) thread 0xc91afc00 (100240) exclusive lockmgr ufs (ufs) r = 0 (0xc8b7e034) locked @ kern/vfs_subr.c:2168 exclusive lockmgr ufs (ufs) r = 0 (0xc96e7cdc) locked @ kern/vfs_lookup.c:517 Process 6569 (tail) thread 0xc9168900 (100318) shared lockmgr ufs (ufs) r = 0 (0xc80e173c) locked @ kern/vfs_subr.c:2168 Process 521 (syslogd) thread 0xc7e07300 (100092) exclusive lockmgr ufs (ufs) r = 0 (0xc8321304) locked @ kern/vfs_syscalls.c:3473 Process 13 (geom) thread 0xc7773c00 (100015) exclusive sleep mutex bio queue (bio queue) r = 0 (0xc127c89c) locked @ geom/geom_io.c:89 db:0:alllocks> show lockedvnods Locked vnodes 0xc80e1708: tag ufs, type VDIR usecount 1, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xc7e2cc24 ref 0 pages 0 lock type ufs: SHARED (count 1) #0 0xc0a956f3 at __lockmgr_args+0xf63 #1 0xc0d1990d at ffs_lock+0xad #2 0xc0efca62 at VOP_LOCK1_APV+0x112 #3 0xc0b6834a at _vn_lock+0xca #4 0xc0b55eb7 at vget+0x77 #5 0xc0b40f88 at cache_lookup+0x5a8 #6 0xc0b420bc at vfs_cache_lookup+0xbc #7 0xc0ef9484 at VOP_LOOKUP_APV+0x124 #8 0xc0b4aef8 at lookup+0x528 #9 0xc0b4a5ed at namei+0x47d #10 0xc0b625a2 at kern_statat_vnhook+0xc2 #11 0xc0b62379 at sys_stat+0x59 #12 0xc0ed6aed at syscall+0x2ed #13 0xc0ebf061 at Xint0x80_syscall+0x21 ino 6052864, on dev ada0s1e 0xc83212d0: tag ufs, type VREG usecount 2, writecount 1, refcount 5 mountedhere 0 flags (VI_ACTIVE) v_object 0xc1b83534 ref 0 pages 1 lock type ufs: EXCL by thread 0xc7e07300 (pid 521, syslogd, tid 100092) with shared waiters pending #0 0xc0a9583f at __lockmgr_args+0x10af #1 0xc0d1990d at ffs_lock+0xad #2 0xc0efca62 at VOP_LOCK1_APV+0x112 #3 0xc0b6834a at _vn_lock+0xca #4 0xc0b64951 at sys_fsync+0xd1 #5 0xc0ed6aed at syscall+0x2ed #6 0xc0ebf061 at Xint0x80_syscall+0x21 ino 6052872, on dev ada0s1e 0xc96e7ca8: tag ufs, type VDIR usecount 3, writecount 0, refcount 4 mountedhere 0 flags (VI_ACTIVE) v_object 0xcb11b250 ref 0 pages 0 lock type ufs: EXCL by thread 0xc91afc00 (pid 40414, rm, tid 100240) #0 0xc0a956f3 at __lockmgr_args+0xf63 #1 0xc0d1990d at ffs_lock+0xad #2 0xc0efca62 at VOP_LOCK1_APV+0x112 #3 0xc0b6834a at _vn_lock+0xca #4 0xc0b4aac9 at lookup+0xf9 #5 0xc0b4a5ed at namei+0x47d #6 0xc0b6190c at kern_unlinkat+0xbc #7 0xc0b61562 at sys_unlink+0x32 #8 0xc0ed6aed at syscall+0x2ed #9 0xc0ebf061 at Xint0x80_syscall+0x21 ino 1530880, on dev label/tmp 0xc8b7e000: tag ufs, type VFIFO usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type ufs: EXCL by thread 0xc91afc00 (pid 40414, rm, tid 100240) #0 0xc0a9583f at __lockmgr_args+0x10af #1 0xc0d1990d at ffs_lock+0xad #2 0xc0efca62 at VOP_LOCK1_APV+0x112 #3 0xc0b6834a at _vn_lock+0xca #4 0xc0b55eb7 at vget+0x77 #5 0xc0b4968f at vfs_hash_get+0xff #6 0xc0d14177 at ffs_vgetf+0x47 #7 0xc0d1411e at ffs_vget+0x2e #8 0xc0d2317e at ufs_lookup_ino+0xeee #9 0xc0d2228a at ufs_lookup+0x2a #10 0xc0ef9674 at VOP_CACHEDLOOKUP_APV+0x124 #11 0xc0b420f0 at vfs_cache_lookup+0xf0 #12 0xc0ef9484 at VOP_LOOKUP_APV+0x124 #13 0xc0b4aef8 at lookup+0x528 #14 0xc0b4a5ed at namei+0x47d #15 0xc0b6190c at kern_unlinkat+0xbc #16 0xc0b61562 at sys_unlink+0x32 #17 0xc0ed6aed at syscall+0x2ed ino 1530927, on dev label/tmp, NULL v_fifoinfo 0xc87592d0: tag null, type VDIR usecount 0, writecount 0, refcount 0 mountedhere 0 flags (VI_FREE) v_object 0xcb11b250 ref 0 pages 0 lock type ufs: EXCL by thread 0xc91afc00 (pid 40414, rm, tid 100240) #0 0xc0a956f3 at __lockmgr_args+0xf63 #1 0xc0d1990d at ffs_lock+0xad #2 0xc0efca62 at VOP_LOCK1_APV+0x112 #3 0xc0b6834a at _vn_lock+0xca #4 0xc0b4aac9 at lookup+0xf9 #5 0xc0b4a5ed at namei+0x47d #6 0xc0b6190c at kern_unlinkat+0xbc #7 0xc0b61562 at sys_unlink+0x32 #8 0xc0ed6aed at syscall+0x2ed #9 0xc0ebf061 at Xint0x80_syscall+0x21 vp=0xc87592d0, lowervp=0xc96e7ca8 0xc8e8c708: tag null, type VFIFO usecount 1, writecount 0, refcount 1 mountedhere 0 flags (VI_DOOMED|VI_ACTIVE) lock type ufs: EXCL by thread 0xc91afc00 (pid 40414, rm, tid 100240) #0 0xc0a9583f at __lockmgr_args+0x10af #1 0xc0d1990d at ffs_lock+0xad #2 0xc0efca62 at VOP_LOCK1_APV+0x112 #3 0xc0b6834a at _vn_lock+0xca #4 0xc0b55eb7 at vget+0x77 #5 0xc0b4968f at vfs_hash_get+0xff #6 0xc0d14177 at ffs_vgetf+0x47 #7 0xc0d1411e at ffs_vget+0x2e #8 0xc0d2317e at ufs_lookup_ino+0xeee #9 0xc0d2228a at ufs_lookup+0x2a #10 0xc0ef9674 at VOP_CACHEDLOOKUP_APV+0x124 #11 0xc0b420f0 at vfs_cache_lookup+0xf0 #12 0xc0ef9484 at VOP_LOOKUP_APV+0x124 #13 0xc0b4aef8 at lookup+0x528 #14 0xc0b4a5ed at namei+0x47d #15 0xc0b6190c at kern_unlinkat+0xbc #16 0xc0b61562 at sys_unlink+0x32 #17 0xc0ed6aed at syscall+0x2ed vp=0xc8e8c708, lowervp=0xc8b7e000 db:0:lockedvnods> show mount 0xc7d44bb0 /dev/ad4s1a on / (ufs) 0xc7d45000 devfs on /dev (devfs) 0xc80c75d8 /dev/ad4s1f on /home (ufs) 0xc7d448c4 /dev/ad4s1d on /usr (ufs) 0xc80d3000 /dev/ad4s1e on /var (ufs) 0xc80d2bb0 procfs on /proc (procfs) 0xc7d445d8 /dev/label/tmp on /tmp (ufs) 0xc80d28c4 /tmp on /home/pho/stress2/misc/mp1 (nullfs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 40459 6607 6572 1001 S nanslp 0xc127f65a sleep 40414 40402 22207 0 R+ CPU 3 rm 40402 22207 22207 0 S+ wait 0xc80cf2e8 sh 22207 794 22207 0 S+ wait 0xc93e45d0 sh 71139 70366 71139 0 S+ ttyin 0xc7cd7a70 csh 70366 69824 70366 1001 S+ wait 0xc93e1ba0 su 69824 69807 69824 1001 Ss+ wait 0xc915f000 bash 69807 69648 69648 1001 S select 0xc84b8d64 sshd 69648 724 69648 0 Ss select 0xcc7930a4 sshd 6608 6572 6572 1001 S piperd 0xc7dfc330 awk 6607 6572 6572 1001 S wait 0xc92432e8 sh 6573 6570 6573 1001 Ss+ select 0xcce955a4 top 6572 6571 6572 1001 Ss wait 0xc92268b8 sh 6571 6204 6204 1001 S select 0xcc4f8e24 sshd 6570 6203 6203 1001 S select 0xcce559e4 sshd 6569 6568 6569 1001 Ds ufs 0xc8321304 tail 6568 6205 6205 1001 DL swread 0xc49b2680 sshd 6205 724 6205 0 Ss select 0xcac6ba64 sshd 6204 724 6204 0 Ss select 0xcbe6e824 sshd 6203 724 6203 0 Ss select 0xcb3bc524 sshd 990 1 990 0 Ss+ ttyin 0xc75a4670 getty 989 1 989 0 Ss+ ttyin 0xc75a4870 getty 988 1 988 0 Ss+ ttyin 0xc75a4a70 getty 987 1 987 0 Ss+ ttyin 0xc75a4c70 getty 986 1 986 0 Ss+ ttyin 0xc75a4e70 getty 985 1 985 0 Ss+ ttyin 0xc792e070 getty 984 1 984 0 Ss+ ttyin 0xc792e270 getty 983 1 983 0 Ss+ ttyin 0xc792e470 getty 982 1 982 0 Ss+ ttyin 0xc75a3070 getty 965 1 965 0 Ss select 0xc7db51a4 inetd 941 1 941 0 Ss nanslp 0xc127f65b watchdogd 794 791 794 0 S+ wait 0xc833fba0 bash 791 790 791 0 S+ pause 0xc7e0091c csh 790 785 790 1001 S+ wait 0xc833e5d0 su 785 784 785 1001 Ss+ wait 0xc86a42e8 bash 784 782 782 1001 S select 0xc84b8e24 sshd 782 724 782 0 Ss select 0xc8a44364 sshd 735 1 735 0 Ss nanslp 0xc127f65b cron 730 1 730 25 Ss pause 0xc86a391c sendmail 727 1 727 0 Ss select 0xc757a664 sendmail 724 1 724 0 Ss select 0xc7d43a64 sshd 692 1 692 0 Ss select 0xc7e01ba4 moused 684 1 683 0 S nanslp 0xc127f658 smartd 682 670 670 0 S select 0xc7e01de4 winbindd 681 668 668 0 S select 0xc7db56a4 smbd 670 1 670 0 Ss select 0xc84b8264 winbindd 668 1 668 0 Ss select 0xc84b80e4 smbd 666 1 666 0 Ss select 0xc84b82a4 nmbd 642 1 642 0 Ss select 0xc757b364 ntpd 585 581 581 0 S (threaded) nfsd 100123 S rpcsvc 0xc7d12e10 nfsd: service 100122 S rpcsvc 0xc7d12e50 nfsd: service 100121 S rpcsvc 0xc7d12e90 nfsd: service 100120 S rpcsvc 0xc7cde110 nfsd: master 581 1 581 0 Ss select 0xc757b064 nfsd 575 1 575 0 Ss select 0xc757a064 mountd 568 564 564 0 S select 0xc7d43c24 nfsuserd 567 564 564 0 S select 0xc7db5de4 nfsuserd 566 564 564 0 S select 0xc7d43be4 nfsuserd 565 564 564 0 S select 0xc757a564 nfsuserd 564 1 564 0 Ss pause 0xc7e7391c nfsuserd 536 1 536 0 Ss select 0xc757b124 rpcbind 521 1 521 0 Ds bo_wwait 0xc83213dc syslogd 418 1 418 0 Ss select 0xc757b4e4 devd 17 0 0 0 DL sdflush 0xc13fa7e4 [softdepflush] 16 0 0 0 DL syncer 0xc13f65a4 [syncer] 9 0 0 0 DL vlruwt 0xc7c2aba0 [vnlru] 8 0 0 0 DL psleep 0xc13f631c [bufdaemon] 7 0 0 0 DL pgzero 0xc13fb0e4 [pagezero] 6 0 0 0 DL psleep 0xc13facac [vmdaemon] 5 0 0 0 DL psleep 0xc144eb84 [pagedaemon] 4 0 0 0 DL ccb_scan 0xc124a724 [xpt_thrd] 3 0 0 0 DL waiting_ 0xc144a88c [sctp_iterator] 2 0 0 0 DL - 0xc789303c [fdc0] 15 0 0 0 DL (threaded) [usb] 100058 D - 0xc78f7d34 [usbus5] 100057 D - 0xc78f7d04 [usbus5] 100056 D - 0xc78f7cd4 [usbus5] 100055 D - 0xc78f7ca4 [usbus5] 100053 D - 0xc78ebb5c [usbus4] 100052 D - 0xc78ebb2c [usbus4] 100051 D - 0xc78ebafc [usbus4] 100050 D - 0xc78ebacc [usbus4] 100049 D - 0xc78e6b5c [usbus3] 100048 D - 0xc78e6b2c [usbus3] 100047 D - 0xc78e6afc [usbus3] 100046 D - 0xc78e6acc [usbus3] 100045 D - 0xc78deb5c [usbus2] 100044 D - 0xc78deb2c [usbus2] 100043 D - 0xc78deafc [usbus2] 100042 D - 0xc78deacc [usbus2] 100040 D - 0xc78d9b5c [usbus1] 100039 D - 0xc78d9b2c [usbus1] 100038 D - 0xc78d9afc [usbus1] 100037 D - 0xc78d9acc [usbus1] 100035 D - 0xc78cdb5c [usbus0] 100034 D - 0xc78cdb2c [usbus0] 100033 D - 0xc78cdafc [usbus0] 100032 D - 0xc78cdacc [usbus0] 14 0 0 0 DL - 0xc12652dc [yarrow] 13 0 0 0 RL (threaded) [geom] 100016 D - 0xc14468e8 [g_down] 100015 Run CPU 1 [g_up] 100014 D - 0xc14468e0 [g_event] 12 0 0 0 WL (threaded) [intr] 100063 I [irq12: psm0] 100062 I [irq1: atkbd0] 100060 I [swi0: uart] 100059 I [irq14: ata0] 100054 I [irq19: ehci0] 100041 I [irq18: ohci2 ohci4] 100036 I [irq17: ohci1 ohci3] 100031 I [irq16: hdac1 ohci0] 100030 I [irq22: ahci0] 100029 I [irq257: re0] 100028 I [irq256: hdac0] 100027 I [swi6: task queue] 100022 I [swi2: cambio] 100020 I [swi5: fast taskq] 100018 I [swi6: Giant taskq] 100012 I [swi3: vm] 100011 I [swi1: netisr 0] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 I [swi4: clock] 100007 I [swi4: clock] 11 0 0 0 RL (threaded) [idle] 100006 CanRun [idle: cpu3] 100005 Run CPU 2 [idle: cpu2] 100004 CanRun [idle: cpu1] 100003 Run CPU 0 [idle: cpu0] 1 0 1 0 SLs wait 0xc76c3ba0 [init] 10 0 0 0 DL audit_wo 0xc144d638 [audit] 0 0 0 0 DLs (threaded) [kernel] 100065 D - 0xc127e550 [deadlkres] 100064 D - 0xc7867d80 [mca taskq] 100026 D - 0xc75a8600 [ffs_trim taskq] 100025 D - 0xc75a8680 [acpi_task_2] 100024 D - 0xc75a8680 [acpi_task_1] 100023 D - 0xc75a8680 [acpi_task_0] 100021 D - 0xc75a8a00 [kqueue taskq] 100019 D - 0xc75a8b00 [thread taskq] 100013 D - 0xc75a7100 [firmware taskq] 100000 D sched 0xc1446964 [swapper] db:0:ps> allt Tracing command sleep pid 40459 tid 100246 td 0xc9165300 sched_switch(c9165300,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5f2da64 mi_switch(104,0,c10d2871,1f5,c0af53c0,...) at mi_switch+0x1c9/frame 0xf5f2da98 sleepq_switch(c9165300,0,c10d2871,1ab,8,...) at sleepq_switch+0x1b9/frame 0xf5f2dacc sleepq_catch_signals(c0af53c0,c9165300,2,201,2,...) at sleepq_catch_signals+0x361/frame 0xf5f2db14 sleepq_timedwait_sig(c127f65a,6c,523,a0000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf5f2db3c _sleep(c127f65a,0,16c,c10ce1ea,405e5331,...) at _sleep+0x331/frame 0xf5f2db98 kern_nanosleep(bfbfdce0,f5f2dc18,f5f2dc20,2,a,...) at kern_nanosleep+0x158/frame 0xf5f2dc00 sys_nanosleep(c9165300,f5f2dcc8,c0edd3d0,c71fdc90,0,...) at sys_nanosleep+0x6b/frame 0xf5f2dc40 syscall(f5f2dd08) at syscall+0x2ed/frame 0xf5f2dcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5f2dcfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28164223, esp = 0xbfbfdcac, ebp = 0xbfbfdcf4 --- Tracing command rm pid 40414 tid 100240 td 0xc91afc00 fifo_close(f5f16a78,c112b496,c91afc00,cf29b3e0,c8e8c708,...) at fifo_close+0x28/frame 0xf5f16934 VOP_CLOSE_APV(c122fd0c,f5f16a78) at VOP_CLOSE_APV+0x124/frame 0xf5f16964 VOP_CLOSE_AP(f5f16a78,cf4c2cf9,107,f5f169d8,c0b00400,...) at VOP_CLOSE_AP+0x1b/frame 0xf5f16974 null_bypass(f5f16a78,c112b496,1,c8e8c7d8,c8e8c7f4,...) at null_bypass+0xfd/frame 0xf5f16a20 VOP_CLOSE_APV(cf4c3200,f5f16a78,0,0,1,...) at VOP_CLOSE_APV+0x12c/frame 0xf5f16a50 vgonel(c8e8c7b8,0,c10dd567,a89,c8e8c708,...) at vgonel+0x1e7/frame 0xf5f16a9c vgone(c8e8c708,c8b7e000,c80d28c4,f5f16b08,c0b585f8,...) at vgone+0x38/frame 0xf5f16abc nullfs_unlink_lowervp(c80d28c4,c8b7e000,c10dd567,ab3,c12449f0,...) at nullfs_unlink_lowervp+0x37/frame 0xf5f16ad0 vfs_notify_upper(c8b7e000,2,c8b7e000,f5f16bd4,2,...) at vfs_notify_upper+0x1e8/frame 0xf5f16b08 kern_unlinkat(c91afc00,ffffff9c,288283d8,0,0) at kern_unlinkat+0x23d/frame 0xf5f16c24 sys_unlink(c91afc00,f5f16cc8,c0edd3d0,c1825c90,0,...) at sys_unlink+0x32/frame 0xf5f16c40 syscall(f5f16d08) at syscall+0x2ed/frame 0xf5f16cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5f16cfc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x281744d7, esp = 0xbfbfd7dc, ebp = 0xbfbfd874 --- Tracing command sh pid 40402 tid 100365 td 0xc940b300 sched_switch(c940b300,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf616598c mi_switch(104,0,c10d2871,1f5,c10d2871,...) at mi_switch+0x1c9/frame 0xf61659c0 sleepq_switch(c940b300,0,c10d2871,1ab,f6165a38,...) at sleepq_switch+0x1b9/frame 0xf61659f4 sleepq_catch_signals(0,c10d2871,162,270,c940b300,...) at sleepq_catch_signals+0x361/frame 0xf6165a3c sleepq_wait_sig(c80cf2e8,6c,c10d5ce9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf6165a60 _sleep(c80cf2e8,c80cf37c,16c,c10d5ce9,0,...) at _sleep+0x35b/frame 0xf6165abc kern_wait6(c940b300,7,0,0,f6165b4c,...) at kern_wait6+0x45c/frame 0xf6165b20 sys_wait4(c940b300,f6165cc8,c1124b8f,e9,0,...) at sys_wait4+0x94/frame 0xf6165c40 syscall(f6165d08) at syscall+0x2ed/frame 0xf6165cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6165cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x28152563, esp = 0xbfbfd7d8, ebp = 0xbfbfd7f0 --- Tracing command sh pid 22207 tid 100364 td 0xcf378000 sched_switch(cf378000,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf616298c mi_switch(104,0,c10d2871,1f5,c10d2871,...) at mi_switch+0x1c9/frame 0xf61629c0 sleepq_switch(cf378000,0,c10d2871,1ab,f6162a38,...) at sleepq_switch+0x1b9/frame 0xf61629f4 sleepq_catch_signals(0,c10d2871,162,df8,cf378000,...) at sleepq_catch_signals+0x361/frame 0xf6162a3c sleepq_wait_sig(c93e45d0,6c,c10d5ce9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf6162a60 _sleep(c93e45d0,c93e4664,16c,c10d5ce9,0,...) at _sleep+0x35b/frame 0xf6162abc kern_wait6(cf378000,7,0,0,f6162b4c,...) at kern_wait6+0x45c/frame 0xf6162b20 sys_wait4(cf378000,f6162cc8,c1124b8f,e9,7b3,...) at sys_wait4+0x94/frame 0xf6162c40 syscall(f6162d08) at syscall+0x2ed/frame 0xf6162cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6162cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x28152563, esp = 0xbfbfd7e8, ebp = 0xbfbfd800 --- Tracing command csh pid 71139 tid 100302 td 0xc9248300 sched_switch(c9248300,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5fff9bc mi_switch(104,0,c10d2871,1f5,46,...) at mi_switch+0x1c9/frame 0xf5fff9f0 sleepq_switch(c9248300,0,c10d2871,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5fffa24 sleepq_catch_signals(f5fffa90,c0a9d9b9,c7cd7a14,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5fffa6c sleepq_wait_sig(c7cd7a70,0,f5fffac0,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5fffa90 _cv_wait_sig(c7cd7a70,c7cd7a04,c10d75e1,531,f5fffc10,...) at _cv_wait_sig+0x200/frame 0xf5fffad4 tty_wait(c7cd7a00,c7cd7a70,f5fffc10,1,0,...) at tty_wait+0x4b/frame 0xf5fffaf8 ttydisc_read(c7cd7a00,f5fffc10,0,a1,f5fffc10,...) at ttydisc_read+0x377/frame 0xf5fffb3c ttydev_read(c7cb2c00,f5fffc10,0,1,0,...) at ttydev_read+0x81/frame 0xf5fffb5c devfs_read_f(ce0f5738,f5fffc10,c848ed80,0,c9248300,...) at devfs_read_f+0x87/frame 0xf5fffb90 dofileread(ce0f5738,f5fffc10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5fffbc4 kern_readv(c9248300,10,f5fffc10,0,bfbfd3ae,...) at kern_readv+0x66/frame 0xf5fffbf0 sys_read(c9248300,f5fffcc8,28,2,c0b01461,...) at sys_read+0x5c/frame 0xf5fffc40 syscall(f5fffd08) at syscall+0x2ed/frame 0xf5fffcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5fffcfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28234077, esp = 0xbfbfd378, ebp = 0xbfbfd394 --- Tracing command su pid 70366 tid 100319 td 0xc9411300 sched_switch(c9411300,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf605e98c mi_switch(104,0,c10d2871,1f5,c10d2871,...) at mi_switch+0x1c9/frame 0xf605e9c0 sleepq_switch(c9411300,0,c10d2871,1ab,f605ea38,...) at sleepq_switch+0x1b9/frame 0xf605e9f4 sleepq_catch_signals(0,c10d2871,162,1188,c9411300,...) at sleepq_catch_signals+0x361/frame 0xf605ea3c sleepq_wait_sig(c93e1ba0,6c,c10d5ce9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf605ea60 _sleep(c93e1ba0,c93e1c34,16c,c10d5ce9,0,...) at _sleep+0x35b/frame 0xf605eabc kern_wait6(c9411300,0,115e3,0,f605eb4c,...) at kern_wait6+0x45c/frame 0xf605eb20 sys_wait4(c9411300,f605ecc8,c0edd3d0,c7200c90,0,...) at sys_wait4+0x94/frame 0xf605ec40 syscall(f605ed08) at syscall+0x2ed/frame 0xf605ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf605ecfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x28110563, esp = 0xbfbfd650, ebp = 0xbfbfd668 --- Tracing command bash pid 69824 tid 100213 td 0xc9166600 sched_switch(c9166600,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5eb698c mi_switch(104,0,c10d2871,1f5,c10d2871,...) at mi_switch+0x1c9/frame 0xf5eb69c0 sleepq_switch(c9166600,0,c10d2871,1ab,f5eb6a38,...) at sleepq_switch+0x1b9/frame 0xf5eb69f4 sleepq_catch_signals(0,c10d2871,162,1680,c9166600,...) at sleepq_catch_signals+0x361/frame 0xf5eb6a3c sleepq_wait_sig(c915f000,6c,c10d5ce9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5eb6a60 _sleep(c915f000,c915f094,16c,c10d5ce9,0,...) at _sleep+0x35b/frame 0xf5eb6abc kern_wait6(c9166600,7,0,0,f5eb6b4c,...) at kern_wait6+0x45c/frame 0xf5eb6b20 sys_wait4(c9166600,f5eb6cc8,f5eb6c8c,c0a83070,c128cd90,...) at sys_wait4+0x94/frame 0xf5eb6c40 syscall(f5eb6d08) at syscall+0x2ed/frame 0xf5eb6cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5eb6cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282b0563, esp = 0xbfbfd9b0, ebp = 0xbfbfd9c8 --- Tracing command sshd pid 69807 tid 100277 td 0xc9290600 sched_switch(c9290600,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5f9b90c mi_switch(104,0,c10d2871,1f5,200046,...) at mi_switch+0x1c9/frame 0xf5f9b940 sleepq_switch(c9290600,0,c10d2871,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5f9b974 sleepq_catch_signals(f5f9b9e0,c0a9d9b9,c84b8d60,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5f9b9bc sleepq_wait_sig(c84b8d64,0,f5f9ba10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5f9b9e0 _cv_wait_sig(c84b8d64,c84b8d50,c10d55b5,68e,1b2,...) at _cv_wait_sig+0x200/frame 0xf5f9ba24 seltdwait(ffffffff,0,0,c9290600,0,...) at seltdwait+0x90/frame 0xf5f9ba58 kern_select(c9290600,c,28c0c1c8,28c0c1d0,0,...) at kern_select+0x88c/frame 0xf5f9bbf8 sys_select(c9290600,f5f9bcc8,c0edd3d0,c71fdc90,0,...) at sys_select+0x69/frame 0xf5f9bc40 syscall(f5f9bd08) at syscall+0x2ed/frame 0xf5f9bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5f9bcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28531037, esp = 0xbfbfd374, ebp = 0xbfbfd3c0 --- Tracing command sshd pid 69648 tid 100312 td 0xc92e4000 sched_switch(c92e4000,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf6023984 mi_switch(104,0,c10d2871,1f5,200046,...) at mi_switch+0x1c9/frame 0xf60239b8 sleepq_switch(c92e4000,0,c10d2871,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf60239ec sleepq_catch_signals(f6023a58,c0a9d9b9,cc7930a0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf6023a34 sleepq_wait_sig(cc7930a4,0,f6023a88,101,0,...) at sleepq_wait_sig+0x14/frame 0xf6023a58 _cv_wait_sig(cc7930a4,cc793090,c10d55b5,68e,5c3,...) at _cv_wait_sig+0x200/frame 0xf6023a9c seltdwait(ffffffff,0,0,c92e4000,c1207740,...) at seltdwait+0x90/frame 0xf6023ad0 sys_poll(c92e4000,f6023cc8,14,c10cf0fd,7b3,...) at sys_poll+0x44c/frame 0xf6023c40 syscall(f6023d08) at syscall+0x2ed/frame 0xf6023cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6023cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284c738f, esp = 0xbfbfd3bc, ebp = 0xbfbfd408 --- Tracing command awk pid 6608 tid 100316 td 0xc92e3300 sched_switch(c92e3300,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf6031a1c mi_switch(104,0,c10d2871,1f5,c10d2871,...) at mi_switch+0x1c9/frame 0xf6031a50 sleepq_switch(c92e3300,0,c10d2871,1ab,f6031ac8,...) at sleepq_switch+0x1b9/frame 0xf6031a84 sleepq_catch_signals(0,c10d2871,162,16c8,c92e3300,...) at sleepq_catch_signals+0x361/frame 0xf6031acc sleepq_wait_sig(c7dfc330,5c,c10d57fa,100,0,...) at sleepq_wait_sig+0x14/frame 0xf6031af0 _sleep(c7dfc330,c7dfc4b0,15c,c10d57fa,0,...) at _sleep+0x35b/frame 0xf6031b4c pipe_read(cda00230,f6031c10,c7ccde00,0,c92e3300,...) at pipe_read+0x2dc/frame 0xf6031b90 dofileread(cda00230,f6031c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf6031bc4 kern_readv(c92e3300,0,f6031c10,0,28855000,...) at kern_readv+0x66/frame 0xf6031bf0 sys_read(c92e3300,f6031cc8,c0edd3d0,c71fdc90,0,...) at sys_read+0x5c/frame 0xf6031c40 syscall(f6031d08) at syscall+0x2ed/frame 0xf6031cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6031cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281c2077, esp = 0xbfbfd9e0, ebp = 0xbfbfd9f4 --- Tracing command sh pid 6607 tid 100310 td 0xc91e8600 sched_switch(c91e8600,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf601c98c mi_switch(104,0,c10d2871,1f5,c10d2871,...) at mi_switch+0x1c9/frame 0xf601c9c0 sleepq_switch(c91e8600,0,c10d2871,1ab,f601ca38,...) at sleepq_switch+0x1b9/frame 0xf601c9f4 sleepq_catch_signals(0,c10d2871,162,1470,c91e8600,...) at sleepq_catch_signals+0x361/frame 0xf601ca3c sleepq_wait_sig(c92432e8,6c,c10d5ce9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf601ca60 _sleep(c92432e8,c924337c,16c,c10d5ce9,0,...) at _sleep+0x35b/frame 0xf601cabc kern_wait6(c91e8600,7,0,0,f601cb4c,...) at kern_wait6+0x45c/frame 0xf601cb20 sys_wait4(c91e8600,f601ccc8,c1124b8f,e9,0,...) at sys_wait4+0x94/frame 0xf601cc40 syscall(f601cd08) at syscall+0x2ed/frame 0xf601ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf601ccfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x28152563, esp = 0xbfbfd938, ebp = 0xbfbfd950 --- Tracing command top pid 6573 tid 100315 td 0xc92e3600 sched_switch(c92e3600,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf602d900 mi_switch(104,0,c10d2871,1f5,400,...) at mi_switch+0x1c9/frame 0xf602d934 sleepq_switch(c92e3600,0,c10d2871,1ab,cce95590,...) at sleepq_switch+0x1b9/frame 0xf602d968 sleepq_catch_signals(c12053a8,f602d9d8,c0a9d9b9,cce955a0,0,...) at sleepq_catch_signals+0x361/frame 0xf602d9b0 sleepq_timedwait_sig(cce955a4,0,f602da10,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf602d9d8 _cv_timedwait_sig_sbt(cce955a4,cce95590,f6e57051,51c,10000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf602da24 seltdwait(51c,10000000,0,c92e3600,0,...) at seltdwait+0xbc/frame 0xf602da58 kern_select(c92e3600,2,bfbfdbe8,0,0,...) at kern_select+0x88c/frame 0xf602dbf8 sys_select(c92e3600,f602dcc8,c0edd3d0,c1825c90,0,...) at sys_select+0x69/frame 0xf602dc40 syscall(f602dd08) at syscall+0x2ed/frame 0xf602dcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf602dcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281f4037, esp = 0xbfbfdb8c, ebp = 0xbfbfdcf4 --- Tracing command sh pid 6572 tid 100247 td 0xc9165000 sched_switch(c9165000,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5f3098c mi_switch(104,0,c10d2871,1f5,c10d2871,...) at mi_switch+0x1c9/frame 0xf5f309c0 sleepq_switch(c9165000,0,c10d2871,1ab,f5f30a38,...) at sleepq_switch+0x1b9/frame 0xf5f309f4 sleepq_catch_signals(0,c10d2871,162,1380,c9165000,...) at sleepq_catch_signals+0x361/frame 0xf5f30a3c sleepq_wait_sig(c92268b8,6c,c10d5ce9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5f30a60 _sleep(c92268b8,c922694c,16c,c10d5ce9,0,...) at _sleep+0x35b/frame 0xf5f30abc kern_wait6(c9165000,7,0,0,f5f30b4c,...) at kern_wait6+0x45c/frame 0xf5f30b20 sys_wait4(c9165000,f5f30cc8,c0edd3d0,c71fac90,0,...) at sys_wait4+0x94/frame 0xf5f30c40 syscall(f5f30d08) at syscall+0x2ed/frame 0xf5f30cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5f30cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x28152563, esp = 0xbfbfdb20, ebp = 0xbfbfdb38 --- Tracing command sshd pid 6571 tid 100327 td 0xc940e900 sched_switch(c940e900,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf607690c mi_switch(104,0,c10d2871,1f5,200046,...) at mi_switch+0x1c9/frame 0xf6076940 sleepq_switch(c940e900,0,c10d2871,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf6076974 sleepq_catch_signals(f60769e0,c0a9d9b9,cc4f8e20,0,0,...) at sleepq_catch_signals+0x361/frame 0xf60769bc sleepq_wait_sig(cc4f8e24,0,f6076a10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf60769e0 _cv_wait_sig(cc4f8e24,cc4f8e10,c10d55b5,68e,5d0,...) at _cv_wait_sig+0x200/frame 0xf6076a24 seltdwait(ffffffff,0,0,c940e900,0,...) at seltdwait+0x90/frame 0xf6076a58 kern_select(c940e900,c,28c0c1c8,28c0c1d0,0,...) at kern_select+0x88c/frame 0xf6076bf8 sys_select(c940e900,f6076cc8,14,c10cf0fd,7b3,...) at sys_select+0x69/frame 0xf6076c40 syscall(f6076d08) at syscall+0x2ed/frame 0xf6076cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6076cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28531037, esp = 0xbfbfd374, ebp = 0xbfbfd3c0 --- Tracing command sshd pid 6570 tid 100257 td 0xc914ac00 sched_switch(c914ac00,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5f5090c mi_switch(104,0,c10d2871,1f5,200046,...) at mi_switch+0x1c9/frame 0xf5f50940 sleepq_switch(c914ac00,0,c10d2871,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5f50974 sleepq_catch_signals(f5f509e0,c0a9d9b9,cce559e0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5f509bc sleepq_wait_sig(cce559e4,0,f5f50a10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5f509e0 _cv_wait_sig(cce559e4,cce559d0,c10d55b5,68e,1b2,...) at _cv_wait_sig+0x200/frame 0xf5f50a24 seltdwait(ffffffff,0,0,c914ac00,0,...) at seltdwait+0x90/frame 0xf5f50a58 kern_select(c914ac00,a,28c0c1c8,28c0c1d0,0,...) at kern_select+0x88c/frame 0xf5f50bf8 sys_select(c914ac00,f5f50cc8,c0edd3d0,c71fdc90,0,...) at sys_select+0x69/frame 0xf5f50c40 syscall(f5f50d08) at syscall+0x2ed/frame 0xf5f50cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5f50cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28531037, esp = 0xbfbfd374, ebp = 0xbfbfd3c0 --- Tracing command tail pid 6569 tid 100318 td 0xc9168900 sched_switch(c9168900,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf605b634 mi_switch(104,0,c10d2871,1f5,162,...) at mi_switch+0x1c9/frame 0xf605b668 sleepq_switch(c9168900,0,c10d2871,26b,60,...) at sleepq_switch+0x1b9/frame 0xf605b69c sleepq_wait(c8321304,60,c10bc232,4,1,...) at sleepq_wait+0x48/frame 0xf605b6c0 sleeplk(c8321370,c10bc232,60,33,1,...) at sleeplk+0x126/frame 0xf605b708 __lockmgr_args(c8321304,200100,c8321370,0,0,...) at __lockmgr_args+0x60b/frame 0xf605b7e8 ffs_lock(f605b870,f605b840,c757f1e0,c7580b10,c757f1e0,...) at ffs_lock+0xad/frame 0xf605b828 VOP_LOCK1_APV(c122fbec,f605b870,0,f605b8e4,c1244430,...) at VOP_LOCK1_APV+0x112/frame 0xf605b858 _vn_lock(c83212d0,200100,c10dd567,878,2a1,...) at _vn_lock+0xca/frame 0xf605b898 vget(c83212d0,200100,c9168900,29d,c12418f8,...) at vget+0x77/frame 0xf605b8d0 cache_lookup(c80e1708,f605bb50,f605bb64,0,0,...) at cache_lookup+0x5a8/frame 0xf605b930 vfs_cache_lookup(f605b9e8,c112b2ab,c10ffc8d,c10dd567,c12418f8,...) at vfs_cache_lookup+0xbc/frame 0xf605b978 VOP_LOOKUP_APV(c122fbec,f605b9e8,f605bb64,322,f605b9f0,...) at VOP_LOOKUP_APV+0x124/frame 0xf605b9a8 lookup(f605bb18,c10dc9ab,107,ce,c13c62a8,...) at lookup+0x528/frame 0xf605ba10 namei(f605bb18,c0a77eec,c7d16a14,c849e204,0,...) at namei+0x47d/frame 0xf605ba98 kern_statat_vnhook(c9168900,0,ffffff9c,28805020,0,...) at kern_statat_vnhook+0xc2/frame 0xf605bba8 sys_stat(c9168900,f605bcc8,f605bc8c,c0a83070,c128bf90,...) at sys_stat+0x59/frame 0xf605bc40 syscall(f605bd08) at syscall+0x2ed/frame 0xf605bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf605bcfc --- syscall (188, FreeBSD ELF32, sys_stat), eip = 0x28177f47, esp = 0xbfbfdb9c, ebp = 0xbfbfdc48 --- Tracing command sshd pid 6568 tid 100322 td 0xc9410900 sched_switch(c9410900,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf6067580 mi_switch(104,0,c10d2871,1f5,101,...) at mi_switch+0x1c9/frame 0xf60675b4 sleepq_switch(c9410900,0,c10d2871,28e,c9410900,...) at sleepq_switch+0x1b9/frame 0xf60675e8 sleepq_timedwait(c49b2680,50,13,0,0,...) at sleepq_timedwait+0x48/frame 0xf606760c _sleep(c49b2680,cb7f9818,50,c1107881,ffffe8e0,...) at _sleep+0x345/frame 0xf6067668 swap_pager_getpages(cb7f9818,f6067734,2,1,f606780c,...) at swap_pager_getpages+0x4a3/frame 0xf60676c8 vm_fault_hold(cda43e80,28c0c000,2,0,0,...) at vm_fault_hold+0xa2f/frame 0xf6067828 vm_fault(cda43e80,28c0c000,2,0,cda43e80,...) at vm_fault+0x82/frame 0xf6067850 trap_pfault(28c0c1c8,67ae140,2710,7c5cc,7ed05,...) at trap_pfault+0x1ba/frame 0xf60678c8 trap(f6067a10) at trap+0x53d/frame 0xf6067a04 calltrap() at calltrap+0x6/frame 0xf6067a04 --- trap 0xc, eip = 0xc0ed3c13, esp = 0xf6067a50, ebp = 0xf6067bf8 --- copyout(c9410900,c,28c0c1c8,28c0c1d0,0,...) at copyout+0x37/frame 0xf6067bf8 sys_select(c9410900,f6067cc8,c0edd3d0,c7200c90,0,...) at sys_select+0x69/frame 0xf6067c40 syscall(f6067d08) at syscall+0x2ed/frame 0xf6067cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6067cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28531037, esp = 0xbfbfd374, ebp = 0xbfbfd3c0 --- Tracing command sshd pid 6205 tid 100263 td 0xc926c000 sched_switch(c926c000,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5f66984 mi_switch(104,0,c10d2871,1f5,200046,...) at mi_switch+0x1c9/frame 0xf5f669b8 sleepq_switch(c926c000,0,c10d2871,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5f669ec sleepq_catch_signals(f5f66a58,c0a9d9b9,cac6ba60,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5f66a34 sleepq_wait_sig(cac6ba64,0,f5f66a88,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5f66a58 _cv_wait_sig(cac6ba64,cac6ba50,c10d55b5,68e,5c3,...) at _cv_wait_sig+0x200/frame 0xf5f66a9c seltdwait(ffffffff,0,0,c926c000,0,...) at seltdwait+0x90/frame 0xf5f66ad0 sys_poll(c926c000,f5f66cc8,14,c10cf0fd,7b3,...) at sys_poll+0x44c/frame 0xf5f66c40 syscall(f5f66d08) at syscall+0x2ed/frame 0xf5f66cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5f66cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284c738f, esp = 0xbfbfd3bc, ebp = 0xbfbfd408 --- Tracing command sshd pid 6204 tid 100306 td 0xc92c0c00 sched_switch(c92c0c00,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf600b984 mi_switch(104,0,c10d2871,1f5,200046,...) at mi_switch+0x1c9/frame 0xf600b9b8 sleepq_switch(c92c0c00,0,c10d2871,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf600b9ec sleepq_catch_signals(f600ba58,c0a9d9b9,cbe6e820,0,0,...) at sleepq_catch_signals+0x361/frame 0xf600ba34 sleepq_wait_sig(cbe6e824,0,f600ba88,101,0,...) at sleepq_wait_sig+0x14/frame 0xf600ba58 _cv_wait_sig(cbe6e824,cbe6e810,c10d55b5,68e,5c3,...) at _cv_wait_sig+0x200/frame 0xf600ba9c seltdwait(ffffffff,0,0,c92c0c00,0,...) at seltdwait+0x90/frame 0xf600bad0 sys_poll(c92c0c00,f600bcc8,14,c10cf0fd,7b3,...) at sys_poll+0x44c/frame 0xf600bc40 syscall(f600bd08) at syscall+0x2ed/frame 0xf600bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf600bcfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284c738f, esp = 0xbfbfd3bc, ebp = 0xbfbfd408 --- Tracing command sshd pid 6203 tid 100329 td 0xc940e300 sched_switch(c940e300,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf607c984 mi_switch(104,0,c10d2871,1f5,200046,...) at mi_switch+0x1c9/frame 0xf607c9b8 sleepq_switch(c940e300,0,c10d2871,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf607c9ec sleepq_catch_signals(f607ca58,c0a9d9b9,cb3bc520,0,0,...) at sleepq_catch_signals+0x361/frame 0xf607ca34 sleepq_wait_sig(cb3bc524,0,f607ca88,101,0,...) at sleepq_wait_sig+0x14/frame 0xf607ca58 _cv_wait_sig(cb3bc524,cb3bc510,c10d55b5,68e,5c3,...) at _cv_wait_sig+0x200/frame 0xf607ca9c seltdwait(ffffffff,0,0,c940e300,0,...) at seltdwait+0x90/frame 0xf607cad0 sys_poll(c940e300,f607ccc8,c0edd3d0,c71fdc90,0,...) at sys_poll+0x44c/frame 0xf607cc40 syscall(f607cd08) at syscall+0x2ed/frame 0xf607ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf607ccfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284c738f, esp = 0xbfbfd3bc, ebp = 0xbfbfd408 --- Tracing command getty pid 990 tid 100104 td 0xc7e7b300 sched_switch(c7e7b300,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5d199bc mi_switch(104,0,c10d2871,1f5,c10d2871,...) at mi_switch+0x1c9/frame 0xf5d199f0 sleepq_switch(c7e7b300,0,c10d2871,1ab,f5d19a68,...) at sleepq_switch+0x1b9/frame 0xf5d19a24 sleepq_catch_signals(0,c10d2871,162,510,1,...) at sleepq_catch_signals+0x361/frame 0xf5d19a6c sleepq_wait_sig(c75a4670,0,c10d75f5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5d19a90 _cv_wait_sig(c75a4670,c1447298,c10d75e1,531,f5d19c10,...) at _cv_wait_sig+0x200/frame 0xf5d19ad4 tty_wait(c75a4600,c75a4670,f5d19c10,1,0,...) at tty_wait+0x4b/frame 0xf5d19af8 ttydisc_read(c75a4600,f5d19c10,0,a1,f5d19c10,...) at ttydisc_read+0x377/frame 0xf5d19b3c ttydev_read(c7909500,f5d19c10,0,1,0,...) at ttydev_read+0x81/frame 0xf5d19b5c devfs_read_f(c7d87968,f5d19c10,c76bfe80,0,c7e7b300,...) at devfs_read_f+0x87/frame 0xf5d19b90 dofileread(c7d87968,f5d19c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5d19bc4 kern_readv(c7e7b300,0,f5d19c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5d19bf0 sys_read(c7e7b300,f5d19cc8,c0edd3d0,c7200c90,0,...) at sys_read+0x5c/frame 0xf5d19c40 syscall(f5d19d08) at syscall+0x2ed/frame 0xf5d19cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d19cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819d077, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 989 tid 100125 td 0xc794ac00 sched_switch(c794ac00,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5da19bc mi_switch(104,0,c10d2871,1f5,c10d2871,...) at mi_switch+0x1c9/frame 0xf5da19f0 sleepq_switch(c794ac00,0,c10d2871,1ab,f5da1a68,...) at sleepq_switch+0x1b9/frame 0xf5da1a24 sleepq_catch_signals(0,c10d2871,162,540,1,...) at sleepq_catch_signals+0x361/frame 0xf5da1a6c sleepq_wait_sig(c75a4870,0,c10d75f5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5da1a90 _cv_wait_sig(c75a4870,c1447298,c10d75e1,531,f5da1c10,...) at _cv_wait_sig+0x200/frame 0xf5da1ad4 tty_wait(c75a4800,c75a4870,f5da1c10,1,0,...) at tty_wait+0x4b/frame 0xf5da1af8 ttydisc_read(c75a4800,f5da1c10,0,a1,f5da1c10,...) at ttydisc_read+0x377/frame 0xf5da1b3c ttydev_read(c7909600,f5da1c10,0,1,0,...) at ttydev_read+0x81/frame 0xf5da1b5c devfs_read_f(c7db8658,f5da1c10,c76bfe80,0,c794ac00,...) at devfs_read_f+0x87/frame 0xf5da1b90 dofileread(c7db8658,f5da1c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5da1bc4 kern_readv(c794ac00,0,f5da1c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5da1bf0 sys_read(c794ac00,f5da1cc8,c0edd3d0,c71fdc90,0,...) at sys_read+0x5c/frame 0xf5da1c40 syscall(f5da1d08) at syscall+0x2ed/frame 0xf5da1cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5da1cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819d077, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 988 tid 100080 td 0xc7e09000 sched_switch(c7e09000,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5c819bc mi_switch(104,0,c10d2871,1f5,c10d2871,...) at mi_switch+0x1c9/frame 0xf5c819f0 sleepq_switch(c7e09000,0,c10d2871,1ab,f5c81a68,...) at sleepq_switch+0x1b9/frame 0xf5c81a24 sleepq_catch_signals(0,c10d2871,162,570,1,...) at sleepq_catch_signals+0x361/frame 0xf5c81a6c sleepq_wait_sig(c75a4a70,0,c10d75f5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5c81a90 _cv_wait_sig(c75a4a70,c1447298,c10d75e1,531,f5c81c10,...) at _cv_wait_sig+0x200/frame 0xf5c81ad4 tty_wait(c75a4a00,c75a4a70,f5c81c10,1,0,...) at tty_wait+0x4b/frame 0xf5c81af8 ttydisc_read(c75a4a00,f5c81c10,0,a1,f5c81c10,...) at ttydisc_read+0x377/frame 0xf5c81b3c ttydev_read(c7909700,f5c81c10,0,1,0,...) at ttydev_read+0x81/frame 0xf5c81b5c devfs_read_f(c7db88c0,f5c81c10,c76bfe80,0,c7e09000,...) at devfs_read_f+0x87/frame 0xf5c81b90 dofileread(c7db88c0,f5c81c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5c81bc4 kern_readv(c7e09000,0,f5c81c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5c81bf0 sys_read(c7e09000,f5c81cc8,c0edd3d0,c71fac90,0,...) at sys_read+0x5c/frame 0xf5c81c40 syscall(f5c81d08) at syscall+0x2ed/frame 0xf5c81cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c81cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819d077, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 987 tid 100115 td 0xc7dae300 sched_switch(c7dae300,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5d549bc mi_switch(104,0,c10d2871,1f5,c10d2871,...) at mi_switch+0x1c9/frame 0xf5d549f0 sleepq_switch(c7dae300,0,c10d2871,1ab,f5d54a68,...) at sleepq_switch+0x1b9/frame 0xf5d54a24 sleepq_catch_signals(0,c10d2871,162,5a0,1,...) at sleepq_catch_signals+0x361/frame 0xf5d54a6c sleepq_wait_sig(c75a4c70,0,c10d75f5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5d54a90 _cv_wait_sig(c75a4c70,c1447298,c10d75e1,531,f5d54c10,...) at _cv_wait_sig+0x200/frame 0xf5d54ad4 tty_wait(c75a4c00,c75a4c70,f5d54c10,1,0,...) at tty_wait+0x4b/frame 0xf5d54af8 ttydisc_read(c75a4c00,f5d54c10,0,a1,f5d54c10,...) at ttydisc_read+0x377/frame 0xf5d54b3c ttydev_read(c7909800,f5d54c10,0,1,0,...) at ttydev_read+0x81/frame 0xf5d54b5c devfs_read_f(c7d87e38,f5d54c10,c76bfe80,0,c7dae300,...) at devfs_read_f+0x87/frame 0xf5d54b90 dofileread(c7d87e38,f5d54c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5d54bc4 kern_readv(c7dae300,0,f5d54c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5d54bf0 sys_read(c7dae300,f5d54cc8,c0edd3d0,c7200c90,0,...) at sys_read+0x5c/frame 0xf5d54c40 syscall(f5d54d08) at syscall+0x2ed/frame 0xf5d54cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d54cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819d077, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 986 tid 100142 td 0xc86b6300 sched_switch(c86b6300,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5dd49bc mi_switch(104,0,c10d2871,1f5,c10d2871,...) at mi_switch+0x1c9/frame 0xf5dd49f0 sleepq_switch(c86b6300,0,c10d2871,1ab,f5dd4a68,...) at sleepq_switch+0x1b9/frame 0xf5dd4a24 sleepq_catch_signals(0,c10d2871,162,5d0,1,...) at sleepq_catch_signals+0x361/frame 0xf5dd4a6c sleepq_wait_sig(c75a4e70,0,c10d75f5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5dd4a90 _cv_wait_sig(c75a4e70,c1447298,c10d75e1,531,f5dd4c10,...) at _cv_wait_sig+0x200/frame 0xf5dd4ad4 tty_wait(c75a4e00,c75a4e70,f5dd4c10,1,0,...) at tty_wait+0x4b/frame 0xf5dd4af8 ttydisc_read(c75a4e00,f5dd4c10,0,a1,f5dd4c10,...) at ttydisc_read+0x377/frame 0xf5dd4b3c ttydev_read(c7909900,f5dd4c10,0,1,0,...) at ttydev_read+0x81/frame 0xf5dd4b5c devfs_read_f(c7d885e8,f5dd4c10,c76bfe80,0,c86b6300,...) at devfs_read_f+0x87/frame 0xf5dd4b90 dofileread(c7d885e8,f5dd4c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5dd4bc4 kern_readv(c86b6300,0,f5dd4c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5dd4bf0 sys_read(c86b6300,f5dd4cc8,c0edd3d0,c1825c90,0,...) at sys_read+0x5c/frame 0xf5dd4c40 syscall(f5dd4d08) at syscall+0x2ed/frame 0xf5dd4cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5dd4cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819d077, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 985 tid 100137 td 0xc794a300 sched_switch(c794a300,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5dc59bc mi_switch(104,0,c10d2871,1f5,c10d2871,...) at mi_switch+0x1c9/frame 0xf5dc59f0 sleepq_switch(c794a300,0,c10d2871,1ab,f5dc5a68,...) at sleepq_switch+0x1b9/frame 0xf5dc5a24 sleepq_catch_signals(0,c10d2871,162,d80,1,...) at sleepq_catch_signals+0x361/frame 0xf5dc5a6c sleepq_wait_sig(c792e070,0,c10d75f5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5dc5a90 _cv_wait_sig(c792e070,c1447298,c10d75e1,531,f5dc5c10,...) at _cv_wait_sig+0x200/frame 0xf5dc5ad4 tty_wait(c792e000,c792e070,f5dc5c10,1,0,...) at tty_wait+0x4b/frame 0xf5dc5af8 ttydisc_read(c792e000,f5dc5c10,0,a1,f5dc5c10,...) at ttydisc_read+0x377/frame 0xf5dc5b3c ttydev_read(c7909a00,f5dc5c10,0,1,0,...) at ttydev_read+0x81/frame 0xf5dc5b5c devfs_read_f(c7d88ce8,f5dc5c10,c76bfe80,0,c794a300,...) at devfs_read_f+0x87/frame 0xf5dc5b90 dofileread(c7d88ce8,f5dc5c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5dc5bc4 kern_readv(c794a300,0,f5dc5c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5dc5bf0 sys_read(c794a300,f5dc5cc8,c1124b8f,d6,0,...) at sys_read+0x5c/frame 0xf5dc5c40 syscall(f5dc5d08) at syscall+0x2ed/frame 0xf5dc5cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5dc5cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819d077, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 984 tid 100130 td 0xc86b7900 sched_switch(c86b7900,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5db09bc mi_switch(104,0,c10d2871,1f5,c10d2871,...) at mi_switch+0x1c9/frame 0xf5db09f0 sleepq_switch(c86b7900,0,c10d2871,1ab,f5db0a68,...) at sleepq_switch+0x1b9/frame 0xf5db0a24 sleepq_catch_signals(0,c10d2871,162,db0,1,...) at sleepq_catch_signals+0x361/frame 0xf5db0a6c sleepq_wait_sig(c792e270,0,c10d75f5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5db0a90 _cv_wait_sig(c792e270,c1447298,c10d75e1,531,f5db0c10,...) at _cv_wait_sig+0x200/frame 0xf5db0ad4 tty_wait(c792e200,c792e270,f5db0c10,1,0,...) at tty_wait+0x4b/frame 0xf5db0af8 ttydisc_read(c792e200,f5db0c10,0,a1,f5db0c10,...) at ttydisc_read+0x377/frame 0xf5db0b3c ttydev_read(c7909b00,f5db0c10,0,1,0,...) at ttydev_read+0x81/frame 0xf5db0b5c devfs_read_f(c7df1dc8,f5db0c10,c76bfe80,0,c86b7900,...) at devfs_read_f+0x87/frame 0xf5db0b90 dofileread(c7df1dc8,f5db0c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5db0bc4 kern_readv(c86b7900,0,f5db0c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5db0bf0 sys_read(c86b7900,f5db0cc8,c1124b8f,d6,7b3,...) at sys_read+0x5c/frame 0xf5db0c40 syscall(f5db0d08) at syscall+0x2ed/frame 0xf5db0cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5db0cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819d077, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 983 tid 100132 td 0xc794a600 sched_switch(c794a600,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5db69bc mi_switch(104,0,c10d2871,1f5,c10d2871,...) at mi_switch+0x1c9/frame 0xf5db69f0 sleepq_switch(c794a600,0,c10d2871,1ab,f5db6a68,...) at sleepq_switch+0x1b9/frame 0xf5db6a24 sleepq_catch_signals(0,c10d2871,162,de0,1,...) at sleepq_catch_signals+0x361/frame 0xf5db6a6c sleepq_wait_sig(c792e470,0,c10d75f5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5db6a90 _cv_wait_sig(c792e470,c1447298,c10d75e1,531,f5db6c10,...) at _cv_wait_sig+0x200/frame 0xf5db6ad4 tty_wait(c792e400,c792e470,f5db6c10,1,0,...) at tty_wait+0x4b/frame 0xf5db6af8 ttydisc_read(c792e400,f5db6c10,0,a1,f5db6c10,...) at ttydisc_read+0x377/frame 0xf5db6b3c ttydev_read(c7909c00,f5db6c10,0,1,0,...) at ttydev_read+0x81/frame 0xf5db6b5c devfs_read_f(c7da7118,f5db6c10,c76bfe80,0,c794a600,...) at devfs_read_f+0x87/frame 0xf5db6b90 dofileread(c7da7118,f5db6c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5db6bc4 kern_readv(c794a600,0,f5db6c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5db6bf0 sys_read(c794a600,f5db6cc8,14,c10cf0fd,7b3,...) at sys_read+0x5c/frame 0xf5db6c40 syscall(f5db6d08) at syscall+0x2ed/frame 0xf5db6cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5db6cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819d077, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 982 tid 100131 td 0xc86b7600 sched_switch(c86b7600,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5db39bc mi_switch(104,0,c10d2871,1f5,46,...) at mi_switch+0x1c9/frame 0xf5db39f0 sleepq_switch(c86b7600,0,c10d2871,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5db3a24 sleepq_catch_signals(f5db3a90,c0a9d9b9,c75a3014,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5db3a6c sleepq_wait_sig(c75a3070,0,f5db3ac0,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5db3a90 _cv_wait_sig(c75a3070,c75a3004,c10d75e1,531,f5db3c10,...) at _cv_wait_sig+0x200/frame 0xf5db3ad4 tty_wait(c75a3000,c75a3070,f5db3c10,1,0,...) at tty_wait+0x4b/frame 0xf5db3af8 ttydisc_read(c75a3000,f5db3c10,0,a1,f5db3c10,...) at ttydisc_read+0x377/frame 0xf5db3b3c ttydev_read(c7771d00,f5db3c10,0,1,0,...) at ttydev_read+0x81/frame 0xf5db3b5c devfs_read_f(c7d87230,f5db3c10,c76bfe80,0,c86b7600,...) at devfs_read_f+0x87/frame 0xf5db3b90 dofileread(c7d87230,f5db3c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5db3bc4 kern_readv(c86b7600,0,f5db3c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5db3bf0 sys_read(c86b7600,f5db3cc8,14,c10cf0fd,7b3,...) at sys_read+0x5c/frame 0xf5db3c40 syscall(f5db3d08) at syscall+0x2ed/frame 0xf5db3cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5db3cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819d077, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command inetd pid 965 tid 100136 td 0xc86b6900 sched_switch(c86b6900,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5dc290c mi_switch(104,0,c10d2871,1f5,46,...) at mi_switch+0x1c9/frame 0xf5dc2940 sleepq_switch(c86b6900,0,c10d2871,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5dc2974 sleepq_catch_signals(f5dc29e0,c0a9d9b9,c7db51a0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5dc29bc sleepq_wait_sig(c7db51a4,0,f5dc2a10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5dc29e0 _cv_wait_sig(c7db51a4,c7db5190,c10d55b5,68e,c0b0cd1d,...) at _cv_wait_sig+0x200/frame 0xf5dc2a24 seltdwait(ffffffff,0,0,c86b6900,0,...) at seltdwait+0x90/frame 0xf5dc2a58 kern_select(c86b6900,8,bfbfd070,0,0,...) at kern_select+0x88c/frame 0xf5dc2bf8 sys_select(c86b6900,f5dc2cc8,c1124b8f,e9,0,...) at sys_select+0x69/frame 0xf5dc2c40 syscall(f5dc2d08) at syscall+0x2ed/frame 0xf5dc2cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5dc2cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281af037, esp = 0xbfbfd014, ebp = 0xbfbfde34 --- Tracing command watchdogd pid 941 tid 100105 td 0xc7e7b000 sched_switch(c7e7b000,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5d1ca64 mi_switch(104,0,c10d2871,1f5,c0af53c0,...) at mi_switch+0x1c9/frame 0xf5d1ca98 sleepq_switch(c7e7b000,0,c10d2871,1ab,8,...) at sleepq_switch+0x1b9/frame 0xf5d1cacc sleepq_catch_signals(c0af53c0,c7e7b000,3,201,3,...) at sleepq_catch_signals+0x361/frame 0xf5d1cb14 sleepq_timedwait_sig(c127f65b,6c,52f,c0000000,3,...) at sleepq_timedwait_sig+0x14/frame 0xf5d1cb3c _sleep(c127f65b,0,16c,c10ce1ea,65bea55d,...) at _sleep+0x331/frame 0xf5d1cb98 kern_nanosleep(bfbfdcb0,f5d1cc18,f5d1cc20,c7ccf760,3c,...) at kern_nanosleep+0x158/frame 0xf5d1cc00 sys_nanosleep(c7e7b000,f5d1ccc8,c0edd3d0,c71fdc90,0,...) at sys_nanosleep+0x6b/frame 0xf5d1cc40 syscall(f5d1cd08) at syscall+0x2ed/frame 0xf5d1ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d1ccfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28178223, esp = 0xbfbfdca4, ebp = 0xbfbfdce8 --- Tracing command bash pid 794 tid 100147 td 0xc86c4900 sched_switch(c86c4900,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5de398c mi_switch(104,0,c10d2871,1f5,c10d2871,...) at mi_switch+0x1c9/frame 0xf5de39c0 sleepq_switch(c86c4900,0,c10d2871,1ab,f5de3a38,...) at sleepq_switch+0x1b9/frame 0xf5de39f4 sleepq_catch_signals(0,c10d2871,162,888,c86c4900,...) at sleepq_catch_signals+0x361/frame 0xf5de3a3c sleepq_wait_sig(c833fba0,6c,c10d5ce9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5de3a60 _sleep(c833fba0,c833fc34,16c,c10d5ce9,0,...) at _sleep+0x35b/frame 0xf5de3abc kern_wait6(c86c4900,7,0,0,f5de3b4c,...) at kern_wait6+0x45c/frame 0xf5de3b20 sys_wait4(c86c4900,f5de3cc8,c0edd3d0,c1825c90,0,...) at sys_wait4+0x94/frame 0xf5de3c40 syscall(f5de3d08) at syscall+0x2ed/frame 0xf5de3cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5de3cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282b0563, esp = 0xbfbfd7c0, ebp = 0xbfbfd7d8 --- Tracing command csh pid 791 tid 100081 td 0xc7e08c00 sched_switch(c7e08c00,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5c85aa0 mi_switch(104,0,c10d2871,1f5,8,...) at mi_switch+0x1c9/frame 0xf5c85ad4 sleepq_switch(c7e08c00,0,c10d2871,1ab,f5c85b4c,...) at sleepq_switch+0x1b9/frame 0xf5c85b08 sleepq_catch_signals(0,c10d2871,162,1f8,c7e08c00,...) at sleepq_catch_signals+0x361/frame 0xf5c85b50 sleepq_wait_sig(c7e0091c,74,c0f2f354,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5c85b74 _sleep(c7e0091c,c7e0094c,174,c0f2f354,0,...) at _sleep+0x35b/frame 0xf5c85bd0 kern_sigsuspend(c7e08c00,0,0,0,0,...) at kern_sigsuspend+0xfb/frame 0xf5c85c10 sys_sigsuspend(c7e08c00,f5c85cc8,c1124b8f,e9,0,...) at sys_sigsuspend+0x58/frame 0xf5c85c40 syscall(f5c85d08) at syscall+0x2ed/frame 0xf5c85cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c85cfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2816c15b, esp = 0xbfbfd134, ebp = 0xbfbfd19c --- Tracing command su pid 790 tid 100114 td 0xc7dae600 sched_switch(c7dae600,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5d4898c mi_switch(104,0,c10d2871,1f5,c10d2871,...) at mi_switch+0x1c9/frame 0xf5d489c0 sleepq_switch(c7dae600,0,c10d2871,1ab,f5d48a38,...) at sleepq_switch+0x1b9/frame 0xf5d489f4 sleepq_catch_signals(0,c10d2871,162,4f8,c7dae600,...) at sleepq_catch_signals+0x361/frame 0xf5d48a3c sleepq_wait_sig(c833e5d0,6c,c10d5ce9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5d48a60 _sleep(c833e5d0,c833e664,16c,c10d5ce9,0,...) at _sleep+0x35b/frame 0xf5d48abc kern_wait6(c7dae600,0,317,0,f5d48b4c,...) at kern_wait6+0x45c/frame 0xf5d48b20 sys_wait4(c7dae600,f5d48cc8,c0edd3d0,c7200c90,0,...) at sys_wait4+0x94/frame 0xf5d48c40 syscall(f5d48d08) at syscall+0x2ed/frame 0xf5d48cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d48cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x28110563, esp = 0xbfbfd650, ebp = 0xbfbfd668 --- Tracing command bash pid 785 tid 100150 td 0xc86b5900 sched_switch(c86b5900,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5dec98c mi_switch(104,0,c10d2871,1f5,c10d2871,...) at mi_switch+0x1c9/frame 0xf5dec9c0 sleepq_switch(c86b5900,0,c10d2871,1ab,f5deca38,...) at sleepq_switch+0x1b9/frame 0xf5dec9f4 sleepq_catch_signals(0,c10d2871,162,ff0,c86b5900,...) at sleepq_catch_signals+0x361/frame 0xf5deca3c sleepq_wait_sig(c86a42e8,6c,c10d5ce9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5deca60 _sleep(c86a42e8,c86a437c,16c,c10d5ce9,0,...) at _sleep+0x35b/frame 0xf5decabc kern_wait6(c86b5900,7,0,0,f5decb4c,...) at kern_wait6+0x45c/frame 0xf5decb20 sys_wait4(c86b5900,f5deccc8,8,c10cd1dc,db,...) at sys_wait4+0x94/frame 0xf5decc40 syscall(f5decd08) at syscall+0x2ed/frame 0xf5deccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5deccfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282b0563, esp = 0xbfbfd9b0, ebp = 0xbfbfd9c8 --- Tracing command sshd pid 784 tid 100146 td 0xc86b6000 sched_switch(c86b6000,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5de090c mi_switch(104,0,c10d2871,1f5,200046,...) at mi_switch+0x1c9/frame 0xf5de0940 sleepq_switch(c86b6000,0,c10d2871,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5de0974 sleepq_catch_signals(f5de09e0,c0a9d9b9,c84b8e20,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5de09bc sleepq_wait_sig(c84b8e24,0,f5de0a10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5de09e0 _cv_wait_sig(c84b8e24,c84b8e10,c10d55b5,68e,1b2,...) at _cv_wait_sig+0x200/frame 0xf5de0a24 seltdwait(ffffffff,0,0,c86b6000,0,...) at seltdwait+0x90/frame 0xf5de0a58 kern_select(c86b6000,c,28c0c1c8,28c0c1d0,0,...) at kern_select+0x88c/frame 0xf5de0bf8 sys_select(c86b6000,f5de0cc8,f5de0c8c,c0a83070,c128b890,...) at sys_select+0x69/frame 0xf5de0c40 syscall(f5de0d08) at syscall+0x2ed/frame 0xf5de0cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5de0cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28531037, esp = 0xbfbfd374, ebp = 0xbfbfd3c0 --- Tracing command sshd pid 782 tid 100149 td 0xc86b5c00 sched_switch(c86b5c00,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5de9984 mi_switch(104,0,c10d2871,1f5,200046,...) at mi_switch+0x1c9/frame 0xf5de99b8 sleepq_switch(c86b5c00,0,c10d2871,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5de99ec sleepq_catch_signals(f5de9a58,c0a9d9b9,c8a44360,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5de9a34 sleepq_wait_sig(c8a44364,0,f5de9a88,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5de9a58 _cv_wait_sig(c8a44364,c8a44350,c10d55b5,68e,5c3,...) at _cv_wait_sig+0x200/frame 0xf5de9a9c seltdwait(ffffffff,0,0,c86b5c00,c1207740,...) at seltdwait+0x90/frame 0xf5de9ad0 sys_poll(c86b5c00,f5de9cc8,c0edd3d0,c7200c90,0,...) at sys_poll+0x44c/frame 0xf5de9c40 syscall(f5de9d08) at syscall+0x2ed/frame 0xf5de9cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5de9cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284c738f, esp = 0xbfbfd3bc, ebp = 0xbfbfd408 --- Tracing command cron pid 735 tid 100129 td 0xc7e02000 sched_switch(c7e02000,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5dada64 mi_switch(104,0,c10d2871,1f5,c0af53c0,...) at mi_switch+0x1c9/frame 0xf5dada98 sleepq_switch(c7e02000,0,c10d2871,1ab,8,...) at sleepq_switch+0x1b9/frame 0xf5dadacc sleepq_catch_signals(c0af53c0,c7e02000,3,201,3,...) at sleepq_catch_signals+0x361/frame 0xf5dadb14 sleepq_timedwait_sig(c127f65b,6c,51d,ee91c141,2,...) at sleepq_timedwait_sig+0x14/frame 0xf5dadb3c _sleep(c127f65b,0,16c,c10ce1ea,9cada19a,...) at _sleep+0x331/frame 0xf5dadb98 kern_nanosleep(bfbfde28,f5dadc18,f5dadc20,f5dadcc8,2e,...) at kern_nanosleep+0x158/frame 0xf5dadc00 sys_nanosleep(c7e02000,f5dadcc8,c0edd3d0,c7200c90,0,...) at sys_nanosleep+0x6b/frame 0xf5dadc40 syscall(f5dadd08) at syscall+0x2ed/frame 0xf5dadcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5dadcfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28188223, esp = 0xbfbfdcb4, ebp = 0xbfbfde44 --- Tracing command sendmail pid 730 tid 100127 td 0xc794a900 sched_switch(c794a900,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5da7aa0 mi_switch(104,0,c10d2871,1f5,8,...) at mi_switch+0x1c9/frame 0xf5da7ad4 sleepq_switch(c794a900,0,c10d2871,1ab,f5da7b4c,...) at sleepq_switch+0x1b9/frame 0xf5da7b08 sleepq_catch_signals(0,c10d2871,162,378,c794a900,...) at sleepq_catch_signals+0x361/frame 0xf5da7b50 sleepq_wait_sig(c86a391c,74,c0f2f354,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5da7b74 _sleep(c86a391c,c86a394c,174,c0f2f354,0,...) at _sleep+0x35b/frame 0xf5da7bd0 kern_sigsuspend(c794a900,0,0,0,0,...) at kern_sigsuspend+0xfb/frame 0xf5da7c10 sys_sigsuspend(c794a900,f5da7cc8,1,0,c794a900,...) at sys_sigsuspend+0x58/frame 0xf5da7c40 syscall(f5da7d08) at syscall+0x2ed/frame 0xf5da7cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5da7cfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2835815b, esp = 0xbfbfc9dc, ebp = 0xbfbfca08 --- Tracing command sendmail pid 727 tid 100126 td 0xc7e02600 sched_switch(c7e02600,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5da4900 mi_switch(104,0,c10d2871,1f5,400,...) at mi_switch+0x1c9/frame 0xf5da4934 sleepq_switch(c7e02600,0,c10d2871,1ab,c757a650,...) at sleepq_switch+0x1b9/frame 0xf5da4968 sleepq_catch_signals(c12053a8,f5da49d8,c0a9d9b9,c757a660,0,...) at sleepq_catch_signals+0x361/frame 0xf5da49b0 sleepq_timedwait_sig(c757a664,0,f5da4a10,50000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf5da49d8 _cv_timedwait_sig_sbt(c757a664,c757a650,eef53a2f,520,50000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5da4a24 seltdwait(520,50000000,0,c7e02600,0,...) at seltdwait+0xbc/frame 0xf5da4a58 kern_select(c7e02600,5,bfbfbfc8,0,0,...) at kern_select+0x88c/frame 0xf5da4bf8 sys_select(c7e02600,f5da4cc8,c0edd3d0,c1825c90,0,...) at sys_select+0x69/frame 0xf5da4c40 syscall(f5da4d08) at syscall+0x2ed/frame 0xf5da4cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5da4cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28420037, esp = 0xbfbfbf2c, ebp = 0xbfbfc9e8 --- Tracing command sshd pid 724 tid 100093 td 0xc7d7a000 sched_switch(c7d7a000,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5cc190c mi_switch(104,0,c10d2871,1f5,200046,...) at mi_switch+0x1c9/frame 0xf5cc1940 sleepq_switch(c7d7a000,0,c10d2871,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5cc1974 sleepq_catch_signals(f5cc19e0,c0a9d9b9,c7d43a60,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5cc19bc sleepq_wait_sig(c7d43a64,0,f5cc1a10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5cc19e0 _cv_wait_sig(c7d43a64,c7d43a50,c10d55b5,68e,c0b0cd1d,...) at _cv_wait_sig+0x200/frame 0xf5cc1a24 seltdwait(ffffffff,0,0,c7d7a000,0,...) at seltdwait+0x90/frame 0xf5cc1a58 kern_select(c7d7a000,9,28c0c140,0,0,...) at kern_select+0x88c/frame 0xf5cc1bf8 sys_select(c7d7a000,f5cc1cc8,c0edd3d0,c71fac90,0,...) at sys_select+0x69/frame 0xf5cc1c40 syscall(f5cc1d08) at syscall+0x2ed/frame 0xf5cc1cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cc1cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28531037, esp = 0xbfbfd424, ebp = 0xbfbfde44 --- Tracing command moused pid 692 tid 100079 td 0xc7daf900 sched_switch(c7daf900,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5c7a90c mi_switch(104,0,c10d2871,1f5,46,...) at mi_switch+0x1c9/frame 0xf5c7a940 sleepq_switch(c7daf900,0,c10d2871,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5c7a974 sleepq_catch_signals(f5c7a9e0,c0a9d9b9,c7e01ba0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5c7a9bc sleepq_wait_sig(c7e01ba4,0,f5c7aa10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5c7a9e0 _cv_wait_sig(c7e01ba4,c7e01b90,c10d55b5,68e,c7daf900,...) at _cv_wait_sig+0x200/frame 0xf5c7aa24 seltdwait(ffffffff,0,0,c7daf900,0,...) at seltdwait+0x90/frame 0xf5c7aa58 kern_select(c7daf900,400,bfbfdcb0,0,0,...) at kern_select+0x88c/frame 0xf5c7abf8 sys_select(c7daf900,f5c7acc8,c0edd3d0,c71fdc90,0,...) at sys_select+0x69/frame 0xf5c7ac40 syscall(f5c7ad08) at syscall+0x2ed/frame 0xf5c7acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c7acfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281bd037, esp = 0xbfbfd894, ebp = 0xbfbfde24 --- Tracing command smartd pid 684 tid 100088 td 0xc7d7a300 sched_switch(c7d7a300,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5ca6a64 mi_switch(104,0,c10d2871,1f5,c0af53c0,...) at mi_switch+0x1c9/frame 0xf5ca6a98 sleepq_switch(c7d7a300,0,c10d2871,1ab,8,...) at sleepq_switch+0x1b9/frame 0xf5ca6acc sleepq_catch_signals(c0af53c0,c7d7a300,0,201,0,...) at sleepq_catch_signals+0x361/frame 0xf5ca6b14 sleepq_timedwait_sig(c127f658,6c,71c,80000000,70,...) at sleepq_timedwait_sig+0x14/frame 0xf5ca6b3c _sleep(c127f658,0,16c,c10ce1ea,149cbeba,...) at _sleep+0x331/frame 0xf5ca6b98 kern_nanosleep(bfbf53c8,f5ca6c18,f5ca6c20,f5ca6cc8,708,...) at kern_nanosleep+0x158/frame 0xf5ca6c00 sys_nanosleep(c7d7a300,f5ca6cc8,c0edd3d0,c1825c90,0,...) at sys_nanosleep+0x6b/frame 0xf5ca6c40 syscall(f5ca6d08) at syscall+0x2ed/frame 0xf5ca6cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5ca6cfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x282ea223, esp = 0xbfbf53bc, ebp = 0xbfbf5400 --- Tracing command winbindd pid 682 tid 100096 td 0xc7d77600 sched_switch(c7d77600,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5ccd978 mi_switch(104,0,c10d2871,1f5,400,...) at mi_switch+0x1c9/frame 0xf5ccd9ac sleepq_switch(c7d77600,0,c10d2871,1ab,c7e01dd0,...) at sleepq_switch+0x1b9/frame 0xf5ccd9e0 sleepq_catch_signals(c12053a8,f5ccda50,c0a9d9b9,c7e01de0,0,...) at sleepq_catch_signals+0x361/frame 0xf5ccda28 sleepq_timedwait_sig(c7e01de4,0,f5ccda88,b7fbe76c,20c49,...) at sleepq_timedwait_sig+0x14/frame 0xf5ccda50 _cv_timedwait_sig_sbt(c7e01de4,c7e01dd0,ef37a223,20c97e,b7fbe76c,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5ccda9c seltdwait(20c97e,b7fbe76c,20c49,c7d77600,c10d92fc,...) at seltdwait+0xbc/frame 0xf5ccdad0 sys_poll(c7d77600,f5ccdcc8,14,c10cf0fd,7b3,...) at sys_poll+0x44c/frame 0xf5ccdc40 syscall(f5ccdd08) at syscall+0x2ed/frame 0xf5ccdcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5ccdcfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2193b38f, esp = 0xbfbfc47c, ebp = 0xbfbfc4b8 --- Tracing command smbd pid 681 tid 100111 td 0xc7daf000 sched_switch(c7daf000,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5d2f978 mi_switch(104,0,c10d2871,1f5,400,...) at mi_switch+0x1c9/frame 0xf5d2f9ac sleepq_switch(c7daf000,0,c10d2871,1ab,c7db5690,...) at sleepq_switch+0x1b9/frame 0xf5d2f9e0 sleepq_catch_signals(c12053a8,f5d2fa50,c0a9d9b9,c7db56a0,0,...) at sleepq_catch_signals+0x361/frame 0xf5d2fa28 sleepq_timedwait_sig(c7db56a4,0,f5d2fa88,b7fbe76c,20c49,...) at sleepq_timedwait_sig+0x14/frame 0xf5d2fa50 _cv_timedwait_sig_sbt(c7db56a4,c7db5690,eeb9bf37,20c4ae,b7fbe76c,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5d2fa9c seltdwait(20c4ae,b7fbe76c,20c49,c7daf000,0,...) at seltdwait+0xbc/frame 0xf5d2fad0 sys_poll(c7daf000,f5d2fcc8,c0edd3d0,c7200c90,0,...) at sys_poll+0x44c/frame 0xf5d2fc40 syscall(f5d2fd08) at syscall+0x2ed/frame 0xf5d2fcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d2fcfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x21b6438f, esp = 0xbfbfd9ec, ebp = 0xbfbfda28 --- Tracing command winbindd pid 670 tid 100095 td 0xc7d77900 sched_switch(c7d77900,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5cc9978 mi_switch(104,0,c10d2871,1f5,400,...) at mi_switch+0x1c9/frame 0xf5cc99ac sleepq_switch(c7d77900,0,c10d2871,1ab,c84b8250,...) at sleepq_switch+0x1b9/frame 0xf5cc99e0 sleepq_catch_signals(c12053a8,f5cc9a50,c0a9d9b9,c84b8260,0,...) at sleepq_catch_signals+0x361/frame 0xf5cc9a28 sleepq_timedwait_sig(c84b8264,0,f5cc9a88,ddb63221,10,...) at sleepq_timedwait_sig+0x14/frame 0xf5cc9a50 _cv_timedwait_sig_sbt(c84b8264,c84b8250,eadc32d1,5f6,ddb63221,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5cc9a9c seltdwait(5f6,ddb63221,10,c7d77900,c13fa950,...) at seltdwait+0xbc/frame 0xf5cc9ad0 sys_poll(c7d77900,f5cc9cc8,c0edd3d0,c7200c90,0,...) at sys_poll+0x44c/frame 0xf5cc9c40 syscall(f5cc9d08) at syscall+0x2ed/frame 0xf5cc9cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cc9cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2193b38f, esp = 0xbfbfdbcc, ebp = 0xbfbfdc08 --- Tracing command smbd pid 668 tid 100117 td 0xc7dadc00 sched_switch(c7dadc00,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5d5a978 mi_switch(104,0,c10d2871,1f5,400,...) at mi_switch+0x1c9/frame 0xf5d5a9ac sleepq_switch(c7dadc00,0,c10d2871,1ab,c84b80d0,...) at sleepq_switch+0x1b9/frame 0xf5d5a9e0 sleepq_catch_signals(c12053a8,f5d5aa50,c0a9d9b9,c84b80e0,0,...) at sleepq_catch_signals+0x361/frame 0xf5d5aa28 sleepq_timedwait_sig(c84b80e4,0,f5d5aa88,bffffbaa,3,...) at sleepq_timedwait_sig+0x14/frame 0xf5d5aa50 _cv_timedwait_sig_sbt(c84b80e4,c84b80d0,cadce720,53b,bffffbaa,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5d5aa9c seltdwait(53b,bffffbaa,3,c7dadc00,c0a77eec,...) at seltdwait+0xbc/frame 0xf5d5aad0 sys_poll(c7dadc00,f5d5acc8,c0edd3d0,c71fac90,0,...) at sys_poll+0x44c/frame 0xf5d5ac40 syscall(f5d5ad08) at syscall+0x2ed/frame 0xf5d5acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d5acfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x21b6438f, esp = 0xbfbfda9c, ebp = 0xbfbfdad8 --- Tracing command nmbd pid 666 tid 100084 td 0xc7e08300 sched_switch(c7e08300,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5c95978 mi_switch(104,0,c10d2871,1f5,400,...) at mi_switch+0x1c9/frame 0xf5c959ac sleepq_switch(c7e08300,0,c10d2871,1ab,c84b8290,...) at sleepq_switch+0x1b9/frame 0xf5c959e0 sleepq_catch_signals(c12053a8,f5c95a50,c0a9d9b9,c84b82a0,0,...) at sleepq_catch_signals+0x361/frame 0xf5c95a28 sleepq_timedwait_sig(c84b82a4,0,f5c95a88,9fffff47,0,...) at sleepq_timedwait_sig+0x14/frame 0xf5c95a50 _cv_timedwait_sig_sbt(c84b82a4,c84b8290,907ead45,524,9fffff47,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5c95a9c seltdwait(524,9fffff47,0,c7e08300,a58,...) at seltdwait+0xbc/frame 0xf5c95ad0 sys_poll(c7e08300,f5c95cc8,c0edd3d0,c1825c90,0,...) at sys_poll+0x44c/frame 0xf5c95c40 syscall(f5c95d08) at syscall+0x2ed/frame 0xf5c95cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c95cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2156338f, esp = 0xbfbfdb1c, ebp = 0xbfbfdb58 --- Tracing command ntpd pid 642 tid 100118 td 0xc7dad900 sched_switch(c7dad900,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5d5d90c mi_switch(104,0,c10d2871,1f5,200046,...) at mi_switch+0x1c9/frame 0xf5d5d940 sleepq_switch(c7dad900,0,c10d2871,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5d5d974 sleepq_catch_signals(f5d5d9e0,c0a9d9b9,c757b360,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5d5d9bc sleepq_wait_sig(c757b364,0,f5d5da10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5d5d9e0 _cv_wait_sig(c757b364,c757b350,c10d55b5,68e,c0b0cd1d,...) at _cv_wait_sig+0x200/frame 0xf5d5da24 seltdwait(ffffffff,0,0,c7dad900,0,...) at seltdwait+0x90/frame 0xf5d5da58 kern_select(c7dad900,1c,bfbfdd48,0,0,...) at kern_select+0x88c/frame 0xf5d5dbf8 sys_select(c7dad900,f5d5dcc8,0,0,c7dad900,...) at sys_select+0x69/frame 0xf5d5dc40 syscall(f5d5dd08) at syscall+0x2ed/frame 0xf5d5dcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d5dcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28399037, esp = 0xbfbfdd24, ebp = 0xbfbfdde4 --- Tracing command nfsd pid 585 tid 100123 td 0xc7e02900 sched_switch(c7e02900,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5d6fa84 mi_switch(104,0,c10d2871,1f5,c0af53c0,...) at mi_switch+0x1c9/frame 0xf5d6fab8 sleepq_switch(c7e02900,0,c10d2871,1ab,c7931000,...) at sleepq_switch+0x1b9/frame 0xf5d6faec sleepq_catch_signals(c12053a8,f5d6fb5c,c0a9d9b9,c7931010,0,...) at sleepq_catch_signals+0x361/frame 0xf5d6fb34 sleepq_timedwait_sig(c7d12e10,0,f5d6fb94,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf5d6fb5c _cv_timedwait_sig_sbt(c7d12e10,c7931000,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5d6fba8 svc_run_internal(f5d6fcf4,c0a80bbf,c7931000,f5d6fd08,c10c6680,...) at svc_run_internal+0xa5d/frame 0xf5d6fcc4 svc_thread_start(c7931000,f5d6fd08,c10c6680,3d7,0,...) at svc_thread_start+0xd/frame 0xf5d6fccc fork_exit(c0cb9bd0,c7931000,f5d6fd08) at fork_exit+0x7f/frame 0xf5d6fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5d6fcf4 --- trap 0x9873792e, eip = 0xc, esp = 0x33, ebp = 0xbfbfd937 --- Tracing command nfsd pid 585 tid 100122 td 0xc7e02c00 sched_switch(c7e02c00,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5d6ca84 mi_switch(104,0,c10d2871,1f5,c0af53c0,...) at mi_switch+0x1c9/frame 0xf5d6cab8 sleepq_switch(c7e02c00,0,c10d2871,1ab,c7931000,...) at sleepq_switch+0x1b9/frame 0xf5d6caec sleepq_catch_signals(c12053a8,f5d6cb5c,c0a9d9b9,c7931010,0,...) at sleepq_catch_signals+0x361/frame 0xf5d6cb34 sleepq_timedwait_sig(c7d12e50,0,f5d6cb94,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf5d6cb5c _cv_timedwait_sig_sbt(c7d12e50,c7931000,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5d6cba8 svc_run_internal(f5d6ccf4,c0a80bbf,c7931000,f5d6cd08,c10c6680,...) at svc_run_internal+0xa5d/frame 0xf5d6ccc4 svc_thread_start(c7931000,f5d6cd08,c10c6680,3d7,0,...) at svc_thread_start+0xd/frame 0xf5d6cccc fork_exit(c0cb9bd0,c7931000,f5d6cd08) at fork_exit+0x7f/frame 0xf5d6ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5d6ccf4 --- trap 0x9873792e, eip = 0xc, esp = 0x33, ebp = 0xbfbfd937 --- Tracing command nfsd pid 585 tid 100121 td 0xc7e07000 sched_switch(c7e07000,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5d69a84 mi_switch(104,0,c10d2871,1f5,c0af53c0,...) at mi_switch+0x1c9/frame 0xf5d69ab8 sleepq_switch(c7e07000,0,c10d2871,1ab,c7931000,...) at sleepq_switch+0x1b9/frame 0xf5d69aec sleepq_catch_signals(c12053a8,f5d69b5c,c0a9d9b9,c7931010,0,...) at sleepq_catch_signals+0x361/frame 0xf5d69b34 sleepq_timedwait_sig(c7d12e90,0,f5d69b94,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf5d69b5c _cv_timedwait_sig_sbt(c7d12e90,c7931000,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5d69ba8 svc_run_internal(f5d69cf4,c0a80bbf,c7931000,f5d69d08,c10c6680,...) at svc_run_internal+0xa5d/frame 0xf5d69cc4 svc_thread_start(c7931000,f5d69d08,c10c6680,3d7,0,...) at svc_thread_start+0xd/frame 0xf5d69ccc fork_exit(c0cb9bd0,c7931000,f5d69d08) at fork_exit+0x7f/frame 0xf5d69cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5d69cf4 --- trap 0x9873792e, eip = 0xc, esp = 0x33, ebp = 0xbfbfd937 --- Tracing command nfsd pid 585 tid 100120 td 0xc7dad300 sched_switch(c7dad300,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5d662fc mi_switch(104,0,c10d2871,1f5,c0af53c0,...) at mi_switch+0x1c9/frame 0xf5d66330 sleepq_switch(c7dad300,0,c10d2871,1ab,c7931000,...) at sleepq_switch+0x1b9/frame 0xf5d66364 sleepq_catch_signals(c12053a8,f5d663d4,c0a9d9b9,c7931010,0,...) at sleepq_catch_signals+0x361/frame 0xf5d663ac sleepq_timedwait_sig(c7cde110,0,f5d6640c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf5d663d4 _cv_timedwait_sig_sbt(c7cde110,c7931000,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5d66420 svc_run_internal(c0cb9bd0,c7931000,c7e742e8,f5d66568,0,...) at svc_run_internal+0xa5d/frame 0xf5d6653c svc_run(c7931000,0,c10b7f85,1b5,0,...) at svc_run+0xc3/frame 0xf5d66578 nfsrvd_nfsd(c7dad300,f5d666d0,c,0,246,...) at nfsrvd_nfsd+0x1a2/frame 0xf5d666b0 nfssvc_nfsd(c7dad300,f5d66cc8,0,c7dad300,f5d66cfc,...) at nfssvc_nfsd+0xf4/frame 0xf5d66c28 sys_nfssvc(c7dad300,f5d66cc8,0,0,0,...) at sys_nfssvc+0xbf/frame 0xf5d66c40 syscall(f5d66d08) at syscall+0x2ed/frame 0xf5d66cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d66cfc --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280c278b, esp = 0xbfbfd7e4, ebp = 0xbfbfda58 --- Tracing command nfsd pid 581 tid 100119 td 0xc7dad600 sched_switch(c7dad600,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5d6090c mi_switch(104,0,c10d2871,1f5,46,...) at mi_switch+0x1c9/frame 0xf5d60940 sleepq_switch(c7dad600,0,c10d2871,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5d60974 sleepq_catch_signals(f5d609e0,c0a9d9b9,c757b060,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5d609bc sleepq_wait_sig(c757b064,0,f5d60a10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5d609e0 _cv_wait_sig(c757b064,c757b050,c10d55b5,68e,c0b0cd1d,...) at _cv_wait_sig+0x200/frame 0xf5d60a24 seltdwait(ffffffff,0,0,c7dad600,0,...) at seltdwait+0x90/frame 0xf5d60a58 kern_select(c7dad600,7,bfbfdc30,0,0,...) at kern_select+0x88c/frame 0xf5d60bf8 sys_select(c7dad600,f5d60cc8,c0edd3d0,c1825c90,0,...) at sys_select+0x69/frame 0xf5d60c40 syscall(f5d60d08) at syscall+0x2ed/frame 0xf5d60cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d60cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2818a037, esp = 0xbfbfda5c, ebp = 0xbfbfde34 --- Tracing command mountd pid 575 tid 100087 td 0xc7d7a600 sched_switch(c7d7a600,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5ca290c mi_switch(104,0,c10d2871,1f5,46,...) at mi_switch+0x1c9/frame 0xf5ca2940 sleepq_switch(c7d7a600,0,c10d2871,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5ca2974 sleepq_catch_signals(f5ca29e0,c0a9d9b9,c757a060,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5ca29bc sleepq_wait_sig(c757a064,0,f5ca2a10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5ca29e0 _cv_wait_sig(c757a064,c757a050,c10d55b5,68e,c0b0cd1d,...) at _cv_wait_sig+0x200/frame 0xf5ca2a24 seltdwait(ffffffff,0,0,c7d7a600,0,...) at seltdwait+0x90/frame 0xf5ca2a58 kern_select(c7d7a600,9,bfbfdd50,0,0,...) at kern_select+0x88c/frame 0xf5ca2bf8 sys_select(c7d7a600,f5ca2cc8,c0edd3d0,c7200c90,0,...) at sys_select+0x69/frame 0xf5ca2c40 syscall(f5ca2d08) at syscall+0x2ed/frame 0xf5ca2cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5ca2cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a1037, esp = 0xbfbfdd0c, ebp = 0xbfbfde34 --- Tracing command nfsuserd pid 568 tid 100083 td 0xc7e08600 sched_switch(c7e08600,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5c8f900 mi_switch(104,0,c10d2871,1f5,400,...) at mi_switch+0x1c9/frame 0xf5c8f934 sleepq_switch(c7e08600,0,c10d2871,1ab,c7d43c10,...) at sleepq_switch+0x1b9/frame 0xf5c8f968 sleepq_catch_signals(c12053a8,f5c8f9d8,c0a9d9b9,c7d43c20,0,...) at sleepq_catch_signals+0x361/frame 0xf5c8f9b0 sleepq_timedwait_sig(c7d43c24,0,f5c8fa10,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xf5c8f9d8 _cv_timedwait_sig_sbt(c7d43c24,c7d43c10,478923ec,539,e0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5c8fa24 seltdwait(539,e0000000,1,c7e08600,0,...) at seltdwait+0xbc/frame 0xf5c8fa58 kern_select(c7e08600,4,bfbfdc10,0,0,...) at kern_select+0x88c/frame 0xf5c8fbf8 sys_select(c7e08600,f5c8fcc8,c0edd3d0,c71fac90,0,...) at sys_select+0x69/frame 0xf5c8fc40 syscall(f5c8fd08) at syscall+0x2ed/frame 0xf5c8fcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c8fcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28189037, esp = 0xbfbfdb6c, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 567 tid 100098 td 0xc7e7c600 sched_switch(c7e7c600,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5cd7900 mi_switch(104,0,c10d2871,1f5,400,...) at mi_switch+0x1c9/frame 0xf5cd7934 sleepq_switch(c7e7c600,0,c10d2871,1ab,c7db5dd0,...) at sleepq_switch+0x1b9/frame 0xf5cd7968 sleepq_catch_signals(c12053a8,f5cd79d8,c0a9d9b9,c7db5de0,0,...) at sleepq_catch_signals+0x361/frame 0xf5cd79b0 sleepq_timedwait_sig(c7db5de4,0,f5cd7a10,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xf5cd79d8 _cv_timedwait_sig_sbt(c7db5de4,c7db5dd0,3620dfb2,539,e0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5cd7a24 seltdwait(539,e0000000,1,c7e7c600,0,...) at seltdwait+0xbc/frame 0xf5cd7a58 kern_select(c7e7c600,4,bfbfdc10,0,0,...) at kern_select+0x88c/frame 0xf5cd7bf8 sys_select(c7e7c600,f5cd7cc8,c0edd3d0,c7200c90,0,...) at sys_select+0x69/frame 0xf5cd7c40 syscall(f5cd7d08) at syscall+0x2ed/frame 0xf5cd7cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cd7cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28189037, esp = 0xbfbfdb6c, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 566 tid 100078 td 0xc7dafc00 sched_switch(c7dafc00,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5c76900 mi_switch(104,0,c10d2871,1f5,400,...) at mi_switch+0x1c9/frame 0xf5c76934 sleepq_switch(c7dafc00,0,c10d2871,1ab,c7d43bd0,...) at sleepq_switch+0x1b9/frame 0xf5c76968 sleepq_catch_signals(c12053a8,f5c769d8,c0a9d9b9,c7d43be0,0,...) at sleepq_catch_signals+0x361/frame 0xf5c769b0 sleepq_timedwait_sig(c7d43be4,0,f5c76a10,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xf5c769d8 _cv_timedwait_sig_sbt(c7d43be4,c7d43bd0,effbc579,538,e0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5c76a24 seltdwait(538,e0000000,1,c7dafc00,0,...) at seltdwait+0xbc/frame 0xf5c76a58 kern_select(c7dafc00,4,bfbfdc10,0,0,...) at kern_select+0x88c/frame 0xf5c76bf8 sys_select(c7dafc00,f5c76cc8,c0edd3d0,c71fac90,0,...) at sys_select+0x69/frame 0xf5c76c40 syscall(f5c76d08) at syscall+0x2ed/frame 0xf5c76cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c76cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28189037, esp = 0xbfbfdb6c, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 565 tid 100076 td 0xc78f2c00 sched_switch(c78f2c00,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5c6e900 mi_switch(104,0,c10d2871,1f5,400,...) at mi_switch+0x1c9/frame 0xf5c6e934 sleepq_switch(c78f2c00,0,c10d2871,1ab,c757a550,...) at sleepq_switch+0x1b9/frame 0xf5c6e968 sleepq_catch_signals(c12053a8,f5c6e9d8,c0a9d9b9,c757a560,0,...) at sleepq_catch_signals+0x361/frame 0xf5c6e9b0 sleepq_timedwait_sig(c757a564,0,f5c6ea10,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xf5c6e9d8 _cv_timedwait_sig_sbt(c757a564,c757a550,163dad4,539,e0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5c6ea24 seltdwait(539,e0000000,1,c78f2c00,0,...) at seltdwait+0xbc/frame 0xf5c6ea58 kern_select(c78f2c00,4,bfbfdc10,0,0,...) at kern_select+0x88c/frame 0xf5c6ebf8 sys_select(c78f2c00,f5c6ecc8,c0edd3d0,c71fac90,0,...) at sys_select+0x69/frame 0xf5c6ec40 syscall(f5c6ed08) at syscall+0x2ed/frame 0xf5c6ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c6ecfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28189037, esp = 0xbfbfdb6c, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 564 tid 100100 td 0xc7e7c000 sched_switch(c7e7c000,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5d0daa0 mi_switch(104,0,c10d2871,1f5,8,...) at mi_switch+0x1c9/frame 0xf5d0dad4 sleepq_switch(c7e7c000,0,c10d2871,1ab,f5d0db4c,...) at sleepq_switch+0x1b9/frame 0xf5d0db08 sleepq_catch_signals(0,c10d2871,162,378,c7e7c000,...) at sleepq_catch_signals+0x361/frame 0xf5d0db50 sleepq_wait_sig(c7e7391c,74,c0f2f354,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5d0db74 _sleep(c7e7391c,c7e7394c,174,c0f2f354,0,...) at _sleep+0x35b/frame 0xf5d0dbd0 kern_sigsuspend(c7e7c000,0,0,0,0,...) at kern_sigsuspend+0xfb/frame 0xf5d0dc10 sys_sigsuspend(c7e7c000,f5d0dcc8,c1124b8f,d6,2882ab0c,...) at sys_sigsuspend+0x58/frame 0xf5d0dc40 syscall(f5d0dd08) at syscall+0x2ed/frame 0xf5d0dcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d0dcfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x280c115b, esp = 0xbfbfdcac, ebp = 0xbfbfde44 --- Tracing command rpcbind pid 536 tid 100086 td 0xc7d7a900 sched_switch(c7d7a900,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5c9e978 mi_switch(104,0,c10d2871,1f5,400,...) at mi_switch+0x1c9/frame 0xf5c9e9ac sleepq_switch(c7d7a900,0,c10d2871,1ab,c757b110,...) at sleepq_switch+0x1b9/frame 0xf5c9e9e0 sleepq_catch_signals(c12053a8,f5c9ea50,c0a9d9b9,c757b120,0,...) at sleepq_catch_signals+0x361/frame 0xf5c9ea28 sleepq_timedwait_sig(c757b124,0,f5c9ea88,dffffdd5,1,...) at sleepq_timedwait_sig+0x14/frame 0xf5c9ea50 _cv_timedwait_sig_sbt(c757b124,c757b110,3620bd02,539,dffffdd5,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5c9ea9c seltdwait(539,dffffdd5,1,c7d7a900,f5c9eb18,...) at seltdwait+0xbc/frame 0xf5c9ead0 sys_poll(c7d7a900,f5c9ecc8,c0edd3d0,c71fdc90,0,...) at sys_poll+0x44c/frame 0xf5c9ec40 syscall(f5c9ed08) at syscall+0x2ed/frame 0xf5c9ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c9ecfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2813e38f, esp = 0xbfbfbbfc, ebp = 0xbfbfddd8 --- Tracing command syslogd pid 521 tid 100092 td 0xc7e07300 sched_switch(c7e07300,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5cb6a0c mi_switch(104,0,c10d2871,1f5,162,...) at mi_switch+0x1c9/frame 0xf5cb6a40 sleepq_switch(c7e07300,0,c10d2871,26b,c7e07300,...) at sleepq_switch+0x1b9/frame 0xf5cb6a74 sleepq_wait(c83213dc,5d,c10dadde,0,0,...) at sleepq_wait+0x48/frame 0xf5cb6a98 _sleep(c83213dc,c8321390,5d,c10dadde,0,...) at _sleep+0x37c/frame 0xf5cb6af4 bufobj_wwait(c8321390,0,0,12c,0,...) at bufobj_wwait+0xc7/frame 0xf5cb6b38 ffs_syncvnode(c83212d0,1,0,c83212d0,246,...) at ffs_syncvnode+0x3d5/frame 0xf5cb6b90 ffs_fsync(f5cb6c18,c112b84e,c10dec90,d96,0,...) at ffs_fsync+0x26/frame 0xf5cb6bb8 VOP_FSYNC_APV(c122fbec,f5cb6c18,d96,0,0,...) at VOP_FSYNC_APV+0x124/frame 0xf5cb6be8 sys_fsync(c7e07300,f5cb6cc8,0,0,c7e07300,...) at sys_fsync+0x190/frame 0xf5cb6c40 syscall(f5cb6d08) at syscall+0x2ed/frame 0xf5cb6cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cb6cfc --- syscall (95, FreeBSD ELF32, sys_fsync), eip = 0x2819cfb3, esp = 0xbfbfceac, ebp = 0xbfbfde34 --- Tracing command devd pid 418 tid 100082 td 0xc7e08900 sched_switch(c7e08900,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf5c8b900 mi_switch(104,0,c10d2871,1f5,400,...) at mi_switch+0x1c9/frame 0xf5c8b934 sleepq_switch(c7e08900,0,c10d2871,1ab,c757b4d0,...) at sleepq_switch+0x1b9/frame 0xf5c8b968 sleepq_catch_signals(c12053a8,f5c8b9d8,c0a9d9b9,c757b4e0,0,...) at sleepq_catch_signals+0x361/frame 0xf5c8b9b0 sleepq_timedwait_sig(c757b4e4,0,f5c8ba10,c0000000,3,...) at sleepq_timedwait_sig+0x14/frame 0xf5c8b9d8 _cv_timedwait_sig_sbt(c757b4e4,c757b4d0,f1c632fb,54f,c0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5c8ba24 seltdwait(54f,c0000000,3,c7e08900,0,...) at seltdwait+0xbc/frame 0xf5c8ba58 kern_select(c7e08900,5,bfbfbda0,0,0,...) at kern_select+0x88c/frame 0xf5c8bbf8 sys_select(c7e08900,f5c8bcc8,c1124b8f,e9,0,...) at sys_select+0x69/frame 0xf5c8bc40 syscall(f5c8bd08) at syscall+0x2ed/frame 0xf5c8bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c8bcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x8095dc3, esp = 0xbfbfbd44, ebp = 0xbfbfde54 --- Tracing command softdepflush pid 17 tid 100074 td 0xc7948000 sched_switch(c7948000,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf0799ba4 mi_switch(104,0,c10d2871,1f5,101,...) at mi_switch+0x1c9/frame 0xf0799bd8 sleepq_switch(c7948000,0,c10d2871,28e,c7948000,...) at sleepq_switch+0x1b9/frame 0xf0799c0c sleepq_timedwait(c13fa7e4,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xf0799c30 _sleep(c13fa7e4,c13fa764,54,c1104e80,fffffed8,...) at _sleep+0x345/frame 0xf0799c8c softdep_flush(0,f0799d08,c10c6680,3d7,0,...) at softdep_flush+0x27c/frame 0xf0799ccc fork_exit(c0d12a60,0,f0799d08) at fork_exit+0x7f/frame 0xf0799cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf0799cf4 --- trap 0, eip = 0, esp = 0xf0799d40, ebp = 0 --- Tracing command syncer pid 16 tid 100073 td 0xc7948300 sched_switch(c7948300,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf0796b78 mi_switch(104,0,c10d2871,1f5,8,...) at mi_switch+0x1c9/frame 0xf0796bac sleepq_switch(c7948300,0,c10d2871,28e,0,...) at sleepq_switch+0x1b9/frame 0xf0796be0 sleepq_timedwait(c13f65a4,0,f0796c3c,0,0,...) at sleepq_timedwait+0x48/frame 0xf0796c04 _cv_timedwait_sbt(c13f65a4,c13f6584,fffffed8,0,0,...) at _cv_timedwait_sbt+0x228/frame 0xf0796c50 sched_sync(0,f0796d08,c10c6680,3d7,0,...) at sched_sync+0x682/frame 0xf0796ccc fork_exit(c0b5cdd0,0,f0796d08) at fork_exit+0x7f/frame 0xf0796cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf0796cf4 --- trap 0, eip = 0, esp = 0xf0796d40, ebp = 0 --- Tracing command vnlru pid 9 tid 100072 td 0xc7948600 sched_switch(c7948600,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf0793b78 mi_switch(104,0,c10d2871,1f5,101,...) at mi_switch+0x1c9/frame 0xf0793bac sleepq_switch(c7948600,0,c10d2871,28e,c7948600,...) at sleepq_switch+0x1b9/frame 0xf0793be0 sleepq_timedwait(c7c2aba0,60,0,0,0,...) at sleepq_timedwait+0x48/frame 0xf0793c04 _sleep(c7c2aba0,c13f655c,260,c10de90f,fffffed8,...) at _sleep+0x345/frame 0xf0793c60 vnlru_proc(0,f0793d08,c10c6680,3d7,0,...) at vnlru_proc+0xcf/frame 0xf0793ccc fork_exit(c0b5d610,0,f0793d08) at fork_exit+0x7f/frame 0xf0793cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf0793cf4 --- trap 0, eip = 0, esp = 0xf0793d40, ebp = 0 --- Tracing command bufdaemon pid 8 tid 100071 td 0xc7948900 sched_switch(c7948900,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xf0790bb0 mi_switch(104,0,c10d2871,1f5,101,...) at mi_switch+0x1c9/frame 0xf0790be4 sleepq_switch(c7948900,0,c10d2871,28e,c7948900,...) at sleepq_switch+0x1b9/frame 0xf0790c18 sleepq_timedwait(c13f631c,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xf0790c3c _sleep(c13f631c,c13f6304,54,c10db39c,fffffed8,...) at _sleep+0x345/frame 0xf0790c98 buf_daemon(0,f0790d08,c10c6680,3d7,0,...) at buf_daemon+0x8c/frame 0xf0790ccc fork_exit(c0b40790,0,f0790d08) at fork_exit+0x7f/frame 0xf0790cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf0790cf4 --- trap 0, eip = 0, esp = 0xf0790d40, ebp = 0 --- Tracing command pagezero pid 7 tid 100070 td 0xc7948c00 sched_switch(c7948c00,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3bfebac mi_switch(104,0,c10d2871,1f5,101,...) at mi_switch+0x1c9/frame 0xe3bfebe0 sleepq_switch(c7948c00,0,c10d2871,28e,c7948c00,...) at sleepq_switch+0x1b9/frame 0xe3bfec14 sleepq_timedwait(c13fb0e4,0,12b,0,0,...) at sleepq_timedwait+0x48/frame 0xe3bfec38 _sleep(c13fb0e4,c144eb00,0,c110c253,fffea520,...) at _sleep+0x345/frame 0xe3bfec94 vm_pagezero(0,e3bfed08,c10c6680,3d7,0,...) at vm_pagezero+0xc2/frame 0xe3bfeccc fork_exit(c0d59b90,0,e3bfed08) at fork_exit+0x7f/frame 0xe3bfecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3bfecf4 --- trap 0, eip = 0, esp = 0xe3bfed40, ebp = 0 --- Tracing command vmdaemon pid 6 tid 100069 td 0xc7949000 sched_switch(c7949000,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3bfbb78 mi_switch(104,0,c10d2871,1f5,162,...) at mi_switch+0x1c9/frame 0xe3bfbbac sleepq_switch(c7949000,0,c10d2871,26b,c7949000,...) at sleepq_switch+0x1b9/frame 0xe3bfbbe0 sleepq_wait(c13facac,74,c10db39c,0,0,...) at sleepq_wait+0x48/frame 0xe3bfbc04 _sleep(c13facac,c13fac94,74,c10db39c,0,...) at _sleep+0x37c/frame 0xe3bfbc60 vm_daemon(0,e3bfbd08,c10c6680,3d7,0,...) at vm_daemon+0xac/frame 0xe3bfbccc fork_exit(c0d51be0,0,e3bfbd08) at fork_exit+0x7f/frame 0xe3bfbcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3bfbcf4 --- trap 0, eip = 0, esp = 0xe3bfbd40, ebp = 0 --- Tracing command pagedaemon pid 5 tid 100068 td 0xc7949300 sched_switch(c7949300,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3bf8b30 mi_switch(104,0,c10d2871,1f5,101,...) at mi_switch+0x1c9/frame 0xe3bf8b64 sleepq_switch(c7949300,0,c10d2871,28e,c7949300,...) at sleepq_switch+0x1b9/frame 0xe3bf8b98 sleepq_timedwait(c144eb84,54,4,0,0,...) at sleepq_timedwait+0x48/frame 0xe3bf8bbc _sleep(c144eb84,c144eb00,54,c10db39c,fffffa38,...) at _sleep+0x345/frame 0xe3bf8c18 vm_pageout(0,e3bf8d08,c10c6680,3d7,0,...) at vm_pageout+0x290/frame 0xe3bf8ccc fork_exit(c0d52400,0,e3bf8d08) at fork_exit+0x7f/frame 0xe3bf8cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3bf8cf4 --- trap 0, eip = 0, esp = 0xe3bf8d40, ebp = 0 --- Tracing command xpt_thrd pid 4 tid 100067 td 0xc7949600 sched_switch(c7949600,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3bb5bb0 mi_switch(104,0,c10d2871,1f5,162,...) at mi_switch+0x1c9/frame 0xe3bb5be4 sleepq_switch(c7949600,0,c10d2871,26b,c7949600,...) at sleepq_switch+0x1b9/frame 0xe3bb5c18 sleepq_wait(c124a724,5c,c0f05120,0,0,...) at sleepq_wait+0x48/frame 0xe3bb5c3c _sleep(c124a724,c124a774,5c,c0f05120,0,...) at _sleep+0x37c/frame 0xe3bb5c98 xpt_scanner_thread(0,e3bb5d08,c10c6680,3d7,0,...) at xpt_scanner_thread+0x11c/frame 0xe3bb5ccc fork_exit(c04b8380,0,e3bb5d08) at fork_exit+0x7f/frame 0xe3bb5cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3bb5cf4 --- trap 0, eip = 0, esp = 0xe3bb5d40, ebp = 0 --- Tracing command sctp_iterator pid 3 tid 100066 td 0xc7949900 sched_switch(c7949900,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3bb2bb8 mi_switch(104,0,c10d2871,1f5,162,...) at mi_switch+0x1c9/frame 0xe3bb2bec sleepq_switch(c7949900,0,c10d2871,26b,c7949900,...) at sleepq_switch+0x1b9/frame 0xe3bb2c20 sleepq_wait(c144a88c,0,c10f1e45,0,0,...) at sleepq_wait+0x48/frame 0xe3bb2c44 _sleep(c144a88c,c144a854,0,c10f1e45,0,...) at _sleep+0x37c/frame 0xe3bb2ca0 sctp_iterator_thread(0,e3bb2d08,c10c6680,3d7,0,...) at sctp_iterator_thread+0x7c/frame 0xe3bb2ccc fork_exit(c0bfc690,0,e3bb2d08) at fork_exit+0x7f/frame 0xe3bb2cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3bb2cf4 --- trap 0, eip = 0, esp = 0xe3bb2d40, ebp = 0 --- Tracing command fdc0 pid 2 tid 100061 td 0xc78e5900 sched_switch(c78e5900,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3ba2b48 mi_switch(104,0,c10d2871,1f5,101,...) at mi_switch+0x1c9/frame 0xe3ba2b7c sleepq_switch(c78e5900,0,c10d2871,28e,c78e5900,...) at sleepq_switch+0x1b9/frame 0xe3ba2bb0 sleepq_timedwait(c789303c,5c,0,0,0,...) at sleepq_timedwait+0x48/frame 0xe3ba2bd4 _sleep(c789303c,c78930f0,5c,c10b8946,fffffed8,...) at _sleep+0x345/frame 0xe3ba2c30 fdc_thread(c7893000,e3ba2d08,c10c6680,3d7,0,...) at fdc_thread+0x877/frame 0xe3ba2ccc fork_exit(c0e64390,c7893000,e3ba2d08) at fork_exit+0x7f/frame 0xe3ba2cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3ba2cf4 --- trap 0, eip = 0, esp = 0xe3ba2d40, ebp = 0 --- Tracing command usb pid 15 tid 100058 td 0xc78ef300 sched_switch(c78ef300,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3b7ebd4 mi_switch(104,0,c10d2871,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b7ec08 sleepq_switch(c78ef300,0,c10d2871,26b,c78ef300,...) at sleepq_switch+0x1b9/frame 0xe3b7ec3c sleepq_wait(c78f7d34,0,e3b7ec90,1,0,...) at sleepq_wait+0x48/frame 0xe3b7ec60 _cv_wait(c78f7d34,c78f7e4c,c10aa0c3,77,c78f7d3c,...) at _cv_wait+0x1f9/frame 0xe3b7eca4 usb_process(c78f7d2c,e3b7ed08,c10c6680,3d7,0,...) at usb_process+0xe6/frame 0xe3b7eccc fork_exit(c0961120,c78f7d2c,e3b7ed08) at fork_exit+0x7f/frame 0xe3b7ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b7ecf4 --- trap 0, eip = 0, esp = 0xe3b7ed40, ebp = 0 --- Tracing command usb pid 15 tid 100057 td 0xc78ef600 sched_switch(c78ef600,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3b7bbd4 mi_switch(104,0,c10d2871,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b7bc08 sleepq_switch(c78ef600,0,c10d2871,26b,c78ef600,...) at sleepq_switch+0x1b9/frame 0xe3b7bc3c sleepq_wait(c78f7d04,0,e3b7bc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b7bc60 _cv_wait(c78f7d04,c78f7e4c,c10aa0c3,77,c78f7d0c,...) at _cv_wait+0x1f9/frame 0xe3b7bca4 usb_process(c78f7cfc,e3b7bd08,c10c6680,3d7,0,...) at usb_process+0xe6/frame 0xe3b7bccc fork_exit(c0961120,c78f7cfc,e3b7bd08) at fork_exit+0x7f/frame 0xe3b7bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b7bcf4 --- trap 0, eip = 0, esp = 0xe3b7bd40, ebp = 0 --- Tracing command usb pid 15 tid 100056 td 0xc78ef900 sched_switch(c78ef900,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3b78bd4 mi_switch(104,0,c10d2871,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b78c08 sleepq_switch(c78ef900,0,c10d2871,26b,c78ef900,...) at sleepq_switch+0x1b9/frame 0xe3b78c3c sleepq_wait(c78f7cd4,0,e3b78c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b78c60 _cv_wait(c78f7cd4,c78f7e4c,c10aa0c3,77,c78f7cdc,...) at _cv_wait+0x1f9/frame 0xe3b78ca4 usb_process(c78f7ccc,e3b78d08,c10c6680,3d7,0,...) at usb_process+0xe6/frame 0xe3b78ccc fork_exit(c0961120,c78f7ccc,e3b78d08) at fork_exit+0x7f/frame 0xe3b78cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b78cf4 --- trap 0, eip = 0, esp = 0xe3b78d40, ebp = 0 --- Tracing command usb pid 15 tid 100055 td 0xc78efc00 sched_switch(c78efc00,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3b75bd4 mi_switch(104,0,c10d2871,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b75c08 sleepq_switch(c78efc00,0,c10d2871,26b,c78efc00,...) at sleepq_switch+0x1b9/frame 0xe3b75c3c sleepq_wait(c78f7ca4,0,e3b75c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b75c60 _cv_wait(c78f7ca4,c78f7e4c,c10aa0c3,77,c78f7cac,...) at _cv_wait+0x1f9/frame 0xe3b75ca4 usb_process(c78f7c9c,e3b75d08,c10c6680,3d7,0,...) at usb_process+0xe6/frame 0xe3b75ccc fork_exit(c0961120,c78f7c9c,e3b75d08) at fork_exit+0x7f/frame 0xe3b75cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b75cf4 --- trap 0, eip = 0, esp = 0xe3b75d40, ebp = 0 --- Tracing command usb pid 15 tid 100053 td 0xc78f2300 sched_switch(c78f2300,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3b6cbd4 mi_switch(104,0,c10d2871,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b6cc08 sleepq_switch(c78f2300,0,c10d2871,26b,c78f2300,...) at sleepq_switch+0x1b9/frame 0xe3b6cc3c sleepq_wait(c78ebb5c,0,e3b6cc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b6cc60 _cv_wait(c78ebb5c,c78ebc74,c10aa0c3,77,c78ebb64,...) at _cv_wait+0x1f9/frame 0xe3b6cca4 usb_process(c78ebb54,e3b6cd08,c10c6680,3d7,0,...) at usb_process+0xe6/frame 0xe3b6cccc fork_exit(c0961120,c78ebb54,e3b6cd08) at fork_exit+0x7f/frame 0xe3b6ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b6ccf4 --- trap 0, eip = 0, esp = 0xe3b6cd40, ebp = 0 --- Tracing command usb pid 15 tid 100052 td 0xc78f2600 sched_switch(c78f2600,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3b69bd4 mi_switch(104,0,c10d2871,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b69c08 sleepq_switch(c78f2600,0,c10d2871,26b,c78f2600,...) at sleepq_switch+0x1b9/frame 0xe3b69c3c sleepq_wait(c78ebb2c,0,e3b69c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b69c60 _cv_wait(c78ebb2c,c78ebc74,c10aa0c3,77,c78ebb34,...) at _cv_wait+0x1f9/frame 0xe3b69ca4 usb_process(c78ebb24,e3b69d08,c10c6680,3d7,0,...) at usb_process+0xe6/frame 0xe3b69ccc fork_exit(c0961120,c78ebb24,e3b69d08) at fork_exit+0x7f/frame 0xe3b69cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b69cf4 --- trap 0, eip = 0, esp = 0xe3b69d40, ebp = 0 --- Tracing command usb pid 15 tid 100051 td 0xc78e2000 sched_switch(c78e2000,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3b66bd4 mi_switch(104,0,c10d2871,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b66c08 sleepq_switch(c78e2000,0,c10d2871,26b,c78e2000,...) at sleepq_switch+0x1b9/frame 0xe3b66c3c sleepq_wait(c78ebafc,0,e3b66c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b66c60 _cv_wait(c78ebafc,c78ebc74,c10aa0c3,77,c78ebb04,...) at _cv_wait+0x1f9/frame 0xe3b66ca4 usb_process(c78ebaf4,e3b66d08,c10c6680,3d7,0,...) at usb_process+0xe6/frame 0xe3b66ccc fork_exit(c0961120,c78ebaf4,e3b66d08) at fork_exit+0x7f/frame 0xe3b66cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b66cf4 --- trap 0, eip = 0, esp = 0xe3b66d40, ebp = 0 --- Tracing command usb pid 15 tid 100050 td 0xc78e2300 sched_switch(c78e2300,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3b63bd4 mi_switch(104,0,c10d2871,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b63c08 sleepq_switch(c78e2300,0,c10d2871,26b,c78e2300,...) at sleepq_switch+0x1b9/frame 0xe3b63c3c sleepq_wait(c78ebacc,0,e3b63c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b63c60 _cv_wait(c78ebacc,c78ebc74,c10aa0c3,77,c78ebad4,...) at _cv_wait+0x1f9/frame 0xe3b63ca4 usb_process(c78ebac4,e3b63d08,c10c6680,3d7,0,...) at usb_process+0xe6/frame 0xe3b63ccc fork_exit(c0961120,c78ebac4,e3b63d08) at fork_exit+0x7f/frame 0xe3b63cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b63cf4 --- trap 0, eip = 0, esp = 0xe3b63d40, ebp = 0 --- Tracing command usb pid 15 tid 100049 td 0xc78e2600 sched_switch(c78e2600,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3b5fbd4 mi_switch(104,0,c10d2871,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b5fc08 sleepq_switch(c78e2600,0,c10d2871,26b,c78e2600,...) at sleepq_switch+0x1b9/frame 0xe3b5fc3c sleepq_wait(c78e6b5c,0,e3b5fc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b5fc60 _cv_wait(c78e6b5c,c78e6c74,c10aa0c3,77,c78e6b64,...) at _cv_wait+0x1f9/frame 0xe3b5fca4 usb_process(c78e6b54,e3b5fd08,c10c6680,3d7,0,...) at usb_process+0xe6/frame 0xe3b5fccc fork_exit(c0961120,c78e6b54,e3b5fd08) at fork_exit+0x7f/frame 0xe3b5fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b5fcf4 --- trap 0, eip = 0, esp = 0xe3b5fd40, ebp = 0 --- Tracing command usb pid 15 tid 100048 td 0xc78e2900 sched_switch(c78e2900,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3b5cbd4 mi_switch(104,0,c10d2871,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b5cc08 sleepq_switch(c78e2900,0,c10d2871,26b,c78e2900,...) at sleepq_switch+0x1b9/frame 0xe3b5cc3c sleepq_wait(c78e6b2c,0,e3b5cc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b5cc60 _cv_wait(c78e6b2c,c78e6c74,c10aa0c3,77,c78e6b34,...) at _cv_wait+0x1f9/frame 0xe3b5cca4 usb_process(c78e6b24,e3b5cd08,c10c6680,3d7,0,...) at usb_process+0xe6/frame 0xe3b5cccc fork_exit(c0961120,c78e6b24,e3b5cd08) at fork_exit+0x7f/frame 0xe3b5ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b5ccf4 --- trap 0, eip = 0, esp = 0xe3b5cd40, ebp = 0 --- Tracing command usb pid 15 tid 100047 td 0xc78e2c00 sched_switch(c78e2c00,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3b59bd4 mi_switch(104,0,c10d2871,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b59c08 sleepq_switch(c78e2c00,0,c10d2871,26b,c78e2c00,...) at sleepq_switch+0x1b9/frame 0xe3b59c3c sleepq_wait(c78e6afc,0,e3b59c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b59c60 _cv_wait(c78e6afc,c78e6c74,c10aa0c3,77,c78e6b04,...) at _cv_wait+0x1f9/frame 0xe3b59ca4 usb_process(c78e6af4,e3b59d08,c10c6680,3d7,0,...) at usb_process+0xe6/frame 0xe3b59ccc fork_exit(c0961120,c78e6af4,e3b59d08) at fork_exit+0x7f/frame 0xe3b59cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b59cf4 --- trap 0, eip = 0, esp = 0xe3b59d40, ebp = 0 --- Tracing command usb pid 15 tid 100046 td 0xc78e3000 sched_switch(c78e3000,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3b56bd4 mi_switch(104,0,c10d2871,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b56c08 sleepq_switch(c78e3000,0,c10d2871,26b,c78e3000,...) at sleepq_switch+0x1b9/frame 0xe3b56c3c sleepq_wait(c78e6acc,0,e3b56c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b56c60 _cv_wait(c78e6acc,c78e6c74,c10aa0c3,77,c78e6ad4,...) at _cv_wait+0x1f9/frame 0xe3b56ca4 usb_process(c78e6ac4,e3b56d08,c10c6680,3d7,0,...) at usb_process+0xe6/frame 0xe3b56ccc fork_exit(c0961120,c78e6ac4,e3b56d08) at fork_exit+0x7f/frame 0xe3b56cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b56cf4 --- trap 0, eip = 0, esp = 0xe3b56d40, ebp = 0 --- Tracing command usb pid 15 tid 100045 td 0xc78e3300 sched_switch(c78e3300,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3b52bd4 mi_switch(104,0,c10d2871,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b52c08 sleepq_switch(c78e3300,0,c10d2871,26b,c78e3300,...) at sleepq_switch+0x1b9/frame 0xe3b52c3c sleepq_wait(c78deb5c,0,e3b52c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b52c60 _cv_wait(c78deb5c,c78dec74,c10aa0c3,77,c78deb64,...) at _cv_wait+0x1f9/frame 0xe3b52ca4 usb_process(c78deb54,e3b52d08,c10c6680,3d7,0,...) at usb_process+0xe6/frame 0xe3b52ccc fork_exit(c0961120,c78deb54,e3b52d08) at fork_exit+0x7f/frame 0xe3b52cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b52cf4 --- trap 0, eip = 0, esp = 0xe3b52d40, ebp = 0 --- Tracing command usb pid 15 tid 100044 td 0xc78e3600 sched_switch(c78e3600,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3b4fbd4 mi_switch(104,0,c10d2871,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b4fc08 sleepq_switch(c78e3600,0,c10d2871,26b,c78e3600,...) at sleepq_switch+0x1b9/frame 0xe3b4fc3c sleepq_wait(c78deb2c,0,e3b4fc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b4fc60 _cv_wait(c78deb2c,c78dec74,c10aa0c3,77,c78deb34,...) at _cv_wait+0x1f9/frame 0xe3b4fca4 usb_process(c78deb24,e3b4fd08,c10c6680,3d7,0,...) at usb_process+0xe6/frame 0xe3b4fccc fork_exit(c0961120,c78deb24,e3b4fd08) at fork_exit+0x7f/frame 0xe3b4fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b4fcf4 --- trap 0, eip = 0, esp = 0xe3b4fd40, ebp = 0 --- Tracing command usb pid 15 tid 100043 td 0xc78e3900 sched_switch(c78e3900,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3b4cbd4 mi_switch(104,0,c10d2871,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b4cc08 sleepq_switch(c78e3900,0,c10d2871,26b,c78e3900,...) at sleepq_switch+0x1b9/frame 0xe3b4cc3c sleepq_wait(c78deafc,0,e3b4cc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b4cc60 _cv_wait(c78deafc,c78dec74,c10aa0c3,77,c78deb04,...) at _cv_wait+0x1f9/frame 0xe3b4cca4 usb_process(c78deaf4,e3b4cd08,c10c6680,3d7,0,...) at usb_process+0xe6/frame 0xe3b4cccc fork_exit(c0961120,c78deaf4,e3b4cd08) at fork_exit+0x7f/frame 0xe3b4ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b4ccf4 --- trap 0, eip = 0, esp = 0xe3b4cd40, ebp = 0 --- Tracing command usb pid 15 tid 100042 td 0xc78e3c00 sched_switch(c78e3c00,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3b49bd4 mi_switch(104,0,c10d2871,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b49c08 sleepq_switch(c78e3c00,0,c10d2871,26b,c78e3c00,...) at sleepq_switch+0x1b9/frame 0xe3b49c3c sleepq_wait(c78deacc,0,e3b49c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b49c60 _cv_wait(c78deacc,c78dec74,c10aa0c3,77,c78dead4,...) at _cv_wait+0x1f9/frame 0xe3b49ca4 usb_process(c78deac4,e3b49d08,c10c6680,3d7,0,...) at usb_process+0xe6/frame 0xe3b49ccc fork_exit(c0961120,c78deac4,e3b49d08) at fork_exit+0x7f/frame 0xe3b49cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b49cf4 --- trap 0, eip = 0, esp = 0xe3b49d40, ebp = 0 --- Tracing command usb pid 15 tid 100040 td 0xc78d2000 sched_switch(c78d2000,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3b42bd4 mi_switch(104,0,c10d2871,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b42c08 sleepq_switch(c78d2000,0,c10d2871,26b,c78d2000,...) at sleepq_switch+0x1b9/frame 0xe3b42c3c sleepq_wait(c78d9b5c,0,e3b42c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b42c60 _cv_wait(c78d9b5c,c78d9c74,c10aa0c3,77,c78d9b64,...) at _cv_wait+0x1f9/frame 0xe3b42ca4 usb_process(c78d9b54,e3b42d08,c10c6680,3d7,0,...) at usb_process+0xe6/frame 0xe3b42ccc fork_exit(c0961120,c78d9b54,e3b42d08) at fork_exit+0x7f/frame 0xe3b42cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b42cf4 --- trap 0, eip = 0, esp = 0xe3b42d40, ebp = 0 --- Tracing command usb pid 15 tid 100039 td 0xc78d2300 sched_switch(c78d2300,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3b3fbd4 mi_switch(104,0,c10d2871,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b3fc08 sleepq_switch(c78d2300,0,c10d2871,26b,c78d2300,...) at sleepq_switch+0x1b9/frame 0xe3b3fc3c sleepq_wait(c78d9b2c,0,e3b3fc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b3fc60 _cv_wait(c78d9b2c,c78d9c74,c10aa0c3,77,c78d9b34,...) at _cv_wait+0x1f9/frame 0xe3b3fca4 usb_process(c78d9b24,e3b3fd08,c10c6680,3d7,0,...) at usb_process+0xe6/frame 0xe3b3fccc fork_exit(c0961120,c78d9b24,e3b3fd08) at fork_exit+0x7f/frame 0xe3b3fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b3fcf4 --- trap 0, eip = 0, esp = 0xe3b3fd40, ebp = 0 --- Tracing command usb pid 15 tid 100038 td 0xc78d2600 sched_switch(c78d2600,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3b3cbd4 mi_switch(104,0,c10d2871,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b3cc08 sleepq_switch(c78d2600,0,c10d2871,26b,c78d2600,...) at sleepq_switch+0x1b9/frame 0xe3b3cc3c sleepq_wait(c78d9afc,0,e3b3cc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b3cc60 _cv_wait(c78d9afc,c78d9c74,c10aa0c3,77,c78d9b04,...) at _cv_wait+0x1f9/frame 0xe3b3cca4 usb_process(c78d9af4,e3b3cd08,c10c6680,3d7,0,...) at usb_process+0xe6/frame 0xe3b3cccc fork_exit(c0961120,c78d9af4,e3b3cd08) at fork_exit+0x7f/frame 0xe3b3ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b3ccf4 --- trap 0, eip = 0, esp = 0xe3b3cd40, ebp = 0 --- Tracing command usb pid 15 tid 100037 td 0xc78d2900 sched_switch(c78d2900,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3b39bd4 mi_switch(104,0,c10d2871,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b39c08 sleepq_switch(c78d2900,0,c10d2871,26b,c78d2900,...) at sleepq_switch+0x1b9/frame 0xe3b39c3c sleepq_wait(c78d9acc,0,e3b39c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b39c60 _cv_wait(c78d9acc,c78d9c74,c10aa0c3,77,c78d9ad4,...) at _cv_wait+0x1f9/frame 0xe3b39ca4 usb_process(c78d9ac4,e3b39d08,c10c6680,3d7,0,...) at usb_process+0xe6/frame 0xe3b39ccc fork_exit(c0961120,c78d9ac4,e3b39d08) at fork_exit+0x7f/frame 0xe3b39cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b39cf4 --- trap 0, eip = 0, esp = 0xe3b39d40, ebp = 0 --- Tracing command usb pid 15 tid 100035 td 0xc78d4000 sched_switch(c78d4000,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3b32bd4 mi_switch(104,0,c10d2871,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b32c08 sleepq_switch(c78d4000,0,c10d2871,26b,c78d4000,...) at sleepq_switch+0x1b9/frame 0xe3b32c3c sleepq_wait(c78cdb5c,0,e3b32c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b32c60 _cv_wait(c78cdb5c,c78cdc74,c10aa0c3,77,c78cdb64,...) at _cv_wait+0x1f9/frame 0xe3b32ca4 usb_process(c78cdb54,e3b32d08,c10c6680,3d7,0,...) at usb_process+0xe6/frame 0xe3b32ccc fork_exit(c0961120,c78cdb54,e3b32d08) at fork_exit+0x7f/frame 0xe3b32cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b32cf4 --- trap 0, eip = 0, esp = 0xe3b32d40, ebp = 0 --- Tracing command usb pid 15 tid 100034 td 0xc78d4300 sched_switch(c78d4300,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3b2fbd4 mi_switch(104,0,c10d2871,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b2fc08 sleepq_switch(c78d4300,0,c10d2871,26b,c78d4300,...) at sleepq_switch+0x1b9/frame 0xe3b2fc3c sleepq_wait(c78cdb2c,0,e3b2fc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b2fc60 _cv_wait(c78cdb2c,c78cdc74,c10aa0c3,77,c78cdb34,...) at _cv_wait+0x1f9/frame 0xe3b2fca4 usb_process(c78cdb24,e3b2fd08,c10c6680,3d7,0,...) at usb_process+0xe6/frame 0xe3b2fccc fork_exit(c0961120,c78cdb24,e3b2fd08) at fork_exit+0x7f/frame 0xe3b2fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b2fcf4 --- trap 0, eip = 0, esp = 0xe3b2fd40, ebp = 0 --- Tracing command usb pid 15 tid 100033 td 0xc78d4600 sched_switch(c78d4600,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3b2cbd4 mi_switch(104,0,c10d2871,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b2cc08 sleepq_switch(c78d4600,0,c10d2871,26b,c78d4600,...) at sleepq_switch+0x1b9/frame 0xe3b2cc3c sleepq_wait(c78cdafc,0,e3b2cc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b2cc60 _cv_wait(c78cdafc,c78cdc74,c10aa0c3,77,c78cdb04,...) at _cv_wait+0x1f9/frame 0xe3b2cca4 usb_process(c78cdaf4,e3b2cd08,c10c6680,3d7,0,...) at usb_process+0xe6/frame 0xe3b2cccc fork_exit(c0961120,c78cdaf4,e3b2cd08) at fork_exit+0x7f/frame 0xe3b2ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b2ccf4 --- trap 0, eip = 0, esp = 0xe3b2cd40, ebp = 0 --- Tracing command usb pid 15 tid 100032 td 0xc78d4900 sched_switch(c78d4900,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3b29bd4 mi_switch(104,0,c10d2871,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b29c08 sleepq_switch(c78d4900,0,c10d2871,26b,c78d4900,...) at sleepq_switch+0x1b9/frame 0xe3b29c3c sleepq_wait(c78cdacc,0,e3b29c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b29c60 _cv_wait(c78cdacc,c78cdc74,c10aa0c3,77,c78cdad4,...) at _cv_wait+0x1f9/frame 0xe3b29ca4 usb_process(c78cdac4,e3b29d08,c10c6680,3d7,0,...) at usb_process+0xe6/frame 0xe3b29ccc fork_exit(c0961120,c78cdac4,e3b29d08) at fork_exit+0x7f/frame 0xe3b29cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b29cf4 --- trap 0, eip = 0, esp = 0xe3b29d40, ebp = 0 --- Tracing command yarrow pid 14 tid 100017 td 0xc7773600 sched_switch(c7773600,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xc7236bb4 mi_switch(104,0,c10d2871,1f5,c129b248,...) at mi_switch+0x1c9/frame 0xc7236be8 sleepq_switch(c7773600,0,c10d2871,28e,c12652dc,...) at sleepq_switch+0x1b9/frame 0xc7236c1c sleepq_timedwait(c12652dc,0,c10cd77d,c10b8946,0,...) at sleepq_timedwait+0x48/frame 0xc7236c40 msleep_spin_sbt(c12652dc,c1445610,c10b8946,19999999,0,...) at msleep_spin_sbt+0x225/frame 0xc7236c88 random_kthread(0,c7236d08,c10c6680,3d7,0,...) at random_kthread+0x2ea/frame 0xc7236ccc fork_exit(c084f6f0,0,c7236d08) at fork_exit+0x7f/frame 0xc7236cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7236cf4 --- trap 0, eip = 0, esp = 0xc7236d40, ebp = 0 --- Tracing command geom pid 13 tid 100016 td 0xc7773900 sched_switch(c7773900,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xc7232b70 mi_switch(104,0,c10d2871,1f5,162,...) at mi_switch+0x1c9/frame 0xc7232ba4 sleepq_switch(c7773900,0,c10d2871,26b,c7773900,...) at sleepq_switch+0x1b9/frame 0xc7232bd8 sleepq_wait(c14468e8,5c,c10b8946,0,0,...) at sleepq_wait+0x48/frame 0xc7232bfc _sleep(c14468e8,c127c87c,25c,c10b8946,0,...) at _sleep+0x37c/frame 0xc7232c58 g_io_schedule_down(c7773900,0,c10ba66d,6c,c7232cf4,...) at g_io_schedule_down+0x5c/frame 0xc7232cb4 g_down_procbody(0,c7232d08,c10c6680,3d7,0,...) at g_down_procbody+0x9d/frame 0xc7232ccc fork_exit(c0a107c0,0,c7232d08) at fork_exit+0x7f/frame 0xc7232cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7232cf4 --- trap 0, eip = 0, esp = 0xc7232d40, ebp = 0 --- Tracing command geom pid 13 tid 100015 td 0xc7773c00 cpustop_handler(1,13,c722fb00,c0ed56db,409c39,...) at cpustop_handler+0x2f/frame 0xc722f9b0 ipi_nmi_handler(409c39,0,0,c722fa04,c0a756db,...) at ipi_nmi_handler+0x37/frame 0xc722f9c0 trap(c722fb0c) at trap+0x3b/frame 0xc722fb00 calltrap() at calltrap+0x6/frame 0xc722fb00 --- trap 0x13, eip = 0xc053af7b, esp = 0xc722fb4c, ebp = 0xc722fb50 --- acpi_timer_get_timecount_safe(c1144500,d34870e4,1b296,c7c19690,2000,...) at acpi_timer_get_timecount_safe+0x1b/frame 0xc722fb50 binuptime(c722fba0,1,c128bf80,246,1,...) at binuptime+0x3d/frame 0xc722fb70 devstat_end_transaction(c7c19690,2000,0,1,0,...) at devstat_end_transaction+0x30/frame 0xc722fbbc devstat_end_transaction_bio(c7c19690,c9f4c1ec,c10ba452,59,c7c366e0,...) at devstat_end_transaction_bio+0x65/frame 0xc722fbe4 g_io_deliver(c9f4c1ec,0) at g_io_deliver+0x16b/frame 0xc722fc40 g_std_done(cdf9d854,0,c10da64c,e0c,0,...) at g_std_done+0x4e/frame 0xc722fc54 biodone(cdf9d854,0,c10ba452,60,0,...) at biodone+0xb2/frame 0xc722fc80 g_io_schedule_up(c7773c00,0,c10ba66d,5f,c722fcf4,...) at g_io_schedule_up+0x129/frame 0xc722fcb4 g_up_procbody(0,c722fd08,c10c6680,3d7,0,...) at g_up_procbody+0x9d/frame 0xc722fccc fork_exit(c0a10720,0,c722fd08) at fork_exit+0x7f/frame 0xc722fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc722fcf4 --- trap 0, eip = 0, esp = 0xc722fd40, ebp = 0 --- Tracing command geom pid 13 tid 100014 td 0xc7775000 sched_switch(c7775000,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xc722cba8 mi_switch(104,0,c10d2871,1f5,162,...) at mi_switch+0x1c9/frame 0xc722cbdc sleepq_switch(c7775000,0,c10d2871,26b,c7775000,...) at sleepq_switch+0x1b9/frame 0xc722cc10 sleepq_wait(c14468e0,5c,c10b8946,0,0,...) at sleepq_wait+0x48/frame 0xc722cc34 _sleep(c14468e0,c127c854,25c,c10b8946,0,...) at _sleep+0x37c/frame 0xc722cc90 g_run_events(0,c722cd08,c10c6680,3d7,0,...) at g_run_events+0x566/frame 0xc722cccc fork_exit(c0a10680,0,c722cd08) at fork_exit+0x7f/frame 0xc722ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc722ccf4 --- trap 0, eip = 0, esp = 0xc722cd40, ebp = 0 --- Tracing command intr pid 12 tid 100063 td 0xc78e5300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100062 td 0xc78e5600 sched_switch(c78e5600,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xe3ba5c60 mi_switch(109,0,c10c691d,55a,8,...) at mi_switch+0x1c9/frame 0xe3ba5c94 ithread_loop(c770d1f0,e3ba5d08,c10c6680,3d7,0,...) at ithread_loop+0x100/frame 0xe3ba5ccc fork_exit(c0a83940,c770d1f0,e3ba5d08) at fork_exit+0x7f/frame 0xe3ba5cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3ba5cf4 --- trap 0, eip = 0, esp = 0xe3ba5d40, ebp = 0 --- Tracing command intr pid 12 tid 100060 td 0xc78e5c00 sched_switch(c78e5c00,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xe3b95c60 mi_switch(109,0,c10c691d,55a,8,...) at mi_switch+0x1c9/frame 0xe3b95c94 ithread_loop(c770d5a0,e3b95d08,c10c6680,3d7,0,...) at ithread_loop+0x100/frame 0xe3b95ccc fork_exit(c0a83940,c770d5a0,e3b95d08) at fork_exit+0x7f/frame 0xe3b95cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b95cf4 --- trap 0, eip = 0, esp = 0xe3b95d40, ebp = 0 --- Tracing command intr pid 12 tid 100059 td 0xc78ef000 sched_switch(c78ef000,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xe3b84c60 mi_switch(109,0,c10c691d,55a,8,...) at mi_switch+0x1c9/frame 0xe3b84c94 ithread_loop(c770d0f0,e3b84d08,c10c6680,3d7,0,...) at ithread_loop+0x100/frame 0xe3b84ccc fork_exit(c0a83940,c770d0f0,e3b84d08) at fork_exit+0x7f/frame 0xe3b84cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b84cf4 --- trap 0, eip = 0, esp = 0xe3b84d40, ebp = 0 --- Tracing command intr pid 12 tid 100054 td 0xc78f2000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xc78e5000 sched_switch(c78e5000,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xe3b46c60 mi_switch(109,0,c10c691d,55a,8,...) at mi_switch+0x1c9/frame 0xe3b46c94 ithread_loop(c770d1e0,e3b46d08,c10c6680,3d7,0,...) at ithread_loop+0x100/frame 0xe3b46ccc fork_exit(c0a83940,c770d1e0,e3b46d08) at fork_exit+0x7f/frame 0xe3b46cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b46cf4 --- trap 0, eip = 0, esp = 0xe3b46d40, ebp = 0 --- Tracing command intr pid 12 tid 100036 td 0xc78d2c00 sched_switch(c78d2c00,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xe3b36c60 mi_switch(109,0,c10c691d,55a,8,...) at mi_switch+0x1c9/frame 0xe3b36c94 ithread_loop(c770d0c0,e3b36d08,c10c6680,3d7,0,...) at ithread_loop+0x100/frame 0xe3b36ccc fork_exit(c0a83940,c770d0c0,e3b36d08) at fork_exit+0x7f/frame 0xe3b36cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b36cf4 --- trap 0, eip = 0, esp = 0xe3b36d40, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xc78d4c00 sched_switch(c78d4c00,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xe3b26c60 mi_switch(109,0,c10c691d,55a,8,...) at mi_switch+0x1c9/frame 0xe3b26c94 ithread_loop(c770d6a0,e3b26d08,c10c6680,3d7,0,...) at ithread_loop+0x100/frame 0xe3b26ccc fork_exit(c0a83940,c770d6a0,e3b26d08) at fork_exit+0x7f/frame 0xe3b26cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b26cf4 --- trap 0, eip = 0, esp = 0xe3b26d40, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc7775300 sched_switch(c7775300,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xc7393c60 mi_switch(109,0,c10c691d,55a,8,...) at mi_switch+0x1c9/frame 0xc7393c94 ithread_loop(c770d280,c7393d08,c10c6680,3d7,0,...) at ithread_loop+0x100/frame 0xc7393ccc fork_exit(c0a83940,c770d280,c7393d08) at fork_exit+0x7f/frame 0xc7393cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7393cf4 --- trap 0, eip = 0, esp = 0xc7393d40, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc7775600 sched_switch(c7775600,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xc738fc60 mi_switch(109,0,c10c691d,55a,8,...) at mi_switch+0x1c9/frame 0xc738fc94 ithread_loop(c770d6c0,c738fd08,c10c6680,3d7,0,...) at ithread_loop+0x100/frame 0xc738fccc fork_exit(c0a83940,c770d6c0,c738fd08) at fork_exit+0x7f/frame 0xc738fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc738fcf4 --- trap 0, eip = 0, esp = 0xc738fd40, ebp = 0 --- Tracing command intr pid 12 tid 100028 td 0xc7775900 sched_switch(c7775900,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xc7286c60 mi_switch(109,0,c10c691d,55a,8,...) at mi_switch+0x1c9/frame 0xc7286c94 ithread_loop(c770d3b0,c7286d08,c10c6680,3d7,0,...) at ithread_loop+0x100/frame 0xc7286ccc fork_exit(c0a83940,c770d3b0,c7286d08) at fork_exit+0x7f/frame 0xc7286cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7286cf4 --- trap 0, eip = 0, esp = 0xc7286d40, ebp = 0 --- Tracing command intr pid 12 tid 100027 td 0xc7775c00 sched_switch(c7775c00,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xc7254c60 mi_switch(109,0,c10c691d,55a,8,...) at mi_switch+0x1c9/frame 0xc7254c94 ithread_loop(c770d760,c7254d08,c10c6680,3d7,0,...) at ithread_loop+0x100/frame 0xc7254ccc fork_exit(c0a83940,c770d760,c7254d08) at fork_exit+0x7f/frame 0xc7254cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7254cf4 --- trap 0, eip = 0, esp = 0xc7254d40, ebp = 0 --- Tracing command intr pid 12 tid 100022 td 0xc7860c00 sched_switch(c7860c00,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xc7245c60 mi_switch(109,0,c10c691d,55a,8,...) at mi_switch+0x1c9/frame 0xc7245c94 ithread_loop(c770d770,c7245d08,c10c6680,3d7,0,...) at ithread_loop+0x100/frame 0xc7245ccc fork_exit(c0a83940,c770d770,c7245d08) at fork_exit+0x7f/frame 0xc7245cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7245cf4 --- trap 0, eip = 0, esp = 0xc7245d40, ebp = 0 --- Tracing command intr pid 12 tid 100020 td 0xc770ec00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100018 td 0xc7773300 sched_switch(c7773300,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xc7239c60 mi_switch(109,0,c10c691d,55a,8,...) at mi_switch+0x1c9/frame 0xc7239c94 ithread_loop(c770d790,c7239d08,c10c6680,3d7,0,...) at ithread_loop+0x100/frame 0xc7239ccc fork_exit(c0a83940,c770d790,c7239d08) at fork_exit+0x7f/frame 0xc7239cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7239cf4 --- trap 0, eip = 0, esp = 0xc7239d40, ebp = 0 --- Tracing command intr pid 12 tid 100012 td 0xc76c7600 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100011 td 0xc76c7900 sched_switch(c76c7900,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xc7223c60 mi_switch(109,0,c10c691d,55a,8,...) at mi_switch+0x1c9/frame 0xc7223c94 ithread_loop(c770d7b0,c7223d08,c10c6680,3d7,0,...) at ithread_loop+0x100/frame 0xc7223ccc fork_exit(c0a83940,c770d7b0,c7223d08) at fork_exit+0x7f/frame 0xc7223cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7223cf4 --- trap 0, eip = 0, esp = 0xc7223d40, ebp = 0 --- Tracing command intr pid 12 tid 100010 td 0xc76c7c00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100009 td 0xc770e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100008 td 0xc770e300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100007 td 0xc770e600 sched_switch(c770e600,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xc7217c60 mi_switch(109,0,c10c691d,55a,8,...) at mi_switch+0x1c9/frame 0xc7217c94 ithread_loop(c770d7f0,c7217d08,c10c6680,3d7,0,...) at ithread_loop+0x100/frame 0xc7217ccc fork_exit(c0a83940,c770d7f0,c7217d08) at fork_exit+0x7f/frame 0xc7217cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7217cf4 --- trap 0, eip = 0, esp = 0xc7217d40, ebp = 0 --- Tracing command idle pid 11 tid 100006 td 0xc76c5000 sched_switch(c76c5000,0,608,1b0,51c,...) at sched_switch+0x4b9/frame 0xc7213c00 mi_switch(608,0,c10cd1dc,d3,19,...) at mi_switch+0x1c9/frame 0xc7213c34 critical_exit(0,2,c10cf0fd,a46,c128ce08,...) at critical_exit+0xa3/frame 0xc7213c50 sched_idletd(0,c7213d08,c10c6680,3d7,0,...) at sched_idletd+0x1d6/frame 0xc7213ccc fork_exit(c0ada170,0,c7213d08) at fork_exit+0x7f/frame 0xc7213cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7213cf4 --- trap 0, eip = 0, esp = 0xc7213d40, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc76c5300 cpustop_handler(2,13,c7210b90,c0ed56db,0,...) at cpustop_handler+0x2f/frame 0xc7210a40 ipi_nmi_handler(0,0,46,0,c71fdcac,...) at ipi_nmi_handler+0x37/frame 0xc7210a50 trap(c7210b9c) at trap+0x3b/frame 0xc7210b90 calltrap() at calltrap+0x6/frame 0xc7210b90 --- trap 0x13, eip = 0xc0ebb0d5, esp = 0xc7210bdc, ebp = 0xc7210bdc --- acpi_cpu_c1(c0ede48b,c71fdc90,0,c1126097,303,...) at acpi_cpu_c1+0x5/frame 0xc7210bdc acpi_cpu_idle(1a3d5c9f,0,1a3d5c9f,c7210c50,c0ec522a,...) at acpi_cpu_idle+0x146/frame 0xc7210c20 cpu_idle_acpi(1a3d5c9f,0,8,c128c708,c128c716,...) at cpu_idle_acpi+0x3f/frame 0xc7210c34 cpu_idle(0,2,c10cf0fd,a46,c128c708,...) at cpu_idle+0x9a/frame 0xc7210c50 sched_idletd(0,c7210d08,c10c6680,3d7,0,...) at sched_idletd+0x1d6/frame 0xc7210ccc fork_exit(c0ada170,0,c7210d08) at fork_exit+0x7f/frame 0xc7210cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7210cf4 --- trap 0, eip = 0, esp = 0xc7210d40, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc76c5600 sched_switch(c76c5600,0,608,1b0,51c,...) at sched_switch+0x4b9/frame 0xc720dc00 mi_switch(608,0,c10cd1dc,d3,a,...) at mi_switch+0x1c9/frame 0xc720dc34 critical_exit(0,2,c10cf0fd,a46,c128c008,...) at critical_exit+0xa3/frame 0xc720dc50 sched_idletd(0,c720dd08,c10c6680,3d7,0,...) at sched_idletd+0x1d6/frame 0xc720dccc fork_exit(c0ada170,0,c720dd08) at fork_exit+0x7f/frame 0xc720dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc720dcf4 --- trap 0, eip = 0, esp = 0xc720dd40, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xc76c5900 cpustop_handler(0,13,c720ab90,c0ed56db,0,...) at cpustop_handler+0x2f/frame 0xc720aa40 ipi_nmi_handler(0,0,0,c76c5900,c1825cac,...) at ipi_nmi_handler+0x37/frame 0xc720aa50 trap(c720ab9c) at trap+0x3b/frame 0xc720ab90 calltrap() at calltrap+0x6/frame 0xc720ab90 --- trap 0x13, eip = 0xc0ebb0d5, esp = 0xc720abdc, ebp = 0xc720abdc --- acpi_cpu_c1(c0ede48b,c1825c90,0,c1126097,303,...) at acpi_cpu_c1+0x5/frame 0xc720abdc acpi_cpu_idle(c49bde7,0,c49bde7,c720ac50,c0ec522a,...) at acpi_cpu_idle+0x146/frame 0xc720ac20 cpu_idle_acpi(c49bde7,0,9,c128b908,c128b916,...) at cpu_idle_acpi+0x3f/frame 0xc720ac34 cpu_idle(0,2,c10cf0fd,a46,c128b908,...) at cpu_idle+0x9a/frame 0xc720ac50 sched_idletd(0,c720ad08,c10c6680,3d7,0,...) at sched_idletd+0x1d6/frame 0xc720accc fork_exit(c0ada170,0,c720ad08) at fork_exit+0x7f/frame 0xc720acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc720acf4 --- trap 0, eip = 0, esp = 0xc720ad40, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc76c5c00 sched_switch(c76c5c00,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xc720698c mi_switch(104,0,c10d2871,1f5,c10d2871,...) at mi_switch+0x1c9/frame 0xc72069c0 sleepq_switch(c76c5c00,0,c10d2871,1ab,c7206a38,...) at sleepq_switch+0x1b9/frame 0xc72069f4 sleepq_catch_signals(0,c10d2871,162,e88,c76c5c00,...) at sleepq_catch_signals+0x361/frame 0xc7206a3c sleepq_wait_sig(c76c3ba0,6c,c10d5ce9,100,0,...) at sleepq_wait_sig+0x14/frame 0xc7206a60 _sleep(c76c3ba0,c76c3c34,16c,c10d5ce9,0,...) at _sleep+0x35b/frame 0xc7206abc kern_wait6(c76c5c00,7,0,0,c7206b4c,...) at kern_wait6+0x45c/frame 0xc7206b20 sys_wait4(c76c5c00,c7206cc8,14,c10cf0fd,7b3,...) at sys_wait4+0x94/frame 0xc7206c40 syscall(c7206d08) at syscall+0x2ed/frame 0xc7206cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xc7206cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x805e3b7, esp = 0xbfbfd8f4, ebp = 0xbfbfd908 --- Tracing command audit pid 10 tid 100001 td 0xc76c7000 sched_switch(c76c7000,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xc7203ba8 mi_switch(104,0,c10d2871,1f5,8,...) at mi_switch+0x1c9/frame 0xc7203bdc sleepq_switch(c76c7000,0,c10d2871,26b,c76c7000,...) at sleepq_switch+0x1b9/frame 0xc7203c10 sleepq_wait(c144d638,0,c7203c64,1,0,...) at sleepq_wait+0x48/frame 0xc7203c34 _cv_wait(c144d638,c144d5c4,c10fe392,18d,0,...) at _cv_wait+0x1f9/frame 0xc7203c78 audit_worker(0,c7203d08,c10c6680,3d7,0,...) at audit_worker+0x94/frame 0xc7203ccc fork_exit(c0cc7ca0,0,c7203d08) at fork_exit+0x7f/frame 0xc7203cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7203cf4 --- trap 0, eip = 0, esp = 0xc7203d40, ebp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xc7949c00 sched_switch(c7949c00,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3baeb68 mi_switch(104,0,c10d2871,1f5,101,...) at mi_switch+0x1c9/frame 0xe3baeb9c sleepq_switch(c7949c00,0,c10d2871,28e,c7949c00,...) at sleepq_switch+0x1b9/frame 0xe3baebd0 sleepq_timedwait(c127e550,0,2,0,0,...) at sleepq_timedwait+0x48/frame 0xe3baebf4 _sleep(c127e550,0,0,c10b8946,fffffc88,...) at _sleep+0x345/frame 0xe3baec50 pause_sbt(c10b8946,fffffc88,2,0,0,...) at pause_sbt+0x86/frame 0xe3baec8c deadlkres(0,e3baed08,c10c6680,3d7,0,...) at deadlkres+0x82/frame 0xe3baeccc fork_exit(c0a62370,0,e3baed08) at fork_exit+0x7f/frame 0xe3baecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3baecf4 --- trap 0, eip = 0, esp = 0xe3baed40, ebp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xc794a000 sched_switch(c794a000,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xe3babbc0 mi_switch(104,0,c10d2871,1f5,c129bcb0,...) at mi_switch+0x1c9/frame 0xe3babbf4 sleepq_switch(c794a000,0,c10d2871,26b,c7867d80,...) at sleepq_switch+0x1b9/frame 0xe3babc28 sleepq_wait(c7867d80,0,c10cd77d,c10b8946,0,...) at sleepq_wait+0x48/frame 0xe3babc4c msleep_spin_sbt(c7867d80,c7867d98,c10b8946,0,0,...) at msleep_spin_sbt+0x239/frame 0xe3babc94 taskqueue_thread_loop(c1443100,e3babd08,c10c6680,3d7,0,...) at taskqueue_thread_loop+0xcc/frame 0xe3babccc fork_exit(c0af9650,c1443100,e3babd08) at fork_exit+0x7f/frame 0xe3babcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3babcf4 --- trap 0, eip = 0, esp = 0xe3babd40, ebp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xc7860000 sched_switch(c7860000,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xc7251bac mi_switch(104,0,c10d2871,1f5,162,...) at mi_switch+0x1c9/frame 0xc7251be0 sleepq_switch(c7860000,0,c10d2871,26b,c7860000,...) at sleepq_switch+0x1b9/frame 0xc7251c14 sleepq_wait(c75a8600,0,c10b8946,0,0,...) at sleepq_wait+0x48/frame 0xc7251c38 _sleep(c75a8600,c75a8618,0,c10b8946,0,...) at _sleep+0x37c/frame 0xc7251c94 taskqueue_thread_loop(c144d670,c7251d08,c10c6680,3d7,0,...) at taskqueue_thread_loop+0x129/frame 0xc7251ccc fork_exit(c0af9650,c144d670,c7251d08) at fork_exit+0x7f/frame 0xc7251cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7251cf4 --- trap 0, eip = 0, esp = 0xc7251d40, ebp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xc7860300 sched_switch(c7860300,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xc724ebc0 mi_switch(104,0,c10d2871,1f5,c129a588,...) at mi_switch+0x1c9/frame 0xc724ebf4 sleepq_switch(c7860300,0,c10d2871,26b,c75a8680,...) at sleepq_switch+0x1b9/frame 0xc724ec28 sleepq_wait(c75a8680,0,c10cd77d,c10b8946,0,...) at sleepq_wait+0x48/frame 0xc724ec4c msleep_spin_sbt(c75a8680,c75a8698,c10b8946,0,0,...) at msleep_spin_sbt+0x239/frame 0xc724ec94 taskqueue_thread_loop(c1443c20,c724ed08,c10c6680,3d7,0,...) at taskqueue_thread_loop+0xcc/frame 0xc724eccc fork_exit(c0af9650,c1443c20,c724ed08) at fork_exit+0x7f/frame 0xc724ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc724ecf4 --- trap 0, eip = 0, esp = 0xc724ed40, ebp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xc7860600 sched_switch(c7860600,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xc724bbc0 mi_switch(104,0,c10d2871,1f5,c129a588,...) at mi_switch+0x1c9/frame 0xc724bbf4 sleepq_switch(c7860600,0,c10d2871,26b,c75a8680,...) at sleepq_switch+0x1b9/frame 0xc724bc28 sleepq_wait(c75a8680,0,c10cd77d,c10b8946,0,...) at sleepq_wait+0x48/frame 0xc724bc4c msleep_spin_sbt(c75a8680,c75a8698,c10b8946,0,0,...) at msleep_spin_sbt+0x239/frame 0xc724bc94 taskqueue_thread_loop(c1443c20,c724bd08,c10c6680,3d7,0,...) at taskqueue_thread_loop+0xcc/frame 0xc724bccc fork_exit(c0af9650,c1443c20,c724bd08) at fork_exit+0x7f/frame 0xc724bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc724bcf4 --- trap 0, eip = 0, esp = 0xc724bd40, ebp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xc7860900 sched_switch(c7860900,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xc7248bc0 mi_switch(104,0,c10d2871,1f5,c129a588,...) at mi_switch+0x1c9/frame 0xc7248bf4 sleepq_switch(c7860900,0,c10d2871,26b,c75a8680,...) at sleepq_switch+0x1b9/frame 0xc7248c28 sleepq_wait(c75a8680,0,c10cd77d,c10b8946,0,...) at sleepq_wait+0x48/frame 0xc7248c4c msleep_spin_sbt(c75a8680,c75a8698,c10b8946,0,0,...) at msleep_spin_sbt+0x239/frame 0xc7248c94 taskqueue_thread_loop(c1443c20,c7248d08,c10c6680,3d7,0,...) at taskqueue_thread_loop+0xcc/frame 0xc7248ccc fork_exit(c0af9650,c1443c20,c7248d08) at fork_exit+0x7f/frame 0xc7248cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7248cf4 --- trap 0, eip = 0, esp = 0xc7248d40, ebp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xc770e900 sched_switch(c770e900,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xc7242bac mi_switch(104,0,c10d2871,1f5,162,...) at mi_switch+0x1c9/frame 0xc7242be0 sleepq_switch(c770e900,0,c10d2871,26b,c770e900,...) at sleepq_switch+0x1b9/frame 0xc7242c14 sleepq_wait(c75a8a00,0,c10b8946,0,0,...) at sleepq_wait+0x48/frame 0xc7242c38 _sleep(c75a8a00,c75a8a18,0,c10b8946,0,...) at _sleep+0x37c/frame 0xc7242c94 taskqueue_thread_loop(c14470dc,c7242d08,c10c6680,3d7,0,...) at taskqueue_thread_loop+0x129/frame 0xc7242ccc fork_exit(c0af9650,c14470dc,c7242d08) at fork_exit+0x7f/frame 0xc7242cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7242cf4 --- trap 0, eip = 0, esp = 0xc7242d40, ebp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xc7773000 sched_switch(c7773000,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xc723cbac mi_switch(104,0,c10d2871,1f5,162,...) at mi_switch+0x1c9/frame 0xc723cbe0 sleepq_switch(c7773000,0,c10d2871,26b,c7773000,...) at sleepq_switch+0x1b9/frame 0xc723cc14 sleepq_wait(c75a8b00,0,c10b8946,0,0,...) at sleepq_wait+0x48/frame 0xc723cc38 _sleep(c75a8b00,c75a8b18,0,c10b8946,0,...) at _sleep+0x37c/frame 0xc723cc94 taskqueue_thread_loop(c144a040,c723cd08,c10c6680,3d7,0,...) at taskqueue_thread_loop+0x129/frame 0xc723cccc fork_exit(c0af9650,c144a040,c723cd08) at fork_exit+0x7f/frame 0xc723ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc723ccf4 --- trap 0, eip = 0, esp = 0xc723cd40, ebp = 0 --- Tracing command kernel pid 0 tid 100013 td 0xc76c7300 sched_switch(c76c7300,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xc7229bac mi_switch(104,0,c10d2871,1f5,162,...) at mi_switch+0x1c9/frame 0xc7229be0 sleepq_switch(c76c7300,0,c10d2871,26b,c76c7300,...) at sleepq_switch+0x1b9/frame 0xc7229c14 sleepq_wait(c75a7100,0,c10b8946,0,0,...) at sleepq_wait+0x48/frame 0xc7229c38 _sleep(c75a7100,c75a7118,0,c10b8946,0,...) at _sleep+0x37c/frame 0xc7229c94 taskqueue_thread_loop(c12999c4,c7229d08,c10c6680,3d7,0,...) at taskqueue_thread_loop+0x129/frame 0xc7229ccc fork_exit(c0af9650,c12999c4,c7229d08) at fork_exit+0x7f/frame 0xc7229cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7229cf4 --- trap 0, eip = 0, esp = 0xc7229d40, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc1446c50 sched_switch(c1446c50,0,104,1b5,c0a9ef9e,...) at sched_switch+0x4b9/frame 0xc1820c0c mi_switch(104,0,c10d2871,1f5,101,...) at mi_switch+0x1c9/frame 0xc1820c40 sleepq_switch(c1446c50,0,c10d2871,28e,c1446c50,...) at sleepq_switch+0x1b9/frame 0xc1820c74 sleepq_timedwait(c1446964,54,9,0,0,...) at sleepq_timedwait+0x48/frame 0xc1820c98 _sleep(c1446964,0,54,c10ff555,fffff470,...) at _sleep+0x345/frame 0xc1820cf4 scheduler(0,0,c1132338,181e000,1825000,...) at scheduler+0x2b3/frame 0xc1820d38 mi_startup() at mi_startup+0xf7/frame 0xc1820d58 begin() at begin+0x2c db:0:allt> call doadump Physical memory: 3435 MB Dumping 323 MB: 308 292 276 260 244 228 212 196 180 164 148 132 116 100 84 68 52 36 20 4 Dump complete = 0 db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 3 (kgdb) bt #0 doadump (textdump=0xa) at pcpu.h:253 #1 0xc051275d in db_fncall (dummy1=0x19, dummy2=0x0, dummy3=0xc124c26c, dummy4=0xf5f16450 "") at ../../../ddb/db_command.c:578 #2 0xc0512457 in db_command (cmd_table=) at ../../../ddb/db_command.c:449 #3 0xc0516334 in db_script_exec (scriptname=0xc1443984 "doadump", warnifnotfound=) at ../../../ddb/db_script.c:302 #4 0xc0512457 in db_command (cmd_table=) at ../../../ddb/db_command.c:449 #5 0xc0512170 in db_command_loop () at ../../../ddb/db_command.c:502 #6 0xc05149b0 in db_trap (type=, code=0xf5f16644) at ../../../ddb/db_main.c:231 #7 0xc0aea3c8 in kdb_trap (type=, code=, tf=) at ../../../kern/subr_kdb.c:654 #8 0xc0ed62ba in trap_fatal (frame=0xf5f168b0, eva=0x0) at ../../../i386/i386/trap.c:1037 #9 0xc0ed657f in trap_pfault (frame=0x0, usermode=0x0, eva=0x0) at ../../../i386/i386/trap.c:858 #10 0xc0ed5bdd in trap (frame=0xf5f168b0) at ../../../i386/i386/trap.c:556 #11 0xc0ebefcc in calltrap () at ../../../i386/i386/exception.s:169 #12 0xc099d388 in fifo_close (ap=0xf5f16a78) at ../../../fs/fifofs/fifo_vnops.c:267 #13 0xc0ef9fe4 in VOP_CLOSE_APV (vop=, a=0xf5f16a78) at vnode_if.c:535 #14 0xc0ef9ebb in VOP_CLOSE_AP (a=0xf5f16a78) at vnode_if.c:513 #15 0xcf4c1c3d in null_bypass (ap=0xf5f169d8) at /usr/src/sys/modules/nullfs/../../fs/nullfs/null_vnops.c:280 #16 0xc0ef9fec in VOP_CLOSE_APV (vop=, a=) at vnode_if.c:537 #17 0xc0b57da7 in vgonel (vp=0xc8e8c708) at vnode_if.h:225 #18 0xc0b58358 in vgone (vp=0xc8e8c708) at ../../../kern/vfs_subr.c:2698 #19 0xcf4c1b27 in nullfs_unlink_lowervp (mp=0xc80d28c4, lowervp=0xc8b7e000) at /usr/src/sys/modules/nullfs/../../fs/nullfs/null_vfsops.c:407 #20 0xc0b585f8 in vfs_notify_upper (vp=, event=0xc12449f0) at ../../../kern/vfs_subr.c:2745 #21 0xc0b61a8d in kern_unlinkat (td=) at ../../../kern/vfs_syscalls.c:1849 #22 0xc0b61562 in sys_unlink (td=0xc91afc00, uap=0xf5f16cc8) at ../../../kern/vfs_syscalls.c:1795 #23 0xc0ed6aed in syscall (frame=) at subr_syscall.c:134 #24 0xc0ebf061 in Xint0x80_syscall () at ../../../i386/i386/exception.s:267 #25 0x00000033 in ?? () Previous frame inner to this frame (corrupt stack?) Current language: auto; currently minimal (kgdb) f 12 #12 0xc099d388 in fifo_close (ap=0xf5f16a78) at ../../../fs/fifofs/fifo_vnops.c:267 267 cpipe = fip->fi_pipe; (kgdb) l 262 struct fifoinfo *fip; 263 struct pipe *cpipe; 264 265 vp = ap->a_vp; 266 fip = vp->v_fifoinfo; 267 cpipe = fip->fi_pipe; 268 ASSERT_VOP_ELOCKED(vp, "fifo_close"); 269 if (ap->a_fflag & FREAD) { 270 fip->fi_readers--; 271 if (fip->fi_readers == 0) { (kgdb) info loc vp = (struct vnode *) 0xc8b7e000 fip = (struct fifoinfo *) 0x0 cpipe = (struct pipe *) 0x0 (kgdb) p *vp $1 = {v_tag = 0xc10bc232 "ufs", v_op = 0xc122fd0c, v_data = 0xc9c8e9f8, v_mount = 0xc7d445d8, v_nmntvnodes = {tqe_next = 0xcbe26870, tqe_prev = 0xcb682448}, v_un = {vu_mount = 0x0, vu_socket = 0x0, vu_cdev = 0x0, vu_fifoinfo = 0x0}, v_hashlist = {le_next = 0x0, le_prev = 0xc7985f54}, v_cache_src = {lh_first = 0x0}, v_cache_dst = {tqh_first = 0x0, tqh_last = 0xc8b7e028}, v_cache_dd = 0x0, v_lock = {lock_object = { lo_name = 0xc10bc232 "ufs", lo_flags = 0x57b0008, lo_data = 0x0, lo_witness = 0xc7586200}, lk_lock = 0xc91afc00, lk_exslpfail = 0x0, lk_timo = 0x33, lk_pri = 0x60, lk_stack = {depth = 0x12, pcs = {0xc0a9583f, 0xc0d1990d, 0xc0efca62, 0xc0b6834a, 0xc0b55eb7, 0xc0b4968f, 0xc0d14177, 0xc0d1411e, 0xc0d2317e, 0xc0d2228a, 0xc0ef9674, 0xc0b420f0, 0xc0ef9484, 0xc0b4aef8, 0xc0b4a5ed, 0xc0b6190c, 0xc0b61562, 0xc0ed6aed}}}, v_interlock = {lock_object = {lo_name = 0xc10d4e21 "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc757f1e0}, mtx_lock = 0x4}, v_vnlock = 0xc8b7e034, v_actfreelist = {tqe_next = 0xcb43a708, tqe_prev = 0xcae73658}, v_bufobj = {bo_mtx = {lock_object = {lo_name = 0xc10dd5d1 "bufobj interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc7584730}, mtx_lock = 0x4}, bo_ops = 0xc120dc70, bo_object = 0x0, bo_synclist = {le_next = 0x0, le_prev = 0x0}, bo_private = 0xc8b7e000, __bo_vnode = 0xc8b7e000, bo_clean = {bv_hd = {tqh_first = 0x0, tqh_last = 0xc8b7e0ec}, bv_root = 0x0, bv_cnt = 0x0}, bo_dirty = {bv_hd = {tqh_first = 0x0, tqh_last = 0xc8b7e0fc}, bv_root = 0x0, bv_cnt = 0x0}, bo_numoutput = 0x0, bo_flag = 0x0, bo_bsize = 0x4000}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0, v_rl = { rl_waiters = {tqh_first = 0x0, tqh_last = 0xc8b7e124}, rl_currdep = 0x0}, v_cstart = 0x0, v_lasta = 0x0, v_lastw = 0x0, v_clen = 0x0, v_holdcnt = 0x2, v_usecount = 0x2, v_iflag = 0x200, v_vflag = 0x0, v_writecount = 0x0, v_hash = 0x175c2f, v_type = VFIFO} (kgdb) f 15 #15 0xcf4c1c3d in null_bypass (ap=0xf5f169d8) at /usr/src/sys/modules/nullfs/../../fs/nullfs/null_vnops.c:280 280 error = VCALL(ap); (kgdb) l 275 /* 276 * Call the operation on the lower layer 277 * with the modified argument structure. 278 */ 279 if (vps_p[0] && *vps_p[0]) 280 error = VCALL(ap); 281 else { 282 printf("null_bypass: no map for %s\n", descp->vdesc_name); 283 error = EINVAL; 284 } (kgdb) info loc old_vps = {0xc8e8c708, 0x0, 0xf5f16a0c, 0xf5f16a0c, 0xc8e8c708, 0xf5f16a78, 0xf5f16a7c, 0xf5f16a20, 0xc0b54baf, 0xcf4c3200, 0xf5f16a08, 0xc8e8c7d8, 0xc8e8c7c8, 0xc12418f8, 0xc8e8c708, 0xc0b546dc} vps_p = {0xf5f16a7c, 0xc0b00400, 0x1, 0x246, 0xc757f998, 0x1, 0xc8e8c804, 0xc13c89ec, 0xf5f169c0, 0xc0b45518, 0xc8b7e034, 0xf5f169f0, 0xc0ef92e0, 0xf5f16a08, 0x246, 0xc8e8c7c8} descp = (struct vnodeop_desc *) 0xc1242308 reles = this_vp_p = error = (kgdb) p *ap $2 = {a_desc = 0x0} (kgdb) f 19 #19 0xcf4c1b27 in nullfs_unlink_lowervp (mp=0xc80d28c4, lowervp=0xc8b7e000) at /usr/src/sys/modules/nullfs/../../fs/nullfs/null_vfsops.c:407 407 vgone(vp); (kgdb) l 402 403 vp = null_hashget(mp, lowervp); 404 if (vp == NULL || vp->v_usecount > 1) 405 return; 406 VTONULL(vp)->null_flags |= NULLV_NOUNLOCK; 407 vgone(vp); 408 vput(vp); 409 } 410 411 static struct vfsops null_vfsops = { (kgdb) info loc vp = (struct vnode *) 0xc8e8c708 (kgdb) p *vp $3 = {v_tag = 0xcf4c2b4e "null", v_op = 0xcf4c3200, v_data = 0xcf29b3e0, v_mount = 0xc80d28c4, v_nmntvnodes = {tqe_next = 0xc979c000, tqe_prev = 0xc88d82e0}, v_un = {vu_mount = 0x0, vu_socket = 0x0, vu_cdev = 0x0, vu_fifoinfo = 0x0}, v_hashlist = {le_next = 0x0, le_prev = 0x0}, v_cache_src = {lh_first = 0x0}, v_cache_dst = {tqh_first = 0x0, tqh_last = 0xc8e8c730}, v_cache_dd = 0x0, v_lock = {lock_object = { lo_name = 0xcf4c2b4e "null", lo_flags = 0x5730008, lo_data = 0x0, lo_witness = 0xc7586950}, lk_lock = 0x1, lk_exslpfail = 0x0, lk_timo = 0x33, lk_pri = 0x60, lk_stack = {depth = 0x0, pcs = { 0x0 }}}, v_interlock = {lock_object = {lo_name = 0xc10d4e21 "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc757f1e0}, mtx_lock = 0x4}, v_vnlock = 0xc8b7e034, v_actfreelist = {tqe_next = 0xca8c3e10, tqe_prev = 0xc80d2904}, v_bufobj = {bo_mtx = {lock_object = {lo_name = 0xc10dd5d1 "bufobj interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc7584730}, mtx_lock = 0x4}, bo_ops = 0xc120dc70, bo_object = 0x0, bo_synclist = {le_next = 0x0, le_prev = 0x0}, bo_private = 0xc8e8c708, __bo_vnode = 0xc8e8c708, bo_clean = {bv_hd = {tqh_first = 0x0, tqh_last = 0xc8e8c7f4}, bv_root = 0x0, bv_cnt = 0x0}, bo_dirty = {bv_hd = {tqh_first = 0x0, tqh_last = 0xc8e8c804}, bv_root = 0x0, bv_cnt = 0x0}, bo_numoutput = 0x0, bo_flag = 0x0, bo_bsize = 0x4000}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0, v_rl = {rl_waiters = {tqh_first = 0x0, tqh_last = 0xc8e8c82c}, rl_currdep = 0x0}, v_cstart = 0x0, v_lasta = 0x0, v_lastw = 0x0, v_clen = 0x0, v_holdcnt = 0x1, v_usecount = 0x1, v_iflag = 0x280, v_vflag = 0x0, v_writecount = 0x0, v_hash = 0xc8e8c7, v_type = VFIFO} (kgdb) $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/fs/nullfs/null_vnops.c =================================================================== --- /usr/src/sys/fs/nullfs/null_vnops.c (revision 250363) +++ /usr/src/sys/fs/nullfs/null_vnops.c (working copy) @@ -692,18 +692,21 @@ null_unlock(struct vop_unlock_args *ap) static int null_inactive(struct vop_inactive_args *ap __unused) { - struct vnode *vp; + struct vnode *vp, *lvp; struct mount *mp; struct null_mount *xmp; vp = ap->a_vp; + lvp = NULLVPTOLOWERVP(vp); mp = vp->v_mount; xmp = MOUNTTONULLMOUNT(mp); - if ((xmp->nullm_flags & NULLM_CACHE) == 0) { + if ((xmp->nullm_flags & NULLM_CACHE) == 0 || + (lvp->v_vflag & VV_NOSYNC) != 0) { /* * If this is the last reference and caching of the - * nullfs vnodes is not enabled, then free up the - * vnode so as not to tie up the lower vnodes. + * nullfs vnodes is not enabled, or the lower vnode is + * deleted, then free up the vnode so as not to tie up + * the lower vnodes. */ vp->v_object = NULL; vrecycle(vp); @@ -748,7 +751,10 @@ null_reclaim(struct vop_reclaim_args *ap) */ if (vp->v_writecount > 0) VOP_ADD_WRITECOUNT(lowervp, -1); - vput(lowervp); + if ((xp->null_flags & NULLV_NOUNLOCK) != 0) + vunref(lowervp); + else + vput(lowervp); free(xp, M_NULLFSNODE); return (0); Index: /usr/src/sys/fs/nullfs/null.h =================================================================== --- /usr/src/sys/fs/nullfs/null.h (revision 250363) +++ /usr/src/sys/fs/nullfs/null.h (working copy) @@ -53,8 +53,11 @@ struct null_node { LIST_ENTRY(null_node) null_hash; /* Hash list */ struct vnode *null_lowervp; /* VREFed once */ struct vnode *null_vnode; /* Back pointer */ + u_int null_flags; }; +#define NULLV_NOUNLOCK 0x0001 + #define MOUNTTONULLMOUNT(mp) ((struct null_mount *)((mp)->mnt_data)) #define VTONULL(vp) ((struct null_node *)(vp)->v_data) #define NULLTOV(xp) ((xp)->null_vnode) Index: /usr/src/sys/fs/nullfs/null_vfsops.c =================================================================== --- /usr/src/sys/fs/nullfs/null_vfsops.c (revision 250363) +++ /usr/src/sys/fs/nullfs/null_vfsops.c (working copy) @@ -65,7 +65,6 @@ static vfs_statfs_t nullfs_statfs; static vfs_unmount_t nullfs_unmount; static vfs_vget_t nullfs_vget; static vfs_extattrctl_t nullfs_extattrctl; -static vfs_reclaim_lowervp_t nullfs_reclaim_lowervp; /* * Mount null layer @@ -391,10 +390,24 @@ nullfs_reclaim_lowervp(struct mount *mp, struct vn vp = null_hashget(mp, lowervp); if (vp == NULL) return; + VTONULL(vp)->null_flags |= NULLV_NOUNLOCK; vgone(vp); - vn_lock(lowervp, LK_EXCLUSIVE | LK_RETRY); + vput(vp); } +static void +nullfs_unlink_lowervp(struct mount *mp, struct vnode *lowervp) +{ + struct vnode *vp; + + vp = null_hashget(mp, lowervp); + if (vp == NULL || vp->v_usecount > 1) + return; + VTONULL(vp)->null_flags |= NULLV_NOUNLOCK; + vgone(vp); + vput(vp); +} + static struct vfsops null_vfsops = { .vfs_extattrctl = nullfs_extattrctl, .vfs_fhtovp = nullfs_fhtovp, @@ -408,6 +421,7 @@ static struct vfsops null_vfsops = { .vfs_unmount = nullfs_unmount, .vfs_vget = nullfs_vget, .vfs_reclaim_lowervp = nullfs_reclaim_lowervp, + .vfs_unlink_lowervp = nullfs_unlink_lowervp, }; VFS_SET(null_vfsops, nullfs, VFCF_LOOPBACK | VFCF_JAIL); Index: /usr/src/sys/sys/mount.h =================================================================== --- /usr/src/sys/sys/mount.h (revision 250363) +++ /usr/src/sys/sys/mount.h (working copy) @@ -608,7 +608,7 @@ typedef int vfs_mount_t(struct mount *mp); typedef int vfs_sysctl_t(struct mount *mp, fsctlop_t op, struct sysctl_req *req); typedef void vfs_susp_clean_t(struct mount *mp); -typedef void vfs_reclaim_lowervp_t(struct mount *mp, struct vnode *lowervp); +typedef void vfs_notify_lowervp_t(struct mount *mp, struct vnode *lowervp); struct vfsops { vfs_mount_t *vfs_mount; @@ -626,7 +626,8 @@ struct vfsops { vfs_extattrctl_t *vfs_extattrctl; vfs_sysctl_t *vfs_sysctl; vfs_susp_clean_t *vfs_susp_clean; - vfs_reclaim_lowervp_t *vfs_reclaim_lowervp; + vfs_notify_lowervp_t *vfs_reclaim_lowervp; + vfs_notify_lowervp_t *vfs_unlink_lowervp; }; vfs_statfs_t __vfs_statfs; @@ -747,6 +748,14 @@ vfs_statfs_t __vfs_statfs; } \ } while (0) +#define VFS_UNLINK_LOWERVP(MP, VP) do { \ + if (*(MP)->mnt_op->vfs_unlink_lowervp != NULL) { \ + VFS_PROLOGUE(MP); \ + (*(MP)->mnt_op->vfs_unlink_lowervp)((MP), (VP)); \ + VFS_EPILOGUE(MP); \ + } \ +} while (0) + #define VFS_KNOTE_LOCKED(vp, hint) do \ { \ if (((vp)->v_vflag & VV_NOKNOTE) == 0) \ @@ -759,6 +768,9 @@ vfs_statfs_t __vfs_statfs; VN_KNOTE((vp), (hint), 0); \ } while (0) +#define VFS_NOTIFY_UPPER_RECLAIM 1 +#define VFS_NOTIFY_UPPER_UNLINK 2 + #include /* @@ -840,6 +852,7 @@ int vfs_modevent(module_t, int, void *); void vfs_mount_error(struct mount *, const char *, ...); void vfs_mountroot(void); /* mount our root filesystem */ void vfs_mountedfrom(struct mount *, const char *from); +void vfs_notify_upper(struct vnode *, int); void vfs_oexport_conv(const struct oexport_args *oexp, struct export_args *exp); void vfs_ref(struct mount *); Index: /usr/src/sys/kern/vfs_syscalls.c =================================================================== --- /usr/src/sys/kern/vfs_syscalls.c (revision 250363) +++ /usr/src/sys/kern/vfs_syscalls.c (working copy) @@ -1846,6 +1846,7 @@ restart: if (error) goto out; #endif + vfs_notify_upper(vp, VFS_NOTIFY_UPPER_UNLINK); error = VOP_REMOVE(nd.ni_dvp, vp, &nd.ni_cnd); #ifdef MAC out: @@ -3825,6 +3826,7 @@ restart: return (error); goto restart; } + vfs_notify_upper(vp, VFS_NOTIFY_UPPER_UNLINK); error = VOP_RMDIR(nd.ni_dvp, nd.ni_vp, &nd.ni_cnd); vn_finished_write(mp); out: Index: /usr/src/sys/kern/vfs_subr.c =================================================================== --- /usr/src/sys/kern/vfs_subr.c (revision 250363) +++ /usr/src/sys/kern/vfs_subr.c (working copy) @@ -2700,19 +2700,20 @@ vgone(struct vnode *vp) } static void -vgonel_reclaim_lowervp_vfs(struct mount *mp __unused, +notify_lowervp_vfs_dummy(struct mount *mp __unused, struct vnode *lowervp __unused) { } /* - * Notify upper mounts about reclaimed vnode. + * Notify upper mounts about reclaimed or unlinked vnode. */ -static void -vgonel_reclaim_lowervp(struct vnode *vp) +void +vfs_notify_upper(struct vnode *vp, int event) { static struct vfsops vgonel_vfsops = { - .vfs_reclaim_lowervp = vgonel_reclaim_lowervp_vfs + .vfs_reclaim_lowervp = notify_lowervp_vfs_dummy, + .vfs_unlink_lowervp = notify_lowervp_vfs_dummy, }; struct mount *mp, *ump, *mmp; @@ -2736,7 +2737,17 @@ static void } TAILQ_INSERT_AFTER(&mp->mnt_uppers, ump, mmp, mnt_upper_link); MNT_IUNLOCK(mp); - VFS_RECLAIM_LOWERVP(ump, vp); + switch (event) { + case VFS_NOTIFY_UPPER_RECLAIM: + VFS_RECLAIM_LOWERVP(ump, vp); + break; + case VFS_NOTIFY_UPPER_UNLINK: + VFS_UNLINK_LOWERVP(ump, vp); + break; + default: + KASSERT(0, ("invalid event %d", event)); + break; + } MNT_ILOCK(mp); ump = TAILQ_NEXT(mmp, mnt_upper_link); TAILQ_REMOVE(&mp->mnt_uppers, mmp, mnt_upper_link); @@ -2783,7 +2794,7 @@ vgonel(struct vnode *vp) active = vp->v_usecount; oweinact = (vp->v_iflag & VI_OWEINACT); VI_UNLOCK(vp); - vgonel_reclaim_lowervp(vp); + vfs_notify_upper(vp, VFS_NOTIFY_UPPER_RECLAIM); /* * Clean out any buffers associated with the vnode. -- Test scenario: wip/nullfsx.sh