GENERIC HEAD from 2013-04-20 14:33:55 UTC, r249704M, vmcore.606 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb 4718592K of memory above 4GB ignored Copyright (c) 1992-2013 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #0 r249704M: Sun Apr 21 17:02:35 CEST 2013 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 FreeBSD clang version 3.3 (trunk 178860) 20130405 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 0x10 Model = 0x2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 8589934592 (8192 MB) avail memory = 2062401536 (1966 MB) : Trying to mount root from ufs:/dev/ad4s1a [rw]... Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. warning: total configured swap (4194304 pages) exceeds maximum recommended amount (4085984 pages). warning: increase kern.maxswzone or reduce amount of swap. Starting file system checks: /dev/ad4s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1a: clean, 595767 free (1175 frags, 74324 blocks, 0.1% fragmentation) /dev/ad4s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1f: clean, 185042 free (4330 frags, 22589 blocks, 0.4% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 50995361 free (2329 frags, 6374129 blocks, 0.0% fragmentation) /dev/ad4s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1d: clean, 3656956 free (249996 frags, 425870 blocks, 2.5% fragmentation) /dev/ad4s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1e: clean, 9826494 free (162390 frags, 1208013 blocks, 0.6% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN re0: link state changed to UP Starting Network: lo0 re0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 scopeid 0x1 nd6 options=29 media: Ethernet autoselect (100baseTX ) status: active Starting devd. add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/kde4/lib /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/gcc46 /usr/local/lib/mysql /usr/local/lib/nss /usr/local/lib/pth /usr/local/lib/qt4 /usr/local/lib/virtualbox a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. savecore: couldn't find media and/or sector size of /var/crash: Inappropriate ioctl for device Apr 21 21:57:51 x4 savecore: couldn't find media and/or sector size of /var/crash: Inappropriate ioctl for device No core dumps found. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered lock order reversal: 1st 0xe13ce5d0 bufwait (bufwait) @ kern/vfs_bio.c:3070 2nd 0xc6e65800 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper(c1089b00,c109322c,c1c,c0b0db10,c6c59ee0,...) at db_trace_self_wrapper+0x2d/frame 0xf29df798 kdb_backtrace(c108cd2f,c6e65800,c10beded,c6186268,c10bea32,...) at kdb_backtrace+0x30/frame 0xf29df800 witness_checkorder(c6e65800,9,c10bea29,11c,0,...) at witness_checkorder+0xbaa/frame 0xf29df850 _sx_xlock(c6e65800,0,c10bea29,11c,c6516000,...) at _sx_xlock+0x77/frame 0xf29df880 ufsdirhash_add(c693fd98,f29df978,35e0,f29df900,f29df904,...) at ufsdirhash_add+0x4a/frame 0xf29df8b0 ufs_direnter(c6c59e10,c6c82b40,f29df978,f29dfb64,e13d2224,...) at ufs_direnter+0x63b/frame 0xf29df930 ufs_mkdir(f29dfc00,c10e4343,c10b86f6,c6c59e10,f29dfbfc,...) at ufs_mkdir+0x884/frame 0xf29dfad0 VOP_MKDIR_APV(c11e2d04,f29dfc00,f29dfb64,f29dfb90,28803020,...) at VOP_MKDIR_APV+0x124/frame 0xf29dfb00 kern_mkdirat(c69b6c00,ffffff9c,28803020,0,1c0) at kern_mkdirat+0x1fc/frame 0xf29dfc24 sys_mkdir(c69b6c00,f29dfcc8,14,c1087ced,7b3,...) at sys_mkdir+0x31/frame 0xf29dfc40 syscall(f29dfd08) at syscall+0x2ed/frame 0xf29dfcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf29dfcfc --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x28174ea7, esp = 0xbfbfd92c, ebp = 0xbfbfddd0 --- Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Recovering vi editor sessions:. Updating motd:. Starting ntpd. Removing stale Samba tdb files: ....... done Starting nmbd. Starting smbd. Starting winbindd. Starting default moused. Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Local package initialization: backuplock order reversal: 1st 0xc6c59e44 ufs (ufs) @ kern/vfs_subr.c:2167 2nd 0xe13ce5d0 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:262 3rd 0xc6c778a4 ufs (ufs) @ kern/vfs_subr.c:2167 KDB: stack backtrace: db_trace_self_wrapper(c1089b00,f2a3c770,c69477a8,0,0,...) at db_trace_self_wrapper+0x2d/frame 0xf2a3c6e0 kdb_backtrace(c108cd48,c6c778a4,c1074e5e,c6186200,c1096128,...) at kdb_backtrace+0x30/frame 0xf2a3c748 witness_checkorder(c6c778a4,9,c109611f,877,c6c77910,...) at witness_checkorder+0xbaa/frame 0xf2a3c798 __lockmgr_args(c6c778a4,80100,c6c77910,0,0,...) at __lockmgr_args+0x816/frame 0xf2a3c878 ffs_lock(f2a3c900,6a4,c617f1e0,c6184798,c617f1e0,...) at ffs_lock+0xad/frame 0xf2a3c8b8 VOP_LOCK1_APV(c11e2d04,f2a3c900,0,f2a3c93c,c11f7530,...) at VOP_LOCK1_APV+0x112/frame 0xf2a3c8e8 _vn_lock(c6c77870,80100,c109611f,877,c1095395,...) at _vn_lock+0xca/frame 0xf2a3c928 vget(c6c77870,80100,c728f900,57,0,...) at vget+0x77/frame 0xf2a3c960 vfs_hash_get(c6c5b2ec,9f3400,80000,c728f900,f2a3ca40,...) at vfs_hash_get+0xff/frame 0xf2a3c98c ffs_vgetf(c6c5b2ec,9f3400,80000,f2a3ca40,1,...) at ffs_vgetf+0x47/frame 0xf2a3c9e8 softdep_sync_buf(c6c59e10,e13ce570,1,108,0,...) at softdep_sync_buf+0x2ea/frame 0xf2a3ca50 ffs_syncvnode(c6c59e10,1,0,619,0,...) at ffs_syncvnode+0x2a3/frame 0xf2a3caa8 ffs_sync(c6c5b2ec,1,f2a3cb68,50f,c1bded14,...) at ffs_sync+0x23e/frame 0xf2a3cb30 dounmount(c6c5b2ec,8080000,c728f900,493,c0ace8d5,...) at dounmount+0x43c/frame 0xf2a3cb90 sys_unmount(c728f900,f2a3ccc8,c10dd55f,d6,0,...) at sys_unmount+0x3cd/frame 0xf2a3cc40 syscall(f2a3cd08) at syscall+0x2ed/frame 0xf2a3ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2a3ccfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c195b, esp = 0xbfbfd6a4, ebp = 0xbfbfd770 --- lock order reversal: 1st 0xc6c58a0c ufs (ufs) @ kern/vfs_mount.c:1236 2nd 0xc697d034 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1866 KDB: stack backtrace: db_trace_self_wrapper(c1089b00,0,33,c1074e5e,67e,...) at db_trace_self_wrapper+0x2d/frame 0xf2a3c830 kdb_backtrace(c108cd2f,c697d034,c1080b45,c6186060,c10bb117,...) at kdb_backtrace+0x30/frame 0xf2a3c898 witness_checkorder(c697d034,9,c10bb10e,74a,c697d0a0,...) at witness_checkorder+0xbaa/frame 0xf2a3c8e8 __lockmgr_args(c697d034,80400,c697d0a0,0,0,0,c10bb10e,74a) at __lockmgr_args+0x816/frame 0xf2a3c9c8 vop_stdlock(f2a3ca40,632,4,f2a3ca3c,c0a72a27,...) at vop_stdlock+0x53/frame 0xf2a3c9f8 VOP_LOCK1_APV(c11a860c,f2a3ca40,4,f2a3ca68,c11f7530,...) at VOP_LOCK1_APV+0x112/frame 0xf2a3ca28 _vn_lock(c697d000,80400,c10bb10e,74a,f2a3caa8,...) at _vn_lock+0xca/frame 0xf2a3ca68 softdep_flushworklist(c6c5b2ec,f2a3cafc,c728f900,62d,0,...) at softdep_flushworklist+0x6e/frame 0xf2a3caa8 ffs_sync(c6c5b2ec,1,f2a3cb68,50f,c1bded14,...) at ffs_sync+0x2e5/frame 0xf2a3cb30 dounmount(c6c5b2ec,8080000,c728f900,493,c0ace8d5,...) at dounmount+0x43c/frame 0xf2a3cb90 sys_unmount(c728f900,f2a3ccc8,c10dd55f,d6,0,...) at sys_unmount+0x3cd/frame 0xf2a3cc40 syscall(f2a3cd08) at syscall+0x2ed/frame 0xf2a3ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2a3ccfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c195b, esp = 0xbfbfd6a4, ebp = 0xbfbfd770 --- ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 113512 files, 67318620 used, 50995361 free (2329 frags, 6374129 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes Apr 21 22:00:09 x4 su: pho to root on /dev/pts/0 ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 113512 files, 67318620 used, 50995361 free (2329 frags, 6374129 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmp watchdogd. Starting inetd. Sun Apr 21 22:01:59 CEST 2013 FreeBSD/i386 (x4.osted.lan) (console) login: 20130421 22:02:00 all (1/1): sendfile5.sh lock order reversal: 1st 0xc6c5973c syncer (syncer) @ kern/vfs_subr.c:1786 2nd 0xc709373c ufs (ufs) @ kern/vfs_subr.c:2167 KDB: stack backtrace: db_trace_self_wrapper(c1089b00,246,b1,c137d4c8,c11b853c,...) at db_trace_self_wrapper+0x2d/frame 0xee1d9930 kdb_backtrace(c108cd2f,c709373c,c1074e5e,c6186200,c1096128,...) at kdb_backtrace+0x30/frame 0xee1d9998 witness_checkorder(c709373c,9,c109611f,877,c70937a8,...) at witness_checkorder+0xbaa/frame 0xee1d99e8 __lockmgr_args(c709373c,80500,c70937a8,0,0,...) at __lockmgr_args+0x816/frame 0xee1d9ac8 ffs_lock(ee1d9b50,0,c61845f8,246,c61845f8,...) at ffs_lock+0xad/frame 0xee1d9b08 VOP_LOCK1_APV(c11e2d04,ee1d9b50,246,c13a8c5c,c11f7530,...) at VOP_LOCK1_APV+0x112/frame 0xee1d9b38 _vn_lock(c7093708,80500,c109611f,877,c13a8c6c,...) at _vn_lock+0xca/frame 0xee1d9b78 vget(c7093708,80500,c6546300,12b2,c68e7bc0,...) at vget+0x77/frame 0xee1d9bb0 vfs_msync(c68e7bb0,2,2,e71,c68e7bb0,...) at vfs_msync+0xa0/frame 0xee1d9bf8 sync_fsync(ee1d9ca8,c10e421e,80400,c109611f,6fa,...) at sync_fsync+0x12e/frame 0xee1d9c20 VOP_FSYNC_APV(c11c3024,ee1d9ca8,c109611f,6fa,0,...) at VOP_FSYNC_APV+0x124/frame 0xee1d9c50 sched_sync(0,ee1d9d08,c107f270,3d7,0,...) at sched_sync+0x38f/frame 0xee1d9ccc fork_exit(c0b31610,0,ee1d9d08) at fork_exit+0x7f/frame 0xee1d9cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee1d9cf4 --- trap 0, eip = 0, esp = 0xee1d9d40, ebp = 0 --- interrupt total irq1: atkbd0 2 Expensive timeout(9) function: 0xc08ca550(0xc13c0de8) 0.010964981 s irq4: uart0 526 irq6: fdc0 1 irq9: acpi0 1 irq14: ata0 1568 irq16: hdac1 ohci0 126 irq17: ohci1 ohci3 3 irq18: ohci2 ohci4 3 irq22: ahci0 275061 cpu0:timer 85235 irq256: hdac0 4 irq257: re0 5566 cpu3:timer 139385 cpu2:timer 53848 cpu1:timer 72254 Total 633585 KDB: stack backtrace: db_trace_self_wrapper(c1089b00,0,0,0,0,...) at db_trace_self_wrapper+0x2d/frame 0xc5ff59f8 kdb_backtrace(c107ccea,9aaf1,0,0,9aaf1,...) at kdb_backtrace+0x30/frame 0xc5ff5a60 watchdog_fire(2f,0,c107cc4d,222,40c320,...) at watchdog_fire+0x9c/frame 0xc5ff5a88 hardclock_cnt(97,0,c10dea67,ef,c5ff5b9c,...) at hardclock_cnt+0x2c2/frame 0xc5ff5adc handleevents(0,0,c62cc600,c6374600,c123e600,...) at handleevents+0xec/frame 0xc5ff5b20 timercb(c13c2da8,0,1,1,c648021c,...) at timercb+0x267/frame 0xc5ff5b70 lapic_handle_timer(c5ff5b9c) at lapic_handle_timer+0x89/frame 0xc5ff5b90 Xtimerint() at Xtimerint+0x20/frame 0xc5ff5b90 --- interrupt, eip = 0xc0e8fb35, esp = 0xc5ff5bdc, ebp = 0xc5ff5bdc --- acpi_cpu_c1(c0eb2eeb,c5fe2c90,0,c10dea67,303,...) at acpi_cpu_c1+0x5/frame 0xc5ff5bdc acpi_cpu_idle(26a63a7f,0,26a63a7f,c5ff5c50,c0e99c8a,...) at acpi_cpu_idle+0x146/frame 0xc5ff5c20 cpu_idle_acpi(26a63a7f,0,1,c123e688,c123e696,...) at cpu_idle_acpi+0x3f/frame 0xc5ff5c34 cpu_idle(0,2,c1087ced,a46,c123e688,...) at cpu_idle+0x9a/frame 0xc5ff5c50 sched_idletd(0,c5ff5d08,c107f270,3d7,0,...) at sched_idletd+0x1d6/frame 0xc5ff5ccc fork_exit(c0aaeb60,0,c5ff5d08) at fork_exit+0x7f/frame 0xc5ff5cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc5ff5cf4 --- trap 0, eip = 0, esp = 0xc5ff5d40, ebp = 0 --- KDB: enter: watchdog timeout [ thread pid 11 tid 100004 ] Stopped at kdb_enter+0x3d: movl $0,kdb_why db> run pho db:0:pho> bt Tracing pid 11 tid 100004 td 0xc62cc600 kdb_enter(c0f10c56,c10070bc,0,0,9aaf1) at kdb_enter+0x3d/frame 0xc5ff5a60 watchdog_fire(2f,0,c107cc4d,222,40c320,...) at watchdog_fire+0xb0/frame 0xc5ff5a88 hardclock_cnt(97,0,c10dea67,ef,c5ff5b9c,...) at hardclock_cnt+0x2c2/frame 0xc5ff5adc handleevents(0,0,c62cc600,c6374600,c123e600,...) at handleevents+0xec/frame 0xc5ff5b20 timercb(c13c2da8,0,1,1,c648021c,...) at timercb+0x267/frame 0xc5ff5b70 lapic_handle_timer(c5ff5b9c) at lapic_handle_timer+0x89/frame 0xc5ff5b90 Xtimerint() at Xtimerint+0x20/frame 0xc5ff5b90 --- interrupt, eip = 0xc0e8fb35, esp = 0xc5ff5bdc, ebp = 0xc5ff5bdc --- acpi_cpu_c1(c0eb2eeb,c5fe2c90,0,c10dea67,303,...) at acpi_cpu_c1+0x5/frame 0xc5ff5bdc acpi_cpu_idle(26a63a7f,0,26a63a7f,c5ff5c50,c0e99c8a,...) at acpi_cpu_idle+0x146/frame 0xc5ff5c20 cpu_idle_acpi(26a63a7f,0,1,c123e688,c123e696,...) at cpu_idle_acpi+0x3f/frame 0xc5ff5c34 cpu_idle(0,2,c1087ced,a46,c123e688,...) at cpu_idle+0x9a/frame 0xc5ff5c50 sched_idletd(0,c5ff5d08,c107f270,3d7,0,...) at sched_idletd+0x1d6/frame 0xc5ff5ccc fork_exit(c0aaeb60,0,c5ff5d08) at fork_exit+0x7f/frame 0xc5ff5cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc5ff5cf4 --- trap 0, eip = 0, esp = 0xc5ff5d40, ebp = 0 --- db:0:bt> show allpcpu Current CPU: 1 cpuid = 0 dynamic pcpu = 0x628500 curthread = 0xc6374c00: pid 13 "g_up" curpcb = 0xe1602d60 fpcurthread = none idlethread = 0xc62cc900: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x4de5500 curthread = 0xc62cc600: pid 11 "idle: cpu1" curpcb = 0xc5ff5d60 fpcurthread = none idlethread = 0xc62cc600: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x4de8500 curthread = 0xc62cc300: pid 11 "idle: cpu2" curpcb = 0xc5ff8d60 fpcurthread = none idlethread = 0xc62cc300: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x4deb500 curthread = 0xc62cc000: pid 11 "idle: cpu3" curpcb = 0xc5ffbd60 fpcurthread = none idlethread = 0xc62cc000: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks Process 1095 (ls) thread 0xc6958900 (100125) exclusive lockmgr tmpfs (tmpfs) r = 0 (0xc7b8e19c) locked @ kern/vfs_lookup.c:517 Process 1093 (sendfile5) thread 0xc69c5600 (100094) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xc6d7e3cc) locked @ kern/uipc_sockbuf.c:148 Process 1092 (sendfile5) thread 0xc6958300 (100131) exclusive lockmgr tmpfs (tmpfs) r = 0 (0xc7b8de44) locked @ kern/uipc_syscalls.c:2107 exclusive sx so_snd_sx (so_snd_sx) r = 0 (0xc6d7e940) locked @ kern/uipc_sockbuf.c:145 Process 523 (syslogd) thread 0xc6960000 (100081) exclusive lockmgr ufs (ufs) r = 0 (0xc706e8a4) locked @ kern/vfs_syscalls.c:3472 db:0:alllocks> show lockedvnods Locked vnodes 0xc706e870: tag ufs, type VREG usecount 2, writecount 1, refcount 4 mountedhere 0 flags (VI_ACTIVE) v_object 0xc75d81bc ref 0 pages 2 lock type ufs: EXCL by thread 0xc6960000 (pid 523, syslogd, tid 100081) with shared waiters pending #0 0xc0a6a22f at __lockmgr_args+0x10af #1 0xc0cedfbd at ffs_lock+0xad #2 0xc0ed14c2 at VOP_LOCK1_APV+0x112 #3 0xc0b3cb8a at _vn_lock+0xca #4 0xc0b39171 at sys_fsync+0xd1 #5 0xc0eab54d at syscall+0x2ed #6 0xc0e93ac1 at Xint0x80_syscall+0x21 ino 6052894, on dev ada0s1e 0xc7b8e168: tag tmpfs, type VDIR usecount 3, writecount 0, refcount 4 mountedhere 0 flags (VV_ROOT|VI_ACTIVE) v_object 0xc7b6dcb8 ref 0 pages 0 lock type tmpfs: EXCL by thread 0xc6958900 (pid 1095, ls, tid 100125) #0 0xc0a6a22f at __lockmgr_args+0x10af #1 0xc0b19fb3 at vop_stdlock+0x53 #2 0xc0ed14c2 at VOP_LOCK1_APV+0x112 #3 0xc0b3cb8a at _vn_lock+0xca #4 0xc0b1f369 at lookup+0xf9 #5 0xc0b1ee8d at namei+0x47d #6 0xc0b36dc2 at kern_statat_vnhook+0xc2 #7 0xc0b36fa9 at sys_lstat+0x59 #8 0xc0eab54d at syscall+0x2ed #9 0xc0e93ac1 at Xint0x80_syscall+0x21 tag VT_TMPFS, tmpfs_node 0xc8478000, flags 0x0, links 2 mode 0755, owner 0, group 0, size 36, status 0x2 0xc7b8de10: tag tmpfs, type VREG usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xc7b55818 ref 2 pages 168750 lock type tmpfs: EXCL by thread 0xc6958300 (pid 1092, sendfile5, tid 100131) with exclusive waiters pending #0 0xc0a6a22f at __lockmgr_args+0x10af #1 0xc0b19fb3 at vop_stdlock+0x53 #2 0xc0ed14c2 at VOP_LOCK1_APV+0x112 #3 0xc0b3cb8a at _vn_lock+0xca #4 0xc0b05677 at kern_sendfile+0x6f7 #5 0xc0b04ed7 at do_sendfile+0xb7 #6 0xc0b04e16 at sys_sendfile+0x16 #7 0xc0eab54d at syscall+0x2ed #8 0xc0e93ac1 at Xint0x80_syscall+0x21 tag VT_TMPFS, tmpfs_node 0xc8477ee0, flags 0x0, links 1 mode 0644, owner 0, group 0, size 1073741824, status 0x2 db:0:lockedvnods> show mount 0xc68e6bb0 /dev/ad4s1a on / (ufs) 0xc68e7000 devfs on /dev (devfs) 0xc6c5b5d8 /dev/ad4s1f on /home (ufs) 0xc6c5b000 /dev/ad4s1d on /usr (ufs) 0xc68e7bb0 /dev/ad4s1e on /var (ufs) 0xc68e78c4 procfs on /proc (procfs) 0xc68e75d8 /dev/label/tmp on /tmp (ufs) 0xc8474000 tmpfs on /mnt (tmpfs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 3515 1110 1108 1001 S nanslp 0xc1231d08 sleep 1111 1108 1108 1001 S piperd 0xc7b83cc0 awk 1110 1108 1108 1001 S wait 0xc64d58b8 sh 1109 1104 1109 1001 Ss+ select 0xc6c716e4 top 1108 1105 1108 1001 Ss wait 0xc7acd8b8 sh 1107 1106 1107 1001 Ds ufs 0xc706e8a4 tail 1106 1098 1098 1001 S select 0xc6494d24 sshd 1105 1100 1100 1001 S select 0xc6c71564 sshd 1104 1099 1099 1001 S select 0xc64934e4 sshd 1100 723 1100 0 Ss select 0xc72659e4 sshd 1099 723 1099 0 Ss select 0xc6494ce4 sshd 1098 723 1098 0 Ss select 0xc64934a4 sshd 1095 1094 902 0 D tmpfs 0xc7b8de44 ls 1094 902 902 0 S wait 0xc7b59000 sh 1093 1092 815 0 S+ sbwait 0xc6d7e3f8 sendfile5 1092 1071 815 0 D+ pgrbwt 0xc3b54a40 sendfile5 1071 815 815 0 SW+ wait 0xc7a2c5d0 sh 951 1 951 0 Ss+ ttyin 0xc6531270 getty 950 1 950 0 Ss+ ttyin 0xc6531470 getty 949 1 949 0 Ss+ ttyin 0xc6389070 getty 948 1 948 0 Ss+ ttyin 0xc6389270 getty 947 1 947 0 Ss+ ttyin 0xc6389470 getty 946 1 946 0 Ss+ ttyin 0xc6389670 getty 945 1 945 0 Ss+ ttyin 0xc6389870 getty 944 1 944 0 Ss+ ttyin 0xc6389a70 getty 943 1 943 0 Ss+ ttyin 0xc6389c70 getty 926 1 926 0 Ss select 0xc6493824 inetd 902 1 902 0 Ss wait 0xc7a2cba0 watchdogd 815 811 815 0 SW+ wait 0xc72672e8 sh 811 808 811 0 SW+ wait 0xc69bd2e8 bash 808 807 808 0 SW+ pause 0xc69bd634 csh 807 800 807 1001 SW+ wait 0xc726b8b8 su 800 799 800 1001 SWs+ wait 0xc6c9d8b8 bash 799 797 797 1001 S select 0xc64948a4 sshd 797 723 797 0 Ss select 0xc64937a4 sshd 734 1 734 0 Ss nanslp 0xc1231d08 cron 729 1 729 25 Ss pause 0xc691634c sendmail 726 1 726 0 Ss select 0xc6c717a4 sendmail 723 1 723 0 Ss select 0xc6494aa4 sshd 714 671 671 0 S select 0xc6494a24 smbd 689 1 689 0 Ss select 0xc6494b64 moused 688 673 673 0 S select 0xc64949a4 winbindd 673 1 673 0 Ss select 0xc64949e4 winbindd 671 1 671 0 Ss select 0xc6c717e4 smbd 669 1 669 0 Ss select 0xc6493724 nmbd 645 1 645 0 Ss select 0xc64937e4 ntpd 589 584 584 0 S (threaded) nfsd 100123 S rpcsvc 0xc694b790 nfsd: service 100122 S rpcsvc 0xc694b7d0 nfsd: service 100121 S rpcsvc 0xc694b810 nfsd: service 100114 S rpcsvc 0xc6465ad0 nfsd: master 584 1 584 0 Ss select 0xc6493864 nfsd 578 1 578 0 Ss select 0xc6c71824 mountd 571 567 567 0 S select 0xc64932e4 nfsuserd 570 567 567 0 S select 0xc6494924 nfsuserd 569 567 567 0 S select 0xc6493b64 nfsuserd 568 567 567 0 S select 0xc64948e4 nfsuserd 567 1 567 0 SWs pause 0xc6c9cc04 nfsuserd 538 1 538 0 Ss select 0xc64933a4 rpcbind 523 1 523 0 Ds getbuf 0xe1510700 syslogd 420 1 420 0 Ss select 0xc6493a24 devd 17 0 0 0 DL sdflush 0xc13ad214 [softdepflush] 16 0 0 0 DL syncer 0xc13a8ca4 [syncer] 9 0 0 0 DL vlruwt 0xc6802ba0 [vnlru] 8 0 0 0 DL psleep 0xc13a8a1c [bufdaemon] 7 0 0 0 DL pgzero 0xc13adb14 [pagezero] 6 0 0 0 DL psleep 0xc13ad6dc [vmdaemon] 5 0 0 0 DL psleep 0xc1401d04 [pagedaemon] 4 0 0 0 DL ccb_scan 0xc11fd824 [xpt_thrd] 3 0 0 0 DL waiting_ 0xc13fd6d8 [sctp_iterator] 2 0 0 0 DL - 0xc6481e3c [fdc0] 15 0 0 0 RL (threaded) [usb] 100058 D - 0xc64f8d34 [usbus5] 100057 RunQ [usbus5] 100056 D - 0xc64f8cd4 [usbus5] 100055 D - 0xc64f8ca4 [usbus5] 100053 D - 0xc64e9b5c [usbus4] 100052 D - 0xc64e9b2c [usbus4] 100051 D - 0xc64e9afc [usbus4] 100050 D - 0xc64e9acc [usbus4] 100049 D - 0xc64e3b5c [usbus3] 100048 D - 0xc64e3b2c [usbus3] 100047 D - 0xc64e3afc [usbus3] 100046 D - 0xc64e3acc [usbus3] 100045 D - 0xc64dbb5c [usbus2] 100044 D - 0xc64dbb2c [usbus2] 100043 D - 0xc64dbafc [usbus2] 100042 D - 0xc64dbacc [usbus2] 100040 D - 0xc64d7b5c [usbus1] 100039 D - 0xc64d7b2c [usbus1] 100038 D - 0xc64d7afc [usbus1] 100037 D - 0xc64d7acc [usbus1] 100035 D - 0xc64cdb5c [usbus0] 100034 D - 0xc64cdb2c [usbus0] 100033 D - 0xc64cdafc [usbus0] 100032 D - 0xc64cdacc [usbus0] 14 0 0 0 DL - 0xc1217984 [yarrow] 13 0 0 0 RL (threaded) [geom] 100016 D - 0xc13f92e0 [g_down] 100015 Run CPU 0 [g_up] 100014 D - 0xc13f92d8 [g_event] 12 0 0 0 WL (threaded) [intr] 100063 I [irq12: psm0] 100062 I [irq1: atkbd0] 100060 I [swi0: uart] 100059 I [irq14: ata0] 100054 I [irq19: ehci0] 100041 I [irq18: ohci2 ohci4] 100036 I [irq17: ohci1 ohci3] 100031 I [irq16: hdac1 ohci0] 100030 I [irq22: ahci0] 100029 I [irq257: re0] 100028 I [irq256: hdac0] 100027 I [swi6: task queue] 100025 I [swi2: cambio] 100020 I [swi5: fast taskq] 100018 I [swi6: Giant taskq] 100012 I [swi3: vm] 100011 I [swi1: netisr 0] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 I [swi4: clock] 100007 I [swi4: clock] 11 0 0 0 RL (threaded) [idle] 100006 Run CPU 3 [idle: cpu3] 100005 Run CPU 2 [idle: cpu2] 100004 Run CPU 1 [idle: cpu1] 100003 CanRun [idle: cpu0] 1 0 1 0 SLs wait 0xc62caba0 [init] 10 0 0 0 DL audit_wo 0xc14007e4 [audit] 0 0 0 0 DLs (threaded) [kernel] 100065 D - 0xc1230c01 [deadlkres] 100064 D - 0xc6371400 [mca taskq] 100026 D - 0xc6371c00 [ffs_trim taskq] 100024 D - 0xc6371c80 [kqueue taskq] 100023 D - 0xc6371d00 [acpi_task_2] 100022 D - 0xc6371d00 [acpi_task_1] 100021 D - 0xc6371d00 [acpi_task_0] 100019 D - 0xc6371e00 [thread taskq] 100013 D - 0xc6372000 [firmware taskq] 100000 D sched 0xc13f9364 [swapper] db:0:ps> allt Tracing command sleep pid 3515 tid 100196 td 0xc728d600 sched_switch(c728d600,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf2b50a64 mi_switch(104,0,c108b461,1f5,c0ac9db0,...) at mi_switch+0x1c9/frame 0xf2b50a98 sleepq_switch(c728d600,0,c108b461,1ab,8,...) at sleepq_switch+0x1b9/frame 0xf2b50acc sleepq_catch_signals(c0ac9db0,c728d600,0,201,0,...) at sleepq_catch_signals+0x361/frame 0xf2b50b14 sleepq_timedwait_sig(c1231d08,6c,90d,a0000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf2b50b3c _sleep(c1231d08,0,16c,c1086dda,36e00fdc,...) at _sleep+0x331/frame 0xf2b50b98 kern_nanosleep(bfbfdce0,f2b50c18,f2b50c20,2,a,...) at kern_nanosleep+0x158/frame 0xf2b50c00 sys_nanosleep(c728d600,f2b50cc8,c10dd55f,d6,0,...) at sys_nanosleep+0x6b/frame 0xf2b50c40 syscall(f2b50d08) at syscall+0x2ed/frame 0xf2b50cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2b50cfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28164173, esp = 0xbfbfdcac, ebp = 0xbfbfdcf4 --- Tracing command awk pid 1111 tid 100129 td 0xc728f900 sched_switch(c728f900,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf2a3ca1c mi_switch(104,0,c108b461,1f5,c108b461,...) at mi_switch+0x1c9/frame 0xf2a3ca50 sleepq_switch(c728f900,0,c108b461,1ab,f2a3cac8,...) at sleepq_switch+0x1b9/frame 0xf2a3ca84 sleepq_catch_signals(0,c108b461,162,17a0,c728f900,...) at sleepq_catch_signals+0x361/frame 0xf2a3cacc sleepq_wait_sig(c7b83cc0,5c,c108e3ea,100,0,...) at sleepq_wait_sig+0x14/frame 0xf2a3caf0 _sleep(c7b83cc0,c7b83e40,15c,c108e3ea,0,...) at _sleep+0x35b/frame 0xf2a3cb4c pipe_read(c692c9d8,f2a3cc10,c6761d80,0,c728f900,...) at pipe_read+0x2dc/frame 0xf2a3cb90 dofileread(c692c9d8,f2a3cc10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf2a3cbc4 kern_readv(c728f900,0,f2a3cc10,0,28855000,...) at kern_readv+0x66/frame 0xf2a3cbf0 sys_read(c728f900,f2a3ccc8,c0eb1e30,c1825c90,0,...) at sys_read+0x5c/frame 0xf2a3cc40 syscall(f2a3cd08) at syscall+0x2ed/frame 0xf2a3ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2a3ccfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281c1fc7, esp = 0xbfbfd9e0, ebp = 0xbfbfd9f4 --- Tracing command sh pid 1110 tid 100097 td 0xc69b7c00 sched_switch(c69b7c00,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf297998c mi_switch(104,0,c108b461,1f5,c108b461,...) at mi_switch+0x1c9/frame 0xf29799c0 sleepq_switch(c69b7c00,0,c108b461,1ab,f2979a38,...) at sleepq_switch+0x1b9/frame 0xf29799f4 sleepq_catch_signals(0,c108b461,162,1500,c69b7c00,...) at sleepq_catch_signals+0x361/frame 0xf2979a3c sleepq_wait_sig(c64d58b8,6c,c108e8d9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf2979a60 _sleep(c64d58b8,c64d594c,16c,c108e8d9,0,...) at _sleep+0x35b/frame 0xf2979abc kern_wait6(c69b7c00,7,0,0,f2979b4c,...) at kern_wait6+0x45c/frame 0xf2979b20 sys_wait4(c69b7c00,f2979cc8,c10dd55f,e9,0,...) at sys_wait4+0x94/frame 0xf2979c40 syscall(f2979d08) at syscall+0x2ed/frame 0xf2979cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2979cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd938, ebp = 0xbfbfd950 --- Tracing command top pid 1109 tid 100136 td 0xc728f000 sched_switch(c728f000,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf2a51900 mi_switch(104,0,c108b461,1f5,400,...) at mi_switch+0x1c9/frame 0xf2a51934 sleepq_switch(c728f000,0,c108b461,1ab,c6c716d0,...) at sleepq_switch+0x1b9/frame 0xf2a51968 sleepq_catch_signals(c11b853c,f2a519d8,c0a723a9,c6c716e0,0,...) at sleepq_catch_signals+0x361/frame 0xf2a519b0 sleepq_timedwait_sig(c6c716e4,0,f2a51a10,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf2a519d8 _cv_timedwait_sig_sbt(c6c716e4,c6c716d0,a471bcaf,906,10000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf2a51a24 seltdwait(906,10000000,0,c728f000,0,...) at seltdwait+0xbc/frame 0xf2a51a58 kern_select(c728f000,2,bfbfdbe8,0,0,...) at kern_select+0x88c/frame 0xf2a51bf8 sys_select(c728f000,f2a51cc8,c0eb1e30,c5fe5c90,0,...) at sys_select+0x69/frame 0xf2a51c40 syscall(f2a51d08) at syscall+0x2ed/frame 0xf2a51cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2a51cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281f3f87, esp = 0xbfbfdb8c, ebp = 0xbfbfdcf4 --- Tracing command sh pid 1108 tid 100167 td 0xc6c62c00 sched_switch(c6c62c00,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf2aae98c mi_switch(104,0,c108b461,1f5,c108b461,...) at mi_switch+0x1c9/frame 0xf2aae9c0 sleepq_switch(c6c62c00,0,c108b461,1ab,f2aaea38,...) at sleepq_switch+0x1b9/frame 0xf2aae9f4 sleepq_catch_signals(0,c108b461,162,900,c6c62c00,...) at sleepq_catch_signals+0x361/frame 0xf2aaea3c sleepq_wait_sig(c7acd8b8,6c,c108e8d9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf2aaea60 _sleep(c7acd8b8,c7acd94c,16c,c108e8d9,0,...) at _sleep+0x35b/frame 0xf2aaeabc kern_wait6(c6c62c00,7,0,0,f2aaeb4c,...) at kern_wait6+0x45c/frame 0xf2aaeb20 sys_wait4(c6c62c00,f2aaecc8,c0eb1e30,c5fe8c90,0,...) at sys_wait4+0x94/frame 0xf2aaec40 syscall(f2aaed08) at syscall+0x2ed/frame 0xf2aaecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2aaecfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfdb20, ebp = 0xbfbfdb38 --- Tracing command tail pid 1107 tid 100156 td 0xc7aaec00 sched_switch(c7aaec00,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf2a8d7dc mi_switch(104,0,c108b461,1f5,162,...) at mi_switch+0x1c9/frame 0xf2a8d810 sleepq_switch(c7aaec00,0,c108b461,26b,60,...) at sleepq_switch+0x1b9/frame 0xf2a8d844 sleepq_wait(c706e8a4,60,c1074e5e,4,1,...) at sleepq_wait+0x48/frame 0xf2a8d868 sleeplk(c706e910,c1074e5e,60,33,1,...) at sleeplk+0x126/frame 0xf2a8d8b0 __lockmgr_args(c706e8a4,200400,c706e910,0,0,...) at __lockmgr_args+0x60b/frame 0xf2a8d990 ffs_lock(f2a8da18,c0a7312b,c124d880,8,c108b461,...) at ffs_lock+0xad/frame 0xf2a8d9d0 VOP_LOCK1_APV(c11e2d04,f2a8da18,c137bec8,c11b853c,c11f7530,...) at VOP_LOCK1_APV+0x112/frame 0xf2a8da00 _vn_lock(c706e870,200400,c1097ab8,2b8,f2a8da94,...) at _vn_lock+0xca/frame 0xf2a8da40 vn_read(c70103f0,f2a8dc10,c6880e80,1,c7aaec00,...) at vn_read+0x14c/frame 0xf2a8dab0 vn_io_fault(c70103f0,f2a8dc10,c6880e80,0,c7aaec00,...) at vn_io_fault+0x24b/frame 0xf2a8db90 dofileread(c70103f0,f2a8dc10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf2a8dbc4 kern_readv(c7aaec00,3,f2a8dc10,0,28806000,...) at kern_readv+0x66/frame 0xf2a8dbf0 sys_read(c7aaec00,f2a8dcc8,14,c1087ced,7b3,...) at sys_read+0x5c/frame 0xf2a8dc40 syscall(f2a8dd08) at syscall+0x2ed/frame 0xf2a8dcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2a8dcfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28189fc7, esp = 0xbfbfdb0c, ebp = 0xbfbfdb20 --- Tracing command sshd pid 1106 tid 100135 td 0xc75b2900 sched_switch(c75b2900,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf2a4e90c mi_switch(104,0,c108b461,1f5,200046,...) at mi_switch+0x1c9/frame 0xf2a4e940 sleepq_switch(c75b2900,0,c108b461,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf2a4e974 sleepq_catch_signals(f2a4e9e0,c0a723a9,c6494d20,0,0,...) at sleepq_catch_signals+0x361/frame 0xf2a4e9bc sleepq_wait_sig(c6494d24,0,f2a4ea10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf2a4e9e0 _cv_wait_sig(c6494d24,c6494d10,c108e1a5,68e,5be,...) at _cv_wait_sig+0x200/frame 0xf2a4ea24 seltdwait(ffffffff,0,0,c75b2900,0,...) at seltdwait+0x90/frame 0xf2a4ea58 kern_select(c75b2900,c,28c0c1c8,28c0c1d0,0,...) at kern_select+0x88c/frame 0xf2a4ebf8 sys_select(c75b2900,f2a4ecc8,c10dd55f,d6,0,...) at sys_select+0x69/frame 0xf2a4ec40 syscall(f2a4ed08) at syscall+0x2ed/frame 0xf2a4ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2a4ecfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2852ef87, esp = 0xbfbfd374, ebp = 0xbfbfd3c0 --- Tracing command sshd pid 1105 tid 100155 td 0xc69b9300 sched_switch(c69b9300,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf2a8a90c mi_switch(104,0,c108b461,1f5,200046,...) at mi_switch+0x1c9/frame 0xf2a8a940 sleepq_switch(c69b9300,0,c108b461,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf2a8a974 sleepq_catch_signals(f2a8a9e0,c0a723a9,c6c71560,0,0,...) at sleepq_catch_signals+0x361/frame 0xf2a8a9bc sleepq_wait_sig(c6c71564,0,f2a8aa10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf2a8a9e0 _cv_wait_sig(c6c71564,c6c71550,c108e1a5,68e,5be,...) at _cv_wait_sig+0x200/frame 0xf2a8aa24 seltdwait(ffffffff,0,0,c69b9300,0,...) at seltdwait+0x90/frame 0xf2a8aa58 kern_select(c69b9300,c,28c0c1c8,28c0c1d0,0,...) at kern_select+0x88c/frame 0xf2a8abf8 sys_select(c69b9300,f2a8acc8,8,c1085dcc,db,...) at sys_select+0x69/frame 0xf2a8ac40 syscall(f2a8ad08) at syscall+0x2ed/frame 0xf2a8acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2a8acfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2852ef87, esp = 0xbfbfd374, ebp = 0xbfbfd3c0 --- Tracing command sshd pid 1104 tid 100168 td 0xc6c62900 sched_switch(c6c62900,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf2ab190c mi_switch(104,0,c108b461,1f5,200046,...) at mi_switch+0x1c9/frame 0xf2ab1940 sleepq_switch(c6c62900,0,c108b461,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf2ab1974 sleepq_catch_signals(f2ab19e0,c0a723a9,c64934e0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf2ab19bc sleepq_wait_sig(c64934e4,0,f2ab1a10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf2ab19e0 _cv_wait_sig(c64934e4,c64934d0,c108e1a5,68e,1b2,...) at _cv_wait_sig+0x200/frame 0xf2ab1a24 seltdwait(ffffffff,0,0,c6c62900,0,...) at seltdwait+0x90/frame 0xf2ab1a58 kern_select(c6c62900,a,28c0c1c8,28c0c1d0,0,...) at kern_select+0x88c/frame 0xf2ab1bf8 sys_select(c6c62900,f2ab1cc8,c0eb1e30,c5fe8c90,0,...) at sys_select+0x69/frame 0xf2ab1c40 syscall(f2ab1d08) at syscall+0x2ed/frame 0xf2ab1cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2ab1cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2852ef87, esp = 0xbfbfd374, ebp = 0xbfbfd3c0 --- Tracing command sshd pid 1100 tid 100145 td 0xc6c63900 sched_switch(c6c63900,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf2a6c984 mi_switch(104,0,c108b461,1f5,200046,...) at mi_switch+0x1c9/frame 0xf2a6c9b8 sleepq_switch(c6c63900,0,c108b461,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf2a6c9ec sleepq_catch_signals(f2a6ca58,c0a723a9,c72659e0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf2a6ca34 sleepq_wait_sig(c72659e4,0,f2a6ca88,101,0,...) at sleepq_wait_sig+0x14/frame 0xf2a6ca58 _cv_wait_sig(c72659e4,c72659d0,c108e1a5,68e,5c3,...) at _cv_wait_sig+0x200/frame 0xf2a6ca9c seltdwait(ffffffff,0,0,c6c63900,0,...) at seltdwait+0x90/frame 0xf2a6cad0 sys_poll(c6c63900,f2a6ccc8,8,c1085dcc,db,...) at sys_poll+0x44c/frame 0xf2a6cc40 syscall(f2a6cd08) at syscall+0x2ed/frame 0xf2a6ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2a6ccfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284c52df, esp = 0xbfbfd3bc, ebp = 0xbfbfd408 --- Tracing command sshd pid 1099 tid 100153 td 0xc69b9900 sched_switch(c69b9900,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf2a84984 mi_switch(104,0,c108b461,1f5,200046,...) at mi_switch+0x1c9/frame 0xf2a849b8 sleepq_switch(c69b9900,0,c108b461,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf2a849ec sleepq_catch_signals(f2a84a58,c0a723a9,c6494ce0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf2a84a34 sleepq_wait_sig(c6494ce4,0,f2a84a88,101,0,...) at sleepq_wait_sig+0x14/frame 0xf2a84a58 _cv_wait_sig(c6494ce4,c6494cd0,c108e1a5,68e,5c3,...) at _cv_wait_sig+0x200/frame 0xf2a84a9c seltdwait(ffffffff,0,0,c69b9900,0,...) at seltdwait+0x90/frame 0xf2a84ad0 sys_poll(c69b9900,f2a84cc8,c0eb1e30,c5fe2c90,0,...) at sys_poll+0x44c/frame 0xf2a84c40 syscall(f2a84d08) at syscall+0x2ed/frame 0xf2a84cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2a84cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284c52df, esp = 0xbfbfd3bc, ebp = 0xbfbfd408 --- Tracing command sshd pid 1098 tid 100151 td 0xc69bf000 sched_switch(c69bf000,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf2a7e984 mi_switch(104,0,c108b461,1f5,200046,...) at mi_switch+0x1c9/frame 0xf2a7e9b8 sleepq_switch(c69bf000,0,c108b461,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf2a7e9ec sleepq_catch_signals(f2a7ea58,c0a723a9,c64934a0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf2a7ea34 sleepq_wait_sig(c64934a4,0,f2a7ea88,101,0,...) at sleepq_wait_sig+0x14/frame 0xf2a7ea58 _cv_wait_sig(c64934a4,c6493490,c108e1a5,68e,5c3,...) at _cv_wait_sig+0x200/frame 0xf2a7ea9c seltdwait(ffffffff,0,0,c69bf000,0,...) at seltdwait+0x90/frame 0xf2a7ead0 sys_poll(c69bf000,f2a7ecc8,14,c1087ced,7b3,...) at sys_poll+0x44c/frame 0xf2a7ec40 syscall(f2a7ed08) at syscall+0x2ed/frame 0xf2a7ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2a7ecfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284c52df, esp = 0xbfbfd3bc, ebp = 0xbfbfd408 --- Tracing command ls pid 1095 tid 100125 td 0xc6958900 sched_switch(c6958900,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf2a30644 mi_switch(104,0,c108b461,1f5,162,...) at mi_switch+0x1c9/frame 0xf2a30678 sleepq_switch(c6958900,0,c108b461,26b,60,...) at sleepq_switch+0x1b9/frame 0xf2a306ac sleepq_wait(c7b8de44,60,c8445470,4,0,...) at sleepq_wait+0x48/frame 0xf2a306d0 sleeplk(c7b8deb0,c8445470,60,33,0,...) at sleeplk+0x126/frame 0xf2a30718 __lockmgr_args(c7b8de44,80100,c7b8deb0,0,0,0,c109611f,877) at __lockmgr_args+0xa44/frame 0xf2a307f8 vop_stdlock(f2a30870,8,c617f1e0,c6180b10,c617f1e0,...) at vop_stdlock+0x53/frame 0xf2a30828 VOP_LOCK1_APV(c8446a04,f2a30870,0,0,c11f7530,...) at VOP_LOCK1_APV+0x112/frame 0xf2a30858 _vn_lock(c7b8de10,80100,c109611f,877,2a1,...) at _vn_lock+0xca/frame 0xf2a30898 vget(c7b8de10,80100,c6958900,29d,c11f49f8,...) at vget+0x77/frame 0xf2a308d0 cache_lookup(c7b8e168,f2a30b50,f2a30b64,0,0,...) at cache_lookup+0x5a8/frame 0xf2a30930 vfs_cache_lookup(f2a309e8,c10e3c7b,c10b87bd,c1095563,c11f49f8,...) at vfs_cache_lookup+0xbc/frame 0xf2a30978 VOP_LOOKUP_APV(c8446a04,f2a309e8,f2a30b64,205,f2a309f0,...) at VOP_LOOKUP_APV+0x124/frame 0xf2a309a8 lookup(f2a30b18,c1095563,107,ce,c137c130,...) at lookup+0x528/frame 0xf2a30a10 namei(f2a30b18,c6958900,f2a30ad4,c7b8e168,e168,...) at namei+0x47d/frame 0xf2a30a98 kern_statat_vnhook(c6958900,200,ffffff9c,2881b2f8,0,...) at kern_statat_vnhook+0xc2/frame 0xf2a30ba8 sys_lstat(c6958900,f2a30cc8,c0eb1e30,c5fe8c90,0,...) at sys_lstat+0x59/frame 0xf2a30c40 syscall(f2a30d08) at syscall+0x2ed/frame 0xf2a30cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2a30cfc --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x281c7e87, esp = 0xbfbfd5ac, ebp = 0xbfbfd634 --- Tracing command sh pid 1094 tid 100187 td 0xc7b6b600 sched_switch(c7b6b600,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf2b2198c mi_switch(104,0,c108b461,1f5,c108b461,...) at mi_switch+0x1c9/frame 0xf2b219c0 sleepq_switch(c7b6b600,0,c108b461,1ab,f2b21a38,...) at sleepq_switch+0x1b9/frame 0xf2b219f4 sleepq_catch_signals(0,c108b461,162,d80,c7b6b600,...) at sleepq_catch_signals+0x361/frame 0xf2b21a3c sleepq_wait_sig(c7b59000,6c,c108e8d9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf2b21a60 _sleep(c7b59000,c7b59094,16c,c108e8d9,0,...) at _sleep+0x35b/frame 0xf2b21abc kern_wait6(c7b6b600,7,0,0,f2b21b4c,...) at kern_wait6+0x45c/frame 0xf2b21b20 sys_wait4(c7b6b600,f2b21cc8,c10dd55f,d6,8,...) at sys_wait4+0x94/frame 0xf2b21c40 syscall(f2b21d08) at syscall+0x2ed/frame 0xf2b21cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2b21cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfdae0, ebp = 0xbfbfdaf8 --- Tracing command sendfile5 pid 1093 tid 100094 td 0xc69c5600 sched_switch(c69c5600,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf296d99c mi_switch(104,0,c108b461,1f5,c108b461,...) at mi_switch+0x1c9/frame 0xf296d9d0 sleepq_switch(c69c5600,0,c108b461,1ab,f296da48,...) at sleepq_switch+0x1b9/frame 0xf296da04 sleepq_catch_signals(0,c108b461,162,288,c69c5600,...) at sleepq_catch_signals+0x361/frame 0xf296da4c sleepq_wait_sig(c6d7e3f8,68,c1091ef9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf296da70 _sleep(c6d7e3f8,c6d7e3b8,168,c1091ef9,0,0,0,0,100) at _sleep+0x35b/frame 0xf296dacc sbwait(c6d7e394,4,c109218d,652,c0a72a27,...) at sbwait+0xb8/frame 0xf296db04 soreceive_generic(c6d7e340,0,f296dc10,0,0,0) at soreceive_generic+0x253/frame 0xf296db6c soo_read(c692ce70,f296dc10,c7072100,0,c69c5600,...) at soo_read+0x4e/frame 0xf296db90 dofileread(c692ce70,f296dc10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf296dbc4 kern_readv(c69c5600,5,f296dc10,0,28802000,...) at kern_readv+0x66/frame 0xf296dbf0 sys_read(c69c5600,f296dcc8,c0eb1e30,c5fe2c90,0,...) at sys_read+0x5c/frame 0xf296dc40 syscall(f296dd08) at syscall+0x2ed/frame 0xf296dcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf296dcfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28186fc7, esp = 0xbfbfd7fc, ebp = 0xbfbfd8b4 --- Tracing command sendfile5 pid 1092 tid 100131 td 0xc6958300 sched_switch(c6958300,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf2a4284c mi_switch(104,0,c108b461,1f5,162,...) at mi_switch+0x1c9/frame 0xf2a42880 sleepq_switch(c6958300,0,c108b461,26b,c6958300,...) at sleepq_switch+0x1b9/frame 0xf2a428b4 sleepq_wait(c3b54a40,54,c10c33b0,0,0,...) at sleepq_wait+0x48/frame 0xf2a428d8 _sleep(c3b54a40,c7b55818,54,c10c33b0,0,0,0,0,100) at _sleep+0x37c/frame 0xf2a42934 vm_page_sleep(c3b54a40,c10c33b0,0,396,c7b55848,...) at vm_page_sleep+0xc0/frame 0xf2a42968 vm_page_grab(c7b55818,2,0,80,c7b8de10,...) at vm_page_grab+0x84/frame 0xf2a4299c tmpfs_read(f2a42a78,c10e4051,c10b884b,0,c11f49f8,...) at tmpfs_read+0x12c/frame 0xf2a429f0 VOP_READ_APV(c8446a04,f2a42a78,c7b8de10,246,c7b55848,...) at VOP_READ_APV+0x124/frame 0xf2a42a20 vn_rdwr(0,c7b8de10,0,10000,2000,...) at vn_rdwr+0x292/frame 0xf2a42aa0 kern_sendfile(c6958300,f2a42cc8,0,0,0,...) at kern_sendfile+0xa44/frame 0xf2a42be8 do_sendfile(0) at do_sendfile+0xb7/frame 0xf2a42c34 sys_sendfile(c6958300,f2a42cc8,c10dd55f,d6,0,...) at sys_sendfile+0x16/frame 0xf2a42c40 syscall(f2a42d08) at syscall+0x2ed/frame 0xf2a42cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2a42cfc --- syscall (393, FreeBSD ELF32, sys_sendfile), eip = 0x280beebb, esp = 0xbfbfd7fc, ebp = 0xbfbfd8b4 --- Tracing command sh pid 1071 tid 100152 td 0xc69b9c00 Tracing command getty pid 951 tid 100106 td 0xc69bfc00 sched_switch(c69bfc00,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf29b29bc mi_switch(104,0,c108b461,1f5,c108b461,...) at mi_switch+0x1c9/frame 0xf29b29f0 sleepq_switch(c69bfc00,0,c108b461,1ab,f29b2a68,...) at sleepq_switch+0x1b9/frame 0xf29b2a24 sleepq_catch_signals(0,c108b461,162,930,1,...) at sleepq_catch_signals+0x361/frame 0xf29b2a6c sleepq_wait_sig(c6531270,0,c10901d5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf29b2a90 _cv_wait_sig(c6531270,c13f9c94,c10901c1,531,f29b2c10,...) at _cv_wait_sig+0x200/frame 0xf29b2ad4 tty_wait(c6531200,c6531270,f29b2c10,1,0,...) at tty_wait+0x4b/frame 0xf29b2af8 ttydisc_read(c6531200,f29b2c10,0,a1,f29b2c10,...) at ttydisc_read+0x377/frame 0xf29b2b3c ttydev_read(c648a700,f29b2c10,0,1,0,...) at ttydev_read+0x81/frame 0xf29b2b5c devfs_read_f(c692c3b8,f29b2c10,c62a9e00,0,c69bfc00,...) at devfs_read_f+0x87/frame 0xf29b2b90 dofileread(c692c3b8,f29b2c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf29b2bc4 kern_readv(c69bfc00,0,f29b2c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf29b2bf0 sys_read(c69bfc00,f29b2cc8,c10dd55f,d6,0,...) at sys_read+0x5c/frame 0xf29b2c40 syscall(f29b2d08) at syscall+0x2ed/frame 0xf29b2cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf29b2cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cfc7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 950 tid 100098 td 0xc6918300 sched_switch(c6918300,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf29829bc mi_switch(104,0,c108b461,1f5,c108b461,...) at mi_switch+0x1c9/frame 0xf29829f0 sleepq_switch(c6918300,0,c108b461,1ab,f2982a68,...) at sleepq_switch+0x1b9/frame 0xf2982a24 sleepq_catch_signals(0,c108b461,162,960,1,...) at sleepq_catch_signals+0x361/frame 0xf2982a6c sleepq_wait_sig(c6531470,0,c10901d5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf2982a90 _cv_wait_sig(c6531470,c13f9c94,c10901c1,531,f2982c10,...) at _cv_wait_sig+0x200/frame 0xf2982ad4 tty_wait(c6531400,c6531470,f2982c10,1,0,...) at tty_wait+0x4b/frame 0xf2982af8 ttydisc_read(c6531400,f2982c10,0,a1,f2982c10,...) at ttydisc_read+0x377/frame 0xf2982b3c ttydev_read(c648a800,f2982c10,0,1,0,...) at ttydev_read+0x81/frame 0xf2982b5c devfs_read_f(c6971b28,f2982c10,c62a9e00,0,c6918300,...) at devfs_read_f+0x87/frame 0xf2982b90 dofileread(c6971b28,f2982c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf2982bc4 kern_readv(c6918300,0,f2982c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf2982bf0 sys_read(c6918300,f2982cc8,c10dd55f,d6,c6918300,...) at sys_read+0x5c/frame 0xf2982c40 syscall(f2982d08) at syscall+0x2ed/frame 0xf2982cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2982cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cfc7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 949 tid 100132 td 0xc6958000 sched_switch(c6958000,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf2a459bc mi_switch(104,0,c108b461,1f5,c108b461,...) at mi_switch+0x1c9/frame 0xf2a459f0 sleepq_switch(c6958000,0,c108b461,1ab,f2a45a68,...) at sleepq_switch+0x1b9/frame 0xf2a45a24 sleepq_catch_signals(0,c108b461,162,1500,1,...) at sleepq_catch_signals+0x361/frame 0xf2a45a6c sleepq_wait_sig(c6389070,0,c10901d5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf2a45a90 _cv_wait_sig(c6389070,c13f9c94,c10901c1,531,f2a45c10,...) at _cv_wait_sig+0x200/frame 0xf2a45ad4 tty_wait(c6389000,c6389070,f2a45c10,1,0,...) at tty_wait+0x4b/frame 0xf2a45af8 ttydisc_read(c6389000,f2a45c10,0,a1,f2a45c10,...) at ttydisc_read+0x377/frame 0xf2a45b3c ttydev_read(c648a900,f2a45c10,0,1,0,...) at ttydev_read+0x81/frame 0xf2a45b5c devfs_read_f(c692b0a8,f2a45c10,c62a9e00,0,c6958000,...) at devfs_read_f+0x87/frame 0xf2a45b90 dofileread(c692b0a8,f2a45c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf2a45bc4 kern_readv(c6958000,0,f2a45c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf2a45bf0 sys_read(c6958000,f2a45cc8,c0eb1e30,c5fe8c90,0,...) at sys_read+0x5c/frame 0xf2a45c40 syscall(f2a45d08) at syscall+0x2ed/frame 0xf2a45cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2a45cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cfc7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 948 tid 100075 td 0xc691cc00 sched_switch(c691cc00,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf29219bc mi_switch(104,0,c108b461,1f5,c108b461,...) at mi_switch+0x1c9/frame 0xf29219f0 sleepq_switch(c691cc00,0,c108b461,1ab,f2921a68,...) at sleepq_switch+0x1b9/frame 0xf2921a24 sleepq_catch_signals(0,c108b461,162,1530,1,...) at sleepq_catch_signals+0x361/frame 0xf2921a6c sleepq_wait_sig(c6389270,0,c10901d5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf2921a90 _cv_wait_sig(c6389270,c13f9c94,c10901c1,531,f2921c10,...) at _cv_wait_sig+0x200/frame 0xf2921ad4 tty_wait(c6389200,c6389270,f2921c10,1,0,...) at tty_wait+0x4b/frame 0xf2921af8 ttydisc_read(c6389200,f2921c10,0,a1,f2921c10,...) at ttydisc_read+0x377/frame 0xf2921b3c ttydev_read(c648aa00,f2921c10,0,1,0,...) at ttydev_read+0x81/frame 0xf2921b5c devfs_read_f(c692cc78,f2921c10,c62a9e00,0,c691cc00,...) at devfs_read_f+0x87/frame 0xf2921b90 dofileread(c692cc78,f2921c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf2921bc4 kern_readv(c691cc00,0,f2921c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf2921bf0 sys_read(c691cc00,f2921cc8,c0eb1e30,c5fe8c90,0,...) at sys_read+0x5c/frame 0xf2921c40 syscall(f2921d08) at syscall+0x2ed/frame 0xf2921cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2921cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cfc7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 947 tid 100077 td 0xc6960c00 sched_switch(c6960c00,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf29299bc mi_switch(104,0,c108b461,1f5,c108b461,...) at mi_switch+0x1c9/frame 0xf29299f0 sleepq_switch(c6960c00,0,c108b461,1ab,f2929a68,...) at sleepq_switch+0x1b9/frame 0xf2929a24 sleepq_catch_signals(0,c108b461,162,1560,1,...) at sleepq_catch_signals+0x361/frame 0xf2929a6c sleepq_wait_sig(c6389470,0,c10901d5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf2929a90 _cv_wait_sig(c6389470,c13f9c94,c10901c1,531,f2929c10,...) at _cv_wait_sig+0x200/frame 0xf2929ad4 tty_wait(c6389400,c6389470,f2929c10,1,0,...) at tty_wait+0x4b/frame 0xf2929af8 ttydisc_read(c6389400,f2929c10,0,a1,f2929c10,...) at ttydisc_read+0x377/frame 0xf2929b3c ttydev_read(c648ab00,f2929c10,0,1,0,...) at ttydev_read+0x81/frame 0xf2929b5c devfs_read_f(c692b460,f2929c10,c62a9e00,0,c6960c00,...) at devfs_read_f+0x87/frame 0xf2929b90 dofileread(c692b460,f2929c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf2929bc4 kern_readv(c6960c00,0,f2929c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf2929bf0 sys_read(c6960c00,f2929cc8,c10dd55f,d6,db,...) at sys_read+0x5c/frame 0xf2929c40 syscall(f2929d08) at syscall+0x2ed/frame 0xf2929cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2929cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cfc7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 946 tid 100109 td 0xc69b7900 sched_switch(c69b7900,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf29d09bc mi_switch(104,0,c108b461,1f5,c108b461,...) at mi_switch+0x1c9/frame 0xf29d09f0 sleepq_switch(c69b7900,0,c108b461,1ab,f29d0a68,...) at sleepq_switch+0x1b9/frame 0xf29d0a24 sleepq_catch_signals(0,c108b461,162,1590,1,...) at sleepq_catch_signals+0x361/frame 0xf29d0a6c sleepq_wait_sig(c6389670,0,c10901d5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf29d0a90 _cv_wait_sig(c6389670,c13f9c94,c10901c1,531,f29d0c10,...) at _cv_wait_sig+0x200/frame 0xf29d0ad4 tty_wait(c6389600,c6389670,f29d0c10,1,0,...) at tty_wait+0x4b/frame 0xf29d0af8 ttydisc_read(c6389600,f29d0c10,0,a1,f29d0c10,...) at ttydisc_read+0x377/frame 0xf29d0b3c ttydev_read(c648ac00,f29d0c10,0,1,0,...) at ttydev_read+0x81/frame 0xf29d0b5c devfs_read_f(c6971540,f29d0c10,c62a9e00,0,c69b7900,...) at devfs_read_f+0x87/frame 0xf29d0b90 dofileread(c6971540,f29d0c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf29d0bc4 kern_readv(c69b7900,0,f29d0c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf29d0bf0 sys_read(c69b7900,f29d0cc8,c0eb1e30,c1825c90,0,...) at sys_read+0x5c/frame 0xf29d0c40 syscall(f29d0d08) at syscall+0x2ed/frame 0xf29d0cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf29d0cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cfc7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 945 tid 100087 td 0xc64f0900 sched_switch(c64f0900,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf29519bc mi_switch(104,0,c108b461,1f5,c108b461,...) at mi_switch+0x1c9/frame 0xf29519f0 sleepq_switch(c64f0900,0,c108b461,1ab,f2951a68,...) at sleepq_switch+0x1b9/frame 0xf2951a24 sleepq_catch_signals(0,c108b461,162,15c0,1,...) at sleepq_catch_signals+0x361/frame 0xf2951a6c sleepq_wait_sig(c6389870,0,c10901d5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf2951a90 _cv_wait_sig(c6389870,c13f9c94,c10901c1,531,f2951c10,...) at _cv_wait_sig+0x200/frame 0xf2951ad4 tty_wait(c6389800,c6389870,f2951c10,1,0,...) at tty_wait+0x4b/frame 0xf2951af8 ttydisc_read(c6389800,f2951c10,0,a1,f2951c10,...) at ttydisc_read+0x377/frame 0xf2951b3c ttydev_read(c648ad00,f2951c10,0,1,0,...) at ttydev_read+0x81/frame 0xf2951b5c devfs_read_f(c692c818,f2951c10,c62a9e00,0,c64f0900,...) at devfs_read_f+0x87/frame 0xf2951b90 dofileread(c692c818,f2951c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf2951bc4 kern_readv(c64f0900,0,f2951c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf2951bf0 sys_read(c64f0900,f2951cc8,f2951c8c,c08fea67,c6524000,...) at sys_read+0x5c/frame 0xf2951c40 syscall(f2951d08) at syscall+0x2ed/frame 0xf2951cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2951cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cfc7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 944 tid 100117 td 0xc69b6000 sched_switch(c69b6000,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf29f39bc mi_switch(104,0,c108b461,1f5,c108b461,...) at mi_switch+0x1c9/frame 0xf29f39f0 sleepq_switch(c69b6000,0,c108b461,1ab,f29f3a68,...) at sleepq_switch+0x1b9/frame 0xf29f3a24 sleepq_catch_signals(0,c108b461,162,15f0,1,...) at sleepq_catch_signals+0x361/frame 0xf29f3a6c sleepq_wait_sig(c6389a70,0,c10901d5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf29f3a90 _cv_wait_sig(c6389a70,c13f9c94,c10901c1,531,f29f3c10,...) at _cv_wait_sig+0x200/frame 0xf29f3ad4 tty_wait(c6389a00,c6389a70,f29f3c10,1,0,...) at tty_wait+0x4b/frame 0xf29f3af8 ttydisc_read(c6389a00,f29f3c10,0,a1,f29f3c10,...) at ttydisc_read+0x377/frame 0xf29f3b3c ttydev_read(c648ae00,f29f3c10,0,1,0,...) at ttydev_read+0x81/frame 0xf29f3b5c devfs_read_f(c7010620,f29f3c10,c62a9e00,0,c69b6000,...) at devfs_read_f+0x87/frame 0xf29f3b90 dofileread(c7010620,f29f3c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf29f3bc4 kern_readv(c69b6000,0,f29f3c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf29f3bf0 sys_read(c69b6000,f29f3cc8,c0eb1e30,c5fe2c90,0,...) at sys_read+0x5c/frame 0xf29f3c40 syscall(f29f3d08) at syscall+0x2ed/frame 0xf29f3cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf29f3cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cfc7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 943 tid 100133 td 0xc75b2c00 sched_switch(c75b2c00,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf2a489bc mi_switch(104,0,c108b461,1f5,46,...) at mi_switch+0x1c9/frame 0xf2a489f0 sleepq_switch(c75b2c00,0,c108b461,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf2a48a24 sleepq_catch_signals(f2a48a90,c0a723a9,c6389c14,0,0,...) at sleepq_catch_signals+0x361/frame 0xf2a48a6c sleepq_wait_sig(c6389c70,0,f2a48ac0,101,0,...) at sleepq_wait_sig+0x14/frame 0xf2a48a90 _cv_wait_sig(c6389c70,c6389c04,c10901c1,531,f2a48c10,...) at _cv_wait_sig+0x200/frame 0xf2a48ad4 tty_wait(c6389c00,c6389c70,f2a48c10,1,0,...) at tty_wait+0x4b/frame 0xf2a48af8 ttydisc_read(c6389c00,f2a48c10,0,a1,f2a48c10,...) at ttydisc_read+0x377/frame 0xf2a48b3c ttydev_read(c630bc00,f2a48c10,0,1,0,...) at ttydev_read+0x81/frame 0xf2a48b5c devfs_read_f(c75da038,f2a48c10,c62a9e00,0,c75b2c00,...) at devfs_read_f+0x87/frame 0xf2a48b90 dofileread(c75da038,f2a48c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf2a48bc4 kern_readv(c75b2c00,0,f2a48c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf2a48bf0 sys_read(c75b2c00,f2a48cc8,c10dd55f,d6,0,...) at sys_read+0x5c/frame 0xf2a48c40 syscall(f2a48d08) at syscall+0x2ed/frame 0xf2a48cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2a48cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cfc7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command inetd pid 926 tid 100110 td 0xc69b7600 sched_switch(c69b7600,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf29d690c mi_switch(104,0,c108b461,1f5,46,...) at mi_switch+0x1c9/frame 0xf29d6940 sleepq_switch(c69b7600,0,c108b461,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf29d6974 sleepq_catch_signals(f29d69e0,c0a723a9,c6493820,0,0,...) at sleepq_catch_signals+0x361/frame 0xf29d69bc sleepq_wait_sig(c6493824,0,f29d6a10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf29d69e0 _cv_wait_sig(c6493824,c6493810,c108e1a5,68e,c0ae168d,...) at _cv_wait_sig+0x200/frame 0xf29d6a24 seltdwait(ffffffff,0,0,c69b7600,0,...) at seltdwait+0x90/frame 0xf29d6a58 kern_select(c69b7600,8,bfbfd070,0,0,...) at kern_select+0x88c/frame 0xf29d6bf8 sys_select(c69b7600,f29d6cc8,c0eb1e30,c5fe5c90,0,...) at sys_select+0x69/frame 0xf29d6c40 syscall(f29d6d08) at syscall+0x2ed/frame 0xf29d6cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf29d6cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281aef87, esp = 0xbfbfd014, ebp = 0xbfbfde34 --- Tracing command watchdogd pid 902 tid 100150 td 0xc69bf300 sched_switch(c69bf300,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf2a7b98c mi_switch(104,0,c108b461,1f5,c108b461,...) at mi_switch+0x1c9/frame 0xf2a7b9c0 sleepq_switch(c69bf300,0,c108b461,1ab,f2a7ba38,...) at sleepq_switch+0x1b9/frame 0xf2a7b9f4 sleepq_catch_signals(0,c108b461,162,a08,c69bf300,...) at sleepq_catch_signals+0x361/frame 0xf2a7ba3c sleepq_wait_sig(c7a2cba0,6c,c108e8d9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf2a7ba60 _sleep(c7a2cba0,c7a2cc34,16c,c108e8d9,0,...) at _sleep+0x35b/frame 0xf2a7babc kern_wait6(c69bf300,0,446,0,f2a7bb4c,...) at kern_wait6+0x45c/frame 0xf2a7bb20 sys_wait4(c69bf300,f2a7bcc8,0,0,0,...) at sys_wait4+0x94/frame 0xf2a7bc40 syscall(f2a7bd08) at syscall+0x2ed/frame 0xf2a7bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2a7bcfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x280eb4b3, esp = 0xbfbfdc4c, ebp = 0xbfbfdce8 --- Tracing command sh pid 815 tid 100142 td 0xc75b2000 Tracing command bash pid 811 tid 100102 td 0xc69c4900 Tracing command csh pid 808 tid 100100 td 0xc69c4c00 Tracing command su pid 807 tid 100148 td 0xc728dc00 Tracing command bash pid 800 tid 100146 td 0xc6c63600 Tracing command sshd pid 799 tid 100108 td 0xc69bf600 sched_switch(c69bf600,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf29bb90c mi_switch(104,0,c108b461,1f5,200046,...) at mi_switch+0x1c9/frame 0xf29bb940 sleepq_switch(c69bf600,0,c108b461,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf29bb974 sleepq_catch_signals(f29bb9e0,c0a723a9,c64948a0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf29bb9bc sleepq_wait_sig(c64948a4,0,f29bba10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf29bb9e0 _cv_wait_sig(c64948a4,c6494890,c108e1a5,68e,1b2,...) at _cv_wait_sig+0x200/frame 0xf29bba24 seltdwait(ffffffff,0,0,c69bf600,0,...) at seltdwait+0x90/frame 0xf29bba58 kern_select(c69bf600,c,28c0c1c8,28c0c1d0,0,...) at kern_select+0x88c/frame 0xf29bbbf8 sys_select(c69bf600,f29bbcc8,c0eb1e30,c5fe5c90,0,...) at sys_select+0x69/frame 0xf29bbc40 syscall(f29bbd08) at syscall+0x2ed/frame 0xf29bbcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf29bbcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2852ef87, esp = 0xbfbfd374, ebp = 0xbfbfd3c0 --- Tracing command sshd pid 797 tid 100103 td 0xc69c4600 sched_switch(c69c4600,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf299f984 mi_switch(104,0,c108b461,1f5,200046,...) at mi_switch+0x1c9/frame 0xf299f9b8 sleepq_switch(c69c4600,0,c108b461,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf299f9ec sleepq_catch_signals(f299fa58,c0a723a9,c64937a0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf299fa34 sleepq_wait_sig(c64937a4,0,f299fa88,101,0,...) at sleepq_wait_sig+0x14/frame 0xf299fa58 _cv_wait_sig(c64937a4,c6493790,c108e1a5,68e,5c3,...) at _cv_wait_sig+0x200/frame 0xf299fa9c seltdwait(ffffffff,0,0,c69c4600,c11ba8d4,...) at seltdwait+0x90/frame 0xf299fad0 sys_poll(c69c4600,f299fcc8,c0eb1e30,c1825c90,0,...) at sys_poll+0x44c/frame 0xf299fc40 syscall(f299fd08) at syscall+0x2ed/frame 0xf299fcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf299fcfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284c52df, esp = 0xbfbfd3bc, ebp = 0xbfbfd408 --- Tracing command cron pid 734 tid 100124 td 0xc6958c00 sched_switch(c6958c00,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf2a2da64 mi_switch(104,0,c108b461,1f5,c0ac9db0,...) at mi_switch+0x1c9/frame 0xf2a2da98 sleepq_switch(c6958c00,0,c108b461,1ab,8,...) at sleepq_switch+0x1b9/frame 0xf2a2dacc sleepq_catch_signals(c0ac9db0,c6958c00,0,201,0,...) at sleepq_catch_signals+0x361/frame 0xf2a2db14 sleepq_timedwait_sig(c1231d08,6c,907,aed4a852,2,...) at sleepq_timedwait_sig+0x14/frame 0xf2a2db3c _sleep(c1231d08,0,16c,c1086dda,d139a740,...) at _sleep+0x331/frame 0xf2a2db98 kern_nanosleep(bfbfde28,f2a2dc18,f2a2dc20,f2a2dcc8,2a,...) at kern_nanosleep+0x158/frame 0xf2a2dc00 sys_nanosleep(c6958c00,f2a2dcc8,0,0,c6958c00,...) at sys_nanosleep+0x6b/frame 0xf2a2dc40 syscall(f2a2dd08) at syscall+0x2ed/frame 0xf2a2dcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2a2dcfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28188173, esp = 0xbfbfdcb4, ebp = 0xbfbfde44 --- Tracing command sendmail pid 729 tid 100084 td 0xc691c300 sched_switch(c691c300,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf2945aa0 mi_switch(104,0,c108b461,1f5,8,...) at mi_switch+0x1c9/frame 0xf2945ad4 sleepq_switch(c691c300,0,c108b461,1ab,f2945b4c,...) at sleepq_switch+0x1b9/frame 0xf2945b08 sleepq_catch_signals(0,c108b461,162,468,c691c300,...) at sleepq_catch_signals+0x361/frame 0xf2945b50 sleepq_wait_sig(c691634c,74,c0f03c14,100,0,...) at sleepq_wait_sig+0x14/frame 0xf2945b74 _sleep(c691634c,c691637c,174,c0f03c14,0,...) at _sleep+0x35b/frame 0xf2945bd0 kern_sigsuspend(c691c300,0,0,0,0,...) at kern_sigsuspend+0xfb/frame 0xf2945c10 sys_sigsuspend(c691c300,f2945cc8,1,0,c691c300,...) at sys_sigsuspend+0x58/frame 0xf2945c40 syscall(f2945d08) at syscall+0x2ed/frame 0xf2945cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2945cfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x283550ab, esp = 0xbfbfc9f4, ebp = 0xbfbfca20 --- Tracing command sendmail pid 726 tid 100118 td 0xc69b4c00 sched_switch(c69b4c00,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf29f6900 mi_switch(104,0,c108b461,1f5,400,...) at mi_switch+0x1c9/frame 0xf29f6934 sleepq_switch(c69b4c00,0,c108b461,1ab,c6c71790,...) at sleepq_switch+0x1b9/frame 0xf29f6968 sleepq_catch_signals(c11b853c,f29f69d8,c0a723a9,c6c717a0,0,...) at sleepq_catch_signals+0x361/frame 0xf29f69b0 sleepq_timedwait_sig(c6c717a4,0,f29f6a10,50000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf29f69d8 _cv_timedwait_sig_sbt(c6c717a4,c6c71790,184254f2,90b,50000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf29f6a24 seltdwait(90b,50000000,0,c69b4c00,0,...) at seltdwait+0xbc/frame 0xf29f6a58 kern_select(c69b4c00,5,bfbfbfe0,0,0,...) at kern_select+0x88c/frame 0xf29f6bf8 sys_select(c69b4c00,f29f6cc8,7b3,2,f29f6cc4,...) at sys_select+0x69/frame 0xf29f6c40 syscall(f29f6d08) at syscall+0x2ed/frame 0xf29f6cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf29f6cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2841cf87, esp = 0xbfbfbf44, ebp = 0xbfbfca00 --- Tracing command sshd pid 723 tid 100078 td 0xc6960900 sched_switch(c6960900,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf292d90c mi_switch(104,0,c108b461,1f5,200046,...) at mi_switch+0x1c9/frame 0xf292d940 sleepq_switch(c6960900,0,c108b461,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf292d974 sleepq_catch_signals(f292d9e0,c0a723a9,c6494aa0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf292d9bc sleepq_wait_sig(c6494aa4,0,f292da10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf292d9e0 _cv_wait_sig(c6494aa4,c6494a90,c108e1a5,68e,c0ae168d,...) at _cv_wait_sig+0x200/frame 0xf292da24 seltdwait(ffffffff,0,0,c6960900,0,...) at seltdwait+0x90/frame 0xf292da58 kern_select(c6960900,9,28c0c140,0,0,...) at kern_select+0x88c/frame 0xf292dbf8 sys_select(c6960900,f292dcc8,c0eb1e30,c5fe5c90,0,...) at sys_select+0x69/frame 0xf292dc40 syscall(f292dd08) at syscall+0x2ed/frame 0xf292dcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf292dcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2852ef87, esp = 0xbfbfd424, ebp = 0xbfbfde44 --- Tracing command smbd pid 714 tid 100076 td 0xc691c900 sched_switch(c691c900,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf2925978 mi_switch(104,0,c108b461,1f5,400,...) at mi_switch+0x1c9/frame 0xf29259ac sleepq_switch(c691c900,0,c108b461,1ab,c6494a10,...) at sleepq_switch+0x1b9/frame 0xf29259e0 sleepq_catch_signals(c11b853c,f2925a50,c0a723a9,c6494a20,0,...) at sleepq_catch_signals+0x361/frame 0xf2925a28 sleepq_timedwait_sig(c6494a24,0,f2925a88,b7fbe76c,20c49,...) at sleepq_timedwait_sig+0x14/frame 0xf2925a50 _cv_timedwait_sig_sbt(c6494a24,c6494a10,ccee8046,20c4b1,b7fbe76c,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf2925a9c seltdwait(20c4b1,b7fbe76c,20c49,c691c900,0,...) at seltdwait+0xbc/frame 0xf2925ad0 sys_poll(c691c900,f2925cc8,c0eb1e30,c5fe5c90,0,...) at sys_poll+0x44c/frame 0xf2925c40 syscall(f2925d08) at syscall+0x2ed/frame 0xf2925cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2925cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x21b642df, esp = 0xbfbfd9ec, ebp = 0xbfbfda28 --- Tracing command moused pid 689 tid 100083 td 0xc691c600 sched_switch(c691c600,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf294190c mi_switch(104,0,c108b461,1f5,46,...) at mi_switch+0x1c9/frame 0xf2941940 sleepq_switch(c691c600,0,c108b461,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf2941974 sleepq_catch_signals(f29419e0,c0a723a9,c6494b60,0,0,...) at sleepq_catch_signals+0x361/frame 0xf29419bc sleepq_wait_sig(c6494b64,0,f2941a10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf29419e0 _cv_wait_sig(c6494b64,c6494b50,c108e1a5,68e,c691c600,...) at _cv_wait_sig+0x200/frame 0xf2941a24 seltdwait(ffffffff,0,0,c691c600,0,...) at seltdwait+0x90/frame 0xf2941a58 kern_select(c691c600,400,bfbfdcb0,0,0,...) at kern_select+0x88c/frame 0xf2941bf8 sys_select(c691c600,f2941cc8,c10dd55f,e9,0,...) at sys_select+0x69/frame 0xf2941c40 syscall(f2941d08) at syscall+0x2ed/frame 0xf2941cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2941cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281bcf87, esp = 0xbfbfd894, ebp = 0xbfbfde24 --- Tracing command winbindd pid 688 tid 100079 td 0xc6960600 sched_switch(c6960600,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf2931978 mi_switch(104,0,c108b461,1f5,400,...) at mi_switch+0x1c9/frame 0xf29319ac sleepq_switch(c6960600,0,c108b461,1ab,c6494990,...) at sleepq_switch+0x1b9/frame 0xf29319e0 sleepq_catch_signals(c11b853c,f2931a50,c0a723a9,c64949a0,0,...) at sleepq_catch_signals+0x361/frame 0xf2931a28 sleepq_timedwait_sig(c64949a4,0,f2931a88,b7fbe76c,20c49,...) at sleepq_timedwait_sig+0x14/frame 0xf2931a50 _cv_timedwait_sig_sbt(c64949a4,c6494990,e36c0d68,20cce5,b7fbe76c,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf2931a9c seltdwait(20cce5,b7fbe76c,20c49,c6960600,c1091edc,...) at seltdwait+0xbc/frame 0xf2931ad0 sys_poll(c6960600,f2931cc8,c0eb1e30,c5fe8c90,0,...) at sys_poll+0x44c/frame 0xf2931c40 syscall(f2931d08) at syscall+0x2ed/frame 0xf2931cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2931cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2193b2df, esp = 0xbfbfc47c, ebp = 0xbfbfc4b8 --- Tracing command winbindd pid 673 tid 100092 td 0xc695f300 sched_switch(c695f300,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf2965978 mi_switch(104,0,c108b461,1f5,400,...) at mi_switch+0x1c9/frame 0xf29659ac sleepq_switch(c695f300,0,c108b461,1ab,c64949d0,...) at sleepq_switch+0x1b9/frame 0xf29659e0 sleepq_catch_signals(c11b853c,f2965a50,c0a723a9,c64949e0,0,...) at sleepq_catch_signals+0x361/frame 0xf2965a28 sleepq_timedwait_sig(c64949e4,0,f2965a88,bfffea52,12,...) at sleepq_timedwait_sig+0x14/frame 0xf2965a50 _cv_timedwait_sig_sbt(c64949e4,c64949d0,63ac3bbf,976,bfffea52,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf2965a9c seltdwait(976,bfffea52,12,c695f300,f2965b28,...) at seltdwait+0xbc/frame 0xf2965ad0 sys_poll(c695f300,f2965cc8,c0eb1e30,c1825c90,0,...) at sys_poll+0x44c/frame 0xf2965c40 syscall(f2965d08) at syscall+0x2ed/frame 0xf2965cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2965cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2193b2df, esp = 0xbfbfdbcc, ebp = 0xbfbfdc08 --- Tracing command smbd pid 671 tid 100089 td 0xc691c000 sched_switch(c691c000,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf2959978 mi_switch(104,0,c108b461,1f5,400,...) at mi_switch+0x1c9/frame 0xf29599ac sleepq_switch(c691c000,0,c108b461,1ab,c6c717d0,...) at sleepq_switch+0x1b9/frame 0xf29599e0 sleepq_catch_signals(c11b853c,f2959a50,c0a723a9,c6c717e0,0,...) at sleepq_catch_signals+0x361/frame 0xf2959a28 sleepq_timedwait_sig(c6c717e4,0,f2959a88,bffffbaa,3,...) at sleepq_timedwait_sig+0x14/frame 0xf2959a50 _cv_timedwait_sig_sbt(c6c717e4,c6c717d0,97a4460f,93c,bffffbaa,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf2959a9c seltdwait(93c,bffffbaa,3,c691c000,c0a4c8dc,...) at seltdwait+0xbc/frame 0xf2959ad0 sys_poll(c691c000,f2959cc8,0,0,c691c000,...) at sys_poll+0x44c/frame 0xf2959c40 syscall(f2959d08) at syscall+0x2ed/frame 0xf2959cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2959cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x21b642df, esp = 0xbfbfda9c, ebp = 0xbfbfdad8 --- Tracing command nmbd pid 669 tid 100099 td 0xc69c5000 sched_switch(c69c5000,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf298e978 mi_switch(104,0,c108b461,1f5,400,...) at mi_switch+0x1c9/frame 0xf298e9ac sleepq_switch(c69c5000,0,c108b461,1ab,c6493710,...) at sleepq_switch+0x1b9/frame 0xf298e9e0 sleepq_catch_signals(c11b853c,f298ea50,c0a723a9,c6493720,0,...) at sleepq_catch_signals+0x361/frame 0xf298ea28 sleepq_timedwait_sig(c6493724,0,f298ea88,9fffff47,0,...) at sleepq_timedwait_sig+0x14/frame 0xf298ea50 _cv_timedwait_sig_sbt(c6493724,c6493710,8fb57504,906,9fffff47,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf298ea9c seltdwait(906,9fffff47,0,c69c5000,c69dfa78,...) at seltdwait+0xbc/frame 0xf298ead0 sys_poll(c69c5000,f298ecc8,c0eb1e30,c1825c90,0,...) at sys_poll+0x44c/frame 0xf298ec40 syscall(f298ed08) at syscall+0x2ed/frame 0xf298ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf298ecfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x215632df, esp = 0xbfbfdb1c, ebp = 0xbfbfdb58 --- Tracing command ntpd pid 645 tid 100119 td 0xc69b4900 sched_switch(c69b4900,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf29f990c mi_switch(104,0,c108b461,1f5,200046,...) at mi_switch+0x1c9/frame 0xf29f9940 sleepq_switch(c69b4900,0,c108b461,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf29f9974 sleepq_catch_signals(f29f99e0,c0a723a9,c64937e0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf29f99bc sleepq_wait_sig(c64937e4,0,f29f9a10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf29f99e0 _cv_wait_sig(c64937e4,c64937d0,c108e1a5,68e,c0ae168d,...) at _cv_wait_sig+0x200/frame 0xf29f9a24 seltdwait(ffffffff,0,0,c69b4900,0,...) at seltdwait+0x90/frame 0xf29f9a58 kern_select(c69b4900,1c,bfbfdd48,0,0,...) at kern_select+0x88c/frame 0xf29f9bf8 sys_select(c69b4900,f29f9cc8,0,0,c69b4900,...) at sys_select+0x69/frame 0xf29f9c40 syscall(f29f9d08) at syscall+0x2ed/frame 0xf29f9cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf29f9cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28396f87, esp = 0xbfbfdd24, ebp = 0xbfbfdde4 --- Tracing command nfsd pid 589 tid 100123 td 0xc6548900 sched_switch(c6548900,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf2a18a84 mi_switch(104,0,c108b461,1f5,c0ac9db0,...) at mi_switch+0x1c9/frame 0xf2a18ab8 sleepq_switch(c6548900,0,c108b461,1ab,c6462b80,...) at sleepq_switch+0x1b9/frame 0xf2a18aec sleepq_catch_signals(c11b853c,f2a18b5c,c0a723a9,c6462b90,0,...) at sleepq_catch_signals+0x361/frame 0xf2a18b34 sleepq_timedwait_sig(c694b790,0,f2a18b94,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf2a18b5c _cv_timedwait_sig_sbt(c694b790,c6462b80,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf2a18ba8 svc_run_internal(f2a18cf4,c0a555af,c6462b80,f2a18d08,c107f270,...) at svc_run_internal+0xa5d/frame 0xf2a18cc4 svc_thread_start(c6462b80,f2a18d08,c107f270,3d7,0,...) at svc_thread_start+0xd/frame 0xf2a18ccc fork_exit(c0c8e280,c6462b80,f2a18d08) at fork_exit+0x7f/frame 0xf2a18cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf2a18cf4 --- trap 0x85c3922e, eip = 0xc, esp = 0x33, ebp = 0xbfbfd937 --- Tracing command nfsd pid 589 tid 100122 td 0xc6548c00 sched_switch(c6548c00,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf2a15a84 mi_switch(104,0,c108b461,1f5,c0ac9db0,...) at mi_switch+0x1c9/frame 0xf2a15ab8 sleepq_switch(c6548c00,0,c108b461,1ab,c6462b80,...) at sleepq_switch+0x1b9/frame 0xf2a15aec sleepq_catch_signals(c11b853c,f2a15b5c,c0a723a9,c6462b90,0,...) at sleepq_catch_signals+0x361/frame 0xf2a15b34 sleepq_timedwait_sig(c694b7d0,0,f2a15b94,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf2a15b5c _cv_timedwait_sig_sbt(c694b7d0,c6462b80,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf2a15ba8 svc_run_internal(f2a15cf4,c0a555af,c6462b80,f2a15d08,c107f270,...) at svc_run_internal+0xa5d/frame 0xf2a15cc4 svc_thread_start(c6462b80,f2a15d08,c107f270,3d7,0,...) at svc_thread_start+0xd/frame 0xf2a15ccc fork_exit(c0c8e280,c6462b80,f2a15d08) at fork_exit+0x7f/frame 0xf2a15cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf2a15cf4 --- trap 0x85c3922e, eip = 0xc, esp = 0x33, ebp = 0xbfbfd937 --- Tracing command nfsd pid 589 tid 100121 td 0xc6918000 sched_switch(c6918000,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf2a12a84 mi_switch(104,0,c108b461,1f5,c0ac9db0,...) at mi_switch+0x1c9/frame 0xf2a12ab8 sleepq_switch(c6918000,0,c108b461,1ab,c6462b80,...) at sleepq_switch+0x1b9/frame 0xf2a12aec sleepq_catch_signals(c11b853c,f2a12b5c,c0a723a9,c6462b90,0,...) at sleepq_catch_signals+0x361/frame 0xf2a12b34 sleepq_timedwait_sig(c694b810,0,f2a12b94,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf2a12b5c _cv_timedwait_sig_sbt(c694b810,c6462b80,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf2a12ba8 svc_run_internal(f2a12cf4,c0a555af,c6462b80,f2a12d08,c107f270,...) at svc_run_internal+0xa5d/frame 0xf2a12cc4 svc_thread_start(c6462b80,f2a12d08,c107f270,3d7,0,...) at svc_thread_start+0xd/frame 0xf2a12ccc fork_exit(c0c8e280,c6462b80,f2a12d08) at fork_exit+0x7f/frame 0xf2a12cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf2a12cf4 --- trap 0x85c3922e, eip = 0xc, esp = 0x33, ebp = 0xbfbfd937 --- Tracing command nfsd pid 589 tid 100114 td 0xc69b6900 sched_switch(c69b6900,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf29e22fc mi_switch(104,0,c108b461,1f5,c0ac9db0,...) at mi_switch+0x1c9/frame 0xf29e2330 sleepq_switch(c69b6900,0,c108b461,1ab,c6462b80,...) at sleepq_switch+0x1b9/frame 0xf29e2364 sleepq_catch_signals(c11b853c,f29e23d4,c0a723a9,c6462b90,0,...) at sleepq_catch_signals+0x361/frame 0xf29e23ac sleepq_timedwait_sig(c6465ad0,0,f29e240c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf29e23d4 _cv_timedwait_sig_sbt(c6465ad0,c6462b80,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf29e2420 svc_run_internal(c0c8e280,c6462b80,c6c9c5d0,f29e2568,0,...) at svc_run_internal+0xa5d/frame 0xf29e253c svc_run(c6462b80,0,c1070c8f,1b5,0,...) at svc_run+0xc3/frame 0xf29e2578 nfsrvd_nfsd(c69b6900,f29e26d0,c,246,c1be5f0c,...) at nfsrvd_nfsd+0x1a2/frame 0xf29e26b0 nfssvc_nfsd(c69b6900,f29e2cc8,0,c69b6900,f29e2cfc,...) at nfssvc_nfsd+0xf4/frame 0xf29e2c28 sys_nfssvc(c69b6900,f29e2cc8,c10dd55f,d6,0,...) at sys_nfssvc+0xbf/frame 0xf29e2c40 syscall(f29e2d08) at syscall+0x2ed/frame 0xf29e2cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf29e2cfc --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280c26db, esp = 0xbfbfd7e4, ebp = 0xbfbfda58 --- Tracing command nfsd pid 584 tid 100104 td 0xc69c4300 sched_switch(c69c4300,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf29a390c mi_switch(104,0,c108b461,1f5,46,...) at mi_switch+0x1c9/frame 0xf29a3940 sleepq_switch(c69c4300,0,c108b461,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf29a3974 sleepq_catch_signals(f29a39e0,c0a723a9,c6493860,0,0,...) at sleepq_catch_signals+0x361/frame 0xf29a39bc sleepq_wait_sig(c6493864,0,f29a3a10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf29a39e0 _cv_wait_sig(c6493864,c6493850,c108e1a5,68e,c0ae168d,...) at _cv_wait_sig+0x200/frame 0xf29a3a24 seltdwait(ffffffff,0,0,c69c4300,0,...) at seltdwait+0x90/frame 0xf29a3a58 kern_select(c69c4300,7,bfbfdc30,0,0,...) at kern_select+0x88c/frame 0xf29a3bf8 sys_select(c69c4300,f29a3cc8,c0eb1e30,c1825c90,0,...) at sys_select+0x69/frame 0xf29a3c40 syscall(f29a3d08) at syscall+0x2ed/frame 0xf29a3cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf29a3cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28189f87, esp = 0xbfbfda5c, ebp = 0xbfbfde34 --- Tracing command mountd pid 578 tid 100111 td 0xc69b7300 sched_switch(c69b7300,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf29d990c mi_switch(104,0,c108b461,1f5,46,...) at mi_switch+0x1c9/frame 0xf29d9940 sleepq_switch(c69b7300,0,c108b461,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf29d9974 sleepq_catch_signals(f29d99e0,c0a723a9,c6c71820,0,0,...) at sleepq_catch_signals+0x361/frame 0xf29d99bc sleepq_wait_sig(c6c71824,0,f29d9a10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf29d99e0 _cv_wait_sig(c6c71824,c6c71810,c108e1a5,68e,c0ae168d,...) at _cv_wait_sig+0x200/frame 0xf29d9a24 seltdwait(ffffffff,0,0,c69b7300,0,...) at seltdwait+0x90/frame 0xf29d9a58 kern_select(c69b7300,9,bfbfdd50,0,0,...) at kern_select+0x88c/frame 0xf29d9bf8 sys_select(c69b7300,f29d9cc8,0,0,c69b7300,...) at sys_select+0x69/frame 0xf29d9c40 syscall(f29d9d08) at syscall+0x2ed/frame 0xf29d9cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf29d9cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a0f87, esp = 0xbfbfdd0c, ebp = 0xbfbfde34 --- Tracing command nfsuserd pid 571 tid 100080 td 0xc6960300 sched_switch(c6960300,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf2935900 mi_switch(104,0,c108b461,1f5,400,...) at mi_switch+0x1c9/frame 0xf2935934 sleepq_switch(c6960300,0,c108b461,1ab,c64932d0,...) at sleepq_switch+0x1b9/frame 0xf2935968 sleepq_catch_signals(c11b853c,f29359d8,c0a723a9,c64932e0,0,...) at sleepq_catch_signals+0x361/frame 0xf29359b0 sleepq_timedwait_sig(c64932e4,0,f2935a10,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xf29359d8 _cv_timedwait_sig_sbt(c64932e4,c64932d0,e2f91cee,91c,e0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf2935a24 seltdwait(91c,e0000000,1,c6960300,0,...) at seltdwait+0xbc/frame 0xf2935a58 kern_select(c6960300,4,bfbfdc10,0,0,...) at kern_select+0x88c/frame 0xf2935bf8 sys_select(c6960300,f2935cc8,c0eb1e30,c5fe8c90,0,...) at sys_select+0x69/frame 0xf2935c40 syscall(f2935d08) at syscall+0x2ed/frame 0xf2935cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2935cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28188f87, esp = 0xbfbfdb6c, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 570 tid 100085 td 0xc695fc00 sched_switch(c695fc00,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf2949900 mi_switch(104,0,c108b461,1f5,400,...) at mi_switch+0x1c9/frame 0xf2949934 sleepq_switch(c695fc00,0,c108b461,1ab,c6494910,...) at sleepq_switch+0x1b9/frame 0xf2949968 sleepq_catch_signals(c11b853c,f29499d8,c0a723a9,c6494920,0,...) at sleepq_catch_signals+0x361/frame 0xf29499b0 sleepq_timedwait_sig(c6494924,0,f2949a10,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xf29499d8 _cv_timedwait_sig_sbt(c6494924,c6494910,2c1fe8a2,91a,e0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf2949a24 seltdwait(91a,e0000000,1,c695fc00,0,...) at seltdwait+0xbc/frame 0xf2949a58 kern_select(c695fc00,4,bfbfdc10,0,0,...) at kern_select+0x88c/frame 0xf2949bf8 sys_select(c695fc00,f2949cc8,c0eb1e30,c5fe5c90,0,...) at sys_select+0x69/frame 0xf2949c40 syscall(f2949d08) at syscall+0x2ed/frame 0xf2949cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2949cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28188f87, esp = 0xbfbfdb6c, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 569 tid 100115 td 0xc69b6600 sched_switch(c69b6600,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf29e7900 mi_switch(104,0,c108b461,1f5,400,...) at mi_switch+0x1c9/frame 0xf29e7934 sleepq_switch(c69b6600,0,c108b461,1ab,c6493b50,...) at sleepq_switch+0x1b9/frame 0xf29e7968 sleepq_catch_signals(c11b853c,f29e79d8,c0a723a9,c6493b60,0,...) at sleepq_catch_signals+0x361/frame 0xf29e79b0 sleepq_timedwait_sig(c6493b64,0,f29e7a10,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xf29e79d8 _cv_timedwait_sig_sbt(c6493b64,c6493b50,688a84a5,91a,e0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf29e7a24 seltdwait(91a,e0000000,1,c69b6600,0,...) at seltdwait+0xbc/frame 0xf29e7a58 kern_select(c69b6600,4,bfbfdc10,0,0,...) at kern_select+0x88c/frame 0xf29e7bf8 sys_select(c69b6600,f29e7cc8,c10dd55f,e9,0,...) at sys_select+0x69/frame 0xf29e7c40 syscall(f29e7d08) at syscall+0x2ed/frame 0xf29e7cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf29e7cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28188f87, esp = 0xbfbfdb6c, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 568 tid 100093 td 0xc6918900 sched_switch(c6918900,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf2969900 mi_switch(104,0,c108b461,1f5,400,...) at mi_switch+0x1c9/frame 0xf2969934 sleepq_switch(c6918900,0,c108b461,1ab,c64948d0,...) at sleepq_switch+0x1b9/frame 0xf2969968 sleepq_catch_signals(c11b853c,f29699d8,c0a723a9,c64948e0,0,...) at sleepq_catch_signals+0x361/frame 0xf29699b0 sleepq_timedwait_sig(c64948e4,0,f2969a10,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xf29699d8 _cv_timedwait_sig_sbt(c64948e4,c64948d0,b8aaa6f6,919,e0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf2969a24 seltdwait(919,e0000000,1,c6918900,0,...) at seltdwait+0xbc/frame 0xf2969a58 kern_select(c6918900,4,bfbfdc10,0,0,...) at kern_select+0x88c/frame 0xf2969bf8 sys_select(c6918900,f2969cc8,7b3,2,f2969cc4,...) at sys_select+0x69/frame 0xf2969c40 syscall(f2969d08) at syscall+0x2ed/frame 0xf2969cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2969cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28188f87, esp = 0xbfbfdb6c, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 567 tid 100112 td 0xc69b7000 Tracing command rpcbind pid 538 tid 100091 td 0xc695f600 sched_switch(c695f600,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf2961978 mi_switch(104,0,c108b461,1f5,400,...) at mi_switch+0x1c9/frame 0xf29619ac sleepq_switch(c695f600,0,c108b461,1ab,c6493390,...) at sleepq_switch+0x1b9/frame 0xf29619e0 sleepq_catch_signals(c11b853c,f2961a50,c0a723a9,c64933a0,0,...) at sleepq_catch_signals+0x361/frame 0xf2961a28 sleepq_timedwait_sig(c64933a4,0,f2961a88,dffffdd5,1,...) at sleepq_timedwait_sig+0x14/frame 0xf2961a50 _cv_timedwait_sig_sbt(c64933a4,c6493390,24f4effd,91c,dffffdd5,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf2961a9c seltdwait(91c,dffffdd5,1,c695f600,f2961b18,...) at seltdwait+0xbc/frame 0xf2961ad0 sys_poll(c695f600,f2961cc8,c0eb1e30,c5fe5c90,0,...) at sys_poll+0x44c/frame 0xf2961c40 syscall(f2961d08) at syscall+0x2ed/frame 0xf2961cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2961cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2813e2df, esp = 0xbfbfbbfc, ebp = 0xbfbfddd8 --- Tracing command syslogd pid 523 tid 100081 td 0xc6960000 sched_switch(c6960000,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf29399b8 mi_switch(104,0,c108b461,1f5,162,...) at mi_switch+0x1c9/frame 0xf29399ec sleepq_switch(c6960000,0,c108b461,26b,c6960000,...) at sleepq_switch+0x1b9/frame 0xf2939a20 sleepq_wait(e1510700,5c,c10bbd8b,0,0,...) at sleepq_wait+0x48/frame 0xf2939a44 _sleep(e1510700,c68eb4f8,25c,c10bbd8b,0,...) at _sleep+0x37c/frame 0xf2939aa0 getdirtybuf(1,4,c10bb10e,3097,c7097900,...) at getdirtybuf+0x255/frame 0xf2939ae0 flush_deplist(f2939b28,4,c10bb10e,866,c706e870,...) at flush_deplist+0x67/frame 0xf2939b04 softdep_sync_metadata(c706e870,c706e870,c706e910,f2939b58,c0b19db8,...) at softdep_sync_metadata+0x239/frame 0xf2939b38 ffs_syncvnode(c706e870,1,0,c706e870,246,...) at ffs_syncvnode+0x36/frame 0xf2939b90 ffs_fsync(f2939c18,c10e421e,c1097838,d95,0,...) at ffs_fsync+0x26/frame 0xf2939bb8 VOP_FSYNC_APV(c11e2d04,f2939c18,d95,0,0,...) at VOP_FSYNC_APV+0x124/frame 0xf2939be8 sys_fsync(c6960000,f2939cc8,c0eb1e30,c5fe8c90,0,...) at sys_fsync+0x190/frame 0xf2939c40 syscall(f2939d08) at syscall+0x2ed/frame 0xf2939cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf2939cfc --- syscall (95, FreeBSD ELF32, sys_fsync), eip = 0x2819cf03, esp = 0xbfbfceac, ebp = 0xbfbfde34 --- Tracing command devd pid 420 tid 100105 td 0xc69c4000 sched_switch(c69c4000,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xf29a8900 mi_switch(104,0,c108b461,1f5,400,...) at mi_switch+0x1c9/frame 0xf29a8934 sleepq_switch(c69c4000,0,c108b461,1ab,c6493a10,...) at sleepq_switch+0x1b9/frame 0xf29a8968 sleepq_catch_signals(c11b853c,f29a89d8,c0a723a9,c6493a20,0,...) at sleepq_catch_signals+0x361/frame 0xf29a89b0 sleepq_timedwait_sig(c6493a24,0,f29a8a10,c0000000,3,...) at sleepq_timedwait_sig+0x14/frame 0xf29a89d8 _cv_timedwait_sig_sbt(c6493a24,c6493a10,4ed03dba,924,c0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf29a8a24 seltdwait(924,c0000000,3,c69c4000,0,...) at seltdwait+0xbc/frame 0xf29a8a58 kern_select(c69c4000,5,bfbfd998,0,0,...) at kern_select+0x88c/frame 0xf29a8bf8 sys_select(c69c4000,f29a8cc8,c10dd55f,e9,0,...) at sys_select+0x69/frame 0xf29a8c40 syscall(f29a8d08) at syscall+0x2ed/frame 0xf29a8cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf29a8cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x8095dc3, esp = 0xbfbfd93c, ebp = 0xbfbfde54 --- Tracing command softdepflush pid 17 tid 100074 td 0xc6546000 sched_switch(c6546000,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xee1dcba4 mi_switch(104,0,c108b461,1f5,101,...) at mi_switch+0x1c9/frame 0xee1dcbd8 sleepq_switch(c6546000,0,c108b461,28e,c6546000,...) at sleepq_switch+0x1b9/frame 0xee1dcc0c sleepq_timedwait(c13ad214,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xee1dcc30 _sleep(c13ad214,c13ad194,54,c10bd9b0,fffffed8,...) at _sleep+0x345/frame 0xee1dcc8c softdep_flush(0,ee1dcd08,c107f270,3d7,0,...) at softdep_flush+0x27c/frame 0xee1dcccc fork_exit(c0ce7110,0,ee1dcd08) at fork_exit+0x7f/frame 0xee1dccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee1dccf4 --- trap 0, eip = 0, esp = 0xee1dcd40, ebp = 0 --- Tracing command syncer pid 16 tid 100073 td 0xc6546300 sched_switch(c6546300,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xee1d9b78 mi_switch(104,0,c108b461,1f5,8,...) at mi_switch+0x1c9/frame 0xee1d9bac sleepq_switch(c6546300,0,c108b461,28e,0,...) at sleepq_switch+0x1b9/frame 0xee1d9be0 sleepq_timedwait(c13a8ca4,0,ee1d9c3c,0,0,...) at sleepq_timedwait+0x48/frame 0xee1d9c04 _cv_timedwait_sbt(c13a8ca4,c13a8c84,fffffed8,0,0,...) at _cv_timedwait_sbt+0x228/frame 0xee1d9c50 sched_sync(0,ee1d9d08,c107f270,3d7,0,...) at sched_sync+0x682/frame 0xee1d9ccc fork_exit(c0b31610,0,ee1d9d08) at fork_exit+0x7f/frame 0xee1d9cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee1d9cf4 --- trap 0, eip = 0, esp = 0xee1d9d40, ebp = 0 --- Tracing command vnlru pid 9 tid 100072 td 0xc6546600 sched_switch(c6546600,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xee1d6b78 mi_switch(104,0,c108b461,1f5,101,...) at mi_switch+0x1c9/frame 0xee1d6bac sleepq_switch(c6546600,0,c108b461,28e,c6546600,...) at sleepq_switch+0x1b9/frame 0xee1d6be0 sleepq_timedwait(c6802ba0,60,0,0,0,...) at sleepq_timedwait+0x48/frame 0xee1d6c04 _sleep(c6802ba0,c13a8c5c,260,c10974b6,fffffed8,...) at _sleep+0x345/frame 0xee1d6c60 vnlru_proc(0,ee1d6d08,c107f270,3d7,0,...) at vnlru_proc+0xcf/frame 0xee1d6ccc fork_exit(c0b31e50,0,ee1d6d08) at fork_exit+0x7f/frame 0xee1d6cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee1d6cf4 --- trap 0, eip = 0, esp = 0xee1d6d40, ebp = 0 --- Tracing command bufdaemon pid 8 tid 100071 td 0xc6546900 sched_switch(c6546900,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xee1d3bb0 mi_switch(104,0,c108b461,1f5,101,...) at mi_switch+0x1c9/frame 0xee1d3be4 sleepq_switch(c6546900,0,c108b461,28e,c6546900,...) at sleepq_switch+0x1b9/frame 0xee1d3c18 sleepq_timedwait(c13a8a1c,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xee1d3c3c _sleep(c13a8a1c,c13a8a04,54,c1093f7c,fffffed8,...) at _sleep+0x345/frame 0xee1d3c98 buf_daemon(0,ee1d3d08,c107f270,3d7,0,...) at buf_daemon+0x8c/frame 0xee1d3ccc fork_exit(c0b15040,0,ee1d3d08) at fork_exit+0x7f/frame 0xee1d3cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee1d3cf4 --- trap 0, eip = 0, esp = 0xee1d3d40, ebp = 0 --- Tracing command pagezero pid 7 tid 100070 td 0xc6546c00 sched_switch(c6546c00,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xee1d0bac mi_switch(104,0,c108b461,1f5,101,...) at mi_switch+0x1c9/frame 0xee1d0be0 sleepq_switch(c6546c00,0,c108b461,28e,c6546c00,...) at sleepq_switch+0x1b9/frame 0xee1d0c14 sleepq_timedwait(c13adb14,0,12b,0,0,...) at sleepq_timedwait+0x48/frame 0xee1d0c38 _sleep(c13adb14,c1401c80,0,c10c4c47,fffea520,...) at _sleep+0x345/frame 0xee1d0c94 vm_pagezero(0,ee1d0d08,c107f270,3d7,0,...) at vm_pagezero+0xc2/frame 0xee1d0ccc fork_exit(c0d2e610,0,ee1d0d08) at fork_exit+0x7f/frame 0xee1d0cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee1d0cf4 --- trap 0, eip = 0, esp = 0xee1d0d40, ebp = 0 --- Tracing command vmdaemon pid 6 tid 100069 td 0xc6547000 sched_switch(c6547000,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xee1cdb78 mi_switch(104,0,c108b461,1f5,162,...) at mi_switch+0x1c9/frame 0xee1cdbac sleepq_switch(c6547000,0,c108b461,26b,c6547000,...) at sleepq_switch+0x1b9/frame 0xee1cdbe0 sleepq_wait(c13ad6dc,74,c1093f7c,0,0,...) at sleepq_wait+0x48/frame 0xee1cdc04 _sleep(c13ad6dc,c13ad6c4,74,c1093f7c,0,...) at _sleep+0x37c/frame 0xee1cdc60 vm_daemon(0,ee1cdd08,c107f270,3d7,0,...) at vm_daemon+0xac/frame 0xee1cdccc fork_exit(c0d26270,0,ee1cdd08) at fork_exit+0x7f/frame 0xee1cdcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee1cdcf4 --- trap 0, eip = 0, esp = 0xee1cdd40, ebp = 0 --- Tracing command pagedaemon pid 5 tid 100068 td 0xc6547300 sched_switch(c6547300,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xee1cab30 mi_switch(104,0,c108b461,1f5,101,...) at mi_switch+0x1c9/frame 0xee1cab64 sleepq_switch(c6547300,0,c108b461,28e,c6547300,...) at sleepq_switch+0x1b9/frame 0xee1cab98 sleepq_timedwait(c1401d04,54,4,0,0,...) at sleepq_timedwait+0x48/frame 0xee1cabbc _sleep(c1401d04,c1401c80,54,c1093f7c,fffffa38,...) at _sleep+0x345/frame 0xee1cac18 vm_pageout(0,ee1cad08,c107f270,3d7,0,...) at vm_pageout+0x290/frame 0xee1caccc fork_exit(c0d26a90,0,ee1cad08) at fork_exit+0x7f/frame 0xee1cacf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee1cacf4 --- trap 0, eip = 0, esp = 0xee1cad40, ebp = 0 --- Tracing command xpt_thrd pid 4 tid 100067 td 0xc6547600 sched_switch(c6547600,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xee047bb0 mi_switch(104,0,c108b461,1f5,162,...) at mi_switch+0x1c9/frame 0xee047be4 sleepq_switch(c6547600,0,c108b461,26b,c6547600,...) at sleepq_switch+0x1b9/frame 0xee047c18 sleepq_wait(c11fd824,5c,c0ed9b80,0,0,...) at sleepq_wait+0x48/frame 0xee047c3c _sleep(c11fd824,c11fd874,5c,c0ed9b80,0,...) at _sleep+0x37c/frame 0xee047c98 xpt_scanner_thread(0,ee047d08,c107f270,3d7,0,...) at xpt_scanner_thread+0x11c/frame 0xee047ccc fork_exit(c04b2110,0,ee047d08) at fork_exit+0x7f/frame 0xee047cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee047cf4 --- trap 0, eip = 0, esp = 0xee047d40, ebp = 0 --- Tracing command sctp_iterator pid 3 tid 100066 td 0xc6547900 sched_switch(c6547900,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xee044bb8 mi_switch(104,0,c108b461,1f5,162,...) at mi_switch+0x1c9/frame 0xee044bec sleepq_switch(c6547900,0,c108b461,26b,c6547900,...) at sleepq_switch+0x1b9/frame 0xee044c20 sleepq_wait(c13fd6d8,0,c10aa9f5,0,0,...) at sleepq_wait+0x48/frame 0xee044c44 _sleep(c13fd6d8,c13fd6a0,0,c10aa9f5,0,...) at _sleep+0x37c/frame 0xee044ca0 sctp_iterator_thread(0,ee044d08,c107f270,3d7,0,...) at sctp_iterator_thread+0x7c/frame 0xee044ccc fork_exit(c0bd0f50,0,ee044d08) at fork_exit+0x7f/frame 0xee044cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee044cf4 --- trap 0, eip = 0, esp = 0xee044d40, ebp = 0 --- Tracing command fdc0 pid 2 tid 100061 td 0xc64e2900 sched_switch(c64e2900,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xee034b48 mi_switch(104,0,c108b461,1f5,101,...) at mi_switch+0x1c9/frame 0xee034b7c sleepq_switch(c64e2900,0,c108b461,28e,c64e2900,...) at sleepq_switch+0x1b9/frame 0xee034bb0 sleepq_timedwait(c6481e3c,5c,0,0,0,...) at sleepq_timedwait+0x48/frame 0xee034bd4 _sleep(c6481e3c,c6481ef0,5c,c1071652,fffffed8,...) at _sleep+0x345/frame 0xee034c30 fdc_thread(c6481e00,ee034d08,c107f270,3d7,0,...) at fdc_thread+0x877/frame 0xee034ccc fork_exit(c0e38df0,c6481e00,ee034d08) at fork_exit+0x7f/frame 0xee034cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee034cf4 --- trap 0, eip = 0, esp = 0xee034d40, ebp = 0 --- Tracing command usb pid 15 tid 100058 td 0xc64ed300 sched_switch(c64ed300,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xee010bd4 mi_switch(104,0,c108b461,1f5,8,...) at mi_switch+0x1c9/frame 0xee010c08 sleepq_switch(c64ed300,0,c108b461,26b,c64ed300,...) at sleepq_switch+0x1b9/frame 0xee010c3c sleepq_wait(c64f8d34,0,ee010c90,1,0,...) at sleepq_wait+0x48/frame 0xee010c60 _cv_wait(c64f8d34,c64f8e4c,c1062e27,77,c64f8d3c,...) at _cv_wait+0x1f9/frame 0xee010ca4 usb_process(c64f8d2c,ee010d08,c107f270,3d7,0,...) at usb_process+0xe6/frame 0xee010ccc fork_exit(c09365d0,c64f8d2c,ee010d08) at fork_exit+0x7f/frame 0xee010cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee010cf4 --- trap 0, eip = 0, esp = 0xee010d40, ebp = 0 --- Tracing command usb pid 15 tid 100057 td 0xc64ed600 sched_switch(c64ed600,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xee00dbd4 mi_switch(104,0,c108b461,1f5,8,...) at mi_switch+0x1c9/frame 0xee00dc08 sleepq_switch(c64ed600,0,c108b461,26b,c64ed600,...) at sleepq_switch+0x1b9/frame 0xee00dc3c sleepq_wait(c64f8d04,0,ee00dc90,1,0,...) at sleepq_wait+0x48/frame 0xee00dc60 _cv_wait(c64f8d04,c64f8e4c,c1062e27,77,c64f8d0c,...) at _cv_wait+0x1f9/frame 0xee00dca4 usb_process(c64f8cfc,ee00dd08,c107f270,3d7,0,...) at usb_process+0xe6/frame 0xee00dccc fork_exit(c09365d0,c64f8cfc,ee00dd08) at fork_exit+0x7f/frame 0xee00dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee00dcf4 --- trap 0, eip = 0, esp = 0xee00dd40, ebp = 0 --- Tracing command usb pid 15 tid 100056 td 0xc64ed900 sched_switch(c64ed900,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xee00abd4 mi_switch(104,0,c108b461,1f5,8,...) at mi_switch+0x1c9/frame 0xee00ac08 sleepq_switch(c64ed900,0,c108b461,26b,c64ed900,...) at sleepq_switch+0x1b9/frame 0xee00ac3c sleepq_wait(c64f8cd4,0,ee00ac90,1,0,...) at sleepq_wait+0x48/frame 0xee00ac60 _cv_wait(c64f8cd4,c64f8e4c,c1062e27,77,c64f8cdc,...) at _cv_wait+0x1f9/frame 0xee00aca4 usb_process(c64f8ccc,ee00ad08,c107f270,3d7,0,...) at usb_process+0xe6/frame 0xee00accc fork_exit(c09365d0,c64f8ccc,ee00ad08) at fork_exit+0x7f/frame 0xee00acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee00acf4 --- trap 0, eip = 0, esp = 0xee00ad40, ebp = 0 --- Tracing command usb pid 15 tid 100055 td 0xc64edc00 sched_switch(c64edc00,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xee007bd4 mi_switch(104,0,c108b461,1f5,8,...) at mi_switch+0x1c9/frame 0xee007c08 sleepq_switch(c64edc00,0,c108b461,26b,c64edc00,...) at sleepq_switch+0x1b9/frame 0xee007c3c sleepq_wait(c64f8ca4,0,ee007c90,1,0,...) at sleepq_wait+0x48/frame 0xee007c60 _cv_wait(c64f8ca4,c64f8e4c,c1062e27,77,c64f8cac,...) at _cv_wait+0x1f9/frame 0xee007ca4 usb_process(c64f8c9c,ee007d08,c107f270,3d7,0,...) at usb_process+0xe6/frame 0xee007ccc fork_exit(c09365d0,c64f8c9c,ee007d08) at fork_exit+0x7f/frame 0xee007cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee007cf4 --- trap 0, eip = 0, esp = 0xee007d40, ebp = 0 --- Tracing command usb pid 15 tid 100053 td 0xc64f0300 sched_switch(c64f0300,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xedffebd4 mi_switch(104,0,c108b461,1f5,8,...) at mi_switch+0x1c9/frame 0xedffec08 sleepq_switch(c64f0300,0,c108b461,26b,c64f0300,...) at sleepq_switch+0x1b9/frame 0xedffec3c sleepq_wait(c64e9b5c,0,edffec90,1,0,...) at sleepq_wait+0x48/frame 0xedffec60 _cv_wait(c64e9b5c,c64e9c74,c1062e27,77,c64e9b64,...) at _cv_wait+0x1f9/frame 0xedffeca4 usb_process(c64e9b54,edffed08,c107f270,3d7,0,...) at usb_process+0xe6/frame 0xedffeccc fork_exit(c09365d0,c64e9b54,edffed08) at fork_exit+0x7f/frame 0xedffecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedffecf4 --- trap 0, eip = 0, esp = 0xedffed40, ebp = 0 --- Tracing command usb pid 15 tid 100052 td 0xc64f0600 sched_switch(c64f0600,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xedffbbd4 mi_switch(104,0,c108b461,1f5,8,...) at mi_switch+0x1c9/frame 0xedffbc08 sleepq_switch(c64f0600,0,c108b461,26b,c64f0600,...) at sleepq_switch+0x1b9/frame 0xedffbc3c sleepq_wait(c64e9b2c,0,edffbc90,1,0,...) at sleepq_wait+0x48/frame 0xedffbc60 _cv_wait(c64e9b2c,c64e9c74,c1062e27,77,c64e9b34,...) at _cv_wait+0x1f9/frame 0xedffbca4 usb_process(c64e9b24,edffbd08,c107f270,3d7,0,...) at usb_process+0xe6/frame 0xedffbccc fork_exit(c09365d0,c64e9b24,edffbd08) at fork_exit+0x7f/frame 0xedffbcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedffbcf4 --- trap 0, eip = 0, esp = 0xedffbd40, ebp = 0 --- Tracing command usb pid 15 tid 100051 td 0xc64e0000 sched_switch(c64e0000,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xedff8bd4 mi_switch(104,0,c108b461,1f5,8,...) at mi_switch+0x1c9/frame 0xedff8c08 sleepq_switch(c64e0000,0,c108b461,26b,c64e0000,...) at sleepq_switch+0x1b9/frame 0xedff8c3c sleepq_wait(c64e9afc,0,edff8c90,1,0,...) at sleepq_wait+0x48/frame 0xedff8c60 _cv_wait(c64e9afc,c64e9c74,c1062e27,77,c64e9b04,...) at _cv_wait+0x1f9/frame 0xedff8ca4 usb_process(c64e9af4,edff8d08,c107f270,3d7,0,...) at usb_process+0xe6/frame 0xedff8ccc fork_exit(c09365d0,c64e9af4,edff8d08) at fork_exit+0x7f/frame 0xedff8cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedff8cf4 --- trap 0, eip = 0, esp = 0xedff8d40, ebp = 0 --- Tracing command usb pid 15 tid 100050 td 0xc64e0300 sched_switch(c64e0300,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xedff5bd4 mi_switch(104,0,c108b461,1f5,8,...) at mi_switch+0x1c9/frame 0xedff5c08 sleepq_switch(c64e0300,0,c108b461,26b,c64e0300,...) at sleepq_switch+0x1b9/frame 0xedff5c3c sleepq_wait(c64e9acc,0,edff5c90,1,0,...) at sleepq_wait+0x48/frame 0xedff5c60 _cv_wait(c64e9acc,c64e9c74,c1062e27,77,c64e9ad4,...) at _cv_wait+0x1f9/frame 0xedff5ca4 usb_process(c64e9ac4,edff5d08,c107f270,3d7,0,...) at usb_process+0xe6/frame 0xedff5ccc fork_exit(c09365d0,c64e9ac4,edff5d08) at fork_exit+0x7f/frame 0xedff5cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedff5cf4 --- trap 0, eip = 0, esp = 0xedff5d40, ebp = 0 --- Tracing command usb pid 15 tid 100049 td 0xc64e0600 sched_switch(c64e0600,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xedff1bd4 mi_switch(104,0,c108b461,1f5,8,...) at mi_switch+0x1c9/frame 0xedff1c08 sleepq_switch(c64e0600,0,c108b461,26b,c64e0600,...) at sleepq_switch+0x1b9/frame 0xedff1c3c sleepq_wait(c64e3b5c,0,edff1c90,1,0,...) at sleepq_wait+0x48/frame 0xedff1c60 _cv_wait(c64e3b5c,c64e3c74,c1062e27,77,c64e3b64,...) at _cv_wait+0x1f9/frame 0xedff1ca4 usb_process(c64e3b54,edff1d08,c107f270,3d7,0,...) at usb_process+0xe6/frame 0xedff1ccc fork_exit(c09365d0,c64e3b54,edff1d08) at fork_exit+0x7f/frame 0xedff1cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedff1cf4 --- trap 0, eip = 0, esp = 0xedff1d40, ebp = 0 --- Tracing command usb pid 15 tid 100048 td 0xc64e0900 sched_switch(c64e0900,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xedfeebd4 mi_switch(104,0,c108b461,1f5,8,...) at mi_switch+0x1c9/frame 0xedfeec08 sleepq_switch(c64e0900,0,c108b461,26b,c64e0900,...) at sleepq_switch+0x1b9/frame 0xedfeec3c sleepq_wait(c64e3b2c,0,edfeec90,1,0,...) at sleepq_wait+0x48/frame 0xedfeec60 _cv_wait(c64e3b2c,c64e3c74,c1062e27,77,c64e3b34,...) at _cv_wait+0x1f9/frame 0xedfeeca4 usb_process(c64e3b24,edfeed08,c107f270,3d7,0,...) at usb_process+0xe6/frame 0xedfeeccc fork_exit(c09365d0,c64e3b24,edfeed08) at fork_exit+0x7f/frame 0xedfeecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedfeecf4 --- trap 0, eip = 0, esp = 0xedfeed40, ebp = 0 --- Tracing command usb pid 15 tid 100047 td 0xc64e0c00 sched_switch(c64e0c00,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xedfebbd4 mi_switch(104,0,c108b461,1f5,8,...) at mi_switch+0x1c9/frame 0xedfebc08 sleepq_switch(c64e0c00,0,c108b461,26b,c64e0c00,...) at sleepq_switch+0x1b9/frame 0xedfebc3c sleepq_wait(c64e3afc,0,edfebc90,1,0,...) at sleepq_wait+0x48/frame 0xedfebc60 _cv_wait(c64e3afc,c64e3c74,c1062e27,77,c64e3b04,...) at _cv_wait+0x1f9/frame 0xedfebca4 usb_process(c64e3af4,edfebd08,c107f270,3d7,0,...) at usb_process+0xe6/frame 0xedfebccc fork_exit(c09365d0,c64e3af4,edfebd08) at fork_exit+0x7f/frame 0xedfebcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedfebcf4 --- trap 0, eip = 0, esp = 0xedfebd40, ebp = 0 --- Tracing command usb pid 15 tid 100046 td 0xc64e1000 sched_switch(c64e1000,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xedfe8bd4 mi_switch(104,0,c108b461,1f5,8,...) at mi_switch+0x1c9/frame 0xedfe8c08 sleepq_switch(c64e1000,0,c108b461,26b,c64e1000,...) at sleepq_switch+0x1b9/frame 0xedfe8c3c sleepq_wait(c64e3acc,0,edfe8c90,1,0,...) at sleepq_wait+0x48/frame 0xedfe8c60 _cv_wait(c64e3acc,c64e3c74,c1062e27,77,c64e3ad4,...) at _cv_wait+0x1f9/frame 0xedfe8ca4 usb_process(c64e3ac4,edfe8d08,c107f270,3d7,0,...) at usb_process+0xe6/frame 0xedfe8ccc fork_exit(c09365d0,c64e3ac4,edfe8d08) at fork_exit+0x7f/frame 0xedfe8cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedfe8cf4 --- trap 0, eip = 0, esp = 0xedfe8d40, ebp = 0 --- Tracing command usb pid 15 tid 100045 td 0xc64e1300 sched_switch(c64e1300,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xedfe4bd4 mi_switch(104,0,c108b461,1f5,8,...) at mi_switch+0x1c9/frame 0xedfe4c08 sleepq_switch(c64e1300,0,c108b461,26b,c64e1300,...) at sleepq_switch+0x1b9/frame 0xedfe4c3c sleepq_wait(c64dbb5c,0,edfe4c90,1,0,...) at sleepq_wait+0x48/frame 0xedfe4c60 _cv_wait(c64dbb5c,c64dbc74,c1062e27,77,c64dbb64,...) at _cv_wait+0x1f9/frame 0xedfe4ca4 usb_process(c64dbb54,edfe4d08,c107f270,3d7,0,...) at usb_process+0xe6/frame 0xedfe4ccc fork_exit(c09365d0,c64dbb54,edfe4d08) at fork_exit+0x7f/frame 0xedfe4cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedfe4cf4 --- trap 0, eip = 0, esp = 0xedfe4d40, ebp = 0 --- Tracing command usb pid 15 tid 100044 td 0xc64e1600 sched_switch(c64e1600,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xedfe1bd4 mi_switch(104,0,c108b461,1f5,8,...) at mi_switch+0x1c9/frame 0xedfe1c08 sleepq_switch(c64e1600,0,c108b461,26b,c64e1600,...) at sleepq_switch+0x1b9/frame 0xedfe1c3c sleepq_wait(c64dbb2c,0,edfe1c90,1,0,...) at sleepq_wait+0x48/frame 0xedfe1c60 _cv_wait(c64dbb2c,c64dbc74,c1062e27,77,c64dbb34,...) at _cv_wait+0x1f9/frame 0xedfe1ca4 usb_process(c64dbb24,edfe1d08,c107f270,3d7,0,...) at usb_process+0xe6/frame 0xedfe1ccc fork_exit(c09365d0,c64dbb24,edfe1d08) at fork_exit+0x7f/frame 0xedfe1cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedfe1cf4 --- trap 0, eip = 0, esp = 0xedfe1d40, ebp = 0 --- Tracing command usb pid 15 tid 100043 td 0xc64e1900 sched_switch(c64e1900,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xedfdebd4 mi_switch(104,0,c108b461,1f5,8,...) at mi_switch+0x1c9/frame 0xedfdec08 sleepq_switch(c64e1900,0,c108b461,26b,c64e1900,...) at sleepq_switch+0x1b9/frame 0xedfdec3c sleepq_wait(c64dbafc,0,edfdec90,1,0,...) at sleepq_wait+0x48/frame 0xedfdec60 _cv_wait(c64dbafc,c64dbc74,c1062e27,77,c64dbb04,...) at _cv_wait+0x1f9/frame 0xedfdeca4 usb_process(c64dbaf4,edfded08,c107f270,3d7,0,...) at usb_process+0xe6/frame 0xedfdeccc fork_exit(c09365d0,c64dbaf4,edfded08) at fork_exit+0x7f/frame 0xedfdecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedfdecf4 --- trap 0, eip = 0, esp = 0xedfded40, ebp = 0 --- Tracing command usb pid 15 tid 100042 td 0xc64e1c00 sched_switch(c64e1c00,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xedfdbbd4 mi_switch(104,0,c108b461,1f5,8,...) at mi_switch+0x1c9/frame 0xedfdbc08 sleepq_switch(c64e1c00,0,c108b461,26b,c64e1c00,...) at sleepq_switch+0x1b9/frame 0xedfdbc3c sleepq_wait(c64dbacc,0,edfdbc90,1,0,...) at sleepq_wait+0x48/frame 0xedfdbc60 _cv_wait(c64dbacc,c64dbc74,c1062e27,77,c64dbad4,...) at _cv_wait+0x1f9/frame 0xedfdbca4 usb_process(c64dbac4,edfdbd08,c107f270,3d7,0,...) at usb_process+0xe6/frame 0xedfdbccc fork_exit(c09365d0,c64dbac4,edfdbd08) at fork_exit+0x7f/frame 0xedfdbcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedfdbcf4 --- trap 0, eip = 0, esp = 0xedfdbd40, ebp = 0 --- Tracing command usb pid 15 tid 100040 td 0xc64d1000 sched_switch(c64d1000,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xedfd4bd4 mi_switch(104,0,c108b461,1f5,8,...) at mi_switch+0x1c9/frame 0xedfd4c08 sleepq_switch(c64d1000,0,c108b461,26b,c64d1000,...) at sleepq_switch+0x1b9/frame 0xedfd4c3c sleepq_wait(c64d7b5c,0,edfd4c90,1,0,...) at sleepq_wait+0x48/frame 0xedfd4c60 _cv_wait(c64d7b5c,c64d7c74,c1062e27,77,c64d7b64,...) at _cv_wait+0x1f9/frame 0xedfd4ca4 usb_process(c64d7b54,edfd4d08,c107f270,3d7,0,...) at usb_process+0xe6/frame 0xedfd4ccc fork_exit(c09365d0,c64d7b54,edfd4d08) at fork_exit+0x7f/frame 0xedfd4cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedfd4cf4 --- trap 0, eip = 0, esp = 0xedfd4d40, ebp = 0 --- Tracing command usb pid 15 tid 100039 td 0xc64d1300 sched_switch(c64d1300,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xedfd1bd4 mi_switch(104,0,c108b461,1f5,8,...) at mi_switch+0x1c9/frame 0xedfd1c08 sleepq_switch(c64d1300,0,c108b461,26b,c64d1300,...) at sleepq_switch+0x1b9/frame 0xedfd1c3c sleepq_wait(c64d7b2c,0,edfd1c90,1,0,...) at sleepq_wait+0x48/frame 0xedfd1c60 _cv_wait(c64d7b2c,c64d7c74,c1062e27,77,c64d7b34,...) at _cv_wait+0x1f9/frame 0xedfd1ca4 usb_process(c64d7b24,edfd1d08,c107f270,3d7,0,...) at usb_process+0xe6/frame 0xedfd1ccc fork_exit(c09365d0,c64d7b24,edfd1d08) at fork_exit+0x7f/frame 0xedfd1cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedfd1cf4 --- trap 0, eip = 0, esp = 0xedfd1d40, ebp = 0 --- Tracing command usb pid 15 tid 100038 td 0xc64d1600 sched_switch(c64d1600,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xedfcebd4 mi_switch(104,0,c108b461,1f5,8,...) at mi_switch+0x1c9/frame 0xedfcec08 sleepq_switch(c64d1600,0,c108b461,26b,c64d1600,...) at sleepq_switch+0x1b9/frame 0xedfcec3c sleepq_wait(c64d7afc,0,edfcec90,1,0,...) at sleepq_wait+0x48/frame 0xedfcec60 _cv_wait(c64d7afc,c64d7c74,c1062e27,77,c64d7b04,...) at _cv_wait+0x1f9/frame 0xedfceca4 usb_process(c64d7af4,edfced08,c107f270,3d7,0,...) at usb_process+0xe6/frame 0xedfceccc fork_exit(c09365d0,c64d7af4,edfced08) at fork_exit+0x7f/frame 0xedfcecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedfcecf4 --- trap 0, eip = 0, esp = 0xedfced40, ebp = 0 --- Tracing command usb pid 15 tid 100037 td 0xc64d1900 sched_switch(c64d1900,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xedfcbbd4 mi_switch(104,0,c108b461,1f5,8,...) at mi_switch+0x1c9/frame 0xedfcbc08 sleepq_switch(c64d1900,0,c108b461,26b,c64d1900,...) at sleepq_switch+0x1b9/frame 0xedfcbc3c sleepq_wait(c64d7acc,0,edfcbc90,1,0,...) at sleepq_wait+0x48/frame 0xedfcbc60 _cv_wait(c64d7acc,c64d7c74,c1062e27,77,c64d7ad4,...) at _cv_wait+0x1f9/frame 0xedfcbca4 usb_process(c64d7ac4,edfcbd08,c107f270,3d7,0,...) at usb_process+0xe6/frame 0xedfcbccc fork_exit(c09365d0,c64d7ac4,edfcbd08) at fork_exit+0x7f/frame 0xedfcbcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedfcbcf4 --- trap 0, eip = 0, esp = 0xedfcbd40, ebp = 0 --- Tracing command usb pid 15 tid 100035 td 0xc64d4000 sched_switch(c64d4000,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xedfc4bd4 mi_switch(104,0,c108b461,1f5,8,...) at mi_switch+0x1c9/frame 0xedfc4c08 sleepq_switch(c64d4000,0,c108b461,26b,c64d4000,...) at sleepq_switch+0x1b9/frame 0xedfc4c3c sleepq_wait(c64cdb5c,0,edfc4c90,1,0,...) at sleepq_wait+0x48/frame 0xedfc4c60 _cv_wait(c64cdb5c,c64cdc74,c1062e27,77,c64cdb64,...) at _cv_wait+0x1f9/frame 0xedfc4ca4 usb_process(c64cdb54,edfc4d08,c107f270,3d7,0,...) at usb_process+0xe6/frame 0xedfc4ccc fork_exit(c09365d0,c64cdb54,edfc4d08) at fork_exit+0x7f/frame 0xedfc4cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedfc4cf4 --- trap 0, eip = 0, esp = 0xedfc4d40, ebp = 0 --- Tracing command usb pid 15 tid 100034 td 0xc64d4300 sched_switch(c64d4300,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xedfc1bd4 mi_switch(104,0,c108b461,1f5,8,...) at mi_switch+0x1c9/frame 0xedfc1c08 sleepq_switch(c64d4300,0,c108b461,26b,c64d4300,...) at sleepq_switch+0x1b9/frame 0xedfc1c3c sleepq_wait(c64cdb2c,0,edfc1c90,1,0,...) at sleepq_wait+0x48/frame 0xedfc1c60 _cv_wait(c64cdb2c,c64cdc74,c1062e27,77,c64cdb34,...) at _cv_wait+0x1f9/frame 0xedfc1ca4 usb_process(c64cdb24,edfc1d08,c107f270,3d7,0,...) at usb_process+0xe6/frame 0xedfc1ccc fork_exit(c09365d0,c64cdb24,edfc1d08) at fork_exit+0x7f/frame 0xedfc1cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedfc1cf4 --- trap 0, eip = 0, esp = 0xedfc1d40, ebp = 0 --- Tracing command usb pid 15 tid 100033 td 0xc64d4600 sched_switch(c64d4600,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xedfbebd4 mi_switch(104,0,c108b461,1f5,8,...) at mi_switch+0x1c9/frame 0xedfbec08 sleepq_switch(c64d4600,0,c108b461,26b,c64d4600,...) at sleepq_switch+0x1b9/frame 0xedfbec3c sleepq_wait(c64cdafc,0,edfbec90,1,0,...) at sleepq_wait+0x48/frame 0xedfbec60 _cv_wait(c64cdafc,c64cdc74,c1062e27,77,c64cdb04,...) at _cv_wait+0x1f9/frame 0xedfbeca4 usb_process(c64cdaf4,edfbed08,c107f270,3d7,0,...) at usb_process+0xe6/frame 0xedfbeccc fork_exit(c09365d0,c64cdaf4,edfbed08) at fork_exit+0x7f/frame 0xedfbecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedfbecf4 --- trap 0, eip = 0, esp = 0xedfbed40, ebp = 0 --- Tracing command usb pid 15 tid 100032 td 0xc64d4900 sched_switch(c64d4900,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xedfbbbd4 mi_switch(104,0,c108b461,1f5,8,...) at mi_switch+0x1c9/frame 0xedfbbc08 sleepq_switch(c64d4900,0,c108b461,26b,c64d4900,...) at sleepq_switch+0x1b9/frame 0xedfbbc3c sleepq_wait(c64cdacc,0,edfbbc90,1,0,...) at sleepq_wait+0x48/frame 0xedfbbc60 _cv_wait(c64cdacc,c64cdc74,c1062e27,77,c64cdad4,...) at _cv_wait+0x1f9/frame 0xedfbbca4 usb_process(c64cdac4,edfbbd08,c107f270,3d7,0,...) at usb_process+0xe6/frame 0xedfbbccc fork_exit(c09365d0,c64cdac4,edfbbd08) at fork_exit+0x7f/frame 0xedfbbcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedfbbcf4 --- trap 0, eip = 0, esp = 0xedfbbd40, ebp = 0 --- Tracing command yarrow pid 14 tid 100017 td 0xc6374600 sched_switch(c6374600,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xe1609bb4 mi_switch(104,0,c108b461,1f5,c124e330,...) at mi_switch+0x1c9/frame 0xe1609be8 sleepq_switch(c6374600,0,c108b461,28e,c1217984,...) at sleepq_switch+0x1b9/frame 0xe1609c1c sleepq_timedwait(c1217984,0,c108636d,c1071652,0,...) at sleepq_timedwait+0x48/frame 0xe1609c40 msleep_spin_sbt(c1217984,c13f8010,c1071652,19999999,0,...) at msleep_spin_sbt+0x225/frame 0xe1609c88 random_kthread(0,e1609d08,c107f270,3d7,0,...) at random_kthread+0x2ea/frame 0xe1609ccc fork_exit(c0824da0,0,e1609d08) at fork_exit+0x7f/frame 0xe1609cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe1609cf4 --- trap 0, eip = 0, esp = 0xe1609d40, ebp = 0 --- Tracing command geom pid 13 tid 100016 td 0xc6374900 sched_switch(c6374900,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xe1605b70 mi_switch(104,0,c108b461,1f5,162,...) at mi_switch+0x1c9/frame 0xe1605ba4 sleepq_switch(c6374900,0,c108b461,26b,c6374900,...) at sleepq_switch+0x1b9/frame 0xe1605bd8 sleepq_wait(c13f92e0,5c,c1071652,0,0,...) at sleepq_wait+0x48/frame 0xe1605bfc _sleep(c13f92e0,c122ef2c,25c,c1071652,0,...) at _sleep+0x37c/frame 0xe1605c58 g_io_schedule_down(c6374900,0,c1073291,6c,e1605cf4,...) at g_io_schedule_down+0x5c/frame 0xe1605cb4 g_down_procbody(0,e1605d08,c107f270,3d7,0,...) at g_down_procbody+0x9d/frame 0xe1605ccc fork_exit(c09e5430,0,e1605d08) at fork_exit+0x7f/frame 0xe1605cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe1605cf4 --- trap 0, eip = 0, esp = 0xe1605d40, ebp = 0 --- Tracing command geom pid 13 tid 100015 td 0xc6374c00 cpustop_handler(0,13,e1602a8c,c0eaa13b,c124e3a8,...) at cpustop_handler+0x2f/frame 0xe1602940 ipi_nmi_handler(c124e3a8,1,0,80000000,1c0,...) at ipi_nmi_handler+0x37/frame 0xe1602950 trap(e1602a98) at trap+0x3b/frame 0xe1602a8c calltrap() at calltrap+0x6/frame 0xe1602a8c --- trap 0x13, eip = 0xc0e9ee47, esp = 0xe1602ad8, ebp = 0xe1602b08 --- smp_tlb_shootdown(e1aa8000) at smp_tlb_shootdown+0xd7/frame 0xe1602b08 smp_invlpg_range(e1aa4000,e1aa8000,0,0,e1602b6c,...) at smp_invlpg_range+0x23/frame 0xe1602b14 pmap_qremove(e1aa4000,4,0,e1513480,c6d88c00,...) at pmap_qremove+0x69/frame 0xe1602b2c allocbuf(e15132f0,0,246,c68f4b00,0,...) at allocbuf+0x515/frame 0xe1602b6c brelse(e15132f0,c109611f,c6374c00,e15106a4,e15106a4,...) at brelse+0x193/frame 0xe1602bc8 bufdone(e15132f0,0,c10bdd39,7d3,e15132f0,...) at bufdone+0xd3/frame 0xe1602be8 ffs_backgroundwritedone(e15132f0,0,c109322c,193,e15132f0,...) at ffs_backgroundwritedone+0xc5/frame 0xe1602c0c bufdone(e15132f0,0,c10741f6,9d,c67f3880) at bufdone+0xc9/frame 0xe1602c2c g_vfs_done(c67f5cd0,0,c109322c,e0c,0,...) at g_vfs_done+0x22c/frame 0xe1602c54 biodone(c67f5cd0,0,c1073076,60,0,...) at biodone+0xb2/frame 0xe1602c80 g_io_schedule_up(c6374c00,0,c1073291,5f,e1602cf4,...) at g_io_schedule_up+0x129/frame 0xe1602cb4 g_up_procbody(0,e1602d08,c107f270,3d7,0,...) at g_up_procbody+0x9d/frame 0xe1602ccc fork_exit(c09e5390,0,e1602d08) at fork_exit+0x7f/frame 0xe1602cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe1602cf4 --- trap 0, eip = 0, esp = 0xe1602d40, ebp = 0 --- Tracing command geom pid 13 tid 100014 td 0xc6375000 sched_switch(c6375000,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xe15ffba8 mi_switch(104,0,c108b461,1f5,162,...) at mi_switch+0x1c9/frame 0xe15ffbdc sleepq_switch(c6375000,0,c108b461,26b,c6375000,...) at sleepq_switch+0x1b9/frame 0xe15ffc10 sleepq_wait(c13f92d8,5c,c1071652,0,0,...) at sleepq_wait+0x48/frame 0xe15ffc34 _sleep(c13f92d8,c122ef04,25c,c1071652,0,...) at _sleep+0x37c/frame 0xe15ffc90 g_run_events(0,e15ffd08,c107f270,3d7,0,...) at g_run_events+0x566/frame 0xe15ffccc fork_exit(c09e52f0,0,e15ffd08) at fork_exit+0x7f/frame 0xe15ffcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe15ffcf4 --- trap 0, eip = 0, esp = 0xe15ffd40, ebp = 0 --- Tracing command intr pid 12 tid 100063 td 0xc64e2300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100062 td 0xc64e2600 sched_switch(c64e2600,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xee037c60 mi_switch(109,0,c107f50d,55a,8,...) at mi_switch+0x1c9/frame 0xee037c94 ithread_loop(c630f6b0,ee037d08,c107f270,3d7,0,...) at ithread_loop+0x100/frame 0xee037ccc fork_exit(c0a58330,c630f6b0,ee037d08) at fork_exit+0x7f/frame 0xee037cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee037cf4 --- trap 0, eip = 0, esp = 0xee037d40, ebp = 0 --- Tracing command intr pid 12 tid 100060 td 0xc64e2c00 sched_switch(c64e2c00,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xee027c60 mi_switch(109,0,c107f50d,55a,8,...) at mi_switch+0x1c9/frame 0xee027c94 ithread_loop(c630f6c0,ee027d08,c107f270,3d7,0,...) at ithread_loop+0x100/frame 0xee027ccc fork_exit(c0a58330,c630f6c0,ee027d08) at fork_exit+0x7f/frame 0xee027cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee027cf4 --- trap 0, eip = 0, esp = 0xee027d40, ebp = 0 --- Tracing command intr pid 12 tid 100059 td 0xc64ed000 sched_switch(c64ed000,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xee016c60 mi_switch(109,0,c107f50d,55a,8,...) at mi_switch+0x1c9/frame 0xee016c94 ithread_loop(c630f6e0,ee016d08,c107f270,3d7,0,...) at ithread_loop+0x100/frame 0xee016ccc fork_exit(c0a58330,c630f6e0,ee016d08) at fork_exit+0x7f/frame 0xee016cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee016cf4 --- trap 0, eip = 0, esp = 0xee016d40, ebp = 0 --- Tracing command intr pid 12 tid 100054 td 0xc64f0000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xc64e2000 sched_switch(c64e2000,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xedfd8c60 mi_switch(109,0,c107f50d,55a,8,...) at mi_switch+0x1c9/frame 0xedfd8c94 ithread_loop(c630f700,edfd8d08,c107f270,3d7,0,...) at ithread_loop+0x100/frame 0xedfd8ccc fork_exit(c0a58330,c630f700,edfd8d08) at fork_exit+0x7f/frame 0xedfd8cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedfd8cf4 --- trap 0, eip = 0, esp = 0xedfd8d40, ebp = 0 --- Tracing command intr pid 12 tid 100036 td 0xc64d1c00 sched_switch(c64d1c00,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xedfc8c60 mi_switch(109,0,c107f50d,55a,8,...) at mi_switch+0x1c9/frame 0xedfc8c94 ithread_loop(c630f710,edfc8d08,c107f270,3d7,0,...) at ithread_loop+0x100/frame 0xedfc8ccc fork_exit(c0a58330,c630f710,edfc8d08) at fork_exit+0x7f/frame 0xedfc8cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedfc8cf4 --- trap 0, eip = 0, esp = 0xedfc8d40, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xc64d4c00 sched_switch(c64d4c00,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xedfb8c60 mi_switch(109,0,c107f50d,55a,8,...) at mi_switch+0x1c9/frame 0xedfb8c94 ithread_loop(c630f720,edfb8d08,c107f270,3d7,0,...) at ithread_loop+0x100/frame 0xedfb8ccc fork_exit(c0a58330,c630f720,edfb8d08) at fork_exit+0x7f/frame 0xedfb8cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xedfb8cf4 --- trap 0, eip = 0, esp = 0xedfb8d40, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc6375300 sched_switch(c6375300,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xe1766c60 mi_switch(109,0,c107f50d,55a,8,...) at mi_switch+0x1c9/frame 0xe1766c94 ithread_loop(c630f730,e1766d08,c107f270,3d7,0,...) at ithread_loop+0x100/frame 0xe1766ccc fork_exit(c0a58330,c630f730,e1766d08) at fork_exit+0x7f/frame 0xe1766cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe1766cf4 --- trap 0, eip = 0, esp = 0xe1766d40, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc6375600 sched_switch(c6375600,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xe1762c60 mi_switch(109,0,c107f50d,55a,8,...) at mi_switch+0x1c9/frame 0xe1762c94 ithread_loop(c630f740,e1762d08,c107f270,3d7,0,...) at ithread_loop+0x100/frame 0xe1762ccc fork_exit(c0a58330,c630f740,e1762d08) at fork_exit+0x7f/frame 0xe1762cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe1762cf4 --- trap 0, eip = 0, esp = 0xe1762d40, ebp = 0 --- Tracing command intr pid 12 tid 100028 td 0xc6375900 sched_switch(c6375900,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xe1659c60 mi_switch(109,0,c107f50d,55a,8,...) at mi_switch+0x1c9/frame 0xe1659c94 ithread_loop(c630f750,e1659d08,c107f270,3d7,0,...) at ithread_loop+0x100/frame 0xe1659ccc fork_exit(c0a58330,c630f750,e1659d08) at fork_exit+0x7f/frame 0xe1659cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe1659cf4 --- trap 0, eip = 0, esp = 0xe1659d40, ebp = 0 --- Tracing command intr pid 12 tid 100027 td 0xc6375c00 sched_switch(c6375c00,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xe1627c60 mi_switch(109,0,c107f50d,55a,8,...) at mi_switch+0x1c9/frame 0xe1627c94 ithread_loop(c630f760,e1627d08,c107f270,3d7,0,...) at ithread_loop+0x100/frame 0xe1627ccc fork_exit(c0a58330,c630f760,e1627d08) at fork_exit+0x7f/frame 0xe1627cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe1627cf4 --- trap 0, eip = 0, esp = 0xe1627d40, ebp = 0 --- Tracing command intr pid 12 tid 100025 td 0xc6460300 sched_switch(c6460300,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xe1621c60 mi_switch(109,0,c107f50d,55a,8,...) at mi_switch+0x1c9/frame 0xe1621c94 ithread_loop(c630f770,e1621d08,c107f270,3d7,0,...) at ithread_loop+0x100/frame 0xe1621ccc fork_exit(c0a58330,c630f770,e1621d08) at fork_exit+0x7f/frame 0xe1621cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe1621cf4 --- trap 0, eip = 0, esp = 0xe1621d40, ebp = 0 --- Tracing command intr pid 12 tid 100020 td 0xc6310c00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100018 td 0xc6374300 sched_switch(c6374300,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xe160cc60 mi_switch(109,0,c107f50d,55a,8,...) at mi_switch+0x1c9/frame 0xe160cc94 ithread_loop(c630f790,e160cd08,c107f270,3d7,0,...) at ithread_loop+0x100/frame 0xe160cccc fork_exit(c0a58330,c630f790,e160cd08) at fork_exit+0x7f/frame 0xe160ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe160ccf4 --- trap 0, eip = 0, esp = 0xe160cd40, ebp = 0 --- Tracing command intr pid 12 tid 100012 td 0xc62cd600 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100011 td 0xc62cd900 sched_switch(c62cd900,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xe15f6c60 mi_switch(109,0,c107f50d,55a,8,...) at mi_switch+0x1c9/frame 0xe15f6c94 ithread_loop(c630f7b0,e15f6d08,c107f270,3d7,0,...) at ithread_loop+0x100/frame 0xe15f6ccc fork_exit(c0a58330,c630f7b0,e15f6d08) at fork_exit+0x7f/frame 0xe15f6cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe15f6cf4 --- trap 0, eip = 0, esp = 0xe15f6d40, ebp = 0 --- Tracing command intr pid 12 tid 100010 td 0xc62cdc00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100009 td 0xc6310000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100008 td 0xc6310300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100007 td 0xc6310600 sched_switch(c6310600,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xc5fffc60 mi_switch(109,0,c107f50d,55a,8,...) at mi_switch+0x1c9/frame 0xc5fffc94 ithread_loop(c630f7f0,c5fffd08,c107f270,3d7,0,...) at ithread_loop+0x100/frame 0xc5fffccc fork_exit(c0a58330,c630f7f0,c5fffd08) at fork_exit+0x7f/frame 0xc5fffcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc5fffcf4 --- trap 0, eip = 0, esp = 0xc5fffd40, ebp = 0 --- Tracing command idle pid 11 tid 100006 td 0xc62cc000 cpustop_handler(3,13,c5ffbb90,c0eaa13b,c5ffbaac,...) at cpustop_handler+0x2f/frame 0xc5ffba40 ipi_nmi_handler(c5ffbaac,c6375300,c6375300,c123f49c,c5ffba8c,...) at ipi_nmi_handler+0x37/frame 0xc5ffba50 trap(c5ffbb9c) at trap+0x3b/frame 0xc5ffbb90 calltrap() at calltrap+0x6/frame 0xc5ffbb90 --- trap 0x13, eip = 0xc0e8fb35, esp = 0xc5ffbbdc, ebp = 0xc5ffbbdc --- acpi_cpu_c1(c0eb2eeb,c5fe8c90,0,c10dea67,303,...) at acpi_cpu_c1+0x5/frame 0xc5ffbbdc acpi_cpu_idle(4be33d26,0,4be33d26,c5ffbc50,c0e99c8a,...) at acpi_cpu_idle+0x146/frame 0xc5ffbc20 cpu_idle_acpi(4be33d26,0,d,c123f488,c123f496,...) at cpu_idle_acpi+0x3f/frame 0xc5ffbc34 cpu_idle(0,2,c1087ced,409,c123f488,...) at cpu_idle+0x9a/frame 0xc5ffbc50 sched_idletd(0,c5ffbd08,c107f270,3d7,0,...) at sched_idletd+0x1d6/frame 0xc5ffbccc fork_exit(c0aaeb60,0,c5ffbd08) at fork_exit+0x7f/frame 0xc5ffbcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc5ffbcf4 --- trap 0, eip = 0, esp = 0xc5ffbd40, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc62cc300 cpustop_handler(2,13,c5ff8b90,c0eaa13b,c123f410,...) at cpustop_handler+0x2f/frame 0xc5ff8a40 ipi_nmi_handler(c123f410,c64ed000,c64ed000,c123ed9c,c5ff8a8c,...) at ipi_nmi_handler+0x37/frame 0xc5ff8a50 trap(c5ff8b9c) at trap+0x3b/frame 0xc5ff8b90 calltrap() at calltrap+0x6/frame 0xc5ff8b90 --- trap 0x13, eip = 0xc0e8fb35, esp = 0xc5ff8bdc, ebp = 0xc5ff8bdc --- acpi_cpu_c1(c0eb2eeb,c5fe5c90,0,c10dea67,303,...) at acpi_cpu_c1+0x5/frame 0xc5ff8bdc acpi_cpu_idle(4bd7ab16,0,4bd7ab16,c5ff8c50,c0e99c8a,...) at acpi_cpu_idle+0x146/frame 0xc5ff8c20 cpu_idle_acpi(4bd7ab16,0,f,c123ed88,c123ed96,...) at cpu_idle_acpi+0x3f/frame 0xc5ff8c34 cpu_idle(0,2,c1087ced,409,c123ed88,...) at cpu_idle+0x9a/frame 0xc5ff8c50 sched_idletd(0,c5ff8d08,c107f270,3d7,0,...) at sched_idletd+0x1d6/frame 0xc5ff8ccc fork_exit(c0aaeb60,0,c5ff8d08) at fork_exit+0x7f/frame 0xc5ff8cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc5ff8cf4 --- trap 0, eip = 0, esp = 0xc5ff8d40, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc62cc600 kdb_enter(c0f10c56,c10070bc,0,0,9aaf1) at kdb_enter+0x3d/frame 0xc5ff5a60 watchdog_fire(2f,0,c107cc4d,222,40c320,...) at watchdog_fire+0xb0/frame 0xc5ff5a88 hardclock_cnt(97,0,c10dea67,ef,c5ff5b9c,...) at hardclock_cnt+0x2c2/frame 0xc5ff5adc handleevents(0,0,c62cc600,c6374600,c123e600,...) at handleevents+0xec/frame 0xc5ff5b20 timercb(c13c2da8,0,1,1,c648021c,...) at timercb+0x267/frame 0xc5ff5b70 lapic_handle_timer(c5ff5b9c) at lapic_handle_timer+0x89/frame 0xc5ff5b90 Xtimerint() at Xtimerint+0x20/frame 0xc5ff5b90 --- interrupt, eip = 0xc0e8fb35, esp = 0xc5ff5bdc, ebp = 0xc5ff5bdc --- acpi_cpu_c1(c0eb2eeb,c5fe2c90,0,c10dea67,303,...) at acpi_cpu_c1+0x5/frame 0xc5ff5bdc acpi_cpu_idle(26a63a7f,0,26a63a7f,c5ff5c50,c0e99c8a,...) at acpi_cpu_idle+0x146/frame 0xc5ff5c20 cpu_idle_acpi(26a63a7f,0,1,c123e688,c123e696,...) at cpu_idle_acpi+0x3f/frame 0xc5ff5c34 cpu_idle(0,2,c1087ced,a46,c123e688,...) at cpu_idle+0x9a/frame 0xc5ff5c50 sched_idletd(0,c5ff5d08,c107f270,3d7,0,...) at sched_idletd+0x1d6/frame 0xc5ff5ccc fork_exit(c0aaeb60,0,c5ff5d08) at fork_exit+0x7f/frame 0xc5ff5cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc5ff5cf4 --- trap 0, eip = 0, esp = 0xc5ff5d40, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xc62cc900 sched_switch(c62cc900,0,608,1b0,907,...) at sched_switch+0x4b9/frame 0xc5ff2c00 mi_switch(608,0,c1085dcc,d3,3,...) at mi_switch+0x1c9/frame 0xc5ff2c34 critical_exit(0,2,c1087ced,409,c123df88,...) at critical_exit+0xa3/frame 0xc5ff2c50 sched_idletd(0,c5ff2d08,c107f270,3d7,0,...) at sched_idletd+0x1d6/frame 0xc5ff2ccc fork_exit(c0aaeb60,0,c5ff2d08) at fork_exit+0x7f/frame 0xc5ff2cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc5ff2cf4 --- trap 0, eip = 0, esp = 0xc5ff2d40, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc62ccc00 sched_switch(c62ccc00,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xc5fee98c mi_switch(104,0,c108b461,1f5,c108b461,...) at mi_switch+0x1c9/frame 0xc5fee9c0 sleepq_switch(c62ccc00,0,c108b461,1ab,c5feea38,...) at sleepq_switch+0x1b9/frame 0xc5fee9f4 sleepq_catch_signals(0,c108b461,162,108,c62ccc00,...) at sleepq_catch_signals+0x361/frame 0xc5feea3c sleepq_wait_sig(c62caba0,6c,c108e8d9,100,0,...) at sleepq_wait_sig+0x14/frame 0xc5feea60 _sleep(c62caba0,c62cac34,16c,c108e8d9,0,...) at _sleep+0x35b/frame 0xc5feeabc kern_wait6(c62ccc00,7,0,0,c5feeb4c,...) at kern_wait6+0x45c/frame 0xc5feeb20 sys_wait4(c62ccc00,c5feecc8,c10dd55f,d6,bfbfefe4,...) at sys_wait4+0x94/frame 0xc5feec40 syscall(c5feed08) at syscall+0x2ed/frame 0xc5feecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xc5feecfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x805e3b7, esp = 0xbfbfd8f4, ebp = 0xbfbfd908 --- Tracing command audit pid 10 tid 100001 td 0xc62cd000 sched_switch(c62cd000,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xc5febba8 mi_switch(104,0,c108b461,1f5,8,...) at mi_switch+0x1c9/frame 0xc5febbdc sleepq_switch(c62cd000,0,c108b461,26b,c62cd000,...) at sleepq_switch+0x1b9/frame 0xc5febc10 sleepq_wait(c14007e4,0,c5febc64,1,0,...) at sleepq_wait+0x48/frame 0xc5febc34 _cv_wait(c14007e4,c1400770,c10b6ec2,18d,0,...) at _cv_wait+0x1f9/frame 0xc5febc78 audit_worker(0,c5febd08,c107f270,3d7,0,...) at audit_worker+0x94/frame 0xc5febccc fork_exit(c0c9c350,0,c5febd08) at fork_exit+0x7f/frame 0xc5febcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc5febcf4 --- trap 0, eip = 0, esp = 0xc5febd40, ebp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xc6547c00 sched_switch(c6547c00,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xee040b68 mi_switch(104,0,c108b461,1f5,101,...) at mi_switch+0x1c9/frame 0xee040b9c sleepq_switch(c6547c00,0,c108b461,28e,c6547c00,...) at sleepq_switch+0x1b9/frame 0xee040bd0 sleepq_timedwait(c1230c01,0,2,0,0,...) at sleepq_timedwait+0x48/frame 0xee040bf4 _sleep(c1230c01,0,0,c1071652,fffffc88,...) at _sleep+0x345/frame 0xee040c50 pause_sbt(c1071652,fffffc88,2,0,0,...) at pause_sbt+0x86/frame 0xee040c8c deadlkres(0,ee040d08,c107f270,3d7,0,...) at deadlkres+0x82/frame 0xee040ccc fork_exit(c0a36e40,0,ee040d08) at fork_exit+0x7f/frame 0xee040cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee040cf4 --- trap 0, eip = 0, esp = 0xee040d40, ebp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xc6548000 sched_switch(c6548000,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xee03dbc0 mi_switch(104,0,c108b461,1f5,c124cd58,...) at mi_switch+0x1c9/frame 0xee03dbf4 sleepq_switch(c6548000,0,c108b461,26b,c6371400,...) at sleepq_switch+0x1b9/frame 0xee03dc28 sleepq_wait(c6371400,0,c108636d,c1071652,0,...) at sleepq_wait+0x48/frame 0xee03dc4c msleep_spin_sbt(c6371400,c6371418,c1071652,0,0,...) at msleep_spin_sbt+0x239/frame 0xee03dc94 taskqueue_thread_loop(c13f5b00,ee03dd08,c107f270,3d7,0,...) at taskqueue_thread_loop+0xcc/frame 0xee03dccc fork_exit(c0ace040,c13f5b00,ee03dd08) at fork_exit+0x7f/frame 0xee03dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee03dcf4 --- trap 0, eip = 0, esp = 0xee03dd40, ebp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xc6460000 sched_switch(c6460000,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xe1624bac mi_switch(104,0,c108b461,1f5,162,...) at mi_switch+0x1c9/frame 0xe1624be0 sleepq_switch(c6460000,0,c108b461,26b,c6460000,...) at sleepq_switch+0x1b9/frame 0xe1624c14 sleepq_wait(c6371c00,0,c1071652,0,0,...) at sleepq_wait+0x48/frame 0xe1624c38 _sleep(c6371c00,c6371c18,0,c1071652,0,...) at _sleep+0x37c/frame 0xe1624c94 taskqueue_thread_loop(c1400820,e1624d08,c107f270,3d7,0,...) at taskqueue_thread_loop+0x129/frame 0xe1624ccc fork_exit(c0ace040,c1400820,e1624d08) at fork_exit+0x7f/frame 0xe1624cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe1624cf4 --- trap 0, eip = 0, esp = 0xe1624d40, ebp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xc6460600 sched_switch(c6460600,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xe161ebac mi_switch(104,0,c108b461,1f5,162,...) at mi_switch+0x1c9/frame 0xe161ebe0 sleepq_switch(c6460600,0,c108b461,26b,c6460600,...) at sleepq_switch+0x1b9/frame 0xe161ec14 sleepq_wait(c6371c80,0,c1071652,0,0,...) at sleepq_wait+0x48/frame 0xe161ec38 _sleep(c6371c80,c6371c98,0,c1071652,0,...) at _sleep+0x37c/frame 0xe161ec94 taskqueue_thread_loop(c13f9ad8,e161ed08,c107f270,3d7,0,...) at taskqueue_thread_loop+0x129/frame 0xe161eccc fork_exit(c0ace040,c13f9ad8,e161ed08) at fork_exit+0x7f/frame 0xe161ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe161ecf4 --- trap 0, eip = 0, esp = 0xe161ed40, ebp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xc6460900 sched_switch(c6460900,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xe161bbc0 mi_switch(104,0,c108b461,1f5,c124ce30,...) at mi_switch+0x1c9/frame 0xe161bbf4 sleepq_switch(c6460900,0,c108b461,26b,c6371d00,...) at sleepq_switch+0x1b9/frame 0xe161bc28 sleepq_wait(c6371d00,0,c108636d,c1071652,0,...) at sleepq_wait+0x48/frame 0xe161bc4c msleep_spin_sbt(c6371d00,c6371d18,c1071652,0,0,...) at msleep_spin_sbt+0x239/frame 0xe161bc94 taskqueue_thread_loop(c13f6620,e161bd08,c107f270,3d7,0,...) at taskqueue_thread_loop+0xcc/frame 0xe161bccc fork_exit(c0ace040,c13f6620,e161bd08) at fork_exit+0x7f/frame 0xe161bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe161bcf4 --- trap 0, eip = 0, esp = 0xe161bd40, ebp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xc6460c00 sched_switch(c6460c00,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xe1618bc0 mi_switch(104,0,c108b461,1f5,c124ce30,...) at mi_switch+0x1c9/frame 0xe1618bf4 sleepq_switch(c6460c00,0,c108b461,26b,c6371d00,...) at sleepq_switch+0x1b9/frame 0xe1618c28 sleepq_wait(c6371d00,0,c108636d,c1071652,0,...) at sleepq_wait+0x48/frame 0xe1618c4c msleep_spin_sbt(c6371d00,c6371d18,c1071652,0,0,...) at msleep_spin_sbt+0x239/frame 0xe1618c94 taskqueue_thread_loop(c13f6620,e1618d08,c107f270,3d7,0,...) at taskqueue_thread_loop+0xcc/frame 0xe1618ccc fork_exit(c0ace040,c13f6620,e1618d08) at fork_exit+0x7f/frame 0xe1618cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe1618cf4 --- trap 0, eip = 0, esp = 0xe1618d40, ebp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xc6310900 sched_switch(c6310900,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xe1615bc0 mi_switch(104,0,c108b461,1f5,c124ce30,...) at mi_switch+0x1c9/frame 0xe1615bf4 sleepq_switch(c6310900,0,c108b461,26b,c6371d00,...) at sleepq_switch+0x1b9/frame 0xe1615c28 sleepq_wait(c6371d00,0,c108636d,c1071652,0,...) at sleepq_wait+0x48/frame 0xe1615c4c msleep_spin_sbt(c6371d00,c6371d18,c1071652,0,0,...) at msleep_spin_sbt+0x239/frame 0xe1615c94 taskqueue_thread_loop(c13f6620,e1615d08,c107f270,3d7,0,...) at taskqueue_thread_loop+0xcc/frame 0xe1615ccc fork_exit(c0ace040,c13f6620,e1615d08) at fork_exit+0x7f/frame 0xe1615cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe1615cf4 --- trap 0, eip = 0, esp = 0xe1615d40, ebp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xc6374000 sched_switch(c6374000,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xe160fbac mi_switch(104,0,c108b461,1f5,162,...) at mi_switch+0x1c9/frame 0xe160fbe0 sleepq_switch(c6374000,0,c108b461,26b,c6374000,...) at sleepq_switch+0x1b9/frame 0xe160fc14 sleepq_wait(c6371e00,0,c1071652,0,0,...) at sleepq_wait+0x48/frame 0xe160fc38 _sleep(c6371e00,c6371e18,0,c1071652,0,...) at _sleep+0x37c/frame 0xe160fc94 taskqueue_thread_loop(c13fca40,e160fd08,c107f270,3d7,0,...) at taskqueue_thread_loop+0x129/frame 0xe160fccc fork_exit(c0ace040,c13fca40,e160fd08) at fork_exit+0x7f/frame 0xe160fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe160fcf4 --- trap 0, eip = 0, esp = 0xe160fd40, ebp = 0 --- Tracing command kernel pid 0 tid 100013 td 0xc62cd300 sched_switch(c62cd300,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xe15fcbac mi_switch(104,0,c108b461,1f5,162,...) at mi_switch+0x1c9/frame 0xe15fcbe0 sleepq_switch(c62cd300,0,c108b461,26b,c62cd300,...) at sleepq_switch+0x1b9/frame 0xe15fcc14 sleepq_wait(c6372000,0,c1071652,0,0,...) at sleepq_wait+0x48/frame 0xe15fcc38 _sleep(c6372000,c6372018,0,c1071652,0,...) at _sleep+0x37c/frame 0xe15fcc94 taskqueue_thread_loop(c124c044,e15fcd08,c107f270,3d7,0,...) at taskqueue_thread_loop+0x129/frame 0xe15fcccc fork_exit(c0ace040,c124c044,e15fcd08) at fork_exit+0x7f/frame 0xe15fccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe15fccf4 --- trap 0, eip = 0, esp = 0xe15fcd40, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc13f9650 sched_switch(c13f9650,0,104,1b5,c0a7398e,...) at sched_switch+0x4b9/frame 0xc1820c0c mi_switch(104,0,c108b461,1f5,101,...) at mi_switch+0x1c9/frame 0xc1820c40 sleepq_switch(c13f9650,0,c108b461,28e,c13f9650,...) at sleepq_switch+0x1b9/frame 0xc1820c74 sleepq_timedwait(c13f9364,54,9,0,0,...) at sleepq_timedwait+0x48/frame 0xc1820c98 _sleep(c13f9364,0,54,c10b8085,fffff470,...) at _sleep+0x345/frame 0xc1820cf4 scheduler(0,0,c10eacf4,181e000,1825000,...) at scheduler+0x2b3/frame 0xc1820d38 mi_startup() at mi_startup+0xf7/frame 0xc1820d58 begin() at begin+0x2c db:0:allt> call doadump Physical memory: 2027 MB Dumping 159 MB: 144 128 112 96 80 64 48 32 16 Dump complete = 0 db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 1 (kgdb) proc 1092 [Switching to thread 120 (Thread 100131)]#0 sched_switch (td=0xc6958300, newtd=, flags=0x104) at ../../../kern/sched_ule.c:1954 1954 cpuid = PCPU_GET(cpuid); Current language: auto; currently minimal (kgdb) bt #0 sched_switch (td=0xc6958300, newtd=, flags=0x104) at ../../../kern/sched_ule.c:1954 #1 0xc0a91b29 in mi_switch (flags=) at ../../../kern/kern_synch.c:487 #2 0xc0aca329 in sleepq_switch (wchan=, pri=0x54) at ../../../kern/subr_sleepqueue.c:541 #3 0xc0aca118 in sleepq_wait (wchan=0xc3b54a40, pri=0x54) at ../../../kern/subr_sleepqueue.c:620 #4 0xc0a9135c in _sleep (ident=0x0, lock=0x0, priority=, sbt=0x0, pr=0x0) at ../../../kern/kern_synch.c:249 #5 0xc0d21a00 in vm_page_sleep (m=0xc3b54a40, msg=0xc10c33b0 "pgrbwt") at ../../../vm/vm_page.c:768 #6 0xc0d24074 in vm_page_grab (object=, pindex=0x2, allocflags=) at ../../../vm/vm_page.c:2323 #7 0xc843c97c in tmpfs_read (v=0xf2a42a78) at /usr/src/sys/modules/tmpfs/../../fs/tmpfs/tmpfs_vnops.c:456 #8 0xc0ecf4d4 in VOP_READ_APV (vop=, a=0xf2a42a78) at vnode_if.c:932 #9 0xc0b3d032 in vn_rdwr (rw=, vp=0xc7b8de10, base=0xc7b55848, len=, offset=0x800000000, segflg=UIO_USERSPACE, ioflg=, active_cred=, file_cred=, aresid=, td=0x1) at vnode_if.h:384 #10 0xc0b059c4 in kern_sendfile (td=0x246, uap=0x0, hdr_uio=) at ../../../kern/uipc_syscalls.c:2193 #11 0xc0b04ed7 in do_sendfile (td=0xc6958300, uap=0xf2a42cc8, compat=0x0) at ../../../kern/uipc_syscalls.c:1867 #12 0xc0b04e16 in sys_sendfile (td=0xc6958300, uap=0xf2a42cc8) at ../../../kern/uipc_syscalls.c:1838 #13 0xc0eab54d in syscall (frame=) at subr_syscall.c:134 #14 0xc0e93ac1 in Xint0x80_syscall () at ../../../i386/i386/exception.s:267 #15 0x00000033 in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb) f 6 #6 0xc0d24074 in vm_page_grab (object=, pindex=0x2, allocflags=) at ../../../vm/vm_page.c:2323 2323 vm_page_sleep(m, "pgrbwt"); (kgdb) p *m $2 = {pageq = {tqe_next = 0x0, tqe_prev = 0xc13ad710}, listq = {tqe_next = 0xc30d6080, tqe_prev = 0xc4277208}, object = 0xc7b55818, pindex = 0x2, phys_addr = 0x5ef2a000, md = {pv_list = {tqh_first = 0x0, tqh_last = 0xc3b54a60}, pat_mode = 0x6}, queue = 0xff, segind = 0x2, hold_count = 0x0, order = 0xb, pool = 0x0, cow = 0x0, wire_count = 0x1, aflags = 0x2, oflags = 0x2, flags = 0x0, act_count = 0x0, busy = 0x1, valid = 0x0, dirty = 0x0} (kgdb) proc 1095 [Switching to thread 123 (Thread 100125)]#0 sched_switch (td=0xc6958900, newtd=, flags=0x104) at ../../../kern/sched_ule.c:1954 1954 cpuid = PCPU_GET(cpuid); (kgdb) bt #0 sched_switch (td=0xc6958900, newtd=, flags=0x104) at ../../../kern/sched_ule.c:1954 #1 0xc0a91b29 in mi_switch (flags=) at ../../../kern/kern_synch.c:487 #2 0xc0aca329 in sleepq_switch (wchan=, pri=0x60) at ../../../kern/subr_sleepqueue.c:541 #3 0xc0aca118 in sleepq_wait (wchan=0xc7b8de44, pri=0x60) at ../../../kern/subr_sleepqueue.c:620 #4 0xc0a6a406 in sleeplk (lk=0xc7b8de44, flags=0x80100, ilk=, wmesg=, pri=0x60, timo=) at ../../../kern/kern_lock.c:226 #5 0xc0a69bc4 in __lockmgr_args (lk=0xc7b8de44, flags=, wmesg=0xc8445470 "tmpfs", pri=0x60, timo=0x33, file=0xc137c130 "", line=0x0) at ../../../kern/kern_lock.c:916 #6 0xc0b19fb3 in vop_stdlock (ap=0xf2a30870) at lockmgr.h:97 #7 0xc0ed14c2 in VOP_LOCK1_APV (vop=, a=0xf2a30870) at vnode_if.c:2084 #8 0xc0b3cb8a in _vn_lock (vp=, flags=) at vnode_if.h:859 #9 0xc0b2a757 in vget (vp=0xc7b8de10, flags=0x80100, td=0x0) at ../../../kern/vfs_subr.c:2167 #10 0xc0b15838 in cache_lookup (dvp=0xc7b8e168, vpp=0xc8446a04, cnp=0xf2a30b64, tsp=0xf2a30950, ticksp=0x0) at ../../../kern/vfs_cache.c:674 #11 0xc0b1696c in vfs_cache_lookup (ap=0xf2a30b64) at ../../../kern/vfs_cache.c:1033 #12 0xc0ecdee4 in VOP_LOOKUP_APV (vop=, a=0xf2a309e8) at vnode_if.c:129 #13 0xc0b1f798 in lookup (ndp=0xf2a30b18) at vnode_if.h:54 #14 0xc0b1ee8d in namei (ndp=0xf2a30b18) at ../../../kern/vfs_lookup.c:292 #15 0xc0b36dc2 in kern_statat_vnhook (td=0xc6958900, flag=, fd=0x0, path=0x2881b2f8
, pathseg=, hook=) at ../../../kern/vfs_syscalls.c:2321 #16 0xc0b36fa9 in sys_lstat (td=0xffffff9c, uap=0xf2a30cc8) at ../../../kern/vfs_syscalls.c:2302 #17 0xc0eab54d in syscall (frame=) at subr_syscall.c:134 #18 0xc0e93ac1 in Xint0x80_syscall () at ../../../i386/i386/exception.s:267 #19 0x00000033 in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb) f 4 #4 0xc0a6a406 in sleeplk (lk=0xc7b8de44, flags=0x80100, ilk=, wmesg=, pri=0x60, timo=) at ../../../kern/kern_lock.c:226 226 sleepq_wait(&lk->lock_object, pri); (kgdb) p lk->lock_object $1 = {lo_name = 0xc8445470 "tmpfs", lo_flags = 0x5730008, lo_data = 0x0, lo_witness = 0xc61869b8} (kgdb) $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/fs/tmpfs/tmpfs_vnops.c =================================================================== --- /usr/src/sys/fs/tmpfs/tmpfs_vnops.c (revision 249704) +++ /usr/src/sys/fs/tmpfs/tmpfs_vnops.c (working copy) @@ -278,8 +278,6 @@ tmpfs_close(struct vop_close_args *v) { struct vnode *vp = v->a_vp; - MPASS(VOP_ISLOCKED(vp)); - /* Update node times. */ tmpfs_update(vp); @@ -439,7 +437,6 @@ tmpfs_setattr(struct vop_setattr_args *v) return error; } -/* --------------------------------------------------------------------- */ static int tmpfs_nocacheread(vm_object_t tobj, vm_pindex_t idx, vm_offset_t offset, size_t tlen, struct uio *uio) @@ -448,12 +445,29 @@ tmpfs_nocacheread(vm_object_t tobj, vm_pindex_t id int error, rv; VM_OBJECT_WLOCK(tobj); - m = vm_page_grab(tobj, idx, VM_ALLOC_WIRED | - VM_ALLOC_NORMAL | VM_ALLOC_RETRY); + + /* + * It shall be safe to sleep waiting for a free page there, + * while holding the tmpfs vnode lock, because pageout daemon + * is still able to page out tobj pages. The type of the tobj + * is OBJT_SWAP, so the pageout of its pages does not need the + * vnode lock. + */ + m = vm_page_grab(tobj, idx, VM_ALLOC_NORMAL | VM_ALLOC_RETRY); if (m->valid != VM_PAGE_BITS_ALL) { if (vm_pager_has_page(tobj, idx, NULL, NULL)) { rv = vm_pager_get_pages(tobj, &m, 1, 0); + m = vm_page_lookup(tobj, idx); + if (m == NULL) { + printf( + "tmpfs: vm_obj %p idx %jd null lookup rv %d\n", + tobj, idx, rv); + return (EIO); + } if (rv != VM_PAGER_OK) { + printf( + "tmpfs: vm_obj %p idx %jd valid %x pager error %d\n", + tobj, idx, m->valid, rv); vm_page_lock(m); vm_page_free(m); vm_page_unlock(m); @@ -463,127 +477,36 @@ tmpfs_nocacheread(vm_object_t tobj, vm_pindex_t id } else vm_page_zero_invalid(m, TRUE); } + vm_page_lock(m); + vm_page_hold(m); + vm_page_wakeup(m); + vm_page_unlock(m); VM_OBJECT_WUNLOCK(tobj); error = uiomove_fromphys(&m, offset, tlen, uio); VM_OBJECT_WLOCK(tobj); vm_page_lock(m); - vm_page_unwire(m, TRUE); + vm_page_unhold(m); + vm_page_deactivate(m); vm_page_unlock(m); - vm_page_wakeup(m); VM_OBJECT_WUNLOCK(tobj); return (error); } -static __inline int -tmpfs_nocacheread_buf(vm_object_t tobj, vm_pindex_t idx, - vm_offset_t offset, size_t tlen, void *buf) -{ - struct uio uio; - struct iovec iov; - - uio.uio_iovcnt = 1; - uio.uio_iov = &iov; - iov.iov_base = buf; - iov.iov_len = tlen; - - uio.uio_offset = 0; - uio.uio_resid = tlen; - uio.uio_rw = UIO_READ; - uio.uio_segflg = UIO_SYSSPACE; - uio.uio_td = curthread; - - return (tmpfs_nocacheread(tobj, idx, offset, tlen, &uio)); -} - static int -tmpfs_mappedread(vm_object_t vobj, vm_object_t tobj, size_t len, struct uio *uio) -{ - struct sf_buf *sf; - vm_pindex_t idx; - vm_page_t m; - vm_offset_t offset; - off_t addr; - size_t tlen; - char *ma; - int error; - - addr = uio->uio_offset; - idx = OFF_TO_IDX(addr); - offset = addr & PAGE_MASK; - tlen = MIN(PAGE_SIZE - offset, len); - - VM_OBJECT_WLOCK(vobj); -lookupvpg: - if (((m = vm_page_lookup(vobj, idx)) != NULL) && - vm_page_is_valid(m, offset, tlen)) { - if ((m->oflags & VPO_BUSY) != 0) { - /* - * Reference the page before unlocking and sleeping so - * that the page daemon is less likely to reclaim it. - */ - vm_page_reference(m); - vm_page_sleep(m, "tmfsmr"); - goto lookupvpg; - } - vm_page_busy(m); - VM_OBJECT_WUNLOCK(vobj); - error = uiomove_fromphys(&m, offset, tlen, uio); - VM_OBJECT_WLOCK(vobj); - vm_page_wakeup(m); - VM_OBJECT_WUNLOCK(vobj); - return (error); - } else if (m != NULL && uio->uio_segflg == UIO_NOCOPY) { - KASSERT(offset == 0, - ("unexpected offset in tmpfs_mappedread for sendfile")); - if ((m->oflags & VPO_BUSY) != 0) { - /* - * Reference the page before unlocking and sleeping so - * that the page daemon is less likely to reclaim it. - */ - vm_page_reference(m); - vm_page_sleep(m, "tmfsmr"); - goto lookupvpg; - } - vm_page_busy(m); - VM_OBJECT_WUNLOCK(vobj); - sched_pin(); - sf = sf_buf_alloc(m, SFB_CPUPRIVATE); - ma = (char *)sf_buf_kva(sf); - error = tmpfs_nocacheread_buf(tobj, idx, 0, tlen, ma); - if (error == 0) { - if (tlen != PAGE_SIZE) - bzero(ma + tlen, PAGE_SIZE - tlen); - uio->uio_offset += tlen; - uio->uio_resid -= tlen; - } - sf_buf_free(sf); - sched_unpin(); - VM_OBJECT_WLOCK(vobj); - if (error == 0) - m->valid = VM_PAGE_BITS_ALL; - vm_page_wakeup(m); - VM_OBJECT_WUNLOCK(vobj); - return (error); - } - VM_OBJECT_WUNLOCK(vobj); - error = tmpfs_nocacheread(tobj, idx, offset, tlen, uio); - - return (error); -} - -static int tmpfs_read(struct vop_read_args *v) { struct vnode *vp = v->a_vp; struct uio *uio = v->a_uio; - struct tmpfs_node *node; vm_object_t uobj; size_t len; int resid; - int error = 0; + vm_pindex_t idx; + vm_offset_t offset; + off_t addr; + size_t tlen; node = VP_TO_TMPFS_NODE(vp); @@ -607,7 +530,11 @@ tmpfs_read(struct vop_read_args *v) len = MIN(node->tn_size - uio->uio_offset, resid); if (len == 0) break; - error = tmpfs_mappedread(vp->v_object, uobj, len, uio); + addr = uio->uio_offset; + idx = OFF_TO_IDX(addr); + offset = addr & PAGE_MASK; + tlen = MIN(PAGE_SIZE - offset, len); + error = tmpfs_nocacheread(uobj, idx, offset, tlen, uio); if ((error != 0) || (resid == uio->uio_resid)) break; } @@ -620,10 +547,10 @@ out: /* --------------------------------------------------------------------- */ static int -tmpfs_mappedwrite(vm_object_t vobj, vm_object_t tobj, size_t len, struct uio *uio) +tmpfs_mappedwrite(vm_object_t tobj, size_t len, struct uio *uio) { vm_pindex_t idx; - vm_page_t vpg, tpg; + vm_page_t tpg; vm_offset_t offset; off_t addr; size_t tlen; @@ -636,69 +563,45 @@ static int offset = addr & PAGE_MASK; tlen = MIN(PAGE_SIZE - offset, len); - VM_OBJECT_WLOCK(vobj); -lookupvpg: - if (((vpg = vm_page_lookup(vobj, idx)) != NULL) && - vm_page_is_valid(vpg, offset, tlen)) { - if ((vpg->oflags & VPO_BUSY) != 0) { - /* - * Reference the page before unlocking and sleeping so - * that the page daemon is less likely to reclaim it. - */ - vm_page_reference(vpg); - vm_page_sleep(vpg, "tmfsmw"); - goto lookupvpg; - } - vm_page_busy(vpg); - vm_page_undirty(vpg); - VM_OBJECT_WUNLOCK(vobj); - error = uiomove_fromphys(&vpg, offset, tlen, uio); - } else { - if (vm_page_is_cached(vobj, idx)) - vm_page_cache_free(vobj, idx, idx + 1); - VM_OBJECT_WUNLOCK(vobj); - vpg = NULL; - } VM_OBJECT_WLOCK(tobj); - tpg = vm_page_grab(tobj, idx, VM_ALLOC_WIRED | - VM_ALLOC_NORMAL | VM_ALLOC_RETRY); + tpg = vm_page_grab(tobj, idx, VM_ALLOC_NORMAL | VM_ALLOC_RETRY); if (tpg->valid != VM_PAGE_BITS_ALL) { if (vm_pager_has_page(tobj, idx, NULL, NULL)) { rv = vm_pager_get_pages(tobj, &tpg, 1, 0); + tpg = vm_page_lookup(tobj, idx); + if (tpg == NULL) { + printf( + "tmpfs: vm_obj %p idx %jd null lookup rv %d\n", + tobj, idx, rv); + return (EIO); + } if (rv != VM_PAGER_OK) { + printf( + "tmpfs: vm_obj %p idx %jd valid %x pager error %d\n", + tobj, idx, tpg->valid, rv); vm_page_lock(tpg); vm_page_free(tpg); vm_page_unlock(tpg); - error = EIO; - goto out; + VM_OBJECT_WUNLOCK(tobj); + return (EIO); } } else vm_page_zero_invalid(tpg, TRUE); } + vm_page_lock(tpg); + vm_page_hold(tpg); + vm_page_wakeup(tpg); + vm_page_unlock(tpg); VM_OBJECT_WUNLOCK(tobj); - if (vpg == NULL) - error = uiomove_fromphys(&tpg, offset, tlen, uio); - else { - KASSERT(vpg->valid == VM_PAGE_BITS_ALL, ("parts of vpg invalid")); - pmap_copy_page(vpg, tpg); - } + error = uiomove_fromphys(&tpg, offset, tlen, uio); VM_OBJECT_WLOCK(tobj); - if (error == 0) { - KASSERT(tpg->valid == VM_PAGE_BITS_ALL, - ("parts of tpg invalid")); + if (error == 0) vm_page_dirty(tpg); - } vm_page_lock(tpg); - vm_page_unwire(tpg, TRUE); + vm_page_unhold(tpg); + vm_page_deactivate(tpg); vm_page_unlock(tpg); - vm_page_wakeup(tpg); -out: VM_OBJECT_WUNLOCK(tobj); - if (vpg != NULL) { - VM_OBJECT_WLOCK(vobj); - vm_page_wakeup(vpg); - VM_OBJECT_WUNLOCK(vobj); - } return (error); } @@ -756,7 +659,7 @@ tmpfs_write(struct vop_write_args *v) len = MIN(node->tn_size - uio->uio_offset, resid); if (len == 0) break; - error = tmpfs_mappedwrite(vp->v_object, uobj, len, uio); + error = tmpfs_mappedwrite(uobj, len, uio); if ((error != 0) || (resid == uio->uio_resid)) break; } @@ -1536,8 +1439,6 @@ tmpfs_inactive(struct vop_inactive_args *v) struct tmpfs_node *node; - MPASS(VOP_ISLOCKED(vp)); - node = VP_TO_TMPFS_NODE(vp); if (node->tn_links == 0) @@ -1555,11 +1456,24 @@ tmpfs_reclaim(struct vop_reclaim_args *v) struct tmpfs_mount *tmp; struct tmpfs_node *node; + vm_object_t obj; node = VP_TO_TMPFS_NODE(vp); tmp = VFS_TO_TMPFS(vp->v_mount); - vnode_destroy_vobject(vp); + if (node->tn_type == VREG) { + obj = node->tn_reg.tn_aobj; + if (obj != NULL) { + /* Instead of vnode_destroy_vobject() */ + VM_OBJECT_WLOCK(obj); + VI_LOCK(vp); + vm_object_clear_flag(obj, OBJ_TMPFS); + obj->un_pager.swp.swp_tmpfs = NULL; + VI_UNLOCK(vp); + VM_OBJECT_WUNLOCK(obj); + } + } + vp->v_object = NULL; cache_purge(vp); TMPFS_NODE_LOCK(node); Index: /usr/src/sys/fs/tmpfs/tmpfs_subr.c =================================================================== --- /usr/src/sys/fs/tmpfs/tmpfs_subr.c (revision 249704) +++ /usr/src/sys/fs/tmpfs/tmpfs_subr.c (working copy) @@ -166,6 +166,7 @@ tmpfs_alloc_node(struct tmpfs_mount *tmp, enum vty char *target, dev_t rdev, struct tmpfs_node **node) { struct tmpfs_node *nnode; + vm_object_t obj; /* If the root directory of the 'tmp' file system is not yet * allocated, this must be the request to do it. */ @@ -227,9 +228,14 @@ tmpfs_alloc_node(struct tmpfs_mount *tmp, enum vty break; case VREG: - nnode->tn_reg.tn_aobj = + obj = nnode->tn_reg.tn_aobj = vm_pager_allocate(OBJT_SWAP, NULL, 0, VM_PROT_DEFAULT, 0, NULL /* XXXKIB - tmpfs needs swap reservation */); + VM_OBJECT_WLOCK(obj); + /* OBJ_TMPFS is set together with the setting of vp->v_object */ + vm_object_set_flag(obj, OBJ_NOSPLIT); + vm_object_clear_flag(obj, OBJ_ONEMAPPING); + VM_OBJECT_WUNLOCK(obj); break; default: @@ -434,9 +440,11 @@ int tmpfs_alloc_vp(struct mount *mp, struct tmpfs_node *node, int lkflag, struct vnode **vpp) { - int error = 0; struct vnode *vp; + vm_object_t object; + int error; + error = 0; loop: TMPFS_NODE_LOCK(node); if ((vp = node->tn_vnode) != NULL) { @@ -506,13 +514,22 @@ loop: /* FALLTHROUGH */ case VLNK: /* FALLTHROUGH */ - case VREG: - /* FALLTHROUGH */ case VSOCK: break; case VFIFO: vp->v_op = &tmpfs_fifoop_entries; break; + case VREG: + object = node->tn_reg.tn_aobj; + VM_OBJECT_WLOCK(object); + VI_LOCK(vp); + KASSERT(vp->v_object == NULL, ("Not NULL v_object in tmpfs")); + vp->v_object = object; + object->un_pager.swp.swp_tmpfs = vp; + vm_object_set_flag(object, OBJ_TMPFS); + VI_UNLOCK(vp); + VM_OBJECT_WUNLOCK(object); + break; case VDIR: MPASS(node->tn_dir.tn_parent != NULL); if (node->tn_dir.tn_parent == node) @@ -523,7 +540,6 @@ loop: panic("tmpfs_alloc_vp: type %p %d", node, (int)node->tn_type); } - vnode_pager_setsize(vp, node->tn_size); error = insmntque(vp, mp); if (error) vp = NULL; @@ -1343,7 +1359,6 @@ retry: TMPFS_UNLOCK(tmp); node->tn_size = newsize; - vnode_pager_setsize(vp, newsize); return (0); } Index: /usr/src/sys/vm/vm_object.c =================================================================== --- /usr/src/sys/vm/vm_object.c (revision 249704) +++ /usr/src/sys/vm/vm_object.c (working copy) @@ -505,6 +505,7 @@ void vm_object_deallocate(vm_object_t object) { vm_object_t temp; + struct vnode *vp; while (object != NULL) { VM_OBJECT_WLOCK(object); @@ -527,15 +528,36 @@ vm_object_deallocate(vm_object_t object) VM_OBJECT_WUNLOCK(object); return; } else if (object->ref_count == 1) { + if (object->type == OBJT_SWAP && + (object->flags & OBJ_TMPFS) != 0) { + vp = object->un_pager.swp.swp_tmpfs; + vhold(vp); + VM_OBJECT_WUNLOCK(object); + vn_lock(vp, LK_EXCLUSIVE | LK_RETRY); + vdrop(vp); + VM_OBJECT_WLOCK(object); + if (object->type == OBJT_DEAD) { + VM_OBJECT_WUNLOCK(object); + VOP_UNLOCK(vp, 0); + return; + } else if ((object->flags & OBJ_TMPFS) != 0) { + if (object->ref_count == 1) + VOP_UNSET_TEXT(vp); + VOP_UNLOCK(vp, 0); + } + } if (object->shadow_count == 0 && object->handle == NULL && (object->type == OBJT_DEFAULT || - object->type == OBJT_SWAP)) { + (object->type == OBJT_SWAP && + (object->flags & OBJ_TMPFS) == 0))) { vm_object_set_flag(object, OBJ_ONEMAPPING); } else if ((object->shadow_count == 1) && (object->handle == NULL) && (object->type == OBJT_DEFAULT || object->type == OBJT_SWAP)) { + KASSERT((object->flags & OBJ_TMPFS) == 0, + ("Shadowed tmpfs v_object")); vm_object_t robject; robject = LIST_FIRST(&object->shadow_head); @@ -820,7 +842,12 @@ vm_object_page_clean(vm_object_t object, vm_ooffse boolean_t clearobjflags, eio, res; VM_OBJECT_ASSERT_WLOCKED(object); - KASSERT(object->type == OBJT_VNODE, ("Not a vnode object")); + + /* + * The OBJ_MIGHTBEDIRTY flag is only set for the OBJT_VNODE + * objects. The check below prevents the function from + * operating on the non-vnode objects. + */ if ((object->flags & OBJ_MIGHTBEDIRTY) == 0 || object->resident_page_count == 0) return (TRUE); Index: /usr/src/sys/vm/vm_object.h =================================================================== --- /usr/src/sys/vm/vm_object.h (revision 249704) +++ /usr/src/sys/vm/vm_object.h (working copy) @@ -159,6 +159,7 @@ struct vm_object { * see vm/swap_pager.h */ struct { + void *swp_tmpfs; int swp_bcount; } swp; } un_pager; @@ -179,6 +180,7 @@ struct vm_object { #define OBJ_COLORED 0x1000 /* pg_color is defined */ #define OBJ_ONEMAPPING 0x2000 /* One USE (a single, non-forked) mapping flag */ #define OBJ_DISCONNECTWNT 0x4000 /* disconnect from vnode wanted */ +#define OBJ_TMPFS 0x8000 #define IDX_TO_OFF(idx) (((vm_ooffset_t)(idx)) << PAGE_SHIFT) #define OFF_TO_IDX(off) ((vm_pindex_t)(((vm_ooffset_t)(off)) >> PAGE_SHIFT)) Index: /usr/src/sys/vm/vm_mmap.c =================================================================== --- /usr/src/sys/vm/vm_mmap.c (revision 249704) +++ /usr/src/sys/vm/vm_mmap.c (working copy) @@ -1284,7 +1284,7 @@ vm_mmap_vnode(struct thread *td, vm_size_t objsize error = EINVAL; goto done; } - if (obj->handle != vp) { + if (obj->type == OBJT_VNODE && obj->handle != vp) { vput(vp); vp = (struct vnode *)obj->handle; /* @@ -1333,7 +1333,14 @@ vm_mmap_vnode(struct thread *td, vm_size_t objsize objsize = round_page(va.va_size); if (va.va_nlink == 0) flags |= MAP_NOSYNC; - obj = vm_pager_allocate(OBJT_VNODE, vp, objsize, prot, foff, cred); + if (obj->type == OBJT_VNODE) + obj = vm_pager_allocate(OBJT_VNODE, vp, objsize, prot, foff, + cred); + else { + KASSERT(obj->type == OBJT_DEFAULT || obj->type == OBJT_SWAP, + ("wrong object type")); + vm_object_reference(obj); + } if (obj == NULL) { error = ENOMEM; goto done; Index: /usr/src/sys/vm/vnode_pager.c =================================================================== --- /usr/src/sys/vm/vnode_pager.c (revision 249704) +++ /usr/src/sys/vm/vnode_pager.c (working copy) @@ -214,8 +214,7 @@ retry: VM_OBJECT_SLEEP(object, object, PDROP | PVM, "vadead", 0); } - if (vp->v_usecount == 0) - panic("vnode_pager_alloc: no vnode reference"); + KASSERT(vp->v_usecount != 0, ("vnode_pager_alloc: no vnode reference")); if (object == NULL) { /* @@ -377,7 +376,7 @@ vnode_pager_setsize(vp, nsize) vm_page_t m; vm_pindex_t nobjsize; - if ((object = vp->v_object) == NULL) + if ((object = vp->v_object) == NULL || object->type != OBJT_VNODE) return; /* ASSERT_VOP_ELOCKED(vp, "vnode_pager_setsize and not locked vnode"); */ VM_OBJECT_WLOCK(object); Index: /usr/src/sys/kern/uipc_syscalls.c =================================================================== --- /usr/src/sys/kern/uipc_syscalls.c (revision 249704) +++ /usr/src/sys/kern/uipc_syscalls.c (working copy) @@ -1902,8 +1902,10 @@ kern_sendfile(struct thread *td, struct sendfile_a struct mbuf *m = NULL; struct sf_buf *sf; struct vm_page *pg; + struct vattr va; off_t off, xfsize, fsbytes = 0, sbytes = 0, rem = 0; int error, hdrlen = 0, mnw = 0; + int bsize; struct sendfile_sync *sfs = NULL; /* @@ -2102,6 +2104,16 @@ retry_space: */ space -= hdrlen; + error = vn_lock(vp, LK_SHARED); + if (error != 0) + goto done; + error = VOP_GETATTR(vp, &va, td->td_ucred); + if (error != 0) { + VOP_UNLOCK(vp, 0); + goto done; + } + bsize = vp->v_mount->mnt_stat.f_iosize; + /* * Loop and construct maximum sized mbuf chain to be bulk * dumped into socket buffer. @@ -2111,7 +2123,6 @@ retry_space: vm_offset_t pgoff; struct mbuf *m0; - VM_OBJECT_WLOCK(obj); /* * Calculate the amount to transfer. * Not to exceed a page, the EOF, @@ -2121,12 +2132,11 @@ retry_space: if (uap->nbytes) rem = (uap->nbytes - fsbytes - loopbytes); else - rem = obj->un_pager.vnp.vnp_size - + rem = va.va_size - uap->offset - fsbytes - loopbytes; xfsize = omin(PAGE_SIZE - pgoff, rem); xfsize = omin(space - loopbytes, xfsize); if (xfsize <= 0) { - VM_OBJECT_WUNLOCK(obj); done = 1; /* all data sent */ break; } @@ -2146,6 +2156,7 @@ retry_space: * if not found or wait and loop if busy. */ pindex = OFF_TO_IDX(off); + VM_OBJECT_WLOCK(obj); pg = vm_page_grab(obj, pindex, VM_ALLOC_NOBUSY | VM_ALLOC_NORMAL | VM_ALLOC_WIRED | VM_ALLOC_RETRY); @@ -2163,7 +2174,6 @@ retry_space: else if (uap->flags & SF_NODISKIO) error = EBUSY; else { - int bsize; ssize_t resid; /* @@ -2175,13 +2185,6 @@ retry_space: /* * Get the page from backing store. - */ - error = vn_lock(vp, LK_SHARED); - if (error != 0) - goto after_read; - bsize = vp->v_mount->mnt_stat.f_iosize; - - /* * XXXMAC: Because we don't have fp->f_cred * here, we pass in NOCRED. This is probably * wrong, but is consistent with our original @@ -2191,8 +2194,6 @@ retry_space: trunc_page(off), UIO_NOCOPY, IO_NODELOCKED | IO_VMIO | ((MAXBSIZE / bsize) << IO_SEQSHIFT), td->td_ucred, NOCRED, &resid, td); - VOP_UNLOCK(vp, 0); - after_read: VM_OBJECT_WLOCK(obj); vm_page_io_finish(pg); if (!error) @@ -2281,6 +2282,8 @@ retry_space: } } + VOP_UNLOCK(vp, 0); + /* Add the buffer chain to the socket buffer. */ if (m != NULL) { int mlen, err; -- Test scenario: sendfile5.sh + hw.physmem=2g