GENERIC from Fri Sep 28 14:28:35 2012 +0300, r241025+tmpfs 6ab0130, vmcore.447 KDB: debugger backends: ddb KDB: current backend: ddb 524288K of memory above 4GB ignored Copyright (c) 1992-2012 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #0 r241025+6ab0130: Sat Sep 29 14:35:16 CEST 2012 pho@x4.osted.lan:/var/tmp/deviant2/sys/i386/compile/PHO i386 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 0x10 Model = 0x2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 4294967296 (4096 MB) avail memory = 3531583488 (3367 MB) : Trying to mount root from ufs:/dev/ad4s1a [rw]... WARNING: / was not properly dismounted Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. warning: total configured swap (4194304 pages) exceeds maximum recommended amount (3890432 pages). warning: increase kern.maxswzone or reduce amount of swap. Starting file system checks: /dev/ad4s1a: INCORRECT BLOCK COUNT I=213364 (32 should be 0) (CORRECTED) /dev/ad4s1a: UNREF FILE I=213364 OWNER=root MODE=100600 /dev/ad4s1a: SIZE=0 MTIME=Sep 29 15:33 2012 (CLEARED) /dev/ad4s1a: LINK COUNT FILE I=213426 OWNER=root MODE=100600 /dev/ad4s1a: SIZE=15289 MTIME=Sep 29 15:33 2012 COUNT 2 SHOULD BE 1 (ADJUSTED) /dev/ad4s1a: BLK(S) MISSING IN BIT MAPS (SALVAGED) /dev/ad4s1a: 7571 files, 407686 used, 605329 free (1569 frags, 75470 blocks, 0.2% fragmentation) /dev/ad4s1f: UNREF FILE I=4020 OWNER=pho MODE=100755 /dev/ad4s1f: SIZE=2796 MTIME=Sep 29 15:32 2012 (CLEARED) /dev/ad4s1f: UNREF FILE I=4023 OWNER=pho MODE=100755 /dev/ad4s1f: SIZE=2578 MTIME=Sep 29 14:29 2012 (CLEARED) /dev/ad4s1f: FREE BLK COUNT(S) WRONG IN SUPERBLK (SALVAGED) /dev/ad4s1f: SUMMARY INFORMATION BAD (SALVAGED) /dev/ad4s1f: BLK(S) MISSING IN BIT MAPS (SALVAGED) /dev/ad4s1f: 23382 files, 872453 used, 140562 free (5178 frags, 16923 blocks, 0.5% fragmentation) /dev/label/tmp: 2304 files, 48521464 used, 69792517 free (4637 frags, 8723485 blocks, 0.0% fragmentation) /dev/ad4s1d: 660115 files, 7209632 used, 2944567 free (227967 frags, 339575 blocks, 2.2% fragmentation) /dev/ad4s1e: LINK COUNT FILE I=1742853 OWNER=operator MODE=100400 /dev/ad4s1e: SIZE=2048 MTIME=Sep 29 15:11 2012 COUNT 2 SHOULD BE 1 (ADJUSTED) /dev/ad4s1e: LINK COUNT FILE I=1742861 OWNER=operator MODE=100400 /dev/ad4s1e: SIZE=2048 MTIME=Sep 29 14:44 2012 COUNT 2 SHOULD BE 1 (ADJUSTED) /dev/ad4s1e: LINK COUNT FILE I=1742869 OWNER=operator MODE=100400 /dev/ad4s1e: SIZE=2048 MTIME=Sep 29 14:22 2012 COUNT 2 SHOULD BE 1 (ADJUSTED) /dev/ad4s1e: LINK COUNT FILE I=1742872 OWNER=operator MODE=100400 /dev/ad4s1e: SIZE=2048 MTIME=Sep 29 14:55 2012 COUNT 2 SHOULD BE 1 (ADJUSTED) /dev/ad4s1e: LINK COUNT FILE I=1742877 OWNER=operator MODE=100400 /dev/ad4s1e: SIZE=2048 MTIME=Sep 29 14:33 2012 COUNT 2 SHOULD BE 1 (ADJUSTED) /dev/ad4s1e: LINK COUNT FILE I=1742890 OWNER=operator MODE=100400 /dev/ad4s1e: SIZE=2048 MTIME=Sep 29 15:22 2012 COUNT 2 SHOULD BE 1 (ADJUSTED) /dev/ad4s1e: LINK COUNT FILE I=1742896 OWNER=operator MODE=100400 /dev/ad4s1e: SIZE=2048 MTIME=Sep 29 14:11 2012 COUNT 2 SHOULD BE 1 (ADJUSTED) /dev/ad4s1e: FREE BLK COUNT(S) WRONG IN SUPERBLK (SALVAGED) /dev/ad4s1e: SUMMARY INFORMATION BAD (SALVAGED) /dev/ad4s1e: BLK(S) MISSING IN BIT MAPS (SALVAGED) /dev/ad4s1e: 304414 files, 8773278 used, 16615239 free (64455 frags, 2068848 blocks, 0.3% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN re0: link state changed to UP Starting Network: lo0 re0 fwe0 fwip0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x4 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 scopeid 0x1 nd6 options=29 media: Ethernet autoselect (100baseTX ) status: active fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 Starting devd. Starting Network: fwe0. fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 Starting Network: fwip0. fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/kde4/lib /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/gcc46 /usr/local/lib/mysql /usr/local/lib/nss /usr/local/lib/qt4 /usr/local/lib/virtualbox a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. savecore: reboot after panic: Assertion tmp->tm_pages_used == 0 failed at /var/tmp/deviant2/sys/modules/tmpfs/../../fs/tmpfs/tmpfs_vfsops.c:322 Sep 29 15:39:41 x4 savecore: reboot after panic: Assertion tmp->tm_pages_used == 0 failed at /var/tmp/deviant2/sys/modules/tmpfs/../../fs/tmpfs/tmpfs_vfsops.c:322 lock order reversal: 1st 0xe1914420 bufwait (bufwait) @ kern/vfs_bio.c:2652 2nd 0xca812600 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper(c1084a70,2e687361,38323a63,c1000a34,ca867984,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0adeb7b,c108860c,c138f348,11c,f275b7dc,...) at kdb_backtrace+0x2a _witness_debugger(c108860c,ca812600,c10ba41e,c7d86818,c10ba0b0,...) at _witness_debugger+0x25 witness_checkorder(ca812600,9,c10ba0a7,11c,0,...) at witness_checkorder+0x86f _sx_xlock(ca812600,0,c10ba0a7,11c,cac3ca6c,...) at _sx_xlock+0xa5 ufsdirhash_acquire(e19143c0,cac3ca6c,28,e2268858,f275b8ac,...) at ufsdirhash_acquire+0x48 ufsdirhash_add(cac3ca6c,f275b918,858,f275b898,f275b89c,...) at ufsdirhash_add+0x13 ufs_direnter(cae1b000,cae082d0,f275b918,f275bbc0,0,...) at ufs_direnter+0x799 ufs_makeinode(f275bbc0,c11ed020,f275bb10,f275ba6c,c0ed2420,...) at ufs_makeinode+0x65d ufs_create(f275bb10,c10deda0,c1200f80,cae1b000,f275bb24,...) at ufs_create+0x30 VOP_CREATE_APV(c11eca60,f275bb10,f275bbc0,f275baa8,0,...) at VOP_CREATE_APV+0x100 vn_open_cred(f275bb80,f275bc20,180,0,c7dc3e00,...) at vn_open_cred+0x20a vn_open(f275bb80,f275bc20,180,ca800930,0,...) at vn_open+0x3b kern_openat(ca8678d0,ffffff9c,28807000,0,602,...) at kern_openat+0x1e2 kern_open(ca8678d0,28807000,0,601,180,...) at kern_open+0x35 sys_open(ca8678d0,f275bccc,32906284,0,f275bcc4,...) at sys_open+0x30 syscall(f275bd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x28189523, esp = 0xbfbfd2cc, ebp = 0xbfbfdde8 --- savecore: writing core to vmcore.446 Writing crash summary to /var/crash/core.txt.446. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 Clearing /tmp (X related). Starting mountd. Starting nfsuserd. Starting nfsd. Recovering vi editor sessions:. Updating motd:. Starting ntpd. Starting default moused. Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Local package initialization: backuplock order reversal: 1st 0xca87d760 ufs (ufs) @ kern/vfs_subr.c:2159 2nd 0xe1badcc0 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:261 3rd 0xcad96e68 ufs (ufs) @ kern/vfs_subr.c:2159 KDB: stack backtrace: db_trace_self_wrapper(c1084a70,3a632e73,a313632,7fffff00,0,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0adeb7b,c1088625,c138e9a8,86f,f27f9818,...) at kdb_backtrace+0x2a _witness_debugger(c1088625,cad96e68,c106ff8b,c7d867b0,c1090785,...) at _witness_debugger+0x25 witness_checkorder(cad96e68,9,c109077c,86f,0,...) at witness_checkorder+0x86f __lockmgr_args(cad96e68,80100,cad96ed4,0,0,...) at __lockmgr_args+0x915 ffs_lock(f27f9924,c0af136c,0,4,ca855c38,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c11eca60,f27f9924,c8198c74,c1200d00,cad96e10,...) at VOP_LOCK1_APV+0xf3 _vn_lock(cad96e10,80100,c109077c,86f,ec,...) at _vn_lock+0x78 vget(cad96e10,80100,c8198bc0,50,0,...) at vget+0xbb vfs_hash_get(ca78c5d8,c38000,80000,c8198bc0,f27f9a70,...) at vfs_hash_get+0xed ffs_vgetf(ca78c5d8,c38000,80000,f27f9a70,1,...) at ffs_vgetf+0x49 softdep_sync_buf(ca87d708,e1badc60,1,107,0,...) at softdep_sync_buf+0x4a3 ffs_syncvnode(ca87d708,1,0,5fe,ca87d7cc,...) at ffs_syncvnode+0x24c ffs_sync(ca78c5d8,1,f27f9b98,522,c1baf710,...) at ffs_sync+0x379 dounmount(ca78c5d8,8080000,c8198bc0,4a3,ffffffff,...) at dounmount+0x400 sys_unmount(c8198bc0,f27f9ccc,e12805ea,0,f27f9cc4,...) at sys_unmount+0x421 syscall(f27f9d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c58bb, esp = 0xbfbfd67c, ebp = 0xbfbfd748 --- lock order reversal: 1st 0xca879490 ufs (ufs) @ kern/vfs_mount.c:1256 2nd 0xca855b98 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1834 KDB: stack backtrace: db_trace_self_wrapper(c1084a70,38313a63,a3433,cad975f8,8,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0adeb7b,c108860c,c138e988,72a,f27f9984,...) at kdb_backtrace+0x2a _witness_debugger(c108860c,ca855b98,c107b374,c7d86610,c10b6522,...) at _witness_debugger+0x25 witness_checkorder(ca855b98,9,c10b6519,72a,ca855c04,...) at witness_checkorder+0x86f __lockmgr_args(ca855b98,80400,ca855c04,0,0,...) at __lockmgr_args+0x915 vop_stdlock(f27f9a8c,c13c41e0,4,c107e4ff,ec,...) at vop_stdlock+0x65 VOP_LOCK1_APV(c11abe60,f27f9a8c,c13c41e0,c1200d00,ca855b40,...) at VOP_LOCK1_APV+0xf3 _vn_lock(ca855b40,80400,c10b6519,72a,0,...) at _vn_lock+0x78 softdep_flushworklist(ca78c5d8,f27f9b44,c8198bc0,612,ca87d7cc,...) at softdep_flushworklist+0x47 ffs_sync(ca78c5d8,1,f27f9b98,522,c1baf710,...) at ffs_sync+0x3bf dounmount(ca78c5d8,8080000,c8198bc0,4a3,ffffffff,...) at dounmount+0x400 sys_unmount(c8198bc0,f27f9ccc,e12805ea,0,f27f9cc4,...) at sys_unmount+0x421 syscall(f27f9d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c58bb, esp = 0xbfbfd67c, ebp = 0xbfbfd748 --- ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 2304 files, 48521464 used, 69792517 free (4637 frags, 8723485 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 2304 files, 48521464 used, 69792517 free (4637 frags, 8723485 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmp watchdogd. Starting inetd. Sat Sep 29 15:44:15 CEST 2012 FreeBSD/i386 (x4.osted.lan) (console) login: Sep 29 15:46:53 x4 su: pho to root on /dev/pts/0 panic: vm_page_free_toq: freeing mapped page 0xc2b83678 cpuid = 2 KDB: enter: panic [ thread pid 3547 tid 100227 ] Stopped at kdb_enter+0x3a: movl $0,kdb_why db> run pho db:0:pho> bt Tracing pid 3547 tid 100227 td 0xcd8945e0 kdb_enter(c10805f2,c10805f2,c10be98e,f2974adc,2,...) at kdb_enter+0x3a panic(c10be98e,c2b83678,c10be07a,7fa,c2b83678,...) at panic+0x18c vm_page_free_toq(c2b83678,f2974b30,c0d2fe7f,c2b83678,0,...) at vm_page_free_toq+0x5c vm_page_free(c2b83678,0,c10bda73,77a,691,...) at vm_page_free+0x15 vm_object_page_remove(cc687940,0,0,1,0,...) at vm_object_page_remove+0x26f vm_map_delete(c818e828,1000,bfc00000,c818e8d8,c818e828,...) at vm_map_delete+0x2ee vm_map_remove(c818e828,1000,bfc00000,cd8945e0,cd86bb30,...) at vm_map_remove+0x51 vmspace_exit(cd8945e0,0,c107a223,141,0,...) at vmspace_exit+0xc3 exit1(cd8945e0,0,f2974cfc,c0ea94ee,cd8945e0,...) at exit1+0x63b sys_sys_exit(cd8945e0,f2974ccc,f2974ccc,f2974c98,c0acd167,...) at sys_sys_exit+0x1d syscall(f2974d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (1, FreeBSD ELF32, sys_sys_exit), eip = 0x280f7d0f, esp = 0xbfbfd8ac, ebp = 0xbfbfd8b8 --- db:0:bt> show allpcpu Current CPU: 2 cpuid = 0 dynamic pcpu = 0x61d180 curthread = 0xcd8555e0: pid 1700 "swap" curpcb = 0xf28fcd60 fpcurthread = none idlethread = 0xc7de28d0: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x690d180 curthread = 0xcb42f8d0: pid 3503 "true" curpcb = 0xf284ed60 fpcurthread = none idlethread = 0xc7de25e0: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x6910180 curthread = 0xcd8945e0: pid 3547 "true" curpcb = 0xf2974d60 fpcurthread = 0xcd8945e0: pid 3547 "true" idlethread = 0xc7de22f0: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x6913180 curthread = 0xc81955e0: pid 7 "pagedaemon" curpcb = 0xee320d60 fpcurthread = none idlethread = 0xc7de2000: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks Process 3547 (true) thread 0xcd8945e0 (100227) exclusive sleep mutex vm page (vm page) r = 0 (0xc13c5b00) locked @ vm/vm_object.c:1914 exclusive sleep mutex vm object (standard object) r = 0 (0xcc687940) locked @ vm/vm_map.c:2727 exclusive sx vm map (user) (vm map (user)) r = 0 (0xc818e870) locked @ vm/vm_map.c:2869 Process 3503 (true) thread 0xcb42f8d0 (100133) exclusive sleep mutex process lock (process lock) r = 0 (0xcb41d8ec) locked @ kern/vfs_vnops.c:1872 exclusive lockmgr ufs (ufs) r = 0 (0xcd7e5e68) locked @ kern/kern_ktrace.c:1209 exclusive sx ktrace_sx (ktrace_sx) r = 0 (0xc1242db8) locked @ kern/kern_ktrace.c:389 Process 3480 (sed) thread 0xcad41000 (100232) exclusive lockmgr bufwait (bufwait) r = 0 (0xe18e3b60) locked @ vm/vm_pager.c:311 shared lockmgr ufs (ufs) r = 0 (0xcae07d00) locked @ kern/vfs_subr.c:2159 Process 3411 (bash) thread 0xca844bc0 (100083) exclusive lockmgr bufwait (bufwait) r = 0 (0xe18e3d00) locked @ vm/vm_pager.c:311 shared lockmgr ufs (ufs) r = 0 (0xcbd5e058) locked @ kern/vfs_subr.c:2159 Process 1700 (swap) thread 0xcd8555e0 (100187) exclusive sleep mutex process lock (process lock) r = 0 (0xcd850bb8) locked @ i386/i386/trap.c:903 Process 7 (pagedaemon) thread 0xc81955e0 (100072) exclusive sleep mutex pmap (pmap) r = 0 (0xcad26b90) locked @ i386/i386/pmap.c:4777 exclusive rw pmap pv global (pmap pv global) r = 0 (0xc13e5a80) locked @ i386/i386/pmap.c:4735 exclusive sleep mutex vm object (standard object) r = 0 (0xcd7e065c) locked @ vm/vm_pageout.c:955 exclusive sleep mutex vm page (vm page) r = 0 (0xc13c5200) locked @ vm/vm_pageout.c:302 db:0:alllocks> show lockedvnods Locked vnodes 0xcd7e5e10: tag ufs, type VREG usecount 18, writecount 0, refcount 655 mountedhere 0 flags (VI(0x200)) v_object 0xcd7c39d4 ref 0 pages 2544 lock type ufs: EXCL by thread 0xcb42f8d0 (pid 3503, true, tid 100133) #0 0xc0a871ee at __lockmgr_args+0xdbe #1 0xc0d01961 at ffs_lock+0xa1 #2 0xc0ed0fe3 at VOP_LOCK1_APV+0xf3 #3 0xc0b54bb8 at _vn_lock+0x78 #4 0xc0a811d8 at ktr_writerequest+0x1f8 #5 0xc0a81885 at ktr_submitrequest+0x45 #6 0xc0a81d83 at ktrsysret+0x43 #7 0xc0ea96f1 at syscall+0x501 #8 0xc0e931b1 at Xint0x80_syscall+0x21 ino 4031, on dev ada0s1f 0xcae07ca8: tag ufs, type VREG usecount 6, writecount 0, refcount 8 mountedhere 0 flags (VV_TEXT|VI(0x200)) v_object 0xcac51cb8 ref 3 pages 8 lock type ufs: SHARED (count 1) #0 0xc0a86ad8 at __lockmgr_args+0x6a8 #1 0xc0d01961 at ffs_lock+0xa1 #2 0xc0ed0fe3 at VOP_LOCK1_APV+0xf3 #3 0xc0b54bb8 at _vn_lock+0x78 #4 0xc0b477ab at vget+0xbb #5 0xc0d211b5 at vm_fault_hold+0x925 #6 0xc0d2289b at vm_fault+0x8b #7 0xc0ea8fe2 at trap_pfault+0x1c2 #8 0xc0ea9cd6 at trap+0x3b6 #9 0xc0e9311c at calltrap+0x6 ino 1108409, on dev ada0s1d 0xcbd5e000: tag ufs, type VREG usecount 12, writecount 0, refcount 13 mountedhere 0 flags (VI(0x200)) v_object 0xcbd5b818 ref 11 pages 8 lock type ufs: SHARED (count 1) #0 0xc0a86ad8 at __lockmgr_args+0x6a8 #1 0xc0d01961 at ffs_lock+0xa1 #2 0xc0ed0fe3 at VOP_LOCK1_APV+0xf3 #3 0xc0b54bb8 at _vn_lock+0x78 #4 0xc0b477ab at vget+0xbb #5 0xc0d211b5 at vm_fault_hold+0x925 #6 0xc0d2289b at vm_fault+0x8b #7 0xc0ea8fe2 at trap_pfault+0x1c2 #8 0xc0ea9cd6 at trap+0x3b6 #9 0xc0e9311c at calltrap+0x6 ino 1346565, on dev ada0s1d db:0:lockedvnods> show mount 0xca78cbb0 /dev/ad4s1a on / (ufs) 0xca78d000 devfs on /dev (devfs) 0xca78c8c4 /dev/ad4s1f on /home (ufs) 0xca78c2ec /dev/ad4s1d on /usr (ufs) 0xca78c000 /dev/ad4s1e on /var (ufs) 0xcac305d8 procfs on /proc (procfs) 0xcac302ec /dev/label/tmp on /tmp (ufs) 0xcd839bb0 tmpfs on /mnt (tmpfs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 3547 1638 1604 0 RE+ CPU 2 true 3545 1632 1604 0 R+ tmpfs13 3544 1626 1604 0 N+ tmpfs13 3527 1630 1604 0 R+ tmpfs13 3503 1637 1604 0 R+ CPU 1 true 3491 3474 3391 1001 RL awk 3480 3474 3391 1001 DL vnread 0xe18e3b00 sed 3479 3474 3391 1001 RL sed 3478 3474 3391 1001 RL vmstat 3475 3391 3391 1001 RL awk 3474 3391 3391 1001 SW wait 0xcac242cc sh 3468 1634 1604 0 RL+ tmpfs13 3467 3465 3467 1001 DLs pfault 0xc13c48dc tail 3465 3106 3106 1001 S select 0xca8601a4 sshd 3411 3401 3411 1001 DLs+ vnread 0xe18e3ca0 bash 3401 3104 3104 1001 S select 0xcb262424 sshd 3391 3367 3391 1001 SWs wait 0xccec4598 sh 3367 3105 3105 1001 S select 0xcb49a464 sshd 3106 1207 3106 0 Ss select 0xca861964 sshd 3105 1207 3105 0 Ss select 0xca7ba224 sshd 3104 1207 3104 0 Ss select 0xca861ca4 sshd 1741 1687 1604 0 R+ swap 1740 1687 1604 0 R+ swap 1739 1687 1604 0 DL+ pfault 0xc13c48dc swap 1738 1687 1604 0 DL+ pfault 0xc13c48dc swap 1737 1687 1604 0 R+ swap 1736 1687 1604 0 R+ swap 1735 1687 1604 0 DL+ pfault 0xc13c48dc swap 1733 1687 1604 0 R+ swap 1732 1687 1604 0 R+ swap 1731 1687 1604 0 R+ swap 1729 1687 1604 0 R+ swap 1728 1687 1604 0 R+ swap 1727 1687 1604 0 DL+ pfault 0xc13c48dc swap 1726 1687 1604 0 RL+ swap 1725 1687 1604 0 DL+ pfault 0xc13c48dc swap 1724 1687 1604 0 RL+ swap 1722 1687 1604 0 R+ swap 1721 1687 1604 0 R+ swap 1719 1687 1604 0 RL+ swap 1718 1687 1604 0 R+ swap 1717 1687 1604 0 R+ swap 1716 1687 1604 0 RL+ swap 1714 1687 1604 0 R+ swap 1713 1687 1604 0 R+ swap 1712 1687 1604 0 DL+ pfault 0xc13c48dc swap 1710 1687 1604 0 R+ swap 1709 1687 1604 0 RL+ swap 1708 1687 1604 0 R+ swap 1703 1687 1604 0 R+ swap 1702 1687 1604 0 R+ swap 1701 1687 1604 0 R+ swap 1700 1687 1604 0 R+ CPU 0 swap 1699 1687 1604 0 R+ swap 1698 1687 1604 0 R+ swap 1697 1687 1604 0 R+ swap 1696 1687 1604 0 R+ swap 1695 1687 1604 0 R+ swap 1694 1687 1604 0 R+ swap 1693 1687 1604 0 R+ swap 1692 1687 1604 0 DL+ pfault 0xc13c48dc swap 1687 1624 1604 0 SW+ wait 0xca6cb2cc swap 1638 1623 1604 0 S+ wait 0xcad3c2cc tmpfs13 1637 1623 1604 0 S+ wait 0xccec62cc tmpfs13 1635 1623 1604 0 ?WL+ tmpfs13 1634 1623 1604 0 SW+ wait 0xcac24864 tmpfs13 1632 1623 1604 0 S+ wait 0xca7b82cc tmpfs13 1631 1623 1604 0 RL+ tmpfs13 1630 1623 1604 0 S+ wait 0xccec6000 tmpfs13 1628 1623 1604 0 ?W+ tmpfs13 1626 1623 1604 0 RL+ tmpfs13 1625 1623 1604 0 R+ tmpfs13 1624 1604 1604 0 S+ nanslp 0xc1246284 swap 1623 1604 1604 0 SW+ wait 0xcb41f864 tmpfs13 1604 1464 1604 0 SW+ wait 0xcb41d000 sh 1502 1 1502 1001 DLs swread 0xc33fd368 vim 1490 1489 1490 1001 Ss+ ttyin 0xca746270 bash 1489 1487 1487 1001 S select 0xcb262324 sshd 1487 1207 1487 0 Ss select 0xcb262ba4 sshd 1464 1461 1464 0 SW+ wait 0xcb41fb30 bash 1461 1460 1461 0 SW+ pause 0xca83bb88 csh 1460 1455 1460 1001 SW+ wait 0xcad3bb30 su 1455 1454 1455 1001 SWs+ wait 0xcb570b30 bash 1454 1452 1452 1001 S select 0xcb49a0a4 sshd 1452 1207 1452 0 Ss select 0xcb262024 sshd 1393 1 1393 0 Ss+ ttyin 0xc7f2da70 getty 1392 1 1392 0 Ss+ ttyin 0xc7f2dc70 getty 1391 1 1391 0 Ss+ ttyin 0xc7f2de70 getty 1390 1 1390 0 Ss+ ttyin 0xc81a2070 getty 1389 1 1389 0 Ss+ ttyin 0xc81a2270 getty 1388 1 1388 0 Ss+ ttyin 0xc81a2470 getty 1387 1 1387 0 Ss+ ttyin 0xc7f2c070 getty 1386 1 1386 0 Ss+ ttyin 0xc7f2c270 getty 1385 1 1385 0 Ss+ ttyin 0xc7f2c470 getty 1368 1 1368 0 Ss select 0xca861664 inetd 1343 1 1343 0 Ss nanslp 0xc1246284 watchdogd 1218 1 1218 0 SWs nanslp 0xc1246284 cron 1213 1 1213 25 SWs pause 0xcad3b058 sendmail 1210 1 1210 0 Ss select 0xc8007d24 sendmail 1207 1 1207 0 Ss select 0xca8603e4 sshd 1175 1 1175 0 Ss select 0xca83c264 moused 1150 1 1150 0 Ss select 0xcb262624 ntpd 1095 1091 1091 0 R (threaded) nfsd 100125 S rpcsvc 0xcb1e37d0 nfsd: service 100124 RunQ nfsd: service 100123 S rpcsvc 0xcb1e4d10 nfsd: service 100105 S rpcsvc 0xcb1e3850 nfsd: master 1091 1 1091 0 Ss select 0xc8007164 nfsd 1089 1085 1085 0 S select 0xca7babe4 nfsuserd 1088 1085 1085 0 S select 0xca8600e4 nfsuserd 1087 1085 1085 0 S select 0xca7bac24 nfsuserd 1086 1085 1085 0 S select 0xc80070e4 nfsuserd 1085 1 1085 0 SWs pause 0xca6cb8bc nfsuserd 1069 1 1069 0 Ss select 0xca83c524 mountd 1036 1 1036 0 Ss select 0xca83cea4 rpcbind 966 1 966 0 Ss select 0xc7ff9264 syslogd 843 1 843 0 Ss select 0xc7ffb0a4 devd 19 0 0 0 DL sdflush 0xc13c4220 [softdepflush] 18 0 0 0 DL vlruwt 0xca6c92cc [vnlru] 17 0 0 0 DL syncer 0xc13bc4b4 [syncer] 16 0 0 0 DL psleep 0xc13bc148 [bufdaemon] 9 0 0 0 DL pgzero 0xc13c61dc [pagezero] 8 0 0 0 DL psleep 0xc13c5d48 [vmdaemon] 7 0 0 0 RL CPU 3 [pagedaemon] 6 0 0 0 DL ccb_scan 0xc1208bd4 [xpt_thrd] 5 0 0 0 DL waiting_ 0xc13bfa38 [sctp_iterator] 4 0 0 0 DL ctl_work 0xc81a4000 [ctl_thrd] 3 0 0 0 DL - 0xc7ff623c [fdc0] 2 0 0 0 SL - 0xc809a000 [fw0_probe] 15 0 0 0 DL (threaded) [usb] 100058 D - 0xc8076d34 [usbus5] 100057 D - 0xc8076d04 [usbus5] 100056 D - 0xc8076cd4 [usbus5] 100055 D - 0xc8076ca4 [usbus5] 100053 D - 0xc806ab5c [usbus4] 100052 D - 0xc806ab2c [usbus4] 100051 D - 0xc806aafc [usbus4] 100050 D - 0xc806aacc [usbus4] 100049 D - 0xc8062b5c [usbus3] 100048 D - 0xc8062b2c [usbus3] 100047 D - 0xc8062afc [usbus3] 100046 D - 0xc8062acc [usbus3] 100045 D - 0xc805bb5c [usbus2] 100044 D - 0xc805bb2c [usbus2] 100043 D - 0xc805bafc [usbus2] 100042 D - 0xc805bacc [usbus2] 100040 D - 0xc8056b5c [usbus1] 100039 D - 0xc8056b2c [usbus1] 100038 D - 0xc8056afc [usbus1] 100037 D - 0xc8056acc [usbus1] 100035 D - 0xc8048b5c [usbus0] 100034 D - 0xc8048b2c [usbus0] 100033 D - 0xc8048afc [usbus0] 100032 D - 0xc8048acc [usbus0] 14 0 0 0 DL - 0xc1245084 [yarrow] 13 0 0 0 DL (threaded) [geom] 100015 D - 0xc1242108 [g_down] 100014 D - 0xc1242104 [g_up] 100013 D - 0xc12420fc [g_event] 12 0 0 0 WL (threaded) [intr] 100066 I [irq12: psm0] 100065 I [irq1: atkbd0] 100063 I [swi0: uart] 100060 I [irq20: fwohci0] 100059 I [irq14: ata0] 100054 I [irq19: ehci0] 100041 I [irq18: ohci2 ohci4] 100036 I [irq17: ohci1 ohci3] 100031 I [irq16: hdac1 ohci0] 100030 I [irq22: ahci0] 100029 I [irq257: re0] 100028 I [irq256: hdac0] 100027 I [swi2: cambio] 100023 I [swi6: task queue] 100022 I [swi6: Giant taskq] 100019 I [swi5: fast taskq] 100012 I [swi1: netisr 0] 100011 I [swi3: vm] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 I [swi4: clock] 100007 I [swi4: clock] 11 0 0 0 RL (threaded) [idle] 100006 CanRun [idle: cpu3] 100005 CanRun [idle: cpu2] 100004 CanRun [idle: cpu1] 100003 CanRun [idle: cpu0] 1 0 1 0 SLs wait 0xc7de0b30 [init] 10 0 0 0 DL audit_wo 0xc13c3960 [audit] 0 0 0 0 DLs (threaded) [kernel] 100069 D - 0xc1245084 [deadlkres] 100068 D - 0xc8194500 [mca taskq] 100061 D - 0xc8066d00 [fw0_taskq] 100026 D - 0xc7db2480 [acpi_task_2] 100025 D - 0xc7db2480 [acpi_task_1] 100024 D - 0xc7db2480 [acpi_task_0] 100021 D - 0xc7db25c0 [thread taskq] 100020 D - 0xc7db2600 [ffs_trim taskq] 100018 D - 0xc7db26c0 [kqueue taskq] 100016 D - 0xc7db2ac0 [firmware taskq] 100000 D swread 0xc2b2a5f0 [swapper] 3546 1625 1604 0 Z+ true 3493 1628 1604 0 Z+ true 3492 1635 1604 0 Z+ true db:0:ps> allt Tracing command true pid 3547 tid 100227 td 0xcd8945e0 kdb_enter(c10805f2,c10805f2,c10be98e,f2974adc,2,...) at kdb_enter+0x3a panic(c10be98e,c2b83678,c10be07a,7fa,c2b83678,...) at panic+0x18c vm_page_free_toq(c2b83678,f2974b30,c0d2fe7f,c2b83678,0,...) at vm_page_free_toq+0x5c vm_page_free(c2b83678,0,c10bda73,77a,691,...) at vm_page_free+0x15 vm_object_page_remove(cc687940,0,0,1,0,...) at vm_object_page_remove+0x26f vm_map_delete(c818e828,1000,bfc00000,c818e8d8,c818e828,...) at vm_map_delete+0x2ee vm_map_remove(c818e828,1000,bfc00000,cd8945e0,cd86bb30,...) at vm_map_remove+0x51 vmspace_exit(cd8945e0,0,c107a223,141,0,...) at vmspace_exit+0xc3 exit1(cd8945e0,0,f2974cfc,c0ea94ee,cd8945e0,...) at exit1+0x63b sys_sys_exit(cd8945e0,f2974ccc,f2974ccc,f2974c98,c0acd167,...) at sys_sys_exit+0x1d syscall(f2974d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (1, FreeBSD ELF32, sys_sys_exit), eip = 0x280f7d0f, esp = 0xbfbfd8ac, ebp = 0xbfbfd8b8 --- Tracing command tmpfs13 pid 3545 tid 100224 td 0xcd896000 fork_trampoline() at fork_trampoline Tracing command tmpfs13 pid 3544 tid 100134 td 0xcb42f5e0 sched_switch(c0af136c,1,c7d823d8,c7d867b0,c,...) at sched_switch+0x458 uart_sab82532_class(72656b2f,66762f6e,69625f73,632e6f,61726477,...) at 0x64c Tracing command tmpfs13 pid 3527 tid 100176 td 0xcad41bc0 fork_trampoline() at fork_trampoline Tracing command true pid 3503 tid 100133 td 0xcb42f8d0 cpustop_handler(1,f284e9a8,c0ea9953,0,f284ea34,...) at cpustop_handler+0x26 ipi_nmi_handler(0,f284ea34,0,0,cb41d864,...) at ipi_nmi_handler+0x35 trap(f284e9b4) at trap+0x33 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0a9c30b, esp = 0xf284e9f4, ebp = 0xf284ea10 --- lim_rlimit(cb41d864,1,f284ea24,f284ea48,f284ebb4,...) at lim_rlimit+0x5b lim_cur(cb41d864,1,c1092084,750,f284ebb4,...) at lim_cur+0x1f vn_rlimit_fsize(cd7e5e10,f284ebb4,cb42f8d0,c0a871ee,cd7e5e88,...) at vn_rlimit_fsize+0x83 ffs_write(f284ebec,c10decd5,cd7e5e10,cd7e5e10,f284eb74,...) at ffs_write+0x168 VOP_WRITE_APV(c11eca60,f284ebec,cd7e5e10,4b9,0,...) at VOP_WRITE_APV+0x174 ktr_writerequest(c1242db8,0,c107c101,185,0,...) at ktr_writerequest+0x248 ktr_submitrequest(0,cb42f8d0,f284ecfc,c0ea96f1,154,...) at ktr_submitrequest+0x45 ktrsysret(154,0,0,f284ec98,c0acd167,...) at ktrsysret+0x43 syscall(f284ed08) at syscall+0x501 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (0, FreeBSD ELF32, nosys), eip = 0x28055553, esp = 0xbfbfd20c, ebp = 0xbfbfd228 --- Tracing command awk pid 3491 tid 100152 td 0xca7bbbc0 sched_switch(ca7bbbc0,0,104,1b3,f2893924,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,cd8730c0,...) at mi_switch+0x243 sleepq_switch(ca7bbbc0,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(c13c48dc,78,c10be5b0,0,0,...) at sleepq_wait+0x6b _sleep(c13c48dc,c13c4b80,278,c10be5b0,0,...) at _sleep+0x39b vm_waitpfault(ca5ce4a0,6,0,12b,f2893b44,...) at vm_waitpfault+0x75 vm_fault_hold(cd8a21d0,281cf000,2,0,0,...) at vm_fault_hold+0x62e vm_fault(cd8a21d0,281cf000,2,0,281cf678,...) at vm_fault+0x8b trap_pfault(cb570864,f2893c44,c0ae8d2c,2,cb570864,...) at trap_pfault+0x1c2 trap(f2893d08) at trap+0x3b6 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x28074203, esp = 0xbfbfd2a0, ebp = 0xbfbfd378 --- Tracing command sed pid 3480 tid 100232 td 0xcad41000 sched_switch(cad41000,0,104,1b3,f29b877c,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c7dc06c0,...) at mi_switch+0x243 sleepq_switch(cad41000,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(e18e3b00,54,c10c010c,0,0,...) at sleepq_wait+0x6b _sleep(e18e3b00,c7d9990c,54,c10c010c,0,...) at _sleep+0x39b bwait(e18e3b00,54,c10c010c,325,0,...) at bwait+0x6f vnode_pager_generic_getpages(cae07ca8,f29b8a10,2000,0,c3b37a50,...) at vnode_pager_generic_getpages+0x1369 ffs_getpages(f29b89b8,c10de3e9,ec,c526a418,0,...) at ffs_getpages+0x189 VOP_GETPAGES_APV(c11eca60,f29b89b8,c10bfd3d,2a3,c12013e0,...) at VOP_GETPAGES_APV+0x111 vnode_pager_getpages(cac51cb8,f29b8a10,2,0,f29b8b74,...) at vnode_pager_getpages+0xb4 vm_fault_hold(cae19000,804a000,1,0,0,...) at vm_fault_hold+0xe55 vm_fault(cae19000,804a000,1,0,804a58e,...) at vm_fault+0x8b trap_pfault(cad41000,f29b8d08,f29b8cc4,c7b18c80,ca6f9864,...) at trap_pfault+0x1c2 trap(f29b8d08) at trap+0x3b6 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x804a58e, esp = 0xbfbfc290, ebp = 0xbfbfdc68 --- Tracing command sed pid 3479 tid 100158 td 0xcbd61bc0 sched_switch(cbd61bc0,0,104,1b3,f28a5924,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,cd8730c0,...) at mi_switch+0x243 sleepq_switch(cbd61bc0,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(c13c48dc,78,c10be5b0,0,0,...) at sleepq_wait+0x6b _sleep(c13c48dc,c13c4b80,278,c10be5b0,0,...) at _sleep+0x39b vm_waitpfault(cd7e09d4,27f,0,12b,f28a5b44,...) at vm_waitpfault+0x75 vm_fault_hold(cae199f8,2841b000,1,0,0,...) at vm_fault_hold+0x62e vm_fault(cae199f8,2841b000,1,0,2841b000,...) at vm_fault+0x8b trap_pfault(cbd61bc0,f28a5d08,c0ae8d2c,2,cb56f598,...) at trap_pfault+0x1c2 trap(f28a5d08) at trap+0x3b6 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x280f3ee3, esp = 0xbfbfd730, ebp = 0xbfbfd788 --- Tracing command vmstat pid 3478 tid 100085 td 0xca8445e0 sched_switch(ca8445e0,0,104,1b3,f272b924,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,cd8730c0,...) at mi_switch+0x243 sleepq_switch(ca8445e0,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(c13c48dc,78,c10be5b0,0,0,...) at sleepq_wait+0x6b _sleep(c13c48dc,c13c4b80,278,c10be5b0,0,...) at _sleep+0x39b vm_waitpfault(cd7c265c,360,0,12b,f272bb44,...) at vm_waitpfault+0x75 vm_fault_hold(c81900e8,2851f000,1,0,0,...) at vm_fault_hold+0x62e vm_fault(c81900e8,2851f000,1,0,2851f000,...) at vm_fault+0x8b trap_pfault(0,f272bc50,c0aca57c,c12542b0,ca83b2cc,...) at trap_pfault+0x1c2 trap(f272bd08) at trap+0x3b6 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x28116ee3, esp = 0xbfbfce50, ebp = 0xbfbfcea8 --- Tracing command awk pid 3475 tid 100221 td 0xcd7b98d0 sched_switch(cd7b98d0,0,104,1b3,f2962924,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,cd8730c0,...) at mi_switch+0x243 sleepq_switch(cd7b98d0,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(c13c48dc,78,c10be5b0,0,0,...) at sleepq_wait+0x6b _sleep(c13c48dc,c13c4b80,278,c10be5b0,0,...) at _sleep+0x39b vm_waitpfault(ca5cc818,9c8,0,12b,f2962b44,...) at vm_waitpfault+0x75 vm_fault_hold(cd8a20e8,28b98000,1,0,0,...) at vm_fault_hold+0x62e vm_fault(cd8a20e8,28b98000,1,0,28b98000,...) at vm_fault+0x8b trap_pfault(cd7b98d0,f2962d08,c0ae8d2c,2,ccec4864,...) at trap_pfault+0x1c2 trap(f2962d08) at trap+0x3b6 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x28127ee3, esp = 0xbfbfd8e0, ebp = 0xbfbfd938 --- Tracing command sh pid 3474 tid 100147 td 0xcb4d2bc0 Tracing command tmpfs13 pid 3468 tid 100220 td 0xcd8968d0 sched_switch(cd8968d0,0,104,1b3,f295f924,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,cd8730c0,...) at mi_switch+0x243 sleepq_switch(cd8968d0,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(c13c48dc,78,c10be5b0,0,0,...) at sleepq_wait+0x6b _sleep(c13c48dc,c13c4b80,278,c10be5b0,0,...) at _sleep+0x39b vm_waitpfault(ca5cf534,4,0,12b,f295fb44,...) at vm_waitpfault+0x75 vm_fault_hold(c7de6ae0,28063000,2,0,0,...) at vm_fault_hold+0x62e vm_fault(c7de6ae0,28063000,2,0,28063000,...) at vm_fault+0x8b trap_pfault(cd8968d0,f295fd08,c138cf68,cd896984,cd88c000,...) at trap_pfault+0x1c2 trap(f295fd08) at trap+0x3b6 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x28051cf6, esp = 0xbfbfd794, ebp = 0xbfbfd794 --- Tracing command tail pid 3467 tid 100101 td 0xca862bc0 sched_switch(ca862bc0,0,104,1b3,f2773924,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c806fb00,...) at mi_switch+0x243 sleepq_switch(ca862bc0,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(c13c48dc,78,c10be5b0,0,0,...) at sleepq_wait+0x6b _sleep(c13c48dc,c13c4b80,278,c10be5b0,0,...) at _sleep+0x39b vm_waitpfault(c8182378,34c,0,12b,f2773b44,...) at vm_waitpfault+0x75 vm_fault_hold(cae19910,284e4000,1,0,0,...) at vm_fault_hold+0x62e vm_fault(cae19910,284e4000,1,0,284e4000,...) at vm_fault+0x8b trap_pfault(ca862bc0,f2773d08,c0ae8d2c,2,ca85b598,...) at trap_pfault+0x1c2 trap(f2773d08) at trap+0x3b6 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x280efee3, esp = 0xbfbfd6b0, ebp = 0xbfbfd708 --- Tracing command sshd pid 3465 tid 100159 td 0xcbd618d0 sched_switch(cbd618d0,0,104,1b3,f28a896c,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1254280,...) at mi_switch+0x243 sleepq_switch(cbd618d0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a8f49a,ca860190,0,c107e4ff,cbd618d0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(ca8601a4,0,f28a8a30,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca8601a4,ca860190,c1088cc5,6ae,ca8003f0,...) at _cv_wait_sig+0x263 seltdwait(ca8003f0,58,ca764180,cbd618d0,cbd61984,...) at seltdwait+0xa2 kern_select(cbd618d0,c,28c0c1c8,28c0c1d0,0,0,20,cb56f2cc,0) at kern_select+0x667 sys_select(cbd618d0,f28a8ccc,c0aa9ea8,f28a8c98,c0acd167,...) at sys_select+0x66 syscall(f28a8d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28521aa3, esp = 0xbfbfce5c, ebp = 0xbfbfcea8 --- Tracing command bash pid 3411 tid 100083 td 0xca844bc0 sched_switch(ca844bc0,0,104,1b3,f272277c,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c806fd00,...) at mi_switch+0x243 sleepq_switch(ca844bc0,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(e18e3ca0,54,c10c010c,0,0,...) at sleepq_wait+0x6b _sleep(e18e3ca0,c7d99010,54,c10c010c,0,...) at _sleep+0x39b bwait(e18e3ca0,54,c10c010c,325,0,...) at bwait+0x6f vnode_pager_generic_getpages(cbd5e000,f2722a10,5000,1,c3359aa8,...) at vnode_pager_generic_getpages+0x1369 ffs_getpages(f27229b8,c10de3e9,ec,c5394978,0,...) at ffs_getpages+0x189 VOP_GETPAGES_APV(c11eca60,f27229b8,c10bfd3d,2a3,c12013e0,...) at VOP_GETPAGES_APV+0x111 vnode_pager_getpages(cbd5b818,f2722a10,5,1,f2722b74,...) at vnode_pager_getpages+0xb4 vm_fault_hold(ca7f6cb0,2814a000,1,0,0,...) at vm_fault_hold+0xe55 vm_fault(ca7f6cb0,2814a000,1,0,2814a780,...) at vm_fault+0x8b trap_pfault(ca844bc0,f2722d08,f2722cc4,c7b18c80,ca83b864,...) at trap_pfault+0x1c2 trap(f2722d08) at trap+0x3b6 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x2814a780, esp = 0xbfbfdb6c, ebp = 0xbfbfdb88 --- Tracing command sshd pid 3401 tid 100100 td 0xca7c1bc0 sched_switch(ca7c1bc0,0,104,1b3,f276f96c,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1253580,...) at mi_switch+0x243 sleepq_switch(ca7c1bc0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a8f49a,cb262410,0,c107e4ff,ca7c1bc0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cb262424,0,f276fa30,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cb262424,cb262410,c1088cc5,6ae,ca7ce8c0,...) at _cv_wait_sig+0x263 seltdwait(ca7ce8c0,58,cac56180,ca7c1bc0,ca7c1c74,...) at seltdwait+0xa2 kern_select(ca7c1bc0,a,28c0c1c8,28c0c1d0,0,0,20,ca6cbb30,0) at kern_select+0x667 sys_select(ca7c1bc0,f276fccc,c0ea713c,f276fc98,c0acd167,...) at sys_select+0x66 syscall(f276fd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28521aa3, esp = 0xbfbfce5c, ebp = 0xbfbfcea8 --- Tracing command sh pid 3391 tid 100229 td 0xcd7b95e0 Tracing command sshd pid 3367 tid 100161 td 0xcb4d1bc0 sched_switch(cb4d1bc0,0,104,1b3,f28ae96c,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1253580,...) at mi_switch+0x243 sleepq_switch(cb4d1bc0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a8f49a,cb49a450,0,c107e4ff,cb4d1bc0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cb49a464,0,f28aea30,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cb49a464,cb49a450,c1088cc5,6ae,cb270620,...) at _cv_wait_sig+0x263 seltdwait(cb270620,58,ca764a00,cb4d1bc0,c0aef1f7,...) at seltdwait+0xa2 kern_select(cb4d1bc0,c,28c0c1c8,28c0c1d0,0,0,20,cb41f2cc,0) at kern_select+0x667 sys_select(cb4d1bc0,f28aeccc,c1253580,f28aec98,c0acd167,...) at sys_select+0x66 syscall(f28aed08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28521aa3, esp = 0xbfbfce5c, ebp = 0xbfbfcea8 --- Tracing command sshd pid 3106 tid 100132 td 0xcb42fbc0 sched_switch(cb42fbc0,0,104,1b3,f28469d0,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1252f00,...) at mi_switch+0x243 sleepq_switch(cb42fbc0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a8f49a,ca861950,0,c107e4ff,cb42fbc0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(ca861964,0,f2846a94,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca861964,ca861950,c1088cc5,6ae,f2846b1c,...) at _cv_wait_sig+0x263 seltdwait(cb4f082c,c1088cc5,5ab,cb42fbc0,c0a8f3c8,...) at seltdwait+0xa2 sys_poll(cb42fbc0,f2846ccc,9954405f,0,f2846cc4,...) at sys_poll+0x321 syscall(f2846d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284b8ecb, esp = 0xbfbfcebc, ebp = 0xbfbfcef8 --- Tracing command sshd pid 3105 tid 100107 td 0xca8435e0 sched_switch(ca8435e0,0,104,1b3,f278d9d0,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1252f00,...) at mi_switch+0x243 sleepq_switch(ca8435e0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a8f49a,ca7ba210,0,c107e4ff,ca8435e0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(ca7ba224,0,f278da94,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca7ba224,ca7ba210,c1088cc5,6ae,f278db1c,...) at _cv_wait_sig+0x263 seltdwait(ca874a2c,c1088cc5,5ab,ca8435e0,c0a8f3c8,...) at seltdwait+0xa2 sys_poll(ca8435e0,f278dccc,c0aa9ea8,f278dc98,c0acd167,...) at sys_poll+0x321 syscall(f278dd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284b8ecb, esp = 0xbfbfcebc, ebp = 0xbfbfcef8 --- Tracing command sshd pid 3104 tid 100156 td 0xca7bb000 sched_switch(ca7bb000,0,104,1b3,f289f9d0,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1253c00,...) at mi_switch+0x243 sleepq_switch(ca7bb000,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a8f49a,ca861c90,0,c107e4ff,ca7bb000,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(ca861ca4,0,f289fa94,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca861ca4,ca861c90,c1088cc5,6ae,f289fb1c,...) at _cv_wait_sig+0x263 seltdwait(cb4f132c,c1088cc5,5ab,ca7bb000,c0a8f3c8,...) at seltdwait+0xa2 sys_poll(ca7bb000,f289fccc,bd5101ee,0,f289fcc4,...) at sys_poll+0x321 syscall(f289fd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284b8ecb, esp = 0xbfbfcebc, ebp = 0xbfbfcef8 --- Tracing command swap pid 1741 tid 100218 td 0xcd8558d0 sched_switch(cd8558d0,0,207,1ae,af,...) at sched_switch+0x458 mi_switch(207,0,c1086ec5,ec,c1426460,...) at mi_switch+0x243 ast(f2959d08) at ast+0x2ee doreti_ast() at doreti_ast+0x1a Tracing command swap pid 1740 tid 100217 td 0xcd855bc0 sched_switch(cd855bc0,0,207,1ae,af,...) at sched_switch+0x458 mi_switch(207,0,c1086ec5,ec,c1426460,...) at mi_switch+0x243 ast(f2956d08) at ast+0x2ee doreti_ast() at doreti_ast+0x1a Tracing command swap pid 1739 tid 100216 td 0xcd870000 sched_switch(cd870000,0,104,1b3,f2953924,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c806fb00,...) at mi_switch+0x243 sleepq_switch(cd870000,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(c13c48dc,78,c10be5b0,0,0,...) at sleepq_wait+0x6b _sleep(c13c48dc,c13c4b80,278,c10be5b0,0,...) at _sleep+0x39b vm_waitpfault(cd897128,a70,0,12b,f2953b44,...) at vm_waitpfault+0x75 vm_fault_hold(cb3fa570,29670000,2,0,0,...) at vm_fault_hold+0x62e vm_fault(cb3fa570,29670000,2,0,29670000,...) at vm_fault+0x8b trap_pfault(cd870000,f2953d08,7f9f74b4,690d180,cd88cb30,...) at trap_pfault+0x1c2 trap(f2953d08) at trap+0x3b6 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x2819027f, esp = 0xbfbfd6d0, ebp = 0xbfbfd718 --- Tracing command swap pid 1738 tid 100215 td 0xcd8702f0 sched_switch(cd8702f0,0,104,1b3,f2950924,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c806fb00,...) at mi_switch+0x243 sleepq_switch(cd8702f0,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(c13c48dc,78,c10be5b0,0,0,...) at sleepq_wait+0x6b _sleep(c13c48dc,c13c4b80,278,c10be5b0,0,...) at _sleep+0x39b vm_waitpfault(cd899128,343a,0,12b,f2950b44,...) at vm_waitpfault+0x75 vm_fault_hold(c7de51d0,2c03a000,2,0,0,...) at vm_fault_hold+0x62e vm_fault(c7de51d0,2c03a000,2,0,2c03a000,...) at vm_fault+0x8b trap_pfault(cd8702f0,f2950d08,f2950cc4,c1825c80,cd88d000,...) at trap_pfault+0x1c2 trap(f2950d08) at trap+0x3b6 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x2819027f, esp = 0xbfbfd6d0, ebp = 0xbfbfd718 --- Tracing command swap pid 1737 tid 100214 td 0xcd8705e0 sched_switch(cd8705e0,0,207,1ae,ae,...) at sched_switch+0x458 mi_switch(207,0,c1086ec5,ec,c1426460,...) at mi_switch+0x243 ast(f294dd08) at ast+0x2ee doreti_ast() at doreti_ast+0x1a Tracing command swap pid 1736 tid 100213 td 0xcd8708d0 sched_switch(cd8708d0,0,207,1ae,ae,...) at sched_switch+0x458 mi_switch(207,0,c1086ec5,ec,c1426460,...) at mi_switch+0x243 ast(f294ad08) at ast+0x2ee doreti_ast() at doreti_ast+0x1a Tracing command swap pid 1735 tid 100212 td 0xcd870bc0 sched_switch(cd870bc0,0,104,1b3,f2947924,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c806fb00,...) at mi_switch+0x243 sleepq_switch(cd870bc0,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(c13c48dc,78,c10be5b0,0,0,...) at sleepq_wait+0x6b _sleep(c13c48dc,c13c4b80,278,c10be5b0,0,...) at _sleep+0x39b vm_waitpfault(cd89d6f0,298c,0,12b,f2947b44,...) at vm_waitpfault+0x75 vm_fault_hold(cad1d828,2b58c000,2,0,0,...) at vm_fault_hold+0x62e vm_fault(cad1d828,2b58c000,2,0,2b58c000,...) at vm_fault+0x8b trap_pfault(cd870bc0,f2947d08,f2947cc4,c7b18c80,cd88d864,...) at trap_pfault+0x1c2 trap(f2947d08) at trap+0x3b6 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x2819027f, esp = 0xbfbfd6d0, ebp = 0xbfbfd718 --- Tracing command swap pid 1733 tid 100211 td 0xcd871000 sched_switch(cd871000,0,207,1ae,af,...) at sched_switch+0x458 mi_switch(207,0,c1086ec5,ec,c1426460,...) at mi_switch+0x243 ast(f2944d08) at ast+0x2ee doreti_ast() at doreti_ast+0x1a Tracing command swap pid 1732 tid 100210 td 0xcd8712f0 sched_switch(cd8712f0,0,207,1ae,b0,...) at sched_switch+0x458 mi_switch(207,0,c1086ec5,ec,c1426460,...) at mi_switch+0x243 ast(f2941d08) at ast+0x2ee doreti_ast() at doreti_ast+0x1a Tracing command swap pid 1731 tid 100209 td 0xcd8715e0 sched_switch(cd8715e0,0,602,1ae,0,...) at sched_switch+0x458 mi_switch(602,0,c1080ebf,cd,0,...) at mi_switch+0x243 critical_exit(cd8715e0,0,0,28c00000,1000,...) at critical_exit+0xb8 ipi_bitmap_handler(3b,3b,3b,5066ff3d,1000,...) at ipi_bitmap_handler+0x82 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x2f --- interrupt, eip = 0x8049254, esp = 0xbfbfd7a0, ebp = 0xbfbfd7b8 --- Tracing command swap pid 1729 tid 100208 td 0xcd8718d0 sched_switch(cd8718d0,0,207,1ae,b0,...) at sched_switch+0x458 mi_switch(207,0,c1086ec5,ec,c1426460,...) at mi_switch+0x243 ast(f293bd08) at ast+0x2ee doreti_ast() at doreti_ast+0x1a Tracing command swap pid 1728 tid 100207 td 0xcd871bc0 sched_switch(cd871bc0,0,207,1ae,b1,...) at sched_switch+0x458 mi_switch(207,0,c1086ec5,ec,c1426460,...) at mi_switch+0x243 ast(f2938d08) at ast+0x2ee doreti_ast() at doreti_ast+0x1a Tracing command swap pid 1727 tid 100206 td 0xcd872000 sched_switch(cd872000,0,104,1b3,f2935924,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c806fb00,...) at mi_switch+0x243 sleepq_switch(cd872000,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(c13c48dc,78,c10be5b0,0,0,...) at sleepq_wait+0x6b _sleep(c13c48dc,c13c4b80,278,c10be5b0,0,...) at _sleep+0x39b vm_waitpfault(cd89d000,39be,0,12b,f2935b44,...) at vm_waitpfault+0x75 vm_fault_hold(c7de6488,2c5be000,1,0,0,...) at vm_fault_hold+0x62e vm_fault(c7de6488,2c5be000,1,0,2c5be000,...) at vm_fault+0x8b trap_pfault(cd872000,f2935d08,f2935cc4,c1825c80,cd869598,...) at trap_pfault+0x1c2 trap(f2935d08) at trap+0x3b6 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x28101ee3, esp = 0xbfbfd680, ebp = 0xbfbfd6d8 --- Tracing command swap pid 1726 tid 100205 td 0xcd8722f0 sched_switch(cd8722f0,0,104,1b3,f2932924,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,cd8730c0,...) at mi_switch+0x243 sleepq_switch(cd8722f0,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(c13c48dc,78,c10be5b0,0,0,...) at sleepq_wait+0x6b _sleep(c13c48dc,c13c4b80,278,c10be5b0,0,...) at _sleep+0x39b vm_waitpfault(cd7b19d4,dab,0,12b,f2932b44,...) at vm_waitpfault+0x75 vm_fault_hold(c7de5570,299ab000,2,0,0,...) at vm_fault_hold+0x62e vm_fault(c7de5570,299ab000,2,0,299ab000,...) at vm_fault+0x8b trap_pfault(cd8722f0,f2932d08,f2932cc4,c1825c80,cd869864,...) at trap_pfault+0x1c2 trap(f2932d08) at trap+0x3b6 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x2819027f, esp = 0xbfbfd6d0, ebp = 0xbfbfd718 --- Tracing command swap pid 1725 tid 100204 td 0xcd8725e0 sched_switch(cd8725e0,0,104,1b3,f292f924,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c806fb00,...) at mi_switch+0x243 sleepq_switch(cd8725e0,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(c13c48dc,78,c10be5b0,0,0,...) at sleepq_wait+0x6b _sleep(c13c48dc,c13c4b80,278,c10be5b0,0,...) at _sleep+0x39b vm_waitpfault(cd89e000,3f33,0,12b,f292fb44,...) at vm_waitpfault+0x75 vm_fault_hold(c7de6828,2cb33000,2,0,0,...) at vm_fault_hold+0x62e vm_fault(c7de6828,2cb33000,2,0,2cb33000,...) at vm_fault+0x8b trap_pfault(cd8725e0,f292fd08,f292fcc4,c7b15c80,cd869b30,...) at trap_pfault+0x1c2 trap(f292fd08) at trap+0x3b6 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x2819027f, esp = 0xbfbfd6d0, ebp = 0xbfbfd718 --- Tracing command swap pid 1724 tid 100203 td 0xcd8728d0 sched_switch(cd8728d0,0,104,1b3,f292c924,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,cd8730c0,...) at mi_switch+0x243 sleepq_switch(cd8728d0,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(c13c48dc,78,c10be5b0,0,0,...) at sleepq_wait+0x6b _sleep(c13c48dc,c13c4b80,278,c10be5b0,0,...) at _sleep+0x39b vm_waitpfault(cd89bc24,6326,0,12b,f292cb44,...) at vm_waitpfault+0x75 vm_fault_hold(ca8850e8,2ef26000,1,0,0,...) at vm_fault_hold+0x62e vm_fault(ca8850e8,2ef26000,1,0,2ef26000,...) at vm_fault+0x8b trap_pfault(cd8728d0,f292cd08,f292ccc4,c7b18c80,cd86a000,...) at trap_pfault+0x1c2 trap(f292cd08) at trap+0x3b6 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x28101ee3, esp = 0xbfbfd680, ebp = 0xbfbfd6d8 --- Tracing command swap pid 1722 tid 100202 td 0xcd7ba5e0 sched_switch(cd7ba5e0,0,207,1ae,af,...) at sched_switch+0x458 mi_switch(207,0,c1086ec5,ec,c1426460,...) at mi_switch+0x243 ast(f2929d08) at ast+0x2ee doreti_ast() at doreti_ast+0x1a Tracing command swap pid 1721 tid 100201 td 0xcd7ba8d0 sched_switch(cd7ba8d0,0,207,1ae,ae,...) at sched_switch+0x458 mi_switch(207,0,c1086ec5,ec,c1426460,...) at mi_switch+0x243 ast(f2926d08) at ast+0x2ee doreti_ast() at doreti_ast+0x1a Tracing command swap pid 1719 tid 100200 td 0xcd7babc0 sched_switch(cd7babc0,0,104,1b3,f2923924,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,cd8730c0,...) at mi_switch+0x243 sleepq_switch(cd7babc0,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(c13c48dc,78,c10be5b0,0,0,...) at sleepq_wait+0x6b _sleep(c13c48dc,c13c4b80,278,c10be5b0,0,...) at _sleep+0x39b vm_waitpfault(cd89e9d4,2bc9,0,12b,f2923b44,...) at vm_waitpfault+0x75 vm_fault_hold(ca7b2bc8,2b7c9000,2,0,0,...) at vm_fault_hold+0x62e vm_fault(ca7b2bc8,2b7c9000,2,0,2b7c9000,...) at vm_fault+0x8b trap_pfault(cd7babc0,f2923d08,f2923cc4,c7b1bc80,cd86a864,...) at trap_pfault+0x1c2 trap(f2923d08) at trap+0x3b6 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x2819027f, esp = 0xbfbfd6d0, ebp = 0xbfbfd718 --- Tracing command swap pid 1718 tid 100199 td 0xcd853000 sched_switch(cd853000,0,207,1ae,af,...) at sched_switch+0x458 mi_switch(207,0,c1086ec5,ec,c1426460,...) at mi_switch+0x243 ast(f2920d08) at ast+0x2ee doreti_ast() at doreti_ast+0x1a Tracing command swap pid 1717 tid 100198 td 0xcd8532f0 sched_switch(cd8532f0,0,207,1ae,af,...) at sched_switch+0x458 mi_switch(207,0,c1086ec5,ec,c1426460,...) at mi_switch+0x243 ast(f291dd08) at ast+0x2ee doreti_ast() at doreti_ast+0x1a Tracing command swap pid 1716 tid 100197 td 0xcd8535e0 sched_switch(cd8535e0,0,104,1b3,f291a924,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,cd8730c0,...) at mi_switch+0x243 sleepq_switch(cd8535e0,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(c13c48dc,78,c10be5b0,0,0,...) at sleepq_wait+0x6b _sleep(c13c48dc,c13c4b80,278,c10be5b0,0,...) at _sleep+0x39b vm_waitpfault(cd7c26f0,a79,0,12b,f291ab44,...) at vm_waitpfault+0x75 vm_fault_hold(cad26740,29679000,2,0,0,...) at vm_fault_hold+0x62e vm_fault(cad26740,29679000,2,0,29679000,...) at vm_fault+0x8b trap_pfault(cd8535e0,f291ad08,f291acc4,c1825c80,cd86b2cc,...) at trap_pfault+0x1c2 trap(f291ad08) at trap+0x3b6 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x2819027f, esp = 0xbfbfd6d0, ebp = 0xbfbfd718 --- Tracing command swap pid 1714 tid 100196 td 0xcd8538d0 sched_switch(cd8538d0,0,207,1ae,b0,...) at sched_switch+0x458 mi_switch(207,0,c1086ec5,ec,c1426460,...) at mi_switch+0x243 ast(f2917d08) at ast+0x2ee doreti_ast() at doreti_ast+0x1a Tracing command swap pid 1713 tid 100140 td 0xcb42ebc0 sched_switch(cb42ebc0,0,207,1ae,af,...) at sched_switch+0x458 mi_switch(207,0,c1086ec5,ec,c1426460,...) at mi_switch+0x243 ast(f2866d08) at ast+0x2ee doreti_ast() at doreti_ast+0x1a Tracing command swap pid 1712 tid 100195 td 0xcd853bc0 sched_switch(cd853bc0,0,104,1b3,f2914924,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c806fb00,...) at mi_switch+0x243 sleepq_switch(cd853bc0,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(c13c48dc,78,c10be5b0,0,0,...) at sleepq_wait+0x6b _sleep(c13c48dc,c13c4b80,278,c10be5b0,0,...) at _sleep+0x39b vm_waitpfault(cd7e0de0,4e57,0,12b,f2914b44,...) at vm_waitpfault+0x75 vm_fault_hold(ca8853a0,2da57000,1,0,0,...) at vm_fault_hold+0x62e vm_fault(ca8853a0,2da57000,1,0,2da57000,...) at vm_fault+0x8b trap_pfault(cd853bc0,f2914d08,f2914cc4,c7b15c80,ccec72cc,...) at trap_pfault+0x1c2 trap(f2914d08) at trap+0x3b6 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x28101ee3, esp = 0xbfbfd680, ebp = 0xbfbfd6d8 --- Tracing command swap pid 1710 tid 100194 td 0xcd854000 sched_switch(cd854000,0,207,1ae,af,...) at sched_switch+0x458 mi_switch(207,0,c1086ec5,ec,c1426460,...) at mi_switch+0x243 ast(f2911d08) at ast+0x2ee doreti_ast() at doreti_ast+0x1a Tracing command swap pid 1709 tid 100193 td 0xcd8542f0 sched_switch(cd8542f0,0,104,1b3,f290e924,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,cd8730c0,...) at mi_switch+0x243 sleepq_switch(cd8542f0,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(c13c48dc,78,c10be5b0,0,0,...) at sleepq_wait+0x6b _sleep(c13c48dc,c13c4b80,278,c10be5b0,0,...) at _sleep+0x39b vm_waitpfault(cd7e065c,166a,0,12b,f290eb44,...) at vm_waitpfault+0x75 vm_fault_hold(cad26ae0,2a26a000,2,0,0,...) at vm_fault_hold+0x62e vm_fault(cad26ae0,2a26a000,2,0,2a26a000,...) at vm_fault+0x8b trap_pfault(cd8542f0,f290ed08,f290ecc4,c7b15c80,ccec7864,...) at trap_pfault+0x1c2 trap(f290ed08) at trap+0x3b6 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x2819027f, esp = 0xbfbfd6d0, ebp = 0xbfbfd718 --- Tracing command swap pid 1708 tid 100192 td 0xcd8545e0 sched_switch(cd8545e0,0,602,1ae,0,...) at sched_switch+0x458 mi_switch(602,0,c1080ebf,cd,4,...) at mi_switch+0x243 critical_exit(cd8545e0,0,1,28c00000,1000,...) at critical_exit+0xb8 ipi_bitmap_handler(3b,3b,3b,5066ff42,1000,...) at ipi_bitmap_handler+0x82 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x2f --- interrupt, eip = 0x8049254, esp = 0xbfbfd7a0, ebp = 0xbfbfd7b8 --- Tracing command swap pid 1703 tid 100190 td 0xcd854bc0 sched_switch(cd854bc0,0,207,1ae,af,...) at sched_switch+0x458 mi_switch(207,0,c1086ec5,ec,c1426460,...) at mi_switch+0x243 ast(f2905d08) at ast+0x2ee doreti_ast() at doreti_ast+0x1a Tracing command swap pid 1702 tid 100189 td 0xcd855000 sched_switch(cd855000,0,207,1ae,af,...) at sched_switch+0x458 mi_switch(207,0,c1086ec5,ec,c1426460,...) at mi_switch+0x243 ast(f2902d08) at ast+0x2ee doreti_ast() at doreti_ast+0x1a Tracing command swap pid 1701 tid 100188 td 0xcd8552f0 sched_switch(cd8552f0,0,602,1ae,0,...) at sched_switch+0x458 mi_switch(602,0,c1080ebf,cd,8,...) at mi_switch+0x243 critical_exit(cd8552f0,0,2,28c00000,1000,...) at critical_exit+0xb8 ipi_bitmap_handler(3b,3b,3b,5066ff3d,1000,...) at ipi_bitmap_handler+0x82 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x2f --- interrupt, eip = 0x8049254, esp = 0xbfbfd7a0, ebp = 0xbfbfd7b8 --- Tracing command swap pid 1700 tid 100187 td 0xcd8555e0 cpustop_handler(0,f28fcb30,c0ea9953,c0a6800e,c1426460,...) at cpustop_handler+0x26 ipi_nmi_handler(c0a6800e,c1426460,f28fcaa4,0,cd850b30,...) at ipi_nmi_handler+0x35 trap(f28fcb3c) at trap+0x33 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0aef004, esp = 0xf28fcb7c, ebp = 0xf28fcb94 --- witness_lock(cd850bb8,8,c10d73f2,387,0,...) at witness_lock+0x194 _mtx_lock_flags(cd850bb8,0,c10d73f2,387,2accd000,...) at _mtx_lock_flags+0x166 trap_pfault(cd8555e0,f28fcd08,f28fccc4,c1825c80,cd850b30,...) at trap_pfault+0x179 trap(f28fcd08) at trap+0x3b6 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x2819027f, esp = 0xbfbfd6d0, ebp = 0xbfbfd718 --- Tracing command swap pid 1699 tid 100186 td 0xcbd5f000 sched_switch(cbd5f000,0,207,1ae,af,...) at sched_switch+0x458 mi_switch(207,0,c1086ec5,ec,c1426460,...) at mi_switch+0x243 ast(f28f9d08) at ast+0x2ee doreti_ast() at doreti_ast+0x1a Tracing command swap pid 1698 tid 100185 td 0xcbd5f2f0 sched_switch(cbd5f2f0,0,207,1ae,ae,...) at sched_switch+0x458 mi_switch(207,0,c1086ec5,ec,c1426460,...) at mi_switch+0x243 ast(f28f6d08) at ast+0x2ee doreti_ast() at doreti_ast+0x1a Tracing command swap pid 1697 tid 100184 td 0xcbd5f5e0 sched_switch(cbd5f5e0,0,602,1ae,0,...) at sched_switch+0x458 mi_switch(602,0,c1080ebf,cd,c,...) at mi_switch+0x243 critical_exit(cbd5f5e0,0,3,28c00000,1000,...) at critical_exit+0xb8 ipi_bitmap_handler(3b,3b,3b,5066ff3b,1000,...) at ipi_bitmap_handler+0x82 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x2f --- interrupt, eip = 0x8049254, esp = 0xbfbfd7a0, ebp = 0xbfbfd7b8 --- Tracing command swap pid 1696 tid 100183 td 0xcbd5f8d0 sched_switch(cbd5f8d0,0,207,1ae,af,...) at sched_switch+0x458 mi_switch(207,0,c1086ec5,ec,c1426460,...) at mi_switch+0x243 ast(f28f0d08) at ast+0x2ee doreti_ast() at doreti_ast+0x1a Tracing command swap pid 1695 tid 100182 td 0xcbd5fbc0 sched_switch(cbd5fbc0,0,207,1ae,b0,...) at sched_switch+0x458 mi_switch(207,0,c1086ec5,ec,c1426460,...) at mi_switch+0x243 ast(f28edd08) at ast+0x2ee doreti_ast() at doreti_ast+0x1a Tracing command swap pid 1694 tid 100181 td 0xcbd60000 sched_switch(cbd60000,0,207,1ae,b0,...) at sched_switch+0x458 mi_switch(207,0,c1086ec5,ec,c1426460,...) at mi_switch+0x243 ast(f28ead08) at ast+0x2ee doreti_ast() at doreti_ast+0x1a Tracing command swap pid 1693 tid 100180 td 0xcbd602f0 sched_switch(cbd602f0,0,207,1ae,af,...) at sched_switch+0x458 mi_switch(207,0,c1086ec5,ec,c1426460,...) at mi_switch+0x243 ast(f28e7d08) at ast+0x2ee doreti_ast() at doreti_ast+0x1a Tracing command swap pid 1692 tid 100164 td 0xcbd61000 sched_switch(cbd61000,0,104,1b3,f28b7924,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c806fb00,...) at mi_switch+0x243 sleepq_switch(cbd61000,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(c13c48dc,78,c10be5b0,0,0,...) at sleepq_wait+0x6b _sleep(c13c48dc,c13c4b80,278,c10be5b0,0,...) at _sleep+0x39b vm_waitpfault(cd89e250,4ee7,0,12b,f28b7b44,...) at vm_waitpfault+0x75 vm_fault_hold(cb3fa1d0,2dae7000,1,0,0,...) at vm_fault_hold+0x62e vm_fault(cb3fa1d0,2dae7000,1,0,2dae7000,...) at vm_fault+0x8b trap_pfault(cbd61000,f28b7d08,f28b7cc4,c7b1bc80,cb56e864,...) at trap_pfault+0x1c2 trap(f28b7d08) at trap+0x3b6 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x28101ee3, esp = 0xbfbfd680, ebp = 0xbfbfd6d8 --- Tracing command swap pid 1687 tid 100110 td 0xca7c12f0 Tracing command tmpfs13 pid 1638 tid 100112 td 0xca6ccbc0 sched_switch(ca6ccbc0,0,104,1b3,f27e8ab4,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1253c00,...) at mi_switch+0x243 sleepq_switch(ca6ccbc0,0,c1086460,1ad,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c1086460,166,0,100,100,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cad3c2cc,6c,c10894a4,100,0,...) at sleepq_wait_sig+0x17 _sleep(cad3c2cc,cad3c354,16c,c10894a4,0,...) at _sleep+0x384 kern_wait(ca6ccbc0,ffffffff,f27e8c38,0,0,...) at kern_wait+0x597 sys_wait4(ca6ccbc0,f27e8ccc,f27e8ccc,f27e8c98,c0acd167,...) at sys_wait4+0x3b syscall(f27e8d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x280db18b, esp = 0xbfbfd82c, ebp = 0xbfbfd848 --- Tracing command tmpfs13 pid 1637 tid 100172 td 0xcb42d8d0 sched_switch(cb42d8d0,0,104,1b3,f28cfab4,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1253580,...) at mi_switch+0x243 sleepq_switch(cb42d8d0,0,c1086460,1ad,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c1086460,166,0,100,100,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(ccec62cc,6c,c10894a4,100,0,...) at sleepq_wait_sig+0x17 _sleep(ccec62cc,ccec6354,16c,c10894a4,0,...) at _sleep+0x384 kern_wait(cb42d8d0,ffffffff,f28cfc38,0,0,...) at kern_wait+0x597 sys_wait4(cb42d8d0,f28cfccc,f28cfccc,c107c101,189,...) at sys_wait4+0x3b syscall(f28cfd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x280db18b, esp = 0xbfbfd82c, ebp = 0xbfbfd848 --- Tracing command tmpfs13 pid 1635 tid 100089 td 0xca844000 Tracing command tmpfs13 pid 1634 tid 100145 td 0xcb4d32f0 Tracing command tmpfs13 pid 1632 tid 100092 td 0xca7c22f0 sched_switch(ca7c22f0,0,104,1b3,f274aab4,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1254280,...) at mi_switch+0x243 sleepq_switch(ca7c22f0,0,c1086460,1ad,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c1086460,166,0,100,100,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(ca7b82cc,6c,c10894a4,100,0,...) at sleepq_wait_sig+0x17 _sleep(ca7b82cc,ca7b8354,16c,c10894a4,0,...) at _sleep+0x384 kern_wait(ca7c22f0,ffffffff,f274ac38,0,0,...) at kern_wait+0x597 sys_wait4(ca7c22f0,f274accc,f274accc,f274ac98,c0acd167,...) at sys_wait4+0x3b syscall(f274ad08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x280db18b, esp = 0xbfbfd82c, ebp = 0xbfbfd848 --- Tracing command tmpfs13 pid 1631 tid 100154 td 0xca7bb5e0 sched_switch(ca7bb5e0,0,104,1b3,f2899924,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,cd8730c0,...) at mi_switch+0x243 sleepq_switch(ca7bb5e0,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(c13c48dc,78,c10be5b0,0,0,...) at sleepq_wait+0x6b _sleep(c13c48dc,c13c4b80,278,c10be5b0,0,...) at _sleep+0x39b vm_waitpfault(cceb4e74,0,0,12b,f2899b44,...) at vm_waitpfault+0x75 vm_fault_hold(cb3fa000,8049000,1,0,0,...) at vm_fault_hold+0x62e vm_fault(cb3fa000,8049000,1,0,80499e0,...) at vm_fault+0x8b trap_pfault(ca7bb5e0,f2899d08,c0aca57c,c12542b0,cb5702cc,...) at trap_pfault+0x1c2 trap(f2899d08) at trap+0x3b6 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x8048454, esp = 0xbfbfd84c, ebp = 0xbfbfd868 --- Tracing command tmpfs13 pid 1630 tid 100173 td 0xcb42d5e0 sched_switch(cb42d5e0,0,104,1b3,f28d2ab4,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1253c00,...) at mi_switch+0x243 sleepq_switch(cb42d5e0,0,c1086460,1ad,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c1086460,166,0,100,100,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(ccec6000,6c,c10894a4,100,0,...) at sleepq_wait_sig+0x17 _sleep(ccec6000,ccec6088,16c,c10894a4,0,...) at _sleep+0x384 kern_wait(cb42d5e0,ffffffff,f28d2c38,0,0,...) at kern_wait+0x597 sys_wait4(cb42d5e0,f28d2ccc,f28d2ccc,f28d2c98,c0acd167,...) at sys_wait4+0x3b syscall(f28d2d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x280db18b, esp = 0xbfbfd82c, ebp = 0xbfbfd848 --- Tracing command tmpfs13 pid 1628 tid 100126 td 0xca843000 Tracing command tmpfs13 pid 1626 tid 100163 td 0xcbd612f0 sched_switch(cbd612f0,0,104,1b3,f28b4acc,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,cd8730c0,...) at mi_switch+0x243 sleepq_switch(cbd612f0,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(c13c48dc,54,c10be5be,0,0,...) at sleepq_wait+0x6b _sleep(c13c48dc,c13c4b80,254,c10be5be,0,...) at _sleep+0x39b vm_wait(cb41d598,0,c107c101,251,0,...) at vm_wait+0xbe vm_forkproc(cbd612f0,cb41d598,cb42f5e0,c7de6570,14,...) at vm_forkproc+0xa6 fork1(cbd612f0,14,2,f28b4c3c,0,...) at fork1+0x1184 sys_fork(cbd612f0,f28b4ccc,f28b4ccc,f28b4c98,c0acd167,...) at sys_fork+0x39 syscall(f28b4d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (2, FreeBSD ELF32, sys_fork), eip = 0x280db1ab, esp = 0xbfbfd84c, ebp = 0xbfbfd868 --- Tracing command tmpfs13 pid 1625 tid 100153 td 0xca7bb8d0 sched_switch(ca7bb8d0,0,104,1b3,f2896ab4,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1253c00,...) at mi_switch+0x243 sleepq_switch(ca7bb8d0,0,c1086460,1ad,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c1086460,166,0,100,100,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cb570598,6c,c10894a4,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb570598,cb570620,16c,c10894a4,0,...) at _sleep+0x384 kern_wait(ca7bb8d0,ffffffff,f2896c38,0,0,...) at kern_wait+0x597 sys_wait4(ca7bb8d0,f2896ccc,f2896ccc,f2896c98,c0acd167,...) at sys_wait4+0x3b syscall(f2896d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x280db18b, esp = 0xbfbfd82c, ebp = 0xbfbfd848 --- Tracing command swap pid 1624 tid 100174 td 0xcb42d2f0 sched_switch(cb42d2f0,0,104,1b3,f28d5aec,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,f28d5b10,...) at mi_switch+0x243 sleepq_switch(cb42d2f0,0,c1086460,1ad,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(3e9,c0ae5410,cb42d2f0,2,100,...) at sleepq_catch_signals+0xfc sleepq_timedwait_sig(c1246284,6c,c1081ceb,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1246284,0,16c,c1081ceb,3e9,...) at _sleep+0x34e kern_nanosleep(cb42d2f0,f28d5c28,f28d5c30,1,0,...) at kern_nanosleep+0xc1 sys_nanosleep(cb42d2f0,f28d5ccc,c0ea713c,f28d5c98,c0acd167,...) at sys_nanosleep+0x6f syscall(f28d5d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2816df33, esp = 0xbfbfd78c, ebp = 0xbfbfd7b8 --- Tracing command tmpfs13 pid 1623 tid 100150 td 0xcb4d22f0 Tracing command sh pid 1604 tid 100139 td 0xcb42f000 Tracing command vim pid 1502 tid 100171 td 0xcb42dbc0 sched_switch(cb42dbc0,0,104,1b3,f28cc8e8,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,352,...) at mi_switch+0x243 sleepq_switch(cb42dbc0,0,c1086460,292,0,...) at sleepq_switch+0x1a7 sleepq_timedwait(c33fd368,50,c10bb715,0,0,...) at sleepq_timedwait+0x6b _sleep(c33fd368,cd6a71bc,50,c10bb715,4e20,...) at _sleep+0x369 swap_pager_getpages(cd6a71bc,f28cca10,1,0,f28ccb74,...) at swap_pager_getpages+0x3a1 vm_fault_hold(cad279f8,bfbfc000,2,0,0,...) at vm_fault_hold+0xe55 vm_fault(cad279f8,bfbfc000,2,0,bfbfcf3c,...) at vm_fault+0x8b trap_pfault(ccec6598,f28ccc44,c0ae8d2c,2,ccec6598,...) at trap_pfault+0x1c2 trap(f28ccd08) at trap+0x3b6 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x28b8ee2c, esp = 0xbfbfcf40, ebp = 0xbfbfd398 --- Tracing command bash pid 1490 tid 100138 td 0xca8452f0 sched_switch(ca8452f0,0,104,1b3,f285fa08,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1254280,...) at mi_switch+0x243 sleepq_switch(ca8452f0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a8f49a,ca746204,0,c107e4ff,ca8452f0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(ca746270,0,f285facc,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca746270,ca746204,c108ad14,538,0,...) at _cv_wait_sig+0x263 tty_wait(ca746200,ca746270,f285fc1c,1,0,...) at tty_wait+0x71 ttydisc_read(ca746200,f285fc1c,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(cbd65000,f285fc1c,0,1,0,...) at ttydev_read+0xaa devfs_read_f(ca7ce738,f285fc1c,ca623000,0,ca8452f0,...) at devfs_read_f+0x7d dofileread(f285fc1c,ffffffff,ffffffff,0,f285fbf8,...) at dofileread+0x9e kern_readv(ca8452f0,0,f285fc1c,f285fc3c,1,...) at kern_readv+0x68 sys_read(ca8452f0,f285fccc,23342355,0,f285fcc4,...) at sys_read+0x4f syscall(f285fd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28358b23, esp = 0xbfbfcfec, ebp = 0xbfbfd018 --- Tracing command sshd pid 1489 tid 100162 td 0xcbd615e0 sched_switch(cbd615e0,0,104,1b3,f28b196c,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1252f00,...) at mi_switch+0x243 sleepq_switch(cbd615e0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a8f49a,cb262310,0,c107e4ff,cbd615e0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cb262324,0,f28b1a30,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cb262324,cb262310,c1088cc5,6ae,ca7ce700,...) at _cv_wait_sig+0x263 seltdwait(ca7ce700,58,c817b880,cbd615e0,0,...) at seltdwait+0xa2 kern_select(cbd615e0,c,28c0c1c8,28c0c1d0,0,0,20,cb56f000,0) at kern_select+0x667 sys_select(cbd615e0,f28b1ccc,3873f32f,0,f28b1cc4,...) at sys_select+0x66 syscall(f28b1d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28521aa3, esp = 0xbfbfce5c, ebp = 0xbfbfcea8 --- Tracing command sshd pid 1487 tid 100141 td 0xcb4d3bc0 sched_switch(cb4d3bc0,0,104,1b3,f28699d0,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1253580,...) at mi_switch+0x243 sleepq_switch(cb4d3bc0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a8f49a,cb262b90,0,c107e4ff,cb4d3bc0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cb262ba4,0,f2869a94,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cb262ba4,cb262b90,c1088cc5,6ae,f2869b1c,...) at _cv_wait_sig+0x263 seltdwait(ca7cce2c,c1088cc5,5ab,cb4d3bc0,c138ea38,...) at seltdwait+0xa2 sys_poll(cb4d3bc0,f2869ccc,670b4b7c,0,f2869cc4,...) at sys_poll+0x321 syscall(f2869d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284b8ecb, esp = 0xbfbfcebc, ebp = 0xbfbfcef8 --- Tracing command bash pid 1464 tid 100149 td 0xcb4d25e0 Tracing command csh pid 1461 tid 100082 td 0xca845000 Tracing command su pid 1460 tid 100114 td 0xca6cc5e0 Tracing command bash pid 1455 tid 100151 td 0xca7c1000 Tracing command sshd pid 1454 tid 100166 td 0xcbd608d0 sched_switch(cbd608d0,0,104,1b3,f28bd96c,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1254280,...) at mi_switch+0x243 sleepq_switch(cbd608d0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a8f49a,cb49a090,0,c107e4ff,cbd608d0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cb49a0a4,0,f28bda30,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cb49a0a4,cb49a090,c1088cc5,6ae,ca7eae70,...) at _cv_wait_sig+0x263 seltdwait(ca7eae70,58,cb267000,cbd608d0,cbd60984,...) at seltdwait+0xa2 kern_select(cbd608d0,c,28c0c1c8,28c0c1d0,0,0,20,cb56e2cc,0) at kern_select+0x667 sys_select(cbd608d0,f28bdccc,91440a8d,0,f28bdcc4,...) at sys_select+0x66 syscall(f28bdd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28521aa3, esp = 0xbfbfce5c, ebp = 0xbfbfcea8 --- Tracing command sshd pid 1452 tid 100097 td 0xca8675e0 sched_switch(ca8675e0,0,104,1b3,f275f9d0,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1253580,...) at mi_switch+0x243 sleepq_switch(ca8675e0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a8f49a,cb262010,0,c107e4ff,ca8675e0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cb262024,0,f275fa94,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cb262024,cb262010,c1088cc5,6ae,f275fb1c,...) at _cv_wait_sig+0x263 seltdwait(ca7e8b2c,c1088cc5,5ab,ca8675e0,c138e720,...) at seltdwait+0xa2 sys_poll(ca8675e0,f275fccc,10845a33,0,f275fcc4,...) at sys_poll+0x321 syscall(f275fd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284b8ecb, esp = 0xbfbfcebc, ebp = 0xbfbfcef8 --- Tracing command getty pid 1393 tid 100088 td 0xca8442f0 sched_switch(ca8442f0,0,104,1b3,f2737a08,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1254280,...) at mi_switch+0x243 sleepq_switch(ca8442f0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c1086460,166,0,ca8442f0,ca8442f0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(c7f2da70,0,c108b343,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7f2da70,c1243f90,c108ad14,538,0,...) at _cv_wait_sig+0x263 tty_wait(c7f2da00,c7f2da70,f2737c1c,1,0,...) at tty_wait+0x71 ttydisc_read(c7f2da00,f2737c1c,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c81a0200,f2737c1c,0,1,0,...) at ttydev_read+0xaa devfs_read_f(ca80c7a8,f2737c1c,c7dc3e00,0,ca8442f0,...) at devfs_read_f+0x7d dofileread(f2737c1c,ffffffff,ffffffff,0,f2737bf8,...) at dofileread+0x9e kern_readv(ca8442f0,0,f2737c1c,f2737c3c,1,...) at kern_readv+0x68 sys_read(ca8442f0,f2737ccc,8b37dc09,0,f2737cc4,...) at sys_read+0x4f syscall(f2737d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28190b23, esp = 0xbfbfddac, ebp = 0xbfbfdde8 --- Tracing command getty pid 1392 tid 100143 td 0xcb4d38d0 sched_switch(cb4d38d0,0,104,1b3,f2870a08,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1253580,...) at mi_switch+0x243 sleepq_switch(cb4d38d0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c1086460,166,0,cb4d38d0,cb4d38d0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(c7f2dc70,0,c108b343,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7f2dc70,c1243f90,c108ad14,538,0,...) at _cv_wait_sig+0x263 tty_wait(c7f2dc00,c7f2dc70,f2870c1c,1,0,...) at tty_wait+0x71 ttydisc_read(c7f2dc00,f2870c1c,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c81a0300,f2870c1c,0,1,0,...) at ttydev_read+0xaa devfs_read_f(ca7ead90,f2870c1c,c7dc3e00,0,cb4d38d0,...) at devfs_read_f+0x7d dofileread(f2870c1c,ffffffff,ffffffff,0,f2870bf8,...) at dofileread+0x9e kern_readv(cb4d38d0,0,f2870c1c,f2870c3c,1,...) at kern_readv+0x68 sys_read(cb4d38d0,f2870ccc,920d424d,0,f2870cc4,...) at sys_read+0x4f syscall(f2870d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28190b23, esp = 0xbfbfddac, ebp = 0xbfbfdde8 --- Tracing command getty pid 1391 tid 100103 td 0xca8625e0 sched_switch(ca8625e0,0,104,1b3,f277ba08,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1253c00,...) at mi_switch+0x243 sleepq_switch(ca8625e0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c1086460,166,0,ca8625e0,ca8625e0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(c7f2de70,0,c108b343,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7f2de70,c1243f90,c108ad14,538,0,...) at _cv_wait_sig+0x263 tty_wait(c7f2de00,c7f2de70,f277bc1c,1,0,...) at tty_wait+0x71 ttydisc_read(c7f2de00,f277bc1c,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c81a0400,f277bc1c,0,1,0,...) at ttydev_read+0xaa devfs_read_f(ca7ceaf0,f277bc1c,c7dc3e00,0,ca8625e0,...) at devfs_read_f+0x7d dofileread(f277bc1c,ffffffff,ffffffff,0,f277bbf8,...) at dofileread+0x9e kern_readv(ca8625e0,0,f277bc1c,f277bc3c,1,...) at kern_readv+0x68 sys_read(ca8625e0,f277bccc,874cc2d9,0,f277bcc4,...) at sys_read+0x4f syscall(f277bd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28190b23, esp = 0xbfbfddac, ebp = 0xbfbfdde8 --- Tracing command getty pid 1390 tid 100094 td 0xca868000 sched_switch(ca868000,0,104,1b3,f2753a08,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1252f00,...) at mi_switch+0x243 sleepq_switch(ca868000,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c1086460,166,0,ca868000,ca868000,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(c81a2070,0,c108b343,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c81a2070,c1243f90,c108ad14,538,0,...) at _cv_wait_sig+0x263 tty_wait(c81a2000,c81a2070,f2753c1c,1,0,...) at tty_wait+0x71 ttydisc_read(c81a2000,f2753c1c,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c81a0500,f2753c1c,0,1,0,...) at ttydev_read+0xaa devfs_read_f(cb2705e8,f2753c1c,c7dc3e00,0,ca868000,...) at devfs_read_f+0x7d dofileread(f2753c1c,ffffffff,ffffffff,0,f2753bf8,...) at dofileread+0x9e kern_readv(ca868000,0,f2753c1c,f2753c3c,1,...) at kern_readv+0x68 sys_read(ca868000,f2753ccc,89dc2c34,0,f2753cc4,...) at sys_read+0x4f syscall(f2753d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28190b23, esp = 0xbfbfddac, ebp = 0xbfbfdde8 --- Tracing command getty pid 1389 tid 100130 td 0xca83d2f0 sched_switch(ca83d2f0,0,104,1b3,f2840a08,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1253c00,...) at mi_switch+0x243 sleepq_switch(ca83d2f0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c1086460,166,0,ca83d2f0,ca83d2f0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(c81a2270,0,c108b343,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c81a2270,c1243f90,c108ad14,538,0,...) at _cv_wait_sig+0x263 tty_wait(c81a2200,c81a2270,f2840c1c,1,0,...) at tty_wait+0x71 ttydisc_read(c81a2200,f2840c1c,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c81a0600,f2840c1c,0,1,0,...) at ttydev_read+0xaa devfs_read_f(ca80c268,f2840c1c,c7dc3e00,0,ca83d2f0,...) at devfs_read_f+0x7d dofileread(f2840c1c,ffffffff,ffffffff,0,f2840bf8,...) at dofileread+0x9e kern_readv(ca83d2f0,0,f2840c1c,f2840c3c,1,...) at kern_readv+0x68 sys_read(ca83d2f0,f2840ccc,920d550c,0,f2840cc4,...) at sys_read+0x4f syscall(f2840d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28190b23, esp = 0xbfbfddac, ebp = 0xbfbfdde8 --- Tracing command getty pid 1388 tid 100129 td 0xca83d5e0 sched_switch(ca83d5e0,0,104,1b3,f283da08,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1253580,...) at mi_switch+0x243 sleepq_switch(ca83d5e0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c1086460,166,0,ca83d5e0,ca83d5e0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(c81a2470,0,c108b343,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c81a2470,c1243f90,c108ad14,538,0,...) at _cv_wait_sig+0x263 tty_wait(c81a2400,c81a2470,f283dc1c,1,0,...) at tty_wait+0x71 ttydisc_read(c81a2400,f283dc1c,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c81a0700,f283dc1c,0,1,0,...) at ttydev_read+0xaa devfs_read_f(ca7cfc78,f283dc1c,c7dc3e00,0,ca83d5e0,...) at devfs_read_f+0x7d dofileread(f283dc1c,ffffffff,ffffffff,0,f283dbf8,...) at dofileread+0x9e kern_readv(ca83d5e0,0,f283dc1c,f283dc3c,1,...) at kern_readv+0x68 sys_read(ca83d5e0,f283dccc,96a90c21,0,f283dcc4,...) at sys_read+0x4f syscall(f283dd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28190b23, esp = 0xbfbfddac, ebp = 0xbfbfdde8 --- Tracing command getty pid 1387 tid 100137 td 0xcb42f2f0 sched_switch(cb42f2f0,0,104,1b3,f285ba08,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1253580,...) at mi_switch+0x243 sleepq_switch(cb42f2f0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c1086460,166,0,cb42f2f0,cb42f2f0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(c7f2c070,0,c108b343,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7f2c070,c1243f90,c108ad14,538,0,...) at _cv_wait_sig+0x263 tty_wait(c7f2c000,c7f2c070,f285bc1c,1,0,...) at tty_wait+0x71 ttydisc_read(c7f2c000,f285bc1c,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c81a0800,f285bc1c,0,1,0,...) at ttydev_read+0xaa devfs_read_f(ca7ea5b0,f285bc1c,c7dc3e00,0,cb42f2f0,...) at devfs_read_f+0x7d dofileread(f285bc1c,ffffffff,ffffffff,0,f285bbf8,...) at dofileread+0x9e kern_readv(cb42f2f0,0,f285bc1c,f285bc3c,1,...) at kern_readv+0x68 sys_read(cb42f2f0,f285bccc,8b382bb4,0,f285bcc4,...) at sys_read+0x4f syscall(f285bd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28190b23, esp = 0xbfbfddac, ebp = 0xbfbfdde8 --- Tracing command getty pid 1386 tid 100146 td 0xcb4d3000 sched_switch(cb4d3000,0,104,1b3,f287ca08,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1252f00,...) at mi_switch+0x243 sleepq_switch(cb4d3000,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c1086460,166,0,cb4d3000,cb4d3000,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(c7f2c270,0,c108b343,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7f2c270,c1243f90,c108ad14,538,0,...) at _cv_wait_sig+0x263 tty_wait(c7f2c200,c7f2c270,f287cc1c,1,0,...) at tty_wait+0x71 ttydisc_read(c7f2c200,f287cc1c,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c81a0900,f287cc1c,0,1,0,...) at ttydev_read+0xaa devfs_read_f(cb2707a8,f287cc1c,c7dc3e00,0,cb4d3000,...) at devfs_read_f+0x7d dofileread(f287cc1c,ffffffff,ffffffff,0,f287cbf8,...) at dofileread+0x9e kern_readv(cb4d3000,0,f287cc1c,f287cc3c,1,...) at kern_readv+0x68 sys_read(cb4d3000,f287cccc,92d1cfa2,0,f287ccc4,...) at sys_read+0x4f syscall(f287cd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28190b23, esp = 0xbfbfddac, ebp = 0xbfbfdde8 --- Tracing command getty pid 1385 tid 100128 td 0xca83d8d0 sched_switch(ca83d8d0,0,104,1b3,f283aa08,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1254280,...) at mi_switch+0x243 sleepq_switch(ca83d8d0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a8f49a,c7f2c404,0,c107e4ff,ca83d8d0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(c7f2c470,0,f283aacc,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7f2c470,c7f2c404,c108ad14,538,0,...) at _cv_wait_sig+0x263 tty_wait(c7f2c400,c7f2c470,f283ac1c,1,0,...) at tty_wait+0x71 ttydisc_read(c7f2c400,f283ac1c,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c7dcfb00,f283ac1c,0,1,0,...) at ttydev_read+0xaa devfs_read_f(cac23460,f283ac1c,c7dc3e00,0,ca83d8d0,...) at devfs_read_f+0x7d dofileread(f283ac1c,ffffffff,ffffffff,0,f283abf8,...) at dofileread+0x9e kern_readv(ca83d8d0,0,f283ac1c,f283ac3c,1,...) at kern_readv+0x68 sys_read(ca83d8d0,f283accc,92d1f9cf,0,f283acc4,...) at sys_read+0x4f syscall(f283ad08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28190b23, esp = 0xbfbfddac, ebp = 0xbfbfdde8 --- Tracing command inetd pid 1368 tid 100144 td 0xcb4d35e0 sched_switch(cb4d35e0,0,104,1b3,f287496c,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1254280,...) at mi_switch+0x243 sleepq_switch(cb4d35e0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a8f49a,ca861650,0,c107e4ff,cb4d35e0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(ca861664,0,f2874a30,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca861664,ca861650,c1088cc5,6ae,ca7ea150,...) at _cv_wait_sig+0x263 seltdwait(ca7ea150,58,c7dc3e00,cb4d35e0,0,...) at seltdwait+0xa2 kern_select(cb4d35e0,8,bfbfcfd0,0,0,0,20,cac24b30,4) at kern_select+0x667 sys_select(cb4d35e0,f2874ccc,46aed3cf,0,f2874cc4,...) at sys_select+0x66 syscall(f2874d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a3aa3, esp = 0xbfbfcf8c, ebp = 0xbfbfde18 --- Tracing command watchdogd pid 1343 tid 100095 td 0xca867bc0 sched_switch(ca867bc0,0,104,1b3,f2757aec,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,f2757b10,...) at mi_switch+0x243 sleepq_switch(ca867bc0,0,c1086460,1ad,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(ea61,c0ae5410,ca867bc0,0,100,...) at sleepq_catch_signals+0xfc sleepq_timedwait_sig(c1246284,6c,c1081ceb,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1246284,0,16c,c1081ceb,ea61,...) at _sleep+0x34e kern_nanosleep(ca867bc0,f2757c28,f2757c30,3c,0,...) at kern_nanosleep+0xc1 sys_nanosleep(ca867bc0,f2757ccc,8db3209b,0,f2757cc4,...) at sys_nanosleep+0x6f syscall(f2757d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28189f33, esp = 0xbfbfdcec, ebp = 0xbfbfdd18 --- Tracing command cron pid 1218 tid 100086 td 0xca7c28d0 Tracing command sendmail pid 1213 tid 100118 td 0xc81988d0 Tracing command sendmail pid 1210 tid 100121 td 0xcad418d0 sched_switch(cad418d0,0,104,1b3,f2805968,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,200046,...) at mi_switch+0x243 sleepq_switch(cad418d0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(f28059fc,c0a8f49a,c8007d10,0,cad418d0,...) at sleepq_catch_signals+0xfc sleepq_timedwait_sig(c8007d24,0,f2805a30,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c8007d24,c8007d10,1389,6ae,ca800268,...) at _cv_timedwait_sig+0x272 seltdwait(f2805be8,f2805bf0,cac56500,cad418d0,40,...) at seltdwait+0x8a kern_select(cad418d0,5,bfbfb540,0,0,f2805c34,20,5,0) at kern_select+0x667 sys_select(cad418d0,f2805ccc,af80819b,0,f2805cc4,...) at sys_select+0x66 syscall(f2805d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2842daa3, esp = 0xbfbfb4ac, ebp = 0xbfbfbfd8 --- Tracing command sshd pid 1207 tid 100109 td 0xca7c15e0 sched_switch(ca7c15e0,0,104,1b3,f27a096c,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1253c00,...) at mi_switch+0x243 sleepq_switch(ca7c15e0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a8f49a,ca8603d0,0,c107e4ff,ca7c15e0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(ca8603e4,0,f27a0a30,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca8603e4,ca8603d0,c1088cc5,6ae,ca800a48,...) at _cv_wait_sig+0x263 seltdwait(ca800a48,58,cac56800,ca7c15e0,c138eca0,...) at seltdwait+0xa2 kern_select(ca7c15e0,9,28c0c140,0,0,0,20,ca6cb598,a) at kern_select+0x667 sys_select(ca7c15e0,f27a0ccc,8123def1,0,f27a0cc4,...) at sys_select+0x66 syscall(f27a0d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28521aa3, esp = 0xbfbfcf1c, ebp = 0xbfbfde28 --- Tracing command moused pid 1175 tid 100091 td 0xca8682f0 sched_switch(ca8682f0,0,104,1b3,f274596c,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1253c00,...) at mi_switch+0x243 sleepq_switch(ca8682f0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a8f49a,ca83c250,0,c107e4ff,ca8682f0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(ca83c264,0,f2745a30,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca83c264,ca83c250,c1088cc5,6ae,ca80ccb0,...) at _cv_wait_sig+0x263 seltdwait(ca80ccb0,58,c7dc3e00,ca8682f0,58,...) at seltdwait+0xa2 kern_select(ca8682f0,400,bfbfda34,0,0,0,20,ca85db30,1) at kern_select+0x667 sys_select(ca8682f0,f2745ccc,c0af10dd,0,f2745cc4,...) at sys_select+0x66 syscall(f2745d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281b1aa3, esp = 0xbfbfd9cc, ebp = 0xbfbfdb58 --- Tracing command ntpd pid 1150 tid 100119 td 0xc81985e0 sched_switch(c81985e0,0,104,1b3,f27ff96c,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1254280,...) at mi_switch+0x243 sleepq_switch(c81985e0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a8f49a,cb262610,0,c107e4ff,c81985e0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cb262624,0,f27ffa30,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cb262624,cb262610,c1088cc5,6ae,cb270268,...) at _cv_wait_sig+0x263 seltdwait(cb270268,58,c7dc3e00,c81985e0,0,...) at seltdwait+0xa2 kern_select(c81985e0,1c,bfbfdd18,0,0,0,20,ca85eb30,0) at kern_select+0x667 sys_select(c81985e0,f27ffccc,0,0,e,...) at sys_select+0x66 syscall(f27ffd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28399aa3, esp = 0xbfbfdcec, ebp = 0xbfbfddb8 --- Tracing command nfsd pid 1095 tid 100125 td 0xca845bc0 sched_switch(ca845bc0,0,104,1b3,f2829b30,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,46,...) at mi_switch+0x243 sleepq_switch(ca845bc0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(f2829bc4,c0a8f49a,c7fd7e00,0,ca845bc0,...) at sleepq_catch_signals+0xfc sleepq_timedwait_sig(cb1e37d0,0,f2829bf8,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(cb1e37d0,c7fd7e00,1388,3b1,0,...) at _cv_timedwait_sig+0x272 svc_run_internal(f2829cf4,c0a71988,c7fd7e00,f2829d08,c107a4b0,...) at svc_run_internal+0x36a svc_thread_start(c7fd7e00,f2829d08,c107a4b0,3db,ca839598,...) at svc_thread_start+0x10 fork_exit(c0ca3bf0,c7fd7e00,f2829d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1095 tid 100124 td 0xca862000 sched_switch(ca862000,0,104,1b3,f2826b30,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,46,...) at mi_switch+0x243 sleepq_switch(ca862000,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(f2826bc4,c0a8f49a,c7fd7e00,0,ca862000,...) at sleepq_catch_signals+0xfc sleepq_timedwait_sig(cb1e3810,0,f2826bf8,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(cb1e3810,c7fd7e00,1388,3b1,0,...) at _cv_timedwait_sig+0x272 svc_run_internal(f2826cf4,c0a71988,c7fd7e00,f2826d08,c107a4b0,...) at svc_run_internal+0x36a svc_thread_start(c7fd7e00,f2826d08,c107a4b0,3db,ca839598,...) at svc_thread_start+0x10 fork_exit(c0ca3bf0,c7fd7e00,f2826d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1095 tid 100123 td 0xca8622f0 sched_switch(ca8622f0,0,104,1b3,f2823b30,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,46,...) at mi_switch+0x243 sleepq_switch(ca8622f0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(f2823bc4,c0a8f49a,c7fd7e00,0,ca8622f0,...) at sleepq_catch_signals+0xfc sleepq_timedwait_sig(cb1e4d10,0,f2823bf8,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(cb1e4d10,c7fd7e00,1388,3b1,0,...) at _cv_timedwait_sig+0x272 svc_run_internal(f2823cf4,c0a71988,c7fd7e00,f2823d08,c107a4b0,...) at svc_run_internal+0x36a svc_thread_start(c7fd7e00,f2823d08,c107a4b0,3db,ca839598,...) at svc_thread_start+0x10 fork_exit(c0ca3bf0,c7fd7e00,f2823d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1095 tid 100105 td 0xca8438d0 sched_switch(ca8438d0,0,104,1b3,f27853e0,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,46,...) at mi_switch+0x243 sleepq_switch(ca8438d0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(f2785474,c0a8f49a,c7fd7e00,0,ca8438d0,...) at sleepq_catch_signals+0xfc sleepq_timedwait_sig(cb1e3850,0,f27854a8,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(cb1e3850,c7fd7e00,1388,3b1,0,...) at _cv_timedwait_sig+0x272 svc_run_internal(ca843a78,14,c10b115a,c106b87b,f27857e8,...) at svc_run_internal+0x36a svc_run(c7fd7e00,0,c106b856,19f,c10bcbff,...) at svc_run+0x7b nfsrvd_nfsd(ca8438d0,f27857e8,c,f278570c,c0a8f3c8,...) at nfsrvd_nfsd+0x1c3 nfssvc_nfsd(ca8438d0,f2785ccc,0,ca8438d0,f2785cfc,...) at nfssvc_nfsd+0x177 sys_nfssvc(ca8438d0,f2785ccc,c0af10dd,0,f2785cc4,...) at sys_nfssvc+0xeb syscall(f2785d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280c63bb, esp = 0xbfbfd85c, ebp = 0xbfbfdac8 --- Tracing command nfsd pid 1091 tid 100113 td 0xca6cc8d0 sched_switch(ca6cc8d0,0,104,1b3,f27eb96c,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1252f00,...) at mi_switch+0x243 sleepq_switch(ca6cc8d0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a8f49a,c8007150,0,c107e4ff,ca6cc8d0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(c8007164,0,f27eba30,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c8007164,c8007150,c1088cc5,6ae,ca7ceab8,...) at _cv_wait_sig+0x263 seltdwait(ca7ceab8,58,c7dc3e00,ca6cc8d0,ca885c10,...) at seltdwait+0xa2 kern_select(ca6cc8d0,7,bfbfdce4,0,0,0,20,cad3c000,1) at kern_select+0x667 sys_select(ca6cc8d0,f27ebccc,43342e31,0,f27ebcc4,...) at sys_select+0x66 syscall(f27ebd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2817daa3, esp = 0xbfbfdacc, ebp = 0xbfbfde18 --- Tracing command nfsuserd pid 1089 tid 100122 td 0xcad415e0 sched_switch(cad415e0,0,104,1b3,f2808968,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,46,...) at mi_switch+0x243 sleepq_switch(cad415e0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(f28089fc,c0a8f49a,ca7babd0,0,cad415e0,...) at sleepq_catch_signals+0xfc sleepq_timedwait_sig(ca7babe4,0,f2808a30,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca7babe4,ca7babd0,7531,6ae,ca7cf508,...) at _cv_timedwait_sig+0x272 seltdwait(f2808be8,f2808bf0,c7dc3e00,cad415e0,c7de5de0,...) at seltdwait+0x8a kern_select(cad415e0,4,bfbfdbf4,0,0,f2808c34,20,1e,0) at kern_select+0x667 sys_select(cad415e0,f2808ccc,c0af10dd,0,f2808cc4,...) at sys_select+0x66 syscall(f2808d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2817caa3, esp = 0xbfbfdb4c, ebp = 0xbfbfdc88 --- Tracing command nfsuserd pid 1088 tid 100104 td 0xca843bc0 sched_switch(ca843bc0,0,104,1b3,f2780968,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,46,...) at mi_switch+0x243 sleepq_switch(ca843bc0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(f27809fc,c0a8f49a,ca8600d0,0,ca843bc0,...) at sleepq_catch_signals+0xfc sleepq_timedwait_sig(ca8600e4,0,f2780a30,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca8600e4,ca8600d0,7531,6ae,ca7cf508,...) at _cv_timedwait_sig+0x272 seltdwait(f2780be8,f2780bf0,c7dc3e00,ca843bc0,c7de5300,...) at seltdwait+0x8a kern_select(ca843bc0,4,bfbfdbf4,0,0,f2780c34,20,1e,0) at kern_select+0x667 sys_select(ca843bc0,f2780ccc,c0af10dd,eb,f2780cc4,...) at sys_select+0x66 syscall(f2780d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2817caa3, esp = 0xbfbfdb4c, ebp = 0xbfbfdc88 --- Tracing command nfsuserd pid 1087 tid 100096 td 0xca8678d0 sched_switch(ca8678d0,0,104,1b3,f275b968,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,46,...) at mi_switch+0x243 sleepq_switch(ca8678d0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(f275b9fc,c0a8f49a,ca7bac10,0,ca8678d0,...) at sleepq_catch_signals+0xfc sleepq_timedwait_sig(ca7bac24,0,f275ba30,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca7bac24,ca7bac10,7531,6ae,ca7cf508,...) at _cv_timedwait_sig+0x272 seltdwait(f275bbe8,f275bbf0,c7dc3e00,ca8678d0,ca7f6788,...) at seltdwait+0x8a kern_select(ca8678d0,4,bfbfdbf4,0,0,f275bc34,20,1e,0) at kern_select+0x667 sys_select(ca8678d0,f275bccc,c0af10dd,0,f275bcc4,...) at sys_select+0x66 syscall(f275bd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2817caa3, esp = 0xbfbfdb4c, ebp = 0xbfbfdc88 --- Tracing command nfsuserd pid 1086 tid 100120 td 0xc81982f0 sched_switch(c81982f0,0,104,1b3,f2802968,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,46,...) at mi_switch+0x243 sleepq_switch(c81982f0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(f28029fc,c0a8f49a,c80070d0,0,c81982f0,...) at sleepq_catch_signals+0xfc sleepq_timedwait_sig(c80070e4,0,f2802a30,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c80070e4,c80070d0,7531,6ae,ca7cf508,...) at _cv_timedwait_sig+0x272 seltdwait(f2802be8,f2802bf0,c7dc3e00,c81982f0,cad26048,...) at seltdwait+0x8a kern_select(c81982f0,4,bfbfdbf4,0,0,f2802c34,20,1e,0) at kern_select+0x667 sys_select(c81982f0,f2802ccc,c0af10dd,eb,f2802cc4,...) at sys_select+0x66 syscall(f2802d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2817caa3, esp = 0xbfbfdb4c, ebp = 0xbfbfdc88 --- Tracing command nfsuserd pid 1085 tid 100106 td 0xca7c18d0 Tracing command mountd pid 1069 tid 100098 td 0xca8672f0 sched_switch(ca8672f0,0,104,1b3,f276396c,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1253580,...) at mi_switch+0x243 sleepq_switch(ca8672f0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a8f49a,ca83c510,0,c107e4ff,ca8672f0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(ca83c524,0,f2763a30,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca83c524,ca83c510,c1088cc5,6ae,ca7ea818,...) at _cv_wait_sig+0x263 seltdwait(ca7ea818,58,c7dc3e00,ca8672f0,4,...) at seltdwait+0xa2 kern_select(ca8672f0,9,bfbfdd34,0,0,0,20,ca85bb30,bfbfdd34) at kern_select+0x667 sys_select(ca8672f0,f2763ccc,0,0,1,...) at sys_select+0x66 syscall(f2763d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28194aa3, esp = 0xbfbfdccc, ebp = 0xbfbfde18 --- Tracing command rpcbind pid 1036 tid 100102 td 0xca8628d0 sched_switch(ca8628d0,0,104,1b3,f27779cc,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,46,...) at mi_switch+0x243 sleepq_switch(ca8628d0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(f2777a60,c0a8f49a,ca83ce90,0,ca8628d0,...) at sleepq_catch_signals+0xfc sleepq_timedwait_sig(ca83cea4,0,f2777a94,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca83cea4,ca83ce90,7531,6ae,f2777b4c,...) at _cv_timedwait_sig+0x272 seltdwait(f2777c1c,f2777c24,5ab,ca8628d0,a24,...) at seltdwait+0x8a sys_poll(ca8628d0,f2777ccc,f3135e43,0,f2777cc4,...) at sys_poll+0x321 syscall(f2777d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x28133ecb, esp = 0xbfbfbbdc, ebp = 0xbfbfdda8 --- Tracing command syslogd pid 966 tid 100116 td 0xca6cc000 sched_switch(ca6cc000,0,104,1b3,f27f696c,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1254280,...) at mi_switch+0x243 sleepq_switch(ca6cc000,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a8f49a,c7ff9250,0,c107e4ff,ca6cc000,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(c7ff9264,0,f27f6a30,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7ff9264,c7ff9250,c1088cc5,6ae,ca7eab98,...) at _cv_wait_sig+0x263 seltdwait(ca7eab98,58,c7dc3e00,ca6cc000,c1092084,...) at seltdwait+0xa2 kern_select(ca6cc000,9,28849100,0,0,0,20,cad3b598,0) at kern_select+0x667 sys_select(ca6cc000,f27f6ccc,0,0,e,...) at sys_select+0x66 syscall(f27f6d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28194aa3, esp = 0xbfbfd2cc, ebp = 0xbfbfde18 --- Tracing command devd pid 843 tid 100080 td 0xca6cd5e0 sched_switch(ca6cd5e0,0,104,1b3,f271296c,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1253580,...) at mi_switch+0x243 sleepq_switch(ca6cd5e0,0,c1086460,1ad,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a8f49a,c7ffb090,0,c107e4ff,ca6cd5e0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(c7ffb0a4,0,f2712a30,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7ffb0a4,c7ffb090,c1088cc5,6ae,ca7ea460,...) at _cv_wait_sig+0x263 seltdwait(ca7ea460,58,c7dc3e00,ca6cd5e0,ca6cd694,...) at seltdwait+0xa2 kern_select(ca6cd5e0,5,bfbfd990,0,0,0,20,c8050b30,0) at kern_select+0x667 sys_select(ca6cd5e0,f2712ccc,66ef5dbb,0,f2712cc4,...) at sys_select+0x66 syscall(f2712d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x808936b, esp = 0xbfbfd95c, ebp = 0xbfbfde38 --- Tracing command softdepflush pid 19 tid 100078 td 0xca6cd8d0 sched_switch(ca6cd8d0,0,104,1b3,ee332bf8,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,352,...) at mi_switch+0x243 sleepq_switch(ca6cd8d0,0,c1086460,292,0,...) at sleepq_switch+0x1a7 sleepq_timedwait(c13c4220,54,c10b8a65,0,0,...) at sleepq_timedwait+0x6b _sleep(c13c4220,c13c41e0,54,c10b8a65,3e8,...) at _sleep+0x369 softdep_flush(0,ee332d08,c107a4b0,3db,ca6c9000,...) at softdep_flush+0x259 fork_exit(c0cf6db0,0,ee332d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee332d40, ebp = 0 --- Tracing command vnlru pid 18 tid 100077 td 0xca6cdbc0 sched_switch(ca6cdbc0,0,104,1b3,ee32fbcc,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,352,...) at mi_switch+0x243 sleepq_switch(ca6cdbc0,0,c1086460,292,0,...) at sleepq_switch+0x1a7 sleepq_timedwait(ca6c92cc,60,c1091781,0,0,...) at sleepq_timedwait+0x6b _sleep(ca6c92cc,c13bc474,260,c1091781,3e8,...) at _sleep+0x369 vnlru_proc(0,ee32fd08,c107a4b0,3db,ca6c92cc,...) at vnlru_proc+0xe7 fork_exit(c0b487d0,0,ee32fd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee32fd40, ebp = 0 --- Tracing command syncer pid 17 tid 100076 td 0xc80708d0 sched_switch(c80708d0,0,104,1b3,ee32cbd4,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c107e4ff,...) at mi_switch+0x243 sleepq_switch(c80708d0,0,c1086460,292,c80708d0,...) at sleepq_switch+0x1a7 sleepq_timedwait(c13bc4b4,0,ee32cc58,1,0,...) at sleepq_timedwait+0x6b _cv_timedwait(c13bc4b4,c13bc4a0,3e8,783,4e20,...) at _cv_timedwait+0x272 sched_sync(0,ee32cd08,c107a4b0,3db,ca6c9598,...) at sched_sync+0x595 fork_exit(c0b47b20,0,ee32cd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee32cd40, ebp = 0 --- Tracing command bufdaemon pid 16 tid 100075 td 0xc8070bc0 sched_switch(c8070bc0,0,104,1b3,ee329c04,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,352,...) at mi_switch+0x243 sleepq_switch(c8070bc0,0,c1086460,292,0,...) at sleepq_switch+0x1a7 sleepq_timedwait(c13bc148,54,c108e4f2,0,0,...) at sleepq_timedwait+0x6b _sleep(c13bc148,c13bc150,54,c108e4f2,3e8,...) at _sleep+0x369 buf_daemon(0,ee329d08,c107a4b0,3db,ca6c9864,...) at buf_daemon+0x175 fork_exit(c0b2a460,0,ee329d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee329d40, ebp = 0 --- Tracing command pagezero pid 9 tid 100074 td 0xc8195000 sched_switch(c8195000,0,104,1b3,ee326c08,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,352,...) at mi_switch+0x243 sleepq_switch(c8195000,0,c1086460,292,0,...) at sleepq_switch+0x1a7 sleepq_timedwait(c13c61dc,0,c10bfce9,0,0,...) at sleepq_timedwait+0x6b _sleep(c13c61dc,c13c4b80,0,c10bfce9,493e0,...) at _sleep+0x369 vm_pagezero(0,ee326d08,c107a4b0,3db,ca6c9b30,...) at vm_pagezero+0xdc fork_exit(c0d3e260,0,ee326d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee326d40, ebp = 0 --- Tracing command vmdaemon pid 8 tid 100073 td 0xc81952f0 sched_switch(c81952f0,0,104,1b3,ee323bcc,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c7dc0d80,...) at mi_switch+0x243 sleepq_switch(c81952f0,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(c13c5d48,74,c108e4f2,0,0,...) at sleepq_wait+0x6b _sleep(c13c5d48,c13c5d4c,74,c108e4f2,0,...) at _sleep+0x39b vm_daemon(0,ee323d08,c107a4b0,3db,ca6cb000,...) at vm_daemon+0x59 fork_exit(c0d38350,0,ee323d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee323d40, ebp = 0 --- Tracing command pagedaemon pid 7 tid 100072 td 0xc81955e0 cpustop_handler(3,ee320b6c,c0ea9953,ee320b24,ee320b04,...) at cpustop_handler+0x26 ipi_nmi_handler(ee320b24,ee320b04,c0eb13a9,cd895700,c7de12cc,...) at ipi_nmi_handler+0x35 trap(ee320b78) at trap+0x33 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0e9f258, esp = 0xee320bb8, ebp = 0xee320bd4 --- pmap_pte_quick(cad26b90,0,c10d601a,12a9,ec,...) at pmap_pte_quick+0xc8 pmap_ts_referenced(c27fa7b8,0,c10bebda,3d7,1f4,...) at pmap_ts_referenced+0x269 vm_pageout(0,ee320d08,c107a4b0,3db,c7de12cc,...) at vm_pageout+0xb82 fork_exit(c0d38850,0,ee320d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee320d40, ebp = 0 --- Tracing command xpt_thrd pid 6 tid 100071 td 0xc81958d0 sched_switch(c81958d0,0,104,1b3,ee19dc04,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c7dc0d00,...) at mi_switch+0x243 sleepq_switch(c81958d0,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(c1208bd4,5c,c0ed63e8,0,0,...) at sleepq_wait+0x6b _sleep(c1208bd4,c1208c18,5c,c0ed63e8,0,...) at _sleep+0x39b xpt_scanner_thread(0,ee19dd08,c107a4b0,3db,c7de1598,...) at xpt_scanner_thread+0x47 fork_exit(c04aa880,0,ee19dd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee19dd40, ebp = 0 --- Tracing command sctp_iterator pid 5 tid 100070 td 0xc8195bc0 sched_switch(c8195bc0,0,104,1b3,ee19ac0c,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c7dc0cc0,...) at mi_switch+0x243 sleepq_switch(c8195bc0,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(c13bfa38,0,c10a5ec7,0,0,...) at sleepq_wait+0x6b _sleep(c13bfa38,c13bfa00,0,c10a5ec7,0,...) at _sleep+0x39b sctp_iterator_thread(0,ee19ad08,c107a4b0,3db,c7de1864,...) at sctp_iterator_thread+0x5c fork_exit(c0be4a40,0,ee19ad08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee19ad40, ebp = 0 --- Tracing command ctl_thrd pid 4 tid 100067 td 0xc81975e0 sched_switch(c81975e0,0,104,1b3,ee19065c,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c7dc0c00,...) at mi_switch+0x243 sleepq_switch(c81975e0,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(c81a4000,5c,c0ee1e31,0,0,...) at sleepq_wait+0x6b _sleep(c81a4000,c81a4000,5c,c0ee1e31,0,...) at _sleep+0x39b ctl_work_thread(c81a4000,ee190d08,c107a4b0,3db,c7de1b30,...) at ctl_work_thread+0x22c6 fork_exit(c04d81d0,c81a4000,ee190d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee190d40, ebp = 0 --- Tracing command fdc0 pid 3 tid 100064 td 0xc8198000 sched_switch(c8198000,0,104,1b3,ee187b54,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,352,...) at mi_switch+0x243 sleepq_switch(c8198000,0,c1086460,292,0,...) at sleepq_switch+0x1a7 sleepq_timedwait(c7ff623c,5c,c106c2f2,0,0,...) at sleepq_timedwait+0x6b _sleep(c7ff623c,c7ff62f0,5c,c106c2f2,3e8,...) at _sleep+0x369 fdc_thread(c7ff6200,ee187d08,c107a4b0,3db,c8050000,...) at fdc_thread+0x27d fork_exit(c0e474b0,c7ff6200,ee187d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee187d40, ebp = 0 --- Tracing command fw0_probe pid 2 tid 100062 td 0xc80615e0 sched_switch(c80615e0,0,104,1b3,ee1776f8,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1252f00,...) at mi_switch+0x243 sleepq_switch(c80615e0,0,c1086460,1ad,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c1086460,166,0,100,100,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(c809a000,6c,c106c2f2,100,0,...) at sleepq_wait_sig+0x17 _sleep(c809a000,c809e488,16c,c106c2f2,0,...) at _sleep+0x384 fw_bus_probe_thread(c809a000,ee177d08,c107a4b0,3db,c80502cc,...) at fw_bus_probe_thread+0xa08 fork_exit(c0715180,c809a000,ee177d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee177d40, ebp = 0 --- Tracing command usb pid 15 tid 100058 td 0xc806e2f0 sched_switch(c806e2f0,0,104,1b3,ee156c10,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,ec,...) at mi_switch+0x243 sleepq_switch(c806e2f0,0,c1086460,26f,c806e2f0,...) at sleepq_switch+0x1a7 sleepq_wait(c8076d34,0,ee156c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(c8076d34,c8076e4c,c105d951,74,c8076d3c,...) at _cv_wait+0x263 usb_process(c8076d2c,ee156d08,c107a4b0,3db,c8050598,...) at usb_process+0x1a3 fork_exit(c0949710,c8076d2c,ee156d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee156d40, ebp = 0 --- Tracing command usb pid 15 tid 100057 td 0xc806e5e0 sched_switch(c806e5e0,0,104,1b3,ee153c10,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,ec,...) at mi_switch+0x243 sleepq_switch(c806e5e0,0,c1086460,26f,c806e5e0,...) at sleepq_switch+0x1a7 sleepq_wait(c8076d04,0,ee153c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(c8076d04,c8076e4c,c105d951,74,c8076d0c,...) at _cv_wait+0x263 usb_process(c8076cfc,ee153d08,c107a4b0,3db,c8050598,...) at usb_process+0x1a3 fork_exit(c0949710,c8076cfc,ee153d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee153d40, ebp = 0 --- Tracing command usb pid 15 tid 100056 td 0xc806e8d0 sched_switch(c806e8d0,0,104,1b3,ee150c10,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,ec,...) at mi_switch+0x243 sleepq_switch(c806e8d0,0,c1086460,26f,c806e8d0,...) at sleepq_switch+0x1a7 sleepq_wait(c8076cd4,0,ee150c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(c8076cd4,c8076e4c,c105d951,74,c8076cdc,...) at _cv_wait+0x263 usb_process(c8076ccc,ee150d08,c107a4b0,3db,c8050598,...) at usb_process+0x1a3 fork_exit(c0949710,c8076ccc,ee150d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee150d40, ebp = 0 --- Tracing command usb pid 15 tid 100055 td 0xc806ebc0 sched_switch(c806ebc0,0,104,1b3,ee14dc10,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,ec,...) at mi_switch+0x243 sleepq_switch(c806ebc0,0,c1086460,26f,c806ebc0,...) at sleepq_switch+0x1a7 sleepq_wait(c8076ca4,0,ee14dc8c,1,0,...) at sleepq_wait+0x6b _cv_wait(c8076ca4,c8076e4c,c105d951,74,c8076cac,...) at _cv_wait+0x263 usb_process(c8076c9c,ee14dd08,c107a4b0,3db,c8050598,...) at usb_process+0x1a3 fork_exit(c0949710,c8076c9c,ee14dd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee14dd40, ebp = 0 --- Tracing command usb pid 15 tid 100053 td 0xc80702f0 sched_switch(c80702f0,0,104,1b3,ee144c10,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,ec,...) at mi_switch+0x243 sleepq_switch(c80702f0,0,c1086460,26f,c80702f0,...) at sleepq_switch+0x1a7 sleepq_wait(c806ab5c,0,ee144c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(c806ab5c,c806ac74,c105d951,74,c806ab64,...) at _cv_wait+0x263 usb_process(c806ab54,ee144d08,c107a4b0,3db,c8050598,...) at usb_process+0x1a3 fork_exit(c0949710,c806ab54,ee144d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee144d40, ebp = 0 --- Tracing command usb pid 15 tid 100052 td 0xc80705e0 sched_switch(c80705e0,0,104,1b3,ee141c10,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,ec,...) at mi_switch+0x243 sleepq_switch(c80705e0,0,c1086460,26f,c80705e0,...) at sleepq_switch+0x1a7 sleepq_wait(c806ab2c,0,ee141c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(c806ab2c,c806ac74,c105d951,74,c806ab34,...) at _cv_wait+0x263 usb_process(c806ab24,ee141d08,c107a4b0,3db,c8050598,...) at usb_process+0x1a3 fork_exit(c0949710,c806ab24,ee141d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee141d40, ebp = 0 --- Tracing command usb pid 15 tid 100051 td 0xc805f000 sched_switch(c805f000,0,104,1b3,ee13ec10,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,ec,...) at mi_switch+0x243 sleepq_switch(c805f000,0,c1086460,26f,c805f000,...) at sleepq_switch+0x1a7 sleepq_wait(c806aafc,0,ee13ec8c,1,0,...) at sleepq_wait+0x6b _cv_wait(c806aafc,c806ac74,c105d951,74,c806ab04,...) at _cv_wait+0x263 usb_process(c806aaf4,ee13ed08,c107a4b0,3db,c8050598,...) at usb_process+0x1a3 fork_exit(c0949710,c806aaf4,ee13ed08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee13ed40, ebp = 0 --- Tracing command usb pid 15 tid 100050 td 0xc805f2f0 sched_switch(c805f2f0,0,104,1b3,ee13bc10,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,ec,...) at mi_switch+0x243 sleepq_switch(c805f2f0,0,c1086460,26f,c805f2f0,...) at sleepq_switch+0x1a7 sleepq_wait(c806aacc,0,ee13bc8c,1,0,...) at sleepq_wait+0x6b _cv_wait(c806aacc,c806ac74,c105d951,74,c806aad4,...) at _cv_wait+0x263 usb_process(c806aac4,ee13bd08,c107a4b0,3db,c8050598,...) at usb_process+0x1a3 fork_exit(c0949710,c806aac4,ee13bd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee13bd40, ebp = 0 --- Tracing command usb pid 15 tid 100049 td 0xc805f5e0 sched_switch(c805f5e0,0,104,1b3,ee137c10,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,ec,...) at mi_switch+0x243 sleepq_switch(c805f5e0,0,c1086460,26f,c805f5e0,...) at sleepq_switch+0x1a7 sleepq_wait(c8062b5c,0,ee137c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(c8062b5c,c8062c74,c105d951,74,c8062b64,...) at _cv_wait+0x263 usb_process(c8062b54,ee137d08,c107a4b0,3db,c8050598,...) at usb_process+0x1a3 fork_exit(c0949710,c8062b54,ee137d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee137d40, ebp = 0 --- Tracing command usb pid 15 tid 100048 td 0xc805f8d0 sched_switch(c805f8d0,0,104,1b3,ee134c10,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,ec,...) at mi_switch+0x243 sleepq_switch(c805f8d0,0,c1086460,26f,c805f8d0,...) at sleepq_switch+0x1a7 sleepq_wait(c8062b2c,0,ee134c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(c8062b2c,c8062c74,c105d951,74,c8062b34,...) at _cv_wait+0x263 usb_process(c8062b24,ee134d08,c107a4b0,3db,c8050598,...) at usb_process+0x1a3 fork_exit(c0949710,c8062b24,ee134d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee134d40, ebp = 0 --- Tracing command usb pid 15 tid 100047 td 0xc805fbc0 sched_switch(c805fbc0,0,104,1b3,ee131c10,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,ec,...) at mi_switch+0x243 sleepq_switch(c805fbc0,0,c1086460,26f,c805fbc0,...) at sleepq_switch+0x1a7 sleepq_wait(c8062afc,0,ee131c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(c8062afc,c8062c74,c105d951,74,c8062b04,...) at _cv_wait+0x263 usb_process(c8062af4,ee131d08,c107a4b0,3db,c8050598,...) at usb_process+0x1a3 fork_exit(c0949710,c8062af4,ee131d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee131d40, ebp = 0 --- Tracing command usb pid 15 tid 100046 td 0xc8060000 sched_switch(c8060000,0,104,1b3,ee12ec10,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,ec,...) at mi_switch+0x243 sleepq_switch(c8060000,0,c1086460,26f,c8060000,...) at sleepq_switch+0x1a7 sleepq_wait(c8062acc,0,ee12ec8c,1,0,...) at sleepq_wait+0x6b _cv_wait(c8062acc,c8062c74,c105d951,74,c8062ad4,...) at _cv_wait+0x263 usb_process(c8062ac4,ee12ed08,c107a4b0,3db,c8050598,...) at usb_process+0x1a3 fork_exit(c0949710,c8062ac4,ee12ed08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee12ed40, ebp = 0 --- Tracing command usb pid 15 tid 100045 td 0xc80602f0 sched_switch(c80602f0,0,104,1b3,ee12ac10,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,ec,...) at mi_switch+0x243 sleepq_switch(c80602f0,0,c1086460,26f,c80602f0,...) at sleepq_switch+0x1a7 sleepq_wait(c805bb5c,0,ee12ac8c,1,0,...) at sleepq_wait+0x6b _cv_wait(c805bb5c,c805bc74,c105d951,74,c805bb64,...) at _cv_wait+0x263 usb_process(c805bb54,ee12ad08,c107a4b0,3db,c8050598,...) at usb_process+0x1a3 fork_exit(c0949710,c805bb54,ee12ad08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee12ad40, ebp = 0 --- Tracing command usb pid 15 tid 100044 td 0xc80605e0 sched_switch(c80605e0,0,104,1b3,ee127c10,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,ec,...) at mi_switch+0x243 sleepq_switch(c80605e0,0,c1086460,26f,c80605e0,...) at sleepq_switch+0x1a7 sleepq_wait(c805bb2c,0,ee127c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(c805bb2c,c805bc74,c105d951,74,c805bb34,...) at _cv_wait+0x263 usb_process(c805bb24,ee127d08,c107a4b0,3db,c8050598,...) at usb_process+0x1a3 fork_exit(c0949710,c805bb24,ee127d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee127d40, ebp = 0 --- Tracing command usb pid 15 tid 100043 td 0xc80608d0 sched_switch(c80608d0,0,104,1b3,ee124c10,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,ec,...) at mi_switch+0x243 sleepq_switch(c80608d0,0,c1086460,26f,c80608d0,...) at sleepq_switch+0x1a7 sleepq_wait(c805bafc,0,ee124c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(c805bafc,c805bc74,c105d951,74,c805bb04,...) at _cv_wait+0x263 usb_process(c805baf4,ee124d08,c107a4b0,3db,c8050598,...) at usb_process+0x1a3 fork_exit(c0949710,c805baf4,ee124d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee124d40, ebp = 0 --- Tracing command usb pid 15 tid 100042 td 0xc8060bc0 sched_switch(c8060bc0,0,104,1b3,ee121c10,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,ec,...) at mi_switch+0x243 sleepq_switch(c8060bc0,0,c1086460,26f,c8060bc0,...) at sleepq_switch+0x1a7 sleepq_wait(c805bacc,0,ee121c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(c805bacc,c805bc74,c105d951,74,c805bad4,...) at _cv_wait+0x263 usb_process(c805bac4,ee121d08,c107a4b0,3db,c8050598,...) at usb_process+0x1a3 fork_exit(c0949710,c805bac4,ee121d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee121d40, ebp = 0 --- Tracing command usb pid 15 tid 100040 td 0xc804d000 sched_switch(c804d000,0,104,1b3,ee11ac10,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,ec,...) at mi_switch+0x243 sleepq_switch(c804d000,0,c1086460,26f,c804d000,...) at sleepq_switch+0x1a7 sleepq_wait(c8056b5c,0,ee11ac8c,1,0,...) at sleepq_wait+0x6b _cv_wait(c8056b5c,c8056c74,c105d951,74,c8056b64,...) at _cv_wait+0x263 usb_process(c8056b54,ee11ad08,c107a4b0,3db,c8050598,...) at usb_process+0x1a3 fork_exit(c0949710,c8056b54,ee11ad08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee11ad40, ebp = 0 --- Tracing command usb pid 15 tid 100039 td 0xc804d2f0 sched_switch(c804d2f0,0,104,1b3,ee117c10,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,ec,...) at mi_switch+0x243 sleepq_switch(c804d2f0,0,c1086460,26f,c804d2f0,...) at sleepq_switch+0x1a7 sleepq_wait(c8056b2c,0,ee117c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(c8056b2c,c8056c74,c105d951,74,c8056b34,...) at _cv_wait+0x263 usb_process(c8056b24,ee117d08,c107a4b0,3db,c8050598,...) at usb_process+0x1a3 fork_exit(c0949710,c8056b24,ee117d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee117d40, ebp = 0 --- Tracing command usb pid 15 tid 100038 td 0xc804d5e0 sched_switch(c804d5e0,0,104,1b3,ee114c10,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,ec,...) at mi_switch+0x243 sleepq_switch(c804d5e0,0,c1086460,26f,c804d5e0,...) at sleepq_switch+0x1a7 sleepq_wait(c8056afc,0,ee114c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(c8056afc,c8056c74,c105d951,74,c8056b04,...) at _cv_wait+0x263 usb_process(c8056af4,ee114d08,c107a4b0,3db,c8050598,...) at usb_process+0x1a3 fork_exit(c0949710,c8056af4,ee114d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee114d40, ebp = 0 --- Tracing command usb pid 15 tid 100037 td 0xc804d8d0 sched_switch(c804d8d0,0,104,1b3,ee111c10,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,ec,...) at mi_switch+0x243 sleepq_switch(c804d8d0,0,c1086460,26f,c804d8d0,...) at sleepq_switch+0x1a7 sleepq_wait(c8056acc,0,ee111c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(c8056acc,c8056c74,c105d951,74,c8056ad4,...) at _cv_wait+0x263 usb_process(c8056ac4,ee111d08,c107a4b0,3db,c8050598,...) at usb_process+0x1a3 fork_exit(c0949710,c8056ac4,ee111d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee111d40, ebp = 0 --- Tracing command usb pid 15 tid 100035 td 0xc804f000 sched_switch(c804f000,0,104,1b3,ee10ac10,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,ec,...) at mi_switch+0x243 sleepq_switch(c804f000,0,c1086460,26f,c804f000,...) at sleepq_switch+0x1a7 sleepq_wait(c8048b5c,0,ee10ac8c,1,0,...) at sleepq_wait+0x6b _cv_wait(c8048b5c,c8048c74,c105d951,74,c8048b64,...) at _cv_wait+0x263 usb_process(c8048b54,ee10ad08,c107a4b0,3db,c8050598,...) at usb_process+0x1a3 fork_exit(c0949710,c8048b54,ee10ad08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee10ad40, ebp = 0 --- Tracing command usb pid 15 tid 100034 td 0xc804f2f0 sched_switch(c804f2f0,0,104,1b3,ee107c10,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,ec,...) at mi_switch+0x243 sleepq_switch(c804f2f0,0,c1086460,26f,c804f2f0,...) at sleepq_switch+0x1a7 sleepq_wait(c8048b2c,0,ee107c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(c8048b2c,c8048c74,c105d951,74,c8048b34,...) at _cv_wait+0x263 usb_process(c8048b24,ee107d08,c107a4b0,3db,c8050598,...) at usb_process+0x1a3 fork_exit(c0949710,c8048b24,ee107d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee107d40, ebp = 0 --- Tracing command usb pid 15 tid 100033 td 0xc804f5e0 sched_switch(c804f5e0,0,104,1b3,ee104c10,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,ec,...) at mi_switch+0x243 sleepq_switch(c804f5e0,0,c1086460,26f,c804f5e0,...) at sleepq_switch+0x1a7 sleepq_wait(c8048afc,0,ee104c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(c8048afc,c8048c74,c105d951,74,c8048b04,...) at _cv_wait+0x263 usb_process(c8048af4,ee104d08,c107a4b0,3db,c8050598,...) at usb_process+0x1a3 fork_exit(c0949710,c8048af4,ee104d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee104d40, ebp = 0 --- Tracing command usb pid 15 tid 100032 td 0xc804f8d0 sched_switch(c804f8d0,0,104,1b3,ee101c10,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,ec,...) at mi_switch+0x243 sleepq_switch(c804f8d0,0,c1086460,26f,c804f8d0,...) at sleepq_switch+0x1a7 sleepq_wait(c8048acc,0,ee101c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(c8048acc,c8048c74,c105d951,74,c8048ad4,...) at _cv_wait+0x263 usb_process(c8048ac4,ee101d08,c107a4b0,3db,c8050598,...) at usb_process+0x1a3 fork_exit(c0949710,c8048ac4,ee101d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee101d40, ebp = 0 --- Tracing command yarrow pid 14 tid 100017 td 0xc7eea5e0 sched_switch(c7eea5e0,0,104,1b3,c7b50bd8,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,352,...) at mi_switch+0x243 sleepq_switch(c7eea5e0,0,c1086460,292,2,...) at sleepq_switch+0x1a7 sleepq_timedwait(c1245084,0,c106c2f2,2,0,...) at sleepq_timedwait+0x6b _sleep(c1245084,0,0,c106c2f2,64) at _sleep+0x369 pause(c106c2f2,64,c1039839,111,0,...) at pause+0xa0 random_kthread(0,c7b50d08,c107a4b0,3db,c7de0000,...) at random_kthread+0x1ef fork_exit(c08456e0,0,c7b50d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b50d40, ebp = 0 --- Tracing command geom pid 13 tid 100015 td 0xc7eeabc0 sched_switch(c7eeabc0,0,104,1b3,c7b4abc4,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c7dbf9c0,...) at mi_switch+0x243 sleepq_switch(c7eeabc0,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(c1242108,5c,c106c2f2,0,0,...) at sleepq_wait+0x6b _sleep(c1242108,c1242068,25c,c106c2f2,0,...) at _sleep+0x39b g_io_schedule_down(c7eeabc0,0,c106dea5,6c,c7b4acf4,...) at g_io_schedule_down+0x56 g_down_procbody(0,c7b4ad08,c107a4b0,3db,c7de02cc,...) at g_down_procbody+0x9d fork_exit(c0a00e30,0,c7b4ad08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b4ad40, ebp = 0 --- Tracing command geom pid 13 tid 100014 td 0xc7eeb000 sched_switch(c7eeb000,0,104,1b3,c7b47bf0,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c7dbf980,...) at mi_switch+0x243 sleepq_switch(c7eeb000,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(c1242104,5c,c106c2f2,0,0,...) at sleepq_wait+0x6b _sleep(c1242104,c1242088,25c,c106c2f2,0,...) at _sleep+0x39b g_io_schedule_up(c7eeb000,0,c106dea5,5f,c7b47cf4,...) at g_io_schedule_up+0x144 g_up_procbody(0,c7b47d08,c107a4b0,3db,c7de02cc,...) at g_up_procbody+0x9d fork_exit(c0a00ed0,0,c7b47d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b47d40, ebp = 0 --- Tracing command geom pid 13 tid 100013 td 0xc7de32f0 sched_switch(c7de32f0,0,104,1b3,c7b44be8,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c7dbfd00,...) at mi_switch+0x243 sleepq_switch(c7de32f0,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(c12420fc,5c,c106c2f2,0,0,...) at sleepq_wait+0x6b _sleep(c12420fc,c124202c,25c,c106c2f2,0,...) at _sleep+0x39b g_run_events(c1252f00,0,c106dea5,79,c7b44cf4,...) at g_run_events+0x54b g_event_procbody(0,c7b44d08,c107a4b0,3db,c7de02cc,...) at g_event_procbody+0x90 fork_exit(c0a00f70,0,c7b44d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b44d40, ebp = 0 --- Tracing command intr pid 12 tid 100066 td 0xc81978d0 sched_switch(c81978d0,0,109,1b3,0,...) at sched_switch+0x458 mi_switch(109,0,c107a7d3,563,c7e279f0,...) at mi_switch+0x243 ithread_loop(c8191700,ee18dd08,c107a4b0,3db,c7de0598,...) at ithread_loop+0x1fb fork_exit(c0a75cd0,c8191700,ee18dd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee18dd40, ebp = 0 --- Tracing command intr pid 12 tid 100065 td 0xc8197bc0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100063 td 0xc80612f0 sched_switch(c80612f0,0,109,1b3,0,...) at sched_switch+0x458 mi_switch(109,0,c107a7d3,563,c7e28770,...) at mi_switch+0x243 ithread_loop(c8188aa0,ee17ad08,c107a4b0,3db,c7de0598,...) at ithread_loop+0x1fb fork_exit(c0a75cd0,c8188aa0,ee17ad08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee17ad40, ebp = 0 --- Tracing command intr pid 12 tid 100060 td 0xc8061bc0 sched_switch(c8061bc0,0,109,1b3,0,...) at sched_switch+0x458 mi_switch(109,0,c107a7d3,563,c7e275f0,...) at mi_switch+0x243 ithread_loop(c808f8b0,ee16ed08,c107a4b0,3db,c7de0598,...) at ithread_loop+0x1fb fork_exit(c0a75cd0,c808f8b0,ee16ed08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee16ed40, ebp = 0 --- Tracing command intr pid 12 tid 100059 td 0xc806e000 sched_switch(c806e000,0,109,1b3,0,...) at sched_switch+0x458 mi_switch(109,0,c107a7d3,563,c7e278f0,...) at mi_switch+0x243 ithread_loop(c808f060,ee15cd08,c107a4b0,3db,c7de0598,...) at ithread_loop+0x1fb fork_exit(c0a75cd0,c808f060,ee15cd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee15cd40, ebp = 0 --- Tracing command intr pid 12 tid 100054 td 0xc8070000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xc8061000 sched_switch(c8061000,0,109,1b3,0,...) at sched_switch+0x458 mi_switch(109,0,c107a7d3,563,c7e276f0,...) at mi_switch+0x243 ithread_loop(c8034710,ee11ed08,c107a4b0,3db,c7de0598,...) at ithread_loop+0x1fb fork_exit(c0a75cd0,c8034710,ee11ed08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee11ed40, ebp = 0 --- Tracing command intr pid 12 tid 100036 td 0xc804dbc0 sched_switch(c804dbc0,0,109,1b3,0,...) at sched_switch+0x458 mi_switch(109,0,c107a7d3,563,c7e27770,...) at mi_switch+0x243 ithread_loop(c8026560,ee10ed08,c107a4b0,3db,c7de0598,...) at ithread_loop+0x1fb fork_exit(c0a75cd0,c8026560,ee10ed08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee10ed40, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xc804fbc0 sched_switch(c804fbc0,0,109,1b3,0,...) at sched_switch+0x458 mi_switch(109,0,c107a7d3,563,c7e277f0,...) at mi_switch+0x243 ithread_loop(c80267e0,ee0fed08,c107a4b0,3db,c7de0598,...) at ithread_loop+0x1fb fork_exit(c0a75cd0,c80267e0,ee0fed08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee0fed40, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc7eeb2f0 sched_switch(c7eeb2f0,0,109,1b3,0,...) at sched_switch+0x458 mi_switch(109,0,c107a7d3,563,c7e274f0,...) at mi_switch+0x243 ithread_loop(c8017af0,edfa8d08,c107a4b0,3db,c7de0598,...) at ithread_loop+0x1fb fork_exit(c0a75cd0,c8017af0,edfa8d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xedfa8d40, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc7eeb5e0 sched_switch(c7eeb5e0,0,109,1b3,0,...) at sched_switch+0x458 mi_switch(109,0,c107a7d3,563,c7e28a70,...) at mi_switch+0x243 ithread_loop(c8017c90,edfa4d08,c107a4b0,3db,c7de0598,...) at ithread_loop+0x1fb fork_exit(c0a75cd0,c8017c90,edfa4d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xedfa4d40, ebp = 0 --- Tracing command intr pid 12 tid 100028 td 0xc7eeb8d0 sched_switch(c7eeb8d0,0,109,1b3,0,...) at sched_switch+0x458 mi_switch(109,0,c107a7d3,563,c7e28af0,...) at mi_switch+0x243 ithread_loop(c80174d0,c7ba1d08,c107a4b0,3db,c7de0598,...) at ithread_loop+0x1fb fork_exit(c0a75cd0,c80174d0,c7ba1d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7ba1d40, ebp = 0 --- Tracing command intr pid 12 tid 100027 td 0xc7eebbc0 sched_switch(c7eebbc0,0,109,1b3,0,...) at sched_switch+0x458 mi_switch(109,0,c107a7d3,563,c7fd4070,...) at mi_switch+0x243 ithread_loop(c7db43d0,c7b6fd08,c107a4b0,3db,c7de0598,...) at ithread_loop+0x1fb fork_exit(c0a75cd0,c7db43d0,c7b6fd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b6fd40, ebp = 0 --- Tracing command intr pid 12 tid 100023 td 0xc7fd28d0 sched_switch(c7fd28d0,0,109,1b3,0,...) at sched_switch+0x458 mi_switch(109,0,c107a7d3,563,c7fd4170,...) at mi_switch+0x243 ithread_loop(c7db4460,c7b63d08,c107a4b0,3db,c7de0598,...) at ithread_loop+0x1fb fork_exit(c0a75cd0,c7db4460,c7b63d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b63d40, ebp = 0 --- Tracing command intr pid 12 tid 100022 td 0xc7fd2bc0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100019 td 0xc7eea000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100012 td 0xc7de35e0 sched_switch(c7de35e0,0,109,1b3,0,...) at sched_switch+0x458 mi_switch(109,0,c107a7d3,563,c7e27170,...) at mi_switch+0x243 ithread_loop(c7db46f0,c7b41d08,c107a4b0,3db,c7de0598,...) at ithread_loop+0x1fb fork_exit(c0a75cd0,c7db46f0,c7b41d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b41d40, ebp = 0 --- Tracing command intr pid 12 tid 100011 td 0xc7de38d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100010 td 0xc7de3bc0 sched_switch(c7de3bc0,0,109,1b3,0,...) at sched_switch+0x458 mi_switch(109,0,c107a7d3,563,c7e27270,...) at mi_switch+0x243 ithread_loop(c7db4710,c7b3bd08,c107a4b0,3db,c7de0598,...) at ithread_loop+0x1fb fork_exit(c0a75cd0,c7db4710,c7b3bd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b3bd40, ebp = 0 --- Tracing command intr pid 12 tid 100009 td 0xc7e29000 sched_switch(c7e29000,0,109,1b3,0,...) at sched_switch+0x458 mi_switch(109,0,c107a7d3,563,c7e272f0,...) at mi_switch+0x243 ithread_loop(c7db4720,c7b38d08,c107a4b0,3db,c7de0598,...) at ithread_loop+0x1fb fork_exit(c0a75cd0,c7db4720,c7b38d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b38d40, ebp = 0 --- Tracing command intr pid 12 tid 100008 td 0xc7e292f0 sched_switch(c7e292f0,0,109,1b3,0,...) at sched_switch+0x458 mi_switch(109,0,c107a7d3,563,c7e27370,...) at mi_switch+0x243 ithread_loop(c7db4730,c7b35d08,c107a4b0,3db,c7de0598,...) at ithread_loop+0x1fb fork_exit(c0a75cd0,c7db4730,c7b35d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b35d40, ebp = 0 --- Tracing command intr pid 12 tid 100007 td 0xc7e295e0 sched_switch(c7e295e0,0,109,1b3,0,...) at sched_switch+0x458 mi_switch(109,0,c107a7d3,563,c7e273f0,...) at mi_switch+0x243 ithread_loop(c7db4740,c7b32d08,c107a4b0,3db,c7de0598,...) at ithread_loop+0x1fb fork_exit(c0a75cd0,c7db4740,c7b32d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b32d40, ebp = 0 --- Tracing command idle pid 11 tid 100006 td 0xc7de2000 sched_switch(c7de2000,0,108,1ae,c0a8f01c,...) at sched_switch+0x458 mi_switch(108,0,c1082a20,3e6,c7de2000,...) at mi_switch+0x243 sched_idletd(0,c7b2ed08,c107a4b0,3db,c7de0864,...) at sched_idletd+0x19c fork_exit(c0acb910,0,c7b2ed08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b2ed40, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc7de22f0 sched_switch(c7de22f0,0,108,1ae,c0a8f01c,...) at sched_switch+0x458 mi_switch(108,0,c1082a20,3e6,c7de22f0,...) at mi_switch+0x243 sched_idletd(0,c7b2bd08,c107a4b0,3db,c7de0864,...) at sched_idletd+0x19c fork_exit(c0acb910,0,c7b2bd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b2bd40, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc7de25e0 sched_switch(c7de25e0,0,108,1ae,c0a8f01c,...) at sched_switch+0x458 mi_switch(108,0,c1082a20,3e6,c7de25e0,...) at mi_switch+0x243 sched_idletd(0,c7b28d08,c107a4b0,3db,c7de0864,...) at sched_idletd+0x19c fork_exit(c0acb910,0,c7b28d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b28d40, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xc7de28d0 sched_switch(c7de28d0,0,108,1ae,c0a8f01c,...) at sched_switch+0x458 mi_switch(108,0,c1082a20,3e6,c7de28d0,...) at mi_switch+0x243 sched_idletd(0,c7b25d08,c107a4b0,3db,c7de0864,...) at sched_idletd+0x19c fork_exit(c0acb910,0,c7b25d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b25d40, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc7de2bc0 sched_switch(c7de2bc0,0,104,1b3,c7b21ab4,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1253580,...) at mi_switch+0x243 sleepq_switch(c7de2bc0,0,c1086460,1ad,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c1086460,166,0,100,100,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(c7de0b30,6c,c10894a4,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7de0b30,c7de0bb8,16c,c10894a4,0,...) at _sleep+0x384 kern_wait(c7de2bc0,ffffffff,c7b21c38,0,0,...) at kern_wait+0x597 sys_wait4(c7de2bc0,c7b21ccc,d3c93a83,0,c7b21cc4,...) at sys_wait4+0x3b syscall(c7b21d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x805ff2f, esp = 0xbfbfd8ec, ebp = 0xbfbfd908 --- Tracing command audit pid 10 tid 100001 td 0xc7de3000 sched_switch(c7de3000,0,104,1b3,c7b1ebf0,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,ec,...) at mi_switch+0x243 sleepq_switch(c7de3000,0,c1086460,26f,c7de3000,...) at sleepq_switch+0x1a7 sleepq_wait(c13c3960,0,c7b1ec6c,1,0,...) at sleepq_wait+0x6b _cv_wait(c13c3960,c13c3944,c10b2bd7,194,c7b1eca4,...) at _cv_wait+0x263 audit_worker(0,c7b1ed08,c107a4b0,3db,c7de1000,...) at audit_worker+0x84 fork_exit(c0cb3f30,0,c7b1ed08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b1ed40, ebp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xc8197000 sched_switch(c8197000,0,104,1b3,ee196bd0,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,352,...) at mi_switch+0x243 sleepq_switch(c8197000,0,c1086460,292,2,...) at sleepq_switch+0x1a7 sleepq_timedwait(c1245084,0,c106c2f2,2,0,...) at sleepq_timedwait+0x6b _sleep(c1245084,0,0,c106c2f2,bb8) at _sleep+0x369 pause(c106c2f2,bb8,12b,129,c1242368,...) at pause+0xa0 deadlkres(0,ee196d08,c107a4b0,3db,c12422e0,...) at deadlkres+0x324 fork_exit(c0a540b0,0,ee196d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee196d40, ebp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xc81972f0 sched_switch(c81972f0,0,104,1b3,ee193c1c,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1086460,...) at mi_switch+0x243 sleepq_switch(c81972f0,0,c1086460,26f,c81972f0,...) at sleepq_switch+0x1a7 sleepq_wait(c8194500,0,c1081496,c106c2f2,0,...) at sleepq_wait+0x6b msleep_spin(c8194500,c8194518,c106c2f2,0,a6f,...) at msleep_spin+0x252 taskqueue_thread_loop(c1426520,ee193d08,c107a4b0,3db,c12422e0,...) at taskqueue_thread_loop+0x8f fork_exit(c0ae8b40,c1426520,ee193d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee193d40, ebp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xc80618d0 sched_switch(c80618d0,0,104,1b3,ee174c1c,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1086460,...) at mi_switch+0x243 sleepq_switch(c80618d0,0,c1086460,26f,c80618d0,...) at sleepq_switch+0x1a7 sleepq_wait(c8066d00,0,c1081496,c106c2f2,0,...) at sleepq_wait+0x6b msleep_spin(c8066d00,c8066d18,c106c2f2,0,a6f,...) at msleep_spin+0x252 taskqueue_thread_loop(c809e49c,ee174d08,c107a4b0,3db,c12422e0,...) at taskqueue_thread_loop+0x8f fork_exit(c0ae8b40,c809e49c,ee174d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee174d40, ebp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xc7fd2000 sched_switch(c7fd2000,0,104,1b3,c7b6cc1c,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1086460,...) at mi_switch+0x243 sleepq_switch(c7fd2000,0,c1086460,26f,c7fd2000,...) at sleepq_switch+0x1a7 sleepq_wait(c7db2480,0,c1081496,c106c2f2,0,...) at sleepq_wait+0x6b msleep_spin(c7db2480,c7db2498,c106c2f2,0,a6f,...) at msleep_spin+0x252 taskqueue_thread_loop(c120be18,c7b6cd08,c107a4b0,3db,c12422e0,...) at taskqueue_thread_loop+0x8f fork_exit(c0ae8b40,c120be18,c7b6cd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b6cd40, ebp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xc7fd22f0 sched_switch(c7fd22f0,0,104,1b3,c7b69c1c,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1086460,...) at mi_switch+0x243 sleepq_switch(c7fd22f0,0,c1086460,26f,c7fd22f0,...) at sleepq_switch+0x1a7 sleepq_wait(c7db2480,0,c1081496,c106c2f2,0,...) at sleepq_wait+0x6b msleep_spin(c7db2480,c7db2498,c106c2f2,0,a6f,...) at msleep_spin+0x252 taskqueue_thread_loop(c120be18,c7b69d08,c107a4b0,3db,c12422e0,...) at taskqueue_thread_loop+0x8f fork_exit(c0ae8b40,c120be18,c7b69d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b69d40, ebp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xc7fd25e0 sched_switch(c7fd25e0,0,104,1b3,c7b66c1c,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c1086460,...) at mi_switch+0x243 sleepq_switch(c7fd25e0,0,c1086460,26f,c7fd25e0,...) at sleepq_switch+0x1a7 sleepq_wait(c7db2480,0,c1081496,c106c2f2,0,...) at sleepq_wait+0x6b msleep_spin(c7db2480,c7db2498,c106c2f2,0,a6f,...) at msleep_spin+0x252 taskqueue_thread_loop(c120be18,c7b66d08,c107a4b0,3db,c12422e0,...) at taskqueue_thread_loop+0x8f fork_exit(c0ae8b40,c120be18,c7b66d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b66d40, ebp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xc7e298d0 sched_switch(c7e298d0,0,104,1b3,c7b5dc04,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c7dbfb40,...) at mi_switch+0x243 sleepq_switch(c7e298d0,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(c7db25c0,0,c106c2f2,0,0,...) at sleepq_wait+0x6b _sleep(c7db25c0,c7db25d8,0,c106c2f2,0,...) at _sleep+0x39b taskqueue_thread_loop(c1261cac,c7b5dd08,c107a4b0,3db,c12422e0,...) at taskqueue_thread_loop+0xb5 fork_exit(c0ae8b40,c1261cac,c7b5dd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b5dd40, ebp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xc7e29bc0 sched_switch(c7e29bc0,0,104,1b3,c7b5ac04,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c7dbfb00,...) at mi_switch+0x243 sleepq_switch(c7e29bc0,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(c7db2600,0,c106c2f2,0,0,...) at sleepq_wait+0x6b _sleep(c7db2600,c7db2618,0,c106c2f2,0,...) at _sleep+0x39b taskqueue_thread_loop(c13c3f44,c7b5ad08,c107a4b0,3db,c12422e0,...) at taskqueue_thread_loop+0xb5 fork_exit(c0ae8b40,c13c3f44,c7b5ad08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b5ad40, ebp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xc7eea2f0 sched_switch(c7eea2f0,0,104,1b3,c7b54c04,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c7dbfa80,...) at mi_switch+0x243 sleepq_switch(c7eea2f0,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(c7db26c0,0,c106c2f2,0,0,...) at sleepq_wait+0x6b _sleep(c7db26c0,c7db26d8,0,c106c2f2,0,...) at _sleep+0x39b taskqueue_thread_loop(c1242c78,c7b54d08,c107a4b0,3db,c12422e0,...) at taskqueue_thread_loop+0xb5 fork_exit(c0ae8b40,c1242c78,c7b54d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b54d40, ebp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xc7eea8d0 sched_switch(c7eea8d0,0,104,1b3,c7b4dc04,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,c7dbfa00,...) at mi_switch+0x243 sleepq_switch(c7eea8d0,0,c1086460,26f,0,...) at sleepq_switch+0x1a7 sleepq_wait(c7db2ac0,0,c106c2f2,0,0,...) at sleepq_wait+0x6b _sleep(c7db2ac0,c7db2ad8,0,c106c2f2,0,...) at _sleep+0x39b taskqueue_thread_loop(c12606a0,c7b4dd08,c107a4b0,3db,c12422e0,...) at taskqueue_thread_loop+0xb5 fork_exit(c0ae8b40,c12606a0,c7b4dd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b4dd40, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc12425b0 sched_switch(c12425b0,0,104,1b3,c1820b4c,...) at sched_switch+0x458 mi_switch(104,0,c1086460,1f9,352,...) at mi_switch+0x243 sleepq_switch(c12425b0,0,c1086460,292,0,...) at sleepq_switch+0x1a7 sleepq_timedwait(c2b2a5f0,50,c10bb715,0,0,...) at sleepq_timedwait+0x6b _sleep(c2b2a5f0,ca852378,50,c10bb715,4e20,...) at _sleep+0x369 swap_pager_getpages(ca852378,c1820c7c,2,0,1,...) at swap_pager_getpages+0x3a1 faultin(ca839b30,0,c10bc6c0,2fb,2710,...) at faultin+0x288 scheduler(0,181ec00,181ec00,181e000,1825000,...) at scheduler+0x2ad mi_startup() at mi_startup+0xac begin() at begin+0x2c db:0:allt> call doadump Physical memory: 3435 MB Dumping 279 MB: 264 248 232 216 200 184 168 152 136 120 104 88 72 56 40 24 8 Dump complete = 0 db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 2 (kgdb) bt #0 doadump (textdump=0xf2974694) at pcpu.h:249 #1 0xc0527009 in db_fncall (dummy1=0xc0ada0fa, dummy2=0x0, dummy3=0xffffffff, dummy4=0xf2974728 "oflags & VPO_UNMANAGED) == 0) { 2042 vm_page_lock_assert(m, MA_OWNED); 2043 KASSERT(!pmap_page_is_mapped(m), 2044 ("vm_page_free_toq: freeing mapped page %p", m)); 2045 } 2046 PCPU_INC(cnt.v_tfree); 2047 (kgdb) p *m $1 = {pageq = {tqe_next = 0xc2537fb8, tqe_prev = 0xc5de3fb8}, listq = {tqe_next = 0x0, tqe_prev = 0xcc687968}, left = 0x0, right = 0x0, object = 0xcc687940, pindex = 0x0, phys_addr = 0x1fa18000, md = {pv_list = {tqh_first = 0xc6db1040, tqh_last = 0xc6db1044}, pat_mode = 0x6}, queue = 0x1, segind = 0x2, hold_count = 0x0, order = 0xb, pool = 0x0, cow = 0x0, wire_count = 0x0, aflags = 0x0, flags = 0x0, oflags = 0x0, act_count = 0x18, busy = 0x0, valid = 0xff, dirty = 0xff} (kgdb) f 16 #16 0xc0d2fe7f in vm_object_page_remove (object=0xcc687940, start=0x0, end=0x1, options=0x2) at ../../../vm/vm_object.c:1953 1953 vm_page_free(p); (kgdb) l 1948 p->wire_count, wirings, p)); 1949 p->wire_count = 0; 1950 atomic_subtract_int(&cnt.v_wire_count, 1); 1951 } 1952 } 1953 vm_page_free(p); 1954 vm_page_unlock(p); 1955 } 1956 vm_object_pip_wakeup(object); 1957 skipmemq: (kgdb) p *object $2 = {mtx = {lock_object = {lo_name = 0xc108880c "vm object", lo_flags = 0x1430000, lo_data = 0x0, lo_witness = 0xc7d82bf8}, mtx_lock = 0xcd8945e0}, object_list = {tqe_next = 0xccec1128, tqe_prev = 0xcd7c313c}, shadow_head = {lh_first = 0x0}, shadow_list = {le_next = 0xcd758378, le_prev = 0xcd69c26c}, memq = {tqh_first = 0xc2b83678, tqh_last = 0xc2b83680}, root = 0xc2b83678, size = 0x1, generation = 0x1, ref_count = 0x3, shadow_count = 0x0, memattr = 0x6, type = 0x1, flags = 0xb000, pg_color = 0x0, paging_in_progress = 0x1, resident_page_count = 0x1, backing_object = 0x0, backing_object_offset = 0x0, pager_object_list = {tqe_next = 0x0, tqe_prev = 0x0}, rvq = {lh_first = 0x0}, cache = 0x0, handle = 0x0, un_pager = {vnp = {vnp_size = 0xcd7e9e10, writemappings = 0x0}, devp = {devp_pglist = {tqh_first = 0xcd7e9e10, tqh_last = 0x0}, ops = 0x0}, sgp = {sgp_pglist = {tqh_first = 0xcd7e9e10, tqh_last = 0x0}}, swp = {swp_tmpfs = 0xcd7e9e10, swp_bcount = 0x0}}, cred = 0x0, charge = 0x0} (kgdb) git diff master diff --git a/sys/fs/nullfs/null_vnops.c b/sys/fs/nullfs/null_vnops.c index 5fb020b..ab0cc49 100644 --- a/sys/fs/nullfs/null_vnops.c +++ b/sys/fs/nullfs/null_vnops.c @@ -665,7 +665,9 @@ null_unlock(struct vop_unlock_args *ap) } /* - * XXXKIB + * Do not allow the VOP_INACTIVE to be bypassed to the lower layer, + * since the reference count on the lower vnode is not related with + * our. */ static int null_inactive(struct vop_inactive_args *ap __unused) diff --git a/sys/fs/tmpfs/tmpfs_subr.c b/sys/fs/tmpfs/tmpfs_subr.c index 5f1616c..eb63c76 100644 --- a/sys/fs/tmpfs/tmpfs_subr.c +++ b/sys/fs/tmpfs/tmpfs_subr.c @@ -154,6 +154,7 @@ tmpfs_alloc_node(struct tmpfs_mount *tmp, enum vtype type, char *target, dev_t rdev, struct tmpfs_node **node) { struct tmpfs_node *nnode; + struct vm_object *obj; /* If the root directory of the 'tmp' file system is not yet * allocated, this must be the request to do it. */ @@ -214,7 +215,7 @@ tmpfs_alloc_node(struct tmpfs_mount *tmp, enum vtype type, break; case VREG: - nnode->tn_reg.tn_aobj = + obj = nnode->tn_reg.tn_aobj = vm_pager_allocate(OBJT_SWAP, NULL, 0, VM_PROT_DEFAULT, 0, NULL /* XXXKIB - tmpfs needs swap reservation */); break; @@ -295,6 +296,9 @@ tmpfs_free_node(struct tmpfs_mount *tmp, struct tmpfs_node *node) TMPFS_LOCK(tmp); tmp->tm_pages_used -= uobj->size; TMPFS_UNLOCK(tmp); + VM_OBJECT_LOCK(uobj); + uobj->flags &= ~OBJ_TMPFS; + VM_OBJECT_UNLOCK(uobj); vm_object_deallocate(uobj); } break; @@ -381,9 +385,11 @@ int tmpfs_alloc_vp(struct mount *mp, struct tmpfs_node *node, int lkflag, struct vnode **vpp) { - int error = 0; struct vnode *vp; + vm_object_t object; + int error; + error = 0; loop: TMPFS_NODE_LOCK(node); if ((vp = node->tn_vnode) != NULL) { @@ -453,13 +459,22 @@ loop: /* FALLTHROUGH */ case VLNK: /* FALLTHROUGH */ - case VREG: - /* FALLTHROUGH */ case VSOCK: break; case VFIFO: vp->v_op = &tmpfs_fifoop_entries; break; + case VREG: + object = node->tn_reg.tn_aobj; + VM_OBJECT_LOCK(object); + VI_LOCK(vp); + KASSERT(vp->v_object == NULL, ("Not NULL v_object in tmpfs")); + vp->v_object = object; + object->un_pager.swp.swp_tmpfs = vp; + object->flags |= OBJ_TMPFS; + VI_UNLOCK(vp); + VM_OBJECT_UNLOCK(object); + break; case VDIR: MPASS(node->tn_dir.tn_parent != NULL); if (node->tn_dir.tn_parent == node) @@ -470,7 +485,6 @@ loop: panic("tmpfs_alloc_vp: type %p %d", node, (int)node->tn_type); } - vnode_pager_setsize(vp, node->tn_size); error = insmntque(vp, mp); if (error) vp = NULL; diff --git a/sys/fs/tmpfs/tmpfs_vnops.c b/sys/fs/tmpfs/tmpfs_vnops.c index 368e1ca..d4c2e13 100644 --- a/sys/fs/tmpfs/tmpfs_vnops.c +++ b/sys/fs/tmpfs/tmpfs_vnops.c @@ -276,8 +276,6 @@ tmpfs_close(struct vop_close_args *v) { struct vnode *vp = v->a_vp; - MPASS(VOP_ISLOCKED(vp)); - /* Update node times. */ tmpfs_update(vp); @@ -437,7 +435,6 @@ tmpfs_setattr(struct vop_setattr_args *v) return error; } -/* --------------------------------------------------------------------- */ static int tmpfs_nocacheread(vm_object_t tobj, vm_pindex_t idx, vm_offset_t offset, size_t tlen, struct uio *uio) @@ -451,7 +448,17 @@ tmpfs_nocacheread(vm_object_t tobj, vm_pindex_t idx, if (m->valid != VM_PAGE_BITS_ALL) { if (vm_pager_has_page(tobj, idx, NULL, NULL)) { rv = vm_pager_get_pages(tobj, &m, 1, 0); + m = vm_page_lookup(tobj, idx); + if (m == NULL) { + printf( + "tmpfs: vm_obj %p idx %jd null lookup rv %d\n", + tobj, idx, rv); + return (EIO); + } if (rv != VM_PAGER_OK) { + printf( + "tmpfs: vm_obj %p idx %jd valid %x pager error %d\n", + tobj, idx, m->valid, rv); vm_page_lock(m); vm_page_free(m); vm_page_unlock(m); @@ -473,120 +480,20 @@ tmpfs_nocacheread(vm_object_t tobj, vm_pindex_t idx, return (error); } -static __inline int -tmpfs_nocacheread_buf(vm_object_t tobj, vm_pindex_t idx, - vm_offset_t offset, size_t tlen, void *buf) -{ - struct uio uio; - struct iovec iov; - - uio.uio_iovcnt = 1; - uio.uio_iov = &iov; - iov.iov_base = buf; - iov.iov_len = tlen; - - uio.uio_offset = 0; - uio.uio_resid = tlen; - uio.uio_rw = UIO_READ; - uio.uio_segflg = UIO_SYSSPACE; - uio.uio_td = curthread; - - return (tmpfs_nocacheread(tobj, idx, offset, tlen, &uio)); -} - -static int -tmpfs_mappedread(vm_object_t vobj, vm_object_t tobj, size_t len, struct uio *uio) -{ - struct sf_buf *sf; - vm_pindex_t idx; - vm_page_t m; - vm_offset_t offset; - off_t addr; - size_t tlen; - char *ma; - int error; - - addr = uio->uio_offset; - idx = OFF_TO_IDX(addr); - offset = addr & PAGE_MASK; - tlen = MIN(PAGE_SIZE - offset, len); - - if ((vobj == NULL) || - (vobj->resident_page_count == 0 && vobj->cache == NULL)) - goto nocache; - - VM_OBJECT_LOCK(vobj); -lookupvpg: - if (((m = vm_page_lookup(vobj, idx)) != NULL) && - vm_page_is_valid(m, offset, tlen)) { - if ((m->oflags & VPO_BUSY) != 0) { - /* - * Reference the page before unlocking and sleeping so - * that the page daemon is less likely to reclaim it. - */ - vm_page_reference(m); - vm_page_sleep(m, "tmfsmr"); - goto lookupvpg; - } - vm_page_busy(m); - VM_OBJECT_UNLOCK(vobj); - error = uiomove_fromphys(&m, offset, tlen, uio); - VM_OBJECT_LOCK(vobj); - vm_page_wakeup(m); - VM_OBJECT_UNLOCK(vobj); - return (error); - } else if (m != NULL && uio->uio_segflg == UIO_NOCOPY) { - KASSERT(offset == 0, - ("unexpected offset in tmpfs_mappedread for sendfile")); - if ((m->oflags & VPO_BUSY) != 0) { - /* - * Reference the page before unlocking and sleeping so - * that the page daemon is less likely to reclaim it. - */ - vm_page_reference(m); - vm_page_sleep(m, "tmfsmr"); - goto lookupvpg; - } - vm_page_busy(m); - VM_OBJECT_UNLOCK(vobj); - sched_pin(); - sf = sf_buf_alloc(m, SFB_CPUPRIVATE); - ma = (char *)sf_buf_kva(sf); - error = tmpfs_nocacheread_buf(tobj, idx, 0, tlen, ma); - if (error == 0) { - if (tlen != PAGE_SIZE) - bzero(ma + tlen, PAGE_SIZE - tlen); - uio->uio_offset += tlen; - uio->uio_resid -= tlen; - } - sf_buf_free(sf); - sched_unpin(); - VM_OBJECT_LOCK(vobj); - if (error == 0) - m->valid = VM_PAGE_BITS_ALL; - vm_page_wakeup(m); - VM_OBJECT_UNLOCK(vobj); - return (error); - } - VM_OBJECT_UNLOCK(vobj); -nocache: - error = tmpfs_nocacheread(tobj, idx, offset, tlen, uio); - - return (error); -} - static int tmpfs_read(struct vop_read_args *v) { struct vnode *vp = v->a_vp; struct uio *uio = v->a_uio; - struct tmpfs_node *node; vm_object_t uobj; size_t len; int resid; - int error = 0; + vm_pindex_t idx; + vm_offset_t offset; + off_t addr; + size_t tlen; node = VP_TO_TMPFS_NODE(vp); @@ -610,7 +517,11 @@ tmpfs_read(struct vop_read_args *v) len = MIN(node->tn_size - uio->uio_offset, resid); if (len == 0) break; - error = tmpfs_mappedread(vp->v_object, uobj, len, uio); + addr = uio->uio_offset; + idx = OFF_TO_IDX(addr); + offset = addr & PAGE_MASK; + tlen = MIN(PAGE_SIZE - offset, len); + error = tmpfs_nocacheread(uobj, idx, offset, tlen, uio); if ((error != 0) || (resid == uio->uio_resid)) break; } @@ -623,10 +534,10 @@ out: /* --------------------------------------------------------------------- */ static int -tmpfs_mappedwrite(vm_object_t vobj, vm_object_t tobj, size_t len, struct uio *uio) +tmpfs_mappedwrite(vm_object_t tobj, size_t len, struct uio *uio) { vm_pindex_t idx; - vm_page_t vpg, tpg; + vm_page_t tpg; vm_offset_t offset; off_t addr; size_t tlen; @@ -639,76 +550,42 @@ tmpfs_mappedwrite(vm_object_t vobj, vm_object_t tobj, size_t len, struct uio *ui offset = addr & PAGE_MASK; tlen = MIN(PAGE_SIZE - offset, len); - if ((vobj == NULL) || - (vobj->resident_page_count == 0 && vobj->cache == NULL)) { - vpg = NULL; - goto nocache; - } - - VM_OBJECT_LOCK(vobj); -lookupvpg: - if (((vpg = vm_page_lookup(vobj, idx)) != NULL) && - vm_page_is_valid(vpg, offset, tlen)) { - if ((vpg->oflags & VPO_BUSY) != 0) { - /* - * Reference the page before unlocking and sleeping so - * that the page daemon is less likely to reclaim it. - */ - vm_page_reference(vpg); - vm_page_sleep(vpg, "tmfsmw"); - goto lookupvpg; - } - vm_page_busy(vpg); - vm_page_undirty(vpg); - VM_OBJECT_UNLOCK(vobj); - error = uiomove_fromphys(&vpg, offset, tlen, uio); - } else { - if (vm_page_is_cached(vobj, idx)) - vm_page_cache_free(vobj, idx, idx + 1); - VM_OBJECT_UNLOCK(vobj); - vpg = NULL; - } -nocache: VM_OBJECT_LOCK(tobj); - tpg = vm_page_grab(tobj, idx, VM_ALLOC_WIRED | - VM_ALLOC_NORMAL | VM_ALLOC_RETRY); + tpg = vm_page_grab(tobj, idx, VM_ALLOC_WIRED | VM_ALLOC_NORMAL | + VM_ALLOC_RETRY); if (tpg->valid != VM_PAGE_BITS_ALL) { if (vm_pager_has_page(tobj, idx, NULL, NULL)) { rv = vm_pager_get_pages(tobj, &tpg, 1, 0); + tpg = vm_page_lookup(tobj, idx); + if (tpg == NULL) { + printf( + "tmpfs: vm_obj %p idx %jd null lookup rv %d\n", + tobj, idx, rv); + return (EIO); + } if (rv != VM_PAGER_OK) { + printf( + "tmpfs: vm_obj %p idx %jd valid %x pager error %d\n", + tobj, idx, tpg->valid, rv); vm_page_lock(tpg); vm_page_free(tpg); vm_page_unlock(tpg); - error = EIO; - goto out; + VM_OBJECT_UNLOCK(tobj); + return (EIO); } } else vm_page_zero_invalid(tpg, TRUE); } VM_OBJECT_UNLOCK(tobj); - if (vpg == NULL) - error = uiomove_fromphys(&tpg, offset, tlen, uio); - else { - KASSERT(vpg->valid == VM_PAGE_BITS_ALL, ("parts of vpg invalid")); - pmap_copy_page(vpg, tpg); - } + error = uiomove_fromphys(&tpg, offset, tlen, uio); VM_OBJECT_LOCK(tobj); - if (error == 0) { - KASSERT(tpg->valid == VM_PAGE_BITS_ALL, - ("parts of tpg invalid")); + if (error == 0) vm_page_dirty(tpg); - } vm_page_lock(tpg); vm_page_unwire(tpg, TRUE); vm_page_unlock(tpg); vm_page_wakeup(tpg); -out: VM_OBJECT_UNLOCK(tobj); - if (vpg != NULL) { - VM_OBJECT_LOCK(vobj); - vm_page_wakeup(vpg); - VM_OBJECT_UNLOCK(vobj); - } return (error); } @@ -766,7 +643,7 @@ tmpfs_write(struct vop_write_args *v) len = MIN(node->tn_size - uio->uio_offset, resid); if (len == 0) break; - error = tmpfs_mappedwrite(vp->v_object, uobj, len, uio); + error = tmpfs_mappedwrite(uobj, len, uio); if ((error != 0) || (resid == uio->uio_resid)) break; } @@ -1581,8 +1458,6 @@ tmpfs_inactive(struct vop_inactive_args *v) struct tmpfs_node *node; - MPASS(VOP_ISLOCKED(vp)); - node = VP_TO_TMPFS_NODE(vp); if (node->tn_links == 0) @@ -1604,7 +1479,7 @@ tmpfs_reclaim(struct vop_reclaim_args *v) node = VP_TO_TMPFS_NODE(vp); tmp = VFS_TO_TMPFS(vp->v_mount); - vnode_destroy_vobject(vp); + vp->v_object = NULL; cache_purge(vp); TMPFS_NODE_LOCK(node); diff --git a/sys/i386/i386/pmap.c b/sys/i386/i386/pmap.c index bea4102..1021803 100644 --- a/sys/i386/i386/pmap.c +++ b/sys/i386/i386/pmap.c @@ -2341,6 +2341,37 @@ out: return (m_pc); } +static int +sysctl_pv_reclaim(SYSCTL_HANDLER_ARGS) +{ + vm_page_t m; + pmap_t pmap; + int error, c, i, val; + + val = 0; + error = sysctl_handle_int(oidp, &val, 0, req); + if (error || !req->newptr) + return (error); + pmap = vmspace_pmap(curproc->p_vmspace); + for (i = 0, c = 0; i < val; i++) { + rw_wlock(&pvh_global_lock); + PMAP_LOCK(pmap); + m = pmap_pv_reclaim(pmap); + PMAP_UNLOCK(pmap); + rw_wunlock(&pvh_global_lock); + if (m != NULL) { + c++; + m->wire_count = 0; + atomic_add_int(&cnt.v_wire_count, -1); + vm_page_free(m); + } + } + return (error); +} + +SYSCTL_PROC(_vm_pmap, OID_AUTO, pv_reclaim, CTLTYPE_INT | CTLFLAG_RW, 0, 0, + sysctl_pv_reclaim, "I", ""); + /* * free the pv_entry back to the free list */ @@ -4366,6 +4397,8 @@ pmap_remove_pages(pmap_t pmap) PMAP_LOCK(pmap); sched_pin(); TAILQ_FOREACH_SAFE(pc, &pmap->pm_pvchunk, pc_list, npc) { + KASSERT(pc->pc_pmap == pmap, ("Wrong pmap %p %p", pmap, + pc->pc_pmap)); allfree = 1; for (field = 0; field < _NPCM; field++) { inuse = ~pc->pc_map[field] & pc_freemask[field]; diff --git a/sys/kern/uipc_syscalls.c b/sys/kern/uipc_syscalls.c index 94dd127..c3f5fae 100644 --- a/sys/kern/uipc_syscalls.c +++ b/sys/kern/uipc_syscalls.c @@ -1832,9 +1832,10 @@ kern_sendfile(struct thread *td, struct sendfile_args *uap, struct mbuf *m = NULL; struct sf_buf *sf; struct vm_page *pg; + struct vattr va; off_t off, xfsize, fsbytes = 0, sbytes = 0, rem = 0; int error, hdrlen = 0, mnw = 0; - int vfslocked; + int bsize, vfslocked; struct sendfile_sync *sfs = NULL; /* @@ -2031,6 +2032,20 @@ retry_space: */ space -= hdrlen; + vfslocked = VFS_LOCK_GIANT(vp->v_mount); + error = vn_lock(vp, LK_SHARED); + if (error != 0) { + VFS_UNLOCK_GIANT(vfslocked); + goto done; + } + error = VOP_GETATTR(vp, &va, td->td_ucred); + if (error != 0) { + VOP_UNLOCK(vp, 0); + VFS_UNLOCK_GIANT(vfslocked); + goto done; + } + bsize = vp->v_mount->mnt_stat.f_iosize; + /* * Loop and construct maximum sized mbuf chain to be bulk * dumped into socket buffer. @@ -2040,7 +2055,6 @@ retry_space: vm_offset_t pgoff; struct mbuf *m0; - VM_OBJECT_LOCK(obj); /* * Calculate the amount to transfer. * Not to exceed a page, the EOF, @@ -2048,17 +2062,16 @@ retry_space: */ pgoff = (vm_offset_t)(off & PAGE_MASK); xfsize = omin(PAGE_SIZE - pgoff, - obj->un_pager.vnp.vnp_size - uap->offset - + va.va_size - uap->offset - fsbytes - loopbytes); if (uap->nbytes) rem = (uap->nbytes - fsbytes - loopbytes); else - rem = obj->un_pager.vnp.vnp_size - + rem = va.va_size - uap->offset - fsbytes - loopbytes; xfsize = omin(rem, xfsize); xfsize = omin(space - loopbytes, xfsize); if (xfsize <= 0) { - VM_OBJECT_UNLOCK(obj); done = 1; /* all data sent */ break; } @@ -2068,6 +2081,7 @@ retry_space: * if not found or wait and loop if busy. */ pindex = OFF_TO_IDX(off); + VM_OBJECT_LOCK(obj); pg = vm_page_grab(obj, pindex, VM_ALLOC_NOBUSY | VM_ALLOC_NORMAL | VM_ALLOC_WIRED | VM_ALLOC_RETRY); @@ -2085,7 +2099,6 @@ retry_space: else if (uap->flags & SF_NODISKIO) error = EBUSY; else { - int bsize; ssize_t resid; /* @@ -2098,12 +2111,6 @@ retry_space: /* * Get the page from backing store. */ - vfslocked = VFS_LOCK_GIANT(vp->v_mount); - error = vn_lock(vp, LK_SHARED); - if (error != 0) - goto after_read; - bsize = vp->v_mount->mnt_stat.f_iosize; - /* * XXXMAC: Because we don't have fp->f_cred * here, we pass in NOCRED. This is probably @@ -2114,9 +2121,6 @@ retry_space: trunc_page(off), UIO_NOCOPY, IO_NODELOCKED | IO_VMIO | ((MAXBSIZE / bsize) << IO_SEQSHIFT), td->td_ucred, NOCRED, &resid, td); - VOP_UNLOCK(vp, 0); - after_read: - VFS_UNLOCK_GIANT(vfslocked); VM_OBJECT_LOCK(obj); vm_page_io_finish(pg); if (!error) @@ -2199,6 +2203,9 @@ retry_space: } } + VOP_UNLOCK(vp, 0); + VFS_UNLOCK_GIANT(vfslocked); + /* Add the buffer chain to the socket buffer. */ if (m != NULL) { int mlen, err; diff --git a/sys/vm/vm_mmap.c b/sys/vm/vm_mmap.c index e0aab73..a84f968 100644 --- a/sys/vm/vm_mmap.c +++ b/sys/vm/vm_mmap.c @@ -1280,7 +1280,7 @@ vm_mmap_vnode(struct thread *td, vm_size_t objsize, error = EINVAL; goto done; } - if (obj->handle != vp) { + if (obj->type == OBJT_VNODE && obj->handle != vp) { vput(vp); vp = (struct vnode *)obj->handle; /* @@ -1331,7 +1331,14 @@ vm_mmap_vnode(struct thread *td, vm_size_t objsize, objsize = round_page(va.va_size); if (va.va_nlink == 0) flags |= MAP_NOSYNC; - obj = vm_pager_allocate(OBJT_VNODE, vp, objsize, prot, foff, cred); + if (obj->type == OBJT_VNODE) + obj = vm_pager_allocate(OBJT_VNODE, vp, objsize, prot, foff, + cred); + else { + KASSERT(obj->type == OBJT_DEFAULT || obj->type == OBJT_SWAP, + ("wrong object type")); + vm_object_reference(obj); + } if (obj == NULL) { error = ENOMEM; goto done; diff --git a/sys/vm/vm_object.c b/sys/vm/vm_object.c index abf7689..80463e1 100644 --- a/sys/vm/vm_object.c +++ b/sys/vm/vm_object.c @@ -478,6 +478,7 @@ void vm_object_deallocate(vm_object_t object) { vm_object_t temp; + struct vnode *vp; while (object != NULL) { int vfslocked; @@ -527,6 +528,24 @@ vm_object_deallocate(vm_object_t object) VM_OBJECT_UNLOCK(object); return; } else if (object->ref_count == 1) { + if (object->type == OBJT_SWAP && + (object->flags & OBJ_TMPFS) != 0) { + vp = object->un_pager.swp.swp_tmpfs; + vhold(vp); + VM_OBJECT_UNLOCK(object); + vn_lock(vp, LK_EXCLUSIVE | LK_RETRY); + vdrop(vp); + VM_OBJECT_LOCK(object); + if (object->type == OBJT_DEAD) { + VM_OBJECT_UNLOCK(object); + VOP_UNLOCK(vp, 0); + return; + } else if ((object->flags & OBJ_TMPFS) != 0) { + if (object->ref_count == 1) + VOP_UNSET_TEXT(vp); + VOP_UNLOCK(vp, 0); + } + } if (object->shadow_count == 0 && object->handle == NULL && (object->type == OBJT_DEFAULT || @@ -822,7 +841,12 @@ vm_object_page_clean(vm_object_t object, vm_ooffset_t start, vm_ooffset_t end, mtx_assert(&vm_page_queue_mtx, MA_NOTOWNED); VM_OBJECT_LOCK_ASSERT(object, MA_OWNED); - KASSERT(object->type == OBJT_VNODE, ("Not a vnode object")); + + /* + * The OBJ_MIGHTBEDIRTY flag is only set for the OBJT_VNODE + * objects. The check below prevents the function from + * operating on the non-vnode objects. + */ if ((object->flags & OBJ_MIGHTBEDIRTY) == 0 || object->resident_page_count == 0) return (TRUE); diff --git a/sys/vm/vm_object.h b/sys/vm/vm_object.h index daafd03..d7c5b75 100644 --- a/sys/vm/vm_object.h +++ b/sys/vm/vm_object.h @@ -155,6 +155,7 @@ struct vm_object { * see vm/swap_pager.h */ struct { + void *swp_tmpfs; int swp_bcount; } swp; } un_pager; @@ -173,6 +174,7 @@ struct vm_object { #define OBJ_COLORED 0x1000 /* pg_color is defined */ #define OBJ_ONEMAPPING 0x2000 /* One USE (a single, non-forked) mapping flag */ #define OBJ_DISCONNECTWNT 0x4000 /* disconnect from vnode wanted */ +#define OBJ_TMPFS 0x8000 #define IDX_TO_OFF(idx) (((vm_ooffset_t)(idx)) << PAGE_SHIFT) #define OFF_TO_IDX(off) ((vm_pindex_t)(((vm_ooffset_t)(off)) >> PAGE_SHIFT)) diff --git a/sys/vm/vnode_pager.c b/sys/vm/vnode_pager.c index cc9063b..9183ba3 100644 --- a/sys/vm/vnode_pager.c +++ b/sys/vm/vnode_pager.c @@ -213,8 +213,7 @@ retry: msleep(object, VM_OBJECT_MTX(object), PDROP | PVM, "vadead", 0); } - if (vp->v_usecount == 0) - panic("vnode_pager_alloc: no vnode reference"); + KASSERT(vp->v_usecount != 0, ("vnode_pager_alloc: no vnode reference")); if (object == NULL) { /* @@ -379,7 +378,7 @@ vnode_pager_setsize(vp, nsize) vm_page_t m; vm_pindex_t nobjsize; - if ((object = vp->v_object) == NULL) + if ((object = vp->v_object) == NULL || object->type != OBJT_VNODE) return; /* ASSERT_VOP_ELOCKED(vp, "vnode_pager_setsize and not locked vnode"); */ VM_OBJECT_LOCK(object); -- Test scenario: tmpfs13.sh