GENERIC HEAD from 2013-09-11 18:22:30 UTC, r255487, vmcore.698 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb 4718592K of memory above 4GB ignored Copyright (c) 1992-2013 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #1 r255487: Thu Sep 12 12:49:17 CEST 2013 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 FreeBSD clang version 3.3 (tags/RELEASE_33/final 183502) 20130610 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 0x10 Model = 0x2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 8589934592 (8192 MB) avail memory = 3536470016 (3372 MB) : Trying to mount root from ufs:/dev/ad4s1a [rw]... Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/ad4s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1a: clean, 585218 free (3554 frags, 72708 blocks, 0.4% fragmentation) /dev/ad4s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1f: clean, 566557 free (8485 frags, 69759 blocks, 0.8% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 94397612 free (14788 frags, 11797853 blocks, 0.0% fragmentation) /dev/ad4s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1d: clean, 3729535 free (202623 frags, 440864 blocks, 2.0% fragmentation) /dev/ad4s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1e: clean, 9377010 free (90442 frags, 1160821 blocks, 0.4% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN Starting Network: lo0 re0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 scopeid 0x1 nd6 options=29 media: Ethernet autoselect (none) status: no carrier Starting devd. add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/kde4/lib /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/gcc46 /usr/local/lib/mysql /usr/local/lib/nss /usr/local/lib/pth /usr/local/lib/qt4 /usr/local/lib/virtualbox a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. savecore: couldn't find media and/or sector size of /var/crash: Inappropriate ioctl for device Sep 12 12:57:32 x4 savecore: couldn't find media and/or sector size of /var/crash: Inappropriate ioctl for device No core dumps found. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 lock order reversal: 1st 0xe4103274 bufwait (bufwait) @ kern/vfs_bio.c:3059 2nd 0xc8aef400 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper(c119223c,e410321c,ed79e78c,c0b544ca,e4103274,...) at db_trace_self_wrapper+0x2d/frame 0xed79e760 kdb_backtrace(c1195e41,c8aef400,c11c8869,c81973a0,c11c84ae,...) at kdb_backtrace+0x30/frame 0xed79e7c8 witness_checkorder(c8aef400,9,c11c84a5,11c,0,...) at witness_checkorder+0xc8a/frame 0xed79e818 _sx_xlock(c8aef400,0,c11c84a5,11c,c8e0a000,...) at _sx_xlock+0x77/frame 0xed79e848 ufsdirhash_add(c8a57bc8,ed79e940,2bb0,ed79e8c8,ed79e8cc,...) at ufsdirhash_add+0x4a/frame 0xed79e878 ufs_direnter(c8bb85a0,c90235a0,ed79e940,ed79eb64,e4106da8,...) at ufs_direnter+0x63b/frame 0xed79e8f8 ufs_mkdir(ed79ec00,c11f05a7,c11c2066,c8bb85a0,ed79ebfc,...) at ufs_mkdir+0x884/frame 0xed79ea98 VOP_MKDIR_APV(c12bc48c,ed79ec00,ed79eb64,ed79eb90,28803020,...) at VOP_MKDIR_APV+0x124/frame 0xed79eac8 kern_mkdirat(c8b75000,ffffff9c,28803020,0,1c0) at kern_mkdirat+0x22b/frame 0xed79ec24 sys_mkdir(c8b75000,ed79ecc8,c0f66c70,e4340c90,0,...) at sys_mkdir+0x31/frame 0xed79ec40 syscall(ed79ed08) at syscall+0x2ed/frame 0xed79ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed79ecfc --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x2817dfb7, esp = 0xbfbfd92c, ebp = 0xbfbfddcc --- Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Recovering vi editor sessions:. Updating motd:. Starting ntpd. Starting powerd. Removing stale Samba tdb files: ....... done Starting nmbd. Starting smbd. Starting winbindd. Starting smartd. Starting default moused. Expensive timeout(9) function: 0xc0908070(0xc1497de8) 0.010113508 s Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Local package initialization: backuplock order reversal: 1st 0xc91e8304 ufs (ufs) @ kern/vfs_lookup.c:524 2nd 0xe411d348 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:262 3rd 0xc91a246c ufs (ufs) @ kern/vfs_subr.c:2099 KDB: stack backtrace: db_trace_self_wrapper(c119223c,c0f67317,0,530,700,...) at db_trace_self_wrapper+0lock order reversal: x 1st 0xc8b3473c ufs (ufs) @ kern/vfs_mount.c:1237 2 2nd 0xc8b34cdc devfs (devfs) @ ufs/ffs/ffs_softdep.c:1903 dKDB: stack backtrace: /framed b0_xtfr8a4caee_2s8e8l f_wrapper(c1192k2d3bc_,bca9c3k7tbr3acc4e,(2c4161,9c51e15caa,8cc9a1,ac214b68c1,8c1101,7.d.0.c)6 ,act8 19733d8b,_ct1r1a9cfe5_1s2e,l.f._.w)r aaptp er+0x2d/kfdrba_mbea c0kxtfr8a4cde0+802x03 0/frame 0xf84aek2dfb0_ backtrace(c1195wei4t1n,ecs8sb_3c4hcedcck,ocr1d1e8r8(ec8941,ac284169c7,199,8c,1c1191fc540a98,b8,3.3.,.c)9 1aat2 4d8,...)k dabt_ backtracwei+t0nxe3s0s/_fcrhaemcek o0rxdfer8+40dx0c888a8/ frame 0xf84ae34w0i tness_checkorde_r_(lco8cbk3m4gcrd_ca,r9g,sc(1c19c14aa28426,c7,68f0,100,0.,.c.9)1 aa2t4 d8,0,0,.w.i.t)n easts _checkor_d_elro+c0kxmcg8ra_/afrrgasm+e0 x08x1f58/4fdr0a8mde8 0xf84ae414 __lockmgr_args(fcf8sb_3l4occdkc(,f88044a0e04,9c88,bc3841d84381,e00,,0c,801,8c81d1bc04,ac8821,87361fe)0 ,act8 188db0,_._.l.o)c kamtg r_args+0fxf8s1_5l/ofcrka+m0ex a0dx/ff8r4adm0e9 a0cx f84ae454 vop_stdlock(f84VdO0Pa_2L0O,CcK114_8A3P7V1(cc,1c214b8c34780cc,,ff8844ade04a9280,,cc101a9cc25db04f,2,0.8.,.c)1 2adt0 978,...)v oapt_ stdlock+V0OxP5_3L/OfCrKa1m_eA P0Vx+f08x41d0049/dfcr ame 0xf84ae480 VOP_LOCK1_APV(c_1v2n8_6l4o2c0k,(fc8941da02a42308,,48,041,0c01,2cd101997f85,0.9.,.8)3 3,act1 19e751,.V.O.P)_ LaOtC K1_APV+0_xv1n0_4l/ofcrka+m0ex c0ax/ff8r4adm0ea 008x f84ae4c0 _vn_lock(c8b34cvag8e,t8(0c49010a,2c41318c,48a08120,07,6cf8,bf68940d000a,8587,,.0.,..). .a)t at _vnv_gleotc+k0+x07x7c/af/rfarmaem e0 x0fx8f48a4ed40fa84 8 vfs_hash_get(c8seo2f5t8dce4p,_1f6l1u5sbh3w,o8r0k0l0i0s,tc(8cb86e91050b0b,0f,8f48a4ed50da8d,c.,.c.9)3 7abt3 10,62e,fv8f4sd_0haacs8h,_.g.e.t)+ 0axtf f/frame so0fxtfd8e4pa_ef5l2u4s hworklist+0x6e/fffrsa_mveg e0txff(8c48de02a5888c 4,1615b3,80000,fff8s4_asey5ndc8(,c18,e.1.5.b)b 0a,t1 ,f84d0b4f8f,s5_1v8g,ect1f2+906x3d407,/.f.r.a)m ea t0 xf84ae58f0f s_sync+0x2e5/frasmoef t0dxefp8_4sdy0nbc1_0b uf(c91e82d0,e41d1odu2nfm0o,u1n,t0(,c08,e.1.5.b)b 0a,t8 080000,cs9o3f7tbd3e1p0_,s4y9n4c,_0b,u.f.+.0)x 8aetf /frame 0dxofu8n4maoeu5net8+ 0x49f/frame 0xf8f4fds0_bs7y0n cvnode(c91e82d0s,y1s,_0u,nbmfo3u,nct9(1ce983379b03,1.0.,.f)8 4adt0 cc8,c11ef9f7sb_es,ydn6c,v0n,o.d.e.+)0 xa2t8 7/frame s0yxsf_8u4nameo6u4n0t +0x3a1/frame 0xff8f4sd_0tcr4u0n cate(c91e82d0,2s0y0s,c0a,l8l8(0f,8c48da07de0880)0 ,a.t. .) at syscallf+f0sx_2terdu/nfcraatmee+ 00xx6fd8f4/df0rcafmce 0xf84aeX8i0n0t 0x80_syscall() uafts _direnteXri(nct901xe8802_ds0y,scc9a1lal2+403x82,1f/8f4raaem8ec 00,xff8844ade0bccfcc, 0-,-.-. .s)y sacta ll (22ufs_d,i rFerneteeBrS+D0 xE7LeFd3/2f,r asmyes _0uxnfm8o4uanet8)8,0 eip = 0x280c81aubf,s _emsapk e=i n0oxdbef(bff8d46aae4b,b 8e,bfp8 4=a e0bxcbcf)b fadt7 70 --- ufs_makeinode+0x538/frame 0xf84ae9f4 ufs_create(f84aeae0,c11eff95,c11c2066,c8e258d4,2,...) at ufs_create+0x2f/frame 0xf84aea08 VOP_CREATE_APV(c12bc48c,f84aeae0,f84aebcc,f84aea70,c1ba0300,...) at VOP_CREATE_APV+0x124/frame 0xf84aea38 vn_open_cred(f84aeb70,f84aebfc,180,0,c8a7e800,c8b589d8) at vn_open_cred+0x2d7/frame 0xf84aeb08 vn_open(f84aeb70,f84aebfc,180,c8b589d8,28c80360,...) at vn_open+0x3b/frame 0xf84aeb28 kern_openat(c8b69000,ffffff9c,28c80360,0,a02,180) at kern_openat+0x315/frame 0xf84aelock order reversal: 1st 0xc8e23e44 syncer (syncer) @ kern/vfs_subr.c:1718 c 2nd 0xc91d48a4 ufs (ufs) @ kern/vfs_subr.c:2099 2KDB: stack backtrace: 0 db_trace_self_wrsaypsp_ero(pce1n1(9c282b36c9,0c000b,1f88b40a7e,c1c,8c,1c109f6666a0,cc7101,9c6168a205,c.9.0.,)0 ,a.t. .) atd b_trace_ssyesl_fo_pwerna+p0pxe3r8+/0fxr2adm/ef r0axmfe8 40axeecd4701 6940 syscall(f84aed0k8d)b _abta cktrace(scy1s1c9a5lel4+10,xc29e1dd/4f8raa4m,ec 101x7fd804ca6e,ccf8c1 97338,c1X1i9nft501x28,0._.s.y)s caatl l() at kdb_backXtirnatc0ex+80x03_0s/yfsrcaamlel +00xxe2d17/1f6r9aam8e 0xf84aecfc w-i-t-n essyss_ccahlelc k(o5rder(c9,1 dF4r8eae4B,S9D, cE1L1F93f25,0 9s,y8s3_3o,pce9n1)d,4 9e1i0p, .=. .0)x 2a8t4 22247, ewsipt n=e s0sx_bcfhbefcak0o9rcd,e re+b0px c=8 a0/xfbrfabmfea 102x8e d-7-1-6 9f8 __lockmgr_args(c91d48a4,80500,c91d4910,0,0,...) at __lockmgr_args+0x815/frame 0xed716acc ffs_lock(ed716b50,c8188c10,c8197408,c8188c10,c8197408,...) at ffs_lock+0xad/frame 0xed716b0c VOP_LOCK1_APV(c12bc48c,ed716b50,c147f4a8,c147f498,c12d0978,...) at VOP_LOCK1_APV+0x104/frame 0xed716b38 _vn_lock(c91d4870,80500,c119f509,833,c119f509,...) at _vn_lock+0xca/frame 0xed716b78 vget(c91d4870,80500,c884c310,1281,c8e158d4,...) at vget+0x77/frame 0xed716bb0 vfs_msync(c8e158c4,2,2,e40,c8e158c4,...) at vfs_msync+0xa0/frame 0xed716bf8 sync_fsync(ed716ca8,c11f0482,80400,c119f509,6b6,...) at sync_fsync+0x11e/frame 0xed716c20 VOP_FSYNC_APV(c12a0158,ed716ca8,c119f509,6b6,0,...) at VOP_FSYNC_APV+0x124/frame 0xed716c50 sched_sync(0,ed716d08,c1187544,3d5,0,...) at sched_sync+0x38f/frame 0xed716ccc fork_exit(c0b778c0,0,ed716d08) at fork_exit+0x7f/frame 0xed716cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed716cf4 --- trap 0, eip = 0, esp = 0xed716d40, ebp = 0 --- ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes Sep 12 12:57:50 x4 su: BAD SU pho to root on /dev/pts/0 Sep 12 12:58:09 x4 su: pho to root on /dev/pts/0 20130912 12:58:18 all (1/1): mmap6.sh panic: vm_pageout_flush: partially invalid page 0xc33327e8 index 0/1 cpuid = 2 KDB: stack backtrace: db_trace_self_wrapper(c119223c,a,3,c11cd5cc,4,...) at db_trace_self_wrapper+0x2d/frame 0xf8520770 kdb_backtrace(c11e807b,2,c11cd595,f8520848,f8520818,...) at kdb_backtrace+0x30/frame 0xf85207d8 vpanic(c13055f2,100,c11cd595,f8520848,f8520848,...) at vpanic+0x11f/frame 0xf8520818 kassert_panic(c11cd595,c33327e8,0,1) at kassert_panic+0xea/frame 0xf852083c vm_pageout_flush(f8520904,1,3,0,f852096c,f8520a2c) at vm_pageout_flush+0x118/frame 0xf85208e4 vm_object_page_collect_flush(c9392ccc,c33327e8,3,3,f8520a30,...) at vm_object_page_collect_flush+0x27d/frame 0xf85209b0 vm_object_page_clean(c9392ccc,0,0,3000,0,...) at vm_object_page_clean+0x42b/frame 0xf8520a98 vm_object_sync(c9392ccc,0,0,3000,1,...) at vm_object_sync+0x403/frame 0xf8520b68 vm_map_sync(c1b83e10,281d2000,281d5000,1,1,...) at vm_map_sync+0x570/frame 0xf8520c1c sys_msync(c97b9c40,f8520cc8,0,0,0,...) at sys_msync+0x69/frame 0xf8520c40 syscall(f8520d08) at syscall+0x2ed/frame 0xf8520cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8520cfc --- syscall (65, FreeBSD ELF32, sys_msync), eip = 0x280c70bb, esp = 0xbfbfd93c, ebp = 0xbfbfda38 --- KDB: enter: panic [ thread pid 958 tid 100135 ] Stopped at kdb_enter+0x3d: movl $0,kdb_why db> run pho db:0:pho> bt Tracing pid 958 tid 100135 td 0xc97b9c40 kdb_enter(c118dc95,c118dc95,c11cd595,f8520848,f8520818,...) at kdb_enter+0x3d/frame 0xf85207d8 vpanic(c13055f2,100,c11cd595,f8520848,f8520848,...) at vpanic+0x143/frame 0xf8520818 kassert_panic(c11cd595,c33327e8,0,1) at kassert_panic+0xea/frame 0xf852083c vm_pageout_flush(f8520904,1,3,0,f852096c,f8520a2c) at vm_pageout_flush+0x118/frame 0xf85208e4 vm_object_page_collect_flush(c9392ccc,c33327e8,3,3,f8520a30,...) at vm_object_page_collect_flush+0x27d/frame 0xf85209b0 vm_object_page_clean(c9392ccc,0,0,3000,0,...) at vm_object_page_clean+0x42b/frame 0xf8520a98 vm_object_sync(c9392ccc,0,0,3000,1,...) at vm_object_sync+0x403/frame 0xf8520b68 vm_map_sync(c1b83e10,281d2000,281d5000,1,1,...) at vm_map_sync+0x570/frame 0xf8520c1c sys_msync(c97b9c40,f8520cc8,0,0,0,...) at sys_msync+0x69/frame 0xf8520c40 syscall(f8520d08) at syscall+0x2ed/frame 0xf8520cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8520cfc --- syscall (65, FreeBSD ELF32, sys_msync), eip = 0x280c70bb, esp = 0xbfbfd93c, ebp = 0xbfbfda38 --- db:0:bt> show allpcpu Current CPU: 2 cpuid = 0 dynamic pcpu = 0x551c00 curthread = 0xc82f6000: pid 11 "idle: cpu0" curpcb = 0xe434dd60 fpcurthread = none idlethread = 0xc82f6000: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x23069c00 curthread = 0xc82f5c40: pid 11 "idle: cpu1" curpcb = 0xe4350d60 fpcurthread = none idlethread = 0xc82f5c40: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x2306cc00 curthread = 0xc97b9c40: pid 958 "mmap6" curpcb = 0xf8520d60 fpcurthread = none idlethread = 0xc82f5930: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x2306fc00 curthread = 0xc82f5620: pid 11 "idle: cpu3" curpcb = 0xe4356d60 fpcurthread = none idlethread = 0xc82f5620: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks Process 960 (mmap6) thread 0xc9395000 (100141) shared lockmgr ufs (ufs) r = 0 (0xc8b3473c) locked @ kern/vfs_subr.c:2099 Process 959 (mmap6) thread 0xc9395310 (100140) shared lockmgr ufs (ufs) r = 0 (0xc8b3473c) locked @ kern/vfs_subr.c:2099 Process 958 (mmap6) thread 0xc97b9c40 (100135) exclusive rw vm object (vm object) r = 0 (0xc9392ccc) locked @ vm/vnode_pager.c:1061 exclusive lockmgr ufs (ufs) r = 0 (0xc9adba0c) locked @ vm/vm_object.c:1020 Process 930 (sh) thread 0xc8a94c40 (100114) exclusive lockmgr bufwait (bufwait) r = 0 (0xe40d2784) locked @ vm/vm_pager.c:308 exclusive lockmgr ufs (ufs) r = 0 (0xc95da46c) locked @ kern/vfs_subr.c:2099 Process 767 (fsck_ufs) thread 0xc937ac40 (100117) exclusive lockmgr bufwait (bufwait) r = 0 (0xe40d2920) locked @ vm/vm_pager.c:308 db:0:alllocks> show lockedvnods Locked vnodes 0xc8b34708: tag ufs, type VDIR usecount 2, writecount 0, refcount 5 mountedhere 0 flags (VI_ACTIVE) v_object 0xc9392b94 ref 0 pages 1 lock type ufs: SHARED (count 2) #0 0xc0aa7521 at __lockmgr_args+0xf61 #1 0xc0d3f63d at ffs_lock+0xad #2 0xc0f86284 at VOP_LOCK1_APV+0x104 #3 0xc0b8325a at _vn_lock+0xca #4 0xc0b70957 at vget+0x77 #5 0xc0b5bc08 at cache_lookup+0x5a8 #6 0xc0b5cd3c at vfs_cache_lookup+0xbc #7 0xc0f82cf4 at VOP_LOOKUP_APV+0x124 #8 0xc0b65c88 at lookup+0x538 #9 0xc0b6539d at namei+0x51d #10 0xc0b8297d at vn_open_cred+0x24d #11 0xc0b8272b at vn_open+0x3b #12 0xc0b7ad55 at kern_openat+0x315 #13 0xc0b7a9b8 at sys_open+0x38 #14 0xc0f6027d at syscall+0x2ed #15 0xc0f484e1 at Xint0x80_syscall+0x21 ino 211968, on dev ada0s1a 0xc9adb9d8: tag ufs, type VREG usecount 4, writecount 2, refcount 7 mountedhere 0 flags (VI_ACTIVE) v_object 0xc9392ccc ref 3 pages 2 lock type ufs: EXCL by thread 0xc97b9c40 (pid 958, mmap6, tid 100135) with exclusive waiters pending #0 0xc0aa764e at __lockmgr_args+0x108e #1 0xc0d3f63d at ffs_lock+0xad #2 0xc0f86284 at VOP_LOCK1_APV+0x104 #3 0xc0b8325a at _vn_lock+0xca #4 0xc0d75f3b at vm_object_sync+0x2ab #5 0xc0d6c620 at vm_map_sync+0x570 #6 0xc0d71ae9 at sys_msync+0x69 #7 0xc0f6027d at syscall+0x2ed #8 0xc0f484e1 at Xint0x80_syscall+0x21 ino 212010, on dev ada0s1a 0xc95da438: tag ufs, type VREG usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VV_TEXT|VI_ACTIVE) v_object 0xc9c6b000 ref 1 pages 8 lock type ufs: EXCL by thread 0xc8a94c40 (pid 930, sh, tid 100114) #0 0xc0aa764e at __lockmgr_args+0x108e #1 0xc0d3f63d at ffs_lock+0xad #2 0xc0f86284 at VOP_LOCK1_APV+0x104 #3 0xc0b8325a at _vn_lock+0xca #4 0xc0b70957 at vget+0x77 #5 0xc0b5bc08 at cache_lookup+0x5a8 #6 0xc0b5cd3c at vfs_cache_lookup+0xbc #7 0xc0f82cf4 at VOP_LOOKUP_APV+0x124 #8 0xc0b65c88 at lookup+0x538 #9 0xc0b6539d at namei+0x51d #10 0xc0a8b75d at kern_execve+0x4fd #11 0xc0a8b043 at sys_execve+0x53 #12 0xc0f6027d at syscall+0x2ed #13 0xc0f484e1 at Xint0x80_syscall+0x21 ino 97293, on dev ada0s1f db:0:lockedvnods> show mount 0xc8a442ec /dev/ad4s1a on / (ufs) 0xc8a445d8 devfs on /dev (devfs) 0xc8e16000 /dev/ad4s1f on /home (ufs) 0xc8e158c4 /dev/ad4s1d on /usr (ufs) 0xc8e258c4 /dev/ad4s1e on /var (ufs) 0xc8e255d8 procfs on /proc (procfs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 960 957 811 0 D+ ufs 0xc9adba0c mmap6 959 957 811 0 D+ ufs 0xc9adba0c mmap6 958 957 811 0 R+ CPU 2 mmap6 957 932 811 0 S+ wait 0xc89182e8 mmap6 932 923 811 0 S+ wait 0xc8918000 mmap6 930 923 811 0 D+ vnread 0xe40d272c sh 923 811 811 0 S+ wait 0xc93775d0 sh 811 807 811 0 S+ wait 0xc8b052e8 sh 807 804 807 0 S+ wait 0xc89188b8 bash 804 803 804 0 S+ pause 0xc8b0591c csh 803 797 803 1001 S+ wait 0xc8a86ba0 su 797 791 797 1001 S+ wait 0xc8aff000 bash 791 790 791 1001 Ss+ wait 0xc8aff2e8 bash 790 784 784 1001 S select 0xc8adaa64 sshd 784 730 784 0 Ss select 0xc8a803e4 sshd 767 766 18 0 DL+ physrd 0xe40d28c8 fsck_ufs 766 752 18 0 S+ wait 0xc9378ba0 fsck 752 751 18 0 S+ wait 0xc89185d0 sh 751 743 18 0 S+ pause 0xc9379634 sh 743 18 18 0 S+ wait 0xc8b68000 sh 741 1 741 0 Ss nanslp 0xc1306980 cron 736 1 736 25 Ss pause 0xc8b04634 sendmail 733 1 733 0 Ss select 0xc81a1c64 sendmail 730 1 730 0 Ss select 0xc8a805e4 sshd 698 1 698 0 Ss select 0xc8ac7aa4 moused 690 1 689 0 S nanslp 0xc1306981 smartd 688 676 676 0 S select 0xc8a80a64 winbindd 687 674 674 0 S select 0xc8a80764 smbd 676 1 676 0 Ss select 0xc8a80f24 winbindd 674 1 674 0 Ss select 0xc8a81ce4 smbd 672 1 672 0 Ss select 0xc8ac7ae4 nmbd 649 1 649 0 Ss select 0xc8ac78a4 powerd 646 1 646 0 Ss select 0xc8ac76e4 ntpd 589 585 585 0 S (threaded) nfsd 100095 S rpcsvc 0xc8889c50 nfsd: service 100094 S rpcsvc 0xc8889c90 nfsd: service 100093 S rpcsvc 0xc89b4f50 nfsd: service 100092 S rpcsvc 0xc89b50d0 nfsd: master 585 1 585 0 Ss select 0xc8a80b64 nfsd 579 1 579 0 Ss select 0xc8ac7b64 mountd 572 568 568 0 S select 0xc8ac7be4 nfsuserd 571 568 568 0 S select 0xc8a80d64 nfsuserd 570 568 568 0 S select 0xc8ac7c24 nfsuserd 569 568 568 0 S select 0xc8a80da4 nfsuserd 568 1 568 0 Ss pause 0xc8b68634 nfsuserd 532 1 532 0 Ss select 0xc8ac7d24 rpcbind 517 1 517 0 Ss select 0xc81a1ca4 syslogd 414 1 414 0 Ss select 0xc8adac64 devd 18 1 18 0 Ss+ wait 0xc8a868b8 sh 17 0 0 0 DL sdflush 0xc148378c [softdepflush] 16 0 0 0 DL vlruwt 0xc89198b8 [vnlru] 9 0 0 0 DL syncer 0xc147f4e0 [syncer] 8 0 0 0 DL psleep 0xc147f004 [bufdaemon] 7 0 0 0 DL pgzero 0xc14843a4 [pagezero] 6 0 0 0 DL psleep 0xc14840c8 [vmdaemon] 5 0 0 0 DL psleep 0xc14dc584 [pagedaemon] 4 0 0 0 DL ccb_scan 0xc12d4120 [xpt_thrd] 3 0 0 0 DL waiting_ 0xc14d8f5c [sctp_iterator] 2 0 0 0 DL - 0xc84ce83c [fdc0] 15 0 0 0 DL (threaded) [usb] 100058 D - 0xc8533d34 [usbus5] 100057 D - 0xc8533d04 [usbus5] 100056 D - 0xc8533cd4 [usbus5] 100055 D - 0xc8533ca4 [usbus5] 100053 D - 0xc8525b5c [usbus4] 100052 D - 0xc8525b2c [usbus4] 100051 D - 0xc8525afc [usbus4] 100050 D - 0xc8525acc [usbus4] 100049 D - 0xc851fb5c [usbus3] 100048 D - 0xc851fb2c [usbus3] 100047 D - 0xc851fafc [usbus3] 100046 D - 0xc851facc [usbus3] 100045 D - 0xc8517b5c [usbus2] 100044 D - 0xc8517b2c [usbus2] 100043 D - 0xc8517afc [usbus2] 100042 D - 0xc8517acc [usbus2] 100040 D - 0xc850cb5c [usbus1] 100039 D - 0xc850cb2c [usbus1] 100038 D - 0xc850cafc [usbus1] 100037 D - 0xc850cacc [usbus1] 100035 D - 0xc8509b5c [usbus0] 100034 D - 0xc8509b2c [usbus0] 100033 D - 0xc8509afc [usbus0] 100032 D - 0xc8509acc [usbus0] 14 0 0 0 DL - 0xc12ebe30 [rand_harvestq] 13 0 0 0 DL (threaded) [geom] 100015 D - 0xc14d50cc [g_down] 100014 D - 0xc14d50c8 [g_up] 100013 D - 0xc14d50c4 [g_event] 12 0 0 0 WL (threaded) [intr] 100063 I [irq12: psm0] 100062 I [irq1: atkbd0] 100060 I [swi0: uart] 100059 I [irq14: ata0] 100054 I [irq19: ehci0] 100041 I [irq18: ohci2 ohci4] 100036 I [irq17: ohci1 ohci3] 100031 I [irq16: hdac1 ohci0] 100030 I [irq22: ahci0] 100029 I [irq257: re0] 100028 I [irq256: hdac0] 100027 I [swi6: Giant taskq] 100026 I [swi6: task queue] 100021 I [swi2: cambio] 100020 I [swi5: fast taskq] 100012 I [swi1: netisr 0] 100011 I [swi4: clock] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 I [swi4: clock] 100007 I [swi3: vm] 11 0 0 0 RL (threaded) [idle] 100006 Run CPU 3 [idle: cpu3] 100005 CanRun [idle: cpu2] 100004 Run CPU 1 [idle: cpu1] 100003 Run CPU 0 [idle: cpu0] 1 0 1 0 SLs wait 0xc82eb2e8 [init] 10 0 0 0 DL audit_wo 0xc14dae38 [audit] 0 0 0 0 DLs (threaded) [kernel] 100065 D - 0xc130587d [deadlkres] 100064 D - 0xc83ad080 [mca taskq] 100025 D - 0xc83b0a80 [acpi_task_2] 100024 D - 0xc83b0a80 [acpi_task_1] 100023 D - 0xc83b0a80 [acpi_task_0] 100022 D - 0xc83b0b00 [kqueue taskq] 100019 D - 0xc83b0c80 [ffs_trim taskq] 100018 D - 0xc83b0d00 [thread taskq] 100016 D - 0xc83b1000 [firmware taskq] 100000 D swapin 0xc14d5144 [swapper] db:0:ps> allt Tracing command mmap6 pid 960 tid 100141 td 0xc9395000 sched_switch(c9395000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf85335d4 mi_switch(104,0,c1193e95,1f5,162,...) at mi_switch+0x1c9/frame 0xf8533608 sleepq_switch(c9395000,0,c1193e95,26b,60,...) at sleepq_switch+0x1c5/frame 0xf853363c sleepq_wait(c9adba0c,60,c117d0c6,4,0,...) at sleepq_wait+0x48/frame 0xf8533660 sleeplk(c9adba78,c117d0c6,60,33,0,...) at sleeplk+0x126/frame 0xf85336a8 __lockmgr_args(c9adba0c,80100,c9adba78,0,0,...) at __lockmgr_args+0xa3b/frame 0xf853377c ffs_lock(f8533800,c81831e0,c8184d18,c81831e0,c8184d18,...) at ffs_lock+0xad/frame 0xf85337bc VOP_LOCK1_APV(c12bc48c,f8533800,0,f8533874,c12d0978,...) at VOP_LOCK1_APV+0x104/frame 0xf85337e8 _vn_lock(c9adb9d8,80100,c119f509,833,2a1,...) at _vn_lock+0xca/frame 0xf8533828 vget(c9adb9d8,80100,c9395000,29d,c12cea70,...) at vget+0x77/frame 0xf8533860 cache_lookup(c8b34708,f8533bb8,f8533bcc,0,0,...) at cache_lookup+0x5a8/frame 0xf85338c0 vfs_cache_lookup(f8533978,c11efedf,c11c212d,c119e91f,c12cea70,...) at vfs_cache_lookup+0xbc/frame 0xf8533908 VOP_LOOKUP_APV(c12bc48c,f8533978,f8533bcc,20c,f8533980,...) at VOP_LOOKUP_APV+0x124/frame 0xf8533938 lookup(f8533b70,c119e91f,10e,cf,f8533b58,...) at lookup+0x538/frame 0xf85339a0 namei(f8533b70,c1ba0300,f8533a78,c0aafeab,c1ba0300,...) at namei+0x51d/frame 0xf8533a38 vn_open_cred(f8533b70,f8533bfc,9e8,0,c8ad8980,c8b58a80) at vn_open_cred+0x24d/frame 0xf8533b08 vn_open(f8533b70,f8533bfc,9e8,c8b58a80,bfbfdc4b,...) at vn_open+0x3b/frame 0xf8533b28 kern_openat(c9395000,ffffff9c,bfbfdc4b,0,2,bfbfd9f8) at kern_openat+0x315/frame 0xf8533c20 sys_open(c9395000,f8533cc8,0,0,0,...) at sys_open+0x38/frame 0xf8533c40 syscall(f8533d08) at syscall+0x2ed/frame 0xf8533cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8533cfc --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x28188247, esp = 0xbfbfd93c, ebp = 0xbfbfda38 --- Tracing command mmap6 pid 959 tid 100140 td 0xc9395310 sched_switch(c9395310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf85305d4 mi_switch(104,0,c1193e95,1f5,162,...) at mi_switch+0x1c9/frame 0xf8530608 sleepq_switch(c9395310,0,c1193e95,26b,60,...) at sleepq_switch+0x1c5/frame 0xf853063c sleepq_wait(c9adba0c,60,c117d0c6,4,0,...) at sleepq_wait+0x48/frame 0xf8530660 sleeplk(c9adba78,c117d0c6,60,33,0,...) at sleeplk+0x126/frame 0xf85306a8 __lockmgr_args(c9adba0c,80100,c9adba78,0,0,...) at __lockmgr_args+0xa3b/frame 0xf853077c ffs_lock(f8530800,c81831e0,c8184d18,c81831e0,c8184d18,...) at ffs_lock+0xad/frame 0xf85307bc VOP_LOCK1_APV(c12bc48c,f8530800,0,f8530874,c12d0978,...) at VOP_LOCK1_APV+0x104/frame 0xf85307e8 _vn_lock(c9adb9d8,80100,c119f509,833,2a1,...) at _vn_lock+0xca/frame 0xf8530828 vget(c9adb9d8,80100,c9395310,29d,c12cea70,...) at vget+0x77/frame 0xf8530860 cache_lookup(c8b34708,f8530bb8,f8530bcc,0,0,...) at cache_lookup+0x5a8/frame 0xf85308c0 vfs_cache_lookup(f8530978,c11efedf,c11c212d,c119e91f,c12cea70,...) at vfs_cache_lookup+0xbc/frame 0xf8530908 VOP_LOOKUP_APV(c12bc48c,f8530978,f8530bcc,20c,f8530980,...) at VOP_LOOKUP_APV+0x124/frame 0xf8530938 lookup(f8530b70,c119e91f,10e,cf,f8530b58,...) at lookup+0x538/frame 0xf85309a0 namei(f8530b70,c1ba0300,f8530a78,c0aafeab,c1ba0300,...) at namei+0x51d/frame 0xf8530a38 vn_open_cred(f8530b70,f8530bfc,9e8,0,c8ad8980,c8b59f18) at vn_open_cred+0x24d/frame 0xf8530b08 vn_open(f8530b70,f8530bfc,9e8,c8b59f18,bfbfdc4b,...) at vn_open+0x3b/frame 0xf8530b28 kern_openat(c9395310,ffffff9c,bfbfdc4b,0,2,bfbfd9f8) at kern_openat+0x315/frame 0xf8530c20 sys_open(c9395310,f8530cc8,0,0,0,...) at sys_open+0x38/frame 0xf8530c40 syscall(f8530d08) at syscall+0x2ed/frame 0xf8530cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8530cfc --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x28188247, esp = 0xbfbfd93c, ebp = 0xbfbfda38 --- Tracing command mmap6 pid 958 tid 100135 td 0xc97b9c40 kdb_enter(c118dc95,c118dc95,c11cd595,f8520848,f8520818,...) at kdb_enter+0x3d/frame 0xf85207d8 vpanic(c13055f2,100,c11cd595,f8520848,f8520848,...) at vpanic+0x143/frame 0xf8520818 kassert_panic(c11cd595,c33327e8,0,1) at kassert_panic+0xea/frame 0xf852083c vm_pageout_flush(f8520904,1,3,0,f852096c,f8520a2c) at vm_pageout_flush+0x118/frame 0xf85208e4 vm_object_page_collect_flush(c9392ccc,c33327e8,3,3,f8520a30,...) at vm_object_page_collect_flush+0x27d/frame 0xf85209b0 vm_object_page_clean(c9392ccc,0,0,3000,0,...) at vm_object_page_clean+0x42b/frame 0xf8520a98 vm_object_sync(c9392ccc,0,0,3000,1,...) at vm_object_sync+0x403/frame 0xf8520b68 vm_map_sync(c1b83e10,281d2000,281d5000,1,1,...) at vm_map_sync+0x570/frame 0xf8520c1c sys_msync(c97b9c40,f8520cc8,0,0,0,...) at sys_msync+0x69/frame 0xf8520c40 syscall(f8520d08) at syscall+0x2ed/frame 0xf8520cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8520cfc --- syscall (65, FreeBSD ELF32, sys_msync), eip = 0x280c70bb, esp = 0xbfbfd93c, ebp = 0xbfbfda38 --- Tracing command mmap6 pid 957 tid 100127 td 0xc9396310 sched_switch(c9396310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84fe98c mi_switch(104,0,c1193e95,1f5,c1193e95,...) at mi_switch+0x1c9/frame 0xf84fe9c0 sleepq_switch(c9396310,0,c1193e95,1ab,f84fea38,...) at sleepq_switch+0x1c5/frame 0xf84fe9f4 sleepq_catch_signals(0,c1193e95,162,9f0,c89182e8,...) at sleepq_catch_signals+0x36c/frame 0xf84fea3c sleepq_wait_sig(c89182e8,6c,c1197b21,100,0,...) at sleepq_wait_sig+0x14/frame 0xf84fea60 _sleep(c89182e8,c891837c,16c,c1197b21,0,...) at _sleep+0x364/frame 0xf84feabc kern_wait6(c9396310,7,0,0,f84feb4c,...) at kern_wait6+0x45c/frame 0xf84feb20 sys_wait4(c9396310,f84fecc8,c0f66c70,c1825c90,0,...) at sys_wait4+0x94/frame 0xf84fec40 syscall(f84fed08) at syscall+0x2ed/frame 0xf84fecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84fecfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x280e07b3, esp = 0xbfbfda30, ebp = 0xbfbfda48 --- Tracing command mmap6 pid 932 tid 100133 td 0xc9396000 sched_switch(c9396000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf851a98c mi_switch(104,0,c1193e95,1f5,c1193e95,...) at mi_switch+0x1c9/frame 0xf851a9c0 sleepq_switch(c9396000,0,c1193e95,1ab,f851aa38,...) at sleepq_switch+0x1c5/frame 0xf851a9f4 sleepq_catch_signals(0,c1193e95,162,c00,c8918000,...) at sleepq_catch_signals+0x36c/frame 0xf851aa3c sleepq_wait_sig(c8918000,6c,c1197b21,100,0,...) at sleepq_wait_sig+0x14/frame 0xf851aa60 _sleep(c8918000,c8918094,16c,c1197b21,0,...) at _sleep+0x364/frame 0xf851aabc kern_wait6(c9396000,7,0,0,f851ab4c,...) at kern_wait6+0x45c/frame 0xf851ab20 sys_wait4(c9396000,f851acc8,c11e97be,d6,0,...) at sys_wait4+0x94/frame 0xf851ac40 syscall(f851ad08) at syscall+0x2ed/frame 0xf851acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf851acfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x280e07b3, esp = 0xbfbfda4c, ebp = 0xbfbfda64 --- Tracing command sh pid 930 tid 100114 td 0xc8a94c40 sched_switch(c8a94c40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84d36cc mi_switch(104,0,c1193e95,1f5,162,...) at mi_switch+0x1c9/frame 0xf84d3700 sleepq_switch(c8a94c40,0,c1193e95,26b,e40d272c,...) at sleepq_switch+0x1c5/frame 0xf84d3734 sleepq_wait(e40d272c,54,c11ced1c,0,0,...) at sleepq_wait+0x48/frame 0xf84d3758 _sleep(e40d272c,c819c5ec,54,c11ced1c,0,...) at _sleep+0x385/frame 0xf84d37b4 bwait(e40d272c,54,c11ced1c,35a,f84d3838,...) at bwait+0x9f/frame 0xf84d37f0 vnode_pager_generic_getpages(c95da438,f84d398c,9000,0,246,...) at vnode_pager_generic_getpages+0x149e/frame 0xf84d38d8 ffs_getpages(f84d3948,c11f0b97,c11ceb75,2a1,f84d3944,...) at ffs_getpages+0x80/frame 0xf84d3900 VOP_GETPAGES_APV(c12bc48c,f84d3948,2a1,f84d3970,c12d14d0,...) at VOP_GETPAGES_APV+0x12a/frame 0xf84d3930 vnode_pager_getpages(c9c6b000,f84d398c,9,0,c9c6b010,...) at vnode_pager_getpages+0x76/frame 0xf84d3970 exec_map_first_page(f84d3ad0,f84d3bc0,4200844,1,ed841000,...) at exec_map_first_page+0x16c/frame 0xf84d39d8 kern_execve(c8a94c40,f84d3c08,0,28893324,2889333c,...) at kern_execve+0x5bc/frame 0xf84d3be8 sys_execve(c8a94c40,f84d3cc8,f84d3c9c,c0f67317,0,...) at sys_execve+0x53/frame 0xf84d3c40 syscall(f84d3d08) at syscall+0x2ed/frame 0xf84d3cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84d3cfc --- syscall (59, FreeBSD ELF32, sys_execve), eip = 0x28159793, esp = 0xbfbfd634, ebp = 0xbfbfd764 --- Tracing command sh pid 923 tid 100124 td 0xc8b76c40 sched_switch(c8b76c40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84f498c mi_switch(104,0,c1193e95,1f5,c1193e95,...) at mi_switch+0x1c9/frame 0xf84f49c0 sleepq_switch(c8b76c40,0,c1193e95,1ab,f84f4a38,...) at sleepq_switch+0x1c5/frame 0xf84f49f4 sleepq_catch_signals(0,c1193e95,162,f78,c93775d0,...) at sleepq_catch_signals+0x36c/frame 0xf84f4a3c sleepq_wait_sig(c93775d0,6c,c1197b21,100,0,...) at sleepq_wait_sig+0x14/frame 0xf84f4a60 _sleep(c93775d0,c9377664,16c,c1197b21,0,...) at _sleep+0x364/frame 0xf84f4abc kern_wait6(c8b76c40,7,0,0,f84f4b4c,...) at kern_wait6+0x45c/frame 0xf84f4b20 sys_wait4(c8b76c40,f84f4cc8,c11e97be,e9,0,...) at sys_wait4+0x94/frame 0xf84f4c40 syscall(f84f4d08) at syscall+0x2ed/frame 0xf84f4cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84f4cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281597b3, esp = 0xbfbfd800, ebp = 0xbfbfd818 --- Tracing command sh pid 811 tid 100076 td 0xc8b13930 sched_switch(c8b13930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed72398c mi_switch(104,0,c1193e95,1f5,c1193e95,...) at mi_switch+0x1c9/frame 0xed7239c0 sleepq_switch(c8b13930,0,c1193e95,1ab,ed723a38,...) at sleepq_switch+0x1c5/frame 0xed7239f4 sleepq_catch_signals(0,c1193e95,162,1170,c8b052e8,...) at sleepq_catch_signals+0x36c/frame 0xed723a3c sleepq_wait_sig(c8b052e8,6c,c1197b21,100,0,...) at sleepq_wait_sig+0x14/frame 0xed723a60 _sleep(c8b052e8,c8b0537c,16c,c1197b21,0,...) at _sleep+0x364/frame 0xed723abc kern_wait6(c8b13930,7,0,0,ed723b4c,...) at kern_wait6+0x45c/frame 0xed723b20 sys_wait4(c8b13930,ed723cc8,c11e97be,e9,0,...) at sys_wait4+0x94/frame 0xed723c40 syscall(ed723d08) at syscall+0x2ed/frame 0xed723cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed723cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281597b3, esp = 0xbfbfd678, ebp = 0xbfbfd690 --- Tracing command bash pid 807 tid 100108 td 0xc884b000 sched_switch(c884b000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84c198c mi_switch(104,0,c1193e95,1f5,c1193e95,...) at mi_switch+0x1c9/frame 0xf84c19c0 sleepq_switch(c884b000,0,c1193e95,1ab,f84c1a38,...) at sleepq_switch+0x1c5/frame 0xf84c19f4 sleepq_catch_signals(0,c1193e95,162,480,c89188b8,...) at sleepq_catch_signals+0x36c/frame 0xf84c1a3c sleepq_wait_sig(c89188b8,6c,c1197b21,100,0,...) at sleepq_wait_sig+0x14/frame 0xf84c1a60 _sleep(c89188b8,c891894c,16c,c1197b21,0,...) at _sleep+0x364/frame 0xf84c1abc kern_wait6(c884b000,7,0,0,f84c1b4c,...) at kern_wait6+0x45c/frame 0xf84c1b20 sys_wait4(c884b000,f84c1cc8,14,c11902c9,7bb,...) at sys_wait4+0x94/frame 0xf84c1c40 syscall(f84c1d08) at syscall+0x2ed/frame 0xf84c1cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84c1cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282b87b3, esp = 0xbfbfd7b0, ebp = 0xbfbfd7c8 --- Tracing command csh pid 804 tid 100104 td 0xc8b69000 sched_switch(c8b69000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84aeaa0 mi_switch(104,0,c1193e95,1f5,8,...) at mi_switch+0x1c9/frame 0xf84aead4 sleepq_switch(c8b69000,0,c1193e95,1ab,f84aeb4c,...) at sleepq_switch+0x1c5/frame 0xf84aeb08 sleepq_catch_signals(0,c1193e95,162,678,c8b0591c,...) at sleepq_catch_signals+0x36c/frame 0xf84aeb50 sleepq_wait_sig(c8b0591c,74,c0fb9ff4,100,0,...) at sleepq_wait_sig+0x14/frame 0xf84aeb74 _sleep(c8b0591c,c8b0594c,174,c0fb9ff4,0,...) at _sleep+0x364/frame 0xf84aebd0 kern_sigsuspend(c8b69000,0,0,0,0,...) at kern_sigsuspend+0xfb/frame 0xf84aec10 sys_sigsuspend(c8b69000,f84aecc8,c11e97be,e9,0,...) at sys_sigsuspend+0x58/frame 0xf84aec40 syscall(f84aed08) at syscall+0x2ed/frame 0xf84aecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84aecfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x281728fb, esp = 0xbfbfd0b4, ebp = 0xbfbfd11c --- Tracing command su pid 803 tid 100129 td 0xc97ba930 sched_switch(c97ba930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf850498c mi_switch(104,0,c1193e95,1f5,c1193e95,...) at mi_switch+0x1c9/frame 0xf85049c0 sleepq_switch(c97ba930,0,c1193e95,1ab,f8504a38,...) at sleepq_switch+0x1c5/frame 0xf85049f4 sleepq_catch_signals(0,c1193e95,162,1308,c8a86ba0,...) at sleepq_catch_signals+0x36c/frame 0xf8504a3c sleepq_wait_sig(c8a86ba0,6c,c1197b21,100,0,...) at sleepq_wait_sig+0x14/frame 0xf8504a60 _sleep(c8a86ba0,c8a86c34,16c,c1197b21,0,...) at _sleep+0x364/frame 0xf8504abc kern_wait6(c97ba930,0,324,0,f8504b4c,...) at kern_wait6+0x45c/frame 0xf8504b20 sys_wait4(c97ba930,f8504cc8,c0f66c70,c1825c90,0,...) at sys_wait4+0x94/frame 0xf8504c40 syscall(f8504d08) at syscall+0x2ed/frame 0xf8504cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8504cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281187b3, esp = 0xbfbfd5c8, ebp = 0xbfbfd5e0 --- Tracing command bash pid 797 tid 100128 td 0xc97bac40 sched_switch(c97bac40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf850198c mi_switch(104,0,c1193e95,1f5,c1193e95,...) at mi_switch+0x1c9/frame 0xf85019c0 sleepq_switch(c97bac40,0,c1193e95,1ab,f8501a38,...) at sleepq_switch+0x1c5/frame 0xf85019f4 sleepq_catch_signals(0,c1193e95,162,1680,c8aff000,...) at sleepq_catch_signals+0x36c/frame 0xf8501a3c sleepq_wait_sig(c8aff000,6c,c1197b21,100,0,...) at sleepq_wait_sig+0x14/frame 0xf8501a60 _sleep(c8aff000,c8aff094,16c,c1197b21,0,...) at _sleep+0x364/frame 0xf8501abc kern_wait6(c97bac40,7,0,0,f8501b4c,...) at kern_wait6+0x45c/frame 0xf8501b20 sys_wait4(c97bac40,f8501cc8,c0f66c70,e433dc90,0,...) at sys_wait4+0x94/frame 0xf8501c40 syscall(f8501d08) at syscall+0x2ed/frame 0xf8501cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8501cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282b87b3, esp = 0xbfbfd7d0, ebp = 0xbfbfd7e8 --- Tracing command bash pid 791 tid 100126 td 0xc97bb000 sched_switch(c97bb000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84fa98c mi_switch(104,0,c1193e95,1f5,c1193e95,...) at mi_switch+0x1c9/frame 0xf84fa9c0 sleepq_switch(c97bb000,0,c1193e95,1ab,f84faa38,...) at sleepq_switch+0x1c5/frame 0xf84fa9f4 sleepq_catch_signals(0,c1193e95,162,270,c8aff2e8,...) at sleepq_catch_signals+0x36c/frame 0xf84faa3c sleepq_wait_sig(c8aff2e8,6c,c1197b21,100,0,...) at sleepq_wait_sig+0x14/frame 0xf84faa60 _sleep(c8aff2e8,c8aff37c,16c,c1197b21,0,...) at _sleep+0x364/frame 0xf84faabc kern_wait6(c97bb000,7,0,0,f84fab4c,...) at kern_wait6+0x45c/frame 0xf84fab20 sys_wait4(c97bb000,f84facc8,c0f66c70,e4340c90,0,...) at sys_wait4+0x94/frame 0xf84fac40 syscall(f84fad08) at syscall+0x2ed/frame 0xf84facfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84facfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282b87b3, esp = 0xbfbfd9b0, ebp = 0xbfbfd9c8 --- Tracing command sshd pid 790 tid 100125 td 0xc8a94310 sched_switch(c8a94310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84f7904 mi_switch(104,0,c1193e95,1f5,200046,...) at mi_switch+0x1c9/frame 0xf84f7938 sleepq_switch(c8a94310,0,c1193e95,1ab,c8adaa60,...) at sleepq_switch+0x1c5/frame 0xf84f796c sleepq_catch_signals(f84f79d8,c0aaf809,c8adaa60,0,0,...) at sleepq_catch_signals+0x36c/frame 0xf84f79b4 sleepq_wait_sig(c8adaa64,0,f84f7a08,101,0,...) at sleepq_wait_sig+0x14/frame 0xf84f79d8 _cv_wait_sig(c8adaa64,c8adaa50,c11972a3,6d8,1b2,...) at _cv_wait_sig+0x200/frame 0xf84f7a1c seltdwait(ffffffff,0,0,c8a94310,f84f7bc8,...) at seltdwait+0x90/frame 0xf84f7a50 kern_select(c8a94310,c,28c0c1c8,28c0c1d0,0,...) at kern_select+0x883/frame 0xf84f7bf8 sys_select(c8a94310,f84f7cc8,c0f66c70,e4340c90,0,...) at sys_select+0x69/frame 0xf84f7c40 syscall(f84f7d08) at syscall+0x2ed/frame 0xf84f7cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84f7cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2853c137, esp = 0xbfbfd374, ebp = 0xbfbfd3c0 --- Tracing command sshd pid 784 tid 100123 td 0xc937a000 sched_switch(c937a000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84f196c mi_switch(104,0,c1193e95,1f5,200046,...) at mi_switch+0x1c9/frame 0xf84f19a0 sleepq_switch(c937a000,0,c1193e95,1ab,c8a803e0,...) at sleepq_switch+0x1c5/frame 0xf84f19d4 sleepq_catch_signals(f84f1a40,c0aaf809,c8a803e0,0,0,...) at sleepq_catch_signals+0x36c/frame 0xf84f1a1c sleepq_wait_sig(c8a803e4,0,f84f1a70,101,0,...) at sleepq_wait_sig+0x14/frame 0xf84f1a40 _cv_wait_sig(c8a803e4,c8a803d0,c11972a3,6d8,5d5,...) at _cv_wait_sig+0x200/frame 0xf84f1a84 seltdwait(ffffffff,0,0,c937a000,0,...) at seltdwait+0x90/frame 0xf84f1ab8 sys_poll(c937a000,f84f1cc8,f84f1c9c,c0f67317,0,...) at sys_poll+0x46d/frame 0xf84f1c40 syscall(f84f1d08) at syscall+0x2ed/frame 0xf84f1cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84f1cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284d218f, esp = 0xbfbfd3bc, ebp = 0xbfbfd408 --- Tracing command fsck_ufs pid 767 tid 100117 td 0xc937ac40 sched_switch(c937ac40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84dc9e8 mi_switch(104,0,c1193e95,1f5,162,...) at mi_switch+0x1c9/frame 0xf84dca1c sleepq_switch(c937ac40,0,c1193e95,26b,e40d28c8,...) at sleepq_switch+0x1c5/frame 0xf84dca50 sleepq_wait(e40d28c8,5c,c118c141,0,0,...) at sleepq_wait+0x48/frame 0xf84dca74 _sleep(e40d28c8,c819c240,5c,c118c141,0,...) at _sleep+0x385/frame 0xf84dcad0 bwait(e40d28c8,5c,c118c141,2c,ebe0c000,...) at bwait+0x9f/frame 0xf84dcb0c physio(c8a12100,f84dcc10,0,10000,0,...) at physio+0x328/frame 0xf84dcb40 devfs_read_f(c8b5d0a8,f84dcc10,c8ac6100,0,c937ac40,...) at devfs_read_f+0x84/frame 0xf84dcb74 dofileread(c8b5d0a8,f84dcc10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf84dcba8 kern_readv(c937ac40,3,f84dcc10,0,28953000,...) at kern_readv+0x96/frame 0xf84dcbf0 sys_read(c937ac40,f84dccc8,c0f66c70,e4343c90,0,...) at sys_read+0x5c/frame 0xf84dcc40 syscall(f84dcd08) at syscall+0x2ed/frame 0xf84dccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84dccfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281af177, esp = 0xbfbfd964, ebp = 0xbfbfd9b8 --- Tracing command fsck pid 766 tid 100113 td 0xc937b310 sched_switch(c937b310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84d098c mi_switch(104,0,c1193e95,1f5,c1193e95,...) at mi_switch+0x1c9/frame 0xf84d09c0 sleepq_switch(c937b310,0,c1193e95,1ab,f84d0a38,...) at sleepq_switch+0x1c5/frame 0xf84d09f4 sleepq_catch_signals(0,c1193e95,162,408,c9378ba0,...) at sleepq_catch_signals+0x36c/frame 0xf84d0a3c sleepq_wait_sig(c9378ba0,6c,c1197b21,100,0,...) at sleepq_wait_sig+0x14/frame 0xf84d0a60 _sleep(c9378ba0,c9378c34,16c,c1197b21,0,...) at _sleep+0x364/frame 0xf84d0abc kern_wait6(c937b310,0,2ff,0,f84d0b4c,...) at kern_wait6+0x45c/frame 0xf84d0b20 sys_wait4(c937b310,f84d0cc8,c11e97be,e9,0,...) at sys_wait4+0x94/frame 0xf84d0c40 syscall(f84d0d08) at syscall+0x2ed/frame 0xf84d0cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84d0cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x280e27b3, esp = 0xbfbfd480, ebp = 0xbfbfd498 --- Tracing command sh pid 752 tid 100111 td 0xc9396620 sched_switch(c9396620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84ca98c mi_switch(104,0,c1193e95,1f5,c1193e95,...) at mi_switch+0x1c9/frame 0xf84ca9c0 sleepq_switch(c9396620,0,c1193e95,1ab,f84caa38,...) at sleepq_switch+0x1c5/frame 0xf84ca9f4 sleepq_catch_signals(0,c1193e95,162,7f8,c89185d0,...) at sleepq_catch_signals+0x36c/frame 0xf84caa3c sleepq_wait_sig(c89185d0,6c,c1197b21,100,0,...) at sleepq_wait_sig+0x14/frame 0xf84caa60 _sleep(c89185d0,c8918664,16c,c1197b21,0,...) at _sleep+0x364/frame 0xf84caabc kern_wait6(c9396620,7,0,0,f84cab4c,...) at kern_wait6+0x45c/frame 0xf84cab20 sys_wait4(c9396620,f84cacc8,c11e97be,e9,0,...) at sys_wait4+0x94/frame 0xf84cac40 syscall(f84cad08) at syscall+0x2ed/frame 0xf84cacfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84cacfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281597b3, esp = 0xbfbfdb08, ebp = 0xbfbfdb20 --- Tracing command sh pid 751 tid 100106 td 0xc937bc40 sched_switch(c937bc40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84bbaa0 mi_switch(104,0,c1193e95,1f5,8,...) at mi_switch+0x1c9/frame 0xf84bbad4 sleepq_switch(c937bc40,0,c1193e95,1ab,f84bbb4c,...) at sleepq_switch+0x1c5/frame 0xf84bbb08 sleepq_catch_signals(0,c1193e95,162,f30,c9379634,...) at sleepq_catch_signals+0x36c/frame 0xf84bbb50 sleepq_wait_sig(c9379634,74,c0fb9ff4,100,0,...) at sleepq_wait_sig+0x14/frame 0xf84bbb74 _sleep(c9379634,c9379664,174,c0fb9ff4,0,...) at _sleep+0x364/frame 0xf84bbbd0 kern_sigsuspend(c937bc40,0,0,0,0,...) at kern_sigsuspend+0xfb/frame 0xf84bbc10 sys_sigsuspend(c937bc40,f84bbcc8,c11e97be,e9,c937bc40,...) at sys_sigsuspend+0x58/frame 0xf84bbc40 syscall(f84bbd08) at syscall+0x2ed/frame 0xf84bbcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84bbcfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2813f8fb, esp = 0xbfbfcccc, ebp = 0xbfbfcd5c --- Tracing command sh pid 743 tid 100083 td 0xc8b75620 sched_switch(c8b75620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed75998c mi_switch(104,0,c1193e95,1f5,c1193e95,...) at mi_switch+0x1c9/frame 0xed7599c0 sleepq_switch(c8b75620,0,c1193e95,1ab,ed759a38,...) at sleepq_switch+0x1c5/frame 0xed7599f4 sleepq_catch_signals(0,c1193e95,162,c00,c8b68000,...) at sleepq_catch_signals+0x36c/frame 0xed759a3c sleepq_wait_sig(c8b68000,6c,c1197b21,100,0,...) at sleepq_wait_sig+0x14/frame 0xed759a60 _sleep(c8b68000,c8b68094,16c,c1197b21,0,...) at _sleep+0x364/frame 0xed759abc kern_wait6(c8b75620,7,0,0,ed759b4c,...) at kern_wait6+0x45c/frame 0xed759b20 sys_wait4(c8b75620,ed759cc8,c0f66c70,e4343c90,0,...) at sys_wait4+0x94/frame 0xed759c40 syscall(ed759d08) at syscall+0x2ed/frame 0xed759cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed759cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281597b3, esp = 0xbfbfce20, ebp = 0xbfbfce38 --- Tracing command cron pid 741 tid 100110 td 0xc8b06000 sched_switch(c8b06000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84c7a64 mi_switch(104,0,c1193e95,1f5,c0b0a9c0,...) at mi_switch+0x1c9/frame 0xf84c7a98 sleepq_switch(c8b06000,0,c1193e95,1ab,8,...) at sleepq_switch+0x1c5/frame 0xf84c7acc sleepq_catch_signals(c0b0a9c0,c8b06000,0,201,0,...) at sleepq_catch_signals+0x36c/frame 0xf84c7b14 sleepq_timedwait_sig(c1306980,6c,45,f4cddce5,2,...) at sleepq_timedwait_sig+0x14/frame 0xf84c7b3c _sleep(c1306980,0,16c,c118f3a6,658cac2,...) at _sleep+0x33c/frame 0xf84c7b98 kern_nanosleep(bfbfde28,f84c7c18,f84c7c20,f84c7cc8,2f,...) at kern_nanosleep+0x158/frame 0xf84c7c00 sys_nanosleep(c8b06000,f84c7cc8,c0f66c70,c1825c90,0,...) at sys_nanosleep+0x6b/frame 0xf84c7c40 syscall(f84c7d08) at syscall+0x2ed/frame 0xf84c7cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84c7cfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x281913b3, esp = 0xbfbfdcb4, ebp = 0xbfbfde44 --- Tracing command sendmail pid 736 tid 100109 td 0xc8b06310 sched_switch(c8b06310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84c4aa0 mi_switch(104,0,c1193e95,1f5,8,...) at mi_switch+0x1c9/frame 0xf84c4ad4 sleepq_switch(c8b06310,0,c1193e95,1ab,f84c4b4c,...) at sleepq_switch+0x1c5/frame 0xf84c4b08 sleepq_catch_signals(0,c1193e95,162,ab0,c8b04634,...) at sleepq_catch_signals+0x36c/frame 0xf84c4b50 sleepq_wait_sig(c8b04634,74,c0fb9ff4,100,0,...) at sleepq_wait_sig+0x14/frame 0xf84c4b74 _sleep(c8b04634,c8b04664,174,c0fb9ff4,0,...) at _sleep+0x364/frame 0xf84c4bd0 kern_sigsuspend(c8b06310,0,0,0,0,...) at kern_sigsuspend+0xfb/frame 0xf84c4c10 sys_sigsuspend(c8b06310,f84c4cc8,1,0,c8b06310,...) at sys_sigsuspend+0x58/frame 0xf84c4c40 syscall(f84c4d08) at syscall+0x2ed/frame 0xf84c4cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84c4cfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x283608fb, esp = 0xbfbfc9dc, ebp = 0xbfbfca08 --- Tracing command sendmail pid 733 tid 100107 td 0xc937b930 sched_switch(c937b930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84be8f8 mi_switch(104,0,c1193e95,1f5,3fe,...) at mi_switch+0x1c9/frame 0xf84be92c sleepq_switch(c937b930,0,c1193e95,1ab,c118b725,...) at sleepq_switch+0x1c5/frame 0xf84be960 sleepq_catch_signals(c12963d0,f84be9d0,c0aaf809,c81a1c60,0,...) at sleepq_catch_signals+0x36c/frame 0xf84be9a8 sleepq_timedwait_sig(c81a1c64,0,f84bea08,50000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf84be9d0 _cv_timedwait_sig_sbt(c81a1c64,c81a1c50,c6e3fab9,45,50000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf84bea1c seltdwait(45,50000000,0,c937b930,f84bebc8,...) at seltdwait+0xbc/frame 0xf84bea50 kern_select(c937b930,5,bfbfbfc8,0,0,...) at kern_select+0x883/frame 0xf84bebf8 sys_select(c937b930,f84becc8,0,0,c937b930,...) at sys_select+0x69/frame 0xf84bec40 syscall(f84bed08) at syscall+0x2ed/frame 0xf84becfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84becfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2842b137, esp = 0xbfbfbf2c, ebp = 0xbfbfc9e8 --- Tracing command sshd pid 730 tid 100103 td 0xc8a87930 sched_switch(c8a87930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84ab904 mi_switch(104,0,c1193e95,1f5,200046,...) at mi_switch+0x1c9/frame 0xf84ab938 sleepq_switch(c8a87930,0,c1193e95,1ab,c8a805e0,...) at sleepq_switch+0x1c5/frame 0xf84ab96c sleepq_catch_signals(f84ab9d8,c0aaf809,c8a805e0,0,0,...) at sleepq_catch_signals+0x36c/frame 0xf84ab9b4 sleepq_wait_sig(c8a805e4,0,f84aba08,101,0,...) at sleepq_wait_sig+0x14/frame 0xf84ab9d8 _cv_wait_sig(c8a805e4,c8a805d0,c11972a3,6d8,c0b2631d,...) at _cv_wait_sig+0x200/frame 0xf84aba1c seltdwait(ffffffff,0,0,c8a87930,f84abbc8,...) at seltdwait+0x90/frame 0xf84aba50 kern_select(c8a87930,7,28c0c148,0,0,...) at kern_select+0x883/frame 0xf84abbf8 sys_select(c8a87930,f84abcc8,c0f66c70,e4343c90,0,...) at sys_select+0x69/frame 0xf84abc40 syscall(f84abd08) at syscall+0x2ed/frame 0xf84abcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84abcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2853c137, esp = 0xbfbfd424, ebp = 0xbfbfde44 --- Tracing command moused pid 698 tid 100105 td 0xc8b13c40 sched_switch(c8b13c40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84b1904 mi_switch(104,0,c1193e95,1f5,46,...) at mi_switch+0x1c9/frame 0xf84b1938 sleepq_switch(c8b13c40,0,c1193e95,1ab,c8ac7aa0,...) at sleepq_switch+0x1c5/frame 0xf84b196c sleepq_catch_signals(f84b19d8,c0aaf809,c8ac7aa0,0,0,...) at sleepq_catch_signals+0x36c/frame 0xf84b19b4 sleepq_wait_sig(c8ac7aa4,0,f84b1a08,101,0,...) at sleepq_wait_sig+0x14/frame 0xf84b19d8 _cv_wait_sig(c8ac7aa4,c8ac7a90,c11972a3,6d8,c8b13c40,...) at _cv_wait_sig+0x200/frame 0xf84b1a1c seltdwait(ffffffff,0,0,c8b13c40,f84b1bc8,...) at seltdwait+0x90/frame 0xf84b1a50 kern_select(c8b13c40,400,bfbfdcb0,0,0,...) at kern_select+0x883/frame 0xf84b1bf8 sys_select(c8b13c40,f84b1cc8,0,0,0,...) at sys_select+0x69/frame 0xf84b1c40 syscall(f84b1d08) at syscall+0x2ed/frame 0xf84b1cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84b1cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281cb137, esp = 0xbfbfd894, ebp = 0xbfbfde24 --- Tracing command smartd pid 690 tid 100098 td 0xc8b69620 sched_switch(c8b69620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed7faa64 mi_switch(104,0,c1193e95,1f5,c0b0a9c0,...) at mi_switch+0x1c9/frame 0xed7faa98 sleepq_switch(c8b69620,0,c1193e95,1ab,8,...) at sleepq_switch+0x1c5/frame 0xed7faacc sleepq_catch_signals(c0b0a9c0,c8b69620,1,201,1,...) at sleepq_catch_signals+0x36c/frame 0xed7fab14 sleepq_timedwait_sig(c1306981,6c,71b,80000000,70,...) at sleepq_timedwait_sig+0x14/frame 0xed7fab3c _sleep(c1306981,0,16c,c118f3a6,fc8c737b,...) at _sleep+0x33c/frame 0xed7fab98 kern_nanosleep(bfbf53c8,ed7fac18,ed7fac20,ed7facc8,708,...) at kern_nanosleep+0x158/frame 0xed7fac00 sys_nanosleep(c8b69620,ed7facc8,c0f66c70,e433dc90,0,...) at sys_nanosleep+0x6b/frame 0xed7fac40 syscall(ed7fad08) at syscall+0x2ed/frame 0xed7facfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed7facfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x282f93b3, esp = 0xbfbf53bc, ebp = 0xbfbf5400 --- Tracing command winbindd pid 688 tid 100102 td 0xc8a87c40 sched_switch(c8a87c40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84a8960 mi_switch(104,0,c1193e95,1f5,3fe,...) at mi_switch+0x1c9/frame 0xf84a8994 sleepq_switch(c8a87c40,0,c1193e95,1ab,c118b725,...) at sleepq_switch+0x1c5/frame 0xf84a89c8 sleepq_catch_signals(c12963d0,f84a8a38,c0aaf809,c8a80a60,0,...) at sleepq_catch_signals+0x36c/frame 0xf84a8a10 sleepq_timedwait_sig(c8a80a64,0,f84a8a70,b7fbe76c,20c49,...) at sleepq_timedwait_sig+0x14/frame 0xf84a8a38 _cv_timedwait_sig_sbt(c8a80a64,c8a80a50,1ad6af9c,20c4af,b7fbe76c,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf84a8a84 seltdwait(20c4af,b7fbe76c,20c49,c8a87c40,0,...) at seltdwait+0xbc/frame 0xf84a8ab8 sys_poll(c8a87c40,f84a8cc8,0,0,0,...) at sys_poll+0x46d/frame 0xf84a8c40 syscall(f84a8d08) at syscall+0x2ed/frame 0xf84a8cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84a8cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2194518f, esp = 0xbfbfc47c, ebp = 0xbfbfc4b8 --- Tracing command smbd pid 687 tid 100101 td 0xc8b69310 sched_switch(c8b69310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84a5960 mi_switch(104,0,c1193e95,1f5,3fe,...) at mi_switch+0x1c9/frame 0xf84a5994 sleepq_switch(c8b69310,0,c1193e95,1ab,c118b725,...) at sleepq_switch+0x1c5/frame 0xf84a59c8 sleepq_catch_signals(c12963d0,f84a5a38,c0aaf809,c8a80760,0,...) at sleepq_catch_signals+0x36c/frame 0xf84a5a10 sleepq_timedwait_sig(c8a80764,0,f84a5a70,b7fbe76c,20c49,...) at sleepq_timedwait_sig+0x14/frame 0xf84a5a38 _cv_timedwait_sig_sbt(c8a80764,c8a80750,e74d105d,20c4ae,b7fbe76c,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf84a5a84 seltdwait(20c4ae,b7fbe76c,20c49,c8b69310,0,...) at seltdwait+0xbc/frame 0xf84a5ab8 sys_poll(c8b69310,f84a5cc8,0,0,0,...) at sys_poll+0x46d/frame 0xf84a5c40 syscall(f84a5d08) at syscall+0x2ed/frame 0xf84a5cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84a5cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x21b6e18f, esp = 0xbfbfd9ec, ebp = 0xbfbfda28 --- Tracing command winbindd pid 676 tid 100087 td 0xc8b75000 sched_switch(c8b75000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed79e960 mi_switch(104,0,c1193e95,1f5,3fe,...) at mi_switch+0x1c9/frame 0xed79e994 sleepq_switch(c8b75000,0,c1193e95,1ab,c118b725,...) at sleepq_switch+0x1c5/frame 0xed79e9c8 sleepq_catch_signals(c12963d0,ed79ea38,c0aaf809,c8a80f20,0,...) at sleepq_catch_signals+0x36c/frame 0xed79ea10 sleepq_timedwait_sig(c8a80f24,0,ed79ea70,bec06d65,12,...) at sleepq_timedwait_sig+0x14/frame 0xed79ea38 _cv_timedwait_sig_sbt(c8a80f24,c8a80f10,871f0f31,13f,bec06d65,...) at _cv_timedwait_sig_sbt+0x228/frame 0xed79ea84 seltdwait(13f,bec06d65,12,c8b75000,0,...) at seltdwait+0xbc/frame 0xed79eab8 sys_poll(c8b75000,ed79ecc8,c0f66c70,e433dc90,0,...) at sys_poll+0x46d/frame 0xed79ec40 syscall(ed79ed08) at syscall+0x2ed/frame 0xed79ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed79ecfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2194518f, esp = 0xbfbfdbcc, ebp = 0xbfbfdc08 --- Tracing command smbd pid 674 tid 100099 td 0xc8b06620 sched_switch(c8b06620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed7fd960 mi_switch(104,0,c1193e95,1f5,3fe,...) at mi_switch+0x1c9/frame 0xed7fd994 sleepq_switch(c8b06620,0,c1193e95,1ab,c118b725,...) at sleepq_switch+0x1c5/frame 0xed7fd9c8 sleepq_catch_signals(c12963d0,ed7fda38,c0aaf809,c8a81ce0,0,...) at sleepq_catch_signals+0x36c/frame 0xed7fda10 sleepq_timedwait_sig(c8a81ce4,0,ed7fda70,bed4f99f,3,...) at sleepq_timedwait_sig+0x14/frame 0xed7fda38 _cv_timedwait_sig_sbt(c8a81ce4,c8a81cd0,67cfe503,4f,bed4f99f,...) at _cv_timedwait_sig_sbt+0x228/frame 0xed7fda84 seltdwait(4f,bed4f99f,3,c8b06620,0,...) at seltdwait+0xbc/frame 0xed7fdab8 sys_poll(c8b06620,ed7fdcc8,0,0,c8b06620,...) at sys_poll+0x46d/frame 0xed7fdc40 syscall(ed7fdd08) at syscall+0x2ed/frame 0xed7fdcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed7fdcfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x21b6e18f, esp = 0xbfbfda9c, ebp = 0xbfbfdad8 --- Tracing command nmbd pid 672 tid 100085 td 0xc8b13310 sched_switch(c8b13310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed76f960 mi_switch(104,0,c1193e95,1f5,3fe,...) at mi_switch+0x1c9/frame 0xed76f994 sleepq_switch(c8b13310,0,c1193e95,1ab,c118b725,...) at sleepq_switch+0x1c5/frame 0xed76f9c8 sleepq_catch_signals(c12963d0,ed76fa38,c0aaf809,c8ac7ae0,0,...) at sleepq_catch_signals+0x36c/frame 0xed76fa10 sleepq_timedwait_sig(c8ac7ae4,0,ed76fa70,9fffff47,0,...) at sleepq_timedwait_sig+0x14/frame 0xed76fa38 _cv_timedwait_sig_sbt(c8ac7ae4,c8ac7ad0,c99aa076,48,9fffff47,...) at _cv_timedwait_sig_sbt+0x228/frame 0xed76fa84 seltdwait(48,9fffff47,0,c8b13310,0,...) at seltdwait+0xbc/frame 0xed76fab8 sys_poll(c8b13310,ed76fcc8,c0f66c70,e4340c90,0,...) at sys_poll+0x46d/frame 0xed76fc40 syscall(ed76fd08) at syscall+0x2ed/frame 0xed76fcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed76fcfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2156d18f, esp = 0xbfbfdb1c, ebp = 0xbfbfdb58 --- Tracing command powerd pid 649 tid 100097 td 0xc8a93000 sched_switch(c8a93000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed7e48f8 mi_switch(104,0,c1193e95,1f5,3fe,...) at mi_switch+0x1c9/frame 0xed7e492c sleepq_switch(c8a93000,0,c1193e95,1ab,c118b725,...) at sleepq_switch+0x1c5/frame 0xed7e4960 sleepq_catch_signals(c12963d0,ed7e49d0,c0aaf809,c8ac78a0,0,...) at sleepq_catch_signals+0x36c/frame 0xed7e49a8 sleepq_timedwait_sig(c8ac78a4,0,ed7e4a08,3ffffff,0,...) at sleepq_timedwait_sig+0x14/frame 0xed7e49d0 _cv_timedwait_sig_sbt(c8ac78a4,c8ac7890,a2b1f1c2,43,3ffffff,...) at _cv_timedwait_sig_sbt+0x228/frame 0xed7e4a1c seltdwait(43,3ffffff,0,c0aabb84,c1bab3c0,...) at seltdwait+0xbc/frame 0xed7e4a50 kern_select(c8a93000,0,bfbfdd90,0,bfbfdd90,...) at kern_select+0x883/frame 0xed7e4bf8 sys_select(c8a93000,ed7e4cc8,c11e97be,d6,0,...) at sys_select+0x69/frame 0xed7e4c40 syscall(ed7e4d08) at syscall+0x2ed/frame 0xed7e4cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed7e4cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a4137, esp = 0xbfbfdd0c, ebp = 0xbfbfde44 --- Tracing command ntpd pid 646 tid 100096 td 0xc8a93310 sched_switch(c8a93310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed7e1904 mi_switch(104,0,c1193e95,1f5,200046,...) at mi_switch+0x1c9/frame 0xed7e1938 sleepq_switch(c8a93310,0,c1193e95,1ab,c8ac76e0,...) at sleepq_switch+0x1c5/frame 0xed7e196c sleepq_catch_signals(ed7e19d8,c0aaf809,c8ac76e0,0,0,...) at sleepq_catch_signals+0x36c/frame 0xed7e19b4 sleepq_wait_sig(c8ac76e4,0,ed7e1a08,101,0,...) at sleepq_wait_sig+0x14/frame 0xed7e19d8 _cv_wait_sig(c8ac76e4,c8ac76d0,c11972a3,6d8,c0b2631d,...) at _cv_wait_sig+0x200/frame 0xed7e1a1c seltdwait(ffffffff,0,0,c8a93310,ed7e1bc8,...) at seltdwait+0x90/frame 0xed7e1a50 kern_select(c8a93310,1c,bfbfdd48,0,0,...) at kern_select+0x883/frame 0xed7e1bf8 sys_select(c8a93310,ed7e1cc8,0,0,c8a93310,...) at sys_select+0x69/frame 0xed7e1c40 syscall(ed7e1d08) at syscall+0x2ed/frame 0xed7e1cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed7e1cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x283a9137, esp = 0xbfbfdd24, ebp = 0xbfbfdde4 --- Tracing command nfsd pid 589 tid 100095 td 0xc8b06930 sched_switch(c8b06930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed7daa8c mi_switch(104,0,c1193e95,1f5,c0b0a9c0,...) at mi_switch+0x1c9/frame 0xed7daac0 sleepq_switch(c8b06930,0,c1193e95,1ab,c118b725,...) at sleepq_switch+0x1c5/frame 0xed7daaf4 sleepq_catch_signals(c12963d0,ed7dab64,c0aaf809,c85c3510,0,...) at sleepq_catch_signals+0x36c/frame 0xed7dab3c sleepq_timedwait_sig(c8889c50,0,ed7dab9c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xed7dab64 _cv_timedwait_sig_sbt(c8889c50,c85c3500,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x228/frame 0xed7dabb0 svc_run_internal(ed7dacf4,c0a9249f,c85c3500,ed7dad08,c1187544,...) at svc_run_internal+0xa86/frame 0xed7dacc4 svc_thread_start(c85c3500,ed7dad08,c1187544,3d5,0,...) at svc_thread_start+0xd/frame 0xed7daccc fork_exit(c0ce0320,c85c3500,ed7dad08) at fork_exit+0x7f/frame 0xed7dacf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed7dacf4 --- trap 0x8295d72e, eip = 0xc, esp = 0x33, ebp = 0xbfbfd937 --- Tracing command nfsd pid 589 tid 100094 td 0xc8b06c40 sched_switch(c8b06c40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed7d7a8c mi_switch(104,0,c1193e95,1f5,c0b0a9c0,...) at mi_switch+0x1c9/frame 0xed7d7ac0 sleepq_switch(c8b06c40,0,c1193e95,1ab,c118b725,...) at sleepq_switch+0x1c5/frame 0xed7d7af4 sleepq_catch_signals(c12963d0,ed7d7b64,c0aaf809,c85c3510,0,...) at sleepq_catch_signals+0x36c/frame 0xed7d7b3c sleepq_timedwait_sig(c8889c90,0,ed7d7b9c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xed7d7b64 _cv_timedwait_sig_sbt(c8889c90,c85c3500,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x228/frame 0xed7d7bb0 svc_run_internal(ed7d7cf4,c0a9249f,c85c3500,ed7d7d08,c1187544,...) at svc_run_internal+0xa86/frame 0xed7d7cc4 svc_thread_start(c85c3500,ed7d7d08,c1187544,3d5,0,...) at svc_thread_start+0xd/frame 0xed7d7ccc fork_exit(c0ce0320,c85c3500,ed7d7d08) at fork_exit+0x7f/frame 0xed7d7cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed7d7cf4 --- trap 0x8295d72e, eip = 0xc, esp = 0x33, ebp = 0xbfbfd937 --- Tracing command nfsd pid 589 tid 100093 td 0xc8b13000 sched_switch(c8b13000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed7d4a8c mi_switch(104,0,c1193e95,1f5,c0b0a9c0,...) at mi_switch+0x1c9/frame 0xed7d4ac0 sleepq_switch(c8b13000,0,c1193e95,1ab,c118b725,...) at sleepq_switch+0x1c5/frame 0xed7d4af4 sleepq_catch_signals(c12963d0,ed7d4b64,c0aaf809,c85c3510,0,...) at sleepq_catch_signals+0x36c/frame 0xed7d4b3c sleepq_timedwait_sig(c89b4f50,0,ed7d4b9c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xed7d4b64 _cv_timedwait_sig_sbt(c89b4f50,c85c3500,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x228/frame 0xed7d4bb0 svc_run_internal(ed7d4cf4,c0a9249f,c85c3500,ed7d4d08,c1187544,...) at svc_run_internal+0xa86/frame 0xed7d4cc4 svc_thread_start(c85c3500,ed7d4d08,c1187544,3d5,0,...) at svc_thread_start+0xd/frame 0xed7d4ccc fork_exit(c0ce0320,c85c3500,ed7d4d08) at fork_exit+0x7f/frame 0xed7d4cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed7d4cf4 --- trap 0x8295d72e, eip = 0xc, esp = 0x33, ebp = 0xbfbfd937 --- Tracing command nfsd pid 589 tid 100092 td 0xc8a93620 sched_switch(c8a93620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed7d12e4 mi_switch(104,0,c1193e95,1f5,c0b0a9c0,...) at mi_switch+0x1c9/frame 0xed7d1318 sleepq_switch(c8a93620,0,c1193e95,1ab,c118b725,...) at sleepq_switch+0x1c5/frame 0xed7d134c sleepq_catch_signals(c12963d0,ed7d13bc,c0aaf809,c85c3510,0,...) at sleepq_catch_signals+0x36c/frame 0xed7d1394 sleepq_timedwait_sig(c89b50d0,0,ed7d13f4,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xed7d13bc _cv_timedwait_sig_sbt(c89b50d0,c85c3500,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x228/frame 0xed7d1408 svc_run_internal(c0ce0320,c85c3500,c8a86000,ed7d1548,0,...) at svc_run_internal+0xa86/frame 0xed7d151c svc_run(c85c3500,0,c1178d3d,1b5,0,...) at svc_run+0xc3/frame 0xed7d1558 nfsrvd_nfsd(c8a93620,ed7d16c0,c,0,0,...) at nfsrvd_nfsd+0x1a2/frame 0xed7d1690 nfssvc_nfsd(c8a93620,ed7d1cc8,0,c8a93620,ed7d1cfc,...) at nfssvc_nfsd+0x11c/frame 0xed7d1c28 sys_nfssvc(c8a93620,ed7d1cc8,c0f66c70,e4340c90,0,...) at sys_nfssvc+0xbf/frame 0xed7d1c40 syscall(ed7d1d08) at syscall+0x2ed/frame 0xed7d1cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed7d1cfc --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280c8f2b, esp = 0xbfbfd7e4, ebp = 0xbfbfda58 --- Tracing command nfsd pid 585 tid 100084 td 0xc8a93c40 sched_switch(c8a93c40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed76c904 mi_switch(104,0,c1193e95,1f5,46,...) at mi_switch+0x1c9/frame 0xed76c938 sleepq_switch(c8a93c40,0,c1193e95,1ab,c8a80b60,...) at sleepq_switch+0x1c5/frame 0xed76c96c sleepq_catch_signals(ed76c9d8,c0aaf809,c8a80b60,0,0,...) at sleepq_catch_signals+0x36c/frame 0xed76c9b4 sleepq_wait_sig(c8a80b64,0,ed76ca08,101,0,...) at sleepq_wait_sig+0x14/frame 0xed76c9d8 _cv_wait_sig(c8a80b64,c8a80b50,c11972a3,6d8,c0b2631d,...) at _cv_wait_sig+0x200/frame 0xed76ca1c seltdwait(ffffffff,0,0,c8a93c40,ed76cbc8,...) at seltdwait+0x90/frame 0xed76ca50 kern_select(c8a93c40,7,bfbfdc30,0,0,...) at kern_select+0x883/frame 0xed76cbf8 sys_select(c8a93c40,ed76ccc8,c0f66c70,e433dc90,0,...) at sys_select+0x69/frame 0xed76cc40 syscall(ed76cd08) at syscall+0x2ed/frame 0xed76ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed76ccfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28193137, esp = 0xbfbfda5c, ebp = 0xbfbfde34 --- Tracing command mountd pid 579 tid 100088 td 0xc8a93930 sched_switch(c8a93930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed7a3904 mi_switch(104,0,c1193e95,1f5,46,...) at mi_switch+0x1c9/frame 0xed7a3938 sleepq_switch(c8a93930,0,c1193e95,1ab,c8ac7b60,...) at sleepq_switch+0x1c5/frame 0xed7a396c sleepq_catch_signals(ed7a39d8,c0aaf809,c8ac7b60,0,0,...) at sleepq_catch_signals+0x36c/frame 0xed7a39b4 sleepq_wait_sig(c8ac7b64,0,ed7a3a08,101,0,...) at sleepq_wait_sig+0x14/frame 0xed7a39d8 _cv_wait_sig(c8ac7b64,c8ac7b50,c11972a3,6d8,c0b2631d,...) at _cv_wait_sig+0x200/frame 0xed7a3a1c seltdwait(ffffffff,0,0,c8a93930,ed7a3bc8,...) at seltdwait+0x90/frame 0xed7a3a50 kern_select(c8a93930,9,bfbfdd50,0,0,...) at kern_select+0x883/frame 0xed7a3bf8 sys_select(c8a93930,ed7a3cc8,c0f66c70,e4343c90,0,...) at sys_select+0x69/frame 0xed7a3c40 syscall(ed7a3d08) at syscall+0x2ed/frame 0xed7a3cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed7a3cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281aa137, esp = 0xbfbfdd0c, ebp = 0xbfbfde34 --- Tracing command nfsuserd pid 572 tid 100091 td 0xc884b620 sched_switch(c884b620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed7cd8f8 mi_switch(104,0,c1193e95,1f5,3fe,...) at mi_switch+0x1c9/frame 0xed7cd92c sleepq_switch(c884b620,0,c1193e95,1ab,c118b725,...) at sleepq_switch+0x1c5/frame 0xed7cd960 sleepq_catch_signals(c12963d0,ed7cd9d0,c0aaf809,c8ac7be0,0,...) at sleepq_catch_signals+0x36c/frame 0xed7cd9a8 sleepq_timedwait_sig(c8ac7be4,0,ed7cda08,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xed7cd9d0 _cv_timedwait_sig_sbt(c8ac7be4,c8ac7bd0,1f9fb2ee,4c,e0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xed7cda1c seltdwait(4c,e0000000,1,c884b620,ed7cdbc8,...) at seltdwait+0xbc/frame 0xed7cda50 kern_select(c884b620,4,bfbfdc10,0,0,...) at kern_select+0x883/frame 0xed7cdbf8 sys_select(c884b620,ed7cdcc8,0,0,0,...) at sys_select+0x69/frame 0xed7cdc40 syscall(ed7cdd08) at syscall+0x2ed/frame 0xed7cdcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed7cdcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28192137, esp = 0xbfbfdb6c, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 571 tid 100078 td 0xc884b930 sched_switch(c884b930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed72e8f8 mi_switch(104,0,c1193e95,1f5,3fe,...) at mi_switch+0x1c9/frame 0xed72e92c sleepq_switch(c884b930,0,c1193e95,1ab,c118b725,...) at sleepq_switch+0x1c5/frame 0xed72e960 sleepq_catch_signals(c12963d0,ed72e9d0,c0aaf809,c8a80d60,0,...) at sleepq_catch_signals+0x36c/frame 0xed72e9a8 sleepq_timedwait_sig(c8a80d64,0,ed72ea08,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xed72e9d0 _cv_timedwait_sig_sbt(c8a80d64,c8a80d50,1f9fb2ee,4c,e0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xed72ea1c seltdwait(4c,e0000000,1,c884b930,ed72ebc8,...) at seltdwait+0xbc/frame 0xed72ea50 kern_select(c884b930,4,bfbfdc10,0,0,...) at kern_select+0x883/frame 0xed72ebf8 sys_select(c884b930,ed72ecc8,c0f66c70,e4343c90,0,...) at sys_select+0x69/frame 0xed72ec40 syscall(ed72ed08) at syscall+0x2ed/frame 0xed72ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed72ecfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28192137, esp = 0xbfbfdb6c, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 570 tid 100080 td 0xc8b76000 sched_switch(c8b76000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed7358f8 mi_switch(104,0,c1193e95,1f5,3fe,...) at mi_switch+0x1c9/frame 0xed73592c sleepq_switch(c8b76000,0,c1193e95,1ab,c118b725,...) at sleepq_switch+0x1c5/frame 0xed735960 sleepq_catch_signals(c12963d0,ed7359d0,c0aaf809,c8ac7c20,0,...) at sleepq_catch_signals+0x36c/frame 0xed7359a8 sleepq_timedwait_sig(c8ac7c24,0,ed735a08,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xed7359d0 _cv_timedwait_sig_sbt(c8ac7c24,c8ac7c10,1f9fb2ee,4c,e0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xed735a1c seltdwait(4c,e0000000,1,c8b76000,ed735bc8,...) at seltdwait+0xbc/frame 0xed735a50 kern_select(c8b76000,4,bfbfdc10,0,0,...) at kern_select+0x883/frame 0xed735bf8 sys_select(c8b76000,ed735cc8,c0f66c70,e4340c90,0,...) at sys_select+0x69/frame 0xed735c40 syscall(ed735d08) at syscall+0x2ed/frame 0xed735cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed735cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28192137, esp = 0xbfbfdb6c, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 569 tid 100077 td 0xc8b13620 sched_switch(c8b13620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed72a8f8 mi_switch(104,0,c1193e95,1f5,3fe,...) at mi_switch+0x1c9/frame 0xed72a92c sleepq_switch(c8b13620,0,c1193e95,1ab,c118b725,...) at sleepq_switch+0x1c5/frame 0xed72a960 sleepq_catch_signals(c12963d0,ed72a9d0,c0aaf809,c8a80da0,0,...) at sleepq_catch_signals+0x36c/frame 0xed72a9a8 sleepq_timedwait_sig(c8a80da4,0,ed72aa08,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xed72a9d0 _cv_timedwait_sig_sbt(c8a80da4,c8a80d90,1f9fb2ee,4c,e0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xed72aa1c seltdwait(4c,e0000000,1,c8b13620,ed72abc8,...) at seltdwait+0xbc/frame 0xed72aa50 kern_select(c8b13620,4,bfbfdc10,0,0,...) at kern_select+0x883/frame 0xed72abf8 sys_select(c8b13620,ed72acc8,14,c11902c9,7bb,...) at sys_select+0x69/frame 0xed72ac40 syscall(ed72ad08) at syscall+0x2ed/frame 0xed72acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed72acfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28192137, esp = 0xbfbfdb6c, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 568 tid 100081 td 0xc8b75c40 sched_switch(c8b75c40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed743aa0 mi_switch(104,0,c1193e95,1f5,8,...) at mi_switch+0x1c9/frame 0xed743ad4 sleepq_switch(c8b75c40,0,c1193e95,1ab,ed743b4c,...) at sleepq_switch+0x1c5/frame 0xed743b08 sleepq_catch_signals(0,c1193e95,162,10b0,c8b68634,...) at sleepq_catch_signals+0x36c/frame 0xed743b50 sleepq_wait_sig(c8b68634,74,c0fb9ff4,100,0,...) at sleepq_wait_sig+0x14/frame 0xed743b74 _sleep(c8b68634,c8b68664,174,c0fb9ff4,0,...) at _sleep+0x364/frame 0xed743bd0 kern_sigsuspend(c8b75c40,0,0,0,0,...) at kern_sigsuspend+0xfb/frame 0xed743c10 sys_sigsuspend(c8b75c40,ed743cc8,c11e97be,d6,0,...) at sys_sigsuspend+0x58/frame 0xed743c40 syscall(ed743d08) at syscall+0x2ed/frame 0xed743cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed743cfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x280c78fb, esp = 0xbfbfdcac, ebp = 0xbfbfde44 --- Tracing command rpcbind pid 532 tid 100089 td 0xc8b69c40 sched_switch(c8b69c40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed7a6960 mi_switch(104,0,c1193e95,1f5,3fe,...) at mi_switch+0x1c9/frame 0xed7a6994 sleepq_switch(c8b69c40,0,c1193e95,1ab,c118b725,...) at sleepq_switch+0x1c5/frame 0xed7a69c8 sleepq_catch_signals(c12963d0,ed7a6a38,c0aaf809,c8ac7d20,0,...) at sleepq_catch_signals+0x36c/frame 0xed7a6a10 sleepq_timedwait_sig(c8ac7d24,0,ed7a6a70,dffffdd5,1,...) at sleepq_timedwait_sig+0x14/frame 0xed7a6a38 _cv_timedwait_sig_sbt(c8ac7d24,c8ac7d10,44bdc19d,4c,dffffdd5,...) at _cv_timedwait_sig_sbt+0x228/frame 0xed7a6a84 seltdwait(4c,dffffdd5,1,c8b69c40,0,...) at seltdwait+0xbc/frame 0xed7a6ab8 sys_poll(c8b69c40,ed7a6cc8,c0f66c70,e4340c90,0,...) at sys_poll+0x46d/frame 0xed7a6c40 syscall(ed7a6d08) at syscall+0x2ed/frame 0xed7a6cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed7a6cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2814718f, esp = 0xbfbfbbfc, ebp = 0xbfbfddd8 --- Tracing command syslogd pid 517 tid 100086 td 0xc8b75310 sched_switch(c8b75310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed775904 mi_switch(104,0,c1193e95,1f5,46,...) at mi_switch+0x1c9/frame 0xed775938 sleepq_switch(c8b75310,0,c1193e95,1ab,c81a1ca0,...) at sleepq_switch+0x1c5/frame 0xed77596c sleepq_catch_signals(ed7759d8,c0aaf809,c81a1ca0,0,0,...) at sleepq_catch_signals+0x36c/frame 0xed7759b4 sleepq_wait_sig(c81a1ca4,0,ed775a08,101,0,...) at sleepq_wait_sig+0x14/frame 0xed7759d8 _cv_wait_sig(c81a1ca4,c81a1c90,c11972a3,6d8,c8b75310,...) at _cv_wait_sig+0x200/frame 0xed775a1c seltdwait(ffffffff,0,0,c8b75310,ed775bc8,...) at seltdwait+0x90/frame 0xed775a50 kern_select(c8b75310,9,28844108,0,0,...) at kern_select+0x883/frame 0xed775bf8 sys_select(c8b75310,ed775cc8,0,0,c8b75310,...) at sys_select+0x69/frame 0xed775c40 syscall(ed775d08) at syscall+0x2ed/frame 0xed775cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed775cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a9137, esp = 0xbfbfceac, ebp = 0xbfbfde34 --- Tracing command devd pid 414 tid 100082 td 0xc8b75930 sched_switch(c8b75930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed7488f8 mi_switch(104,0,c1193e95,1f5,3fe,...) at mi_switch+0x1c9/frame 0xed74892c sleepq_switch(c8b75930,0,c1193e95,1ab,c118b725,...) at sleepq_switch+0x1c5/frame 0xed748960 sleepq_catch_signals(c12963d0,ed7489d0,c0aaf809,c8adac60,0,...) at sleepq_catch_signals+0x36c/frame 0xed7489a8 sleepq_timedwait_sig(c8adac64,0,ed748a08,c0000000,3,...) at sleepq_timedwait_sig+0x14/frame 0xed7489d0 _cv_timedwait_sig_sbt(c8adac64,c8adac50,9bc827fd,55,c0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xed748a1c seltdwait(55,c0000000,3,c8b75930,ed748bc8,...) at seltdwait+0xbc/frame 0xed748a50 kern_select(c8b75930,5,bfbfbda0,0,0,...) at kern_select+0x883/frame 0xed748bf8 sys_select(c8b75930,ed748cc8,14,c11902c9,7bb,...) at sys_select+0x69/frame 0xed748c40 syscall(ed748d08) at syscall+0x2ed/frame 0xed748cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed748cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x80e7d63, esp = 0xbfbfbd44, ebp = 0xbfbfde54 --- Tracing command sh pid 18 tid 100075 td 0xc8a94000 sched_switch(c8a94000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed72098c mi_switch(104,0,c1193e95,1f5,c1193e95,...) at mi_switch+0x1c9/frame 0xed7209c0 sleepq_switch(c8a94000,0,c1193e95,1ab,ed720a38,...) at sleepq_switch+0x1c5/frame 0xed7209f4 sleepq_catch_signals(0,c1193e95,162,1380,c8a868b8,...) at sleepq_catch_signals+0x36c/frame 0xed720a3c sleepq_wait_sig(c8a868b8,6c,c1197b21,100,0,...) at sleepq_wait_sig+0x14/frame 0xed720a60 _sleep(c8a868b8,c8a8694c,16c,c1197b21,0,...) at _sleep+0x364/frame 0xed720abc kern_wait6(c8a94000,7,0,0,ed720b4c,...) at kern_wait6+0x45c/frame 0xed720b20 sys_wait4(c8a94000,ed720cc8,c0f66c70,e4340c90,0,...) at sys_wait4+0x94/frame 0xed720c40 syscall(ed720d08) at syscall+0x2ed/frame 0xed720cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed720cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281597b3, esp = 0xbfbfdac8, ebp = 0xbfbfdae0 --- Tracing command softdepflush pid 17 tid 100074 td 0xc884bc40 sched_switch(c884bc40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed71cba4 mi_switch(104,0,c1193e95,1f5,101,...) at mi_switch+0x1c9/frame 0xed71cbd8 sleepq_switch(c884bc40,0,c1193e95,28e,c148378c,...) at sleepq_switch+0x1c5/frame 0xed71cc0c sleepq_timedwait(c148378c,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xed71cc30 _sleep(c148378c,c148370c,54,c11c7403,fffffed8,...) at _sleep+0x350/frame 0xed71cc8c softdep_flush(0,ed71cd08,c1187544,3d5,0,...) at softdep_flush+0x264/frame 0xed71cccc fork_exit(c0d38920,0,ed71cd08) at fork_exit+0x7f/frame 0xed71ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed71ccf4 --- trap 0, eip = 0, esp = 0xed71cd40, ebp = 0 --- Tracing command vnlru pid 16 tid 100073 td 0xc884c000 sched_switch(c884c000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed719b78 mi_switch(104,0,c1193e95,1f5,101,...) at mi_switch+0x1c9/frame 0xed719bac sleepq_switch(c884c000,0,c1193e95,28e,c89198b8,...) at sleepq_switch+0x1c5/frame 0xed719be0 sleepq_timedwait(c89198b8,60,0,0,0,...) at sleepq_timedwait+0x48/frame 0xed719c04 _sleep(c89198b8,c147f498,260,c11a08d1,fffffed8,...) at _sleep+0x350/frame 0xed719c60 vnlru_proc(0,ed719d08,c1187544,3d5,0,...) at vnlru_proc+0xcf/frame 0xed719ccc fork_exit(c0b78160,0,ed719d08) at fork_exit+0x7f/frame 0xed719cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed719cf4 --- trap 0, eip = 0, esp = 0xed719d40, ebp = 0 --- Tracing command syncer pid 9 tid 100072 td 0xc884c310 sched_switch(c884c310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed716b78 mi_switch(104,0,c1193e95,1f5,8,...) at mi_switch+0x1c9/frame 0xed716bac sleepq_switch(c884c310,0,c1193e95,28e,0,...) at sleepq_switch+0x1c5/frame 0xed716be0 sleepq_timedwait(c147f4e0,0,ed716c3c,0,0,...) at sleepq_timedwait+0x48/frame 0xed716c04 _cv_timedwait_sbt(c147f4e0,c147f4c0,fffffed8,0,0,...) at _cv_timedwait_sbt+0x228/frame 0xed716c50 sched_sync(0,ed716d08,c1187544,3d5,0,...) at sched_sync+0x682/frame 0xed716ccc fork_exit(c0b778c0,0,ed716d08) at fork_exit+0x7f/frame 0xed716cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed716cf4 --- trap 0, eip = 0, esp = 0xed716d40, ebp = 0 --- Tracing command bufdaemon pid 8 tid 100071 td 0xc884c620 sched_switch(c884c620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed713bb0 mi_switch(104,0,c1193e95,1f5,101,...) at mi_switch+0x1c9/frame 0xed713be4 sleepq_switch(c884c620,0,c1193e95,28e,c147f004,...) at sleepq_switch+0x1c5/frame 0xed713c18 sleepq_timedwait(c147f004,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xed713c3c _sleep(c147f004,c147ef80,54,c119d292,fffffed8,...) at _sleep+0x350/frame 0xed713c98 buf_daemon(0,ed713d08,c1187544,3d5,0,...) at buf_daemon+0x8c/frame 0xed713ccc fork_exit(c0b5b330,0,ed713d08) at fork_exit+0x7f/frame 0xed713cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed713cf4 --- trap 0, eip = 0, esp = 0xed713d40, ebp = 0 --- Tracing command pagezero pid 7 tid 100070 td 0xc884c930 sched_switch(c884c930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed710bac mi_switch(104,0,c1193e95,1f5,101,...) at mi_switch+0x1c9/frame 0xed710be0 sleepq_switch(c884c930,0,c1193e95,28e,c14843a4,...) at sleepq_switch+0x1c5/frame 0xed710c14 sleepq_timedwait(c14843a4,0,12b,0,0,...) at sleepq_timedwait+0x48/frame 0xed710c38 _sleep(c14843a4,c14dc500,0,c11ceb21,fffea520,...) at _sleep+0x350/frame 0xed710c94 vm_pagezero(0,ed710d08,c1187544,3d5,0,...) at vm_pagezero+0xc2/frame 0xed710ccc fork_exit(c0d8b3f0,0,ed710d08) at fork_exit+0x7f/frame 0xed710cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed710cf4 --- trap 0, eip = 0, esp = 0xed710d40, ebp = 0 --- Tracing command vmdaemon pid 6 tid 100069 td 0xc884cc40 sched_switch(c884cc40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed70daf0 mi_switch(104,0,c1193e95,1f5,162,...) at mi_switch+0x1c9/frame 0xed70db24 sleepq_switch(c884cc40,0,c1193e95,26b,c14840c8,...) at sleepq_switch+0x1c5/frame 0xed70db58 sleepq_wait(c14840c8,74,c119d292,0,0,...) at sleepq_wait+0x48/frame 0xed70db7c _sleep(c14840c8,c14840b0,74,c119d292,0,...) at _sleep+0x385/frame 0xed70dbd8 vm_daemon(0,ed70dd08,c1187544,3d5,0,...) at vm_daemon+0xa8/frame 0xed70dccc fork_exit(c0d81e00,0,ed70dd08) at fork_exit+0x7f/frame 0xed70dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed70dcf4 --- trap 0, eip = 0, esp = 0xed70dd40, ebp = 0 --- Tracing command pagedaemon pid 5 tid 100068 td 0xc884d000 sched_switch(c884d000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed70ab20 mi_switch(104,0,c1193e95,1f5,101,...) at mi_switch+0x1c9/frame 0xed70ab54 sleepq_switch(c884d000,0,c1193e95,28e,c14dc584,...) at sleepq_switch+0x1c5/frame 0xed70ab88 sleepq_timedwait(c14dc584,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xed70abac _sleep(c14dc584,c14dc500,54,c119d292,fffffed8,...) at _sleep+0x350/frame 0xed70ac08 vm_pageout_worker(0,0,3,a,3d5,6c28,32,3,c8) at vm_pageout_worker+0x272/frame 0xed70ac9c vm_pageout(0,ed70ad08,c1187544,3d5,0,...) at vm_pageout+0x1cd/frame 0xed70accc fork_exit(c0d82ee0,0,ed70ad08) at fork_exit+0x7f/frame 0xed70acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed70acf4 --- trap 0, eip = 0, esp = 0xed70ad40, ebp = 0 --- Tracing command xpt_thrd pid 4 tid 100067 td 0xc884d310 sched_switch(c884d310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed587bb0 mi_switch(104,0,c1193e95,1f5,162,...) at mi_switch+0x1c9/frame 0xed587be4 sleepq_switch(c884d310,0,c1193e95,26b,c12d4120,...) at sleepq_switch+0x1c5/frame 0xed587c18 sleepq_wait(c12d4120,5c,c0f8e9fa,0,0,...) at sleepq_wait+0x48/frame 0xed587c3c _sleep(c12d4120,c12d4170,5c,c0f8e9fa,0,...) at _sleep+0x385/frame 0xed587c98 xpt_scanner_thread(0,ed587d08,c1187544,3d5,0,...) at xpt_scanner_thread+0x11c/frame 0xed587ccc fork_exit(c04c3a20,0,ed587d08) at fork_exit+0x7f/frame 0xed587cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed587cf4 --- trap 0, eip = 0, esp = 0xed587d40, ebp = 0 --- Tracing command sctp_iterator pid 3 tid 100066 td 0xc884d620 sched_switch(c884d620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed584bb8 mi_switch(104,0,c1193e95,1f5,162,...) at mi_switch+0x1c9/frame 0xed584bec sleepq_switch(c884d620,0,c1193e95,26b,c14d8f5c,...) at sleepq_switch+0x1c5/frame 0xed584c20 sleepq_wait(c14d8f5c,0,c11b3ff5,0,0,...) at sleepq_wait+0x48/frame 0xed584c44 _sleep(c14d8f5c,c14d8f24,0,c11b3ff5,0,...) at _sleep+0x385/frame 0xed584ca0 sctp_iterator_thread(0,ed584d08,c1187544,3d5,0,...) at sctp_iterator_thread+0x7c/frame 0xed584ccc fork_exit(c0c17ed0,0,ed584d08) at fork_exit+0x7f/frame 0xed584cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed584cf4 --- trap 0, eip = 0, esp = 0xed584d40, ebp = 0 --- Tracing command fdc0 pid 2 tid 100061 td 0xc852b310 sched_switch(c852b310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed574b48 mi_switch(104,0,c1193e95,1f5,101,...) at mi_switch+0x1c9/frame 0xed574b7c sleepq_switch(c852b310,0,c1193e95,28e,c84ce83c,...) at sleepq_switch+0x1c5/frame 0xed574bb0 sleepq_timedwait(c84ce83c,5c,0,0,0,...) at sleepq_timedwait+0x48/frame 0xed574bd4 _sleep(c84ce83c,c84ce8f0,5c,c11797ce,fffffed8,...) at _sleep+0x350/frame 0xed574c30 fdc_thread(c84ce800,ed574d08,c1187544,3d5,0,...) at fdc_thread+0x8a7/frame 0xed574ccc fork_exit(c0ee84f0,c84ce800,ed574d08) at fork_exit+0x7f/frame 0xed574cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed574cf4 --- trap 0, eip = 0, esp = 0xed574d40, ebp = 0 --- Tracing command usb pid 15 tid 100058 td 0xc852bc40 sched_switch(c852bc40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed550bd4 mi_switch(104,0,c1193e95,1f5,8,...) at mi_switch+0x1c9/frame 0xed550c08 sleepq_switch(c852bc40,0,c1193e95,26b,c852bc40,...) at sleepq_switch+0x1c5/frame 0xed550c3c sleepq_wait(c8533d34,0,ed550c90,1,0,...) at sleepq_wait+0x48/frame 0xed550c60 _cv_wait(c8533d34,c8533e4c,c116ad3b,77,c8533d3c,...) at _cv_wait+0x1f9/frame 0xed550ca4 usb_process(c8533d2c,ed550d08,c1187544,3d5,0,...) at usb_process+0xe6/frame 0xed550ccc fork_exit(c0973fa0,c8533d2c,ed550d08) at fork_exit+0x7f/frame 0xed550cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed550cf4 --- trap 0, eip = 0, esp = 0xed550d40, ebp = 0 --- Tracing command usb pid 15 tid 100057 td 0xc852c000 sched_switch(c852c000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed54dbd4 mi_switch(104,0,c1193e95,1f5,8,...) at mi_switch+0x1c9/frame 0xed54dc08 sleepq_switch(c852c000,0,c1193e95,26b,c852c000,...) at sleepq_switch+0x1c5/frame 0xed54dc3c sleepq_wait(c8533d04,0,ed54dc90,1,0,...) at sleepq_wait+0x48/frame 0xed54dc60 _cv_wait(c8533d04,c8533e4c,c116ad3b,77,c8533d0c,...) at _cv_wait+0x1f9/frame 0xed54dca4 usb_process(c8533cfc,ed54dd08,c1187544,3d5,0,...) at usb_process+0xe6/frame 0xed54dccc fork_exit(c0973fa0,c8533cfc,ed54dd08) at fork_exit+0x7f/frame 0xed54dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed54dcf4 --- trap 0, eip = 0, esp = 0xed54dd40, ebp = 0 --- Tracing command usb pid 15 tid 100056 td 0xc852c310 sched_switch(c852c310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed54abd4 mi_switch(104,0,c1193e95,1f5,8,...) at mi_switch+0x1c9/frame 0xed54ac08 sleepq_switch(c852c310,0,c1193e95,26b,c852c310,...) at sleepq_switch+0x1c5/frame 0xed54ac3c sleepq_wait(c8533cd4,0,ed54ac90,1,0,...) at sleepq_wait+0x48/frame 0xed54ac60 _cv_wait(c8533cd4,c8533e4c,c116ad3b,77,c8533cdc,...) at _cv_wait+0x1f9/frame 0xed54aca4 usb_process(c8533ccc,ed54ad08,c1187544,3d5,0,...) at usb_process+0xe6/frame 0xed54accc fork_exit(c0973fa0,c8533ccc,ed54ad08) at fork_exit+0x7f/frame 0xed54acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed54acf4 --- trap 0, eip = 0, esp = 0xed54ad40, ebp = 0 --- Tracing command usb pid 15 tid 100055 td 0xc852c620 sched_switch(c852c620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed547bd4 mi_switch(104,0,c1193e95,1f5,8,...) at mi_switch+0x1c9/frame 0xed547c08 sleepq_switch(c852c620,0,c1193e95,26b,c852c620,...) at sleepq_switch+0x1c5/frame 0xed547c3c sleepq_wait(c8533ca4,0,ed547c90,1,0,...) at sleepq_wait+0x48/frame 0xed547c60 _cv_wait(c8533ca4,c8533e4c,c116ad3b,77,c8533cac,...) at _cv_wait+0x1f9/frame 0xed547ca4 usb_process(c8533c9c,ed547d08,c1187544,3d5,0,...) at usb_process+0xe6/frame 0xed547ccc fork_exit(c0973fa0,c8533c9c,ed547d08) at fork_exit+0x7f/frame 0xed547cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed547cf4 --- trap 0, eip = 0, esp = 0xed547d40, ebp = 0 --- Tracing command usb pid 15 tid 100053 td 0xc852cc40 sched_switch(c852cc40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed53ebd4 mi_switch(104,0,c1193e95,1f5,8,...) at mi_switch+0x1c9/frame 0xed53ec08 sleepq_switch(c852cc40,0,c1193e95,26b,c852cc40,...) at sleepq_switch+0x1c5/frame 0xed53ec3c sleepq_wait(c8525b5c,0,ed53ec90,1,0,...) at sleepq_wait+0x48/frame 0xed53ec60 _cv_wait(c8525b5c,c8525c74,c116ad3b,77,c8525b64,...) at _cv_wait+0x1f9/frame 0xed53eca4 usb_process(c8525b54,ed53ed08,c1187544,3d5,0,...) at usb_process+0xe6/frame 0xed53eccc fork_exit(c0973fa0,c8525b54,ed53ed08) at fork_exit+0x7f/frame 0xed53ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed53ecf4 --- trap 0, eip = 0, esp = 0xed53ed40, ebp = 0 --- Tracing command usb pid 15 tid 100052 td 0xc84a9c40 sched_switch(c84a9c40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed53bbd4 mi_switch(104,0,c1193e95,1f5,8,...) at mi_switch+0x1c9/frame 0xed53bc08 sleepq_switch(c84a9c40,0,c1193e95,26b,c84a9c40,...) at sleepq_switch+0x1c5/frame 0xed53bc3c sleepq_wait(c8525b2c,0,ed53bc90,1,0,...) at sleepq_wait+0x48/frame 0xed53bc60 _cv_wait(c8525b2c,c8525c74,c116ad3b,77,c8525b34,...) at _cv_wait+0x1f9/frame 0xed53bca4 usb_process(c8525b24,ed53bd08,c1187544,3d5,0,...) at usb_process+0xe6/frame 0xed53bccc fork_exit(c0973fa0,c8525b24,ed53bd08) at fork_exit+0x7f/frame 0xed53bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed53bcf4 --- trap 0, eip = 0, esp = 0xed53bd40, ebp = 0 --- Tracing command usb pid 15 tid 100051 td 0xc8514000 sched_switch(c8514000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed538bd4 mi_switch(104,0,c1193e95,1f5,8,...) at mi_switch+0x1c9/frame 0xed538c08 sleepq_switch(c8514000,0,c1193e95,26b,c8514000,...) at sleepq_switch+0x1c5/frame 0xed538c3c sleepq_wait(c8525afc,0,ed538c90,1,0,...) at sleepq_wait+0x48/frame 0xed538c60 _cv_wait(c8525afc,c8525c74,c116ad3b,77,c8525b04,...) at _cv_wait+0x1f9/frame 0xed538ca4 usb_process(c8525af4,ed538d08,c1187544,3d5,0,...) at usb_process+0xe6/frame 0xed538ccc fork_exit(c0973fa0,c8525af4,ed538d08) at fork_exit+0x7f/frame 0xed538cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed538cf4 --- trap 0, eip = 0, esp = 0xed538d40, ebp = 0 --- Tracing command usb pid 15 tid 100050 td 0xc8514310 sched_switch(c8514310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed535bd4 mi_switch(104,0,c1193e95,1f5,8,...) at mi_switch+0x1c9/frame 0xed535c08 sleepq_switch(c8514310,0,c1193e95,26b,c8514310,...) at sleepq_switch+0x1c5/frame 0xed535c3c sleepq_wait(c8525acc,0,ed535c90,1,0,...) at sleepq_wait+0x48/frame 0xed535c60 _cv_wait(c8525acc,c8525c74,c116ad3b,77,c8525ad4,...) at _cv_wait+0x1f9/frame 0xed535ca4 usb_process(c8525ac4,ed535d08,c1187544,3d5,0,...) at usb_process+0xe6/frame 0xed535ccc fork_exit(c0973fa0,c8525ac4,ed535d08) at fork_exit+0x7f/frame 0xed535cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed535cf4 --- trap 0, eip = 0, esp = 0xed535d40, ebp = 0 --- Tracing command usb pid 15 tid 100049 td 0xc8514620 sched_switch(c8514620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed531bd4 mi_switch(104,0,c1193e95,1f5,8,...) at mi_switch+0x1c9/frame 0xed531c08 sleepq_switch(c8514620,0,c1193e95,26b,c8514620,...) at sleepq_switch+0x1c5/frame 0xed531c3c sleepq_wait(c851fb5c,0,ed531c90,1,0,...) at sleepq_wait+0x48/frame 0xed531c60 _cv_wait(c851fb5c,c851fc74,c116ad3b,77,c851fb64,...) at _cv_wait+0x1f9/frame 0xed531ca4 usb_process(c851fb54,ed531d08,c1187544,3d5,0,...) at usb_process+0xe6/frame 0xed531ccc fork_exit(c0973fa0,c851fb54,ed531d08) at fork_exit+0x7f/frame 0xed531cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed531cf4 --- trap 0, eip = 0, esp = 0xed531d40, ebp = 0 --- Tracing command usb pid 15 tid 100048 td 0xc8514930 sched_switch(c8514930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed52ebd4 mi_switch(104,0,c1193e95,1f5,8,...) at mi_switch+0x1c9/frame 0xed52ec08 sleepq_switch(c8514930,0,c1193e95,26b,c8514930,...) at sleepq_switch+0x1c5/frame 0xed52ec3c sleepq_wait(c851fb2c,0,ed52ec90,1,0,...) at sleepq_wait+0x48/frame 0xed52ec60 _cv_wait(c851fb2c,c851fc74,c116ad3b,77,c851fb34,...) at _cv_wait+0x1f9/frame 0xed52eca4 usb_process(c851fb24,ed52ed08,c1187544,3d5,0,...) at usb_process+0xe6/frame 0xed52eccc fork_exit(c0973fa0,c851fb24,ed52ed08) at fork_exit+0x7f/frame 0xed52ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed52ecf4 --- trap 0, eip = 0, esp = 0xed52ed40, ebp = 0 --- Tracing command usb pid 15 tid 100047 td 0xc8514c40 sched_switch(c8514c40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed52bbd4 mi_switch(104,0,c1193e95,1f5,8,...) at mi_switch+0x1c9/frame 0xed52bc08 sleepq_switch(c8514c40,0,c1193e95,26b,c8514c40,...) at sleepq_switch+0x1c5/frame 0xed52bc3c sleepq_wait(c851fafc,0,ed52bc90,1,0,...) at sleepq_wait+0x48/frame 0xed52bc60 _cv_wait(c851fafc,c851fc74,c116ad3b,77,c851fb04,...) at _cv_wait+0x1f9/frame 0xed52bca4 usb_process(c851faf4,ed52bd08,c1187544,3d5,0,...) at usb_process+0xe6/frame 0xed52bccc fork_exit(c0973fa0,c851faf4,ed52bd08) at fork_exit+0x7f/frame 0xed52bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed52bcf4 --- trap 0, eip = 0, esp = 0xed52bd40, ebp = 0 --- Tracing command usb pid 15 tid 100046 td 0xc8515000 sched_switch(c8515000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed528bd4 mi_switch(104,0,c1193e95,1f5,8,...) at mi_switch+0x1c9/frame 0xed528c08 sleepq_switch(c8515000,0,c1193e95,26b,c8515000,...) at sleepq_switch+0x1c5/frame 0xed528c3c sleepq_wait(c851facc,0,ed528c90,1,0,...) at sleepq_wait+0x48/frame 0xed528c60 _cv_wait(c851facc,c851fc74,c116ad3b,77,c851fad4,...) at _cv_wait+0x1f9/frame 0xed528ca4 usb_process(c851fac4,ed528d08,c1187544,3d5,0,...) at usb_process+0xe6/frame 0xed528ccc fork_exit(c0973fa0,c851fac4,ed528d08) at fork_exit+0x7f/frame 0xed528cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed528cf4 --- trap 0, eip = 0, esp = 0xed528d40, ebp = 0 --- Tracing command usb pid 15 tid 100045 td 0xc8515310 sched_switch(c8515310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed524bd4 mi_switch(104,0,c1193e95,1f5,8,...) at mi_switch+0x1c9/frame 0xed524c08 sleepq_switch(c8515310,0,c1193e95,26b,c8515310,...) at sleepq_switch+0x1c5/frame 0xed524c3c sleepq_wait(c8517b5c,0,ed524c90,1,0,...) at sleepq_wait+0x48/frame 0xed524c60 _cv_wait(c8517b5c,c8517c74,c116ad3b,77,c8517b64,...) at _cv_wait+0x1f9/frame 0xed524ca4 usb_process(c8517b54,ed524d08,c1187544,3d5,0,...) at usb_process+0xe6/frame 0xed524ccc fork_exit(c0973fa0,c8517b54,ed524d08) at fork_exit+0x7f/frame 0xed524cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed524cf4 --- trap 0, eip = 0, esp = 0xed524d40, ebp = 0 --- Tracing command usb pid 15 tid 100044 td 0xc8515620 sched_switch(c8515620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed521bd4 mi_switch(104,0,c1193e95,1f5,8,...) at mi_switch+0x1c9/frame 0xed521c08 sleepq_switch(c8515620,0,c1193e95,26b,c8515620,...) at sleepq_switch+0x1c5/frame 0xed521c3c sleepq_wait(c8517b2c,0,ed521c90,1,0,...) at sleepq_wait+0x48/frame 0xed521c60 _cv_wait(c8517b2c,c8517c74,c116ad3b,77,c8517b34,...) at _cv_wait+0x1f9/frame 0xed521ca4 usb_process(c8517b24,ed521d08,c1187544,3d5,0,...) at usb_process+0xe6/frame 0xed521ccc fork_exit(c0973fa0,c8517b24,ed521d08) at fork_exit+0x7f/frame 0xed521cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed521cf4 --- trap 0, eip = 0, esp = 0xed521d40, ebp = 0 --- Tracing command usb pid 15 tid 100043 td 0xc8515930 sched_switch(c8515930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed51ebd4 mi_switch(104,0,c1193e95,1f5,8,...) at mi_switch+0x1c9/frame 0xed51ec08 sleepq_switch(c8515930,0,c1193e95,26b,c8515930,...) at sleepq_switch+0x1c5/frame 0xed51ec3c sleepq_wait(c8517afc,0,ed51ec90,1,0,...) at sleepq_wait+0x48/frame 0xed51ec60 _cv_wait(c8517afc,c8517c74,c116ad3b,77,c8517b04,...) at _cv_wait+0x1f9/frame 0xed51eca4 usb_process(c8517af4,ed51ed08,c1187544,3d5,0,...) at usb_process+0xe6/frame 0xed51eccc fork_exit(c0973fa0,c8517af4,ed51ed08) at fork_exit+0x7f/frame 0xed51ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed51ecf4 --- trap 0, eip = 0, esp = 0xed51ed40, ebp = 0 --- Tracing command usb pid 15 tid 100042 td 0xc8515c40 sched_switch(c8515c40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed51bbd4 mi_switch(104,0,c1193e95,1f5,8,...) at mi_switch+0x1c9/frame 0xed51bc08 sleepq_switch(c8515c40,0,c1193e95,26b,c8515c40,...) at sleepq_switch+0x1c5/frame 0xed51bc3c sleepq_wait(c8517acc,0,ed51bc90,1,0,...) at sleepq_wait+0x48/frame 0xed51bc60 _cv_wait(c8517acc,c8517c74,c116ad3b,77,c8517ad4,...) at _cv_wait+0x1f9/frame 0xed51bca4 usb_process(c8517ac4,ed51bd08,c1187544,3d5,0,...) at usb_process+0xe6/frame 0xed51bccc fork_exit(c0973fa0,c8517ac4,ed51bd08) at fork_exit+0x7f/frame 0xed51bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed51bcf4 --- trap 0, eip = 0, esp = 0xed51bd40, ebp = 0 --- Tracing command usb pid 15 tid 100040 td 0xc8516310 sched_switch(c8516310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed514bd4 mi_switch(104,0,c1193e95,1f5,8,...) at mi_switch+0x1c9/frame 0xed514c08 sleepq_switch(c8516310,0,c1193e95,26b,c8516310,...) at sleepq_switch+0x1c5/frame 0xed514c3c sleepq_wait(c850cb5c,0,ed514c90,1,0,...) at sleepq_wait+0x48/frame 0xed514c60 _cv_wait(c850cb5c,c850cc74,c116ad3b,77,c850cb64,...) at _cv_wait+0x1f9/frame 0xed514ca4 usb_process(c850cb54,ed514d08,c1187544,3d5,0,...) at usb_process+0xe6/frame 0xed514ccc fork_exit(c0973fa0,c850cb54,ed514d08) at fork_exit+0x7f/frame 0xed514cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed514cf4 --- trap 0, eip = 0, esp = 0xed514d40, ebp = 0 --- Tracing command usb pid 15 tid 100039 td 0xc83a7310 sched_switch(c83a7310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed511bd4 mi_switch(104,0,c1193e95,1f5,8,...) at mi_switch+0x1c9/frame 0xed511c08 sleepq_switch(c83a7310,0,c1193e95,26b,c83a7310,...) at sleepq_switch+0x1c5/frame 0xed511c3c sleepq_wait(c850cb2c,0,ed511c90,1,0,...) at sleepq_wait+0x48/frame 0xed511c60 _cv_wait(c850cb2c,c850cc74,c116ad3b,77,c850cb34,...) at _cv_wait+0x1f9/frame 0xed511ca4 usb_process(c850cb24,ed511d08,c1187544,3d5,0,...) at usb_process+0xe6/frame 0xed511ccc fork_exit(c0973fa0,c850cb24,ed511d08) at fork_exit+0x7f/frame 0xed511cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed511cf4 --- trap 0, eip = 0, esp = 0xed511d40, ebp = 0 --- Tracing command usb pid 15 tid 100038 td 0xc83a7620 sched_switch(c83a7620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed50ebd4 mi_switch(104,0,c1193e95,1f5,8,...) at mi_switch+0x1c9/frame 0xed50ec08 sleepq_switch(c83a7620,0,c1193e95,26b,c83a7620,...) at sleepq_switch+0x1c5/frame 0xed50ec3c sleepq_wait(c850cafc,0,ed50ec90,1,0,...) at sleepq_wait+0x48/frame 0xed50ec60 _cv_wait(c850cafc,c850cc74,c116ad3b,77,c850cb04,...) at _cv_wait+0x1f9/frame 0xed50eca4 usb_process(c850caf4,ed50ed08,c1187544,3d5,0,...) at usb_process+0xe6/frame 0xed50eccc fork_exit(c0973fa0,c850caf4,ed50ed08) at fork_exit+0x7f/frame 0xed50ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed50ecf4 --- trap 0, eip = 0, esp = 0xed50ed40, ebp = 0 --- Tracing command usb pid 15 tid 100037 td 0xc83a7930 sched_switch(c83a7930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed50bbd4 mi_switch(104,0,c1193e95,1f5,8,...) at mi_switch+0x1c9/frame 0xed50bc08 sleepq_switch(c83a7930,0,c1193e95,26b,c83a7930,...) at sleepq_switch+0x1c5/frame 0xed50bc3c sleepq_wait(c850cacc,0,ed50bc90,1,0,...) at sleepq_wait+0x48/frame 0xed50bc60 _cv_wait(c850cacc,c850cc74,c116ad3b,77,c850cad4,...) at _cv_wait+0x1f9/frame 0xed50bca4 usb_process(c850cac4,ed50bd08,c1187544,3d5,0,...) at usb_process+0xe6/frame 0xed50bccc fork_exit(c0973fa0,c850cac4,ed50bd08) at fork_exit+0x7f/frame 0xed50bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed50bcf4 --- trap 0, eip = 0, esp = 0xed50bd40, ebp = 0 --- Tracing command usb pid 15 tid 100035 td 0xc84a8000 sched_switch(c84a8000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed504bd4 mi_switch(104,0,c1193e95,1f5,8,...) at mi_switch+0x1c9/frame 0xed504c08 sleepq_switch(c84a8000,0,c1193e95,26b,c84a8000,...) at sleepq_switch+0x1c5/frame 0xed504c3c sleepq_wait(c8509b5c,0,ed504c90,1,0,...) at sleepq_wait+0x48/frame 0xed504c60 _cv_wait(c8509b5c,c8509c74,c116ad3b,77,c8509b64,...) at _cv_wait+0x1f9/frame 0xed504ca4 usb_process(c8509b54,ed504d08,c1187544,3d5,0,...) at usb_process+0xe6/frame 0xed504ccc fork_exit(c0973fa0,c8509b54,ed504d08) at fork_exit+0x7f/frame 0xed504cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed504cf4 --- trap 0, eip = 0, esp = 0xed504d40, ebp = 0 --- Tracing command usb pid 15 tid 100034 td 0xc84a8310 sched_switch(c84a8310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed501bd4 mi_switch(104,0,c1193e95,1f5,8,...) at mi_switch+0x1c9/frame 0xed501c08 sleepq_switch(c84a8310,0,c1193e95,26b,c84a8310,...) at sleepq_switch+0x1c5/frame 0xed501c3c sleepq_wait(c8509b2c,0,ed501c90,1,0,...) at sleepq_wait+0x48/frame 0xed501c60 _cv_wait(c8509b2c,c8509c74,c116ad3b,77,c8509b34,...) at _cv_wait+0x1f9/frame 0xed501ca4 usb_process(c8509b24,ed501d08,c1187544,3d5,0,...) at usb_process+0xe6/frame 0xed501ccc fork_exit(c0973fa0,c8509b24,ed501d08) at fork_exit+0x7f/frame 0xed501cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed501cf4 --- trap 0, eip = 0, esp = 0xed501d40, ebp = 0 --- Tracing command usb pid 15 tid 100033 td 0xc84a8620 sched_switch(c84a8620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed4febd4 mi_switch(104,0,c1193e95,1f5,8,...) at mi_switch+0x1c9/frame 0xed4fec08 sleepq_switch(c84a8620,0,c1193e95,26b,c84a8620,...) at sleepq_switch+0x1c5/frame 0xed4fec3c sleepq_wait(c8509afc,0,ed4fec90,1,0,...) at sleepq_wait+0x48/frame 0xed4fec60 _cv_wait(c8509afc,c8509c74,c116ad3b,77,c8509b04,...) at _cv_wait+0x1f9/frame 0xed4feca4 usb_process(c8509af4,ed4fed08,c1187544,3d5,0,...) at usb_process+0xe6/frame 0xed4feccc fork_exit(c0973fa0,c8509af4,ed4fed08) at fork_exit+0x7f/frame 0xed4fecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed4fecf4 --- trap 0, eip = 0, esp = 0xed4fed40, ebp = 0 --- Tracing command usb pid 15 tid 100032 td 0xc84a8930 sched_switch(c84a8930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed4fbbd4 mi_switch(104,0,c1193e95,1f5,8,...) at mi_switch+0x1c9/frame 0xed4fbc08 sleepq_switch(c84a8930,0,c1193e95,26b,c84a8930,...) at sleepq_switch+0x1c5/frame 0xed4fbc3c sleepq_wait(c8509acc,0,ed4fbc90,1,0,...) at sleepq_wait+0x48/frame 0xed4fbc60 _cv_wait(c8509acc,c8509c74,c116ad3b,77,c8509ad4,...) at _cv_wait+0x1f9/frame 0xed4fbca4 usb_process(c8509ac4,ed4fbd08,c1187544,3d5,0,...) at usb_process+0xe6/frame 0xed4fbccc fork_exit(c0973fa0,c8509ac4,ed4fbd08) at fork_exit+0x7f/frame 0xed4fbcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed4fbcf4 --- trap 0, eip = 0, esp = 0xed4fbd40, ebp = 0 --- Tracing command rand_harvestq pid 14 tid 100017 td 0xc83a6620 sched_switch(c83a6620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xe4378bb4 mi_switch(104,0,c1193e95,1f5,c1322548,...) at mi_switch+0x1c9/frame 0xe4378be8 sleepq_switch(c83a6620,0,c1193e95,28e,c12ebe30,...) at sleepq_switch+0x1c5/frame 0xe4378c1c sleepq_timedwait(c12ebe30,0,c118e8fd,c11797ce,0,...) at sleepq_timedwait+0x48/frame 0xe4378c40 msleep_spin_sbt(c12ebe30,c14cefcc,c11797ce,19999999,0,...) at msleep_spin_sbt+0x225/frame 0xe4378c88 random_kthread(c08631b0,e4378d08,c1187544,3d5,0,...) at random_kthread+0x1cb/frame 0xe4378ccc fork_exit(c0862230,c08631b0,e4378d08) at fork_exit+0x7f/frame 0xe4378cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4378cf4 --- trap 0, eip = 0, esp = 0xe4378d40, ebp = 0 --- Tracing command geom pid 13 tid 100015 td 0xc83a6c40 sched_switch(c83a6c40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xe4372b70 mi_switch(104,0,c1193e95,1f5,162,...) at mi_switch+0x1c9/frame 0xe4372ba4 sleepq_switch(c83a6c40,0,c1193e95,26b,c14d50cc,...) at sleepq_switch+0x1c5/frame 0xe4372bd8 sleepq_wait(c14d50cc,5c,c11797ce,0,0,...) at sleepq_wait+0x48/frame 0xe4372bfc _sleep(c14d50cc,c1303bdc,25c,c11797ce,0,...) at _sleep+0x385/frame 0xe4372c58 g_io_schedule_down(c83a6c40,0,c117b4f2,6c,e4372cf4,...) at g_io_schedule_down+0x5c/frame 0xe4372cb4 g_down_procbody(0,e4372d08,c1187544,3d5,0,...) at g_down_procbody+0x9d/frame 0xe4372ccc fork_exit(c0a233b0,0,e4372d08) at fork_exit+0x7f/frame 0xe4372cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4372cf4 --- trap 0, eip = 0, esp = 0xe4372d40, ebp = 0 --- Tracing command geom pid 13 tid 100014 td 0xc83a7000 sched_switch(c83a7000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xe436fb98 mi_switch(104,0,c1193e95,1f5,162,...) at mi_switch+0x1c9/frame 0xe436fbcc sleepq_switch(c83a7000,0,c1193e95,26b,c14d50c8,...) at sleepq_switch+0x1c5/frame 0xe436fc00 sleepq_wait(c14d50c8,5c,c11797ce,0,0,...) at sleepq_wait+0x48/frame 0xe436fc24 _sleep(c14d50c8,c1303bfc,25c,c11797ce,0,...) at _sleep+0x385/frame 0xe436fc80 g_io_schedule_up(c83a7000,0,c117b4f2,5f,e436fcf4,...) at g_io_schedule_up+0xe6/frame 0xe436fcb4 g_up_procbody(0,e436fd08,c1187544,3d5,0,...) at g_up_procbody+0x9d/frame 0xe436fccc fork_exit(c0a23310,0,e436fd08) at fork_exit+0x7f/frame 0xe436fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe436fcf4 --- trap 0, eip = 0, esp = 0xe436fd40, ebp = 0 --- Tracing command geom pid 13 tid 100013 td 0xc82ec000 sched_switch(c82ec000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xe436cba8 mi_switch(104,0,c1193e95,1f5,162,...) at mi_switch+0x1c9/frame 0xe436cbdc sleepq_switch(c82ec000,0,c1193e95,26b,c14d50c4,...) at sleepq_switch+0x1c5/frame 0xe436cc10 sleepq_wait(c14d50c4,5c,c11797ce,0,0,...) at sleepq_wait+0x48/frame 0xe436cc34 _sleep(c14d50c4,c1303bb4,25c,c11797ce,0,...) at _sleep+0x385/frame 0xe436cc90 g_run_events(0,e436cd08,c1187544,3d5,0,...) at g_run_events+0x586/frame 0xe436cccc fork_exit(c0a23270,0,e436cd08) at fork_exit+0x7f/frame 0xe436ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe436ccf4 --- trap 0, eip = 0, esp = 0xe436cd40, ebp = 0 --- Tracing command intr pid 12 tid 100063 td 0xc8516c40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100062 td 0xc852b000 sched_switch(c852b000,0,109,1bb,0,...) at sched_switch+0x4b9/frame 0xed577c60 mi_switch(109,0,c11877b5,55a,8,...) at mi_switch+0x1c9/frame 0xed577c94 ithread_loop(c8342450,ed577d08,c1187544,3d5,0,...) at ithread_loop+0x201/frame 0xed577ccc fork_exit(c0a95440,c8342450,ed577d08) at fork_exit+0x7f/frame 0xed577cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed577cf4 --- trap 0, eip = 0, esp = 0xed577d40, ebp = 0 --- Tracing command intr pid 12 tid 100060 td 0xc852b620 sched_switch(c852b620,0,109,1bb,0,...) at sched_switch+0x4b9/frame 0xed567c60 mi_switch(109,0,c11877b5,55a,8,...) at mi_switch+0x1c9/frame 0xed567c94 ithread_loop(c8342460,ed567d08,c1187544,3d5,0,...) at ithread_loop+0x201/frame 0xed567ccc fork_exit(c0a95440,c8342460,ed567d08) at fork_exit+0x7f/frame 0xed567cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed567cf4 --- trap 0, eip = 0, esp = 0xed567d40, ebp = 0 --- Tracing command intr pid 12 tid 100059 td 0xc852b930 sched_switch(c852b930,0,109,1bb,0,...) at sched_switch+0x4b9/frame 0xed556c60 mi_switch(109,0,c11877b5,55a,8,...) at mi_switch+0x1c9/frame 0xed556c94 ithread_loop(c8342470,ed556d08,c1187544,3d5,0,...) at ithread_loop+0x201/frame 0xed556ccc fork_exit(c0a95440,c8342470,ed556d08) at fork_exit+0x7f/frame 0xed556cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed556cf4 --- trap 0, eip = 0, esp = 0xed556d40, ebp = 0 --- Tracing command intr pid 12 tid 100054 td 0xc852c930 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xc8516000 sched_switch(c8516000,0,109,1bb,0,...) at sched_switch+0x4b9/frame 0xed518c60 mi_switch(109,0,c11877b5,55a,8,...) at mi_switch+0x1c9/frame 0xed518c94 ithread_loop(c8342490,ed518d08,c1187544,3d5,0,...) at ithread_loop+0x201/frame 0xed518ccc fork_exit(c0a95440,c8342490,ed518d08) at fork_exit+0x7f/frame 0xed518cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed518cf4 --- trap 0, eip = 0, esp = 0xed518d40, ebp = 0 --- Tracing command intr pid 12 tid 100036 td 0xc83a7c40 sched_switch(c83a7c40,0,109,1bb,0,...) at sched_switch+0x4b9/frame 0xed508c60 mi_switch(109,0,c11877b5,55a,8,...) at mi_switch+0x1c9/frame 0xed508c94 ithread_loop(c83424a0,ed508d08,c1187544,3d5,0,...) at ithread_loop+0x201/frame 0xed508ccc fork_exit(c0a95440,c83424a0,ed508d08) at fork_exit+0x7f/frame 0xed508cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed508cf4 --- trap 0, eip = 0, esp = 0xed508d40, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xc84a8c40 sched_switch(c84a8c40,0,109,1bb,0,...) at sched_switch+0x4b9/frame 0xed4f8c60 mi_switch(109,0,c11877b5,55a,8,...) at mi_switch+0x1c9/frame 0xed4f8c94 ithread_loop(c83424b0,ed4f8d08,c1187544,3d5,0,...) at ithread_loop+0x201/frame 0xed4f8ccc fork_exit(c0a95440,c83424b0,ed4f8d08) at fork_exit+0x7f/frame 0xed4f8cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed4f8cf4 --- trap 0, eip = 0, esp = 0xed4f8d40, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc84a9000 sched_switch(c84a9000,0,109,1bb,0,...) at sched_switch+0x4b9/frame 0xf0ad6c60 mi_switch(109,0,c11877b5,55a,8,...) at mi_switch+0x1c9/frame 0xf0ad6c94 ithread_loop(c83424c0,f0ad6d08,c1187544,3d5,0,...) at ithread_loop+0x201/frame 0xf0ad6ccc fork_exit(c0a95440,c83424c0,f0ad6d08) at fork_exit+0x7f/frame 0xf0ad6cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf0ad6cf4 --- trap 0, eip = 0, esp = 0xf0ad6d40, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc84a9310 sched_switch(c84a9310,0,109,1bb,0,...) at sched_switch+0x4b9/frame 0xf0ad2c60 mi_switch(109,0,c11877b5,55a,8,...) at mi_switch+0x1c9/frame 0xf0ad2c94 ithread_loop(c83424d0,f0ad2d08,c1187544,3d5,0,...) at ithread_loop+0x201/frame 0xf0ad2ccc fork_exit(c0a95440,c83424d0,f0ad2d08) at fork_exit+0x7f/frame 0xf0ad2cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf0ad2cf4 --- trap 0, eip = 0, esp = 0xf0ad2d40, ebp = 0 --- Tracing command intr pid 12 tid 100028 td 0xc84a9620 sched_switch(c84a9620,0,109,1bb,0,...) at sched_switch+0x4b9/frame 0xe43c9c60 mi_switch(109,0,c11877b5,55a,8,...) at mi_switch+0x1c9/frame 0xe43c9c94 ithread_loop(c83424e0,e43c9d08,c1187544,3d5,0,...) at ithread_loop+0x201/frame 0xe43c9ccc fork_exit(c0a95440,c83424e0,e43c9d08) at fork_exit+0x7f/frame 0xe43c9cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe43c9cf4 --- trap 0, eip = 0, esp = 0xe43c9d40, ebp = 0 --- Tracing command intr pid 12 tid 100027 td 0xc84a9930 sched_switch(c84a9930,0,109,1bb,0,...) at sched_switch+0x4b9/frame 0xe4397c60 mi_switch(109,0,c11877b5,55a,8,...) at mi_switch+0x1c9/frame 0xe4397c94 ithread_loop(c8342730,e4397d08,c1187544,3d5,0,...) at ithread_loop+0x201/frame 0xe4397ccc fork_exit(c0a95440,c8342730,e4397d08) at fork_exit+0x7f/frame 0xe4397cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4397cf4 --- trap 0, eip = 0, esp = 0xe4397d40, ebp = 0 --- Tracing command intr pid 12 tid 100026 td 0xc82f6930 sched_switch(c82f6930,0,109,1bb,0,...) at sched_switch+0x4b9/frame 0xe4394c60 mi_switch(109,0,c11877b5,55a,8,...) at mi_switch+0x1c9/frame 0xe4394c94 ithread_loop(c8342740,e4394d08,c1187544,3d5,0,...) at ithread_loop+0x201/frame 0xe4394ccc fork_exit(c0a95440,c8342740,e4394d08) at fork_exit+0x7f/frame 0xe4394cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4394cf4 --- trap 0, eip = 0, esp = 0xe4394d40, ebp = 0 --- Tracing command intr pid 12 tid 100021 td 0xc83a5930 sched_switch(c83a5930,0,109,1bb,0,...) at sched_switch+0x4b9/frame 0xe4385c60 mi_switch(109,0,c11877b5,55a,8,...) at mi_switch+0x1c9/frame 0xe4385c94 ithread_loop(c8342750,e4385d08,c1187544,3d5,0,...) at ithread_loop+0x201/frame 0xe4385ccc fork_exit(c0a95440,c8342750,e4385d08) at fork_exit+0x7f/frame 0xe4385cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4385cf4 --- trap 0, eip = 0, esp = 0xe4385d40, ebp = 0 --- Tracing command intr pid 12 tid 100020 td 0xc83a5c40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100012 td 0xc82ec310 sched_switch(c82ec310,0,109,1bb,0,...) at sched_switch+0x4b9/frame 0xe4369c60 mi_switch(109,0,c11877b5,55a,8,...) at mi_switch+0x1c9/frame 0xe4369c94 ithread_loop(c8342770,e4369d08,c1187544,3d5,0,...) at ithread_loop+0x201/frame 0xe4369ccc fork_exit(c0a95440,c8342770,e4369d08) at fork_exit+0x7f/frame 0xe4369cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4369cf4 --- trap 0, eip = 0, esp = 0xe4369d40, ebp = 0 --- Tracing command intr pid 12 tid 100011 td 0xc82ec620 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100010 td 0xc82ec930 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100009 td 0xc82ecc40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100008 td 0xc82f5000 sched_switch(c82f5000,0,109,1bb,0,...) at sched_switch+0x4b9/frame 0xe435dc60 mi_switch(109,0,c11877b5,55a,8,...) at mi_switch+0x1c9/frame 0xe435dc94 ithread_loop(c83427b0,e435dd08,c1187544,3d5,0,...) at ithread_loop+0x201/frame 0xe435dccc fork_exit(c0a95440,c83427b0,e435dd08) at fork_exit+0x7f/frame 0xe435dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe435dcf4 --- trap 0, eip = 0, esp = 0xe435dd40, ebp = 0 --- Tracing command intr pid 12 tid 100007 td 0xc82f5310 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100006 td 0xc82f5620 cpustop_handler(3,13,e4356bf0,c0f5ee0e,c1314090,...) at cpustop_handler+0x2f/frame 0xe4356a98 ipi_nmi_handler(c1314090,4,c11902c9,917,c84a9000,...) at ipi_nmi_handler+0x37/frame 0xe4356aa8 trap(e4356bfc) at trap+0x3e/frame 0xe4356bf0 calltrap() at calltrap+0x6/frame 0xe4356bf0 --- trap 0x13, eip = 0xc0f4e685, esp = 0xe4356c3c, ebp = 0xe4356c50 --- cpu_idle(1,2,c11902c9,a4e,c1314108,...) at cpu_idle+0xc5/frame 0xe4356c50 sched_idletd(0,e4356d08,c1187544,3d5,0,...) at sched_idletd+0x1d6/frame 0xe4356ccc fork_exit(c0aed4f0,0,e4356d08) at fork_exit+0x7f/frame 0xe4356cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4356cf4 --- trap 0, eip = 0, esp = 0xe4356d40, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc82f5930 sched_switch(c82f5930,0,108,1b6,e4353c50,...) at sched_switch+0x4b9/frame 0xe4353c1c mi_switch(108,0,c11902c9,a4c,c1313a08,...) at mi_switch+0x1c9/frame 0xe4353c50 sched_idletd(0,e4353d08,c1187544,3d5,0,...) at sched_idletd+0xf1/frame 0xe4353ccc fork_exit(c0aed4f0,0,e4353d08) at fork_exit+0x7f/frame 0xe4353cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4353cf4 --- trap 0, eip = 0, esp = 0xe4353d40, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc82f5c40 cpustop_handler(1,13,e4350bf0,c0f5ee0e,c1313290,...) at cpustop_handler+0x2f/frame 0xe4350a98 ipi_nmi_handler(c1313290,1,40a95b,0,0,...) at ipi_nmi_handler+0x37/frame 0xe4350aa8 trap(e4350bfc) at trap+0x3e/frame 0xe4350bf0 calltrap() at calltrap+0x6/frame 0xe4350bf0 --- trap 0x13, eip = 0xc0f4e685, esp = 0xe4350c3c, ebp = 0xe4350c50 --- cpu_idle(1,2,c11902c9,a4e,c1313308,...) at cpu_idle+0xc5/frame 0xe4350c50 sched_idletd(0,e4350d08,c1187544,3d5,0,...) at sched_idletd+0x1d6/frame 0xe4350ccc fork_exit(c0aed4f0,0,e4350d08) at fork_exit+0x7f/frame 0xe4350cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4350cf4 --- trap 0, eip = 0, esp = 0xe4350d40, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xc82f6000 cpustop_handler(0,13,e434dbf0,c0f5ee0e,c1312b90,...) at cpustop_handler+0x2f/frame 0xe434da98 ipi_nmi_handler(c1312b90,0,40cbb9,0,0,...) at ipi_nmi_handler+0x37/frame 0xe434daa8 trap(e434dbfc) at trap+0x3e/frame 0xe434dbf0 calltrap() at calltrap+0x6/frame 0xe434dbf0 --- trap 0x13, eip = 0xc0f4e685, esp = 0xe434dc3c, ebp = 0xe434dc50 --- cpu_idle(1,2,c11902c9,a4e,c1312c08,...) at cpu_idle+0xc5/frame 0xe434dc50 sched_idletd(0,e434dd08,c1187544,3d5,0,...) at sched_idletd+0x1d6/frame 0xe434dccc fork_exit(c0aed4f0,0,e434dd08) at fork_exit+0x7f/frame 0xe434dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe434dcf4 --- trap 0, eip = 0, esp = 0xe434dd40, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc82f6310 sched_switch(c82f6310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xe434998c mi_switch(104,0,c1193e95,1f5,c1193e95,...) at mi_switch+0x1c9/frame 0xe43499c0 sleepq_switch(c82f6310,0,c1193e95,1ab,e4349a38,...) at sleepq_switch+0x1c5/frame 0xe43499f4 sleepq_catch_signals(0,c1193e95,162,870,c82eb2e8,...) at sleepq_catch_signals+0x36c/frame 0xe4349a3c sleepq_wait_sig(c82eb2e8,6c,c1197b21,100,0,...) at sleepq_wait_sig+0x14/frame 0xe4349a60 _sleep(c82eb2e8,c82eb37c,16c,c1197b21,0,...) at _sleep+0x364/frame 0xe4349abc kern_wait6(c82f6310,7,0,0,e4349b4c,...) at kern_wait6+0x45c/frame 0xe4349b20 sys_wait4(c82f6310,e4349cc8,c11e97be,d6,e4349ccc,...) at sys_wait4+0x94/frame 0xe4349c40 syscall(e4349d08) at syscall+0x2ed/frame 0xe4349cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xe4349cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x805eae7, esp = 0xbfbfd8bc, ebp = 0xbfbfd8d0 --- Tracing command audit pid 10 tid 100001 td 0xc82f6620 sched_switch(c82f6620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xe4346ba8 mi_switch(104,0,c1193e95,1f5,8,...) at mi_switch+0x1c9/frame 0xe4346bdc sleepq_switch(c82f6620,0,c1193e95,26b,c82f6620,...) at sleepq_switch+0x1c5/frame 0xe4346c10 sleepq_wait(c14dae38,0,e4346c64,1,0,...) at sleepq_wait+0x48/frame 0xe4346c34 _cv_wait(c14dae38,c14dadc4,c11c0832,18d,0,...) at _cv_wait+0x1f9/frame 0xe4346c78 audit_worker(0,e4346d08,c1187544,3d5,0,...) at audit_worker+0x94/frame 0xe4346ccc fork_exit(c0cee400,0,e4346d08) at fork_exit+0x7f/frame 0xe4346cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4346cf4 --- trap 0, eip = 0, esp = 0xe4346d40, ebp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xc8516620 sched_switch(c8516620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed580b68 mi_switch(104,0,c1193e95,1f5,101,...) at mi_switch+0x1c9/frame 0xed580b9c sleepq_switch(c8516620,0,c1193e95,28e,c130587d,...) at sleepq_switch+0x1c5/frame 0xed580bd0 sleepq_timedwait(c130587d,0,2,0,0,...) at sleepq_timedwait+0x48/frame 0xed580bf4 _sleep(c130587d,0,0,c11797ce,fffffc88,...) at _sleep+0x350/frame 0xed580c50 pause_sbt(c11797ce,fffffc88,2,0,0,...) at pause_sbt+0xe9/frame 0xed580c8c deadlkres(0,ed580d08,c1187544,3d5,0,...) at deadlkres+0x82/frame 0xed580ccc fork_exit(c0a73700,0,ed580d08) at fork_exit+0x7f/frame 0xed580cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed580cf4 --- trap 0, eip = 0, esp = 0xed580d40, ebp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xc8516930 sched_switch(c8516930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed57dbc0 mi_switch(104,0,c1193e95,1f5,c1321f78,...) at mi_switch+0x1c9/frame 0xed57dbf4 sleepq_switch(c8516930,0,c1193e95,26b,c83ad080,...) at sleepq_switch+0x1c5/frame 0xed57dc28 sleepq_wait(c83ad080,0,c118e8fd,c11797ce,0,...) at sleepq_wait+0x48/frame 0xed57dc4c msleep_spin_sbt(c83ad080,c83ad098,c11797ce,0,0,...) at msleep_spin_sbt+0x239/frame 0xed57dc94 taskqueue_thread_loop(c14ccb00,ed57dd08,c1187544,3d5,0,...) at taskqueue_thread_loop+0xcc/frame 0xed57dccc fork_exit(c0b0ec80,c14ccb00,ed57dd08) at fork_exit+0x7f/frame 0xed57dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed57dcf4 --- trap 0, eip = 0, esp = 0xed57dd40, ebp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xc82f6c40 sched_switch(c82f6c40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xe4391bc0 mi_switch(104,0,c1193e95,1f5,c13224e8,...) at mi_switch+0x1c9/frame 0xe4391bf4 sleepq_switch(c82f6c40,0,c1193e95,26b,c83b0a80,...) at sleepq_switch+0x1c5/frame 0xe4391c28 sleepq_wait(c83b0a80,0,c118e8fd,c11797ce,0,...) at sleepq_wait+0x48/frame 0xe4391c4c msleep_spin_sbt(c83b0a80,c83b0a98,c11797ce,0,0,...) at msleep_spin_sbt+0x239/frame 0xe4391c94 taskqueue_thread_loop(c14cd624,e4391d08,c1187544,3d5,0,...) at taskqueue_thread_loop+0xcc/frame 0xe4391ccc fork_exit(c0b0ec80,c14cd624,e4391d08) at fork_exit+0x7f/frame 0xe4391cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4391cf4 --- trap 0, eip = 0, esp = 0xe4391d40, ebp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xc83a5000 sched_switch(c83a5000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xe438ebc0 mi_switch(104,0,c1193e95,1f5,c13224e8,...) at mi_switch+0x1c9/frame 0xe438ebf4 sleepq_switch(c83a5000,0,c1193e95,26b,c83b0a80,...) at sleepq_switch+0x1c5/frame 0xe438ec28 sleepq_wait(c83b0a80,0,c118e8fd,c11797ce,0,...) at sleepq_wait+0x48/frame 0xe438ec4c msleep_spin_sbt(c83b0a80,c83b0a98,c11797ce,0,0,...) at msleep_spin_sbt+0x239/frame 0xe438ec94 taskqueue_thread_loop(c14cd624,e438ed08,c1187544,3d5,0,...) at taskqueue_thread_loop+0xcc/frame 0xe438eccc fork_exit(c0b0ec80,c14cd624,e438ed08) at fork_exit+0x7f/frame 0xe438ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe438ecf4 --- trap 0, eip = 0, esp = 0xe438ed40, ebp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xc83a5310 sched_switch(c83a5310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xe438bbc0 mi_switch(104,0,c1193e95,1f5,c13224e8,...) at mi_switch+0x1c9/frame 0xe438bbf4 sleepq_switch(c83a5310,0,c1193e95,26b,c83b0a80,...) at sleepq_switch+0x1c5/frame 0xe438bc28 sleepq_wait(c83b0a80,0,c118e8fd,c11797ce,0,...) at sleepq_wait+0x48/frame 0xe438bc4c msleep_spin_sbt(c83b0a80,c83b0a98,c11797ce,0,0,...) at msleep_spin_sbt+0x239/frame 0xe438bc94 taskqueue_thread_loop(c14cd624,e438bd08,c1187544,3d5,0,...) at taskqueue_thread_loop+0xcc/frame 0xe438bccc fork_exit(c0b0ec80,c14cd624,e438bd08) at fork_exit+0x7f/frame 0xe438bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe438bcf4 --- trap 0, eip = 0, esp = 0xe438bd40, ebp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xc83a5620 sched_switch(c83a5620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xe4388bac mi_switch(104,0,c1193e95,1f5,162,...) at mi_switch+0x1c9/frame 0xe4388be0 sleepq_switch(c83a5620,0,c1193e95,26b,c83b0b00,...) at sleepq_switch+0x1c5/frame 0xe4388c14 sleepq_wait(c83b0b00,0,c11797ce,0,0,...) at sleepq_wait+0x48/frame 0xe4388c38 _sleep(c83b0b00,c83b0b18,0,c11797ce,0,...) at _sleep+0x385/frame 0xe4388c94 taskqueue_thread_loop(c14d58c8,e4388d08,c1187544,3d5,0,...) at taskqueue_thread_loop+0x129/frame 0xe4388ccc fork_exit(c0b0ec80,c14d58c8,e4388d08) at fork_exit+0x7f/frame 0xe4388cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4388cf4 --- trap 0, eip = 0, esp = 0xe4388d40, ebp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xc83a6000 sched_switch(c83a6000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xe437fbac mi_switch(104,0,c1193e95,1f5,162,...) at mi_switch+0x1c9/frame 0xe437fbe0 sleepq_switch(c83a6000,0,c1193e95,26b,c83b0c80,...) at sleepq_switch+0x1c5/frame 0xe437fc14 sleepq_wait(c83b0c80,0,c11797ce,0,0,...) at sleepq_wait+0x48/frame 0xe437fc38 _sleep(c83b0c80,c83b0c98,0,c11797ce,0,...) at _sleep+0x385/frame 0xe437fc94 taskqueue_thread_loop(c14dae70,e437fd08,c1187544,3d5,0,...) at taskqueue_thread_loop+0x129/frame 0xe437fccc fork_exit(c0b0ec80,c14dae70,e437fd08) at fork_exit+0x7f/frame 0xe437fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe437fcf4 --- trap 0, eip = 0, esp = 0xe437fd40, ebp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xc83a6310 sched_switch(c83a6310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xe437cbac mi_switch(104,0,c1193e95,1f5,162,...) at mi_switch+0x1c9/frame 0xe437cbe0 sleepq_switch(c83a6310,0,c1193e95,26b,c83b0d00,...) at sleepq_switch+0x1c5/frame 0xe437cc14 sleepq_wait(c83b0d00,0,c11797ce,0,0,...) at sleepq_wait+0x48/frame 0xe437cc38 _sleep(c83b0d00,c83b0d18,0,c11797ce,0,...) at _sleep+0x385/frame 0xe437cc94 taskqueue_thread_loop(c14d87c0,e437cd08,c1187544,3d5,0,...) at taskqueue_thread_loop+0x129/frame 0xe437cccc fork_exit(c0b0ec80,c14d87c0,e437cd08) at fork_exit+0x7f/frame 0xe437ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe437ccf4 --- trap 0, eip = 0, esp = 0xe437cd40, ebp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xc83a6930 sched_switch(c83a6930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xe4375bac mi_switch(104,0,c1193e95,1f5,162,...) at mi_switch+0x1c9/frame 0xe4375be0 sleepq_switch(c83a6930,0,c1193e95,26b,c83b1000,...) at sleepq_switch+0x1c5/frame 0xe4375c14 sleepq_wait(c83b1000,0,c11797ce,0,0,...) at sleepq_wait+0x48/frame 0xe4375c38 _sleep(c83b1000,c83b1018,0,c11797ce,0,...) at _sleep+0x385/frame 0xe4375c94 taskqueue_thread_loop(c1320cc4,e4375d08,c1187544,3d5,0,...) at taskqueue_thread_loop+0x129/frame 0xe4375ccc fork_exit(c0b0ec80,c1320cc4,e4375d08) at fork_exit+0x7f/frame 0xe4375cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4375cf4 --- trap 0, eip = 0, esp = 0xe4375d40, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc14d5430 sched_switch(c14d5430,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xc1820c2c mi_switch(104,0,c1193e95,1f5,101,...) at mi_switch+0x1c9/frame 0xc1820c60 sleepq_switch(c14d5430,0,c1193e95,28e,c14d5144,...) at sleepq_switch+0x1c5/frame 0xc1820c94 sleepq_timedwait(c14d5144,54,9,0,0,...) at sleepq_timedwait+0x48/frame 0xc1820cb8 _sleep(c14d5144,0,54,c11cbc02,fffff470,...) at _sleep+0x350/frame 0xc1820d14 swapper() at swapper+0x24f/frame 0xc1820d58 begin() at begin+0x2c db:0:allt> call doadump Physical memory: 3435 MB Dumping 137 MB: 122 106 90 74 58 42 26 10 Dump complete = 0 db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 2 (kgdb) bt #0 doadump (textdump=0xa) at pcpu.h:232 #1 0xc051f5bd in db_fncall (dummy1=0x19, dummy2=0x0, dummy3=0xc12d5c74, dummy4=0xf85203e8 "") at ../../../ddb/db_command.c:578 #2 0xc051f2a7 in db_command (cmd_table=) at ../../../ddb/db_command.c:449 #3 0xc05231e4 in db_script_exec (scriptname=0xc14cd384 "doadump", warnifnotfound=) at ../../../ddb/db_script.c:302 #4 0xc051f2a7 in db_command (cmd_table=) at ../../../ddb/db_command.c:449 #5 0xc051efc0 in db_command_loop () at ../../../ddb/db_command.c:502 #6 0xc0521850 in db_trap (type=, code=0x2) at ../../../ddb/db_main.c:231 #7 0xc0afe748 in kdb_trap (type=, code=, tf=) at ../../../kern/subr_kdb.c:654 #8 0xc0f5f59f in trap (frame=) at ../../../i386/i386/trap.c:720 #9 0xc0f4844c in calltrap () at ../../../i386/i386/exception.s:170 #10 0xc0afdfed in kdb_enter (why=0xc118dc95 "panic", msg=) at cpufunc.h:71 #11 0xc0ac52a3 in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:747 #12 0xc0ac515a in kassert_panic (fmt=) at ../../../kern/kern_shutdown.c:642 #13 0xc0d7fe58 in vm_pageout_flush (mc=0xf8520904, count=0x1, flags=0x3, mreq=0x0, prunlen=0xf852096c, eio=0xf8520a2c) at ../../../vm/vm_pageout.c:492 #14 0xc0d75c4d in vm_object_page_collect_flush (object=0xc9392ccc, p=0xc33327e8, pagerflags=0x3, flags=0x3, clearobjflags=0xf8520a30, eio=0xf8520a2c) at ../../../vm/vm_object.c:962 #15 0xc0d757eb in vm_object_page_clean (object=0xc9392ccc, start=0x0, end=0x3000, flags=0x3) at ../../../vm/vm_object.c:888 #16 0xc0d76093 in vm_object_sync (object=0xc9392ccc, offset=0x0, size=0x3000, syncio=0x1, invalidate=0x1) at ../../../vm/vm_object.c:1037 #17 0xc0d6c620 in vm_map_sync (map=0xc1b83e10, start=0x281d2000, end=0x281d5000, syncio=0x1, invalidate=0x1) at ../../../vm/vm_map.c:2719 #18 0xc0d71ae9 in sys_msync (td=, uap=0xf8520cc8) at ../../../vm/vm_mmap.c:551 #19 0xc0f6027d in syscall (frame=) at subr_syscall.c:134 #20 0xc0f484e1 in Xint0x80_syscall () at ../../../i386/i386/exception.s:270 #21 0x00000033 in ?? () Previous frame inner to this frame (corrupt stack?) Current language: auto; currently minimal (kgdb) f 13 #13 0xc0d7fe58 in vm_pageout_flush (mc=0xf8520904, count=0x1, flags=0x3, mreq=0x0, prunlen=0xf852096c, eio=0xf8520a2c) at ../../../vm/vm_pageout.c:492 492 KASSERT(mc[i]->valid == VM_PAGE_BITS_ALL, (kgdb) info loc object = 0xc9392ccc numpagedout = 0x0 i = 0x0 runlen = 0x1 pageout_status = 0xf8520854 (kgdb) p *mc[0] $1 = {plinks = {q = {tqe_next = 0x0, tqe_prev = 0xc3332760}, s = {ss = {sle_next = 0x0}, pv = 0xc3332760}, memguard = {p = 0x0, v = 0xc3332760}}, listq = {tqe_next = 0x0, tqe_prev = 0xc3332768}, object = 0xc9392ccc, pindex = 0x2, phys_addr = 0x40c5b000, md = {pv_list = {tqh_first = 0x0, tqh_last = 0xc3332808}, pat_mode = 0x6}, queue = 0x0, segind = 0x2, hold_count = 0x0, order = 0xb, pool = 0x0, cow = 0x0, wire_count = 0x0, aflags = 0x2, oflags = 0x0, flags = 0x0, act_count = 0x0, __pad0 = 0x0, valid = 0xf0, dirty = 0xf0, busy_lock = 0x1} (kgdb) p *object $2 = {lock = {lock_object = {lo_name = 0xc11cbf72 "vm object", lo_flags = 0x5630000, lo_data = 0x0, lo_witness = 0xc8183318}, rw_lock = 0xc97b9c40}, object_list = { tqe_next = 0xc9c92ccc, tqe_prev = 0xc9c81ba8}, shadow_head = {lh_first = 0x0}, shadow_list = {le_next = 0x0, le_prev = 0xc9c77bb0}, memq = {tqh_first = 0xc3332760, tqh_last = 0xc33327f0}, rtree = {rt_root = 0xe1c35210, rt_flags = 0x0}, size = 0x3, generation = 0x3c, ref_count = 0x3, shadow_count = 0x0, memattr = 0x6, type = 0x2, flags = 0x1100, pg_color = 0x81d2, paging_in_progress = 0x0, resident_page_count = 0x2, backing_object = 0x0, backing_object_offset = 0x0, pager_object_list = { tqe_next = 0x0, tqe_prev = 0x0}, rvq = {lh_first = 0x0}, cache = {rt_root = 0x0, rt_flags = 0x0}, handle = 0xc9adb9d8, un_pager = {vnp = {vnp_size = 0x22a7, writemappings = 0x6000}, devp = {devp_pglist = {tqh_first = 0x22a7, tqh_last = 0x0}, ops = 0x6000, dev = 0x0}, sgp = {sgp_pglist = {tqh_first = 0x22a7, tqh_last = 0x0}}, swp = {swp_tmpfs = 0x22a7, swp_bcount = 0x0}}, cred = 0x0, charge = 0x0} (kgdb) $ svn diff -x -p /usr/src/sys -- Test scenario: mmap6.sh