GENERIC HEAD from 2013-05-12 04:05:01 UTC, r250556, vmcore.630 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb 4718592K of memory above 4GB ignored Copyright (c) 1992-2013 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #1 r250556: Mon May 13 07:50:59 CEST 2013 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 FreeBSD clang version 3.3 (trunk 178860) 20130405 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 0x10 Model = 0x2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 8589934592 (8192 MB) avail memory = 3498360832 (3336 MB) : Trying to mount root from ufs:/dev/ad4s1a [rw]... Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/ad4s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1a: clean, 618512 free (1280 frags, 77154 blocks, 0.1% fragmentation) /dev/ad4s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1f: clean, 184122 free (4362 frags, 22470 blocks, 0.4% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 49187931 free (3259 frags, 6148084 blocks, 0.0% fragmentation) /dev/ad4s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1d: clean, 3936954 free (272922 frags, 458004 blocks, 2.7% fragmentation) /dev/ad4s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1e: clean, 9158427 free (165499 frags, 1124116 blocks, 0.7% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN re0: link state changed to UP Starting Network: lo0 re0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 scopeid 0x1 nd6 options=29 media: Ethernet autoselect (100baseTX ) status: active Starting devd. add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/kde4/lib /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/gcc46 /usr/local/lib/mysql /usr/local/lib/nss /usr/local/lib/pth /usr/local/lib/qt4 /usr/local/lib/virtualbox a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. savecore: couldn't find media and/or sector size of /var/crash: Inappropriate ioctl for device May 13 07:56:20 x4 savecore: couldn't find media and/or sector size of /var/crash: Inappropriate ioctl for device No core dumps found. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 lock order reversal: 1st 0xe381e914 bufwait (bufwait) @ kern/vfs_bio.c:3070 2nd 0xc7920a00 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper(c10d8de0,c10e2818,c1c,c0b3a9d0,c8108508,...) at db_trace_self_wrapper+0x2d/frame 0xf5c6b798 kdb_backtrace(c10dc30b,c7920a00,c110e50d,c7586268,c110e152,...) at kdb_backtrace+0x30/frame 0xf5c6b800 witness_checkorder(c7920a00,9,c110e149,11c,0,...) at witness_checkorder+0xbaa/frame 0xf5c6b850 _sx_xlock(c7920a00,0,c110e149,11c,c80ff000,...) at _sx_xlock+0x77/frame 0xf5c6b880 ufsdirhash_add(c7dda3a0,f5c6b978,53dc,f5c6b900,f5c6b904,...) at ufsdirhash_add+0x4a/frame 0xf5c6b8b0 ufs_direnter(c8108438,c83855a0,f5c6b978,f5c6bb64,e38222ac,...) at ufs_direnter+0x63b/frame 0xf5c6b930 ufs_mkdir(f5c6bc00,c1133b13,c1107e16,c8108438,f5c6bbfc,...) at ufs_mkdir+0x884/frame 0xf5c6bad0 VOP_MKDIR_APV(c1237ed0,f5c6bc00,f5c6bb64,f5c6bb90,28803020,...) at VOP_MKDIR_APV+0x124/frame 0xf5c6bb00 kern_mkdirat(c7dfb600,ffffff9c,28803020,0,1c0) at kern_mkdirat+0x1fc/frame 0xf5c6bc24 sys_mkdir(c7dfb600,f5c6bcc8,14,c10d6fcd,7b3,...) at sys_mkdir+0x31/frame 0xf5c6bc40 syscall(f5c6bd08) at syscall+0x2ed/frame 0xf5c6bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c6bcfc --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x28174f57, esp = 0xbfbfd92c, ebp = 0xbfbfddd0 --- Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Recovering vi editor sessions:. Updating motd:. Starting ntpd. Removing stale Samba tdb files: ....... done Starting nmbd. Starting smbd. Starting winbindd. Starting smartd. Starting default moused. Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Local package initialization: backuplock order reversal: lock order reversal: 1st 0xc85638a4 ufs (ufs) @ kern/vfs_lookup.c:517 1st 0xc7e4173c ufs (ufs) @ kern/vfs_mount.c:1236 2nd 0xe3838040 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:262 2nd 0xc7e73cdc devfs (devfs) @ ufs/ffs/ffs_softdep.c:1866 3rd 0xc8784cdc ufs (ufs) @ kern/vfs_subr.c:2109 KDB: stack backtrace: KDB: stack backtrace: db_tradcbe__tsrealcfe__wsrealpfp_ewrr(acp1p0edr8(dce100,d08,d3e30,,cc1806c14b160ba4,,6c71d3,d.2.8.5)8 ,act7 57f998d,bc_7t5r7afc2eb_0s,e.l.f._)w raatp per+0dxb2_dt/rfarcaem_es e0lxff_5wcrbabp8p3e0r +0x2d/frame 0xf5kddb8_fb2abc0k trace(c10dc30b,ck7deb7_3bcadcck,tcr1a0ccef(ec2150,dcc7352846,0c6807,8c41c1d0ca,8c3170,c.4.1.0)a ,act7 586200,c1k0deb5_7b3acc,k.t.r.a)c ea+t0 x30/framked b0_xbfa5cckbtbr8a9c8e +0x30/frame 0xf5wdi8tfn3e18s s_checkorder(c7ew7i3tcndecs,s9_,cch1e1c0kao8r2dee,r7(4c87a8,4cc7dec7,39d,4c81,0.e.5.7)3 3a,t8 3d,c8784wdi4t8n,e.s.s._)c haetc korder+0wxibtanae/sfsr_acmhee c0kxofr5dcebrb+80ex8b aa/frame 0xf5d8f_3_6l8o ckmgr_args(c7e7_3_cldocc,k8m0g4r0_0a,rcg7se(7c38d74884,c0d,c0,8,001,0c01,1c08a78824ed,4784,a0), 0a,t. ..) at __lockm_g_lro_cakrmggsr+_0axr8g1s6+/0fxr8a1m6e/ f0rxafm5ec b0bx9fc58d 8f448 vop_stdlock(f5cbfbfas4_0l,o6c3k2(,f45,df85fc4bdb0a,3cc7,5c802a397e04,9c77,5.7.f.1)e 0a,tc 7584798,cv7o5p7_fs1ted0l,o.c.k.+)0 xa5t3 /frame 0fxffs5_clbobc9kf+80 xad/frame 0xf5d8VfO4P8_8L OCK1_APV(c11fd63V4O,Pf_5LcObCbKa14_0A,P4V,(fc51c2b3b7ae6d80,,cf152d48cf743d00,,.c.1.0)e 2a8t1 8,180,c12V4OcP7_3L0O,C.K.1._)A PaVt+ 0x112/frVaOmPe_ L0OxCfK51c_bAbPaV2+80 x112/frame 0xf5d_8vfn4_bl8o ck(c7e73ca8,8040_0v,nc_1l1o0cak8(2ce8,77844ac,af85,c8b0b1a0a08,,c.1.0.e)5 7a3t3 ,_8v3nd_,lco1c0ke+409xac9a,/.f.r.a)m ea t0 xf5cbba6_8v n_lock+0xca/frames o0fxtfd5edp8_ff4lfu8s hlock order reversal: wv 1st 0xc8108034 syncer (syncer) @ kern/vfs_subr.c:1728 og 2nd 0xc857e46c ufs (ufs) @ kern/vfs_subr.c:2109 erKDB: stack backtrace: tk(lci8ds7bt8_(4tccr8aa08cf,eb82_0es1ce0,l0ff,5_ccw8br6ba1apbfp6ce0,r0c(,7c5d17f0,ad038,0d.0e.,0.6,)28 d,a,ct01 ,1.2.b.8)2v 2ga,et2t 4+60,x07,s7.o/.fft.rd)ae mpae_t f 0lxufsd5hbdw_8otfrr5ka3lc0ie s_ts+e0lxf6_ew/rfvarfpaspm_eehr a+0s0xhxf_25gdce/btbf(arcaa78md e8 10bxbe03,b1f5cfe9fd3se0_b s,y8n0c0(0c08,0ckf8db6b21_ebbc6a0,c01k,,tffr55adcc8befb(6bc611800,,d5.c0.3f.0),b ,cac1t8b 5a7eec4164vc,f,.sc._1.h0)ac s4ah1t_0 gae,tc+70f5xf8fs6f_2/s0fy0rn,accm+1e00 xe025xe7f535/cdf,8r.fa.5m.5e)c 0axtf 5cbbb30 kfdfbs__vbgaectkfdt(orcua7ncdme8o+1u0bnxbt30(0,c/18f50refadbme2ebe ,c08,x08e00308b00f,0cf09509d,88c f76d1f0a,310,0.,.w4.i9)t3 n,aects0 sa_fcbh4ef3cf5ks,o_.rv.dg.ee)rt (fac+t80 5x74e7d4/o6fucrn,am9mo,euc n10t0x+ef055x7d43833fc,5/8bf38rd a,mce8 507xef45dcs8bo,bf.bt.9d.0e) p _asty nc_buf(csw8yi5st6_n3ue8ns7ms0o_,ucenh3te8(c3ck77ofdref8da,e31r0,+010,x0fb85a,ca0b/,bf.cr.ca.8m),e c a10t1x 2ec3db1ffcs,9odef68t, d0e,p._.s.y)n ca__t_b luofc+k0msxgy9rs7__7au/rnfgmrsoa(ucmn8et5 +700exx43f6c5cdd,/88ff0r65a20m00e , c08x5f75ec4bdb8fc,f40s0,_ s0y,n.c.v.n)o daest(y cs8c5a6l3_l8_(7lf0o5,cc1kb,mb0gd,r0c_87a)5r 8ga2st4+ 400x,8cs11y36sd/c2fa4rlbal4m+,e0. x.02.xe)ed 3/abftfr caamce8 f0fxsf_5scybnbccvffnfcos d_el+o0cxXk2i(ane3t3/0bfxfr8ca0bm_5es0 y,0s0xc,fac5l7dl58(8f)46 57af8t8 ,246,c75X8i4n5tff08fx,s8._0.t_.rs)uy nsacctaa tlel(+c08fx5f26s13_/8lf7or0ca,mk2e+0 000x,xa0fd,5/8cf8br0ba,cmcfe7c 6 0-cx-0e-83 0bs0fy,cs.bc.0a.8l) la t( 22f,Vf OsFP_r_teLreOuBCnSKcD1a _tEAeLP+FV03(x2c6,1c 2es3/y7fser_dau0mn,eme o30ubxnfftc5)bd,58 0fe,8i23p40 6 =, c01x32f8e08c51ucaf,0scb_1,d2 i4ercse7pn3 t0=e, r.0(.xc.b8)f5 b6af3td8 67a04,,c V8eO7bP8p_4 Lc=Oa C80K,x1fb_5fAdbP8fVfd+870f7x001, 1f-25-/d-f8 rfabmcec ,00x,e.3.b.f)c ba3t8 ufs_direnter+0x7_evdn/_flroacmke( c08x5f57de84f388b,08 0500,c10e5733,83udf,sc_1m3afkee8i6nco,d.e.(.f)5 da8tf bb8,f5d8_fvbnc_cl)o cakt+ 0uxfcsa_/mfarkaemien o0dxee+30bxf5c3b87/8f rame 0xf5d8fa24 vget(c857e438,80u5f0s0_,ccr7e9a4t8e3(0f05,d18f2b8150,,cc8101f3b3051001,,.c.1.1)0 7aet1 6,c7d81bvcg0e,t2+,0.x.7.7)/ farta me 0xe3buffcsb_bc0r eate+0x2f/frame v0fxsf_5mds8yfnac3(8c 80fb000,2,2,e44,cV8O0Pf_bC0R0E0A,T.E._.A)P Va(tc 1237ed0,vff5sd_8mfsby1nc0+,0fx5ad08/ffbrcacm,ef 50dx8ef3abaf0c,bff58d 8fad0,...) at sync_fsVyOnPc_(CeR3EbAfTcEc_aA8P,Vc+101x313294e/ef,r8a0m4e0 00,xcf150de85f7a3638, 6c0,...) at vn_ospyennc__cfrseydn(cf+50dx81f2be8/0f,rfa5mde8 f0bxfec,31b8f0c,c02,0c 76c0800,c7dc8d90V)O Pa_tF SYNC_APVv(cn1_2o1p8e1nc_4c,ree3db+f0cxc2ac8f,/cf1r0aem5e7 303x,f65cd08,f0b,3.8. .) at VOPv_nF_SoYpNeCn_(AfP5Vd+80fxb18204,/ff5rda8mfeb f0cx,e138b0f,ccc75d0c 8d90,c861b600,..s.c)h eadt_ sync(0,ev3nb_focpde0n8+,0cx130bc/ef5r5a0m,e3 d07x,f05,d.8.f.b)5 8a t sched_skyenrcn+_0oxp3e8nfa/tf(rca8m6e1 b06x0e03,bfffcfcfcfcf 9c,28c80360,0,af0o2r,k1_8e0x)i ta(tc 0b5e360,k0e,ren3_bofpcedn0a8t)+ 0axt1 ec/frafmoer k0_xefx5idt8+f0cx270f /frame 0xe3bfccfs4y s_open(cf8o6r1kb_6t0r0a,mfp5odl8ifncec(8), ca0te e50c0,c7f1ofrdkc_9t0r,a0m,p.o.l.i)n ea+t0 x8/frames y0sx_eo3pbefnc+c0fx43 8-/-f-r atmrea p0 x0f,5 de8ifpc 4=0 0, esp = 0xe3bfcsdy4s0c,a lelb(pf 5=d 80f d-0-8-) at syscall+0x2ed/frame 0xf5d8fcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d8fcfc --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x284171e7, esp = 0xbfbfa09c, ebp = 0xbfbfa128 --- ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 49740 files, 69126050 used, 49187931 free (3259 frags, 6148084 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 49740 files, 69126050 used, 49187931 free (3259 frags, 6148084 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmp watchdogd. Starting inetd. Mon May 13 08:00:25 CEST 2013 FreeBSD/i386 (x4.osted.lan) (console) login: root Password: May 13 08:16:14 x4 login: ROOT LOGIN (root) ON console Last login: Mon May 13 07:21:11 on console FreeBSD 10.0-CURRENT (PHO) #1 r250556: Mon May 13 07:50:59 CEST 2013 You have new mail. x4# /home/pho/stress2/wip/msync 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 : : 2712 2713 2714 panic: vm_fault_copy_wired: page missing cpuid = 3 KDB: enter: panic [ thread pid 805 tid 100148 ] Stopped at kdb_enter+0x3d: movl $0,kdb_why db> run pho db:0:pho> bt Tracing pid 805 tid 100148 td 0xc8759c00 kdb_enter(c10d49d3,c10d49d3,c111071c,f5dcb9bc,f5dcb9b0,...) at kdb_enter+0x3d/frame 0xf5dcb968 vpanic(f5dcb9bc,f5dcbaa8,c0d3f338,c111071c,31,...) at vpanic+0x143/frame 0xf5dcb9a4 panic(c111071c,31,0,0,5,...) at panic+0x12/frame 0xf5dcb9b0 vm_fault_copy_entry(c90849f8,c8137740,c905d168,c8598318,f5dcbbf8,c9084a40,4,c1110d3e,3c2,4,f5dcbbf8,3c2,c1110d3e,b77,f5dcbbf8,f5dcbb20,c0d45ea3,c905d168,c1110d3e,3c2,f5dcbbf8,c905d168,c8598318,c90849f8,c8137740) at vm_fault_copy_entry+0x5a8/frame 0xf5dcbaa8 vm_map_copy_entry(c8137740,c90849f8,c8598318,c905d168,f5dcbbf8,...) at vm_map_copy_entry+0x50a/frame 0xf5dcbb20 vmspace_fork(c8137740,f5dcbbf8,2,c10db480,c8759c00,...) at vmspace_fork+0x63c/frame 0xf5dcbba0 fork1(c8759c00,14,0,f5dcbc38,c85ad8b8,...) at fork1+0x1fc/frame 0xf5dcbc18 sys_fork(c8759c00,f5dcbcc8,f5dcbc9c,c0ee5767,0,...) at sys_fork+0x29/frame 0xf5dcbc40 syscall(f5dcbd08) at syscall+0x2ed/frame 0xf5dcbcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5dcbcfc --- syscall (2, FreeBSD ELF32, sys_fork), eip = 0x280eb573, esp = 0xbfbfdc4c, ebp = 0xbfbfdce8 --- db:0:bt> show allpcpu Current CPU: 3 cpuid = 0 dynamic pcpu = 0x5d3300 curthread = 0xc8759900: pid 3623 "msync" curpcb = 0xf5dced60 fpcurthread = none idlethread = 0xc76c5900: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x5fa8300 curthread = 0xc76c5600: pid 11 "idle: cpu1" curpcb = 0xc720dd60 fpcurthread = none idlethread = 0xc76c5600: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x5fab300 curthread = 0xc76c5300: pid 11 "idle: cpu2" curpcb = 0xc7210d60 fpcurthread = none idlethread = 0xc76c5300: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x5fae300 curthread = 0xc8759c00: pid 805 "watchdogd" curpcb = 0xf5dcbd60 fpcurthread = none idlethread = 0xc76c5000: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks Process 805 (watchdogd) thread 0xc8759c00 (100148) exclusive rw vm object (vm object) r = 0 (0xc7deb378) locked @ vm/vm_fault.c:1321 exclusive rw vm object (vm object) r = 0 (0xc9099128) locked @ vm/vm_fault.c:1353 exclusive sx vm map (user) (vm map (user)) r = 0 (0xc9084a40) locked @ vm/vm_map.c:3102 exclusive sx vm map (user) (vm map (user)) r = 0 (0xc8137788) locked @ vm/vm_map.c:3098 db:0:alllocks> show lockedvnods Locked vnodes db:0:lockedvnods> show mount 0xc7d80bb0 /dev/ad4s1a on / (ufs) 0xc7d81000 devfs on /dev (devfs) 0xc80fb5d8 /dev/ad4s1f on /home (ufs) 0xc80fb000 /dev/ad4s1d on /usr (ufs) 0xc7d81bb0 /dev/ad4s1e on /var (ufs) 0xc7d818c4 procfs on /proc (procfs) 0xc7d808c4 /dev/label/tmp on /tmp (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 3623 908 908 65534 R+ CPU 0 msync 908 903 908 65534 S+ wait 0xc7e545d0 msync 903 846 903 0 S+ pause 0xc85adc04 csh 854 1 854 0 Ss+ ttyin 0xc75a4670 getty 853 1 853 0 Ss+ ttyin 0xc75a4870 getty 852 1 852 0 Ss+ ttyin 0xc75a4a70 getty 851 1 851 0 Ss+ ttyin 0xc75a4c70 getty 850 1 850 0 Ss+ ttyin 0xc75a4e70 getty 849 1 849 0 Ss+ ttyin 0xc792e070 getty 848 1 848 0 Ss+ ttyin 0xc792e270 getty 847 1 847 0 Ss+ ttyin 0xc792e470 getty 846 1 846 0 Ss+ wait 0xc84ddba0 login 829 1 829 0 Ss select 0xc757b464 inetd 805 1 805 0 Rs CPU 3 watchdogd 737 1 737 0 Ss nanslp 0xc128795b cron 732 1 732 25 Ss pause 0xc85ab91c sendmail 729 1 729 0 Ss select 0xc7d7f3e4 sendmail 726 1 726 0 Ss select 0xc7ded124 sshd 694 1 694 0 Ss select 0xc7d7f564 moused 686 1 685 0 S nanslp 0xc128795a smartd 684 672 672 0 S select 0xc7dafba4 winbindd 683 670 670 0 S select 0xc7d7f6a4 smbd 672 1 672 0 Ss select 0xc7d7f7e4 winbindd 670 1 670 0 Ss select 0xc7daf7a4 smbd 668 1 668 0 Ss select 0xc757a6a4 nmbd 644 1 644 0 Ss select 0xc757bde4 ntpd 587 583 583 0 S (threaded) nfsd 100111 S rpcsvc 0xc7cc4a10 nfsd: service 100110 S rpcsvc 0xc7d5c810 nfsd: service 100109 S rpcsvc 0xc7d5c290 nfsd: service 100092 S rpcsvc 0xc7d5c6d0 nfsd: master 583 1 583 0 Ss select 0xc757b2a4 nfsd 577 1 577 0 Ss select 0xc757bba4 mountd 570 566 566 0 S select 0xc7dafbe4 nfsuserd 569 566 566 0 S select 0xc757a564 nfsuserd 568 566 566 0 S select 0xc757b8e4 nfsuserd 567 566 566 0 S select 0xc7ded264 nfsuserd 566 1 566 0 Ss pause 0xc7c6f34c nfsuserd 538 1 538 0 Ss select 0xc7d7f9a4 rpcbind 523 1 523 0 Ss select 0xc7ded1a4 syslogd 420 1 420 0 Ss select 0xc757a164 devd 17 0 0 0 DL sdflush 0xc1402af4 [softdepflush] 16 0 0 0 DL syncer 0xc13fe8a4 [syncer] 9 0 0 0 DL vlruwt 0xc7c6fba0 [vnlru] 8 0 0 0 DL psleep 0xc13fe61c [bufdaemon] 7 0 0 0 DL pgzero 0xc14033f4 [pagezero] 6 0 0 0 DL psleep 0xc1402fbc [vmdaemon] 5 0 0 0 DL psleep 0xc1456e84 [pagedaemon] 4 0 0 0 DL ccb_scan 0xc1252a24 [xpt_thrd] 3 0 0 0 DL waiting_ 0xc1452b8c [sctp_iterator] 2 0 0 0 DL - 0xc789303c [fdc0] 15 0 0 0 DL (threaded) [usb] 100058 D - 0xc78f7d34 [usbus5] 100057 D - 0xc78f7d04 [usbus5] 100056 D - 0xc78f7cd4 [usbus5] 100055 D - 0xc78f7ca4 [usbus5] 100053 D - 0xc78ebb5c [usbus4] 100052 D - 0xc78ebb2c [usbus4] 100051 D - 0xc78ebafc [usbus4] 100050 D - 0xc78ebacc [usbus4] 100049 D - 0xc78e6b5c [usbus3] 100048 D - 0xc78e6b2c [usbus3] 100047 D - 0xc78e6afc [usbus3] 100046 D - 0xc78e6acc [usbus3] 100045 D - 0xc78deb5c [usbus2] 100044 D - 0xc78deb2c [usbus2] 100043 D - 0xc78deafc [usbus2] 100042 D - 0xc78deacc [usbus2] 100040 D - 0xc78d9b5c [usbus1] 100039 D - 0xc78d9b2c [usbus1] 100038 D - 0xc78d9afc [usbus1] 100037 D - 0xc78d9acc [usbus1] 100035 D - 0xc78cdb5c [usbus0] 100034 D - 0xc78cdb2c [usbus0] 100033 D - 0xc78cdafc [usbus0] 100032 D - 0xc78cdacc [usbus0] 14 0 0 0 DL - 0xc126d5dc [yarrow] 13 0 0 0 DL (threaded) [geom] 100015 D - 0xc144ebe8 [g_down] 100014 D - 0xc144ebe4 [g_up] 100013 D - 0xc144ebe0 [g_event] 12 0 0 0 WL (threaded) [intr] 100063 I [irq12: psm0] 100062 I [irq1: atkbd0] 100060 I [swi0: uart] 100059 I [irq14: ata0] 100054 I [irq19: ehci0] 100041 I [irq18: ohci2 ohci4] 100036 I [irq17: ohci1 ohci3] 100031 I [irq16: hdac1 ohci0] 100030 I [irq22: ahci0] 100029 I [irq257: re0] 100028 I [irq256: hdac0] 100027 I [swi6: task queue] 100025 I [swi2: cambio] 100020 I [swi5: fast taskq] 100018 I [swi6: Giant taskq] 100012 I [swi4: clock] 100011 I [swi4: clock] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 I [swi1: netisr 0] 100007 I [swi3: vm] 11 0 0 0 RL (threaded) [idle] 100006 CanRun [idle: cpu3] 100005 Run CPU 2 [idle: cpu2] 100004 Run CPU 1 [idle: cpu1] 100003 CanRun [idle: cpu0] 1 0 1 0 SLs wait 0xc76c3ba0 [init] 10 0 0 0 DL audit_wo 0xc1455938 [audit] 0 0 0 0 DLs (threaded) [kernel] 100065 D - 0xc1286853 [deadlkres] 100064 D - 0xc7867d80 [mca taskq] 100026 D - 0xc75a8600 [ffs_trim taskq] 100024 D - 0xc75a8980 [acpi_task_2] 100023 D - 0xc75a8980 [acpi_task_1] 100022 D - 0xc75a8980 [acpi_task_0] 100021 D - 0xc75a8a00 [kqueue taskq] 100019 D - 0xc75a8b00 [thread taskq] 100016 D - 0xc75a8c80 [firmware taskq] 100000 D sched 0xc144ec64 [swapper] db:0:ps> allt Tracing command msync pid 3623 tid 100149 td 0xc8759900 cpustop_handler(0,13,f5dcecf0,c0edd3cb,c8759900,...) at cpustop_handler+0x2f/frame 0xf5dceba0 ipi_nmi_handler(c8759900,1,f5dcecfc,c0edd7f5,c8759900,...) at ipi_nmi_handler+0x37/frame 0xf5dcebb0 trap(f5dcecfc) at trap+0x3b/frame 0xf5dcecf0 calltrap() at calltrap+0x6/frame 0xf5dcecf0 --- trap 0x13, eip = 0xc0ec6d30, esp = 0xf5dced3c, ebp = 0xbfbfdbfc --- Xint0x80_syscall() at Xint0x80_syscall/frame 0xbfbfdbfc Tracing command msync pid 908 tid 100101 td 0xc7e5a600 sched_switch(c7e5a600,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5ceb98c mi_switch(104,0,c10daa3d,1f5,c10daa3d,...) at mi_switch+0x1c9/frame 0xf5ceb9c0 sleepq_switch(c7e5a600,0,c10daa3d,1ab,f5ceba38,...) at sleepq_switch+0x1b9/frame 0xf5ceb9f4 sleepq_catch_signals(0,c10daa3d,162,df8,c7e5a600,...) at sleepq_catch_signals+0x361/frame 0xf5ceba3c sleepq_wait_sig(c7e545d0,6c,c10ddeb5,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5ceba60 _sleep(c7e545d0,c7e54664,16c,c10ddeb5,0,...) at _sleep+0x35b/frame 0xf5cebabc kern_wait6(c7e5a600,7,0,0,f5cebb4c,...) at kern_wait6+0x45c/frame 0xf5cebb20 sys_wait4(c7e5a600,f5cebcc8,c0ee50c0,c7200c90,0,...) at sys_wait4+0x94/frame 0xf5cebc40 syscall(f5cebd08) at syscall+0x2ed/frame 0xf5cebcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cebcfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x280fa563, esp = 0xbfbfdbc8, ebp = 0xbfbfdbe0 --- Tracing command csh pid 903 tid 100147 td 0xc875a000 sched_switch(c875a000,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5dc8aa0 mi_switch(104,0,c10daa3d,1f5,8,...) at mi_switch+0x1c9/frame 0xf5dc8ad4 sleepq_switch(c875a000,0,c10daa3d,1ab,f5dc8b4c,...) at sleepq_switch+0x1b9/frame 0xf5dc8b08 sleepq_catch_signals(0,c10daa3d,162,1440,c875a000,...) at sleepq_catch_signals+0x361/frame 0xf5dc8b50 sleepq_wait_sig(c85adc04,74,c0f37104,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5dc8b74 _sleep(c85adc04,c85adc34,174,c0f37104,0,...) at _sleep+0x35b/frame 0xf5dc8bd0 kern_sigsuspend(c875a000,0,0,0,0,...) at kern_sigsuspend+0xfb/frame 0xf5dc8c10 sys_sigsuspend(c875a000,f5dc8cc8,c112cd1f,e9,0,...) at sys_sigsuspend+0x58/frame 0xf5dc8c40 syscall(f5dc8d08) at syscall+0x2ed/frame 0xf5dc8cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5dc8cfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2816c15b, esp = 0xbfbfd374, ebp = 0xbfbfd3dc --- Tracing command getty pid 854 tid 100096 td 0xc7db4300 sched_switch(c7db4300,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5cb39bc mi_switch(104,0,c10daa3d,1f5,c10daa3d,...) at mi_switch+0x1c9/frame 0xf5cb39f0 sleepq_switch(c7db4300,0,c10daa3d,1ab,f5cb3a68,...) at sleepq_switch+0x1b9/frame 0xf5cb3a24 sleepq_catch_signals(0,c10daa3d,162,510,1,...) at sleepq_catch_signals+0x361/frame 0xf5cb3a6c sleepq_wait_sig(c75a4670,0,c10df7c1,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5cb3a90 _cv_wait_sig(c75a4670,c144f598,c10df7ad,531,f5cb3c10,...) at _cv_wait_sig+0x200/frame 0xf5cb3ad4 tty_wait(c75a4600,c75a4670,f5cb3c10,1,0,...) at tty_wait+0x4b/frame 0xf5cb3af8 ttydisc_read(c75a4600,f5cb3c10,0,a1,f5cb3c10,...) at ttydisc_read+0x377/frame 0xf5cb3b3c ttydev_read(c7909500,f5cb3c10,0,1,0,...) at ttydev_read+0x81/frame 0xf5cb3b5c devfs_read_f(c8758038,f5cb3c10,c76bfe80,0,c7db4300,...) at devfs_read_f+0x87/frame 0xf5cb3b90 dofileread(c8758038,f5cb3c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5cb3bc4 kern_readv(c7db4300,0,f5cb3c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5cb3bf0 sys_read(c7db4300,f5cb3cc8,c0ee50c0,c71fac90,0,...) at sys_read+0x5c/frame 0xf5cb3c40 syscall(f5cb3d08) at syscall+0x2ed/frame 0xf5cb3cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cb3cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819d077, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 853 tid 100106 td 0xc7e59600 sched_switch(c7e59600,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5d009bc mi_switch(104,0,c10daa3d,1f5,c10daa3d,...) at mi_switch+0x1c9/frame 0xf5d009f0 sleepq_switch(c7e59600,0,c10daa3d,1ab,f5d00a68,...) at sleepq_switch+0x1b9/frame 0xf5d00a24 sleepq_catch_signals(0,c10daa3d,162,540,1,...) at sleepq_catch_signals+0x361/frame 0xf5d00a6c sleepq_wait_sig(c75a4870,0,c10df7c1,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5d00a90 _cv_wait_sig(c75a4870,c144f598,c10df7ad,531,f5d00c10,...) at _cv_wait_sig+0x200/frame 0xf5d00ad4 tty_wait(c75a4800,c75a4870,f5d00c10,1,0,...) at tty_wait+0x4b/frame 0xf5d00af8 ttydisc_read(c75a4800,f5d00c10,0,a1,f5d00c10,...) at ttydisc_read+0x377/frame 0xf5d00b3c ttydev_read(c7909600,f5d00c10,0,1,0,...) at ttydev_read+0x81/frame 0xf5d00b5c devfs_read_f(c8758150,f5d00c10,c76bfe80,0,c7e59600,...) at devfs_read_f+0x87/frame 0xf5d00b90 dofileread(c8758150,f5d00c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5d00bc4 kern_readv(c7e59600,0,f5d00c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5d00bf0 sys_read(c7e59600,f5d00cc8,c0ee50c0,c71fdc90,0,...) at sys_read+0x5c/frame 0xf5d00c40 syscall(f5d00d08) at syscall+0x2ed/frame 0xf5d00cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d00cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819d077, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 852 tid 100116 td 0xc7e6d000 sched_switch(c7e6d000,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5d539bc mi_switch(104,0,c10daa3d,1f5,c10daa3d,...) at mi_switch+0x1c9/frame 0xf5d539f0 sleepq_switch(c7e6d000,0,c10daa3d,1ab,f5d53a68,...) at sleepq_switch+0x1b9/frame 0xf5d53a24 sleepq_catch_signals(0,c10daa3d,162,570,1,...) at sleepq_catch_signals+0x361/frame 0xf5d53a6c sleepq_wait_sig(c75a4a70,0,c10df7c1,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5d53a90 _cv_wait_sig(c75a4a70,c144f598,c10df7ad,531,f5d53c10,...) at _cv_wait_sig+0x200/frame 0xf5d53ad4 tty_wait(c75a4a00,c75a4a70,f5d53c10,1,0,...) at tty_wait+0x4b/frame 0xf5d53af8 ttydisc_read(c75a4a00,f5d53c10,0,a1,f5d53c10,...) at ttydisc_read+0x377/frame 0xf5d53b3c ttydev_read(c7909700,f5d53c10,0,1,0,...) at ttydev_read+0x81/frame 0xf5d53b5c devfs_read_f(c7dc70e0,f5d53c10,c76bfe80,0,c7e6d000,...) at devfs_read_f+0x87/frame 0xf5d53b90 dofileread(c7dc70e0,f5d53c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5d53bc4 kern_readv(c7e6d000,0,f5d53c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5d53bf0 sys_read(c7e6d000,f5d53cc8,c0ee50c0,c7200c90,0,...) at sys_read+0x5c/frame 0xf5d53c40 syscall(f5d53d08) at syscall+0x2ed/frame 0xf5d53cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d53cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819d077, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 851 tid 100114 td 0xc7e6d600 sched_switch(c7e6d600,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5d479bc mi_switch(104,0,c10daa3d,1f5,c10daa3d,...) at mi_switch+0x1c9/frame 0xf5d479f0 sleepq_switch(c7e6d600,0,c10daa3d,1ab,f5d47a68,...) at sleepq_switch+0x1b9/frame 0xf5d47a24 sleepq_catch_signals(0,c10daa3d,162,5a0,1,...) at sleepq_catch_signals+0x361/frame 0xf5d47a6c sleepq_wait_sig(c75a4c70,0,c10df7c1,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5d47a90 _cv_wait_sig(c75a4c70,c144f598,c10df7ad,531,f5d47c10,...) at _cv_wait_sig+0x200/frame 0xf5d47ad4 tty_wait(c75a4c00,c75a4c70,f5d47c10,1,0,...) at tty_wait+0x4b/frame 0xf5d47af8 ttydisc_read(c75a4c00,f5d47c10,0,a1,f5d47c10,...) at ttydisc_read+0x377/frame 0xf5d47b3c ttydev_read(c7909800,f5d47c10,0,1,0,...) at ttydev_read+0x81/frame 0xf5d47b5c devfs_read_f(c7e0ea80,f5d47c10,c76bfe80,0,c7e6d600,...) at devfs_read_f+0x87/frame 0xf5d47b90 dofileread(c7e0ea80,f5d47c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5d47bc4 kern_readv(c7e6d600,0,f5d47c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5d47bf0 sys_read(c7e6d600,f5d47cc8,c0ee50c0,c7200c90,0,...) at sys_read+0x5c/frame 0xf5d47c40 syscall(f5d47d08) at syscall+0x2ed/frame 0xf5d47cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d47cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819d077, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 850 tid 100135 td 0xc861a000 sched_switch(c861a000,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5da49bc mi_switch(104,0,c10daa3d,1f5,c10daa3d,...) at mi_switch+0x1c9/frame 0xf5da49f0 sleepq_switch(c861a000,0,c10daa3d,1ab,f5da4a68,...) at sleepq_switch+0x1b9/frame 0xf5da4a24 sleepq_catch_signals(0,c10daa3d,162,5d0,1,...) at sleepq_catch_signals+0x361/frame 0xf5da4a6c sleepq_wait_sig(c75a4e70,0,c10df7c1,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5da4a90 _cv_wait_sig(c75a4e70,c144f598,c10df7ad,531,f5da4c10,...) at _cv_wait_sig+0x200/frame 0xf5da4ad4 tty_wait(c75a4e00,c75a4e70,f5da4c10,1,0,...) at tty_wait+0x4b/frame 0xf5da4af8 ttydisc_read(c75a4e00,f5da4c10,0,a1,f5da4c10,...) at ttydisc_read+0x377/frame 0xf5da4b3c ttydev_read(c7909900,f5da4c10,0,1,0,...) at ttydev_read+0x81/frame 0xf5da4b5c devfs_read_f(c8758118,f5da4c10,c76bfe80,0,c861a000,...) at devfs_read_f+0x87/frame 0xf5da4b90 dofileread(c8758118,f5da4c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5da4bc4 kern_readv(c861a000,0,f5da4c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5da4bf0 sys_read(c861a000,f5da4cc8,14,c10d6fcd,7b3,...) at sys_read+0x5c/frame 0xf5da4c40 syscall(f5da4d08) at syscall+0x2ed/frame 0xf5da4cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5da4cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819d077, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 849 tid 100091 td 0xc7e5b000 sched_switch(c7e5b000,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5c9f9bc mi_switch(104,0,c10daa3d,1f5,c10daa3d,...) at mi_switch+0x1c9/frame 0xf5c9f9f0 sleepq_switch(c7e5b000,0,c10daa3d,1ab,f5c9fa68,...) at sleepq_switch+0x1b9/frame 0xf5c9fa24 sleepq_catch_signals(0,c10daa3d,162,d80,1,...) at sleepq_catch_signals+0x361/frame 0xf5c9fa6c sleepq_wait_sig(c792e070,0,c10df7c1,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5c9fa90 _cv_wait_sig(c792e070,c144f598,c10df7ad,531,f5c9fc10,...) at _cv_wait_sig+0x200/frame 0xf5c9fad4 tty_wait(c792e000,c792e070,f5c9fc10,1,0,...) at tty_wait+0x4b/frame 0xf5c9faf8 ttydisc_read(c792e000,f5c9fc10,0,a1,f5c9fc10,...) at ttydisc_read+0x377/frame 0xf5c9fb3c ttydev_read(c7909a00,f5c9fc10,0,1,0,...) at ttydev_read+0x81/frame 0xf5c9fb5c devfs_read_f(c7dc79a0,f5c9fc10,c76bfe80,0,c7e5b000,...) at devfs_read_f+0x87/frame 0xf5c9fb90 dofileread(c7dc79a0,f5c9fc10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5c9fbc4 kern_readv(c7e5b000,0,f5c9fc10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5c9fbf0 sys_read(c7e5b000,f5c9fcc8,c112cd1f,d6,0,...) at sys_read+0x5c/frame 0xf5c9fc40 syscall(f5c9fd08) at syscall+0x2ed/frame 0xf5c9fcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c9fcfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819d077, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 848 tid 100131 td 0xc861ac00 sched_switch(c861ac00,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5d989bc mi_switch(104,0,c10daa3d,1f5,c10daa3d,...) at mi_switch+0x1c9/frame 0xf5d989f0 sleepq_switch(c861ac00,0,c10daa3d,1ab,f5d98a68,...) at sleepq_switch+0x1b9/frame 0xf5d98a24 sleepq_catch_signals(0,c10daa3d,162,db0,1,...) at sleepq_catch_signals+0x361/frame 0xf5d98a6c sleepq_wait_sig(c792e270,0,c10df7c1,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5d98a90 _cv_wait_sig(c792e270,c144f598,c10df7ad,531,f5d98c10,...) at _cv_wait_sig+0x200/frame 0xf5d98ad4 tty_wait(c792e200,c792e270,f5d98c10,1,0,...) at tty_wait+0x4b/frame 0xf5d98af8 ttydisc_read(c792e200,f5d98c10,0,a1,f5d98c10,...) at ttydisc_read+0x377/frame 0xf5d98b3c ttydev_read(c7909b00,f5d98c10,0,1,0,...) at ttydev_read+0x81/frame 0xf5d98b5c devfs_read_f(c7dc8818,f5d98c10,c76bfe80,0,c861ac00,...) at devfs_read_f+0x87/frame 0xf5d98b90 dofileread(c7dc8818,f5d98c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5d98bc4 kern_readv(c861ac00,0,f5d98c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5d98bf0 sys_read(c861ac00,f5d98cc8,c0ee50c0,c7200c90,0,...) at sys_read+0x5c/frame 0xf5d98c40 syscall(f5d98d08) at syscall+0x2ed/frame 0xf5d98cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d98cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819d077, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 847 tid 100127 td 0xc794a300 sched_switch(c794a300,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5d8c9bc mi_switch(104,0,c10daa3d,1f5,c10daa3d,...) at mi_switch+0x1c9/frame 0xf5d8c9f0 sleepq_switch(c794a300,0,c10daa3d,1ab,f5d8ca68,...) at sleepq_switch+0x1b9/frame 0xf5d8ca24 sleepq_catch_signals(0,c10daa3d,162,de0,1,...) at sleepq_catch_signals+0x361/frame 0xf5d8ca6c sleepq_wait_sig(c792e470,0,c10df7c1,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5d8ca90 _cv_wait_sig(c792e470,c144f598,c10df7ad,531,f5d8cc10,...) at _cv_wait_sig+0x200/frame 0xf5d8cad4 tty_wait(c792e400,c792e470,f5d8cc10,1,0,...) at tty_wait+0x4b/frame 0xf5d8caf8 ttydisc_read(c792e400,f5d8cc10,0,a1,f5d8cc10,...) at ttydisc_read+0x377/frame 0xf5d8cb3c ttydev_read(c7909c00,f5d8cc10,0,1,0,...) at ttydev_read+0x81/frame 0xf5d8cb5c devfs_read_f(c7ddda10,f5d8cc10,c76bfe80,0,c794a300,...) at devfs_read_f+0x87/frame 0xf5d8cb90 dofileread(c7ddda10,f5d8cc10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5d8cbc4 kern_readv(c794a300,0,f5d8cc10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5d8cbf0 sys_read(c794a300,f5d8ccc8,c0ee50c0,c1825c90,0,...) at sys_read+0x5c/frame 0xf5d8cc40 syscall(f5d8cd08) at syscall+0x2ed/frame 0xf5d8ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d8ccfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819d077, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command login pid 846 tid 100134 td 0xc861a300 sched_switch(c861a300,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5da198c mi_switch(104,0,c10daa3d,1f5,c10daa3d,...) at mi_switch+0x1c9/frame 0xf5da19c0 sleepq_switch(c861a300,0,c10daa3d,1ab,f5da1a38,...) at sleepq_switch+0x1b9/frame 0xf5da19f4 sleepq_catch_signals(0,c10daa3d,162,b88,c861a300,...) at sleepq_catch_signals+0x361/frame 0xf5da1a3c sleepq_wait_sig(c84ddba0,6c,c10ddeb5,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5da1a60 _sleep(c84ddba0,c84ddc34,16c,c10ddeb5,0,...) at _sleep+0x35b/frame 0xf5da1abc kern_wait6(c861a300,0,387,0,f5da1b4c,...) at kern_wait6+0x45c/frame 0xf5da1b20 sys_wait4(c861a300,f5da1cc8,c0ee50c0,c71fac90,0,...) at sys_wait4+0x94/frame 0xf5da1c40 syscall(f5da1d08) at syscall+0x2ed/frame 0xf5da1cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5da1cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x28112563, esp = 0xbfbfdd58, ebp = 0xbfbfdd70 --- Tracing command inetd pid 829 tid 100105 td 0xc7e59900 sched_switch(c7e59900,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5cfc90c mi_switch(104,0,c10daa3d,1f5,46,...) at mi_switch+0x1c9/frame 0xf5cfc940 sleepq_switch(c7e59900,0,c10daa3d,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5cfc974 sleepq_catch_signals(f5cfc9e0,c0a9de19,c757b460,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5cfc9bc sleepq_wait_sig(c757b464,0,f5cfca10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5cfc9e0 _cv_wait_sig(c757b464,c757b450,c10dd781,68e,c0b0e26d,...) at _cv_wait_sig+0x200/frame 0xf5cfca24 seltdwait(ffffffff,0,0,c7e59900,0,...) at seltdwait+0x90/frame 0xf5cfca58 kern_select(c7e59900,8,bfbfd070,0,0,...) at kern_select+0x88c/frame 0xf5cfcbf8 sys_select(c7e59900,f5cfccc8,c0ee50c0,c71fac90,0,...) at sys_select+0x69/frame 0xf5cfcc40 syscall(f5cfcd08) at syscall+0x2ed/frame 0xf5cfccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cfccfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281af037, esp = 0xbfbfd014, ebp = 0xbfbfde34 --- Tracing command watchdogd pid 805 tid 100148 td 0xc8759c00 kdb_enter(c10d49d3,c10d49d3,c111071c,f5dcb9bc,f5dcb9b0,...) at kdb_enter+0x3d/frame 0xf5dcb968 vpanic(f5dcb9bc,f5dcbaa8,c0d3f338,c111071c,31,...) at vpanic+0x143/frame 0xf5dcb9a4 panic(c111071c,31,0,0,5,...) at panic+0x12/frame 0xf5dcb9b0 vm_fault_copy_entry(c90849f8,c8137740,c905d168,c8598318,f5dcbbf8,c9084a40,4,c1110d3e,3c2,4,f5dcbbf8,3c2,c1110d3e,b77,f5dcbbf8,f5dcbb20,c0d45ea3,c905d168,c1110d3e,3c2,f5dcbbf8,c905d168,c8598318,c90849f8,c8137740) at vm_fault_copy_entry+0x5a8/frame 0xf5dcbaa8 vm_map_copy_entry(c8137740,c90849f8,c8598318,c905d168,f5dcbbf8,...) at vm_map_copy_entry+0x50a/frame 0xf5dcbb20 vmspace_fork(c8137740,f5dcbbf8,2,c10db480,c8759c00,...) at vmspace_fork+0x63c/frame 0xf5dcbba0 fork1(c8759c00,14,0,f5dcbc38,c85ad8b8,...) at fork1+0x1fc/frame 0xf5dcbc18 sys_fork(c8759c00,f5dcbcc8,f5dcbc9c,c0ee5767,0,...) at sys_fork+0x29/frame 0xf5dcbc40 syscall(f5dcbd08) at syscall+0x2ed/frame 0xf5dcbcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5dcbcfc --- syscall (2, FreeBSD ELF32, sys_fork), eip = 0x280eb573, esp = 0xbfbfdc4c, ebp = 0xbfbfdce8 --- Tracing command cron pid 737 tid 100138 td 0xc7df5000 sched_switch(c7df5000,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5dada64 mi_switch(104,0,c10daa3d,1f5,c0af6910,...) at mi_switch+0x1c9/frame 0xf5dada98 sleepq_switch(c7df5000,0,c10daa3d,1ab,8,...) at sleepq_switch+0x1b9/frame 0xf5dadacc sleepq_catch_signals(c0af6910,c7df5000,3,201,3,...) at sleepq_catch_signals+0x361/frame 0xf5dadb14 sleepq_timedwait_sig(c128795b,6c,516,bfc2aef4,3,...) at sleepq_timedwait_sig+0x14/frame 0xf5dadb3c _sleep(c128795b,0,16c,c10d60ba,81e9a048,...) at _sleep+0x331/frame 0xf5dadb98 kern_nanosleep(bfbfde28,f5dadc18,f5dadc20,f5dadcc8,3b,...) at kern_nanosleep+0x158/frame 0xf5dadc00 sys_nanosleep(c7df5000,f5dadcc8,0,0,c7df5000,...) at sys_nanosleep+0x6b/frame 0xf5dadc40 syscall(f5dadd08) at syscall+0x2ed/frame 0xf5dadcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5dadcfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28188223, esp = 0xbfbfdcb4, ebp = 0xbfbfde44 --- Tracing command sendmail pid 732 tid 100130 td 0xc861b000 sched_switch(c861b000,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5d95aa0 mi_switch(104,0,c10daa3d,1f5,8,...) at mi_switch+0x1c9/frame 0xf5d95ad4 sleepq_switch(c861b000,0,c10daa3d,1ab,f5d95b4c,...) at sleepq_switch+0x1b9/frame 0xf5d95b08 sleepq_catch_signals(0,c10daa3d,162,f78,c861b000,...) at sleepq_catch_signals+0x361/frame 0xf5d95b50 sleepq_wait_sig(c85ab91c,74,c0f37104,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5d95b74 _sleep(c85ab91c,c85ab94c,174,c0f37104,0,...) at _sleep+0x35b/frame 0xf5d95bd0 kern_sigsuspend(c861b000,0,0,0,0,...) at kern_sigsuspend+0xfb/frame 0xf5d95c10 sys_sigsuspend(c861b000,f5d95cc8,1,0,c861b000,...) at sys_sigsuspend+0x58/frame 0xf5d95c40 syscall(f5d95d08) at syscall+0x2ed/frame 0xf5d95cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d95cfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2835815b, esp = 0xbfbfc9dc, ebp = 0xbfbfca08 --- Tracing command sendmail pid 729 tid 100113 td 0xc7e6d900 sched_switch(c7e6d900,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5d42900 mi_switch(104,0,c10daa3d,1f5,400,...) at mi_switch+0x1c9/frame 0xf5d42934 sleepq_switch(c7e6d900,0,c10daa3d,1ab,c7d7f3d0,...) at sleepq_switch+0x1b9/frame 0xf5d42968 sleepq_catch_signals(c120d620,f5d429d8,c0a9de19,c7d7f3e0,0,...) at sleepq_catch_signals+0x361/frame 0xf5d429b0 sleepq_timedwait_sig(c7d7f3e4,0,f5d42a10,50000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf5d429d8 _cv_timedwait_sig_sbt(c7d7f3e4,c7d7f3d0,b5fbe9a,504,50000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5d42a24 seltdwait(504,50000000,0,c7e6d900,0,...) at seltdwait+0xbc/frame 0xf5d42a58 kern_select(c7e6d900,5,bfbfbfc8,0,0,...) at kern_select+0x88c/frame 0xf5d42bf8 sys_select(c7e6d900,f5d42cc8,c0ee50c0,c71fdc90,0,...) at sys_select+0x69/frame 0xf5d42c40 syscall(f5d42d08) at syscall+0x2ed/frame 0xf5d42cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d42cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28420037, esp = 0xbfbfbf2c, ebp = 0xbfbfc9e8 --- Tracing command sshd pid 726 tid 100132 td 0xc861a900 sched_switch(c861a900,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5d9b90c mi_switch(104,0,c10daa3d,1f5,200046,...) at mi_switch+0x1c9/frame 0xf5d9b940 sleepq_switch(c861a900,0,c10daa3d,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5d9b974 sleepq_catch_signals(f5d9b9e0,c0a9de19,c7ded120,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5d9b9bc sleepq_wait_sig(c7ded124,0,f5d9ba10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5d9b9e0 _cv_wait_sig(c7ded124,c7ded110,c10dd781,68e,c0b0e26d,...) at _cv_wait_sig+0x200/frame 0xf5d9ba24 seltdwait(ffffffff,0,0,c861a900,0,...) at seltdwait+0x90/frame 0xf5d9ba58 kern_select(c861a900,5,28c0c140,0,0,...) at kern_select+0x88c/frame 0xf5d9bbf8 sys_select(c861a900,f5d9bcc8,c112cd1f,d6,0,...) at sys_select+0x69/frame 0xf5d9bc40 syscall(f5d9bd08) at syscall+0x2ed/frame 0xf5d9bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d9bcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28531037, esp = 0xbfbfd424, ebp = 0xbfbfde44 --- Tracing command moused pid 694 tid 100078 td 0xc7dfb600 sched_switch(c7dfb600,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5c6b90c mi_switch(104,0,c10daa3d,1f5,46,...) at mi_switch+0x1c9/frame 0xf5c6b940 sleepq_switch(c7dfb600,0,c10daa3d,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5c6b974 sleepq_catch_signals(f5c6b9e0,c0a9de19,c7d7f560,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5c6b9bc sleepq_wait_sig(c7d7f564,0,f5c6ba10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5c6b9e0 _cv_wait_sig(c7d7f564,c7d7f550,c10dd781,68e,c7dfb600,...) at _cv_wait_sig+0x200/frame 0xf5c6ba24 seltdwait(ffffffff,0,0,c7dfb600,0,...) at seltdwait+0x90/frame 0xf5c6ba58 kern_select(c7dfb600,400,bfbfdcb0,0,0,...) at kern_select+0x88c/frame 0xf5c6bbf8 sys_select(c7dfb600,f5c6bcc8,c0ee50c0,c71fac90,0,...) at sys_select+0x69/frame 0xf5c6bc40 syscall(f5c6bd08) at syscall+0x2ed/frame 0xf5c6bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c6bcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281bd037, esp = 0xbfbfd894, ebp = 0xbfbfde24 --- Tracing command smartd pid 686 tid 100104 td 0xc7e59c00 sched_switch(c7e59c00,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5cf7a64 mi_switch(104,0,c10daa3d,1f5,c0af6910,...) at mi_switch+0x1c9/frame 0xf5cf7a98 sleepq_switch(c7e59c00,0,c10daa3d,1ab,8,...) at sleepq_switch+0x1b9/frame 0xf5cf7acc sleepq_catch_signals(c0af6910,c7e59c00,2,201,2,...) at sleepq_catch_signals+0x361/frame 0xf5cf7b14 sleepq_timedwait_sig(c128795a,6c,71b,80000000,70,...) at sleepq_timedwait_sig+0x14/frame 0xf5cf7b3c _sleep(c128795a,0,16c,c10d60ba,74de84ed,...) at _sleep+0x331/frame 0xf5cf7b98 kern_nanosleep(bfbf53c8,f5cf7c18,f5cf7c20,f5cf7cc8,708,...) at kern_nanosleep+0x158/frame 0xf5cf7c00 sys_nanosleep(c7e59c00,f5cf7cc8,c0ee50c0,c71fdc90,0,...) at sys_nanosleep+0x6b/frame 0xf5cf7c40 syscall(f5cf7d08) at syscall+0x2ed/frame 0xf5cf7cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cf7cfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x282ea223, esp = 0xbfbf53bc, ebp = 0xbfbf5400 --- Tracing command winbindd pid 684 tid 100122 td 0xc7e5bc00 sched_switch(c7e5bc00,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5d7d978 mi_switch(104,0,c10daa3d,1f5,400,...) at mi_switch+0x1c9/frame 0xf5d7d9ac sleepq_switch(c7e5bc00,0,c10daa3d,1ab,c7dafb90,...) at sleepq_switch+0x1b9/frame 0xf5d7d9e0 sleepq_catch_signals(c120d620,f5d7da50,c0a9de19,c7dafba0,0,...) at sleepq_catch_signals+0x361/frame 0xf5d7da28 sleepq_timedwait_sig(c7dafba4,0,f5d7da88,b7fbe76c,20c49,...) at sleepq_timedwait_sig+0x14/frame 0xf5d7da50 _cv_timedwait_sig_sbt(c7dafba4,c7dafb90,fed58389,20c95f,b7fbe76c,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5d7da9c seltdwait(20c95f,b7fbe76c,20c49,c7e5bc00,c10e14c8,...) at seltdwait+0xbc/frame 0xf5d7dad0 sys_poll(c7e5bc00,f5d7dcc8,c0ee50c0,c1825c90,0,...) at sys_poll+0x44c/frame 0xf5d7dc40 syscall(f5d7dd08) at syscall+0x2ed/frame 0xf5d7dcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d7dcfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2193b38f, esp = 0xbfbfc47c, ebp = 0xbfbfc4b8 --- Tracing command smbd pid 683 tid 100099 td 0xc7dfa000 sched_switch(c7dfa000,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5cbf978 mi_switch(104,0,c10daa3d,1f5,400,...) at mi_switch+0x1c9/frame 0xf5cbf9ac sleepq_switch(c7dfa000,0,c10daa3d,1ab,c7d7f690,...) at sleepq_switch+0x1b9/frame 0xf5cbf9e0 sleepq_catch_signals(c120d620,f5cbfa50,c0a9de19,c7d7f6a0,0,...) at sleepq_catch_signals+0x361/frame 0xf5cbfa28 sleepq_timedwait_sig(c7d7f6a4,0,f5cbfa88,b7fbe76c,20c49,...) at sleepq_timedwait_sig+0x14/frame 0xf5cbfa50 _cv_timedwait_sig_sbt(c7d7f6a4,c7d7f690,5c4b559c,20c4ae,b7fbe76c,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5cbfa9c seltdwait(20c4ae,b7fbe76c,20c49,c7dfa000,c81372b8,...) at seltdwait+0xbc/frame 0xf5cbfad0 sys_poll(c7dfa000,f5cbfcc8,14,c10d6fcd,7b3,...) at sys_poll+0x44c/frame 0xf5cbfc40 syscall(f5cbfd08) at syscall+0x2ed/frame 0xf5cbfcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cbfcfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x21b6438f, esp = 0xbfbfd9ec, ebp = 0xbfbfda28 --- Tracing command winbindd pid 672 tid 100100 td 0xc7e5a900 sched_switch(c7e5a900,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5cd0978 mi_switch(104,0,c10daa3d,1f5,400,...) at mi_switch+0x1c9/frame 0xf5cd09ac sleepq_switch(c7e5a900,0,c10daa3d,1ab,c7d7f7d0,...) at sleepq_switch+0x1b9/frame 0xf5cd09e0 sleepq_catch_signals(c120d620,f5cd0a50,c0a9de19,c7d7f7e0,0,...) at sleepq_catch_signals+0x361/frame 0xf5cd0a28 sleepq_timedwait_sig(c7d7f7e4,0,f5cd0a88,bffbd1be,12,...) at sleepq_timedwait_sig+0x14/frame 0xf5cd0a50 _cv_timedwait_sig_sbt(c7d7f7e4,c7d7f7d0,7f151422,5f0,bffbd1be,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5cd0a9c seltdwait(5f0,bffbd1be,12,c7e5a900,864,...) at seltdwait+0xbc/frame 0xf5cd0ad0 sys_poll(c7e5a900,f5cd0cc8,c0ee50c0,c1825c90,0,...) at sys_poll+0x44c/frame 0xf5cd0c40 syscall(f5cd0d08) at syscall+0x2ed/frame 0xf5cd0cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cd0cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2193b38f, esp = 0xbfbfdbcc, ebp = 0xbfbfdc08 --- Tracing command smbd pid 670 tid 100120 td 0xc7e6c300 sched_switch(c7e6c300,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5d76978 mi_switch(104,0,c10daa3d,1f5,400,...) at mi_switch+0x1c9/frame 0xf5d769ac sleepq_switch(c7e6c300,0,c10daa3d,1ab,c7daf790,...) at sleepq_switch+0x1b9/frame 0xf5d769e0 sleepq_catch_signals(c120d620,f5d76a50,c0a9de19,c7daf7a0,0,...) at sleepq_catch_signals+0x361/frame 0xf5d76a28 sleepq_timedwait_sig(c7daf7a4,0,f5d76a88,bffffbaa,3,...) at sleepq_timedwait_sig+0x14/frame 0xf5d76a50 _cv_timedwait_sig_sbt(c7daf7a4,c7daf790,632e5bb1,53d,bffffbaa,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5d76a9c seltdwait(53d,bffffbaa,3,c7e6c300,c76c83a0,...) at seltdwait+0xbc/frame 0xf5d76ad0 sys_poll(c7e6c300,f5d76cc8,0,0,c7e6c300,...) at sys_poll+0x44c/frame 0xf5d76c40 syscall(f5d76d08) at syscall+0x2ed/frame 0xf5d76cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d76cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x21b6438f, esp = 0xbfbfda9c, ebp = 0xbfbfdad8 --- Tracing command nmbd pid 668 tid 100094 td 0xc7e6e300 sched_switch(c7e6e300,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5cab978 mi_switch(104,0,c10daa3d,1f5,400,...) at mi_switch+0x1c9/frame 0xf5cab9ac sleepq_switch(c7e6e300,0,c10daa3d,1ab,c757a690,...) at sleepq_switch+0x1b9/frame 0xf5cab9e0 sleepq_catch_signals(c120d620,f5caba50,c0a9de19,c757a6a0,0,...) at sleepq_catch_signals+0x361/frame 0xf5caba28 sleepq_timedwait_sig(c757a6a4,0,f5caba88,9fffff47,0,...) at sleepq_timedwait_sig+0x14/frame 0xf5caba50 _cv_timedwait_sig_sbt(c757a6a4,c757a690,31858597,504,9fffff47,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5caba9c seltdwait(504,9fffff47,0,c7e6e300,a58,...) at seltdwait+0xbc/frame 0xf5cabad0 sys_poll(c7e6e300,f5cabcc8,c0ee50c0,c71fac90,0,...) at sys_poll+0x44c/frame 0xf5cabc40 syscall(f5cabd08) at syscall+0x2ed/frame 0xf5cabcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cabcfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2156338f, esp = 0xbfbfdb1c, ebp = 0xbfbfdb58 --- Tracing command ntpd pid 644 tid 100080 td 0xc7dfb000 sched_switch(c7dfb000,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5c7390c mi_switch(104,0,c10daa3d,1f5,200046,...) at mi_switch+0x1c9/frame 0xf5c73940 sleepq_switch(c7dfb000,0,c10daa3d,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5c73974 sleepq_catch_signals(f5c739e0,c0a9de19,c757bde0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5c739bc sleepq_wait_sig(c757bde4,0,f5c73a10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5c739e0 _cv_wait_sig(c757bde4,c757bdd0,c10dd781,68e,c0b0e26d,...) at _cv_wait_sig+0x200/frame 0xf5c73a24 seltdwait(ffffffff,0,0,c7dfb000,0,...) at seltdwait+0x90/frame 0xf5c73a58 kern_select(c7dfb000,1c,bfbfdd48,0,0,...) at kern_select+0x88c/frame 0xf5c73bf8 sys_select(c7dfb000,f5c73cc8,0,0,c7dfb000,...) at sys_select+0x69/frame 0xf5c73c40 syscall(f5c73d08) at syscall+0x2ed/frame 0xf5c73cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c73cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28399037, esp = 0xbfbfdd24, ebp = 0xbfbfdde4 --- Tracing command nfsd pid 587 tid 100111 td 0xc7df5600 sched_switch(c7df5600,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5d3ca84 mi_switch(104,0,c10daa3d,1f5,c0af6910,...) at mi_switch+0x1c9/frame 0xf5d3cab8 sleepq_switch(c7df5600,0,c10daa3d,1ab,c7931000,...) at sleepq_switch+0x1b9/frame 0xf5d3caec sleepq_catch_signals(c120d620,f5d3cb5c,c0a9de19,c7931010,0,...) at sleepq_catch_signals+0x361/frame 0xf5d3cb34 sleepq_timedwait_sig(c7cc4a10,0,f5d3cb94,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf5d3cb5c _cv_timedwait_sig_sbt(c7cc4a10,c7931000,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5d3cba8 svc_run_internal(f5d3ccf4,c0a8100f,c7931000,f5d3cd08,c10ce550,...) at svc_run_internal+0xa5d/frame 0xf5d3ccc4 svc_thread_start(c7931000,f5d3cd08,c10ce550,3d7,0,...) at svc_thread_start+0xd/frame 0xf5d3cccc fork_exit(c0cbb370,c7931000,f5d3cd08) at fork_exit+0x7f/frame 0xf5d3ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5d3ccf4 --- trap 0x8d20092e, eip = 0xc, esp = 0x33, ebp = 0xbfbfd937 --- Tracing command nfsd pid 587 tid 100110 td 0xc7df5900 sched_switch(c7df5900,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5d39a84 mi_switch(104,0,c10daa3d,1f5,c0af6910,...) at mi_switch+0x1c9/frame 0xf5d39ab8 sleepq_switch(c7df5900,0,c10daa3d,1ab,c7931000,...) at sleepq_switch+0x1b9/frame 0xf5d39aec sleepq_catch_signals(c120d620,f5d39b5c,c0a9de19,c7931010,0,...) at sleepq_catch_signals+0x361/frame 0xf5d39b34 sleepq_timedwait_sig(c7d5c810,0,f5d39b94,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf5d39b5c _cv_timedwait_sig_sbt(c7d5c810,c7931000,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5d39ba8 svc_run_internal(f5d39cf4,c0a8100f,c7931000,f5d39d08,c10ce550,...) at svc_run_internal+0xa5d/frame 0xf5d39cc4 svc_thread_start(c7931000,f5d39d08,c10ce550,3d7,0,...) at svc_thread_start+0xd/frame 0xf5d39ccc fork_exit(c0cbb370,c7931000,f5d39d08) at fork_exit+0x7f/frame 0xf5d39cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5d39cf4 --- trap 0x8d20092e, eip = 0xc, esp = 0x33, ebp = 0xbfbfd937 --- Tracing command nfsd pid 587 tid 100109 td 0xc7df5c00 sched_switch(c7df5c00,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5d36a84 mi_switch(104,0,c10daa3d,1f5,c0af6910,...) at mi_switch+0x1c9/frame 0xf5d36ab8 sleepq_switch(c7df5c00,0,c10daa3d,1ab,c7931000,...) at sleepq_switch+0x1b9/frame 0xf5d36aec sleepq_catch_signals(c120d620,f5d36b5c,c0a9de19,c7931010,0,...) at sleepq_catch_signals+0x361/frame 0xf5d36b34 sleepq_timedwait_sig(c7d5c290,0,f5d36b94,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf5d36b5c _cv_timedwait_sig_sbt(c7d5c290,c7931000,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5d36ba8 svc_run_internal(f5d36cf4,c0a8100f,c7931000,f5d36d08,c10ce550,...) at svc_run_internal+0xa5d/frame 0xf5d36cc4 svc_thread_start(c7931000,f5d36d08,c10ce550,3d7,0,...) at svc_thread_start+0xd/frame 0xf5d36ccc fork_exit(c0cbb370,c7931000,f5d36d08) at fork_exit+0x7f/frame 0xf5d36cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5d36cf4 --- trap 0x8d20092e, eip = 0xc, esp = 0x33, ebp = 0xbfbfd937 --- Tracing command nfsd pid 587 tid 100092 td 0xc7e5ac00 sched_switch(c7e5ac00,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5ca32fc mi_switch(104,0,c10daa3d,1f5,c0af6910,...) at mi_switch+0x1c9/frame 0xf5ca3330 sleepq_switch(c7e5ac00,0,c10daa3d,1ab,c7931000,...) at sleepq_switch+0x1b9/frame 0xf5ca3364 sleepq_catch_signals(c120d620,f5ca33d4,c0a9de19,c7931010,0,...) at sleepq_catch_signals+0x361/frame 0xf5ca33ac sleepq_timedwait_sig(c7d5c6d0,0,f5ca340c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xf5ca33d4 _cv_timedwait_sig_sbt(c7d5c6d0,c7931000,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5ca3420 svc_run_internal(c0cbb370,c7931000,c7e54ba0,f5ca3568,0,...) at svc_run_internal+0xa5d/frame 0xf5ca353c svc_run(c7931000,0,c10bfe5d,1b5,f5ca35e0,...) at svc_run+0xc3/frame 0xf5ca3578 nfsrvd_nfsd(c7e5ac00,f5ca36d0,c,c0b01950,1,...) at nfsrvd_nfsd+0x1a2/frame 0xf5ca36b0 nfssvc_nfsd(c7e5ac00,f5ca3cc8,0,c7e5ac00,f5ca3cfc,...) at nfssvc_nfsd+0xf4/frame 0xf5ca3c28 sys_nfssvc(c7e5ac00,f5ca3cc8,c0ee50c0,c7200c90,0,...) at sys_nfssvc+0xbf/frame 0xf5ca3c40 syscall(f5ca3d08) at syscall+0x2ed/frame 0xf5ca3cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5ca3cfc --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280c278b, esp = 0xbfbfd7e4, ebp = 0xbfbfda58 --- Tracing command nfsd pid 583 tid 100081 td 0xc7dfac00 sched_switch(c7dfac00,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5c7790c mi_switch(104,0,c10daa3d,1f5,46,...) at mi_switch+0x1c9/frame 0xf5c77940 sleepq_switch(c7dfac00,0,c10daa3d,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5c77974 sleepq_catch_signals(f5c779e0,c0a9de19,c757b2a0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5c779bc sleepq_wait_sig(c757b2a4,0,f5c77a10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5c779e0 _cv_wait_sig(c757b2a4,c757b290,c10dd781,68e,c0b0e26d,...) at _cv_wait_sig+0x200/frame 0xf5c77a24 seltdwait(ffffffff,0,0,c7dfac00,0,...) at seltdwait+0x90/frame 0xf5c77a58 kern_select(c7dfac00,7,bfbfdc30,0,0,...) at kern_select+0x88c/frame 0xf5c77bf8 sys_select(c7dfac00,f5c77cc8,c0ee50c0,c71fac90,0,...) at sys_select+0x69/frame 0xf5c77c40 syscall(f5c77d08) at syscall+0x2ed/frame 0xf5c77cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c77cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2818a037, esp = 0xbfbfda5c, ebp = 0xbfbfde34 --- Tracing command mountd pid 577 tid 100088 td 0xc7dbc000 sched_switch(c7dbc000,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5c9390c mi_switch(104,0,c10daa3d,1f5,46,...) at mi_switch+0x1c9/frame 0xf5c93940 sleepq_switch(c7dbc000,0,c10daa3d,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5c93974 sleepq_catch_signals(f5c939e0,c0a9de19,c757bba0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5c939bc sleepq_wait_sig(c757bba4,0,f5c93a10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5c939e0 _cv_wait_sig(c757bba4,c757bb90,c10dd781,68e,c0b0e26d,...) at _cv_wait_sig+0x200/frame 0xf5c93a24 seltdwait(ffffffff,0,0,c7dbc000,0,...) at seltdwait+0x90/frame 0xf5c93a58 kern_select(c7dbc000,9,bfbfdd50,0,0,...) at kern_select+0x88c/frame 0xf5c93bf8 sys_select(c7dbc000,f5c93cc8,f5c93c8c,c0929d87,c7922000,...) at sys_select+0x69/frame 0xf5c93c40 syscall(f5c93d08) at syscall+0x2ed/frame 0xf5c93cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c93cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a1037, esp = 0xbfbfdd0c, ebp = 0xbfbfde34 --- Tracing command nfsuserd pid 570 tid 100082 td 0xc7dfa900 sched_switch(c7dfa900,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5c7b900 mi_switch(104,0,c10daa3d,1f5,400,...) at mi_switch+0x1c9/frame 0xf5c7b934 sleepq_switch(c7dfa900,0,c10daa3d,1ab,c7dafbd0,...) at sleepq_switch+0x1b9/frame 0xf5c7b968 sleepq_catch_signals(c120d620,f5c7b9d8,c0a9de19,c7dafbe0,0,...) at sleepq_catch_signals+0x361/frame 0xf5c7b9b0 sleepq_timedwait_sig(c7dafbe4,0,f5c7ba10,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xf5c7b9d8 _cv_timedwait_sig_sbt(c7dafbe4,c7dafbd0,de52b380,51c,e0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5c7ba24 seltdwait(51c,e0000000,1,c7dfa900,0,...) at seltdwait+0xbc/frame 0xf5c7ba58 kern_select(c7dfa900,4,bfbfdc10,0,0,...) at kern_select+0x88c/frame 0xf5c7bbf8 sys_select(c7dfa900,f5c7bcc8,c112cd1f,d6,0,...) at sys_select+0x69/frame 0xf5c7bc40 syscall(f5c7bd08) at syscall+0x2ed/frame 0xf5c7bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c7bcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28189037, esp = 0xbfbfdb6c, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 569 tid 100089 td 0xc7db4c00 sched_switch(c7db4c00,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5c97900 mi_switch(104,0,c10daa3d,1f5,400,...) at mi_switch+0x1c9/frame 0xf5c97934 sleepq_switch(c7db4c00,0,c10daa3d,1ab,c757a550,...) at sleepq_switch+0x1b9/frame 0xf5c97968 sleepq_catch_signals(c120d620,f5c979d8,c0a9de19,c757a560,0,...) at sleepq_catch_signals+0x361/frame 0xf5c979b0 sleepq_timedwait_sig(c757a564,0,f5c97a10,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xf5c979d8 _cv_timedwait_sig_sbt(c757a564,c757a550,cf5bc531,51b,e0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5c97a24 seltdwait(51b,e0000000,1,c7db4c00,0,...) at seltdwait+0xbc/frame 0xf5c97a58 kern_select(c7db4c00,4,bfbfdc10,0,0,...) at kern_select+0x88c/frame 0xf5c97bf8 sys_select(c7db4c00,f5c97cc8,c0ee50c0,c7200c90,0,...) at sys_select+0x69/frame 0xf5c97c40 syscall(f5c97d08) at syscall+0x2ed/frame 0xf5c97cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c97cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28189037, esp = 0xbfbfdb6c, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 568 tid 100093 td 0xc7db4600 sched_switch(c7db4600,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5ca7900 mi_switch(104,0,c10daa3d,1f5,400,...) at mi_switch+0x1c9/frame 0xf5ca7934 sleepq_switch(c7db4600,0,c10daa3d,1ab,c757b8d0,...) at sleepq_switch+0x1b9/frame 0xf5ca7968 sleepq_catch_signals(c120d620,f5ca79d8,c0a9de19,c757b8e0,0,...) at sleepq_catch_signals+0x361/frame 0xf5ca79b0 sleepq_timedwait_sig(c757b8e4,0,f5ca7a10,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xf5ca79d8 _cv_timedwait_sig_sbt(c757b8e4,c757b8d0,a954c39b,51b,e0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5ca7a24 seltdwait(51b,e0000000,1,c7db4600,0,...) at seltdwait+0xbc/frame 0xf5ca7a58 kern_select(c7db4600,4,bfbfdc10,0,0,...) at kern_select+0x88c/frame 0xf5ca7bf8 sys_select(c7db4600,f5ca7cc8,c0ee50c0,c1825c90,0,...) at sys_select+0x69/frame 0xf5ca7c40 syscall(f5ca7d08) at syscall+0x2ed/frame 0xf5ca7cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5ca7cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28189037, esp = 0xbfbfdb6c, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 567 tid 100090 td 0xc7db4900 sched_switch(c7db4900,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5c9b900 mi_switch(104,0,c10daa3d,1f5,400,...) at mi_switch+0x1c9/frame 0xf5c9b934 sleepq_switch(c7db4900,0,c10daa3d,1ab,c7ded250,...) at sleepq_switch+0x1b9/frame 0xf5c9b968 sleepq_catch_signals(c120d620,f5c9b9d8,c0a9de19,c7ded260,0,...) at sleepq_catch_signals+0x361/frame 0xf5c9b9b0 sleepq_timedwait_sig(c7ded264,0,f5c9ba10,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xf5c9b9d8 _cv_timedwait_sig_sbt(c7ded264,c7ded250,e288bfa7,506,e0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5c9ba24 seltdwait(506,e0000000,1,c7db4900,0,...) at seltdwait+0xbc/frame 0xf5c9ba58 kern_select(c7db4900,4,bfbfdc10,0,0,...) at kern_select+0x88c/frame 0xf5c9bbf8 sys_select(c7db4900,f5c9bcc8,c112cd1f,e9,0,...) at sys_select+0x69/frame 0xf5c9bc40 syscall(f5c9bd08) at syscall+0x2ed/frame 0xf5c9bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c9bcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28189037, esp = 0xbfbfdb6c, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 566 tid 100085 td 0xc78f2c00 sched_switch(c78f2c00,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5c87aa0 mi_switch(104,0,c10daa3d,1f5,8,...) at mi_switch+0x1c9/frame 0xf5c87ad4 sleepq_switch(c78f2c00,0,c10daa3d,1ab,f5c87b4c,...) at sleepq_switch+0x1b9/frame 0xf5c87b08 sleepq_catch_signals(0,c10daa3d,162,11e8,c78f2c00,...) at sleepq_catch_signals+0x361/frame 0xf5c87b50 sleepq_wait_sig(c7c6f34c,74,c0f37104,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5c87b74 _sleep(c7c6f34c,c7c6f37c,174,c0f37104,0,...) at _sleep+0x35b/frame 0xf5c87bd0 kern_sigsuspend(c78f2c00,0,0,0,0,...) at kern_sigsuspend+0xfb/frame 0xf5c87c10 sys_sigsuspend(c78f2c00,f5c87cc8,c0ee50c0,c71fdc90,0,...) at sys_sigsuspend+0x58/frame 0xf5c87c40 syscall(f5c87d08) at syscall+0x2ed/frame 0xf5c87cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c87cfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x280c115b, esp = 0xbfbfdcac, ebp = 0xbfbfde44 --- Tracing command rpcbind pid 538 tid 100084 td 0xc7dbc600 sched_switch(c7dbc600,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5c83978 mi_switch(104,0,c10daa3d,1f5,400,...) at mi_switch+0x1c9/frame 0xf5c839ac sleepq_switch(c7dbc600,0,c10daa3d,1ab,c7d7f990,...) at sleepq_switch+0x1b9/frame 0xf5c839e0 sleepq_catch_signals(c120d620,f5c83a50,c0a9de19,c7d7f9a0,0,...) at sleepq_catch_signals+0x361/frame 0xf5c83a28 sleepq_timedwait_sig(c7d7f9a4,0,f5c83a88,dffffdd5,1,...) at sleepq_timedwait_sig+0x14/frame 0xf5c83a50 _cv_timedwait_sig_sbt(c7d7f9a4,c7d7f990,877cdab0,51b,dffffdd5,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5c83a9c seltdwait(51b,dffffdd5,1,c7dbc600,c7e17ae0,...) at seltdwait+0xbc/frame 0xf5c83ad0 sys_poll(c7dbc600,f5c83cc8,c0ee50c0,c7200c90,0,...) at sys_poll+0x44c/frame 0xf5c83c40 syscall(f5c83d08) at syscall+0x2ed/frame 0xf5c83cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c83cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2813e38f, esp = 0xbfbfbbfc, ebp = 0xbfbfddd8 --- Tracing command syslogd pid 523 tid 100086 td 0xc78f2900 sched_switch(c78f2900,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5c8b90c mi_switch(104,0,c10daa3d,1f5,46,...) at mi_switch+0x1c9/frame 0xf5c8b940 sleepq_switch(c78f2900,0,c10daa3d,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5c8b974 sleepq_catch_signals(f5c8b9e0,c0a9de19,c7ded1a0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5c8b9bc sleepq_wait_sig(c7ded1a4,0,f5c8ba10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5c8b9e0 _cv_wait_sig(c7ded1a4,c7ded190,c10dd781,68e,c78f2900,...) at _cv_wait_sig+0x200/frame 0xf5c8ba24 seltdwait(ffffffff,0,0,c78f2900,0,...) at seltdwait+0x90/frame 0xf5c8ba58 kern_select(c78f2900,9,28849100,0,0,...) at kern_select+0x88c/frame 0xf5c8bbf8 sys_select(c78f2900,f5c8bcc8,0,c7200c90,0,...) at sys_select+0x69/frame 0xf5c8bc40 syscall(f5c8bd08) at syscall+0x2ed/frame 0xf5c8bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c8bcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a0037, esp = 0xbfbfceac, ebp = 0xbfbfde34 --- Tracing command devd pid 420 tid 100108 td 0xc7e59000 sched_switch(c7e59000,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xf5d07900 mi_switch(104,0,c10daa3d,1f5,400,...) at mi_switch+0x1c9/frame 0xf5d07934 sleepq_switch(c7e59000,0,c10daa3d,1ab,c757a150,...) at sleepq_switch+0x1b9/frame 0xf5d07968 sleepq_catch_signals(c120d620,f5d079d8,c0a9de19,c757a160,0,...) at sleepq_catch_signals+0x361/frame 0xf5d079b0 sleepq_timedwait_sig(c757a164,0,f5d07a10,c0000000,3,...) at sleepq_timedwait_sig+0x14/frame 0xf5d079d8 _cv_timedwait_sig_sbt(c757a164,c757a150,62297c3b,53d,c0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5d07a24 seltdwait(53d,c0000000,3,c7e59000,0,...) at seltdwait+0xbc/frame 0xf5d07a58 kern_select(c7e59000,5,bfbfbda0,0,0,...) at kern_select+0x88c/frame 0xf5d07bf8 sys_select(c7e59000,f5d07cc8,c0ee50c0,c1825c90,0,...) at sys_select+0x69/frame 0xf5d07c40 syscall(f5d07d08) at syscall+0x2ed/frame 0xf5d07cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d07cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x8095dc3, esp = 0xbfbfbd44, ebp = 0xbfbfde54 --- Tracing command softdepflush pid 17 tid 100074 td 0xc7948000 sched_switch(c7948000,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3bffba4 mi_switch(104,0,c10daa3d,1f5,101,...) at mi_switch+0x1c9/frame 0xe3bffbd8 sleepq_switch(c7948000,0,c10daa3d,28e,c7948000,...) at sleepq_switch+0x1b9/frame 0xe3bffc0c sleepq_timedwait(c1402af4,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xe3bffc30 _sleep(c1402af4,c1402a74,54,c110d0d0,fffffed8,...) at _sleep+0x345/frame 0xe3bffc8c softdep_flush(0,e3bffd08,c10ce550,3d7,0,...) at softdep_flush+0x27c/frame 0xe3bffccc fork_exit(c0d14200,0,e3bffd08) at fork_exit+0x7f/frame 0xe3bffcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3bffcf4 --- trap 0, eip = 0, esp = 0xe3bffd40, ebp = 0 --- Tracing command syncer pid 16 tid 100073 td 0xc7948300 sched_switch(c7948300,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3bfcb78 mi_switch(104,0,c10daa3d,1f5,8,...) at mi_switch+0x1c9/frame 0xe3bfcbac sleepq_switch(c7948300,0,c10daa3d,28e,0,...) at sleepq_switch+0x1b9/frame 0xe3bfcbe0 sleepq_timedwait(c13fe8a4,0,e3bfcc3c,0,0,...) at sleepq_timedwait+0x48/frame 0xe3bfcc04 _cv_timedwait_sbt(c13fe8a4,c13fe884,fffffed8,0,0,...) at _cv_timedwait_sbt+0x228/frame 0xe3bfcc50 sched_sync(0,e3bfcd08,c10ce550,3d7,0,...) at sched_sync+0x682/frame 0xe3bfcccc fork_exit(c0b5e360,0,e3bfcd08) at fork_exit+0x7f/frame 0xe3bfccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3bfccf4 --- trap 0, eip = 0, esp = 0xe3bfcd40, ebp = 0 --- Tracing command vnlru pid 9 tid 100072 td 0xc7948600 sched_switch(c7948600,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3bf9b78 mi_switch(104,0,c10daa3d,1f5,101,...) at mi_switch+0x1c9/frame 0xe3bf9bac sleepq_switch(c7948600,0,c10daa3d,28e,c7948600,...) at sleepq_switch+0x1b9/frame 0xe3bf9be0 sleepq_timedwait(c7c6fba0,60,0,0,0,...) at sleepq_timedwait+0x48/frame 0xe3bf9c04 _sleep(c7c6fba0,c13fe85c,260,c10e6af4,fffffed8,...) at _sleep+0x345/frame 0xe3bf9c60 vnlru_proc(0,e3bf9d08,c10ce550,3d7,0,...) at vnlru_proc+0xcf/frame 0xe3bf9ccc fork_exit(c0b5ec00,0,e3bf9d08) at fork_exit+0x7f/frame 0xe3bf9cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3bf9cf4 --- trap 0, eip = 0, esp = 0xe3bf9d40, ebp = 0 --- Tracing command bufdaemon pid 8 tid 100071 td 0xc7948900 sched_switch(c7948900,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3bf6bb0 mi_switch(104,0,c10daa3d,1f5,101,...) at mi_switch+0x1c9/frame 0xe3bf6be4 sleepq_switch(c7948900,0,c10daa3d,28e,c7948900,...) at sleepq_switch+0x1b9/frame 0xe3bf6c18 sleepq_timedwait(c13fe61c,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xe3bf6c3c _sleep(c13fe61c,c13fe604,54,c10e3568,fffffed8,...) at _sleep+0x345/frame 0xe3bf6c98 buf_daemon(0,e3bf6d08,c10ce550,3d7,0,...) at buf_daemon+0x8c/frame 0xe3bf6ccc fork_exit(c0b41f00,0,e3bf6d08) at fork_exit+0x7f/frame 0xe3bf6cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3bf6cf4 --- trap 0, eip = 0, esp = 0xe3bf6d40, ebp = 0 --- Tracing command pagezero pid 7 tid 100070 td 0xc7948c00 sched_switch(c7948c00,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3bf3bac mi_switch(104,0,c10daa3d,1f5,101,...) at mi_switch+0x1c9/frame 0xe3bf3be0 sleepq_switch(c7948c00,0,c10daa3d,28e,c7948c00,...) at sleepq_switch+0x1b9/frame 0xe3bf3c14 sleepq_timedwait(c14033f4,0,12b,0,0,...) at sleepq_timedwait+0x48/frame 0xe3bf3c38 _sleep(c14033f4,c1456e00,0,c1114414,fffea520,...) at _sleep+0x345/frame 0xe3bf3c94 vm_pagezero(0,e3bf3d08,c10ce550,3d7,0,...) at vm_pagezero+0xc2/frame 0xe3bf3ccc fork_exit(c0d61880,0,e3bf3d08) at fork_exit+0x7f/frame 0xe3bf3cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3bf3cf4 --- trap 0, eip = 0, esp = 0xe3bf3d40, ebp = 0 --- Tracing command vmdaemon pid 6 tid 100069 td 0xc7949000 sched_switch(c7949000,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3bf0b78 mi_switch(104,0,c10daa3d,1f5,162,...) at mi_switch+0x1c9/frame 0xe3bf0bac sleepq_switch(c7949000,0,c10daa3d,26b,c7949000,...) at sleepq_switch+0x1b9/frame 0xe3bf0be0 sleepq_wait(c1402fbc,74,c10e3568,0,0,...) at sleepq_wait+0x48/frame 0xe3bf0c04 _sleep(c1402fbc,c1402fa4,74,c10e3568,0,...) at _sleep+0x37c/frame 0xe3bf0c60 vm_daemon(0,e3bf0d08,c10ce550,3d7,0,...) at vm_daemon+0xac/frame 0xe3bf0ccc fork_exit(c0d59940,0,e3bf0d08) at fork_exit+0x7f/frame 0xe3bf0cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3bf0cf4 --- trap 0, eip = 0, esp = 0xe3bf0d40, ebp = 0 --- Tracing command pagedaemon pid 5 tid 100068 td 0xc7949300 sched_switch(c7949300,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3bedb30 mi_switch(104,0,c10daa3d,1f5,101,...) at mi_switch+0x1c9/frame 0xe3bedb64 sleepq_switch(c7949300,0,c10daa3d,28e,c7949300,...) at sleepq_switch+0x1b9/frame 0xe3bedb98 sleepq_timedwait(c1456e84,54,4,0,0,...) at sleepq_timedwait+0x48/frame 0xe3bedbbc _sleep(c1456e84,c1456e00,54,c10e3568,fffffa38,...) at _sleep+0x345/frame 0xe3bedc18 vm_pageout(0,e3bedd08,c10ce550,3d7,0,...) at vm_pageout+0x290/frame 0xe3bedccc fork_exit(c0d5a160,0,e3bedd08) at fork_exit+0x7f/frame 0xe3bedcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3bedcf4 --- trap 0, eip = 0, esp = 0xe3bedd40, ebp = 0 --- Tracing command xpt_thrd pid 4 tid 100067 td 0xc7949600 sched_switch(c7949600,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3baabb0 mi_switch(104,0,c10daa3d,1f5,162,...) at mi_switch+0x1c9/frame 0xe3baabe4 sleepq_switch(c7949600,0,c10daa3d,26b,c7949600,...) at sleepq_switch+0x1b9/frame 0xe3baac18 sleepq_wait(c1252a24,5c,c0f0ce60,0,0,...) at sleepq_wait+0x48/frame 0xe3baac3c _sleep(c1252a24,c1252a74,5c,c0f0ce60,0,...) at _sleep+0x37c/frame 0xe3baac98 xpt_scanner_thread(0,e3baad08,c10ce550,3d7,0,...) at xpt_scanner_thread+0x11c/frame 0xe3baaccc fork_exit(c04b84a0,0,e3baad08) at fork_exit+0x7f/frame 0xe3baacf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3baacf4 --- trap 0, eip = 0, esp = 0xe3baad40, ebp = 0 --- Tracing command sctp_iterator pid 3 tid 100066 td 0xc7949900 sched_switch(c7949900,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3ba7bb8 mi_switch(104,0,c10daa3d,1f5,162,...) at mi_switch+0x1c9/frame 0xe3ba7bec sleepq_switch(c7949900,0,c10daa3d,26b,c7949900,...) at sleepq_switch+0x1b9/frame 0xe3ba7c20 sleepq_wait(c1452b8c,0,c10fa095,0,0,...) at sleepq_wait+0x48/frame 0xe3ba7c44 _sleep(c1452b8c,c1452b54,0,c10fa095,0,...) at _sleep+0x37c/frame 0xe3ba7ca0 sctp_iterator_thread(0,e3ba7d08,c10ce550,3d7,0,...) at sctp_iterator_thread+0x7c/frame 0xe3ba7ccc fork_exit(c0bfde70,0,e3ba7d08) at fork_exit+0x7f/frame 0xe3ba7cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3ba7cf4 --- trap 0, eip = 0, esp = 0xe3ba7d40, ebp = 0 --- Tracing command fdc0 pid 2 tid 100061 td 0xc78e5900 sched_switch(c78e5900,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3b97b48 mi_switch(104,0,c10daa3d,1f5,101,...) at mi_switch+0x1c9/frame 0xe3b97b7c sleepq_switch(c78e5900,0,c10daa3d,28e,c78e5900,...) at sleepq_switch+0x1b9/frame 0xe3b97bb0 sleepq_timedwait(c789303c,5c,0,0,0,...) at sleepq_timedwait+0x48/frame 0xe3b97bd4 _sleep(c789303c,c78930f0,5c,c10c081e,fffffed8,...) at _sleep+0x345/frame 0xe3b97c30 fdc_thread(c7893000,e3b97d08,c10ce550,3d7,0,...) at fdc_thread+0x877/frame 0xe3b97ccc fork_exit(c0e6c080,c7893000,e3b97d08) at fork_exit+0x7f/frame 0xe3b97cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b97cf4 --- trap 0, eip = 0, esp = 0xe3b97d40, ebp = 0 --- Tracing command usb pid 15 tid 100058 td 0xc78ef300 sched_switch(c78ef300,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3b73bd4 mi_switch(104,0,c10daa3d,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b73c08 sleepq_switch(c78ef300,0,c10daa3d,26b,c78ef300,...) at sleepq_switch+0x1b9/frame 0xe3b73c3c sleepq_wait(c78f7d34,0,e3b73c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b73c60 _cv_wait(c78f7d34,c78f7e4c,c10b1fb3,77,c78f7d3c,...) at _cv_wait+0x1f9/frame 0xe3b73ca4 usb_process(c78f7d2c,e3b73d08,c10ce550,3d7,0,...) at usb_process+0xe6/frame 0xe3b73ccc fork_exit(c0961af0,c78f7d2c,e3b73d08) at fork_exit+0x7f/frame 0xe3b73cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b73cf4 --- trap 0, eip = 0, esp = 0xe3b73d40, ebp = 0 --- Tracing command usb pid 15 tid 100057 td 0xc78ef600 sched_switch(c78ef600,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3b70bd4 mi_switch(104,0,c10daa3d,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b70c08 sleepq_switch(c78ef600,0,c10daa3d,26b,c78ef600,...) at sleepq_switch+0x1b9/frame 0xe3b70c3c sleepq_wait(c78f7d04,0,e3b70c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b70c60 _cv_wait(c78f7d04,c78f7e4c,c10b1fb3,77,c78f7d0c,...) at _cv_wait+0x1f9/frame 0xe3b70ca4 usb_process(c78f7cfc,e3b70d08,c10ce550,3d7,0,...) at usb_process+0xe6/frame 0xe3b70ccc fork_exit(c0961af0,c78f7cfc,e3b70d08) at fork_exit+0x7f/frame 0xe3b70cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b70cf4 --- trap 0, eip = 0, esp = 0xe3b70d40, ebp = 0 --- Tracing command usb pid 15 tid 100056 td 0xc78ef900 sched_switch(c78ef900,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3b6dbd4 mi_switch(104,0,c10daa3d,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b6dc08 sleepq_switch(c78ef900,0,c10daa3d,26b,c78ef900,...) at sleepq_switch+0x1b9/frame 0xe3b6dc3c sleepq_wait(c78f7cd4,0,e3b6dc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b6dc60 _cv_wait(c78f7cd4,c78f7e4c,c10b1fb3,77,c78f7cdc,...) at _cv_wait+0x1f9/frame 0xe3b6dca4 usb_process(c78f7ccc,e3b6dd08,c10ce550,3d7,0,...) at usb_process+0xe6/frame 0xe3b6dccc fork_exit(c0961af0,c78f7ccc,e3b6dd08) at fork_exit+0x7f/frame 0xe3b6dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b6dcf4 --- trap 0, eip = 0, esp = 0xe3b6dd40, ebp = 0 --- Tracing command usb pid 15 tid 100055 td 0xc78efc00 sched_switch(c78efc00,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3b6abd4 mi_switch(104,0,c10daa3d,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b6ac08 sleepq_switch(c78efc00,0,c10daa3d,26b,c78efc00,...) at sleepq_switch+0x1b9/frame 0xe3b6ac3c sleepq_wait(c78f7ca4,0,e3b6ac90,1,0,...) at sleepq_wait+0x48/frame 0xe3b6ac60 _cv_wait(c78f7ca4,c78f7e4c,c10b1fb3,77,c78f7cac,...) at _cv_wait+0x1f9/frame 0xe3b6aca4 usb_process(c78f7c9c,e3b6ad08,c10ce550,3d7,0,...) at usb_process+0xe6/frame 0xe3b6accc fork_exit(c0961af0,c78f7c9c,e3b6ad08) at fork_exit+0x7f/frame 0xe3b6acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b6acf4 --- trap 0, eip = 0, esp = 0xe3b6ad40, ebp = 0 --- Tracing command usb pid 15 tid 100053 td 0xc78f2300 sched_switch(c78f2300,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3b61bd4 mi_switch(104,0,c10daa3d,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b61c08 sleepq_switch(c78f2300,0,c10daa3d,26b,c78f2300,...) at sleepq_switch+0x1b9/frame 0xe3b61c3c sleepq_wait(c78ebb5c,0,e3b61c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b61c60 _cv_wait(c78ebb5c,c78ebc74,c10b1fb3,77,c78ebb64,...) at _cv_wait+0x1f9/frame 0xe3b61ca4 usb_process(c78ebb54,e3b61d08,c10ce550,3d7,0,...) at usb_process+0xe6/frame 0xe3b61ccc fork_exit(c0961af0,c78ebb54,e3b61d08) at fork_exit+0x7f/frame 0xe3b61cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b61cf4 --- trap 0, eip = 0, esp = 0xe3b61d40, ebp = 0 --- Tracing command usb pid 15 tid 100052 td 0xc78f2600 sched_switch(c78f2600,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3b5ebd4 mi_switch(104,0,c10daa3d,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b5ec08 sleepq_switch(c78f2600,0,c10daa3d,26b,c78f2600,...) at sleepq_switch+0x1b9/frame 0xe3b5ec3c sleepq_wait(c78ebb2c,0,e3b5ec90,1,0,...) at sleepq_wait+0x48/frame 0xe3b5ec60 _cv_wait(c78ebb2c,c78ebc74,c10b1fb3,77,c78ebb34,...) at _cv_wait+0x1f9/frame 0xe3b5eca4 usb_process(c78ebb24,e3b5ed08,c10ce550,3d7,0,...) at usb_process+0xe6/frame 0xe3b5eccc fork_exit(c0961af0,c78ebb24,e3b5ed08) at fork_exit+0x7f/frame 0xe3b5ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b5ecf4 --- trap 0, eip = 0, esp = 0xe3b5ed40, ebp = 0 --- Tracing command usb pid 15 tid 100051 td 0xc78e2000 sched_switch(c78e2000,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3b5bbd4 mi_switch(104,0,c10daa3d,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b5bc08 sleepq_switch(c78e2000,0,c10daa3d,26b,c78e2000,...) at sleepq_switch+0x1b9/frame 0xe3b5bc3c sleepq_wait(c78ebafc,0,e3b5bc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b5bc60 _cv_wait(c78ebafc,c78ebc74,c10b1fb3,77,c78ebb04,...) at _cv_wait+0x1f9/frame 0xe3b5bca4 usb_process(c78ebaf4,e3b5bd08,c10ce550,3d7,0,...) at usb_process+0xe6/frame 0xe3b5bccc fork_exit(c0961af0,c78ebaf4,e3b5bd08) at fork_exit+0x7f/frame 0xe3b5bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b5bcf4 --- trap 0, eip = 0, esp = 0xe3b5bd40, ebp = 0 --- Tracing command usb pid 15 tid 100050 td 0xc78e2300 sched_switch(c78e2300,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3b58bd4 mi_switch(104,0,c10daa3d,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b58c08 sleepq_switch(c78e2300,0,c10daa3d,26b,c78e2300,...) at sleepq_switch+0x1b9/frame 0xe3b58c3c sleepq_wait(c78ebacc,0,e3b58c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b58c60 _cv_wait(c78ebacc,c78ebc74,c10b1fb3,77,c78ebad4,...) at _cv_wait+0x1f9/frame 0xe3b58ca4 usb_process(c78ebac4,e3b58d08,c10ce550,3d7,0,...) at usb_process+0xe6/frame 0xe3b58ccc fork_exit(c0961af0,c78ebac4,e3b58d08) at fork_exit+0x7f/frame 0xe3b58cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b58cf4 --- trap 0, eip = 0, esp = 0xe3b58d40, ebp = 0 --- Tracing command usb pid 15 tid 100049 td 0xc78e2600 sched_switch(c78e2600,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3b54bd4 mi_switch(104,0,c10daa3d,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b54c08 sleepq_switch(c78e2600,0,c10daa3d,26b,c78e2600,...) at sleepq_switch+0x1b9/frame 0xe3b54c3c sleepq_wait(c78e6b5c,0,e3b54c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b54c60 _cv_wait(c78e6b5c,c78e6c74,c10b1fb3,77,c78e6b64,...) at _cv_wait+0x1f9/frame 0xe3b54ca4 usb_process(c78e6b54,e3b54d08,c10ce550,3d7,0,...) at usb_process+0xe6/frame 0xe3b54ccc fork_exit(c0961af0,c78e6b54,e3b54d08) at fork_exit+0x7f/frame 0xe3b54cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b54cf4 --- trap 0, eip = 0, esp = 0xe3b54d40, ebp = 0 --- Tracing command usb pid 15 tid 100048 td 0xc78e2900 sched_switch(c78e2900,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3b51bd4 mi_switch(104,0,c10daa3d,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b51c08 sleepq_switch(c78e2900,0,c10daa3d,26b,c78e2900,...) at sleepq_switch+0x1b9/frame 0xe3b51c3c sleepq_wait(c78e6b2c,0,e3b51c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b51c60 _cv_wait(c78e6b2c,c78e6c74,c10b1fb3,77,c78e6b34,...) at _cv_wait+0x1f9/frame 0xe3b51ca4 usb_process(c78e6b24,e3b51d08,c10ce550,3d7,0,...) at usb_process+0xe6/frame 0xe3b51ccc fork_exit(c0961af0,c78e6b24,e3b51d08) at fork_exit+0x7f/frame 0xe3b51cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b51cf4 --- trap 0, eip = 0, esp = 0xe3b51d40, ebp = 0 --- Tracing command usb pid 15 tid 100047 td 0xc78e2c00 sched_switch(c78e2c00,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3b4ebd4 mi_switch(104,0,c10daa3d,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b4ec08 sleepq_switch(c78e2c00,0,c10daa3d,26b,c78e2c00,...) at sleepq_switch+0x1b9/frame 0xe3b4ec3c sleepq_wait(c78e6afc,0,e3b4ec90,1,0,...) at sleepq_wait+0x48/frame 0xe3b4ec60 _cv_wait(c78e6afc,c78e6c74,c10b1fb3,77,c78e6b04,...) at _cv_wait+0x1f9/frame 0xe3b4eca4 usb_process(c78e6af4,e3b4ed08,c10ce550,3d7,0,...) at usb_process+0xe6/frame 0xe3b4eccc fork_exit(c0961af0,c78e6af4,e3b4ed08) at fork_exit+0x7f/frame 0xe3b4ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b4ecf4 --- trap 0, eip = 0, esp = 0xe3b4ed40, ebp = 0 --- Tracing command usb pid 15 tid 100046 td 0xc78e3000 sched_switch(c78e3000,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3b4bbd4 mi_switch(104,0,c10daa3d,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b4bc08 sleepq_switch(c78e3000,0,c10daa3d,26b,c78e3000,...) at sleepq_switch+0x1b9/frame 0xe3b4bc3c sleepq_wait(c78e6acc,0,e3b4bc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b4bc60 _cv_wait(c78e6acc,c78e6c74,c10b1fb3,77,c78e6ad4,...) at _cv_wait+0x1f9/frame 0xe3b4bca4 usb_process(c78e6ac4,e3b4bd08,c10ce550,3d7,0,...) at usb_process+0xe6/frame 0xe3b4bccc fork_exit(c0961af0,c78e6ac4,e3b4bd08) at fork_exit+0x7f/frame 0xe3b4bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b4bcf4 --- trap 0, eip = 0, esp = 0xe3b4bd40, ebp = 0 --- Tracing command usb pid 15 tid 100045 td 0xc78e3300 sched_switch(c78e3300,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3b47bd4 mi_switch(104,0,c10daa3d,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b47c08 sleepq_switch(c78e3300,0,c10daa3d,26b,c78e3300,...) at sleepq_switch+0x1b9/frame 0xe3b47c3c sleepq_wait(c78deb5c,0,e3b47c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b47c60 _cv_wait(c78deb5c,c78dec74,c10b1fb3,77,c78deb64,...) at _cv_wait+0x1f9/frame 0xe3b47ca4 usb_process(c78deb54,e3b47d08,c10ce550,3d7,0,...) at usb_process+0xe6/frame 0xe3b47ccc fork_exit(c0961af0,c78deb54,e3b47d08) at fork_exit+0x7f/frame 0xe3b47cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b47cf4 --- trap 0, eip = 0, esp = 0xe3b47d40, ebp = 0 --- Tracing command usb pid 15 tid 100044 td 0xc78e3600 sched_switch(c78e3600,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3b44bd4 mi_switch(104,0,c10daa3d,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b44c08 sleepq_switch(c78e3600,0,c10daa3d,26b,c78e3600,...) at sleepq_switch+0x1b9/frame 0xe3b44c3c sleepq_wait(c78deb2c,0,e3b44c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b44c60 _cv_wait(c78deb2c,c78dec74,c10b1fb3,77,c78deb34,...) at _cv_wait+0x1f9/frame 0xe3b44ca4 usb_process(c78deb24,e3b44d08,c10ce550,3d7,0,...) at usb_process+0xe6/frame 0xe3b44ccc fork_exit(c0961af0,c78deb24,e3b44d08) at fork_exit+0x7f/frame 0xe3b44cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b44cf4 --- trap 0, eip = 0, esp = 0xe3b44d40, ebp = 0 --- Tracing command usb pid 15 tid 100043 td 0xc78e3900 sched_switch(c78e3900,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3b41bd4 mi_switch(104,0,c10daa3d,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b41c08 sleepq_switch(c78e3900,0,c10daa3d,26b,c78e3900,...) at sleepq_switch+0x1b9/frame 0xe3b41c3c sleepq_wait(c78deafc,0,e3b41c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b41c60 _cv_wait(c78deafc,c78dec74,c10b1fb3,77,c78deb04,...) at _cv_wait+0x1f9/frame 0xe3b41ca4 usb_process(c78deaf4,e3b41d08,c10ce550,3d7,0,...) at usb_process+0xe6/frame 0xe3b41ccc fork_exit(c0961af0,c78deaf4,e3b41d08) at fork_exit+0x7f/frame 0xe3b41cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b41cf4 --- trap 0, eip = 0, esp = 0xe3b41d40, ebp = 0 --- Tracing command usb pid 15 tid 100042 td 0xc78e3c00 sched_switch(c78e3c00,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3b3ebd4 mi_switch(104,0,c10daa3d,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b3ec08 sleepq_switch(c78e3c00,0,c10daa3d,26b,c78e3c00,...) at sleepq_switch+0x1b9/frame 0xe3b3ec3c sleepq_wait(c78deacc,0,e3b3ec90,1,0,...) at sleepq_wait+0x48/frame 0xe3b3ec60 _cv_wait(c78deacc,c78dec74,c10b1fb3,77,c78dead4,...) at _cv_wait+0x1f9/frame 0xe3b3eca4 usb_process(c78deac4,e3b3ed08,c10ce550,3d7,0,...) at usb_process+0xe6/frame 0xe3b3eccc fork_exit(c0961af0,c78deac4,e3b3ed08) at fork_exit+0x7f/frame 0xe3b3ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b3ecf4 --- trap 0, eip = 0, esp = 0xe3b3ed40, ebp = 0 --- Tracing command usb pid 15 tid 100040 td 0xc78d2000 sched_switch(c78d2000,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3b37bd4 mi_switch(104,0,c10daa3d,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b37c08 sleepq_switch(c78d2000,0,c10daa3d,26b,c78d2000,...) at sleepq_switch+0x1b9/frame 0xe3b37c3c sleepq_wait(c78d9b5c,0,e3b37c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b37c60 _cv_wait(c78d9b5c,c78d9c74,c10b1fb3,77,c78d9b64,...) at _cv_wait+0x1f9/frame 0xe3b37ca4 usb_process(c78d9b54,e3b37d08,c10ce550,3d7,0,...) at usb_process+0xe6/frame 0xe3b37ccc fork_exit(c0961af0,c78d9b54,e3b37d08) at fork_exit+0x7f/frame 0xe3b37cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b37cf4 --- trap 0, eip = 0, esp = 0xe3b37d40, ebp = 0 --- Tracing command usb pid 15 tid 100039 td 0xc78d2300 sched_switch(c78d2300,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3b34bd4 mi_switch(104,0,c10daa3d,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b34c08 sleepq_switch(c78d2300,0,c10daa3d,26b,c78d2300,...) at sleepq_switch+0x1b9/frame 0xe3b34c3c sleepq_wait(c78d9b2c,0,e3b34c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b34c60 _cv_wait(c78d9b2c,c78d9c74,c10b1fb3,77,c78d9b34,...) at _cv_wait+0x1f9/frame 0xe3b34ca4 usb_process(c78d9b24,e3b34d08,c10ce550,3d7,0,...) at usb_process+0xe6/frame 0xe3b34ccc fork_exit(c0961af0,c78d9b24,e3b34d08) at fork_exit+0x7f/frame 0xe3b34cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b34cf4 --- trap 0, eip = 0, esp = 0xe3b34d40, ebp = 0 --- Tracing command usb pid 15 tid 100038 td 0xc78d2600 sched_switch(c78d2600,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3b31bd4 mi_switch(104,0,c10daa3d,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b31c08 sleepq_switch(c78d2600,0,c10daa3d,26b,c78d2600,...) at sleepq_switch+0x1b9/frame 0xe3b31c3c sleepq_wait(c78d9afc,0,e3b31c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b31c60 _cv_wait(c78d9afc,c78d9c74,c10b1fb3,77,c78d9b04,...) at _cv_wait+0x1f9/frame 0xe3b31ca4 usb_process(c78d9af4,e3b31d08,c10ce550,3d7,0,...) at usb_process+0xe6/frame 0xe3b31ccc fork_exit(c0961af0,c78d9af4,e3b31d08) at fork_exit+0x7f/frame 0xe3b31cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b31cf4 --- trap 0, eip = 0, esp = 0xe3b31d40, ebp = 0 --- Tracing command usb pid 15 tid 100037 td 0xc78d2900 sched_switch(c78d2900,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3b2ebd4 mi_switch(104,0,c10daa3d,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b2ec08 sleepq_switch(c78d2900,0,c10daa3d,26b,c78d2900,...) at sleepq_switch+0x1b9/frame 0xe3b2ec3c sleepq_wait(c78d9acc,0,e3b2ec90,1,0,...) at sleepq_wait+0x48/frame 0xe3b2ec60 _cv_wait(c78d9acc,c78d9c74,c10b1fb3,77,c78d9ad4,...) at _cv_wait+0x1f9/frame 0xe3b2eca4 usb_process(c78d9ac4,e3b2ed08,c10ce550,3d7,0,...) at usb_process+0xe6/frame 0xe3b2eccc fork_exit(c0961af0,c78d9ac4,e3b2ed08) at fork_exit+0x7f/frame 0xe3b2ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b2ecf4 --- trap 0, eip = 0, esp = 0xe3b2ed40, ebp = 0 --- Tracing command usb pid 15 tid 100035 td 0xc78d4000 sched_switch(c78d4000,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3b27bd4 mi_switch(104,0,c10daa3d,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b27c08 sleepq_switch(c78d4000,0,c10daa3d,26b,c78d4000,...) at sleepq_switch+0x1b9/frame 0xe3b27c3c sleepq_wait(c78cdb5c,0,e3b27c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b27c60 _cv_wait(c78cdb5c,c78cdc74,c10b1fb3,77,c78cdb64,...) at _cv_wait+0x1f9/frame 0xe3b27ca4 usb_process(c78cdb54,e3b27d08,c10ce550,3d7,0,...) at usb_process+0xe6/frame 0xe3b27ccc fork_exit(c0961af0,c78cdb54,e3b27d08) at fork_exit+0x7f/frame 0xe3b27cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b27cf4 --- trap 0, eip = 0, esp = 0xe3b27d40, ebp = 0 --- Tracing command usb pid 15 tid 100034 td 0xc78d4300 sched_switch(c78d4300,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3b24bd4 mi_switch(104,0,c10daa3d,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b24c08 sleepq_switch(c78d4300,0,c10daa3d,26b,c78d4300,...) at sleepq_switch+0x1b9/frame 0xe3b24c3c sleepq_wait(c78cdb2c,0,e3b24c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b24c60 _cv_wait(c78cdb2c,c78cdc74,c10b1fb3,77,c78cdb34,...) at _cv_wait+0x1f9/frame 0xe3b24ca4 usb_process(c78cdb24,e3b24d08,c10ce550,3d7,0,...) at usb_process+0xe6/frame 0xe3b24ccc fork_exit(c0961af0,c78cdb24,e3b24d08) at fork_exit+0x7f/frame 0xe3b24cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b24cf4 --- trap 0, eip = 0, esp = 0xe3b24d40, ebp = 0 --- Tracing command usb pid 15 tid 100033 td 0xc78d4600 sched_switch(c78d4600,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3b21bd4 mi_switch(104,0,c10daa3d,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b21c08 sleepq_switch(c78d4600,0,c10daa3d,26b,c78d4600,...) at sleepq_switch+0x1b9/frame 0xe3b21c3c sleepq_wait(c78cdafc,0,e3b21c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b21c60 _cv_wait(c78cdafc,c78cdc74,c10b1fb3,77,c78cdb04,...) at _cv_wait+0x1f9/frame 0xe3b21ca4 usb_process(c78cdaf4,e3b21d08,c10ce550,3d7,0,...) at usb_process+0xe6/frame 0xe3b21ccc fork_exit(c0961af0,c78cdaf4,e3b21d08) at fork_exit+0x7f/frame 0xe3b21cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b21cf4 --- trap 0, eip = 0, esp = 0xe3b21d40, ebp = 0 --- Tracing command usb pid 15 tid 100032 td 0xc78d4900 sched_switch(c78d4900,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3b1ebd4 mi_switch(104,0,c10daa3d,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b1ec08 sleepq_switch(c78d4900,0,c10daa3d,26b,c78d4900,...) at sleepq_switch+0x1b9/frame 0xe3b1ec3c sleepq_wait(c78cdacc,0,e3b1ec90,1,0,...) at sleepq_wait+0x48/frame 0xe3b1ec60 _cv_wait(c78cdacc,c78cdc74,c10b1fb3,77,c78cdad4,...) at _cv_wait+0x1f9/frame 0xe3b1eca4 usb_process(c78cdac4,e3b1ed08,c10ce550,3d7,0,...) at usb_process+0xe6/frame 0xe3b1eccc fork_exit(c0961af0,c78cdac4,e3b1ed08) at fork_exit+0x7f/frame 0xe3b1ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b1ecf4 --- trap 0, eip = 0, esp = 0xe3b1ed40, ebp = 0 --- Tracing command yarrow pid 14 tid 100017 td 0xc7776600 sched_switch(c7776600,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xc7236bb4 mi_switch(104,0,c10daa3d,1f5,c12a28d0,...) at mi_switch+0x1c9/frame 0xc7236be8 sleepq_switch(c7776600,0,c10daa3d,28e,c126d5dc,...) at sleepq_switch+0x1b9/frame 0xc7236c1c sleepq_timedwait(c126d5dc,0,c10d564d,c10c081e,0,...) at sleepq_timedwait+0x48/frame 0xc7236c40 msleep_spin_sbt(c126d5dc,c144d910,c10c081e,19999999,0,...) at msleep_spin_sbt+0x225/frame 0xc7236c88 random_kthread(0,c7236d08,c10ce550,3d7,0,...) at random_kthread+0x2ea/frame 0xc7236ccc fork_exit(c08500c0,0,c7236d08) at fork_exit+0x7f/frame 0xc7236cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7236cf4 --- trap 0, eip = 0, esp = 0xc7236d40, ebp = 0 --- Tracing command geom pid 13 tid 100015 td 0xc7776c00 sched_switch(c7776c00,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xc722fb70 mi_switch(104,0,c10daa3d,1f5,162,...) at mi_switch+0x1c9/frame 0xc722fba4 sleepq_switch(c7776c00,0,c10daa3d,26b,c7776c00,...) at sleepq_switch+0x1b9/frame 0xc722fbd8 sleepq_wait(c144ebe8,5c,c10c081e,0,0,...) at sleepq_wait+0x48/frame 0xc722fbfc _sleep(c144ebe8,c1284b7c,25c,c10c081e,0,...) at _sleep+0x37c/frame 0xc722fc58 g_io_schedule_down(c7776c00,0,c10c2545,6c,c722fcf4,...) at g_io_schedule_down+0x5c/frame 0xc722fcb4 g_down_procbody(0,c722fd08,c10ce550,3d7,0,...) at g_down_procbody+0x9d/frame 0xc722fccc fork_exit(c0a10c10,0,c722fd08) at fork_exit+0x7f/frame 0xc722fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc722fcf4 --- trap 0, eip = 0, esp = 0xc722fd40, ebp = 0 --- Tracing command geom pid 13 tid 100014 td 0xc7778000 sched_switch(c7778000,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xc722cb98 mi_switch(104,0,c10daa3d,1f5,162,...) at mi_switch+0x1c9/frame 0xc722cbcc sleepq_switch(c7778000,0,c10daa3d,26b,c7778000,...) at sleepq_switch+0x1b9/frame 0xc722cc00 sleepq_wait(c144ebe4,5c,c10c081e,0,0,...) at sleepq_wait+0x48/frame 0xc722cc24 _sleep(c144ebe4,c1284b9c,25c,c10c081e,0,...) at _sleep+0x37c/frame 0xc722cc80 g_io_schedule_up(c7778000,0,c10c2545,5f,c722ccf4,...) at g_io_schedule_up+0xe6/frame 0xc722ccb4 g_up_procbody(0,c722cd08,c10ce550,3d7,0,...) at g_up_procbody+0x9d/frame 0xc722cccc fork_exit(c0a10b70,0,c722cd08) at fork_exit+0x7f/frame 0xc722ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc722ccf4 --- trap 0, eip = 0, esp = 0xc722cd40, ebp = 0 --- Tracing command geom pid 13 tid 100013 td 0xc76c7300 sched_switch(c76c7300,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xc7229ba8 mi_switch(104,0,c10daa3d,1f5,162,...) at mi_switch+0x1c9/frame 0xc7229bdc sleepq_switch(c76c7300,0,c10daa3d,26b,c76c7300,...) at sleepq_switch+0x1b9/frame 0xc7229c10 sleepq_wait(c144ebe0,5c,c10c081e,0,0,...) at sleepq_wait+0x48/frame 0xc7229c34 _sleep(c144ebe0,c1284b54,25c,c10c081e,0,...) at _sleep+0x37c/frame 0xc7229c90 g_run_events(0,c7229d08,c10ce550,3d7,0,...) at g_run_events+0x566/frame 0xc7229ccc fork_exit(c0a10ad0,0,c7229d08) at fork_exit+0x7f/frame 0xc7229cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7229cf4 --- trap 0, eip = 0, esp = 0xc7229d40, ebp = 0 --- Tracing command intr pid 12 tid 100063 td 0xc78e5300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100062 td 0xc78e5600 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100060 td 0xc78e5c00 sched_switch(c78e5c00,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xe3b8ac60 mi_switch(109,0,c10ce7ed,55a,8,...) at mi_switch+0x1c9/frame 0xe3b8ac94 ithread_loop(c770d5a0,e3b8ad08,c10ce550,3d7,0,...) at ithread_loop+0x100/frame 0xe3b8accc fork_exit(c0a83d90,c770d5a0,e3b8ad08) at fork_exit+0x7f/frame 0xe3b8acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b8acf4 --- trap 0, eip = 0, esp = 0xe3b8ad40, ebp = 0 --- Tracing command intr pid 12 tid 100059 td 0xc78ef000 sched_switch(c78ef000,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xe3b79c60 mi_switch(109,0,c10ce7ed,55a,8,...) at mi_switch+0x1c9/frame 0xe3b79c94 ithread_loop(c770d0f0,e3b79d08,c10ce550,3d7,0,...) at ithread_loop+0x100/frame 0xe3b79ccc fork_exit(c0a83d90,c770d0f0,e3b79d08) at fork_exit+0x7f/frame 0xe3b79cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b79cf4 --- trap 0, eip = 0, esp = 0xe3b79d40, ebp = 0 --- Tracing command intr pid 12 tid 100054 td 0xc78f2000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xc78e5000 sched_switch(c78e5000,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xe3b3bc60 mi_switch(109,0,c10ce7ed,55a,8,...) at mi_switch+0x1c9/frame 0xe3b3bc94 ithread_loop(c770d1e0,e3b3bd08,c10ce550,3d7,0,...) at ithread_loop+0x100/frame 0xe3b3bccc fork_exit(c0a83d90,c770d1e0,e3b3bd08) at fork_exit+0x7f/frame 0xe3b3bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b3bcf4 --- trap 0, eip = 0, esp = 0xe3b3bd40, ebp = 0 --- Tracing command intr pid 12 tid 100036 td 0xc78d2c00 sched_switch(c78d2c00,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xe3b2bc60 mi_switch(109,0,c10ce7ed,55a,8,...) at mi_switch+0x1c9/frame 0xe3b2bc94 ithread_loop(c770d0c0,e3b2bd08,c10ce550,3d7,0,...) at ithread_loop+0x100/frame 0xe3b2bccc fork_exit(c0a83d90,c770d0c0,e3b2bd08) at fork_exit+0x7f/frame 0xe3b2bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b2bcf4 --- trap 0, eip = 0, esp = 0xe3b2bd40, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xc78d4c00 sched_switch(c78d4c00,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xe3b1bc60 mi_switch(109,0,c10ce7ed,55a,8,...) at mi_switch+0x1c9/frame 0xe3b1bc94 ithread_loop(c770d6a0,e3b1bd08,c10ce550,3d7,0,...) at ithread_loop+0x100/frame 0xe3b1bccc fork_exit(c0a83d90,c770d6a0,e3b1bd08) at fork_exit+0x7f/frame 0xe3b1bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b1bcf4 --- trap 0, eip = 0, esp = 0xe3b1bd40, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc7778300 sched_switch(c7778300,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xc7393c60 mi_switch(109,0,c10ce7ed,55a,8,...) at mi_switch+0x1c9/frame 0xc7393c94 ithread_loop(c770d280,c7393d08,c10ce550,3d7,0,...) at ithread_loop+0x100/frame 0xc7393ccc fork_exit(c0a83d90,c770d280,c7393d08) at fork_exit+0x7f/frame 0xc7393cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7393cf4 --- trap 0, eip = 0, esp = 0xc7393d40, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc7778600 sched_switch(c7778600,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xc738fc60 mi_switch(109,0,c10ce7ed,55a,8,...) at mi_switch+0x1c9/frame 0xc738fc94 ithread_loop(c770d6c0,c738fd08,c10ce550,3d7,0,...) at ithread_loop+0x100/frame 0xc738fccc fork_exit(c0a83d90,c770d6c0,c738fd08) at fork_exit+0x7f/frame 0xc738fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc738fcf4 --- trap 0, eip = 0, esp = 0xc738fd40, ebp = 0 --- Tracing command intr pid 12 tid 100028 td 0xc7778900 sched_switch(c7778900,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xc7286c60 mi_switch(109,0,c10ce7ed,55a,8,...) at mi_switch+0x1c9/frame 0xc7286c94 ithread_loop(c770d3b0,c7286d08,c10ce550,3d7,0,...) at ithread_loop+0x100/frame 0xc7286ccc fork_exit(c0a83d90,c770d3b0,c7286d08) at fork_exit+0x7f/frame 0xc7286cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7286cf4 --- trap 0, eip = 0, esp = 0xc7286d40, ebp = 0 --- Tracing command intr pid 12 tid 100027 td 0xc7778c00 sched_switch(c7778c00,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xc7254c60 mi_switch(109,0,c10ce7ed,55a,8,...) at mi_switch+0x1c9/frame 0xc7254c94 ithread_loop(c770d760,c7254d08,c10ce550,3d7,0,...) at ithread_loop+0x100/frame 0xc7254ccc fork_exit(c0a83d90,c770d760,c7254d08) at fork_exit+0x7f/frame 0xc7254cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7254cf4 --- trap 0, eip = 0, esp = 0xc7254d40, ebp = 0 --- Tracing command intr pid 12 tid 100025 td 0xc785b300 sched_switch(c785b300,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xc724ec60 mi_switch(109,0,c10ce7ed,55a,8,...) at mi_switch+0x1c9/frame 0xc724ec94 ithread_loop(c770d770,c724ed08,c10ce550,3d7,0,...) at ithread_loop+0x100/frame 0xc724eccc fork_exit(c0a83d90,c770d770,c724ed08) at fork_exit+0x7f/frame 0xc724ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc724ecf4 --- trap 0, eip = 0, esp = 0xc724ed40, ebp = 0 --- Tracing command intr pid 12 tid 100020 td 0xc770ec00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100018 td 0xc7776300 sched_switch(c7776300,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xc7239c60 mi_switch(109,0,c10ce7ed,55a,8,...) at mi_switch+0x1c9/frame 0xc7239c94 ithread_loop(c770d790,c7239d08,c10ce550,3d7,0,...) at ithread_loop+0x100/frame 0xc7239ccc fork_exit(c0a83d90,c770d790,c7239d08) at fork_exit+0x7f/frame 0xc7239cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7239cf4 --- trap 0, eip = 0, esp = 0xc7239d40, ebp = 0 --- Tracing command intr pid 12 tid 100012 td 0xc76c7600 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100011 td 0xc76c7900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100010 td 0xc76c7c00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100009 td 0xc770e000 sched_switch(c770e000,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xc721dc60 mi_switch(109,0,c10ce7ed,55a,8,...) at mi_switch+0x1c9/frame 0xc721dc94 ithread_loop(c770d7d0,c721dd08,c10ce550,3d7,0,...) at ithread_loop+0x100/frame 0xc721dccc fork_exit(c0a83d90,c770d7d0,c721dd08) at fork_exit+0x7f/frame 0xc721dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc721dcf4 --- trap 0, eip = 0, esp = 0xc721dd40, ebp = 0 --- Tracing command intr pid 12 tid 100008 td 0xc770e300 sched_switch(c770e300,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xc721ac60 mi_switch(109,0,c10ce7ed,55a,8,...) at mi_switch+0x1c9/frame 0xc721ac94 ithread_loop(c770d7e0,c721ad08,c10ce550,3d7,0,...) at ithread_loop+0x100/frame 0xc721accc fork_exit(c0a83d90,c770d7e0,c721ad08) at fork_exit+0x7f/frame 0xc721acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc721acf4 --- trap 0, eip = 0, esp = 0xc721ad40, ebp = 0 --- Tracing command intr pid 12 tid 100007 td 0xc770e600 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100006 td 0xc76c5000 sched_switch(c76c5000,0,608,1b0,502,...) at sched_switch+0x4b9/frame 0xc7213c00 mi_switch(608,0,c10d50ac,d3,4,...) at mi_switch+0x1c9/frame 0xc7213c34 critical_exit(0,2,c10d6fcd,a46,c1295108,...) at critical_exit+0xa3/frame 0xc7213c50 sched_idletd(0,c7213d08,c10ce550,3d7,0,...) at sched_idletd+0x1d6/frame 0xc7213ccc fork_exit(c0ada5d0,0,c7213d08) at fork_exit+0x7f/frame 0xc7213cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7213cf4 --- trap 0, eip = 0, esp = 0xc7213d40, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc76c5300 cpustop_handler(2,13,c7210b90,c0edd3cb,c76c5300,...) at cpustop_handler+0x2f/frame 0xc7210a40 ipi_nmi_handler(c76c5300,c7210a68,46,c7706a80,c7210aa8,...) at ipi_nmi_handler+0x37/frame 0xc7210a50 trap(c7210b9c) at trap+0x3b/frame 0xc7210b90 calltrap() at calltrap+0x6/frame 0xc7210b90 --- trap 0x13, eip = 0xc0ec2dc5, esp = 0xc7210bdc, ebp = 0xc7210bdc --- acpi_cpu_c1(c0ee617b,c71fdc90,0,c112e227,303,...) at acpi_cpu_c1+0x5/frame 0xc7210bdc acpi_cpu_idle(15cfa839,0,15cfa839,c7210c50,c0eccf1a,...) at acpi_cpu_idle+0x146/frame 0xc7210c20 cpu_idle_acpi(15cfa839,0,5,c1294a08,c1294a16,...) at cpu_idle_acpi+0x3f/frame 0xc7210c34 cpu_idle(0,2,c10d6fcd,a46,c1294a08,...) at cpu_idle+0x9a/frame 0xc7210c50 sched_idletd(0,c7210d08,c10ce550,3d7,0,...) at sched_idletd+0x1d6/frame 0xc7210ccc fork_exit(c0ada5d0,0,c7210d08) at fork_exit+0x7f/frame 0xc7210cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7210cf4 --- trap 0, eip = 0, esp = 0xc7210d40, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc76c5600 cpustop_handler(1,13,c720db90,c0edd3cb,1a2864,...) at cpustop_handler+0x2f/frame 0xc720da40 ipi_nmi_handler(1a2864,0,0,c720da94,c0a75b2b,...) at ipi_nmi_handler+0x37/frame 0xc720da50 trap(c720db9c) at trap+0x3b/frame 0xc720db90 calltrap() at calltrap+0x6/frame 0xc720db90 --- trap 0x13, eip = 0xc0ec2dc5, esp = 0xc720dbdc, ebp = 0xc720dbdc --- acpi_cpu_c1(c0ee617b,c71fac90,0,c112e227,303,...) at acpi_cpu_c1+0x5/frame 0xc720dbdc acpi_cpu_idle(652a1d96,0,652a1d96,c720dc50,c0eccf1a,...) at acpi_cpu_idle+0x146/frame 0xc720dc20 cpu_idle_acpi(652a1d96,0,a,c1294308,c1294316,...) at cpu_idle_acpi+0x3f/frame 0xc720dc34 cpu_idle(0,2,c10d6fcd,a46,c1294308,...) at cpu_idle+0x9a/frame 0xc720dc50 sched_idletd(0,c720dd08,c10ce550,3d7,0,...) at sched_idletd+0x1d6/frame 0xc720dccc fork_exit(c0ada5d0,0,c720dd08) at fork_exit+0x7f/frame 0xc720dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc720dcf4 --- trap 0, eip = 0, esp = 0xc720dd40, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xc76c5900 sched_switch(c76c5900,0,608,1b0,502,...) at sched_switch+0x4b9/frame 0xc720ac00 mi_switch(608,0,c10d50ac,d3,b,...) at mi_switch+0x1c9/frame 0xc720ac34 critical_exit(0,2,c10d6fcd,a46,c1293c08,...) at critical_exit+0xa3/frame 0xc720ac50 sched_idletd(0,c720ad08,c10ce550,3d7,0,...) at sched_idletd+0x1d6/frame 0xc720accc fork_exit(c0ada5d0,0,c720ad08) at fork_exit+0x7f/frame 0xc720acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc720acf4 --- trap 0, eip = 0, esp = 0xc720ad40, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc76c5c00 sched_switch(c76c5c00,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xc720698c mi_switch(104,0,c10daa3d,1f5,c10daa3d,...) at mi_switch+0x1c9/frame 0xc72069c0 sleepq_switch(c76c5c00,0,c10daa3d,1ab,c7206a38,...) at sleepq_switch+0x1b9/frame 0xc72069f4 sleepq_catch_signals(0,c10daa3d,162,e88,c76c5c00,...) at sleepq_catch_signals+0x361/frame 0xc7206a3c sleepq_wait_sig(c76c3ba0,6c,c10ddeb5,100,0,...) at sleepq_wait_sig+0x14/frame 0xc7206a60 _sleep(c76c3ba0,c76c3c34,16c,c10ddeb5,0,...) at _sleep+0x35b/frame 0xc7206abc kern_wait6(c76c5c00,7,0,0,c7206b4c,...) at kern_wait6+0x45c/frame 0xc7206b20 sys_wait4(c76c5c00,c7206cc8,c112cd1f,d6,bfbfefe4,...) at sys_wait4+0x94/frame 0xc7206c40 syscall(c7206d08) at syscall+0x2ed/frame 0xc7206cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xc7206cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x805e3b7, esp = 0xbfbfd8f4, ebp = 0xbfbfd908 --- Tracing command audit pid 10 tid 100001 td 0xc76c7000 sched_switch(c76c7000,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xc7203ba8 mi_switch(104,0,c10daa3d,1f5,8,...) at mi_switch+0x1c9/frame 0xc7203bdc sleepq_switch(c76c7000,0,c10daa3d,26b,c76c7000,...) at sleepq_switch+0x1b9/frame 0xc7203c10 sleepq_wait(c1455938,0,c7203c64,1,0,...) at sleepq_wait+0x48/frame 0xc7203c34 _cv_wait(c1455938,c14558c4,c11065e2,18d,0,...) at _cv_wait+0x1f9/frame 0xc7203c78 audit_worker(0,c7203d08,c10ce550,3d7,0,...) at audit_worker+0x94/frame 0xc7203ccc fork_exit(c0cc9440,0,c7203d08) at fork_exit+0x7f/frame 0xc7203cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7203cf4 --- trap 0, eip = 0, esp = 0xc7203d40, ebp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xc7949c00 sched_switch(c7949c00,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3ba3b68 mi_switch(104,0,c10daa3d,1f5,101,...) at mi_switch+0x1c9/frame 0xe3ba3b9c sleepq_switch(c7949c00,0,c10daa3d,28e,c7949c00,...) at sleepq_switch+0x1b9/frame 0xe3ba3bd0 sleepq_timedwait(c1286853,0,2,0,0,...) at sleepq_timedwait+0x48/frame 0xe3ba3bf4 _sleep(c1286853,0,0,c10c081e,fffffc88,...) at _sleep+0x345/frame 0xe3ba3c50 pause_sbt(c10c081e,fffffc88,2,0,0,...) at pause_sbt+0x86/frame 0xe3ba3c8c deadlkres(0,e3ba3d08,c10ce550,3d7,0,...) at deadlkres+0x82/frame 0xe3ba3ccc fork_exit(c0a627c0,0,e3ba3d08) at fork_exit+0x7f/frame 0xe3ba3cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3ba3cf4 --- trap 0, eip = 0, esp = 0xe3ba3d40, ebp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xc794a000 sched_switch(c794a000,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xe3ba0bc0 mi_switch(104,0,c10daa3d,1f5,c12a3fb0,...) at mi_switch+0x1c9/frame 0xe3ba0bf4 sleepq_switch(c794a000,0,c10daa3d,26b,c7867d80,...) at sleepq_switch+0x1b9/frame 0xe3ba0c28 sleepq_wait(c7867d80,0,c10d564d,c10c081e,0,...) at sleepq_wait+0x48/frame 0xe3ba0c4c msleep_spin_sbt(c7867d80,c7867d98,c10c081e,0,0,...) at msleep_spin_sbt+0x239/frame 0xe3ba0c94 taskqueue_thread_loop(c144b400,e3ba0d08,c10ce550,3d7,0,...) at taskqueue_thread_loop+0xcc/frame 0xe3ba0ccc fork_exit(c0afaba0,c144b400,e3ba0d08) at fork_exit+0x7f/frame 0xe3ba0cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3ba0cf4 --- trap 0, eip = 0, esp = 0xe3ba0d40, ebp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xc785b000 sched_switch(c785b000,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xc7251bac mi_switch(104,0,c10daa3d,1f5,162,...) at mi_switch+0x1c9/frame 0xc7251be0 sleepq_switch(c785b000,0,c10daa3d,26b,c785b000,...) at sleepq_switch+0x1b9/frame 0xc7251c14 sleepq_wait(c75a8600,0,c10c081e,0,0,...) at sleepq_wait+0x48/frame 0xc7251c38 _sleep(c75a8600,c75a8618,0,c10c081e,0,...) at _sleep+0x37c/frame 0xc7251c94 taskqueue_thread_loop(c1455970,c7251d08,c10ce550,3d7,0,...) at taskqueue_thread_loop+0x129/frame 0xc7251ccc fork_exit(c0afaba0,c1455970,c7251d08) at fork_exit+0x7f/frame 0xc7251cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7251cf4 --- trap 0, eip = 0, esp = 0xc7251d40, ebp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xc785b600 sched_switch(c785b600,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xc724bbc0 mi_switch(104,0,c10daa3d,1f5,c12a28d0,...) at mi_switch+0x1c9/frame 0xc724bbf4 sleepq_switch(c785b600,0,c10daa3d,26b,c75a8980,...) at sleepq_switch+0x1b9/frame 0xc724bc28 sleepq_wait(c75a8980,0,c10d564d,c10c081e,0,...) at sleepq_wait+0x48/frame 0xc724bc4c msleep_spin_sbt(c75a8980,c75a8998,c10c081e,0,0,...) at msleep_spin_sbt+0x239/frame 0xc724bc94 taskqueue_thread_loop(c144bf20,c724bd08,c10ce550,3d7,0,...) at taskqueue_thread_loop+0xcc/frame 0xc724bccc fork_exit(c0afaba0,c144bf20,c724bd08) at fork_exit+0x7f/frame 0xc724bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc724bcf4 --- trap 0, eip = 0, esp = 0xc724bd40, ebp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xc785b900 sched_switch(c785b900,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xc7248bc0 mi_switch(104,0,c10daa3d,1f5,c12a28d0,...) at mi_switch+0x1c9/frame 0xc7248bf4 sleepq_switch(c785b900,0,c10daa3d,26b,c75a8980,...) at sleepq_switch+0x1b9/frame 0xc7248c28 sleepq_wait(c75a8980,0,c10d564d,c10c081e,0,...) at sleepq_wait+0x48/frame 0xc7248c4c msleep_spin_sbt(c75a8980,c75a8998,c10c081e,0,0,...) at msleep_spin_sbt+0x239/frame 0xc7248c94 taskqueue_thread_loop(c144bf20,c7248d08,c10ce550,3d7,0,...) at taskqueue_thread_loop+0xcc/frame 0xc7248ccc fork_exit(c0afaba0,c144bf20,c7248d08) at fork_exit+0x7f/frame 0xc7248cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7248cf4 --- trap 0, eip = 0, esp = 0xc7248d40, ebp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xc785bc00 sched_switch(c785bc00,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xc7245bc0 mi_switch(104,0,c10daa3d,1f5,c12a28d0,...) at mi_switch+0x1c9/frame 0xc7245bf4 sleepq_switch(c785bc00,0,c10daa3d,26b,c75a8980,...) at sleepq_switch+0x1b9/frame 0xc7245c28 sleepq_wait(c75a8980,0,c10d564d,c10c081e,0,...) at sleepq_wait+0x48/frame 0xc7245c4c msleep_spin_sbt(c75a8980,c75a8998,c10c081e,0,0,...) at msleep_spin_sbt+0x239/frame 0xc7245c94 taskqueue_thread_loop(c144bf20,c7245d08,c10ce550,3d7,0,...) at taskqueue_thread_loop+0xcc/frame 0xc7245ccc fork_exit(c0afaba0,c144bf20,c7245d08) at fork_exit+0x7f/frame 0xc7245cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7245cf4 --- trap 0, eip = 0, esp = 0xc7245d40, ebp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xc770e900 sched_switch(c770e900,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xc7242bac mi_switch(104,0,c10daa3d,1f5,162,...) at mi_switch+0x1c9/frame 0xc7242be0 sleepq_switch(c770e900,0,c10daa3d,26b,c770e900,...) at sleepq_switch+0x1b9/frame 0xc7242c14 sleepq_wait(c75a8a00,0,c10c081e,0,0,...) at sleepq_wait+0x48/frame 0xc7242c38 _sleep(c75a8a00,c75a8a18,0,c10c081e,0,...) at _sleep+0x37c/frame 0xc7242c94 taskqueue_thread_loop(c144f3dc,c7242d08,c10ce550,3d7,0,...) at taskqueue_thread_loop+0x129/frame 0xc7242ccc fork_exit(c0afaba0,c144f3dc,c7242d08) at fork_exit+0x7f/frame 0xc7242cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7242cf4 --- trap 0, eip = 0, esp = 0xc7242d40, ebp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xc7776000 sched_switch(c7776000,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xc723cbac mi_switch(104,0,c10daa3d,1f5,162,...) at mi_switch+0x1c9/frame 0xc723cbe0 sleepq_switch(c7776000,0,c10daa3d,26b,c7776000,...) at sleepq_switch+0x1b9/frame 0xc723cc14 sleepq_wait(c75a8b00,0,c10c081e,0,0,...) at sleepq_wait+0x48/frame 0xc723cc38 _sleep(c75a8b00,c75a8b18,0,c10c081e,0,...) at _sleep+0x37c/frame 0xc723cc94 taskqueue_thread_loop(c1452340,c723cd08,c10ce550,3d7,0,...) at taskqueue_thread_loop+0x129/frame 0xc723cccc fork_exit(c0afaba0,c1452340,c723cd08) at fork_exit+0x7f/frame 0xc723ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc723ccf4 --- trap 0, eip = 0, esp = 0xc723cd40, ebp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xc7776900 sched_switch(c7776900,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xc7232bac mi_switch(104,0,c10daa3d,1f5,162,...) at mi_switch+0x1c9/frame 0xc7232be0 sleepq_switch(c7776900,0,c10daa3d,26b,c7776900,...) at sleepq_switch+0x1b9/frame 0xc7232c14 sleepq_wait(c75a8c80,0,c10c081e,0,0,...) at sleepq_wait+0x48/frame 0xc7232c38 _sleep(c75a8c80,c75a8c98,0,c10c081e,0,...) at _sleep+0x37c/frame 0xc7232c94 taskqueue_thread_loop(c12a1cc4,c7232d08,c10ce550,3d7,0,...) at taskqueue_thread_loop+0x129/frame 0xc7232ccc fork_exit(c0afaba0,c12a1cc4,c7232d08) at fork_exit+0x7f/frame 0xc7232cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7232cf4 --- trap 0, eip = 0, esp = 0xc7232d40, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc144ef50 sched_switch(c144ef50,0,104,1b5,c0a9f3fe,...) at sched_switch+0x4b9/frame 0xc1820c0c mi_switch(104,0,c10daa3d,1f5,101,...) at mi_switch+0x1c9/frame 0xc1820c40 sleepq_switch(c144ef50,0,c10daa3d,28e,c144ef50,...) at sleepq_switch+0x1b9/frame 0xc1820c74 sleepq_timedwait(c144ec64,54,9,0,0,...) at sleepq_timedwait+0x48/frame 0xc1820c98 _sleep(c144ec64,0,54,c11077a5,fffff470,...) at _sleep+0x345/frame 0xc1820cf4 scheduler(0,0,c113a4e8,181e000,1825000,...) at scheduler+0x2b3/frame 0xc1820d38 mi_startup() at mi_startup+0xf7/frame 0xc1820d58 begin() at begin+0x2c db:0:allt> call doadump Physical memory: 3435 MB Dumping 173 MB: 158 142 126 110 94 78 62 46 30 14 Dump complete = 0 db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 3 (kgdb) bt #0 doadump (textdump=0xa) at pcpu.h:253 #1 0xc0512a7d in db_fncall (dummy1=0x19, dummy2=0x0, dummy3=0xc125456c, dummy4=0xf5dcb580 "") at ../../../ddb/db_command.c:578 #2 0xc0512777 in db_command (cmd_table=) at ../../../ddb/db_command.c:449 #3 0xc0516654 in db_script_exec (scriptname=0xc144bc84 "doadump", warnifnotfound=) at ../../../ddb/db_script.c:302 #4 0xc0512777 in db_command (cmd_table=) at ../../../ddb/db_command.c:449 #5 0xc0512490 in db_command_loop () at ../../../ddb/db_command.c:502 #6 0xc0514cd0 in db_trap (type=, code=0xf5dcb8c8) at ../../../ddb/db_main.c:231 #7 0xc0aea828 in kdb_trap (type=, code=, tf=) at ../../../kern/subr_kdb.c:654 #8 0xc0eddb0e in trap (frame=) at ../../../i386/i386/trap.c:720 #9 0xc0ec6cbc in calltrap () at ../../../i386/i386/exception.s:169 #10 0xc0aea0ad in kdb_enter (why=0xc10d49d3 "panic", msg=) at cpufunc.h:71 #11 0xc0ab3963 in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:747 #12 0xc0ab39a2 in panic (fmt=0xc111071c "vm_fault_copy_wired: page missing") at ../../../kern/kern_shutdown.c:683 #13 0xc0d3f338 in vm_fault_copy_entry (dst_map=0xc90849f8, src_map=0xc8137740, dst_entry=0xc905d168, src_entry=0xc8598318, fork_charge=0xf5dcbbf8) at ../../../vm/vm_fault.c:1336 #14 0xc0d4b3fa in vm_map_copy_entry (src_map=0xc8137740, dst_map=0xc90849f8, src_entry=0xc8598318, dst_entry=0xc905d168, fork_charge=0xf5dcbbf8) at ../../../vm/vm_map.c:3035 #15 0xc0d4ac7c in vmspace_fork (vm1=0xc8137740, fork_charge=0xf5dcbbf8) at ../../../vm/vm_map.c:3228 #16 0xc0a7f8bc in fork1 (td=0xc8759c00, flags=, pages=Cannot access memory at address 0x2 ) at ../../../kern/kern_fork.c:840 #17 0xc0a7f699 in sys_fork (td=0xc8759c00, uap=0xf5dcbcc8) at ../../../kern/kern_fork.c:110 #18 0xc0ede7dd in syscall (frame=) at subr_syscall.c:134 #19 0xc0ec6d51 in Xint0x80_syscall () at ../../../i386/i386/exception.s:267 #20 0x00000033 in ?? () Previous frame inner to this frame (corrupt stack?) Current language: auto; currently minimal (kgdb) f 13 #13 0xc0d3f338 in vm_fault_copy_entry (dst_map=0xc90849f8, src_map=0xc8137740, dst_entry=0xc905d168, src_entry=0xc8598318, fork_charge=0xf5dcbbf8) at ../../../vm/vm_fault.c:1336 1336 panic("vm_fault_copy_wired: page missing"); (kgdb) l 1331 pindex += OFF_TO_IDX(object->backing_object_offset); 1332 VM_OBJECT_WUNLOCK(object); 1333 object = backing_object; 1334 } 1335 if (src_m == NULL) 1336 panic("vm_fault_copy_wired: page missing"); 1337 pmap_copy_page(src_m, dst_m); 1338 VM_OBJECT_WUNLOCK(object); 1339 dst_m->valid = VM_PAGE_BITS_ALL; 1340 dst_m->dirty = VM_PAGE_BITS_ALL; (kgdb) info loc backing_object = 0x0 dst_object = 0xc9099128 object = 0xc7deb378 src_object = 0xc7deb378 dst_pindex = 0x31 pindex = 0x31 src_pindex = 0x0 access = 0x5 prot = 0x5 vaddr = 0x280ae000 dst_m = 0xc3227700 src_m = 0x0 src_readonly = 0x1 upgrade = 0x0 (kgdb) p *dst_object $1 = {lock = {lock_object = {lo_name = 0xc1111bd2 "vm object", lo_flags = 0x4630000, lo_data = 0x0, lo_witness = 0xc757f318}, rw_lock = 0xc8759c00}, object_list = {tqe_next = 0x0, tqe_prev = 0xc9088264}, shadow_head = { lh_first = 0x0}, shadow_list = {le_next = 0x0, le_prev = 0xc8eb570c}, memq = {tqh_first = 0xc3226a80, tqh_last = 0xc3227708}, rtree = {rt_root = 0xe3794c34}, size = 0x131, generation = 0x1, ref_count = 0x1, shadow_count = 0x0, memattr = 0x6, type = 0x0, flags = 0x3000, pg_color = 0x807d, paging_in_progress = 0x0, resident_page_count = 0x32, backing_object = 0x0, backing_object_offset = 0x0, pager_object_list = {tqe_next = 0x0, tqe_prev = 0x0}, rvq = { lh_first = 0x0}, cache = {rt_root = 0x0}, handle = 0x0, un_pager = {vnp = {vnp_size = 0x0, writemappings = 0x0}, devp = {devp_pglist = {tqh_first = 0x0, tqh_last = 0x0}, ops = 0x0, dev = 0x0}, sgp = {sgp_pglist = { tqh_first = 0x0, tqh_last = 0x0}}, swp = {swp_tmpfs = 0x0, swp_bcount = 0x0}}, cred = 0xc76bfe80, charge = 0x131000} (kgdb) p *dst_map $2 = {header = {prev = 0xc905d168, next = 0xc86acb88, left = 0x0, right = 0x0, start = 0x1000, end = 0xbfc00000, avail_ssize = 0x0, adj_free = 0x0, max_free = 0x0, object = {vm_object = 0x0, sub_map = 0x0}, offset = 0x0, eflags = 0x0, protection = 0x0, max_protection = 0x0, inheritance = 0x0, read_ahead = 0x0, wired_count = 0x0, next_read = 0x0, cred = 0x0}, lock = {lock_object = {lo_name = 0xc10dcffd "vm map (user)", lo_flags = 0x2330000, lo_data = 0x0, lo_witness = 0xc757f2b0}, sx_lock = 0xc8759c00}, system_mtx = {lock_object = {lo_name = 0xc10dcfcf "vm map (system)", lo_flags = 0x1430000, lo_data = 0x0, lo_witness = 0xc757f110}, mtx_lock = 0x4}, nentries = 0x8, size = 0x165000, timestamp = 0x1, needs_wakeup = 0x0, system_map = 0x0, flags = 0x0, root = 0xc905d168, pmap = 0xc9084aa8, busy = 0x0} (kgdb) p *src_map $3 = {header = {prev = 0xc8581798, next = 0xc86ac1b0, left = 0x0, right = 0x0, start = 0x1000, end = 0xbfc00000, avail_ssize = 0x0, adj_free = 0x0, max_free = 0x0, object = {vm_object = 0x0, sub_map = 0x0}, offset = 0x0, eflags = 0x0, protection = 0x0, max_protection = 0x0, inheritance = 0x0, read_ahead = 0x0, wired_count = 0x0, next_read = 0x0, cred = 0x0}, lock = {lock_object = {lo_name = 0xc10dcffd "vm map (user)", lo_flags = 0x2330000, lo_data = 0x0, lo_witness = 0xc757f2b0}, sx_lock = 0xc8759c00}, system_mtx = {lock_object = {lo_name = 0xc10dcfcf "vm map (system)", lo_flags = 0x1430000, lo_data = 0x0, lo_witness = 0xc757f110}, mtx_lock = 0x4}, nentries = 0xd, size = 0x1c2000, timestamp = 0x2a, needs_wakeup = 0x0, system_map = 0x0, flags = 0x1, root = 0xc8598318, pmap = 0xc81377f0, busy = 0x0} (kgdb) p *dst_entry $4 = {prev = 0xc905d5a0, next = 0xc90849f8, left = 0xc905d5a0, right = 0x0, start = 0x2807d000, end = 0x281ae000, avail_ssize = 0x0, adj_free = 0x97a52000, max_free = 0x97a52000, object = {vm_object = 0xc9099128, sub_map = 0xc9099128}, offset = 0x0, eflags = 0x40c, protection = 0x5, max_protection = 0x7, inheritance = 0x1, read_ahead = 0xf, wired_count = 0x0, next_read = 0x0, cred = 0x0} (kgdb) p *src_entry $5 = {prev = 0xc85a8d80, next = 0xc7e6b6c0, left = 0xc86ac1b0, right = 0xc87685a0, start = 0x2807d000, end = 0x281ae000, avail_ssize = 0x0, adj_free = 0x0, max_free = 0x979f3000, object = {vm_object = 0xc7deb378, sub_map = 0xc7deb378}, offset = 0x0, eflags = 0x42c, protection = 0x5, max_protection = 0x7, inheritance = 0x1, read_ahead = 0xf, wired_count = 0x1, next_read = 0x0, cred = 0x0} (kgdb) p *fork_charge $6 = 0x165000 (kgdb) f 15 #15 0xc0d4ac7c in vmspace_fork (vm1=0xc8137740, fork_charge=0xf5dcbbf8) at ../../../vm/vm_map.c:3228 3228 vm_map_copy_entry(old_map, new_map, old_entry, (kgdb) l 3223 new_entry->object.vm_object = NULL; 3224 new_entry->cred = NULL; 3225 vm_map_entry_link(new_map, new_map->header.prev, 3226 new_entry); 3227 vmspace_map_entry_forked(vm1, vm2, new_entry); 3228 vm_map_copy_entry(old_map, new_map, old_entry, 3229 new_entry, fork_charge); 3230 break; 3231 } 3232 old_entry = old_entry->next; (kgdb) info loc vm2 = (struct vmspace *) 0xc90849f8 new_map = 0xc90849f8 old_map = 0xc8137740 new_entry = 0xc905d168 old_entry = 0xc8598318 object = 0x2 locked = 0x1 (kgdb) $ svn diff -x -p /usr/src/sys -- Test scenario: msync.c