GENERIC HEAD from 2013-03-19 15:09:32 UTC, r248523, vmcore.570 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb 4718592K of memory above 4GB ignored Copyright (c) 1992-2013 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #0 r248523: Tue Mar 19 16:44:58 CET 2013 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 FreeBSD clang version 3.2 (tags/RELEASE_32/final 170710) 20121221 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.01-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 0x10 Model = 0x2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 8589934592 (8192 MB) avail memory = 3497172992 (3335 MB) : Trying to mount root from ufs:/dev/ad4s1a [rw]... WARNING: / was not properly dismounted Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/ad4s1a: 14570 files, 504990 used, 508025 free (1233 frags, 63349 blocks, 0.1% fragmentation) /dev/ad4s1f: 23910 files, 900024 used, 112991 free (5191 frags, 13475 blocks, 0.5% fragmentation) /dev/label/tmp: 4652 files, 61934167 used, 56379814 free (2022 frags, 7047224 blocks, 0.0% fragmentation) /dev/ad4s1d: 752021 files, 8920995 used, 1233204 free (157996 frags, 134401 blocks, 1.6% fragmentation) /dev/ad4s1e: 822493 files, 15742305 used, 9646212 free (114596 frags, 1191452 blocks, 0.5% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN re0: link state changed to UP Starting Network: lo0 re0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 scopeid 0x1 nd6 options=29 media: Ethernet autoselect (100baseTX ) status: active Starting devd. add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/kde4/lib /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/gcc46 /usr/local/lib/mysql /usr/local/lib/nss /usr/local/lib/pth /usr/local/lib/qt4 /usr/local/lib/virtualbox a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. savecore: couldn't find media and/or sector size of /var/crash: Inappropriate ioctl for device Mar 19 17:52:59 x4 savecore: couldn't find media and/or sector size of /var/crash: Inappropriate ioctl for device savecore: reboot Mar 19 17:52:59 x4 savecore: reboot lock order reversal: 1st 0xe386124c bufwait (bufwait) @ kern/vfs_bio.c:3058 2nd 0xc7881800 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper(c109a0f8,c10a36f6,c10,c0b23d20,c8289d78,...) at db_trace_self_wrapper+0x2d/frame 0xfb524718 kdb_backtrace(c109d1fa,c7881800,c10cf00d,c7586268,c10cec52,...) at kdb_backtrace+0x30/frame 0xfb524780 witness_checkorder(c7881800,9,c10cec49,11c,0,...) at witness_checkorder+0xbad/frame 0xfb5247d0 _sx_xlock(c7881800,0,c10cec49,11c,c7e38000,...) at _sx_xlock+0x75/frame 0xfb524800 ufsdirhash_add(c828c658,fb5248f0,3e6c,fb524880,fb524884,...) at ufsdirhash_add+0x4a/frame 0xfb524830 ufs_direnter(c8289ca8,c80d3ca8,fb5248f0,fb524bcc,0,...) at ufs_direnter+0x63b/frame 0xfb5248b0 ufs_makeinode(fb524bb8,fb524bcc) at ufs_makeinode+0x537/frame 0xfb524a24 ufs_create(fb524b10,c10f3ea7,c10c8926,c809cbc0,2,...) at ufs_create+0x2f/frame 0xfb524a38 VOP_CREATE_APV(c11f482c,fb524b10,fb524bcc,fb524aa0,fb524b08,...) at VOP_CREATE_APV+0x124/frame 0xfb524a68 vn_open_cred(fb524b80,fb524bfc,180,0,c76a9e00,c7da6d20) at vn_open_cred+0x2cf/frame 0xfb524b38 vn_open(fb524b80,fb524bfc,180,c7da6d20,fb524bd8,...) at vn_open+0x3b/frame 0xfb524b58 kern_openat(c7e00600,ffffff9c,804c4c1,0,601,180) at kern_openat+0x1ec/frame 0xfb524c20 sys_open(c7e00600,fb524cc8,c0ebf800,c7200c90,0,...) at sys_open+0x38/frame 0xfb524c40 syscall(fb524d08) at syscall+0x2ed/frame 0xfb524cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb524cfc --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x28194e87, esp = 0xbfbfd6a4, ebp = 0xbfbfde10 --- savecore: writing core to /var/crash/vmcore.569 Writing crash summary to /var/crash/core.txt.569. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Recovering vi editor sessions:. Updating motd:. Starting ntpd. Removing stale Samba tdb files: ....... done Starting nmbd. Starting smbd. Starting winbindd. Starting default moused. Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Local package initialization: backuplock order reversal: 1st 0xc851a304 ufs (ufs) @ kern/vfs_lookup.c:517 2nd 0xe3958e0c bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:262 3rd 0xc8607034 ufs (ufs) @ kern/vfs_subr.c:2177 KDB: stack backtrace: db_trace_self_wrapper(c109a0f8,0,0,0,0,...) at db_trace_self_wrapper+0x2d/frame 0xfb5be2b0 kdb_backtrace(c109d213,c8607034,c1085472,c7586200,c10a65b8,...) at kdb_backtrace+0x30/frame 0xfb5be318 lock order reversal: w 1st 0xc7dec034 ufs (ufs) @ kern/vfs_mount.c:1236 i 2nd 0xc7def5d4 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1866 tKDB: stack backtrace: ness_cdhbe_ctkroarcdee_rs(ecl8f6_0w7r0a3p4p,e9r,(cc1100a96a50aff8,,808,13,3c,8c61007805a407,2.,.6.7)e ,a.t. .) at witndebs_st_rcahceec_ksoerldfe_rw+r0axpbpaedr/+f0rxa2mde/ f0xrfabm5eb e03x6f8b 5d0830 __lockmgr_args(ck8d6b0_7b0a3c4k,t8r0a1c0e0(,cc180690d710faa0,,c07,d0e,f.5.d.4), ca1t0 9114d,c_7_5l8o6c0k6m0g,rc_1a0rcgbs3+307,x.8.7.c)/f raatm e 0xfb5bked4b4_8b acktrace+0x30/frfafmse_ l0oxcfkb(5fdb058b9e84 d0,c7582308,c757wfi1ten0e,scs7_5c8h4e7ck3o0r,dce7r5(7cf71dee0f,5.d.4.,)9 ,act1 0cfbf3s2_el,o7c4ka+,0cx7adde/ff6r4a0m,e. .0.x)f ba5tb e488 witness_checkordVeOrP+_0LxObCaKd1/_fArPaVm(ec 101xff4b852dc0,8feb85 be4d0,c10a36f6,_1_8l0o,cck1m2g0r9_0a6r8g,s.(.c.7)d eaft5 d4,80400V,OcP7_dLeOfC6K410_,A0P,V0+,00x,1c1120/cfbr3a2mee, 704xaf)b 5abet4 b8 __lockmgr_args+0_xv8n7_cl/ofcrka(mce8 600x7f0b050d,0890c180 0,c10a65af,881,vco1p0_as5t8d2l5o,c.k.(.f)b 5adt0 a40,632,_5v,nf_bl5odc0ka+30cx,cca0/af8r9a5mde7 ,0.x.f.b)5 baet4 f8 vop_stdlock+0x53v/gferta(mce8 600x7f0b050d,0890f180 0,c7de6600,57,0,V.O.P._)L OaCtK 1_APV(c1v1gbeat2+904x,7f7b/5fdr0aam4e0 ,05x,ffbb55bde05a3608 ,c1209068,...) avtf s_hash_gVeOtP(_cL8O0C9Kc1b_bA0P,V1+50exe141c2,/8f0r0a0m0e, c07xdfeb656d000a,2f8b 5be610,...) at _vn_locvkf(sc_7hdaesfh5_ag0e,t8+004x0f0f,/cf1r0acmbe3 20ex,f7b45abe,5f5bc5 d0aa8,...) at ffs_vge_tvfn(_cl8o0c9kc+b0bx0c,a1/5ferea4mce, 800x0f0b05,df0ba56b8e 610,1,...) at softdefpf_sf_lvugsehtwfo+r0kxl4i7s/tf(rca8m0e9 200x0f0b,5fbbe55db08a fc,c888a900,62d,s0o,f.t.d.e)p _asty nc_buf(cs8o5f1tad2edp0_,fel3u9s5h8wdoarck,l1i,s1t0+80,x06,e./.f.r)a maet 0xfb5d0asao8f tdep_sync_buf+0xf9f7s7_/sfyrnacm(ec 800x9f2b050b0e,612,0f b5d0b68,50e,c1bafefds1_4s,y.n.c.v)n oadte (c851a2df0f,s1_,s0y,nfcb+50bxe26ed5c/,fcr0aameeb 007xff,b.5.d.0)b 3a0t ffs_syndcovunnomdoeu+n0tx(2ca830/9f2r0a0m0e, 800x8f0b050b0e,6c7888 8a900,493,c0ae4bf4f5s,_.t.r.u)n caatt e(c851a2ddo0u,n2m0o0u,n0t,+808x03,fc28/0f7r8a4m0e0 ,0.x.f.b)5 da0tb 90 ffs_truncate+0x6scy8s/_furnammoeu n0tx(fcb858b8ea893000 ,fb5d0cc8,c0ebf8u0f0s,_cd7i1rfednct9e0r,(0c,8.5.1.a)2 da0t, c8607000s,yfsb_5ubnem8ofu0n,tf+b05xb3ecbdc/cf,r0a,m.e. .0)x fabt5 d0c40 ufs_direnter+0x7seyds/cfarlalm(ef b05xdf0bd50b8e)8 ba0t syscallu+f0sx_2meadk/efirnaomdee (0fxbf5bb5edb0bc8f,cf b5bebcc)X iantt 0x80_sysucfas_lmla(k)e ianto de+0x537X/ifnrta0mxe8 00_xsfybs5cbaelal2+40 x21/frame 0xfb5du0fcsf_cc r-e-a-t es(yfsbc5ablelb 1(02,2c10f3ea,7 ,Fcr1e0ecB8S9D2 6E,LcF83029,c bscy0s,_2u,n.m.o.u)n ta)t, eip = 0uxf2s8_0ccr1e6adt7e,+ 0exs2pf /=f r0axmbef b0fxdf6ba54b,e ae3b8p = 0xbfbfd770 --V-O P_CREATE_APV(c11f482c,fb5beb10,fb5bebcc,fb5beaa0,c12091d8,...) at VOP_CREATE_APV+0x124/frame 0xfb5bea68 vn_open_cred(fb5beb80,fb5bebfc,180,0,c8078400,c7db1230) at vn_open_cred+0x2cf/frame 0xfb5beb38 vn_open(fb5beb80,fb5bebfc,180,c7db1230,0,...) at vn_open+0x3b/frame 0xfb5beb58 kern_openat(c7de6600,ffffff9c,28c80360,0,a02,180) at kern_openat+0x1ec/frame 0xfb5bec20 sys_open(c7de6600,fb5becc8,c0ebf800,c1825c90,0,...) at sys_open+0x38/frame 0xfb5bec40 syscall(fb5bed08) at syscall+0x2ed/frame 0xfb5becfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb5becfc --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x28414e87, esp = 0xbfbf9644, ebp = 0xbfbf96d0 --- ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes Mar 19 17:54:07 x4 su: pho to root on /dev/pts/0 ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 4652 files, 61934167 used, 56379814 free (2022 frags, 7047224 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 4652 files, 61934167 used, 56379814 free (2022 frags, 7047224 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmp watchdogd. Starting inetd. Tue Mar 19 17:58:33 CET 2013 FreeBSD/i386 (x4.osted.lan) (console) login: lock order reversal: 1st 0xc80a119c syncer (syncer) @ kern/vfs_subr.c:1796 2nd 0xc86a5034 ufs (ufs) @ kern/vfs_subr.c:2177 KDB: stack backtrace: db_trace_self_wrapper(c109a0f8,e385d1f0,3,f5fcb968,e385d1f0,...) at db_trace_self_wrapper+0x2d/frame 0xf5fcb930 kdb_backtrace(c109d1fa,c86a5034,c1085472,c7586200,c10a65b8,...) at kdb_backtrace+0x30/frame 0xf5fcb998 witness_checkorder(c86a5034,9,c10a65af,881,c86a50a0,...) at witness_checkorder+0xbad/frame 0xf5fcb9e8 __lockmgr_args(c86a5034,80500,c86a50a0,0,0,...) at __lockmgr_args+0x87c/frame 0xf5fcbac8 ffs_lock(f5fcbb50,0,c7584458,246,c7584458,...) at ffs_lock+0xad/frame 0xf5fcbb08 VOP_LOCK1_APV(c11f482c,f5fcbb50,246,c13ba85c,c1209068,...) at VOP_LOCK1_APV+0x112/frame 0xf5fcbb38 _vn_lock(c86a5000,80500,c10a65af,881,c13ba86c,...) at _vn_lock+0xca/frame 0xf5fcbb78 vget(c86a5000,80500,c7945300,12bc,c809cbc0,...) at vget+0x77/frame 0xf5fcbbb0 vfs_msync(c809cbb0,2,2,e7b,0,...) at vfs_msync+0xa0/frame 0xf5fcbbf4 sync_fsync(f5fcbca8,c10f4394,80400,c10a65af,704,...) at sync_fsync+0x130/frame 0xf5fcbc20 VOP_FSYNC_APV(c11d4b8c,f5fcbca8,c10a65af,704,0,...) at VOP_FSYNC_APV+0x124/frame 0xf5fcbc50 sched_sync(0,f5fcbd08,c108f880,3d7,0,...) at sched_sync+0x38f/frame 0xf5fcbccc fork_exit(c0b47660,0,f5fcbd08) at fork_exit+0x7f/frame 0xf5fcbcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5fcbcf4 --- trap 0, eip = 0, esp = 0xf5fcbd40, ebp = 0 --- 20130319 18:01:35 all (1/15): nfs2.sh lock order reversal: 1st 0xca382b74 ufs (ufs) @ kern/vfs_mount.c:851 2nd 0xca453a0c newnfs (newnfs) @ kern/vfs_subr.c:2177 KDB: stack backtrace: db_trace_self_wrapper(c109a0f8,246,246,0,0,...) at db_trace_self_wrapper+0x2d/frame 0xfb4e8728 kdb_backtrace(c109d1fa,ca453a0c,c107ff76,c7586af0,c10a65b8,...) at kdb_backtrace+0x30/frame 0xfb4e8790 witness_checkorder(ca453a0c,9,c10a65af,881,ca453a78,...) at witness_checkorder+0xbad/frame 0xfb4e87e0 __lockmgr_args(ca453a0c,80100,ca453a78,0,0,0,c10a65af,881) at __lockmgr_args+0x87c/frame 0xfb4e88c0 nfs_lock1(fb4e8938,c757f1e0,c7584730,c757f1e0,c7584730,...) at nfs_lock1+0x9c/frame 0xfb4e88f0 VOP_LOCK1_APV(c11bb6b8,fb4e8938,c0d1c2ee,c1bb7e88,c1209068,...) at VOP_LOCK1_APV+0x112/frame 0xfb4e8920 _vn_lock(ca4539d8,80100,c10a65af,881,57,...) at _vn_lock+0xca/frame 0xfb4e8960 vget(ca4539d8,80100,c7e08000,57,0,...) at vget+0x77/frame 0xfb4e8994 vfs_hash_get(c80915d8,bd03ac16,80000,c7e08000,fb4e8a04,...) at vfs_hash_get+0xff/frame 0xfb4e89c0 ncl_nget(c80915d8,ca565e8c,1c,fb4e8a30,80000,...) at ncl_nget+0xba/frame 0xfb4e8a14 nfs_root(c80915d8,80000,fb4e8bf8,35c,2,...) at nfs_root+0x3c/frame 0xfb4e8a40 vfs_donmount(c7e08000,0,0,c8072b00,c8072b00,...) at vfs_donmount+0x130b/frame 0xfb4e8c18 sys_nmount(c7e08000,fb4e8cc8,c0ebf800,c7200c90,0,...) at sys_nmount+0x78/frame 0xfb4e8c40 syscall(fb4e8d08) at syscall+0x2ed/frame 0xfb4e8cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb4e8cfc --- syscall (378, FreeBSD ELF32, sys_nmount), eip = 0x280c3cd7, esp = 0xbfbfcf54, ebp = 0xbfbfd854 --- lock order reversal: 1st 0xe38ab7c0 bufwait (bufwait) @ kern/vfs_bio.c:2282 2nd 0xc80c0600 so_snd_sx (so_snd_sx) @ kern/uipc_sockbuf.c:148 KDB: stack backtrace: db_trace_self_wrapper(c109a0f8,0,c138e344,c138e330,c757fee0,...) at db_trace_self_wrapper+0x2d/frame 0xfb600290 kdb_backtrace(c109d1fa,c80c0600,c108d4cd,c75863a0,c10a2395,...) at kdb_backtrace+0x30/frame 0xfb6002f4 witness_checkorder(c80c0600,9,c10a238c,94,0,...) at witness_checkorder+0xbad/frame 0xfb600344 _sx_xlock(c80c0600,40,c10a238c,94,0,...) at _sx_xlock+0x75/frame 0xfb600374 sblock(c80c05c8,1,34,c138e344,c138e330,...) at sblock+0xa3/frame 0xfb600390 sosend_generic(c80c04e0,0,0,c81be100,0,...) at sosend_generic+0xb6/frame 0xfb600400 clnt_vc_call(c7ca9420,fb6005b0,10,c7aea100,fb600708,...) at clnt_vc_call+0x458/frame 0xfb6004d8 clnt_reconnect_call(c7ca9440,fb6005b0,10,c7aea100,fb600708,...) at clnt_reconnect_call+0x506/frame 0xfb600540 newnfs_request(fb600708,ca565e00,0,ca565f10,ca571708,ca45f300,c7d71680,186a3,3,0,1,0,0) at newnfs_request+0x77b/frame 0xfb600600 nfscl_request(fb600708,ca571708,ca45f300,c7d71680,0,...) at nfscl_request+0x8c/frame 0xfb600648 nfsrpc_readdir(ca571708,fb600958,fb600878,c7d71680,ca45f300,...) at nfsrpc_readdir+0x352/frame 0xfb600840 ncl_readdirrpc(ca571708,fb600958,c7d71680,ca45f300,8,...) at ncl_readdirrpc+0x10f/frame 0xfb600920 ncl_doio(ca571708,e38ab760,c7d71680,ca45f300,0,...) at ncl_doio+0x144/frame 0xfb600998 ncl_bioread(ca571708,fb600bb8,0,c7d71680,0,...) at ncl_bioread+0x681/frame 0xfb600a98 nfs_readdir(fb600be0,c10f45a8,c10c8a90,c10a7cc8,fbb,...) at nfs_readdir+0x19c/frame 0xfb600b48 VOP_READDIR_APV(c11bb6b8,fb600be0,c10a7cc8,fbb,fb600bdc,...) at VOP_READDIR_APV+0x124/frame 0xfb600b78 kern_getdirentries(ca45f300,5,2888c000,1000,fb600c34,...) at kern_getdirentries+0x19e/frame 0xfb600c10 sys_getdirentries(ca45f300,fb600cc8,c10ed72f,d6,0,...) at sys_getdirentries+0x41/frame 0xfb600c40 syscall(fb600d08) at syscall+0x2ed/frame 0xfb600cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb600cfc --- syscall (196, FreeBSD ELF32, sys_getdirentries), eip = 0x280e0b8b, esp = 0xbfbfd7a4, ebp = 0xbfbfd7d4 --- lock order reversal: 1st 0xca382b74 ufs (ufs) @ kern/vfs_mount.c:1236 2nd 0xc140bfd0 allproc (allproc) @ kern/kern_descrip.c:2725 KDB: stack backtrace: db_trace_self_wrapper(c109a0f8,c10d0824,a3f,8,ca575000,...) at db_trace_self_wrapper+0x2d/frame 0xfb6c9a18 kdb_backtrace(c109d1fa,c140bfd0,c108d46a,c757e0d0,c108e8fa,...) at kdb_backtrace+0x30/frame 0xfb6c9a80 witness_checkorder(c140bfd0,1,c108e8f1,aa5,0,...) at witness_checkorder+0xbad/frame 0xfb6c9ad0 _sx_slock(c140bfd0,0,c108e8f1,aa5,c0aa4a8a,...) at _sx_slock+0x78/frame 0xfb6c9b00 mountcheckdirs(ca4539d8,ca382b40,fb6c9b68,50e,c1baed14,...) at mountcheckdirs+0x41/frame 0xfb6c9b30 dounmount(c80915d8,8080000,ca5c2300,493,c0ae4b45,...) at dounmount+0x38f/frame 0xfb6c9b90 sys_unmount(ca5c2300,fb6c9cc8,c10ed72f,d6,0,...) at sys_unmount+0x3cd/frame 0xfb6c9c40 syscall(fb6c9d08) at syscall+0x2ed/frame 0xfb6c9cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb6c9cfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c16d7, esp = 0xbfbfd104, ebp = 0xbfbfd1d0 --- 20130319 18:11:39 all (2/15): nfs10.sh lock order reversal: 1st 0xca382b74 ufs (ufs) @ kern/vfs_mount.c:1236 2nd 0xcb17f940 so_snd_sx (so_snd_sx) @ kern/uipc_sockbuf.c:148 KDB: stack backtrace: db_trace_self_wrapper(c109a0f8,c109da79,c138e4a4,c138e490,c757fee0,...) at db_trace_self_wrapper+0x2d/frame 0xfb69c5d0 kdb_backtrace(c109d1fa,cb17f940,c108d4cd,c75863a0,c10a2395,...) at kdb_backtrace+0x30/frame 0xfb69c634 witness_checkorder(cb17f940,9,c10a238c,94,0,...) at witness_checkorder+0xbad/frame 0xfb69c684 _sx_xlock(cb17f940,40,c10a238c,94,0,...) at _sx_xlock+0x75/frame 0xfb69c6b4 sblock(cb17f908,1,34,c138e4a4,c138e490,...) at sblock+0xa3/frame 0xfb69c6d0 sosend_generic(cb17f820,0,0,c81c4900,0,...) at sosend_generic+0xb6/frame 0xfb69c740 clnt_vc_call(c7cdd9a0,fb69c8f0,1,cb4eb100,fb69c9b0,...) at clnt_vc_call+0x458/frame 0xfb69c818 clnt_reconnect_call(c7c0f820,fb69c8f0,1,cb4eb100,fb69c9b0,...) at clnt_reconnect_call+0x506/frame 0xfb69c880 newnfs_request(fb69c9b0,ca666400,0,ca666510,0,...) at newnfs_request+0x77b/frame 0xfb69c940 nfsrpc_setclient(ca666400,ca6c9000,0,cbc73880,ca5b7900,...) at nfsrpc_setclient+0x585/frame 0xfb69cab8 nfscl_umount(ca666400,ca5b7900,0,ca5b7900,ca666400,...) at nfscl_umount+0x2b5/frame 0xfb69cafc nfs_unmount(c7d0b8c4,8000000,c10a5bbf,50e,c1baed14,...) at nfs_unmount+0xf3/frame 0xfb69cb30 dounmount(c7d0b8c4,8000000,ca5b7900,493,c0ae4b45,...) at dounmount+0x433/frame 0xfb69cb90 sys_unmount(ca5b7900,fb69ccc8,c0ebf800,c7200c90,0,...) at sys_unmount+0x3cd/frame 0xfb69cc40 syscall(fb69cd08) at syscall+0x2ed/frame 0xfb69ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb69ccfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c16d7, esp = 0xbfbfd114, ebp = 0xbfbfd1e0 --- 20130319 18:23:56 all (3/15): lockf.sh lock order reversal: 1st 0xc86065d4 ufs (ufs) @ kern/vfs_mount.c:1236 2nd 0xc80d9428 filedesc structure (filedesc structure) @ kern/kern_descrip.c:2730 KDB: stack backtrace: db_trace_self_wrapper(c109a0f8,63736564,2e706972,37323a63,a3033,...) at db_trace_self_wrapper+0x2d/frame 0xfb6c6a18 kdb_backtrace(c109d1fa,c80d9428,c108eace,c7582780,c108e8fa,...) at kdb_backtrace+0x30/frame 0xfb6c6a80 witness_checkorder(c80d9428,9,c108e8f1,aaa,0,...) at witness_checkorder+0xbad/frame 0xfb6c6ad0 _sx_xlock(c80d9428,0,c108e8f1,aaa,c0aa4a8a,...) at _sx_xlock+0x75/frame 0xfb6c6b00 mountcheckdirs(c9df4ca8,c86065a0,fb6c6b68,50e,0,...) at mountcheckdirs+0xf7/frame 0xfb6c6b30 dounmount(c80928c4,8080000,ca5c2600,493,c0ae4b45,...) at dounmount+0x38f/frame 0xfb6c6b90 sys_unmount(ca5c2600,fb6c6cc8,7b3,0,fb6c6cc4,...) at sys_unmount+0x3cd/frame 0xfb6c6c40 syscall(fb6c6d08) at syscall+0x2ed/frame 0xfb6c6cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb6c6cfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c16d7, esp = 0xbfbfd114, ebp = 0xbfbfd1e0 --- 20130319 18:24:09 all (4/15): crossmp2.sh 20130319 18:24:55 all (5/15): nfs6.sh 20130319 18:26:32 all (6/15): nfs.sh 20130319 18:37:50 all (7/15): nfs4.sh Expensive timeout(9) function: 0xc09355a0(0xc78e9aa0) 0.059352143 s Expensive timeout(9) function: 0xc09355a0(0xc78cdaa0) 0.319661163 s 20130319 18:40:20 all (8/15): nullfs8.sh lock order reversal: 1st 0xc9bf3304 newnfs (newnfs) @ kern/vfs_syscalls.c:4027 2nd 0xe3aff3c8 bufwait (bufwait) @ kern/vfs_bio.c:2282 3rd 0xc89545d4 newnfs (newnfs) @ kern/vfs_subr.c:2177 KDB: stack backtrace: db_trace_self_wrapper(c109a0f8,fb856300,c0d1984a,c1bafc98,0,...) at db_trace_self_wrapper+0x2d/frame 0xfb8562b8 kdb_backtrace(c109d213,c89545d4,c107ff76,c7586af0,c10a65b8,...) at kdb_backtrace+0x30/frame 0xfb856320 witness_checkorder(c89545d4,9,c10a65af,881,c8954640,...) at witness_checkorder+0xbad/frame 0xfb856370 __lockmgr_args(c89545d4,80100,c8954640,0,0,0,c10a65af,881) at __lockmgr_args+0x87c/frame 0xfb856450 nfs_lock1(fb8564c8,1,c757f1e0,c7584730,c757f1e0,...) at nfs_lock1+0x9c/frame 0xfb856480 VOP_LOCK1_APV(c11bb6b8,fb8564c8,c138c9c0,c11ca0a4,c1209068,...) at VOP_LOCK1_APV+0x112/frame 0xfb8564b0 _vn_lock(c89545a0,80100,c10a65af,881,c10a5825,...) at _vn_lock+0xca/frame 0xfb8564f0 vget(c89545a0,80100,ca7fa000,57,0,...) at vget+0x77/frame 0xfb856528 vfs_hash_get(cd0082ec,7e4805e9,80000,ca7fa000,fb856590,...) at vfs_hash_get+0xff/frame 0xfb856554 nfscl_nget(cd0082ec,c9bf32d0,cb63e380,fb856764,ca7fa000,...) at nfscl_nget+0x92/frame 0xfb8565a0 nfsrpc_readdirplus(c9bf32d0,fb856958,fb856878,ca66cd80,ca7fa000,...) at nfsrpc_readdirplus+0xb0d/frame 0xfb856840 ncl_readdirplusrpc(c9bf32d0,fb856958,ca66cd80,ca7fa000,8,...) at ncl_readdirplusrpc+0x10f/frame 0xfb856920 ncl_doio(c9bf32d0,e3aff368,ca66cd80,ca7fa000,0,...) at ncl_doio+0x105/frame 0xfb856998 ncl_bioread(c9bf32d0,fb856bb8,0,ca66cd80,0,...) at ncl_bioread+0x681/frame 0xfb856a98 nfs_readdir(fb856be0,c10f45a8,c10c8a90,c10a7cc8,fbb,...) at nfs_readdir+0x19c/frame 0xfb856b48 VOP_READDIR_APV(c11bb6b8,fb856be0,c10a7cc8,fbb,fb856bdc,...) at VOP_READDIR_APV+0x124/frame 0xfb856b78 kern_getdirentries(ca7fa000,5,2888b000,1000,fb856c34,...) at kern_getdirentries+0x19e/frame 0xfb856c10 sys_getdirentries(ca7fa000,fb856cc8,c0ebf800,c1825c90,0,...) at sys_getdirentries+0x41/frame 0xfb856c40 syscall(fb856d08) at syscall+0x2ed/frame 0xfb856cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb856cfc --- syscall (196, FreeBSD ELF32, sys_getdirentries), eip = 0x280e0b8b, esp = 0xbfbfd784, ebp = 0xbfbfd7b4 --- 20130319 18:44:11 all (9/15): nfsrename.sh 20130319 18:47:14 all (10/15): nfs7.sh Mar 19 19:02:05 x4 kernel: pid 64400 (lockf), uid 0, was killed: exceeded maximum CPU limit Mar 19 19:02:07 x4 kernel: pid 64381 (lockf), uid 0, was killed: exceeded maximum CPU limit Mar 19 19:02:08 x4 kernel: pid 64380 (lockf), uid 0, was killed: exceeded maximum CPU limit Mar 19 19:02:12 x4 kernel: pid 64371 (lockf), uid 0, was killed: exceeded maximum CPU limit Mar 19 19:02:24 x4 kernel: pid 64379 (lockf), uid 0, was killed: exceeded maximum CPU limit 20130319 19:03:42 all (11/15): nfs3.sh Mar 19 19:03:42 x4 kernel: pid 65095 (lockf), uid 0, was killed: exceeded maximum CPU limit Mar 19 19:03:42 x4 kernel: pid 65089 (lockf), uid 0, was killed: exceeded maximum CPU limit Mar 19 19:03:42 x4 kernel: pid 65093 (lockf), uid 0, was killed: exceeded maximum CPU limit Mar 19 19:03:42 x4 kernel: pid 65096 (lockf), uid 0, was killed: exceeded maximum CPU limit Mar 19 19:03:42 x4 kernel: pid 65097 (lockf), uid 0, was killed: exceeded maximum CPU limit Mar 19 19:03:42 x4 kernel: pid 65071 (lockf), uid 0, was killed: exceeded maximum CPU limit Mar 19 19:03:42 x4 kernel: pid 65090 (lockf), uid 0, was killed: exceeded maximum CPU limit 20130319 19:03:42 run all.cfg lock order reversal: 1st 0xc9f0946c syncer (syncer) @ kern/vfs_subr.c:1796 2nd 0xce27d73c newnfs (newnfs) @ kern/vfs_subr.c:2177 KDB: stack backtrace: db_trace_self_wrapper(c109a0f8,e394e654,0,e387186c,e1c2560,...) at db_trace_self_wrapper+0x2d/frame 0xf5fcb940 kdb_backtrace(c109d1fa,ce27d73c,c107ff76,c7586af0,c10a65b8,...) at kdb_backtrace+0x30/frame 0xf5fcb9a8 witness_checkorder(ce27d73c,9,c10a65af,881,ce27d7a8,...) at witness_checkorder+0xbad/frame 0xf5fcb9f8 __lockmgr_args(ce27d73c,80500,ce27d7a8,0,0,0,c10a65af,881) at __lockmgr_args+0x87c/frame 0xf5fcbad8 nfs_lock1(f5fcbb50,c1251118,c7584458,246,c7584458,...) at nfs_lock1+0x9c/frame 0xf5fcbb08 VOP_LOCK1_APV(c11bb6b8,f5fcbb50,246,c13ba85c,c1209068,...) at VOP_LOCK1_APV+0x112/frame 0xf5fcbb38 _vn_lock(ce27d708,80500,c10a65af,881,c13ba86c,...) at _vn_lock+0xca/frame 0xf5fcbb78 vget(ce27d708,80500,c7945300,12bc,c80922fc,...) at vget+0x77/frame 0xf5fcbbb0 vfs_msync(c80922ec,2,2,e7b,0,...) at vfs_msync+0xa0/frame 0xf5fcbbf4 sync_fsync(f5fcbca8,c10f4394,80400,c10a65af,704,...) at sync_fsync+0x130/frame 0xf5fcbc20 VOP_FSYNC_APV(c11d4b8c,f5fcbca8,c10a65af,704,0,...) at VOP_FSYNC_APV+0x124/frame 0xf5fcbc50 sched_sync(0,f5fcbd08,c108f880,3d7,0,...) at sched_sync+0x38f/frame 0xf5fcbccc fork_exit(c0b47660,0,f5fcbd08) at fork_exit+0x7f/frame 0xf5fcbcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5fcbcf4 --- trap 0, eip = 0, esp = 0xf5fcbd40, ebp = 0 --- 20130319 19:06:28 all (12/15): readdir.sh lock order reversal: 1st 0xcbe5d5d4 pseudofs (pseudofs) @ kern/vfs_syscalls.c:4027 2nd 0xc140bfd0 allproc (allproc) @ fs/pseudofs/pseudofs_vnops.c:793 KDB: stack backtrace: db_trace_self_wrapper(c109a0f8,a,cbe5d640,10229c6f,eb10af95,...) at db_trace_self_wrapper+0x2d/frame 0xfb4b4a00 kdb_backtrace(c109d1fa,c140bfd0,c108d46a,c757e0d0,c10821f1,...) at kdb_backtrace+0x30/frame 0xfb4b4a68 witness_checkorder(c140bfd0,1,c10821e8,319,0,...) at witness_checkorder+0xbad/frame 0xfb4b4ab8 _sx_slock(c140bfd0,0,c10821e8,319,0,...) at _sx_slock+0x78/frame 0xfb4b4ae8 pfs_readdir(fb4b4be0,c10f45a8,c10c8a90,c10a7cc8,fbb,...) at pfs_readdir+0x118/frame 0xfb4b4b48 VOP_READDIR_APV(c11bd190,fb4b4be0,c10a7cc8,fbb,fb4b4bdc,...) at VOP_READDIR_APV+0x124/frame 0xfb4b4b78 kern_getdirentries(c78f0900,3,28804000,39ee7256,fb4b4c34,...) at kern_getdirentries+0x19e/frame 0xfb4b4c10 sys_getdirentries(c78f0900,fb4b4cc8,c0ebf800,c71fdc90,0,...) at sys_getdirentries+0x41/frame 0xfb4b4c40 syscall(fb4b4d08) at syscall+0x2ed/frame 0xfb4b4cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb4b4cfc --- syscall (196, FreeBSD ELF32, sys_getdirentries), eip = 0x280d8b8b, esp = 0xbfbfd7d4, ebp = 0xbfbfd804 --- 20130319 19:18:55 all (13/15): nfs5.sh lock order reversal: 1st 0xce82dcdc ufs (ufs) @ kern/vfs_subr.c:2177 2nd 0xc140bf8c proctree (proctree) @ kern/subr_prf.c:149 KDB: stack backtrace: db_trace_self_wrapper(c109a0f8,2,c7d84c00,c7586200,fb508ba8,...) at db_trace_self_wrapper+0x2d/frame 0xfb508b40 kdb_backtrace(c109d1fa,c140bf8c,c10945f8,c757e068,c109abfc,...) at kdb_backtrace+0x30/frame 0xfb508ba8 witness_checkorder(cMar 19 19:19:57 14x4 kernel: pid 6054 (nfsd), uid 0bf inumber 13582 o8n /mnt: filesystcem full ,1,c109abf3,95,0,...) at witness_checkorder+0xbad/frame 0xfb508bf8 _sx_slock(c140bf8c,0,c109abf3,95,2051ecd9,...) at _sx_slock+0x78/frame 0xfb508c28 uprintf(c10c9bb2,c94a10d4,c10c9ba2,ca0,0,...) at uprintf+0x49/frame 0xfb508c80 ffs_balloc_ufs2(ce82dca8,478000,0,8000,cacdb200,...) at ffs_balloc_ufs2+0x24cf/frame 0xfb508dbc ffs_write(fb508f48,c10f4211,814,c8307a00,fb508e98,...) at ffs_write+0x346/frame 0xfb508e50 VOP_WRITE_APV(c11f482c,fb508f48,2,c8307a00,c8307a90,...) at VOP_WRITE_APV+0x19f/frame 0xfb508f10 nfsvno_write(ce82dca8,470000,0,10000,25,...) at nfsvno_write+0x10f/frame 0xfb508f70 nfsrvd_write(fb509350,0,ce82dca8,c7d84c00,fb5091e8,...) at nfsrvd_write+0x498/frame 0xfb509188 nfsrvd_dorpc(fb509350,0,c7d84c00,ec,992b67bb,...) at nfsrvd_dorpc+0x7bd/frame 0xfb509320 nfssvc_program(cc20b800,c8b23a00,c10c577b,490,0,...) at nfssvc_program+0x418/frame 0xfb509428 svc_run_internal(c0c9d670,c7861b80,c7d7bba0,fb509568,0,...) at svc_run_internal+0x201/frame 0xfb50953c svc_run(c7861b80,0,c10812d7,1b2,c10d2635,...) at svc_run+0xc3/frame 0xfb509578 nfsrvd_nfsd(c7d84c00,fb5096d0,c,246,c1bb5f0c,...) at nfsrvd_nfsd+0x1a2/frame 0xfb5096b0 nfssvc_nfsd(c7d84c00,fb509cc8,0,c7d84c00,fb509cfc,...) at nfssvc_nfsd+0xf4/frame 0xfb509c28 sys_nfssvc(c7d84c00,fb509cc8,c0ebf800,c7200c90,0,...) at sys_nfssvc+0xbf/frame 0xfb509c40 syscall(fb509d08) at syscall+0x2ed/frame 0xfb509cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb509cfc --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280c2457, esp = 0xbfbfd7dc, ebp = 0xbfbfda50 --- 20130319 19:19:58 all (14/15): nfs9.sh witness_lock_list_get: witness exhausted 20130319 19:37:41 all (15/15): mountu.sh 20130319 19:38:01 all (1/15): crossmp2.sh 20130319 19:38:49 all (2/15): lockf.sh 20130319 19:39:03 all (3/15): nfs4.sh VNASSERT failed 0xca41f168: tag newnfs, type VREG VNASSERT failed 0xc93ab708: tag newnfs, type VREG usecount 2, writecount 2, refcount 4 mountedhere 0 flags (VI_ACTIVE) VI_LOCKed v_object 0xc91ea8ac ref 0 pages 5 lock type newnfs: EXCL by thread 0xca7fa900 (pid 41556, mmap, tid 100299) VNASSERT failed 0xc9ebe870: tag newnfs, type VREG #0 0xc0a80f25 at __lockmgr_args+0x10c5 usecount 2, writecount 2, refcount 4 mountedhere 0 #1 0xc09c358c at nfs_lock1+0x9c flags (VI_ACTIVE) #2 0xc0edec72 at VOP_LOCK1_APV+0x112 VI_LOCKed usecount 2, writecount 2, refcount 4 mountedhere 0 v_object 0xcb5a21bc ref 0 pages 5 lock type newnfs: EXCL by thread 0xca5be900 (pid 41573, mmap, tid 100183) #3 0xc0b52b1a at _vn_lock+0xca #0 0xc0a80f25 at __lockmgr_args+0x10c5 #4 0xc0b407e7 at vget+0x77 #1 0xc09c358c at nfs_lock1+0x9c #5 0xc0d29e43 at vm_mmap+0x3b3 #2 0xc0edec72 at VOP_LOCK1_APV+0x112 #6 0xc0d29850 at sys_mmap+0x2f0 #3 0xc0b52b1a at _vn_lock+0xca #7 0xc0eb8f1d at syscall+0x2ed #4 0xc0b407e7 at vget+0x77 #8 0xc0ea15e1 at Xint0x80_syscall+0x21 #5 0xc0d29e43 at vm_mmap+0x3b3 fileid 1772181 fsid 0x3a05ffe6#6 0xc0d29850 at sys_mmap+0x2f0 #panic: vputx: missed vn_close cpuid = 0 KDB: enter: panic [ thread pid 41556 tid 100299 ] Stopped at kdb_enter+0x3d: movl $0,kdb_why db> run pho db:0:pho> bt Tracing pid 41556 tid 100299 td 0xca7fa900 kdb_enter(c1095cfb,c1095cfb,c10a7718,fb831a8c,c10a7718,...) at kdb_enter+0x3d/frame 0xfb831a20 vpanic(c12425d2,100,c10a7718,fb831a8c,fb831a8c,...) at vpanic+0x142/frame 0xfb831a5c kassert_panic(c10a7718,c10a4d4c,c10a65af,8cf,fb831ac8,...) at kassert_panic+0xea/frame 0xfb831a80 vputx(c93ab708,fb831b98,5000,5e3,fb831c18,...) at vputx+0x452/frame 0xfb831ac8 vm_mmap(c964abc8,fb831c18,5000,3,7,...) at vm_mmap+0x828/frame 0xfb831bc0 sys_mmap(ca7fa900,fb831cc8,8,c10963d4,db,...) at sys_mmap+0x2f0/frame 0xfb831c40 syscall(fb831d08) at syscall+0x2ed/frame 0xfb831cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb831cfc --- syscall (477, FreeBSD ELF32, sys_mmap), eip = 0x280fee9f, esp = 0xbfbfd574, ebp = 0xbfbfd6a0 --- db:0:bt> show allpcpu Current CPU: 0 cpuid = 0 dynamic pcpu = 0x616a00 curthread = 0xca7fa900: pid 41556 "mmap" curpcb = 0xfb831d60 fpcurthread = none idlethread = 0xc76cc900: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x5feba00 curthread = 0xca5be900: pid 41573 "mmap" curpcb = 0xfb675d60 fpcurthread = none idlethread = 0xc76cc600: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x5feea00 curthread = 0xc9409300: pid 41615 "swap" curpcb = 0xfbc29d60 fpcurthread = none idlethread = 0xc76cc300: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x5ff1a00 curthread = 0xcbbf3000: pid 41553 "mmap" curpcb = 0xfbbdad60 fpcurthread = none idlethread = 0xc76cc000: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks db:0:alllocks> show lockedvnods Locked vnodes 0xc7d2a2d0: tag ufs, type VDIR usecount 220, writecount 0, refcount 222 mountedhere 0 flags (VV_ROOT|VI_ACTIVE) v_object 0xc7d2f534 ref 0 pages 0 lock type ufs: SHARED (count 1) #0 0xc0a80dc0 at __lockmgr_args+0xf60 #1 0xc0cfce4d at ffs_lock+0xad #2 0xc0edec72 at VOP_LOCK1_APV+0x112 #3 0xc0b52b1a at _vn_lock+0xca #4 0xc0b35467 at lookup+0xf7 #5 0xc0b34f8d at namei+0x47d #6 0xc0a657d4 at kern_execve+0x544 #7 0xc0a65073 at sys_execve+0x53 #8 0xc0eb8f1d at syscall+0x2ed #9 0xc0ea15e1 at Xint0x80_syscall+0x21 ino 2, on dev ada0s1a 0xc86065a0: tag ufs, type VDIR usecount 1, writecount 0, refcount 2 mountedhere 0xc809c000 flags (VI_ACTIVE) v_object 0xca2874a0 ref 0 pages 0 lock type ufs: EXCL by thread 0xca7ac900 (pid 41673, umount, tid 100302) with shared waiters pending #0 0xc0a80f25 at __lockmgr_args+0x10c5 #1 0xc0cfce4d at ffs_lock+0xad #2 0xc0edec72 at VOP_LOCK1_APV+0x112 #3 0xc0b52b1a at _vn_lock+0xca #4 0xc0b39329 at dounmount+0x99 #5 0xc0b3924d at sys_unmount+0x3cd #6 0xc0eb8f1d at syscall+0x2ed #7 0xc0ea15e1 at Xint0x80_syscall+0x21 ino 235521, on dev ada0s1a 0xcb8799d8: tag newnfs, type VDIR usecount 45, writecount 0, refcount 46 mountedhere 0 flags (VI_ACTIVE) v_object 0xc8be4534 ref 0 pages 0 lock type newnfs: SHARED (count 7) #0 0xc0a80dc0 at __lockmgr_args+0xf60 #1 0xc09c358c at nfs_lock1+0x9c #2 0xc0edec72 at VOP_LOCK1_APV+0x112 #3 0xc0b52b1a at _vn_lock+0xca #4 0xc0b35467 at lookup+0xf7 #5 0xc0b34f8d at namei+0x47d #6 0xc0b4cd86 at kern_statat_vnhook+0xb6 #7 0xc0b4cf4d at sys_lstat+0x4d #8 0xc0eb8f1d at syscall+0x2ed #9 0xc0ea15e1 at Xint0x80_syscall+0x21 fileid 1648641 fsid 0x3a05ffe6 0xcd882438: tag newnfs, type VDIR usecount 9, writecount 0, refcount 18 mountedhere 0 flags (VI_ACTIVE) v_object 0xcb9488ac ref 0 pages 2 lock type newnfs: SHARED (count 1) with shared waiters pending #0 0xc0a80f25 at __lockmgr_args+0x10c5 #1 0xc09c358c at nfs_lock1+0x9c #2 0xc0edec72 at VOP_LOCK1_APV+0x112 #3 0xc0b52b1a at _vn_lock+0xca #4 0xc09a3ad2 at ncl_upgrade_vnlock+0x72 #5 0xc09ce57d at ncl_bioread+0x20d #6 0xc09c348c at nfs_readdir+0x19c #7 0xc0ede584 at VOP_READDIR_APV+0x124 #8 0xc0b4fd5e at kern_getdirentries+0x19e #9 0xc0b4fb91 at sys_getdirentries+0x41 #10 0xc0eb8f1d at syscall+0x2ed #11 0xc0ea15e1 at Xint0x80_syscall+0x21 fileid 1766404 fsid 0x3a05ffe6 0xca2e62d0: tag newnfs, type VDIR usecount 3, writecount 0, refcount 7 mountedhere 0 flags (VI_ACTIVE) v_object 0xcb948000 ref 0 pages 2 lock type newnfs: EXCL by thread 0xc978cc00 (pid 41596, creat, tid 100441) with shared waiters pending #0 0xc0a80f25 at __lockmgr_args+0x10c5 #1 0xc09c358c at nfs_lock1+0x9c #2 0xc0edec72 at VOP_LOCK1_APV+0x112 #3 0xc0b52b1a at _vn_lock+0xca #4 0xc0b357d4 at lookup+0x464 #5 0xc0b34f8d at namei+0x47d #6 0xc0b4c15c at kern_unlinkat+0xac #7 0xc0b4bdd2 at sys_unlink+0x32 #8 0xc0eb8f1d at syscall+0x2ed #9 0xc0ea15e1 at Xint0x80_syscall+0x21 fileid 1766420 fsid 0x3a05ffe6 0xc970b9d8: tag newnfs, type VREG usecount 1, writecount 0, refcount 267 mountedhere 0 flags (VI_ACTIVE) v_object 0xcdf46534 ref 0 pages 4240 lock type newnfs: SHARED (count 1) #0 0xc0a80dc0 at __lockmgr_args+0xf60 #1 0xc09c358c at nfs_lock1+0x9c #2 0xc0edec72 at VOP_LOCK1_APV+0x112 #3 0xc0b52b1a at _vn_lock+0xca #4 0xc0b54be4 at vn_read+0x144 #5 0xc0b5155b at vn_io_fault+0x24b #6 0xc0aefda9 at dofileread+0x99 #7 0xc0aefaa6 at kern_readv+0x66 #8 0xc0aefa2c at sys_read+0x5c #9 0xc0eb8f1d at syscall+0x2ed #10 0xc0ea15e1 at Xint0x80_syscall+0x21 fileid 1766871 fsid 0x3a05ffe6 0xcabf5708: tag newnfs, type VREG usecount 1, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xcd2c3de0 ref 0 pages 5 lock type newnfs: EXCL by thread 0xca5c5000 (pid 41574, mmap, tid 100207) #0 0xc0a80f25 at __lockmgr_args+0x10c5 #1 0xc09c358c at nfs_lock1+0x9c #2 0xc0edec72 at VOP_LOCK1_APV+0x112 #3 0xc0b52b1a at _vn_lock+0xca #4 0xc0b52c7b at vn_close+0xeb #5 0xc0b51df3 at vn_closefile+0x53 #6 0xc0a5983c at _fdrop+0x2c #7 0xc0a5c013 at closef+0x203 #8 0xc0a59eb5 at closefp+0xb5 #9 0xc0a5a79b at kern_close+0xfb #10 0xc0a5a69a at sys_close+0x1a #11 0xc0eb8f1d at syscall+0x2ed #12 0xc0ea15e1 at Xint0x80_syscall+0x21 fileid 1772161 fsid 0x3a05ffe6 0xcb2af5a0: tag newnfs, type VREG usecount 0, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE|VI_DOINGINACT) v_object 0xc8c32e74 ref 0 pages 5 lock type newnfs: EXCL by thread 0xc8af6c00 (pid 41568, mmap, tid 100485) with exclusive waiters pending #0 0xc0a80f25 at __lockmgr_args+0x10c5 #1 0xc09c358c at nfs_lock1+0x9c #2 0xc0edec72 at VOP_LOCK1_APV+0x112 #3 0xc0b52b1a at _vn_lock+0xca #4 0xc0b52c7b at vn_close+0xeb #5 0xc0b51df3 at vn_closefile+0x53 #6 0xc0a5983c at _fdrop+0x2c #7 0xc0a5c013 at closef+0x203 #8 0xc0a59eb5 at closefp+0xb5 #9 0xc0a5a79b at kern_close+0xfb #10 0xc0a5a69a at sys_close+0x1a #11 0xc0eb8f1d at syscall+0x2ed #12 0xc0ea15e1 at Xint0x80_syscall+0x21 fileid 1772149 fsid 0x3a05ffe6 0xca41f168: tag newnfs, type VREG usecount 2, writecount 2, refcount 4 mountedhere 0 flags (VI_ACTIVE) v_object 0xcb5a25c8 ref 0 pages 5 lock type newnfs: EXCL by thread 0xcbbf3000 (pid 41553, mmap, tid 100534) #0 0xc0a80f25 at __lockmgr_args+0x10c5 #1 0xc09c358c at nfs_lock1+0x9c #2 0xc0edec72 at VOP_LOCK1_APV+0x112 #3 0xc0b52b1a at _vn_lock+0xca #4 0xc0b407e7 at vget+0x77 #5 0xc0d29e43 at vm_mmap+0x3b3 #6 0xc0d29850 at sys_mmap+0x2f0 #7 0xc0eb8f1d at syscall+0x2ed #8 0xc0ea15e1 at Xint0x80_syscall+0x21 fileid 1772162 fsid 0x3a05ffe6 0xc9ebe870: tag newnfs, type VREG usecount 2, writecount 2, refcount 4 mountedhere 0 flags (VI_ACTIVE) v_object 0xcb5a21bc ref 0 pages 5 lock type newnfs: EXCL by thread 0xca5be900 (pid 41573, mmap, tid 100183) #0 0xc0a80f25 at __lockmgr_args+0x10c5 #1 0xc09c358c at nfs_lock1+0x9c #2 0xc0edec72 at VOP_LOCK1_APV+0x112 #3 0xc0b52b1a at _vn_lock+0xca #4 0xc0b407e7 at vget+0x77 #5 0xc0d29e43 at vm_mmap+0x3b3 #6 0xc0d29850 at sys_mmap+0x2f0 #7 0xc0eb8f1d at syscall+0x2ed #8 0xc0ea15e1 at Xint0x80_syscall+0x21 fileid 1772172 fsid 0x3a05ffe6 0xc93ab708: tag newnfs, type VREG usecount 2, writecount 2, refcount 4 mountedhere 0 flags (VI_ACTIVE) VI_LOCKed v_object 0xc91ea8ac ref 0 pages 5 lock type newnfs: EXCL by thread 0xca7fa900 (pid 41556, mmap, tid 100299) #0 0xc0a80f25 at __lockmgr_args+0x10c5 #1 0xc09c358c at nfs_lock1+0x9c #2 0xc0edec72 at VOP_LOCK1_APV+0x112 #3 0xc0b52b1a at _vn_lock+0xca #4 0xc0b407e7 at vget+0x77 #5 0xc0d29e43 at vm_mmap+0x3b3 #6 0xc0d29850 at sys_mmap+0x2f0 #7 0xc0eb8f1d at syscall+0x2ed #8 0xc0ea15e1 at Xint0x80_syscall+0x21 fileid 1772181 fsid 0x3a05ffe6 0xcf9eb168: tag newnfs, type VDIR usecount 1, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE) lock type newnfs: SHARED (count 1) #0 0xc0a80dc0 at __lockmgr_args+0xf60 #1 0xc09c358c at nfs_lock1+0x9c #2 0xc0edec72 at VOP_LOCK1_APV+0x112 #3 0xc0b52b1a at _vn_lock+0xca #4 0xc0b407e7 at vget+0x77 #5 0xc0b2b9e8 at cache_lookup+0x5a8 #6 0xc09bf541 at nfs_lookup+0x1d1 #7 0xc0edb694 at VOP_LOOKUP_APV+0x124 #8 0xc0b3589e at lookup+0x52e #9 0xc0b34f8d at namei+0x47d #10 0xc0b4a1e9 at kern_chdir+0x89 #11 0xc0b4a152 at sys_chdir+0x22 #12 0xc0eb8f1d at syscall+0x2ed #13 0xc0ea15e1 at Xint0x80_syscall+0x21 fileid 2991106 fsid 0x3a05ffe6 db:0:lockedvnods> show mount 0xc7d0bbb0 /dev/ad4s1a on / (ufs) 0xc7d0c000 devfs on /dev (devfs) 0xc80905d8 /dev/ad4s1f on /home (ufs) 0xc8091bb0 /dev/ad4s1d on /usr (ufs) 0xc809cbb0 /dev/ad4s1e on /var (ufs) 0xc809c8c4 procfs on /proc (procfs) 0xc809c5d8 /dev/label/tmp on /tmp (ufs) 0xc809c000 127.0.0.1:/tmp on /mnt (nfs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 41673 41482 997 0 D+ newnfs 0xcb2af5d4 umount 41672 1192 1187 1001 S piperd 0xc7da3198 awk 41671 1192 1187 1001 S piperd 0xca5514c8 sed 41670 1192 1187 1001 S piperd 0xc8ed3000 head 41669 1192 1187 1001 R netstat 41663 41657 41663 0 Rs sh 41662 41655 923 0 D ufs 0xc86065d4 ls 41657 796 796 0 S piperd 0xc7db0330 cron 41655 923 923 0 S wait 0xc7dd8ba0 sh 41621 41599 997 0 R+ swap 41620 41599 997 0 LL+ *pmap pv 0xc9629e80 swap 41619 41599 997 0 R+ swap 41618 41599 997 0 R+ swap 41617 41599 997 0 DL+ swread 0xc5184840 swap 41616 41599 997 0 R+ swap 41615 41599 997 0 R+ CPU 2 swap 41614 41599 997 0 R+ swap 41613 41599 997 0 R+ swap 41612 41599 997 0 R+ swap 41611 41599 997 0 R+ swap 41610 41599 997 0 R+ swap 41605 41583 997 0 DL+ swread 0xc3cd4000 creat 41603 41583 997 0 DL+ vmpfw 0xc3cd4000 creat 41601 41583 997 0 DL+ vmpfw 0xc3cd4000 creat 41599 41558 997 0 SW+ wait 0xc9f61000 swap 41598 41583 997 0 RL+ creat 41596 41583 997 0 S+ newnfsre 0xcaddfa00 creat 41594 41583 997 0 LL+ *pmap pv 0xc9629e80 creat 41593 41575 997 0 DL+ swread 0xc31bf240 mkdir 41591 41583 997 0 DL+ swread 0xc4256700 creat 41590 41575 997 0 LL+ *pmap pv 0xc9629e80 mkdir 41588 41575 997 0 R+ mkdir 41587 41583 997 0 D+ newnfs 0xcd88246c creat 41583 41546 997 0 SW+ wait 0xc8af7000 creat 41582 41575 997 0 DL+ swread 0xc3d64300 mkdir 41580 41575 997 0 DL+ swread 0xc54ed840 mkdir 41575 41552 997 0 SW+ wait 0xca7165d0 mkdir 41574 41543 997 0 R+ mmap 41573 41543 997 0 R+ CPU 1 mmap 41571 41551 997 0 D+ newnfs 0xcd88246c fts 41570 41551 997 0 D+ newnfs 0xcd88246c fts 41569 41551 997 0 DL+ swread 0xc3cd4200 fts 41568 41543 997 0 R+ mmap 41567 41551 997 0 S+ newnfsre 0xc9517c00 fts 41565 41551 997 0 D+ newnfs 0xcd88246c fts 41563 41551 997 0 D+ newnfs 0xcd88246c fts 41561 41551 997 0 D+ newnfs 0xcd88246c fts 41559 41551 997 0 LL+ *pmap pv 0xc9629e80 fts 41558 41524 997 0 S+ nanslp 0xc124396a swap 41557 41551 997 0 D+ newnfs 0xcd88246c fts 41556 41543 997 0 R+ CPU 0 mmap 41554 41551 997 0 D+ newnfs 0xca2e6304 fts 41553 41543 997 0 R+ CPU 3 mmap 41552 41524 997 0 S+ nanslp 0xc124396a mkdir 41551 41537 997 0 SW+ wait 0xca70bba0 fts 41550 41543 997 0 DL+ swread 0xc3cd40c0 mmap 41549 41543 997 0 RL+ mmap 41548 41543 997 0 DL+ swread 0xc4be6440 mmap 41547 41543 997 0 DL+ swread 0xc3cd4180 mmap 41546 41524 997 0 S+ nanslp 0xc124396b creat 41545 41543 997 0 DL+ vmpfw 0xc3cd4180 mmap 41544 41540 997 0 DL+ swread 0xc3cd4080 rw 41543 41536 997 0 SW+ wait 0xca69b2e8 mmap 41542 41540 997 0 R+ rw 41541 41540 997 0 DL+ swread 0xc3cd4240 rw 41540 41535 997 0 SW+ wait 0xc7dfd5d0 rw 41539 41524 997 0 S+ nanslp 0xc124396b lockf 41537 41524 997 0 S+ nanslp 0xc124396b fts 41536 41524 997 0 S+ nanslp 0xc1243968 mmap 41535 41524 997 0 S+ nanslp 0xc124396b rw 41524 41523 997 0 SW+ wait 0xca45c2e8 run 41523 41522 997 0 SW+ wait 0xca70c8b8 run 41522 41497 997 0 S+ nanslp 0xc124396b run 41497 41482 997 0 SW+ wait 0xca8425d0 sh 41482 997 997 0 S+ wait 0xcb2f9ba0 sh 96762 0 0 0 SL - 0xc140a90c [newnfs 19] 96761 0 0 0 SL - 0xc140a908 [newnfs 18] 96760 0 0 0 SL - 0xc140a904 [newnfs 17] 96759 0 0 0 SL - 0xc140a900 [newnfs 16] 96758 0 0 0 SL - 0xc140a8fc [newnfs 15] 96757 0 0 0 SL - 0xc140a8f8 [newnfs 14] 96756 0 0 0 SL - 0xc140a8f4 [newnfs 13] 96755 0 0 0 SL - 0xc140a8f0 [newnfs 12] 96753 0 0 0 SL - 0xc140a8ec [newnfs 11] 96752 0 0 0 SL - 0xc140a8e8 [newnfs 10] 96751 0 0 0 SL - 0xc140a8e4 [newnfs 9] 96750 0 0 0 SL - 0xc140a8e0 [newnfs 8] 96749 0 0 0 SL - 0xc140a8dc [newnfs 7] 96748 0 0 0 SL - 0xc140a8d8 [newnfs 6] 74004 0 0 0 SL - 0xc140a8d4 [newnfs 5] 74003 0 0 0 SL - 0xc140a8d0 [newnfs 4] 74002 0 0 0 SL - 0xc140a8cc [newnfs 3] 74001 0 0 0 SL - 0xc140a8c8 [newnfs 2] 74000 0 0 0 SL - 0xc140a8c4 [newnfs 1] 66634 0 0 0 RL [newnfs 0] 1212 1211 1212 1001 Ss+ ttyin 0xc7930c70 bash 1211 1209 1209 1001 S select 0xc81b81a4 sshd 1209 785 1209 0 Ss select 0xc7893864 sshd 1193 1187 1187 1001 S piperd 0xca44f330 awk 1192 1187 1187 1001 S wait 0xca596000 sh 1191 1189 1191 1001 Ss kqread 0xc7d71980 tail 1190 1188 1190 1001 Ls+ *pmap pv 0xc9629e80 top 1189 1182 1182 1001 S select 0xc7894524 sshd 1188 1181 1181 1001 S select 0xc80a75a4 sshd 1187 1186 1187 1001 SWs wait 0xca5ac2e8 sh 1186 1180 1180 1001 S select 0xc78938e4 sshd 1182 785 1182 0 Ss select 0xc78938a4 sshd 1181 785 1181 0 Ss select 0xc7894564 sshd 1180 785 1180 0 Ss select 0xc78945a4 sshd 997 896 997 0 SW+ wait 0xc86edba0 sh 972 1 972 0 Ss+ ttyin 0xc7930270 getty 971 1 971 0 Ss+ ttyin 0xc7930470 getty 970 1 970 0 Ss+ ttyin 0xc778b070 getty 969 1 969 0 Ss+ ttyin 0xc778b270 getty 968 1 968 0 Ss+ ttyin 0xc778b470 getty 967 1 967 0 Ss+ ttyin 0xc778b670 getty 966 1 966 0 Ss+ ttyin 0xc778b870 getty 965 1 965 0 Ss+ ttyin 0xc778ba70 getty 964 1 964 0 Ss+ ttyin 0xc778bc70 getty 947 1 947 0 Ss select 0xc81a6664 inetd 923 1 923 0 Ss wait 0xc7dfc000 watchdogd 896 876 896 0 SW+ wait 0xc7dfc5d0 bash 876 859 876 0 SW+ pause 0xc7c2c634 csh 859 846 859 1001 SW+ wait 0xc86ed5d0 su 846 845 846 1001 SWs+ wait 0xc86ea2e8 bash 845 843 843 1001 S select 0xc81a6ca4 sshd 843 785 843 0 Ss select 0xc78939e4 sshd 796 1 796 0 SWs nanslp 0xc124396b cron 791 1 791 25 SWs pause 0xc7d7dc04 sendmail 788 1 788 0 Ss select 0xc7894aa4 sendmail 785 1 785 0 Ss select 0xc81a6da4 sshd 754 733 733 0 S select 0xc81a6564 smbd 752 735 735 0 DL swread 0xc38b9f80 winbindd 750 1 750 0 Ss select 0xc7893ba4 moused 735 1 735 0 Ss select 0xc7894b24 winbindd 733 1 733 0 Ss select 0xc7894ae4 smbd 731 1 731 0 Ss select 0xc7894ba4 nmbd 707 1 707 0 Ss select 0xc7894b64 ntpd 654 648 648 0 R (threaded) nfsd 100111 RunQ nfsd: service 100110 RunQ nfsd: service 100109 S rpcsvc 0xc7864590 nfsd: service 100098 S rpcsvc 0xc7da18d0 nfsd: master 648 1 648 0 Ss select 0xc7893ce4 nfsd 642 1 642 0 Ss select 0xc81a6de4 mountd 635 631 631 0 S select 0xc81a6e24 nfsuserd 634 631 631 0 S select 0xc7893be4 nfsuserd 633 631 631 0 S select 0xc81a6e64 nfsuserd 632 631 631 0 S select 0xc7893c24 nfsuserd 631 1 631 0 SWs pause 0xc7dfa634 nfsuserd 602 1 602 0 Ss select 0xc7893c64 rpcbind 532 1 532 0 RLs syslogd 429 1 429 0 Ss select 0xc81b9124 devd 17 0 0 0 DL sdflush 0xc13bead4 [softdepflush] 16 0 0 0 DL syncer 0xc13ba8a4 [syncer] 9 0 0 0 DL vlruwt 0xc7c2aba0 [vnlru] 8 0 0 0 DL psleep 0xc13ba61c [bufdaemon] 7 0 0 0 RL [pagezero] 6 0 0 0 DL psleep 0xc13bef9c [vmdaemon] 5 0 0 0 DL wswbuf0 0xc13bec2c [pagedaemon] 4 0 0 0 DL ccb_scan 0xc120f324 [xpt_thrd] 3 0 0 0 DL waiting_ 0xc140ec0c [sctp_iterator] 2 0 0 0 DL - 0xc7881e3c [fdc0] 15 0 0 0 DL (threaded) [usb] 100058 D - 0xc78f8d34 [usbus5] 100057 D - 0xc78f8d04 [usbus5] 100056 D - 0xc78f8cd4 [usbus5] 100055 D - 0xc78f8ca4 [usbus5] 100053 D - 0xc78e9b5c [usbus4] 100052 D - 0xc78e9b2c [usbus4] 100051 D - 0xc78e9afc [usbus4] 100050 D - 0xc78e9acc [usbus4] 100049 D - 0xc78e3b5c [usbus3] 100048 D - 0xc78e3b2c [usbus3] 100047 D - 0xc78e3afc [usbus3] 100046 D - 0xc78e3acc [usbus3] 100045 D - 0xc78dcb5c [usbus2] 100044 D - 0xc78dcb2c [usbus2] 100043 D - 0xc78dcafc [usbus2] 100042 D - 0xc78dcacc [usbus2] 100040 D - 0xc78d7b5c [usbus1] 100039 D - 0xc78d7b2c [usbus1] 100038 D - 0xc78d7afc [usbus1] 100037 D - 0xc78d7acc [usbus1] 100035 D - 0xc78cdb5c [usbus0] 100034 D - 0xc78cdb2c [usbus0] 100033 D - 0xc78cdafc [usbus0] 100032 D - 0xc78cdacc [usbus0] 14 0 0 0 DL - 0xc122964c [yarrow] 13 0 0 0 LL (threaded) [geom] 100016 D - 0xc140ac6c [g_down] 100015 L *pmap pv 0xc9629e80 [g_up] 100014 D - 0xc140ac64 [g_event] 12 0 0 0 WL (threaded) [intr] 100063 I [irq12: psm0] 100062 I [irq1: atkbd0] 100060 I [swi0: uart] 100059 I [irq14: ata0] 100054 I [irq19: ehci0] 100041 I [irq18: ohci2 ohci4] 100036 I [irq17: ohci1 ohci3] 100031 I [irq16: hdac1 ohci0] 100030 I [irq22: ahci0] 100029 I [irq257: re0] 100028 I [irq256: hdac0] 100025 I [swi2: cambio] 100024 I [swi5: fast taskq] 100022 I [swi6: Giant taskq] 100021 I [swi6: task queue] 100012 I [swi3: vm] 100011 I [swi4: clock] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 I [swi4: clock] 100007 I [swi1: netisr 0] 11 0 0 0 RL (threaded) [idle] 100006 CanRun [idle: cpu3] 100005 CanRun [idle: cpu2] 100004 CanRun [idle: cpu1] 100003 CanRun [idle: cpu0] 1 0 1 0 SLs wait 0xc76caba0 [init] 10 0 0 0 DL audit_wo 0xc14119f8 [audit] 0 0 0 0 DLs (threaded) [kernel] 100065 D - 0xc1242862 [deadlkres] 100064 D - 0xc789a240 [mca taskq] 100027 D - 0xc76abc80 [ffs_trim taskq] 100026 D - 0xc76abcc0 [kqueue taskq] 100023 D - 0xc76abd40 [thread taskq] 100020 D - 0xc76abe00 [acpi_task_2] 100019 D - 0xc76abe00 [acpi_task_1] 100018 D - 0xc76abe00 [acpi_task_0] 100013 D - 0xc76abe40 [firmware taskq] 100000 D sched 0xc140ace4 [swapper] 41572 41539 997 0 Z+ lockf 41555 41524 997 0 Z+ rename 41566 41524 997 0 Z+ thr1 41562 41524 997 0 Z+ mkfifo 41564 41524 997 0 Z+ pty 41560 41524 997 0 Z+ syscall 41538 41524 997 0 Z+ link db:0:ps> allt Tracing command umount pid 41673 tid 100302 td 0xca7ac900 sched_switch(ca7ac900,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb83c85c mi_switch(104,0,c109b989,1f5,162,...) at mi_switch+0x1c9/frame 0xfb83c890 sleepq_switch(ca7ac900,0,c109b989,26b,60,...) at sleepq_switch+0x1b9/frame 0xfb83c8c4 sleepq_wait(cb2af5d4,60,c107ff76,4,0,...) at sleepq_wait+0x48/frame 0xfb83c8e8 sleeplk(cb2af640,c107ff76,60,33,0,...) at sleeplk+0x126/frame 0xfb83c930 __lockmgr_args(cb2af5d4,80500,cb2af640,0,0,0,c10a65af,881) at __lockmgr_args+0xaa4/frame 0xfb83ca10 nfs_lock1(fb83ca88,fb83ca7c,c0a895d7,c93254d8,8,...) at nfs_lock1+0x9c/frame 0xfb83ca40 VOP_LOCK1_APV(c11bb6b8,fb83ca88,c0b41801,c13ba85c,c1209068,...) at VOP_LOCK1_APV+0x112/frame 0xfb83ca70 _vn_lock(cb2af5a0,80500,c10a65af,881,c13ba86c,...) at _vn_lock+0xca/frame 0xfb83cab0 vget(cb2af5a0,80500,ca7ac900,12bc,0,...) at vget+0x77/frame 0xfb83cae8 vfs_msync(c809c000,1,1,4fd,c1baed14,...) at vfs_msync+0xa0/frame 0xfb83cb30 dounmount(c809c000,8080000,ca7ac900,493,c0ae4b45,...) at dounmount+0x2a7/frame 0xfb83cb90 sys_unmount(ca7ac900,fb83ccc8,14,c10982d9,7b3,...) at sys_unmount+0x3cd/frame 0xfb83cc40 syscall(fb83cd08) at syscall+0x2ed/frame 0xfb83ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb83ccfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c16d7, esp = 0xbfbfd104, ebp = 0xbfbfd1d0 --- Tracing command awk pid 41672 tid 100528 td 0xcbbf4300 sched_switch(cbbf4300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfbbc8a1c mi_switch(104,0,c109b989,1f5,c109b989,...) at mi_switch+0x1c9/frame 0xfbbc8a50 sleepq_switch(cbbf4300,0,c109b989,1ab,fbbc8ac8,...) at sleepq_switch+0x1b9/frame 0xfbbc8a84 sleepq_catch_signals(0,c109b989,162,fd8,cbbf4300,...) at sleepq_catch_signals+0x3a1/frame 0xfbbc8acc sleepq_wait_sig(c7da3198,5c,c109e8b6,100,0,...) at sleepq_wait_sig+0x14/frame 0xfbbc8af0 _sleep(c7da3198,c7da3318,15c,c109e8b6,0,...) at _sleep+0x35b/frame 0xfbbc8b4c pipe_read(c7db1658,fbbc8c10,c8078e80,0,cbbf4300,...) at pipe_read+0x2dc/frame 0xfbbc8b90 dofileread(c7db1658,fbbc8c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xfbbc8bc4 kern_readv(cbbf4300,0,fbbc8c10,0,28861000,...) at kern_readv+0x66/frame 0xfbbc8bf0 sys_read(cbbf4300,fbbc8cc8,c0ebf800,c7200c90,0,...) at sys_read+0x5c/frame 0xfbbc8c40 syscall(fbbc8d08) at syscall+0x2ed/frame 0xfbbc8cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfbbc8cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281c2ca7, esp = 0xbfbfdaa4, ebp = 0xbfbfdab8 --- Tracing command sed pid 41671 tid 100509 td 0xc8b17600 sched_switch(c8b17600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfbb82a1c mi_switch(104,0,c109b989,1f5,c109b989,...) at mi_switch+0x1c9/frame 0xfbb82a50 sleepq_switch(c8b17600,0,c109b989,1ab,fbb82ac8,...) at sleepq_switch+0x1b9/frame 0xfbb82a84 sleepq_catch_signals(0,c109b989,162,14a0,c8b17600,...) at sleepq_catch_signals+0x3a1/frame 0xfbb82acc sleepq_wait_sig(ca5514c8,5c,c109e8b6,100,0,...) at sleepq_wait_sig+0x14/frame 0xfbb82af0 _sleep(ca5514c8,ca551648,15c,c109e8b6,0,...) at _sleep+0x35b/frame 0xfbb82b4c pipe_read(ca5e4818,fbb82c10,c8078e80,0,c8b17600,...) at pipe_read+0x2dc/frame 0xfbb82b90 dofileread(ca5e4818,fbb82c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xfbb82bc4 kern_readv(c8b17600,0,fbb82c10,0,28808000,...) at kern_readv+0x66/frame 0xfbb82bf0 sys_read(c8b17600,fbb82cc8,c10ed72f,d6,0,...) at sys_read+0x5c/frame 0xfbb82c40 syscall(fbb82d08) at syscall+0x2ed/frame 0xfbb82cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfbb82cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2818cca7, esp = 0xbfbfda84, ebp = 0xbfbfda98 --- Tracing command head pid 41670 tid 100393 td 0xc97a6600 sched_switch(c97a6600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb990a1c mi_switch(104,0,c109b989,1f5,c109b989,...) at mi_switch+0x1c9/frame 0xfb990a50 sleepq_switch(c97a6600,0,c109b989,1ab,fb990ac8,...) at sleepq_switch+0x1b9/frame 0xfb990a84 sleepq_catch_signals(0,c109b989,162,480,c97a6600,...) at sleepq_catch_signals+0x3a1/frame 0xfb990acc sleepq_wait_sig(c8ed3000,5c,c109e8b6,100,0,...) at sleepq_wait_sig+0x14/frame 0xfb990af0 _sleep(c8ed3000,c8ed3180,15c,c109e8b6,0,...) at _sleep+0x35b/frame 0xfb990b4c pipe_read(c8ed5118,fb990c10,c8078e80,0,c97a6600,...) at pipe_read+0x2dc/frame 0xfb990b90 dofileread(c8ed5118,fb990c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xfb990bc4 kern_readv(c97a6600,0,fb990c10,0,28804000,...) at kern_readv+0x66/frame 0xfb990bf0 sys_read(c97a6600,fb990cc8,c10ed72f,d6,7b3,...) at sys_read+0x5c/frame 0xfb990c40 syscall(fb990d08) at syscall+0x2ed/frame 0xfb990cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb990cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28187ca7, esp = 0xbfbfcc14, ebp = 0xbfbfcc28 --- Tracing command netstat pid 41669 tid 100479 td 0xc8ad8900 sched_switch(c8ad8900,0,207,1b0,c8a98787,...) at sched_switch+0x4b4/frame 0xfbb28c98 mi_switch(207,0,c109c4e4,fb,c13d4628,...) at mi_switch+0x1c9/frame 0xfbb28ccc ast(fbb28d08) at ast+0x2e1/frame 0xfbb28cfc doreti_ast() at doreti_ast+0x1b/frame 0xbfbfda10 Tracing command sh pid 41663 tid 100542 td 0xcbbee600 sched_switch(cbbee600,0,602,1b0,c1251090,...) at sched_switch+0x4b4/frame 0xfbbf2768 mi_switch(602,0,c10963d4,d3,cbbee600,...) at mi_switch+0x1c9/frame 0xfbbf279c critical_exit(c76a1f5c,c1250980,c1250990,c1250980,0,...) at critical_exit+0xa3/frame 0xfbbf27b8 intr_event_handle(c770d480,fbbf2834,fbbf2800,fbbf2834,3,...) at intr_event_handle+0x123/frame 0xfbbf27e4 intr_execute_handlers(c76a1f5c,fbbf2834,3) at intr_execute_handlers+0x42/frame 0xfbbf2804 lapic_handle_intr(32,fbbf2834) at lapic_handle_intr+0x6f/frame 0xfbbf2824 Xapic_isr1() at Xapic_isr1+0x35/frame 0xfbbf2824 --- interrupt, eip = 0xc0ea8ed7, esp = 0xfbbf2874, ebp = 0xfbbf2878 --- spinlock_exit(c140e3a0,0,c10ec086,4c8,0,...) at spinlock_exit+0x27/frame 0xfbbf2878 smp_tlb_shootdown(c621d000) at smp_tlb_shootdown+0xff/frame 0xfbbf28b0 smp_invlpg_range(c621c000,c621d000,c3cd4778,c48bd7c0,c8a07620,...) at smp_invlpg_range+0x23/frame 0xfbbf28bc free_pv_chunk(c8a07620,bfca2000,c10ec202,1129,c1251090,...) at free_pv_chunk+0xd9/frame 0xfbbf28d8 pmap_remove_pages(c8a07620,0,c108f4be,3fe,fbbf29e8,...) at pmap_remove_pages+0x5c4/frame 0xfbbf2948 exec_new_vmspace(fbbf2ae0,c12018d0,8,cefa22e4,fbbf2a08,...) at exec_new_vmspace+0x16d/frame 0xfbbf2988 exec_elf32_imgact(fbbf2ae0,fbbf2bc0,c108f4be,170,0,...) at exec_elf32_imgact+0x518/frame 0xfbbf2a08 kern_execve(cbbee600,fbbf2c08,0,2880e254,2880e25c,...) at kern_execve+0x68b/frame 0xfbbf2be8 sys_execve(cbbee600,fbbf2cc8,c10ed72f,d6,db,...) at sys_execve+0x53/frame 0xfbbf2c40 syscall(fbbf2d08) at syscall+0x2ed/frame 0xfbbf2cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfbbf2cfc --- syscall (59, FreeBSD ELF32, sys_execve), eip = 0x2815231f, esp = 0xbfbfdabc, ebp = 0xbfbfdbec --- Tracing command ls pid 41662 tid 100384 td 0xcb2fcc00 sched_switch(cb2fcc00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb97571c mi_switch(104,0,c109b989,1f5,162,...) at mi_switch+0x1c9/frame 0xfb975750 sleepq_switch(cb2fcc00,0,c109b989,26b,60,...) at sleepq_switch+0x1b9/frame 0xfb975784 sleepq_wait(c86065d4,60,c1085472,4,1,...) at sleepq_wait+0x48/frame 0xfb9757a8 sleeplk(c8606640,c1085472,60,33,1,...) at sleeplk+0x126/frame 0xfb9757f0 __lockmgr_args(c86065d4,200100,c8606640,0,0,...) at __lockmgr_args+0x612/frame 0xfb9758d0 ffs_lock(fb975958,0,c0b2fe88,c7d2a304,fb975958,...) at ffs_lock+0xad/frame 0xfb975910 VOP_LOCK1_APV(c11f482c,fb975958,0,fb9759cc,c1209068,...) at VOP_LOCK1_APV+0x112/frame 0xfb975940 _vn_lock(c86065a0,200100,c10a65af,881,2a1,...) at _vn_lock+0xca/frame 0xfb975980 vget(c86065a0,200100,cb2fcc00,29d,c1206530,...) at vget+0x77/frame 0xfb9759b8 cache_lookup(c7d2a2d0,fb975bc0,fb975bd4,0,0,...) at cache_lookup+0x5a8/frame 0xfb975a18 vfs_cache_lookup(fb975ac8,c10f3df1,c10c89ed,c10a59f3,c1206530,...) at vfs_cache_lookup+0xbc/frame 0xfb975a60 VOP_LOOKUP_APV(c11f482c,fb975ac8,fb975bd4,205,c7d2a370,...) at VOP_LOOKUP_APV+0x124/frame 0xfb975a90 lookup(fb975b88,c10a59f3,107,ce,c7599254,...) at lookup+0x52e/frame 0xfb975af0 namei(fb975b88,fb975c10,bfbfc9a6,0,0,...) at namei+0x47d/frame 0xfb975b78 kern_pathconf(cb2fcc00,bfbfc9a6,0,40,0) at kern_pathconf+0x83/frame 0xfb975c24 sys_lpathconf(cb2fcc00,fb975cc8,c0ebf800,c71fdc90,0,...) at sys_lpathconf+0x31/frame 0xfb975c40 syscall(fb975d08) at syscall+0x2ed/frame 0xfb975cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb975cfc --- syscall (513, FreeBSD ELF32, sys_lpathconf), eip = 0x28111657, esp = 0xbfbfc94c, ebp = 0xbfbfd1b8 --- Tracing command cron pid 41657 tid 100506 td 0xc8b1b000 sched_switch(c8b1b000,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfbb79a1c mi_switch(104,0,c109b989,1f5,c109b989,...) at mi_switch+0x1c9/frame 0xfbb79a50 sleepq_switch(c8b1b000,0,c109b989,1ab,fbb79ac8,...) at sleepq_switch+0x1b9/frame 0xfbb79a84 sleepq_catch_signals(0,c109b989,162,4c8,c8b1b000,...) at sleepq_catch_signals+0x3a1/frame 0xfbb79acc sleepq_wait_sig(c7db0330,5c,c109e8b6,100,0,...) at sleepq_wait_sig+0x14/frame 0xfbb79af0 _sleep(c7db0330,c7db04b0,15c,c109e8b6,0,...) at _sleep+0x35b/frame 0xfbb79b4c pipe_read(c86c2770,fbb79c10,c7d06380,0,c8b1b000,...) at pipe_read+0x2dc/frame 0xfbb79b90 dofileread(c86c2770,fbb79c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xfbb79bc4 kern_readv(c8b1b000,5,fbb79c10,0,2881b000,...) at kern_readv+0x66/frame 0xfbb79bf0 sys_read(c8b1b000,fbb79cc8,c10ed72f,e9,7b3,...) at sys_read+0x5c/frame 0xfbb79c40 syscall(fbb79d08) at syscall+0x2ed/frame 0xfbb79cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfbb79cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a8ca7, esp = 0xbfbfd634, ebp = 0xbfbfd648 --- Tracing command sh pid 41655 tid 100437 td 0xc9f6dc00 sched_switch(c9f6dc00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfbaaa98c mi_switch(104,0,c109b989,1f5,c109b989,...) at mi_switch+0x1c9/frame 0xfbaaa9c0 sleepq_switch(c9f6dc00,0,c109b989,1ab,fbaaaa38,...) at sleepq_switch+0x1b9/frame 0xfbaaa9f4 sleepq_catch_signals(0,c109b989,162,408,c9f6dc00,...) at sleepq_catch_signals+0x3a1/frame 0xfbaaaa3c sleepq_wait_sig(c7dd8ba0,6c,c109eda5,100,0,...) at sleepq_wait_sig+0x14/frame 0xfbaaaa60 _sleep(c7dd8ba0,c7dd8c34,16c,c109eda5,0,...) at _sleep+0x35b/frame 0xfbaaaabc kern_wait6(c9f6dc00,7,0,0,fbaaab4c,...) at kern_wait6+0x45c/frame 0xfbaaab20 sys_wait4(c9f6dc00,fbaaacc8,c0ebf800,c71fac90,0,...) at sys_wait4+0x94/frame 0xfbaaac40 syscall(fbaaad08) at syscall+0x2ed/frame 0xfbaaacfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfbaaacfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815233f, esp = 0xbfbfdae0, ebp = 0xbfbfdaf8 --- Tracing command swap pid 41621 tid 101172 td 0xc8c02300 sched_switch(c8c02300,0,602,1b0,fbc3bcb4,...) at sched_switch+0x4b4/frame 0xfbc3bc90 mi_switch(602,0,c10963d4,d3,c8c02300,...) at mi_switch+0x1c9/frame 0xfbc3bcc4 critical_exit(c8c02300,0,3) at critical_exit+0xa3/frame 0xfbc3bce0 ipi_bitmap_handler(3b,3b,3b,1000,28c00000,...) at ipi_bitmap_handler+0x6b/frame 0xfbc3bd00 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x2f/frame 0xfbc3bd00 --- interrupt, eip = 0x80494e0, esp = 0xbfbfd688, ebp = 0xbfbfd6a0 --- Tracing command swap pid 41620 tid 101171 td 0xc8c02900 sched_switch(c8c02900,0,103,1b0,0,...) at sched_switch+0x4b4/frame 0xfbc3885c mi_switch(103,0,c109c55c,2e6,1a75,...) at mi_switch+0x1c9/frame 0xfbc38890 turnstile_wait(c9629e80,cbbee600,0,11112,0,...) at turnstile_wait+0x3b4/frame 0xfbc388c0 __rw_wlock_hard(c13d1a90,c8c02900,c10ec202,d66,0,...) at __rw_wlock_hard+0x343/frame 0xfbc3893c _rw_wlock_cookie(c13d1a90,c10ec202,d66,c10d00e0,c8c02900,...) at _rw_wlock_cookie+0xdd/frame 0xfbc3896c pmap_enter(c85f70b0,28f18000,2,c325a700,3,...) at pmap_enter+0x7b/frame 0xfbc389c0 vm_fault_hold(c85f7000,28f18000,2,0,0,...) at vm_fault_hold+0x1a57/frame 0xfbc38b20 vm_fault(c85f7000,28f18000,2,0,c85f7000,...) at vm_fault+0x82/frame 0xfbc38b48 trap_pfault(28f18000,fbc38d08,c124fb80,c7772edc,fbc38bec,...) at trap_pfault+0x1ba/frame 0xfbc38bc0 trap(fbc38d08) at trap+0x5da/frame 0xfbc38cfc calltrap() at calltrap+0x6/frame 0xfbc38cfc --- trap 0xc, eip = 0x80494dc, esp = 0xbfbfd688, ebp = 0xbfbfd6a0 --- Tracing command swap pid 41619 tid 101169 td 0xc8ba6c00 sched_switch(c8ba6c00,0,207,1b0,ccdeb4b4,...) at sched_switch+0x4b4/frame 0xfbc35c98 mi_switch(207,0,c109c4e4,fb,c13d4628,...) at mi_switch+0x1c9/frame 0xfbc35ccc ast(fbc35d08) at ast+0x2e1/frame 0xfbc35cfc doreti_ast() at doreti_ast+0x1b/frame 0xbfbfd6a0 Tracing command swap pid 41618 tid 101167 td 0xc8ba6600 sched_switch(c8ba6600,0,207,1b0,ccdeb5b5,...) at sched_switch+0x4b4/frame 0xfbc32c98 mi_switch(207,0,c109c4e4,fb,c13d4628,...) at mi_switch+0x1c9/frame 0xfbc32ccc ast(fbc32d08) at ast+0x2e1/frame 0xfbc32cfc doreti_ast() at doreti_ast+0x1b/frame 0xbfbfd6a0 Tracing command swap pid 41617 tid 101165 td 0xc9409c00 sched_switch(c9409c00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfbc2f878 mi_switch(104,0,c109b989,1f5,101,...) at mi_switch+0x1c9/frame 0xfbc2f8ac sleepq_switch(c9409c00,0,c109b989,28e,c9409c00,...) at sleepq_switch+0x1b9/frame 0xfbc2f8e0 sleepq_timedwait(c5184840,50,13,0,0,...) at sleepq_timedwait+0x48/frame 0xfbc2f904 _sleep(c5184840,ca781940,50,c10d0579,ffffe8e0,...) at _sleep+0x345/frame 0xfbc2f960 swap_pager_getpages(ca781940,fbc2fa2c,8,0,fbc2fb04,...) at swap_pager_getpages+0x4a3/frame 0xfbc2f9c0 vm_fault_hold(c8a07658,28e10000,2,0,0,...) at vm_fault_hold+0xa21/frame 0xfbc2fb20 vm_fault(c8a07658,28e10000,2,0,c8a07658,...) at vm_fault+0x82/frame 0xfbc2fb48 trap_pfault(28e10000,fbc2fd08,c124fb80,c79465dc,fbc2fbec,...) at trap_pfault+0x1ba/frame 0xfbc2fbc0 trap(fbc2fd08) at trap+0x5da/frame 0xfbc2fcfc calltrap() at calltrap+0x6/frame 0xfbc2fcfc --- trap 0xc, eip = 0x80494dc, esp = 0xbfbfd688, ebp = 0xbfbfd6a0 --- Tracing command swap pid 41616 tid 101164 td 0xc9409900 sched_switch(c9409900,0,207,1b0,ccdeb5b5,...) at sched_switch+0x4b4/frame 0xfbc2cc98 mi_switch(207,0,c109c4e4,fb,c13d4628,...) at mi_switch+0x1c9/frame 0xfbc2cccc ast(fbc2cd08) at ast+0x2e1/frame 0xfbc2ccfc doreti_ast() at doreti_ast+0x1b/frame 0xbfbfd6a0 Tracing command swap pid 41615 tid 101161 td 0xc9409300 cpustop_handler(2,13,fbc29cfc,c0eb7b0b,40c3c3,...) at cpustop_handler+0x2f/frame 0xfbc29bb0 ipi_nmi_handler(40c3c3,0,0,fbc29c04,c0a60e4b,...) at ipi_nmi_handler+0x37/frame 0xfbc29bc0 trap(fbc29d08) at trap+0x3b/frame 0xfbc29cfc calltrap() at calltrap+0x6/frame 0xfbc29cfc --- trap 0x13, eip = 0x80494da, esp = 0xbfbfd688, ebp = 0xbfbfd6a0 --- Tracing command swap pid 41614 tid 101159 td 0xc9708c00 sched_switch(c9708c00,0,207,1b0,ccdeb5b5,...) at sched_switch+0x4b4/frame 0xfbc26c98 mi_switch(207,0,c109c4e4,fb,c13d4628,...) at mi_switch+0x1c9/frame 0xfbc26ccc ast(fbc26d08) at ast+0x2e1/frame 0xfbc26cfc doreti_ast() at doreti_ast+0x1b/frame 0xbfbfd6a0 Tracing command swap pid 41613 tid 100374 td 0xcaeb5000 sched_switch(caeb5000,0,602,1b0,fb957cb4,...) at sched_switch+0x4b4/frame 0xfb957c90 mi_switch(602,0,c10963d4,d3,caeb5000,...) at mi_switch+0x1c9/frame 0xfb957cc4 critical_exit(caeb5000,0,1) at critical_exit+0xa3/frame 0xfb957ce0 ipi_bitmap_handler(3b,3b,3b,1000,28c00000,...) at ipi_bitmap_handler+0x6b/frame 0xfb957d00 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x2f/frame 0xfb957d00 --- interrupt, eip = 0x80494e0, esp = 0xbfbfd688, ebp = 0xbfbfd6a0 --- Tracing command swap pid 41612 tid 100522 td 0xcbbf9600 sched_switch(cbbf9600,0,207,1b0,cbbeb6b6,...) at sched_switch+0x4b4/frame 0xfbbb6c98 mi_switch(207,0,c109c4e4,fb,c13d4628,...) at mi_switch+0x1c9/frame 0xfbbb6ccc ast(fbbb6d08) at ast+0x2e1/frame 0xfbbb6cfc doreti_ast() at doreti_ast+0x1b/frame 0xbfbfd6a0 Tracing command swap pid 41611 tid 100150 td 0xca45e000 sched_switch(ca45e000,0,602,1b0,fb612cb4,...) at sched_switch+0x4b4/frame 0xfb612c90 mi_switch(602,0,c10963d4,d3,ca45e000,...) at mi_switch+0x1c9/frame 0xfb612cc4 critical_exit(ca45e000,0,0) at critical_exit+0xa3/frame 0xfb612ce0 ipi_bitmap_handler(3b,3b,3b,1000,28c00000,...) at ipi_bitmap_handler+0x6b/frame 0xfb612d00 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x2f/frame 0xfb612d00 --- interrupt, eip = 0x80494e0, esp = 0xbfbfd688, ebp = 0xbfbfd6a0 --- Tracing command swap pid 41610 tid 100350 td 0xc844e900 sched_switch(c844e900,0,207,1b0,ca95b4b4,...) at sched_switch+0x4b4/frame 0xfb8dec98 mi_switch(207,0,c109c4e4,fb,c13d4628,...) at mi_switch+0x1c9/frame 0xfb8deccc ast(fb8ded08) at ast+0x2e1/frame 0xfb8decfc doreti_ast() at doreti_ast+0x1b/frame 0xbfbfd6a0 Tracing command creat pid 41605 tid 100176 td 0xca5c0600 sched_switch(ca5c0600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb660878 mi_switch(104,0,c109b989,1f5,101,...) at mi_switch+0x1c9/frame 0xfb6608ac sleepq_switch(ca5c0600,0,c109b989,28e,ca5c0600,...) at sleepq_switch+0x1b9/frame 0xfb6608e0 sleepq_timedwait(c3cd4000,50,13,0,0,...) at sleepq_timedwait+0x48/frame 0xfb660904 _sleep(c3cd4000,caebe784,50,c10d0579,ffffe8e0,...) at _sleep+0x345/frame 0xfb660960 swap_pager_getpages(caebe784,fb660a2c,1,0,fb660b04,...) at swap_pager_getpages+0x4a3/frame 0xfb6609c0 vm_fault_hold(ca6169f8,281b5000,1,0,0,...) at vm_fault_hold+0xa21/frame 0xfb660b20 vm_fault(ca6169f8,281b5000,1,0,ca6169f8,...) at vm_fault+0x82/frame 0xfb660b48 trap_pfault(281b5010,fb660d08,c1250980,ca738edc,fb660bec,...) at trap_pfault+0x1ba/frame 0xfb660bc0 trap(fb660d08) at trap+0x5da/frame 0xfb660cfc calltrap() at calltrap+0x6/frame 0xfb660cfc --- trap 0xc, eip = 0x28189d9b, esp = 0xbfbfd050, ebp = 0xbfbfd56c --- Tracing command creat pid 41603 tid 100516 td 0xc8b0f000 sched_switch(c8b0f000,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfbb978a4 mi_switch(104,0,c109b989,1f5,162,...) at mi_switch+0x1c9/frame 0xfbb978d8 sleepq_switch(c8b0f000,0,c109b989,26b,c8b0f000,...) at sleepq_switch+0x1b9/frame 0xfbb9790c sleepq_wait(c3cd4000,54,c10d1012,0,0,...) at sleepq_wait+0x48/frame 0xfbb97930 _sleep(c3cd4000,caebe784,54,c10d1012,0,0,0,0,100) at _sleep+0x37c/frame 0xfbb9798c vm_page_sleep(c3cd4000,c10d1012,0,176,fbb97b04,...) at vm_page_sleep+0xc0/frame 0xfbb979c0 vm_fault_hold(c76cf000,281b5000,1,0,0,...) at vm_fault_hold+0xf06/frame 0xfbb97b20 vm_fault(c76cf000,281b5000,1,0,c76cf000,...) at vm_fault+0x82/frame 0xfbb97b48 trap_pfault(281b5010,fbb97d08,0,2,400800c,...) at trap_pfault+0x1ba/frame 0xfbb97bc0 trap(fbb97d08) at trap+0x5da/frame 0xfbb97cfc calltrap() at calltrap+0x6/frame 0xfbb97cfc --- trap 0xc, eip = 0x28189d9b, esp = 0xbfbfd050, ebp = 0xbfbfd56c --- Tracing command creat pid 41601 tid 100253 td 0xca738c00 sched_switch(ca738c00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb78f8a4 mi_switch(104,0,c109b989,1f5,162,...) at mi_switch+0x1c9/frame 0xfb78f8d8 sleepq_switch(ca738c00,0,c109b989,26b,ca738c00,...) at sleepq_switch+0x1b9/frame 0xfb78f90c sleepq_wait(c3cd4000,54,c10d1012,0,0,...) at sleepq_wait+0x48/frame 0xfb78f930 _sleep(c3cd4000,caebe784,54,c10d1012,0,0,0,0,100) at _sleep+0x37c/frame 0xfb78f98c vm_page_sleep(c3cd4000,c10d1012,0,176,fb78fb04,...) at vm_page_sleep+0xc0/frame 0xfb78f9c0 vm_fault_hold(cb162d98,281b5000,1,0,0,...) at vm_fault_hold+0xf06/frame 0xfb78fb20 vm_fault(cb162d98,281b5000,1,0,cb162d98,...) at vm_fault+0x82/frame 0xfb78fb48 trap_pfault(281b5010,fb78fd08,420c84c,0,ca738c00,...) at trap_pfault+0x1ba/frame 0xfb78fbc0 trap(fb78fd08) at trap+0x5da/frame 0xfb78fcfc calltrap() at calltrap+0x6/frame 0xfb78fcfc --- trap 0xc, eip = 0x28189d9b, esp = 0xbfbfd050, ebp = 0xbfbfd56c --- Tracing command swap pid 41599 tid 100431 td 0xc9f70000 Tracing command creat pid 41598 tid 100382 td 0xcb2fd300 sched_switch(cb2fd300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb96f878 mi_switch(104,0,c109b989,1f5,101,...) at mi_switch+0x1c9/frame 0xfb96f8ac sleepq_switch(cb2fd300,0,c109b989,28e,cb2fd300,...) at sleepq_switch+0x1b9/frame 0xfb96f8e0 sleepq_timedwait(c4a50dc0,50,13,0,0,...) at sleepq_timedwait+0x48/frame 0xfb96f904 _sleep(c4a50dc0,ca6a5818,50,c10d0579,ffffe8e0,...) at _sleep+0x345/frame 0xfb96f960 swap_pager_getpages(ca6a5818,fb96fa2c,1,0,fb96fb04,...) at swap_pager_getpages+0x4a3/frame 0xfb96f9c0 vm_fault_hold(c836f828,28062000,1,0,0,...) at vm_fault_hold+0xa21/frame 0xfb96fb20 vm_fault(c836f828,28062000,1,0,c836f828,...) at vm_fault+0x82/frame 0xfb96fb48 trap_pfault(28062224,fb96fd08,0,2,400880c,...) at trap_pfault+0x1ba/frame 0xfb96fbc0 trap(fb96fd08) at trap+0x5da/frame 0xfb96fcfc calltrap() at calltrap+0x6/frame 0xfb96fcfc --- trap 0xc, eip = 0x2804f44b, esp = 0xbfbfd560, ebp = 0xbfbfd5d4 --- Tracing command creat pid 41596 tid 100441 td 0xc978cc00 sched_switch(c978cc00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfbab6394 mi_switch(104,0,c109b989,1f5,1,...) at mi_switch+0x1c9/frame 0xfbab63c8 sleepq_switch(c978cc00,0,c109b989,1ab,8,...) at sleepq_switch+0x1b9/frame 0xfbab63fc sleepq_catch_signals(c0ae0150,c978cc00,1,101,1,...) at sleepq_catch_signals+0x3a1/frame 0xfbab6444 sleepq_timedwait_sig(caddfa00,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xfbab646c _sleep(caddfa00,cb72d700,100,c107e28c,402e57,...) at _sleep+0x331/frame 0xfbab64c8 clnt_vc_call(c7cdd060,fbab6678,3,c8485900,fbab6740,...) at clnt_vc_call+0x67e/frame 0xfbab65a0 clnt_reconnect_call(c7c0f0a0,fbab6678,3,c8485900,fbab6740,...) at clnt_reconnect_call+0x506/frame 0xfbab6608 newnfs_request(fbab6740,cd05a000,0,cd05a110,ca2e62d0,c978cc00,c7d71680,186a3,3,0,1,0,0) at newnfs_request+0x77b/frame 0xfbab66c8 nfscl_request(fbab6740,ca2e62d0,c978cc00,c7d71680,0,...) at nfscl_request+0x8c/frame 0xfbab6710 nfsrpc_lookup(ca2e62d0,c8d73000,c,c7d71680,c978cc00,...) at nfsrpc_lookup+0x1e9/frame 0xfbab67e0 nfs_lookup(fbab6a58,c10f3df1,400400,c10a59f3,2bc,...) at nfs_lookup+0x50d/frame 0xfbab69f0 VOP_LOOKUP_APV(c11bb6b8,fbab6a58,c10a59f3,2bc,ca2e6370,...) at VOP_LOOKUP_APV+0x124/frame 0xfbab6a20 lookup(fbab6b88,c10a59f3,107,ce,200,...) at lookup+0x52e/frame 0xfbab6a80 namei(fbab6b88,ffffffdf,cf6c7708,fbab6bd4,fbab6ba8,...) at namei+0x47d/frame 0xfbab6b08 kern_unlinkat(c978cc00,ffffff9c,bfbfd610,0,0) at kern_unlinkat+0xac/frame 0xfbab6c24 sys_unlink(c978cc00,fbab6cc8,7b3,13e,fbab6cc4,...) at sys_unlink+0x32/frame 0xfbab6c40 syscall(fbab6d08) at syscall+0x2ed/frame 0xfbab6cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfbab6cfc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28187183, esp = 0xbfbfd5fc, ebp = 0xbfbfd6a0 --- Tracing command creat pid 41594 tid 100142 td 0xca45f900 sched_switch(ca45f900,0,103,1b0,0,...) at sched_switch+0x4b4/frame 0xfb5fa85c mi_switch(103,0,c109c55c,2e6,1a75,...) at mi_switch+0x1c9/frame 0xfb5fa890 turnstile_wait(c9629e80,cbbee600,0,11112,0,...) at turnstile_wait+0x3b4/frame 0xfb5fa8c0 __rw_wlock_hard(c13d1a90,ca45f900,c10ec202,d66,0,...) at __rw_wlock_hard+0x343/frame 0xfb5fa93c _rw_wlock_cookie(c13d1a90,c10ec202,d66,c10d00e0,ca45f900,...) at _rw_wlock_cookie+0xdd/frame 0xfb5fa96c pmap_enter(c91ecb90,bfbfc000,2,c4c18f80,7,...) at pmap_enter+0x7b/frame 0xfb5fa9c0 vm_fault_hold(c91ecae0,bfbfc000,2,0,0,...) at vm_fault_hold+0x1a57/frame 0xfb5fab20 vm_fault(c91ecae0,bfbfc000,2,0,c91ecae0,...) at vm_fault+0x82/frame 0xfb5fab48 trap_pfault(bfbfcfac,fb5fad08,0,2,400800c,...) at trap_pfault+0x1ba/frame 0xfb5fabc0 trap(fb5fad08) at trap+0x5da/frame 0xfb5facfc calltrap() at calltrap+0x6/frame 0xfb5facfc --- trap 0xc, eip = 0x2819a3df, esp = 0xbfbfcfb0, ebp = 0xbfbfd034 --- Tracing command mkdir pid 41593 tid 100512 td 0xc8b0fc00 sched_switch(c8b0fc00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfbb8b878 mi_switch(104,0,c109b989,1f5,101,...) at mi_switch+0x1c9/frame 0xfbb8b8ac sleepq_switch(c8b0fc00,0,c109b989,28e,c8b0fc00,...) at sleepq_switch+0x1b9/frame 0xfbb8b8e0 sleepq_timedwait(c31bf240,50,13,0,0,...) at sleepq_timedwait+0x48/frame 0xfbb8b904 _sleep(c31bf240,cd570000,50,c10d0579,ffffe8e0,...) at _sleep+0x345/frame 0xfbb8b960 swap_pager_getpages(cd570000,fbb8ba2c,1,0,fbb8bb04,...) at swap_pager_getpages+0x4a3/frame 0xfbb8b9c0 vm_fault_hold(c91dd910,28065000,2,0,0,...) at vm_fault_hold+0xa21/frame 0xfbb8bb20 vm_fault(c91dd910,28065000,2,0,c91dd910,...) at vm_fault+0x82/frame 0xfbb8bb48 trap_pfault(28065000,fbb8bd08,ffffffff,ffffffff,ffffffff,...) at trap_pfault+0x1ba/frame 0xfbb8bbc0 trap(fbb8bd08) at trap+0x5da/frame 0xfbb8bcfc calltrap() at calltrap+0x6/frame 0xfbb8bcfc --- trap 0xc, eip = 0x280561b4, esp = 0xbfbe2dfc, ebp = 0xbfbe2e10 --- Tracing command creat pid 41591 tid 100271 td 0xca784c00 sched_switch(ca784c00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb7cf878 mi_switch(104,0,c109b989,1f5,101,...) at mi_switch+0x1c9/frame 0xfb7cf8ac sleepq_switch(ca784c00,0,c109b989,28e,ca784c00,...) at sleepq_switch+0x1b9/frame 0xfb7cf8e0 sleepq_timedwait(c4256700,50,13,0,0,...) at sleepq_timedwait+0x48/frame 0xfb7cf904 _sleep(c4256700,c8d5c65c,50,c10d0579,ffffe8e0,...) at _sleep+0x345/frame 0xfb7cf960 swap_pager_getpages(c8d5c65c,fb7cfa2c,1,0,fb7cfb04,...) at swap_pager_getpages+0x4a3/frame 0xfb7cf9c0 vm_fault_hold(c8a073a0,bfbfc000,2,0,0,...) at vm_fault_hold+0xa21/frame 0xfb7cfb20 vm_fault(c8a073a0,bfbfc000,2,0,c8a073a0,...) at vm_fault+0x82/frame 0xfb7cfb48 trap_pfault(bfbfcfac,fb7cfd08,0,2,400880c,...) at trap_pfault+0x1ba/frame 0xfb7cfbc0 trap(fb7cfd08) at trap+0x5da/frame 0xfb7cfcfc calltrap() at calltrap+0x6/frame 0xfb7cfcfc --- trap 0xc, eip = 0x2819a3df, esp = 0xbfbfcfb0, ebp = 0xbfbfd034 --- Tracing command mkdir pid 41590 tid 100507 td 0xc8b17c00 sched_switch(c8b17c00,0,103,1b0,0,...) at sched_switch+0x4b4/frame 0xfbb7c85c mi_switch(103,0,c109c55c,2e6,1a75,...) at mi_switch+0x1c9/frame 0xfbb7c890 turnstile_wait(c9629e80,cbbee600,0,96,0,...) at turnstile_wait+0x3b4/frame 0xfbb7c8c0 __rw_wlock_hard(c13d1a90,c8b17c00,c10ec202,d66,0,...) at __rw_wlock_hard+0x343/frame 0xfbb7c93c _rw_wlock_cookie(c13d1a90,c10ec202,d66,fbb7c9a8,c8b17c00,...) at _rw_wlock_cookie+0xdd/frame 0xfbb7c96c pmap_enter(c87e0b90,28062000,1,c2f07100,3,...) at pmap_enter+0x7b/frame 0xfbb7c9c0 vm_fault_hold(c87e0ae0,28062000,1,0,0,...) at vm_fault_hold+0x1a57/frame 0xfbb7cb20 vm_fault(c87e0ae0,28062000,1,0,c87e0ae0,...) at vm_fault+0x82/frame 0xfbb7cb48 trap_pfault(28062224,fbb7cd08,1,c8d7ec04,0,...) at trap_pfault+0x1ba/frame 0xfbb7cbc0 trap(fbb7cd08) at trap+0x5da/frame 0xfbb7ccfc calltrap() at calltrap+0x6/frame 0xfbb7ccfc --- trap 0xc, eip = 0x2804f44b, esp = 0xbfbd7310, ebp = 0xbfbd7388 --- Tracing command mkdir pid 41588 tid 100205 td 0xca5c5600 sched_switch(ca5c5600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb6b75b4 mi_switch(104,0,c109b989,1f5,1,...) at mi_switch+0x1c9/frame 0xfb6b75e8 sleepq_switch(ca5c5600,0,c109b989,1ab,8,...) at sleepq_switch+0x1b9/frame 0xfb6b761c sleepq_catch_signals(c0ae0150,ca5c5600,1,101,1,...) at sleepq_catch_signals+0x3a1/frame 0xfb6b7664 sleepq_timedwait_sig(cb4b7000,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xfb6b768c _sleep(cb4b7000,cb72d700,100,c107e28c,402e57,...) at _sleep+0x331/frame 0xfb6b76e8 clnt_vc_call(c7cdd060,fb6b7898,4,cc124a00,fb6b7960,...) at clnt_vc_call+0x67e/frame 0xfb6b77c0 clnt_reconnect_call(c7c0f0a0,fb6b7898,4,cc124a00,fb6b7960,...) at clnt_reconnect_call+0x506/frame 0xfb6b7828 newnfs_request(fb6b7960,cd05a000,0,cd05a110,cf9eb168,ca5c5600,c7d71680,186a3,3,0,1,0,0) at newnfs_request+0x77b/frame 0xfb6b78e8 nfscl_request(fb6b7960,cf9eb168,ca5c5600,c7d71680,0,...) at nfscl_request+0x8c/frame 0xfb6b7930 nfsrpc_accessrpc(cf9eb168,3f,c7d71680,ca5c5600,fb6b7a30,...) at nfsrpc_accessrpc+0xe1/frame 0xfb6b7a00 nfs34_access_otw(ca5c5600,c7d71680,fb6b7b28,1ae,c1250280,...) at nfs34_access_otw+0x5c/frame 0xfb6b7ad8 nfs_access(fb6b7c08,c10f402a,c10c88f9,cbb0a5a0,c1206530,...) at nfs_access+0x383/frame 0xfb6b7b40 VOP_ACCESS_APV(c11bb6b8,fb6b7c08,c9224c00,4,0,...) at VOP_ACCESS_APV+0x124/frame 0xfb6b7b70 kern_chdir(ca5c5600,bfbde3ff,0) at kern_chdir+0x13a/frame 0xfb6b7c2c sys_chdir(ca5c5600,fb6b7cc8,14,c10982d9,7b3,...) at sys_chdir+0x22/frame 0xfb6b7c40 syscall(fb6b7d08) at syscall+0x2ed/frame 0xfb6b7cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb6b7cfc --- syscall (12, FreeBSD ELF32, sys_chdir), eip = 0x280d4747, esp = 0xbfbddfc0, ebp = 0xbfbde3e4 --- Tracing command creat pid 41587 tid 100244 td 0xca694900 sched_switch(ca694900,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb77172c mi_switch(104,0,c109b989,1f5,162,...) at mi_switch+0x1c9/frame 0xfb771760 sleepq_switch(ca694900,0,c109b989,26b,60,...) at sleepq_switch+0x1b9/frame 0xfb771794 sleepq_wait(cd88246c,60,c107ff76,4,1,...) at sleepq_wait+0x48/frame 0xfb7717b8 sleeplk(cd8824d8,c107ff76,60,33,1,...) at sleeplk+0x126/frame 0xfb771800 __lockmgr_args(cd88246c,200400,cd8824d8,0,0,0,c10a59f3,205) at __lockmgr_args+0x612/frame 0xfb7718e0 nfs_lock1(fb771958,ca694900,cc9ac8a4,c10a565b,fb771a08,...) at nfs_lock1+0x9c/frame 0xfb771910 VOP_LOCK1_APV(c11bb6b8,fb771958,0,c11ca0a4,c1209068,...) at VOP_LOCK1_APV+0x112/frame 0xfb771940 _vn_lock(cd882438,200400,c10a59f3,205,cd8824d8,...) at _vn_lock+0xca/frame 0xfb771980 lookup(fb771b80,c10a59f3,107,ce,c11ca0a4,...) at lookup+0xf7/frame 0xfb7719e0 namei(fb771b80,c809c000,ca694900,c809c010,c809c000,...) at namei+0x47d/frame 0xfb771a68 vn_open_cred(fb771b80,fb771bfc,1b0,0,c7d71680,c7db1578) at vn_open_cred+0x91/frame 0xfb771b38 vn_open(fb771b80,fb771bfc,1b0,c7db1578,fb771bd8,...) at vn_open+0x3b/frame 0xfb771b58 kern_openat(ca694900,ffffff9c,bfbfd610,0,601,1b0) at kern_openat+0x1ec/frame 0xfb771c20 sys_open(ca694900,fb771cc8,7b3,0,fb771cc4,...) at sys_open+0x38/frame 0xfb771c40 syscall(fb771d08) at syscall+0x2ed/frame 0xfb771cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb771cfc --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x28192e87, esp = 0xbfbfd5e4, ebp = 0xbfbfd5f8 --- Tracing command creat pid 41583 tid 100514 td 0xc8b0f600 Tracing command mkdir pid 41582 tid 100247 td 0xca460600 sched_switch(ca460600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb77b878 mi_switch(104,0,c109b989,1f5,101,...) at mi_switch+0x1c9/frame 0xfb77b8ac sleepq_switch(ca460600,0,c109b989,28e,ca460600,...) at sleepq_switch+0x1b9/frame 0xfb77b8e0 sleepq_timedwait(c3d64300,50,13,0,0,...) at sleepq_timedwait+0x48/frame 0xfb77b904 _sleep(c3d64300,ca7fbafc,50,c10d0579,ffffe8e0,...) at _sleep+0x345/frame 0xfb77b960 swap_pager_getpages(ca7fbafc,fb77ba2c,2,0,fb77bb04,...) at swap_pager_getpages+0x4a3/frame 0xfb77b9c0 vm_fault_hold(c964a658,28066000,1,0,0,...) at vm_fault_hold+0xa21/frame 0xfb77bb20 vm_fault(c964a658,28066000,1,0,c964a658,...) at vm_fault+0x82/frame 0xfb77bb48 trap_pfault(2806607c,fb77bd08,1,c8907803,0,...) at trap_pfault+0x1ba/frame 0xfb77bbc0 trap(fb77bd08) at trap+0x5da/frame 0xfb77bcfc calltrap() at calltrap+0x6/frame 0xfb77bcfc --- trap 0xc, eip = 0x2804f493, esp = 0xbfbe57a8, ebp = 0xbfbe5820 --- Tracing command mkdir pid 41580 tid 100168 td 0xc7e08c00 sched_switch(c7e08c00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb648878 mi_switch(104,0,c109b989,1f5,101,...) at mi_switch+0x1c9/frame 0xfb6488ac sleepq_switch(c7e08c00,0,c109b989,28e,c7e08c00,...) at sleepq_switch+0x1b9/frame 0xfb6488e0 sleepq_timedwait(c54ed840,50,13,0,0,...) at sleepq_timedwait+0x48/frame 0xfb648904 _sleep(c54ed840,c954e9d4,50,c10d0579,ffffe8e0,...) at _sleep+0x345/frame 0xfb648960 swap_pager_getpages(c954e9d4,fb648a2c,1,0,fb648b04,...) at swap_pager_getpages+0x4a3/frame 0xfb6489c0 vm_fault_hold(c8ed7828,28065000,2,0,0,...) at vm_fault_hold+0xa21/frame 0xfb648b20 vm_fault(c8ed7828,28065000,2,0,c8ed7828,...) at vm_fault+0x82/frame 0xfb648b48 trap_pfault(28065000,fb648d08,1,cbb68404,0,...) at trap_pfault+0x1ba/frame 0xfb648bc0 trap(fb648d08) at trap+0x5da/frame 0xfb648cfc calltrap() at calltrap+0x6/frame 0xfb648cfc --- trap 0xc, eip = 0x280561b4, esp = 0xbfbe0894, ebp = 0xbfbe08a8 --- Tracing command mkdir pid 41575 tid 100254 td 0xca5c8c00 Tracing command mmap pid 41574 tid 100207 td 0xca5c5000 sched_switch(ca5c5000,0,602,1b0,fb6bd6ac,...) at sched_switch+0x4b4/frame 0xfb6bd688 mi_switch(602,0,c10963d4,d3,ca5c5000,...) at mi_switch+0x1c9/frame 0xfb6bd6bc critical_exit(ca5c5000,0,1) at critical_exit+0xa3/frame 0xfb6bd6d8 ipi_bitmap_handler(8,28,28,c7d71680,fb6bd8e4,...) at ipi_bitmap_handler+0x6b/frame 0xfb6bd6f8 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x2f/frame 0xfb6bd6f8 --- interrupt, eip = 0xc0d3fb5c, esp = 0xfb6bd740, ebp = 0xfb6bd768 --- vnode_pager_undirty_pages(fb6bd8e4,fb6bd8a0,a60,fb6bd7c4,fb6bd7c0,...) at vnode_pager_undirty_pages+0x1c/frame 0xfb6bd768 ncl_putpages(fb6bd850,c10f4b00,c10d4e8b,421,cabf5708,...) at ncl_putpages+0x380/frame 0xfb6bd808 VOP_PUTPAGES_APV(c11bb6b8,fb6bd850,421,5000,c120a1a8,...) at VOP_PUTPAGES_APV+0x12a/frame 0xfb6bd838 vnode_pager_putpages(cd2c3de0,fb6bd8e4,1,8,fb6bd8a0) at vnode_pager_putpages+0x94/frame 0xfb6bd884 vm_pageout_flush(fb6bd8e4,1,8,0,fb6bd938,fb6bd994) at vm_pageout_flush+0x131/frame 0xfb6bd8c4 vm_object_page_collect_flush(8,0,fb6bd998,fb6bd994,c1251090,...) at vm_object_page_collect_flush+0x1d6/frame 0xfb6bd94c vm_object_page_clean(cd2c3de0,0,0,0,0,...) at vm_object_page_clean+0x189/frame 0xfb6bd9a8 nfs_close(fb6bdac8,c10f3fdc,80400,c10a7f48,16d,...) at nfs_close+0xe8/frame 0xfb6bda78 VOP_CLOSE_APV(c11bb6b8,fb6bdac8,c10a7f48,16d,80400,...) at VOP_CLOSE_APV+0x124/frame 0xfb6bdaa8 vn_close(cabf5708,3,c7d71680,ca5c5000,a05,...) at vn_close+0x155/frame 0xfb6bdaf0 vn_closefile(cd0a6000,ca5c5000,c99d2f10,0,ca5c5000,...) at vn_closefile+0x53/frame 0xfb6bdb54 _fdrop(cd0a6000,ca5c5000,b3b,cd2c3df0,c1bb6b00,...) at _fdrop+0x2c/frame 0xfb6bdb70 closef(cd0a6000,ca5c5000,46e,453,0,...) at closef+0x203/frame 0xfb6bdbd8 closefp(cd0a6000,ca5c5000,1,b3,c9454c00,...) at closefp+0xb5/frame 0xfb6bdc04 kern_close(ca5c5000,4) at kern_close+0xfb/frame 0xfb6bdc30 sys_close(ca5c5000,fb6bdcc8,c0ebf800,c7200c90,0,...) at sys_close+0x1a/frame 0xfb6bdc40 syscall(fb6bdd08) at syscall+0x2ed/frame 0xfb6bdcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb6bdcfc --- syscall (6, FreeBSD ELF32, sys_close), eip = 0x2819bc87, esp = 0xbfbfd574, ebp = 0xbfbfd6a0 --- Tracing command mmap pid 41573 tid 100183 td 0xca5be900 cpustop_handler(1,13,fb6755a8,c0eb7b0b,c1250290,...) at cpustop_handler+0x2f/frame 0xfb675458 ipi_nmi_handler(c1250290,1,40edf1,0,0,...) at ipi_nmi_handler+0x37/frame 0xfb675468 trap(fb6755b4) at trap+0x3b/frame 0xfb6755a8 calltrap() at calltrap+0x6/frame 0xfb6755a8 --- trap 0x13, eip = 0xc0ec9f62, esp = 0xfb6755f4, ebp = 0xfb67562c --- DELAY(4,c123b0b4,c1240e8c,c11b57e0,fb675660,...) at DELAY+0x1b2/frame 0xfb67562c ns8250_putc(c123b0bc,23,c106ac62,5c,23,...) at ns8250_putc+0x8c/frame 0xfb675644 uart_cnputc(c11b57e0,23,fb675821,1,a,...) at uart_cnputc+0x56/frame 0xfb675660 cnputc(23,0,c108dcc7,1f4,fb675800,...) at cnputc+0x6c/frame 0xfb67567c cnputs(fb675820,ffffffff,fb675820,1,8,...) at cnputs+0x5b/frame 0xfb67569c putchar(a,fb675800,10,0,498a871,...) at putchar+0x131/frame 0xfb67570c kvprintf(c109c1ee,c0ad96c0,fb675800,a,fb6758cc,...) at kvprintf+0xda/frame 0xfb6757e0 vprintf(c109c1ee,fb6758cc,fb6758cc) at vprintf+0x7f/frame 0xfb6758ac printf(c109c1ee,7,c0eb8f1d,c1679c06,2ed,...) at printf+0x1b/frame 0xfb6758c0 stack_print_ddb(c9ebe8c4,c107ff76,ca5be900,a265,ca59edb4,18757) at stack_print_ddb+0xaf/frame 0xfb675904 lockmgr_printinfo(c9ebe8a4,cb5a21bc,0,5,0,...) at lockmgr_printinfo+0xcc/frame 0xfb675930 vn_printf(c9ebe870,c10a4d4c,c10a65af,8cf,fb675ac8,...) at vn_printf+0x4a3/frame 0xfb675a80 vputx(c9ebe870,fb675b98,5000,5e3,fb675c18,...) at vputx+0x446/frame 0xfb675ac8 vm_mmap(c7d37658,fb675c18,5000,3,7,...) at vm_mmap+0x828/frame 0xfb675bc0 sys_mmap(ca5be900,fb675cc8,c0ebf800,c1825c90,0,...) at sys_mmap+0x2f0/frame 0xfb675c40 syscall(fb675d08) at syscall+0x2ed/frame 0xfb675cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb675cfc --- syscall (477, FreeBSD ELF32, sys_mmap), eip = 0x280fee9f, esp = 0xbfbfd574, ebp = 0xbfbfd6a0 --- Tracing command fts pid 41571 tid 100364 td 0xc844d600 sched_switch(c844d600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb91047c mi_switch(104,0,c109b989,1f5,162,...) at mi_switch+0x1c9/frame 0xfb9104b0 sleepq_switch(c844d600,0,c109b989,26b,60,...) at sleepq_switch+0x1b9/frame 0xfb9104e4 sleepq_wait(cd88246c,60,c107ff76,4,1,...) at sleepq_wait+0x48/frame 0xfb910508 sleeplk(cd8824d8,c107ff76,60,33,1,...) at sleeplk+0x126/frame 0xfb910550 __lockmgr_args(cd88246c,200100,cd8824d8,0,0,0,c10a65af,881) at __lockmgr_args+0x612/frame 0xfb910630 nfs_lock1(fb9106a8,0,c9b80100,0,0,...) at nfs_lock1+0x9c/frame 0xfb910660 VOP_LOCK1_APV(c11bb6b8,fb9106a8,c9b80100,c9b80300,c1209068,...) at VOP_LOCK1_APV+0x112/frame 0xfb910690 _vn_lock(cd882438,200100,c10a65af,881,c10a5825,...) at _vn_lock+0xca/frame 0xfb9106d0 vget(cd882438,200100,c844d600,57,0,...) at vget+0x77/frame 0xfb910708 vfs_hash_get(c809c000,88207676,200000,c844d600,fb910770,...) at vfs_hash_get+0xff/frame 0xfb910734 nfscl_nget(c809c000,cb8799d8,c95ac7c0,fb910b74,c844d600,...) at nfscl_nget+0x92/frame 0xfb910780 nfs_lookup(fb9109f8,c10f3df1,c10c89ed,c10a59f3,c1206530,...) at nfs_lookup+0x971/frame 0xfb910990 VOP_LOOKUP_APV(c11bb6b8,fb9109f8,fb910b74,205,cb879a78,...) at VOP_LOOKUP_APV+0x124/frame 0xfb9109c0 lookup(fb910b28,c10a59f3,107,ce,cd88246c,...) at lookup+0x52e/frame 0xfb910a20 namei(fb910b28,c844d600,c1251080,0,fb910b2c,...) at namei+0x47d/frame 0xfb910aa8 kern_statat_vnhook(c844d600,0,ffffff9c,2881f100,0,...) at kern_statat_vnhook+0xb6/frame 0xfb910bb0 sys_stat(c844d600,fb910cc8,7b3,0,fb910cc4,...) at sys_stat+0x4d/frame 0xfb910c40 syscall(fb910d08) at syscall+0x2ed/frame 0xfb910cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb910cfc --- syscall (188, FreeBSD ELF32, sys_stat), eip = 0x28188be3, esp = 0xbfbfd55c, ebp = 0xbfbfd5e8 --- Tracing command fts pid 41570 tid 100426 td 0xc9f73000 sched_switch(c9f73000,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfba89494 mi_switch(104,0,c109b989,1f5,162,...) at mi_switch+0x1c9/frame 0xfba894c8 sleepq_switch(c9f73000,0,c109b989,26b,60,...) at sleepq_switch+0x1b9/frame 0xfba894fc sleepq_wait(cd88246c,60,c107ff76,4,1,...) at sleepq_wait+0x48/frame 0xfba89520 sleeplk(cd8824d8,c107ff76,60,33,1,...) at sleeplk+0x126/frame 0xfba89568 __lockmgr_args(cd88246c,200100,cd8824d8,0,0,0,c10a65af,881) at __lockmgr_args+0x612/frame 0xfba89648 nfs_lock1(fba896c0,80000000,14c0,0,1,...) at nfs_lock1+0x9c/frame 0xfba89678 VOP_LOCK1_APV(c11bb6b8,fba896c0,0,c0a895d7,c1209068,...) at VOP_LOCK1_APV+0x112/frame 0xfba896a8 _vn_lock(cd882438,200100,c10a65af,881,2a1,...) at _vn_lock+0xca/frame 0xfba896e8 vget(cd882438,200100,c9f73000,29d,c1206530,...) at vget+0x77/frame 0xfba89720 cache_lookup(cb8799d8,fba89b60,fba89b74,fba897d0,fba89950,...) at cache_lookup+0x5a8/frame 0xfba89780 nfs_lookup(fba899f8,c10f3df1,c10c89ed,c10a59f3,c1206530,...) at nfs_lookup+0x1d1/frame 0xfba89990 VOP_LOOKUP_APV(c11bb6b8,fba899f8,fba89b74,205,cb879a78,...) at VOP_LOOKUP_APV+0x124/frame 0xfba899c0 lookup(fba89b28,c10a59f3,107,ce,200,...) at lookup+0x52e/frame 0xfba89a20 namei(fba89b28,ffffffdf,c7d71680,0,c9f73000,...) at namei+0x47d/frame 0xfba89aa8 kern_statat_vnhook(c9f73000,0,ffffff9c,2881d100,0,...) at kern_statat_vnhook+0xb6/frame 0xfba89bb0 sys_stat(c9f73000,fba89cc8,8,c10963d4,db,...) at sys_stat+0x4d/frame 0xfba89c40 syscall(fba89d08) at syscall+0x2ed/frame 0xfba89cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfba89cfc --- syscall (188, FreeBSD ELF32, sys_stat), eip = 0x28188be3, esp = 0xbfbfd55c, ebp = 0xbfbfd5e8 --- Tracing command fts pid 41569 tid 100524 td 0xcbbf9000 sched_switch(cbbf9000,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfbbbc878 mi_switch(104,0,c109b989,1f5,101,...) at mi_switch+0x1c9/frame 0xfbbbc8ac sleepq_switch(cbbf9000,0,c109b989,28e,cbbf9000,...) at sleepq_switch+0x1b9/frame 0xfbbbc8e0 sleepq_timedwait(c3cd4200,50,13,0,0,...) at sleepq_timedwait+0x48/frame 0xfbbbc904 _sleep(c3cd4200,cab04094,50,c10d0579,ffffe8e0,...) at _sleep+0x345/frame 0xfbbbc960 swap_pager_getpages(cab04094,fbbbca2c,1,0,fbbbcb04,...) at swap_pager_getpages+0x4a3/frame 0xfbbbc9c0 vm_fault_hold(c9e0f570,28836000,1,0,0,...) at vm_fault_hold+0xa21/frame 0xfbbbcb20 vm_fault(c9e0f570,28836000,1,0,c9e0f570,...) at vm_fault+0x82/frame 0xfbbbcb48 trap_pfault(28836058,fbbbcd08,c8afd828,c8ed5dc8,fbbbcc04,...) at trap_pfault+0x1ba/frame 0xfbbbcbc0 trap(fbbbcd08) at trap+0x5da/frame 0xfbbbccfc calltrap() at calltrap+0x6/frame 0xfbbbccfc --- trap 0xc, eip = 0x281971f2, esp = 0xbfbfd65c, ebp = 0xbfbfd688 --- Tracing command mmap pid 41568 tid 100485 td 0xc8af6c00 sched_switch(c8af6c00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfbb3a8a0 mi_switch(104,0,c109b989,1f5,162,...) at mi_switch+0x1c9/frame 0xfbb3a8d4 sleepq_switch(c8af6c00,0,c109b989,26b,c8af6c00,...) at sleepq_switch+0x1b9/frame 0xfbb3a908 sleepq_wait(c5304d40,54,c10d27b6,0,0,...) at sleepq_wait+0x48/frame 0xfbb3a92c _sleep(c5304d40,c8c32e74,54,c10d27b6,0,0,0,0,100) at _sleep+0x37c/frame 0xfbb3a988 vm_page_sleep(c5304d40,c10d27b6,0,336,0,...) at vm_page_sleep+0xc0/frame 0xfbb3a9bc vm_object_page_clean(c8c32e74,0,0,0,0,...) at vm_object_page_clean+0x1f0/frame 0xfbb3aa18 vinactive(cb2af5a0,c8af6c00,c10a65af,8cf,cb2af650,...) at vinactive+0x143/frame 0xfbb3aa60 vputx(cb2af5a0,fbb3aac8,c10a7f48,16d,80400,...) at vputx+0x38a/frame 0xfbb3aaa8 vn_close(cb2af5a0,3,c7d71680,c8af6c00,a05,...) at vn_close+0x15f/frame 0xfbb3aaf0 vn_closefile(c7d4f508,c8af6c00,a3f,0,c8af6c00,...) at vn_closefile+0x53/frame 0xfbb3ab54 _fdrop(c7d4f508,c8af6c00,a3f,c8c32e84,c7ae9000,...) at _fdrop+0x2c/frame 0xfbb3ab70 closef(c7d4f508,c8af6c00,46e,453,0,...) at closef+0x203/frame 0xfbb3abd8 closefp(c7d4f508,c8af6c00,1,b3,cc1c1400,...) at closefp+0xb5/frame 0xfbb3ac04 kern_close(c8af6c00,4) at kern_close+0xfb/frame 0xfbb3ac30 sys_close(c8af6c00,fbb3acc8,7b3,0,fbb3acc4,...) at sys_close+0x1a/frame 0xfbb3ac40 syscall(fbb3ad08) at syscall+0x2ed/frame 0xfbb3acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfbb3acfc --- syscall (6, FreeBSD ELF32, sys_close), eip = 0x2819bc87, esp = 0xbfbfd574, ebp = 0xbfbfd6a0 --- Tracing command fts pid 41567 tid 100406 td 0xc9215600 sched_switch(c9215600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfba4d2cc mi_switch(104,0,c109b989,1f5,3,...) at mi_switch+0x1c9/frame 0xfba4d300 sleepq_switch(c9215600,0,c109b989,1ab,8,...) at sleepq_switch+0x1b9/frame 0xfba4d334 sleepq_catch_signals(c0ae0150,c9215600,3,101,3,...) at sleepq_catch_signals+0x3a1/frame 0xfba4d37c sleepq_timedwait_sig(c9517c00,0,12c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xfba4d3a4 _sleep(c9517c00,cb72d700,100,c107e28c,402e57,...) at _sleep+0x331/frame 0xfba4d400 clnt_vc_call(c7cdd060,fba4d5b0,10,c862b700,fba4d708,...) at clnt_vc_call+0x67e/frame 0xfba4d4d8 clnt_reconnect_call(c7c0f0a0,fba4d5b0,10,c862b700,fba4d708,...) at clnt_reconnect_call+0x506/frame 0xfba4d540 newnfs_request(fba4d708,cd05a000,0,cd05a110,cd882438,c9215600,c7d71680,186a3,3,0,1,0,0) at newnfs_request+0x77b/frame 0xfba4d600 nfscl_request(fba4d708,cd882438,c9215600,c7d71680,0,...) at nfscl_request+0x8c/frame 0xfba4d648 nfsrpc_readdir(cd882438,fba4d958,fba4d878,c7d71680,c9215600,...) at nfsrpc_readdir+0x352/frame 0xfba4d840 ncl_readdirrpc(cd882438,fba4d958,c7d71680,c9215600,8,...) at ncl_readdirrpc+0x10f/frame 0xfba4d920 ncl_doio(cd882438,e3956b38,c7d71680,c9215600,0,...) at ncl_doio+0x144/frame 0xfba4d998 ncl_bioread(cd882438,fba4dbb8,0,c7d71680,c1095dbc,...) at ncl_bioread+0x9eb/frame 0xfba4da98 nfs_readdir(fba4dbe0,c10f45a8,c10c8a90,c10a7cc8,fbb,...) at nfs_readdir+0x19c/frame 0xfba4db48 VOP_READDIR_APV(c11bb6b8,fba4dbe0,c10a7cc8,fbb,fba4dbdc,...) at VOP_READDIR_APV+0x124/frame 0xfba4db78 kern_getdirentries(c9215600,3,28830000,1000,fba4dc34,...) at kern_getdirentries+0x19e/frame 0xfba4dc10 sys_getdirentries(c9215600,fba4dcc8,2710,6715d5,6740ac,...) at sys_getdirentries+0x41/frame 0xfba4dc40 syscall(fba4dd08) at syscall+0x2ed/frame 0xfba4dcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfba4dcfc --- syscall (196, FreeBSD ELF32, sys_getdirentries), eip = 0x280ecb8b, esp = 0xbfbfd59c, ebp = 0xbfbfd5cc --- Tracing command fts pid 41565 tid 100461 td 0xc8acac00 sched_switch(c8acac00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfbaf247c mi_switch(104,0,c109b989,1f5,162,...) at mi_switch+0x1c9/frame 0xfbaf24b0 sleepq_switch(c8acac00,0,c109b989,26b,60,...) at sleepq_switch+0x1b9/frame 0xfbaf24e4 sleepq_wait(cd88246c,60,c107ff76,4,1,...) at sleepq_wait+0x48/frame 0xfbaf2508 sleeplk(cd8824d8,c107ff76,60,33,1,...) at sleeplk+0x126/frame 0xfbaf2550 __lockmgr_args(cd88246c,200100,cd8824d8,0,0,0,c10a65af,881) at __lockmgr_args+0x612/frame 0xfbaf2630 nfs_lock1(fbaf26a8,0,c87fb000,0,0,...) at nfs_lock1+0x9c/frame 0xfbaf2660 VOP_LOCK1_APV(c11bb6b8,fbaf26a8,c87fb000,0,c1209068,...) at VOP_LOCK1_APV+0x112/frame 0xfbaf2690 _vn_lock(cd882438,200100,c10a65af,881,c10a5825,...) at _vn_lock+0xca/frame 0xfbaf26d0 vget(cd882438,200100,c8acac00,57,0,...) at vget+0x77/frame 0xfbaf2708 vfs_hash_get(c809c000,88207676,200000,c8acac00,fbaf2770,...) at vfs_hash_get+0xff/frame 0xfbaf2734 nfscl_nget(c809c000,cb8799d8,c95ac840,fbaf2b74,c8acac00,...) at nfscl_nget+0x92/frame 0xfbaf2780 nfs_lookup(fbaf29f8,c10f3df1,c10c89ed,c10a59f3,c1206530,...) at nfs_lookup+0x971/frame 0xfbaf2990 VOP_LOOKUP_APV(c11bb6b8,fbaf29f8,fbaf2b74,205,cb879a78,...) at VOP_LOOKUP_APV+0x124/frame 0xfbaf29c0 lookup(fbaf2b28,c10a59f3,107,ce,200,...) at lookup+0x52e/frame 0xfbaf2a20 namei(fbaf2b28,ffffffdf,c7d71680,0,c8acac00,...) at namei+0x47d/frame 0xfbaf2aa8 kern_statat_vnhook(c8acac00,0,ffffff9c,2881d100,0,...) at kern_statat_vnhook+0xb6/frame 0xfbaf2bb0 sys_stat(c8acac00,fbaf2cc8,7b3,0,fbaf2cc4,...) at sys_stat+0x4d/frame 0xfbaf2c40 syscall(fbaf2d08) at syscall+0x2ed/frame 0xfbaf2cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfbaf2cfc --- syscall (188, FreeBSD ELF32, sys_stat), eip = 0x28188be3, esp = 0xbfbfd55c, ebp = 0xbfbfd5e8 --- Tracing command fts pid 41563 tid 100540 td 0xcbbeec00 sched_switch(cbbeec00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfbbec47c mi_switch(104,0,c109b989,1f5,162,...) at mi_switch+0x1c9/frame 0xfbbec4b0 sleepq_switch(cbbeec00,0,c109b989,26b,60,...) at sleepq_switch+0x1b9/frame 0xfbbec4e4 sleepq_wait(cd88246c,60,c107ff76,4,1,...) at sleepq_wait+0x48/frame 0xfbbec508 sleeplk(cd8824d8,c107ff76,60,33,1,...) at sleeplk+0x126/frame 0xfbbec550 __lockmgr_args(cd88246c,200100,cd8824d8,0,0,0,c10a65af,881) at __lockmgr_args+0x612/frame 0xfbbec630 nfs_lock1(fbbec6a8,0,c9ba9400,0,0,...) at nfs_lock1+0x9c/frame 0xfbbec660 VOP_LOCK1_APV(c11bb6b8,fbbec6a8,c9ba9400,c862bc00,c1209068,...) at VOP_LOCK1_APV+0x112/frame 0xfbbec690 _vn_lock(cd882438,200100,c10a65af,881,c10a5825,...) at _vn_lock+0xca/frame 0xfbbec6d0 vget(cd882438,200100,cbbeec00,57,0,...) at vget+0x77/frame 0xfbbec708 vfs_hash_get(c809c000,88207676,200000,cbbeec00,fbbec770,...) at vfs_hash_get+0xff/frame 0xfbbec734 nfscl_nget(c809c000,cb8799d8,c95ac860,fbbecb74,cbbeec00,...) at nfscl_nget+0x92/frame 0xfbbec780 nfs_lookup(fbbec9f8,c10f3df1,c10c89ed,c10a59f3,c1206530,...) at nfs_lookup+0x971/frame 0xfbbec990 VOP_LOOKUP_APV(c11bb6b8,fbbec9f8,fbbecb74,205,cb879a78,...) at VOP_LOOKUP_APV+0x124/frame 0xfbbec9c0 lookup(fbbecb28,c10a59f3,107,ce,cd88246c,...) at lookup+0x52e/frame 0xfbbeca20 namei(fbbecb28,cbbeec00,c1251080,0,fbbecb2c,...) at namei+0x47d/frame 0xfbbecaa8 kern_statat_vnhook(cbbeec00,0,ffffff9c,2881e100,0,...) at kern_statat_vnhook+0xb6/frame 0xfbbecbb0 sys_stat(cbbeec00,fbbeccc8,c0ebf800,c7200c90,0,...) at sys_stat+0x4d/frame 0xfbbecc40 syscall(fbbecd08) at syscall+0x2ed/frame 0xfbbeccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfbbeccfc --- syscall (188, FreeBSD ELF32, sys_stat), eip = 0x28188be3, esp = 0xbfbfd55c, ebp = 0xbfbfd5e8 --- Tracing command fts pid 41561 tid 100211 td 0xca5c2300 sched_switch(ca5c2300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb6c947c mi_switch(104,0,c109b989,1f5,162,...) at mi_switch+0x1c9/frame 0xfb6c94b0 sleepq_switch(ca5c2300,0,c109b989,26b,60,...) at sleepq_switch+0x1b9/frame 0xfb6c94e4 sleepq_wait(cd88246c,60,c107ff76,4,1,...) at sleepq_wait+0x48/frame 0xfb6c9508 sleeplk(cd8824d8,c107ff76,60,33,1,...) at sleeplk+0x126/frame 0xfb6c9550 __lockmgr_args(cd88246c,200100,cd8824d8,0,0,0,c10a65af,881) at __lockmgr_args+0x612/frame 0xfb6c9630 nfs_lock1(fb6c96a8,0,c87fb900,0,0,...) at nfs_lock1+0x9c/frame 0xfb6c9660 VOP_LOCK1_APV(c11bb6b8,fb6c96a8,c87fb900,c87fb800,c1209068,...) at VOP_LOCK1_APV+0x112/frame 0xfb6c9690 _vn_lock(cd882438,200100,c10a65af,881,c10a5825,...) at _vn_lock+0xca/frame 0xfb6c96d0 vget(cd882438,200100,ca5c2300,57,0,...) at vget+0x77/frame 0xfb6c9708 vfs_hash_get(c809c000,88207676,200000,ca5c2300,fb6c9770,...) at vfs_hash_get+0xff/frame 0xfb6c9734 nfscl_nget(c809c000,cb8799d8,c95ac820,fb6c9b74,ca5c2300,...) at nfscl_nget+0x92/frame 0xfb6c9780 nfs_lookup(fb6c99f8,c10f3df1,c10c89ed,c10a59f3,c1206530,...) at nfs_lookup+0x971/frame 0xfb6c9990 VOP_LOOKUP_APV(c11bb6b8,fb6c99f8,fb6c9b74,205,cb879a78,...) at VOP_LOOKUP_APV+0x124/frame 0xfb6c99c0 lookup(fb6c9b28,c10a59f3,107,ce,cd88246c,...) at lookup+0x52e/frame 0xfb6c9a20 namei(fb6c9b28,ca5c2300,c1250980,0,fb6c9b2c,...) at namei+0x47d/frame 0xfb6c9aa8 kern_statat_vnhook(ca5c2300,0,ffffff9c,2881f100,0,...) at kern_statat_vnhook+0xb6/frame 0xfb6c9bb0 sys_stat(ca5c2300,fb6c9cc8,7b3,0,fb6c9cc4,...) at sys_stat+0x4d/frame 0xfb6c9c40 syscall(fb6c9d08) at syscall+0x2ed/frame 0xfb6c9cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb6c9cfc --- syscall (188, FreeBSD ELF32, sys_stat), eip = 0x28188be3, esp = 0xbfbfd55c, ebp = 0xbfbfd5e8 --- Tracing command fts pid 41559 tid 100402 td 0xc921a300 sched_switch(c921a300,0,103,1b0,0,...) at sched_switch+0x4b4/frame 0xfba4185c mi_switch(103,0,c109c55c,2e6,1a75,...) at mi_switch+0x1c9/frame 0xfba41890 turnstile_wait(c9629e80,cbbee600,0,96,0,...) at turnstile_wait+0x3b4/frame 0xfba418c0 __rw_wlock_hard(c13d1a90,c921a300,c10ec202,d66,0,...) at __rw_wlock_hard+0x343/frame 0xfba4193c _rw_wlock_cookie(c13d1a90,c10ec202,d66,fba419a8,c921a300,...) at _rw_wlock_cookie+0xdd/frame 0xfba4196c pmap_enter(ca661280,28839000,1,c45cbe80,3,...) at pmap_enter+0x7b/frame 0xfba419c0 vm_fault_hold(ca6611d0,28839000,1,0,0,...) at vm_fault_hold+0x1a57/frame 0xfba41b20 vm_fault(ca6611d0,28839000,1,0,ca6611d0,...) at vm_fault+0x82/frame 0xfba41b48 trap_pfault(28839018,fba41d08,c81ac828,c7d4f118,fba41c04,...) at trap_pfault+0x1ba/frame 0xfba41bc0 trap(fba41d08) at trap+0x5da/frame 0xfba41cfc calltrap() at calltrap+0x6/frame 0xfba41cfc --- trap 0xc, eip = 0x281971f2, esp = 0xbfbfd65c, ebp = 0xbfbfd688 --- Tracing command swap pid 41558 tid 100529 td 0xcbbf4000 sched_switch(cbbf4000,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfbbcba64 mi_switch(104,0,c109b989,1f5,2,...) at mi_switch+0x1c9/frame 0xfbbcba98 sleepq_switch(cbbf4000,0,c109b989,1ab,8,...) at sleepq_switch+0x1b9/frame 0xfbbcbacc sleepq_catch_signals(c0ae0150,cbbf4000,2,201,2,...) at sleepq_catch_signals+0x3a1/frame 0xfbbcbb14 sleepq_timedwait_sig(c124396a,6c,1a76,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xfbbcbb3c _sleep(c124396a,0,16c,c10973b2,610a0530,...) at _sleep+0x331/frame 0xfbbcbb98 kern_nanosleep(bfbfd668,fbbcbc18,fbbcbc20,fbbcbcc8,1,...) at kern_nanosleep+0x158/frame 0xfbbcbc00 sys_nanosleep(cbbf4000,fbbcbcc8,14,c10982d9,7b3,...) at sys_nanosleep+0x6b/frame 0xfbbcbc40 syscall(fbbcbd08) at syscall+0x2ed/frame 0xfbbcbcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfbbcbcfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2817904f, esp = 0xbfbfd65c, ebp = 0xbfbfd6a0 --- Tracing command fts pid 41557 tid 100379 td 0xcb2fdc00 sched_switch(cb2fdc00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb96647c mi_switch(104,0,c109b989,1f5,162,...) at mi_switch+0x1c9/frame 0xfb9664b0 sleepq_switch(cb2fdc00,0,c109b989,26b,60,...) at sleepq_switch+0x1b9/frame 0xfb9664e4 sleepq_wait(cd88246c,60,c107ff76,4,1,...) at sleepq_wait+0x48/frame 0xfb966508 sleeplk(cd8824d8,c107ff76,60,33,1,...) at sleeplk+0x126/frame 0xfb966550 __lockmgr_args(cd88246c,200100,cd8824d8,0,0,0,c10a65af,881) at __lockmgr_args+0x612/frame 0xfb966630 nfs_lock1(fb9666a8,2,c82f3600,0,0,...) at nfs_lock1+0x9c/frame 0xfb966660 VOP_LOCK1_APV(c11bb6b8,fb9666a8,c82f3600,c82fbd00,c1209068,...) at VOP_LOCK1_APV+0x112/frame 0xfb966690 _vn_lock(cd882438,200100,c10a65af,881,c10a5825,...) at _vn_lock+0xca/frame 0xfb9666d0 vget(cd882438,200100,cb2fdc00,57,0,...) at vget+0x77/frame 0xfb966708 vfs_hash_get(c809c000,88207676,200000,cb2fdc00,fb966770,...) at vfs_hash_get+0xff/frame 0xfb966734 nfscl_nget(c809c000,cb8799d8,c9e6b180,fb966b74,cb2fdc00,...) at nfscl_nget+0x92/frame 0xfb966780 nfs_lookup(fb9669f8,c10f3df1,c10c89ed,c10a59f3,c1206530,...) at nfs_lookup+0x971/frame 0xfb966990 VOP_LOOKUP_APV(c11bb6b8,fb9669f8,fb966b74,205,cb879a78,...) at VOP_LOOKUP_APV+0x124/frame 0xfb9669c0 lookup(fb966b28,c10a59f3,107,ce,cd88246c,...) at lookup+0x52e/frame 0xfb966a20 namei(fb966b28,cb2fdc00,c1250980,0,fb966b2c,...) at namei+0x47d/frame 0xfb966aa8 kern_statat_vnhook(cb2fdc00,0,ffffff9c,2881d100,0,...) at kern_statat_vnhook+0xb6/frame 0xfb966bb0 sys_stat(cb2fdc00,fb966cc8,14,c10982d9,7b3,...) at sys_stat+0x4d/frame 0xfb966c40 syscall(fb966d08) at syscall+0x2ed/frame 0xfb966cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb966cfc --- syscall (188, FreeBSD ELF32, sys_stat), eip = 0x28188be3, esp = 0xbfbfd55c, ebp = 0xbfbfd5e8 --- Tracing command mmap pid 41556 tid 100299 td 0xca7fa900 kdb_enter(c1095cfb,c1095cfb,c10a7718,fb831a8c,c10a7718,...) at kdb_enter+0x3d/frame 0xfb831a20 vpanic(c12425d2,100,c10a7718,fb831a8c,fb831a8c,...) at vpanic+0x142/frame 0xfb831a5c kassert_panic(c10a7718,c10a4d4c,c10a65af,8cf,fb831ac8,...) at kassert_panic+0xea/frame 0xfb831a80 vputx(c93ab708,fb831b98,5000,5e3,fb831c18,...) at vputx+0x452/frame 0xfb831ac8 vm_mmap(c964abc8,fb831c18,5000,3,7,...) at vm_mmap+0x828/frame 0xfb831bc0 sys_mmap(ca7fa900,fb831cc8,8,c10963d4,db,...) at sys_mmap+0x2f0/frame 0xfb831c40 syscall(fb831d08) at syscall+0x2ed/frame 0xfb831cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb831cfc --- syscall (477, FreeBSD ELF32, sys_mmap), eip = 0x280fee9f, esp = 0xbfbfd574, ebp = 0xbfbfd6a0 --- Tracing command fts pid 41554 tid 100513 td 0xc8b0f900 sched_switch(c8b0f900,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfbb8e494 mi_switch(104,0,c109b989,1f5,162,...) at mi_switch+0x1c9/frame 0xfbb8e4c8 sleepq_switch(c8b0f900,0,c109b989,26b,60,...) at sleepq_switch+0x1b9/frame 0xfbb8e4fc sleepq_wait(ca2e6304,60,c107ff76,4,1,...) at sleepq_wait+0x48/frame 0xfbb8e520 sleeplk(ca2e6370,c107ff76,60,33,1,...) at sleeplk+0x126/frame 0xfbb8e568 __lockmgr_args(ca2e6304,200100,ca2e6370,0,0,0,c10a65af,881) at __lockmgr_args+0x612/frame 0xfbb8e648 nfs_lock1(fbb8e6c0,80000000,fc0,0,1,...) at nfs_lock1+0x9c/frame 0xfbb8e678 VOP_LOCK1_APV(c11bb6b8,fbb8e6c0,0,c0a895d7,c1209068,...) at VOP_LOCK1_APV+0x112/frame 0xfbb8e6a8 _vn_lock(ca2e62d0,200100,c10a65af,881,2a1,...) at _vn_lock+0xca/frame 0xfbb8e6e8 vget(ca2e62d0,200100,c8b0f900,29d,c1206530,...) at vget+0x77/frame 0xfbb8e720 cache_lookup(cb8799d8,fbb8eb60,fbb8eb74,fbb8e7d0,fbb8e950,...) at cache_lookup+0x5a8/frame 0xfbb8e780 nfs_lookup(fbb8e9f8,c10f3df1,c10c89ed,c10a59f3,c1206530,...) at nfs_lookup+0x1d1/frame 0xfbb8e990 VOP_LOOKUP_APV(c11bb6b8,fbb8e9f8,fbb8eb74,205,cb879a78,...) at VOP_LOOKUP_APV+0x124/frame 0xfbb8e9c0 lookup(fbb8eb28,c10a59f3,107,ce,200,...) at lookup+0x52e/frame 0xfbb8ea20 namei(fbb8eb28,ffffffdf,c7d71680,0,c8b0f900,...) at namei+0x47d/frame 0xfbb8eaa8 kern_statat_vnhook(c8b0f900,0,ffffff9c,2881d100,0,...) at kern_statat_vnhook+0xb6/frame 0xfbb8ebb0 sys_stat(c8b0f900,fbb8ecc8,c0ebf800,c7200c90,0,...) at sys_stat+0x4d/frame 0xfbb8ec40 syscall(fbb8ed08) at syscall+0x2ed/frame 0xfbb8ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfbb8ecfc --- syscall (188, FreeBSD ELF32, sys_stat), eip = 0x28188be3, esp = 0xbfbfd55c, ebp = 0xbfbfd5e8 --- Tracing command mmap pid 41553 tid 100534 td 0xcbbf3000 cpustop_handler(3,13,fbbda5dc,c0eb7b0b,0,...) at cpustop_handler+0x2f/frame 0xfbbda490 ipi_nmi_handler(0,fbbda4dc,c0a60e4b,c13d4628,411ccf,...) at ipi_nmi_handler+0x37/frame 0xfbbda4a0 trap(fbbda5e8) at trap+0x3b/frame 0xfbbda5dc calltrap() at calltrap+0x6/frame 0xfbbda5dc --- trap 0x13, eip = 0xc0ec9f82, esp = 0xfbbda628, ebp = 0xfbbda660 --- DELAY(1,c109a4e9,11c,0,c1890ffc,...) at DELAY+0x1d2/frame 0xfbbda660 _mtx_lock_spin_cookie(c1240eb8,cbbf3000,0,1f4,0,...) at _mtx_lock_spin_cookie+0x17c/frame 0xfbbda6bc __mtx_lock_spin_flags(c1240eb8,0,c108dcc7,1f4,fbbda870,...) at __mtx_lock_spin_flags+0x101/frame 0xfbbda6ec cnputs(fbbda890,ffffffff,fbbda890,1,46,...) at cnputs+0x3a/frame 0xfbbda70c putchar(a,fbbda870,10,0,4425801,...) at putchar+0x131/frame 0xfbbda77c kvprintf(c10a6c02,c0ad96c0,fbbda870,a,fbbda93c,...) at kvprintf+0xda/frame 0xfbbda850 vprintf(c10a6c02,fbbda93c,fbbda93c) at vprintf+0x7f/frame 0xfbbda91c printf(c10a6c02,fbbda969,100,4,0,...) at printf+0x1b/frame 0xfbbda930 vn_printf(ca41f168,c10a4d4c,c10a65af,8cf,fbbdaac8,...) at vn_printf+0x441/frame 0xfbbdaa80 vputx(ca41f168,fbbdab98,5000,5e3,fbbdac18,...) at vputx+0x446/frame 0xfbbdaac8 vm_mmap(ca661000,fbbdac18,5000,3,7,...) at vm_mmap+0x828/frame 0xfbbdabc0 sys_mmap(cbbf3000,fbbdacc8,7b3,0,fbbdacc4,...) at sys_mmap+0x2f0/frame 0xfbbdac40 syscall(fbbdad08) at syscall+0x2ed/frame 0xfbbdacfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfbbdacfc --- syscall (477, FreeBSD ELF32, sys_mmap), eip = 0x280fee9f, esp = 0xbfbfd574, ebp = 0xbfbfd6a0 --- Tracing command mkdir pid 41552 tid 100495 td 0xc8aefc00 sched_switch(c8aefc00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfbb58a64 mi_switch(104,0,c109b989,1f5,2,...) at mi_switch+0x1c9/frame 0xfbb58a98 sleepq_switch(c8aefc00,0,c109b989,1ab,8,...) at sleepq_switch+0x1b9/frame 0xfbb58acc sleepq_catch_signals(c0ae0150,c8aefc00,2,201,2,...) at sleepq_catch_signals+0x3a1/frame 0xfbb58b14 sleepq_timedwait_sig(c124396a,6c,1a76,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xfbb58b3c _sleep(c124396a,0,16c,c10973b2,5d32fae1,...) at _sleep+0x331/frame 0xfbb58b98 kern_nanosleep(bfbfd668,fbb58c18,fbb58c20,fbb58cc8,1,...) at kern_nanosleep+0x158/frame 0xfbb58c00 sys_nanosleep(c8aefc00,fbb58cc8,14,c10982d9,7b3,...) at sys_nanosleep+0x6b/frame 0xfbb58c40 syscall(fbb58d08) at syscall+0x2ed/frame 0xfbb58cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfbb58cfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2817904f, esp = 0xbfbfd65c, ebp = 0xbfbfd6a0 --- Tracing command fts pid 41551 tid 100252 td 0xca739000 Tracing command mmap pid 41550 tid 100284 td 0xca737900 sched_switch(ca737900,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb7fd878 mi_switch(104,0,c109b989,1f5,101,...) at mi_switch+0x1c9/frame 0xfb7fd8ac sleepq_switch(ca737900,0,c109b989,28e,ca737900,...) at sleepq_switch+0x1b9/frame 0xfb7fd8e0 sleepq_timedwait(c3cd40c0,50,13,0,0,...) at sleepq_timedwait+0x48/frame 0xfb7fd904 _sleep(c3cd40c0,ca7fb2e4,50,c10d0579,ffffe8e0,...) at _sleep+0x345/frame 0xfb7fd960 swap_pager_getpages(ca7fb2e4,fb7fda2c,1,0,fb7fdb04,...) at swap_pager_getpages+0x4a3/frame 0xfb7fd9c0 vm_fault_hold(ca661910,28065000,2,0,0,...) at vm_fault_hold+0xa21/frame 0xfb7fdb20 vm_fault(ca661910,28065000,2,0,ca661910,...) at vm_fault+0x82/frame 0xfb7fdb48 trap_pfault(28065000,fb7fdd08,0,2,400800c,...) at trap_pfault+0x1ba/frame 0xfb7fdbc0 trap(fb7fdd08) at trap+0x5da/frame 0xfb7fdcfc calltrap() at calltrap+0x6/frame 0xfb7fdcfc --- trap 0xc, eip = 0x280561b4, esp = 0xbfbfd4bc, ebp = 0xbfbfd4d0 --- Tracing command mmap pid 41549 tid 100340 td 0xcaeb6c00 sched_switch(caeb6c00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb8b9878 mi_switch(104,0,c109b989,1f5,101,...) at mi_switch+0x1c9/frame 0xfb8b98ac sleepq_switch(caeb6c00,0,c109b989,28e,caeb6c00,...) at sleepq_switch+0x1b9/frame 0xfb8b98e0 sleepq_timedwait(c32821c0,50,13,0,0,...) at sleepq_timedwait+0x48/frame 0xfb8b9904 _sleep(c32821c0,cf0bfcb8,50,c10d0579,ffffe8e0,...) at _sleep+0x345/frame 0xfb8b9960 swap_pager_getpages(cf0bfcb8,fb8b9a2c,1,0,fb8b9b04,...) at swap_pager_getpages+0x4a3/frame 0xfb8b99c0 vm_fault_hold(c7da5cb0,28062000,1,0,0,...) at vm_fault_hold+0xa21/frame 0xfb8b9b20 vm_fault(c7da5cb0,28062000,1,0,c7da5cb0,...) at vm_fault+0x82/frame 0xfb8b9b48 trap_pfault(28062224,cc1f180c,0,2,400800c,...) at trap_pfault+0x1ba/frame 0xfb8b9bc0 trap(fb8b9d08) at trap+0x5da/frame 0xfb8b9cfc calltrap() at calltrap+0x6/frame 0xfb8b9cfc --- trap 0xc, eip = 0x2804f44b, esp = 0xbfbfd4d8, ebp = 0xbfbfd54c --- Tracing command mmap pid 41548 tid 100087 td 0xc7d85300 sched_switch(c7d85300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb4d1878 mi_switch(104,0,c109b989,1f5,101,...) at mi_switch+0x1c9/frame 0xfb4d18ac sleepq_switch(c7d85300,0,c109b989,28e,c7d85300,...) at sleepq_switch+0x1b9/frame 0xfb4d18e0 sleepq_timedwait(c4be6440,50,13,0,0,...) at sleepq_timedwait+0x48/frame 0xfb4d1904 _sleep(c4be6440,cb8606f0,50,c10d0579,ffffe8e0,...) at _sleep+0x345/frame 0xfb4d1960 swap_pager_getpages(cb8606f0,fb4d1a2c,1,0,fb4d1b04,...) at swap_pager_getpages+0x4a3/frame 0xfb4d19c0 vm_fault_hold(c7d99ae0,bfbfc000,2,0,0,...) at vm_fault_hold+0xa21/frame 0xfb4d1b20 vm_fault(c7d99ae0,bfbfc000,2,0,c7d99ae0,...) at vm_fault+0x82/frame 0xfb4d1b48 trap_pfault(bfbfcfbc,fb4d1d08,0,2,400800c,...) at trap_pfault+0x1ba/frame 0xfb4d1bc0 trap(fb4d1d08) at trap+0x5da/frame 0xfb4d1cfc calltrap() at calltrap+0x6/frame 0xfb4d1cfc --- trap 0xc, eip = 0x28189d02, esp = 0xbfbfcfc0, ebp = 0xbfbfd4e0 --- Tracing command mmap pid 41547 tid 100242 td 0xca5b7300 sched_switch(ca5b7300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb76b878 mi_switch(104,0,c109b989,1f5,101,...) at mi_switch+0x1c9/frame 0xfb76b8ac sleepq_switch(ca5b7300,0,c109b989,28e,ca5b7300,...) at sleepq_switch+0x1b9/frame 0xfb76b8e0 sleepq_timedwait(c3cd4180,50,13,0,0,...) at sleepq_timedwait+0x48/frame 0xfb76b904 _sleep(c3cd4180,c923c784,50,c10d0579,ffffe8e0,...) at _sleep+0x345/frame 0xfb76b960 swap_pager_getpages(c923c784,fb76ba2c,1,0,fb76bb04,...) at swap_pager_getpages+0x4a3/frame 0xfb76b9c0 vm_fault_hold(c91dd0e8,281b5000,1,0,0,...) at vm_fault_hold+0xa21/frame 0xfb76bb20 vm_fault(c91dd0e8,281b5000,1,0,c91dd0e8,...) at vm_fault+0x82/frame 0xfb76bb48 trap_pfault(281b5010,fb76bd08,420c04c,0,ca5b7300,...) at trap_pfault+0x1ba/frame 0xfb76bbc0 trap(fb76bd08) at trap+0x5da/frame 0xfb76bcfc calltrap() at calltrap+0x6/frame 0xfb76bcfc --- trap 0xc, eip = 0x28189d9b, esp = 0xbfbfcfc0, ebp = 0xbfbfd4e0 --- Tracing command creat pid 41546 tid 100505 td 0xc8b1b300 sched_switch(c8b1b300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfbb76a64 mi_switch(104,0,c109b989,1f5,3,...) at mi_switch+0x1c9/frame 0xfbb76a98 sleepq_switch(c8b1b300,0,c109b989,1ab,8,...) at sleepq_switch+0x1b9/frame 0xfbb76acc sleepq_catch_signals(c0ae0150,c8b1b300,3,201,3,...) at sleepq_catch_signals+0x3a1/frame 0xfbb76b14 sleepq_timedwait_sig(c124396b,6c,1a76,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xfbb76b3c _sleep(c124396b,0,16c,c10973b2,5fc266b5,...) at _sleep+0x331/frame 0xfbb76b98 kern_nanosleep(bfbfd668,fbb76c18,fbb76c20,fbb76cc8,1,...) at kern_nanosleep+0x158/frame 0xfbb76c00 sys_nanosleep(c8b1b300,fbb76cc8,7b3,0,fbb76cc4,...) at sys_nanosleep+0x6b/frame 0xfbb76c40 syscall(fbb76d08) at syscall+0x2ed/frame 0xfbb76cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfbb76cfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2817904f, esp = 0xbfbfd65c, ebp = 0xbfbfd6a0 --- Tracing command mmap pid 41545 tid 100474 td 0xc8adb900 sched_switch(c8adb900,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfbb198a4 mi_switch(104,0,c109b989,1f5,162,...) at mi_switch+0x1c9/frame 0xfbb198d8 sleepq_switch(c8adb900,0,c109b989,26b,c8adb900,...) at sleepq_switch+0x1b9/frame 0xfbb1990c sleepq_wait(c3cd4180,54,c10d1012,0,0,...) at sleepq_wait+0x48/frame 0xfbb19930 _sleep(c3cd4180,c923c784,54,c10d1012,0,0,0,0,100) at _sleep+0x37c/frame 0xfbb1998c vm_page_sleep(c3cd4180,c10d1012,0,176,fbb19b04,...) at vm_page_sleep+0xc0/frame 0xfbb199c0 vm_fault_hold(ca616e80,281b5000,1,0,0,...) at vm_fault_hold+0xf06/frame 0xfbb19b20 vm_fault(ca616e80,281b5000,1,0,ca616e80,...) at vm_fault+0x82/frame 0xfbb19b48 trap_pfault(281b5010,fbb19d08,0,2,400800c,...) at trap_pfault+0x1ba/frame 0xfbb19bc0 trap(fbb19d08) at trap+0x5da/frame 0xfbb19cfc calltrap() at calltrap+0x6/frame 0xfbb19cfc --- trap 0xc, eip = 0x28189d9b, esp = 0xbfbfcfc0, ebp = 0xbfbfd4e0 --- Tracing command rw pid 41544 tid 100462 td 0xc8aca900 sched_switch(c8aca900,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfbaf5878 mi_switch(104,0,c109b989,1f5,101,...) at mi_switch+0x1c9/frame 0xfbaf58ac sleepq_switch(c8aca900,0,c109b989,28e,c8aca900,...) at sleepq_switch+0x1b9/frame 0xfbaf58e0 sleepq_timedwait(c3cd4080,50,13,0,0,...) at sleepq_timedwait+0x48/frame 0xfbaf5904 _sleep(c3cd4080,cb9c3784,50,c10d0579,ffffe8e0,...) at _sleep+0x345/frame 0xfbaf5960 swap_pager_getpages(cb9c3784,fbaf5a2c,1,0,fbaf5b04,...) at swap_pager_getpages+0x4a3/frame 0xfbaf59c0 vm_fault_hold(c8a072b8,28062000,1,0,0,...) at vm_fault_hold+0xa21/frame 0xfbaf5b20 vm_fault(c8a072b8,28062000,1,0,c8a072b8,...) at vm_fault+0x82/frame 0xfbaf5b48 trap_pfault(28062224,fbaf5d08,c1250980,c7772edc,fbaf5bec,...) at trap_pfault+0x1ba/frame 0xfbaf5bc0 trap(fbaf5d08) at trap+0x5da/frame 0xfbaf5cfc calltrap() at calltrap+0x6/frame 0xfbaf5cfc --- trap 0xc, eip = 0x2804f44b, esp = 0xbfbfc568, ebp = 0xbfbfc5e0 --- Tracing command mmap pid 41543 tid 100234 td 0xca6ac300 Tracing command rw pid 41542 tid 100533 td 0xcbbf3300 sched_switch(cbbf3300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfbbd763c mi_switch(104,0,c109b989,1f5,c109b989,...) at mi_switch+0x1c9/frame 0xfbbd7670 sleepq_switch(cbbf3300,0,c109b989,1ab,fbbd76e8,...) at sleepq_switch+0x1b9/frame 0xfbbd76a4 sleepq_catch_signals(0,c109b989,162,978,60,...) at sleepq_catch_signals+0x3a1/frame 0xfbbd76ec sleepq_wait_sig(e38c7114,60,c108d4c6,104,0,...) at sleepq_wait_sig+0x14/frame 0xfbbd7710 sleeplk(c970ba98,c108d4c6,160,0,0,...) at sleeplk+0x110/frame 0xfbbd7758 __lockmgr_args(e38c7114,81900,c970ba98,c108d4c6,160,...) at __lockmgr_args+0xaa4/frame 0xfbbd7838 getblk(c970b9d8,6ac,0,10000,100,...) at getblk+0x1e8/frame 0xfbbd78a8 nfs_getcacheblk(0,10000,cbbf3300,cbbf3300,c124fb80,...) at nfs_getcacheblk+0x77/frame 0xfbbd7900 ncl_bioread(c970b9d8,fbbd7c10,7f0000,c7d71680,c11bb6b8,...) at ncl_bioread+0xcb4/frame 0xfbbd79fc nfs_read(fbbd7a80,c10f41c7,c10c8a7b,c10a7f48,2b8,...) at nfs_read+0x3f/frame 0xfbbd7a18 VOP_READ_APV(c11bb6b8,fbbd7a80,c970b9d8,2b8,c970ba88,...) at VOP_READ_APV+0x124/frame 0xfbbd7a48 vn_read(ccfd5d58,fbbd7c10,c7d71680,1,cbbf3300,...) at vn_read+0x2a6/frame 0xfbbd7ab0 vn_io_fault(ccfd5d58,fbbd7c10,c7d71680,0,cbbf3300,...) at vn_io_fault+0x24b/frame 0xfbbd7b90 dofileread(ccfd5d58,fbbd7c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xfbbd7bc4 kern_readv(cbbf3300,4,fbbd7c10,cbbf3300,bfbfc620,...) at kern_readv+0x66/frame 0xfbbd7bf0 sys_read(cbbf3300,fbbd7cc8,14,c10982d9,7b3,...) at sys_read+0x5c/frame 0xfbbd7c40 syscall(fbbd7d08) at syscall+0x2ed/frame 0xfbbd7cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfbbd7cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819bca7, esp = 0xbfbfc608, ebp = 0xbfbfd6b0 --- Tracing command rw pid 41541 tid 100290 td 0xca6aa000 sched_switch(ca6aa000,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb814878 mi_switch(104,0,c109b989,1f5,101,...) at mi_switch+0x1c9/frame 0xfb8148ac sleepq_switch(ca6aa000,0,c109b989,28e,ca6aa000,...) at sleepq_switch+0x1b9/frame 0xfb8148e0 sleepq_timedwait(c3cd4240,50,13,0,0,...) at sleepq_timedwait+0x48/frame 0xfb814904 _sleep(c3cd4240,cf5b4940,50,c10d0579,ffffe8e0,...) at _sleep+0x345/frame 0xfb814960 swap_pager_getpages(cf5b4940,fb814a2c,1,0,fb814b04,...) at swap_pager_getpages+0x4a3/frame 0xfb8149c0 vm_fault_hold(c8ed79f8,28062000,1,0,0,...) at vm_fault_hold+0xa21/frame 0xfb814b20 vm_fault(c8ed79f8,28062000,1,0,c8ed79f8,...) at vm_fault+0x82/frame 0xfb814b48 trap_pfault(28062224,fb814d08,fb814c10,ffffffff,ffffffff,...) at trap_pfault+0x1ba/frame 0xfb814bc0 trap(fb814d08) at trap+0x5da/frame 0xfb814cfc calltrap() at calltrap+0x6/frame 0xfb814cfc --- trap 0xc, eip = 0x2804f44b, esp = 0xbfbfc568, ebp = 0xbfbfc5e0 --- Tracing command rw pid 41540 tid 100122 td 0xc7de0900 Tracing command lockf pid 41539 tid 100541 td 0xcbbee900 sched_switch(cbbee900,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfbbefa64 mi_switch(104,0,c109b989,1f5,3,...) at mi_switch+0x1c9/frame 0xfbbefa98 sleepq_switch(cbbee900,0,c109b989,1ab,8,...) at sleepq_switch+0x1b9/frame 0xfbbefacc sleepq_catch_signals(c0ae0150,cbbee900,3,201,3,...) at sleepq_catch_signals+0x3a1/frame 0xfbbefb14 sleepq_timedwait_sig(c124396b,6c,1a76,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xfbbefb3c _sleep(c124396b,0,16c,c10973b2,595c44ef,...) at _sleep+0x331/frame 0xfbbefb98 kern_nanosleep(bfbfd668,fbbefc18,fbbefc20,fbbefcc8,1,...) at kern_nanosleep+0x158/frame 0xfbbefc00 sys_nanosleep(cbbee900,fbbefcc8,14,c10982d9,7b3,...) at sys_nanosleep+0x6b/frame 0xfbbefc40 syscall(fbbefd08) at syscall+0x2ed/frame 0xfbbefcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfbbefcfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2817904f, esp = 0xbfbfd65c, ebp = 0xbfbfd6a0 --- Tracing command fts pid 41537 tid 100191 td 0xca5be000 sched_switch(ca5be000,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb68da64 mi_switch(104,0,c109b989,1f5,3,...) at mi_switch+0x1c9/frame 0xfb68da98 sleepq_switch(ca5be000,0,c109b989,1ab,8,...) at sleepq_switch+0x1b9/frame 0xfb68dacc sleepq_catch_signals(c0ae0150,ca5be000,3,201,3,...) at sleepq_catch_signals+0x3a1/frame 0xfb68db14 sleepq_timedwait_sig(c124396b,6c,1a76,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xfb68db3c _sleep(c124396b,0,16c,c10973b2,53fbb3a1,...) at _sleep+0x331/frame 0xfb68db98 kern_nanosleep(bfbfd678,fb68dc18,fb68dc20,fb68dcc8,1,...) at kern_nanosleep+0x158/frame 0xfb68dc00 sys_nanosleep(ca5be000,fb68dcc8,14,c10982d9,7b3,...) at sys_nanosleep+0x6b/frame 0xfb68dc40 syscall(fb68dd08) at syscall+0x2ed/frame 0xfb68dcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb68dcfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2817804f, esp = 0xbfbfd66c, ebp = 0xbfbfd6b0 --- Tracing command mmap pid 41536 tid 100134 td 0xc888a300 sched_switch(c888a300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb5dba64 mi_switch(104,0,c109b989,1f5,0,...) at mi_switch+0x1c9/frame 0xfb5dba98 sleepq_switch(c888a300,0,c109b989,1ab,8,...) at sleepq_switch+0x1b9/frame 0xfb5dbacc sleepq_catch_signals(c0ae0150,c888a300,0,201,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb5dbb14 sleepq_timedwait_sig(c1243968,6c,1a76,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xfb5dbb3c _sleep(c1243968,0,16c,c10973b2,5a61ff95,...) at _sleep+0x331/frame 0xfb5dbb98 kern_nanosleep(bfbfd668,fb5dbc18,fb5dbc20,fb5dbcc8,1,...) at kern_nanosleep+0x158/frame 0xfb5dbc00 sys_nanosleep(c888a300,fb5dbcc8,c0ebf800,c7200c90,0,...) at sys_nanosleep+0x6b/frame 0xfb5dbc40 syscall(fb5dbd08) at syscall+0x2ed/frame 0xfb5dbcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb5dbcfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2817904f, esp = 0xbfbfd65c, ebp = 0xbfbfd6a0 --- Tracing command rw pid 41535 tid 100547 td 0xcbbed600 sched_switch(cbbed600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfbc01a64 mi_switch(104,0,c109b989,1f5,3,...) at mi_switch+0x1c9/frame 0xfbc01a98 sleepq_switch(cbbed600,0,c109b989,1ab,8,...) at sleepq_switch+0x1b9/frame 0xfbc01acc sleepq_catch_signals(c0ae0150,cbbed600,3,201,3,...) at sleepq_catch_signals+0x3a1/frame 0xfbc01b14 sleepq_timedwait_sig(c124396b,6c,1a76,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xfbc01b3c _sleep(c124396b,0,16c,c10973b2,599d689b,...) at _sleep+0x331/frame 0xfbc01b98 kern_nanosleep(bfbfd678,fbc01c18,fbc01c20,fbc01cc8,1,...) at kern_nanosleep+0x158/frame 0xfbc01c00 sys_nanosleep(cbbed600,fbc01cc8,7b3,0,fbc01cc4,...) at sys_nanosleep+0x6b/frame 0xfbc01c40 syscall(fbc01d08) at syscall+0x2ed/frame 0xfbc01cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfbc01cfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2817904f, esp = 0xbfbfd66c, ebp = 0xbfbfd6b0 --- Tracing command run pid 41524 tid 100145 td 0xca45f000 Tracing command run pid 41523 tid 100243 td 0xca5b7000 Tracing command run pid 41522 tid 100424 td 0xc9f73600 sched_switch(c9f73600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfba83a64 mi_switch(104,0,c109b989,1f5,3,...) at mi_switch+0x1c9/frame 0xfba83a98 sleepq_switch(c9f73600,0,c109b989,1ab,8,...) at sleepq_switch+0x1b9/frame 0xfba83acc sleepq_catch_signals(c0ae0150,c9f73600,3,201,3,...) at sleepq_catch_signals+0x3a1/frame 0xfba83b14 sleepq_timedwait_sig(c124396b,6c,1a76,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xfba83b3c _sleep(c124396b,0,16c,c10973b2,5a20b66a,...) at _sleep+0x331/frame 0xfba83b98 kern_nanosleep(bfbfd418,fba83c18,fba83c20,fba83cc8,1,...) at kern_nanosleep+0x158/frame 0xfba83c00 sys_nanosleep(c9f73600,fba83cc8,c0ebf800,c71fdc90,0,...) at sys_nanosleep+0x6b/frame 0xfba83c40 syscall(fba83d08) at syscall+0x2ed/frame 0xfba83cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfba83cfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2817804f, esp = 0xbfbfd40c, ebp = 0xbfbfd450 --- Tracing command sh pid 41497 tid 100353 td 0xca736300 Tracing command sh pid 41482 tid 100378 td 0xcb2fe000 sched_switch(cb2fe000,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb96398c mi_switch(104,0,c109b989,1f5,c109b989,...) at mi_switch+0x1c9/frame 0xfb9639c0 sleepq_switch(cb2fe000,0,c109b989,1ab,fb963a38,...) at sleepq_switch+0x1b9/frame 0xfb9639f4 sleepq_catch_signals(0,c109b989,162,588,cb2fe000,...) at sleepq_catch_signals+0x3a1/frame 0xfb963a3c sleepq_wait_sig(cb2f9ba0,6c,c109eda5,100,0,...) at sleepq_wait_sig+0x14/frame 0xfb963a60 _sleep(cb2f9ba0,cb2f9c34,16c,c109eda5,0,...) at _sleep+0x35b/frame 0xfb963abc kern_wait6(cb2fe000,7,0,0,fb963b4c,...) at kern_wait6+0x45c/frame 0xfb963b20 sys_wait4(cb2fe000,fb963cc8,14,c10982d9,7b3,...) at sys_wait4+0x94/frame 0xfb963c40 syscall(fb963d08) at syscall+0x2ed/frame 0xfb963cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb963cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815233f, esp = 0xbfbfd770, ebp = 0xbfbfd788 --- Tracing command newnfs 19 pid 96762 tid 100279 td 0xca6aa600 sched_switch(ca6aa600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb7eab58 mi_switch(104,0,c109b989,1f5,ca6aa600,...) at mi_switch+0x1c9/frame 0xfb7eab8c sleepq_switch(ca6aa600,0,c109b989,1ab,8,...) at sleepq_switch+0x1b9/frame 0xfb7eabc0 sleepq_catch_signals(c0ae0150,ca6aa600,2,101,2,...) at sleepq_catch_signals+0x3a1/frame 0xfb7eac08 sleepq_timedwait_sig(c140a90c,6c,77,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xfb7eac30 _sleep(c140a90c,c140a888,16c,c1081d06,ffff7540,...) at _sleep+0x331/frame 0xfb7eac8c nfssvc_iod(c123b53c,fb7ead08,c108f880,3d7,0,...) at nfssvc_iod+0x139/frame 0xfb7eaccc fork_exit(c09d1670,c123b53c,fb7ead08) at fork_exit+0x7f/frame 0xfb7eacf4 fork_trampoline() at fork_trampoline+0x8/frame 0xfb7eacf4 --- trap 0, eip = 0, esp = 0xfb7ead40, ebp = 0 --- Tracing command newnfs 18 pid 96761 tid 100508 td 0xc8b17900 sched_switch(c8b17900,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfbb7fb58 mi_switch(104,0,c109b989,1f5,c8b17900,...) at mi_switch+0x1c9/frame 0xfbb7fb8c sleepq_switch(c8b17900,0,c109b989,1ab,8,...) at sleepq_switch+0x1b9/frame 0xfbb7fbc0 sleepq_catch_signals(c0ae0150,c8b17900,1,101,1,...) at sleepq_catch_signals+0x3a1/frame 0xfbb7fc08 sleepq_timedwait_sig(c140a908,6c,77,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xfbb7fc30 _sleep(c140a908,c140a888,16c,c1081d06,ffff7540,...) at _sleep+0x331/frame 0xfbb7fc8c nfssvc_iod(c123b538,fbb7fd08,c108f880,3d7,0,...) at nfssvc_iod+0x139/frame 0xfbb7fccc fork_exit(c09d1670,c123b538,fbb7fd08) at fork_exit+0x7f/frame 0xfbb7fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xfbb7fcf4 --- trap 0, eip = 0, esp = 0xfbb7fd40, ebp = 0 --- Tracing command newnfs 17 pid 96760 tid 100455 td 0xc8ad2000 sched_switch(c8ad2000,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfbae0b58 mi_switch(104,0,c109b989,1f5,c8ad2000,...) at mi_switch+0x1c9/frame 0xfbae0b8c sleepq_switch(c8ad2000,0,c109b989,1ab,8,...) at sleepq_switch+0x1b9/frame 0xfbae0bc0 sleepq_catch_signals(c0ae0150,c8ad2000,2,101,2,...) at sleepq_catch_signals+0x3a1/frame 0xfbae0c08 sleepq_timedwait_sig(c140a904,6c,77,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xfbae0c30 _sleep(c140a904,c140a888,16c,c1081d06,ffff7540,...) at _sleep+0x331/frame 0xfbae0c8c nfssvc_iod(c123b534,fbae0d08,c108f880,3d7,0,...) at nfssvc_iod+0x139/frame 0xfbae0ccc fork_exit(c09d1670,c123b534,fbae0d08) at fork_exit+0x7f/frame 0xfbae0cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xfbae0cf4 --- trap 0, eip = 0, esp = 0xfbae0d40, ebp = 0 --- Tracing command newnfs 16 pid 96759 tid 100476 td 0xc8adb300 sched_switch(c8adb300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfbb1fb58 mi_switch(104,0,c109b989,1f5,c8adb300,...) at mi_switch+0x1c9/frame 0xfbb1fb8c sleepq_switch(c8adb300,0,c109b989,1ab,8,...) at sleepq_switch+0x1b9/frame 0xfbb1fbc0 sleepq_catch_signals(c0ae0150,c8adb300,3,101,3,...) at sleepq_catch_signals+0x3a1/frame 0xfbb1fc08 sleepq_timedwait_sig(c140a900,6c,77,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xfbb1fc30 _sleep(c140a900,c140a888,16c,c1081d06,ffff7540,...) at _sleep+0x331/frame 0xfbb1fc8c nfssvc_iod(c123b530,fbb1fd08,c108f880,3d7,0,...) at nfssvc_iod+0x139/frame 0xfbb1fccc fork_exit(c09d1670,c123b530,fbb1fd08) at fork_exit+0x7f/frame 0xfbb1fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xfbb1fcf4 --- trap 0, eip = 0, esp = 0xfbb1fd40, ebp = 0 --- Tracing command newnfs 15 pid 96758 tid 100291 td 0xca698c00 sched_switch(ca698c00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb817b58 mi_switch(104,0,c109b989,1f5,ca698c00,...) at mi_switch+0x1c9/frame 0xfb817b8c sleepq_switch(ca698c00,0,c109b989,1ab,8,...) at sleepq_switch+0x1b9/frame 0xfb817bc0 sleepq_catch_signals(c0ae0150,ca698c00,1,101,1,...) at sleepq_catch_signals+0x3a1/frame 0xfb817c08 sleepq_timedwait_sig(c140a8fc,6c,77,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xfb817c30 _sleep(c140a8fc,c140a888,16c,c1081d06,ffff7540,...) at _sleep+0x331/frame 0xfb817c8c nfssvc_iod(c123b52c,fb817d08,c108f880,3d7,0,...) at nfssvc_iod+0x139/frame 0xfb817ccc fork_exit(c09d1670,c123b52c,fb817d08) at fork_exit+0x7f/frame 0xfb817cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xfb817cf4 --- trap 0, eip = 0, esp = 0xfb817d40, ebp = 0 --- Tracing command newnfs 14 pid 96757 tid 100260 td 0xca6aac00 sched_switch(ca6aac00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb7abb58 mi_switch(104,0,c109b989,1f5,ca6aac00,...) at mi_switch+0x1c9/frame 0xfb7abb8c sleepq_switch(ca6aac00,0,c109b989,1ab,8,...) at sleepq_switch+0x1b9/frame 0xfb7abbc0 sleepq_catch_signals(c0ae0150,ca6aac00,1,101,1,...) at sleepq_catch_signals+0x3a1/frame 0xfb7abc08 sleepq_timedwait_sig(c140a8f8,6c,77,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xfb7abc30 _sleep(c140a8f8,c140a888,16c,c1081d06,ffff7540,...) at _sleep+0x331/frame 0xfb7abc8c nfssvc_iod(c123b528,fb7abd08,c108f880,3d7,0,...) at nfssvc_iod+0x139/frame 0xfb7abccc fork_exit(c09d1670,c123b528,fb7abd08) at fork_exit+0x7f/frame 0xfb7abcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xfb7abcf4 --- trap 0, eip = 0, esp = 0xfb7abd40, ebp = 0 --- Tracing command newnfs 13 pid 96756 tid 100241 td 0xca5b7600 sched_switch(ca5b7600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb767b58 mi_switch(104,0,c109b989,1f5,ca5b7600,...) at mi_switch+0x1c9/frame 0xfb767b8c sleepq_switch(ca5b7600,0,c109b989,1ab,8,...) at sleepq_switch+0x1b9/frame 0xfb767bc0 sleepq_catch_signals(c0ae0150,ca5b7600,3,101,3,...) at sleepq_catch_signals+0x3a1/frame 0xfb767c08 sleepq_timedwait_sig(c140a8f4,6c,77,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xfb767c30 _sleep(c140a8f4,c140a888,16c,c1081d06,ffff7540,...) at _sleep+0x331/frame 0xfb767c8c nfssvc_iod(c123b524,fb767d08,c108f880,3d7,0,...) at nfssvc_iod+0x139/frame 0xfb767ccc fork_exit(c09d1670,c123b524,fb767d08) at fork_exit+0x7f/frame 0xfb767cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xfb767cf4 --- trap 0, eip = 0, esp = 0xfb767d40, ebp = 0 --- Tracing command newnfs 12 pid 96755 tid 100277 td 0xca784600 sched_switch(ca784600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb7e4b58 mi_switch(104,0,c109b989,1f5,ca784600,...) at mi_switch+0x1c9/frame 0xfb7e4b8c sleepq_switch(ca784600,0,c109b989,1ab,8,...) at sleepq_switch+0x1b9/frame 0xfb7e4bc0 sleepq_catch_signals(c0ae0150,ca784600,2,101,2,...) at sleepq_catch_signals+0x3a1/frame 0xfb7e4c08 sleepq_timedwait_sig(c140a8f0,6c,77,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xfb7e4c30 _sleep(c140a8f0,c140a888,16c,c1081d06,ffff7540,...) at _sleep+0x331/frame 0xfb7e4c8c nfssvc_iod(c123b520,fb7e4d08,c108f880,3d7,0,...) at nfssvc_iod+0x139/frame 0xfb7e4ccc fork_exit(c09d1670,c123b520,fb7e4d08) at fork_exit+0x7f/frame 0xfb7e4cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xfb7e4cf4 --- trap 0, eip = 0, esp = 0xfb7e4d40, ebp = 0 --- Tracing command newnfs 11 pid 96753 tid 100293 td 0xca7fe600 sched_switch(ca7fe600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb81db58 mi_switch(104,0,c109b989,1f5,ca7fe600,...) at mi_switch+0x1c9/frame 0xfb81db8c sleepq_switch(ca7fe600,0,c109b989,1ab,8,...) at sleepq_switch+0x1b9/frame 0xfb81dbc0 sleepq_catch_signals(c0ae0150,ca7fe600,2,101,2,...) at sleepq_catch_signals+0x3a1/frame 0xfb81dc08 sleepq_timedwait_sig(c140a8ec,6c,77,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xfb81dc30 _sleep(c140a8ec,c140a888,16c,c1081d06,ffff7540,...) at _sleep+0x331/frame 0xfb81dc8c nfssvc_iod(c123b51c,fb81dd08,c108f880,3d7,0,...) at nfssvc_iod+0x139/frame 0xfb81dccc fork_exit(c09d1670,c123b51c,fb81dd08) at fork_exit+0x7f/frame 0xfb81dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xfb81dcf4 --- trap 0, eip = 0, esp = 0xfb81dd40, ebp = 0 --- Tracing command newnfs 10 pid 96752 tid 100297 td 0xca7ad300 sched_switch(ca7ad300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb82ab58 mi_switch(104,0,c109b989,1f5,ca7ad300,...) at mi_switch+0x1c9/frame 0xfb82ab8c sleepq_switch(ca7ad300,0,c109b989,1ab,8,...) at sleepq_switch+0x1b9/frame 0xfb82abc0 sleepq_catch_signals(c0ae0150,ca7ad300,3,101,3,...) at sleepq_catch_signals+0x3a1/frame 0xfb82ac08 sleepq_timedwait_sig(c140a8e8,6c,77,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xfb82ac30 _sleep(c140a8e8,c140a888,16c,c1081d06,ffff7540,...) at _sleep+0x331/frame 0xfb82ac8c nfssvc_iod(c123b518,fb82ad08,c108f880,3d7,0,...) at nfssvc_iod+0x139/frame 0xfb82accc fork_exit(c09d1670,c123b518,fb82ad08) at fork_exit+0x7f/frame 0xfb82acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xfb82acf4 --- trap 0, eip = 0, esp = 0xfb82ad40, ebp = 0 --- Tracing command newnfs 9 pid 96751 tid 100318 td 0xca783300 sched_switch(ca783300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb872b58 mi_switch(104,0,c109b989,1f5,ca783300,...) at mi_switch+0x1c9/frame 0xfb872b8c sleepq_switch(ca783300,0,c109b989,1ab,8,...) at sleepq_switch+0x1b9/frame 0xfb872bc0 sleepq_catch_signals(c0ae0150,ca783300,1,101,1,...) at sleepq_catch_signals+0x3a1/frame 0xfb872c08 sleepq_timedwait_sig(c140a8e4,6c,77,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xfb872c30 _sleep(c140a8e4,c140a888,16c,c1081d06,ffff7540,...) at _sleep+0x331/frame 0xfb872c8c nfssvc_iod(c123b514,fb872d08,c108f880,3d7,0,...) at nfssvc_iod+0x139/frame 0xfb872ccc fork_exit(c09d1670,c123b514,fb872d08) at fork_exit+0x7f/frame 0xfb872cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xfb872cf4 --- trap 0, eip = 0, esp = 0xfb872d40, ebp = 0 --- Tracing command newnfs 8 pid 96750 tid 100314 td 0xca786600 sched_switch(ca786600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb866b58 mi_switch(104,0,c109b989,1f5,ca786600,...) at mi_switch+0x1c9/frame 0xfb866b8c sleepq_switch(ca786600,0,c109b989,1ab,8,...) at sleepq_switch+0x1b9/frame 0xfb866bc0 sleepq_catch_signals(c0ae0150,ca786600,1,101,1,...) at sleepq_catch_signals+0x3a1/frame 0xfb866c08 sleepq_timedwait_sig(c140a8e0,6c,77,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xfb866c30 _sleep(c140a8e0,c140a888,16c,c1081d06,ffff7540,...) at _sleep+0x331/frame 0xfb866c8c nfssvc_iod(c123b510,fb866d08,c108f880,3d7,0,...) at nfssvc_iod+0x139/frame 0xfb866ccc fork_exit(c09d1670,c123b510,fb866d08) at fork_exit+0x7f/frame 0xfb866cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xfb866cf4 --- trap 0, eip = 0, esp = 0xfb866d40, ebp = 0 --- Tracing command newnfs 7 pid 96749 tid 100326 td 0xca7f9300 sched_switch(ca7f9300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb88ab58 mi_switch(104,0,c109b989,1f5,ca7f9300,...) at mi_switch+0x1c9/frame 0xfb88ab8c sleepq_switch(ca7f9300,0,c109b989,1ab,8,...) at sleepq_switch+0x1b9/frame 0xfb88abc0 sleepq_catch_signals(c0ae0150,ca7f9300,3,101,3,...) at sleepq_catch_signals+0x3a1/frame 0xfb88ac08 sleepq_timedwait_sig(c140a8dc,6c,77,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xfb88ac30 _sleep(c140a8dc,c140a888,16c,c1081d06,ffff7540,...) at _sleep+0x331/frame 0xfb88ac8c nfssvc_iod(c123b50c,fb88ad08,c108f880,3d7,0,...) at nfssvc_iod+0x139/frame 0xfb88accc fork_exit(c09d1670,c123b50c,fb88ad08) at fork_exit+0x7f/frame 0xfb88acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xfb88acf4 --- trap 0, eip = 0, esp = 0xfb88ad40, ebp = 0 --- Tracing command newnfs 6 pid 96748 tid 100475 td 0xc8adb600 sched_switch(c8adb600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfbb1cb58 mi_switch(104,0,c109b989,1f5,c8adb600,...) at mi_switch+0x1c9/frame 0xfbb1cb8c sleepq_switch(c8adb600,0,c109b989,1ab,8,...) at sleepq_switch+0x1b9/frame 0xfbb1cbc0 sleepq_catch_signals(c0ae0150,c8adb600,3,101,3,...) at sleepq_catch_signals+0x3a1/frame 0xfbb1cc08 sleepq_timedwait_sig(c140a8d8,6c,77,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xfbb1cc30 _sleep(c140a8d8,c140a888,16c,c1081d06,ffff7540,...) at _sleep+0x331/frame 0xfbb1cc8c nfssvc_iod(c123b508,fbb1cd08,c108f880,3d7,0,...) at nfssvc_iod+0x139/frame 0xfbb1cccc fork_exit(c09d1670,c123b508,fbb1cd08) at fork_exit+0x7f/frame 0xfbb1ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xfbb1ccf4 --- trap 0, eip = 0, esp = 0xfbb1cd40, ebp = 0 --- Tracing command newnfs 5 pid 74004 tid 100172 td 0xca5c1300 sched_switch(ca5c1300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb654b58 mi_switch(104,0,c109b989,1f5,ca5c1300,...) at mi_switch+0x1c9/frame 0xfb654b8c sleepq_switch(ca5c1300,0,c109b989,1ab,8,...) at sleepq_switch+0x1b9/frame 0xfb654bc0 sleepq_catch_signals(c0ae0150,ca5c1300,2,101,2,...) at sleepq_catch_signals+0x3a1/frame 0xfb654c08 sleepq_timedwait_sig(c140a8d4,6c,77,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xfb654c30 _sleep(c140a8d4,c140a888,16c,c1081d06,ffff7540,...) at _sleep+0x331/frame 0xfb654c8c nfssvc_iod(c123b504,fb654d08,c108f880,3d7,0,...) at nfssvc_iod+0x139/frame 0xfb654ccc fork_exit(c09d1670,c123b504,fb654d08) at fork_exit+0x7f/frame 0xfb654cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xfb654cf4 --- trap 0, eip = 0, esp = 0xfb654d40, ebp = 0 --- Tracing command newnfs 4 pid 74003 tid 100497 td 0xc8aef600 sched_switch(c8aef600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfbb5eb58 mi_switch(104,0,c109b989,1f5,c8aef600,...) at mi_switch+0x1c9/frame 0xfbb5eb8c sleepq_switch(c8aef600,0,c109b989,1ab,8,...) at sleepq_switch+0x1b9/frame 0xfbb5ebc0 sleepq_catch_signals(c0ae0150,c8aef600,0,101,0,...) at sleepq_catch_signals+0x3a1/frame 0xfbb5ec08 sleepq_timedwait_sig(c140a8d0,6c,77,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xfbb5ec30 _sleep(c140a8d0,c140a888,16c,c1081d06,ffff7540,...) at _sleep+0x331/frame 0xfbb5ec8c nfssvc_iod(c123b500,fbb5ed08,c108f880,3d7,0,...) at nfssvc_iod+0x139/frame 0xfbb5eccc fork_exit(c09d1670,c123b500,fbb5ed08) at fork_exit+0x7f/frame 0xfbb5ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xfbb5ecf4 --- trap 0, eip = 0, esp = 0xfbb5ed40, ebp = 0 --- Tracing command newnfs 3 pid 74002 tid 100275 td 0xca7af000 sched_switch(ca7af000,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb7ddb58 mi_switch(104,0,c109b989,1f5,ca7af000,...) at mi_switch+0x1c9/frame 0xfb7ddb8c sleepq_switch(ca7af000,0,c109b989,1ab,8,...) at sleepq_switch+0x1b9/frame 0xfb7ddbc0 sleepq_catch_signals(c0ae0150,ca7af000,2,101,2,...) at sleepq_catch_signals+0x3a1/frame 0xfb7ddc08 sleepq_timedwait_sig(c140a8cc,6c,77,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xfb7ddc30 _sleep(c140a8cc,c140a888,16c,c1081d06,ffff7540,...) at _sleep+0x331/frame 0xfb7ddc8c nfssvc_iod(c123b4fc,fb7ddd08,c108f880,3d7,0,...) at nfssvc_iod+0x139/frame 0xfb7ddccc fork_exit(c09d1670,c123b4fc,fb7ddd08) at fork_exit+0x7f/frame 0xfb7ddcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xfb7ddcf4 --- trap 0, eip = 0, esp = 0xfb7ddd40, ebp = 0 --- Tracing command newnfs 2 pid 74001 tid 100269 td 0xca785000 sched_switch(ca785000,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb7c9b58 mi_switch(104,0,c109b989,1f5,ca785000,...) at mi_switch+0x1c9/frame 0xfb7c9b8c sleepq_switch(ca785000,0,c109b989,1ab,8,...) at sleepq_switch+0x1b9/frame 0xfb7c9bc0 sleepq_catch_signals(c0ae0150,ca785000,0,101,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb7c9c08 sleepq_timedwait_sig(c140a8c8,6c,77,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xfb7c9c30 _sleep(c140a8c8,c140a888,16c,c1081d06,ffff7540,...) at _sleep+0x331/frame 0xfb7c9c8c nfssvc_iod(c123b4f8,fb7c9d08,c108f880,3d7,0,...) at nfssvc_iod+0x139/frame 0xfb7c9ccc fork_exit(c09d1670,c123b4f8,fb7c9d08) at fork_exit+0x7f/frame 0xfb7c9cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xfb7c9cf4 --- trap 0, eip = 0, esp = 0xfb7c9d40, ebp = 0 --- Tracing command newnfs 1 pid 74000 tid 100417 td 0xc9f75c00 sched_switch(c9f75c00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfba6eb58 mi_switch(104,0,c109b989,1f5,c9f75c00,...) at mi_switch+0x1c9/frame 0xfba6eb8c sleepq_switch(c9f75c00,0,c109b989,1ab,8,...) at sleepq_switch+0x1b9/frame 0xfba6ebc0 sleepq_catch_signals(c0ae0150,c9f75c00,0,101,0,...) at sleepq_catch_signals+0x3a1/frame 0xfba6ec08 sleepq_timedwait_sig(c140a8c4,6c,77,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xfba6ec30 _sleep(c140a8c4,c140a888,16c,c1081d06,ffff7540,...) at _sleep+0x331/frame 0xfba6ec8c nfssvc_iod(c123b4f4,fba6ed08,c108f880,3d7,0,...) at nfssvc_iod+0x139/frame 0xfba6eccc fork_exit(c09d1670,c123b4f4,fba6ed08) at fork_exit+0x7f/frame 0xfba6ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xfba6ecf4 --- trap 0, eip = 0, esp = 0xfba6ed40, ebp = 0 --- Tracing command newnfs 0 pid 66634 tid 100483 td 0xc8ad2c00 sched_switch(c8ad2c00,0,103,1b0,0,...) at sched_switch+0x4b4/frame 0xfbb34a94 mi_switch(103,0,c109c55c,2e6,1a75,...) at mi_switch+0x1c9/frame 0xfbb34ac8 turnstile_wait(c921e680,ca785000,0,c10a65af,975,...) at turnstile_wait+0x3b4/frame 0xfbb34af8 __rw_wlock_hard(cb81541c,c8ad2c00,c10a36f6,edd,0,...) at __rw_wlock_hard+0x343/frame 0xfbb34b74 _rw_wlock_cookie(cb81541c,c10a36f6,edd,1137,c10a36f6,...) at _rw_wlock_cookie+0xdd/frame 0xfbb34ba4 bufdone_finish(e39b316c,c981cde8,c8ad2c00,cd05a000,46,...) at bufdone_finish+0xbe/frame 0xfbb34bf8 bufdone(e39b316c,fbb34c50,c7d71680,708,fbb34c74,...) at bufdone+0xd3/frame 0xfbb34c18 ncl_doio(cf01d168,e39b316c,c7d71680,0,0,...) at ncl_doio+0x68e/frame 0xfbb34c8c nfssvc_iod(c123b4f0,fbb34d08,c108f880,3d7,0,...) at nfssvc_iod+0x276/frame 0xfbb34ccc fork_exit(c09d1670,c123b4f0,fbb34d08) at fork_exit+0x7f/frame 0xfbb34cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xfbb34cf4 --- trap 0, eip = 0, esp = 0xfbb34d40, ebp = 0 --- Tracing command bash pid 1212 tid 100181 td 0xca5b8c00 sched_switch(ca5b8c00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb66f9b8 mi_switch(104,0,c109b989,1f5,46,...) at mi_switch+0x1c9/frame 0xfb66f9ec sleepq_switch(ca5b8c00,0,c109b989,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xfb66fa20 sleepq_catch_signals(fb66fa8c,c0a88f59,c7930c14,0,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb66fa68 sleepq_wait_sig(c7930c70,0,fb66fac0,101,0,...) at sleepq_wait_sig+0x14/frame 0xfb66fa8c _cv_wait_sig(c7930c70,c7930c04,c10a0685,531,fb66fc10,...) at _cv_wait_sig+0x200/frame 0xfb66fad4 tty_wait(c7930c00,c7930c70,fb66fc10,1,0,...) at tty_wait+0x4b/frame 0xfb66faf8 ttydisc_read(c7930c00,fb66fc10,0,a1,fb66fc10,...) at ttydisc_read+0x377/frame 0xfb66fb3c ttydev_read(c7c08900,fb66fc10,0,1,0,...) at ttydev_read+0x81/frame 0xfb66fb5c devfs_read_f(c86c2850,fb66fc10,c7d06c00,0,ca5b8c00,...) at devfs_read_f+0x87/frame 0xfb66fb90 dofileread(c86c2850,fb66fc10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xfb66fbc4 kern_readv(ca5b8c00,0,fb66fc10,0,bfbfd00f,...) at kern_readv+0x66/frame 0xfb66fbf0 sys_read(ca5b8c00,fb66fcc8,c0ebf800,c71fac90,0,...) at sys_read+0x5c/frame 0xfb66fc40 syscall(fb66fd08) at syscall+0x2ed/frame 0xfb66fcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb66fcfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2835fca7, esp = 0xbfbfcfec, ebp = 0xbfbfd018 --- Tracing command sshd pid 1211 tid 100180 td 0xca5c0000 sched_switch(ca5c0000,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb66c900 mi_switch(104,0,c109b989,1f5,200046,...) at mi_switch+0x1c9/frame 0xfb66c934 sleepq_switch(ca5c0000,0,c109b989,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xfb66c968 sleepq_catch_signals(fb66c9d4,c0a88f59,c81b81a0,0,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb66c9b0 sleepq_wait_sig(c81b81a4,0,fb66ca08,101,0,...) at sleepq_wait_sig+0x14/frame 0xfb66c9d4 _cv_wait_sig(c81b81a4,c81b8190,c109e671,68e,c10a1131,...) at _cv_wait_sig+0x200/frame 0xfb66ca1c seltdwait(ffffffff,0,0,ca5c0000,0,...) at seltdwait+0x90/frame 0xfb66ca50 kern_select(ca5c0000,c,28c0c1c8,28c0c1d0,0,...) at kern_select+0x88c/frame 0xfb66cbf8 sys_select(ca5c0000,fb66ccc8,8,c10963d4,db,...) at sys_select+0x69/frame 0xfb66cc40 syscall(fb66cd08) at syscall+0x2ed/frame 0xfb66ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb66ccfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28523c67, esp = 0xbfbfd3cc, ebp = 0xbfbfd418 --- Tracing command sshd pid 1209 tid 100178 td 0xca5c8000 sched_switch(ca5c8000,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb666980 mi_switch(104,0,c109b989,1f5,200046,...) at mi_switch+0x1c9/frame 0xfb6669b4 sleepq_switch(ca5c8000,0,c109b989,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xfb6669e8 sleepq_catch_signals(fb666a54,c0a88f59,c7893860,0,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb666a30 sleepq_wait_sig(c7893864,0,fb666a88,101,0,...) at sleepq_wait_sig+0x14/frame 0xfb666a54 _cv_wait_sig(c7893864,c7893850,c109e671,68e,5c3,...) at _cv_wait_sig+0x200/frame 0xfb666a9c seltdwait(ffffffff,0,0,ca5c8000,c11cc43c,...) at seltdwait+0x90/frame 0xfb666ad0 sys_poll(ca5c8000,fb666cc8,c0ebf800,c1825c90,0,...) at sys_poll+0x44c/frame 0xfb666c40 syscall(fb666d08) at syscall+0x2ed/frame 0xfb666cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb666cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284ba40f, esp = 0xbfbfd414, ebp = 0xbfbfd460 --- Tracing command awk pid 1193 tid 100165 td 0xca5bb300 sched_switch(ca5bb300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb63fa1c mi_switch(104,0,c109b989,1f5,c109b989,...) at mi_switch+0x1c9/frame 0xfb63fa50 sleepq_switch(ca5bb300,0,c109b989,1ab,fb63fac8,...) at sleepq_switch+0x1b9/frame 0xfb63fa84 sleepq_catch_signals(0,c109b989,162,1248,ca5bb300,...) at sleepq_catch_signals+0x3a1/frame 0xfb63facc sleepq_wait_sig(ca44f330,5c,c109e8b6,100,0,...) at sleepq_wait_sig+0x14/frame 0xfb63faf0 _sleep(ca44f330,ca44f4b0,15c,c109e8b6,0,...) at _sleep+0x35b/frame 0xfb63fb4c pipe_read(c86c2a80,fb63fc10,c8078e80,0,ca5bb300,...) at pipe_read+0x2dc/frame 0xfb63fb90 dofileread(c86c2a80,fb63fc10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xfb63fbc4 kern_readv(ca5bb300,0,fb63fc10,fb63fc4c,28855000,...) at kern_readv+0x66/frame 0xfb63fbf0 sys_read(ca5bb300,fb63fcc8,c0ebf800,c71fac90,0,...) at sys_read+0x5c/frame 0xfb63fc40 syscall(fb63fd08) at syscall+0x2ed/frame 0xfb63fcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb63fcfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281c2ca7, esp = 0xbfbfd9e4, ebp = 0xbfbfd9f8 --- Tracing command sh pid 1192 tid 100164 td 0xca5bb600 sched_switch(ca5bb600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb63c98c mi_switch(104,0,c109b989,1f5,c109b989,...) at mi_switch+0x1c9/frame 0xfb63c9c0 sleepq_switch(ca5bb600,0,c109b989,1ab,fb63ca38,...) at sleepq_switch+0x1b9/frame 0xfb63c9f4 sleepq_catch_signals(0,c109b989,162,900,ca5bb600,...) at sleepq_catch_signals+0x3a1/frame 0xfb63ca3c sleepq_wait_sig(ca596000,6c,c109eda5,100,0,...) at sleepq_wait_sig+0x14/frame 0xfb63ca60 _sleep(ca596000,ca596094,16c,c109eda5,0,...) at _sleep+0x35b/frame 0xfb63cabc kern_wait6(ca5bb600,7,0,0,fb63cb4c,...) at kern_wait6+0x45c/frame 0xfb63cb20 sys_wait4(ca5bb600,fb63ccc8,c0ebf800,c1825c90,0,...) at sys_wait4+0x94/frame 0xfb63cc40 syscall(fb63cd08) at syscall+0x2ed/frame 0xfb63ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb63ccfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815233f, esp = 0xbfbfd9b8, ebp = 0xbfbfd9d0 --- Tracing command tail pid 1191 tid 100163 td 0xc8888600 sched_switch(c8888600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb63993c mi_switch(104,0,c109b989,1f5,2,...) at mi_switch+0x1c9/frame 0xfb639970 sleepq_switch(c8888600,0,c109b989,1ab,8,...) at sleepq_switch+0x1b9/frame 0xfb6399a4 sleepq_catch_signals(c0ae0150,c8888600,2,201,2,...) at sleepq_catch_signals+0x3a1/frame 0xfb6399ec sleepq_timedwait_sig(c7d71980,68,1a76,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xfb639a14 _sleep(c7d71980,c7d71980,168,c108f38e,8c8f6009,...) at _sleep+0x331/frame 0xfb639a70 kern_kevent(c8888600,4,0,1,fb639c10,...) at kern_kevent+0x438/frame 0xfb639bb8 sys_kevent(c8888600,fb639cc8,7b3,0,fb639cc4,...) at sys_kevent+0x12b/frame 0xfb639c40 syscall(fb639d08) at syscall+0x2ed/frame 0xfb639cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb639cfc --- syscall (363, FreeBSD ELF32, sys_kevent), eip = 0x2816819f, esp = 0xbfbfdb9c, ebp = 0xbfbfdc48 --- Tracing command top pid 1190 tid 100162 td 0xc7de0000 sched_switch(c7de0000,0,103,1b0,0,...) at sched_switch+0x4b4/frame 0xfb636a34 mi_switch(103,0,c109c55c,2e6,1a75,...) at mi_switch+0x1c9/frame 0xfb636a68 turnstile_wait(c9629e80,cbbee600,0,c13bebf4,c7de0000,...) at turnstile_wait+0x3b4/frame 0xfb636a98 __rw_wlock_hard(c13d1a90,c7de0000,c10ec202,12d4,0,...) at __rw_wlock_hard+0x343/frame 0xfb636b18 _rw_wlock_cookie(c13d1a90,c10ec202,12d4,12c9,c0d30706,...) at _rw_wlock_cookie+0xdd/frame 0xfb636b48 pmap_clear_modify(c28b4d40,0,c10d2635,463,c7de0000,...) at pmap_clear_modify+0x6c/frame 0xfb636b78 vm_object_madvise(ca5a7c24,6cd,0,6f2,0,...) at vm_object_madvise+0x7c/frame 0xfb636bc4 vm_map_madvise(c85f6740,288dc000,28901000,5,0,...) at vm_map_madvise+0x2ef/frame 0xfb636c1c sys_madvise(c7de0000,fb636cc8,c0ebf800,c71fdc90,0,...) at sys_madvise+0xcf/frame 0xfb636c40 syscall(fb636d08) at syscall+0x2ed/frame 0xfb636cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb636cfc --- syscall (75, FreeBSD ELF32, sys_madvise), eip = 0x28157ebf, esp = 0xbfbfd964, ebp = 0xbfbfd978 --- Tracing command sshd pid 1189 tid 100161 td 0xc888b300 sched_switch(c888b300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb633900 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xfb633934 sleepq_switch(c888b300,0,c109b989,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xfb633968 sleepq_catch_signals(fb6339d4,c0a88f59,c7894520,0,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb6339b0 sleepq_wait_sig(c7894524,0,fb633a08,101,0,...) at sleepq_wait_sig+0x14/frame 0xfb6339d4 _cv_wait_sig(c7894524,c7894510,c109e671,68e,5c1,...) at _cv_wait_sig+0x200/frame 0xfb633a1c seltdwait(ffffffff,0,0,c888b300,0,...) at seltdwait+0x90/frame 0xfb633a50 kern_select(c888b300,c,28c0c1c8,28c0c1d0,0,...) at kern_select+0x88c/frame 0xfb633bf8 sys_select(c888b300,fb633cc8,c0ebf800,c7200c90,0,...) at sys_select+0x69/frame 0xfb633c40 syscall(fb633d08) at syscall+0x2ed/frame 0xfb633cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb633cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28523c67, esp = 0xbfbfd3cc, ebp = 0xbfbfd418 --- Tracing command sshd pid 1188 tid 100160 td 0xc8888900 sched_switch(c8888900,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb630900 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xfb630934 sleepq_switch(c8888900,0,c109b989,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xfb630968 sleepq_catch_signals(fb6309d4,c0a88f59,c80a75a0,0,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb6309b0 sleepq_wait_sig(c80a75a4,0,fb630a08,101,0,...) at sleepq_wait_sig+0x14/frame 0xfb6309d4 _cv_wait_sig(c80a75a4,c80a7590,c109e671,68e,c10a1131,...) at _cv_wait_sig+0x200/frame 0xfb630a1c seltdwait(ffffffff,0,0,c8888900,0,...) at seltdwait+0x90/frame 0xfb630a50 kern_select(c8888900,a,28c0c1c8,28c0c1d0,0,...) at kern_select+0x88c/frame 0xfb630bf8 sys_select(c8888900,fb630cc8,c0ebf800,c7200c90,0,...) at sys_select+0x69/frame 0xfb630c40 syscall(fb630d08) at syscall+0x2ed/frame 0xfb630cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb630cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28523c67, esp = 0xbfbfd3cc, ebp = 0xbfbfd418 --- Tracing command sh pid 1187 tid 100159 td 0xc7de0300 Tracing command sshd pid 1186 tid 100158 td 0xc8888c00 sched_switch(c8888c00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb62a900 mi_switch(104,0,c109b989,1f5,200046,...) at mi_switch+0x1c9/frame 0xfb62a934 sleepq_switch(c8888c00,0,c109b989,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xfb62a968 sleepq_catch_signals(fb62a9d4,c0a88f59,c78938e0,0,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb62a9b0 sleepq_wait_sig(c78938e4,0,fb62aa08,101,0,...) at sleepq_wait_sig+0x14/frame 0xfb62a9d4 _cv_wait_sig(c78938e4,c78938d0,c109e671,68e,5c1,...) at _cv_wait_sig+0x200/frame 0xfb62aa1c seltdwait(ffffffff,0,0,c8888c00,0,...) at seltdwait+0x90/frame 0xfb62aa50 kern_select(c8888c00,c,28c0c1c8,28c0c1d0,0,...) at kern_select+0x88c/frame 0xfb62abf8 sys_select(c8888c00,fb62acc8,c0ebf800,c7200c90,0,...) at sys_select+0x69/frame 0xfb62ac40 syscall(fb62ad08) at syscall+0x2ed/frame 0xfb62acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb62acfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28523c67, esp = 0xbfbfd3cc, ebp = 0xbfbfd418 --- Tracing command sshd pid 1182 tid 100155 td 0xc8889600 sched_switch(c8889600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb621980 mi_switch(104,0,c109b989,1f5,200046,...) at mi_switch+0x1c9/frame 0xfb6219b4 sleepq_switch(c8889600,0,c109b989,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xfb6219e8 sleepq_catch_signals(fb621a54,c0a88f59,c78938a0,0,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb621a30 sleepq_wait_sig(c78938a4,0,fb621a88,101,0,...) at sleepq_wait_sig+0x14/frame 0xfb621a54 _cv_wait_sig(c78938a4,c7893890,c109e671,68e,5c3,...) at _cv_wait_sig+0x200/frame 0xfb621a9c seltdwait(ffffffff,0,0,c8889600,0,...) at seltdwait+0x90/frame 0xfb621ad0 sys_poll(c8889600,fb621cc8,14,c10982d9,7b3,...) at sys_poll+0x44c/frame 0xfb621c40 syscall(fb621d08) at syscall+0x2ed/frame 0xfb621cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb621cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284ba40f, esp = 0xbfbfd414, ebp = 0xbfbfd460 --- Tracing command sshd pid 1181 tid 100154 td 0xc8889900 sched_switch(c8889900,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb61e980 mi_switch(104,0,c109b989,1f5,200046,...) at mi_switch+0x1c9/frame 0xfb61e9b4 sleepq_switch(c8889900,0,c109b989,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xfb61e9e8 sleepq_catch_signals(fb61ea54,c0a88f59,c7894560,0,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb61ea30 sleepq_wait_sig(c7894564,0,fb61ea88,101,0,...) at sleepq_wait_sig+0x14/frame 0xfb61ea54 _cv_wait_sig(c7894564,c7894550,c109e671,68e,5c3,...) at _cv_wait_sig+0x200/frame 0xfb61ea9c seltdwait(ffffffff,0,0,c8889900,0,...) at seltdwait+0x90/frame 0xfb61ead0 sys_poll(c8889900,fb61ecc8,c0ebf800,c71fac90,0,...) at sys_poll+0x44c/frame 0xfb61ec40 syscall(fb61ed08) at syscall+0x2ed/frame 0xfb61ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb61ecfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284ba40f, esp = 0xbfbfd414, ebp = 0xbfbfd460 --- Tracing command sshd pid 1180 tid 100112 td 0xc7de4900 sched_switch(c7de4900,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb580980 mi_switch(104,0,c109b989,1f5,200046,...) at mi_switch+0x1c9/frame 0xfb5809b4 sleepq_switch(c7de4900,0,c109b989,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xfb5809e8 sleepq_catch_signals(fb580a54,c0a88f59,c78945a0,0,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb580a30 sleepq_wait_sig(c78945a4,0,fb580a88,101,0,...) at sleepq_wait_sig+0x14/frame 0xfb580a54 _cv_wait_sig(c78945a4,c7894590,c109e671,68e,5c3,...) at _cv_wait_sig+0x200/frame 0xfb580a9c seltdwait(ffffffff,0,0,c7de4900,0,...) at seltdwait+0x90/frame 0xfb580ad0 sys_poll(c7de4900,fb580cc8,14,c10982d9,7b3,...) at sys_poll+0x44c/frame 0xfb580c40 syscall(fb580d08) at syscall+0x2ed/frame 0xfb580cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb580cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284ba40f, esp = 0xbfbfd414, ebp = 0xbfbfd460 --- Tracing command sh pid 997 tid 100125 td 0xc7e00000 Tracing command getty pid 972 tid 100140 td 0xca460000 sched_switch(ca460000,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb5f49b8 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xfb5f49ec sleepq_switch(ca460000,0,c109b989,1ab,fb5f4a64,...) at sleepq_switch+0x1b9/frame 0xfb5f4a20 sleepq_catch_signals(0,c109b989,162,ab0,1,...) at sleepq_catch_signals+0x3a1/frame 0xfb5f4a68 sleepq_wait_sig(c7930270,0,c10a0699,101,0,...) at sleepq_wait_sig+0x14/frame 0xfb5f4a8c _cv_wait_sig(c7930270,c140b624,c10a0685,531,fb5f4c10,...) at _cv_wait_sig+0x200/frame 0xfb5f4ad4 tty_wait(c7930200,c7930270,fb5f4c10,1,0,...) at tty_wait+0x4b/frame 0xfb5f4af8 ttydisc_read(c7930200,fb5f4c10,0,a1,fb5f4c10,...) at ttydisc_read+0x377/frame 0xfb5f4b3c ttydev_read(c788aa00,fb5f4c10,0,1,0,...) at ttydev_read+0x81/frame 0xfb5f4b5c devfs_read_f(c7db17a8,fb5f4c10,c76a9e00,0,ca460000,...) at devfs_read_f+0x87/frame 0xfb5f4b90 dofileread(c7db17a8,fb5f4c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xfb5f4bc4 kern_readv(ca460000,0,fb5f4c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xfb5f4bf0 sys_read(ca460000,fb5f4cc8,c0ebf800,c71fac90,0,...) at sys_read+0x5c/frame 0xfb5f4c40 syscall(fb5f4d08) at syscall+0x2ed/frame 0xfb5f4cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb5f4cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cca7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 971 tid 100139 td 0xca460300 sched_switch(ca460300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb5f19b8 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xfb5f19ec sleepq_switch(ca460300,0,c109b989,1ab,fb5f1a64,...) at sleepq_switch+0x1b9/frame 0xfb5f1a20 sleepq_catch_signals(0,c109b989,162,ae0,1,...) at sleepq_catch_signals+0x3a1/frame 0xfb5f1a68 sleepq_wait_sig(c7930470,0,c10a0699,101,0,...) at sleepq_wait_sig+0x14/frame 0xfb5f1a8c _cv_wait_sig(c7930470,c140b624,c10a0685,531,fb5f1c10,...) at _cv_wait_sig+0x200/frame 0xfb5f1ad4 tty_wait(c7930400,c7930470,fb5f1c10,1,0,...) at tty_wait+0x4b/frame 0xfb5f1af8 ttydisc_read(c7930400,fb5f1c10,0,a1,fb5f1c10,...) at ttydisc_read+0x377/frame 0xfb5f1b3c ttydev_read(c788ab00,fb5f1c10,0,1,0,...) at ttydev_read+0x81/frame 0xfb5f1b5c devfs_read_f(c86c29a0,fb5f1c10,c76a9e00,0,ca460300,...) at devfs_read_f+0x87/frame 0xfb5f1b90 dofileread(c86c29a0,fb5f1c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xfb5f1bc4 kern_readv(ca460300,0,fb5f1c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xfb5f1bf0 sys_read(ca460300,fb5f1cc8,14,c10982d9,7b3,...) at sys_read+0x5c/frame 0xfb5f1c40 syscall(fb5f1d08) at syscall+0x2ed/frame 0xfb5f1cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb5f1cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cca7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 970 tid 100138 td 0xc7948300 sched_switch(c7948300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb5ee9b8 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xfb5ee9ec sleepq_switch(c7948300,0,c109b989,1ab,fb5eea64,...) at sleepq_switch+0x1b9/frame 0xfb5eea20 sleepq_catch_signals(0,c109b989,162,1200,1,...) at sleepq_catch_signals+0x3a1/frame 0xfb5eea68 sleepq_wait_sig(c778b070,0,c10a0699,101,0,...) at sleepq_wait_sig+0x14/frame 0xfb5eea8c _cv_wait_sig(c778b070,c140b624,c10a0685,531,fb5eec10,...) at _cv_wait_sig+0x200/frame 0xfb5eead4 tty_wait(c778b000,c778b070,fb5eec10,1,0,...) at tty_wait+0x4b/frame 0xfb5eeaf8 ttydisc_read(c778b000,fb5eec10,0,a1,fb5eec10,...) at ttydisc_read+0x377/frame 0xfb5eeb3c ttydev_read(c788ac00,fb5eec10,0,1,0,...) at ttydev_read+0x81/frame 0xfb5eeb5c devfs_read_f(c7da67a8,fb5eec10,c76a9e00,0,c7948300,...) at devfs_read_f+0x87/frame 0xfb5eeb90 dofileread(c7da67a8,fb5eec10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xfb5eebc4 kern_readv(c7948300,0,fb5eec10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xfb5eebf0 sys_read(c7948300,fb5eecc8,c0ebf800,c7200c90,0,...) at sys_read+0x5c/frame 0xfb5eec40 syscall(fb5eed08) at syscall+0x2ed/frame 0xfb5eecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb5eecfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cca7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 969 tid 100137 td 0xc7948600 sched_switch(c7948600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb5eb9b8 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xfb5eb9ec sleepq_switch(c7948600,0,c109b989,1ab,fb5eba64,...) at sleepq_switch+0x1b9/frame 0xfb5eba20 sleepq_catch_signals(0,c109b989,162,1230,1,...) at sleepq_catch_signals+0x3a1/frame 0xfb5eba68 sleepq_wait_sig(c778b270,0,c10a0699,101,0,...) at sleepq_wait_sig+0x14/frame 0xfb5eba8c _cv_wait_sig(c778b270,c140b624,c10a0685,531,fb5ebc10,...) at _cv_wait_sig+0x200/frame 0xfb5ebad4 tty_wait(c778b200,c778b270,fb5ebc10,1,0,...) at tty_wait+0x4b/frame 0xfb5ebaf8 ttydisc_read(c778b200,fb5ebc10,0,a1,fb5ebc10,...) at ttydisc_read+0x377/frame 0xfb5ebb3c ttydev_read(c788ad00,fb5ebc10,0,1,0,...) at ttydev_read+0x81/frame 0xfb5ebb5c devfs_read_f(c7d4f4d0,fb5ebc10,c76a9e00,0,c7948600,...) at devfs_read_f+0x87/frame 0xfb5ebb90 dofileread(c7d4f4d0,fb5ebc10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xfb5ebbc4 kern_readv(c7948600,0,fb5ebc10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xfb5ebbf0 sys_read(c7948600,fb5ebcc8,c0ebf800,c71fdc90,0,...) at sys_read+0x5c/frame 0xfb5ebc40 syscall(fb5ebd08) at syscall+0x2ed/frame 0xfb5ebcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb5ebcfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cca7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 968 tid 100136 td 0xc8889c00 sched_switch(c8889c00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb5e19b8 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xfb5e19ec sleepq_switch(c8889c00,0,c109b989,1ab,fb5e1a64,...) at sleepq_switch+0x1b9/frame 0xfb5e1a20 sleepq_catch_signals(0,c109b989,162,1260,1,...) at sleepq_catch_signals+0x3a1/frame 0xfb5e1a68 sleepq_wait_sig(c778b470,0,c10a0699,101,0,...) at sleepq_wait_sig+0x14/frame 0xfb5e1a8c _cv_wait_sig(c778b470,c140b624,c10a0685,531,fb5e1c10,...) at _cv_wait_sig+0x200/frame 0xfb5e1ad4 tty_wait(c778b400,c778b470,fb5e1c10,1,0,...) at tty_wait+0x4b/frame 0xfb5e1af8 ttydisc_read(c778b400,fb5e1c10,0,a1,fb5e1c10,...) at ttydisc_read+0x377/frame 0xfb5e1b3c ttydev_read(c788ae00,fb5e1c10,0,1,0,...) at ttydev_read+0x81/frame 0xfb5e1b5c devfs_read_f(c7da08f8,fb5e1c10,c76a9e00,0,c8889c00,...) at devfs_read_f+0x87/frame 0xfb5e1b90 dofileread(c7da08f8,fb5e1c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xfb5e1bc4 kern_readv(c8889c00,0,fb5e1c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xfb5e1bf0 sys_read(c8889c00,fb5e1cc8,14,c10982d9,7b3,...) at sys_read+0x5c/frame 0xfb5e1c40 syscall(fb5e1d08) at syscall+0x2ed/frame 0xfb5e1cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb5e1cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cca7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 967 tid 100132 td 0xc888a900 sched_switch(c888a900,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb5d09b8 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xfb5d09ec sleepq_switch(c888a900,0,c109b989,1ab,fb5d0a64,...) at sleepq_switch+0x1b9/frame 0xfb5d0a20 sleepq_catch_signals(0,c109b989,162,1290,1,...) at sleepq_catch_signals+0x3a1/frame 0xfb5d0a68 sleepq_wait_sig(c778b670,0,c10a0699,101,0,...) at sleepq_wait_sig+0x14/frame 0xfb5d0a8c _cv_wait_sig(c778b670,c140b624,c10a0685,531,fb5d0c10,...) at _cv_wait_sig+0x200/frame 0xfb5d0ad4 tty_wait(c778b600,c778b670,fb5d0c10,1,0,...) at tty_wait+0x4b/frame 0xfb5d0af8 ttydisc_read(c778b600,fb5d0c10,0,a1,fb5d0c10,...) at ttydisc_read+0x377/frame 0xfb5d0b3c ttydev_read(c792a000,fb5d0c10,0,1,0,...) at ttydev_read+0x81/frame 0xfb5d0b5c devfs_read_f(c86c2ab8,fb5d0c10,c76a9e00,0,c888a900,...) at devfs_read_f+0x87/frame 0xfb5d0b90 dofileread(c86c2ab8,fb5d0c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xfb5d0bc4 kern_readv(c888a900,0,fb5d0c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xfb5d0bf0 sys_read(c888a900,fb5d0cc8,c0ebf800,c1825c90,0,...) at sys_read+0x5c/frame 0xfb5d0c40 syscall(fb5d0d08) at syscall+0x2ed/frame 0xfb5d0cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb5d0cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cca7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 966 tid 100094 td 0xc7d3c300 sched_switch(c7d3c300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb4f09b8 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xfb4f09ec sleepq_switch(c7d3c300,0,c109b989,1ab,fb4f0a64,...) at sleepq_switch+0x1b9/frame 0xfb4f0a20 sleepq_catch_signals(0,c109b989,162,12c0,1,...) at sleepq_catch_signals+0x3a1/frame 0xfb4f0a68 sleepq_wait_sig(c778b870,0,c10a0699,101,0,...) at sleepq_wait_sig+0x14/frame 0xfb4f0a8c _cv_wait_sig(c778b870,c140b624,c10a0685,531,fb4f0c10,...) at _cv_wait_sig+0x200/frame 0xfb4f0ad4 tty_wait(c778b800,c778b870,fb4f0c10,1,0,...) at tty_wait+0x4b/frame 0xfb4f0af8 ttydisc_read(c778b800,fb4f0c10,0,a1,fb4f0c10,...) at ttydisc_read+0x377/frame 0xfb4f0b3c ttydev_read(c792a100,fb4f0c10,0,1,0,...) at ttydev_read+0x81/frame 0xfb4f0b5c devfs_read_f(c7d50e70,fb4f0c10,c76a9e00,0,c7d3c300,...) at devfs_read_f+0x87/frame 0xfb4f0b90 dofileread(c7d50e70,fb4f0c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xfb4f0bc4 kern_readv(c7d3c300,0,fb4f0c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xfb4f0bf0 sys_read(c7d3c300,fb4f0cc8,c0ebf800,c71fac90,0,...) at sys_read+0x5c/frame 0xfb4f0c40 syscall(fb4f0d08) at syscall+0x2ed/frame 0xfb4f0cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb4f0cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cca7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 965 tid 100114 td 0xc7de4300 sched_switch(c7de4300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb5869b8 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xfb5869ec sleepq_switch(c7de4300,0,c109b989,1ab,fb586a64,...) at sleepq_switch+0x1b9/frame 0xfb586a20 sleepq_catch_signals(0,c109b989,162,12f0,1,...) at sleepq_catch_signals+0x3a1/frame 0xfb586a68 sleepq_wait_sig(c778ba70,0,c10a0699,101,0,...) at sleepq_wait_sig+0x14/frame 0xfb586a8c _cv_wait_sig(c778ba70,c140b624,c10a0685,531,fb586c10,...) at _cv_wait_sig+0x200/frame 0xfb586ad4 tty_wait(c778ba00,c778ba70,fb586c10,1,0,...) at tty_wait+0x4b/frame 0xfb586af8 ttydisc_read(c778ba00,fb586c10,0,a1,fb586c10,...) at ttydisc_read+0x377/frame 0xfb586b3c ttydev_read(c792a200,fb586c10,0,1,0,...) at ttydev_read+0x81/frame 0xfb586b5c devfs_read_f(c7d50930,fb586c10,c76a9e00,0,c7de4300,...) at devfs_read_f+0x87/frame 0xfb586b90 dofileread(c7d50930,fb586c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xfb586bc4 kern_readv(c7de4300,0,fb586c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xfb586bf0 sys_read(c7de4300,fb586cc8,c0ebf800,c1825c90,0,...) at sys_read+0x5c/frame 0xfb586c40 syscall(fb586d08) at syscall+0x2ed/frame 0xfb586cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb586cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cca7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 964 tid 100075 td 0xc7d40c00 sched_switch(c7d40c00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb4a09b8 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xfb4a09ec sleepq_switch(c7d40c00,0,c109b989,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xfb4a0a20 sleepq_catch_signals(fb4a0a8c,c0a88f59,c778bc14,0,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb4a0a68 sleepq_wait_sig(c778bc70,0,fb4a0ac0,101,0,...) at sleepq_wait_sig+0x14/frame 0xfb4a0a8c _cv_wait_sig(c778bc70,c778bc04,c10a0685,531,fb4a0c10,...) at _cv_wait_sig+0x200/frame 0xfb4a0ad4 tty_wait(c778bc00,c778bc70,fb4a0c10,1,0,...) at tty_wait+0x4b/frame 0xfb4a0af8 ttydisc_read(c778bc00,fb4a0c10,0,a1,fb4a0c10,...) at ttydisc_read+0x377/frame 0xfb4a0b3c ttydev_read(c770bc00,fb4a0c10,0,1,0,...) at ttydev_read+0x81/frame 0xfb4a0b5c devfs_read_f(c7d50508,fb4a0c10,c76a9e00,0,c7d40c00,...) at devfs_read_f+0x87/frame 0xfb4a0b90 dofileread(c7d50508,fb4a0c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xfb4a0bc4 kern_readv(c7d40c00,0,fb4a0c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xfb4a0bf0 sys_read(c7d40c00,fb4a0cc8,c10ed72f,d6,c1250290,...) at sys_read+0x5c/frame 0xfb4a0c40 syscall(fb4a0d08) at syscall+0x2ed/frame 0xfb4a0cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb4a0cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cca7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command inetd pid 947 tid 100081 td 0xc7de6000 sched_switch(c7de6000,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb4b8900 mi_switch(104,0,c109b989,1f5,46,...) at mi_switch+0x1c9/frame 0xfb4b8934 sleepq_switch(c7de6000,0,c109b989,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xfb4b8968 sleepq_catch_signals(fb4b89d4,c0a88f59,c81a6660,0,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb4b89b0 sleepq_wait_sig(c81a6664,0,fb4b8a08,101,0,...) at sleepq_wait_sig+0x14/frame 0xfb4b89d4 _cv_wait_sig(c81a6664,c81a6650,c109e671,68e,c0af794d,...) at _cv_wait_sig+0x200/frame 0xfb4b8a1c seltdwait(ffffffff,0,0,c7de6000,0,...) at seltdwait+0x90/frame 0xfb4b8a50 kern_select(c7de6000,8,bfbfd008,0,0,...) at kern_select+0x88c/frame 0xfb4b8bf8 sys_select(c7de6000,fb4b8cc8,c0ebf800,c71fac90,0,...) at sys_select+0x69/frame 0xfb4b8c40 syscall(fb4b8d08) at syscall+0x2ed/frame 0xfb4b8cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb4b8cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281afc67, esp = 0xbfbfcf84, ebp = 0xbfbfde34 --- Tracing command watchdogd pid 923 tid 100099 td 0xc7e07600 sched_switch(c7e07600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb50d98c mi_switch(104,0,c109b989,1f5,c109b989,...) at mi_switch+0x1c9/frame 0xfb50d9c0 sleepq_switch(c7e07600,0,c109b989,1ab,fb50da38,...) at sleepq_switch+0x1b9/frame 0xfb50d9f4 sleepq_catch_signals(0,c109b989,162,1200,c7e07600,...) at sleepq_catch_signals+0x3a1/frame 0xfb50da3c sleepq_wait_sig(c7dfc000,6c,c109eda5,100,0,...) at sleepq_wait_sig+0x14/frame 0xfb50da60 _sleep(c7dfc000,c7dfc094,16c,c109eda5,0,...) at _sleep+0x35b/frame 0xfb50dabc kern_wait6(c7e07600,0,a2b7,0,fb50db4c,...) at kern_wait6+0x45c/frame 0xfb50db20 sys_wait4(c7e07600,fb50dcc8,c0ebf800,c7200c90,0,...) at sys_wait4+0x94/frame 0xfb50dc40 syscall(fb50dd08) at syscall+0x2ed/frame 0xfb50dcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb50dcfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x280eb33f, esp = 0xbfbfdc5c, ebp = 0xbfbfdcf8 --- Tracing command bash pid 896 tid 100095 td 0xc7e07c00 Tracing command csh pid 876 tid 100093 td 0xc7d3c600 Tracing command su pid 859 tid 100127 td 0xc7de6900 Tracing command bash pid 846 tid 100133 td 0xc888a600 Tracing command sshd pid 845 tid 100116 td 0xc7de2c00 sched_switch(c7de2c00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb594900 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xfb594934 sleepq_switch(c7de2c00,0,c109b989,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xfb594968 sleepq_catch_signals(fb5949d4,c0a88f59,c81a6ca0,0,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb5949b0 sleepq_wait_sig(c81a6ca4,0,fb594a08,101,0,...) at sleepq_wait_sig+0x14/frame 0xfb5949d4 _cv_wait_sig(c81a6ca4,c81a6c90,c109e671,68e,c10a1131,...) at _cv_wait_sig+0x200/frame 0xfb594a1c seltdwait(ffffffff,0,0,c7de2c00,0,...) at seltdwait+0x90/frame 0xfb594a50 kern_select(c7de2c00,c,28c0c1c8,28c0c1d0,0,...) at kern_select+0x88c/frame 0xfb594bf8 sys_select(c7de2c00,fb594cc8,7b3,0,fb594cc4,...) at sys_select+0x69/frame 0xfb594c40 syscall(fb594d08) at syscall+0x2ed/frame 0xfb594cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb594cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28523c67, esp = 0xbfbfd3cc, ebp = 0xbfbfd418 --- Tracing command sshd pid 843 tid 100088 td 0xc7d3cc00 sched_switch(c7d3cc00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb4d7980 mi_switch(104,0,c109b989,1f5,200046,...) at mi_switch+0x1c9/frame 0xfb4d79b4 sleepq_switch(c7d3cc00,0,c109b989,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xfb4d79e8 sleepq_catch_signals(fb4d7a54,c0a88f59,c78939e0,0,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb4d7a30 sleepq_wait_sig(c78939e4,0,fb4d7a88,101,0,...) at sleepq_wait_sig+0x14/frame 0xfb4d7a54 _cv_wait_sig(c78939e4,c78939d0,c109e671,68e,5c3,...) at _cv_wait_sig+0x200/frame 0xfb4d7a9c seltdwait(ffffffff,0,0,c7d3cc00,c11cc43c,...) at seltdwait+0x90/frame 0xfb4d7ad0 sys_poll(c7d3cc00,fb4d7cc8,c0ebf800,c1825c90,0,...) at sys_poll+0x44c/frame 0xfb4d7c40 syscall(fb4d7d08) at syscall+0x2ed/frame 0xfb4d7cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb4d7cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284ba40f, esp = 0xbfbfd414, ebp = 0xbfbfd460 --- Tracing command cron pid 796 tid 100123 td 0xc7de0600 Tracing command sendmail pid 791 tid 100076 td 0xc7d85c00 Tracing command sendmail pid 788 tid 100126 td 0xc7de6c00 sched_switch(c7de6c00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb5b78f8 mi_switch(104,0,c109b989,1f5,c7de6c00,...) at mi_switch+0x1c9/frame 0xfb5b792c sleepq_switch(c7de6c00,0,c109b989,1ab,c7894a90,...) at sleepq_switch+0x1b9/frame 0xfb5b7960 sleepq_catch_signals(c11ca0a4,fb5b79d0,c0a88f59,c7894aa0,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb5b79a8 sleepq_timedwait_sig(c7894aa4,0,fb5b7a08,50000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xfb5b79d0 _cv_timedwait_sig_sbt(c7894aa4,c7894a90,e5a5dca6,1a78,50000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xfb5b7a1c seltdwait(1a78,50000000,0,c7de6c00,0,...) at seltdwait+0xbc/frame 0xfb5b7a50 kern_select(c7de6c00,5,bfbfb478,0,0,...) at kern_select+0x88c/frame 0xfb5b7bf8 sys_select(c7de6c00,fb5b7cc8,c0ebf800,c7200c90,0,...) at sys_select+0x69/frame 0xfb5b7c40 syscall(fb5b7d08) at syscall+0x2ed/frame 0xfb5b7cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb5b7cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2841dc67, esp = 0xbfbfb36c, ebp = 0xbfbfbf98 --- Tracing command sshd pid 785 tid 100089 td 0xc7d3c900 sched_switch(c7d3c900,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb4db900 mi_switch(104,0,c109b989,1f5,200046,...) at mi_switch+0x1c9/frame 0xfb4db934 sleepq_switch(c7d3c900,0,c109b989,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xfb4db968 sleepq_catch_signals(fb4db9d4,c0a88f59,c81a6da0,0,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb4db9b0 sleepq_wait_sig(c81a6da4,0,fb4dba08,101,0,...) at sleepq_wait_sig+0x14/frame 0xfb4db9d4 _cv_wait_sig(c81a6da4,c81a6d90,c109e671,68e,c0af794d,...) at _cv_wait_sig+0x200/frame 0xfb4dba1c seltdwait(ffffffff,0,0,c7d3c900,0,...) at seltdwait+0x90/frame 0xfb4dba50 kern_select(c7d3c900,9,28c0c140,0,0,...) at kern_select+0x88c/frame 0xfb4dbbf8 sys_select(c7d3c900,fb4dbcc8,0,0,c7d3c900,...) at sys_select+0x69/frame 0xfb4dbc40 syscall(fb4dbd08) at syscall+0x2ed/frame 0xfb4dbcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb4dbcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28523c67, esp = 0xbfbfd47c, ebp = 0xbfbfde44 --- Tracing command smbd pid 754 tid 100124 td 0xc7e00300 sched_switch(c7e00300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb5ac978 mi_switch(104,0,c109b989,1f5,c7e00300,...) at mi_switch+0x1c9/frame 0xfb5ac9ac sleepq_switch(c7e00300,0,c109b989,1ab,c81a6550,...) at sleepq_switch+0x1b9/frame 0xfb5ac9e0 sleepq_catch_signals(c11ca0a4,fb5aca50,c0a88f59,c81a6560,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb5aca28 sleepq_timedwait_sig(c81a6564,0,fb5aca88,b7fbe76c,20c49,...) at sleepq_timedwait_sig+0x14/frame 0xfb5aca50 _cv_timedwait_sig_sbt(c81a6564,c81a6550,9c499ab9,20c5f8,b7fbe76c,...) at _cv_timedwait_sig_sbt+0x228/frame 0xfb5aca9c seltdwait(20c5f8,b7fbe76c,20c49,c7e00300,0,...) at seltdwait+0xbc/frame 0xfb5acad0 sys_poll(c7e00300,fb5accc8,c0ebf800,c71fac90,0,...) at sys_poll+0x44c/frame 0xfb5acc40 syscall(fb5acd08) at syscall+0x2ed/frame 0xfb5accfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb5accfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x21b6140f, esp = 0xbfbfd9ec, ebp = 0xbfbfda28 --- Tracing command winbindd pid 752 tid 100085 td 0xc7d40000 sched_switch(c7d40000,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb4c9878 mi_switch(104,0,c109b989,1f5,101,...) at mi_switch+0x1c9/frame 0xfb4c98ac sleepq_switch(c7d40000,0,c109b989,28e,c7d40000,...) at sleepq_switch+0x1b9/frame 0xfb4c98e0 sleepq_timedwait(c38b9f80,50,13,0,0,...) at sleepq_timedwait+0x48/frame 0xfb4c9904 _sleep(c38b9f80,c86238ac,50,c10d0579,ffffe8e0,...) at _sleep+0x345/frame 0xfb4c9960 swap_pager_getpages(c86238ac,fb4c9a2c,1,0,fb4c9b04,...) at swap_pager_getpages+0x4a3/frame 0xfb4c99c0 vm_fault_hold(c76ce828,22413000,1,0,0,...) at vm_fault_hold+0xa21/frame 0xfb4c9b20 vm_fault(c76ce828,22413000,1,0,c76ce828,...) at vm_fault+0x82/frame 0xfb4c9b48 trap_pfault(224130c0,fb4c9d08,c0a89cdb,c1251080,8,...) at trap_pfault+0x1ba/frame 0xfb4c9bc0 trap(fb4c9d08) at trap+0x5da/frame 0xfb4c9cfc calltrap() at calltrap+0x6/frame 0xfb4c9cfc --- trap 0xc, eip = 0x118cb67, esp = 0xbfbfc470, ebp = 0xbfbfc4b8 --- Tracing command moused pid 750 tid 100106 td 0xc7d84600 sched_switch(c7d84600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb531900 mi_switch(104,0,c109b989,1f5,46,...) at mi_switch+0x1c9/frame 0xfb531934 sleepq_switch(c7d84600,0,c109b989,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xfb531968 sleepq_catch_signals(fb5319d4,c0a88f59,c7893ba0,0,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb5319b0 sleepq_wait_sig(c7893ba4,0,fb531a08,101,0,...) at sleepq_wait_sig+0x14/frame 0xfb5319d4 _cv_wait_sig(c7893ba4,c7893b90,c109e671,68e,c7d84600,...) at _cv_wait_sig+0x200/frame 0xfb531a1c seltdwait(ffffffff,0,0,c7d84600,0,...) at seltdwait+0x90/frame 0xfb531a50 kern_select(c7d84600,400,bfbfdcb0,0,0,...) at kern_select+0x88c/frame 0xfb531bf8 sys_select(c7d84600,fb531cc8,c0ebf800,c71fdc90,0,...) at sys_select+0x69/frame 0xfb531c40 syscall(fb531d08) at syscall+0x2ed/frame 0xfb531cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb531cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281bdc67, esp = 0xbfbfd88c, ebp = 0xbfbfde24 --- Tracing command winbindd pid 735 tid 100078 td 0xc7d40900 sched_switch(c7d40900,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb4ac978 mi_switch(104,0,c109b989,1f5,c7d40900,...) at mi_switch+0x1c9/frame 0xfb4ac9ac sleepq_switch(c7d40900,0,c109b989,1ab,c7894b10,...) at sleepq_switch+0x1b9/frame 0xfb4ac9e0 sleepq_catch_signals(c11ca0a4,fb4aca50,c0a88f59,c7894b20,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb4aca28 sleepq_timedwait_sig(c7894b24,0,fb4aca88,b7caaade,12,...) at sleepq_timedwait_sig+0x14/frame 0xfb4aca50 _cv_timedwait_sig_sbt(c7894b24,c7894b10,374e5615,1ba1,b7caaade,...) at _cv_timedwait_sig_sbt+0x228/frame 0xfb4aca9c seltdwait(1ba1,b7caaade,12,c7d40900,0,...) at seltdwait+0xbc/frame 0xfb4acad0 sys_poll(c7d40900,fb4accc8,14,c10982d9,7b3,...) at sys_poll+0x44c/frame 0xfb4acc40 syscall(fb4acd08) at syscall+0x2ed/frame 0xfb4accfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb4accfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2193840f, esp = 0xbfbfdbcc, ebp = 0xbfbfdc08 --- Tracing command smbd pid 733 tid 100119 td 0xc7de2300 sched_switch(c7de2300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb59d978 mi_switch(104,0,c109b989,1f5,c7de2300,...) at mi_switch+0x1c9/frame 0xfb59d9ac sleepq_switch(c7de2300,0,c109b989,1ab,c7894ad0,...) at sleepq_switch+0x1b9/frame 0xfb59d9e0 sleepq_catch_signals(c11ca0a4,fb59da50,c0a88f59,c7894ae0,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb59da28 sleepq_timedwait_sig(c7894ae4,0,fb59da88,889fba60,3,...) at sleepq_timedwait_sig+0x14/frame 0xfb59da50 _cv_timedwait_sig_sbt(c7894ae4,c7894ad0,c8b82187,1a81,889fba60,...) at _cv_timedwait_sig_sbt+0x228/frame 0xfb59da9c seltdwait(1a81,889fba60,3,c7de2300,0,...) at seltdwait+0xbc/frame 0xfb59dad0 sys_poll(c7de2300,fb59dcc8,0,0,c7de2300,...) at sys_poll+0x44c/frame 0xfb59dc40 syscall(fb59dd08) at syscall+0x2ed/frame 0xfb59dcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb59dcfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x21b6140f, esp = 0xbfbfda9c, ebp = 0xbfbfdad8 --- Tracing command nmbd pid 731 tid 100120 td 0xc7de2000 sched_switch(c7de2000,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb5a0978 mi_switch(104,0,c109b989,1f5,c7de2000,...) at mi_switch+0x1c9/frame 0xfb5a09ac sleepq_switch(c7de2000,0,c109b989,1ab,c7894b90,...) at sleepq_switch+0x1b9/frame 0xfb5a09e0 sleepq_catch_signals(c11ca0a4,fb5a0a50,c0a88f59,c7894ba0,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb5a0a28 sleepq_timedwait_sig(c7894ba4,0,fb5a0a88,9fffff47,0,...) at sleepq_timedwait_sig+0x14/frame 0xfb5a0a50 _cv_timedwait_sig_sbt(c7894ba4,c7894b90,249f6e2a,1a79,9fffff47,...) at _cv_timedwait_sig_sbt+0x228/frame 0xfb5a0a9c seltdwait(1a79,9fffff47,0,c7de2000,0,...) at seltdwait+0xbc/frame 0xfb5a0ad0 sys_poll(c7de2000,fb5a0cc8,c0ebf800,c7200c90,0,...) at sys_poll+0x44c/frame 0xfb5a0c40 syscall(fb5a0d08) at syscall+0x2ed/frame 0xfb5a0cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb5a0cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2156340f, esp = 0xbfbfdb1c, ebp = 0xbfbfdb58 --- Tracing command ntpd pid 707 tid 100090 td 0xc7e08600 sched_switch(c7e08600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb4e0900 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xfb4e0934 sleepq_switch(c7e08600,0,c109b989,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xfb4e0968 sleepq_catch_signals(fb4e09d4,c0a88f59,c7894b60,0,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb4e09b0 sleepq_wait_sig(c7894b64,0,fb4e0a08,101,0,...) at sleepq_wait_sig+0x14/frame 0xfb4e09d4 _cv_wait_sig(c7894b64,c7894b50,c109e671,68e,c0af794d,...) at _cv_wait_sig+0x200/frame 0xfb4e0a1c seltdwait(ffffffff,0,0,c7e08600,0,...) at seltdwait+0x90/frame 0xfb4e0a50 kern_select(c7e08600,1c,bfbfdd48,0,0,...) at kern_select+0x88c/frame 0xfb4e0bf8 sys_select(c7e08600,fb4e0cc8,0,0,c7e08600,...) at sys_select+0x69/frame 0xfb4e0c40 syscall(fb4e0d08) at syscall+0x2ed/frame 0xfb4e0cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb4e0cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28397c67, esp = 0xbfbfdd24, ebp = 0xbfbfdde4 --- Tracing command nfsd pid 654 tid 100111 td 0xc7948900 sched_switch(c7948900,0,103,1b0,0,...) at sched_switch+0x4b4/frame 0xfb57d94c mi_switch(103,0,c109c55c,2e6,1a75,...) at mi_switch+0x1c9/frame 0xfb57d980 turnstile_wait(ca67a000,c7d84c00,0,c,1af414,...) at turnstile_wait+0x3b4/frame 0xfb57d9b0 __mtx_lock_sleep(c140ac1c,c7948900,c1081777,c1081777,236,...) at __mtx_lock_sleep+0x28e/frame 0xfb57da1c __mtx_lock_flags(c140ac1c,0,c1081777,236,c7948900,...) at __mtx_lock_flags+0xfd/frame 0xfb57da50 nfsrvd_getcache(fb57dad8,cd0f5000,c10812d7,ec,9926b1b0,...) at nfsrvd_getcache+0x317/frame 0xfb57daa8 nfssvc_program(cab16800,cb527000,c10c577b,490,0,...) at nfssvc_program+0x3f9/frame 0xfb57dbb0 svc_run_internal(fb57dcf4,c0a6c2ff,c7861b80,fb57dd08,c108f880,...) at svc_run_internal+0x201/frame 0xfb57dcc4 svc_thread_start(c7861b80,fb57dd08,c108f880,3d7,0,...) at svc_thread_start+0xd/frame 0xfb57dccc fork_exit(c0c9d670,c7861b80,fb57dd08) at fork_exit+0x7f/frame 0xfb57dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xfb57dcf4 --- trap 0xf6e8752e, eip = 0xc, esp = 0x33, ebp = 0xbfbfd92f --- Tracing command nfsd pid 654 tid 100110 td 0xc7948c00 sched_switch(c7948c00,0,103,1b0,0,...) at sched_switch+0x4b4/frame 0xfb57a94c mi_switch(103,0,c109c55c,2e6,1a75,...) at mi_switch+0x1c9/frame 0xfb57a980 turnstile_wait(c7e03d80,c7d3c000,0,c,1af404,...) at turnstile_wait+0x3b4/frame 0xfb57a9b0 __mtx_lock_sleep(c140ac1c,c7948c00,c1081777,c1081777,236,...) at __mtx_lock_sleep+0x28e/frame 0xfb57aa1c __mtx_lock_flags(c140ac1c,0,c1081777,236,c7948c00,...) at __mtx_lock_flags+0xfd/frame 0xfb57aa50 nfsrvd_getcache(fb57aad8,cd0f5000,c10812d7,ec,9926b1a7,...) at nfsrvd_getcache+0x317/frame 0xfb57aaa8 nfssvc_program(cc602800,cb527000,c10c577b,490,0,...) at nfssvc_program+0x3f9/frame 0xfb57abb0 svc_run_internal(fb57acf4,c0a6c2ff,c7861b80,fb57ad08,c108f880,...) at svc_run_internal+0x201/frame 0xfb57acc4 svc_thread_start(c7861b80,fb57ad08,c108f880,3d7,0,...) at svc_thread_start+0xd/frame 0xfb57accc fork_exit(c0c9d670,c7861b80,fb57ad08) at fork_exit+0x7f/frame 0xfb57acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xfb57acf4 --- trap 0xf6e8752e, eip = 0xc, esp = 0x33, ebp = 0xbfbfd92f --- Tracing command nfsd pid 654 tid 100109 td 0xc7d3c000 sched_switch(c7d3c000,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb577a8c mi_switch(104,0,c109b989,1f5,3,...) at mi_switch+0x1c9/frame 0xfb577ac0 sleepq_switch(c7d3c000,0,c109b989,1ab,c7861b80,...) at sleepq_switch+0x1b9/frame 0xfb577af4 sleepq_catch_signals(c11ca0a4,fb577b64,c0a88f59,c7861b90,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb577b3c sleepq_timedwait_sig(c7864590,0,fb577b9c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xfb577b64 _cv_timedwait_sig_sbt(c7864590,c7861b80,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x228/frame 0xfb577bb0 svc_run_internal(fb577cf4,c0a6c2ff,c7861b80,fb577d08,c108f880,...) at svc_run_internal+0xa75/frame 0xfb577cc4 svc_thread_start(c7861b80,fb577d08,c108f880,3d7,0,...) at svc_thread_start+0xd/frame 0xfb577ccc fork_exit(c0c9d670,c7861b80,fb577d08) at fork_exit+0x7f/frame 0xfb577cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xfb577cf4 --- trap 0xf6e8752e, eip = 0xc, esp = 0x33, ebp = 0xbfbfd92f --- Tracing command nfsd pid 654 tid 100098 td 0xc7d84c00 sched_switch(c7d84c00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb509304 mi_switch(104,0,c109b989,1f5,0,...) at mi_switch+0x1c9/frame 0xfb509338 sleepq_switch(c7d84c00,0,c109b989,1ab,c7861b80,...) at sleepq_switch+0x1b9/frame 0xfb50936c sleepq_catch_signals(c11ca0a4,fb5093dc,c0a88f59,c7861b90,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb5093b4 sleepq_timedwait_sig(c7da18d0,0,fb509414,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xfb5093dc _cv_timedwait_sig_sbt(c7da18d0,c7861b80,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x228/frame 0xfb509428 svc_run_internal(c0c9d670,c7861b80,c7d7bba0,fb509568,0,...) at svc_run_internal+0xa75/frame 0xfb50953c svc_run(c7861b80,0,c10812d7,1b2,c10d2635,...) at svc_run+0xc3/frame 0xfb509578 nfsrvd_nfsd(c7d84c00,fb5096d0,c,246,c1bb5f0c,...) at nfsrvd_nfsd+0x1a2/frame 0xfb5096b0 nfssvc_nfsd(c7d84c00,fb509cc8,0,c7d84c00,fb509cfc,...) at nfssvc_nfsd+0xf4/frame 0xfb509c28 sys_nfssvc(c7d84c00,fb509cc8,c0ebf800,c7200c90,0,...) at sys_nfssvc+0xbf/frame 0xfb509c40 syscall(fb509d08) at syscall+0x2ed/frame 0xfb509cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb509cfc --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280c2457, esp = 0xbfbfd7dc, ebp = 0xbfbfda50 --- Tracing command nfsd pid 648 tid 100091 td 0xc7e08300 sched_switch(c7e08300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb4e4900 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xfb4e4934 sleepq_switch(c7e08300,0,c109b989,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xfb4e4968 sleepq_catch_signals(fb4e49d4,c0a88f59,c7893ce0,0,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb4e49b0 sleepq_wait_sig(c7893ce4,0,fb4e4a08,101,0,...) at sleepq_wait_sig+0x14/frame 0xfb4e49d4 _cv_wait_sig(c7893ce4,c7893cd0,c109e671,68e,c0af794d,...) at _cv_wait_sig+0x200/frame 0xfb4e4a1c seltdwait(ffffffff,0,0,c7e08300,0,...) at seltdwait+0x90/frame 0xfb4e4a50 kern_select(c7e08300,7,bfbfdc30,0,0,...) at kern_select+0x88c/frame 0xfb4e4bf8 sys_select(c7e08300,fb4e4cc8,c0ebf800,c1825c90,0,...) at sys_select+0x69/frame 0xfb4e4c40 syscall(fb4e4d08) at syscall+0x2ed/frame 0xfb4e4cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb4e4cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28189c67, esp = 0xbfbfda54, ebp = 0xbfbfde34 --- Tracing command mountd pid 642 tid 100104 td 0xc7e00600 sched_switch(c7e00600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb524900 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xfb524934 sleepq_switch(c7e00600,0,c109b989,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xfb524968 sleepq_catch_signals(fb5249d4,c0a88f59,c81a6de0,0,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb5249b0 sleepq_wait_sig(c81a6de4,0,fb524a08,101,0,...) at sleepq_wait_sig+0x14/frame 0xfb5249d4 _cv_wait_sig(c81a6de4,c81a6dd0,c109e671,68e,c0af794d,...) at _cv_wait_sig+0x200/frame 0xfb524a1c seltdwait(ffffffff,0,0,c7e00600,0,...) at seltdwait+0x90/frame 0xfb524a50 kern_select(c7e00600,9,bfbfdd50,0,0,...) at kern_select+0x88c/frame 0xfb524bf8 sys_select(c7e00600,fb524cc8,c0ebf800,c71fdc90,0,...) at sys_select+0x69/frame 0xfb524c40 syscall(fb524d08) at syscall+0x2ed/frame 0xfb524cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb524cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a0c67, esp = 0xbfbfdd0c, ebp = 0xbfbfde34 --- Tracing command nfsuserd pid 635 tid 100077 td 0xc7d85900 sched_switch(c7d85900,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb4a88f8 mi_switch(104,0,c109b989,1f5,c7d85900,...) at mi_switch+0x1c9/frame 0xfb4a892c sleepq_switch(c7d85900,0,c109b989,1ab,c81a6e10,...) at sleepq_switch+0x1b9/frame 0xfb4a8960 sleepq_catch_signals(c11ca0a4,fb4a89d0,c0a88f59,c81a6e20,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb4a89a8 sleepq_timedwait_sig(c81a6e24,0,fb4a8a08,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xfb4a89d0 _cv_timedwait_sig_sbt(c81a6e24,c81a6e10,4c4dece1,1a81,e0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xfb4a8a1c seltdwait(1a81,e0000000,1,c7d85900,0,...) at seltdwait+0xbc/frame 0xfb4a8a50 kern_select(c7d85900,4,bfbfdc10,0,0,...) at kern_select+0x88c/frame 0xfb4a8bf8 sys_select(c7d85900,fb4a8cc8,14,c10982d9,7b3,...) at sys_select+0x69/frame 0xfb4a8c40 syscall(fb4a8d08) at syscall+0x2ed/frame 0xfb4a8cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb4a8cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28188c67, esp = 0xbfbfdb64, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 634 tid 100082 td 0xc7de4c00 sched_switch(c7de4c00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb4bc8f8 mi_switch(104,0,c109b989,1f5,c7de4c00,...) at mi_switch+0x1c9/frame 0xfb4bc92c sleepq_switch(c7de4c00,0,c109b989,1ab,c7893bd0,...) at sleepq_switch+0x1b9/frame 0xfb4bc960 sleepq_catch_signals(c11ca0a4,fb4bc9d0,c0a88f59,c7893be0,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb4bc9a8 sleepq_timedwait_sig(c7893be4,0,fb4bca08,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xfb4bc9d0 _cv_timedwait_sig_sbt(c7893be4,c7893bd0,d3ba3dc1,1a80,e0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xfb4bca1c seltdwait(1a80,e0000000,1,c7de4c00,0,...) at seltdwait+0xbc/frame 0xfb4bca50 kern_select(c7de4c00,4,bfbfdc10,0,0,...) at kern_select+0x88c/frame 0xfb4bcbf8 sys_select(c7de4c00,fb4bccc8,7b3,0,fb4bccc4,...) at sys_select+0x69/frame 0xfb4bcc40 syscall(fb4bcd08) at syscall+0x2ed/frame 0xfb4bccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb4bccfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28188c67, esp = 0xbfbfdb64, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 633 tid 100107 td 0xc7d84300 sched_switch(c7d84300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb5358f8 mi_switch(104,0,c109b989,1f5,c7d84300,...) at mi_switch+0x1c9/frame 0xfb53592c sleepq_switch(c7d84300,0,c109b989,1ab,c81a6e50,...) at sleepq_switch+0x1b9/frame 0xfb535960 sleepq_catch_signals(c11ca0a4,fb5359d0,c0a88f59,c81a6e60,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb5359a8 sleepq_timedwait_sig(c81a6e64,0,fb535a08,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xfb5359d0 _cv_timedwait_sig_sbt(c81a6e64,c81a6e50,fd32e49e,1a80,e0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xfb535a1c seltdwait(1a80,e0000000,1,c7d84300,0,...) at seltdwait+0xbc/frame 0xfb535a50 kern_select(c7d84300,4,bfbfdc10,0,0,...) at kern_select+0x88c/frame 0xfb535bf8 sys_select(c7d84300,fb535cc8,7b3,0,fb535cc4,...) at sys_select+0x69/frame 0xfb535c40 syscall(fb535d08) at syscall+0x2ed/frame 0xfb535cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb535cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28188c67, esp = 0xbfbfdb64, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 632 tid 100100 td 0xc7e07300 sched_switch(c7e07300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb5128f8 mi_switch(104,0,c109b989,1f5,c7e07300,...) at mi_switch+0x1c9/frame 0xfb51292c sleepq_switch(c7e07300,0,c109b989,1ab,c7893c10,...) at sleepq_switch+0x1b9/frame 0xfb512960 sleepq_catch_signals(c11ca0a4,fb5129d0,c0a88f59,c7893c20,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb5129a8 sleepq_timedwait_sig(c7893c24,0,fb512a08,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xfb5129d0 _cv_timedwait_sig_sbt(c7893c24,c7893c10,e9be3dba,1a80,e0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xfb512a1c seltdwait(1a80,e0000000,1,c7e07300,0,...) at seltdwait+0xbc/frame 0xfb512a50 kern_select(c7e07300,4,bfbfdc10,0,0,...) at kern_select+0x88c/frame 0xfb512bf8 sys_select(c7e07300,fb512cc8,c0ebf800,c7200c90,0,...) at sys_select+0x69/frame 0xfb512c40 syscall(fb512d08) at syscall+0x2ed/frame 0xfb512cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb512cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28188c67, esp = 0xbfbfdb64, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 631 tid 100102 td 0xc7e00c00 Tracing command rpcbind pid 602 tid 100096 td 0xc7e07900 sched_switch(c7e07900,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb501978 mi_switch(104,0,c109b989,1f5,c7e07900,...) at mi_switch+0x1c9/frame 0xfb5019ac sleepq_switch(c7e07900,0,c109b989,1ab,c7893c50,...) at sleepq_switch+0x1b9/frame 0xfb5019e0 sleepq_catch_signals(c11ca0a4,fb501a50,c0a88f59,c7893c60,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb501a28 sleepq_timedwait_sig(c7893c64,0,fb501a88,dffffdd5,1,...) at sleepq_timedwait_sig+0x14/frame 0xfb501a50 _cv_timedwait_sig_sbt(c7893c64,c7893c50,5ebc521c,1a76,dffffdd5,...) at _cv_timedwait_sig_sbt+0x228/frame 0xfb501a9c seltdwait(1a76,dffffdd5,1,c7e07900,0,...) at seltdwait+0xbc/frame 0xfb501ad0 sys_poll(c7e07900,fb501cc8,c0ebf800,c71fac90,0,...) at sys_poll+0x44c/frame 0xfb501c40 syscall(fb501d08) at syscall+0x2ed/frame 0xfb501cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb501cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2813f40f, esp = 0xbfbfbbfc, ebp = 0xbfbfddd8 --- Tracing command syslogd pid 532 tid 100101 td 0xc7e07000 sched_switch(c7e07000,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb517878 mi_switch(104,0,c109b989,1f5,101,...) at mi_switch+0x1c9/frame 0xfb5178ac sleepq_switch(c7e07000,0,c109b989,28e,c7e07000,...) at sleepq_switch+0x1b9/frame 0xfb5178e0 sleepq_timedwait(c5679ac0,50,13,0,0,...) at sleepq_timedwait+0x48/frame 0xfb517904 _sleep(c5679ac0,c7dd9094,50,c10d0579,ffffe8e0,...) at _sleep+0x345/frame 0xfb517960 swap_pager_getpages(c7dd9094,fb517a2c,1,0,fb517b04,...) at swap_pager_getpages+0x4a3/frame 0xfb5179c0 vm_fault_hold(c76ce2b8,281c5000,1,0,0,...) at vm_fault_hold+0xa21/frame 0xfb517b20 vm_fault(c76ce2b8,281c5000,1,0,c76ce2b8,...) at vm_fault+0x82/frame 0xfb517b48 trap_pfault(281c5840,0,fb517c10,ffffffff,ffffffff,...) at trap_pfault+0x1ba/frame 0xfb517bc0 trap(fb517d08) at trap+0x5da/frame 0xfb517cfc calltrap() at calltrap+0x6/frame 0xfb517cfc --- trap 0xc, eip = 0x28177900, esp = 0xbfbfc8cc, ebp = 0xbfbfc8ec --- Tracing command devd pid 429 tid 100086 td 0xc7d85600 sched_switch(c7d85600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xfb4cd8f8 mi_switch(104,0,c109b989,1f5,c7d85600,...) at mi_switch+0x1c9/frame 0xfb4cd92c sleepq_switch(c7d85600,0,c109b989,1ab,c81b9110,...) at sleepq_switch+0x1b9/frame 0xfb4cd960 sleepq_catch_signals(c11ca0a4,fb4cd9d0,c0a88f59,c81b9120,0,...) at sleepq_catch_signals+0x3a1/frame 0xfb4cd9a8 sleepq_timedwait_sig(c81b9124,0,fb4cda08,c0000000,3,...) at sleepq_timedwait_sig+0x14/frame 0xfb4cd9d0 _cv_timedwait_sig_sbt(c81b9124,c81b9110,a5e798d6,1a95,c0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xfb4cda1c seltdwait(1a95,c0000000,3,c7d85600,0,...) at seltdwait+0xbc/frame 0xfb4cda50 kern_select(c7d85600,5,bfbfd998,0,0,...) at kern_select+0x88c/frame 0xfb4cdbf8 sys_select(c7d85600,fb4cdcc8,c0ebf800,c7200c90,0,...) at sys_select+0x69/frame 0xfb4cdc40 syscall(fb4cdd08) at syscall+0x2ed/frame 0xfb4cdcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xfb4cdcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x8095983, esp = 0xbfbfd93c, ebp = 0xbfbfde54 --- Tracing command softdepflush pid 17 tid 100074 td 0xc7945000 sched_switch(c7945000,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5fceba4 mi_switch(104,0,c109b989,1f5,101,...) at mi_switch+0x1c9/frame 0xf5fcebd8 sleepq_switch(c7945000,0,c109b989,28e,c7945000,...) at sleepq_switch+0x1b9/frame 0xf5fcec0c sleepq_timedwait(c13bead4,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xf5fcec30 _sleep(c13bead4,c13bea54,54,c10cdbd0,fffffed8,...) at _sleep+0x345/frame 0xf5fcec8c softdep_flush(0,f5fced08,c108f880,3d7,0,...) at softdep_flush+0x27c/frame 0xf5fceccc fork_exit(c0cf5fa0,0,f5fced08) at fork_exit+0x7f/frame 0xf5fcecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5fcecf4 --- trap 0, eip = 0, esp = 0xf5fced40, ebp = 0 --- Tracing command syncer pid 16 tid 100073 td 0xc7945300 sched_switch(c7945300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5fcbb78 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xf5fcbbac sleepq_switch(c7945300,0,c109b989,28e,0,...) at sleepq_switch+0x1b9/frame 0xf5fcbbe0 sleepq_timedwait(c13ba8a4,0,f5fcbc3c,0,0,...) at sleepq_timedwait+0x48/frame 0xf5fcbc04 _cv_timedwait_sbt(c13ba8a4,c13ba884,fffffed8,0,0,...) at _cv_timedwait_sbt+0x228/frame 0xf5fcbc50 sched_sync(0,f5fcbd08,c108f880,3d7,0,...) at sched_sync+0x682/frame 0xf5fcbccc fork_exit(c0b47660,0,f5fcbd08) at fork_exit+0x7f/frame 0xf5fcbcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5fcbcf4 --- trap 0, eip = 0, esp = 0xf5fcbd40, ebp = 0 --- Tracing command vnlru pid 9 tid 100072 td 0xc7945600 sched_switch(c7945600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5fc8b78 mi_switch(104,0,c109b989,1f5,101,...) at mi_switch+0x1c9/frame 0xf5fc8bac sleepq_switch(c7945600,0,c109b989,28e,c7945600,...) at sleepq_switch+0x1b9/frame 0xf5fc8be0 sleepq_timedwait(c7c2aba0,60,0,0,0,...) at sleepq_timedwait+0x48/frame 0xf5fc8c04 _sleep(c7c2aba0,c13ba85c,260,c10a7946,fffffed8,...) at _sleep+0x345/frame 0xf5fc8c60 vnlru_proc(0,f5fc8d08,c108f880,3d7,0,...) at vnlru_proc+0xcf/frame 0xf5fc8ccc fork_exit(c0b47ea0,0,f5fc8d08) at fork_exit+0x7f/frame 0xf5fc8cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5fc8cf4 --- trap 0, eip = 0, esp = 0xf5fc8d40, ebp = 0 --- Tracing command bufdaemon pid 8 tid 100071 td 0xc7945900 sched_switch(c7945900,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5fc5bb0 mi_switch(104,0,c109b989,1f5,101,...) at mi_switch+0x1c9/frame 0xf5fc5be4 sleepq_switch(c7945900,0,c109b989,28e,c7945900,...) at sleepq_switch+0x1b9/frame 0xf5fc5c18 sleepq_timedwait(c13ba61c,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xf5fc5c3c _sleep(c13ba61c,c13ba604,54,c10a4418,fffffed8,...) at _sleep+0x345/frame 0xf5fc5c98 buf_daemon(0,f5fc5d08,c108f880,3d7,0,...) at buf_daemon+0x8c/frame 0xf5fc5ccc fork_exit(c0b2b1f0,0,f5fc5d08) at fork_exit+0x7f/frame 0xf5fc5cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5fc5cf4 --- trap 0, eip = 0, esp = 0xf5fc5d40, ebp = 0 --- Tracing command pagezero pid 7 tid 100070 td 0xc7945c00 sched_switch(c7945c00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5fc2bac mi_switch(104,0,c109b989,1f5,101,...) at mi_switch+0x1c9/frame 0xf5fc2be0 sleepq_switch(c7945c00,0,c109b989,28e,c7945c00,...) at sleepq_switch+0x1b9/frame 0xf5fc2c14 sleepq_timedwait(c13bf3d4,0,12b,0,0,...) at sleepq_timedwait+0x48/frame 0xf5fc2c38 _sleep(c13bf3d4,c1412f00,0,c10d4e37,fffea520,...) at _sleep+0x345/frame 0xf5fc2c94 vm_pagezero(0,f5fc2d08,c108f880,3d7,0,...) at vm_pagezero+0xc2/frame 0xf5fc2ccc fork_exit(c0d3d330,0,f5fc2d08) at fork_exit+0x7f/frame 0xf5fc2cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5fc2cf4 --- trap 0, eip = 0, esp = 0xf5fc2d40, ebp = 0 --- Tracing command vmdaemon pid 6 tid 100069 td 0xc7946000 sched_switch(c7946000,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5fbfb78 mi_switch(104,0,c109b989,1f5,162,...) at mi_switch+0x1c9/frame 0xf5fbfbac sleepq_switch(c7946000,0,c109b989,26b,c7946000,...) at sleepq_switch+0x1b9/frame 0xf5fbfbe0 sleepq_wait(c13bef9c,74,c10a4418,0,0,...) at sleepq_wait+0x48/frame 0xf5fbfc04 _sleep(c13bef9c,c13bef84,74,c10a4418,0,...) at _sleep+0x37c/frame 0xf5fbfc60 vm_daemon(0,f5fbfd08,c108f880,3d7,0,...) at vm_daemon+0xac/frame 0xf5fbfccc fork_exit(c0d34bc0,0,f5fbfd08) at fork_exit+0x7f/frame 0xf5fbfcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5fbfcf4 --- trap 0, eip = 0, esp = 0xf5fbfd40, ebp = 0 --- Tracing command pagedaemon pid 5 tid 100068 td 0xc7946300 sched_switch(c7946300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5fbc954 mi_switch(104,0,c109b989,1f5,162,...) at mi_switch+0x1c9/frame 0xf5fbc988 sleepq_switch(c7946300,0,c109b989,26b,c7946300,...) at sleepq_switch+0x1b9/frame 0xf5fbc9bc sleepq_wait(c13bec2c,54,c10d3ea2,0,0,...) at sleepq_wait+0x48/frame 0xf5fbc9e0 _sleep(c13bec2c,c1412f98,54,c10d3ea2,0,...) at _sleep+0x37c/frame 0xf5fbca3c getpbuf(c13bec2c,0,c10d00e0,531,0,...) at getpbuf+0xe8/frame 0xf5fbca70 swap_pager_putpages(cb93865c,f5fbcb7c,10,0,f5fbcad8) at swap_pager_putpages+0x1fc/frame 0xf5fbcabc vm_pageout_flush(f5fbcb7c,10,0,0,0,0) at vm_pageout_flush+0x131/frame 0xf5fbcb38 vm_pageout_clean(c476c140,0,c10d3950,3e2,fffffa38,...) at vm_pageout_clean+0x4c3/frame 0xf5fbcc18 vm_pageout(0,f5fbcd08,c108f880,3d7,0,...) at vm_pageout+0xcde/frame 0xf5fbcccc fork_exit(c0d353e0,0,f5fbcd08) at fork_exit+0x7f/frame 0xf5fbccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5fbccf4 --- trap 0, eip = 0, esp = 0xf5fbcd40, ebp = 0 --- Tracing command xpt_thrd pid 4 tid 100067 td 0xc7946600 sched_switch(c7946600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5e39bb0 mi_switch(104,0,c109b989,1f5,162,...) at mi_switch+0x1c9/frame 0xf5e39be4 sleepq_switch(c7946600,0,c109b989,26b,c7946600,...) at sleepq_switch+0x1b9/frame 0xf5e39c18 sleepq_wait(c120f324,5c,c0ee7278,0,0,...) at sleepq_wait+0x48/frame 0xf5e39c3c _sleep(c120f324,c120f374,5c,c0ee7278,0,...) at _sleep+0x37c/frame 0xf5e39c98 xpt_scanner_thread(0,f5e39d08,c108f880,3d7,0,...) at xpt_scanner_thread+0x11c/frame 0xf5e39ccc fork_exit(c04b37c0,0,f5e39d08) at fork_exit+0x7f/frame 0xf5e39cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5e39cf4 --- trap 0, eip = 0, esp = 0xf5e39d40, ebp = 0 --- Tracing command sctp_iterator pid 3 tid 100066 td 0xc7946900 sched_switch(c7946900,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5e36bb8 mi_switch(104,0,c109b989,1f5,162,...) at mi_switch+0x1c9/frame 0xf5e36bec sleepq_switch(c7946900,0,c109b989,26b,c7946900,...) at sleepq_switch+0x1b9/frame 0xf5e36c20 sleepq_wait(c140ec0c,0,c10bae95,0,0,...) at sleepq_wait+0x48/frame 0xf5e36c44 _sleep(c140ec0c,c140ebd4,0,c10bae95,0,...) at _sleep+0x37c/frame 0xf5e36ca0 sctp_iterator_thread(0,f5e36d08,c108f880,3d7,0,...) at sctp_iterator_thread+0x7c/frame 0xf5e36ccc fork_exit(c0be4710,0,f5e36d08) at fork_exit+0x7f/frame 0xf5e36cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5e36cf4 --- trap 0, eip = 0, esp = 0xf5e36d40, ebp = 0 --- Tracing command fdc0 pid 2 tid 100061 td 0xc78e2900 sched_switch(c78e2900,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5e26b48 mi_switch(104,0,c109b989,1f5,101,...) at mi_switch+0x1c9/frame 0xf5e26b7c sleepq_switch(c78e2900,0,c109b989,28e,c78e2900,...) at sleepq_switch+0x1b9/frame 0xf5e26bb0 sleepq_timedwait(c7881e3c,5c,0,0,0,...) at sleepq_timedwait+0x48/frame 0xf5e26bd4 _sleep(c7881e3c,c7881ef0,5c,c1081d06,fffffed8,...) at _sleep+0x345/frame 0xf5e26c30 fdc_thread(c7881e00,f5e26d08,c108f880,3d7,0,...) at fdc_thread+0x877/frame 0xf5e26ccc fork_exit(c0e47aa0,c7881e00,f5e26d08) at fork_exit+0x7f/frame 0xf5e26cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5e26cf4 --- trap 0, eip = 0, esp = 0xf5e26d40, ebp = 0 --- Tracing command usb pid 15 tid 100058 td 0xc78ed300 sched_switch(c78ed300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5e02bd4 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xf5e02c08 sleepq_switch(c78ed300,0,c109b989,26b,c78ed300,...) at sleepq_switch+0x1b9/frame 0xf5e02c3c sleepq_wait(c78f8d34,0,f5e02c90,1,0,...) at sleepq_wait+0x48/frame 0xf5e02c60 _cv_wait(c78f8d34,c78f8e4c,c107348b,77,c78f8d3c,...) at _cv_wait+0x1f9/frame 0xf5e02ca4 usb_process(c78f8d2c,f5e02d08,c108f880,3d7,0,...) at usb_process+0xe6/frame 0xf5e02ccc fork_exit(c094fa40,c78f8d2c,f5e02d08) at fork_exit+0x7f/frame 0xf5e02cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5e02cf4 --- trap 0, eip = 0, esp = 0xf5e02d40, ebp = 0 --- Tracing command usb pid 15 tid 100057 td 0xc78ed600 sched_switch(c78ed600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5dffbd4 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xf5dffc08 sleepq_switch(c78ed600,0,c109b989,26b,c78ed600,...) at sleepq_switch+0x1b9/frame 0xf5dffc3c sleepq_wait(c78f8d04,0,f5dffc90,1,0,...) at sleepq_wait+0x48/frame 0xf5dffc60 _cv_wait(c78f8d04,c78f8e4c,c107348b,77,c78f8d0c,...) at _cv_wait+0x1f9/frame 0xf5dffca4 usb_process(c78f8cfc,f5dffd08,c108f880,3d7,0,...) at usb_process+0xe6/frame 0xf5dffccc fork_exit(c094fa40,c78f8cfc,f5dffd08) at fork_exit+0x7f/frame 0xf5dffcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5dffcf4 --- trap 0, eip = 0, esp = 0xf5dffd40, ebp = 0 --- Tracing command usb pid 15 tid 100056 td 0xc78ed900 sched_switch(c78ed900,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5dfcbd4 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xf5dfcc08 sleepq_switch(c78ed900,0,c109b989,26b,c78ed900,...) at sleepq_switch+0x1b9/frame 0xf5dfcc3c sleepq_wait(c78f8cd4,0,f5dfcc90,1,0,...) at sleepq_wait+0x48/frame 0xf5dfcc60 _cv_wait(c78f8cd4,c78f8e4c,c107348b,77,c78f8cdc,...) at _cv_wait+0x1f9/frame 0xf5dfcca4 usb_process(c78f8ccc,f5dfcd08,c108f880,3d7,0,...) at usb_process+0xe6/frame 0xf5dfcccc fork_exit(c094fa40,c78f8ccc,f5dfcd08) at fork_exit+0x7f/frame 0xf5dfccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5dfccf4 --- trap 0, eip = 0, esp = 0xf5dfcd40, ebp = 0 --- Tracing command usb pid 15 tid 100055 td 0xc78edc00 sched_switch(c78edc00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5df9bd4 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xf5df9c08 sleepq_switch(c78edc00,0,c109b989,26b,c78edc00,...) at sleepq_switch+0x1b9/frame 0xf5df9c3c sleepq_wait(c78f8ca4,0,f5df9c90,1,0,...) at sleepq_wait+0x48/frame 0xf5df9c60 _cv_wait(c78f8ca4,c78f8e4c,c107348b,77,c78f8cac,...) at _cv_wait+0x1f9/frame 0xf5df9ca4 usb_process(c78f8c9c,f5df9d08,c108f880,3d7,0,...) at usb_process+0xe6/frame 0xf5df9ccc fork_exit(c094fa40,c78f8c9c,f5df9d08) at fork_exit+0x7f/frame 0xf5df9cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5df9cf4 --- trap 0, eip = 0, esp = 0xf5df9d40, ebp = 0 --- Tracing command usb pid 15 tid 100053 td 0xc78f0300 sched_switch(c78f0300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5df0bd4 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xf5df0c08 sleepq_switch(c78f0300,0,c109b989,26b,c78f0300,...) at sleepq_switch+0x1b9/frame 0xf5df0c3c sleepq_wait(c78e9b5c,0,f5df0c90,1,0,...) at sleepq_wait+0x48/frame 0xf5df0c60 _cv_wait(c78e9b5c,c78e9c74,c107348b,77,c78e9b64,...) at _cv_wait+0x1f9/frame 0xf5df0ca4 usb_process(c78e9b54,f5df0d08,c108f880,3d7,0,...) at usb_process+0xe6/frame 0xf5df0ccc fork_exit(c094fa40,c78e9b54,f5df0d08) at fork_exit+0x7f/frame 0xf5df0cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5df0cf4 --- trap 0, eip = 0, esp = 0xf5df0d40, ebp = 0 --- Tracing command usb pid 15 tid 100052 td 0xc78f0600 sched_switch(c78f0600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5dedbd4 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xf5dedc08 sleepq_switch(c78f0600,0,c109b989,26b,c78f0600,...) at sleepq_switch+0x1b9/frame 0xf5dedc3c sleepq_wait(c78e9b2c,0,f5dedc90,1,0,...) at sleepq_wait+0x48/frame 0xf5dedc60 _cv_wait(c78e9b2c,c78e9c74,c107348b,77,c78e9b34,...) at _cv_wait+0x1f9/frame 0xf5dedca4 usb_process(c78e9b24,f5dedd08,c108f880,3d7,0,...) at usb_process+0xe6/frame 0xf5dedccc fork_exit(c094fa40,c78e9b24,f5dedd08) at fork_exit+0x7f/frame 0xf5dedcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5dedcf4 --- trap 0, eip = 0, esp = 0xf5dedd40, ebp = 0 --- Tracing command usb pid 15 tid 100051 td 0xc78e0000 sched_switch(c78e0000,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5deabd4 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xf5deac08 sleepq_switch(c78e0000,0,c109b989,26b,c78e0000,...) at sleepq_switch+0x1b9/frame 0xf5deac3c sleepq_wait(c78e9afc,0,f5deac90,1,0,...) at sleepq_wait+0x48/frame 0xf5deac60 _cv_wait(c78e9afc,c78e9c74,c107348b,77,c78e9b04,...) at _cv_wait+0x1f9/frame 0xf5deaca4 usb_process(c78e9af4,f5dead08,c108f880,3d7,0,...) at usb_process+0xe6/frame 0xf5deaccc fork_exit(c094fa40,c78e9af4,f5dead08) at fork_exit+0x7f/frame 0xf5deacf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5deacf4 --- trap 0, eip = 0, esp = 0xf5dead40, ebp = 0 --- Tracing command usb pid 15 tid 100050 td 0xc78e0300 sched_switch(c78e0300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5de7bd4 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xf5de7c08 sleepq_switch(c78e0300,0,c109b989,26b,c78e0300,...) at sleepq_switch+0x1b9/frame 0xf5de7c3c sleepq_wait(c78e9acc,0,f5de7c90,1,0,...) at sleepq_wait+0x48/frame 0xf5de7c60 _cv_wait(c78e9acc,c78e9c74,c107348b,77,c78e9ad4,...) at _cv_wait+0x1f9/frame 0xf5de7ca4 usb_process(c78e9ac4,f5de7d08,c108f880,3d7,0,...) at usb_process+0xe6/frame 0xf5de7ccc fork_exit(c094fa40,c78e9ac4,f5de7d08) at fork_exit+0x7f/frame 0xf5de7cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5de7cf4 --- trap 0, eip = 0, esp = 0xf5de7d40, ebp = 0 --- Tracing command usb pid 15 tid 100049 td 0xc78e0600 sched_switch(c78e0600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5de3bd4 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xf5de3c08 sleepq_switch(c78e0600,0,c109b989,26b,c78e0600,...) at sleepq_switch+0x1b9/frame 0xf5de3c3c sleepq_wait(c78e3b5c,0,f5de3c90,1,0,...) at sleepq_wait+0x48/frame 0xf5de3c60 _cv_wait(c78e3b5c,c78e3c74,c107348b,77,c78e3b64,...) at _cv_wait+0x1f9/frame 0xf5de3ca4 usb_process(c78e3b54,f5de3d08,c108f880,3d7,0,...) at usb_process+0xe6/frame 0xf5de3ccc fork_exit(c094fa40,c78e3b54,f5de3d08) at fork_exit+0x7f/frame 0xf5de3cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5de3cf4 --- trap 0, eip = 0, esp = 0xf5de3d40, ebp = 0 --- Tracing command usb pid 15 tid 100048 td 0xc78e0900 sched_switch(c78e0900,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5de0bd4 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xf5de0c08 sleepq_switch(c78e0900,0,c109b989,26b,c78e0900,...) at sleepq_switch+0x1b9/frame 0xf5de0c3c sleepq_wait(c78e3b2c,0,f5de0c90,1,0,...) at sleepq_wait+0x48/frame 0xf5de0c60 _cv_wait(c78e3b2c,c78e3c74,c107348b,77,c78e3b34,...) at _cv_wait+0x1f9/frame 0xf5de0ca4 usb_process(c78e3b24,f5de0d08,c108f880,3d7,0,...) at usb_process+0xe6/frame 0xf5de0ccc fork_exit(c094fa40,c78e3b24,f5de0d08) at fork_exit+0x7f/frame 0xf5de0cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5de0cf4 --- trap 0, eip = 0, esp = 0xf5de0d40, ebp = 0 --- Tracing command usb pid 15 tid 100047 td 0xc78e0c00 sched_switch(c78e0c00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5dddbd4 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xf5dddc08 sleepq_switch(c78e0c00,0,c109b989,26b,c78e0c00,...) at sleepq_switch+0x1b9/frame 0xf5dddc3c sleepq_wait(c78e3afc,0,f5dddc90,1,0,...) at sleepq_wait+0x48/frame 0xf5dddc60 _cv_wait(c78e3afc,c78e3c74,c107348b,77,c78e3b04,...) at _cv_wait+0x1f9/frame 0xf5dddca4 usb_process(c78e3af4,f5dddd08,c108f880,3d7,0,...) at usb_process+0xe6/frame 0xf5dddccc fork_exit(c094fa40,c78e3af4,f5dddd08) at fork_exit+0x7f/frame 0xf5dddcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5dddcf4 --- trap 0, eip = 0, esp = 0xf5dddd40, ebp = 0 --- Tracing command usb pid 15 tid 100046 td 0xc78e1000 sched_switch(c78e1000,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5ddabd4 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xf5ddac08 sleepq_switch(c78e1000,0,c109b989,26b,c78e1000,...) at sleepq_switch+0x1b9/frame 0xf5ddac3c sleepq_wait(c78e3acc,0,f5ddac90,1,0,...) at sleepq_wait+0x48/frame 0xf5ddac60 _cv_wait(c78e3acc,c78e3c74,c107348b,77,c78e3ad4,...) at _cv_wait+0x1f9/frame 0xf5ddaca4 usb_process(c78e3ac4,f5ddad08,c108f880,3d7,0,...) at usb_process+0xe6/frame 0xf5ddaccc fork_exit(c094fa40,c78e3ac4,f5ddad08) at fork_exit+0x7f/frame 0xf5ddacf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5ddacf4 --- trap 0, eip = 0, esp = 0xf5ddad40, ebp = 0 --- Tracing command usb pid 15 tid 100045 td 0xc78e1300 sched_switch(c78e1300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5dd6bd4 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xf5dd6c08 sleepq_switch(c78e1300,0,c109b989,26b,c78e1300,...) at sleepq_switch+0x1b9/frame 0xf5dd6c3c sleepq_wait(c78dcb5c,0,f5dd6c90,1,0,...) at sleepq_wait+0x48/frame 0xf5dd6c60 _cv_wait(c78dcb5c,c78dcc74,c107348b,77,c78dcb64,...) at _cv_wait+0x1f9/frame 0xf5dd6ca4 usb_process(c78dcb54,f5dd6d08,c108f880,3d7,0,...) at usb_process+0xe6/frame 0xf5dd6ccc fork_exit(c094fa40,c78dcb54,f5dd6d08) at fork_exit+0x7f/frame 0xf5dd6cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5dd6cf4 --- trap 0, eip = 0, esp = 0xf5dd6d40, ebp = 0 --- Tracing command usb pid 15 tid 100044 td 0xc78e1600 sched_switch(c78e1600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5dd3bd4 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xf5dd3c08 sleepq_switch(c78e1600,0,c109b989,26b,c78e1600,...) at sleepq_switch+0x1b9/frame 0xf5dd3c3c sleepq_wait(c78dcb2c,0,f5dd3c90,1,0,...) at sleepq_wait+0x48/frame 0xf5dd3c60 _cv_wait(c78dcb2c,c78dcc74,c107348b,77,c78dcb34,...) at _cv_wait+0x1f9/frame 0xf5dd3ca4 usb_process(c78dcb24,f5dd3d08,c108f880,3d7,0,...) at usb_process+0xe6/frame 0xf5dd3ccc fork_exit(c094fa40,c78dcb24,f5dd3d08) at fork_exit+0x7f/frame 0xf5dd3cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5dd3cf4 --- trap 0, eip = 0, esp = 0xf5dd3d40, ebp = 0 --- Tracing command usb pid 15 tid 100043 td 0xc78e1900 sched_switch(c78e1900,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5dd0bd4 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xf5dd0c08 sleepq_switch(c78e1900,0,c109b989,26b,c78e1900,...) at sleepq_switch+0x1b9/frame 0xf5dd0c3c sleepq_wait(c78dcafc,0,f5dd0c90,1,0,...) at sleepq_wait+0x48/frame 0xf5dd0c60 _cv_wait(c78dcafc,c78dcc74,c107348b,77,c78dcb04,...) at _cv_wait+0x1f9/frame 0xf5dd0ca4 usb_process(c78dcaf4,f5dd0d08,c108f880,3d7,0,...) at usb_process+0xe6/frame 0xf5dd0ccc fork_exit(c094fa40,c78dcaf4,f5dd0d08) at fork_exit+0x7f/frame 0xf5dd0cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5dd0cf4 --- trap 0, eip = 0, esp = 0xf5dd0d40, ebp = 0 --- Tracing command usb pid 15 tid 100042 td 0xc78e1c00 sched_switch(c78e1c00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5dcdbd4 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xf5dcdc08 sleepq_switch(c78e1c00,0,c109b989,26b,c78e1c00,...) at sleepq_switch+0x1b9/frame 0xf5dcdc3c sleepq_wait(c78dcacc,0,f5dcdc90,1,0,...) at sleepq_wait+0x48/frame 0xf5dcdc60 _cv_wait(c78dcacc,c78dcc74,c107348b,77,c78dcad4,...) at _cv_wait+0x1f9/frame 0xf5dcdca4 usb_process(c78dcac4,f5dcdd08,c108f880,3d7,0,...) at usb_process+0xe6/frame 0xf5dcdccc fork_exit(c094fa40,c78dcac4,f5dcdd08) at fork_exit+0x7f/frame 0xf5dcdcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5dcdcf4 --- trap 0, eip = 0, esp = 0xf5dcdd40, ebp = 0 --- Tracing command usb pid 15 tid 100040 td 0xc78d2000 sched_switch(c78d2000,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5dc6bd4 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xf5dc6c08 sleepq_switch(c78d2000,0,c109b989,26b,c78d2000,...) at sleepq_switch+0x1b9/frame 0xf5dc6c3c sleepq_wait(c78d7b5c,0,f5dc6c90,1,0,...) at sleepq_wait+0x48/frame 0xf5dc6c60 _cv_wait(c78d7b5c,c78d7c74,c107348b,77,c78d7b64,...) at _cv_wait+0x1f9/frame 0xf5dc6ca4 usb_process(c78d7b54,f5dc6d08,c108f880,3d7,0,...) at usb_process+0xe6/frame 0xf5dc6ccc fork_exit(c094fa40,c78d7b54,f5dc6d08) at fork_exit+0x7f/frame 0xf5dc6cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5dc6cf4 --- trap 0, eip = 0, esp = 0xf5dc6d40, ebp = 0 --- Tracing command usb pid 15 tid 100039 td 0xc78d2300 sched_switch(c78d2300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5dc3bd4 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xf5dc3c08 sleepq_switch(c78d2300,0,c109b989,26b,c78d2300,...) at sleepq_switch+0x1b9/frame 0xf5dc3c3c sleepq_wait(c78d7b2c,0,f5dc3c90,1,0,...) at sleepq_wait+0x48/frame 0xf5dc3c60 _cv_wait(c78d7b2c,c78d7c74,c107348b,77,c78d7b34,...) at _cv_wait+0x1f9/frame 0xf5dc3ca4 usb_process(c78d7b24,f5dc3d08,c108f880,3d7,0,...) at usb_process+0xe6/frame 0xf5dc3ccc fork_exit(c094fa40,c78d7b24,f5dc3d08) at fork_exit+0x7f/frame 0xf5dc3cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5dc3cf4 --- trap 0, eip = 0, esp = 0xf5dc3d40, ebp = 0 --- Tracing command usb pid 15 tid 100038 td 0xc78d2600 sched_switch(c78d2600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5dc0bd4 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xf5dc0c08 sleepq_switch(c78d2600,0,c109b989,26b,c78d2600,...) at sleepq_switch+0x1b9/frame 0xf5dc0c3c sleepq_wait(c78d7afc,0,f5dc0c90,1,0,...) at sleepq_wait+0x48/frame 0xf5dc0c60 _cv_wait(c78d7afc,c78d7c74,c107348b,77,c78d7b04,...) at _cv_wait+0x1f9/frame 0xf5dc0ca4 usb_process(c78d7af4,f5dc0d08,c108f880,3d7,0,...) at usb_process+0xe6/frame 0xf5dc0ccc fork_exit(c094fa40,c78d7af4,f5dc0d08) at fork_exit+0x7f/frame 0xf5dc0cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5dc0cf4 --- trap 0, eip = 0, esp = 0xf5dc0d40, ebp = 0 --- Tracing command usb pid 15 tid 100037 td 0xc78d2900 sched_switch(c78d2900,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5dbdbd4 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xf5dbdc08 sleepq_switch(c78d2900,0,c109b989,26b,c78d2900,...) at sleepq_switch+0x1b9/frame 0xf5dbdc3c sleepq_wait(c78d7acc,0,f5dbdc90,1,0,...) at sleepq_wait+0x48/frame 0xf5dbdc60 _cv_wait(c78d7acc,c78d7c74,c107348b,77,c78d7ad4,...) at _cv_wait+0x1f9/frame 0xf5dbdca4 usb_process(c78d7ac4,f5dbdd08,c108f880,3d7,0,...) at usb_process+0xe6/frame 0xf5dbdccc fork_exit(c094fa40,c78d7ac4,f5dbdd08) at fork_exit+0x7f/frame 0xf5dbdcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5dbdcf4 --- trap 0, eip = 0, esp = 0xf5dbdd40, ebp = 0 --- Tracing command usb pid 15 tid 100035 td 0xc78d4000 sched_switch(c78d4000,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5db6bd4 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xf5db6c08 sleepq_switch(c78d4000,0,c109b989,26b,c78d4000,...) at sleepq_switch+0x1b9/frame 0xf5db6c3c sleepq_wait(c78cdb5c,0,f5db6c90,1,0,...) at sleepq_wait+0x48/frame 0xf5db6c60 _cv_wait(c78cdb5c,c78cdc74,c107348b,77,c78cdb64,...) at _cv_wait+0x1f9/frame 0xf5db6ca4 usb_process(c78cdb54,f5db6d08,c108f880,3d7,0,...) at usb_process+0xe6/frame 0xf5db6ccc fork_exit(c094fa40,c78cdb54,f5db6d08) at fork_exit+0x7f/frame 0xf5db6cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5db6cf4 --- trap 0, eip = 0, esp = 0xf5db6d40, ebp = 0 --- Tracing command usb pid 15 tid 100034 td 0xc78d4300 sched_switch(c78d4300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5db3bd4 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xf5db3c08 sleepq_switch(c78d4300,0,c109b989,26b,c78d4300,...) at sleepq_switch+0x1b9/frame 0xf5db3c3c sleepq_wait(c78cdb2c,0,f5db3c90,1,0,...) at sleepq_wait+0x48/frame 0xf5db3c60 _cv_wait(c78cdb2c,c78cdc74,c107348b,77,c78cdb34,...) at _cv_wait+0x1f9/frame 0xf5db3ca4 usb_process(c78cdb24,f5db3d08,c108f880,3d7,0,...) at usb_process+0xe6/frame 0xf5db3ccc fork_exit(c094fa40,c78cdb24,f5db3d08) at fork_exit+0x7f/frame 0xf5db3cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5db3cf4 --- trap 0, eip = 0, esp = 0xf5db3d40, ebp = 0 --- Tracing command usb pid 15 tid 100033 td 0xc78d4600 sched_switch(c78d4600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5db0bd4 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xf5db0c08 sleepq_switch(c78d4600,0,c109b989,26b,c78d4600,...) at sleepq_switch+0x1b9/frame 0xf5db0c3c sleepq_wait(c78cdafc,0,f5db0c90,1,0,...) at sleepq_wait+0x48/frame 0xf5db0c60 _cv_wait(c78cdafc,c78cdc74,c107348b,77,c78cdb04,...) at _cv_wait+0x1f9/frame 0xf5db0ca4 usb_process(c78cdaf4,f5db0d08,c108f880,3d7,0,...) at usb_process+0xe6/frame 0xf5db0ccc fork_exit(c094fa40,c78cdaf4,f5db0d08) at fork_exit+0x7f/frame 0xf5db0cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5db0cf4 --- trap 0, eip = 0, esp = 0xf5db0d40, ebp = 0 --- Tracing command usb pid 15 tid 100032 td 0xc78d4900 sched_switch(c78d4900,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5dadbd4 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xf5dadc08 sleepq_switch(c78d4900,0,c109b989,26b,c78d4900,...) at sleepq_switch+0x1b9/frame 0xf5dadc3c sleepq_wait(c78cdacc,0,f5dadc90,1,0,...) at sleepq_wait+0x48/frame 0xf5dadc60 _cv_wait(c78cdacc,c78cdc74,c107348b,77,c78cdad4,...) at _cv_wait+0x1f9/frame 0xf5dadca4 usb_process(c78cdac4,f5dadd08,c108f880,3d7,0,...) at usb_process+0xe6/frame 0xf5dadccc fork_exit(c094fa40,c78cdac4,f5dadd08) at fork_exit+0x7f/frame 0xf5dadcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5dadcf4 --- trap 0, eip = 0, esp = 0xf5dadd40, ebp = 0 --- Tracing command yarrow pid 14 tid 100017 td 0xc7772600 sched_switch(c7772600,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xc7236bb4 mi_switch(104,0,c109b989,1f5,c125fc68,...) at mi_switch+0x1c9/frame 0xc7236be8 sleepq_switch(c7772600,0,c109b989,28e,c122964c,...) at sleepq_switch+0x1b9/frame 0xc7236c1c sleepq_timedwait(c122964c,0,c1096975,c1081d06,0,...) at sleepq_timedwait+0x48/frame 0xc7236c40 msleep_spin_sbt(c122964c,c140999c,c1081d06,19999999,0,...) at msleep_spin_sbt+0x225/frame 0xc7236c88 random_kthread(0,c7236d08,c108f880,3d7,0,...) at random_kthread+0x2ea/frame 0xc7236ccc fork_exit(c083e600,0,c7236d08) at fork_exit+0x7f/frame 0xc7236cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7236cf4 --- trap 0, eip = 0, esp = 0xc7236d40, ebp = 0 --- Tracing command geom pid 13 tid 100016 td 0xc7772900 sched_switch(c7772900,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xc7232b74 mi_switch(104,0,c109b989,1f5,162,...) at mi_switch+0x1c9/frame 0xc7232ba8 sleepq_switch(c7772900,0,c109b989,26b,c7772900,...) at sleepq_switch+0x1b9/frame 0xc7232bdc sleepq_wait(c140ac6c,5c,c1081d06,0,0,...) at sleepq_wait+0x48/frame 0xc7232c00 _sleep(c140ac6c,c1240b90,25c,c1081d06,0,...) at _sleep+0x37c/frame 0xc7232c5c g_io_schedule_down(c7772900,0,c1083967,6c,c7232cf4,...) at g_io_schedule_down+0x5c/frame 0xc7232cb4 g_down_procbody(0,c7232d08,c108f880,3d7,0,...) at g_down_procbody+0x9d/frame 0xc7232ccc fork_exit(c09fd7c0,0,c7232d08) at fork_exit+0x7f/frame 0xc7232cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7232cf4 --- trap 0, eip = 0, esp = 0xc7232d40, ebp = 0 --- Tracing command geom pid 13 tid 100015 td 0xc7772c00 sched_switch(c7772c00,0,103,1b0,0,...) at sched_switch+0x4b4/frame 0xc722fac4 mi_switch(103,0,c109c55c,2e6,1a75,...) at mi_switch+0x1c9/frame 0xc722faf8 turnstile_wait(c9629e80,cbbee600,0,c7772c00,675828,...) at turnstile_wait+0x3b4/frame 0xc722fb28 __rw_wlock_hard(c13d1a90,c7772c00,c10ec202,1106,0,...) at __rw_wlock_hard+0x343/frame 0xc722fba4 _rw_wlock_cookie(c13d1a90,c10ec202,1106,e3851544,c31bf240,...) at _rw_wlock_cookie+0xdd/frame 0xc722fbd4 pmap_page_is_mapped(c31bf240,c10d00e0,5dc,c777d258,1,...) at pmap_page_is_mapped+0x2f/frame 0xc722fbf0 swp_pager_async_iodone(e3851544,8,c10a36f6,e00,0,...) at swp_pager_async_iodone+0x138/frame 0xc722fc24 bufdone(e3851544) at bufdone+0xc9/frame 0xc722fc44 swapgeom_done(c7dc0b88,0,c10a36f6,e00,0,...) at swapgeom_done+0x38/frame 0xc722fc54 biodone(c7dc0b88,0,c108374c,60,0,...) at biodone+0xb2/frame 0xc722fc80 g_io_schedule_up(c7772c00,0,c1083967,5f,c722fcf4,...) at g_io_schedule_up+0x129/frame 0xc722fcb4 g_up_procbody(0,c722fd08,c108f880,3d7,0,...) at g_up_procbody+0x9d/frame 0xc722fccc fork_exit(c09fd720,0,c722fd08) at fork_exit+0x7f/frame 0xc722fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc722fcf4 --- trap 0, eip = 0, esp = 0xc722fd40, ebp = 0 --- Tracing command geom pid 13 tid 100014 td 0xc7773000 sched_switch(c7773000,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xc722cba8 mi_switch(104,0,c109b989,1f5,162,...) at mi_switch+0x1c9/frame 0xc722cbdc sleepq_switch(c7773000,0,c109b989,26b,c7773000,...) at sleepq_switch+0x1b9/frame 0xc722cc10 sleepq_wait(c140ac64,5c,c1081d06,0,0,...) at sleepq_wait+0x48/frame 0xc722cc34 _sleep(c140ac64,c1240b68,25c,c1081d06,0,...) at _sleep+0x37c/frame 0xc722cc90 g_run_events(0,c722cd08,c108f880,3d7,0,...) at g_run_events+0x539/frame 0xc722cccc fork_exit(c09fd680,0,c722cd08) at fork_exit+0x7f/frame 0xc722ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc722ccf4 --- trap 0, eip = 0, esp = 0xc722cd40, ebp = 0 --- Tracing command intr pid 12 tid 100063 td 0xc78e2300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100062 td 0xc78e2600 sched_switch(c78e2600,0,109,1b5,0,...) at sched_switch+0x4b4/frame 0xf5e29c60 mi_switch(109,0,c108fb1d,55a,8,...) at mi_switch+0x1c9/frame 0xf5e29c94 ithread_loop(c770f6b0,f5e29d08,c108f880,3d7,0,...) at ithread_loop+0x100/frame 0xf5e29ccc fork_exit(c0a6f030,c770f6b0,f5e29d08) at fork_exit+0x7f/frame 0xf5e29cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5e29cf4 --- trap 0, eip = 0, esp = 0xf5e29d40, ebp = 0 --- Tracing command intr pid 12 tid 100060 td 0xc78e2c00 sched_switch(c78e2c00,0,109,1b5,0,...) at sched_switch+0x4b4/frame 0xf5e19c60 mi_switch(109,0,c108fb1d,55a,8,...) at mi_switch+0x1c9/frame 0xf5e19c94 ithread_loop(c770f6c0,f5e19d08,c108f880,3d7,0,...) at ithread_loop+0x100/frame 0xf5e19ccc fork_exit(c0a6f030,c770f6c0,f5e19d08) at fork_exit+0x7f/frame 0xf5e19cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5e19cf4 --- trap 0, eip = 0, esp = 0xf5e19d40, ebp = 0 --- Tracing command intr pid 12 tid 100059 td 0xc78ed000 sched_switch(c78ed000,0,109,1b5,c141a5b4,...) at sched_switch+0x4b4/frame 0xf5e08c60 mi_switch(109,0,c108fb1d,55a,8,...) at mi_switch+0x1c9/frame 0xf5e08c94 ithread_loop(c770f6e0,f5e08d08,c108f880,3d7,0,...) at ithread_loop+0x100/frame 0xf5e08ccc fork_exit(c0a6f030,c770f6e0,f5e08d08) at fork_exit+0x7f/frame 0xf5e08cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5e08cf4 --- trap 0, eip = 0, esp = 0xf5e08d40, ebp = 0 --- Tracing command intr pid 12 tid 100054 td 0xc78f0000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xc78e2000 sched_switch(c78e2000,0,109,1b5,0,...) at sched_switch+0x4b4/frame 0xf5dcac60 mi_switch(109,0,c108fb1d,55a,8,...) at mi_switch+0x1c9/frame 0xf5dcac94 ithread_loop(c770f700,f5dcad08,c108f880,3d7,0,...) at ithread_loop+0x100/frame 0xf5dcaccc fork_exit(c0a6f030,c770f700,f5dcad08) at fork_exit+0x7f/frame 0xf5dcacf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5dcacf4 --- trap 0, eip = 0, esp = 0xf5dcad40, ebp = 0 --- Tracing command intr pid 12 tid 100036 td 0xc78d2c00 sched_switch(c78d2c00,0,109,1b5,0,...) at sched_switch+0x4b4/frame 0xf5dbac60 mi_switch(109,0,c108fb1d,55a,8,...) at mi_switch+0x1c9/frame 0xf5dbac94 ithread_loop(c770f710,f5dbad08,c108f880,3d7,0,...) at ithread_loop+0x100/frame 0xf5dbaccc fork_exit(c0a6f030,c770f710,f5dbad08) at fork_exit+0x7f/frame 0xf5dbacf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5dbacf4 --- trap 0, eip = 0, esp = 0xf5dbad40, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xc78d4c00 sched_switch(c78d4c00,0,109,1b5,c141a5b4,...) at sched_switch+0x4b4/frame 0xf5daac60 mi_switch(109,0,c108fb1d,55a,8,...) at mi_switch+0x1c9/frame 0xf5daac94 ithread_loop(c770f720,f5daad08,c108f880,3d7,0,...) at ithread_loop+0x100/frame 0xf5daaccc fork_exit(c0a6f030,c770f720,f5daad08) at fork_exit+0x7f/frame 0xf5daacf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5daacf4 --- trap 0, eip = 0, esp = 0xf5daad40, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc7773300 sched_switch(c7773300,0,109,1b5,c141a5b4,...) at sched_switch+0x4b4/frame 0xc7393c60 mi_switch(109,0,c108fb1d,55a,8,...) at mi_switch+0x1c9/frame 0xc7393c94 ithread_loop(c770f730,c7393d08,c108f880,3d7,0,...) at ithread_loop+0x100/frame 0xc7393ccc fork_exit(c0a6f030,c770f730,c7393d08) at fork_exit+0x7f/frame 0xc7393cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7393cf4 --- trap 0, eip = 0, esp = 0xc7393d40, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc7773600 sched_switch(c7773600,0,109,1b5,c108fb1d,...) at sched_switch+0x4b4/frame 0xc738fc60 mi_switch(109,0,c108fb1d,55a,8,...) at mi_switch+0x1c9/frame 0xc738fc94 ithread_loop(c770f740,c738fd08,c108f880,3d7,0,...) at ithread_loop+0x100/frame 0xc738fccc fork_exit(c0a6f030,c770f740,c738fd08) at fork_exit+0x7f/frame 0xc738fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc738fcf4 --- trap 0, eip = 0, esp = 0xc738fd40, ebp = 0 --- Tracing command intr pid 12 tid 100028 td 0xc7773900 sched_switch(c7773900,0,109,1b5,0,...) at sched_switch+0x4b4/frame 0xc7286c60 mi_switch(109,0,c108fb1d,55a,8,...) at mi_switch+0x1c9/frame 0xc7286c94 ithread_loop(c770f750,c7286d08,c108f880,3d7,0,...) at ithread_loop+0x100/frame 0xc7286ccc fork_exit(c0a6f030,c770f750,c7286d08) at fork_exit+0x7f/frame 0xc7286cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7286cf4 --- trap 0, eip = 0, esp = 0xc7286d40, ebp = 0 --- Tracing command intr pid 12 tid 100025 td 0xc785e300 sched_switch(c785e300,0,109,1b5,0,...) at sched_switch+0x4b4/frame 0xc724ec60 mi_switch(109,0,c108fb1d,55a,8,...) at mi_switch+0x1c9/frame 0xc724ec94 ithread_loop(c770f760,c724ed08,c108f880,3d7,0,...) at ithread_loop+0x100/frame 0xc724eccc fork_exit(c0a6f030,c770f760,c724ed08) at fork_exit+0x7f/frame 0xc724ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc724ecf4 --- trap 0, eip = 0, esp = 0xc724ed40, ebp = 0 --- Tracing command intr pid 12 tid 100024 td 0xc785e600 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100022 td 0xc785ec00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100021 td 0xc7710900 sched_switch(c7710900,0,109,1b5,0,...) at sched_switch+0x4b4/frame 0xc7242c60 mi_switch(109,0,c108fb1d,55a,8,...) at mi_switch+0x1c9/frame 0xc7242c94 ithread_loop(c770f790,c7242d08,c108f880,3d7,0,...) at ithread_loop+0x100/frame 0xc7242ccc fork_exit(c0a6f030,c770f790,c7242d08) at fork_exit+0x7f/frame 0xc7242cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7242cf4 --- trap 0, eip = 0, esp = 0xc7242d40, ebp = 0 --- Tracing command intr pid 12 tid 100012 td 0xc76cd600 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100011 td 0xc76cd900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100010 td 0xc76cdc00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100009 td 0xc7710000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100008 td 0xc7710300 sched_switch(c7710300,0,109,1b5,c108fb1d,...) at sched_switch+0x4b4/frame 0xc721ac60 mi_switch(109,0,c108fb1d,55a,8,...) at mi_switch+0x1c9/frame 0xc721ac94 ithread_loop(c770f7e0,c721ad08,c108f880,3d7,0,...) at ithread_loop+0x100/frame 0xc721accc fork_exit(c0a6f030,c770f7e0,c721ad08) at fork_exit+0x7f/frame 0xc721acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc721acf4 --- trap 0, eip = 0, esp = 0xc721ad40, ebp = 0 --- Tracing command intr pid 12 tid 100007 td 0xc7710600 sched_switch(c7710600,0,109,1b5,c108fb1d,...) at sched_switch+0x4b4/frame 0xc7217c60 mi_switch(109,0,c108fb1d,55a,8,...) at mi_switch+0x1c9/frame 0xc7217c94 ithread_loop(c770f7f0,c7217d08,c108f880,3d7,0,...) at ithread_loop+0x100/frame 0xc7217ccc fork_exit(c0a6f030,c770f7f0,c7217d08) at fork_exit+0x7f/frame 0xc7217cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7217cf4 --- trap 0, eip = 0, esp = 0xc7217d40, ebp = 0 --- Tracing command idle pid 11 tid 100006 td 0xc76cc000 sched_switch(c76cc000,0,108,1b0,c10982d9,...) at sched_switch+0x4b4/frame 0xc7213c1c mi_switch(108,0,c10982d9,407,c1251108,...) at mi_switch+0x1c9/frame 0xc7213c50 sched_idletd(0,c7213d08,c108f880,3d7,0,...) at sched_idletd+0x43b/frame 0xc7213ccc fork_exit(c0ac5590,0,c7213d08) at fork_exit+0x7f/frame 0xc7213cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7213cf4 --- trap 0, eip = 0, esp = 0xc7213d40, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc76cc300 sched_switch(c76cc300,0,108,1b0,c10982d9,...) at sched_switch+0x4b4/frame 0xc7210c1c mi_switch(108,0,c10982d9,407,c1250a08,...) at mi_switch+0x1c9/frame 0xc7210c50 sched_idletd(0,c7210d08,c108f880,3d7,0,...) at sched_idletd+0x43b/frame 0xc7210ccc fork_exit(c0ac5590,0,c7210d08) at fork_exit+0x7f/frame 0xc7210cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7210cf4 --- trap 0, eip = 0, esp = 0xc7210d40, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc76cc600 sched_switch(c76cc600,0,108,1b0,c10982d9,...) at sched_switch+0x4b4/frame 0xc720dc1c mi_switch(108,0,c10982d9,407,c1250308,...) at mi_switch+0x1c9/frame 0xc720dc50 sched_idletd(0,c720dd08,c108f880,3d7,0,...) at sched_idletd+0x43b/frame 0xc720dccc fork_exit(c0ac5590,0,c720dd08) at fork_exit+0x7f/frame 0xc720dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc720dcf4 --- trap 0, eip = 0, esp = 0xc720dd40, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xc76cc900 sched_switch(c76cc900,0,108,1b0,c10982d9,...) at sched_switch+0x4b4/frame 0xc720ac1c mi_switch(108,0,c10982d9,407,c124fc08,...) at mi_switch+0x1c9/frame 0xc720ac50 sched_idletd(0,c720ad08,c108f880,3d7,0,...) at sched_idletd+0x43b/frame 0xc720accc fork_exit(c0ac5590,0,c720ad08) at fork_exit+0x7f/frame 0xc720acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc720acf4 --- trap 0, eip = 0, esp = 0xc720ad40, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc76ccc00 sched_switch(c76ccc00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xc720698c mi_switch(104,0,c109b989,1f5,c109b989,...) at mi_switch+0x1c9/frame 0xc72069c0 sleepq_switch(c76ccc00,0,c109b989,1ab,c7206a38,...) at sleepq_switch+0x1b9/frame 0xc72069f4 sleepq_catch_signals(0,c109b989,162,108,c76ccc00,...) at sleepq_catch_signals+0x3a1/frame 0xc7206a3c sleepq_wait_sig(c76caba0,6c,c109eda5,100,0,...) at sleepq_wait_sig+0x14/frame 0xc7206a60 _sleep(c76caba0,c76cac34,16c,c109eda5,0,...) at _sleep+0x35b/frame 0xc7206abc kern_wait6(c76ccc00,7,0,0,c7206b4c,...) at kern_wait6+0x45c/frame 0xc7206b20 sys_wait4(c76ccc00,c7206cc8,c0ebf800,c1825c90,0,...) at sys_wait4+0x94/frame 0xc7206c40 syscall(c7206d08) at syscall+0x2ed/frame 0xc7206cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xc7206cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x805dcf7, esp = 0xbfbfd8f4, ebp = 0xbfbfd908 --- Tracing command audit pid 10 tid 100001 td 0xc76cd000 sched_switch(c76cd000,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xc7203ba8 mi_switch(104,0,c109b989,1f5,8,...) at mi_switch+0x1c9/frame 0xc7203bdc sleepq_switch(c76cd000,0,c109b989,26b,c76cd000,...) at sleepq_switch+0x1b9/frame 0xc7203c10 sleepq_wait(c14119f8,0,c7203c64,1,0,...) at sleepq_wait+0x48/frame 0xc7203c34 _cv_wait(c14119f8,c1411984,c10c70f2,18d,0,...) at _cv_wait+0x1f9/frame 0xc7203c78 audit_worker(0,c7203d08,c108f880,3d7,0,...) at audit_worker+0x94/frame 0xc7203ccc fork_exit(c0cab660,0,c7203d08) at fork_exit+0x7f/frame 0xc7203cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7203cf4 --- trap 0, eip = 0, esp = 0xc7203d40, ebp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xc7946c00 sched_switch(c7946c00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5e32b68 mi_switch(104,0,c109b989,1f5,101,...) at mi_switch+0x1c9/frame 0xf5e32b9c sleepq_switch(c7946c00,0,c109b989,28e,c7946c00,...) at sleepq_switch+0x1b9/frame 0xf5e32bd0 sleepq_timedwait(c1242862,0,2,0,0,...) at sleepq_timedwait+0x48/frame 0xf5e32bf4 _sleep(c1242862,0,0,c1081d06,fffffc88,...) at _sleep+0x345/frame 0xf5e32c50 pause_sbt(c1081d06,fffffc88,2,0,0,...) at pause_sbt+0x86/frame 0xf5e32c8c deadlkres(0,f5e32d08,c108f880,3d7,0,...) at deadlkres+0x82/frame 0xf5e32ccc fork_exit(c0a4dca0,0,f5e32d08) at fork_exit+0x7f/frame 0xf5e32cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5e32cf4 --- trap 0, eip = 0, esp = 0xf5e32d40, ebp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xc7948000 sched_switch(c7948000,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xf5e2fbc0 mi_switch(104,0,c109b989,1f5,c125fd28,...) at mi_switch+0x1c9/frame 0xf5e2fbf4 sleepq_switch(c7948000,0,c109b989,26b,c789a240,...) at sleepq_switch+0x1b9/frame 0xf5e2fc28 sleepq_wait(c789a240,0,c1096975,c1081d06,0,...) at sleepq_wait+0x48/frame 0xf5e2fc4c msleep_spin_sbt(c789a240,c789a258,c1081d06,0,0,...) at msleep_spin_sbt+0x239/frame 0xf5e2fc94 taskqueue_thread_loop(c1407380,f5e2fd08,c108f880,3d7,0,...) at taskqueue_thread_loop+0x9c/frame 0xf5e2fccc fork_exit(c0ae43a0,c1407380,f5e2fd08) at fork_exit+0x7f/frame 0xf5e2fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5e2fcf4 --- trap 0, eip = 0, esp = 0xf5e2fd40, ebp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xc7773c00 sched_switch(c7773c00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xc7254bac mi_switch(104,0,c109b989,1f5,162,...) at mi_switch+0x1c9/frame 0xc7254be0 sleepq_switch(c7773c00,0,c109b989,26b,c7773c00,...) at sleepq_switch+0x1b9/frame 0xc7254c14 sleepq_wait(c76abc80,0,c1081d06,0,0,...) at sleepq_wait+0x48/frame 0xc7254c38 _sleep(c76abc80,c76abc98,0,c1081d06,0,...) at _sleep+0x37c/frame 0xc7254c94 taskqueue_thread_loop(c1411a30,c7254d08,c108f880,3d7,0,...) at taskqueue_thread_loop+0xf9/frame 0xc7254ccc fork_exit(c0ae43a0,c1411a30,c7254d08) at fork_exit+0x7f/frame 0xc7254cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7254cf4 --- trap 0, eip = 0, esp = 0xc7254d40, ebp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xc785e000 sched_switch(c785e000,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xc7251bac mi_switch(104,0,c109b989,1f5,162,...) at mi_switch+0x1c9/frame 0xc7251be0 sleepq_switch(c785e000,0,c109b989,26b,c785e000,...) at sleepq_switch+0x1b9/frame 0xc7251c14 sleepq_wait(c76abcc0,0,c1081d06,0,0,...) at sleepq_wait+0x48/frame 0xc7251c38 _sleep(c76abcc0,c76abcd8,0,c1081d06,0,...) at _sleep+0x37c/frame 0xc7251c94 taskqueue_thread_loop(c140b468,c7251d08,c108f880,3d7,0,...) at taskqueue_thread_loop+0xf9/frame 0xc7251ccc fork_exit(c0ae43a0,c140b468,c7251d08) at fork_exit+0x7f/frame 0xc7251cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7251cf4 --- trap 0, eip = 0, esp = 0xc7251d40, ebp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xc785e900 sched_switch(c785e900,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xc7248bac mi_switch(104,0,c109b989,1f5,162,...) at mi_switch+0x1c9/frame 0xc7248be0 sleepq_switch(c785e900,0,c109b989,26b,c785e900,...) at sleepq_switch+0x1b9/frame 0xc7248c14 sleepq_wait(c76abd40,0,c1081d06,0,0,...) at sleepq_wait+0x48/frame 0xc7248c38 _sleep(c76abd40,c76abd58,0,c1081d06,0,...) at _sleep+0x37c/frame 0xc7248c94 taskqueue_thread_loop(c140e3c0,c7248d08,c108f880,3d7,0,...) at taskqueue_thread_loop+0xf9/frame 0xc7248ccc fork_exit(c0ae43a0,c140e3c0,c7248d08) at fork_exit+0x7f/frame 0xc7248cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7248cf4 --- trap 0, eip = 0, esp = 0xc7248d40, ebp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xc7710c00 sched_switch(c7710c00,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xc723fbc0 mi_switch(104,0,c109b989,1f5,c125f9c8,...) at mi_switch+0x1c9/frame 0xc723fbf4 sleepq_switch(c7710c00,0,c109b989,26b,c76abe00,...) at sleepq_switch+0x1b9/frame 0xc723fc28 sleepq_wait(c76abe00,0,c1096975,c1081d06,0,...) at sleepq_wait+0x48/frame 0xc723fc4c msleep_spin_sbt(c76abe00,c76abe18,c1081d06,0,0,...) at msleep_spin_sbt+0x239/frame 0xc723fc94 taskqueue_thread_loop(c1407fa8,c723fd08,c108f880,3d7,0,...) at taskqueue_thread_loop+0x9c/frame 0xc723fccc fork_exit(c0ae43a0,c1407fa8,c723fd08) at fork_exit+0x7f/frame 0xc723fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc723fcf4 --- trap 0, eip = 0, esp = 0xc723fd40, ebp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xc7772000 sched_switch(c7772000,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xc723cbc0 mi_switch(104,0,c109b989,1f5,c125f9c8,...) at mi_switch+0x1c9/frame 0xc723cbf4 sleepq_switch(c7772000,0,c109b989,26b,c76abe00,...) at sleepq_switch+0x1b9/frame 0xc723cc28 sleepq_wait(c76abe00,0,c1096975,c1081d06,0,...) at sleepq_wait+0x48/frame 0xc723cc4c msleep_spin_sbt(c76abe00,c76abe18,c1081d06,0,0,...) at msleep_spin_sbt+0x239/frame 0xc723cc94 taskqueue_thread_loop(c1407fa8,c723cd08,c108f880,3d7,0,...) at taskqueue_thread_loop+0x9c/frame 0xc723cccc fork_exit(c0ae43a0,c1407fa8,c723cd08) at fork_exit+0x7f/frame 0xc723ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc723ccf4 --- trap 0, eip = 0, esp = 0xc723cd40, ebp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xc7772300 sched_switch(c7772300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xc7239bc0 mi_switch(104,0,c109b989,1f5,c125f9c8,...) at mi_switch+0x1c9/frame 0xc7239bf4 sleepq_switch(c7772300,0,c109b989,26b,c76abe00,...) at sleepq_switch+0x1b9/frame 0xc7239c28 sleepq_wait(c76abe00,0,c1096975,c1081d06,0,...) at sleepq_wait+0x48/frame 0xc7239c4c msleep_spin_sbt(c76abe00,c76abe18,c1081d06,0,0,...) at msleep_spin_sbt+0x239/frame 0xc7239c94 taskqueue_thread_loop(c1407fa8,c7239d08,c108f880,3d7,0,...) at taskqueue_thread_loop+0x9c/frame 0xc7239ccc fork_exit(c0ae43a0,c1407fa8,c7239d08) at fork_exit+0x7f/frame 0xc7239cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7239cf4 --- trap 0, eip = 0, esp = 0xc7239d40, ebp = 0 --- Tracing command kernel pid 0 tid 100013 td 0xc76cd300 sched_switch(c76cd300,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xc7229bac mi_switch(104,0,c109b989,1f5,162,...) at mi_switch+0x1c9/frame 0xc7229be0 sleepq_switch(c76cd300,0,c109b989,26b,c76cd300,...) at sleepq_switch+0x1b9/frame 0xc7229c14 sleepq_wait(c76abe40,0,c1081d06,0,0,...) at sleepq_wait+0x48/frame 0xc7229c38 _sleep(c76abe40,c76abe58,0,c1081d06,0,...) at _sleep+0x37c/frame 0xc7229c94 taskqueue_thread_loop(c125dcc0,c7229d08,c108f880,3d7,0,...) at taskqueue_thread_loop+0xf9/frame 0xc7229ccc fork_exit(c0ae43a0,c125dcc0,c7229d08) at fork_exit+0x7f/frame 0xc7229cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7229cf4 --- trap 0, eip = 0, esp = 0xc7229d40, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc140afe0 sched_switch(c140afe0,0,104,1b5,c0a8a53e,...) at sched_switch+0x4b4/frame 0xc1820c0c mi_switch(104,0,c109b989,1f5,101,...) at mi_switch+0x1c9/frame 0xc1820c40 sleepq_switch(c140afe0,0,c109b989,28e,c140afe0,...) at sleepq_switch+0x1b9/frame 0xc1820c74 sleepq_timedwait(c140ace4,54,9,0,0,...) at sleepq_timedwait+0x48/frame 0xc1820c98 _sleep(c140ace4,0,54,c10c82b5,fffff470,...) at _sleep+0x345/frame 0xc1820cf4 scheduler(0,0,c10faed4,181e000,1825000,...) at scheduler+0x2b3/frame 0xc1820d38 mi_startup() at mi_startup+0xf7/frame 0xc1820d58 begin() at begin+0x2c db:0:allt> call doadump Physical memory: 3435 MB Dumping 312 MB: 297 281 265 249 233 217 201 185 169 153 137 121 105 89 73 57 41 25 9 Dump complete = 0 db:0:doadump> reset (kgdb) bt #0 doadump (textdump=0xa) at pcpu.h:249 #1 0xc052709d in db_fncall (dummy1=0xfb831594, dummy2=0xfb831594, dummy3=0xfb831594, dummy4=0xfb831594 "\n") at ../../../ddb/db_command.c:578 #2 0xc0526d97 in db_command (cmd_table=) at ../../../ddb/db_command.c:449 #3 0xc052ac44 in db_script_exec (scriptname=0xc1407d0c "doadump", warnifnotfound=) at ../../../ddb/db_script.c:302 #4 0xc0526d97 in db_command (cmd_table=) at ../../../ddb/db_command.c:449 #5 0xc0526ab0 in db_command_loop () at ../../../ddb/db_command.c:502 #6 0xc05292f0 in db_trap (type=, code=0xfb831980) at ../../../ddb/db_main.c:231 #7 0xc0ad5466 in kdb_trap (type=, code=, tf=) at ../../../kern/subr_kdb.c:654 #8 0xc0eb824e in trap (frame=) at ../../../i386/i386/trap.c:720 #9 0xc0ea154c in calltrap () at exception.s:169 #10 0xc0ad4d0d in kdb_enter (why=0xc1095cfb "panic", msg=) at cpufunc.h:71 #11 0xc0a9e992 in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:747 #12 0xc0a9e84a in kassert_panic (fmt=) at ../../../kern/kern_shutdown.c:642 #13 0xc0b412d2 in vputx (vp=0xc93ab708, func=0x2) at ../../../kern/vfs_subr.c:2258 #14 0xc0d2a2b8 in vm_mmap (map=, addr=0xc124fc1c, size=0x5000, maxprot=0x7, flags=0x1, handle_type=, handle=0xca7fa900, foff=0x0) at ../../../vm/vm_mmap.c:1348 #15 0xc0d29850 in sys_mmap (td=0xca7fa900, uap=0xfb831d08) at ../../../vm/vm_mmap.c:392 #16 0xc0eb8f1d in syscall (frame=) at subr_syscall.c:134 #17 0xc0ea15e1 in Xint0x80_syscall () at exception.s:267 #18 0x00000033 in ?? () Previous frame inner to this frame (corrupt stack?) Current language: auto; currently minimal (kgdb) f 13 #13 0xc0b412d2 in vputx (vp=0xc93ab708, func=0x2) at ../../../kern/vfs_subr.c:2258 2258 VNASSERT(vp->v_writecount < vp->v_usecount || vp->v_usecount < 1, vp, (kgdb) p *vp $1 = {v_tag = 0xc107ff76 "newnfs", v_op = 0xc11bb6b8, v_data = 0xc95a8000, v_mount = 0xc809c000, v_nmntvnodes = {tqe_next = 0xc9c3a5a0, tqe_prev = 0xc9ebe880}, v_un = {vu_mount = 0x0, vu_socket = 0x0, vu_cdev = 0x0, vu_fifoinfo = 0x0}, v_hashlist = {le_next = 0xca3939d8, le_prev = 0xc796dbc8}, v_cache_src = {lh_first = 0x0}, v_cache_dst = {tqh_first = 0xcbe028fc, tqh_last = 0xcbe0290c}, v_cache_dd = 0x0, v_lock = {lock_object = {lo_name = 0xc107ff76 "newnfs", lo_flags = 0x57b0000, lo_data = 0x0, lo_witness = 0x0}, lk_lock = 0xca7fa900, lk_exslpfail = 0x0, lk_timo = 0x33, lk_pri = 0x60, lk_stack = {depth = 0x9, pcs = {0xc0a80f25, 0xc09c358c, 0xc0edec72, 0xc0b52b1a, 0xc0b407e7, 0xc0d29e43, 0xc0d29850, 0xc0eb8f1d, 0xc0ea15e1, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}}}, v_interlock = {lock_object = { lo_name = 0xc109dedc "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0x0}, mtx_lock = 0xca7fa900}, v_vnlock = 0xc93ab73c, v_actfreelist = {tqe_next = 0xc9ebe870, tqe_prev = 0xcf01ad60}, v_bufobj = {bo_mtx = {lock_object = {lo_name = 0xc10a6619 "bufobj interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0x0}, mtx_lock = 0x4}, bo_ops = 0xc11bba6c, bo_object = 0xc91ea8ac, bo_synclist = { le_next = 0xcd8da930, le_prev = 0xcabc2d84}, bo_private = 0xc93ab708, __bo_vnode = 0xc93ab708, bo_clean = {bv_hd = {tqh_first = 0x0, tqh_last = 0xc93ab7f4}, bv_root = 0x0, bv_cnt = 0x0}, bo_dirty = {bv_hd = { tqh_first = 0xe38f6b98, tqh_last = 0xe38f6bd0}, bv_root = 0xe38f6b98, bv_cnt = 0x1}, bo_numoutput = 0x0, bo_flag = 0x1, bo_bsize = 0x10000}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0, v_rl = { rl_waiters = {tqh_first = 0x0, tqh_last = 0xc93ab82c}, rl_currdep = 0x0}, v_cstart = 0x0, v_lasta = 0x0, v_lastw = 0x0, v_clen = 0x0, v_holdcnt = 0x4, v_usecount = 0x2, v_iflag = 0x200, v_vflag = 0x0, v_writecount = 0x2, v_hash = 0xe27ee656, v_type = VREG} (kgdb) p *vp->v_mount $2 = {mnt_mtx = {lock_object = {lo_name = 0xc1081662 "struct mount mtx", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc757f5f0}, mtx_lock = 0x4}, mnt_gen = 0x19, mnt_list = {tqe_next = 0x0, tqe_prev = 0xc809c5f0}, mnt_op = 0xc11bbd34, mnt_vfc = 0xc11bbd04, mnt_vnodecovered = 0xc86065a0, mnt_syncer = 0xc80d19d8, mnt_ref = 0x4fb3, mnt_nvnodelist = {tqh_first = 0xc9ad62d0, tqh_last = 0xcf9eb178}, mnt_nvnodelistsize = 0x4faf, mnt_activevnodelist = {tqh_first = 0xcf9eb168, tqh_last = 0xc9ad6388}, mnt_activevnodelistsize = 0x25a, mnt_writeopcount = 0x3, mnt_kern_flag = 0x41000109, mnt_flag = 0x0, mnt_opt = 0xc7cae830, mnt_optnew = 0xc7bffb50, mnt_maxsymlinklen = 0x0, mnt_stat = {f_version = 0x20030518, f_type = 0x3a, f_flags = 0x0, f_bsize = 0x200, f_iosize = 0x10000, f_blocks = 0x1c354ff4, f_bfree = 0xd59199c, f_bavail = 0xb176524, f_files = 0x1d2d3fe, f_ffree = 0x1d2a6b9, f_syncwrites = 0x0, f_asyncwrites = 0x0, f_syncreads = 0x0, f_asyncreads = 0x0, f_spare = {0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}, f_namemax = 0xff, f_owner = 0x0, f_fsid = {val = {0x3a05ffe6, 0x3a}}, f_charspare = '\0' , f_fstypename = "nfs", '\0' , f_mntfromname = "127.0.0.1:/tmp\000ÁÞÀ­ÞÞÀ­ÞÞÀ­ÞÜF\035Ásys\000ÞÀ­ÞÞÀ­ÞÜF\035ÁÞÀ­ÞÞÀ­ÞÞÀ­ÞÜF\035Á/home\000­ÞÞÀ­ÞÜF\035ÁÞÀ­ÞÞÀ­", f_mntonname = "/mnt", '\0' }, mnt_cred = 0xcbc00d00, mnt_data = 0xcd05a000, mnt_time = 0x0, mnt_iosize_max = 0x10000, mnt_export = 0x0, mnt_label = 0x0, mnt_hashseed = 0x53b3a89c, mnt_lockref = 0x0, mnt_secondary_writes = 0x0, mnt_secondary_accwrites = 0x0, mnt_susp_owner = 0x0, mnt_gjprovider = 0x0, mnt_explock = {lock_object = {lo_name = 0xc1081673 "explock", lo_flags = 0x5730000, lo_data = 0x0, lo_witness = 0xc7584d48}, lk_lock = 0x1, lk_exslpfail = 0x0, lk_timo = 0x0, lk_pri = 0x60, lk_stack = {depth = 0x0, pcs = {0x0 }}}, mnt_upper_link = {tqe_next = 0x0, tqe_prev = 0x0}, mnt_uppers = {tqh_first = 0x0, tqh_last = 0xc809c2e4}} (kgdb) l 2253 KASSERT(func == VPUTX_VRELE, ("vputx: wrong func")); 2254 CTR2(KTR_VFS, "%s: vp %p", __func__, vp); 2255 VI_LOCK(vp); 2256 2257 /* Skip this v_writecount check if we're going to panic below. */ 2258 VNASSERT(vp->v_writecount < vp->v_usecount || vp->v_usecount < 1, vp, 2259 ("vputx: missed vn_close")); 2260 error = 0; 2261 2262 if (vp->v_usecount > 1 || ((vp->v_iflag & VI_DOINGINACT) && (kgdb) $ svn diff -x -p /usr/src/sys -- Test scenario: nfs4.sh (umount -f of an active nfs mount)