GENERIC HEAD from 2013-04-27 12:46:04 UTC, r249985M, vmcore.610 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb 4718592K of memory above 4GB ignored Copyright (c) 1992-2013 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #0 r249985M: Sat Apr 27 16:57:29 CEST 2013 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 FreeBSD clang version 3.3 (trunk 178860) 20130405 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 0x10 Model = 0x2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 8589934592 (8192 MB) avail memory = 3498315776 (3336 MB) : Trying to mount root from ufs:/dev/ad4s1a [rw]... Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/ad4s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1a: clean, 595273 free (1185 frags, 74261 blocks, 0.1% fragmentation) /dev/ad4s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1f: clean, 184968 free (4352 frags, 22577 blocks, 0.4% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 50828761 free (2313 frags, 6353306 blocks, 0.0% fragmentation) /dev/ad4s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1d: clean, 3651349 free (255325 frags, 424503 blocks, 2.5% fragmentation) /dev/ad4s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1e: clean, 9367864 free (160464 frags, 1150925 blocks, 0.6% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN re0: link state changed to UP Starting Network: lo0 re0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 scopeid 0x1 nd6 options=29 media: Ethernet autoselect (100baseTX ) status: active Starting devd. add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/kde4/lib /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/gcc46 /usr/local/lib/mysql /usr/local/lib/nss /usr/local/lib/pth /usr/local/lib/qt4 /usr/local/lib/virtualbox a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. savecore: couldn't find media and/or sector size of /var/crash: Inappropriate ioctl for device Apr 27 20:04:46 x4 savecore: couldn't find media and/or sector size of /var/crash: Inappropriate ioctl for device No core dumps found. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered lock order reversal: 1st 0xe3820288 bufwait (bufwait) @ kern/vfs_bio.c:3070 2nd 0xc7d5d400 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper(c108b1f0,c109491c,c1c,c0b0ee90,c7e093a0,...) at db_trace_self_wrapper+0x2d/frame 0xf5cca798 kdb_backtrace(c108e41f,c7d5d400,c10c04dd,c7582268,c10c0122,...) at kdb_backtrace+0x30/frame 0xf5cca800 witness_checkorder(c7d5d400,9,c10c0119,11c,0,...) at witness_checkorder+0xbaa/frame 0xf5cca850 _sx_xlock(c7d5d400,0,c10c0119,11c,c7d50000,...) at _sx_xlock+0x77/frame 0xf5cca880 ufsdirhash_add(c7d56828,f5cca978,3e54,f5cca900,f5cca904,...) at ufsdirhash_add+0x4a/frame 0xf5cca8b0 ufs_direnter(c7e092d0,c8313168,f5cca978,f5ccab64,e3823edc,...) at ufs_direnter+0x63b/frame 0xf5cca930 ufs_mkdir(f5ccac00,c10e5a63,c10b9de6,c7e092d0,f5ccabfc,...) at ufs_mkdir+0x884/frame 0xf5ccaad0 VOP_MKDIR_APV(c11e446c,f5ccac00,f5ccab64,f5ccab90,28803020,...) at VOP_MKDIR_APV+0x124/frame 0xf5ccab00 kern_mkdirat(c7dc1300,ffffff9c,28803020,0,1c0) at kern_mkdirat+0x1fc/frame 0xf5ccac24 sys_mkdir(c7dc1300,f5ccacc8,14,c10893dd,7b3,...) at sys_mkdir+0x31/frame 0xf5ccac40 syscall(f5ccad08) at syscall+0x2ed/frame 0xf5ccacfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5ccacfc --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x28174ea7, esp = 0xbfbfd92c, ebp = 0xbfbfddd0 --- Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Recovering vi editor sessions:. Updating motd:. Starting ntpd. Removing stale Samba tdb files: ....... done Starting nmbd. Starting smbd. Starting winbindd. Starting default moused. Expensive timeout(9) function: 0xc08cb5c0(0xc13c2568) 0.009829969 s Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Local package initialization: backuplock order reversal: 1st 0xc86d15d4 ufs (ufs) @ kern/vfs_lookup.c:517 lock order reversal: 2nd 0xe3838900 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:262 1st 0xc7dcd19c ufs (ufs) @ kern/vfs_mount.c:1236 3rd 0xc8540b74 ufs (ufs) @ kern/vfs_subr.c:2167 2nd 0xc8095a0c devfs (devfs) @ ufs/ffs/ffs_softdep.c:1866 KDB: stack backtrace: KDB: stack backtrace: db_tradcbe__tsrealcfe__wsrealpfp_ewrr(acp1p0e8rb(1cf100,80b,10f,00,,00,,3.3.,.c)1 0a7t6 516,67deb,_.t.r.a)c ea_ts elf_wdrba_ptprearc+e0_xs2edl/ff_rwarmaep p0exrf+50cx72ed2/bf0r ame 0xf5c76830 kdb_backtrace(c1k0d8be_4b3a8c,kct8r5a4c0eb(7c41,0c81e04716f5,1c68,0c9755a802c2,0c01,0c8120293758,1c87,5.8.2.0)6 0a,tc 10bc807,k.d.b._)b aactk trace+0xk3d0b/_fbraacmket r0axcfe5+c07xe3301/8f rame 0xf5c76898w itness_checkordewri(tcn8e5s4s0_bc7h4e,c9k,ocr1d0e9r7(8c08f0,9857a70,cc,895,4c01b0eb0c,7.f.e.,)7 4aat, c8095a78w,i.t.n.e)s sa_tc heckordewri+t0nxebsasa_/cfhreacmkeo r0dxefr5+c07xeb3a6a8/ frame 0xf5c768e_8_ lockmgr_args(c8_5_4l0obc7k4m,g8r0_1a0r0g,sc(8c584009b5ea00,c0,,800,4.0.0.,)c 8a0t9 5a78,0,0_,_0l,occ1k0mbgcr7_faer,g7s4+a0)x 8a1t6 /frame 0_x_fl5occ7kem4g4r8_ args+0x816/framef f0sx_fl5occ7k6(9fc58c 7e4d0,c757e370,cv7o5p7_bs1ted0l,occ7k5(8f057c9786,ac4705,76b312e,04,,.f.5.c)7 6aat3 c,c0a73dfaf7s,_.l.o.c)k +a0tx ad/framev o0px_fs5tcd7leo4c8k8+ 0x53/frame 0xf5cV7O6P9_fL8O CK1_APV(c11e446VcO,Pf_L5OcC7Ke14_dA0P,Vc(1c01914a991dc0,c1,8f05,cc7161af480c,b40,,f.5.c.7)6 aa6t8 ,c11f8cbV0O,P._.L.O)C Ka1t_ APV+0x11V2O/Pf_rLaOmCeK 10_xAfP5Vc+70ex41b182 /frame 0xf5c76a2_8v n_lock(c8540b40_,v8n0_1l0o0c,kc(1c0890798509fd,88,7870,4c0100,9c61a08b5c,7.f.e.,)7 4aat, f5c76aa8_,v.n._.l)o cakt+ 0xca/fra_mven _0lxofc5kc+07xec4af/8f rame 0xf5c76a68 vget(c8540b40,80s1o0f0t,dce7pd_6fbl6u0s0h,w5o7r,k0l,i.s.t.()c 7da3t9 5d8,f5c7v6gaeftc+,0cx77d7c/2fcr0a0m,e6 20dx,f05,c.7.e.5)3 0a t softdevpf_sf_lhuasshhw_ogrektl(ics8t0b+105xd68e,/1f5readmeec ,08x0f050c07,6ca7ad86 b600,f5c7e610,..f.f)s _asty nc(c7d39v5fds8_,h1a,sfh5_cg7e6tb+608x,f5f0/ff,rca1mbea e08x1f45,c.7.e.5)5 ca t ffs_synfcf+s0_xv2gee5t/ff(rca8m0eb 105xdf85,c1756ebd3e0c ,80000,f5c7e610,d1o,u.n.m.o)u natt( c7d395d8f,f8s0_8v0g0e0t0f,+c07xd4c72/cf0r0a,m4e9 30,xcf05acc7fec55b58, ...) at sdoofutndmeopu_nsty+n0cx_4b3ucf/(fcr8a6mde1 50ax0f,5ec37863b8980a 0,1,108,0,...) asty s_unmounsto(fct7ddecp2_cs0y0n,cf_5bcu7f6+c0c8x,9c7170/dferca7mfe, d06x,f05,c.7.e.6)2 0a t sys_unfmfosu_nsty+n0cxv3ncodd/ef(rca8m6ed 105xaf05,c17,60c,4c07 57e440,c137dfb4,s.y.s.c)a lalt( f5c76d08f)f sa_ts yncvnodes+y0sxc2aal3l/+f0rxa2meed /0fxrfa5mce7 e06x7f85 c76cfc ffs_trunXciantte0(xc8806_ds1y5sac0a,l2l0(0), 0a,t8 80,c76aaX3i0n0t,0.x.8.0)_ sayts call+0x2f1f/sf_rtarmuen c0axtfe5+c07x66ccfec/ f-r-a-m es ys0cxafl5lc 7(e28230 , FreeBSD ELF32,u fssy_sd_iurnemnotuenrt()c,8 6edi1p5 a=0 ,0cx8258400cb14905,bf,5 ce7sep8 f=0 ,0fx5bcf7befbcdc6,a04,,. .e.b)p a=t 0xbfbfd7u7f0s _-d-i-r enter+0x7ed/frame 0xf5c7e8b0 ufs_makeinode(f5c7ebb8,f5c7ebcc) at ufs_makeinode+0x538/frame 0xf5c7ea24 ufs_create(f5c7eb10,c10e5451,c10b9de6,c80b15e8,2,...) at ufs_create+0x2f/frame 0xf5c7ea38 VOP_CREATE_APV(c11e446c,f5c7eb10,f5c7ebcc,f5c7eaa0,f5c7ead0,...) at VOP_CREATE_APV+0x124/frame 0xf5c7ea68 vn_open_cred(f5c7eb80,f5c7ebfc,180,0,c76aa300,c7dff3b8) at vn_open_cred+0x2cf/frame 0xf5c7eb38 vn_open(f5c7eb80,f5c7ebfc,180,c7dff3b8,c7d6b600,...) at vn_open+0x3b/frame 0xf5c7eb58 kern_openat(c7d6b600,ffffff9c,28c80360,0,a02,180) at kern_openat+0x1ec/frame 0xf5c7ec20 sys_open(c7d6b600,f5c7ecc8,c0eb32b0,c1825c90,0,...) at sys_open+0x38/frame 0xf5c7ec40 syscall(f5c7ed08) at syscall+0x2ed/frame 0xf5c7ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c7ecfc --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x28414137, esp = 0xbfbfa0ac, ebp = 0xbfbfa138 --- ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 113565 files, 67485220 used, 50828761 free (2313 frags, 6353306 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes Apr 27 20:07:22 x4 su: pho to root on /dev/pts/0 ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 113565 files, 67485220 used, 50828761 free (2313 frags, 6353306 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmp watchdogd. Starting inetd. Sat Apr 27 20:08:55 CEST 2013 FreeBSD/i386 (x4.osted.lan) (console) login: 20130427 20:09:19 all (1/25): nfs13.sh 20130427 20:09:19 all (2/25): nullfs9.sh 20130427 20:09:20 all (3/25): pread.sh 20130427 20:10:01 all (4/25): sendfile5.sh 20130427 20:11:13 all (5/25): tmpfs.sh lock order reversal: 1st 0xc80ade44 syncer (syncer) @ kern/vfs_subr.c:1786 2nd 0xc8531b74 ufs (ufs) @ kern/vfs_subr.c:2167 KDB: stack backtrace: db_trace_self_wrapper(c108b1f0,c7776900,c1240c1c,f0796968,c0aadfa8,...) at db_trace_self_wrapper+0x2d/frame 0xf0796930 kdb_backtrace(c108e41f,c8531b74,c1076516,c7582200,c1097818,...) at kdb_backtrace+0x30/frame 0xf0796998 witness_checkorder(c8531b74,9,c109780f,877,c8531be0,...) at witness_checkorder+0xbaa/frame 0xf07969e8 __lockmgr_args(c8531b74,80500,c8531be0,0,0,...) at __lockmgr_args+0x816/frame 0xf0796ac8 ffs_lock(f0796b50,fffffffe,c75805f8,246,c75805f8,...) at ffs_lock+0xad/frame 0xf0796b08 VOP_LOCK1_APV(c11e446c,f0796b50,246,c13aa3dc,c11f8cb0,...) at VOP_LOCK1_APV+0x112/frame 0xf0796b38 _vn_lock(c8531b40,80500,c109780f,877,c13aa3ec,...) at _vn_lock+0xca/frame 0xf0796b78 vget(c8531b40,80500,c794c300,12b2,c80b15e8,...) at vget+0x77/frame 0xf0796bb0 vfs_msync(c80b15d8,2,2,e71,c80b15d8,...) at vfs_msync+0xa0/frame 0xf0796bf8 sync_fsync(f0796ca8,c10e593e,80400,c109780f,6fa,...) at sync_fsync+0x12e/frame 0xf0796c20 VOP_FSYNC_APV(c11c478c,f0796ca8,c109780f,6fa,0,...) at VOP_FSYNC_APV+0x124/frame 0xf0796c50 sched_sync(0,f0796d08,c1080960,3d7,0,...) at sched_sync+0x38f/frame 0xf0796ccc fork_exit(c0b32990,0,f0796d08) at fork_exit+0x7f/frame 0xf0796cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf0796cf4 --- trap 0, eip = 0, esp = 0xf0796d40, ebp = 0 --- 20130427 20:22:11 all (6/25): tmpfs2.sh Apr 27 20:22:13 x4 mountd[578]: can't delete exports for /mnt14: Invalid argument Apr 27 20:22:13 x4 mountd[578]: can't delete exports for /mnt14: Invalid argument Apr 27 20:22:14 x4 mountd[578]: can't delete exports for /mnt9: Invalid argument : : Apr 27 20:25:33 x4 mountd[578]: can't delete exports for /mnt7: Invalid argument Apr 27 20:25:33 x4 mountd[578]: can't delete exports for /mnt2: Invalid argument Apr 27 20:25:33 x4 mountd[578]: can't delete exports for /mnt14: Invalid argument Apr 27 20:25:33 x4 mountd[578]: can't delete exports for /mnt11: Device busy Apr 27 20:25:33 x4 mountd[578]: can't delete exports for /mnt0: Invalid argument Apr 27 20:25:33 x4 mountd[578]: can't delete exports for /mnt14: Invalid argument 20130427 20:25:34 all (7/25): tmpfs3.sh Apr 27 20:25:34 x4 last message repeated 3 times 20130427 20:36:36 all (8/25): tmpfs4.sh 20130427 20:36:37 all (9/25): tmpfs5.sh 20130427 20:36:56 all (10/25): tmpfs7.sh 20130427 20:36:58 all (11/25): tmpfs8.sh 20130427 20:37:41 all (12/25): tmpfs9.sh 20130427 20:40:38 all (13/25): nfs.sh lock order reversal: 1st 0xc846fcdc ufs (ufs) @ kern/vfs_mount.c:851 2nd 0xcab64b74 newnfs (newnfs) @ kern/vfs_subr.c:2167 KDB: stack backtrace: db_trace_self_wrapper(c108b1f0,246,246,ffffffff,0,...) at db_trace_self_wrapper+0x2d/frame 0xf5fb0728 kdb_backtrace(c108e41f,cab64b74,c1070ec2,c7582c90,c1097818,...) at kdb_backtrace+0x30/frame 0xf5fb0790 witness_checkorder(cab64b74,9,c109780f,877,cab64be0,...) at witness_checkorder+0xbaa/frame 0xf5fb07e0 __lockmgr_args(cab64b74,80100,cab64be0,0,0,0,c109780f,877) at __lockmgr_args+0x816/frame 0xf5fb08c0 nfs_lock1(f5fb0938,c757b1e0,c7580798,c757b1e0,c7580798,...) at nfs_lock1+0x9c/frame 0xf5fb08f0 VOP_LOCK1_APV(c11ab130,f5fb0938,20,0,c11f8cb0,...) at VOP_LOCK1_APV+0x112/frame 0xf5fb0920 _vn_lock(cab64b40,80100,c109780f,877,57,...) at _vn_lock+0xca/frame 0xf5fb0960 vget(cab64b40,80100,cb2e8600,57,0,...) at vget+0x77/frame 0xf5fb0994 vfs_hash_get(c8c40000,7cee4531,80000,cb2e8600,f5fb0a04,...) at vfs_hash_get+0xff/frame 0xf5fb09c0 ncl_nget(c8c40000,c792c48c,1c,f5fb0a30,80000,...) at ncl_nget+0xba/frame 0xf5fb0a14 nfs_root(c8c40000,80000,f5fb0bf8,35c,c846fca8,...) at nfs_root+0x3c/frame 0xf5fb0a40 vfs_donmount(cb2e8600,0,0,c7b83500,c7b83500,...) at vfs_donmount+0x13a7/frame 0xf5fb0c18 sys_nmount(cb2e8600,f5fb0cc8,c0eb32b0,c71fdc90,0,...) at sys_nmount+0x78/frame 0xf5fb0c40 syscall(f5fb0d08) at syscall+0x2ed/frame 0xf5fb0cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5fb0cfc --- syscall (378, FreeBSD ELF32, sys_nmount), eip = 0x280c3f5b, esp = 0xbfbfcf8c, ebp = 0xbfbfd864 --- lock order reversal: 1st 0xe3a2991c bufwait (bufwait) @ kern/vfs_bio.c:2294 2nd 0xc8486600 so_snd_sx (so_snd_sx) @ kern/uipc_sockbuf.c:148 KDB: stack backtrace: db_trace_self_wrapper(c108b1f0,c137be38,c137be4c,c137be38,c757c018,...) at db_trace_self_wrapper+0x2d/frame 0xf6038290 kdb_backtrace(c108e41f,c8486600,c107e5ba,c75823a0,c10935d5,...) at kdb_backtrace+0x30/frame 0xf60382f4 witness_checkorder(c8486600,9,c10935cc,94,0,...) at witness_checkorder+0xbaa/frame 0xf6038344 _sx_xlock(c8486600,40,c10935cc,94,0,...) at _sx_xlock+0x77/frame 0xf6038374 sblock(c84865c8,1,34,c137be4c,c137be38,...) at sblock+0xa3/frame 0xf6038390 sosend_generic(c84864e0,0,0,c8248c00,0,...) at sosend_generic+0xb6/frame 0xf6038400 clnt_vc_call(c789ac40,f60385b0,10,c8248d00,f6038708,...) at clnt_vc_call+0x458/frame 0xf60384d8 clnt_reconnect_call(c789ac60,f60385b0,10,c8248d00,f6038708,...) at clnt_reconnect_call+0x506/frame 0xf6038540 newnfs_request(f6038708,c792c400,0,c792c510,caaa0e10,ca305900,c96a2900,186a3,3,0,1,0,0) at newnfs_request+0x71b/frame 0xf6038600 nfscl_request(f6038708,caaa0e10,ca305900,c96a2900,0,...) at nfscl_request+0x8c/frame 0xf6038648 nfsrpc_readdir(caaa0e10,f6038958,f6038878,c96a2900,ca305900,...) at nfsrpc_readdir+0x362/frame 0xf6038840 ncl_readdirrpc(caaa0e10,f6038958,c96a2900,ca305900,8,...) at ncl_readdirrpc+0x10f/frame 0xf6038920 ncl_doio(caaa0e10,e3a298bc,c96a2900,ca305900,0,...) at ncl_doio+0x144/frame 0xf6038998 ncl_bioread(caaa0e10,f6038bb8,0,c96a2900,0,...) at ncl_bioread+0x681/frame 0xf6038a98 nfs_readdir(f6038be0,c10e5b52,c10b9f50,c1098f28,fde,...) at nfs_readdir+0x19a/frame 0xf6038b48 VOP_READDIR_APV(c11ab130,f6038be0,c1098f28,fde,f6038bdc,...) at VOP_READDIR_APV+0x124/frame 0xf6038b78 kern_getdirentries(ca305900,5,2888c000,1000,f6038c34,...) at kern_getdirentries+0x1a2/frame 0xf6038c10 sys_getdirentries(ca305900,f6038cc8,c0eb32b0,c71fac90,0,...) at sys_getdirentries+0x41/frame 0xf6038c40 syscall(f6038d08) at syscall+0x2ed/frame 0xf6038cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6038cfc --- syscall (196, FreeBSD ELF32, sys_getdirentries), eip = 0x280e0d1b, esp = 0xbfbfd7b4, ebp = 0xbfbfd7e4 --- Expensive timeout(9) function: 0xc082aca0(0xc78b8000) 0.045525245 s 20130427 20:52:10 all (14/25): nfs11.sh lock order reversal: 1st 0xc7921c28 filedesc structure (filedesc structure) @ kern/kern_descrip.c:796 2nd 0xc83035d4 ufs (ufs) @ kern/vfs_subr.c:4392 KDB: stack backtrace: db_trace_self_wrapper(c108b1f0,63736564,2e706972,39373a63,f5000a36,...) at db_trace_self_wrapper+0x2d/frame 0xf5e028d0 kdb_backtrace(c108e41f,c83035d4,c1076516,c7582200,c1097818,...) at kdb_backtrace+0x30/frame 0xf5e02938 witness_checkorder(c83035d4,9,c109780f,1128,c8303640,...) at witness_checkorder+0xbaa/frame 0xf5e02988 __lockmgr_args(c83035d4,80400,c8303640,0,0,...) at __lockmgr_args+0x816/frame 0xf5e02a68 ffs_lock(f5e02af0,f5e02ac0,c0b1b138,c83035d4,f5e02af0,...) at ffs_lock+0xad/frame 0xf5e02aa8 VOP_LOCK1_APV(c11e446c,f5e02af0,c926601c,0,c11f8cb0,...) at VOP_LOCK1_APV+0x112/frame 0xf5e02ad8 _vn_lock(c83035a0,80400,c109780f,1128) at _vn_lock+0xca/frame 0xf5e02b14 vfs_knllock(c83035a0,0,c108026e,71d,c841cca8,...) at vfs_knllock+0x29/frame 0xf5e02b2c knlist_remove_kq(0,0) at knlist_remove_kq+0x87/frame 0xf5e02b50 knlist_remove(c926601c,c841cca8,0) at knlist_remove+0x1f/frame 0xf5e02b60 filt_vfsdetach(c841cca8,0,c108026e,827,c757e780,...) at filt_vfsdetach+0x2f/frame 0xf5e02b7c knote_fdclose(c7e03600,3,c107f9d1,454,0,...) at knote_fdclose+0xde/frame 0xf5e02bb8 closefp(c7dd42a0,c7e03600,1,b4,c83095e8,...) at closefp+0x6b/frame 0xf5e02be4 do_dup(c7e03600,1,5,3,c7e03858) at do_dup+0x34e/frame 0xf5e02c20 sys_dup2(c7e03600,f5e02cc8,14,c10893dd,7b3,...) at sys_dup2+0x34/frame 0xf5e02c40 syscall(f5e02d08) at syscall+0x2ed/frame 0xf5e02cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5e02cfc --- syscall (90, FreeBSD ELF32, sys_dup2), eip = 0x2810c0d3, esp = 0xbfbfdb60, ebp = 0xbfbfdb98 --- lock order reversal: 1st 0xc94335d4 ufs (ufs) @ kern/vfs_mount.c:1236 2nd 0xc882dae0 so_snd_sx (so_snd_sx) @ kern/uipc_sockbuf.c:148 KDB: stack backtrace: db_trace_self_wrapper(c108b1f0,c108ec9e,c137c73c,c137c728,c757c018,...) at db_trace_self_wrapper+0x2d/frame 0xf60445d0 kdb_backtrace(c108e41f,c882dae0,c107e5ba,c75823a0,c10935d5,...) at kdb_backtrace+0x30/frame 0xf6044634 witness_checkorder(c882dae0,9,c10935cc,94,0,...) at witness_checkorder+0xbaa/frame 0xf6044684 _sx_xlock(c882dae0,40,c10935cc,94,0,...) at _sx_xlock+0x77/frame 0xf60446b4 sblock(c882daa8,1,34,c137c73c,c137c728,...) at sblock+0xa3/frame 0xf60446d0 sosend_generic(c882d9c0,0,0,c8244400,0,...) at sosend_generic+0xb6/frame 0xf6044740 clnt_vc_call(c80fcb00,f60448f0,1,c8d7d600,f60449b0,...) at clnt_vc_call+0x458/frame 0xf6044818 clnt_reconnect_call(c789aa20,f60448f0,1,c8d7d600,f60449b0,...) at clnt_reconnect_call+0x506/frame 0xf6044880 newnfs_request(f60449b0,c8ea3200,0,c8ea3310,0,...) at newnfs_request+0x71b/frame 0xf6044940 nfsrpc_setclient(c8ea3200,c993d000,0,c9136100,ca304c00,...) at nfsrpc_setclient+0x583/frame 0xf6044ab8 nfscl_umount(c8ea3200,ca304c00,0,ca304c00,c8ea3200,...) at nfscl_umount+0x2b5/frame 0xf6044afc nfs_unmount(c8cdf000,8000000,c1096e1f,50f,c1bae814,...) at nfs_unmount+0xf3/frame 0xf6044b30 dounmount(c8cdf000,8000000,ca304c00,493,c0acfc55,...) at dounmount+0x47c/frame 0xf6044b90 sys_unmount(ca304c00,f6044cc8,14,c10893dd,7b3,...) at sys_unmount+0x3cd/frame 0xf6044c40 syscall(f6044d08) at syscall+0x2ed/frame 0xf6044cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6044cfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c195b, esp = 0xbfbfd124, ebp = 0xbfbfd1f0 --- 20130427 21:02:19 all (15/25): nfs12.sh lock order reversal: 1st 0xca385a0c syncer (syncer) @ kern/vfs_subr.c:1786 2nd 0xca50f73c newnfs (newnfs) @ kern/vfs_subr.c:2167 KDB: stack backtrace: db_trace_self_wrapper(c108b1f0,c1240b80,c7776900,f0796988,c0aae82e,...) at db_trace_self_wrapper+0x2d/frame 0xf0796940 kdb_backtrace(c108e41f,ca50f73c,c1070ec2,c7582c90,c1097818,...) at kdb_backtrace+0x30/frame 0xf07969a8 witness_checkorder(ca50f73c,9,c109780f,877,ca50f7a8,...) at witness_checkorder+0xbaa/frame 0xf07969f8 __lockmgr_args(ca50f73c,80500,ca50f7a8,0,0,0,c109780f,877) at __lockmgr_args+0x816/frame 0xf0796ad8 nfs_lock1(f0796b50,0,c75805f8,246,c75805f8,...) at nfs_lock1+0x9c/frame 0xf0796b08 VOP_LOCK1_APV(c11ab130,f0796b50,246,c13aa3dc,c11f8cb0,...) at VOP_LOCK1_APV+0x112/frame 0xf0796b38 _vn_lock(ca50f708,80500,c109780f,877,c13aa3ec,...) at _vn_lock+0xca/frame 0xf0796b78 vget(ca50f708,80500,c794c300,12b2,c8ee88d4,...) at vget+0x77/frame 0xf0796bb0 vfs_msync(c8ee88c4,2,2,e71,c8ee88c4,...) at vfs_msync+0xa0/frame 0xf0796bf8 sync_fsync(f0796ca8,c10e593e,80400,c109780f,6fa,...) at sync_fsync+0x12e/frame 0xf0796c20 VOP_FSYNC_APV(c11c478c,f0796ca8,c109780f,6fa,0,...) at VOP_FSYNC_APV+0x124/frame 0xf0796c50 sched_sync(0,f0796d08,c1080960,3d7,0,...) at sched_sync+0x38f/frame 0xf0796ccc fork_exit(c0b32990,0,f0796d08) at fork_exit+0x7f/frame 0xf0796cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf0796cf4 --- trap 0, eip = 0, esp = 0xf0796d40, ebp = 0 --- 20130427 21:03:03 all (16/25): nfs13.sh 20130427 21:03:04 all (17/25): nfs2.sh 20130427 21:13:08 all (18/25): nfs3.sh 20130427 21:16:41 all (19/25): nfs4.sh 20130427 21:17:46 all (20/25): nfs5.sh 20130427 21:18:53 all (21/25): nfs6.sh 20130427 21:20:24 all (22/25): nfs7.sh Apr 27 21:31:34 x4 kernel: pid 37152 (lockf), uid 1004, was killed: exceeded maximum CPU limit Apr 27 21:31:34 x4 kernel: pid 37153 (lockf), uid 1004, was killed: exceeded maximum CPU limit Apr 27 21:31:34 x4 kernel: pid 37155 (lockf), uid 1004, was killed: exceeded maximum CPU limit Apr 27 21:32:16 x4 kernel: pid 37143 (lockf), uid 1004, was killed: exceeded maximum CPU limit Apr 27 21:32:16 x4 kernel: pid 37151 (lockf), uid 1004, was killed: exceeded maximum CPU limit Apr 27 21:33:17 x4 kernel: pid 37142 (lockf), uid 1004, was killed: exceeded maximum CPU limit Apr 27 21:36:11 x4 kernel: pid 37915 (lockf), uid 1004, was killed: exceeded maximum CPU limit Apr 27 21:36:12 x4 kernel: pid 37916 (lockf), uid 1004, was killed: exceeded maximum CPU limit Apr 27 21:36:22 x4 kernel: pid 37913 (lockf), uid 1004, was killed: exceeded maximum CPU limit Apr 27 21:37:52 x4 kernel: pid 37895 (lockf), uid 1004, was killed: exceeded maximum CPU limit Apr 27 21:37:52 x4 kernel: pid 37889 (lockf), uid 1004, was killed: exceeded maximum CPU limit Apr 27 21:37:54 x4 kernel: pid 37887 (lockf), uid 1004, was killed: exceeded maximum CPU limit Apr 27 21:37:54 x4 kernel: pid 37914 (lockf), uid 1004, was killed: exceeded maximum CPU limit Apr 27 21:37:56 x4 kernel: pid 37892 (lockf), uid 1004, was killed: exceeded maximum CPU limit 20130427 21:38:17 all (23/25): nfs8.sh 20130427 21:38:19 all (24/25): nfs9.sh lock order reversal: 1st 0xc852d65c vm object (vm object) @ vm/vm_pageout.c:967 2nd 0xc80b15d8 struct mount mtx (struct mount mtx) @ kern/vfs_mount.c:433 KDB: stack backtrace: db_trace_self_wrapper(c108b1f0,c10c1608,c949c000,c34b0040,0,...) at db_trace_self_wrapper+0x2d/frame 0xe3bf8a90 kdb_backtrace(c108e41f,c80b15d8,c107257e,c757b5f0,c1096e28,...) at kdb_backtrace+0x30/frame 0xe3bf8af4 witness_checkorder(c80b15d8,9,c1096e1f,1b1,0,...) at witness_checkorder+0xbaa/frame 0xe3bf8b44 __mtx_lock_flags(c80b15e8,0,c1096e1f,1b1,e3bf8bf8,...) at __mtx_lock_flags+0x98/frame 0xe3bf8b78 vfs_ref(c80b15d8,c11c3e8c,e3bf8bf8,e3bf8bfc,e3bf8be0,...) at vfs_ref+0x2e/frame 0xe3bf8b98 vop_stdgetwritemount(e3bf8bf8,c10e5ddb,8,c10dd752,12b6,...) at vop_stdgetwritemount+0x1e/frame 0xe3bf8bb0 VOP_GETWRITEMOUNT_APV(c11e446c,e3bf8bf8,c1402f00,8,c11f9270,...) at VOP_GETWRITEMOUNT_APV+0x118/frame 0xe3bf8be0 vn_start_write(c8417b40,e3bf8c6c,2,484,7fffff6c,...) at vn_start_write+0x3c/frame 0xe3bf8c18 vm_pageout(0,e3bf8d08,c1080960,3d7,0,...) at vm_pageout+0xba0/frame 0xe3bf8ccc fork_exit(c0d27f70,0,e3bf8d08) at fork_exit+0x7f/frame 0xe3bf8cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3bf8cf4 --- trap 0, eip = 0, esp = 0xe3bf8d40, ebp = 0 --- 20130427 22:03:28 all (25/25): nfsrename.sh 20130427 22:06:45 all (1/25): nfs13.sh 20130427 22:06:45 all (2/25): nullfs9.sh 20130427 22:06:46 all (3/25): pread.sh 20130428 07:31:09 all (4/25): sendfile5.sh 20130428 07:32:24 all (5/25): tmpfs.sh 20130428 07:43:05 all (6/25): tmpfs2.sh Apr 28 07:43:06 x4 mountd[578]: can't delete exports for /mnt0: Invalid argument Apr 28 07:43:07 x4 mountd[578]: can't delete exports for /mnt6: Invalid argument Apr 28 07:43:07 x4 mountd[578]: can't delete exports for /mnt10: Invalid argument Apr 28 07:43:08 x4 mountd[578]: can't delete exports for /mnt2: Invalid argument : : Apr 28 07:46:37 x4 mountd[578]: can't delete exports for /mnt8: Invalid argument Apr 28 07:46:37 x4 mountd[578]: can't delete exports for /mnt5: Invalid argument Apr 28 07:46:37 x4 mountd[578]: can't delete exports for /mnt4: Invalid argument Apr 28 07:46:38 x4 mountd[578]: can't delete exports for /mnt10: Invalid argument Apr 28 07:46:38 x4 mountd[578]: can't delete exports for /mnt3: Invalid argument Apr 28 07:46:38 x4 mountd[578]: can't delete exports for /mnt0: Invalid argument Apr 28 07:46:38 x4 mountd[578]: can't delete exports for /mnt14: Invalid argument 20130428 07:46:38 all (7/25): tmpfs3.sh 20130428 07:57:34 all (8/25): tmpfs4.sh 20130428 07:57:35 all (9/25): tmpfs5.sh 20130428 07:57:54 all (10/25): tmpfs7.sh 20130428 07:57:55 all (11/25): tmpfs8.sh 20130428 07:58:39 all (12/25): tmpfs9.sh 20130428 08:01:31 all (13/25): nfs.sh 20130428 08:13:13 all (14/25): nfs11.sh Apr 28 08:44:43 x4 su: pho to root on /dev/pts/2 interrupt total irq1: atkbd0 2 irq4: uart0 25028 irq6: fdc0 1 irq9: acpi0 1 irq14: ata0 30654 irq16: hdac1 ohci0 232 irq17: ohci1 ohci3 3 irq18: ohci2 ohci4 3 irq22: ahci0 4502311 cpu0:timer 10319037 irq256: hdac0 5 irq257: re0 12279765 cpu2:timer 9661009 cpu3:timer 9729808 cpu1:timer 9875539 Total 56423398 KDB: stack backtrace: db_trace_self_wrapper(c108b1f0,0,0,0,0,...) at db_trace_self_wrapper+0x2d/frame 0xc720a9f8 kdb_backtrace(c107e3da,35cf3e6,0,0,35cf3e6,...) at kdb_backtrace+0x30/frame 0xc720aa60 watchdog_fire(21,0,c107e33d,222,407982,...) at watchdog_fire+0x9c/frame 0xc720aa88 hardclock_cnt(33,0,c10e0187,ef,c720ab9c,...) at hardclock_cnt+0x2c2/frame 0xc720aadc handleevents(0,c10893dd,887,c7715600,c123f680,...) at handleevents+0xec/frame 0xc720ab20 timercb(c13c4528,0,0,0,c789be1c,...) at timercb+0x267/frame 0xc720ab70 lapic_handle_timer(c720ab9c) at lapic_handle_timer+0x89/frame 0xc720ab90 Xtimerint() at Xtimerint+0x20/frame 0xc720ab90 --- interrupt, eip = 0xc0e90fb5, esp = 0xc720abdc, ebp = 0xc720abdc --- acpi_cpu_c1(c0eb436b,c1825c90,0,c10e0187,303,...) at acpi_cpu_c1+0x5/frame 0xc720abdc acpi_cpu_idle(d0be21b,0,d0be21b,c720ac50,c0e9b10a,...) at acpi_cpu_idle+0x146/frame 0xc720ac20 cpu_idle_acpi(d0be21b,0,2,c123f708,c123f716,...) at cpu_idle_acpi+0x3f/frame 0xc720ac34 cpu_idle(0,2,c10893dd,a46,c123f708,...) at cpu_idle+0x9a/frame 0xc720ac50 sched_idletd(0,c720ad08,c1080960,3d7,0,...) at sched_idletd+0x1d6/frame 0xc720accc fork_exit(c0aafee0,0,c720ad08) at fork_exit+0x7f/frame 0xc720acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc720acf4 --- trap 0, eip = 0, esp = 0xc720ad40, ebp = 0 --- KDB: enter: watchdog timeout [ thread pid 11 tid 100003 ] Stopped at kdb_enter+0x3d: movl $0,kdb_why db> run pho db:0:pho> bt Tracing pid 11 tid 100003 td 0xc76cd900 kdb_enter(c0f121ea,c100864c,0,0,35cf3e6) at kdb_enter+0x3d/frame 0xc720aa60 watchdog_fire(21,0,c107e33d,222,407982,...) at watchdog_fire+0xb0/frame 0xc720aa88 hardclock_cnt(33,0,c10e0187,ef,c720ab9c,...) at hardclock_cnt+0x2c2/frame 0xc720aadc handleevents(0,c10893dd,887,c7715600,c123f680,...) at handleevents+0xec/frame 0xc720ab20 timercb(c13c4528,0,0,0,c789be1c,...) at timercb+0x267/frame 0xc720ab70 lapic_handle_timer(c720ab9c) at lapic_handle_timer+0x89/frame 0xc720ab90 Xtimerint() at Xtimerint+0x20/frame 0xc720ab90 --- interrupt, eip = 0xc0e90fb5, esp = 0xc720abdc, ebp = 0xc720abdc --- acpi_cpu_c1(c0eb436b,c1825c90,0,c10e0187,303,...) at acpi_cpu_c1+0x5/frame 0xc720abdc acpi_cpu_idle(d0be21b,0,d0be21b,c720ac50,c0e9b10a,...) at acpi_cpu_idle+0x146/frame 0xc720ac20 cpu_idle_acpi(d0be21b,0,2,c123f708,c123f716,...) at cpu_idle_acpi+0x3f/frame 0xc720ac34 cpu_idle(0,2,c10893dd,a46,c123f708,...) at cpu_idle+0x9a/frame 0xc720ac50 sched_idletd(0,c720ad08,c1080960,3d7,0,...) at sched_idletd+0x1d6/frame 0xc720accc fork_exit(c0aafee0,0,c720ad08) at fork_exit+0x7f/frame 0xc720acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc720acf4 --- trap 0, eip = 0, esp = 0xc720ad40, ebp = 0 --- db:0:bt> show allpcpu Current CPU: 0 cpuid = 0 dynamic pcpu = 0x626d80 curthread = 0xc76cd900: pid 11 "idle: cpu0" curpcb = 0xc720ad60 fpcurthread = none idlethread = 0xc76cd900: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x5ffbd80 curthread = 0xc76cd600: pid 11 "idle: cpu1" curpcb = 0xc720dd60 fpcurthread = none idlethread = 0xc76cd600: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x5ffed80 curthread = 0xc76cd300: pid 11 "idle: cpu2" curpcb = 0xc7210d60 fpcurthread = none idlethread = 0xc76cd300: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x6001d80 curthread = 0xc76cd000: pid 11 "idle: cpu3" curpcb = 0xc7213d60 fpcurthread = none idlethread = 0xc76cd000: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks Process 44457 (umount) thread 0xc8bc8900 (101008) exclusive lockmgr ufs (ufs) r = 0 (0xcb97acdc) locked @ kern/vfs_mount.c:1236 Process 44371 (umount) thread 0xc8b21000 (101087) exclusive lockmgr ufs (ufs) r = 0 (0xc846fcdc) locked @ kern/vfs_mount.c:1236 Process 42169 (ls) thread 0xcc0fd600 (100492) shared lockmgr newnfs (newnfs) r = 0 (0xcbd3f73c) locked @ kern/vfs_subr.c:2167 Process 41946 (lockf) thread 0xc8f3d000 (100470) exclusive lockmgr newnfs (newnfs) r = 0 (0xca2c48a4) locked @ fs/nfsclient/nfs_clvnops.c:2997 Process 41942 (lockf) thread 0xc973b600 (100524) exclusive lockmgr newnfs (newnfs) r = 0 (0xc9b14304) locked @ fs/nfsclient/nfs_clvnops.c:2997 Process 41941 (lockf) thread 0xc8a0a900 (100130) exclusive lockmgr newnfs (newnfs) r = 0 (0xcbe2b304) locked @ fs/nfsclient/nfs_clvnops.c:3027 Process 41922 (rename) thread 0xc8981c00 (100513) exclusive lockmgr newnfs (newnfs) r = 0 (0xcb3188a4) locked @ fs/nfsclient/nfs_clport.c:254 Process 41920 (rename) thread 0xcc582000 (100386) exclusive lockmgr newnfs (newnfs) r = 0 (0xd158919c) locked @ fs/nfsclient/nfs_clport.c:254 Process 41918 (rename) thread 0xc8fad300 (100147) exclusive lockmgr newnfs (newnfs) r = 0 (0xc81eccdc) locked @ fs/nfsclient/nfs_clport.c:254 exclusive lockmgr newnfs (newnfs) r = 0 (0xcc372034) locked @ kern/vfs_lookup.c:517 Process 41916 (rename) thread 0xc8e53000 (102842) exclusive lockmgr newnfs (newnfs) r = 0 (0xca93acdc) locked @ kern/vfs_lookup.c:517 Process 41914 (rename) thread 0xc9660600 (100230) exclusive lockmgr newnfs (newnfs) r = 0 (0xcf92746c) locked @ fs/nfsclient/nfs_clport.c:254 Process 41913 (rw) thread 0xc871e600 (100438) exclusive lockmgr newnfs (newnfs) r = 0 (0xcfe00cdc) locked @ kern/vfs_subr.c:2167 exclusive lockmgr newnfs (newnfs) r = 0 (0xcef41a0c) locked @ kern/vfs_lookup.c:517 Process 41912 (rename) thread 0xca304300 (100314) exclusive lockmgr newnfs (newnfs) r = 0 (0xcfa6da0c) locked @ fs/nfsclient/nfs_clport.c:254 Process 41910 (rename) thread 0xc8faa000 (100184) exclusive lockmgr newnfs (newnfs) r = 0 (0xcac55e44) locked @ fs/nfsclient/nfs_clport.c:254 Process 41908 (rename) thread 0xcc0fe600 (100479) exclusive lockmgr newnfs (newnfs) r = 0 (0xc9c6e8a4) locked @ fs/nfsclient/nfs_clport.c:254 exclusive lockmgr newnfs (newnfs) r = 0 (0xcba89034) locked @ kern/vfs_lookup.c:517 Process 41906 (rename) thread 0xc8460600 (100367) exclusive lockmgr newnfs (newnfs) r = 0 (0xcb12c8a4) locked @ fs/nfsclient/nfs_clport.c:254 Process 41904 (rename) thread 0xc9094000 (100175) exclusive lockmgr newnfs (newnfs) r = 0 (0xc9be9304) locked @ kern/vfs_subr.c:897 exclusive lockmgr newnfs (newnfs) r = 0 (0xc8306034) locked @ kern/vfs_lookup.c:517 Process 41898 (rename) thread 0xca305600 (100308) exclusive lockmgr newnfs (newnfs) r = 0 (0xc995c73c) locked @ fs/nfsclient/nfs_clport.c:254 exclusive lockmgr newnfs (newnfs) r = 0 (0xc9fd3b74) locked @ kern/vfs_lookup.c:517 Process 41896 (rename) thread 0xca326c00 (100283) exclusive lockmgr newnfs (newnfs) r = 0 (0xc99c219c) locked @ kern/vfs_subr.c:897 exclusive lockmgr newnfs (newnfs) r = 0 (0xcd7db304) locked @ kern/vfs_lookup.c:517 Process 41895 (rename) thread 0xc9884000 (102551) exclusive lockmgr newnfs (newnfs) r = 0 (0xd14ccb74) locked @ kern/vfs_lookup.c:517 Process 41894 (rename) thread 0xc8c8c900 (100964) exclusive lockmgr newnfs (newnfs) r = 0 (0xc89cde44) locked @ fs/nfsclient/nfs_clport.c:254 exclusive lockmgr newnfs (newnfs) r = 0 (0xca3e4a0c) locked @ kern/vfs_lookup.c:517 Process 41893 (rename) thread 0xccfb6600 (100503) exclusive lockmgr newnfs (newnfs) r = 0 (0xd1057304) locked @ kern/vfs_lookup.c:517 Process 41892 (rename) thread 0xc9fcb300 (100222) exclusive lockmgr newnfs (newnfs) r = 0 (0xcc545e44) locked @ fs/nfsclient/nfs_clport.c:254 Process 41891 (rename) thread 0xc8c2a600 (101092) exclusive lockmgr newnfs (newnfs) r = 0 (0xcb3d7b74) locked @ fs/nfsclient/nfs_clport.c:254 exclusive lockmgr newnfs (newnfs) r = 0 (0xca9f973c) locked @ kern/vfs_lookup.c:517 Process 41889 (rename) thread 0xc871e900 (100437) exclusive lockmgr newnfs (newnfs) r = 0 (0xc92e4304) locked @ kern/vfs_vnops.c:365 Process 41887 (rename) thread 0xc9662300 (100226) exclusive lockmgr newnfs (newnfs) r = 0 (0xca9efa0c) locked @ fs/nfsclient/nfs_clport.c:254 Process 41886 (lockf) thread 0xc9094600 (100173) exclusive lockmgr newnfs (newnfs) r = 0 (0xcb1965d4) locked @ fs/nfsclient/nfs_clvnops.c:2997 Process 41885 (lockf) thread 0xca324c00 (100247) exclusive lockmgr newnfs (newnfs) r = 0 (0xc9c3473c) locked @ fs/nfsclient/nfs_clvnops.c:2997 Process 41884 (lockf) thread 0xc871e300 (100439) exclusive lockmgr newnfs (newnfs) r = 0 (0xcfae7304) locked @ fs/nfsclient/nfs_clvnops.c:2997 Process 41881 (lockf) thread 0xcb819c00 (100604) exclusive lockmgr newnfs (newnfs) r = 0 (0xcf170b74) locked @ fs/nfsclient/nfs_clvnops.c:2997 Process 41877 (lockf) thread 0xcd487600 (100351) exclusive lockmgr newnfs (newnfs) r = 0 (0xce84173c) locked @ fs/nfsclient/nfs_clvnops.c:3027 Process 41872 (lockf) thread 0xca34cc00 (100271) exclusive lockmgr newnfs (newnfs) r = 0 (0xcba3873c) locked @ fs/nfsclient/nfs_clvnops.c:2997 Process 589 (nfsd) thread 0xc847e900 (100114) exclusive lockmgr newnfs (newnfs) r = 0 (0xcb43319c) locked @ kern/vfs_subr.c:897 shared lockmgr ufs (ufs) r = 0 (0xcc57ea0c) locked @ kern/vfs_lookup.c:517 db:0:alllocks> show lockedvnods Locked vnodes 0xc846fca8: tag ufs, type VDIR usecount 1, writecount 0, refcount 1 mountedhere 0xc8ee8bb0 flags (VI_ACTIVE) v_object 0xc8eea6f0 ref 0 pages 0 lock type ufs: EXCL by thread 0xc8b21000 (pid 44371, umount, tid 101087) #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc0cef47d at ffs_lock+0xad #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b3df0a at _vn_lock+0xca #4 0xc0b24629 at dounmount+0x99 #5 0xc0b2454d at sys_unmount+0x3cd #6 0xc0eac9cd at syscall+0x2ed #7 0xc0e94f41 at Xint0x80_syscall+0x21 ino 235521, on dev ada0s1a 0xcb97aca8: tag ufs, type VDIR usecount 1, writecount 0, refcount 1 mountedhere 0xc8ca7bb0 flags (VI_ACTIVE) v_object 0xd0aaccb8 ref 0 pages 0 lock type ufs: EXCL by thread 0xc8bc8900 (pid 44457, umount, tid 101008) #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc0cef47d at ffs_lock+0xad #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b3df0a at _vn_lock+0xca #4 0xc0b24629 at dounmount+0x99 #5 0xc0b2454d at sys_unmount+0x3cd #6 0xc0eac9cd at syscall+0x2ed #7 0xc0e94f41 at Xint0x80_syscall+0x21 ino 164864, on dev ada0s1a 0xcc57e9d8: tag ufs, type VDIR usecount 3, writecount 0, refcount 6 mountedhere 0 flags (VI_ACTIVE) v_object 0xce2ab378 ref 0 pages 6 lock type ufs: SHARED (count 1) with exclusive waiters pending #0 0xc0a6b463 at __lockmgr_args+0xf63 #1 0xc0cef47d at ffs_lock+0xad #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b3df0a at _vn_lock+0xca #4 0xc0b206e9 at lookup+0xf9 #5 0xc09d0209 at nfsvno_namei+0x199 #6 0xc09c8ad9 at nfsrvd_lookup+0x159 #7 0xc09bb14e at nfsrvd_dorpc+0xe4e #8 0xc09c74ab at nfssvc_program+0x41b #9 0xc0c8e791 at svc_run_internal+0x201 #10 0xc0c8f74d at svc_thread_start+0xd #11 0xc0a5692f at fork_exit+0x7f #12 0xc0e94f54 at fork_trampoline+0x8 ino 131314, on dev md5a 0xcbd3f708: tag newnfs, type VDIR usecount 2, writecount 0, refcount 5 mountedhere 0 flags (VV_ROOT|VI_ACTIVE) v_object 0xd1441534 ref 0 pages 2 lock type newnfs: SHARED (count 1) with exclusive waiters pending #0 0xc0a6b463 at __lockmgr_args+0xf63 #1 0xc09ab6dc at nfs_lock1+0x9c #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b3df0a at _vn_lock+0xca #4 0xc0b2bad7 at vget+0x77 #5 0xc0b1f2af at vfs_hash_get+0xff #6 0xc09af19a at ncl_nget+0xba #7 0xc09b1e2c at nfs_root+0x3c #8 0xc0b20d5c at lookup+0x76c #9 0xc0b2020d at namei+0x47d #10 0xc0b38142 at kern_statat_vnhook+0xc2 #11 0xc0b38329 at sys_lstat+0x59 #12 0xc0eac9cd at syscall+0x2ed #13 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 2 fsid 0x3a78ff41 0xcef419d8: tag newnfs, type VDIR usecount 3, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xcf9f6cb8 ref 0 pages 0 lock type newnfs: EXCL by thread 0xc871e600 (pid 41913, rw, tid 100438) #0 0xc0a6b463 at __lockmgr_args+0xf63 #1 0xc09ab6dc at nfs_lock1+0x9c #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b3df0a at _vn_lock+0xca #4 0xc0b206e9 at lookup+0xf9 #5 0xc0b2020d at namei+0x47d #6 0xc0b374bc at kern_unlinkat+0xbc #7 0xc0b37122 at sys_unlink+0x32 #8 0xc0eac9cd at syscall+0x2ed #9 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 131098 fsid 0x3a78ff41 0xd14ccb40: tag newnfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type newnfs: EXCL by thread 0xc9884000 (pid 41895, rename, tid 102551) #0 0xc0a6b463 at __lockmgr_args+0xf63 #1 0xc09ab6dc at nfs_lock1+0x9c #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b3df0a at _vn_lock+0xca #4 0xc0b206e9 at lookup+0xf9 #5 0xc0b2020d at namei+0x47d #6 0xc0b3d481 at vn_open_cred+0x91 #7 0xc0b3d3eb at vn_open+0x3b #8 0xc0b35c6c at kern_openat+0x1ec #9 0xc0b359f8 at sys_open+0x38 #10 0xc0eac9cd at syscall+0x2ed #11 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 131187 fsid 0x3a78ff41 0xd10572d0: tag newnfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type newnfs: EXCL by thread 0xccfb6600 (pid 41893, rename, tid 100503) #0 0xc0a6b463 at __lockmgr_args+0xf63 #1 0xc09ab6dc at nfs_lock1+0x9c #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b3df0a at _vn_lock+0xca #4 0xc0b206e9 at lookup+0xf9 #5 0xc0b2020d at namei+0x47d #6 0xc0b3d481 at vn_open_cred+0x91 #7 0xc0b3d3eb at vn_open+0x3b #8 0xc0b35c6c at kern_openat+0x1ec #9 0xc0b359f8 at sys_open+0x38 #10 0xc0eac9cd at syscall+0x2ed #11 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 131204 fsid 0x3a78ff41 0xcd7db2d0: tag newnfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type newnfs: EXCL by thread 0xca326c00 (pid 41896, rename, tid 100283) #0 0xc0a6b463 at __lockmgr_args+0xf63 #1 0xc09ab6dc at nfs_lock1+0x9c #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b3df0a at _vn_lock+0xca #4 0xc0b206e9 at lookup+0xf9 #5 0xc0b2020d at namei+0x47d #6 0xc0b374bc at kern_unlinkat+0xbc #7 0xc0b37122 at sys_unlink+0x32 #8 0xc0eac9cd at syscall+0x2ed #9 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 131205 fsid 0x3a78ff41 0xca3e49d8: tag newnfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type newnfs: EXCL by thread 0xc8c8c900 (pid 41894, rename, tid 100964) #0 0xc0a6b463 at __lockmgr_args+0xf63 #1 0xc09ab6dc at nfs_lock1+0x9c #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b3df0a at _vn_lock+0xca #4 0xc0b206e9 at lookup+0xf9 #5 0xc0b2020d at namei+0x47d #6 0xc0b374bc at kern_unlinkat+0xbc #7 0xc0b37122 at sys_unlink+0x32 #8 0xc0eac9cd at syscall+0x2ed #9 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 131231 fsid 0x3a78ff41 0xc8306000: tag newnfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type newnfs: EXCL by thread 0xc9094000 (pid 41904, rename, tid 100175) #0 0xc0a6b463 at __lockmgr_args+0xf63 #1 0xc09ab6dc at nfs_lock1+0x9c #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b3df0a at _vn_lock+0xca #4 0xc0b206e9 at lookup+0xf9 #5 0xc0b2020d at namei+0x47d #6 0xc0b374bc at kern_unlinkat+0xbc #7 0xc0b37122 at sys_unlink+0x32 #8 0xc0eac9cd at syscall+0x2ed #9 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 131258 fsid 0x3a78ff41 0xcc372000: tag newnfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type newnfs: EXCL by thread 0xc8fad300 (pid 41918, rename, tid 100147) #0 0xc0a6b463 at __lockmgr_args+0xf63 #1 0xc09ab6dc at nfs_lock1+0x9c #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b3df0a at _vn_lock+0xca #4 0xc0b206e9 at lookup+0xf9 #5 0xc0b2020d at namei+0x47d #6 0xc0b374bc at kern_unlinkat+0xbc #7 0xc0b37122 at sys_unlink+0x32 #8 0xc0eac9cd at syscall+0x2ed #9 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 131281 fsid 0x3a78ff41 0xc9fd3b40: tag newnfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type newnfs: EXCL by thread 0xca305600 (pid 41898, rename, tid 100308) #0 0xc0a6b463 at __lockmgr_args+0xf63 #1 0xc09ab6dc at nfs_lock1+0x9c #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b3df0a at _vn_lock+0xca #4 0xc0b206e9 at lookup+0xf9 #5 0xc0b2020d at namei+0x47d #6 0xc0b374bc at kern_unlinkat+0xbc #7 0xc0b37122 at sys_unlink+0x32 #8 0xc0eac9cd at syscall+0x2ed #9 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 131278 fsid 0x3a78ff41 0xcba89000: tag newnfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type newnfs: EXCL by thread 0xcc0fe600 (pid 41908, rename, tid 100479) #0 0xc0a6b463 at __lockmgr_args+0xf63 #1 0xc09ab6dc at nfs_lock1+0x9c #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b3df0a at _vn_lock+0xca #4 0xc0b206e9 at lookup+0xf9 #5 0xc0b2020d at namei+0x47d #6 0xc0b374bc at kern_unlinkat+0xbc #7 0xc0b37122 at sys_unlink+0x32 #8 0xc0eac9cd at syscall+0x2ed #9 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 131285 fsid 0x3a78ff41 0xca9f9708: tag newnfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type newnfs: EXCL by thread 0xc8c2a600 (pid 41891, rename, tid 101092) #0 0xc0a6b463 at __lockmgr_args+0xf63 #1 0xc09ab6dc at nfs_lock1+0x9c #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b3df0a at _vn_lock+0xca #4 0xc0b206e9 at lookup+0xf9 #5 0xc0b2020d at namei+0x47d #6 0xc0b374bc at kern_unlinkat+0xbc #7 0xc0b37122 at sys_unlink+0x32 #8 0xc0eac9cd at syscall+0x2ed #9 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 131317 fsid 0x3a78ff41 0xca93aca8: tag newnfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type newnfs: EXCL by thread 0xc8e53000 (pid 41916, rename, tid 102842) #0 0xc0a6b463 at __lockmgr_args+0xf63 #1 0xc09ab6dc at nfs_lock1+0x9c #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b3df0a at _vn_lock+0xca #4 0xc0b206e9 at lookup+0xf9 #5 0xc0b2020d at namei+0x47d #6 0xc0b374bc at kern_unlinkat+0xbc #7 0xc0b37122 at sys_unlink+0x32 #8 0xc0eac9cd at syscall+0x2ed #9 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 131314 fsid 0x3a78ff41 0xc9c34708: tag newnfs, type VREG usecount 1, writecount 1, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xc8de4250 ref 0 pages 1 lock type newnfs: EXCL by thread 0xca324c00 (pid 41885, lockf, tid 100247) with exclusive waiters pending #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc09ab6dc at nfs_lock1+0x9c #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b3df0a at _vn_lock+0xca #4 0xc09abbd6 at nfs_advlock+0x146 #5 0xc0ed352a at VOP_ADVLOCK_APV+0x12a #6 0xc0a465f6 at closef+0xa6 #7 0xc0a443a5 at closefp+0xb5 #8 0xc0a44c8b at kern_close+0xfb #9 0xc0a44b8a at sys_close+0x1a #10 0xc0eac9cd at syscall+0x2ed #11 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 65549 fsid 0x3a78ff41 0xcfe00ca8: tag newnfs, type VREG usecount 1, writecount 0, refcount 4 mountedhere 0 flags (VI_ACTIVE) v_object 0xcf2c9250 ref 0 pages 416 lock type newnfs: EXCL by thread 0xc871e600 (pid 41913, rw, tid 100438) #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc09ab6dc at nfs_lock1+0x9c #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b3df0a at _vn_lock+0xca #4 0xc0b2bad7 at vget+0x77 #5 0xc0b1f2af at vfs_hash_get+0xff #6 0xc09b3822 at nfscl_nget+0x92 #7 0xc09a7e08 at nfs_lookup+0x988 #8 0xc0ecf364 at VOP_LOOKUP_APV+0x124 #9 0xc0b20b18 at lookup+0x528 #10 0xc0b2020d at namei+0x47d #11 0xc0b374bc at kern_unlinkat+0xbc #12 0xc0b37122 at sys_unlink+0x32 #13 0xc0eac9cd at syscall+0x2ed #14 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 134397 fsid 0x3a78ff41 0xcfae72d0: tag newnfs, type VREG usecount 1, writecount 1, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xce16f534 ref 0 pages 1 lock type newnfs: EXCL by thread 0xc871e300 (pid 41884, lockf, tid 100439) with exclusive waiters pending #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc09ab6dc at nfs_lock1+0x9c #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b3df0a at _vn_lock+0xca #4 0xc09abbd6 at nfs_advlock+0x146 #5 0xc0ed352a at VOP_ADVLOCK_APV+0x12a #6 0xc0a439e6 at kern_fcntl+0xbc6 #7 0xc0a42d6d at sys_fcntl+0xdd #8 0xc0eac9cd at syscall+0x2ed #9 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 65763 fsid 0x3a78ff41 0xcb1965a0: tag newnfs, type VREG usecount 1, writecount 1, refcount 1 mountedhere 0 flags (VI_ACTIVE) v_object 0xd0f2b094 ref 0 pages 0 lock type newnfs: EXCL by thread 0xc9094600 (pid 41886, lockf, tid 100173) with exclusive waiters pending #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc09ab6dc at nfs_lock1+0x9c #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b3df0a at _vn_lock+0xca #4 0xc09abbd6 at nfs_advlock+0x146 #5 0xc0ed352a at VOP_ADVLOCK_APV+0x12a #6 0xc0a439e6 at kern_fcntl+0xbc6 #7 0xc0a42d6d at sys_fcntl+0xdd #8 0xc0eac9cd at syscall+0x2ed #9 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 65766 fsid 0x3a78ff41 0xcbe2b2d0: tag newnfs, type VREG usecount 1, writecount 1, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xce6959d4 ref 0 pages 1 lock type newnfs: EXCL by thread 0xc8a0a900 (pid 41941, lockf, tid 100130) with shared waiters pending #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc09ab6dc at nfs_lock1+0x9c #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b3df0a at _vn_lock+0xca #4 0xc09abd55 at nfs_advlock+0x2c5 #5 0xc0ed352a at VOP_ADVLOCK_APV+0x12a #6 0xc0a439e6 at kern_fcntl+0xbc6 #7 0xc0a42d6d at sys_fcntl+0xdd #8 0xc0eac9cd at syscall+0x2ed #9 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 65769 fsid 0x3a78ff41 0xc9b142d0: tag newnfs, type VREG usecount 1, writecount 1, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xc8862128 ref 0 pages 1 lock type newnfs: EXCL by thread 0xc973b600 (pid 41942, lockf, tid 100524) with exclusive waiters pending #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc09ab6dc at nfs_lock1+0x9c #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b3df0a at _vn_lock+0xca #4 0xc09abbd6 at nfs_advlock+0x146 #5 0xc0ed352a at VOP_ADVLOCK_APV+0x12a #6 0xc0a439e6 at kern_fcntl+0xbc6 #7 0xc0a42d6d at sys_fcntl+0xdd #8 0xc0eac9cd at syscall+0x2ed #9 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 65761 fsid 0x3a78ff41 0xcf170b40: tag newnfs, type VREG usecount 1, writecount 1, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xc89b165c ref 0 pages 1 lock type newnfs: EXCL by thread 0xcb819c00 (pid 41881, lockf, tid 100604) with exclusive waiters pending #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc09ab6dc at nfs_lock1+0x9c #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b3df0a at _vn_lock+0xca #4 0xc09abbd6 at nfs_advlock+0x146 #5 0xc0ed352a at VOP_ADVLOCK_APV+0x12a #6 0xc0a439e6 at kern_fcntl+0xbc6 #7 0xc0a42d6d at sys_fcntl+0xdd #8 0xc0eac9cd at syscall+0x2ed #9 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 65735 fsid 0x3a78ff41 0xcba38708: tag newnfs, type VREG usecount 1, writecount 1, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xcc0c34a0 ref 0 pages 1 lock type newnfs: EXCL by thread 0xca34cc00 (pid 41872, lockf, tid 100271) with shared waiters pending #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc09ab6dc at nfs_lock1+0x9c #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b3df0a at _vn_lock+0xca #4 0xc09abbd6 at nfs_advlock+0x146 #5 0xc0ed352a at VOP_ADVLOCK_APV+0x12a #6 0xc0a439e6 at kern_fcntl+0xbc6 #7 0xc0a42d6d at sys_fcntl+0xdd #8 0xc0eac9cd at syscall+0x2ed #9 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 65942 fsid 0x3a78ff41 0xce841708: tag newnfs, type VREG usecount 1, writecount 1, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xcc025094 ref 0 pages 1 lock type newnfs: EXCL by thread 0xcd487600 (pid 41877, lockf, tid 100351) with exclusive waiters pending #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc09ab6dc at nfs_lock1+0x9c #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b3df0a at _vn_lock+0xca #4 0xc09abd55 at nfs_advlock+0x2c5 #5 0xc0ed352a at VOP_ADVLOCK_APV+0x12a #6 0xc0a439e6 at kern_fcntl+0xbc6 #7 0xc0a42d6d at sys_fcntl+0xdd #8 0xc0eac9cd at syscall+0x2ed #9 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 65908 fsid 0x3a78ff41 0xca2c4870: tag newnfs, type VREG usecount 1, writecount 1, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xc8a87378 ref 0 pages 1 lock type newnfs: EXCL by thread 0xc8f3d000 (pid 41946, lockf, tid 100470) #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc09ab6dc at nfs_lock1+0x9c #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b3df0a at _vn_lock+0xca #4 0xc09abbd6 at nfs_advlock+0x146 #5 0xc0ed352a at VOP_ADVLOCK_APV+0x12a #6 0xc0a465f6 at closef+0xa6 #7 0xc0a463e9 at fdescfree+0x439 #8 0xc0a521b8 at exit1+0x5a8 #9 0xc0a51c0d at sys_sys_exit+0x1d #10 0xc0eac9cd at syscall+0x2ed #11 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 65733 fsid 0x3a78ff41 0xc9be92d0: tag newnfs, type VREG usecount 0, writecount 0, refcount 1 mountedhere 0 flags (VI_DOOMED) lock type newnfs: EXCL by thread 0xc9094000 (pid 41904, rename, tid 100175) #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc09ab6dc at nfs_lock1+0x9c #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b29497 at vnlru_free+0x217 #4 0xc0b29094 at getnewvnode+0x64 #5 0xc09b3b18 at nfscl_nget+0x388 #6 0xc09a7e08 at nfs_lookup+0x988 #7 0xc0ecf364 at VOP_LOOKUP_APV+0x124 #8 0xc0b20b18 at lookup+0x528 #9 0xc0b2020d at namei+0x47d #10 0xc0b374bc at kern_unlinkat+0xbc #11 0xc0b37122 at sys_unlink+0x32 #12 0xc0eac9cd at syscall+0x2ed #13 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 140668 fsid 0x3a78ff41 0xcb433168: tag newnfs, type VREG usecount 0, writecount 0, refcount 1 mountedhere 0 flags (VI_DOOMED) lock type newnfs: EXCL by thread 0xc847e900 (pid 589, nfsd, tid 100114) #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc09ab6dc at nfs_lock1+0x9c #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b29497 at vnlru_free+0x217 #4 0xc0b29094 at getnewvnode+0x64 #5 0xc0ce9d8b at ffs_vgetf+0xeb #6 0xc0ce9c8e at ffs_vget+0x2e #7 0xc0cf8c26 at ufs_lookup_ino+0xe26 #8 0xc0cf7dfa at ufs_lookup+0x2a #9 0xc0ecf554 at VOP_CACHEDLOOKUP_APV+0x124 #10 0xc0b17d20 at vfs_cache_lookup+0xf0 #11 0xc0ecf364 at VOP_LOOKUP_APV+0x124 #12 0xc0b20b18 at lookup+0x528 #13 0xc09d0209 at nfsvno_namei+0x199 #14 0xc09c8ad9 at nfsrvd_lookup+0x159 #15 0xc09bb14e at nfsrvd_dorpc+0xe4e #16 0xc09c74ab at nfssvc_program+0x41b #17 0xc0c8e791 at svc_run_internal+0x201 fileid 140667 fsid 0x3a78ff41 0xc99c2168: tag newnfs, type VREG usecount 0, writecount 0, refcount 1 mountedhere 0 flags (VI_DOOMED) lock type newnfs: EXCL by thread 0xca326c00 (pid 41896, rename, tid 100283) #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc09ab6dc at nfs_lock1+0x9c #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b29497 at vnlru_free+0x217 #4 0xc0b29094 at getnewvnode+0x64 #5 0xc09b3b18 at nfscl_nget+0x388 #6 0xc09a7e08 at nfs_lookup+0x988 #7 0xc0ecf364 at VOP_LOOKUP_APV+0x124 #8 0xc0b20b18 at lookup+0x528 #9 0xc0b2020d at namei+0x47d #10 0xc0b374bc at kern_unlinkat+0xbc #11 0xc0b37122 at sys_unlink+0x32 #12 0xc0eac9cd at syscall+0x2ed #13 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 140669 fsid 0x3a78ff41 0xcac55e10: tag newnfs, type VREG usecount 0, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE|VI_DOINGINACT) lock type newnfs: EXCL by thread 0xc8faa000 (pid 41910, rename, tid 100184) #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc09b3ce9 at nfscl_nget+0x559 #2 0xc09a7e08 at nfs_lookup+0x988 #3 0xc0ecf364 at VOP_LOOKUP_APV+0x124 #4 0xc0b20b18 at lookup+0x528 #5 0xc0b2020d at namei+0x47d #6 0xc0b374bc at kern_unlinkat+0xbc #7 0xc0b37122 at sys_unlink+0x32 #8 0xc0eac9cd at syscall+0x2ed #9 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 135007 fsid 0x3a78ff41 0xcfa6d9d8: tag newnfs, type VREG usecount 0, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE|VI_DOINGINACT) lock type newnfs: EXCL by thread 0xca304300 (pid 41912, rename, tid 100314) #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc09b3ce9 at nfscl_nget+0x559 #2 0xc09a7e08 at nfs_lookup+0x988 #3 0xc0ecf364 at VOP_LOOKUP_APV+0x124 #4 0xc0b20b18 at lookup+0x528 #5 0xc0b2020d at namei+0x47d #6 0xc0b374bc at kern_unlinkat+0xbc #7 0xc0b37122 at sys_unlink+0x32 #8 0xc0eac9cd at syscall+0x2ed #9 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 135250 fsid 0x3a78ff41 0xca9ef9d8: tag newnfs, type VREG usecount 0, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE|VI_DOINGINACT) lock type newnfs: EXCL by thread 0xc9662300 (pid 41887, rename, tid 100226) #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc09b3ce9 at nfscl_nget+0x559 #2 0xc09a7e08 at nfs_lookup+0x988 #3 0xc0ecf364 at VOP_LOOKUP_APV+0x124 #4 0xc0b20b18 at lookup+0x528 #5 0xc0b2020d at namei+0x47d #6 0xc0b374bc at kern_unlinkat+0xbc #7 0xc0b37122 at sys_unlink+0x32 #8 0xc0eac9cd at syscall+0x2ed #9 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 137829 fsid 0x3a78ff41 0xc92e42d0: tag newnfs, type VREG usecount 1, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE) v_object 0xc91b840c ref 0 pages 0 lock type newnfs: EXCL by thread 0xc871e900 (pid 41889, rename, tid 100437) #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc09ab6dc at nfs_lock1+0x9c #2 0xc0ed2942 at VOP_LOCK1_APV+0x112 #3 0xc0b3df0a at _vn_lock+0xca #4 0xc0b3e06b at vn_close+0xeb #5 0xc0b3d1e3 at vn_closefile+0x53 #6 0xc0a43d2c at _fdrop+0x2c #7 0xc0a46753 at closef+0x203 #8 0xc0a443a5 at closefp+0xb5 #9 0xc0a44c8b at kern_close+0xfb #10 0xc0a44b8a at sys_close+0x1a #11 0xc0eac9cd at syscall+0x2ed #12 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 151347 fsid 0x3a78ff41 0xd1589168: tag newnfs, type VREG usecount 0, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE|VI_DOINGINACT) lock type newnfs: EXCL by thread 0xcc582000 (pid 41920, rename, tid 100386) #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc09b3ce9 at nfscl_nget+0x559 #2 0xc09a7e08 at nfs_lookup+0x988 #3 0xc0ecf364 at VOP_LOOKUP_APV+0x124 #4 0xc0b20b18 at lookup+0x528 #5 0xc0b2020d at namei+0x47d #6 0xc0b374bc at kern_unlinkat+0xbc #7 0xc0b37122 at sys_unlink+0x32 #8 0xc0eac9cd at syscall+0x2ed #9 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 136195 fsid 0x3a78ff41 0xcf927438: tag newnfs, type VREG usecount 0, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE|VI_DOINGINACT) lock type newnfs: EXCL by thread 0xc9660600 (pid 41914, rename, tid 100230) #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc09b3ce9 at nfscl_nget+0x559 #2 0xc09a7e08 at nfs_lookup+0x988 #3 0xc0ecf364 at VOP_LOOKUP_APV+0x124 #4 0xc0b20b18 at lookup+0x528 #5 0xc0b2020d at namei+0x47d #6 0xc0b374bc at kern_unlinkat+0xbc #7 0xc0b37122 at sys_unlink+0x32 #8 0xc0eac9cd at syscall+0x2ed #9 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 135520 fsid 0x3a78ff41 0xcb12c870: tag newnfs, type VREG usecount 0, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE|VI_DOINGINACT) lock type newnfs: EXCL by thread 0xc8460600 (pid 41906, rename, tid 100367) #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc09b3ce9 at nfscl_nget+0x559 #2 0xc09a7e08 at nfs_lookup+0x988 #3 0xc0ecf364 at VOP_LOOKUP_APV+0x124 #4 0xc0b20b18 at lookup+0x528 #5 0xc0b2020d at namei+0x47d #6 0xc0b374bc at kern_unlinkat+0xbc #7 0xc0b37122 at sys_unlink+0x32 #8 0xc0eac9cd at syscall+0x2ed #9 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 137729 fsid 0x3a78ff41 0xcc545e10: tag newnfs, type VREG usecount 0, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE|VI_DOINGINACT) lock type newnfs: EXCL by thread 0xc9fcb300 (pid 41892, rename, tid 100222) #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc09b3ce9 at nfscl_nget+0x559 #2 0xc09a7e08 at nfs_lookup+0x988 #3 0xc0ecf364 at VOP_LOOKUP_APV+0x124 #4 0xc0b20b18 at lookup+0x528 #5 0xc0b2020d at namei+0x47d #6 0xc0b374bc at kern_unlinkat+0xbc #7 0xc0b37122 at sys_unlink+0x32 #8 0xc0eac9cd at syscall+0x2ed #9 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 137833 fsid 0x3a78ff41 0xcb318870: tag newnfs, type VREG usecount 0, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE|VI_DOINGINACT) lock type newnfs: EXCL by thread 0xc8981c00 (pid 41922, rename, tid 100513) #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc09b3ce9 at nfscl_nget+0x559 #2 0xc09a7e08 at nfs_lookup+0x988 #3 0xc0ecf364 at VOP_LOOKUP_APV+0x124 #4 0xc0b20b18 at lookup+0x528 #5 0xc0b2020d at namei+0x47d #6 0xc0b374bc at kern_unlinkat+0xbc #7 0xc0b37122 at sys_unlink+0x32 #8 0xc0eac9cd at syscall+0x2ed #9 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 137765 fsid 0x3a78ff41 0xc9c6e870: tag newnfs, type VREG usecount 1, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE) lock type newnfs: EXCL by thread 0xcc0fe600 (pid 41908, rename, tid 100479) #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc09b3ce9 at nfscl_nget+0x559 #2 0xc09a7e08 at nfs_lookup+0x988 #3 0xc0ecf364 at VOP_LOOKUP_APV+0x124 #4 0xc0b20b18 at lookup+0x528 #5 0xc0b2020d at namei+0x47d #6 0xc0b374bc at kern_unlinkat+0xbc #7 0xc0b37122 at sys_unlink+0x32 #8 0xc0eac9cd at syscall+0x2ed #9 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 137773 fsid 0x3a78ff41 0xcb3d7b40: tag newnfs, type VREG usecount 1, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE) lock type newnfs: EXCL by thread 0xc8c2a600 (pid 41891, rename, tid 101092) #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc09b3ce9 at nfscl_nget+0x559 #2 0xc09a7e08 at nfs_lookup+0x988 #3 0xc0ecf364 at VOP_LOOKUP_APV+0x124 #4 0xc0b20b18 at lookup+0x528 #5 0xc0b2020d at namei+0x47d #6 0xc0b374bc at kern_unlinkat+0xbc #7 0xc0b37122 at sys_unlink+0x32 #8 0xc0eac9cd at syscall+0x2ed #9 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 137716 fsid 0x3a78ff41 0xc81ecca8: tag newnfs, type VREG usecount 1, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE) lock type newnfs: EXCL by thread 0xc8fad300 (pid 41918, rename, tid 100147) #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc09b3ce9 at nfscl_nget+0x559 #2 0xc09a7e08 at nfs_lookup+0x988 #3 0xc0ecf364 at VOP_LOOKUP_APV+0x124 #4 0xc0b20b18 at lookup+0x528 #5 0xc0b2020d at namei+0x47d #6 0xc0b374bc at kern_unlinkat+0xbc #7 0xc0b37122 at sys_unlink+0x32 #8 0xc0eac9cd at syscall+0x2ed #9 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 139285 fsid 0x3a78ff41 0xc995c708: tag newnfs, type VREG usecount 1, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE) lock type newnfs: EXCL by thread 0xca305600 (pid 41898, rename, tid 100308) #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc09b3ce9 at nfscl_nget+0x559 #2 0xc09a7e08 at nfs_lookup+0x988 #3 0xc0ecf364 at VOP_LOOKUP_APV+0x124 #4 0xc0b20b18 at lookup+0x528 #5 0xc0b2020d at namei+0x47d #6 0xc0b374bc at kern_unlinkat+0xbc #7 0xc0b37122 at sys_unlink+0x32 #8 0xc0eac9cd at syscall+0x2ed #9 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 137780 fsid 0x3a78ff41 0xc89cde10: tag newnfs, type VREG usecount 1, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE) lock type newnfs: EXCL by thread 0xc8c8c900 (pid 41894, rename, tid 100964) #0 0xc0a6b5af at __lockmgr_args+0x10af #1 0xc09b3ce9 at nfscl_nget+0x559 #2 0xc09a7e08 at nfs_lookup+0x988 #3 0xc0ecf364 at VOP_LOOKUP_APV+0x124 #4 0xc0b20b18 at lookup+0x528 #5 0xc0b2020d at namei+0x47d #6 0xc0b374bc at kern_unlinkat+0xbc #7 0xc0b37122 at sys_unlink+0x32 #8 0xc0eac9cd at syscall+0x2ed #9 0xc0e94f41 at Xint0x80_syscall+0x21 fileid 133094 fsid 0x3a78ff41 db:0:lockedvnods> show mount 0xc7d39bb0 /dev/ad4s1a on / (ufs) 0xc7d3a000 devfs on /dev (devfs) 0xc7d398c4 /dev/ad4s1f on /home (ufs) 0xc7d392ec /dev/ad4s1d on /usr (ufs) 0xc80b15d8 /dev/ad4s1e on /var (ufs) 0xc80b12ec procfs on /proc (procfs) 0xc8ee9000 /dev/label/tmp on /tmp (ufs) 0xc8ee8bb0 /dev/md5a on /mnt (ufs) 0xc8ca7bb0 127.0.0.1:/mnt on /mnt2 (nfs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 47756 1318 1317 1001 S nanslp 0xc123348b sleep 44457 44438 44457 0 D+ newnfs 0xcbd3f73c umount 44438 44435 44438 0 S+ wait 0xca30bba0 bash 44435 44434 44435 0 S+ pause 0xc8475634 csh 44434 33620 44434 1001 S+ wait 0xcc5d15d0 su 44371 1 44360 0 D+ ufs 0xcc57ea0c umount 42169 42168 813 0 D newnfsre 0xc9aeda00 ls 42168 813 813 0 S wait 0xcf69bba0 sh 41946 1 41011 1004 DE+ nfsv4gr 0xcae98824 lockf 41945 41877 41011 1004 D+ newnfs 0xce84173c lockf 41944 41872 41011 1004 D+ newnfs 0xcba3873c lockf 41943 41881 41011 1004 D+ newnfs 0xcf170b74 lockf 41942 41890 41011 1004 D+ nfsv4gr 0xcae98824 lockf 41941 41888 41011 1004 D+ nfsv4gr 0xcae98824 lockf 41940 41886 41011 1004 D+ newnfs 0xcb1965d4 lockf 41939 41884 41011 1004 D+ newnfs 0xcfae7304 lockf 41936 41885 41011 1004 DE+ newnfs 0xc9c3473c lockf 41922 1 41011 1004 D+ nfsv4gr 0xcae98824 rename 41920 1 41011 1004 D+ nfsv4gr 0xcae98824 rename 41918 1 41011 1004 D+ newnfsre 0xcce05c00 rename 41916 1 41011 1004 D+ newnfsre 0xcce07e00 rename 41914 1 41011 1004 D+ nfsv4gr 0xcae98824 rename 41913 1 41011 1004 D+ flushbuf 0xe3889abc rw 41912 1 41011 1004 D+ nfsv4gr 0xcae98824 rename 41910 1 41011 1004 D+ nfsv4gr 0xcae98824 rename 41908 1 41011 1004 D+ newnfsre 0xcc83d800 rename 41906 1 41011 1004 D+ nfsv4gr 0xcae98824 rename 41904 1 41011 1004 D+ nfsv4gr 0xcae98824 rename 41898 1 41011 1004 D+ newnfsre 0xc9388e00 rename 41896 1 41011 1004 D+ nfsv4gr 0xcae98824 rename 41895 1 41011 1004 D+ newnfsre 0xcb778200 rename 41894 1 41011 1004 D+ newnfsre 0xc8122c00 rename 41893 1 41011 1004 D+ newnfsre 0xcafb9800 rename 41892 1 41011 1004 D+ nfsv4gr 0xcae98824 rename 41891 1 41011 1004 D+ newnfsre 0xc9385a00 rename 41890 1 41011 1004 D+ newnfs 0xc9b14304 lockf 41889 1 41011 1004 D+ nfsv4gr 0xcae98824 rename 41888 1 41011 1004 D+ newnfs 0xcbe2b304 lockf 41887 1 41011 1004 D+ nfsv4gr 0xcae98824 rename 41886 1 41011 1004 D+ newnfsre 0xc8b12c00 lockf 41885 1 41011 1004 D+ nfsv4gr 0xcae98824 lockf 41884 1 41011 1004 D+ nfsv4gr 0xcae98824 lockf 41881 1 41011 1004 D+ bo_wwait 0xcf170c4c lockf 41877 1 41011 1004 D+ nfsv4gr 0xcae98824 lockf 41872 1 41011 1004 D+ nfsv4gr 0xcae98824 lockf 41158 0 0 0 DL newnfsre 0xcd999800 [nfscl] 41003 0 0 0 DL mdwait 0xc7711800 [md5] 33620 33619 33620 1001 Ss+ wait 0xc95d7ba0 bash 33619 33578 33578 1001 S select 0xc9c5ac24 sshd 33578 723 33578 0 Ss select 0xcb97c424 sshd 33357 0 0 0 DL newnfsre 0xcc9c0000 [newnfs 2] 33353 0 0 0 DL newnfsre 0xcafb4200 [newnfs 1] 1319 1317 1317 1001 S piperd 0xc905db28 awk 1318 1317 1317 1001 S wait 0xc7d65000 sh 1317 1316 1317 1001 SWs wait 0xc86feba0 sh 1316 1310 1310 1001 S select 0xc7c8f724 sshd 1315 1312 1315 1001 Ss+ select 0xc7ce8964 top 1314 1313 1314 1001 Ss kqread 0xc7d2cd00 tail 1313 1307 1307 1001 S select 0xc7c8f7e4 sshd 1312 1306 1306 1001 S select 0xc7e346a4 sshd 1310 723 1310 0 Ss select 0xc7e342e4 sshd 1307 723 1307 0 Ss select 0xc7ce85a4 sshd 1306 723 1306 0 Ss select 0xc7c0a664 sshd 862 1 862 0 Ss+ ttyin 0xc778ee70 getty 861 1 861 0 Ss+ ttyin 0xc7936070 getty 860 1 860 0 Ss+ ttyin 0xc7936270 getty 859 1 859 0 Ss+ ttyin 0xc7936470 getty 858 1 858 0 Ss+ ttyin 0xc778da70 getty 857 1 857 0 Ss+ ttyin 0xc778d870 getty 856 1 856 0 Ss+ ttyin 0xc778d070 getty 855 1 855 0 Ss+ ttyin 0xc778d270 getty 854 1 854 0 Ss+ ttyin 0xc778d470 getty 837 1 837 0 Ss select 0xc7c0bce4 inetd 813 1 813 0 Ss wait 0xc8f05ba0 watchdogd 800 797 800 0 S+ ttyin 0xc7937270 bash 797 796 797 0 SW+ pause 0xc7dbac04 csh 796 786 796 1001 SW+ wait 0xc86fe5d0 su 786 785 786 1001 SWs+ wait 0xc7c32ba0 bash 785 783 783 1001 S select 0xc7c8fda4 sshd 783 723 783 0 Ss select 0xc7ce85e4 sshd 734 1 734 0 Ss nanslp 0xc1233488 cron 729 1 729 25 Ss pause 0xc7e13c04 sendmail 726 1 726 0 Ss select 0xc7e34be4 sendmail 723 1 723 0 Ss select 0xc7c8fa24 sshd 691 1 691 0 Ss select 0xc7c0a364 moused 690 673 673 0 S select 0xc7c0baa4 winbindd 679 671 671 0 S select 0xc7ce8324 smbd 673 1 673 0 Ss select 0xc7c0a324 winbindd 671 1 671 0 Ss select 0xc7ce8b64 smbd 669 1 669 0 Ss select 0xc7c0a4e4 nmbd 645 1 645 0 Ss select 0xc7c8f4e4 ntpd 589 584 584 0 D (threaded) nfsd 100115 D nfsv4lck 0xc13fa92c nfsd: service 100114 D nfsv4gr 0xcae98824 nfsd: service 100113 D nfsv4lck 0xc13fa92c nfsd: service 100094 D nfsv4lck 0xc13fa92c nfsd: master 584 1 584 0 Ss select 0xc7e345a4 nfsd 578 1 578 0 Ss select 0xc7ce8a64 mountd 571 567 567 0 S select 0xc7c0a3a4 nfsuserd 570 567 567 0 S sbwait 0xc80e0c18 nfsuserd 569 567 567 0 S select 0xc7c0bde4 nfsuserd 568 567 567 0 S select 0xc7e34564 nfsuserd 567 1 567 0 SWs pause 0xc7e1391c nfsuserd 538 1 538 0 Ss select 0xc7c0a264 rpcbind 523 1 523 0 Ss select 0xc7c0a0e4 syslogd 420 1 420 0 Ss select 0xc7e34c64 devd 17 0 0 0 DL sdflush 0xc13ae994 [softdepflush] 16 0 0 0 DL syncer 0xc13aa424 [syncer] 9 0 0 0 DL vlruwt 0xc7c30ba0 [vnlru] 8 0 0 0 DL psleep 0xc13aa19c [bufdaemon] 7 0 0 0 DL pgzero 0xc13af294 [pagezero] 6 0 0 0 DL psleep 0xc13aee5c [vmdaemon] 5 0 0 0 DL psleep 0xc1403484 [pagedaemon] 4 0 0 0 DL ccb_scan 0xc11fefa4 [xpt_thrd] 3 0 0 0 DL waiting_ 0xc13fee58 [sctp_iterator] 2 0 0 0 DL - 0xc789bc3c [fdc0] 15 0 0 0 DL (threaded) [usb] 100058 D - 0xc78ffd34 [usbus5] 100057 D - 0xc78ffd04 [usbus5] 100056 D - 0xc78ffcd4 [usbus5] 100055 D - 0xc78ffca4 [usbus5] 100053 D - 0xc78f3b5c [usbus4] 100052 D - 0xc78f3b2c [usbus4] 100051 D - 0xc78f3afc [usbus4] 100050 D - 0xc78f3acc [usbus4] 100049 D - 0xc78efb5c [usbus3] 100048 D - 0xc78efb2c [usbus3] 100047 D - 0xc78efafc [usbus3] 100046 D - 0xc78efacc [usbus3] 100045 D - 0xc78e2b5c [usbus2] 100044 D - 0xc78e2b2c [usbus2] 100043 D - 0xc78e2afc [usbus2] 100042 D - 0xc78e2acc [usbus2] 100040 D - 0xc78ddb5c [usbus1] 100039 D - 0xc78ddb2c [usbus1] 100038 D - 0xc78ddafc [usbus1] 100037 D - 0xc78ddacc [usbus1] 100035 D - 0xc78d4b5c [usbus0] 100034 D - 0xc78d4b2c [usbus0] 100033 D - 0xc78d4afc [usbus0] 100032 D - 0xc78d4acc [usbus0] 14 0 0 0 DL - 0xc1219104 [yarrow] 13 0 0 0 DL (threaded) [geom] 100016 D - 0xc13faa64 [g_down] 100015 D - 0xc13faa60 [g_up] 100014 D - 0xc13faa5c [g_event] 12 0 0 0 WL (threaded) [intr] 100063 I [irq12: psm0] 100062 I [irq1: atkbd0] 100060 I [swi0: uart] 100059 I [irq14: ata0] 100054 I [irq19: ehci0] 100041 I [irq18: ohci2 ohci4] 100036 I [irq17: ohci1 ohci3] 100031 I [irq16: hdac1 ohci0] 100030 I [irq22: ahci0] 100029 I [irq257: re0] 100028 I [irq256: hdac0] 100027 I [swi6: task queue] 100025 I [swi2: cambio] 100020 I [swi5: fast taskq] 100018 I [swi6: Giant taskq] 100012 I [swi3: vm] 100011 I [swi1: netisr 0] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 I [swi4: clock] 100007 I [swi4: clock] 11 0 0 0 RL (threaded) [idle] 100006 Run CPU 3 [idle: cpu3] 100005 Run CPU 2 [idle: cpu2] 100004 Run CPU 1 [idle: cpu1] 100003 Run CPU 0 [idle: cpu0] 1 0 1 0 SLs wait 0xc76cbba0 [init] 10 0 0 0 DL audit_wo 0xc1401f54 [audit] 0 0 0 0 DLs (threaded) [kernel] 100065 D - 0xc1232380 [deadlkres] 100064 D - 0xc786d300 [mca taskq] 100026 D - 0xc76c6400 [ffs_trim taskq] 100024 D - 0xc76c6500 [kqueue taskq] 100023 D - 0xc76c6580 [acpi_task_2] 100022 D - 0xc76c6580 [acpi_task_1] 100021 D - 0xc76c6580 [acpi_task_0] 100019 D - 0xc76c6700 [thread taskq] 100013 D - 0xc7714000 [firmware taskq] 100000 D sched 0xc13faae4 [swapper] db:0:ps> allt Tracing command sleep pid 47756 tid 100409 td 0xcc7e4c00 sched_switch(cc7e4c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf6210a64 mi_switch(104,0,c108cb51,1f5,c0acb130,...) at mi_switch+0x1c9/frame 0xf6210a98 sleepq_switch(cc7e4c00,0,c108cb51,1ab,8,...) at sleepq_switch+0x1b9/frame 0xf6210acc sleepq_catch_signals(c0acb130,cc7e4c00,3,201,3,...) at sleepq_catch_signals+0x361/frame 0xf6210b14 sleepq_timedwait_sig(c123348b,6c,b49b,a0000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf6210b3c _sleep(c123348b,0,16c,c10884ca,43ed01c1,...) at _sleep+0x331/frame 0xf6210b98 kern_nanosleep(bfbfdce0,f6210c18,f6210c20,2,a,...) at kern_nanosleep+0x158/frame 0xf6210c00 sys_nanosleep(cc7e4c00,f6210cc8,c0eb32b0,c7200c90,0,...) at sys_nanosleep+0x6b/frame 0xf6210c40 syscall(f6210d08) at syscall+0x2ed/frame 0xf6210cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6210cfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28164173, esp = 0xbfbfdcac, ebp = 0xbfbfdcf4 --- Tracing command umount pid 44457 tid 101008 td 0xc8bc8900 sched_switch(c8bc8900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf67af6f4 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf67af728 sleepq_switch(c8bc8900,0,c108cb51,26b,60,...) at sleepq_switch+0x1b9/frame 0xf67af75c sleepq_wait(cbd3f73c,60,c1070ec2,4,0,...) at sleepq_wait+0x48/frame 0xf67af780 sleeplk(cbd3f7a8,c1070ec2,60,33,0,...) at sleeplk+0x126/frame 0xf67af7c8 __lockmgr_args(cbd3f73c,80100,cbd3f7a8,0,0,0,c109780f,877) at __lockmgr_args+0xa44/frame 0xf67af8a8 nfs_lock1(f67af920,c757b1e0,c7580798,c757b1e0,c7580798,...) at nfs_lock1+0x9c/frame 0xf67af8d8 VOP_LOCK1_APV(c11ab130,f67af920,20,0,c11f8cb0,...) at VOP_LOCK1_APV+0x112/frame 0xf67af908 _vn_lock(cbd3f708,80100,c109780f,877,57,...) at _vn_lock+0xca/frame 0xf67af948 vget(cbd3f708,80100,c8bc8900,57,0,...) at vget+0x77/frame 0xf67af97c vfs_hash_get(c8ca7bb0,7e5ed0b,80000,c8bc8900,f67af9ec,...) at vfs_hash_get+0xff/frame 0xf67af9a8 ncl_nget(c8ca7bb0,c8bea08c,1c,f67afa18,80000,...) at ncl_nget+0xba/frame 0xf67af9fc nfs_root(c8ca7bb0,80000,f67afad0,0,c1badb10,...) at nfs_root+0x3c/frame 0xf67afa28 vflush(c8ca7bb0,1,0,c8bc8900,c8bea000,...) at vflush+0x69/frame 0xf67afafc nfs_unmount(c8ca7bb0,8000000,c1096e1f,50f,c1bae814,...) at nfs_unmount+0x91/frame 0xf67afb30 dounmount(c8ca7bb0,8000000,c8bc8900,493,c0acfc55,...) at dounmount+0x47c/frame 0xf67afb90 sys_unmount(c8bc8900,f67afcc8,c10dec7f,d6,0,...) at sys_unmount+0x3cd/frame 0xf67afc40 syscall(f67afd08) at syscall+0x2ed/frame 0xf67afcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf67afcfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c195b, esp = 0xbfbfd314, ebp = 0xbfbfd3e0 --- Tracing command bash pid 44438 tid 100243 td 0xca325900 sched_switch(ca325900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5f5598c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5f559c0 sleepq_switch(ca325900,0,c108cb51,1ab,f5f55a38,...) at sleepq_switch+0x1b9/frame 0xf5f559f4 sleepq_catch_signals(0,c108cb51,162,288,ca325900,...) at sleepq_catch_signals+0x361/frame 0xf5f55a3c sleepq_wait_sig(ca30bba0,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5f55a60 _sleep(ca30bba0,ca30bc34,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf5f55abc kern_wait6(ca325900,7,0,0,f5f55b4c,...) at kern_wait6+0x45c/frame 0xf5f55b20 sys_wait4(ca325900,f5f55cc8,f5f55cc0,c0a74ac2,2710,...) at sys_wait4+0x94/frame 0xf5f55c40 syscall(f5f55d08) at syscall+0x2ed/frame 0xf5f55cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5f55cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282b04b3, esp = 0xbfbfd7a0, ebp = 0xbfbfd7b8 --- Tracing command csh pid 44435 tid 100109 td 0xc7d68000 sched_switch(c7d68000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d41aa0 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xf5d41ad4 sleepq_switch(c7d68000,0,c108cb51,1ab,f5d41b4c,...) at sleepq_switch+0x1b9/frame 0xf5d41b08 sleepq_catch_signals(0,c108cb51,162,930,c7d68000,...) at sleepq_catch_signals+0x361/frame 0xf5d41b50 sleepq_wait_sig(c8475634,74,c0f05194,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5d41b74 _sleep(c8475634,c8475664,174,c0f05194,0,...) at _sleep+0x35b/frame 0xf5d41bd0 kern_sigsuspend(c7d68000,0,0,0,0,...) at kern_sigsuspend+0xfb/frame 0xf5d41c10 sys_sigsuspend(c7d68000,f5d41cc8,c10dec7f,e9,0,...) at sys_sigsuspend+0x58/frame 0xf5d41c40 syscall(f5d41d08) at syscall+0x2ed/frame 0xf5d41cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d41cfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2816c0ab, esp = 0xbfbfd114, ebp = 0xbfbfd17c --- Tracing command su pid 44434 tid 100400 td 0xcc7e7900 sched_switch(cc7e7900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf61f598c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf61f59c0 sleepq_switch(cc7e7900,0,c108cb51,1ab,f61f5a38,...) at sleepq_switch+0x1b9/frame 0xf61f59f4 sleepq_catch_signals(0,c108cb51,162,1278,cc7e7900,...) at sleepq_catch_signals+0x361/frame 0xf61f5a3c sleepq_wait_sig(cc5d15d0,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf61f5a60 _sleep(cc5d15d0,cc5d1664,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf61f5abc kern_wait6(cc7e7900,0,ad93,0,f61f5b4c,...) at kern_wait6+0x45c/frame 0xf61f5b20 sys_wait4(cc7e7900,f61f5cc8,c0eb32b0,c71fac90,0,...) at sys_wait4+0x94/frame 0xf61f5c40 syscall(f61f5d08) at syscall+0x2ed/frame 0xf61f5cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf61f5cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281104b3, esp = 0xbfbfd630, ebp = 0xbfbfd648 --- Tracing command umount pid 44371 tid 101087 td 0xc8b21000 sched_switch(c8b21000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf67dc80c mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf67dc840 sleepq_switch(c8b21000,0,c108cb51,26b,60,...) at sleepq_switch+0x1b9/frame 0xf67dc874 sleepq_wait(cc57ea0c,60,c1076516,4,0,...) at sleepq_wait+0x48/frame 0xf67dc898 sleeplk(cc57ea78,c1076516,60,33,0,...) at sleeplk+0x126/frame 0xf67dc8e0 __lockmgr_args(cc57ea0c,80900,cc57ea78,0,0,...) at __lockmgr_args+0xa44/frame 0xf67dc9c0 ffs_lock(f67dca48,c1badb14,1,246,c757b5f0,...) at ffs_lock+0xad/frame 0xf67dca00 VOP_LOCK1_APV(c11e446c,f67dca48,246,c8ee8bb0,c11f8cb0,...) at VOP_LOCK1_APV+0x112/frame 0xf67dca30 _vn_lock(cc57e9d8,80900,c109780f,877,c8ee8bc0,...) at _vn_lock+0xca/frame 0xf67dca70 vget(cc57e9d8,80900,c8b21000,62d,0,...) at vget+0x77/frame 0xf67dcaa8 ffs_sync(c8ee8bb0,1,c1096e1f,50f,c1bae814,...) at ffs_sync+0x222/frame 0xf67dcb30 dounmount(c8ee8bb0,8000000,c8b21000,493,c0acfc55,...) at dounmount+0x43c/frame 0xf67dcb90 sys_unmount(c8b21000,f67dccc8,c0eb32b0,c7200c90,0,...) at sys_unmount+0x3cd/frame 0xf67dcc40 syscall(f67dcd08) at syscall+0x2ed/frame 0xf67dccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf67dccfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c195b, esp = 0xbfbfd124, ebp = 0xbfbfd1f0 --- Tracing command ls pid 42169 tid 100492 td 0xcc0fd600 sched_switch(cc0fd600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf6309490 mi_switch(104,0,c108cb51,1f5,101,...) at mi_switch+0x1c9/frame 0xf63094c4 sleepq_switch(cc0fd600,0,c108cb51,28e,cc0fd600,...) at sleepq_switch+0x1b9/frame 0xf63094f8 sleepq_timedwait(c9aeda00,0,20c49b,0,0,...) at sleepq_timedwait+0x48/frame 0xf630951c _sleep(c9aeda00,c786e300,0,c106f1d8,7fbe76c9,...) at _sleep+0x345/frame 0xf6309578 clnt_vc_call(c81c53a0,f6309728,1,ca411000,f63097f0,...) at clnt_vc_call+0x67e/frame 0xf6309650 clnt_reconnect_call(c80fc8a0,f6309728,1,ca411000,f63097f0,...) at clnt_reconnect_call+0x506/frame 0xf63096b8 newnfs_request(f63097f0,c8bea000,0,c8bea110,cbd3f708,cc0fd600,c76aae80,186a3,4,0,1,0,0) at newnfs_request+0x71b/frame 0xf6309778 nfscl_request(f63097f0,cbd3f708,cc0fd600,c76aae80,0,...) at nfscl_request+0x8c/frame 0xf63097c0 nfsrpc_getattr(cbd3f708,c76aae80,cc0fd600,f6309920,0,...) at nfsrpc_getattr+0xb1/frame 0xf6309890 nfs_getattr(f6309a70,c10e5679,c10ba064,f6309a10,c0d0bd8a,...) at nfs_getattr+0x152/frame 0xf63099c0 VOP_GETATTR_APV(c11ab130,f6309a70,cbd3f708,0,cc0fd600,...) at VOP_GETATTR_APV+0x124/frame 0xf63099f0 vn_stat(cbd3f708,f6309ab8,c76aae80,0,cc0fd600,...) at vn_stat+0x87/frame 0xf6309a98 kern_statat_vnhook(cc0fd600,200,ffffff9c,2881bd78,0,...) at kern_statat_vnhook+0xfb/frame 0xf6309ba8 sys_lstat(cc0fd600,f6309cc8,c0eb32b0,c1825c90,0,...) at sys_lstat+0x59/frame 0xf6309c40 syscall(f6309d08) at syscall+0x2ed/frame 0xf6309cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6309cfc --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x281c7e87, esp = 0xbfbfd604, ebp = 0xbfbfd68c --- Tracing command sh pid 42168 tid 100299 td 0xca307300 sched_switch(ca307300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf601c98c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf601c9c0 sleepq_switch(ca307300,0,c108cb51,1ab,f601ca38,...) at sleepq_switch+0x1b9/frame 0xf601c9f4 sleepq_catch_signals(0,c108cb51,162,288,ca307300,...) at sleepq_catch_signals+0x361/frame 0xf601ca3c sleepq_wait_sig(cf69bba0,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf601ca60 _sleep(cf69bba0,cf69bc34,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf601cabc kern_wait6(ca307300,7,0,0,f601cb4c,...) at kern_wait6+0x45c/frame 0xf601cb20 sys_wait4(ca307300,f601ccc8,c10dec7f,d6,ca307300,...) at sys_wait4+0x94/frame 0xf601cc40 syscall(f601cd08) at syscall+0x2ed/frame 0xf601ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf601ccfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfdae0, ebp = 0xbfbfdaf8 --- Tracing command lockf pid 41946 tid 100470 td 0xc8f3d000 sched_switch(c8f3d000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf62c77a4 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf62c77d8 sleepq_switch(c8f3d000,0,c108cb51,26b,c8f3d000,...) at sleepq_switch+0x1b9/frame 0xf62c780c sleepq_wait(cae98824,63,c106f6fa,0,0,...) at sleepq_wait+0x48/frame 0xf62c7830 _sleep(cae98824,c13fa698,63,c106f6fa,0,0,0,0,100) at _sleep+0x37c/frame 0xf62c788c nfsmsleep(cae98824,c13fa698,63,c106f6fa,0,...) at nfsmsleep+0xaa/frame 0xf62c78c4 nfsv4_getref(cae98820,0,c13fa698,c8ca7bb0,ca2c4800,...) at nfsv4_getref+0x6f/frame 0xf62c78ec nfscl_getcl(c8ca7bb0,ca1a7680,c8f3d000,1,f62c79a8,...) at nfscl_getcl+0x3f6/frame 0xf62c7968 nfscl_checkwritelocked(ca2c4870,f62c7ae8,ca1a7680,c8f3d000,c81668b8,...) at nfscl_checkwritelocked+0xc1/frame 0xf62c79c8 nfs_advlock(f62c7b08,c10e5ecc,c123f680,c8f3d000,f62c7ac4,...) at nfs_advlock+0x186/frame 0xf62c7aa0 VOP_ADVLOCK_APV(c11ab130,f62c7b08,c9d90658,ca2c50d8,0,...) at VOP_ADVLOCK_APV+0x12a/frame 0xf62c7ad0 closef(c9058700,c8f3d000,7d0,7ce,c11b9ca4,...) at closef+0xa6/frame 0xf62c7b38 fdescfree(c8f3d000,0,c10806dc,11a,f62c7c40,...) at fdescfree+0x439/frame 0xf62c7bd0 exit1(c8f3d000,0,f62c7cfc,c0eac9cd,c8f3d000,...) at exit1+0x5a8/frame 0xf62c7c30 sys_sys_exit(c8f3d000,f62c7cc8,c0eb32b0,c71fac90,0,...) at sys_sys_exit+0x1d/frame 0xf62c7c40 syscall(f62c7d08) at syscall+0x2ed/frame 0xf62c7cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf62c7cfc --- syscall (1, FreeBSD ELF32, sys_sys_exit), eip = 0x281377f3, esp = 0xbfbfd74c, ebp = 0xbfbfd75c --- Tracing command lockf pid 41945 tid 102643 td 0xc90db600 sched_switch(c90db600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf7079814 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf7079848 sleepq_switch(c90db600,0,c108cb51,26b,60,...) at sleepq_switch+0x1b9/frame 0xf707987c sleepq_wait(ce84173c,60,c1070ec2,4,0,...) at sleepq_wait+0x48/frame 0xf70798a0 sleeplk(ce8417a8,c1070ec2,60,33,0,...) at sleeplk+0x126/frame 0xf70798e8 __lockmgr_args(ce84173c,80400,ce8417a8,0,0,0,c1070ac3,bb5) at __lockmgr_args+0xa44/frame 0xf70799c8 nfs_lock1(f7079a40,246,c1baf380,a58,cb612ef8,...) at nfs_lock1+0x9c/frame 0xf70799f8 VOP_LOCK1_APV(c11ab130,f7079a40,c757c080,c1bae600,c11f8cb0,...) at VOP_LOCK1_APV+0x112/frame 0xf7079a28 _vn_lock(ce841708,80400,c1070ac3,bb5,0,...) at _vn_lock+0xca/frame 0xf7079a68 nfs_advlock(f7079bb0,c10e5ecc,4000,0,ffffffff,...) at nfs_advlock+0x146/frame 0xf7079b40 VOP_ADVLOCK_APV(c11ab130,f7079bb0,4000,0,0,...) at VOP_ADVLOCK_APV+0x12a/frame 0xf7079b70 kern_fcntl(c90db600,3,c,f7079c10,c90db600,...) at kern_fcntl+0xbc6/frame 0xf7079be0 sys_fcntl(c90db600,f7079cc8,7b3,2,f7079cc4,...) at sys_fcntl+0xdd/frame 0xf7079c40 syscall(f7079d08) at syscall+0x2ed/frame 0xf7079cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf7079cfc --- syscall (92, FreeBSD ELF32, sys_fcntl), eip = 0x28187407, esp = 0xbfbfd6fc, ebp = 0xbfbfd740 --- Tracing command lockf pid 41944 tid 100152 td 0xc7e04600 sched_switch(c7e04600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5dca7ec mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf5dca820 sleepq_switch(c7e04600,0,c108cb51,26b,60,...) at sleepq_switch+0x1b9/frame 0xf5dca854 sleepq_wait(cba3873c,60,c1070ec2,4,1,...) at sleepq_wait+0x48/frame 0xf5dca878 sleeplk(cba387a8,c1070ec2,60,33,1,...) at sleeplk+0x126/frame 0xf5dca8c0 __lockmgr_args(cba3873c,200400,cba387a8,0,0,0,c10991a8,2b8) at __lockmgr_args+0x60b/frame 0xf5dca9a0 nfs_lock1(f5dcaa18,c0a744ab,c124f318,8,c108cb51,...) at nfs_lock1+0x9c/frame 0xf5dca9d0 VOP_LOCK1_APV(c11ab130,f5dcaa18,c1378580,c11b9ca4,c11f8cb0,...) at VOP_LOCK1_APV+0x112/frame 0xf5dcaa00 _vn_lock(cba38708,200400,c10991a8,2b8,f5dcaa94,...) at _vn_lock+0xca/frame 0xf5dcaa40 vn_read(c8c61c40,f5dcac10,ca1a7680,1,c7e04600,...) at vn_read+0x14c/frame 0xf5dcaab0 vn_io_fault(c8c61c40,f5dcac10,ca1a7680,0,c7e04600,...) at vn_io_fault+0x24b/frame 0xf5dcab90 dofileread(c8c61c40,f5dcac10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5dcabc4 kern_readv(c7e04600,3,f5dcac10,0,bfbfd754,...) at kern_readv+0x66/frame 0xf5dcabf0 sys_read(c7e04600,f5dcacc8,7b3,2,f5dcacc4,...) at sys_read+0x5c/frame 0xf5dcac40 syscall(f5dcad08) at syscall+0x2ed/frame 0xf5dcacfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5dcacfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819bfc7, esp = 0xbfbfd740, ebp = 0xbfbfd75c --- Tracing command lockf pid 41943 tid 100214 td 0xc9091900 sched_switch(c9091900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5ef6814 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf5ef6848 sleepq_switch(c9091900,0,c108cb51,26b,60,...) at sleepq_switch+0x1b9/frame 0xf5ef687c sleepq_wait(cf170b74,60,c1070ec2,4,0,...) at sleepq_wait+0x48/frame 0xf5ef68a0 sleeplk(cf170be0,c1070ec2,60,33,0,...) at sleeplk+0x126/frame 0xf5ef68e8 __lockmgr_args(cf170b74,80400,cf170be0,0,0,0,c1070ac3,bd3) at __lockmgr_args+0xa44/frame 0xf5ef69c8 nfs_lock1(f5ef6a40,ffffffff,c9091900,100,0,...) at nfs_lock1+0x9c/frame 0xf5ef69f8 VOP_LOCK1_APV(c11ab130,f5ef6a40,c122af04,0,c11f8cb0,...) at VOP_LOCK1_APV+0x112/frame 0xf5ef6a28 _vn_lock(cf170b40,80400,c1070ac3,bd3,f5ef6c10,...) at _vn_lock+0xca/frame 0xf5ef6a68 nfs_advlock(f5ef6bb0,c10e5ecc,c107f9d1,270,ffffffff,...) at nfs_advlock+0x2c5/frame 0xf5ef6b40 VOP_ADVLOCK_APV(c11ab130,f5ef6bb0,c107f9d1,270,0,...) at VOP_ADVLOCK_APV+0x12a/frame 0xf5ef6b70 kern_fcntl(c9091900,3,d,f5ef6c10,c9091900,...) at kern_fcntl+0xbc6/frame 0xf5ef6be0 sys_fcntl(c9091900,f5ef6cc8,7b3,2,f5ef6cc4,...) at sys_fcntl+0xdd/frame 0xf5ef6c40 syscall(f5ef6d08) at syscall+0x2ed/frame 0xf5ef6cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5ef6cfc --- syscall (92, FreeBSD ELF32, sys_fcntl), eip = 0x28187407, esp = 0xbfbfd6fc, ebp = 0xbfbfd740 --- Tracing command lockf pid 41942 tid 100524 td 0xc973b600 sched_switch(c973b600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf64c977c mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf64c97b0 sleepq_switch(c973b600,0,c108cb51,26b,c973b600,...) at sleepq_switch+0x1b9/frame 0xf64c97e4 sleepq_wait(cae98824,63,c106f6fa,0,0,...) at sleepq_wait+0x48/frame 0xf64c9808 _sleep(cae98824,c13fa698,63,c106f6fa,0,0,0,0,100) at _sleep+0x37c/frame 0xf64c9864 nfsmsleep(cae98824,c13fa698,63,c106f6fa,0,...) at nfsmsleep+0xaa/frame 0xf64c989c nfsv4_getref(cae98820,0,c13fa698,c8ca7bb0,c9b143a0,...) at nfsv4_getref+0x6f/frame 0xf64c98c4 nfscl_getcl(c8ca7bb0,ca1a7680,c973b600,1,f64c9a48,...) at nfscl_getcl+0x3f6/frame 0xf64c9940 nfsrpc_advlock(c9b142d0,4,0,2,f64c9c10,...) at nfsrpc_advlock+0x2fd/frame 0xf64c9a68 nfs_advlock(f64c9bb0,c10e5ecc,4000,0,ffffffff,...) at nfs_advlock+0x216/frame 0xf64c9b40 VOP_ADVLOCK_APV(c11ab130,f64c9bb0,4000,0,0,...) at VOP_ADVLOCK_APV+0x12a/frame 0xf64c9b70 kern_fcntl(c973b600,3,c,f64c9c10,c973b600,...) at kern_fcntl+0xbc6/frame 0xf64c9be0 sys_fcntl(c973b600,f64c9cc8,c0eb32b0,c71fdc90,0,...) at sys_fcntl+0xdd/frame 0xf64c9c40 syscall(f64c9d08) at syscall+0x2ed/frame 0xf64c9cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf64c9cfc --- syscall (92, FreeBSD ELF32, sys_fcntl), eip = 0x28187407, esp = 0xbfbfd6fc, ebp = 0xbfbfd73c --- Tracing command lockf pid 41941 tid 100130 td 0xc8a0a900 sched_switch(c8a0a900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d87708 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf5d8773c sleepq_switch(c8a0a900,0,c108cb51,26b,c8a0a900,...) at sleepq_switch+0x1b9/frame 0xf5d87770 sleepq_wait(cae98824,63,c106f6fa,0,0,...) at sleepq_wait+0x48/frame 0xf5d87794 _sleep(cae98824,c13fa698,63,c106f6fa,0,0,0,0,100) at _sleep+0x37c/frame 0xf5d877f0 nfsmsleep(cae98824,c13fa698,63,c106f6fa,0,...) at nfsmsleep+0xaa/frame 0xf5d87828 nfsv4_getref(cae98820,0,c13fa698,c8ca7bb0,1,...) at nfsv4_getref+0x6f/frame 0xf5d87850 nfscl_getcl(c8ca7bb0,ca1a7680,c8a0a900,1,f5d8790c,...) at nfscl_getcl+0x3f6/frame 0xf5d878cc nfscl_getbytelock(cbe2b2d0,0,0,ffffffff,ffffffff,...) at nfscl_getbytelock+0x144/frame 0xf5d87940 nfsrpc_advlock(cbe2b2d0,4,0,c,f5d87c10,...) at nfsrpc_advlock+0x1b7/frame 0xf5d87a68 nfs_advlock(f5d87bb0,c10e5ecc,c107f9d1,270,ffffffff,...) at nfs_advlock+0x216/frame 0xf5d87b40 VOP_ADVLOCK_APV(c11ab130,f5d87bb0,c107f9d1,270,0,...) at VOP_ADVLOCK_APV+0x12a/frame 0xf5d87b70 kern_fcntl(c8a0a900,3,d,f5d87c10,c8a0a900,...) at kern_fcntl+0xbc6/frame 0xf5d87be0 sys_fcntl(c8a0a900,f5d87cc8,8,c10874bc,db,...) at sys_fcntl+0xdd/frame 0xf5d87c40 syscall(f5d87d08) at syscall+0x2ed/frame 0xf5d87cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d87cfc --- syscall (92, FreeBSD ELF32, sys_fcntl), eip = 0x28187407, esp = 0xbfbfd6fc, ebp = 0xbfbfd73c --- Tracing command lockf pid 41940 tid 100306 td 0xca305c00 sched_switch(ca305c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf6035814 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf6035848 sleepq_switch(ca305c00,0,c108cb51,26b,60,...) at sleepq_switch+0x1b9/frame 0xf603587c sleepq_wait(cb1965d4,60,c1070ec2,4,0,...) at sleepq_wait+0x48/frame 0xf60358a0 sleeplk(cb196640,c1070ec2,60,33,0,...) at sleeplk+0x126/frame 0xf60358e8 __lockmgr_args(cb1965d4,80400,cb196640,0,0,0,c1070ac3,bb5) at __lockmgr_args+0xa44/frame 0xf60359c8 nfs_lock1(f6035a40,c11c3e8c,f6035b18,f6035b00,f6035a38,...) at nfs_lock1+0x9c/frame 0xf60359f8 VOP_LOCK1_APV(c11ab130,f6035a40,f6035a68,c0ed2b3a,c11f8cb0,...) at VOP_LOCK1_APV+0x112/frame 0xf6035a28 _vn_lock(cb1965a0,80400,c1070ac3,bb5,0,...) at _vn_lock+0xca/frame 0xf6035a68 nfs_advlock(f6035bb0,c10e5ecc,c107f9d1,270,ffffffff,...) at nfs_advlock+0x146/frame 0xf6035b40 VOP_ADVLOCK_APV(c11ab130,f6035bb0,c107f9d1,270,0,...) at VOP_ADVLOCK_APV+0x12a/frame 0xf6035b70 kern_fcntl(ca305c00,3,d,f6035c10,ca305c00,...) at kern_fcntl+0xbc6/frame 0xf6035be0 sys_fcntl(ca305c00,f6035cc8,14,c10893dd,7b3,...) at sys_fcntl+0xdd/frame 0xf6035c40 syscall(f6035d08) at syscall+0x2ed/frame 0xf6035cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6035cfc --- syscall (92, FreeBSD ELF32, sys_fcntl), eip = 0x28187407, esp = 0xbfbfd6fc, ebp = 0xbfbfd740 --- Tracing command lockf pid 41939 tid 100217 td 0xc9091000 sched_switch(c9091000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5f02814 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf5f02848 sleepq_switch(c9091000,0,c108cb51,26b,60,...) at sleepq_switch+0x1b9/frame 0xf5f0287c sleepq_wait(cfae7304,60,c1070ec2,4,0,...) at sleepq_wait+0x48/frame 0xf5f028a0 sleeplk(cfae7370,c1070ec2,60,33,0,...) at sleeplk+0x126/frame 0xf5f028e8 __lockmgr_args(cfae7304,80400,cfae7370,0,0,0,c1070ac3,bb5) at __lockmgr_args+0xa44/frame 0xf5f029c8 nfs_lock1(f5f02a40,246,c1baf380,a58,c7db1ef8,...) at nfs_lock1+0x9c/frame 0xf5f029f8 VOP_LOCK1_APV(c11ab130,f5f02a40,c757c080,c1bae600,c11f8cb0,...) at VOP_LOCK1_APV+0x112/frame 0xf5f02a28 _vn_lock(cfae72d0,80400,c1070ac3,bb5,0,...) at _vn_lock+0xca/frame 0xf5f02a68 nfs_advlock(f5f02bb0,c10e5ecc,4000,0,ffffffff,...) at nfs_advlock+0x146/frame 0xf5f02b40 VOP_ADVLOCK_APV(c11ab130,f5f02bb0,4000,0,0,...) at VOP_ADVLOCK_APV+0x12a/frame 0xf5f02b70 kern_fcntl(c9091000,3,c,f5f02c10,c9091000,...) at kern_fcntl+0xbc6/frame 0xf5f02be0 sys_fcntl(c9091000,f5f02cc8,14,c10893dd,7b3,...) at sys_fcntl+0xdd/frame 0xf5f02c40 syscall(f5f02d08) at syscall+0x2ed/frame 0xf5f02cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5f02cfc --- syscall (92, FreeBSD ELF32, sys_fcntl), eip = 0x28187407, esp = 0xbfbfd6fc, ebp = 0xbfbfd740 --- Tracing command lockf pid 41936 tid 100581 td 0xc8207c00 sched_switch(c8207c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf64f6774 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf64f67a8 sleepq_switch(c8207c00,0,c108cb51,26b,60,...) at sleepq_switch+0x1b9/frame 0xf64f67dc sleepq_wait(c9c3473c,60,c1070ec2,4,0,...) at sleepq_wait+0x48/frame 0xf64f6800 sleeplk(c9c347a8,c1070ec2,60,33,0,...) at sleeplk+0x126/frame 0xf64f6848 __lockmgr_args(c9c3473c,80400,c9c347a8,0,0,0,c1070ac3,bb5) at __lockmgr_args+0xa44/frame 0xf64f6928 nfs_lock1(f64f69a0,c8d9fec0,0,c108319d,1df,...) at nfs_lock1+0x9c/frame 0xf64f6958 VOP_LOCK1_APV(c11ab130,f64f69a0,40,c8d9fe00,c11f8cb0,...) at VOP_LOCK1_APV+0x112/frame 0xf64f6988 _vn_lock(c9c34708,80400,c1070ac3,bb5,0,...) at _vn_lock+0xca/frame 0xf64f69c8 nfs_advlock(f64f6b08,c10e5ecc,c123f680,c8207c00,f64f6ac4,...) at nfs_advlock+0x146/frame 0xf64f6aa0 VOP_ADVLOCK_APV(c11ab130,f64f6b08,c8a25488,c81325e8,0,...) at VOP_ADVLOCK_APV+0x12a/frame 0xf64f6ad0 closef(c7d773b8,c8207c00,7d0,7ce,c11b9ca4,...) at closef+0xa6/frame 0xf64f6b38 fdescfree(c8207c00,0,c10806dc,11a,f64f6c40,...) at fdescfree+0x439/frame 0xf64f6bd0 exit1(c8207c00,0,f64f6cfc,c0eac9cd,c8207c00,...) at exit1+0x5a8/frame 0xf64f6c30 sys_sys_exit(c8207c00,f64f6cc8,7b3,2,f64f6cc4,...) at sys_sys_exit+0x1d/frame 0xf64f6c40 syscall(f64f6d08) at syscall+0x2ed/frame 0xf64f6cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf64f6cfc --- syscall (1, FreeBSD ELF32, sys_sys_exit), eip = 0x281377f3, esp = 0xbfbfd74c, ebp = 0xbfbfd75c --- Tracing command rename pid 41922 tid 100513 td 0xc8981c00 sched_switch(c8981c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf63807f4 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf6380828 sleepq_switch(c8981c00,0,c108cb51,26b,c8981c00,...) at sleepq_switch+0x1b9/frame 0xf638085c sleepq_wait(cae98824,63,c106f6fa,0,0,...) at sleepq_wait+0x48/frame 0xf6380880 _sleep(cae98824,c13fa698,63,c106f6fa,0,0,0,0,100) at _sleep+0x37c/frame 0xf63808dc nfsmsleep(cae98824,c13fa698,63,c106f6fa,0,...) at nfsmsleep+0xaa/frame 0xf6380914 nfsv4_getref(cae98820,0,c13fa698,c8ca7bb0,0,...) at nfsv4_getref+0x6f/frame 0xf638093c nfscl_getcl(c8ca7bb0,0,0,1,f63809f0,...) at nfscl_getcl+0x3f6/frame 0xf63809b8 nfscl_doclose(cb318870,f6380a14,c8981c00,cb318870,f6380a48,...) at nfscl_doclose+0x36/frame 0xf6380a00 nfsrpc_close(cb318870,1,c8981c00,c8981c00,1,...) at nfsrpc_close+0x31/frame 0xf6380a18 ncl_inactive(f6380aa0,c10e5bff,c109780f,9c7,c11f6178,...) at ncl_inactive+0xfe/frame 0xf6380a48 VOP_INACTIVE_APV(c11ab130,f6380aa0,c109780f,9c7,f6380ac0,...) at VOP_INACTIVE_APV+0x124/frame 0xf6380a78 vinactive(cb318870,c8981c00,c109780f,8c5,cb318920,...) at vinactive+0x181/frame 0xf6380ac0 vputx(cb318870,ffffffdf,cb318870,f6380bd4,4,...) at vputx+0x38a/frame 0xf6380b08 kern_unlinkat(c8981c00,ffffff9c,bfbfd6f0,0,0) at kern_unlinkat+0x2af/frame 0xf6380c24 sys_unlink(c8981c00,f6380cc8,c0eb32b0,c7200c90,0,...) at sys_unlink+0x32/frame 0xf6380c40 syscall(f6380d08) at syscall+0x2ed/frame 0xf6380cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6380cfc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28187427, esp = 0xbfbfd648, ebp = 0xbfbfd780 --- Tracing command rename pid 41920 tid 100386 td 0xcc582000 sched_switch(cc582000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf61cb7f4 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf61cb828 sleepq_switch(cc582000,0,c108cb51,26b,cc582000,...) at sleepq_switch+0x1b9/frame 0xf61cb85c sleepq_wait(cae98824,63,c106f6fa,0,0,...) at sleepq_wait+0x48/frame 0xf61cb880 _sleep(cae98824,c13fa698,63,c106f6fa,0,0,0,0,100) at _sleep+0x37c/frame 0xf61cb8dc nfsmsleep(cae98824,c13fa698,63,c106f6fa,0,...) at nfsmsleep+0xaa/frame 0xf61cb914 nfsv4_getref(cae98820,0,c13fa698,c8ca7bb0,0,...) at nfsv4_getref+0x6f/frame 0xf61cb93c nfscl_getcl(c8ca7bb0,0,0,1,f61cb9f0,...) at nfscl_getcl+0x3f6/frame 0xf61cb9b8 nfscl_doclose(d1589168,f61cba14,cc582000,d1589168,f61cba48,...) at nfscl_doclose+0x36/frame 0xf61cba00 nfsrpc_close(d1589168,1,cc582000,cc582000,1,...) at nfsrpc_close+0x31/frame 0xf61cba18 ncl_inactive(f61cbaa0,c10e5bff,c109780f,9c7,c11f6178,...) at ncl_inactive+0xfe/frame 0xf61cba48 VOP_INACTIVE_APV(c11ab130,f61cbaa0,c109780f,9c7,f61cbac0,...) at VOP_INACTIVE_APV+0x124/frame 0xf61cba78 vinactive(d1589168,cc582000,c109780f,8c5,d1589218,...) at vinactive+0x181/frame 0xf61cbac0 vputx(d1589168,ffffffdf,d1589168,f61cbbd4,c1bacd90,...) at vputx+0x38a/frame 0xf61cbb08 kern_unlinkat(cc582000,ffffff9c,bfbfd6f0,0,0) at kern_unlinkat+0x2af/frame 0xf61cbc24 sys_unlink(cc582000,f61cbcc8,0,20,c123fd80,...) at sys_unlink+0x32/frame 0xf61cbc40 syscall(f61cbd08) at syscall+0x2ed/frame 0xf61cbcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf61cbcfc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28187427, esp = 0xbfbfd648, ebp = 0xbfbfd780 --- Tracing command rename pid 41918 tid 100147 td 0xc8fad300 sched_switch(c8fad300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5dbb548 mi_switch(104,0,c108cb51,1f5,101,...) at mi_switch+0x1c9/frame 0xf5dbb57c sleepq_switch(c8fad300,0,c108cb51,28e,c8fad300,...) at sleepq_switch+0x1b9/frame 0xf5dbb5b0 sleepq_timedwait(cce05c00,0,20c49b,0,0,...) at sleepq_timedwait+0x48/frame 0xf5dbb5d4 _sleep(cce05c00,c786e300,0,c106f1d8,7fbe76c9,...) at _sleep+0x345/frame 0xf5dbb630 clnt_vc_call(c81c53a0,f5dbb7e0,1,ca411400,f5dbb8b8,...) at clnt_vc_call+0x67e/frame 0xf5dbb708 clnt_reconnect_call(c80fc8a0,f5dbb7e0,1,ca411400,f5dbb8b8,...) at clnt_reconnect_call+0x506/frame 0xf5dbb770 newnfs_request(f5dbb8b8,c8bea000,0,c8bea110,cc372000,c8fad300,ca1a7680,186a3,4,0,1,0,0) at newnfs_request+0x71b/frame 0xf5dbb830 nfscl_request(f5dbb8b8,cc372000,c8fad300,ca1a7680,0,...) at nfscl_request+0x8c/frame 0xf5dbb878 nfsrpc_remove(cc372000,cb3c9800,c,c81ecca8,ca1a7680,...) at nfsrpc_remove+0x131/frame 0xf5dbb958 nfs_removerpc(cb3c9800,c,ca1a7680,c8fad300,cc372000,...) at nfs_removerpc+0xaf/frame 0xf5dbba28 nfs_remove(f5dbbc00,c10e598c,c11f9270,cc372000,f5dbbbfc,...) at nfs_remove+0x111/frame 0xf5dbbad8 VOP_REMOVE_APV(c11ab130,f5dbbc00,c81ecca8,f5dbbbd4,f5dbbba8,...) at VOP_REMOVE_APV+0x14a/frame 0xf5dbbb08 kern_unlinkat(c8fad300,ffffff9c,bfbfd6f0,0,0) at kern_unlinkat+0x26a/frame 0xf5dbbc24 sys_unlink(c8fad300,f5dbbcc8,c0eb32b0,c71fac90,0,...) at sys_unlink+0x32/frame 0xf5dbbc40 syscall(f5dbbd08) at syscall+0x2ed/frame 0xf5dbbcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5dbbcfc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28187427, esp = 0xbfbfd648, ebp = 0xbfbfd780 --- Tracing command rename pid 41916 tid 102842 td 0xc8e53000 sched_switch(c8e53000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf76003d8 mi_switch(104,0,c108cb51,1f5,101,...) at mi_switch+0x1c9/frame 0xf760040c sleepq_switch(c8e53000,0,c108cb51,28e,c8e53000,...) at sleepq_switch+0x1b9/frame 0xf7600440 sleepq_timedwait(cce07e00,0,20c49b,0,0,...) at sleepq_timedwait+0x48/frame 0xf7600464 _sleep(cce07e00,c786e300,0,c106f1d8,7fbe76c9,...) at _sleep+0x345/frame 0xf76004c0 clnt_vc_call(c81c53a0,f7600670,1,cb5dc500,f7600738,...) at clnt_vc_call+0x67e/frame 0xf7600598 clnt_reconnect_call(c80fc8a0,f7600670,1,cb5dc500,f7600738,...) at clnt_reconnect_call+0x506/frame 0xf7600600 newnfs_request(f7600738,c8bea000,0,c8bea110,ca93aca8,c8e53000,ca1a7680,186a3,4,0,1,0,0) at newnfs_request+0x71b/frame 0xf76006c0 nfscl_request(f7600738,ca93aca8,c8e53000,ca1a7680,0,...) at nfscl_request+0x8c/frame 0xf7600708 nfsrpc_lookup(ca93aca8,cb1a7000,c,ca1a7680,c8e53000,...) at nfsrpc_lookup+0x1eb/frame 0xf76007d8 nfs_lookup(f7600a58,c10e539b,400400,c1096c53,2bc,...) at nfs_lookup+0x524/frame 0xf76009e8 VOP_LOOKUP_APV(c11ab130,f7600a58,c1096c53,2bc,f7600a60,...) at VOP_LOOKUP_APV+0x124/frame 0xf7600a18 lookup(f7600b88,c1096c53,107,ce,200,...) at lookup+0x528/frame 0xf7600a80 namei(f7600b88,ffffffdf,cc34e168,f7600bd4,c1bacd90,...) at namei+0x47d/frame 0xf7600b08 kern_unlinkat(c8e53000,ffffff9c,bfbfd6f0,0,0) at kern_unlinkat+0xbc/frame 0xf7600c24 sys_unlink(c8e53000,f7600cc8,c0eb32b0,c1825c90,0,...) at sys_unlink+0x32/frame 0xf7600c40 syscall(f7600d08) at syscall+0x2ed/frame 0xf7600cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf7600cfc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28187427, esp = 0xbfbfd648, ebp = 0xbfbfd780 --- Tracing command rename pid 41914 tid 100230 td 0xc9660600 sched_switch(c9660600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5f2d7f4 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf5f2d828 sleepq_switch(c9660600,0,c108cb51,26b,c9660600,...) at sleepq_switch+0x1b9/frame 0xf5f2d85c sleepq_wait(cae98824,63,c106f6fa,0,0,...) at sleepq_wait+0x48/frame 0xf5f2d880 _sleep(cae98824,c13fa698,63,c106f6fa,0,0,0,0,100) at _sleep+0x37c/frame 0xf5f2d8dc nfsmsleep(cae98824,c13fa698,63,c106f6fa,0,...) at nfsmsleep+0xaa/frame 0xf5f2d914 nfsv4_getref(cae98820,0,c13fa698,c8ca7bb0,0,...) at nfsv4_getref+0x6f/frame 0xf5f2d93c nfscl_getcl(c8ca7bb0,0,0,1,f5f2d9f0,...) at nfscl_getcl+0x3f6/frame 0xf5f2d9b8 nfscl_doclose(cf927438,f5f2da14,c9660600,cf927438,f5f2da48,...) at nfscl_doclose+0x36/frame 0xf5f2da00 nfsrpc_close(cf927438,1,c9660600,c9660600,1,...) at nfsrpc_close+0x31/frame 0xf5f2da18 ncl_inactive(f5f2daa0,c10e5bff,c109780f,9c7,c11f6178,...) at ncl_inactive+0xfe/frame 0xf5f2da48 VOP_INACTIVE_APV(c11ab130,f5f2daa0,c109780f,9c7,f5f2dac0,...) at VOP_INACTIVE_APV+0x124/frame 0xf5f2da78 vinactive(cf927438,c9660600,c109780f,8c5,cf9274e8,...) at vinactive+0x181/frame 0xf5f2dac0 vputx(cf927438,ffffffdf,cf927438,f5f2dbd4,c1bacd90,...) at vputx+0x38a/frame 0xf5f2db08 kern_unlinkat(c9660600,ffffff9c,bfbfd6f0,0,0) at kern_unlinkat+0x2af/frame 0xf5f2dc24 sys_unlink(c9660600,f5f2dcc8,14,c10893dd,7b3,...) at sys_unlink+0x32/frame 0xf5f2dc40 syscall(f5f2dd08) at syscall+0x2ed/frame 0xf5f2dcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5f2dcfc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28187427, esp = 0xbfbfd648, ebp = 0xbfbfd780 --- Tracing command rw pid 41913 tid 100438 td 0xc871e600 sched_switch(c871e600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf626777c mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf62677b0 sleepq_switch(c871e600,0,c108cb51,26b,60,...) at sleepq_switch+0x1b9/frame 0xf62677e4 sleepq_wait(e3889abc,60,c1098ae8,4,0,...) at sleepq_wait+0x48/frame 0xf6267808 sleeplk(cfe00d68,c1098ae8,60,0,0,...) at sleeplk+0x126/frame 0xf6267850 __lockmgr_args(e3889abc,81900,cfe00d68,c1098ae8,60,...) at __lockmgr_args+0xa44/frame 0xf6267930 flushbuflist(cfe00d68,0,0,4b2,f62679cc,...) at flushbuflist+0x125/frame 0xf6267988 bufobj_invalbuf(cfe00d68,0,0,0) at bufobj_invalbuf+0x13c/frame 0xf62679cc vinvalbuf(cfe00ca8,0,0,0,1,...) at vinvalbuf+0x3d/frame 0xf62679e8 ncl_vinvalbuf(cfe00ca8,0,c871e600,1,cef419d8,...) at ncl_vinvalbuf+0x16b/frame 0xf6267a28 nfs_remove(f6267c00,c10e598c,c11f9270,cef419d8,f6267bfc,...) at nfs_remove+0xe3/frame 0xf6267ad8 VOP_REMOVE_APV(c11ab130,f6267c00,cfe00ca8,f6267bd4,c1bacd90,...) at VOP_REMOVE_APV+0x14a/frame 0xf6267b08 kern_unlinkat(c871e600,ffffff9c,bfbfd700,0,0) at kern_unlinkat+0x26a/frame 0xf6267c24 sys_unlink(c871e600,f6267cc8,0,0,c871e600,...) at sys_unlink+0x32/frame 0xf6267c40 syscall(f6267d08) at syscall+0x2ed/frame 0xf6267cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6267cfc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28187427, esp = 0xbfbfc6e8, ebp = 0xbfbfd790 --- Tracing command rename pid 41912 tid 100314 td 0xca304300 sched_switch(ca304300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf604d7f4 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf604d828 sleepq_switch(ca304300,0,c108cb51,26b,ca304300,...) at sleepq_switch+0x1b9/frame 0xf604d85c sleepq_wait(cae98824,63,c106f6fa,0,0,...) at sleepq_wait+0x48/frame 0xf604d880 _sleep(cae98824,c13fa698,63,c106f6fa,0,0,0,0,100) at _sleep+0x37c/frame 0xf604d8dc nfsmsleep(cae98824,c13fa698,63,c106f6fa,0,...) at nfsmsleep+0xaa/frame 0xf604d914 nfsv4_getref(cae98820,0,c13fa698,c8ca7bb0,0,...) at nfsv4_getref+0x6f/frame 0xf604d93c nfscl_getcl(c8ca7bb0,0,0,1,f604d9f0,...) at nfscl_getcl+0x3f6/frame 0xf604d9b8 nfscl_doclose(cfa6d9d8,f604da14,ca304300,cfa6d9d8,f604da48,...) at nfscl_doclose+0x36/frame 0xf604da00 nfsrpc_close(cfa6d9d8,1,ca304300,ca304300,1,...) at nfsrpc_close+0x31/frame 0xf604da18 ncl_inactive(f604daa0,c10e5bff,c109780f,9c7,c11f6178,...) at ncl_inactive+0xfe/frame 0xf604da48 VOP_INACTIVE_APV(c11ab130,f604daa0,c109780f,9c7,f604dac0,...) at VOP_INACTIVE_APV+0x124/frame 0xf604da78 vinactive(cfa6d9d8,ca304300,c109780f,8c5,cfa6da88,...) at vinactive+0x181/frame 0xf604dac0 vputx(cfa6d9d8,ffffffdf,cfa6d9d8,f604dbd4,c1bacd90,...) at vputx+0x38a/frame 0xf604db08 kern_unlinkat(ca304300,ffffff9c,bfbfd6f0,0,0) at kern_unlinkat+0x2af/frame 0xf604dc24 sys_unlink(ca304300,f604dcc8,14,c10893dd,7b3,...) at sys_unlink+0x32/frame 0xf604dc40 syscall(f604dd08) at syscall+0x2ed/frame 0xf604dcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf604dcfc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28187427, esp = 0xbfbfd648, ebp = 0xbfbfd780 --- Tracing command rename pid 41910 tid 100184 td 0xc8faa000 sched_switch(c8faa000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5e757f4 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf5e75828 sleepq_switch(c8faa000,0,c108cb51,26b,c8faa000,...) at sleepq_switch+0x1b9/frame 0xf5e7585c sleepq_wait(cae98824,63,c106f6fa,0,0,...) at sleepq_wait+0x48/frame 0xf5e75880 _sleep(cae98824,c13fa698,63,c106f6fa,0,0,0,0,100) at _sleep+0x37c/frame 0xf5e758dc nfsmsleep(cae98824,c13fa698,63,c106f6fa,0,...) at nfsmsleep+0xaa/frame 0xf5e75914 nfsv4_getref(cae98820,0,c13fa698,c8ca7bb0,0,...) at nfsv4_getref+0x6f/frame 0xf5e7593c nfscl_getcl(c8ca7bb0,0,0,1,f5e759f0,...) at nfscl_getcl+0x3f6/frame 0xf5e759b8 nfscl_doclose(cac55e10,f5e75a14,c8faa000,cac55e10,f5e75a48,...) at nfscl_doclose+0x36/frame 0xf5e75a00 nfsrpc_close(cac55e10,1,c8faa000,c8faa000,1,...) at nfsrpc_close+0x31/frame 0xf5e75a18 ncl_inactive(f5e75aa0,c10e5bff,c109780f,9c7,c11f6178,...) at ncl_inactive+0xfe/frame 0xf5e75a48 VOP_INACTIVE_APV(c11ab130,f5e75aa0,c109780f,9c7,f5e75ac0,...) at VOP_INACTIVE_APV+0x124/frame 0xf5e75a78 vinactive(cac55e10,c8faa000,c109780f,8c5,cac55ec0,...) at vinactive+0x181/frame 0xf5e75ac0 vputx(cac55e10,ffffffdf,cac55e10,f5e75bd4,c1bacd90,...) at vputx+0x38a/frame 0xf5e75b08 kern_unlinkat(c8faa000,ffffff9c,bfbfd6f0,0,0) at kern_unlinkat+0x2af/frame 0xf5e75c24 sys_unlink(c8faa000,f5e75cc8,14,c10893dd,7b3,...) at sys_unlink+0x32/frame 0xf5e75c40 syscall(f5e75d08) at syscall+0x2ed/frame 0xf5e75cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5e75cfc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28187427, esp = 0xbfbfd648, ebp = 0xbfbfd780 --- Tracing command rename pid 41908 tid 100479 td 0xcc0fe600 sched_switch(cc0fe600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf62e2548 mi_switch(104,0,c108cb51,1f5,101,...) at mi_switch+0x1c9/frame 0xf62e257c sleepq_switch(cc0fe600,0,c108cb51,28e,cc0fe600,...) at sleepq_switch+0x1b9/frame 0xf62e25b0 sleepq_timedwait(cc83d800,0,20c49b,0,0,...) at sleepq_timedwait+0x48/frame 0xf62e25d4 _sleep(cc83d800,c786e300,0,c106f1d8,7fbe76c9,...) at _sleep+0x345/frame 0xf62e2630 clnt_vc_call(c81c53a0,f62e27e0,1,cb28a100,f62e28b8,...) at clnt_vc_call+0x67e/frame 0xf62e2708 clnt_reconnect_call(c80fc8a0,f62e27e0,1,cb28a100,f62e28b8,...) at clnt_reconnect_call+0x506/frame 0xf62e2770 newnfs_request(f62e28b8,c8bea000,0,c8bea110,cba89000,cc0fe600,ca1a7680,186a3,4,0,1,0,0) at newnfs_request+0x71b/frame 0xf62e2830 nfscl_request(f62e28b8,cba89000,cc0fe600,ca1a7680,0,...) at nfscl_request+0x8c/frame 0xf62e2878 nfsrpc_remove(cba89000,cd1ae000,c,c9c6e870,ca1a7680,...) at nfsrpc_remove+0x131/frame 0xf62e2958 nfs_removerpc(cd1ae000,c,ca1a7680,cc0fe600,cba89000,...) at nfs_removerpc+0xaf/frame 0xf62e2a28 nfs_remove(f62e2c00,c10e598c,c11f9270,cba89000,f62e2bfc,...) at nfs_remove+0x111/frame 0xf62e2ad8 VOP_REMOVE_APV(c11ab130,f62e2c00,c9c6e870,f62e2bd4,f62e2ba8,...) at VOP_REMOVE_APV+0x14a/frame 0xf62e2b08 kern_unlinkat(cc0fe600,ffffff9c,bfbfd6f0,0,0) at kern_unlinkat+0x26a/frame 0xf62e2c24 sys_unlink(cc0fe600,f62e2cc8,14,c10893dd,7b3,...) at sys_unlink+0x32/frame 0xf62e2c40 syscall(f62e2d08) at syscall+0x2ed/frame 0xf62e2cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf62e2cfc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28187427, esp = 0xbfbfd648, ebp = 0xbfbfd780 --- Tracing command rename pid 41906 tid 100367 td 0xc8460600 sched_switch(c8460600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf61927f4 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf6192828 sleepq_switch(c8460600,0,c108cb51,26b,c8460600,...) at sleepq_switch+0x1b9/frame 0xf619285c sleepq_wait(cae98824,63,c106f6fa,0,0,...) at sleepq_wait+0x48/frame 0xf6192880 _sleep(cae98824,c13fa698,63,c106f6fa,0,0,0,0,100) at _sleep+0x37c/frame 0xf61928dc nfsmsleep(cae98824,c13fa698,63,c106f6fa,0,...) at nfsmsleep+0xaa/frame 0xf6192914 nfsv4_getref(cae98820,0,c13fa698,c8ca7bb0,0,...) at nfsv4_getref+0x6f/frame 0xf619293c nfscl_getcl(c8ca7bb0,0,0,1,f61929f0,...) at nfscl_getcl+0x3f6/frame 0xf61929b8 nfscl_doclose(cb12c870,f6192a14,c8460600,cb12c870,f6192a48,...) at nfscl_doclose+0x36/frame 0xf6192a00 nfsrpc_close(cb12c870,1,c8460600,c8460600,1,...) at nfsrpc_close+0x31/frame 0xf6192a18 ncl_inactive(f6192aa0,c10e5bff,c109780f,9c7,c11f6178,...) at ncl_inactive+0xfe/frame 0xf6192a48 VOP_INACTIVE_APV(c11ab130,f6192aa0,c109780f,9c7,f6192ac0,...) at VOP_INACTIVE_APV+0x124/frame 0xf6192a78 vinactive(cb12c870,c8460600,c109780f,8c5,cb12c920,...) at vinactive+0x181/frame 0xf6192ac0 vputx(cb12c870,ffffffdf,cb12c870,f6192bd4,0,...) at vputx+0x38a/frame 0xf6192b08 kern_unlinkat(c8460600,ffffff9c,bfbfd6f0,0,0) at kern_unlinkat+0x2af/frame 0xf6192c24 sys_unlink(c8460600,f6192cc8,14,c10893dd,7b3,...) at sys_unlink+0x32/frame 0xf6192c40 syscall(f6192d08) at syscall+0x2ed/frame 0xf6192cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6192cfc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28187427, esp = 0xbfbfd648, ebp = 0xbfbfd780 --- Tracing command rename pid 41904 tid 100175 td 0xc9094000 sched_switch(c9094000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5e5a43c mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf5e5a470 sleepq_switch(c9094000,0,c108cb51,26b,c9094000,...) at sleepq_switch+0x1b9/frame 0xf5e5a4a4 sleepq_wait(cae98824,63,c106f6fa,0,0,...) at sleepq_wait+0x48/frame 0xf5e5a4c8 _sleep(cae98824,c13fa698,63,c106f6fa,0,0,0,0,100) at _sleep+0x37c/frame 0xf5e5a524 nfsmsleep(cae98824,c13fa698,63,c106f6fa,0,...) at nfsmsleep+0xaa/frame 0xf5e5a55c nfsv4_getref(cae98820,0,c13fa698,c8ca7bb0,c90940b4,...) at nfsv4_getref+0x6f/frame 0xf5e5a584 nfscl_getcl(c8ca7bb0,0,0,1,f5e5a638,...) at nfscl_getcl+0x3f6/frame 0xf5e5a600 nfscl_doclose(c9be92d0,f5e5a65c,c9094000,f5e5a6f0,f5e5a680,...) at nfscl_doclose+0x36/frame 0xf5e5a648 nfsrpc_close(c9be92d0,1,c9094000,c11ab130,f5e5a6f0,...) at nfsrpc_close+0x31/frame 0xf5e5a660 ncl_reclaim(f5e5a6f0,c10e5c53,1,c9be93a0,c9be93bc,...) at ncl_reclaim+0x57/frame 0xf5e5a680 VOP_RECLAIM_APV(c11ab130,f5e5a6f0,0,0,0,...) at VOP_RECLAIM_APV+0x124/frame 0xf5e5a6b0 vgonel(c9be9380,0,c109780f,397,f5e5a764,...) at vgonel+0x50c/frame 0xf5e5a718 vnlru_free(c13aa3ec,0,c109780f,3f4,1,...) at vnlru_free+0x274/frame 0xf5e5a764 getnewvnode(c1070ec2,c8ca7bb0,c11ab130,f5e5a7c8,f5e5a7c8,...) at getnewvnode+0x64/frame 0xf5e5a78c nfscl_nget(c8ca7bb0,c8306000,cc0e8700,f5e5abd4,c9094000,...) at nfscl_nget+0x388/frame 0xf5e5a7d8 nfs_lookup(f5e5aa58,c10e539b,400400,c1096c53,2bc,...) at nfs_lookup+0x988/frame 0xf5e5a9e8 VOP_LOOKUP_APV(c11ab130,f5e5aa58,c1096c53,2bc,f5e5aa60,...) at VOP_LOOKUP_APV+0x124/frame 0xf5e5aa18 lookup(f5e5ab88,c1096c53,107,ce,200,...) at lookup+0x528/frame 0xf5e5aa80 namei(f5e5ab88,ffffffdf,c9e69b40,f5e5abd4,c1bacd90,...) at namei+0x47d/frame 0xf5e5ab08 kern_unlinkat(c9094000,ffffff9c,bfbfd6f0,0,0) at kern_unlinkat+0xbc/frame 0xf5e5ac24 sys_unlink(c9094000,f5e5acc8,c0eb32b0,c7200c90,0,...) at sys_unlink+0x32/frame 0xf5e5ac40 syscall(f5e5ad08) at syscall+0x2ed/frame 0xf5e5acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5e5acfc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28187427, esp = 0xbfbfd648, ebp = 0xbfbfd780 --- Tracing command rename pid 41898 tid 100308 td 0xca305600 sched_switch(ca305600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf603b548 mi_switch(104,0,c108cb51,1f5,101,...) at mi_switch+0x1c9/frame 0xf603b57c sleepq_switch(ca305600,0,c108cb51,28e,ca305600,...) at sleepq_switch+0x1b9/frame 0xf603b5b0 sleepq_timedwait(c9388e00,0,20c49b,0,0,...) at sleepq_timedwait+0x48/frame 0xf603b5d4 _sleep(c9388e00,c786e300,0,c106f1d8,7fbe76c9,...) at _sleep+0x345/frame 0xf603b630 clnt_vc_call(c81c53a0,f603b7e0,1,c8953d00,f603b8b8,...) at clnt_vc_call+0x67e/frame 0xf603b708 clnt_reconnect_call(c80fc8a0,f603b7e0,1,c8953d00,f603b8b8,...) at clnt_reconnect_call+0x506/frame 0xf603b770 newnfs_request(f603b8b8,c8bea000,0,c8bea110,c9fd3b40,ca305600,ca1a7680,186a3,4,0,1,0,0) at newnfs_request+0x71b/frame 0xf603b830 nfscl_request(f603b8b8,c9fd3b40,ca305600,ca1a7680,0,...) at nfscl_request+0x8c/frame 0xf603b878 nfsrpc_remove(c9fd3b40,c994a800,c,c995c708,ca1a7680,...) at nfsrpc_remove+0x131/frame 0xf603b958 nfs_removerpc(c994a800,c,ca1a7680,ca305600,c9fd3b40,...) at nfs_removerpc+0xaf/frame 0xf603ba28 nfs_remove(f603bc00,c10e598c,c11f9270,c9fd3b40,f603bbfc,...) at nfs_remove+0x111/frame 0xf603bad8 VOP_REMOVE_APV(c11ab130,f603bc00,c995c708,f603bbd4,c1bacd90,...) at VOP_REMOVE_APV+0x14a/frame 0xf603bb08 kern_unlinkat(ca305600,ffffff9c,bfbfd6f0,0,0) at kern_unlinkat+0x26a/frame 0xf603bc24 sys_unlink(ca305600,f603bcc8,14,c10893dd,7b3,...) at sys_unlink+0x32/frame 0xf603bc40 syscall(f603bd08) at syscall+0x2ed/frame 0xf603bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf603bcfc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28187427, esp = 0xbfbfd648, ebp = 0xbfbfd780 --- Tracing command rename pid 41896 tid 100283 td 0xca326c00 sched_switch(ca326c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5fe143c mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf5fe1470 sleepq_switch(ca326c00,0,c108cb51,26b,ca326c00,...) at sleepq_switch+0x1b9/frame 0xf5fe14a4 sleepq_wait(cae98824,63,c106f6fa,0,0,...) at sleepq_wait+0x48/frame 0xf5fe14c8 _sleep(cae98824,c13fa698,63,c106f6fa,0,0,0,0,100) at _sleep+0x37c/frame 0xf5fe1524 nfsmsleep(cae98824,c13fa698,63,c106f6fa,0,...) at nfsmsleep+0xaa/frame 0xf5fe155c nfsv4_getref(cae98820,0,c13fa698,c8ca7bb0,ca326cb4,...) at nfsv4_getref+0x6f/frame 0xf5fe1584 nfscl_getcl(c8ca7bb0,0,0,1,f5fe1638,...) at nfscl_getcl+0x3f6/frame 0xf5fe1600 nfscl_doclose(c99c2168,f5fe165c,ca326c00,f5fe16f0,f5fe1680,...) at nfscl_doclose+0x36/frame 0xf5fe1648 nfsrpc_close(c99c2168,1,ca326c00,c11ab130,f5fe16f0,...) at nfsrpc_close+0x31/frame 0xf5fe1660 ncl_reclaim(f5fe16f0,c10e5c53,1,c99c2238,c99c2254,...) at ncl_reclaim+0x57/frame 0xf5fe1680 VOP_RECLAIM_APV(c11ab130,f5fe16f0,0,0,0,...) at VOP_RECLAIM_APV+0x124/frame 0xf5fe16b0 vgonel(c99c2218,0,c109780f,397,f5fe1764,...) at vgonel+0x50c/frame 0xf5fe1718 vnlru_free(c13aa3ec,0,c109780f,3f4,3,...) at vnlru_free+0x274/frame 0xf5fe1764 getnewvnode(c1070ec2,c8ca7bb0,c11ab130,f5fe17c8,f5fe17c8,...) at getnewvnode+0x64/frame 0xf5fe178c nfscl_nget(c8ca7bb0,cd7db2d0,cb6c05c0,f5fe1bd4,ca326c00,...) at nfscl_nget+0x388/frame 0xf5fe17d8 nfs_lookup(f5fe1a58,c10e539b,400400,c1096c53,2bc,...) at nfs_lookup+0x988/frame 0xf5fe19e8 VOP_LOOKUP_APV(c11ab130,f5fe1a58,c1096c53,2bc,f5fe1a60,...) at VOP_LOOKUP_APV+0x124/frame 0xf5fe1a18 lookup(f5fe1b88,c1096c53,107,ce,200,...) at lookup+0x528/frame 0xf5fe1a80 namei(f5fe1b88,ffffffdf,cee91870,f5fe1bd4,c1bacd90,...) at namei+0x47d/frame 0xf5fe1b08 kern_unlinkat(ca326c00,ffffff9c,bfbfd6f0,0,0) at kern_unlinkat+0xbc/frame 0xf5fe1c24 sys_unlink(ca326c00,f5fe1cc8,14,c10893dd,7b3,...) at sys_unlink+0x32/frame 0xf5fe1c40 syscall(f5fe1d08) at syscall+0x2ed/frame 0xf5fe1cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5fe1cfc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28187427, esp = 0xbfbfd648, ebp = 0xbfbfd780 --- Tracing command rename pid 41895 tid 102551 td 0xc9884000 sched_switch(c9884000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf70ca2b8 mi_switch(104,0,c108cb51,1f5,101,...) at mi_switch+0x1c9/frame 0xf70ca2ec sleepq_switch(c9884000,0,c108cb51,28e,c9884000,...) at sleepq_switch+0x1b9/frame 0xf70ca320 sleepq_timedwait(cb778200,0,20c49b,0,0,...) at sleepq_timedwait+0x48/frame 0xf70ca344 _sleep(cb778200,c786e300,0,c106f1d8,7fbe76c9,...) at _sleep+0x345/frame 0xf70ca3a0 clnt_vc_call(c81c53a0,f70ca550,1,ca57d400,f70ca618,...) at clnt_vc_call+0x67e/frame 0xf70ca478 clnt_reconnect_call(c80fc8a0,f70ca550,1,ca57d400,f70ca618,...) at clnt_reconnect_call+0x506/frame 0xf70ca4e0 newnfs_request(f70ca618,c8bea000,0,c8bea110,d14ccb40,c9884000,ca1a7680,186a3,4,0,1,0,0) at newnfs_request+0x71b/frame 0xf70ca5a0 nfscl_request(f70ca618,d14ccb40,c9884000,ca1a7680,0,...) at nfscl_request+0x8c/frame 0xf70ca5e8 nfsrpc_getattr(d14ccb40,ca1a7680,c9884000,f70ca748,0,...) at nfsrpc_getattr+0xb1/frame 0xf70ca6b8 nfs_getattr(f70caa10,c10e5679,c1240b80,f70ca801,f70ca86c,...) at nfs_getattr+0x152/frame 0xf70ca7e8 VOP_GETATTR_APV(c11ab130,f70caa10,0,0,c9884000,...) at VOP_GETATTR_APV+0x124/frame 0xf70ca818 nfs_create(f70cab10,c10e5451,c10b9de6,c8ca7bc0,2,...) at nfs_create+0x9b/frame 0xf70caa38 VOP_CREATE_APV(c11ab130,f70cab10,f70cabcc,f70caaa0,c8ca7bb0,...) at VOP_CREATE_APV+0x124/frame 0xf70caa68 vn_open_cred(f70cab80,f70cabfc,1b0,0,ca1a7680,c853dcb0) at vn_open_cred+0x2cf/frame 0xf70cab38 vn_open(f70cab80,f70cabfc,1b0,c853dcb0,f70cabd8,...) at vn_open+0x3b/frame 0xf70cab58 kern_openat(c9884000,ffffff9c,bfbfd6f0,0,200,1b0) at kern_openat+0x1ec/frame 0xf70cac20 sys_open(c9884000,f70cacc8,14,c10893dd,7b3,...) at sys_open+0x38/frame 0xf70cac40 syscall(f70cad08) at syscall+0x2ed/frame 0xf70cacfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf70cacfc --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x28193137, esp = 0xbfbfd648, ebp = 0xbfbfd780 --- Tracing command rename pid 41894 tid 100964 td 0xc8c8c900 sched_switch(c8c8c900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf679a548 mi_switch(104,0,c108cb51,1f5,101,...) at mi_switch+0x1c9/frame 0xf679a57c sleepq_switch(c8c8c900,0,c108cb51,28e,c8c8c900,...) at sleepq_switch+0x1b9/frame 0xf679a5b0 sleepq_timedwait(c8122c00,0,20c49b,0,0,...) at sleepq_timedwait+0x48/frame 0xf679a5d4 _sleep(c8122c00,c786e300,0,c106f1d8,7fbe76c9,...) at _sleep+0x345/frame 0xf679a630 clnt_vc_call(c81c53a0,f679a7e0,1,c9935600,f679a8b8,...) at clnt_vc_call+0x67e/frame 0xf679a708 clnt_reconnect_call(c80fc8a0,f679a7e0,1,c9935600,f679a8b8,...) at clnt_reconnect_call+0x506/frame 0xf679a770 newnfs_request(f679a8b8,c8bea000,0,c8bea110,ca3e49d8,c8c8c900,ca1a7680,186a3,4,0,1,0,0) at newnfs_request+0x71b/frame 0xf679a830 nfscl_request(f679a8b8,ca3e49d8,c8c8c900,ca1a7680,0,...) at nfscl_request+0x8c/frame 0xf679a878 nfsrpc_remove(ca3e49d8,c8c72c00,c,c89cde10,ca1a7680,...) at nfsrpc_remove+0x131/frame 0xf679a958 nfs_removerpc(c8c72c00,c,ca1a7680,c8c8c900,ca3e49d8,...) at nfs_removerpc+0xaf/frame 0xf679aa28 nfs_remove(f679ac00,c10e598c,c11f9270,ca3e49d8,f679abfc,...) at nfs_remove+0x111/frame 0xf679aad8 VOP_REMOVE_APV(c11ab130,f679ac00,c89cde10,f679abd4,c1bacd90,...) at VOP_REMOVE_APV+0x14a/frame 0xf679ab08 kern_unlinkat(c8c8c900,ffffff9c,bfbfd6f0,0,0) at kern_unlinkat+0x26a/frame 0xf679ac24 sys_unlink(c8c8c900,f679acc8,2710,2a213f1,2a23def,...) at sys_unlink+0x32/frame 0xf679ac40 syscall(f679ad08) at syscall+0x2ed/frame 0xf679acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf679acfc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28187427, esp = 0xbfbfd648, ebp = 0xbfbfd780 --- Tracing command rename pid 41893 tid 100503 td 0xccfb6600 sched_switch(ccfb6600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf632a2b8 mi_switch(104,0,c108cb51,1f5,101,...) at mi_switch+0x1c9/frame 0xf632a2ec sleepq_switch(ccfb6600,0,c108cb51,28e,ccfb6600,...) at sleepq_switch+0x1b9/frame 0xf632a320 sleepq_timedwait(cafb9800,0,20c49b,0,0,...) at sleepq_timedwait+0x48/frame 0xf632a344 _sleep(cafb9800,c786e300,0,c106f1d8,7fbe76c9,...) at _sleep+0x345/frame 0xf632a3a0 clnt_vc_call(c81c53a0,f632a550,1,c8a3c400,f632a618,...) at clnt_vc_call+0x67e/frame 0xf632a478 clnt_reconnect_call(c80fc8a0,f632a550,1,c8a3c400,f632a618,...) at clnt_reconnect_call+0x506/frame 0xf632a4e0 newnfs_request(f632a618,c8bea000,0,c8bea110,d10572d0,ccfb6600,ca1a7680,186a3,4,0,1,0,0) at newnfs_request+0x71b/frame 0xf632a5a0 nfscl_request(f632a618,d10572d0,ccfb6600,ca1a7680,0,...) at nfscl_request+0x8c/frame 0xf632a5e8 nfsrpc_getattr(d10572d0,ca1a7680,ccfb6600,f632a748,0,...) at nfsrpc_getattr+0xb1/frame 0xf632a6b8 nfs_getattr(f632aa10,c10e5679,c1240480,f632a801,f632a86c,...) at nfs_getattr+0x152/frame 0xf632a7e8 VOP_GETATTR_APV(c11ab130,f632aa10,0,0,ccfb6600,...) at VOP_GETATTR_APV+0x124/frame 0xf632a818 nfs_create(f632ab10,c10e5451,c10b9de6,c8ca7bc0,2,...) at nfs_create+0x9b/frame 0xf632aa38 VOP_CREATE_APV(c11ab130,f632ab10,f632abcc,f632aaa0,c8ca7bb0,...) at VOP_CREATE_APV+0x124/frame 0xf632aa68 vn_open_cred(f632ab80,f632abfc,1b0,0,ca1a7680,c8c61498) at vn_open_cred+0x2cf/frame 0xf632ab38 vn_open(f632ab80,f632abfc,1b0,c8c61498,f632abd8,...) at vn_open+0x3b/frame 0xf632ab58 kern_openat(ccfb6600,ffffff9c,bfbfd6f0,0,200,1b0) at kern_openat+0x1ec/frame 0xf632ac20 sys_open(ccfb6600,f632acc8,14,c10893dd,7b3,...) at sys_open+0x38/frame 0xf632ac40 syscall(f632ad08) at syscall+0x2ed/frame 0xf632acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf632acfc --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x28193137, esp = 0xbfbfd648, ebp = 0xbfbfd780 --- Tracing command rename pid 41892 tid 100222 td 0xc9fcb300 sched_switch(c9fcb300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5f157f4 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf5f15828 sleepq_switch(c9fcb300,0,c108cb51,26b,c9fcb300,...) at sleepq_switch+0x1b9/frame 0xf5f1585c sleepq_wait(cae98824,63,c106f6fa,0,0,...) at sleepq_wait+0x48/frame 0xf5f15880 _sleep(cae98824,c13fa698,63,c106f6fa,0,0,0,0,100) at _sleep+0x37c/frame 0xf5f158dc nfsmsleep(cae98824,c13fa698,63,c106f6fa,0,...) at nfsmsleep+0xaa/frame 0xf5f15914 nfsv4_getref(cae98820,0,c13fa698,c8ca7bb0,0,...) at nfsv4_getref+0x6f/frame 0xf5f1593c nfscl_getcl(c8ca7bb0,0,0,1,f5f159f0,...) at nfscl_getcl+0x3f6/frame 0xf5f159b8 nfscl_doclose(cc545e10,f5f15a14,c9fcb300,cc545e10,f5f15a48,...) at nfscl_doclose+0x36/frame 0xf5f15a00 nfsrpc_close(cc545e10,1,c9fcb300,c9fcb300,1,...) at nfsrpc_close+0x31/frame 0xf5f15a18 ncl_inactive(f5f15aa0,c10e5bff,c109780f,9c7,c11f6178,...) at ncl_inactive+0xfe/frame 0xf5f15a48 VOP_INACTIVE_APV(c11ab130,f5f15aa0,c109780f,9c7,f5f15ac0,...) at VOP_INACTIVE_APV+0x124/frame 0xf5f15a78 vinactive(cc545e10,c9fcb300,c109780f,8c5,cc545ec0,...) at vinactive+0x181/frame 0xf5f15ac0 vputx(cc545e10,ffffffdf,cc545e10,f5f15bd4,f5f15b74,...) at vputx+0x38a/frame 0xf5f15b08 kern_unlinkat(c9fcb300,ffffff9c,bfbfd6f0,0,0) at kern_unlinkat+0x2af/frame 0xf5f15c24 sys_unlink(c9fcb300,f5f15cc8,7b3,2,f5f15cc4,...) at sys_unlink+0x32/frame 0xf5f15c40 syscall(f5f15d08) at syscall+0x2ed/frame 0xf5f15cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5f15cfc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28187427, esp = 0xbfbfd648, ebp = 0xbfbfd780 --- Tracing command rename pid 41891 tid 101092 td 0xc8c2a600 sched_switch(c8c2a600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf7166548 mi_switch(104,0,c108cb51,1f5,101,...) at mi_switch+0x1c9/frame 0xf716657c sleepq_switch(c8c2a600,0,c108cb51,28e,c8c2a600,...) at sleepq_switch+0x1b9/frame 0xf71665b0 sleepq_timedwait(c9385a00,0,20c49b,0,0,...) at sleepq_timedwait+0x48/frame 0xf71665d4 _sleep(c9385a00,c786e300,0,c106f1d8,7fbe76c9,...) at _sleep+0x345/frame 0xf7166630 clnt_vc_call(c81c53a0,f71667e0,1,cbc69e00,f71668b8,...) at clnt_vc_call+0x67e/frame 0xf7166708 clnt_reconnect_call(c80fc8a0,f71667e0,1,cbc69e00,f71668b8,...) at clnt_reconnect_call+0x506/frame 0xf7166770 newnfs_request(f71668b8,c8bea000,0,c8bea110,ca9f9708,c8c2a600,ca1a7680,186a3,4,0,1,0,0) at newnfs_request+0x71b/frame 0xf7166830 nfscl_request(f71668b8,ca9f9708,c8c2a600,ca1a7680,0,...) at nfscl_request+0x8c/frame 0xf7166878 nfsrpc_remove(ca9f9708,cbe5c000,c,cb3d7b40,ca1a7680,...) at nfsrpc_remove+0x131/frame 0xf7166958 nfs_removerpc(cbe5c000,c,ca1a7680,c8c2a600,ca9f9708,...) at nfs_removerpc+0xaf/frame 0xf7166a28 nfs_remove(f7166c00,c10e598c,c11f9270,ca9f9708,f7166bfc,...) at nfs_remove+0x111/frame 0xf7166ad8 VOP_REMOVE_APV(c11ab130,f7166c00,cb3d7b40,f7166bd4,c1bacd90,...) at VOP_REMOVE_APV+0x14a/frame 0xf7166b08 kern_unlinkat(c8c2a600,ffffff9c,bfbfd6f0,0,0) at kern_unlinkat+0x26a/frame 0xf7166c24 sys_unlink(c8c2a600,f7166cc8,c0eb32b0,c71fac90,0,...) at sys_unlink+0x32/frame 0xf7166c40 syscall(f7166d08) at syscall+0x2ed/frame 0xf7166cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf7166cfc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28187427, esp = 0xbfbfd648, ebp = 0xbfbfd780 --- Tracing command lockf pid 41890 tid 100354 td 0xcb2e3900 sched_switch(cb2e3900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf616b814 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf616b848 sleepq_switch(cb2e3900,0,c108cb51,26b,60,...) at sleepq_switch+0x1b9/frame 0xf616b87c sleepq_wait(c9b14304,60,c1070ec2,4,0,...) at sleepq_wait+0x48/frame 0xf616b8a0 sleeplk(c9b14370,c1070ec2,60,33,0,...) at sleeplk+0x126/frame 0xf616b8e8 __lockmgr_args(c9b14304,80400,c9b14370,0,0,0,c1070ac3,bd3) at __lockmgr_args+0xa44/frame 0xf616b9c8 nfs_lock1(f616ba40,ffffffff,cb2e3900,100,0,...) at nfs_lock1+0x9c/frame 0xf616b9f8 VOP_LOCK1_APV(c11ab130,f616ba40,c122af04,0,c11f8cb0,...) at VOP_LOCK1_APV+0x112/frame 0xf616ba28 _vn_lock(c9b142d0,80400,c1070ac3,bd3,f616bc10,...) at _vn_lock+0xca/frame 0xf616ba68 nfs_advlock(f616bbb0,c10e5ecc,c107f9d1,270,ffffffff,...) at nfs_advlock+0x2c5/frame 0xf616bb40 VOP_ADVLOCK_APV(c11ab130,f616bbb0,c107f9d1,270,0,...) at VOP_ADVLOCK_APV+0x12a/frame 0xf616bb70 kern_fcntl(cb2e3900,3,d,f616bc10,cb2e3900,...) at kern_fcntl+0xbc6/frame 0xf616bbe0 sys_fcntl(cb2e3900,f616bcc8,c10874bc,db,5a6d2f8f,...) at sys_fcntl+0xdd/frame 0xf616bc40 syscall(f616bd08) at syscall+0x2ed/frame 0xf616bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf616bcfc --- syscall (92, FreeBSD ELF32, sys_fcntl), eip = 0x28187407, esp = 0xbfbfd6fc, ebp = 0xbfbfd740 --- Tracing command rename pid 41889 tid 100437 td 0xc871e900 sched_switch(c871e900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf6264794 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf62647c8 sleepq_switch(c871e900,0,c108cb51,26b,c871e900,...) at sleepq_switch+0x1b9/frame 0xf62647fc sleepq_wait(cae98824,63,c106f6fa,0,0,...) at sleepq_wait+0x48/frame 0xf6264820 _sleep(cae98824,c13fa698,63,c106f6fa,0,0,0,0,100) at _sleep+0x37c/frame 0xf626487c nfsmsleep(cae98824,c13fa698,63,c106f6fa,0,...) at nfsmsleep+0xaa/frame 0xf62648b4 nfsv4_getref(cae98820,0,c13fa698,c8ca7bb0,0,...) at nfsv4_getref+0x6f/frame 0xf62648dc nfscl_getcl(c8ca7bb0,0,0,1,f6264980,...) at nfscl_getcl+0x3f6/frame 0xf6264958 nfscl_getclose(c92e42d0,f62649a4,0,f62649d8,f6264a78,...) at nfscl_getclose+0x36/frame 0xf6264990 nfsrpc_close(c92e42d0,0,c871e900,0,0,...) at nfsrpc_close+0x42/frame 0xf62649a8 nfs_close(f6264ac8,c10e5586,80400,c10991a8,16d,...) at nfs_close+0x363/frame 0xf6264a78 VOP_CLOSE_APV(c11ab130,f6264ac8,c10991a8,16d,80400,...) at VOP_CLOSE_APV+0x124/frame 0xf6264aa8 vn_close(c92e42d0,1,ca1a7680,c871e900,8,...) at vn_close+0x155/frame 0xf6264af0 vn_closefile(c8c77460,c871e900,c8c77460,0,c871e900,...) at vn_closefile+0x53/frame 0xf6264b54 _fdrop(c8c77460,c871e900,bfbfd6f0,0,1080001,...) at _fdrop+0x2c/frame 0xf6264b70 closef(c8c77460,c871e900,46f,454,0,...) at closef+0x203/frame 0xf6264bd8 closefp(c8c77460,c871e900,1,b4,c8503c00,...) at closefp+0xb5/frame 0xf6264c04 kern_close(c871e900,3) at kern_close+0xfb/frame 0xf6264c30 sys_close(c871e900,f6264cc8,14,c10893dd,7b3,...) at sys_close+0x1a/frame 0xf6264c40 syscall(f6264d08) at syscall+0x2ed/frame 0xf6264cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6264cfc --- syscall (6, FreeBSD ELF32, sys_close), eip = 0x2819bfa7, esp = 0xbfbfd648, ebp = 0xbfbfd780 --- Tracing command lockf pid 41888 tid 100241 td 0xca326000 sched_switch(ca326000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5f4f7ec mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf5f4f820 sleepq_switch(ca326000,0,c108cb51,26b,60,...) at sleepq_switch+0x1b9/frame 0xf5f4f854 sleepq_wait(cbe2b304,60,c1070ec2,4,1,...) at sleepq_wait+0x48/frame 0xf5f4f878 sleeplk(cbe2b370,c1070ec2,60,33,1,...) at sleeplk+0x126/frame 0xf5f4f8c0 __lockmgr_args(cbe2b304,200400,cbe2b370,0,0,0,c10991a8,2b8) at __lockmgr_args+0x60b/frame 0xf5f4f9a0 nfs_lock1(f5f4fa18,c0a744ab,c124ea00,8,c108cb51,...) at nfs_lock1+0x9c/frame 0xf5f4f9d0 VOP_LOCK1_APV(c11ab130,f5f4fa18,c137acb0,c11b9ca4,c11f8cb0,...) at VOP_LOCK1_APV+0x112/frame 0xf5f4fa00 _vn_lock(cbe2b2d0,200400,c10991a8,2b8,f5f4fa94,...) at _vn_lock+0xca/frame 0xf5f4fa40 vn_read(c8309150,f5f4fc10,ca1a7680,1,ca326000,...) at vn_read+0x14c/frame 0xf5f4fab0 vn_io_fault(c8309150,f5f4fc10,ca1a7680,0,ca326000,...) at vn_io_fault+0x24b/frame 0xf5f4fb90 dofileread(c8309150,f5f4fc10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5f4fbc4 kern_readv(ca326000,3,f5f4fc10,0,bfbfd758,...) at kern_readv+0x66/frame 0xf5f4fbf0 sys_read(ca326000,f5f4fcc8,c0eb32b0,c71fdc90,0,...) at sys_read+0x5c/frame 0xf5f4fc40 syscall(f5f4fd08) at syscall+0x2ed/frame 0xf5f4fcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5f4fcfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819bfc7, esp = 0xbfbfd744, ebp = 0xbfbfd75c --- Tracing command rename pid 41887 tid 100226 td 0xc9662300 sched_switch(c9662300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5f217f4 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf5f21828 sleepq_switch(c9662300,0,c108cb51,26b,c9662300,...) at sleepq_switch+0x1b9/frame 0xf5f2185c sleepq_wait(cae98824,63,c106f6fa,0,0,...) at sleepq_wait+0x48/frame 0xf5f21880 _sleep(cae98824,c13fa698,63,c106f6fa,0,0,0,0,100) at _sleep+0x37c/frame 0xf5f218dc nfsmsleep(cae98824,c13fa698,63,c106f6fa,0,...) at nfsmsleep+0xaa/frame 0xf5f21914 nfsv4_getref(cae98820,0,c13fa698,c8ca7bb0,0,...) at nfsv4_getref+0x6f/frame 0xf5f2193c nfscl_getcl(c8ca7bb0,0,0,1,f5f219f0,...) at nfscl_getcl+0x3f6/frame 0xf5f219b8 nfscl_doclose(ca9ef9d8,f5f21a14,c9662300,ca9ef9d8,f5f21a48,...) at nfscl_doclose+0x36/frame 0xf5f21a00 nfsrpc_close(ca9ef9d8,1,c9662300,c9662300,1,...) at nfsrpc_close+0x31/frame 0xf5f21a18 ncl_inactive(f5f21aa0,c10e5bff,c109780f,9c7,c11f6178,...) at ncl_inactive+0xfe/frame 0xf5f21a48 VOP_INACTIVE_APV(c11ab130,f5f21aa0,c109780f,9c7,f5f21ac0,...) at VOP_INACTIVE_APV+0x124/frame 0xf5f21a78 vinactive(ca9ef9d8,c9662300,c109780f,8c5,ca9efa88,...) at vinactive+0x181/frame 0xf5f21ac0 vputx(ca9ef9d8,ffffffdf,ca9ef9d8,f5f21bd4,f5f21ba8,...) at vputx+0x38a/frame 0xf5f21b08 kern_unlinkat(c9662300,ffffff9c,bfbfd6f0,0,0) at kern_unlinkat+0x2af/frame 0xf5f21c24 sys_unlink(c9662300,f5f21cc8,c0eb32b0,c7200c90,0,...) at sys_unlink+0x32/frame 0xf5f21c40 syscall(f5f21d08) at syscall+0x2ed/frame 0xf5f21cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5f21cfc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28187427, esp = 0xbfbfd648, ebp = 0xbfbfd780 --- Tracing command lockf pid 41886 tid 100173 td 0xc9094600 sched_switch(c9094600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5e54508 mi_switch(104,0,c108cb51,1f5,101,...) at mi_switch+0x1c9/frame 0xf5e5453c sleepq_switch(c9094600,0,c108cb51,28e,c9094600,...) at sleepq_switch+0x1b9/frame 0xf5e54570 sleepq_timedwait(c8b12c00,0,20c49b,0,0,...) at sleepq_timedwait+0x48/frame 0xf5e54594 _sleep(c8b12c00,c786e300,0,c106f1d8,7fbe76c9,...) at _sleep+0x345/frame 0xf5e545f0 clnt_vc_call(c81c53a0,f5e547a0,1,cb90b700,f5e54868,...) at clnt_vc_call+0x67e/frame 0xf5e546c8 clnt_reconnect_call(c80fc8a0,f5e547a0,1,cb90b700,f5e54868,...) at clnt_reconnect_call+0x506/frame 0xf5e54730 newnfs_request(f5e54868,c8bea000,0,c8bea110,cb1965a0,c9094600,ca1a7680,186a3,4,0,1,0,0) at newnfs_request+0x71b/frame 0xf5e547f0 nfscl_request(f5e54868,cb1965a0,c9094600,ca1a7680,0,...) at nfscl_request+0x8c/frame 0xf5e54838 nfsrpc_getattr(cb1965a0,ca1a7680,c9094600,f5e54998,0,...) at nfsrpc_getattr+0xb1/frame 0xf5e54908 nfs_getattr(f5e54b18,c10e5679,80000,cdc549bc,0,...) at nfs_getattr+0x152/frame 0xf5e54a38 VOP_GETATTR_APV(c11ab130,f5e54b18,c9094600,1,f5e54c10,...) at VOP_GETATTR_APV+0x124/frame 0xf5e54a68 nfs_advlock(f5e54bb0,c10e5ecc,c107f9d1,270,ffffffff,...) at nfs_advlock+0x573/frame 0xf5e54b40 VOP_ADVLOCK_APV(c11ab130,f5e54bb0,c107f9d1,270,0,...) at VOP_ADVLOCK_APV+0x12a/frame 0xf5e54b70 kern_fcntl(c9094600,3,d,f5e54c10,c9094600,...) at kern_fcntl+0xbc6/frame 0xf5e54be0 sys_fcntl(c9094600,f5e54cc8,7b3,2,f5e54cc4,...) at sys_fcntl+0xdd/frame 0xf5e54c40 syscall(f5e54d08) at syscall+0x2ed/frame 0xf5e54cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5e54cfc --- syscall (92, FreeBSD ELF32, sys_fcntl), eip = 0x28187407, esp = 0xbfbfd6fc, ebp = 0xbfbfd740 --- Tracing command lockf pid 41885 tid 100247 td 0xca324c00 sched_switch(ca324c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5f61844 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf5f61878 sleepq_switch(ca324c00,0,c108cb51,26b,ca324c00,...) at sleepq_switch+0x1b9/frame 0xf5f618ac sleepq_wait(cae98824,63,c106f6fa,0,0,...) at sleepq_wait+0x48/frame 0xf5f618d0 _sleep(cae98824,c13fa698,63,c106f6fa,0,0,0,0,100) at _sleep+0x37c/frame 0xf5f6192c nfsmsleep(cae98824,c13fa698,63,c106f6fa,0,...) at nfsmsleep+0xaa/frame 0xf5f61964 nfsv4_getref(cae98820,0,c13fa698,c8ca7bb0,c9c34700,...) at nfsv4_getref+0x6f/frame 0xf5f6198c nfscl_getcl(c8ca7bb0,ca1a7680,ca324c00,1,f5f61a48,...) at nfscl_getcl+0x3f6/frame 0xf5f61a08 nfscl_checkwritelocked(c9c34708,f5f61b88,ca1a7680,ca324c00,ca30b000,...) at nfscl_checkwritelocked+0xc1/frame 0xf5f61a68 nfs_advlock(f5f61ba8,c10e5ecc,ca30b0a4,0,c10df06b,...) at nfs_advlock+0x186/frame 0xf5f61b40 VOP_ADVLOCK_APV(c11ab130,f5f61ba8,0,0,0,...) at VOP_ADVLOCK_APV+0x12a/frame 0xf5f61b70 closef(c7d773b8,ca324c00,46f,454,0,...) at closef+0xa6/frame 0xf5f61bd8 closefp(c7d773b8,ca324c00,1,b4,ca0ce800,...) at closefp+0xb5/frame 0xf5f61c04 kern_close(ca324c00,3) at kern_close+0xfb/frame 0xf5f61c30 sys_close(ca324c00,f5f61cc8,c0eb32b0,c71fdc90,0,...) at sys_close+0x1a/frame 0xf5f61c40 syscall(f5f61d08) at syscall+0x2ed/frame 0xf5f61cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5f61cfc --- syscall (6, FreeBSD ELF32, sys_close), eip = 0x2819bfa7, esp = 0xbfbfd760, ebp = 0xbfbfd780 --- Tracing command lockf pid 41884 tid 100439 td 0xc871e300 sched_switch(c871e300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf626a708 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf626a73c sleepq_switch(c871e300,0,c108cb51,26b,c871e300,...) at sleepq_switch+0x1b9/frame 0xf626a770 sleepq_wait(cae98824,63,c106f6fa,0,0,...) at sleepq_wait+0x48/frame 0xf626a794 _sleep(cae98824,c13fa698,63,c106f6fa,0,0,0,0,100) at _sleep+0x37c/frame 0xf626a7f0 nfsmsleep(cae98824,c13fa698,63,c106f6fa,0,...) at nfsmsleep+0xaa/frame 0xf626a828 nfsv4_getref(cae98820,0,c13fa698,c8ca7bb0,2,...) at nfsv4_getref+0x6f/frame 0xf626a850 nfscl_getcl(c8ca7bb0,ca1a7680,c871e300,1,f626a90c,...) at nfscl_getcl+0x3f6/frame 0xf626a8cc nfscl_getbytelock(cfae72d0,0,0,ffffffff,ffffffff,...) at nfscl_getbytelock+0x144/frame 0xf626a940 nfsrpc_advlock(cfae72d0,4,0,c,f626ac10,...) at nfsrpc_advlock+0x1b7/frame 0xf626aa68 nfs_advlock(f626abb0,c10e5ecc,c107f9d1,270,ffffffff,...) at nfs_advlock+0x216/frame 0xf626ab40 VOP_ADVLOCK_APV(c11ab130,f626abb0,c107f9d1,270,0,...) at VOP_ADVLOCK_APV+0x12a/frame 0xf626ab70 kern_fcntl(c871e300,3,d,f626ac10,c871e300,...) at kern_fcntl+0xbc6/frame 0xf626abe0 sys_fcntl(c871e300,f626acc8,14,c10893dd,7b3,...) at sys_fcntl+0xdd/frame 0xf626ac40 syscall(f626ad08) at syscall+0x2ed/frame 0xf626acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf626acfc --- syscall (92, FreeBSD ELF32, sys_fcntl), eip = 0x28187407, esp = 0xbfbfd6fc, ebp = 0xbfbfd73c --- Tracing command lockf pid 41881 tid 100604 td 0xcb819c00 sched_switch(cb819c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf6362860 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf6362894 sleepq_switch(cb819c00,0,c108cb51,26b,cb819c00,...) at sleepq_switch+0x1b9/frame 0xf63628c8 sleepq_wait(cf170c4c,5d,c10950ae,0,0,...) at sleepq_wait+0x48/frame 0xf63628ec _sleep(cf170c4c,cf170c00,5d,c10950ae,0,...) at _sleep+0x37c/frame 0xf6362948 bufobj_wwait(cf170c00,0,0,b18,0,...) at bufobj_wwait+0xc7/frame 0xf636298c ncl_flush(cf170b40,1,ca1a7680,cb819c00,1,...) at ncl_flush+0x516/frame 0xf6362a68 nfs_advlock(f6362bb0,c10e5ecc,4000,0,ffffffff,...) at nfs_advlock+0x1b2/frame 0xf6362b40 VOP_ADVLOCK_APV(c11ab130,f6362bb0,4000,0,0,...) at VOP_ADVLOCK_APV+0x12a/frame 0xf6362b70 kern_fcntl(cb819c00,3,c,f6362c10,cb819c00,...) at kern_fcntl+0xbc6/frame 0xf6362be0 sys_fcntl(cb819c00,f6362cc8,c123fd80,8,f6362c84,...) at sys_fcntl+0xdd/frame 0xf6362c40 syscall(f6362d08) at syscall+0x2ed/frame 0xf6362cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6362cfc --- syscall (92, FreeBSD ELF32, sys_fcntl), eip = 0x28187407, esp = 0xbfbfd6fc, ebp = 0xbfbfd73c --- Tracing command lockf pid 41877 tid 100351 td 0xcd487600 sched_switch(cd487600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf60d9708 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf60d973c sleepq_switch(cd487600,0,c108cb51,26b,cd487600,...) at sleepq_switch+0x1b9/frame 0xf60d9770 sleepq_wait(cae98824,63,c106f6fa,0,0,...) at sleepq_wait+0x48/frame 0xf60d9794 _sleep(cae98824,c13fa698,63,c106f6fa,0,0,0,0,100) at _sleep+0x37c/frame 0xf60d97f0 nfsmsleep(cae98824,c13fa698,63,c106f6fa,0,...) at nfsmsleep+0xaa/frame 0xf60d9828 nfsv4_getref(cae98820,0,c13fa698,c8ca7bb0,1,...) at nfsv4_getref+0x6f/frame 0xf60d9850 nfscl_getcl(c8ca7bb0,ca1a7680,cd487600,1,f60d990c,...) at nfscl_getcl+0x3f6/frame 0xf60d98cc nfscl_getbytelock(ce841708,0,0,ffffffff,ffffffff,...) at nfscl_getbytelock+0x144/frame 0xf60d9940 nfsrpc_advlock(ce841708,4,0,c,f60d9c10,...) at nfsrpc_advlock+0x1b7/frame 0xf60d9a68 nfs_advlock(f60d9bb0,c10e5ecc,c107f9d1,270,ffffffff,...) at nfs_advlock+0x216/frame 0xf60d9b40 VOP_ADVLOCK_APV(c11ab130,f60d9bb0,c107f9d1,270,0,...) at VOP_ADVLOCK_APV+0x12a/frame 0xf60d9b70 kern_fcntl(cd487600,3,d,f60d9c10,cd487600,...) at kern_fcntl+0xbc6/frame 0xf60d9be0 sys_fcntl(cd487600,f60d9cc8,7b3,2,f60d9cc4,...) at sys_fcntl+0xdd/frame 0xf60d9c40 syscall(f60d9d08) at syscall+0x2ed/frame 0xf60d9cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf60d9cfc --- syscall (92, FreeBSD ELF32, sys_fcntl), eip = 0x28187407, esp = 0xbfbfd6fc, ebp = 0xbfbfd740 --- Tracing command lockf pid 41872 tid 100271 td 0xca34cc00 sched_switch(ca34cc00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5fb5708 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf5fb573c sleepq_switch(ca34cc00,0,c108cb51,26b,ca34cc00,...) at sleepq_switch+0x1b9/frame 0xf5fb5770 sleepq_wait(cae98824,63,c106f6fa,0,0,...) at sleepq_wait+0x48/frame 0xf5fb5794 _sleep(cae98824,c13fa698,63,c106f6fa,0,0,0,0,100) at _sleep+0x37c/frame 0xf5fb57f0 nfsmsleep(cae98824,c13fa698,63,c106f6fa,0,...) at nfsmsleep+0xaa/frame 0xf5fb5828 nfsv4_getref(cae98820,0,c13fa698,c8ca7bb0,2,...) at nfsv4_getref+0x6f/frame 0xf5fb5850 nfscl_getcl(c8ca7bb0,ca1a7680,ca34cc00,1,f5fb590c,...) at nfscl_getcl+0x3f6/frame 0xf5fb58cc nfscl_getbytelock(cba38708,0,0,ffffffff,ffffffff,...) at nfscl_getbytelock+0x144/frame 0xf5fb5940 nfsrpc_advlock(cba38708,4,0,c,f5fb5c10,...) at nfsrpc_advlock+0x1b7/frame 0xf5fb5a68 nfs_advlock(f5fb5bb0,c10e5ecc,c107f9d1,270,ffffffff,...) at nfs_advlock+0x216/frame 0xf5fb5b40 VOP_ADVLOCK_APV(c11ab130,f5fb5bb0,c107f9d1,270,0,...) at VOP_ADVLOCK_APV+0x12a/frame 0xf5fb5b70 kern_fcntl(ca34cc00,3,d,f5fb5c10,ca34cc00,...) at kern_fcntl+0xbc6/frame 0xf5fb5be0 sys_fcntl(ca34cc00,f5fb5cc8,14,c10893dd,7b3,...) at sys_fcntl+0xdd/frame 0xf5fb5c40 syscall(f5fb5d08) at syscall+0x2ed/frame 0xf5fb5cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5fb5cfc --- syscall (92, FreeBSD ELF32, sys_fcntl), eip = 0x28187407, esp = 0xbfbfd6fc, ebp = 0xbfbfd740 --- Tracing command nfscl pid 41158 tid 100865 td 0xc8b21600 sched_switch(c8b21600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf66c5808 mi_switch(104,0,c108cb51,1f5,101,...) at mi_switch+0x1c9/frame 0xf66c583c sleepq_switch(c8b21600,0,c108cb51,28e,c8b21600,...) at sleepq_switch+0x1b9/frame 0xf66c5870 sleepq_timedwait(cd999800,0,20c49b,0,0,...) at sleepq_timedwait+0x48/frame 0xf66c5894 _sleep(cd999800,c786e300,0,c106f1d8,7fbe76c9,...) at _sleep+0x345/frame 0xf66c58f0 clnt_vc_call(c81c53a0,f66c5aa0,1,c8bc1600,f66c5b30,...) at clnt_vc_call+0x67e/frame 0xf66c59c8 clnt_reconnect_call(c80fc8a0,f66c5aa0,1,c8bc1600,f66c5b30,...) at clnt_reconnect_call+0x506/frame 0xf66c5a30 newnfs_request(f66c5b30,c8bea000,0,c8bea110,0,...) at newnfs_request+0x71b/frame 0xf66c5af0 nfsrpc_renew(cae98000,c923dc00,cc671180,c8b21600,fffffed8,...) at nfsrpc_renew+0x10b/frame 0xf66c5bd0 nfscl_renewthread(cae98000,c8b21600,f66c5cf4,c0a5692f,cae98000,...) at nfscl_renewthread+0xbd5/frame 0xf66c5cbc start_nfscl(cae98000,f66c5d08,c1080960,3d7,0,...) at start_nfscl+0x1e/frame 0xf66c5ccc fork_exit(c09b4620,cae98000,f66c5d08) at fork_exit+0x7f/frame 0xf66c5cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf66c5cf4 --- trap 0, eip = 0, esp = 0xf66c5d40, ebp = 0 --- Tracing command md5 pid 41003 tid 100812 td 0xc9744c00 sched_switch(c9744c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf678bba0 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf678bbd4 sleepq_switch(c9744c00,0,c108cb51,26b,c9744c00,...) at sleepq_switch+0x1b9/frame 0xf678bc08 sleepq_wait(c7711800,5c,c102105e,0,0,...) at sleepq_wait+0x48/frame 0xf678bc2c _sleep(c7711800,c7711820,25c,c102105e,0,...) at _sleep+0x37c/frame 0xf678bc88 md_kthread(c7711800,f678bd08,c1080960,3d7,0,...) at md_kthread+0x118/frame 0xf678bccc fork_exit(c07674d0,c7711800,f678bd08) at fork_exit+0x7f/frame 0xf678bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf678bcf4 --- trap 0, eip = 0, esp = 0xf678bd40, ebp = 0 --- Tracing command bash pid 33620 tid 100827 td 0xc934a600 sched_switch(c934a600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf668398c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf66839c0 sleepq_switch(c934a600,0,c108cb51,1ab,f6683a38,...) at sleepq_switch+0x1b9/frame 0xf66839f4 sleepq_catch_signals(0,c108cb51,162,1488,c934a600,...) at sleepq_catch_signals+0x361/frame 0xf6683a3c sleepq_wait_sig(c95d7ba0,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf6683a60 _sleep(c95d7ba0,c95d7c34,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf6683abc kern_wait6(c934a600,7,0,0,f6683b4c,...) at kern_wait6+0x45c/frame 0xf6683b20 sys_wait4(c934a600,f6683cc8,c0eb32b0,c7200c90,0,...) at sys_wait4+0x94/frame 0xf6683c40 syscall(f6683d08) at syscall+0x2ed/frame 0xf6683cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6683cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282b04b3, esp = 0xbfbfd9b0, ebp = 0xbfbfd9c8 --- Tracing command sshd pid 33619 tid 101034 td 0xc8b79900 sched_switch(c8b79900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf67c490c mi_switch(104,0,c108cb51,1f5,200046,...) at mi_switch+0x1c9/frame 0xf67c4940 sleepq_switch(c8b79900,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf67c4974 sleepq_catch_signals(f67c49e0,c0a73729,c9c5ac20,0,0,...) at sleepq_catch_signals+0x361/frame 0xf67c49bc sleepq_wait_sig(c9c5ac24,0,f67c4a10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf67c49e0 _cv_wait_sig(c9c5ac24,c9c5ac10,c108f895,68e,1b2,...) at _cv_wait_sig+0x200/frame 0xf67c4a24 seltdwait(ffffffff,0,0,c8b79900,0,...) at seltdwait+0x90/frame 0xf67c4a58 kern_select(c8b79900,c,28c0c1c8,28c0c1d0,0,...) at kern_select+0x88c/frame 0xf67c4bf8 sys_select(c8b79900,f67c4cc8,c0eb32b0,c71fdc90,0,...) at sys_select+0x69/frame 0xf67c4c40 syscall(f67c4d08) at syscall+0x2ed/frame 0xf67c4cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf67c4cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2852ef87, esp = 0xbfbfd374, ebp = 0xbfbfd3c0 --- Tracing command sshd pid 33578 tid 100938 td 0xc9f2ac00 sched_switch(c9f2ac00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf6a19984 mi_switch(104,0,c108cb51,1f5,200046,...) at mi_switch+0x1c9/frame 0xf6a199b8 sleepq_switch(c9f2ac00,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf6a199ec sleepq_catch_signals(f6a19a58,c0a73729,cb97c420,0,0,...) at sleepq_catch_signals+0x361/frame 0xf6a19a34 sleepq_wait_sig(cb97c424,0,f6a19a88,101,0,...) at sleepq_wait_sig+0x14/frame 0xf6a19a58 _cv_wait_sig(cb97c424,cb97c410,c108f895,68e,5c3,...) at _cv_wait_sig+0x200/frame 0xf6a19a9c seltdwait(ffffffff,0,0,c9f2ac00,c11bc03c,...) at seltdwait+0x90/frame 0xf6a19ad0 sys_poll(c9f2ac00,f6a19cc8,c0eb32b0,c71fac90,0,...) at sys_poll+0x44c/frame 0xf6a19c40 syscall(f6a19d08) at syscall+0x2ed/frame 0xf6a19cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf6a19cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284c52df, esp = 0xbfbfd3bc, ebp = 0xbfbfd408 --- Tracing command newnfs 2 pid 33357 tid 100411 td 0xcc7e4600 sched_switch(cc7e4600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf6216740 mi_switch(104,0,c108cb51,1f5,101,...) at mi_switch+0x1c9/frame 0xf6216774 sleepq_switch(cc7e4600,0,c108cb51,28e,cc7e4600,...) at sleepq_switch+0x1b9/frame 0xf62167a8 sleepq_timedwait(cc9c0000,0,20c49b,0,0,...) at sleepq_timedwait+0x48/frame 0xf62167cc _sleep(cc9c0000,c786e300,0,c106f1d8,7fbe76c9,...) at _sleep+0x345/frame 0xf6216828 clnt_vc_call(c81c53a0,f62169d8,1,cbaeec00,f6216aa8,...) at clnt_vc_call+0x67e/frame 0xf6216900 clnt_reconnect_call(c80fc8a0,f62169d8,1,cbaeec00,f6216aa8,...) at clnt_reconnect_call+0x506/frame 0xf6216968 newnfs_request(f6216aa8,c8bea000,0,c8bea110,cf170b40,0,ca1a7680,186a3,4,0,1,0,0) at newnfs_request+0x71b/frame 0xf6216a28 nfscl_request(f6216aa8,cf170b40,0,ca1a7680,0,...) at nfscl_request+0x8c/frame 0xf6216a70 nfsrpc_commit(cf170b40,0,0,4,ca1a7680,...) at nfsrpc_commit+0xfd/frame 0xf6216b48 ncl_commit(cf170b40,0,0,4,ca1a7680,...) at ncl_commit+0xbc/frame 0xf6216c18 ncl_doio(cf170b40,e385afe0,ca1a7680,0,0,...) at ncl_doio+0x1c6/frame 0xf6216c90 nfssvc_iod(c122afb8,f6216d08,c1080960,3d7,0,...) at nfssvc_iod+0x286/frame 0xf6216ccc fork_exit(c09b98e0,c122afb8,f6216d08) at fork_exit+0x7f/frame 0xf6216cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf6216cf4 --- trap 0, eip = 0, esp = 0xf6216d40, ebp = 0 --- Tracing command newnfs 1 pid 33353 tid 100335 td 0xc893b300 sched_switch(c893b300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf60a9560 mi_switch(104,0,c108cb51,1f5,101,...) at mi_switch+0x1c9/frame 0xf60a9594 sleepq_switch(c893b300,0,c108cb51,28e,c893b300,...) at sleepq_switch+0x1b9/frame 0xf60a95c8 sleepq_timedwait(cafb4200,0,20c49b,0,0,...) at sleepq_timedwait+0x48/frame 0xf60a95ec _sleep(cafb4200,c786e300,0,c106f1d8,7fbe76c9,...) at _sleep+0x345/frame 0xf60a9648 clnt_vc_call(c81c53a0,f60a97f8,1,ccd74d00,f60a98b8,...) at clnt_vc_call+0x67e/frame 0xf60a9720 clnt_reconnect_call(c80fc8a0,f60a97f8,1,ccd74d00,f60a98b8,...) at clnt_reconnect_call+0x506/frame 0xf60a9788 newnfs_request(f60a98b8,c8bea000,0,c8bea110,0,...) at newnfs_request+0x71b/frame 0xf60a9848 nfsrpc_setclient(c8bea000,cae98000,0,cb2aa200,0,...) at nfsrpc_setclient+0x583/frame 0xf60a99bc nfscl_hasexpired(cae98000,2,0,c9de5a00,0,...) at nfscl_hasexpired+0x11f/frame 0xf60a9a38 nfsrpc_read(cfe00ca8,f60a9c50,ca1a7680,0,f60a9b78,...) at nfsrpc_read+0x22f/frame 0xf60a9b50 ncl_readrpc(cfe00ca8,f60a9c50,ca1a7680,f60a9c58,c0a744ab,...) at ncl_readrpc+0xd0/frame 0xf60a9c18 ncl_doio(cfe00ca8,e3889a5c,ca1a7680,0,0,...) at ncl_doio+0x270/frame 0xf60a9c90 nfssvc_iod(c122afb4,f60a9d08,c1080960,3d7,0,...) at nfssvc_iod+0x286/frame 0xf60a9ccc fork_exit(c09b98e0,c122afb4,f60a9d08) at fork_exit+0x7f/frame 0xf60a9cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf60a9cf4 --- trap 0, eip = 0, esp = 0xf60a9d40, ebp = 0 --- Tracing command awk pid 1319 tid 100134 td 0xc8a09c00 sched_switch(c8a09c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d94a1c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5d94a50 sleepq_switch(c8a09c00,0,c108cb51,1ab,f5d94ac8,...) at sleepq_switch+0x1b9/frame 0xf5d94a84 sleepq_catch_signals(0,c108cb51,162,16c8,c8a09c00,...) at sleepq_catch_signals+0x361/frame 0xf5d94acc sleepq_wait_sig(c905db28,5c,c108fada,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5d94af0 _sleep(c905db28,c905dca8,15c,c108fada,0,...) at _sleep+0x35b/frame 0xf5d94b4c pipe_read(c9072498,f5d94c10,c7d0c680,0,c8a09c00,...) at pipe_read+0x2dc/frame 0xf5d94b90 dofileread(c9072498,f5d94c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5d94bc4 kern_readv(c8a09c00,0,f5d94c10,0,28855000,...) at kern_readv+0x66/frame 0xf5d94bf0 sys_read(c8a09c00,f5d94cc8,c0eb32b0,c7200c90,0,...) at sys_read+0x5c/frame 0xf5d94c40 syscall(f5d94d08) at syscall+0x2ed/frame 0xf5d94cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d94cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281c1fc7, esp = 0xbfbfd9e0, ebp = 0xbfbfd9f4 --- Tracing command sh pid 1318 tid 100083 td 0xc7d6b000 sched_switch(c7d6b000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5c8a98c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5c8a9c0 sleepq_switch(c7d6b000,0,c108cb51,1ab,f5c8aa38,...) at sleepq_switch+0x1b9/frame 0xf5c8a9f4 sleepq_catch_signals(0,c108cb51,162,780,c7d6b000,...) at sleepq_catch_signals+0x361/frame 0xf5c8aa3c sleepq_wait_sig(c7d65000,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5c8aa60 _sleep(c7d65000,c7d65094,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf5c8aabc kern_wait6(c7d6b000,7,0,0,f5c8ab4c,...) at kern_wait6+0x45c/frame 0xf5c8ab20 sys_wait4(c7d6b000,f5c8acc8,c10dec7f,e9,0,...) at sys_wait4+0x94/frame 0xf5c8ac40 syscall(f5c8ad08) at syscall+0x2ed/frame 0xf5c8acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c8acfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281524b3, esp = 0xbfbfd938, ebp = 0xbfbfd950 --- Tracing command sh pid 1317 tid 100125 td 0xc7dbc900 Tracing command sshd pid 1316 tid 100155 td 0xc7e03c00 sched_switch(c7e03c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5dfc90c mi_switch(104,0,c108cb51,1f5,200046,...) at mi_switch+0x1c9/frame 0xf5dfc940 sleepq_switch(c7e03c00,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5dfc974 sleepq_catch_signals(f5dfc9e0,c0a73729,c7c8f720,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5dfc9bc sleepq_wait_sig(c7c8f724,0,f5dfca10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5dfc9e0 _cv_wait_sig(c7c8f724,c7c8f710,c108f895,68e,5be,...) at _cv_wait_sig+0x200/frame 0xf5dfca24 seltdwait(ffffffff,0,0,c7e03c00,0,...) at seltdwait+0x90/frame 0xf5dfca58 kern_select(c7e03c00,c,28c0c1c8,28c0c1d0,0,...) at kern_select+0x88c/frame 0xf5dfcbf8 sys_select(c7e03c00,f5dfccc8,c0eb32b0,c71fac90,0,...) at sys_select+0x69/frame 0xf5dfcc40 syscall(f5dfcd08) at syscall+0x2ed/frame 0xf5dfccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5dfccfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2852ef87, esp = 0xbfbfd374, ebp = 0xbfbfd3c0 --- Tracing command top pid 1315 tid 100156 td 0xc7e03900 sched_switch(c7e03900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5dff900 mi_switch(104,0,c108cb51,1f5,400,...) at mi_switch+0x1c9/frame 0xf5dff934 sleepq_switch(c7e03900,0,c108cb51,1ab,c7ce8950,...) at sleepq_switch+0x1b9/frame 0xf5dff968 sleepq_catch_signals(c11b9ca4,f5dff9d8,c0a73729,c7ce8960,0,...) at sleepq_catch_signals+0x361/frame 0xf5dff9b0 sleepq_timedwait_sig(c7ce8964,0,f5dffa10,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf5dff9d8 _cv_timedwait_sig_sbt(c7ce8964,c7ce8950,8a54392a,b494,10000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5dffa24 seltdwait(b494,10000000,0,c7e03900,0,...) at seltdwait+0xbc/frame 0xf5dffa58 kern_select(c7e03900,2,bfbfdbe8,0,0,...) at kern_select+0x88c/frame 0xf5dffbf8 sys_select(c7e03900,f5dffcc8,c0eb32b0,c71fac90,0,...) at sys_select+0x69/frame 0xf5dffc40 syscall(f5dffd08) at syscall+0x2ed/frame 0xf5dffcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5dffcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281f3f87, esp = 0xbfbfdb8c, ebp = 0xbfbfdcf4 --- Tracing command tail pid 1314 tid 100157 td 0xc7e03600 sched_switch(c7e03600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5e0293c mi_switch(104,0,c108cb51,1f5,c0acb130,...) at mi_switch+0x1c9/frame 0xf5e02970 sleepq_switch(c7e03600,0,c108cb51,1ab,8,...) at sleepq_switch+0x1b9/frame 0xf5e029a4 sleepq_catch_signals(c0acb130,c7e03600,3,201,3,...) at sleepq_catch_signals+0x361/frame 0xf5e029ec sleepq_timedwait_sig(c7d2cd00,68,b495,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf5e02a14 _sleep(c7d2cd00,c7d2cd00,168,c108046e,632b78f7,...) at _sleep+0x331/frame 0xf5e02a70 kern_kevent(c7e03600,4,0,1,f5e02c10,...) at kern_kevent+0x43a/frame 0xf5e02bb8 sys_kevent(c7e03600,f5e02cc8,7b3,2,f5e02cc4,...) at sys_kevent+0x12b/frame 0xf5e02c40 syscall(f5e02d08) at syscall+0x2ed/frame 0xf5e02cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5e02cfc --- syscall (363, FreeBSD ELF32, sys_kevent), eip = 0x2816828f, esp = 0xbfbfdb9c, ebp = 0xbfbfdc48 --- Tracing command sshd pid 1313 tid 100148 td 0xc8fad000 sched_switch(c8fad000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5dbe90c mi_switch(104,0,c108cb51,1f5,200046,...) at mi_switch+0x1c9/frame 0xf5dbe940 sleepq_switch(c8fad000,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5dbe974 sleepq_catch_signals(f5dbe9e0,c0a73729,c7c8f7e0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5dbe9bc sleepq_wait_sig(c7c8f7e4,0,f5dbea10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5dbe9e0 _cv_wait_sig(c7c8f7e4,c7c8f7d0,c108f895,68e,5be,...) at _cv_wait_sig+0x200/frame 0xf5dbea24 seltdwait(ffffffff,0,0,c8fad000,0,...) at seltdwait+0x90/frame 0xf5dbea58 kern_select(c8fad000,c,28c0c1c8,28c0c1d0,0,...) at kern_select+0x88c/frame 0xf5dbebf8 sys_select(c8fad000,f5dbecc8,c0eb32b0,c71fac90,0,...) at sys_select+0x69/frame 0xf5dbec40 syscall(f5dbed08) at syscall+0x2ed/frame 0xf5dbecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5dbecfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2852ef87, esp = 0xbfbfd374, ebp = 0xbfbfd3c0 --- Tracing command sshd pid 1312 tid 100080 td 0xc7d6b600 sched_switch(c7d6b600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5c7e90c mi_switch(104,0,c108cb51,1f5,200046,...) at mi_switch+0x1c9/frame 0xf5c7e940 sleepq_switch(c7d6b600,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5c7e974 sleepq_catch_signals(f5c7e9e0,c0a73729,c7e346a0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5c7e9bc sleepq_wait_sig(c7e346a4,0,f5c7ea10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5c7e9e0 _cv_wait_sig(c7e346a4,c7e34690,c108f895,68e,1b2,...) at _cv_wait_sig+0x200/frame 0xf5c7ea24 seltdwait(ffffffff,0,0,c7d6b600,0,...) at seltdwait+0x90/frame 0xf5c7ea58 kern_select(c7d6b600,a,28c0c1c8,28c0c1d0,0,...) at kern_select+0x88c/frame 0xf5c7ebf8 sys_select(c7d6b600,f5c7ecc8,c0eb32b0,c7200c90,0,...) at sys_select+0x69/frame 0xf5c7ec40 syscall(f5c7ed08) at syscall+0x2ed/frame 0xf5c7ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c7ecfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2852ef87, esp = 0xbfbfd374, ebp = 0xbfbfd3c0 --- Tracing command sshd pid 1310 tid 100142 td 0xc7e1c900 sched_switch(c7e1c900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5dac984 mi_switch(104,0,c108cb51,1f5,200046,...) at mi_switch+0x1c9/frame 0xf5dac9b8 sleepq_switch(c7e1c900,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5dac9ec sleepq_catch_signals(f5daca58,c0a73729,c7e342e0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5daca34 sleepq_wait_sig(c7e342e4,0,f5daca88,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5daca58 _cv_wait_sig(c7e342e4,c7e342d0,c108f895,68e,5c3,...) at _cv_wait_sig+0x200/frame 0xf5daca9c seltdwait(ffffffff,0,0,c7e1c900,0,...) at seltdwait+0x90/frame 0xf5dacad0 sys_poll(c7e1c900,f5daccc8,c0eb32b0,c1825c90,0,...) at sys_poll+0x44c/frame 0xf5dacc40 syscall(f5dacd08) at syscall+0x2ed/frame 0xf5daccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5daccfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284c52df, esp = 0xbfbfd3bc, ebp = 0xbfbfd408 --- Tracing command sshd pid 1307 tid 100121 td 0xc847d300 sched_switch(c847d300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d68984 mi_switch(104,0,c108cb51,1f5,200046,...) at mi_switch+0x1c9/frame 0xf5d689b8 sleepq_switch(c847d300,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5d689ec sleepq_catch_signals(f5d68a58,c0a73729,c7ce85a0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5d68a34 sleepq_wait_sig(c7ce85a4,0,f5d68a88,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5d68a58 _cv_wait_sig(c7ce85a4,c7ce8590,c108f895,68e,5c3,...) at _cv_wait_sig+0x200/frame 0xf5d68a9c seltdwait(ffffffff,0,0,c847d300,0,...) at seltdwait+0x90/frame 0xf5d68ad0 sys_poll(c847d300,f5d68cc8,c0eb32b0,c7200c90,0,...) at sys_poll+0x44c/frame 0xf5d68c40 syscall(f5d68d08) at syscall+0x2ed/frame 0xf5d68cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d68cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284c52df, esp = 0xbfbfd3bc, ebp = 0xbfbfd408 --- Tracing command sshd pid 1306 tid 100103 td 0xc7e1b600 sched_switch(c7e1b600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5cef984 mi_switch(104,0,c108cb51,1f5,200046,...) at mi_switch+0x1c9/frame 0xf5cef9b8 sleepq_switch(c7e1b600,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5cef9ec sleepq_catch_signals(f5cefa58,c0a73729,c7c0a660,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5cefa34 sleepq_wait_sig(c7c0a664,0,f5cefa88,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5cefa58 _cv_wait_sig(c7c0a664,c7c0a650,c108f895,68e,5c3,...) at _cv_wait_sig+0x200/frame 0xf5cefa9c seltdwait(ffffffff,0,0,c7e1b600,0,...) at seltdwait+0x90/frame 0xf5cefad0 sys_poll(c7e1b600,f5cefcc8,c0eb32b0,c71fdc90,0,...) at sys_poll+0x44c/frame 0xf5cefc40 syscall(f5cefd08) at syscall+0x2ed/frame 0xf5cefcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cefcfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284c52df, esp = 0xbfbfd3bc, ebp = 0xbfbfd408 --- Tracing command getty pid 862 tid 100082 td 0xc7e07000 sched_switch(c7e07000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5c869bc mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5c869f0 sleepq_switch(c7e07000,0,c108cb51,1ab,f5c86a68,...) at sleepq_switch+0x1b9/frame 0xf5c86a24 sleepq_catch_signals(0,c108cb51,162,ed0,1,...) at sleepq_catch_signals+0x361/frame 0xf5c86a6c sleepq_wait_sig(c778ee70,0,c10918c5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5c86a90 _cv_wait_sig(c778ee70,c13fb414,c10918b1,531,f5c86c10,...) at _cv_wait_sig+0x200/frame 0xf5c86ad4 tty_wait(c778ee00,c778ee70,f5c86c10,1,0,...) at tty_wait+0x4b/frame 0xf5c86af8 ttydisc_read(c778ee00,f5c86c10,0,a1,f5c86c10,...) at ttydisc_read+0x377/frame 0xf5c86b3c ttydev_read(c7935100,f5c86c10,0,1,0,...) at ttydev_read+0x81/frame 0xf5c86b5c devfs_read_f(c7dd4b60,f5c86c10,c76aae80,0,c7e07000,...) at devfs_read_f+0x87/frame 0xf5c86b90 dofileread(c7dd4b60,f5c86c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5c86bc4 kern_readv(c7e07000,0,f5c86c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5c86bf0 sys_read(c7e07000,f5c86cc8,c10dec7f,d6,0,...) at sys_read+0x5c/frame 0xf5c86c40 syscall(f5c86d08) at syscall+0x2ed/frame 0xf5c86cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c86cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cfc7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 861 tid 100139 td 0xc847c300 sched_switch(c847c300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5da39bc mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5da39f0 sleepq_switch(c847c300,0,c108cb51,1ab,f5da3a68,...) at sleepq_switch+0x1b9/frame 0xf5da3a24 sleepq_catch_signals(0,c108cb51,162,180,1,...) at sleepq_catch_signals+0x361/frame 0xf5da3a6c sleepq_wait_sig(c7936070,0,c10918c5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5da3a90 _cv_wait_sig(c7936070,c13fb414,c10918b1,531,f5da3c10,...) at _cv_wait_sig+0x200/frame 0xf5da3ad4 tty_wait(c7936000,c7936070,f5da3c10,1,0,...) at tty_wait+0x4b/frame 0xf5da3af8 ttydisc_read(c7936000,f5da3c10,0,a1,f5da3c10,...) at ttydisc_read+0x377/frame 0xf5da3b3c ttydev_read(c7935200,f5da3c10,0,1,0,...) at ttydev_read+0x81/frame 0xf5da3b5c devfs_read_f(c7d768f8,f5da3c10,c76aae80,0,c847c300,...) at devfs_read_f+0x87/frame 0xf5da3b90 dofileread(c7d768f8,f5da3c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5da3bc4 kern_readv(c847c300,0,f5da3c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5da3bf0 sys_read(c847c300,f5da3cc8,c0eb32b0,c1825c90,0,...) at sys_read+0x5c/frame 0xf5da3c40 syscall(f5da3d08) at syscall+0x2ed/frame 0xf5da3cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5da3cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cfc7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 860 tid 100075 td 0xc7d6bc00 sched_switch(c7d6bc00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5c6a9bc mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5c6a9f0 sleepq_switch(c7d6bc00,0,c108cb51,1ab,f5c6aa68,...) at sleepq_switch+0x1b9/frame 0xf5c6aa24 sleepq_catch_signals(0,c108cb51,162,1b0,1,...) at sleepq_catch_signals+0x361/frame 0xf5c6aa6c sleepq_wait_sig(c7936270,0,c10918c5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5c6aa90 _cv_wait_sig(c7936270,c13fb414,c10918b1,531,f5c6ac10,...) at _cv_wait_sig+0x200/frame 0xf5c6aad4 tty_wait(c7936200,c7936270,f5c6ac10,1,0,...) at tty_wait+0x4b/frame 0xf5c6aaf8 ttydisc_read(c7936200,f5c6ac10,0,a1,f5c6ac10,...) at ttydisc_read+0x377/frame 0xf5c6ab3c ttydev_read(c7935300,f5c6ac10,0,1,0,...) at ttydev_read+0x81/frame 0xf5c6ab5c devfs_read_f(c7d768c0,f5c6ac10,c76aae80,0,c7d6bc00,...) at devfs_read_f+0x87/frame 0xf5c6ab90 dofileread(c7d768c0,f5c6ac10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5c6abc4 kern_readv(c7d6bc00,0,f5c6ac10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5c6abf0 sys_read(c7d6bc00,f5c6acc8,c0eb32b0,c7200c90,0,...) at sys_read+0x5c/frame 0xf5c6ac40 syscall(f5c6ad08) at syscall+0x2ed/frame 0xf5c6acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c6acfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cfc7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 859 tid 100122 td 0xc847d000 sched_switch(c847d000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d6b9bc mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5d6b9f0 sleepq_switch(c847d000,0,c108cb51,1ab,f5d6ba68,...) at sleepq_switch+0x1b9/frame 0xf5d6ba24 sleepq_catch_signals(0,c108cb51,162,1e0,1,...) at sleepq_catch_signals+0x361/frame 0xf5d6ba6c sleepq_wait_sig(c7936470,0,c10918c5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5d6ba90 _cv_wait_sig(c7936470,c13fb414,c10918b1,531,f5d6bc10,...) at _cv_wait_sig+0x200/frame 0xf5d6bad4 tty_wait(c7936400,c7936470,f5d6bc10,1,0,...) at tty_wait+0x4b/frame 0xf5d6baf8 ttydisc_read(c7936400,f5d6bc10,0,a1,f5d6bc10,...) at ttydisc_read+0x377/frame 0xf5d6bb3c ttydev_read(c7935400,f5d6bc10,0,1,0,...) at ttydev_read+0x81/frame 0xf5d6bb5c devfs_read_f(c7d766c8,f5d6bc10,c76aae80,0,c847d000,...) at devfs_read_f+0x87/frame 0xf5d6bb90 dofileread(c7d766c8,f5d6bc10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5d6bbc4 kern_readv(c847d000,0,f5d6bc10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5d6bbf0 sys_read(c847d000,f5d6bcc8,c0eb32b0,c71fdc90,0,...) at sys_read+0x5c/frame 0xf5d6bc40 syscall(f5d6bd08) at syscall+0x2ed/frame 0xf5d6bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d6bcfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cfc7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 858 tid 100131 td 0xc8a0a600 sched_switch(c8a0a600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d8b9bc mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5d8b9f0 sleepq_switch(c8a0a600,0,c108cb51,1ab,f5d8ba68,...) at sleepq_switch+0x1b9/frame 0xf5d8ba24 sleepq_catch_signals(0,c108cb51,162,ff0,1,...) at sleepq_catch_signals+0x361/frame 0xf5d8ba6c sleepq_wait_sig(c778da70,0,c10918c5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5d8ba90 _cv_wait_sig(c778da70,c13fb414,c10918b1,531,f5d8bc10,...) at _cv_wait_sig+0x200/frame 0xf5d8bad4 tty_wait(c778da00,c778da70,f5d8bc10,1,0,...) at tty_wait+0x4b/frame 0xf5d8baf8 ttydisc_read(c778da00,f5d8bc10,0,a1,f5d8bc10,...) at ttydisc_read+0x377/frame 0xf5d8bb3c ttydev_read(c7935500,f5d8bc10,0,1,0,...) at ttydev_read+0x81/frame 0xf5d8bb5c devfs_read_f(c7dd4188,f5d8bc10,c76aae80,0,c8a0a600,...) at devfs_read_f+0x87/frame 0xf5d8bb90 dofileread(c7dd4188,f5d8bc10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5d8bbc4 kern_readv(c8a0a600,0,f5d8bc10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5d8bbf0 sys_read(c8a0a600,f5d8bcc8,c0eb32b0,c71fdc90,0,...) at sys_read+0x5c/frame 0xf5d8bc40 syscall(f5d8bd08) at syscall+0x2ed/frame 0xf5d8bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d8bcfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cfc7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 857 tid 100088 td 0xc7d68600 sched_switch(c7d68600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5c9e9bc mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5c9e9f0 sleepq_switch(c7d68600,0,c108cb51,1ab,f5c9ea68,...) at sleepq_switch+0x1b9/frame 0xf5c9ea24 sleepq_catch_signals(0,c108cb51,162,fc0,1,...) at sleepq_catch_signals+0x361/frame 0xf5c9ea6c sleepq_wait_sig(c778d870,0,c10918c5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5c9ea90 _cv_wait_sig(c778d870,c13fb414,c10918b1,531,f5c9ec10,...) at _cv_wait_sig+0x200/frame 0xf5c9ead4 tty_wait(c778d800,c778d870,f5c9ec10,1,0,...) at tty_wait+0x4b/frame 0xf5c9eaf8 ttydisc_read(c778d800,f5c9ec10,0,a1,f5c9ec10,...) at ttydisc_read+0x377/frame 0xf5c9eb3c ttydev_read(c7935600,f5c9ec10,0,1,0,...) at ttydev_read+0x81/frame 0xf5c9eb5c devfs_read_f(c7d77af0,f5c9ec10,c76aae80,0,c7d68600,...) at devfs_read_f+0x87/frame 0xf5c9eb90 dofileread(c7d77af0,f5c9ec10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5c9ebc4 kern_readv(c7d68600,0,f5c9ec10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5c9ebf0 sys_read(c7d68600,f5c9ecc8,c0eb32b0,c71fac90,0,...) at sys_read+0x5c/frame 0xf5c9ec40 syscall(f5c9ed08) at syscall+0x2ed/frame 0xf5c9ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c9ecfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cfc7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 856 tid 100128 td 0xc7dbc000 sched_switch(c7dbc000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d7d9bc mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5d7d9f0 sleepq_switch(c7dbc000,0,c108cb51,1ab,f5d7da68,...) at sleepq_switch+0x1b9/frame 0xf5d7da24 sleepq_catch_signals(0,c108cb51,162,f00,1,...) at sleepq_catch_signals+0x361/frame 0xf5d7da6c sleepq_wait_sig(c778d070,0,c10918c5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5d7da90 _cv_wait_sig(c778d070,c13fb414,c10918b1,531,f5d7dc10,...) at _cv_wait_sig+0x200/frame 0xf5d7dad4 tty_wait(c778d000,c778d070,f5d7dc10,1,0,...) at tty_wait+0x4b/frame 0xf5d7daf8 ttydisc_read(c778d000,f5d7dc10,0,a1,f5d7dc10,...) at ttydisc_read+0x377/frame 0xf5d7db3c ttydev_read(c7935700,f5d7dc10,0,1,0,...) at ttydev_read+0x81/frame 0xf5d7db5c devfs_read_f(c7daae00,f5d7dc10,c76aae80,0,c7dbc000,...) at devfs_read_f+0x87/frame 0xf5d7db90 dofileread(c7daae00,f5d7dc10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5d7dbc4 kern_readv(c7dbc000,0,f5d7dc10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5d7dbf0 sys_read(c7dbc000,f5d7dcc8,14,c10893dd,7b3,...) at sys_read+0x5c/frame 0xf5d7dc40 syscall(f5d7dd08) at syscall+0x2ed/frame 0xf5d7dcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d7dcfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cfc7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 855 tid 100101 td 0xc7e1bc00 sched_switch(c7e1bc00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5ce89bc mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5ce89f0 sleepq_switch(c7e1bc00,0,c108cb51,1ab,f5ce8a68,...) at sleepq_switch+0x1b9/frame 0xf5ce8a24 sleepq_catch_signals(0,c108cb51,162,f30,1,...) at sleepq_catch_signals+0x361/frame 0xf5ce8a6c sleepq_wait_sig(c778d270,0,c10918c5,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5ce8a90 _cv_wait_sig(c778d270,c13fb414,c10918b1,531,f5ce8c10,...) at _cv_wait_sig+0x200/frame 0xf5ce8ad4 tty_wait(c778d200,c778d270,f5ce8c10,1,0,...) at tty_wait+0x4b/frame 0xf5ce8af8 ttydisc_read(c778d200,f5ce8c10,0,a1,f5ce8c10,...) at ttydisc_read+0x377/frame 0xf5ce8b3c ttydev_read(c78eb600,f5ce8c10,0,1,0,...) at ttydev_read+0x81/frame 0xf5ce8b5c devfs_read_f(c7dff310,f5ce8c10,c76aae80,0,c7e1bc00,...) at devfs_read_f+0x87/frame 0xf5ce8b90 dofileread(c7dff310,f5ce8c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5ce8bc4 kern_readv(c7e1bc00,0,f5ce8c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5ce8bf0 sys_read(c7e1bc00,f5ce8cc8,c10dec7f,d6,0,...) at sys_read+0x5c/frame 0xf5ce8c40 syscall(f5ce8d08) at syscall+0x2ed/frame 0xf5ce8cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5ce8cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cfc7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 854 tid 100081 td 0xc7d6b300 sched_switch(c7d6b300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5c829bc mi_switch(104,0,c108cb51,1f5,46,...) at mi_switch+0x1c9/frame 0xf5c829f0 sleepq_switch(c7d6b300,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5c82a24 sleepq_catch_signals(f5c82a90,c0a73729,c778d414,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5c82a6c sleepq_wait_sig(c778d470,0,f5c82ac0,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5c82a90 _cv_wait_sig(c778d470,c778d404,c10918b1,531,f5c82c10,...) at _cv_wait_sig+0x200/frame 0xf5c82ad4 tty_wait(c778d400,c778d470,f5c82c10,1,0,...) at tty_wait+0x4b/frame 0xf5c82af8 ttydisc_read(c778d400,f5c82c10,0,a1,f5c82c10,...) at ttydisc_read+0x377/frame 0xf5c82b3c ttydev_read(c76b7c00,f5c82c10,0,1,0,...) at ttydev_read+0x81/frame 0xf5c82b5c devfs_read_f(c7d761c0,f5c82c10,c76aae80,0,c7d6b300,...) at devfs_read_f+0x87/frame 0xf5c82b90 dofileread(c7d761c0,f5c82c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5c82bc4 kern_readv(c7d6b300,0,f5c82c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf5c82bf0 sys_read(c7d6b300,f5c82cc8,c0eb32b0,c71fac90,0,...) at sys_read+0x5c/frame 0xf5c82c40 syscall(f5c82d08) at syscall+0x2ed/frame 0xf5c82cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c82cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819cfc7, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command inetd pid 837 tid 100146 td 0xc8fad600 sched_switch(c8fad600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5db890c mi_switch(104,0,c108cb51,1f5,46,...) at mi_switch+0x1c9/frame 0xf5db8940 sleepq_switch(c8fad600,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5db8974 sleepq_catch_signals(f5db89e0,c0a73729,c7c0bce0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5db89bc sleepq_wait_sig(c7c0bce4,0,f5db8a10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5db89e0 _cv_wait_sig(c7c0bce4,c7c0bcd0,c108f895,68e,c0ae2a0d,...) at _cv_wait_sig+0x200/frame 0xf5db8a24 seltdwait(ffffffff,0,0,c8fad600,0,...) at seltdwait+0x90/frame 0xf5db8a58 kern_select(c8fad600,8,bfbfd070,0,0,...) at kern_select+0x88c/frame 0xf5db8bf8 sys_select(c8fad600,f5db8cc8,c0eb32b0,c71fac90,0,...) at sys_select+0x69/frame 0xf5db8c40 syscall(f5db8d08) at syscall+0x2ed/frame 0xf5db8cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5db8cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281aef87, esp = 0xbfbfd014, ebp = 0xbfbfde34 --- Tracing command watchdogd pid 813 tid 100137 td 0xc847c900 sched_switch(c847c900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d9d98c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5d9d9c0 sleepq_switch(c847c900,0,c108cb51,1ab,f5d9da38,...) at sleepq_switch+0x1b9/frame 0xf5d9d9f4 sleepq_catch_signals(0,c108cb51,162,1788,c847c900,...) at sleepq_catch_signals+0x361/frame 0xf5d9da3c sleepq_wait_sig(c8f05ba0,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5d9da60 _sleep(c8f05ba0,c8f05c34,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xf5d9dabc kern_wait6(c847c900,0,a4b8,0,f5d9db4c,...) at kern_wait6+0x45c/frame 0xf5d9db20 sys_wait4(c847c900,f5d9dcc8,14,c10893dd,7b3,...) at sys_wait4+0x94/frame 0xf5d9dc40 syscall(f5d9dd08) at syscall+0x2ed/frame 0xf5d9dcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d9dcfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x280eb4b3, esp = 0xbfbfdc4c, ebp = 0xbfbfdce8 --- Tracing command bash pid 800 tid 100132 td 0xc8a0a300 sched_switch(c8a0a300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d8e9bc mi_switch(104,0,c108cb51,1f5,46,...) at mi_switch+0x1c9/frame 0xf5d8e9f0 sleepq_switch(c8a0a300,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5d8ea24 sleepq_catch_signals(f5d8ea90,c0a73729,c7937214,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5d8ea6c sleepq_wait_sig(c7937270,0,f5d8eac0,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5d8ea90 _cv_wait_sig(c7937270,c7937204,c10918b1,531,f5d8ec10,...) at _cv_wait_sig+0x200/frame 0xf5d8ead4 tty_wait(c7937200,c7937270,f5d8ec10,1,0,...) at tty_wait+0x4b/frame 0xf5d8eaf8 ttydisc_read(c7937200,f5d8ec10,0,a1,f5d8ec10,...) at ttydisc_read+0x377/frame 0xf5d8eb3c ttydev_read(c7c07a00,f5d8ec10,0,1,0,...) at ttydev_read+0x81/frame 0xf5d8eb5c devfs_read_f(c7dffe70,f5d8ec10,c7d0ca80,0,c8a0a300,...) at devfs_read_f+0x87/frame 0xf5d8eb90 dofileread(c7dffe70,f5d8ec10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf5d8ebc4 kern_readv(c8a0a300,0,f5d8ec10,0,bfbfcdff,...) at kern_readv+0x66/frame 0xf5d8ebf0 sys_read(c8a0a300,f5d8ecc8,c0eb32b0,c7200c90,0,...) at sys_read+0x5c/frame 0xf5d8ec40 syscall(f5d8ed08) at syscall+0x2ed/frame 0xf5d8ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d8ecfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2835ffc7, esp = 0xbfbfcddc, ebp = 0xbfbfce08 --- Tracing command csh pid 797 tid 100078 td 0xc7dc2c00 Tracing command su pid 796 tid 100127 td 0xc7dbc300 Tracing command bash pid 786 tid 100084 td 0xc7d68c00 Tracing command sshd pid 785 tid 100119 td 0xc847d900 sched_switch(c847d900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d6290c mi_switch(104,0,c108cb51,1f5,200046,...) at mi_switch+0x1c9/frame 0xf5d62940 sleepq_switch(c847d900,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5d62974 sleepq_catch_signals(f5d629e0,c0a73729,c7c8fda0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5d629bc sleepq_wait_sig(c7c8fda4,0,f5d62a10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5d629e0 _cv_wait_sig(c7c8fda4,c7c8fd90,c108f895,68e,1b2,...) at _cv_wait_sig+0x200/frame 0xf5d62a24 seltdwait(ffffffff,0,0,c847d900,0,...) at seltdwait+0x90/frame 0xf5d62a58 kern_select(c847d900,c,28c0c1c8,28c0c1d0,0,...) at kern_select+0x88c/frame 0xf5d62bf8 sys_select(c847d900,f5d62cc8,c0eb32b0,c7200c90,0,...) at sys_select+0x69/frame 0xf5d62c40 syscall(f5d62d08) at syscall+0x2ed/frame 0xf5d62cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d62cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2852ef87, esp = 0xbfbfd374, ebp = 0xbfbfd3c0 --- Tracing command sshd pid 783 tid 100129 td 0xc8a0ac00 sched_switch(c8a0ac00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d81984 mi_switch(104,0,c108cb51,1f5,200046,...) at mi_switch+0x1c9/frame 0xf5d819b8 sleepq_switch(c8a0ac00,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5d819ec sleepq_catch_signals(f5d81a58,c0a73729,c7ce85e0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5d81a34 sleepq_wait_sig(c7ce85e4,0,f5d81a88,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5d81a58 _cv_wait_sig(c7ce85e4,c7ce85d0,c108f895,68e,5c3,...) at _cv_wait_sig+0x200/frame 0xf5d81a9c seltdwait(ffffffff,0,0,c8a0ac00,c11bc03c,...) at seltdwait+0x90/frame 0xf5d81ad0 sys_poll(c8a0ac00,f5d81cc8,c0eb32b0,c71fac90,0,...) at sys_poll+0x44c/frame 0xf5d81c40 syscall(f5d81d08) at syscall+0x2ed/frame 0xf5d81cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d81cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284c52df, esp = 0xbfbfd3bc, ebp = 0xbfbfd408 --- Tracing command cron pid 734 tid 100117 td 0xc847e000 sched_switch(c847e000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d5ca64 mi_switch(104,0,c108cb51,1f5,c0acb130,...) at mi_switch+0x1c9/frame 0xf5d5ca98 sleepq_switch(c847e000,0,c108cb51,1ab,8,...) at sleepq_switch+0x1b9/frame 0xf5d5cacc sleepq_catch_signals(c0acb130,c847e000,0,201,0,...) at sleepq_catch_signals+0x361/frame 0xf5d5cb14 sleepq_timedwait_sig(c1233488,6c,b4b5,bf14a7dc,3,...) at sleepq_timedwait_sig+0x14/frame 0xf5d5cb3c _sleep(c1233488,0,16c,c10884ca,b2a88591,...) at _sleep+0x331/frame 0xf5d5cb98 kern_nanosleep(bfbfde28,f5d5cc18,f5d5cc20,0,3b,...) at kern_nanosleep+0x158/frame 0xf5d5cc00 sys_nanosleep(c847e000,f5d5ccc8,0,0,c847e000,...) at sys_nanosleep+0x6b/frame 0xf5d5cc40 syscall(f5d5cd08) at syscall+0x2ed/frame 0xf5d5ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d5ccfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28188173, esp = 0xbfbfdcb4, ebp = 0xbfbfde44 --- Tracing command sendmail pid 729 tid 100092 td 0xc7e1c300 sched_switch(c7e1c300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5cb1aa0 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xf5cb1ad4 sleepq_switch(c7e1c300,0,c108cb51,1ab,f5cb1b4c,...) at sleepq_switch+0x1b9/frame 0xf5cb1b08 sleepq_catch_signals(0,c108cb51,162,540,c7e1c300,...) at sleepq_catch_signals+0x361/frame 0xf5cb1b50 sleepq_wait_sig(c7e13c04,74,c0f05194,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5cb1b74 _sleep(c7e13c04,c7e13c34,174,c0f05194,0,...) at _sleep+0x35b/frame 0xf5cb1bd0 kern_sigsuspend(c7e1c300,0,0,0,0,...) at kern_sigsuspend+0xfb/frame 0xf5cb1c10 sys_sigsuspend(c7e1c300,f5cb1cc8,1,0,c7e1c300,...) at sys_sigsuspend+0x58/frame 0xf5cb1c40 syscall(f5cb1d08) at syscall+0x2ed/frame 0xf5cb1cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cb1cfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x283550ab, esp = 0xbfbfc9f4, ebp = 0xbfbfca20 --- Tracing command sendmail pid 726 tid 100116 td 0xc847e300 sched_switch(c847e300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d56900 mi_switch(104,0,c108cb51,1f5,400,...) at mi_switch+0x1c9/frame 0xf5d56934 sleepq_switch(c847e300,0,c108cb51,1ab,c7e34bd0,...) at sleepq_switch+0x1b9/frame 0xf5d56968 sleepq_catch_signals(c11b9ca4,f5d569d8,c0a73729,c7e34be0,0,...) at sleepq_catch_signals+0x361/frame 0xf5d569b0 sleepq_timedwait_sig(c7e34be4,0,f5d56a10,50000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf5d569d8 _cv_timedwait_sig_sbt(c7e34be4,c7e34bd0,2ce33d32,b496,50000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5d56a24 seltdwait(b496,50000000,0,c847e300,0,...) at seltdwait+0xbc/frame 0xf5d56a58 kern_select(c847e300,5,bfbfbfe0,0,0,...) at kern_select+0x88c/frame 0xf5d56bf8 sys_select(c847e300,f5d56cc8,c0eb32b0,c71fac90,0,...) at sys_select+0x69/frame 0xf5d56c40 syscall(f5d56d08) at syscall+0x2ed/frame 0xf5d56cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d56cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2841cf87, esp = 0xbfbfbf44, ebp = 0xbfbfca00 --- Tracing command sshd pid 723 tid 100091 td 0xc7e1c600 sched_switch(c7e1c600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5cad90c mi_switch(104,0,c108cb51,1f5,200046,...) at mi_switch+0x1c9/frame 0xf5cad940 sleepq_switch(c7e1c600,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5cad974 sleepq_catch_signals(f5cad9e0,c0a73729,c7c8fa20,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5cad9bc sleepq_wait_sig(c7c8fa24,0,f5cada10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5cad9e0 _cv_wait_sig(c7c8fa24,c7c8fa10,c108f895,68e,c0ae2a0d,...) at _cv_wait_sig+0x200/frame 0xf5cada24 seltdwait(ffffffff,0,0,c7e1c600,0,...) at seltdwait+0x90/frame 0xf5cada58 kern_select(c7e1c600,9,28c0c140,0,0,...) at kern_select+0x88c/frame 0xf5cadbf8 sys_select(c7e1c600,f5cadcc8,0,0,c7e1c600,...) at sys_select+0x69/frame 0xf5cadc40 syscall(f5cadd08) at syscall+0x2ed/frame 0xf5cadcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cadcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2852ef87, esp = 0xbfbfd424, ebp = 0xbfbfde44 --- Tracing command moused pid 691 tid 100077 td 0xc78f9900 sched_switch(c78f9900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5c7290c mi_switch(104,0,c108cb51,1f5,46,...) at mi_switch+0x1c9/frame 0xf5c72940 sleepq_switch(c78f9900,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5c72974 sleepq_catch_signals(f5c729e0,c0a73729,c7c0a360,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5c729bc sleepq_wait_sig(c7c0a364,0,f5c72a10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5c729e0 _cv_wait_sig(c7c0a364,c7c0a350,c108f895,68e,c78f9900,...) at _cv_wait_sig+0x200/frame 0xf5c72a24 seltdwait(ffffffff,0,0,c78f9900,0,...) at seltdwait+0x90/frame 0xf5c72a58 kern_select(c78f9900,400,bfbfdcb0,0,0,...) at kern_select+0x88c/frame 0xf5c72bf8 sys_select(c78f9900,f5c72cc8,c0eb32b0,c7200c90,0,...) at sys_select+0x69/frame 0xf5c72c40 syscall(f5c72d08) at syscall+0x2ed/frame 0xf5c72cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c72cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281bcf87, esp = 0xbfbfd894, ebp = 0xbfbfde24 --- Tracing command winbindd pid 690 tid 100087 td 0xc7d68900 sched_switch(c7d68900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5c9a978 mi_switch(104,0,c108cb51,1f5,400,...) at mi_switch+0x1c9/frame 0xf5c9a9ac sleepq_switch(c7d68900,0,c108cb51,1ab,c7c0ba90,...) at sleepq_switch+0x1b9/frame 0xf5c9a9e0 sleepq_catch_signals(c11b9ca4,f5c9aa50,c0a73729,c7c0baa0,0,...) at sleepq_catch_signals+0x361/frame 0xf5c9aa28 sleepq_timedwait_sig(c7c0baa4,0,f5c9aa88,b7fbe76c,20c49,...) at sleepq_timedwait_sig+0x14/frame 0xf5c9aa50 _cv_timedwait_sig_sbt(c7c0baa4,c7c0ba90,a1e17d1b,2178ba,b7fbe76c,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5c9aa9c seltdwait(2178ba,b7fbe76c,20c49,c7d68900,c10935cc,...) at seltdwait+0xbc/frame 0xf5c9aad0 sys_poll(c7d68900,f5c9acc8,7b3,2,f5c9acc4,...) at sys_poll+0x44c/frame 0xf5c9ac40 syscall(f5c9ad08) at syscall+0x2ed/frame 0xf5c9acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c9acfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2193b2df, esp = 0xbfbfc47c, ebp = 0xbfbfc4b8 --- Tracing command smbd pid 679 tid 100112 td 0xc794e600 sched_switch(c794e600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d4a978 mi_switch(104,0,c108cb51,1f5,400,...) at mi_switch+0x1c9/frame 0xf5d4a9ac sleepq_switch(c794e600,0,c108cb51,1ab,c7ce8310,...) at sleepq_switch+0x1b9/frame 0xf5d4a9e0 sleepq_catch_signals(c11b9ca4,f5d4aa50,c0a73729,c7ce8320,0,...) at sleepq_catch_signals+0x361/frame 0xf5d4aa28 sleepq_timedwait_sig(c7ce8324,0,f5d4aa88,b7fbe76c,20c49,...) at sleepq_timedwait_sig+0x14/frame 0xf5d4aa50 _cv_timedwait_sig_sbt(c7ce8324,c7ce8310,fa803424,20c4ac,b7fbe76c,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5d4aa9c seltdwait(20c4ac,b7fbe76c,20c49,c794e600,0,...) at seltdwait+0xbc/frame 0xf5d4aad0 sys_poll(c794e600,f5d4acc8,c0eb32b0,c71fac90,0,...) at sys_poll+0x44c/frame 0xf5d4ac40 syscall(f5d4ad08) at syscall+0x2ed/frame 0xf5d4acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d4acfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x21b642df, esp = 0xbfbfd9ec, ebp = 0xbfbfda28 --- Tracing command winbindd pid 673 tid 100110 td 0xc794ec00 sched_switch(c794ec00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d44978 mi_switch(104,0,c108cb51,1f5,400,...) at mi_switch+0x1c9/frame 0xf5d449ac sleepq_switch(c794ec00,0,c108cb51,1ab,c7c0a310,...) at sleepq_switch+0x1b9/frame 0xf5d449e0 sleepq_catch_signals(c11b9ca4,f5d44a50,c0a73729,c7c0a320,0,...) at sleepq_catch_signals+0x361/frame 0xf5d44a28 sleepq_timedwait_sig(c7c0a324,0,f5d44a88,bfffea52,12,...) at sleepq_timedwait_sig+0x14/frame 0xf5d44a50 _cv_timedwait_sig_sbt(c7c0a324,c7c0a310,2221ab72,b54b,bfffea52,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5d44a9c seltdwait(b54b,bfffea52,12,c794ec00,f5d44b28,...) at seltdwait+0xbc/frame 0xf5d44ad0 sys_poll(c794ec00,f5d44cc8,c0eb32b0,c7200c90,0,...) at sys_poll+0x44c/frame 0xf5d44c40 syscall(f5d44d08) at syscall+0x2ed/frame 0xf5d44cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d44cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2193b2df, esp = 0xbfbfdbcc, ebp = 0xbfbfdc08 --- Tracing command smbd pid 671 tid 100111 td 0xc794e900 sched_switch(c794e900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d47978 mi_switch(104,0,c108cb51,1f5,400,...) at mi_switch+0x1c9/frame 0xf5d479ac sleepq_switch(c794e900,0,c108cb51,1ab,c7ce8b50,...) at sleepq_switch+0x1b9/frame 0xf5d479e0 sleepq_catch_signals(c11b9ca4,f5d47a50,c0a73729,c7ce8b60,0,...) at sleepq_catch_signals+0x361/frame 0xf5d47a28 sleepq_timedwait_sig(c7ce8b64,0,f5d47a88,bffffbaa,3,...) at sleepq_timedwait_sig+0x14/frame 0xf5d47a50 _cv_timedwait_sig_sbt(c7ce8b64,c7ce8b50,fb3d390,b4a2,bffffbaa,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5d47a9c seltdwait(b4a2,bffffbaa,3,c794e900,c0a4dc5c,...) at seltdwait+0xbc/frame 0xf5d47ad0 sys_poll(c794e900,f5d47cc8,0,0,c794e900,...) at sys_poll+0x44c/frame 0xf5d47c40 syscall(f5d47d08) at syscall+0x2ed/frame 0xf5d47cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d47cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x21b642df, esp = 0xbfbfda9c, ebp = 0xbfbfdad8 --- Tracing command nmbd pid 669 tid 100099 td 0xc7dc1000 sched_switch(c7dc1000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5cd3978 mi_switch(104,0,c108cb51,1f5,400,...) at mi_switch+0x1c9/frame 0xf5cd39ac sleepq_switch(c7dc1000,0,c108cb51,1ab,c7c0a4d0,...) at sleepq_switch+0x1b9/frame 0xf5cd39e0 sleepq_catch_signals(c11b9ca4,f5cd3a50,c0a73729,c7c0a4e0,0,...) at sleepq_catch_signals+0x361/frame 0xf5cd3a28 sleepq_timedwait_sig(c7c0a4e4,0,f5cd3a88,9fffff47,0,...) at sleepq_timedwait_sig+0x14/frame 0xf5cd3a50 _cv_timedwait_sig_sbt(c7c0a4e4,c7c0a4d0,fb9b9ebf,b496,9fffff47,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5cd3a9c seltdwait(b496,9fffff47,0,c7dc1000,c13aeb00,...) at seltdwait+0xbc/frame 0xf5cd3ad0 sys_poll(c7dc1000,f5cd3cc8,c0eb32b0,c71fdc90,0,...) at sys_poll+0x44c/frame 0xf5cd3c40 syscall(f5cd3d08) at syscall+0x2ed/frame 0xf5cd3cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cd3cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x215632df, esp = 0xbfbfdb1c, ebp = 0xbfbfdb58 --- Tracing command ntpd pid 645 tid 100118 td 0xc847dc00 sched_switch(c847dc00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d5f90c mi_switch(104,0,c108cb51,1f5,200046,...) at mi_switch+0x1c9/frame 0xf5d5f940 sleepq_switch(c847dc00,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5d5f974 sleepq_catch_signals(f5d5f9e0,c0a73729,c7c8f4e0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5d5f9bc sleepq_wait_sig(c7c8f4e4,0,f5d5fa10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5d5f9e0 _cv_wait_sig(c7c8f4e4,c7c8f4d0,c108f895,68e,c0ae2a0d,...) at _cv_wait_sig+0x200/frame 0xf5d5fa24 seltdwait(ffffffff,0,0,c847dc00,0,...) at seltdwait+0x90/frame 0xf5d5fa58 kern_select(c847dc00,1c,bfbfdd48,0,0,...) at kern_select+0x88c/frame 0xf5d5fbf8 sys_select(c847dc00,f5d5fcc8,0,0,c847dc00,...) at sys_select+0x69/frame 0xf5d5fc40 syscall(f5d5fd08) at syscall+0x2ed/frame 0xf5d5fcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5d5fcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28396f87, esp = 0xbfbfdd24, ebp = 0xbfbfdde4 --- Tracing command nfsd pid 589 tid 100115 td 0xc847e600 sched_switch(c847e600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d537c8 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf5d537fc sleepq_switch(c847e600,0,c108cb51,26b,c847e600,...) at sleepq_switch+0x1b9/frame 0xf5d53830 sleepq_wait(c13fa92c,63,c106f6df,0,0,...) at sleepq_wait+0x48/frame 0xf5d53854 _sleep(c13fa92c,c13fa9c8,63,c106f6df,0,0,0,0,100) at _sleep+0x37c/frame 0xf5d538b0 nfsmsleep(c13fa92c,c13fa9c8,63,c106f6df,0,...) at nfsmsleep+0xaa/frame 0xf5d538e8 nfsv4_lock(c13fa928,0,0,c13fa9c8,0,...) at nfsv4_lock+0x92/frame 0xf5d53910 nfsrvd_dorpc(f5d53ad8,0,c847e600,ef,96ffd1bb,...) at nfsrvd_dorpc+0x2f6/frame 0xf5d53aa8 nfssvc_program(ca5d0000,cce02400,c10b6c3b,490,0,...) at nfssvc_program+0x41b/frame 0xf5d53ba8 svc_run_internal(f5d53cf4,c0a5692f,c793a280,f5d53d08,c1080960,...) at svc_run_internal+0x201/frame 0xf5d53cc4 svc_thread_start(c793a280,f5d53d08,c1080960,3d7,0,...) at svc_thread_start+0xd/frame 0xf5d53ccc fork_exit(c0c8f740,c793a280,f5d53d08) at fork_exit+0x7f/frame 0xf5d53cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5d53cf4 --- trap 0x8a3fe22e, eip = 0xc, esp = 0x33, ebp = 0xbfbfd937 --- Tracing command nfsd pid 589 tid 100114 td 0xc847e900 sched_switch(c847e900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d5011c mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf5d50150 sleepq_switch(c847e900,0,c108cb51,26b,c847e900,...) at sleepq_switch+0x1b9/frame 0xf5d50184 sleepq_wait(cae98824,63,c106f6fa,0,0,...) at sleepq_wait+0x48/frame 0xf5d501a8 _sleep(cae98824,c13fa698,63,c106f6fa,0,0,0,0,100) at _sleep+0x37c/frame 0xf5d50204 nfsmsleep(cae98824,c13fa698,63,c106f6fa,0,...) at nfsmsleep+0xaa/frame 0xf5d5023c nfsv4_getref(cae98820,0,c13fa698,c8ca7bb0,c847e9b4,...) at nfsv4_getref+0x6f/frame 0xf5d50264 nfscl_getcl(c8ca7bb0,0,0,1,f5d50318,...) at nfscl_getcl+0x3f6/frame 0xf5d502e0 nfscl_doclose(cb433168,f5d5033c,c847e900,f5d503d0,f5d50360,...) at nfscl_doclose+0x36/frame 0xf5d50328 nfsrpc_close(cb433168,1,c847e900,c11ab130,f5d503d0,...) at nfsrpc_close+0x31/frame 0xf5d50340 ncl_reclaim(f5d503d0,c10e5c53,1,cb433238,cb433254,...) at ncl_reclaim+0x57/frame 0xf5d50360 VOP_RECLAIM_APV(c11ab130,f5d503d0,0,0,0,...) at VOP_RECLAIM_APV+0x124/frame 0xf5d50390 vgonel(cb433218,0,c109780f,397,3f4,...) at vgonel+0x50c/frame 0xf5d503f8 vnlru_free(c13aa3ec,0,c109780f,3f4,0,...) at vnlru_free+0x274/frame 0xf5d50448 getnewvnode(c1076516,c8ee8bb0,c11e446c,f5d504b8,f5d50574,...) at getnewvnode+0x64/frame 0xf5d50470 ffs_vgetf(c8ee8bb0,21341,80000,f5d50574,0) at ffs_vgetf+0xeb/frame 0xf5d504cc ffs_vget(c8ee8bb0,21341,80000,f5d50574,f5d50584,...) at ffs_vget+0x2e/frame 0xf5d504e8 ufs_lookup_ino(cc57e9d8,f5d508c0,f5d508d4,0) at ufs_lookup_ino+0xe26/frame 0xf5d505b0 ufs_lookup(f5d50618,c10e53fc,c0b1b138,cc57ea0c,f5d50610,...) at ufs_lookup+0x2a/frame 0xf5d505c8 VOP_CACHEDLOOKUP_APV(c11e446c,f5d50618,f5d508d4,0,0,...) at VOP_CACHEDLOOKUP_APV+0x124/frame 0xf5d505f8 vfs_cache_lookup(f5d506b0,c10e539b,200400,c1096c53,c11f6178,...) at vfs_cache_lookup+0xf0/frame 0xf5d50640 VOP_LOOKUP_APV(c11e446c,f5d506b0,c1096c53,205,f5d506b8,...) at VOP_LOOKUP_APV+0x124/frame 0xf5d50670 lookup(f5d50888,cbaa2400,f5d50730,c0d0b7c0,4,...) at lookup+0x528/frame 0xf5d506d8 nfsvno_namei(f5d50ad8,f5d50888,cc57e9d8,0,f5d509d8,...) at nfsvno_namei+0x199/frame 0xf5d50748 nfsrvd_lookup(f5d50ad8,0,cc57e9d8,f5d50a44,f5d50a24,...) at nfsrvd_lookup+0x159/frame 0xf5d50910 nfsrvd_dorpc(f5d50ad8,0,c847e900,ef,96ffd1a6,...) at nfsrvd_dorpc+0xe4e/frame 0xf5d50aa8 nfssvc_program(ca277000,cce02400,c10b6c3b,490,0,...) at nfssvc_program+0x41b/frame 0xf5d50ba8 svc_run_internal(f5d50cf4,c0a5692f,c793a280,f5d50d08,c1080960,...) at svc_run_internal+0x201/frame 0xf5d50cc4 svc_thread_start(c793a280,f5d50d08,c1080960,3d7,0,...) at svc_thread_start+0xd/frame 0xf5d50ccc fork_exit(c0c8f740,c793a280,f5d50d08) at fork_exit+0x7f/frame 0xf5d50cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5d50cf4 --- trap 0x8a3fe22e, eip = 0xc, esp = 0x33, ebp = 0xbfbfd937 --- Tracing command nfsd pid 589 tid 100113 td 0xc794e300 sched_switch(c794e300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5d4d7c8 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf5d4d7fc sleepq_switch(c794e300,0,c108cb51,26b,c794e300,...) at sleepq_switch+0x1b9/frame 0xf5d4d830 sleepq_wait(c13fa92c,63,c106f6df,0,0,...) at sleepq_wait+0x48/frame 0xf5d4d854 _sleep(c13fa92c,c13fa9c8,63,c106f6df,0,0,0,0,100) at _sleep+0x37c/frame 0xf5d4d8b0 nfsmsleep(c13fa92c,c13fa9c8,63,c106f6df,0,...) at nfsmsleep+0xaa/frame 0xf5d4d8e8 nfsv4_lock(c13fa928,0,0,c13fa9c8,0,...) at nfsv4_lock+0x92/frame 0xf5d4d910 nfsrvd_dorpc(f5d4dad8,0,c794e300,ef,96ffd1bc,...) at nfsrvd_dorpc+0x2f6/frame 0xf5d4daa8 nfssvc_program(cd605000,cce02400,c10b6c3b,490,0,...) at nfssvc_program+0x41b/frame 0xf5d4dba8 svc_run_internal(f5d4dcf4,c0a5692f,c793a280,f5d4dd08,c1080960,...) at svc_run_internal+0x201/frame 0xf5d4dcc4 svc_thread_start(c793a280,f5d4dd08,c1080960,3d7,0,...) at svc_thread_start+0xd/frame 0xf5d4dccc fork_exit(c0c8f740,c793a280,f5d4dd08) at fork_exit+0x7f/frame 0xf5d4dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf5d4dcf4 --- trap 0x8a3fe22e, eip = 0xc, esp = 0x33, ebp = 0xbfbfd937 --- Tracing command nfsd pid 589 tid 100094 td 0xc7dc2000 sched_switch(c7dc2000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5cb9f8c mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xf5cb9fc0 sleepq_switch(c7dc2000,0,c108cb51,26b,c7dc2000,...) at sleepq_switch+0x1b9/frame 0xf5cb9ff4 sleepq_wait(c13fa92c,63,c106f6df,0,0,...) at sleepq_wait+0x48/frame 0xf5cba018 _sleep(c13fa92c,c13fa9c8,63,c106f6df,0,0,0,0,100) at _sleep+0x37c/frame 0xf5cba074 nfsmsleep(c13fa92c,c13fa9c8,63,c106f6df,0,...) at nfsmsleep+0xaa/frame 0xf5cba0ac nfsv4_lock(c13fa928,1,0,c13fa9c8,0,...) at nfsv4_lock+0x92/frame 0xf5cba0d4 nfsrv_setclient(f5cba350,f5cba154,f5cba148,f5cba140,c7dc2000,...) at nfsrv_setclient+0x9c/frame 0xf5cba110 nfsrvd_setclientid(f5cba350,0,0,c7dc2000,f5cba250,...) at nfsrvd_setclientid+0x338/frame 0xf5cba188 nfsrvd_dorpc(f5cba350,0,c7dc2000,ef,96ffd1b9,...) at nfsrvd_dorpc+0xdb4/frame 0xf5cba320 nfssvc_program(c91ab000,cce02400,c10b6c3b,490,0,...) at nfssvc_program+0x41b/frame 0xf5cba420 svc_run_internal(c0c8f740,c793a280,c7dba000,f5cba568,0,...) at svc_run_internal+0x201/frame 0xf5cba53c svc_run(c793a280,0,c107225f,1b5,246,...) at svc_run+0xc3/frame 0xf5cba578 nfsrvd_nfsd(c7dc2000,f5cba6d0,c,0,8,...) at nfsrvd_nfsd+0x1a2/frame 0xf5cba6b0 nfssvc_nfsd(c7dc2000,f5cbacc8,0,c7dc2000,f5cbacfc,...) at nfssvc_nfsd+0xf4/frame 0xf5cbac28 sys_nfssvc(c7dc2000,f5cbacc8,c0eb32b0,c71fdc90,0,...) at sys_nfssvc+0xbf/frame 0xf5cbac40 syscall(f5cbad08) at syscall+0x2ed/frame 0xf5cbacfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cbacfc --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280c26db, esp = 0xbfbfd7e4, ebp = 0xbfbfda58 --- Tracing command nfsd pid 584 tid 100086 td 0xc7dc2600 sched_switch(c7dc2600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5c9690c mi_switch(104,0,c108cb51,1f5,46,...) at mi_switch+0x1c9/frame 0xf5c96940 sleepq_switch(c7dc2600,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5c96974 sleepq_catch_signals(f5c969e0,c0a73729,c7e345a0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5c969bc sleepq_wait_sig(c7e345a4,0,f5c96a10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5c969e0 _cv_wait_sig(c7e345a4,c7e34590,c108f895,68e,c0ae2a0d,...) at _cv_wait_sig+0x200/frame 0xf5c96a24 seltdwait(ffffffff,0,0,c7dc2600,0,...) at seltdwait+0x90/frame 0xf5c96a58 kern_select(c7dc2600,7,bfbfdc30,0,0,...) at kern_select+0x88c/frame 0xf5c96bf8 sys_select(c7dc2600,f5c96cc8,7b3,2,f5c96cc4,...) at sys_select+0x69/frame 0xf5c96c40 syscall(f5c96d08) at syscall+0x2ed/frame 0xf5c96cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c96cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28189f87, esp = 0xbfbfda5c, ebp = 0xbfbfde34 --- Tracing command mountd pid 578 tid 100104 td 0xc7e1b300 sched_switch(c7e1b300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5cf490c mi_switch(104,0,c108cb51,1f5,46,...) at mi_switch+0x1c9/frame 0xf5cf4940 sleepq_switch(c7e1b300,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5cf4974 sleepq_catch_signals(f5cf49e0,c0a73729,c7ce8a60,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5cf49bc sleepq_wait_sig(c7ce8a64,0,f5cf4a10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5cf49e0 _cv_wait_sig(c7ce8a64,c7ce8a50,c108f895,68e,c0ae2a0d,...) at _cv_wait_sig+0x200/frame 0xf5cf4a24 seltdwait(ffffffff,0,0,c7e1b300,0,...) at seltdwait+0x90/frame 0xf5cf4a58 kern_select(c7e1b300,9,bfbfdd50,0,0,...) at kern_select+0x88c/frame 0xf5cf4bf8 sys_select(c7e1b300,f5cf4cc8,0,0,c7e1b300,...) at sys_select+0x69/frame 0xf5cf4c40 syscall(f5cf4d08) at syscall+0x2ed/frame 0xf5cf4cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cf4cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a0f87, esp = 0xbfbfdd0c, ebp = 0xbfbfde34 --- Tracing command nfsuserd pid 571 tid 100102 td 0xc7e1b900 sched_switch(c7e1b900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5ceb900 mi_switch(104,0,c108cb51,1f5,400,...) at mi_switch+0x1c9/frame 0xf5ceb934 sleepq_switch(c7e1b900,0,c108cb51,1ab,c7c0a390,...) at sleepq_switch+0x1b9/frame 0xf5ceb968 sleepq_catch_signals(c11b9ca4,f5ceb9d8,c0a73729,c7c0a3a0,0,...) at sleepq_catch_signals+0x361/frame 0xf5ceb9b0 sleepq_timedwait_sig(c7c0a3a4,0,f5ceba10,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xf5ceb9d8 _cv_timedwait_sig_sbt(c7c0a3a4,c7c0a390,4db80d59,b4a6,e0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5ceba24 seltdwait(b4a6,e0000000,1,c7e1b900,0,...) at seltdwait+0xbc/frame 0xf5ceba58 kern_select(c7e1b900,4,bfbfdc10,0,0,...) at kern_select+0x88c/frame 0xf5cebbf8 sys_select(c7e1b900,f5cebcc8,c0eb32b0,c71fac90,0,...) at sys_select+0x69/frame 0xf5cebc40 syscall(f5cebd08) at syscall+0x2ed/frame 0xf5cebcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cebcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28188f87, esp = 0xbfbfdb6c, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 570 tid 100106 td 0xc7e17c00 sched_switch(c7e17c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5cfe9bc mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xf5cfe9f0 sleepq_switch(c7e17c00,0,c108cb51,1ab,f5cfea68,...) at sleepq_switch+0x1b9/frame 0xf5cfea24 sleepq_catch_signals(0,c108cb51,162,1e0,c7e17c00,...) at sleepq_catch_signals+0x361/frame 0xf5cfea6c sleepq_wait_sig(c80e0c18,68,c10935e9,100,0,...) at sleepq_wait_sig+0x14/frame 0xf5cfea90 _sleep(c80e0c18,c80e0bd8,168,c10935e9,0,0,0,0,100) at _sleep+0x35b/frame 0xf5cfeaec sbwait(c80e0bb4,0,c109387d,8d8,c7d76818,...) at sbwait+0xb8/frame 0xf5cfeb24 soreceive_dgram(c80e0b60,f5cfeba8,f5cfebb0,0,f5cfebac,...) at soreceive_dgram+0x101/frame 0xf5cfeb70 kern_recvit(c7e17c00,3,f5cfec10,0,0,...) at kern_recvit+0x1f0/frame 0xf5cfebe8 sys_recvmsg(c7e17c00,f5cfecc8,7b3,2,f5cfecc4,...) at sys_recvmsg+0x9d/frame 0xf5cfec40 syscall(f5cfed08) at syscall+0x2ed/frame 0xf5cfecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cfecfc --- syscall (27, FreeBSD ELF32, sys_recvmsg), eip = 0x2811f2ef, esp = 0xbfbfd4ac, ebp = 0xbfbfd5b8 --- Tracing command nfsuserd pid 569 tid 100090 td 0xc7d68300 sched_switch(c7d68300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5ca7900 mi_switch(104,0,c108cb51,1f5,400,...) at mi_switch+0x1c9/frame 0xf5ca7934 sleepq_switch(c7d68300,0,c108cb51,1ab,c7c0bdd0,...) at sleepq_switch+0x1b9/frame 0xf5ca7968 sleepq_catch_signals(c11b9ca4,f5ca79d8,c0a73729,c7c0bde0,0,...) at sleepq_catch_signals+0x361/frame 0xf5ca79b0 sleepq_timedwait_sig(c7c0bde4,0,f5ca7a10,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xf5ca79d8 _cv_timedwait_sig_sbt(c7c0bde4,c7c0bdd0,8062679,b4a5,e0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5ca7a24 seltdwait(b4a5,e0000000,1,c7d68300,0,...) at seltdwait+0xbc/frame 0xf5ca7a58 kern_select(c7d68300,4,bfbfdc10,0,0,...) at kern_select+0x88c/frame 0xf5ca7bf8 sys_select(c7d68300,f5ca7cc8,7b3,2,f5ca7cc4,...) at sys_select+0x69/frame 0xf5ca7c40 syscall(f5ca7d08) at syscall+0x2ed/frame 0xf5ca7cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5ca7cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28188f87, esp = 0xbfbfdb6c, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 568 tid 100095 td 0xc7dc1c00 sched_switch(c7dc1c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5cbe900 mi_switch(104,0,c108cb51,1f5,400,...) at mi_switch+0x1c9/frame 0xf5cbe934 sleepq_switch(c7dc1c00,0,c108cb51,1ab,c7e34550,...) at sleepq_switch+0x1b9/frame 0xf5cbe968 sleepq_catch_signals(c11b9ca4,f5cbe9d8,c0a73729,c7e34560,0,...) at sleepq_catch_signals+0x361/frame 0xf5cbe9b0 sleepq_timedwait_sig(c7e34564,0,f5cbea10,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xf5cbe9d8 _cv_timedwait_sig_sbt(c7e34564,c7e34550,5da84cee,b4a7,e0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5cbea24 seltdwait(b4a7,e0000000,1,c7dc1c00,0,...) at seltdwait+0xbc/frame 0xf5cbea58 kern_select(c7dc1c00,4,bfbfdc10,0,0,...) at kern_select+0x88c/frame 0xf5cbebf8 sys_select(c7dc1c00,f5cbecc8,7b3,2,f5cbecc4,...) at sys_select+0x69/frame 0xf5cbec40 syscall(f5cbed08) at syscall+0x2ed/frame 0xf5cbecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cbecfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28188f87, esp = 0xbfbfdb6c, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 567 tid 100100 td 0xc7e1c000 Tracing command rpcbind pid 538 tid 100093 td 0xc7dc2300 sched_switch(c7dc2300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5cb6978 mi_switch(104,0,c108cb51,1f5,400,...) at mi_switch+0x1c9/frame 0xf5cb69ac sleepq_switch(c7dc2300,0,c108cb51,1ab,c7c0a250,...) at sleepq_switch+0x1b9/frame 0xf5cb69e0 sleepq_catch_signals(c11b9ca4,f5cb6a50,c0a73729,c7c0a260,0,...) at sleepq_catch_signals+0x361/frame 0xf5cb6a28 sleepq_timedwait_sig(c7c0a264,0,f5cb6a88,dffffdd5,1,...) at sleepq_timedwait_sig+0x14/frame 0xf5cb6a50 _cv_timedwait_sig_sbt(c7c0a264,c7c0a250,7d668ddf,b4a9,dffffdd5,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5cb6a9c seltdwait(b4a9,dffffdd5,1,c7dc2300,0,...) at seltdwait+0xbc/frame 0xf5cb6ad0 sys_poll(c7dc2300,f5cb6cc8,7b3,2,f5cb6cc4,...) at sys_poll+0x44c/frame 0xf5cb6c40 syscall(f5cb6d08) at syscall+0x2ed/frame 0xf5cb6cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cb6cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2813e2df, esp = 0xbfbfbbfc, ebp = 0xbfbfddd8 --- Tracing command syslogd pid 523 tid 100097 td 0xc7dc1600 sched_switch(c7dc1600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5cc690c mi_switch(104,0,c108cb51,1f5,46,...) at mi_switch+0x1c9/frame 0xf5cc6940 sleepq_switch(c7dc1600,0,c108cb51,1ab,b1,...) at sleepq_switch+0x1b9/frame 0xf5cc6974 sleepq_catch_signals(f5cc69e0,c0a73729,c7c0a0e0,0,0,...) at sleepq_catch_signals+0x361/frame 0xf5cc69bc sleepq_wait_sig(c7c0a0e4,0,f5cc6a10,101,0,...) at sleepq_wait_sig+0x14/frame 0xf5cc69e0 _cv_wait_sig(c7c0a0e4,c7c0a0d0,c108f895,68e,c7dc1600,...) at _cv_wait_sig+0x200/frame 0xf5cc6a24 seltdwait(ffffffff,0,0,c7dc1600,0,...) at seltdwait+0x90/frame 0xf5cc6a58 kern_select(c7dc1600,9,28849100,0,0,...) at kern_select+0x88c/frame 0xf5cc6bf8 sys_select(c7dc1600,f5cc6cc8,0,0,c7dc1600,...) at sys_select+0x69/frame 0xf5cc6c40 syscall(f5cc6d08) at syscall+0x2ed/frame 0xf5cc6cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5cc6cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2819ff87, esp = 0xbfbfceac, ebp = 0xbfbfde34 --- Tracing command devd pid 420 tid 100079 td 0xc7d6b900 sched_switch(c7d6b900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf5c7a900 mi_switch(104,0,c108cb51,1f5,400,...) at mi_switch+0x1c9/frame 0xf5c7a934 sleepq_switch(c7d6b900,0,c108cb51,1ab,c7e34c50,...) at sleepq_switch+0x1b9/frame 0xf5c7a968 sleepq_catch_signals(c11b9ca4,f5c7a9d8,c0a73729,c7e34c60,0,...) at sleepq_catch_signals+0x361/frame 0xf5c7a9b0 sleepq_timedwait_sig(c7e34c64,0,f5c7aa10,c0000000,3,...) at sleepq_timedwait_sig+0x14/frame 0xf5c7a9d8 _cv_timedwait_sig_sbt(c7e34c64,c7e34c50,70fc048e,b4a6,c0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf5c7aa24 seltdwait(b4a6,c0000000,3,c7d6b900,0,...) at seltdwait+0xbc/frame 0xf5c7aa58 kern_select(c7d6b900,5,bfbfd998,0,0,...) at kern_select+0x88c/frame 0xf5c7abf8 sys_select(c7d6b900,f5c7acc8,c0eb32b0,c7200c90,0,...) at sys_select+0x69/frame 0xf5c7ac40 syscall(f5c7ad08) at syscall+0x2ed/frame 0xf5c7acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf5c7acfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x8095dc3, esp = 0xbfbfd93c, ebp = 0xbfbfde54 --- Tracing command softdepflush pid 17 tid 100074 td 0xc794c000 sched_switch(c794c000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf0799ba4 mi_switch(104,0,c108cb51,1f5,101,...) at mi_switch+0x1c9/frame 0xf0799bd8 sleepq_switch(c794c000,0,c108cb51,28e,c794c000,...) at sleepq_switch+0x1b9/frame 0xf0799c0c sleepq_timedwait(c13ae994,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xf0799c30 _sleep(c13ae994,c13ae914,54,c10bf0a0,fffffed8,...) at _sleep+0x345/frame 0xf0799c8c softdep_flush(0,f0799d08,c1080960,3d7,0,...) at softdep_flush+0x27c/frame 0xf0799ccc fork_exit(c0ce85d0,0,f0799d08) at fork_exit+0x7f/frame 0xf0799cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf0799cf4 --- trap 0, eip = 0, esp = 0xf0799d40, ebp = 0 --- Tracing command syncer pid 16 tid 100073 td 0xc794c300 sched_switch(c794c300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf0796b78 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xf0796bac sleepq_switch(c794c300,0,c108cb51,28e,0,...) at sleepq_switch+0x1b9/frame 0xf0796be0 sleepq_timedwait(c13aa424,0,f0796c3c,0,0,...) at sleepq_timedwait+0x48/frame 0xf0796c04 _cv_timedwait_sbt(c13aa424,c13aa404,fffffed8,0,0,...) at _cv_timedwait_sbt+0x228/frame 0xf0796c50 sched_sync(0,f0796d08,c1080960,3d7,0,...) at sched_sync+0x682/frame 0xf0796ccc fork_exit(c0b32990,0,f0796d08) at fork_exit+0x7f/frame 0xf0796cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf0796cf4 --- trap 0, eip = 0, esp = 0xf0796d40, ebp = 0 --- Tracing command vnlru pid 9 tid 100072 td 0xc794c600 sched_switch(c794c600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf0793b78 mi_switch(104,0,c108cb51,1f5,101,...) at mi_switch+0x1c9/frame 0xf0793bac sleepq_switch(c794c600,0,c108cb51,28e,c794c600,...) at sleepq_switch+0x1b9/frame 0xf0793be0 sleepq_timedwait(c7c30ba0,60,0,0,0,...) at sleepq_timedwait+0x48/frame 0xf0793c04 _sleep(c7c30ba0,c13aa3dc,260,c1098ba6,fffffed8,...) at _sleep+0x345/frame 0xf0793c60 vnlru_proc(0,f0793d08,c1080960,3d7,0,...) at vnlru_proc+0xcf/frame 0xf0793ccc fork_exit(c0b331d0,0,f0793d08) at fork_exit+0x7f/frame 0xf0793cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf0793cf4 --- trap 0, eip = 0, esp = 0xf0793d40, ebp = 0 --- Tracing command bufdaemon pid 8 tid 100071 td 0xc794c900 sched_switch(c794c900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xf0790bb0 mi_switch(104,0,c108cb51,1f5,101,...) at mi_switch+0x1c9/frame 0xf0790be4 sleepq_switch(c794c900,0,c108cb51,28e,c794c900,...) at sleepq_switch+0x1b9/frame 0xf0790c18 sleepq_timedwait(c13aa19c,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xf0790c3c _sleep(c13aa19c,c13aa184,54,c109566c,fffffed8,...) at _sleep+0x345/frame 0xf0790c98 buf_daemon(0,f0790d08,c1080960,3d7,0,...) at buf_daemon+0x8c/frame 0xf0790ccc fork_exit(c0b163c0,0,f0790d08) at fork_exit+0x7f/frame 0xf0790cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf0790cf4 --- trap 0, eip = 0, esp = 0xf0790d40, ebp = 0 --- Tracing command pagezero pid 7 tid 100070 td 0xc794cc00 sched_switch(c794cc00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3bfebac mi_switch(104,0,c108cb51,1f5,101,...) at mi_switch+0x1c9/frame 0xe3bfebe0 sleepq_switch(c794cc00,0,c108cb51,28e,c794cc00,...) at sleepq_switch+0x1b9/frame 0xe3bfec14 sleepq_timedwait(c13af294,0,12b,0,0,...) at sleepq_timedwait+0x48/frame 0xe3bfec38 _sleep(c13af294,c1403400,0,c10c6347,fffea520,...) at _sleep+0x345/frame 0xe3bfec94 vm_pagezero(0,e3bfed08,c1080960,3d7,0,...) at vm_pagezero+0xc2/frame 0xe3bfeccc fork_exit(c0d2fa70,0,e3bfed08) at fork_exit+0x7f/frame 0xe3bfecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3bfecf4 --- trap 0, eip = 0, esp = 0xe3bfed40, ebp = 0 --- Tracing command vmdaemon pid 6 tid 100069 td 0xc794d000 sched_switch(c794d000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3bfbb78 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xe3bfbbac sleepq_switch(c794d000,0,c108cb51,26b,c794d000,...) at sleepq_switch+0x1b9/frame 0xe3bfbbe0 sleepq_wait(c13aee5c,74,c109566c,0,0,...) at sleepq_wait+0x48/frame 0xe3bfbc04 _sleep(c13aee5c,c13aee44,74,c109566c,0,...) at _sleep+0x37c/frame 0xe3bfbc60 vm_daemon(0,e3bfbd08,c1080960,3d7,0,...) at vm_daemon+0xac/frame 0xe3bfbccc fork_exit(c0d27750,0,e3bfbd08) at fork_exit+0x7f/frame 0xe3bfbcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3bfbcf4 --- trap 0, eip = 0, esp = 0xe3bfbd40, ebp = 0 --- Tracing command pagedaemon pid 5 tid 100068 td 0xc794d300 sched_switch(c794d300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3bf8b30 mi_switch(104,0,c108cb51,1f5,101,...) at mi_switch+0x1c9/frame 0xe3bf8b64 sleepq_switch(c794d300,0,c108cb51,28e,c794d300,...) at sleepq_switch+0x1b9/frame 0xe3bf8b98 sleepq_timedwait(c1403484,54,4,0,0,...) at sleepq_timedwait+0x48/frame 0xe3bf8bbc _sleep(c1403484,c1403400,54,c109566c,fffffa38,...) at _sleep+0x345/frame 0xe3bf8c18 vm_pageout(0,e3bf8d08,c1080960,3d7,0,...) at vm_pageout+0x290/frame 0xe3bf8ccc fork_exit(c0d27f70,0,e3bf8d08) at fork_exit+0x7f/frame 0xe3bf8cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3bf8cf4 --- trap 0, eip = 0, esp = 0xe3bf8d40, ebp = 0 --- Tracing command xpt_thrd pid 4 tid 100067 td 0xc794d600 sched_switch(c794d600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3bb5bb0 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xe3bb5be4 sleepq_switch(c794d600,0,c108cb51,26b,c794d600,...) at sleepq_switch+0x1b9/frame 0xe3bb5c18 sleepq_wait(c11fefa4,5c,c0edb000,0,0,...) at sleepq_wait+0x48/frame 0xe3bb5c3c _sleep(c11fefa4,c11feff4,5c,c0edb000,0,...) at _sleep+0x37c/frame 0xe3bb5c98 xpt_scanner_thread(0,e3bb5d08,c1080960,3d7,0,...) at xpt_scanner_thread+0x11c/frame 0xe3bb5ccc fork_exit(c04b21c0,0,e3bb5d08) at fork_exit+0x7f/frame 0xe3bb5cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3bb5cf4 --- trap 0, eip = 0, esp = 0xe3bb5d40, ebp = 0 --- Tracing command sctp_iterator pid 3 tid 100066 td 0xc794d900 sched_switch(c794d900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3bb2bb8 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xe3bb2bec sleepq_switch(c794d900,0,c108cb51,26b,c794d900,...) at sleepq_switch+0x1b9/frame 0xe3bb2c20 sleepq_wait(c13fee58,0,c10ac0e5,0,0,...) at sleepq_wait+0x48/frame 0xe3bb2c44 _sleep(c13fee58,c13fee20,0,c10ac0e5,0,...) at _sleep+0x37c/frame 0xe3bb2ca0 sctp_iterator_thread(0,e3bb2d08,c1080960,3d7,0,...) at sctp_iterator_thread+0x7c/frame 0xe3bb2ccc fork_exit(c0bd22c0,0,e3bb2d08) at fork_exit+0x7f/frame 0xe3bb2cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3bb2cf4 --- trap 0, eip = 0, esp = 0xe3bb2d40, ebp = 0 --- Tracing command fdc0 pid 2 tid 100061 td 0xc78e9900 sched_switch(c78e9900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3ba2b48 mi_switch(104,0,c108cb51,1f5,101,...) at mi_switch+0x1c9/frame 0xe3ba2b7c sleepq_switch(c78e9900,0,c108cb51,28e,c78e9900,...) at sleepq_switch+0x1b9/frame 0xe3ba2bb0 sleepq_timedwait(c789bc3c,5c,0,0,0,...) at sleepq_timedwait+0x48/frame 0xe3ba2bd4 _sleep(c789bc3c,c789bcf0,5c,c1072c22,fffffed8,...) at _sleep+0x345/frame 0xe3ba2c30 fdc_thread(c789bc00,e3ba2d08,c1080960,3d7,0,...) at fdc_thread+0x877/frame 0xe3ba2ccc fork_exit(c0e3a270,c789bc00,e3ba2d08) at fork_exit+0x7f/frame 0xe3ba2cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3ba2cf4 --- trap 0, eip = 0, esp = 0xe3ba2d40, ebp = 0 --- Tracing command usb pid 15 tid 100058 td 0xc78f7300 sched_switch(c78f7300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b7ebd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b7ec08 sleepq_switch(c78f7300,0,c108cb51,26b,c78f7300,...) at sleepq_switch+0x1b9/frame 0xe3b7ec3c sleepq_wait(c78ffd34,0,e3b7ec90,1,0,...) at sleepq_wait+0x48/frame 0xe3b7ec60 _cv_wait(c78ffd34,c78ffe4c,c10643f7,77,c78ffd3c,...) at _cv_wait+0x1f9/frame 0xe3b7eca4 usb_process(c78ffd2c,e3b7ed08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b7eccc fork_exit(c09376f0,c78ffd2c,e3b7ed08) at fork_exit+0x7f/frame 0xe3b7ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b7ecf4 --- trap 0, eip = 0, esp = 0xe3b7ed40, ebp = 0 --- Tracing command usb pid 15 tid 100057 td 0xc78f7600 sched_switch(c78f7600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b7bbd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b7bc08 sleepq_switch(c78f7600,0,c108cb51,26b,c78f7600,...) at sleepq_switch+0x1b9/frame 0xe3b7bc3c sleepq_wait(c78ffd04,0,e3b7bc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b7bc60 _cv_wait(c78ffd04,c78ffe4c,c10643f7,77,c78ffd0c,...) at _cv_wait+0x1f9/frame 0xe3b7bca4 usb_process(c78ffcfc,e3b7bd08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b7bccc fork_exit(c09376f0,c78ffcfc,e3b7bd08) at fork_exit+0x7f/frame 0xe3b7bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b7bcf4 --- trap 0, eip = 0, esp = 0xe3b7bd40, ebp = 0 --- Tracing command usb pid 15 tid 100056 td 0xc78f7900 sched_switch(c78f7900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b78bd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b78c08 sleepq_switch(c78f7900,0,c108cb51,26b,c78f7900,...) at sleepq_switch+0x1b9/frame 0xe3b78c3c sleepq_wait(c78ffcd4,0,e3b78c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b78c60 _cv_wait(c78ffcd4,c78ffe4c,c10643f7,77,c78ffcdc,...) at _cv_wait+0x1f9/frame 0xe3b78ca4 usb_process(c78ffccc,e3b78d08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b78ccc fork_exit(c09376f0,c78ffccc,e3b78d08) at fork_exit+0x7f/frame 0xe3b78cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b78cf4 --- trap 0, eip = 0, esp = 0xe3b78d40, ebp = 0 --- Tracing command usb pid 15 tid 100055 td 0xc78f7c00 sched_switch(c78f7c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b75bd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b75c08 sleepq_switch(c78f7c00,0,c108cb51,26b,c78f7c00,...) at sleepq_switch+0x1b9/frame 0xe3b75c3c sleepq_wait(c78ffca4,0,e3b75c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b75c60 _cv_wait(c78ffca4,c78ffe4c,c10643f7,77,c78ffcac,...) at _cv_wait+0x1f9/frame 0xe3b75ca4 usb_process(c78ffc9c,e3b75d08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b75ccc fork_exit(c09376f0,c78ffc9c,e3b75d08) at fork_exit+0x7f/frame 0xe3b75cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b75cf4 --- trap 0, eip = 0, esp = 0xe3b75d40, ebp = 0 --- Tracing command usb pid 15 tid 100053 td 0xc78f9300 sched_switch(c78f9300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b6cbd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b6cc08 sleepq_switch(c78f9300,0,c108cb51,26b,c78f9300,...) at sleepq_switch+0x1b9/frame 0xe3b6cc3c sleepq_wait(c78f3b5c,0,e3b6cc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b6cc60 _cv_wait(c78f3b5c,c78f3c74,c10643f7,77,c78f3b64,...) at _cv_wait+0x1f9/frame 0xe3b6cca4 usb_process(c78f3b54,e3b6cd08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b6cccc fork_exit(c09376f0,c78f3b54,e3b6cd08) at fork_exit+0x7f/frame 0xe3b6ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b6ccf4 --- trap 0, eip = 0, esp = 0xe3b6cd40, ebp = 0 --- Tracing command usb pid 15 tid 100052 td 0xc78f9600 sched_switch(c78f9600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b69bd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b69c08 sleepq_switch(c78f9600,0,c108cb51,26b,c78f9600,...) at sleepq_switch+0x1b9/frame 0xe3b69c3c sleepq_wait(c78f3b2c,0,e3b69c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b69c60 _cv_wait(c78f3b2c,c78f3c74,c10643f7,77,c78f3b34,...) at _cv_wait+0x1f9/frame 0xe3b69ca4 usb_process(c78f3b24,e3b69d08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b69ccc fork_exit(c09376f0,c78f3b24,e3b69d08) at fork_exit+0x7f/frame 0xe3b69cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b69cf4 --- trap 0, eip = 0, esp = 0xe3b69d40, ebp = 0 --- Tracing command usb pid 15 tid 100051 td 0xc78e6000 sched_switch(c78e6000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b66bd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b66c08 sleepq_switch(c78e6000,0,c108cb51,26b,c78e6000,...) at sleepq_switch+0x1b9/frame 0xe3b66c3c sleepq_wait(c78f3afc,0,e3b66c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b66c60 _cv_wait(c78f3afc,c78f3c74,c10643f7,77,c78f3b04,...) at _cv_wait+0x1f9/frame 0xe3b66ca4 usb_process(c78f3af4,e3b66d08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b66ccc fork_exit(c09376f0,c78f3af4,e3b66d08) at fork_exit+0x7f/frame 0xe3b66cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b66cf4 --- trap 0, eip = 0, esp = 0xe3b66d40, ebp = 0 --- Tracing command usb pid 15 tid 100050 td 0xc78e6300 sched_switch(c78e6300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b63bd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b63c08 sleepq_switch(c78e6300,0,c108cb51,26b,c78e6300,...) at sleepq_switch+0x1b9/frame 0xe3b63c3c sleepq_wait(c78f3acc,0,e3b63c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b63c60 _cv_wait(c78f3acc,c78f3c74,c10643f7,77,c78f3ad4,...) at _cv_wait+0x1f9/frame 0xe3b63ca4 usb_process(c78f3ac4,e3b63d08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b63ccc fork_exit(c09376f0,c78f3ac4,e3b63d08) at fork_exit+0x7f/frame 0xe3b63cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b63cf4 --- trap 0, eip = 0, esp = 0xe3b63d40, ebp = 0 --- Tracing command usb pid 15 tid 100049 td 0xc78e6600 sched_switch(c78e6600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b5fbd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b5fc08 sleepq_switch(c78e6600,0,c108cb51,26b,c78e6600,...) at sleepq_switch+0x1b9/frame 0xe3b5fc3c sleepq_wait(c78efb5c,0,e3b5fc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b5fc60 _cv_wait(c78efb5c,c78efc74,c10643f7,77,c78efb64,...) at _cv_wait+0x1f9/frame 0xe3b5fca4 usb_process(c78efb54,e3b5fd08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b5fccc fork_exit(c09376f0,c78efb54,e3b5fd08) at fork_exit+0x7f/frame 0xe3b5fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b5fcf4 --- trap 0, eip = 0, esp = 0xe3b5fd40, ebp = 0 --- Tracing command usb pid 15 tid 100048 td 0xc78e6900 sched_switch(c78e6900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b5cbd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b5cc08 sleepq_switch(c78e6900,0,c108cb51,26b,c78e6900,...) at sleepq_switch+0x1b9/frame 0xe3b5cc3c sleepq_wait(c78efb2c,0,e3b5cc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b5cc60 _cv_wait(c78efb2c,c78efc74,c10643f7,77,c78efb34,...) at _cv_wait+0x1f9/frame 0xe3b5cca4 usb_process(c78efb24,e3b5cd08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b5cccc fork_exit(c09376f0,c78efb24,e3b5cd08) at fork_exit+0x7f/frame 0xe3b5ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b5ccf4 --- trap 0, eip = 0, esp = 0xe3b5cd40, ebp = 0 --- Tracing command usb pid 15 tid 100047 td 0xc78e6c00 sched_switch(c78e6c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b59bd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b59c08 sleepq_switch(c78e6c00,0,c108cb51,26b,c78e6c00,...) at sleepq_switch+0x1b9/frame 0xe3b59c3c sleepq_wait(c78efafc,0,e3b59c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b59c60 _cv_wait(c78efafc,c78efc74,c10643f7,77,c78efb04,...) at _cv_wait+0x1f9/frame 0xe3b59ca4 usb_process(c78efaf4,e3b59d08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b59ccc fork_exit(c09376f0,c78efaf4,e3b59d08) at fork_exit+0x7f/frame 0xe3b59cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b59cf4 --- trap 0, eip = 0, esp = 0xe3b59d40, ebp = 0 --- Tracing command usb pid 15 tid 100046 td 0xc78e7000 sched_switch(c78e7000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b56bd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b56c08 sleepq_switch(c78e7000,0,c108cb51,26b,c78e7000,...) at sleepq_switch+0x1b9/frame 0xe3b56c3c sleepq_wait(c78efacc,0,e3b56c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b56c60 _cv_wait(c78efacc,c78efc74,c10643f7,77,c78efad4,...) at _cv_wait+0x1f9/frame 0xe3b56ca4 usb_process(c78efac4,e3b56d08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b56ccc fork_exit(c09376f0,c78efac4,e3b56d08) at fork_exit+0x7f/frame 0xe3b56cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b56cf4 --- trap 0, eip = 0, esp = 0xe3b56d40, ebp = 0 --- Tracing command usb pid 15 tid 100045 td 0xc78e7300 sched_switch(c78e7300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b52bd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b52c08 sleepq_switch(c78e7300,0,c108cb51,26b,c78e7300,...) at sleepq_switch+0x1b9/frame 0xe3b52c3c sleepq_wait(c78e2b5c,0,e3b52c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b52c60 _cv_wait(c78e2b5c,c78e2c74,c10643f7,77,c78e2b64,...) at _cv_wait+0x1f9/frame 0xe3b52ca4 usb_process(c78e2b54,e3b52d08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b52ccc fork_exit(c09376f0,c78e2b54,e3b52d08) at fork_exit+0x7f/frame 0xe3b52cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b52cf4 --- trap 0, eip = 0, esp = 0xe3b52d40, ebp = 0 --- Tracing command usb pid 15 tid 100044 td 0xc78e7600 sched_switch(c78e7600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b4fbd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b4fc08 sleepq_switch(c78e7600,0,c108cb51,26b,c78e7600,...) at sleepq_switch+0x1b9/frame 0xe3b4fc3c sleepq_wait(c78e2b2c,0,e3b4fc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b4fc60 _cv_wait(c78e2b2c,c78e2c74,c10643f7,77,c78e2b34,...) at _cv_wait+0x1f9/frame 0xe3b4fca4 usb_process(c78e2b24,e3b4fd08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b4fccc fork_exit(c09376f0,c78e2b24,e3b4fd08) at fork_exit+0x7f/frame 0xe3b4fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b4fcf4 --- trap 0, eip = 0, esp = 0xe3b4fd40, ebp = 0 --- Tracing command usb pid 15 tid 100043 td 0xc78e7900 sched_switch(c78e7900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b4cbd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b4cc08 sleepq_switch(c78e7900,0,c108cb51,26b,c78e7900,...) at sleepq_switch+0x1b9/frame 0xe3b4cc3c sleepq_wait(c78e2afc,0,e3b4cc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b4cc60 _cv_wait(c78e2afc,c78e2c74,c10643f7,77,c78e2b04,...) at _cv_wait+0x1f9/frame 0xe3b4cca4 usb_process(c78e2af4,e3b4cd08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b4cccc fork_exit(c09376f0,c78e2af4,e3b4cd08) at fork_exit+0x7f/frame 0xe3b4ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b4ccf4 --- trap 0, eip = 0, esp = 0xe3b4cd40, ebp = 0 --- Tracing command usb pid 15 tid 100042 td 0xc78e7c00 sched_switch(c78e7c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b49bd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b49c08 sleepq_switch(c78e7c00,0,c108cb51,26b,c78e7c00,...) at sleepq_switch+0x1b9/frame 0xe3b49c3c sleepq_wait(c78e2acc,0,e3b49c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b49c60 _cv_wait(c78e2acc,c78e2c74,c10643f7,77,c78e2ad4,...) at _cv_wait+0x1f9/frame 0xe3b49ca4 usb_process(c78e2ac4,e3b49d08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b49ccc fork_exit(c09376f0,c78e2ac4,e3b49d08) at fork_exit+0x7f/frame 0xe3b49cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b49cf4 --- trap 0, eip = 0, esp = 0xe3b49d40, ebp = 0 --- Tracing command usb pid 15 tid 100040 td 0xc78d8000 sched_switch(c78d8000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b42bd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b42c08 sleepq_switch(c78d8000,0,c108cb51,26b,c78d8000,...) at sleepq_switch+0x1b9/frame 0xe3b42c3c sleepq_wait(c78ddb5c,0,e3b42c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b42c60 _cv_wait(c78ddb5c,c78ddc74,c10643f7,77,c78ddb64,...) at _cv_wait+0x1f9/frame 0xe3b42ca4 usb_process(c78ddb54,e3b42d08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b42ccc fork_exit(c09376f0,c78ddb54,e3b42d08) at fork_exit+0x7f/frame 0xe3b42cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b42cf4 --- trap 0, eip = 0, esp = 0xe3b42d40, ebp = 0 --- Tracing command usb pid 15 tid 100039 td 0xc78d8300 sched_switch(c78d8300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b3fbd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b3fc08 sleepq_switch(c78d8300,0,c108cb51,26b,c78d8300,...) at sleepq_switch+0x1b9/frame 0xe3b3fc3c sleepq_wait(c78ddb2c,0,e3b3fc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b3fc60 _cv_wait(c78ddb2c,c78ddc74,c10643f7,77,c78ddb34,...) at _cv_wait+0x1f9/frame 0xe3b3fca4 usb_process(c78ddb24,e3b3fd08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b3fccc fork_exit(c09376f0,c78ddb24,e3b3fd08) at fork_exit+0x7f/frame 0xe3b3fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b3fcf4 --- trap 0, eip = 0, esp = 0xe3b3fd40, ebp = 0 --- Tracing command usb pid 15 tid 100038 td 0xc78d8600 sched_switch(c78d8600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b3cbd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b3cc08 sleepq_switch(c78d8600,0,c108cb51,26b,c78d8600,...) at sleepq_switch+0x1b9/frame 0xe3b3cc3c sleepq_wait(c78ddafc,0,e3b3cc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b3cc60 _cv_wait(c78ddafc,c78ddc74,c10643f7,77,c78ddb04,...) at _cv_wait+0x1f9/frame 0xe3b3cca4 usb_process(c78ddaf4,e3b3cd08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b3cccc fork_exit(c09376f0,c78ddaf4,e3b3cd08) at fork_exit+0x7f/frame 0xe3b3ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b3ccf4 --- trap 0, eip = 0, esp = 0xe3b3cd40, ebp = 0 --- Tracing command usb pid 15 tid 100037 td 0xc78d8900 sched_switch(c78d8900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b39bd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b39c08 sleepq_switch(c78d8900,0,c108cb51,26b,c78d8900,...) at sleepq_switch+0x1b9/frame 0xe3b39c3c sleepq_wait(c78ddacc,0,e3b39c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b39c60 _cv_wait(c78ddacc,c78ddc74,c10643f7,77,c78ddad4,...) at _cv_wait+0x1f9/frame 0xe3b39ca4 usb_process(c78ddac4,e3b39d08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b39ccc fork_exit(c09376f0,c78ddac4,e3b39d08) at fork_exit+0x7f/frame 0xe3b39cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b39cf4 --- trap 0, eip = 0, esp = 0xe3b39d40, ebp = 0 --- Tracing command usb pid 15 tid 100035 td 0xc78db000 sched_switch(c78db000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b32bd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b32c08 sleepq_switch(c78db000,0,c108cb51,26b,c78db000,...) at sleepq_switch+0x1b9/frame 0xe3b32c3c sleepq_wait(c78d4b5c,0,e3b32c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b32c60 _cv_wait(c78d4b5c,c78d4c74,c10643f7,77,c78d4b64,...) at _cv_wait+0x1f9/frame 0xe3b32ca4 usb_process(c78d4b54,e3b32d08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b32ccc fork_exit(c09376f0,c78d4b54,e3b32d08) at fork_exit+0x7f/frame 0xe3b32cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b32cf4 --- trap 0, eip = 0, esp = 0xe3b32d40, ebp = 0 --- Tracing command usb pid 15 tid 100034 td 0xc78db300 sched_switch(c78db300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b2fbd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b2fc08 sleepq_switch(c78db300,0,c108cb51,26b,c78db300,...) at sleepq_switch+0x1b9/frame 0xe3b2fc3c sleepq_wait(c78d4b2c,0,e3b2fc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b2fc60 _cv_wait(c78d4b2c,c78d4c74,c10643f7,77,c78d4b34,...) at _cv_wait+0x1f9/frame 0xe3b2fca4 usb_process(c78d4b24,e3b2fd08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b2fccc fork_exit(c09376f0,c78d4b24,e3b2fd08) at fork_exit+0x7f/frame 0xe3b2fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b2fcf4 --- trap 0, eip = 0, esp = 0xe3b2fd40, ebp = 0 --- Tracing command usb pid 15 tid 100033 td 0xc78db600 sched_switch(c78db600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b2cbd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b2cc08 sleepq_switch(c78db600,0,c108cb51,26b,c78db600,...) at sleepq_switch+0x1b9/frame 0xe3b2cc3c sleepq_wait(c78d4afc,0,e3b2cc90,1,0,...) at sleepq_wait+0x48/frame 0xe3b2cc60 _cv_wait(c78d4afc,c78d4c74,c10643f7,77,c78d4b04,...) at _cv_wait+0x1f9/frame 0xe3b2cca4 usb_process(c78d4af4,e3b2cd08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b2cccc fork_exit(c09376f0,c78d4af4,e3b2cd08) at fork_exit+0x7f/frame 0xe3b2ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b2ccf4 --- trap 0, eip = 0, esp = 0xe3b2cd40, ebp = 0 --- Tracing command usb pid 15 tid 100032 td 0xc78db900 sched_switch(c78db900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3b29bd4 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xe3b29c08 sleepq_switch(c78db900,0,c108cb51,26b,c78db900,...) at sleepq_switch+0x1b9/frame 0xe3b29c3c sleepq_wait(c78d4acc,0,e3b29c90,1,0,...) at sleepq_wait+0x48/frame 0xe3b29c60 _cv_wait(c78d4acc,c78d4c74,c10643f7,77,c78d4ad4,...) at _cv_wait+0x1f9/frame 0xe3b29ca4 usb_process(c78d4ac4,e3b29d08,c1080960,3d7,0,...) at usb_process+0xe6/frame 0xe3b29ccc fork_exit(c09376f0,c78d4ac4,e3b29d08) at fork_exit+0x7f/frame 0xe3b29cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b29cf4 --- trap 0, eip = 0, esp = 0xe3b29d40, ebp = 0 --- Tracing command yarrow pid 14 tid 100017 td 0xc7776600 sched_switch(c7776600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xc7236bb4 mi_switch(104,0,c108cb51,1f5,c124f0f0,...) at mi_switch+0x1c9/frame 0xc7236be8 sleepq_switch(c7776600,0,c108cb51,28e,c1219104,...) at sleepq_switch+0x1b9/frame 0xc7236c1c sleepq_timedwait(c1219104,0,c1087a5d,c1072c22,0,...) at sleepq_timedwait+0x48/frame 0xc7236c40 msleep_spin_sbt(c1219104,c13f9790,c1072c22,19999999,0,...) at msleep_spin_sbt+0x225/frame 0xc7236c88 random_kthread(0,c7236d08,c1080960,3d7,0,...) at random_kthread+0x2ea/frame 0xc7236ccc fork_exit(c0825e10,0,c7236d08) at fork_exit+0x7f/frame 0xc7236cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7236cf4 --- trap 0, eip = 0, esp = 0xc7236d40, ebp = 0 --- Tracing command geom pid 13 tid 100016 td 0xc7776900 sched_switch(c7776900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xc7232b70 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xc7232ba4 sleepq_switch(c7776900,0,c108cb51,26b,c7776900,...) at sleepq_switch+0x1b9/frame 0xc7232bd8 sleepq_wait(c13faa64,5c,c1072c22,0,0,...) at sleepq_wait+0x48/frame 0xc7232bfc _sleep(c13faa64,c12306ac,25c,c1072c22,0,...) at _sleep+0x37c/frame 0xc7232c58 g_io_schedule_down(c7776900,0,c1074949,6c,c7232cf4,...) at g_io_schedule_down+0x5c/frame 0xc7232cb4 g_down_procbody(0,c7232d08,c1080960,3d7,0,...) at g_down_procbody+0x9d/frame 0xc7232ccc fork_exit(c09e6610,0,c7232d08) at fork_exit+0x7f/frame 0xc7232cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7232cf4 --- trap 0, eip = 0, esp = 0xc7232d40, ebp = 0 --- Tracing command geom pid 13 tid 100015 td 0xc7776c00 sched_switch(c7776c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xc722fb98 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xc722fbcc sleepq_switch(c7776c00,0,c108cb51,26b,c7776c00,...) at sleepq_switch+0x1b9/frame 0xc722fc00 sleepq_wait(c13faa60,5c,c1072c22,0,0,...) at sleepq_wait+0x48/frame 0xc722fc24 _sleep(c13faa60,c12306cc,25c,c1072c22,0,...) at _sleep+0x37c/frame 0xc722fc80 g_io_schedule_up(c7776c00,0,c1074949,5f,c722fcf4,...) at g_io_schedule_up+0xe6/frame 0xc722fcb4 g_up_procbody(0,c722fd08,c1080960,3d7,0,...) at g_up_procbody+0x9d/frame 0xc722fccc fork_exit(c09e6570,0,c722fd08) at fork_exit+0x7f/frame 0xc722fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc722fcf4 --- trap 0, eip = 0, esp = 0xc722fd40, ebp = 0 --- Tracing command geom pid 13 tid 100014 td 0xc7777000 sched_switch(c7777000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xc722cba8 mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xc722cbdc sleepq_switch(c7777000,0,c108cb51,26b,c7777000,...) at sleepq_switch+0x1b9/frame 0xc722cc10 sleepq_wait(c13faa5c,5c,c1072c22,0,0,...) at sleepq_wait+0x48/frame 0xc722cc34 _sleep(c13faa5c,c1230684,25c,c1072c22,0,...) at _sleep+0x37c/frame 0xc722cc90 g_run_events(0,c722cd08,c1080960,3d7,0,...) at g_run_events+0x566/frame 0xc722cccc fork_exit(c09e64d0,0,c722cd08) at fork_exit+0x7f/frame 0xc722ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc722ccf4 --- trap 0, eip = 0, esp = 0xc722cd40, ebp = 0 --- Tracing command intr pid 12 tid 100063 td 0xc78e9300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100062 td 0xc78e9600 sched_switch(c78e9600,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xe3ba5c60 mi_switch(109,0,c1080bfd,55a,8,...) at mi_switch+0x1c9/frame 0xe3ba5c94 ithread_loop(c76c7910,e3ba5d08,c1080960,3d7,0,...) at ithread_loop+0x100/frame 0xe3ba5ccc fork_exit(c0a596b0,c76c7910,e3ba5d08) at fork_exit+0x7f/frame 0xe3ba5cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3ba5cf4 --- trap 0, eip = 0, esp = 0xe3ba5d40, ebp = 0 --- Tracing command intr pid 12 tid 100060 td 0xc78e9c00 sched_switch(c78e9c00,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xe3b95c60 mi_switch(109,0,c1080bfd,55a,8,...) at mi_switch+0x1c9/frame 0xe3b95c94 ithread_loop(c76c7920,e3b95d08,c1080960,3d7,0,...) at ithread_loop+0x100/frame 0xe3b95ccc fork_exit(c0a596b0,c76c7920,e3b95d08) at fork_exit+0x7f/frame 0xe3b95cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b95cf4 --- trap 0, eip = 0, esp = 0xe3b95d40, ebp = 0 --- Tracing command intr pid 12 tid 100059 td 0xc78f7000 sched_switch(c78f7000,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xe3b84c60 mi_switch(109,0,c1080bfd,55a,8,...) at mi_switch+0x1c9/frame 0xe3b84c94 ithread_loop(c76c7940,e3b84d08,c1080960,3d7,0,...) at ithread_loop+0x100/frame 0xe3b84ccc fork_exit(c0a596b0,c76c7940,e3b84d08) at fork_exit+0x7f/frame 0xe3b84cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b84cf4 --- trap 0, eip = 0, esp = 0xe3b84d40, ebp = 0 --- Tracing command intr pid 12 tid 100054 td 0xc78f9000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xc78e9000 sched_switch(c78e9000,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xe3b46c60 mi_switch(109,0,c1080bfd,55a,8,...) at mi_switch+0x1c9/frame 0xe3b46c94 ithread_loop(c76c7960,e3b46d08,c1080960,3d7,0,...) at ithread_loop+0x100/frame 0xe3b46ccc fork_exit(c0a596b0,c76c7960,e3b46d08) at fork_exit+0x7f/frame 0xe3b46cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b46cf4 --- trap 0, eip = 0, esp = 0xe3b46d40, ebp = 0 --- Tracing command intr pid 12 tid 100036 td 0xc78d8c00 sched_switch(c78d8c00,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xe3b36c60 mi_switch(109,0,c1080bfd,55a,8,...) at mi_switch+0x1c9/frame 0xe3b36c94 ithread_loop(c76c7970,e3b36d08,c1080960,3d7,0,...) at ithread_loop+0x100/frame 0xe3b36ccc fork_exit(c0a596b0,c76c7970,e3b36d08) at fork_exit+0x7f/frame 0xe3b36cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b36cf4 --- trap 0, eip = 0, esp = 0xe3b36d40, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xc78dbc00 sched_switch(c78dbc00,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xe3b26c60 mi_switch(109,0,c1080bfd,55a,8,...) at mi_switch+0x1c9/frame 0xe3b26c94 ithread_loop(c76c7980,e3b26d08,c1080960,3d7,0,...) at ithread_loop+0x100/frame 0xe3b26ccc fork_exit(c0a596b0,c76c7980,e3b26d08) at fork_exit+0x7f/frame 0xe3b26cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3b26cf4 --- trap 0, eip = 0, esp = 0xe3b26d40, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc7777300 sched_switch(c7777300,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xc7393c60 mi_switch(109,0,c1080bfd,55a,8,...) at mi_switch+0x1c9/frame 0xc7393c94 ithread_loop(c76c79d0,c7393d08,c1080960,3d7,0,...) at ithread_loop+0x100/frame 0xc7393ccc fork_exit(c0a596b0,c76c79d0,c7393d08) at fork_exit+0x7f/frame 0xc7393cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7393cf4 --- trap 0, eip = 0, esp = 0xc7393d40, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc7777600 sched_switch(c7777600,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xc738fc60 mi_switch(109,0,c1080bfd,55a,8,...) at mi_switch+0x1c9/frame 0xc738fc94 ithread_loop(c76c79e0,c738fd08,c1080960,3d7,0,...) at ithread_loop+0x100/frame 0xc738fccc fork_exit(c0a596b0,c76c79e0,c738fd08) at fork_exit+0x7f/frame 0xc738fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc738fcf4 --- trap 0, eip = 0, esp = 0xc738fd40, ebp = 0 --- Tracing command intr pid 12 tid 100028 td 0xc7777900 sched_switch(c7777900,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xc7286c60 mi_switch(109,0,c1080bfd,55a,8,...) at mi_switch+0x1c9/frame 0xc7286c94 ithread_loop(c76c7a00,c7286d08,c1080960,3d7,0,...) at ithread_loop+0x100/frame 0xc7286ccc fork_exit(c0a596b0,c76c7a00,c7286d08) at fork_exit+0x7f/frame 0xc7286cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7286cf4 --- trap 0, eip = 0, esp = 0xc7286d40, ebp = 0 --- Tracing command intr pid 12 tid 100027 td 0xc7777c00 sched_switch(c7777c00,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xc7254c60 mi_switch(109,0,c1080bfd,55a,8,...) at mi_switch+0x1c9/frame 0xc7254c94 ithread_loop(c76c7a10,c7254d08,c1080960,3d7,0,...) at ithread_loop+0x100/frame 0xc7254ccc fork_exit(c0a596b0,c76c7a10,c7254d08) at fork_exit+0x7f/frame 0xc7254cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7254cf4 --- trap 0, eip = 0, esp = 0xc7254d40, ebp = 0 --- Tracing command intr pid 12 tid 100025 td 0xc7869300 sched_switch(c7869300,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xc724ec60 mi_switch(109,0,c1080bfd,55a,8,...) at mi_switch+0x1c9/frame 0xc724ec94 ithread_loop(c76c7a30,c724ed08,c1080960,3d7,0,...) at ithread_loop+0x100/frame 0xc724eccc fork_exit(c0a596b0,c76c7a30,c724ed08) at fork_exit+0x7f/frame 0xc724ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc724ecf4 --- trap 0, eip = 0, esp = 0xc724ed40, ebp = 0 --- Tracing command intr pid 12 tid 100020 td 0xc7715c00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100018 td 0xc7776300 sched_switch(c7776300,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xc7239c60 mi_switch(109,0,c1080bfd,55a,8,...) at mi_switch+0x1c9/frame 0xc7239c94 ithread_loop(c76c7ae0,c7239d08,c1080960,3d7,0,...) at ithread_loop+0x100/frame 0xc7239ccc fork_exit(c0a596b0,c76c7ae0,c7239d08) at fork_exit+0x7f/frame 0xc7239cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7239cf4 --- trap 0, eip = 0, esp = 0xc7239d40, ebp = 0 --- Tracing command intr pid 12 tid 100012 td 0xc76d2600 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100011 td 0xc76d2900 sched_switch(c76d2900,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xc7223c60 mi_switch(109,0,c1080bfd,55a,8,...) at mi_switch+0x1c9/frame 0xc7223c94 ithread_loop(c76c7b10,c7223d08,c1080960,3d7,0,...) at ithread_loop+0x100/frame 0xc7223ccc fork_exit(c0a596b0,c76c7b10,c7223d08) at fork_exit+0x7f/frame 0xc7223cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7223cf4 --- trap 0, eip = 0, esp = 0xc7223d40, ebp = 0 --- Tracing command intr pid 12 tid 100010 td 0xc76d2c00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100009 td 0xc7715000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100008 td 0xc7715300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100007 td 0xc7715600 sched_switch(c7715600,0,109,1b5,0,...) at sched_switch+0x4b9/frame 0xc7217c60 mi_switch(109,0,c1080bfd,55a,8,...) at mi_switch+0x1c9/frame 0xc7217c94 ithread_loop(c76c7b50,c7217d08,c1080960,3d7,0,...) at ithread_loop+0x100/frame 0xc7217ccc fork_exit(c0a596b0,c76c7b50,c7217d08) at fork_exit+0x7f/frame 0xc7217cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7217cf4 --- trap 0, eip = 0, esp = 0xc7217d40, ebp = 0 --- Tracing command idle pid 11 tid 100006 td 0xc76cd000 cpustop_handler(3,13,c7213b90,c0eab5bb,3e3cf5,...) at cpustop_handler+0x2f/frame 0xc7213a40 ipi_nmi_handler(3e3cf5,0,0,c7213a94,c0a4b44b,...) at ipi_nmi_handler+0x37/frame 0xc7213a50 trap(c7213b9c) at trap+0x3b/frame 0xc7213b90 calltrap() at calltrap+0x6/frame 0xc7213b90 --- trap 0x13, eip = 0xc0e90fb5, esp = 0xc7213bdc, ebp = 0xc7213bdc --- acpi_cpu_c1(c0eb436b,c7200c90,0,c10e0187,303,...) at acpi_cpu_c1+0x5/frame 0xc7213bdc acpi_cpu_idle(376511ac,0,376511ac,c7213c50,c0e9b10a,...) at acpi_cpu_idle+0x146/frame 0xc7213c20 cpu_idle_acpi(376511ac,0,2,c1240c08,c1240c16,...) at cpu_idle_acpi+0x3f/frame 0xc7213c34 cpu_idle(0,2,c10893dd,a46,c1240c08,...) at cpu_idle+0x9a/frame 0xc7213c50 sched_idletd(0,c7213d08,c1080960,3d7,0,...) at sched_idletd+0x1d6/frame 0xc7213ccc fork_exit(c0aafee0,0,c7213d08) at fork_exit+0x7f/frame 0xc7213cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7213cf4 --- trap 0, eip = 0, esp = 0xc7213d40, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc76cd300 cpustop_handler(2,13,c7210b90,c0eab5bb,40adc5,...) at cpustop_handler+0x2f/frame 0xc7210a40 ipi_nmi_handler(40adc5,0,0,c7210a94,c0a4b44b,...) at ipi_nmi_handler+0x37/frame 0xc7210a50 trap(c7210b9c) at trap+0x3b/frame 0xc7210b90 calltrap() at calltrap+0x6/frame 0xc7210b90 --- trap 0x13, eip = 0xc0e90fb5, esp = 0xc7210bdc, ebp = 0xc7210bdc --- acpi_cpu_c1(c0eb436b,c71fdc90,0,c10e0187,303,...) at acpi_cpu_c1+0x5/frame 0xc7210bdc acpi_cpu_idle(26a564fa,0,26a564fa,c7210c50,c0e9b10a,...) at acpi_cpu_idle+0x146/frame 0xc7210c20 cpu_idle_acpi(26a564fa,0,1,c1240508,c1240516,...) at cpu_idle_acpi+0x3f/frame 0xc7210c34 cpu_idle(0,2,c10893dd,a46,c1240508,...) at cpu_idle+0x9a/frame 0xc7210c50 sched_idletd(0,c7210d08,c1080960,3d7,0,...) at sched_idletd+0x1d6/frame 0xc7210ccc fork_exit(c0aafee0,0,c7210d08) at fork_exit+0x7f/frame 0xc7210cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7210cf4 --- trap 0, eip = 0, esp = 0xc7210d40, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc76cd600 cpustop_handler(1,13,c720db90,c0eab5bb,2705f4,...) at cpustop_handler+0x2f/frame 0xc720da40 ipi_nmi_handler(2705f4,0,0,c720da94,c0a4b44b,...) at ipi_nmi_handler+0x37/frame 0xc720da50 trap(c720db9c) at trap+0x3b/frame 0xc720db90 calltrap() at calltrap+0x6/frame 0xc720db90 --- trap 0x13, eip = 0xc0e90fb5, esp = 0xc720dbdc, ebp = 0xc720dbdc --- acpi_cpu_c1(c0eb436b,c71fac90,0,c10e0187,303,...) at acpi_cpu_c1+0x5/frame 0xc720dbdc acpi_cpu_idle(7fe3edc8,0,7fe3edc8,c720dc50,c0e9b10a,...) at acpi_cpu_idle+0x146/frame 0xc720dc20 cpu_idle_acpi(7fe3edc8,0,0,c123fe08,c123fe16,...) at cpu_idle_acpi+0x3f/frame 0xc720dc34 cpu_idle(0,2,c10893dd,a46,c123fe08,...) at cpu_idle+0x9a/frame 0xc720dc50 sched_idletd(0,c720dd08,c1080960,3d7,0,...) at sched_idletd+0x1d6/frame 0xc720dccc fork_exit(c0aafee0,0,c720dd08) at fork_exit+0x7f/frame 0xc720dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc720dcf4 --- trap 0, eip = 0, esp = 0xc720dd40, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xc76cd900 kdb_enter(c0f121ea,c100864c,0,0,35cf3e6) at kdb_enter+0x3d/frame 0xc720aa60 watchdog_fire(21,0,c107e33d,222,407982,...) at watchdog_fire+0xb0/frame 0xc720aa88 hardclock_cnt(33,0,c10e0187,ef,c720ab9c,...) at hardclock_cnt+0x2c2/frame 0xc720aadc handleevents(0,c10893dd,887,c7715600,c123f680,...) at handleevents+0xec/frame 0xc720ab20 timercb(c13c4528,0,0,0,c789be1c,...) at timercb+0x267/frame 0xc720ab70 lapic_handle_timer(c720ab9c) at lapic_handle_timer+0x89/frame 0xc720ab90 Xtimerint() at Xtimerint+0x20/frame 0xc720ab90 --- interrupt, eip = 0xc0e90fb5, esp = 0xc720abdc, ebp = 0xc720abdc --- acpi_cpu_c1(c0eb436b,c1825c90,0,c10e0187,303,...) at acpi_cpu_c1+0x5/frame 0xc720abdc acpi_cpu_idle(d0be21b,0,d0be21b,c720ac50,c0e9b10a,...) at acpi_cpu_idle+0x146/frame 0xc720ac20 cpu_idle_acpi(d0be21b,0,2,c123f708,c123f716,...) at cpu_idle_acpi+0x3f/frame 0xc720ac34 cpu_idle(0,2,c10893dd,a46,c123f708,...) at cpu_idle+0x9a/frame 0xc720ac50 sched_idletd(0,c720ad08,c1080960,3d7,0,...) at sched_idletd+0x1d6/frame 0xc720accc fork_exit(c0aafee0,0,c720ad08) at fork_exit+0x7f/frame 0xc720acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc720acf4 --- trap 0, eip = 0, esp = 0xc720ad40, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc76cdc00 sched_switch(c76cdc00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xc720698c mi_switch(104,0,c108cb51,1f5,c108cb51,...) at mi_switch+0x1c9/frame 0xc72069c0 sleepq_switch(c76cdc00,0,c108cb51,1ab,c7206a38,...) at sleepq_switch+0x1b9/frame 0xc72069f4 sleepq_catch_signals(0,c108cb51,162,288,c76cdc00,...) at sleepq_catch_signals+0x361/frame 0xc7206a3c sleepq_wait_sig(c76cbba0,6c,c108ffc9,100,0,...) at sleepq_wait_sig+0x14/frame 0xc7206a60 _sleep(c76cbba0,c76cbc34,16c,c108ffc9,0,...) at _sleep+0x35b/frame 0xc7206abc kern_wait6(c76cdc00,7,0,0,c7206b4c,...) at kern_wait6+0x45c/frame 0xc7206b20 sys_wait4(c76cdc00,c7206cc8,14,c10893dd,7b3,...) at sys_wait4+0x94/frame 0xc7206c40 syscall(c7206d08) at syscall+0x2ed/frame 0xc7206cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xc7206cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x805e3b7, esp = 0xbfbfd8f4, ebp = 0xbfbfd908 --- Tracing command audit pid 10 tid 100001 td 0xc76d2000 sched_switch(c76d2000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xc7203ba8 mi_switch(104,0,c108cb51,1f5,8,...) at mi_switch+0x1c9/frame 0xc7203bdc sleepq_switch(c76d2000,0,c108cb51,26b,c76d2000,...) at sleepq_switch+0x1b9/frame 0xc7203c10 sleepq_wait(c1401f54,0,c7203c64,1,0,...) at sleepq_wait+0x48/frame 0xc7203c34 _cv_wait(c1401f54,c1401ee0,c10b85b2,18d,0,...) at _cv_wait+0x1f9/frame 0xc7203c78 audit_worker(0,c7203d08,c1080960,3d7,0,...) at audit_worker+0x94/frame 0xc7203ccc fork_exit(c0c9d810,0,c7203d08) at fork_exit+0x7f/frame 0xc7203cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7203cf4 --- trap 0, eip = 0, esp = 0xc7203d40, ebp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xc794dc00 sched_switch(c794dc00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3baeb68 mi_switch(104,0,c108cb51,1f5,101,...) at mi_switch+0x1c9/frame 0xe3baeb9c sleepq_switch(c794dc00,0,c108cb51,28e,c794dc00,...) at sleepq_switch+0x1b9/frame 0xe3baebd0 sleepq_timedwait(c1232380,0,2,0,0,...) at sleepq_timedwait+0x48/frame 0xe3baebf4 _sleep(c1232380,0,0,c1072c22,fffffc88,...) at _sleep+0x345/frame 0xe3baec50 pause_sbt(c1072c22,fffffc88,2,0,0,...) at pause_sbt+0x86/frame 0xe3baec8c deadlkres(0,e3baed08,c1080960,3d7,0,...) at deadlkres+0x82/frame 0xe3baeccc fork_exit(c0a381c0,0,e3baed08) at fork_exit+0x7f/frame 0xe3baecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3baecf4 --- trap 0, eip = 0, esp = 0xe3baed40, ebp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xc794e000 sched_switch(c794e000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xe3babbc0 mi_switch(104,0,c108cb51,1f5,c124f6c0,...) at mi_switch+0x1c9/frame 0xe3babbf4 sleepq_switch(c794e000,0,c108cb51,26b,c786d300,...) at sleepq_switch+0x1b9/frame 0xe3babc28 sleepq_wait(c786d300,0,c1087a5d,c1072c22,0,...) at sleepq_wait+0x48/frame 0xe3babc4c msleep_spin_sbt(c786d300,c786d318,c1072c22,0,0,...) at msleep_spin_sbt+0x239/frame 0xe3babc94 taskqueue_thread_loop(c13f7280,e3babd08,c1080960,3d7,0,...) at taskqueue_thread_loop+0xcc/frame 0xe3babccc fork_exit(c0acf3c0,c13f7280,e3babd08) at fork_exit+0x7f/frame 0xe3babcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe3babcf4 --- trap 0, eip = 0, esp = 0xe3babd40, ebp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xc7869000 sched_switch(c7869000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xc7251bac mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xc7251be0 sleepq_switch(c7869000,0,c108cb51,26b,c7869000,...) at sleepq_switch+0x1b9/frame 0xc7251c14 sleepq_wait(c76c6400,0,c1072c22,0,0,...) at sleepq_wait+0x48/frame 0xc7251c38 _sleep(c76c6400,c76c6418,0,c1072c22,0,...) at _sleep+0x37c/frame 0xc7251c94 taskqueue_thread_loop(c1401f90,c7251d08,c1080960,3d7,0,...) at taskqueue_thread_loop+0x129/frame 0xc7251ccc fork_exit(c0acf3c0,c1401f90,c7251d08) at fork_exit+0x7f/frame 0xc7251cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7251cf4 --- trap 0, eip = 0, esp = 0xc7251d40, ebp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xc7869600 sched_switch(c7869600,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xc724bbac mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xc724bbe0 sleepq_switch(c7869600,0,c108cb51,26b,c7869600,...) at sleepq_switch+0x1b9/frame 0xc724bc14 sleepq_wait(c76c6500,0,c1072c22,0,0,...) at sleepq_wait+0x48/frame 0xc724bc38 _sleep(c76c6500,c76c6518,0,c1072c22,0,...) at _sleep+0x37c/frame 0xc724bc94 taskqueue_thread_loop(c13fb258,c724bd08,c1080960,3d7,0,...) at taskqueue_thread_loop+0x129/frame 0xc724bccc fork_exit(c0acf3c0,c13fb258,c724bd08) at fork_exit+0x7f/frame 0xc724bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc724bcf4 --- trap 0, eip = 0, esp = 0xc724bd40, ebp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xc7869900 sched_switch(c7869900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xc7248bc0 mi_switch(104,0,c108cb51,1f5,c124f870,...) at mi_switch+0x1c9/frame 0xc7248bf4 sleepq_switch(c7869900,0,c108cb51,26b,c76c6580,...) at sleepq_switch+0x1b9/frame 0xc7248c28 sleepq_wait(c76c6580,0,c1087a5d,c1072c22,0,...) at sleepq_wait+0x48/frame 0xc7248c4c msleep_spin_sbt(c76c6580,c76c6598,c1072c22,0,0,...) at msleep_spin_sbt+0x239/frame 0xc7248c94 taskqueue_thread_loop(c13f7da0,c7248d08,c1080960,3d7,0,...) at taskqueue_thread_loop+0xcc/frame 0xc7248ccc fork_exit(c0acf3c0,c13f7da0,c7248d08) at fork_exit+0x7f/frame 0xc7248cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7248cf4 --- trap 0, eip = 0, esp = 0xc7248d40, ebp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xc7869c00 sched_switch(c7869c00,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xc7245bc0 mi_switch(104,0,c108cb51,1f5,c124f870,...) at mi_switch+0x1c9/frame 0xc7245bf4 sleepq_switch(c7869c00,0,c108cb51,26b,c76c6580,...) at sleepq_switch+0x1b9/frame 0xc7245c28 sleepq_wait(c76c6580,0,c1087a5d,c1072c22,0,...) at sleepq_wait+0x48/frame 0xc7245c4c msleep_spin_sbt(c76c6580,c76c6598,c1072c22,0,0,...) at msleep_spin_sbt+0x239/frame 0xc7245c94 taskqueue_thread_loop(c13f7da0,c7245d08,c1080960,3d7,0,...) at taskqueue_thread_loop+0xcc/frame 0xc7245ccc fork_exit(c0acf3c0,c13f7da0,c7245d08) at fork_exit+0x7f/frame 0xc7245cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7245cf4 --- trap 0, eip = 0, esp = 0xc7245d40, ebp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xc7715900 sched_switch(c7715900,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xc7242bc0 mi_switch(104,0,c108cb51,1f5,c124f870,...) at mi_switch+0x1c9/frame 0xc7242bf4 sleepq_switch(c7715900,0,c108cb51,26b,c76c6580,...) at sleepq_switch+0x1b9/frame 0xc7242c28 sleepq_wait(c76c6580,0,c1087a5d,c1072c22,0,...) at sleepq_wait+0x48/frame 0xc7242c4c msleep_spin_sbt(c76c6580,c76c6598,c1072c22,0,0,...) at msleep_spin_sbt+0x239/frame 0xc7242c94 taskqueue_thread_loop(c13f7da0,c7242d08,c1080960,3d7,0,...) at taskqueue_thread_loop+0xcc/frame 0xc7242ccc fork_exit(c0acf3c0,c13f7da0,c7242d08) at fork_exit+0x7f/frame 0xc7242cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7242cf4 --- trap 0, eip = 0, esp = 0xc7242d40, ebp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xc7776000 sched_switch(c7776000,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xc723cbac mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xc723cbe0 sleepq_switch(c7776000,0,c108cb51,26b,c7776000,...) at sleepq_switch+0x1b9/frame 0xc723cc14 sleepq_wait(c76c6700,0,c1072c22,0,0,...) at sleepq_wait+0x48/frame 0xc723cc38 _sleep(c76c6700,c76c6718,0,c1072c22,0,...) at _sleep+0x37c/frame 0xc723cc94 taskqueue_thread_loop(c13fe1c0,c723cd08,c1080960,3d7,0,...) at taskqueue_thread_loop+0x129/frame 0xc723cccc fork_exit(c0acf3c0,c13fe1c0,c723cd08) at fork_exit+0x7f/frame 0xc723ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc723ccf4 --- trap 0, eip = 0, esp = 0xc723cd40, ebp = 0 --- Tracing command kernel pid 0 tid 100013 td 0xc76d2300 sched_switch(c76d2300,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xc7229bac mi_switch(104,0,c108cb51,1f5,162,...) at mi_switch+0x1c9/frame 0xc7229be0 sleepq_switch(c76d2300,0,c108cb51,26b,c76d2300,...) at sleepq_switch+0x1b9/frame 0xc7229c14 sleepq_wait(c7714000,0,c1072c22,0,0,...) at sleepq_wait+0x48/frame 0xc7229c38 _sleep(c7714000,c7714018,0,c1072c22,0,...) at _sleep+0x37c/frame 0xc7229c94 taskqueue_thread_loop(c124d7c4,c7229d08,c1080960,3d7,0,...) at taskqueue_thread_loop+0x129/frame 0xc7229ccc fork_exit(c0acf3c0,c124d7c4,c7229d08) at fork_exit+0x7f/frame 0xc7229cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7229cf4 --- trap 0, eip = 0, esp = 0xc7229d40, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc13fadd0 sched_switch(c13fadd0,0,104,1b5,c0a74d0e,...) at sched_switch+0x4b9/frame 0xc1820c0c mi_switch(104,0,c108cb51,1f5,101,...) at mi_switch+0x1c9/frame 0xc1820c40 sleepq_switch(c13fadd0,0,c108cb51,28e,c13fadd0,...) at sleepq_switch+0x1b9/frame 0xc1820c74 sleepq_timedwait(c13faae4,54,9,0,0,...) at sleepq_timedwait+0x48/frame 0xc1820c98 _sleep(c13faae4,0,54,c10b9775,fffff470,...) at _sleep+0x345/frame 0xc1820cf4 scheduler(0,0,c10ec41c,181e000,1825000,...) at scheduler+0x2b3/frame 0xc1820d38 mi_startup() at mi_startup+0xf7/frame 0xc1820d58 begin() at begin+0x2c db:0:allt> call doadump Physical memory: 3435 MB Dumping 284 MB: 269 253 237 221 205 189 173 157 141 125 109 93 77 61 45 29 13 Dump complete = 0 db:0:doadump> reset $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/fs/tmpfs/tmpfs_vnops.c =================================================================== --- /usr/src/sys/fs/tmpfs/tmpfs_vnops.c (revision 249985) +++ /usr/src/sys/fs/tmpfs/tmpfs_vnops.c (working copy) @@ -278,8 +278,6 @@ tmpfs_close(struct vop_close_args *v) { struct vnode *vp = v->a_vp; - MPASS(VOP_ISLOCKED(vp)); - /* Update node times. */ tmpfs_update(vp); @@ -439,7 +437,6 @@ tmpfs_setattr(struct vop_setattr_args *v) return error; } -/* --------------------------------------------------------------------- */ static int tmpfs_nocacheread(vm_object_t tobj, vm_pindex_t idx, vm_offset_t offset, size_t tlen, struct uio *uio) @@ -448,12 +445,35 @@ tmpfs_nocacheread(vm_object_t tobj, vm_pindex_t id int error, rv; VM_OBJECT_WLOCK(tobj); - m = vm_page_grab(tobj, idx, VM_ALLOC_WIRED | - VM_ALLOC_NORMAL | VM_ALLOC_RETRY); + + /* + * The kern_sendfile() code calls vn_rdwr() with the page + * soft-busied. Ignore the soft-busy state here. Parallel + * reads of the page content from disk are prevented by + * VPO_BUSY. + * + * Although the tmpfs vnode lock is held here, it is + * nonetheless safe to sleep waiting for a free page. The + * pageout daemon does not need to acquire the tmpfs vnode + * lock to page out tobj's pages because tobj is a OBJT_SWAP + * type object. + */ + m = vm_page_grab(tobj, idx, VM_ALLOC_NORMAL | VM_ALLOC_RETRY | + VM_ALLOC_IGN_SBUSY); if (m->valid != VM_PAGE_BITS_ALL) { if (vm_pager_has_page(tobj, idx, NULL, NULL)) { rv = vm_pager_get_pages(tobj, &m, 1, 0); + m = vm_page_lookup(tobj, idx); + if (m == NULL) { + printf( + "tmpfs: vm_obj %p idx %jd null lookup rv %d\n", + tobj, idx, rv); + return (EIO); + } if (rv != VM_PAGER_OK) { + printf( + "tmpfs: vm_obj %p idx %jd valid %x pager error %d\n", + tobj, idx, m->valid, rv); vm_page_lock(m); vm_page_free(m); vm_page_unlock(m); @@ -463,127 +483,37 @@ tmpfs_nocacheread(vm_object_t tobj, vm_pindex_t id } else vm_page_zero_invalid(m, TRUE); } + vm_page_lock(m); + vm_page_hold(m); + vm_page_wakeup(m); + vm_page_unlock(m); VM_OBJECT_WUNLOCK(tobj); error = uiomove_fromphys(&m, offset, tlen, uio); VM_OBJECT_WLOCK(tobj); vm_page_lock(m); - vm_page_unwire(m, TRUE); + vm_page_unhold(m); + vm_page_deactivate(m); + vm_page_requeue(m); vm_page_unlock(m); - vm_page_wakeup(m); VM_OBJECT_WUNLOCK(tobj); return (error); } -static __inline int -tmpfs_nocacheread_buf(vm_object_t tobj, vm_pindex_t idx, - vm_offset_t offset, size_t tlen, void *buf) -{ - struct uio uio; - struct iovec iov; - - uio.uio_iovcnt = 1; - uio.uio_iov = &iov; - iov.iov_base = buf; - iov.iov_len = tlen; - - uio.uio_offset = 0; - uio.uio_resid = tlen; - uio.uio_rw = UIO_READ; - uio.uio_segflg = UIO_SYSSPACE; - uio.uio_td = curthread; - - return (tmpfs_nocacheread(tobj, idx, offset, tlen, &uio)); -} - static int -tmpfs_mappedread(vm_object_t vobj, vm_object_t tobj, size_t len, struct uio *uio) -{ - struct sf_buf *sf; - vm_pindex_t idx; - vm_page_t m; - vm_offset_t offset; - off_t addr; - size_t tlen; - char *ma; - int error; - - addr = uio->uio_offset; - idx = OFF_TO_IDX(addr); - offset = addr & PAGE_MASK; - tlen = MIN(PAGE_SIZE - offset, len); - - VM_OBJECT_WLOCK(vobj); -lookupvpg: - if (((m = vm_page_lookup(vobj, idx)) != NULL) && - vm_page_is_valid(m, offset, tlen)) { - if ((m->oflags & VPO_BUSY) != 0) { - /* - * Reference the page before unlocking and sleeping so - * that the page daemon is less likely to reclaim it. - */ - vm_page_reference(m); - vm_page_sleep(m, "tmfsmr"); - goto lookupvpg; - } - vm_page_busy(m); - VM_OBJECT_WUNLOCK(vobj); - error = uiomove_fromphys(&m, offset, tlen, uio); - VM_OBJECT_WLOCK(vobj); - vm_page_wakeup(m); - VM_OBJECT_WUNLOCK(vobj); - return (error); - } else if (m != NULL && uio->uio_segflg == UIO_NOCOPY) { - KASSERT(offset == 0, - ("unexpected offset in tmpfs_mappedread for sendfile")); - if ((m->oflags & VPO_BUSY) != 0) { - /* - * Reference the page before unlocking and sleeping so - * that the page daemon is less likely to reclaim it. - */ - vm_page_reference(m); - vm_page_sleep(m, "tmfsmr"); - goto lookupvpg; - } - vm_page_busy(m); - VM_OBJECT_WUNLOCK(vobj); - sched_pin(); - sf = sf_buf_alloc(m, SFB_CPUPRIVATE); - ma = (char *)sf_buf_kva(sf); - error = tmpfs_nocacheread_buf(tobj, idx, 0, tlen, ma); - if (error == 0) { - if (tlen != PAGE_SIZE) - bzero(ma + tlen, PAGE_SIZE - tlen); - uio->uio_offset += tlen; - uio->uio_resid -= tlen; - } - sf_buf_free(sf); - sched_unpin(); - VM_OBJECT_WLOCK(vobj); - if (error == 0) - m->valid = VM_PAGE_BITS_ALL; - vm_page_wakeup(m); - VM_OBJECT_WUNLOCK(vobj); - return (error); - } - VM_OBJECT_WUNLOCK(vobj); - error = tmpfs_nocacheread(tobj, idx, offset, tlen, uio); - - return (error); -} - -static int tmpfs_read(struct vop_read_args *v) { struct vnode *vp = v->a_vp; struct uio *uio = v->a_uio; - struct tmpfs_node *node; vm_object_t uobj; size_t len; int resid; - int error = 0; + vm_pindex_t idx; + vm_offset_t offset; + off_t addr; + size_t tlen; node = VP_TO_TMPFS_NODE(vp); @@ -607,7 +537,11 @@ tmpfs_read(struct vop_read_args *v) len = MIN(node->tn_size - uio->uio_offset, resid); if (len == 0) break; - error = tmpfs_mappedread(vp->v_object, uobj, len, uio); + addr = uio->uio_offset; + idx = OFF_TO_IDX(addr); + offset = addr & PAGE_MASK; + tlen = MIN(PAGE_SIZE - offset, len); + error = tmpfs_nocacheread(uobj, idx, offset, tlen, uio); if ((error != 0) || (resid == uio->uio_resid)) break; } @@ -620,10 +554,10 @@ out: /* --------------------------------------------------------------------- */ static int -tmpfs_mappedwrite(vm_object_t vobj, vm_object_t tobj, size_t len, struct uio *uio) +tmpfs_mappedwrite(vm_object_t tobj, size_t len, struct uio *uio) { vm_pindex_t idx; - vm_page_t vpg, tpg; + vm_page_t tpg; vm_offset_t offset; off_t addr; size_t tlen; @@ -636,69 +570,46 @@ static int offset = addr & PAGE_MASK; tlen = MIN(PAGE_SIZE - offset, len); - VM_OBJECT_WLOCK(vobj); -lookupvpg: - if (((vpg = vm_page_lookup(vobj, idx)) != NULL) && - vm_page_is_valid(vpg, offset, tlen)) { - if ((vpg->oflags & VPO_BUSY) != 0) { - /* - * Reference the page before unlocking and sleeping so - * that the page daemon is less likely to reclaim it. - */ - vm_page_reference(vpg); - vm_page_sleep(vpg, "tmfsmw"); - goto lookupvpg; - } - vm_page_busy(vpg); - vm_page_undirty(vpg); - VM_OBJECT_WUNLOCK(vobj); - error = uiomove_fromphys(&vpg, offset, tlen, uio); - } else { - if (vm_page_is_cached(vobj, idx)) - vm_page_cache_free(vobj, idx, idx + 1); - VM_OBJECT_WUNLOCK(vobj); - vpg = NULL; - } VM_OBJECT_WLOCK(tobj); - tpg = vm_page_grab(tobj, idx, VM_ALLOC_WIRED | - VM_ALLOC_NORMAL | VM_ALLOC_RETRY); + tpg = vm_page_grab(tobj, idx, VM_ALLOC_NORMAL | VM_ALLOC_RETRY); if (tpg->valid != VM_PAGE_BITS_ALL) { if (vm_pager_has_page(tobj, idx, NULL, NULL)) { rv = vm_pager_get_pages(tobj, &tpg, 1, 0); + tpg = vm_page_lookup(tobj, idx); + if (tpg == NULL) { + printf( + "tmpfs: vm_obj %p idx %jd null lookup rv %d\n", + tobj, idx, rv); + return (EIO); + } if (rv != VM_PAGER_OK) { + printf( + "tmpfs: vm_obj %p idx %jd valid %x pager error %d\n", + tobj, idx, tpg->valid, rv); vm_page_lock(tpg); vm_page_free(tpg); vm_page_unlock(tpg); - error = EIO; - goto out; + VM_OBJECT_WUNLOCK(tobj); + return (EIO); } } else vm_page_zero_invalid(tpg, TRUE); } + vm_page_lock(tpg); + vm_page_hold(tpg); + vm_page_wakeup(tpg); + vm_page_unlock(tpg); VM_OBJECT_WUNLOCK(tobj); - if (vpg == NULL) - error = uiomove_fromphys(&tpg, offset, tlen, uio); - else { - KASSERT(vpg->valid == VM_PAGE_BITS_ALL, ("parts of vpg invalid")); - pmap_copy_page(vpg, tpg); - } + error = uiomove_fromphys(&tpg, offset, tlen, uio); VM_OBJECT_WLOCK(tobj); - if (error == 0) { - KASSERT(tpg->valid == VM_PAGE_BITS_ALL, - ("parts of tpg invalid")); + if (error == 0) vm_page_dirty(tpg); - } vm_page_lock(tpg); - vm_page_unwire(tpg, TRUE); + vm_page_unhold(tpg); + vm_page_deactivate(tpg); + vm_page_requeue(tpg); vm_page_unlock(tpg); - vm_page_wakeup(tpg); -out: VM_OBJECT_WUNLOCK(tobj); - if (vpg != NULL) { - VM_OBJECT_WLOCK(vobj); - vm_page_wakeup(vpg); - VM_OBJECT_WUNLOCK(vobj); - } return (error); } @@ -756,7 +667,7 @@ tmpfs_write(struct vop_write_args *v) len = MIN(node->tn_size - uio->uio_offset, resid); if (len == 0) break; - error = tmpfs_mappedwrite(vp->v_object, uobj, len, uio); + error = tmpfs_mappedwrite(uobj, len, uio); if ((error != 0) || (resid == uio->uio_resid)) break; } @@ -1536,8 +1447,6 @@ tmpfs_inactive(struct vop_inactive_args *v) struct tmpfs_node *node; - MPASS(VOP_ISLOCKED(vp)); - node = VP_TO_TMPFS_NODE(vp); if (node->tn_links == 0) @@ -1555,11 +1464,24 @@ tmpfs_reclaim(struct vop_reclaim_args *v) struct tmpfs_mount *tmp; struct tmpfs_node *node; + vm_object_t obj; node = VP_TO_TMPFS_NODE(vp); tmp = VFS_TO_TMPFS(vp->v_mount); - vnode_destroy_vobject(vp); + if (node->tn_type == VREG) { + obj = node->tn_reg.tn_aobj; + if (obj != NULL) { + /* Instead of vnode_destroy_vobject() */ + VM_OBJECT_WLOCK(obj); + VI_LOCK(vp); + vm_object_clear_flag(obj, OBJ_TMPFS); + obj->un_pager.swp.swp_tmpfs = NULL; + VI_UNLOCK(vp); + VM_OBJECT_WUNLOCK(obj); + } + } + vp->v_object = NULL; cache_purge(vp); TMPFS_NODE_LOCK(node); Index: /usr/src/sys/fs/tmpfs/tmpfs_subr.c =================================================================== --- /usr/src/sys/fs/tmpfs/tmpfs_subr.c (revision 249985) +++ /usr/src/sys/fs/tmpfs/tmpfs_subr.c (working copy) @@ -166,6 +166,7 @@ tmpfs_alloc_node(struct tmpfs_mount *tmp, enum vty char *target, dev_t rdev, struct tmpfs_node **node) { struct tmpfs_node *nnode; + vm_object_t obj; /* If the root directory of the 'tmp' file system is not yet * allocated, this must be the request to do it. */ @@ -227,9 +228,14 @@ tmpfs_alloc_node(struct tmpfs_mount *tmp, enum vty break; case VREG: - nnode->tn_reg.tn_aobj = + obj = nnode->tn_reg.tn_aobj = vm_pager_allocate(OBJT_SWAP, NULL, 0, VM_PROT_DEFAULT, 0, NULL /* XXXKIB - tmpfs needs swap reservation */); + VM_OBJECT_WLOCK(obj); + /* OBJ_TMPFS is set together with the setting of vp->v_object */ + vm_object_set_flag(obj, OBJ_NOSPLIT); + vm_object_clear_flag(obj, OBJ_ONEMAPPING); + VM_OBJECT_WUNLOCK(obj); break; default: @@ -434,9 +440,11 @@ int tmpfs_alloc_vp(struct mount *mp, struct tmpfs_node *node, int lkflag, struct vnode **vpp) { - int error = 0; struct vnode *vp; + vm_object_t object; + int error; + error = 0; loop: TMPFS_NODE_LOCK(node); if ((vp = node->tn_vnode) != NULL) { @@ -506,13 +514,22 @@ loop: /* FALLTHROUGH */ case VLNK: /* FALLTHROUGH */ - case VREG: - /* FALLTHROUGH */ case VSOCK: break; case VFIFO: vp->v_op = &tmpfs_fifoop_entries; break; + case VREG: + object = node->tn_reg.tn_aobj; + VM_OBJECT_WLOCK(object); + VI_LOCK(vp); + KASSERT(vp->v_object == NULL, ("Not NULL v_object in tmpfs")); + vp->v_object = object; + object->un_pager.swp.swp_tmpfs = vp; + vm_object_set_flag(object, OBJ_TMPFS); + VI_UNLOCK(vp); + VM_OBJECT_WUNLOCK(object); + break; case VDIR: MPASS(node->tn_dir.tn_parent != NULL); if (node->tn_dir.tn_parent == node) @@ -523,7 +540,6 @@ loop: panic("tmpfs_alloc_vp: type %p %d", node, (int)node->tn_type); } - vnode_pager_setsize(vp, node->tn_size); error = insmntque(vp, mp); if (error) vp = NULL; @@ -1343,7 +1359,6 @@ retry: TMPFS_UNLOCK(tmp); node->tn_size = newsize; - vnode_pager_setsize(vp, newsize); return (0); } Index: /usr/src/sys/vm/vm_object.c =================================================================== --- /usr/src/sys/vm/vm_object.c (revision 249985) +++ /usr/src/sys/vm/vm_object.c (working copy) @@ -505,6 +505,7 @@ void vm_object_deallocate(vm_object_t object) { vm_object_t temp; + struct vnode *vp; while (object != NULL) { VM_OBJECT_WLOCK(object); @@ -527,15 +528,36 @@ vm_object_deallocate(vm_object_t object) VM_OBJECT_WUNLOCK(object); return; } else if (object->ref_count == 1) { + if (object->type == OBJT_SWAP && + (object->flags & OBJ_TMPFS) != 0) { + vp = object->un_pager.swp.swp_tmpfs; + vhold(vp); + VM_OBJECT_WUNLOCK(object); + vn_lock(vp, LK_EXCLUSIVE | LK_RETRY); + vdrop(vp); + VM_OBJECT_WLOCK(object); + if (object->type == OBJT_DEAD) { + VM_OBJECT_WUNLOCK(object); + VOP_UNLOCK(vp, 0); + return; + } else if ((object->flags & OBJ_TMPFS) != 0) { + if (object->ref_count == 1) + VOP_UNSET_TEXT(vp); + VOP_UNLOCK(vp, 0); + } + } if (object->shadow_count == 0 && object->handle == NULL && (object->type == OBJT_DEFAULT || - object->type == OBJT_SWAP)) { + (object->type == OBJT_SWAP && + (object->flags & OBJ_TMPFS) == 0))) { vm_object_set_flag(object, OBJ_ONEMAPPING); } else if ((object->shadow_count == 1) && (object->handle == NULL) && (object->type == OBJT_DEFAULT || object->type == OBJT_SWAP)) { + KASSERT((object->flags & OBJ_TMPFS) == 0, + ("Shadowed tmpfs v_object")); vm_object_t robject; robject = LIST_FIRST(&object->shadow_head); @@ -820,7 +842,12 @@ vm_object_page_clean(vm_object_t object, vm_ooffse boolean_t clearobjflags, eio, res; VM_OBJECT_ASSERT_WLOCKED(object); - KASSERT(object->type == OBJT_VNODE, ("Not a vnode object")); + + /* + * The OBJ_MIGHTBEDIRTY flag is only set for OBJT_VNODE + * objects. The check below prevents the function from + * operating on non-vnode objects. + */ if ((object->flags & OBJ_MIGHTBEDIRTY) == 0 || object->resident_page_count == 0) return (TRUE); Index: /usr/src/sys/vm/vm_object.h =================================================================== --- /usr/src/sys/vm/vm_object.h (revision 249985) +++ /usr/src/sys/vm/vm_object.h (working copy) @@ -154,11 +154,21 @@ struct vm_object { /* * Swap pager * + * swp_tmpfs - back-pointer to the tmpfs vnode, + * if any, which uses the vm object + * as backing store. The handle + * cannot be reused for linking, + * because the vnode can be + * reclaimed and recreated, making + * the handle changed and hash-chain + * invalid. + * * swp_bcount - number of swap 'swblock' metablocks, each * contains up to 16 swapblk assignments. * see vm/swap_pager.h */ struct { + void *swp_tmpfs; int swp_bcount; } swp; } un_pager; @@ -179,6 +189,7 @@ struct vm_object { #define OBJ_COLORED 0x1000 /* pg_color is defined */ #define OBJ_ONEMAPPING 0x2000 /* One USE (a single, non-forked) mapping flag */ #define OBJ_DISCONNECTWNT 0x4000 /* disconnect from vnode wanted */ +#define OBJ_TMPFS 0x8000 #define IDX_TO_OFF(idx) (((vm_ooffset_t)(idx)) << PAGE_SHIFT) #define OFF_TO_IDX(off) ((vm_pindex_t)(((vm_ooffset_t)(off)) >> PAGE_SHIFT)) Index: /usr/src/sys/vm/vm_mmap.c =================================================================== --- /usr/src/sys/vm/vm_mmap.c (revision 249985) +++ /usr/src/sys/vm/vm_mmap.c (working copy) @@ -1284,7 +1284,7 @@ vm_mmap_vnode(struct thread *td, vm_size_t objsize error = EINVAL; goto done; } - if (obj->handle != vp) { + if (obj->type == OBJT_VNODE && obj->handle != vp) { vput(vp); vp = (struct vnode *)obj->handle; /* @@ -1333,7 +1333,14 @@ vm_mmap_vnode(struct thread *td, vm_size_t objsize objsize = round_page(va.va_size); if (va.va_nlink == 0) flags |= MAP_NOSYNC; - obj = vm_pager_allocate(OBJT_VNODE, vp, objsize, prot, foff, cred); + if (obj->type == OBJT_VNODE) + obj = vm_pager_allocate(OBJT_VNODE, vp, objsize, prot, foff, + cred); + else { + KASSERT(obj->type == OBJT_DEFAULT || obj->type == OBJT_SWAP, + ("wrong object type")); + vm_object_reference(obj); + } if (obj == NULL) { error = ENOMEM; goto done; Index: /usr/src/sys/vm/vnode_pager.c =================================================================== --- /usr/src/sys/vm/vnode_pager.c (revision 249985) +++ /usr/src/sys/vm/vnode_pager.c (working copy) @@ -214,8 +214,7 @@ retry: VM_OBJECT_SLEEP(object, object, PDROP | PVM, "vadead", 0); } - if (vp->v_usecount == 0) - panic("vnode_pager_alloc: no vnode reference"); + KASSERT(vp->v_usecount != 0, ("vnode_pager_alloc: no vnode reference")); if (object == NULL) { /* @@ -381,6 +380,12 @@ vnode_pager_setsize(vp, nsize) return; /* ASSERT_VOP_ELOCKED(vp, "vnode_pager_setsize and not locked vnode"); */ VM_OBJECT_WLOCK(object); + if (object->type == OBJT_DEAD) { + VM_OBJECT_WUNLOCK(object); + return; + } + KASSERT(object->type == OBJT_VNODE, + ("not vnode-backed object %p", object)); if (nsize == object->un_pager.vnp.vnp_size) { /* * Hasn't changed size Index: /usr/src/sys/kern/uipc_syscalls.c =================================================================== --- /usr/src/sys/kern/uipc_syscalls.c (revision 249985) +++ /usr/src/sys/kern/uipc_syscalls.c (working copy) @@ -1902,8 +1902,10 @@ kern_sendfile(struct thread *td, struct sendfile_a struct mbuf *m = NULL; struct sf_buf *sf; struct vm_page *pg; + struct vattr va; off_t off, xfsize, fsbytes = 0, sbytes = 0, rem = 0; int error, hdrlen = 0, mnw = 0; + int bsize; struct sendfile_sync *sfs = NULL; /* @@ -2102,6 +2104,16 @@ retry_space: */ space -= hdrlen; + error = vn_lock(vp, LK_SHARED); + if (error != 0) + goto done; + error = VOP_GETATTR(vp, &va, td->td_ucred); + if (error != 0) { + VOP_UNLOCK(vp, 0); + goto done; + } + bsize = vp->v_mount->mnt_stat.f_iosize; + /* * Loop and construct maximum sized mbuf chain to be bulk * dumped into socket buffer. @@ -2111,7 +2123,6 @@ retry_space: vm_offset_t pgoff; struct mbuf *m0; - VM_OBJECT_WLOCK(obj); /* * Calculate the amount to transfer. * Not to exceed a page, the EOF, @@ -2121,12 +2132,11 @@ retry_space: if (uap->nbytes) rem = (uap->nbytes - fsbytes - loopbytes); else - rem = obj->un_pager.vnp.vnp_size - + rem = va.va_size - uap->offset - fsbytes - loopbytes; xfsize = omin(PAGE_SIZE - pgoff, rem); xfsize = omin(space - loopbytes, xfsize); if (xfsize <= 0) { - VM_OBJECT_WUNLOCK(obj); done = 1; /* all data sent */ break; } @@ -2146,6 +2156,7 @@ retry_space: * if not found or wait and loop if busy. */ pindex = OFF_TO_IDX(off); + VM_OBJECT_WLOCK(obj); pg = vm_page_grab(obj, pindex, VM_ALLOC_NOBUSY | VM_ALLOC_NORMAL | VM_ALLOC_WIRED | VM_ALLOC_RETRY); @@ -2163,7 +2174,6 @@ retry_space: else if (uap->flags & SF_NODISKIO) error = EBUSY; else { - int bsize; ssize_t resid; /* @@ -2175,13 +2185,6 @@ retry_space: /* * Get the page from backing store. - */ - error = vn_lock(vp, LK_SHARED); - if (error != 0) - goto after_read; - bsize = vp->v_mount->mnt_stat.f_iosize; - - /* * XXXMAC: Because we don't have fp->f_cred * here, we pass in NOCRED. This is probably * wrong, but is consistent with our original @@ -2191,8 +2194,6 @@ retry_space: trunc_page(off), UIO_NOCOPY, IO_NODELOCKED | IO_VMIO | ((MAXBSIZE / bsize) << IO_SEQSHIFT), td->td_ucred, NOCRED, &resid, td); - VOP_UNLOCK(vp, 0); - after_read: VM_OBJECT_WLOCK(obj); vm_page_io_finish(pg); if (!error) @@ -2281,6 +2282,8 @@ retry_space: } } + VOP_UNLOCK(vp, 0); + /* Add the buffer chain to the socket buffer. */ if (m != NULL) { int mlen, err; -- Test scenario: nfs11.sh interrupted with killall + umount