GENERIC HEAD from Fri Apr 20 20:04:06 CEST 2012,r234481M, vmcore.344 KDB: debugger backends: ddb KDB: current backend: ddb 524288K of memory above 4GB ignored Copyright (c) 1992-2012 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #2 r234481M: Fri Apr 20 20:04:06 CEST 2012 pho@x4.osted.lan:/var/tmp/vmcontention/sys/i386/compile/PHO i386 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 10 Model = 2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 4294967296 (4096 MB) avail memory = 3538644992 (3374 MB) : Trying to mount root from ufs:/dev/ad4s1a [rw]... Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/ad4s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1a: clean, 672773 free (1661 frags, 83889 blocks, 0.2% fragmentation) /dev/ad4s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1f: clean, 120450 free (5050 frags, 14425 blocks, 0.5% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 117967077 free (173 frags, 14745863 blocks, 0.0% fragmentation) /dev/ad4s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1d: clean, 3620936 free (242808 frags, 422266 blocks, 2.4% fragmentation) /dev/ad4s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1e: clean, 13496073 free (63577 frags, 1679062 blocks, 0.3% fragmentation) Mounting local file systems:ffs_snapshot_mount: non-snapshot inode 205 . Setting hostname: x4.osted.lan. re0: link state changed to DOWN re0: link state changed to UP Starting Network: lo0 re0 fwe0 fwip0. lo0: flags=8049 metric 0 mtu 16384 options=3 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0xa inet 127.0.0.1 netmask 0xff000000 nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 scopeid 0x1 nd6 options=29 media: Ethernet autoselect (100baseTX ) status: active fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 Starting devd. Starting Network: fwe0. fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 Starting Network: fwip0. fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/kde4/lib /usr/local/lib/compat /usr/local/lib/gcc46 /usr/local/lib/qt4 /usr/local/lib/virtualbox a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. No core dumps found. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered Clearing /tmp (X related). lock order reversal: 1st 0xce2afb38 ufs (ufs) @ kern/vfs_subr.c:2123 2nd 0xe510bba0 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:260 3rd 0xce5381b4 ufs (ufs) @ kern/vfs_subr.c:2123 KDB: stack backtrace: db_trace_self_wrapper(c0f796f7,3a632e73,a303632,0,0,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a7cacb,c0f7d1d9,c1258470,84b,f5fcd354,...) at kdb_backtrace+0x2a _witness_debugger(c0f7d1d9,ce5381b4,c0f6b884,cb5795a8,c0f8520b,...) at _witness_debugger+0x25 witness_checkorder(ce5381b4,9,c0f85202,84b,0,...) at witness_checkorder+0x86f __lockmgr_args(ce5381b4,80100,ce538220,0,0,...) at __lockmgr_args+0x8c5 ffs_lock(f5fcd450,c0a8f04c,cdfe95c0,80100,ce53815c,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10bfd20,f5fcd450,cb5721e0,c10d0f00,ce53815c,...) at VOP_LOCK1_APV+0xb5 _vn_lock(ce53815c,80100,c0f85202,84b,4,...) at _vn_lock+0x78 vget(ce53815c,80100,cdfe95c0,50,0,...) at vget+0xbb vfs_hash_get(cdf61b40,1a9a34,80000,cdfe95c0,f5fcd59c,...) at vfs_hash_get+0xed ffs_vgetf(cdf61b40,1a9a34,80000,f5fcd59c,1,...) at ffs_vgetf+0x49 softdep_sync_buf(ce2afae0,e510bb40,1,106,0,...) at softdep_sync_buf+0xac9 ffs_syncvnode(ce2afae0,1,0,c1258460,0,...) at ffs_syncvnode+0x24c ffs_truncate(ce2afae0,200,0,880,cb5b3e80,...) at ffs_truncate+0x8b5 ufs_direnter(ce2afae0,ce53815c,f5fcd914,f5fcdbbc,0,...) at ufs_direnter+0x9a1 ufs_makeinode(f5fcdbbc,c10c02e0,f5fcdb00,f5fcda5c,c0dd2d05,...) at ufs_makeinode+0x65d ufs_create(f5fcdb00,c0fcf038,0,0,f5fcdb7c,...) at ufs_create+0x30 VOP_CREATE_APV(c10bfd20,f5fcdb00,f5fcdbbc,f5fcda98,0,...) at VOP_CREATE_APV+0xc5 vn_open_cred(f5fcdb7c,f5fcdc44,1a4,0,cb5b3e80,...) at vn_open_cred+0x205 vn_open(f5fcdb7c,f5fcdc44,1a4,cdf9a310,203,...) at vn_open+0x3b kern_openat(cdfe95c0,ffffff9c,2842d67c,0,602,...) at kern_openat+0x1ec kern_open(cdfe95c0,2842d67c,0,601,1b6,...) at kern_open+0x35 sys_open(cdfe95c0,f5fcdcec,c0fc78bc,c0f7e071,246,...) at sys_open+0x30 syscall(f5fcdd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x28201193, esp = 0xbfbfdc3c, ebp = 0xbfbfdcf8 --- Starting mountd. Starting nfsuserd. Starting nfsd. Recovering vi editor sessions:. Updating motd:. Starting ntpd. Starting default moused. Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Local package initialization: backuplock order reversal: 1st 0xce2b8724 ufs (ufs) @ kern/vfs_mount.c:1250 2nd 0xce2b0310 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1835 KDB: stack backtrace: db_trace_self_wrapper(c0f796f7,38313a63,a3533,ce5cfc94,8,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a7cacb,c0f7d1c0,c1257c20,72b,f5fd99b8,...) at kdb_backtrace+0x2a _witness_debugger(c0f7d1c0,ce2b0310,c0f70834,cb579408,c0fa99d5,...) at _witness_debugger+0x25 witness_checkorder(ce2b0310,9,c0fa99cc,72b,ce2b037c,...) at witness_checkorder+0x86f __lockmgr_args(ce2b0310,80400,ce2b037c,0,0,...) at __lockmgr_args+0x8c5 vop_stdlock(f5fd9ab0,4,c0f7393b,80400,ce2b02b8,...) at vop_stdlock+0x65 VOP_LOCK1_APV(c10954c0,f5fd9ab0,c128b9c0,c10d0f00,ce2b02b8,...) at VOP_LOCK1_APV+0xb5 _vn_lock(ce2b02b8,80400,c0fa99cc,72b,0,...) at _vn_lock+0x78 softdep_flushworklist(ce2cb2d0,f5fd9b68,cdf982e0,60e,c0ae1488,...) at softdep_flushworklist+0x47 ffs_sync(ce2cb2d0,1,f5fd9bbc,51b,cb434000,...) at ffs_sync+0x3bf dounmount(ce2cb2d0,8080000,cdf982e0,49d,f5fd9c04,...) at dounmount+0x3f8 sys_unmount(cdf982e0,f5fd9cec,c0fc78bc,c,206,...) at sys_unmount+0x421 syscall(f5fd9d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280e7f9b, esp = 0xbfbfe64c, ebp = 0xbfbfe718 --- ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes lock order reversal: 1st 0xe5134740 bufwait (bufwait) @ kern/vfs_bio.c:2652 2nd 0xcdf86400 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper(c0f796f7,2e687361,38323a63,c0000a34,c1257728,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a7cacb,c0f7d1c0,c1257718,11c,f611d7d8,...) at kdb_backtrace+0x2a _witness_debugger(c0f7d1c0,cdf86400,c0fad8da,cb579610,c0fad56c,...) at _witness_debugger+0x25 witness_checkorder(cdf86400,9,c0fad563,11c,0,...) at witness_checkorder+0x86f _sx_xlock(cdf86400,0,c0fad563,11c,ce5263a0,...) at _sx_xlock+0xa0 ufsdirhash_acquire(e51346e0,ce5263a0,f611d914,e5f5e1ac,f611d8a8,...) at ufsdirhash_acquire+0x48 ufsdirhash_add(ce5263a0,f611d914,21ac,f611d894,f611d898,...) at ufsdirhash_add+0x13 ufs_direnter(ce7d52b8,ce8b72b8,f611d914,f611dbbc,0,...) at ufs_direnter+0x7a9 ufs_makeinode(f611dbbc,c10c02e0,f611db00,f611da5c,c0dd2d05,...) at ufs_makeinode+0x65d ufs_create(f611db00,c0fcf038,0,0,f611db7c,...) at ufs_create+0x30 VOP_CREATE_APV(c10bfd20,f611db00,f611dbbc,f611da98,0,...) at VOP_CREATE_APV+0xc5 vn_open_cred(f611db7c,f611dc44,180,0,ce001780,...) at vn_open_cred+0x205 vn_open(f611db7c,f611dc44,180,cdf9a230,c0a8f04c,...) at vn_open+0x3b kern_openat(cb97b5c0,ffffff9c,bfbfe7ab,0,a02,...) at kern_openat+0x1ec kern_open(cb97b5c0,bfbfe7ab,0,a01,180,...) at kern_open+0x35 sys_open(cb97b5c0,f611dcec,c0fc78bc,c0f7ded2,246,...) at sys_open+0x30 syscall(f611dd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x282bb193, esp = 0xbfbfe37c, ebp = 0xbfbfec18 --- Apr 20 20:12:44 x4 su: pho to root on /dev/pts/1 ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 130 files, 346904 used, 117967077 free (173 frags, 14745863 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 130 files, 346904 used, 117967077 free (173 frags, 14745863 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmp watchdogd. Starting inetd. Fri Apr 20 20:14:55 CEST 2012 FreeBSD/i386 (x4.osted.lan) (console) login: Apr 20 22:10:46 x4 su: pho to root on /dev/pts/2 lock order reversal: 1st 0xd2c2c724 ufs (ufs) @ kern/vfs_subr.c:2123 2nd 0xcddb3c1c snaplk (snaplk) @ kern/vfs_subr.c:2123 KDB: stack backtrace: db_trace_self_wrapper(c0f796f7,a3332,0,f63938b8,c0c6f5ae,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a7cacb,c0f7d1c0,c1256f68,84b,f6393638,...) at kdb_backtrace+0x2a _witness_debugger(c0f7d1c0,cddb3c1c,c0fa9494,cb579d60,c0f8520b,...) at _witness_debugger+0x25 witness_checkorder(cddb3c1c,9,c0f85202,84b,0,...) at witness_checkorder+0x86f __lockmgr_args(cddb3c1c,200100,cfcabd00,0,0,...) at __lockmgr_args+0x8c5 ffs_lock(f6393734,cb577ba8,cdf5cc30,200100,cfcabc3c,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10bfd20,f6393734,cb5721e0,c10d0f00,cfcabc3c,...) at VOP_LOCK1_APV+0xb5 _vn_lock(cfcabc3c,200100,c0f85202,84b,4,...) at _vn_lock+0x78 vget(cfcabc3c,200100,cdf5cb80,50,0,...) at vget+0xbb vfs_hash_get(cdf61b40,cc,200000,cdf5cb80,f63938ac,...) at vfs_hash_get+0xed ffs_vgetf(cdf61b40,cc,200000,f63938ac,0,...) at ffs_vgetf+0x49 ffs_vget(cdf61b40,cc,200000,f63938ac,f63938bc,...) at ffs_vget+0x2e ufs_lookup_ino(d2c2c6cc,f6393ba8,f6393bbc,0,f6393900,...) at ufs_lookup_ino+0xbc4 ufs_lookup(f6393928,c0fce757,d2c2c6cc,d2c2c6cc,f6393bbc,...) at ufs_lookup+0x2a VOP_CACHEDLOOKUP_APV(c10bfd20,f6393928,f6393bbc,0,0,...) at VOP_CACHEDLOOKUP_APV+0xc5 vfs_cache_lookup(f63939c4,c0f85ee3,c10d0b40,200000,f6393b7c,...) at vfs_cache_lookup+0xe6 VOP_LOOKUP_APV(c10bfd20,f63939c4,f6393bbc,343,f639399c,...) at VOP_LOOKUP_APV+0xe5 lookup(f6393b7c,c0f84620,10e,dc,f6393a08,...) at lookup+0x6eb namei(f6393b7c,ce2c9650,10000,246,0,...) at namei+0x6bf vn_open_cred(f6393b7c,f6393c44,0,0,ce001080,...) at vn_open_cred+0x31f vn_open(f6393b7c,f6393c44,0,d2d91150,c1256f68,...) at vn_open+0x3b kern_openat(cdf5cb80,ffffff9c,bfbfec24,0,1,...) at kern_openat+0x1ec kern_open(cdf5cb80,bfbfec24,0,0,201000,...) at kern_open+0x35 sys_open(cdf5cb80,f6393cec,c0fc78bc,c0fa9673,246,...) at sys_open+0x30 syscall(f6393d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x28188193, esp = 0xbfbfe2dc, ebp = 0xbfbfea58 --- lock order reversal: 1st 0xe51bba20 bufwait (bufwait) @ kern/vfs_bio.c:2652 2nd 0xcddb3c1c snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:2297 KDB: stack backtrace: db_trace_self_wrapper(c0f796f7,632e746f,3932323a,cd000a37,4,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a7cacb,c0f7d1c0,c12583c0,8f9,f5fed9a0,...) at kdb_backtrace+0x2a _witness_debugger(c0f7d1c0,cddb3c1c,c0fa9494,cb579d60,c0fa941e,...) at _witness_debugger+0x25 witness_checkorder(cddb3c1c,9,c0fa9415,8f9,0,...) at witness_checkorder+0x86f __lockmgr_args(cddb3c1c,80900,ce2b00c4,0,0,...) at __lockmgr_args+0x8c5 ffs_copyonwrite(ce2b0000,e51bb9c0,e51bb9c0,0,0,...) at ffs_copyonwrite+0x2c2 ffs_geom_strategy(ce2b00f8,e51bb9c0,eb,e51bb9c0,170f788,...) at ffs_geom_strategy+0xeb bufwrite(e51bb9c0,0,c0fac8b0,80d,0) at bufwrite+0x159 ffs_bufwrite(e51bb9c0,ce03a900,100,4000,0,...) at ffs_bufwrite+0x290 ffs_update(ce53a828,1,c0fad031,151,0,...) at ffs_update+0x3a5 ffs_syncvnode(ce53a828,1,0,c10bfd20,ce53a920,...) at ffs_syncvnode+0x591 ffs_fsync(f5fedc44,c0fce4ef,f5fedcec,f5fedc44,0,...) at ffs_fsync+0x2f VOP_FSYNC_APV(c10bfd20,f5fedc44,c0f867e7,e04,0,...) at VOP_FSYNC_APV+0xc5 sys_fsync(cdec75c0,f5fedcec,c0fc78bc,c0f7ef6e,202,...) at sys_fsync+0x1df syscall(f5fedd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (95, FreeBSD ELF32, sys_fsync), eip = 0x281a65b7, esp = 0xbfbfe29c, ebp = 0xbfbfede8 --- vnode_pager_putpages: I/O error 28 vnode_pager_putpages: residual I/O 32768 at 9776 Apr 20 23:06:01 x4 kernel: pid 22638 (sync), uid 0 inumber 4 on /mnt: filesystem full vnode_pager_putpages: I/O error 28 vnode_pager_putpages: residual I/O 65536 at 17616 vnode_pager_putpages: I/O error 28 vnode_pager_putpages: residual I/O 65536 at 25456 Apr 20 23:06:03 x4 last message repeated 2 times Apr 20 23:08:53 x4 kernel: pid 33335 (fragments), uid 1004 inumber 52098 on /mnt: filesystem full Apr 20 23:08:53 x4 kernel: pid 33335 (fragments), uid 1004 inumber 32787 on /mnt: filesystem full Apr 20 23:08:54 x4 kernel: pid 33352 (fragments), uid 1004 inumber 5126 on /mnt: filesystem full Apr 20 23:08:55 x4 kernel: pid 33355 (fragments), uid 1004 inumber 5173 on /mnt: filesystem full Apr 20 23:08:56 x4 kernel: pid 33353 (fragments), uid 1004 inumber 5164 on /mnt: filesystem full Apr 20 23:08:57 x4 kernel: pid 33355 (fragments), uid 1004 inumber 5173 on /mnt: filesystem full Apr 20 23:08:58 x4 kernel: pid 33357 (fragments), uid 1004 inumber 5178 on /mnt: filesystem full : : Apr 21 06:25:28 x4 kernel: pid 19027 (fragments), uid 1004 inumber 4166 on /mnt: filesystem full Apr 21 06:25:29 x4 kernel: pid 19026 (fragments), uid 1004 inumber 4168 on /mnt: filesystem full Apr 21 06:25:30 x4 kernel: pid 19030 (fragments), uid 1004 inumber 4173 on /mnt: filesystem full Apr 21 06:25:31 x4 kernel: pid 19027 (fragments), uid 1004 inumber 4166 on /mnt: filesystem full Apr 21 06:25:32 x4 kernel: pid 19031 (fragments), uid 1004 inumber 4170 on /mnt: filesystem full Apr 21 06:25:33 x4 kernel: pid 19029 (fragments), uid 1004 inumber 4169 on /mnt: filesystem full Apr 21 06:25:34 x4 kernel: pid 19029 (fragments), uid 1004 inumber 4209 on /mnt: filesystem full Apr 21 06:25:35 x4 kernel: pid 19024 (fragments), uid 1004 inumber 4254 on /mnt: filesystem full Apr 21 06:25:36 x4 kernel: pid 19025 (fragments), uid 1004 inumber 4277 on /mnt: filesystem full Apr 21 06:25:37 x4 kernel: pid 19024 (fragments), uid 1004 inumber 4274 on /mnt: filesystem full Apr 21 06:59:27 x4 kernel: pid 25343 (openat), uid 1004 inumber 12305 on /mnt: out of inodes 20120421 07:46:30 all: mmap2.sh 20120421 07:48:39 all: statfs.sh\r 20120421 07:48:54 all: libMicro.sh\r Apr 21 07:51:43 x4 su: pho to root on /dev/pts/2 test\012 test\014 test\014 man ascii Password: Login incorrect login: test\015 test 20120421 07:56:33 all: syscall5.sh 20120421 07:57:29 all: zfs5.sh ZFS NOTICE: Prefetch is disabled by default on i386 -- to enable, add "vfs.zfs.prefetch_disable=0" to /boot/loader.conf. ZFS WARNING: Recommended minimum kmem_size is 512MB; expect unstable behavior. Consider tuning vm.kmem_size and vm.kmem_size_max in /boot/loader.conf. ZFS filesystem version 5 ZFS storage pool version 28 lock order reversal: 1st 0xcfc3b310 zfs (zfs) @ /var/tmp/vmcontention/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1704 2nd 0xcf3dbc94 ufs (ufs) @ kern/vfs_vnops.c:407 KDB: stack backtrace: db_trace_self_wrapper(c0f796f7,6f6d2f73,656c7564,667a2f73,2e2e2f73,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a7cacb,c0f7d1c0,c1256570,197,f6b94148,...) at kdb_backtrace+0x2a _witness_debugger(c0f7d1c0,cf3dbc94,c0f6b884,cb5795a8,c0f869f9,...) at _witness_debugger+0x25 witness_checkorder(cf3dbc94,1,c0f869f0,197,cf3dbd00,...) at witness_checkorder+0x86f __lockmgr_args(cf3dbc94,200400,cf3dbd00,0,0,...) at __lockmgr_args+0x267 ffs_lock(f6b94244,1,cb5727f8,200400,cf3dbc3c,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10bfd20,f6b94244,246,c10d0f00,cf3dbc3c,...) at VOP_LOCK1_APV+0xb5 _vn_lock(cf3dbc3c,200400,c0f869f0,197,0,...) at _vn_lock+0x78 vn_rdwr(0,cf3dbc3c,d4a3fc00,200,400400,...) at vn_rdwr+0xf0 vdev_file_io_start(d5c50834,d5c50834,0,28691b8,0,...) at vdev_file_io_start+0x117 zio_vdev_io_start(d5c50834,8000,1f0000,d216e000,1f0000,...) at zio_vdev_io_start+0xcc zio_execute(d5c50834,d5d35888,d5c4e000,400,0,...) at zio_execute+0xa1 vdev_mirror_io_start(d5d35834,10,d5d35834,1,4,...) at vdev_mirror_io_start+0x193 zio_vdev_io_start(d5d35834,d403d2e0,6,d216e000,d403d2e0,...) at zio_vdev_io_start+0x2f4 zio_execute(d5d35834,d216e000,d5d27840,d4a3fc00,200,...) at zio_execute+0xa1 arc_read_nolock(d5d4a2bc,d216e000,d5d27840,d8269cf0,d5d156e8,...) at arc_read_nolock+0x780 arc_read(d5d4a2bc,d216e000,d5d27840,d5ca3a50,d8269cf0,...) at arc_read+0xb0 dbuf_read(d5d156e8,0,a,0,f6b94620,...) at dbuf_read+0x497 dmu_buf_hold(cb7f4800,4,0,0,0,...) at dmu_buf_hold+0x105 zap_lockdir(cb7f4800,4,0,0,1,...) at zap_lockdir+0x52 zap_lookup_norm(cb7f4800,4,0,f6b9482c,8,...) at zap_lookup_norm+0x4f zap_lookup(cb7f4800,4,0,f6b9482c,8,...) at zap_lookup+0x69 zfs_dirent_lock(f6b947b0,d5de8218,f6b9482c,f6b947ac,6,...) at zfs_dirent_lock+0x57c zfs_dirlook(d5de8218,f6b9482c,f6b94afc,0,0,...) at zfs_dirlook+0x6c zfs_lookup(f6b94b10,0,ce001080,d403d2e0,0,...) at zfs_lookup+0x2ba zfs_freebsd_lookup(f6b94980,c0fce757,cfc3b2b8,cfc3b2b8,f6b94b10,...) at zfs_freebsd_lookup+0x79 VOP_CACHEDLOOKUP_APV(d83838e0,f6b94980,f6b94b10,0,0,...) at VOP_CACHEDLOOKUP_APV+0xc5 vfs_cache_lookup(f6b94a1c,c0f85ee3,c10d0b40,200000,f6b94ad0,...) at vfs_cache_lookup+0xe6 VOP_LOOKUP_APV(d83838e0,f6b94a1c,f6b94b10,343,f6b949f4,...) at VOP_LOOKUP_APV+0xe5 lookup(f6b94ad0,c0f84620,10e,dc,cb572ad0,...) at lookup+0x6eb namei(f6b94ad0,f6b94ae4,c0a31371,c1bb7508,4,...) at namei+0x6bf kern_statat_vnhook(d403d2e0,200,ffffff9c,bfbfdaa8,0,...) at kern_statat_vnhook+0xbf kern_statat(d403d2e0,200,ffffff9c,bfbfdaa8,0,...) at kern_statat+0x3c kern_lstat(d403d2e0,bfbfdaa8,0,f6b94c00,cb472000,...) at kern_lstat+0x36 sys_lstat(d403d2e0,f6b94cec,c0fc78bc,c0de1312,202,...) at sys_lstat+0x2f syscall(f6b94d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (190, FreeBSD ELF32, sys_lstat), eip = 0x28205af3, esp = 0xbfbfd60c, ebp = 0xbfbfdfb8 --- Login timed out after 300 seconds Apr 21 07:57:52 x4 login: 1 LOGIN FAILURE ON console FreeBSD/i386 (x4.osted.lan) (console) login: Expensive timeout(9) function: 0xc0ca8050(0) 0.547622873 s 20120421 08:09:18 all: linger2.sh Apr 21 08:09:24 x4 kernel: pid 82113 (linger2), uid 1004 inumber 891 on /mnt: filesystem full 20120421 08:11:08 all: suj21.sh 20120421 08:12:31 all: suj24.sh 20120421 08:12:32 all: mount.sh 20120421 08:12:32 all: rename.sh 20120421 08:45:49 all: nfs5.sh Apr 21 08:46:10 x4 kernel: pid 1038 (nfsd), uid 0 inumber 8531 on /mnt: filesystem full 20120421 08:46:54 all: tmpfs5.sh 20120421 08:46:55 all: suj22.sh 20120421 08:47:55 all: newfs3.sh panic: vm_page_insert: offset 18446744073709551593 not minor than 0 cpuid = 0 KDB: enter: panic [ thread pid 51238 tid 100333 ] Stopped at kdb_enter+0x3a: movl $0,kdb_why db> run pho db:0:pho> bt Tracing pid 51238 tid 100333 td 0xcebed2e0 kdb_enter(c0f75698,c0f75698,c0fb191a,f63ba758,0,...) at kdb_enter+0x3a panic(c0fb191a,ffffffe9,ffffffff,0,0,...) at panic+0x18c vm_page_insert(c48bfd40,d2cd04a0,ffffffe9,ffffffff,20,...) at vm_page_insert+0x134 vm_page_alloc(d2cd04a0,ffffffe9,ffffffff,10222,10222,...) at vm_page_alloc+0x51c vm_page_grab(d2cd04a0,ffffffe9,ffffffff,112a2,0,...) at vm_page_grab+0x152 allocbuf(e53920c0,2000,c0f82707,b00,fffffff0,...) at allocbuf+0x672 getblk(d3122c3c,fffffff4,ffffffff,2000,0,...) at getblk+0x5e3 ffs_balloc_ufs2(d3122c3c,18000,0,1000,ce001080,...) at ffs_balloc_ufs2+0x1533 ffs_write(f63baba8,c0fcef6e,d3122c3c,0,d3122c3c,...) at ffs_write+0x2bd VOP_WRITE_APV(c10bfd20,f63baba8,d3122c3c,285,0,...) at VOP_WRITE_APV+0x136 vn_write(cdf9a2d8,f63bac40,ce001080,0,cebed2e0,...) at vn_write+0x2bc dofilewrite(f63bac40,ffffffff,ffffffff,0,f63bac1c,...) at dofilewrite+0x95 kern_writev(cebed2e0,4,f63bac40,f63bac60,1,...) at kern_writev+0x68 sys_write(cebed2e0,f63bacec,c0fc78bc,c0f4e9c2,206,...) at sys_write+0x4f syscall(f63bad28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x281a16c3, esp = 0xbfbfd73c, ebp = 0xbfbfe7f8 --- db:0:bt> show allpcpu Current CPU: 0 cpuid = 0 dynamic pcpu = 0x753880 curthread = 0xcebed2e0: pid 51238 "rw" curpcb = 0xf63bad80 fpcurthread = none idlethread = 0xcb5cd8a0: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0xa309880 curthread = 0xcb5cd5c0: pid 11 "idle: cpu1" curpcb = 0xcb3eed80 fpcurthread = none idlethread = 0xcb5cd5c0: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0xa30c880 curthread = 0xcb6e0000: pid 13 "g_up" curpcb = 0xe53d7d80 fpcurthread = none idlethread = 0xcb5cd2e0: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0xa30f880 curthread = 0xcb5cd000: pid 11 "idle: cpu3" curpcb = 0xcb3f4d80 fpcurthread = none idlethread = 0xcb5cd000: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks Process 51248 (rw) thread 0xcdf978a0 (173387) exclusive lockmgr ufs (ufs) r = 0 (0xd30f79dc) locked @ ufs/ffs/ffs_vfsops.c:1686 exclusive lockmgr ufs (ufs) r = 0 (0xd331d46c) locked @ kern/vfs_lookup.c:542 Process 51246 (rw) thread 0xd3ff48a0 (173098) exclusive lockmgr ufs (ufs) r = 0 (0xd312b310) locked @ ufs/ffs/ffs_vfsops.c:1686 exclusive lockmgr ufs (ufs) r = 0 (0xd30c09dc) locked @ kern/vfs_lookup.c:542 Process 51244 (rw) thread 0xcebee2e0 (100328) exclusive lockmgr ufs (ufs) r = 0 (0xd3014724) locked @ ufs/ffs/ffs_vfsops.c:1686 exclusive lockmgr ufs (ufs) r = 0 (0xd3016058) locked @ kern/vfs_lookup.c:730 Process 51240 (rw) thread 0xd408f2e0 (173543) exclusive lockmgr bufwait (bufwait) r = 0 (0xe51ebfa0) locked @ kern/vfs_bio.c:2652 exclusive lockmgr ufs (ufs) r = 0 (0xd3020310) locked @ ufs/ffs/ffs_vfsops.c:1686 exclusive lockmgr ufs (ufs) r = 0 (0xd300d9dc) locked @ kern/vfs_lookup.c:542 Process 51238 (rw) thread 0xcebed2e0 (100333) exclusive sleep mutex vm object (standard object) r = 0 (0xd2cd04a0) locked @ kern/vfs_bio.c:3053 exclusive lockmgr bufwait (bufwait) r = 0 (0xe5392120) locked @ kern/vfs_bio.c:1905 exclusive lockmgr ufs (ufs) r = 0 (0xd3122c94) locked @ kern/vfs_vnops.c:645 Process 87825 (md5) thread 0xcdf892e0 (100320) exclusive lockmgr bufwait (bufwait) r = 0 (0xe52ea7e0) locked @ kern/vfs_bio.c:2652 exclusive lockmgr ufs (ufs) r = 0 (0xd37afb38) locked @ dev/md/md.c:621 Process 13 (geom) thread 0xcb6e0000 (100014) exclusive sleep mutex bio queue (bio queue) r = 0 (0xc110b4e8) locked @ geom/geom_io.c:77 db:0:alllocks> show lockedvnods Locked vnodes 0xd37afae0: tag ufs, type VREG usecount 1, writecount 1, refcount 1925 mountedhere 0 flags (VV_MD) v_object 0xd07cc8ac ref 0 pages 7692 lock type ufs: EXCL by thread 0xcdf892e0 (pid 87825, md5, tid 100320) #0 0xc0a293fe at __lockmgr_args+0xd6e #1 0xc0c8f371 at ffs_lock+0xa1 #2 0xc0dd1d35 at VOP_LOCK1_APV+0xb5 #3 0xc0af1138 at _vn_lock+0x78 #4 0xc077ae08 at mdstart_vnode+0x498 #5 0xc0779a30 at md_kthread+0x1c0 #6 0xc0a13d08 at fork_exit+0xb8 #7 0xc0d97274 at fork_trampoline+0x8 ino 6194261, on dev ada0s1e 0xd3016000: tag ufs, type VDIR usecount 23, writecount 0, refcount 25 mountedhere 0 flags () v_object 0xcffd1128 ref 0 pages 0 lock type ufs: EXCL by thread 0xcebee2e0 (pid 51244, rw, tid 100328) with exclusive waiters pending #0 0xc0a293fe at __lockmgr_args+0xd6e #1 0xc0c8f371 at ffs_lock+0xa1 #2 0xc0dd1d35 at VOP_LOCK1_APV+0xb5 #3 0xc0af1138 at _vn_lock+0x78 #4 0xc0ad4474 at lookup+0x674 #5 0xc0ad550f at namei+0x6bf #6 0xc0ae6d8b at kern_mkdirat+0xbb #7 0xc0ae703e at kern_mkdir+0x2e #8 0xc0ae7069 at sys_mkdir+0x29 #9 0xc0dacf27 at syscall+0x2c7 #10 0xc0d97261 at Xint0x80_syscall+0x21 ino 1536, on dev md5a 0xd30c0984: tag ufs, type VDIR usecount 3, writecount 0, refcount 4 mountedhere 0 flags () v_object 0xd0ad365c ref 0 pages 0 lock type ufs: EXCL by thread 0xd3ff48a0 (pid 51246, rw, tid 173098) #0 0xc0a28cf2 at __lockmgr_args+0x662 #1 0xc0c8f371 at ffs_lock+0xa1 #2 0xc0dd1d35 at VOP_LOCK1_APV+0xb5 #3 0xc0af1138 at _vn_lock+0x78 #4 0xc0ad3f06 at lookup+0x106 #5 0xc0ad550f at namei+0x6bf #6 0xc0af0680 at vn_open_cred+0x90 #7 0xc0af0c0b at vn_open+0x3b #8 0xc0aece5c at kern_openat+0x1ec #9 0xc0aed305 at kern_open+0x35 #10 0xc0aed340 at sys_open+0x30 #11 0xc0dacf27 at syscall+0x2c7 #12 0xc0d97261 at Xint0x80_syscall+0x21 ino 1538, on dev md5a 0xd300d984: tag ufs, type VDIR usecount 3, writecount 0, refcount 4 mountedhere 0 flags () v_object 0xce6711bc ref 0 pages 0 lock type ufs: EXCL by thread 0xd408f2e0 (pid 51240, rw, tid 173543) #0 0xc0a28cf2 at __lockmgr_args+0x662 #1 0xc0c8f371 at ffs_lock+0xa1 #2 0xc0dd1d35 at VOP_LOCK1_APV+0xb5 #3 0xc0af1138 at _vn_lock+0x78 #4 0xc0ad3f06 at lookup+0x106 #5 0xc0ad550f at namei+0x6bf #6 0xc0af0680 at vn_open_cred+0x90 #7 0xc0af0c0b at vn_open+0x3b #8 0xc0aece5c at kern_openat+0x1ec #9 0xc0aed305 at kern_open+0x35 #10 0xc0aed340 at sys_open+0x30 #11 0xc0dacf27 at syscall+0x2c7 #12 0xc0d97261 at Xint0x80_syscall+0x21 ino 1539, on dev md5a 0xd331d414: tag ufs, type VDIR usecount 3, writecount 0, refcount 4 mountedhere 0 flags () v_object 0xd09f9250 ref 0 pages 0 lock type ufs: EXCL by thread 0xcdf978a0 (pid 51248, rw, tid 173387) #0 0xc0a28cf2 at __lockmgr_args+0x662 #1 0xc0c8f371 at ffs_lock+0xa1 #2 0xc0dd1d35 at VOP_LOCK1_APV+0xb5 #3 0xc0af1138 at _vn_lock+0x78 #4 0xc0ad3f06 at lookup+0x106 #5 0xc0ad550f at namei+0x6bf #6 0xc0af0680 at vn_open_cred+0x90 #7 0xc0af0c0b at vn_open+0x3b #8 0xc0aece5c at kern_openat+0x1ec #9 0xc0aed305 at kern_open+0x35 #10 0xc0aed340 at sys_open+0x30 #11 0xc0dacf27 at syscall+0x2c7 #12 0xc0d97261 at Xint0x80_syscall+0x21 ino 1540, on dev md5a 0xd3122c3c: tag ufs, type VREG usecount 1, writecount 1, refcount 15 mountedhere 0 flags () v_object 0xd2cd04a0 ref 0 pages 25 lock type ufs: EXCL by thread 0xcebed2e0 (pid 51238, rw, tid 100333) #0 0xc0a293fe at __lockmgr_args+0xd6e #1 0xc0c8f371 at ffs_lock+0xa1 #2 0xc0dd1d35 at VOP_LOCK1_APV+0xb5 #3 0xc0af1138 at _vn_lock+0x78 #4 0xc0af1f86 at vn_write+0x176 #5 0xc0a912a5 at dofilewrite+0x95 #6 0xc0a91918 at kern_writev+0x68 #7 0xc0a91a2f at sys_write+0x4f #8 0xc0dacf27 at syscall+0x2c7 #9 0xc0d97261 at Xint0x80_syscall+0x21 ino 1541, on dev md5a 0xd30202b8: tag ufs, type VREG usecount 1, writecount 0, refcount 1 mountedhere 0 flags () lock type ufs: EXCL by thread 0xd408f2e0 (pid 51240, rw, tid 173543) #0 0xc0a293fe at __lockmgr_args+0xd6e #1 0xc0c886d9 at ffs_vgetf+0x189 #2 0xc0c88b3e at ffs_vget+0x2e #3 0xc0c5c010 at ffs_valloc+0x500 #4 0xc0c9e713 at ufs_makeinode+0xc3 #5 0xc0c9efd0 at ufs_create+0x30 #6 0xc0dd2d05 at VOP_CREATE_APV+0xc5 #7 0xc0af07f5 at vn_open_cred+0x205 #8 0xc0af0c0b at vn_open+0x3b #9 0xc0aece5c at kern_openat+0x1ec #10 0xc0aed305 at kern_open+0x35 #11 0xc0aed340 at sys_open+0x30 #12 0xc0dacf27 at syscall+0x2c7 #13 0xc0d97261 at Xint0x80_syscall+0x21 ino 1542, on dev md5a 0xd30f7984: tag ufs, type VREG usecount 1, writecount 0, refcount 1 mountedhere 0 flags () lock type ufs: EXCL by thread 0xcdf978a0 (pid 51248, rw, tid 173387) #0 0xc0a293fe at __lockmgr_args+0xd6e #1 0xc0c886d9 at ffs_vgetf+0x189 #2 0xc0c88b3e at ffs_vget+0x2e #3 0xc0c5c010 at ffs_valloc+0x500 #4 0xc0c9e713 at ufs_makeinode+0xc3 #5 0xc0c9efd0 at ufs_create+0x30 #6 0xc0dd2d05 at VOP_CREATE_APV+0xc5 #7 0xc0af07f5 at vn_open_cred+0x205 #8 0xc0af0c0b at vn_open+0x3b #9 0xc0aece5c at kern_openat+0x1ec #10 0xc0aed305 at kern_open+0x35 #11 0xc0aed340 at sys_open+0x30 #12 0xc0dacf27 at syscall+0x2c7 #13 0xc0d97261 at Xint0x80_syscall+0x21 ino 1543, on dev md5a 0xd312b2b8: tag ufs, type VREG usecount 1, writecount 0, refcount 1 mountedhere 0 flags () lock type ufs: EXCL by thread 0xd3ff48a0 (pid 51246, rw, tid 173098) #0 0xc0a293fe at __lockmgr_args+0xd6e #1 0xc0c886d9 at ffs_vgetf+0x189 #2 0xc0c88b3e at ffs_vget+0x2e #3 0xc0c5c010 at ffs_valloc+0x500 #4 0xc0c9e713 at ufs_makeinode+0xc3 #5 0xc0c9efd0 at ufs_create+0x30 #6 0xc0dd2d05 at VOP_CREATE_APV+0xc5 #7 0xc0af07f5 at vn_open_cred+0x205 #8 0xc0af0c0b at vn_open+0x3b #9 0xc0aece5c at kern_openat+0x1ec #10 0xc0aed305 at kern_open+0x35 #11 0xc0aed340 at sys_open+0x30 #12 0xc0dacf27 at syscall+0x2c7 #13 0xc0d97261 at Xint0x80_syscall+0x21 ino 1544, on dev md5a 0xd30146cc: tag ufs, type VDIR usecount 1, writecount 0, refcount 1 mountedhere 0 flags () lock type ufs: EXCL by thread 0xcebee2e0 (pid 51244, rw, tid 100328) #0 0xc0a293fe at __lockmgr_args+0xd6e #1 0xc0c886d9 at ffs_vgetf+0x189 #2 0xc0c88b3e at ffs_vget+0x2e #3 0xc0c5c010 at ffs_valloc+0x500 #4 0xc0ca16d9 at ufs_mkdir+0xa9 #5 0xc0dd21b5 at VOP_MKDIR_APV+0xc5 #6 0xc0ae6f61 at kern_mkdirat+0x291 #7 0xc0ae703e at kern_mkdir+0x2e #8 0xc0ae7069 at sys_mkdir+0x29 #9 0xc0dacf27 at syscall+0x2c7 #10 0xc0d97261 at Xint0x80_syscall+0x21 ino 1545, on dev md5a db:0:lockedvnods> show mount 0xcdf60b40 /dev/ad4s1a on / (ufs) 0xcdf61000 devfs on /dev (devfs) 0xce2cb5a0 /dev/ad4s1f on /home (ufs) 0xce2cb000 /dev/ad4s1d on /usr (ufs) 0xcdf61b40 /dev/ad4s1e on /var (ufs) 0xcdf61870 procfs on /proc (procfs) 0xd66a75a0 /dev/label/tmp on /tmp (ufs) 0xcf7382d0 /dev/md5a on /mnt (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 51252 51237 80325 0 D+ ufs 0xd3016058 rw 51251 51241 80325 0 S+ nanslp 0xc110f524 mkdir 51250 51237 80325 0 D+ ufs 0xd3016058 rw 51249 51241 80325 0 S+ nanslp 0xc110f524 mkdir 51248 51237 80325 0 D+ getblk 0xe51ebfa0 rw 51247 51241 80325 0 S+ nanslp 0xc110f524 mkdir 51246 51237 80325 0 D+ getblk 0xe51ebfa0 rw 51245 51241 80325 0 S+ nanslp 0xc110f524 mkdir 51244 51237 80325 0 D+ getblk 0xe51ebfa0 rw 51243 51239 80325 0 D+ ufs 0xd3016058 creat 51242 51237 80325 0 D+ ufs 0xd3016058 rw 51241 51236 80325 0 S+ wait 0xcdfe0b30 mkdir 51240 51237 80325 0 D+ biowr 0xe51ebf40 rw 51239 51235 80325 0 S+ wait 0xd3929000 creat 51238 51237 80325 0 R+ CPU 0 rw 51237 51234 80325 0 S+ wait 0xd4436b30 rw 51236 51233 80325 0 S+ nanslp 0xc110f524 mkdir 51235 51233 80325 0 S+ nanslp 0xc110f524 creat 51234 51233 80325 0 S+ nanslp 0xc110f524 rw 51233 51232 80325 0 S+ wait 0xd475db30 run 51232 51231 80325 0 S+ wait 0xd455f864 run 51231 51226 80325 0 S+ nanslp 0xc110f524 run 51226 87787 80325 0 S+ wait 0xd41f7b30 sh 51211 1203 1201 1001 S nanslp 0xc110f524 sleep 87825 0 0 0 DL biowr 0xe52ea780 [md5] 87787 80325 80325 0 S+ wait 0xd482f000 sh 81021 1 81021 0 Ss+ ttyin 0xcb6f5c70 getty 80945 0 0 0 DL (threaded) [zfskern] 172741 D l2arc_fe 0xd8394284 [l2arc_feed_thread] 100573 D arc_recl 0xd83850fc [arc_reclaim_thread] 80325 1294 80325 0 S+ wait 0xd481c598 sh 37019 37013 37019 0 S+ ttyin 0xce2b5270 bash 37013 37006 37013 0 SW+ pause 0xceeccb88 csh 37006 16369 37006 1001 SW+ wait 0xceb58598 su 16369 16368 16369 1001 SWs+ wait 0xcfc06864 bash 16368 16366 16366 1001 S select 0xd7e984a4 sshd 16366 1143 16366 0 Ss select 0xd7e92be4 sshd 1534 1 1534 0 Ss+ ttyin 0xcb985670 getty 1533 1 1533 0 Ss+ ttyin 0xcb985870 getty 1532 1 1532 0 Ss+ ttyin 0xcb985a70 getty 1531 1 1531 0 Ss+ ttyin 0xcb6f5270 getty 1530 1 1530 0 Ss+ ttyin 0xcb6f5470 getty 1529 1 1529 0 Ss+ ttyin 0xcb6f5670 getty 1528 1 1528 0 Ss+ ttyin 0xcb6f5870 getty 1527 1 1527 0 Ss+ ttyin 0xcb6f5a70 getty 1509 1 1509 0 Ss select 0xcdf534a4 inetd 1484 1 1484 0 Ss nanslp 0xc110f524 watchdogd 1294 1276 1294 0 SW+ wait 0xce9ad2cc bash 1276 1275 1276 0 SW+ pause 0xce9af8bc csh 1275 1223 1275 1001 SW+ wait 0xce8b1598 su 1223 1222 1223 1001 SWs+ wait 0xce8ad598 bash 1222 1220 1220 1001 S select 0xcdf53624 sshd 1220 1143 1220 0 Ss select 0xce2cd1a4 sshd 1204 1201 1201 1001 S piperd 0xce008640 awk 1203 1201 1201 1001 S wait 0xce8adb30 sh 1202 1198 1202 1001 Ss+ select 0xce2cd264 top 1201 1199 1201 1001 SWs wait 0xce8b3b30 sh 1200 1197 1200 1001 Ss kqread 0xce660d00 tail 1199 1192 1192 1001 S select 0xcdf079e4 sshd 1198 1193 1193 1001 S select 0xce2cd224 sshd 1197 1191 1191 1001 S select 0xcde96164 sshd 1193 1143 1193 0 Ss select 0xcde961e4 sshd 1192 1143 1192 0 Ss select 0xcdf07964 sshd 1191 1143 1191 0 Ss select 0xcdf536a4 sshd 1154 1 1154 0 Ss nanslp 0xc110f524 cron 1149 1 1149 25 Ss pause 0xcdfc48bc sendmail 1146 1 1146 0 Ss select 0xcdf537e4 sendmail 1143 1 1143 0 Ss select 0xcde96224 sshd 1112 1 1112 0 Ss select 0xce2cd3a4 moused 1092 1 1092 0 Ss select 0xcdf537a4 ntpd 1038 1032 1032 0 S (threaded) nfsd 100121 S rpcsvc 0xcdf20790 nfsd: service 100120 S rpcsvc 0xcdf207d0 nfsd: service 100119 S rpcsvc 0xcdf20810 nfsd: service 100087 S rpcsvc 0xcde935d0 nfsd: master 1032 1 1032 0 Ss select 0xce2cd3e4 nfsd 1030 1026 1026 0 S select 0xcdf07a64 nfsuserd 1029 1026 1026 0 S select 0xcde96264 nfsuserd 1028 1026 1026 0 S select 0xcdf53824 nfsuserd 1027 1026 1026 0 S select 0xcde962a4 nfsuserd 1026 1 1026 0 SWs pause 0xce5c9058 nfsuserd 1010 1 1010 0 Ss select 0xcdf53864 mountd 976 1 976 0 Ss select 0xce2cd424 rpcbind 961 1 961 0 Ss select 0xcdf539e4 syslogd 838 1 838 0 Ss select 0xcdf07aa4 devd 19 0 0 0 DL sdflush 0xc128ba00 [softdepflush] 18 0 0 0 DL syncer 0xc12856f4 [syncer] 17 0 0 0 DL vlruwt 0xcdec2598 [vnlru] 16 0 0 0 DL psleep 0xc1285388 [bufdaemon] 9 0 0 0 DL pgzero 0xc128d8e8 [pagezero] 8 0 0 0 DL psleep 0xc128d4c8 [vmdaemon] 7 0 0 0 DL psleep 0xc128d490 [pagedaemon] 6 0 0 0 DL ccb_scan 0xc10d24d4 [xpt_thrd] 5 0 0 0 DL waiting_ 0xc1287218 [sctp_iterator] 4 0 0 0 DL ctl_work 0xcb98c000 [ctl_thrd] 3 0 0 0 DL - 0xcb7f7a3c [fdc0] 2 0 0 0 SL - 0xcb887000 [fw0_probe] 15 0 0 0 DL (threaded) [usb] 100058 D - 0xcb85cd34 [usbus5] 100057 D - 0xcb85cd04 [usbus5] 100056 D - 0xcb85ccd4 [usbus5] 100055 D - 0xcb85cca4 [usbus5] 100053 D - 0xcb84fb5c [usbus4] 100052 D - 0xcb84fb2c [usbus4] 100051 D - 0xcb84fafc [usbus4] 100050 D - 0xcb84facc [usbus4] 100049 D - 0xcb84ab5c [usbus3] 100048 D - 0xcb84ab2c [usbus3] 100047 D - 0xcb84aafc [usbus3] 100046 D - 0xcb84aacc [usbus3] 100045 D - 0xcb842b5c [usbus2] 100044 D - 0xcb842b2c [usbus2] 100043 D - 0xcb842afc [usbus2] 100042 D - 0xcb842acc [usbus2] 100040 D - 0xcb83cb5c [usbus1] 100039 D - 0xcb83cb2c [usbus1] 100038 D - 0xcb83cafc [usbus1] 100037 D - 0xcb83cacc [usbus1] 100035 D - 0xcb831b5c [usbus0] 100034 D - 0xcb831b2c [usbus0] 100033 D - 0xcb831afc [usbus0] 100032 D - 0xcb831acc [usbus0] 14 0 0 0 DL - 0xc110e324 [yarrow] 13 0 0 0 RL (threaded) [geom] 100015 D - 0xc110b568 [g_down] 100014 Run CPU 2 [g_up] 100013 D - 0xc110b55c [g_event] 12 0 0 0 WL (threaded) [intr] 100066 I [irq12: psm0] 100065 I [irq1: atkbd0] 100063 I [swi0: uart] 100060 I [irq20: fwohci0] 100059 I [irq14: ata0] 100054 I [irq19: ehci0] 100041 I [irq18: ohci2 ohci4] 100036 I [irq17: ohci1 ohci3] 100031 I [irq16: hdac1 ohci0] 100030 I [irq22: ahci0] 100029 I [irq257: re0] 100028 I [irq256: hdac0] 100024 I [swi6: task queue] 100023 I [swi6: Giant taskq] 100021 I [swi5: +] 100018 I [swi2: cambio] 100012 I [swi4: clock] 100011 I [swi4: clock] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 I [swi3: vm] 100007 I [swi1: netisr 0] 11 0 0 0 RL (threaded) [idle] 100006 Run CPU 3 [idle: cpu3] 100005 CanRun [idle: cpu2] 100004 Run CPU 1 [idle: cpu1] 100003 CanRun [idle: cpu0] 1 0 1 0 SLs wait 0xcb5cbb30 [init] 10 0 0 0 DL audit_wo 0xc128b140 [audit] 0 0 0 0 DLs (threaded) [kernel] 172739 D - 0xcded2240 [system_taskq_3] 172737 D - 0xcded2240 [system_taskq_2] 172736 D - 0xcded2240 [system_taskq_1] 172732 D - 0xcded2240 [system_taskq_0] 100069 D - 0xc110e324 [deadlkres] 100068 D - 0xcdc27200 [mca taskq] 100061 D - 0xcb886500 [fw0_taskq] 100027 D - 0xcb5a56c0 [acpi_task_2] 100026 D - 0xcb5a56c0 [acpi_task_1] 100025 D - 0xcb5a56c0 [acpi_task_0] 100022 D - 0xcb5a5780 [thread taskq] 100020 D - 0xcb5a5800 [ffs_trim taskq] 100019 D - 0xcb5a5840 [kqueue taskq] 100016 D - 0xcb5a5c40 [firmware taskq] 100000 D sched 0xc110b680 [swapper] db:0:ps> allt Tracing command rw pid 51252 tid 173516 td 0xd3fe7b80 sched_switch(d3fe7b80,0,104,1a3,12ac02b3,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,60,...) at mi_switch+0x1ff sleepq_switch(d3fe7b80,0,c0f7b0e0,268,0,...) at sleepq_switch+0x162 sleepq_wait(d3016058,60,c0f6b884,4,0,...) at sleepq_wait+0x63 __lockmgr_args(d3016058,400400,d30160c4,0,0,...) at __lockmgr_args+0xc86 ffs_lock(f761ba0c,d3016000,f761b9f8,400400,d3016000,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10bfd20,f761ba0c,f761ba14,c10d0f00,d3016000,...) at VOP_LOCK1_APV+0xb5 _vn_lock(d3016000,400400,c0f84620,2da,c0f84620,...) at _vn_lock+0x78 lookup(f761bb40,c0f84620,10e,dc,d3fe7b80,...) at lookup+0x674 namei(f761bb40,1c,0,bfbf9000,0,...) at namei+0x6bf kern_mkdirat(d3fe7b80,ffffff9c,804c280,0,1f8,...) at kern_mkdirat+0xbb kern_mkdir(d3fe7b80,804c280,0,1f8,f761bd1c,...) at kern_mkdir+0x2e sys_mkdir(d3fe7b80,f761bcec,c0fc78bc,c0f7ef61,282,...) at sys_mkdir+0x29 syscall(f761bd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x28191b33, esp = 0xbfbfe76c, ebp = 0xbfbfe7f8 --- Tracing command mkdir pid 51251 tid 101600 td 0xce91f8a0 sched_switch(ce91f8a0,0,104,1a3,1168efef,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(ce91f8a0,0,c0f7b0e0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(bb9,c0a832f0,ce91f8a0,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c110f524,6c,c0f76bf7,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c110f524,0,16c,c0f76bf7,bb9,...) at _sleep+0x34f kern_nanosleep(ce91f8a0,f6135c4c,f6135c54,3,0,...) at kern_nanosleep+0xc1 sys_nanosleep(ce91f8a0,f6135cec,4,c,206,...) at sys_nanosleep+0x6f syscall(f6135d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28180223, esp = 0xbfbfe7cc, ebp = 0xbfbfe7f8 --- Tracing command rw pid 51250 tid 173811 td 0xd49fb8a0 sched_switch(d49fb8a0,0,104,1a3,12ac348c,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,60,...) at mi_switch+0x1ff sleepq_switch(d49fb8a0,0,c0f7b0e0,268,0,...) at sleepq_switch+0x162 sleepq_wait(d3016058,60,c0f6b884,4,0,...) at sleepq_wait+0x63 __lockmgr_args(d3016058,400400,d30160c4,0,0,...) at __lockmgr_args+0xc86 ffs_lock(f79fea0c,d3016000,f79fe9f8,400400,d3016000,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10bfd20,f79fea0c,f79fea14,c10d0f00,d3016000,...) at VOP_LOCK1_APV+0xb5 _vn_lock(d3016000,400400,c0f84620,2da,c0f84620,...) at _vn_lock+0x78 lookup(f79feb40,c0f84620,10e,dc,d49fb8a0,...) at lookup+0x674 namei(f79feb40,1c,0,bfbf9000,0,...) at namei+0x6bf kern_mkdirat(d49fb8a0,ffffff9c,804c280,0,1f8,...) at kern_mkdirat+0xbb kern_mkdir(d49fb8a0,804c280,0,1f8,f79fed1c,...) at kern_mkdir+0x2e sys_mkdir(d49fb8a0,f79fecec,c0fc78bc,c0f7ef61,282,...) at sys_mkdir+0x29 syscall(f79fed28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x28191b33, esp = 0xbfbfe76c, ebp = 0xbfbfe7f8 --- Tracing command mkdir pid 51249 tid 100403 td 0xceea15c0 sched_switch(ceea15c0,0,104,1a3,1167d6e8,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(ceea15c0,0,c0f7b0e0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(3e9,c0a832f0,ceea15c0,2,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c110f524,6c,c0f76bf7,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c110f524,0,16c,c0f76bf7,3e9,...) at _sleep+0x34f kern_nanosleep(ceea15c0,f6529c4c,f6529c54,1,0,...) at kern_nanosleep+0xc1 sys_nanosleep(ceea15c0,f6529cec,c0fc78bc,c,202,...) at sys_nanosleep+0x6f syscall(f6529d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28180223, esp = 0xbfbfe7cc, ebp = 0xbfbfe7f8 --- Tracing command rw pid 51248 tid 173387 td 0xcdf978a0 sched_switch(cdf978a0,0,104,1a3,12c06582,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,60,...) at mi_switch+0x1ff sleepq_switch(cdf978a0,0,c0f7b0e0,268,0,...) at sleepq_switch+0x162 sleepq_wait(e51ebfa0,60,c0f6d554,4,0,...) at sleepq_wait+0x63 __lockmgr_args(e51ebfa0,81900,cf216d34,c0f6d554,60,...) at __lockmgr_args+0xc86 getblk(cf216c3c,c0b0,0,2000,0,...) at getblk+0x167 breadn_flags(cf216c3c,c0b0,0,2000,0,...) at breadn_flags+0x43 ffs_update(d30f7984,1,ce001080,0,c10c02e0,...) at ffs_update+0x1c2 ufs_makeinode(f7362bbc,c10c02e0,f7362b00,f7362a5c,c0dd2d05,...) at ufs_makeinode+0x393 ufs_create(f7362b00,c0fcf038,0,0,f7362b7c,...) at ufs_create+0x30 VOP_CREATE_APV(c10bfd20,f7362b00,f7362bbc,f7362a98,0,...) at VOP_CREATE_APV+0xc5 vn_open_cred(f7362b7c,f7362c44,1b0,0,ce001080,...) at vn_open_cred+0x205 vn_open(f7362b7c,f7362c44,1b0,d31000a8,c10af1a0,...) at vn_open+0x3b kern_openat(cdf978a0,ffffff9c,bfbfe768,0,602,...) at kern_openat+0x1ec kern_open(cdf978a0,bfbfe768,0,601,1b0,...) at kern_open+0x35 sys_open(cdf978a0,f7362cec,c0fc78bc,c0f7ef61,206,...) at sys_open+0x30 syscall(f7362d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x28199193, esp = 0xbfbfd71c, ebp = 0xbfbfd738 --- Tracing command mkdir pid 51247 tid 104121 td 0xd20d8000 sched_switch(d20d8000,0,104,1a3,116775be,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(d20d8000,0,c0f7b0e0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(7d1,c0a832f0,d20d8000,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c110f524,6c,c0f76bf7,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c110f524,0,16c,c0f76bf7,7d1,...) at _sleep+0x34f kern_nanosleep(d20d8000,f6ac4c4c,f6ac4c54,2,0,...) at kern_nanosleep+0xc1 sys_nanosleep(d20d8000,f6ac4cec,c0fc78bc,c,202,...) at sys_nanosleep+0x6f syscall(f6ac4d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28180223, esp = 0xbfbfe7cc, ebp = 0xbfbfe7f8 --- Tracing command rw pid 51246 tid 173098 td 0xd3ff48a0 sched_switch(d3ff48a0,0,104,1a3,12c073dc,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,60,...) at mi_switch+0x1ff sleepq_switch(d3ff48a0,0,c0f7b0e0,268,0,...) at sleepq_switch+0x162 sleepq_wait(e51ebfa0,60,c0f6d554,4,0,...) at sleepq_wait+0x63 __lockmgr_args(e51ebfa0,81900,cf216d34,c0f6d554,60,...) at __lockmgr_args+0xc86 getblk(cf216c3c,c0b0,0,2000,0,...) at getblk+0x167 breadn_flags(cf216c3c,c0b0,0,2000,0,...) at breadn_flags+0x43 ffs_update(d312b2b8,1,ce001080,0,c10c02e0,...) at ffs_update+0x1c2 ufs_makeinode(f6efdbbc,c10c02e0,f6efdb00,f6efda5c,c0dd2d05,...) at ufs_makeinode+0x393 ufs_create(f6efdb00,c0fcf038,0,0,f6efdb7c,...) at ufs_create+0x30 VOP_CREATE_APV(c10bfd20,f6efdb00,f6efdbbc,f6efda98,0,...) at VOP_CREATE_APV+0xc5 vn_open_cred(f6efdb7c,f6efdc44,1b0,0,ce001080,...) at vn_open_cred+0x205 vn_open(f6efdb7c,f6efdc44,1b0,d30b83f0,c10af1a0,...) at vn_open+0x3b kern_openat(d3ff48a0,ffffff9c,bfbfe768,0,602,...) at kern_openat+0x1ec kern_open(d3ff48a0,bfbfe768,0,601,1b0,...) at kern_open+0x35 sys_open(d3ff48a0,f6efdcec,c0fc78bc,c0f7ef61,206,...) at sys_open+0x30 syscall(f6efdd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x28199193, esp = 0xbfbfd71c, ebp = 0xbfbfd738 --- Tracing command mkdir pid 51245 tid 173789 td 0xd40352e0 sched_switch(d40352e0,0,104,1a3,11533587,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(d40352e0,0,c0f7b0e0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(fa1,c0a832f0,d40352e0,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c110f524,6c,c0f76bf7,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c110f524,0,16c,c0f76bf7,fa1,...) at _sleep+0x34f kern_nanosleep(d40352e0,f79bcc4c,f79bcc54,4,0,...) at kern_nanosleep+0xc1 sys_nanosleep(d40352e0,f79bccec,c0fc78bc,c,202,...) at sys_nanosleep+0x6f syscall(f79bcd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28180223, esp = 0xbfbfe7cc, ebp = 0xbfbfe7f8 --- Tracing command rw pid 51244 tid 100328 td 0xcebee2e0 sched_switch(cebee2e0,0,104,1a3,12c090ef,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,60,...) at mi_switch+0x1ff sleepq_switch(cebee2e0,0,c0f7b0e0,268,0,...) at sleepq_switch+0x162 sleepq_wait(e51ebfa0,60,c0f6d554,4,0,...) at sleepq_wait+0x63 __lockmgr_args(e51ebfa0,81900,cf216d34,c0f6d554,60,...) at __lockmgr_args+0xc86 getblk(cf216c3c,c0b0,0,2000,0,...) at getblk+0x167 breadn_flags(cf216c3c,c0b0,0,2000,0,...) at breadn_flags+0x43 ffs_update(d3016000,1,ce001080,0,c10d0c60,...) at ffs_update+0x1c2 ufs_mkdir(f63abc10,c0fcee72,0,0,f63abba8,...) at ufs_mkdir+0x38a VOP_MKDIR_APV(c10bfd20,f63abc10,f63abb80,f63abba8,0,...) at VOP_MKDIR_APV+0xc5 kern_mkdirat(cebee2e0,ffffff9c,804c280,0,1f8,...) at kern_mkdirat+0x291 kern_mkdir(cebee2e0,804c280,0,1f8,f63abd1c,...) at kern_mkdir+0x2e sys_mkdir(cebee2e0,f63abcec,c0fc78bc,c0f7ef61,282,...) at sys_mkdir+0x29 syscall(f63abd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x28191b33, esp = 0xbfbfe76c, ebp = 0xbfbfe7f8 --- Tracing command creat pid 51243 tid 100394 td 0xceead2e0 sched_switch(ceead2e0,0,104,1a3,12ac1128,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,60,...) at mi_switch+0x1ff sleepq_switch(ceead2e0,0,c0f7b0e0,268,0,...) at sleepq_switch+0x162 sleepq_wait(d3016058,60,c0f6b884,4,0,...) at sleepq_wait+0x63 __lockmgr_args(d3016058,400400,d30160c4,0,0,...) at __lockmgr_args+0xc86 ffs_lock(f650ea0c,d3016000,f650e9f8,400400,d3016000,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10bfd20,f650ea0c,f650ea14,c10d0f00,d3016000,...) at VOP_LOCK1_APV+0xb5 _vn_lock(d3016000,400400,c0f84620,2da,c0f84620,...) at _vn_lock+0x78 lookup(f650eb40,c0f84620,10e,dc,c0f7393b,...) at lookup+0x674 namei(f650eb40,f650eba4,cf238400,0,804c460,...) at namei+0x6bf kern_mkdirat(ceead2e0,ffffff9c,804c280,0,1f8,...) at kern_mkdirat+0xbb kern_mkdir(ceead2e0,804c280,0,1f8,f650ed1c,...) at kern_mkdir+0x2e sys_mkdir(ceead2e0,f650ecec,c0fc78bc,c0f7ef61,282,...) at sys_mkdir+0x29 syscall(f650ed28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x28191b33, esp = 0xbfbfe76c, ebp = 0xbfbfe7f8 --- Tracing command rw pid 51242 tid 173782 td 0xd40372e0 sched_switch(d40372e0,0,104,1a3,12abf59b,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,60,...) at mi_switch+0x1ff sleepq_switch(d40372e0,0,c0f7b0e0,268,0,...) at sleepq_switch+0x162 sleepq_wait(d3016058,60,c0f6b884,4,0,...) at sleepq_wait+0x63 __lockmgr_args(d3016058,400400,d30160c4,0,0,...) at __lockmgr_args+0xc86 ffs_lock(f79a7a0c,d3016000,f79a79f8,400400,d3016000,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10bfd20,f79a7a0c,f79a7a14,c10d0f00,d3016000,...) at VOP_LOCK1_APV+0xb5 _vn_lock(d3016000,400400,c0f84620,2da,c0f84620,...) at _vn_lock+0x78 lookup(f79a7b40,c0f84620,10e,dc,d40372e0,...) at lookup+0x674 namei(f79a7b40,1c,0,bfbf9000,0,...) at namei+0x6bf kern_mkdirat(d40372e0,ffffff9c,804c280,0,1f8,...) at kern_mkdirat+0xbb kern_mkdir(d40372e0,804c280,0,1f8,f79a7d1c,...) at kern_mkdir+0x2e sys_mkdir(d40372e0,f79a7cec,c0fc78bc,c0f7ef61,282,...) at sys_mkdir+0x29 syscall(f79a7d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x28191b33, esp = 0xbfbfe76c, ebp = 0xbfbfe7f8 --- Tracing command mkdir pid 51241 tid 100093 td 0xcdfe92e0 sched_switch(cdfe92e0,0,104,1a3,115419e9,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cdfe92e0,0,c0f7b0e0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f7b0e0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cdfe0b30,6c,c0f7e025,100,0,...) at sleepq_wait_sig+0x17 _sleep(cdfe0b30,cdfe0bb8,16c,c0f7e025,0,...) at _sleep+0x385 kern_wait(cdfe92e0,c82d,f5ffdc5c,0,0,...) at kern_wait+0x597 sys_wait4(cdfe92e0,f5ffdcec,c0fc78bc,c,216,...) at sys_wait4+0x3b syscall(f5ffdd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2810e5fb, esp = 0xbfbfe7dc, ebp = 0xbfbfe7f8 --- Tracing command rw pid 51240 tid 173543 td 0xd408f2e0 sched_switch(d408f2e0,0,104,1a3,12c0c4af,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(d408f2e0,0,c0f7b0e0,268,0,...) at sleepq_switch+0x162 sleepq_wait(e51ebf40,5c,c0f82ab7,0,0,...) at sleepq_wait+0x63 _sleep(e51ebf40,cb58c704,5c,c0f82ab7,0,...) at _sleep+0x39c bwait(e51ebf40,5c,c0f82ab7,e51ebf40,f76da814,...) at bwait+0x6f bufwait(e51ebf40,e51ebf40,eb,e51ebf40,c00,...) at bufwait+0x48 bufwrite(e51ebf40,0,c0fac8b0,80d,d57c1000) at bufwrite+0x165 ffs_bufwrite(e51ebf40,d561f200,100,2000,0,...) at ffs_bufwrite+0x290 ffs_update(d30202b8,1,ce001080,0,c10c02e0,...) at ffs_update+0x3a5 ufs_makeinode(f76dabbc,c10c02e0,f76dab00,f76daa5c,c0dd2d05,...) at ufs_makeinode+0x393 ufs_create(f76dab00,c0fcf038,0,0,f76dab7c,...) at ufs_create+0x30 VOP_CREATE_APV(c10bfd20,f76dab00,f76dabbc,f76daa98,0,...) at VOP_CREATE_APV+0xc5 vn_open_cred(f76dab7c,f76dac44,1b0,0,ce001080,...) at vn_open_cred+0x205 vn_open(f76dab7c,f76dac44,1b0,d30ce380,c10af1a0,...) at vn_open+0x3b kern_openat(d408f2e0,ffffff9c,bfbfe768,0,602,...) at kern_openat+0x1ec kern_open(d408f2e0,bfbfe768,0,601,1b0,...) at kern_open+0x35 sys_open(d408f2e0,f76dacec,c0fc78bc,c0f7ef61,206,...) at sys_open+0x30 syscall(f76dad28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x28199193, esp = 0xbfbfd71c, ebp = 0xbfbfd738 --- Tracing command creat pid 51239 tid 102861 td 0xce5a98a0 sched_switch(ce5a98a0,0,104,1a3,112dbd48,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(ce5a98a0,0,c0f7b0e0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f7b0e0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(d3929000,6c,c0f7e025,100,0,...) at sleepq_wait_sig+0x17 _sleep(d3929000,d3929088,16c,c0f7e025,0,...) at _sleep+0x385 kern_wait(ce5a98a0,c82b,f699bc5c,0,0,...) at kern_wait+0x597 sys_wait4(ce5a98a0,f699bcec,c0fc78bc,c,216,...) at sys_wait4+0x3b syscall(f699bd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2810e5fb, esp = 0xbfbfe7dc, ebp = 0xbfbfe7f8 --- Tracing command rw pid 51238 tid 100333 td 0xcebed2e0 kdb_enter(c0f75698,c0f75698,c0fb191a,f63ba758,0,...) at kdb_enter+0x3a panic(c0fb191a,ffffffe9,ffffffff,0,0,...) at panic+0x18c vm_page_insert(c48bfd40,d2cd04a0,ffffffe9,ffffffff,20,...) at vm_page_insert+0x134 vm_page_alloc(d2cd04a0,ffffffe9,ffffffff,10222,10222,...) at vm_page_alloc+0x51c vm_page_grab(d2cd04a0,ffffffe9,ffffffff,112a2,0,...) at vm_page_grab+0x152 allocbuf(e53920c0,2000,c0f82707,b00,fffffff0,...) at allocbuf+0x672 getblk(d3122c3c,fffffff4,ffffffff,2000,0,...) at getblk+0x5e3 ffs_balloc_ufs2(d3122c3c,18000,0,1000,ce001080,...) at ffs_balloc_ufs2+0x1533 ffs_write(f63baba8,c0fcef6e,d3122c3c,0,d3122c3c,...) at ffs_write+0x2bd VOP_WRITE_APV(c10bfd20,f63baba8,d3122c3c,285,0,...) at VOP_WRITE_APV+0x136 vn_write(cdf9a2d8,f63bac40,ce001080,0,cebed2e0,...) at vn_write+0x2bc dofilewrite(f63bac40,ffffffff,ffffffff,0,f63bac1c,...) at dofilewrite+0x95 kern_writev(cebed2e0,4,f63bac40,f63bac60,1,...) at kern_writev+0x68 sys_write(cebed2e0,f63bacec,c0fc78bc,c0f4e9c2,206,...) at sys_write+0x4f syscall(f63bad28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x281a16c3, esp = 0xbfbfd73c, ebp = 0xbfbfe7f8 --- Tracing command rw pid 51237 tid 173155 td 0xd408b8a0 sched_switch(d408b8a0,0,104,1a3,1156c0e6,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(d408b8a0,0,c0f7b0e0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f7b0e0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(d4436b30,6c,c0f7e025,100,0,...) at sleepq_wait_sig+0x17 _sleep(d4436b30,d4436bb8,16c,c0f7e025,0,...) at _sleep+0x385 kern_wait(d408b8a0,c826,f6fe1c5c,0,0,...) at kern_wait+0x597 sys_wait4(d408b8a0,f6fe1cec,c0fc78bc,c,216,...) at sys_wait4+0x3b syscall(f6fe1d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2810e5fb, esp = 0xbfbfe7dc, ebp = 0xbfbfe7f8 --- Tracing command mkdir pid 51236 tid 173300 td 0xd3fb08a0 sched_switch(d3fb08a0,0,104,1a3,112554fc,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(d3fb08a0,0,c0f7b0e0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(3e9,c0a832f0,d3fb08a0,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c110f524,6c,c0f76bf7,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c110f524,0,16c,c0f76bf7,3e9,...) at _sleep+0x34f kern_nanosleep(d3fb08a0,f7225c4c,f7225c54,1,0,...) at kern_nanosleep+0xc1 sys_nanosleep(d3fb08a0,f7225cec,c0fc78bc,c,202,...) at sys_nanosleep+0x6f syscall(f7225d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28180223, esp = 0xbfbfe7cc, ebp = 0xbfbfe7f8 --- Tracing command creat pid 51235 tid 173380 td 0xd492a5c0 sched_switch(d492a5c0,0,104,1a3,111f2902,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(d492a5c0,0,c0f7b0e0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(3e9,c0a832f0,d492a5c0,2,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c110f524,6c,c0f76bf7,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c110f524,0,16c,c0f76bf7,3e9,...) at _sleep+0x34f kern_nanosleep(d492a5c0,f7346c4c,f7346c54,1,0,...) at kern_nanosleep+0xc1 sys_nanosleep(d492a5c0,f7346cec,c0fc78bc,c,202,...) at sys_nanosleep+0x6f syscall(f7346d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28180223, esp = 0xbfbfe7cc, ebp = 0xbfbfe7f8 --- Tracing command rw pid 51234 tid 173780 td 0xd40378a0 sched_switch(d40378a0,0,104,1a3,110d3f6e,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(d40378a0,0,c0f7b0e0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(3e9,c0a832f0,d40378a0,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c110f524,6c,c0f76bf7,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c110f524,0,16c,c0f76bf7,3e9,...) at _sleep+0x34f kern_nanosleep(d40378a0,f79a1c4c,f79a1c54,1,0,...) at kern_nanosleep+0xc1 sys_nanosleep(d40378a0,f79a1cec,c0fc78bc,c,202,...) at sys_nanosleep+0x6f syscall(f79a1d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28180223, esp = 0xbfbfe7cc, ebp = 0xbfbfe7f8 --- Tracing command run pid 51233 tid 173486 td 0xd20e28a0 sched_switch(d20e28a0,0,104,1a3,10b2489e,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(d20e28a0,0,c0f7b0e0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f7b0e0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(d475db30,6c,c0f7e025,100,0,...) at sleepq_wait_sig+0x17 _sleep(d475db30,d475dbb8,16c,c0f7e025,0,...) at _sleep+0x385 kern_wait(d20e28a0,c822,f7590c5c,0,0,...) at kern_wait+0x597 sys_wait4(d20e28a0,f7590cec,c0fc78bc,c,216,...) at sys_wait4+0x3b syscall(f7590d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2810d5fb, esp = 0xbfbfe25c, ebp = 0xbfbfe278 --- Tracing command run pid 51232 tid 173274 td 0xd404ab80 sched_switch(d404ab80,0,104,1a3,1098db2a,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(d404ab80,0,c0f7b0e0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f7b0e0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(d455f864,6c,c0f7e025,100,0,...) at sleepq_wait_sig+0x17 _sleep(d455f864,d455f8ec,16c,c0f7e025,0,...) at _sleep+0x385 kern_wait(d404ab80,c821,f71bdc5c,0,0,...) at kern_wait+0x597 sys_wait4(d404ab80,f71bdcec,d404ab80,c,216,...) at sys_wait4+0x3b syscall(f71bdd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2810d5fb, esp = 0xbfbfe77c, ebp = 0xbfbfe798 --- Tracing command run pid 51231 tid 173761 td 0xd498b8a0 sched_switch(d498b8a0,0,104,1a3,1090a298,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(d498b8a0,0,c0f7b0e0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(3e9,c0a832f0,d498b8a0,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c110f524,6c,c0f76bf7,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c110f524,0,16c,c0f76bf7,3e9,...) at _sleep+0x34f kern_nanosleep(d498b8a0,f7968c4c,f7968c54,1,0,...) at kern_nanosleep+0xc1 sys_nanosleep(d498b8a0,f7968cec,c0fc78bc,c,202,...) at sys_nanosleep+0x6f syscall(f7968d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2817f223, esp = 0xbfbfe76c, ebp = 0xbfbfe798 --- Tracing command sh pid 51226 tid 170898 td 0xcefe1b80 sched_switch(cefe1b80,0,104,1a3,cea237f,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cefe1b80,0,c0f7b0e0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f7b0e0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(d41f7b30,6c,c0f7e025,100,0,...) at sleepq_wait_sig+0x17 _sleep(d41f7b30,d41f7bb8,16c,c0f7e025,0,...) at _sleep+0x385 kern_wait(cefe1b80,ffffffff,f6b70c5c,2,0,...) at kern_wait+0x597 sys_wait4(cefe1b80,f6b70cec,c0fc78bc,c0f7e004,216,...) at sys_wait4+0x3b syscall(f6b70d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe5dc, ebp = 0xbfbfe5f8 --- Tracing command sleep pid 51211 tid 102260 td 0xcf9475c0 sched_switch(cf9475c0,0,104,1a3,826cad4,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cf9475c0,0,c0f7b0e0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(2711,c0a832f0,cf9475c0,3,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c110f524,6c,c0f76bf7,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c110f524,0,16c,c0f76bf7,2711,...) at _sleep+0x34f kern_nanosleep(cf9475c0,f6947c4c,f6947c54,a,0,...) at kern_nanosleep+0xc1 sys_nanosleep(cf9475c0,f6947cec,c0fc78bc,c0f7e8a6,246,...) at sys_nanosleep+0x6f syscall(f6947d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2816e223, esp = 0xbfbfec5c, ebp = 0xbfbfeca8 --- Tracing command md5 pid 87825 tid 100320 td 0xcdf892e0 sched_switch(cdf892e0,0,104,1a3,12cfc62a,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(cdf892e0,0,c0f7b0e0,268,0,...) at sleepq_switch+0x162 sleepq_wait(e52ea780,5c,c0f82ab7,0,0,...) at sleepq_wait+0x63 _sleep(e52ea780,cb58c6a0,5c,c0f82ab7,0,...) at _sleep+0x39c bwait(e52ea780,5c,c0f82ab7,e52ea780,f638bb04,...) at bwait+0x6f bufwait(e52ea780,e52ea780,2000,2000,0,...) at bufwait+0x48 bufwrite(e52ea780,2000,f638bc6c,2000,ce001080,...) at bufwrite+0x165 ffs_write(f638bc8c,c0fcef6e,d37afae0,0,d37afae0,...) at ffs_write+0x4a5 VOP_WRITE_APV(c10bfd20,f638bc8c,c0f1c1b5,26d,c0a4bee1,...) at VOP_WRITE_APV+0x136 mdstart_vnode(cee0b800,cdff5da8,c0f1c1b5,2fe,0,...) at mdstart_vnode+0x4da md_kthread(cee0b800,f638bd28,c0f6f970,3d8,cddb22cc,...) at md_kthread+0x1c0 fork_exit(c0779870,cee0b800,f638bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf638bd60, ebp = 0 --- Tracing command sh pid 87787 tid 173636 td 0xd4057000 sched_switch(d4057000,0,104,1a3,bcc8c29,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(d4057000,0,c0f7b0e0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f7b0e0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(d482f000,6c,c0f7e025,100,0,...) at sleepq_wait_sig+0x17 _sleep(d482f000,d482f088,16c,c0f7e025,0,...) at _sleep+0x385 kern_wait(d4057000,ffffffff,f77f1c5c,2,0,...) at kern_wait+0x597 sys_wait4(d4057000,f77f1cec,c0fc78bc,c0f7e004,216,...) at sys_wait4+0x3b syscall(f77f1d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe62c, ebp = 0xbfbfe648 --- Tracing command getty pid 81021 tid 172334 td 0xd4015b80 sched_switch(d4015b80,0,104,1a3,b2a03b31,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(d4015b80,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a313fa,cb6f5c04,0,c0f7393b,d4015b80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb6f5c70,0,f6cb9aec,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cb6f5c70,cb6f5c04,c0f7f91c,527,0,...) at _cv_wait_sig+0x260 tty_wait(cb6f5c00,cb6f5c70,f6cb9c40,1,0,...) at tty_wait+0x71 ttydisc_read(cb6f5c00,f6cb9c40,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(cb6ddc00,f6cb9c40,0,0,1,...) at ttydev_read+0xaa devfs_read_f(d3089888,f6cb9c40,cb5b3e80,0,d4015b80,...) at devfs_read_f+0x7e dofileread(f6cb9c40,ffffffff,ffffffff,0,f6cb9c1c,...) at dofileread+0x9e kern_readv(d4015b80,0,f6cb9c40,f6cb9c60,1,...) at kern_readv+0x68 sys_read(d4015b80,f6cb9cec,c0fc78bc,c0de1312,246,...) at sys_read+0x4f syscall(f6cb9d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a66e3, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command zfskern pid 80945 tid 172741 td 0xd48ab5c0 sched_switch(d48ab5c0,0,104,1a3,c4e5dbad,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(d48ab5c0,0,c0f7b0e0,28b,d48ab5c0,...) at sleepq_switch+0x162 sleepq_timedwait(d8394284,0,f7a16bb4,1,0,...) at sleepq_timedwait+0x6b _cv_timedwait(d8394284,d8394270,3e8,0,0,...) at _cv_timedwait+0x270 l2arc_feed_thread(0,f7a16d28,c0f6f970,3d8,cef27b30,...) at l2arc_feed_thread+0x204 fork_exit(d8265820,0,f7a16d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf7a16d60, ebp = 0 --- Tracing command zfskern pid 80945 tid 100573 td 0xd25db5c0 sched_switch(d25db5c0,0,104,1a3,ea8e2a99,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(d25db5c0,0,c0f7b0e0,28b,d25db5c0,...) at sleepq_switch+0x162 sleepq_timedwait(d83850fc,0,f6189c68,1,0,...) at sleepq_timedwait+0x6b _cv_timedwait(d83850fc,d83850e8,3e8,0,b175a8f8,...) at _cv_timedwait+0x270 arc_reclaim_thread(0,f6189d28,c0f6f970,3d8,cef27b30,...) at arc_reclaim_thread+0x28e fork_exit(d82653c0,0,f6189d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf6189d60, ebp = 0 --- Tracing command sh pid 80325 tid 173571 td 0xd3fccb80 sched_switch(d3fccb80,0,104,1a3,b8f9c97d,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(d3fccb80,0,c0f7b0e0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f7b0e0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(d481c598,6c,c0f7e025,100,0,...) at sleepq_wait_sig+0x17 _sleep(d481c598,d481c620,16c,c0f7e025,0,...) at _sleep+0x385 kern_wait(d3fccb80,ffffffff,f772ec5c,2,0,...) at kern_wait+0x597 sys_wait4(d3fccb80,f772ecec,c0fc78bc,c0f7e004,216,...) at sys_wait4+0x3b syscall(f772ed28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe71c, ebp = 0xbfbfe738 --- Tracing command bash pid 37019 tid 101139 td 0xd493c2e0 sched_switch(d493c2e0,0,104,1a3,3e6ad8a,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(d493c2e0,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a313fa,ce2b5204,0,c0f7393b,d493c2e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ce2b5270,0,f6120aec,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ce2b5270,ce2b5204,c0f7f91c,527,0,...) at _cv_wait_sig+0x260 tty_wait(ce2b5200,ce2b5270,f6120c40,1,0,...) at tty_wait+0x71 ttydisc_read(ce2b5200,f6120c40,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(ce607c00,f6120c40,0,0,1,...) at ttydev_read+0xaa devfs_read_f(cea8f0e0,f6120c40,d44a5500,0,d493c2e0,...) at devfs_read_f+0x7e dofileread(f6120c40,ffffffff,ffffffff,0,f6120c1c,...) at dofileread+0x9e kern_readv(d493c2e0,0,f6120c40,f6120c60,1,...) at kern_readv+0x68 sys_read(d493c2e0,f6120cec,c0fc78bc,c0f7df1a,246,...) at sys_read+0x4f syscall(f6120d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x283686e3, esp = 0xbfbfddac, ebp = 0xbfbfddd8 --- Tracing command csh pid 37013 tid 102961 td 0xcf93b000 Tracing command su pid 37006 tid 100314 td 0xcfa4c5c0 Tracing command bash pid 16369 tid 100340 td 0xd00b18a0 Tracing command sshd pid 16368 tid 100417 td 0xcefd82e0 sched_switch(cefd82e0,0,104,1a3,3e7a44f,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cefd82e0,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a313fa,d7e98490,0,c0f7393b,cefd82e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(d7e984a4,0,f6553a54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(d7e984a4,d7e98490,c0f7d834,6ae,cea8f5b0,...) at _cv_wait_sig+0x260 seltdwait(cea8f5b0,58,ce879400,cefd82e0,f6553ac8,...) at seltdwait+0xa2 kern_select(cefd82e0,c,288060b8,288060c0,0,0,20,cedae2cc,0) at kern_select+0x655 sys_select(cefd82e0,f6553cec,c0fc78bc,c0f7e179,206,...) at sys_select+0x66 syscall(f6553d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d6663, esp = 0xbfbfde2c, ebp = 0xbfbfde78 --- Tracing command sshd pid 16366 tid 100175 td 0xce9b18a0 sched_switch(ce9b18a0,0,104,1a3,139f961e,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ce9b18a0,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a313fa,d7e92bd0,0,c0f7393b,ce9b18a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(d7e92be4,0,f618fab8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(d7e92be4,d7e92bd0,c0f7d834,6ae,f618fb40,...) at _cv_wait_sig+0x260 seltdwait(d18ab62c,c0f7d834,5ab,ce9b18a0,8,...) at seltdwait+0xa2 sys_poll(ce9b18a0,f618fcec,c0fc78bc,c0f65cd1,202,...) at sys_poll+0x321 syscall(f618fd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2846f33b, esp = 0xbfbfde8c, ebp = 0xbfbfdec8 --- Tracing command getty pid 1534 tid 100151 td 0xce91f000 sched_switch(ce91f000,0,104,1a3,78b590a4,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ce91f000,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f7b0e0,160,0,ce91f000,ce91f000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb985670,0,c0f7ff44,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cb985670,c110d290,c0f7f91c,527,0,...) at _cv_wait_sig+0x260 tty_wait(cb985600,cb985670,f6147c40,1,0,...) at tty_wait+0x71 ttydisc_read(cb985600,f6147c40,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(cb7f0b00,f6147c40,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ce00a9a0,f6147c40,cb5b3e80,0,ce91f000,...) at devfs_read_f+0x7e dofileread(f6147c40,ffffffff,ffffffff,0,f6147c1c,...) at dofileread+0x9e kern_readv(ce91f000,0,f6147c40,f6147c60,1,...) at kern_readv+0x68 sys_read(ce91f000,f6147cec,c0fc78bc,c0de1312,246,...) at sys_read+0x4f syscall(f6147d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a66e3, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1533 tid 100123 td 0xce5da5c0 sched_switch(ce5da5c0,0,104,1a3,78d9fb03,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ce5da5c0,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f7b0e0,160,0,ce5da5c0,ce5da5c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb985870,0,c0f7ff44,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cb985870,c110d290,c0f7f91c,527,0,...) at _cv_wait_sig+0x260 tty_wait(cb985800,cb985870,f60e3c40,1,0,...) at tty_wait+0x71 ttydisc_read(cb985800,f60e3c40,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(cb7f0c00,f60e3c40,0,0,1,...) at ttydev_read+0xaa devfs_read_f(cdfddd90,f60e3c40,cb5b3e80,0,ce5da5c0,...) at devfs_read_f+0x7e dofileread(f60e3c40,ffffffff,ffffffff,0,f60e3c1c,...) at dofileread+0x9e kern_readv(ce5da5c0,0,f60e3c40,f60e3c60,1,...) at kern_readv+0x68 sys_read(ce5da5c0,f60e3cec,c0fc78bc,c0de1312,246,...) at sys_read+0x4f syscall(f60e3d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a66e3, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1532 tid 100157 td 0xcdfc72e0 sched_switch(cdfc72e0,0,104,1a3,78d43982,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cdfc72e0,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f7b0e0,160,0,cdfc72e0,cdfc72e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb985a70,0,c0f7ff44,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cb985a70,c110d290,c0f7f91c,527,0,...) at _cv_wait_sig+0x260 tty_wait(cb985a00,cb985a70,f6159c40,1,0,...) at tty_wait+0x71 ttydisc_read(cb985a00,f6159c40,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(cb7f0d00,f6159c40,0,0,1,...) at ttydev_read+0xaa devfs_read_f(cdfdd4d0,f6159c40,cb5b3e80,0,cdfc72e0,...) at devfs_read_f+0x7e dofileread(f6159c40,ffffffff,ffffffff,0,f6159c1c,...) at dofileread+0x9e kern_readv(cdfc72e0,0,f6159c40,f6159c60,1,...) at kern_readv+0x68 sys_read(cdfc72e0,f6159cec,c0fc78bc,c0de1312,246,...) at sys_read+0x4f syscall(f6159d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a66e3, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1531 tid 100164 td 0xce9b28a0 sched_switch(ce9b28a0,0,104,1a3,787e8680,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ce9b28a0,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f7b0e0,160,0,ce9b28a0,ce9b28a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb6f5270,0,c0f7ff44,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cb6f5270,c110d290,c0f7f91c,527,0,...) at _cv_wait_sig+0x260 tty_wait(cb6f5200,cb6f5270,f616ec40,1,0,...) at tty_wait+0x71 ttydisc_read(cb6f5200,f616ec40,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(cb7f0e00,f616ec40,0,0,1,...) at ttydev_read+0xaa devfs_read_f(cdfdd888,f616ec40,cb5b3e80,0,ce9b28a0,...) at devfs_read_f+0x7e dofileread(f616ec40,ffffffff,ffffffff,0,f616ec1c,...) at dofileread+0x9e kern_readv(ce9b28a0,0,f616ec40,f616ec60,1,...) at kern_readv+0x68 sys_read(ce9b28a0,f616ecec,c0fc78bc,c0de1312,246,...) at sys_read+0x4f syscall(f616ed28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a66e3, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1530 tid 100140 td 0xce9255c0 sched_switch(ce9255c0,0,104,1a3,7898c6db,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ce9255c0,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f7b0e0,160,0,ce9255c0,ce9255c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb6f5470,0,c0f7ff44,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cb6f5470,c110d290,c0f7f91c,527,0,...) at _cv_wait_sig+0x260 tty_wait(cb6f5400,cb6f5470,f6126c40,1,0,...) at tty_wait+0x71 ttydisc_read(cb6f5400,f6126c40,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(cb984000,f6126c40,0,0,1,...) at ttydev_read+0xaa devfs_read_f(cdf9b770,f6126c40,cb5b3e80,0,ce9255c0,...) at devfs_read_f+0x7e dofileread(f6126c40,ffffffff,ffffffff,0,f6126c1c,...) at dofileread+0x9e kern_readv(ce9255c0,0,f6126c40,f6126c60,1,...) at kern_readv+0x68 sys_read(ce9255c0,f6126cec,c0fc78bc,c0de1312,246,...) at sys_read+0x4f syscall(f6126d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a66e3, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1529 tid 100146 td 0xce91fb80 sched_switch(ce91fb80,0,104,1a3,78f22787,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ce91fb80,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f7b0e0,160,0,ce91fb80,ce91fb80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb6f5670,0,c0f7ff44,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cb6f5670,c110d290,c0f7f91c,527,0,...) at _cv_wait_sig+0x260 tty_wait(cb6f5600,cb6f5670,f6138c40,1,0,...) at tty_wait+0x71 ttydisc_read(cb6f5600,f6138c40,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(cb984100,f6138c40,0,0,1,...) at ttydev_read+0xaa devfs_read_f(cdf9b268,f6138c40,cb5b3e80,0,ce91fb80,...) at devfs_read_f+0x7e dofileread(f6138c40,ffffffff,ffffffff,0,f6138c1c,...) at dofileread+0x9e kern_readv(ce91fb80,0,f6138c40,f6138c60,1,...) at kern_readv+0x68 sys_read(ce91fb80,f6138cec,c0fc78bc,c0de1312,246,...) at sys_read+0x4f syscall(f6138d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a66e3, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1528 tid 100158 td 0xcdfc7000 sched_switch(cdfc7000,0,104,1a3,78c0f34e,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cdfc7000,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f7b0e0,160,0,cdfc7000,cdfc7000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb6f5870,0,c0f7ff44,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cb6f5870,c110d290,c0f7f91c,527,0,...) at _cv_wait_sig+0x260 tty_wait(cb6f5800,cb6f5870,f615cc40,1,0,...) at tty_wait+0x71 ttydisc_read(cb6f5800,f615cc40,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(cb984200,f615cc40,0,0,1,...) at ttydev_read+0xaa devfs_read_f(cdff9818,f615cc40,cb5b3e80,0,cdfc7000,...) at devfs_read_f+0x7e dofileread(f615cc40,ffffffff,ffffffff,0,f615cc1c,...) at dofileread+0x9e kern_readv(cdfc7000,0,f615cc40,f615cc60,1,...) at kern_readv+0x68 sys_read(cdfc7000,f615ccec,c0fc78bc,c0de1312,246,...) at sys_read+0x4f syscall(f615cd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a66e3, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1527 tid 100080 td 0xcdfce000 sched_switch(cdfce000,0,104,1a3,78ad3693,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cdfce000,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f7b0e0,160,0,cdfce000,cdfce000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb6f5a70,0,c0f7ff44,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cb6f5a70,c110d290,c0f7f91c,527,0,...) at _cv_wait_sig+0x260 tty_wait(cb6f5a00,cb6f5a70,f5fc9c40,1,0,...) at tty_wait+0x71 ttydisc_read(cb6f5a00,f5fc9c40,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(cb984300,f5fc9c40,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ce00a268,f5fc9c40,cb5b3e80,0,cdfce000,...) at devfs_read_f+0x7e dofileread(f5fc9c40,ffffffff,ffffffff,0,f5fc9c1c,...) at dofileread+0x9e kern_readv(cdfce000,0,f5fc9c40,f5fc9c60,1,...) at kern_readv+0x68 sys_read(cdfce000,f5fc9cec,c0fc78bc,c0de1312,246,...) at sys_read+0x4f syscall(f5fc9d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a66e3, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command inetd pid 1509 tid 100190 td 0xce9f9b80 sched_switch(ce9f9b80,0,104,1a3,6f3ba733,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ce9f9b80,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a313fa,cdf53490,0,c0f7393b,ce9f9b80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cdf534a4,0,f61bca54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cdf534a4,cdf53490,c0f7d834,6ae,cdfddd58,...) at _cv_wait_sig+0x260 seltdwait(cdfddd58,58,cb5b3e80,ce9f9b80,eb,...) at seltdwait+0xa2 kern_select(ce9f9b80,8,bfbfdfa0,0,0,0,20,ce9e0598,4) at kern_select+0x655 sys_select(ce9f9b80,f61bccec,c0fc78bc,c0f7e071,202,...) at sys_select+0x66 syscall(f61bcd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281b8663, esp = 0xbfbfdf5c, ebp = 0xbfbfede8 --- Tracing command watchdogd pid 1484 tid 100187 td 0xce9258a0 sched_switch(ce9258a0,0,104,1a3,81591aa,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(ce9258a0,0,c0f7b0e0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(ea61,c0a832f0,ce9258a0,2,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c110f524,6c,c0f76bf7,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c110f524,0,16c,c0f76bf7,ea61,...) at _sleep+0x34f kern_nanosleep(ce9258a0,f61b3c4c,f61b3c54,3c,0,...) at kern_nanosleep+0xc1 sys_nanosleep(ce9258a0,f61b3cec,c0fc78bc,c0de1312,206,...) at sys_nanosleep+0x6f syscall(f61b3d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2819e223, esp = 0xbfbfecbc, ebp = 0xbfbfece8 --- Tracing command bash pid 1294 tid 100166 td 0xce9b22e0 Tracing command csh pid 1276 tid 100154 td 0xcdfc7b80 Tracing command su pid 1275 tid 100139 td 0xce9202e0 Tracing command bash pid 1223 tid 100134 td 0xcdf935c0 Tracing command sshd pid 1222 tid 100094 td 0xcdfe9000 sched_switch(cdfe9000,0,104,1a3,11066bc9,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cdfe9000,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a313fa,cdf53610,0,c0f7393b,cdfe9000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cdf53624,0,f6001a54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cdf53624,cdf53610,c0f7d834,6ae,cdf9b7a8,...) at _cv_wait_sig+0x260 seltdwait(cdf9b7a8,58,cdf8cd80,cdfe9000,f6001ac8,...) at seltdwait+0xa2 kern_select(cdfe9000,c,288060b8,288060c0,0,0,20,cdfe0864,0) at kern_select+0x655 sys_select(cdfe9000,f6001cec,c0fc78bc,c0f7e179,206,...) at sys_select+0x66 syscall(f6001d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d6663, esp = 0xbfbfde2c, ebp = 0xbfbfde78 --- Tracing command sshd pid 1220 tid 100136 td 0xcdf93000 sched_switch(cdf93000,0,104,1a3,f9f89d7b,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cdf93000,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a313fa,ce2cd190,0,c0f7393b,cdf93000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ce2cd1a4,0,f611aab8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ce2cd1a4,ce2cd190,c0f7d834,6ae,f611ab40,...) at _cv_wait_sig+0x260 seltdwait(cdff602c,c0f7d834,5ab,cdf93000,8,...) at seltdwait+0xa2 sys_poll(cdf93000,f611acec,c0fc78bc,c0f65cd1,202,...) at sys_poll+0x321 syscall(f611ad28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2846f33b, esp = 0xbfbfde8c, ebp = 0xbfbfdec8 --- Tracing command awk pid 1204 tid 100129 td 0xcdf938a0 sched_switch(cdf938a0,0,104,1a3,805760e,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(cdf938a0,0,c0f7b0e0,1a7,5c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f7b0e0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ce008640,5c,c0f7da63,100,0,...) at sleepq_wait_sig+0x17 _sleep(ce008640,ce0087b8,15c,c0f7da63,0,...) at _sleep+0x385 pipe_read(cdfdd7e0,f6105c40,cb5b4c80,0,cdf938a0,...) at pipe_read+0x427 dofileread(f6105c40,ffffffff,ffffffff,0,f6105c1c,...) at dofileread+0x9e kern_readv(cdf938a0,0,f6105c40,f6105c60,1,...) at kern_readv+0x68 sys_read(cdf938a0,f6105cec,c0fc78bc,c0ddc563,216,...) at sys_read+0x4f syscall(f6105d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281c86e3, esp = 0xbfbfe93c, ebp = 0xbfbfe958 --- Tracing command sh pid 1203 tid 100128 td 0xcdf93b80 sched_switch(cdf93b80,0,104,1a3,8126d96,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cdf93b80,0,c0f7b0e0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f7b0e0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ce8adb30,6c,c0f7e025,100,0,...) at sleepq_wait_sig+0x17 _sleep(ce8adb30,ce8adbb8,16c,c0f7e025,0,...) at _sleep+0x385 kern_wait(cdf93b80,ffffffff,f6102c5c,2,0,...) at kern_wait+0x597 sys_wait4(cdf93b80,f6102cec,c0fc78bc,c0f7e004,216,...) at sys_wait4+0x3b syscall(f6102d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe93c, ebp = 0xbfbfe958 --- Tracing command top pid 1202 tid 100090 td 0xcdec72e0 sched_switch(cdec72e0,0,104,1a3,f049ee67,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cdec72e0,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f5ff1a1c,c0a313fa,ce2cd250,0,cdec72e0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ce2cd264,0,f5ff1a54,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ce2cd264,ce2cd250,3e9,6ae,cdfddc40,...) at _cv_timedwait_sig+0x270 seltdwait(f5ff1c0c,f5ff1c14,ce879500,cdec72e0,48363531,...) at seltdwait+0x8a kern_select(cdec72e0,2,bfbfebac,0,0,f5ff1c58,20,1,0) at kern_select+0x655 sys_select(cdec72e0,f5ff1cec,c0fc78bc,c0f4e9c2,246,...) at sys_select+0x66 syscall(f5ff1d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281fd663, esp = 0xbfbfeb4c, ebp = 0xbfbfeca8 --- Tracing command sh pid 1201 tid 100127 td 0xcdec55c0 Tracing command tail pid 1200 tid 100126 td 0xcdf97000 sched_switch(cdf97000,0,104,1a3,d0d05fe6,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,68,...) at mi_switch+0x1ff sleepq_switch(cdf97000,0,c0f7b0e0,1a7,68,...) at sleepq_switch+0x162 sleepq_catch_signals(3e9,c0a832f0,cdf97000,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ce660d00,68,c0f6f52e,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(ce660d00,ce660d00,168,c0f6f52e,3e9,...) at _sleep+0x34f kern_kevent(cdf97000,4,0,1,f60fcc40,...) at kern_kevent+0x374 sys_kevent(cdf97000,f60fccec,c0fc78bc,c0ddc563,286,...) at sys_kevent+0x19e syscall(f60fcd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (363, FreeBSD ELF32, sys_kevent), eip = 0x2817213b, esp = 0xbfbfeb1c, ebp = 0xbfbfebd8 --- Tracing command sshd pid 1199 tid 100085 td 0xcdf98000 sched_switch(cdf98000,0,104,1a3,b0f6ef30,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cdf98000,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a313fa,cdf079d0,0,c0f7393b,cdf98000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cdf079e4,0,f5fdda54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cdf079e4,cdf079d0,c0f7d834,6ae,cdfdde70,...) at _cv_wait_sig+0x260 seltdwait(cdfdde70,58,ce001400,cdf98000,f5fddac8,...) at seltdwait+0xa2 kern_select(cdf98000,c,288060b8,288060c0,0,0,20,cdf92000,0) at kern_select+0x655 sys_select(cdf98000,f5fddcec,c0fc78bc,c0f7e179,206,...) at sys_select+0x66 syscall(f5fddd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d6663, esp = 0xbfbfde2c, ebp = 0xbfbfde78 --- Tracing command sshd pid 1198 tid 100115 td 0xcdfce5c0 sched_switch(cdfce5c0,0,104,1a3,f04d0f2d,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cdfce5c0,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a313fa,ce2cd210,0,c0f7393b,cdfce5c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ce2cd224,0,f60bea54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ce2cd224,ce2cd210,c0f7d834,6ae,cdfdd658,...) at _cv_wait_sig+0x260 seltdwait(cdfdd658,58,ce879300,cdfce5c0,f60beac8,...) at seltdwait+0xa2 kern_select(cdfce5c0,a,288060b8,288060c0,0,0,20,ce5c9864,0) at kern_select+0x655 sys_select(cdfce5c0,f60becec,c0fc78bc,c0f7e179,206,...) at sys_select+0x66 syscall(f60bed28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d6663, esp = 0xbfbfde2c, ebp = 0xbfbfde78 --- Tracing command sshd pid 1197 tid 100113 td 0xcdfceb80 sched_switch(cdfceb80,0,104,1a3,b29027d3,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cdfceb80,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a313fa,cde96150,0,c0f7393b,cdfceb80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cde96164,0,f60b8a54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cde96164,cde96150,c0f7d834,6ae,cdf9b0e0,...) at _cv_wait_sig+0x260 seltdwait(cdf9b0e0,58,cdf8c000,cdfceb80,f60b8ac8,...) at seltdwait+0xa2 kern_select(cdfceb80,c,288060b8,288060c0,0,0,20,ce5ca000,0) at kern_select+0x655 sys_select(cdfceb80,f60b8cec,c0fc78bc,c0f7e179,206,...) at sys_select+0x66 syscall(f60b8d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d6663, esp = 0xbfbfde2c, ebp = 0xbfbfde78 --- Tracing command sshd pid 1193 tid 100122 td 0xce5da8a0 sched_switch(ce5da8a0,0,104,1a3,8ee195ba,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ce5da8a0,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a313fa,cde961d0,0,c0f7393b,ce5da8a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cde961e4,0,f60dfab8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cde961e4,cde961d0,c0f7d834,6ae,f60dfb40,...) at _cv_wait_sig+0x260 seltdwait(cb98b72c,c0f7d834,5ab,ce5da8a0,0,...) at seltdwait+0xa2 sys_poll(ce5da8a0,f60dfcec,c0fc78bc,c,202,...) at sys_poll+0x321 syscall(f60dfd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2846f33b, esp = 0xbfbfde8c, ebp = 0xbfbfdec8 --- Tracing command sshd pid 1192 tid 100100 td 0xcdfe85c0 sched_switch(cdfe85c0,0,104,1a3,8b56b3f1,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cdfe85c0,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a313fa,cdf07950,0,c0f7393b,cdfe85c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cdf07964,0,f601eab8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cdf07964,cdf07950,c0f7d834,6ae,f601eb40,...) at _cv_wait_sig+0x260 seltdwait(ce3d732c,c0f7d834,5ab,cdfe85c0,0,...) at seltdwait+0xa2 sys_poll(cdfe85c0,f601ecec,c0fc78bc,c0ddc563,202,...) at sys_poll+0x321 syscall(f601ed28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2846f33b, esp = 0xbfbfde8c, ebp = 0xbfbfdec8 --- Tracing command sshd pid 1191 tid 100098 td 0xcdfe8b80 sched_switch(cdfe8b80,0,104,1a3,8b528e3c,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cdfe8b80,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a313fa,cdf53690,0,c0f7393b,cdfe8b80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cdf536a4,0,f6016ab8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cdf536a4,cdf53690,c0f7d834,6ae,f6016b40,...) at _cv_wait_sig+0x260 seltdwait(ce3d952c,c0f7d834,5ab,cdfe8b80,0,...) at seltdwait+0xa2 sys_poll(cdfe8b80,f6016cec,c0fc78bc,c0ddc563,202,...) at sys_poll+0x321 syscall(f6016d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2846f33b, esp = 0xbfbfde8c, ebp = 0xbfbfdec8 --- Tracing command cron pid 1154 tid 100102 td 0xcdfe8000 sched_switch(cdfe8000,0,104,1a3,107e6b23,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cdfe8000,0,c0f7b0e0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(ea61,c0a832f0,cdfe8000,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c110f524,6c,c0f76bf7,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c110f524,0,16c,c0f76bf7,ea61,...) at _sleep+0x34f kern_nanosleep(cdfe8000,f6026c4c,f6026c54,3c,0,...) at kern_nanosleep+0xc1 sys_nanosleep(cdfe8000,f6026cec,c0fc78bc,c0f7e4d2,206,...) at sys_nanosleep+0x6f syscall(f6026d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28190223, esp = 0xbfbfec4c, ebp = 0xbfbfec78 --- Tracing command sendmail pid 1149 tid 100105 td 0xcdfccb80 sched_switch(cdfccb80,0,104,1a3,b1de11f2,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,74,...) at mi_switch+0x1ff sleepq_switch(cdfccb80,0,c0f7b0e0,1a7,74,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f7b0e0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cdfc48bc,74,c0e0306e,100,0,...) at sleepq_wait_sig+0x17 _sleep(cdfc48bc,cdfc48ec,174,c0e0306e,0,...) at _sleep+0x385 kern_sigsuspend(cdfccb80,0,0,0,0,...) at kern_sigsuspend+0xba sys_sigsuspend(cdfccb80,f6039cec,c0fc78bc,c0f7df1a,202,...) at sys_sigsuspend+0x4d syscall(f6039d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x28349e5b, esp = 0xbfbfcf9c, ebp = 0xbfbfcfc8 --- Tracing command sendmail pid 1146 tid 100081 td 0xcdfe95c0 sched_switch(cdfe95c0,0,104,1a3,f77001a8,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cdfe95c0,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f5fcda1c,c0a313fa,cdf537d0,0,cdfe95c0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(cdf537e4,0,f5fcda54,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(cdf537e4,cdf537d0,1389,6ae,d30d4188,...) at _cv_timedwait_sig+0x270 seltdwait(f5fcdc0c,f5fcdc14,cdf8c900,cdfe95c0,c0a2dc3d,...) at seltdwait+0x8a kern_select(cdfe95c0,5,bfbfc510,0,0,f5fcdc58,20,5,0) at kern_select+0x655 sys_select(cdfe95c0,f5fcdcec,c0fc78bc,c0f7e431,206,...) at sys_select+0x66 syscall(f5fcdd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x283f4663, esp = 0xbfbfc47c, ebp = 0xbfbfcfa8 --- Tracing command sshd pid 1143 tid 100117 td 0xce5db000 sched_switch(ce5db000,0,104,1a3,2e1e3f7,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ce5db000,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a313fa,cde96210,0,c0f7393b,ce5db000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cde96224,0,f60c6a54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cde96224,cde96210,c0f7d834,6ae,cdf9a540,...) at _cv_wait_sig+0x260 seltdwait(cdf9a540,58,cdf8c280,ce5db000,3d1,...) at seltdwait+0xa2 kern_select(ce5db000,9,2880c0b8,0,0,0,20,ce5c92cc,a) at kern_select+0x655 sys_select(ce5db000,f60c6cec,c0fc78bc,c,206,...) at sys_select+0x66 syscall(f60c6d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d6663, esp = 0xbfbfdeec, ebp = 0xbfbfedf8 --- Tracing command moused pid 1112 tid 100086 td 0xcdfcdb80 sched_switch(cdfcdb80,0,104,1a3,b92d1e19,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cdfcdb80,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a313fa,ce2cd390,0,c0f7393b,cdfcdb80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ce2cd3a4,0,f5fe1a54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ce2cd3a4,ce2cd390,c0f7d834,6ae,cdfdd508,...) at _cv_wait_sig+0x260 seltdwait(cdfdd508,58,cb5b3e80,cdfcdb80,f6,...) at seltdwait+0xa2 kern_select(cdfcdb80,400,bfbfea04,0,0,0,20,cdfc6864,1) at kern_select+0x655 sys_select(cdfcdb80,f5fe1cec,c0fc78bc,c0de1312,246,...) at sys_select+0x66 syscall(f5fe1d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281c5663, esp = 0xbfbfe99c, ebp = 0xbfbfeb28 --- Tracing command ntpd pid 1092 tid 100101 td 0xcdfe82e0 sched_switch(cdfe82e0,0,104,1a3,f5c9999,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cdfe82e0,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a313fa,cdf53790,0,c0f7393b,cdfe82e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cdf537a4,0,f6022a54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cdf537a4,cdf53790,c0f7d834,6ae,cdfdd380,...) at _cv_wait_sig+0x260 seltdwait(cdfdd380,58,cb5b3e80,cdfe82e0,0,...) at seltdwait+0xa2 kern_select(cdfe82e0,1c,bfbfece8,0,0,0,20,cdfdeb30,0) at kern_select+0x655 sys_select(cdfe82e0,f6022cec,c0fc78bc,c0f7e8b8,202,...) at sys_select+0x66 syscall(f6022d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28373663, esp = 0xbfbfecbc, ebp = 0xbfbfed88 --- Tracing command nfsd pid 1038 tid 100121 td 0xcdec58a0 sched_switch(cdec58a0,0,104,1a3,291d5f90,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cdec58a0,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f60d4be0,c0a313fa,cb874800,0,cdec58a0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(cdf20790,0,f60d4c18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(cdf20790,cb874800,1388,48a,0,...) at _cv_timedwait_sig+0x270 svc_run_internal(f60d4d14,c0a13d08,cb874800,f60d4d28,c0f6f970,...) at svc_run_internal+0x356 svc_thread_start(cb874800,f60d4d28,c0f6f970,3d8,cdfc6598,...) at svc_thread_start+0x10 fork_exit(c0c34fb0,cb874800,f60d4d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1038 tid 100120 td 0xcdec5b80 sched_switch(cdec5b80,0,104,1a3,2208f1d4,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cdec5b80,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f60d1be0,c0a313fa,cb874800,0,cdec5b80,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(cdf207d0,0,f60d1c18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(cdf207d0,cb874800,1388,494,0,...) at _cv_timedwait_sig+0x270 svc_run_internal(f60d1d14,c0a13d08,cb874800,f60d1d28,c0f6f970,...) at svc_run_internal+0x356 svc_thread_start(cb874800,f60d1d28,c0f6f970,3d8,cdfc6598,...) at svc_thread_start+0x10 fork_exit(c0c34fb0,cb874800,f60d1d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1038 tid 100119 td 0xcdec7000 sched_switch(cdec7000,0,104,1a3,219b5b19,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cdec7000,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f60cebe0,c0a313fa,cb874800,0,cdec7000,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(cdf20810,0,f60cec18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(cdf20810,cb874800,1388,3b1,0,...) at _cv_timedwait_sig+0x270 svc_run_internal(f60ced14,c0a13d08,cb874800,f60ced28,c0f6f970,...) at svc_run_internal+0x356 svc_thread_start(cb874800,f60ced28,c0f6f970,3d8,cdfc6598,...) at svc_thread_start+0x10 fork_exit(c0c34fb0,cb874800,f60ced28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1038 tid 100087 td 0xcdfcd8a0 sched_switch(cdfcd8a0,0,104,1a3,22242f2f,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cdfcd8a0,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f5fe5494,c0a313fa,cb874800,0,cdfcd8a0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(cde935d0,0,f5fe54cc,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(cde935d0,cb874800,1388,48a,f5fe5514,...) at _cv_timedwait_sig+0x270 svc_run_internal(cdfcda50,14,c0fa4efa,c0f671db,f5fe580c,...) at svc_run_internal+0x356 svc_run(cb874800,0,c0f671b6,19f,cb6dfb80,...) at svc_run+0x7b nfsrvd_nfsd(cdfcd8a0,f5fe580c,c,f5fe5724,c0a8cc1a,...) at nfsrvd_nfsd+0x1c3 nfssvc_nfsd(cdfcd8a0,f5fe5cec,bfbfe870,cdfcd8a0,f5fe5d1c,...) at nfssvc_nfsd+0x177 sys_nfssvc(cdfcd8a0,f5fe5cec,c0fc78bc,c0f7e431,206,...) at sys_nfssvc+0xeb syscall(f5fe5d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280e8a9b, esp = 0xbfbfe82c, ebp = 0xbfbfea98 --- Tracing command nfsd pid 1032 tid 100110 td 0xcdfe25c0 sched_switch(cdfe25c0,0,104,1a3,48b667a0,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cdfe25c0,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a313fa,ce2cd3d0,0,c0f7393b,cdfe25c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ce2cd3e4,0,f605da54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ce2cd3e4,ce2cd3d0,c0f7d834,6ae,cdff9620,...) at _cv_wait_sig+0x260 seltdwait(cdff9620,58,cb5b3e80,cdfe25c0,58,...) at seltdwait+0xa2 kern_select(cdfe25c0,7,bfbfecb4,0,0,0,20,cdfde000,7) at kern_select+0x655 sys_select(cdfe25c0,f605dcec,c0fc78bc,c0f65cd1,202,...) at sys_select+0x66 syscall(f605dd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28192663, esp = 0xbfbfea9c, ebp = 0xbfbfede8 --- Tracing command nfsuserd pid 1030 tid 100109 td 0xcdfe28a0 sched_switch(cdfe28a0,0,104,1a3,c9ad5333,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cdfe28a0,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f604fa1c,c0a313fa,cdf07a50,0,cdfe28a0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(cdf07a64,0,f604fa54,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(cdf07a64,cdf07a50,7531,6ae,cdf9a188,...) at _cv_timedwait_sig+0x270 seltdwait(f604fc0c,f604fc14,cb5b3e80,cdfe28a0,3,...) at seltdwait+0x8a kern_select(cdfe28a0,4,bfbfebc4,0,0,f604fc58,20,1e,0) at kern_select+0x655 sys_select(cdfe28a0,f604fcec,c0fc78bc,c0f7e162,202,...) at sys_select+0x66 syscall(f604fd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28191663, esp = 0xbfbfeb1c, ebp = 0xbfbfec58 --- Tracing command nfsuserd pid 1029 tid 100099 td 0xcdfe88a0 sched_switch(cdfe88a0,0,104,1a3,34dbdce5,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cdfe88a0,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f601aa1c,c0a313fa,cde96250,0,cdfe88a0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(cde96264,0,f601aa54,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(cde96264,cde96250,7531,6ae,cdf9a188,...) at _cv_timedwait_sig+0x270 seltdwait(f601ac0c,f601ac14,cb5b3e80,cdfe88a0,3d1,...) at seltdwait+0x8a kern_select(cdfe88a0,4,bfbfebc4,0,0,f601ac58,20,1e,0) at kern_select+0x655 sys_select(cdfe88a0,f601acec,c0fc78bc,c0f7e162,202,...) at sys_select+0x66 syscall(f601ad28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28191663, esp = 0xbfbfeb1c, ebp = 0xbfbfec58 --- Tracing command nfsuserd pid 1028 tid 100092 td 0xcdfcd2e0 sched_switch(cdfcd2e0,0,104,1a3,cb643fba,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cdfcd2e0,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f5ff9a1c,c0a313fa,cdf53810,0,cdfcd2e0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(cdf53824,0,f5ff9a54,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(cdf53824,cdf53810,7531,6ae,cdf9a188,...) at _cv_timedwait_sig+0x270 seltdwait(f5ff9c0c,f5ff9c14,cb5b3e80,cdfcd2e0,3d1,...) at seltdwait+0x8a kern_select(cdfcd2e0,4,bfbfebc4,0,0,f5ff9c58,20,1e,0) at kern_select+0x655 sys_select(cdfcd2e0,f5ff9cec,c0fc78bc,c0f7e162,202,...) at sys_select+0x66 syscall(f5ff9d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28191663, esp = 0xbfbfeb1c, ebp = 0xbfbfec58 --- Tracing command nfsuserd pid 1027 tid 100088 td 0xcdf97b80 sched_switch(cdf97b80,0,104,1a3,62fadcd0,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cdf97b80,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f5fe9a1c,c0a313fa,cde96290,0,cdf97b80,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(cde962a4,0,f5fe9a54,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(cde962a4,cde96290,7531,6ae,cdf9a188,...) at _cv_timedwait_sig+0x270 seltdwait(f5fe9c0c,f5fe9c14,cb5b3e80,cdf97b80,3d1,...) at seltdwait+0x8a kern_select(cdf97b80,4,bfbfebc4,0,0,f5fe9c58,20,1e,0) at kern_select+0x655 sys_select(cdf97b80,f5fe9cec,c0fc78bc,c0f7e162,202,...) at sys_select+0x66 syscall(f5fe9d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28191663, esp = 0xbfbfeb1c, ebp = 0xbfbfec58 --- Tracing command nfsuserd pid 1026 tid 100118 td 0xce5dab80 Tracing command mountd pid 1010 tid 100082 td 0xcdf988a0 sched_switch(cdf988a0,0,104,1a3,c0b471f,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cdf988a0,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a313fa,cdf53850,0,c0f7393b,cdf988a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cdf53864,0,f5fd1a54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cdf53864,cdf53850,c0f7d834,6ae,cdfdd700,...) at _cv_wait_sig+0x260 seltdwait(cdfdd700,58,cb5b3e80,cdf988a0,47d,...) at seltdwait+0xa2 kern_select(cdf988a0,9,bfbfed04,0,0,0,20,cdf92864,bfbfed04) at kern_select+0x655 sys_select(cdf988a0,f5fd1cec,c0fc78bc,c0f64f37,206,...) at sys_select+0x66 syscall(f5fd1d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281aa663, esp = 0xbfbfec9c, ebp = 0xbfbfede8 --- Tracing command rpcbind pid 976 tid 100091 td 0xcdfcd5c0 sched_switch(cdfcd5c0,0,104,1a3,a9c3c16f,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cdfcd5c0,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f5ff5a80,c0a313fa,ce2cd410,0,cdfcd5c0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ce2cd424,0,f5ff5ab8,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ce2cd424,ce2cd410,7531,6ae,f5ff5b70,...) at _cv_timedwait_sig+0x270 seltdwait(f5ff5c40,f5ff5c48,5ab,cdfcd5c0,30,...) at seltdwait+0x8a sys_poll(cdfcd5c0,f5ff5cec,c0fc78bc,c0f7e162,212,...) at sys_poll+0x321 syscall(f5ff5d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2814a33b, esp = 0xbfbfcbac, ebp = 0xbfbfed78 --- Tracing command syslogd pid 961 tid 100089 td 0xcdec75c0 sched_switch(cdec75c0,0,104,1a3,abbd6422,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cdec75c0,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a313fa,cdf539d0,0,c0f7393b,cdec75c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cdf539e4,0,f5feda54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cdf539e4,cdf539d0,c0f7d834,6ae,cdff9bd0,...) at _cv_wait_sig+0x260 seltdwait(cdff9bd0,58,cb5b3e80,cdec75c0,0,...) at seltdwait+0xa2 kern_select(cdec75c0,9,2847f0ac,0,0,0,20,cb83ab30,0) at kern_select+0x655 sys_select(cdec75c0,f5fedcec,c0fc78bc,c0f7e014,246,...) at sys_select+0x66 syscall(f5fedd28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a9663, esp = 0xbfbfe29c, ebp = 0xbfbfede8 --- Tracing command devd pid 838 tid 100104 td 0xcdfcd000 sched_switch(cdfcd000,0,104,1a3,b78464a,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cdfcd000,0,c0f7b0e0,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a313fa,cdf07a90,0,c0f7393b,cdfcd000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cdf07aa4,0,f6035a54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cdf07aa4,cdf07a90,c0f7d834,6ae,cdf9a070,...) at _cv_wait_sig+0x260 seltdwait(cdf9a070,58,cb5b3e80,cdfcd000,c12584c8,...) at seltdwait+0xa2 kern_select(cdfcd000,5,bfbfe960,0,0,0,20,cdfc4b30,46) at kern_select+0x655 sys_select(cdfcd000,f6035cec,c0fc78bc,c0ddc563,206,...) at sys_select+0x66 syscall(f6035d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x809169b, esp = 0xbfbfe92c, ebp = 0xbfbfee08 --- Tracing command softdepflush pid 19 tid 100078 td 0xcdec78a0 sched_switch(cdec78a0,0,104,1a3,d432cef6,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,54,...) at mi_switch+0x1ff sleepq_switch(cdec78a0,0,c0f7b0e0,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c128ba00,54,c0fabf11,0,0,...) at sleepq_timedwait+0x6b _sleep(c128ba00,c128b9c0,54,c0fabf11,3e8,...) at _sleep+0x36a softdep_flush(0,f1be9d28,c0f6f970,3d8,cdec2000,...) at softdep_flush+0x266 fork_exit(c0c847f0,0,f1be9d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf1be9d60, ebp = 0 --- Tracing command syncer pid 18 tid 100077 td 0xcdec7b80 sched_switch(cdec7b80,0,104,1a3,dde540d4,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cdec7b80,0,c0f7b0e0,28b,cdec7b80,...) at sleepq_switch+0x162 sleepq_timedwait(c12856f4,0,f1be6c78,1,0,...) at sleepq_timedwait+0x6b _cv_timedwait(c12856f4,c12856e0,3e8,75f,4e20,...) at _cv_timedwait+0x270 sched_sync(0,f1be6d28,c0f6f970,3d8,cdec22cc,...) at sched_sync+0x595 fork_exit(c0ae4100,0,f1be6d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf1be6d60, ebp = 0 --- Tracing command vnlru pid 17 tid 100076 td 0xcb8568a0 sched_switch(cb8568a0,0,104,1a3,b8aa9055,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,60,...) at mi_switch+0x1ff sleepq_switch(cb8568a0,0,c0f7b0e0,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(cdec2598,60,c0f8614c,0,0,...) at sleepq_timedwait+0x6b _sleep(cdec2598,c12856b4,260,c0f8614c,3e8,...) at _sleep+0x36a vnlru_proc(0,f1be3d28,c0f6f970,3d8,cdec2598,...) at vnlru_proc+0xe7 fork_exit(c0ae4d90,0,f1be3d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf1be3d60, ebp = 0 --- Tracing command bufdaemon pid 16 tid 100075 td 0xcb856b80 sched_switch(cb856b80,0,104,1a3,27b63f6,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,54,...) at mi_switch+0x1ff sleepq_switch(cb856b80,0,c0f7b0e0,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1285388,54,c0f8304e,0,0,...) at sleepq_timedwait+0x6b _sleep(c1285388,c1285390,54,c0f8304e,3e8,...) at _sleep+0x36a buf_daemon(0,f1be0d28,c0f6f970,3d8,cdec2864,...) at buf_daemon+0x175 fork_exit(c0ac8130,0,f1be0d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf1be0d60, ebp = 0 --- Tracing command pagezero pid 9 tid 100074 td 0xcb979000 sched_switch(cb979000,0,104,1a3,1c84c70c,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb979000,0,c0f7b0e0,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c128d8e8,0,c0fb30ce,0,0,...) at sleepq_timedwait+0x6b _sleep(c128d8e8,c128c380,0,c0fb30ce,493e0,...) at _sleep+0x36a vm_pagezero(0,f1bddd28,c0f6f970,3d8,cdec2b30,...) at vm_pagezero+0xdc fork_exit(c0ccc3e0,0,f1bddd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf1bddd60, ebp = 0 --- Tracing command vmdaemon pid 8 tid 100073 td 0xcb9792e0 sched_switch(cb9792e0,0,104,1a3,8bfded40,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,74,...) at mi_switch+0x1ff sleepq_switch(cb9792e0,0,c0f7b0e0,268,0,...) at sleepq_switch+0x162 sleepq_wait(c128d4c8,74,c0f8304e,0,0,...) at sleepq_wait+0x63 _sleep(c128d4c8,c128d4cc,74,c0f8304e,0,...) at _sleep+0x39c vm_daemon(0,f1bdad28,c0f6f970,3d8,cdec4000,...) at vm_daemon+0x59 fork_exit(c0cc4b00,0,f1bdad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf1bdad60, ebp = 0 --- Tracing command pagedaemon pid 7 tid 100072 td 0xcb9795c0 sched_switch(cb9795c0,0,104,1a3,cff1447,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,54,...) at mi_switch+0x1ff sleepq_switch(cb9795c0,0,c0f7b0e0,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c128d490,54,c0f8304e,0,0,...) at sleepq_timedwait+0x6b _sleep(c128d490,c128c380,54,c0f8304e,1388,...) at _sleep+0x36a vm_pageout(0,f1bd7d28,c0f6f970,3d8,cb5cc2cc,...) at vm_pageout+0x2c7 fork_exit(c0cc5b80,0,f1bd7d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf1bd7d60, ebp = 0 --- Tracing command xpt_thrd pid 6 tid 100071 td 0xcb9798a0 sched_switch(cb9798a0,0,104,1a3,7cf2a03b,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(cb9798a0,0,c0f7b0e0,268,0,...) at sleepq_switch+0x162 sleepq_wait(c10d24d4,5c,c0dd6d67,0,0,...) at sleepq_wait+0x63 _sleep(c10d24d4,c10d2518,5c,c0dd6d67,0,...) at _sleep+0x39c xpt_scanner_thread(0,f1a54d28,c0f6f970,3d8,cb5cc598,...) at xpt_scanner_thread+0x47 fork_exit(c049e4f0,0,f1a54d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf1a54d60, ebp = 0 --- Tracing command sctp_iterator pid 5 tid 100070 td 0xcb979b80 sched_switch(cb979b80,0,104,1a3,3e9766,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb979b80,0,c0f7b0e0,268,0,...) at sleepq_switch+0x162 sleepq_wait(c1287218,0,c0f99d1f,0,0,...) at sleepq_wait+0x63 _sleep(c1287218,c12871e0,0,c0f99d1f,0,...) at _sleep+0x39c sctp_iterator_thread(0,f1a51d28,c0f6f970,3d8,cb5cc864,...) at sctp_iterator_thread+0x5c fork_exit(c0b76f90,0,f1a51d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf1a51d60, ebp = 0 --- Tracing command ctl_thrd pid 4 tid 100067 td 0xcb97a5c0 sched_switch(cb97a5c0,0,104,1a3,6aa77d84,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(cb97a5c0,0,c0f7b0e0,268,0,...) at sleepq_switch+0x162 sleepq_wait(cb98c000,5c,c0de17b0,0,0,...) at sleepq_wait+0x63 _sleep(cb98c000,cb98c000,5c,c0de17b0,0,...) at _sleep+0x39c ctl_work_thread(cb98c000,f1a48d28,c0f6f970,3d8,cb5ccb30,...) at ctl_work_thread+0x22f6 fork_exit(c04c7a90,cb98c000,f1a48d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf1a48d60, ebp = 0 --- Tracing command fdc0 pid 3 tid 100064 td 0xcb97b000 sched_switch(cb97b000,0,104,1a3,cab0b2fc,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(cb97b000,0,c0f7b0e0,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(cb7f7a3c,5c,c0f67c52,0,0,...) at sleepq_timedwait+0x6b _sleep(cb7f7a3c,cb7f7af0,5c,c0f67c52,3e8,...) at _sleep+0x36a fdc_thread(cb7f7a00,f1a3fd28,c0f6f970,3d8,cb83a000,...) at fdc_thread+0x27d fork_exit(c0d4e720,cb7f7a00,f1a3fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf1a3fd60, ebp = 0 --- Tracing command fw0_probe pid 2 tid 100062 td 0xcb8495c0 sched_switch(cb8495c0,0,104,1a3,7cf2dfe6,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cb8495c0,0,c0f7b0e0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f7b0e0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb887000,6c,c0f67c52,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb887000,cb88b488,16c,c0f67c52,0,...) at _sleep+0x385 fw_bus_probe_thread(cb887000,f1a2fd28,c0f6f970,3d8,cb83a2cc,...) at fw_bus_probe_thread+0xa08 fork_exit(c06f7cf0,cb887000,f1a2fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf1a2fd60, ebp = 0 --- Tracing command usb pid 15 tid 100058 td 0xcb8542e0 sched_switch(cb8542e0,0,104,1a3,6aa2561d,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb8542e0,0,c0f7b0e0,268,cb8542e0,...) at sleepq_switch+0x162 sleepq_wait(cb85cd34,0,f1a18cac,1,0,...) at sleepq_wait+0x63 _cv_wait(cb85cd34,cb85ce4c,c0f592d1,74,cb85cd3c,...) at _cv_wait+0x260 usb_process(cb85cd2c,f1a18d28,c0f6f970,3d8,cb83a598,...) at usb_process+0x1a3 fork_exit(c091da10,cb85cd2c,f1a18d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf1a18d60, ebp = 0 --- Tracing command usb pid 15 tid 100057 td 0xcb8545c0 sched_switch(cb8545c0,0,104,1a3,b01740f5,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb8545c0,0,c0f7b0e0,268,cb8545c0,...) at sleepq_switch+0x162 sleepq_wait(cb85cd04,0,f1a15cac,1,0,...) at sleepq_wait+0x63 _cv_wait(cb85cd04,cb85ce4c,c0f592d1,74,cb85cd0c,...) at _cv_wait+0x260 usb_process(cb85ccfc,f1a15d28,c0f6f970,3d8,cb83a598,...) at usb_process+0x1a3 fork_exit(c091da10,cb85ccfc,f1a15d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf1a15d60, ebp = 0 --- Tracing command usb pid 15 tid 100056 td 0xcb8548a0 sched_switch(cb8548a0,0,104,1a3,6a3b91ef,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb8548a0,0,c0f7b0e0,268,cb8548a0,...) at sleepq_switch+0x162 sleepq_wait(cb85ccd4,0,f1a12cac,1,0,...) at sleepq_wait+0x63 _cv_wait(cb85ccd4,cb85ce4c,c0f592d1,74,cb85ccdc,...) at _cv_wait+0x260 usb_process(cb85cccc,f1a12d28,c0f6f970,3d8,cb83a598,...) at usb_process+0x1a3 fork_exit(c091da10,cb85cccc,f1a12d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf1a12d60, ebp = 0 --- Tracing command usb pid 15 tid 100055 td 0xcb854b80 sched_switch(cb854b80,0,104,1a3,6a3b81fb,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb854b80,0,c0f7b0e0,268,cb854b80,...) at sleepq_switch+0x162 sleepq_wait(cb85cca4,0,f1a0fcac,1,0,...) at sleepq_wait+0x63 _cv_wait(cb85cca4,cb85ce4c,c0f592d1,74,cb85ccac,...) at _cv_wait+0x260 usb_process(cb85cc9c,f1a0fd28,c0f6f970,3d8,cb83a598,...) at usb_process+0x1a3 fork_exit(c091da10,cb85cc9c,f1a0fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf1a0fd60, ebp = 0 --- Tracing command usb pid 15 tid 100053 td 0xcb8562e0 sched_switch(cb8562e0,0,104,1a3,6a3b6dfa,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb8562e0,0,c0f7b0e0,268,cb8562e0,...) at sleepq_switch+0x162 sleepq_wait(cb84fb5c,0,f1a06cac,1,0,...) at sleepq_wait+0x63 _cv_wait(cb84fb5c,cb84fc74,c0f592d1,74,cb84fb64,...) at _cv_wait+0x260 usb_process(cb84fb54,f1a06d28,c0f6f970,3d8,cb83a598,...) at usb_process+0x1a3 fork_exit(c091da10,cb84fb54,f1a06d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf1a06d60, ebp = 0 --- Tracing command usb pid 15 tid 100052 td 0xcb8565c0 sched_switch(cb8565c0,0,104,1a3,6dad8e27,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb8565c0,0,c0f7b0e0,268,cb8565c0,...) at sleepq_switch+0x162 sleepq_wait(cb84fb2c,0,f1a03cac,1,0,...) at sleepq_wait+0x63 _cv_wait(cb84fb2c,cb84fc74,c0f592d1,74,cb84fb34,...) at _cv_wait+0x260 usb_process(cb84fb24,f1a03d28,c0f6f970,3d8,cb83a598,...) at usb_process+0x1a3 fork_exit(c091da10,cb84fb24,f1a03d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf1a03d60, ebp = 0 --- Tracing command usb pid 15 tid 100051 td 0xcb846000 sched_switch(cb846000,0,104,1a3,69d71d11,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb846000,0,c0f7b0e0,268,cb846000,...) at sleepq_switch+0x162 sleepq_wait(cb84fafc,0,f1a00cac,1,0,...) at sleepq_wait+0x63 _cv_wait(cb84fafc,cb84fc74,c0f592d1,74,cb84fb04,...) at _cv_wait+0x260 usb_process(cb84faf4,f1a00d28,c0f6f970,3d8,cb83a598,...) at usb_process+0x1a3 fork_exit(c091da10,cb84faf4,f1a00d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf1a00d60, ebp = 0 --- Tracing command usb pid 15 tid 100050 td 0xcb8462e0 sched_switch(cb8462e0,0,104,1a3,69d70beb,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb8462e0,0,c0f7b0e0,268,cb8462e0,...) at sleepq_switch+0x162 sleepq_wait(cb84facc,0,f19fdcac,1,0,...) at sleepq_wait+0x63 _cv_wait(cb84facc,cb84fc74,c0f592d1,74,cb84fad4,...) at _cv_wait+0x260 usb_process(cb84fac4,f19fdd28,c0f6f970,3d8,cb83a598,...) at usb_process+0x1a3 fork_exit(c091da10,cb84fac4,f19fdd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf19fdd60, ebp = 0 --- Tracing command usb pid 15 tid 100049 td 0xcb8465c0 sched_switch(cb8465c0,0,104,1a3,69d6f4e1,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb8465c0,0,c0f7b0e0,268,cb8465c0,...) at sleepq_switch+0x162 sleepq_wait(cb84ab5c,0,f19f9cac,1,0,...) at sleepq_wait+0x63 _cv_wait(cb84ab5c,cb84ac74,c0f592d1,74,cb84ab64,...) at _cv_wait+0x260 usb_process(cb84ab54,f19f9d28,c0f6f970,3d8,cb83a598,...) at usb_process+0x1a3 fork_exit(c091da10,cb84ab54,f19f9d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf19f9d60, ebp = 0 --- Tracing command usb pid 15 tid 100048 td 0xcb8468a0 sched_switch(cb8468a0,0,104,1a3,6dad27a0,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb8468a0,0,c0f7b0e0,268,cb8468a0,...) at sleepq_switch+0x162 sleepq_wait(cb84ab2c,0,f19f6cac,1,0,...) at sleepq_wait+0x63 _cv_wait(cb84ab2c,cb84ac74,c0f592d1,74,cb84ab34,...) at _cv_wait+0x260 usb_process(cb84ab24,f19f6d28,c0f6f970,3d8,cb83a598,...) at usb_process+0x1a3 fork_exit(c091da10,cb84ab24,f19f6d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf19f6d60, ebp = 0 --- Tracing command usb pid 15 tid 100047 td 0xcb846b80 sched_switch(cb846b80,0,104,1a3,6414b5c1,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb846b80,0,c0f7b0e0,268,cb846b80,...) at sleepq_switch+0x162 sleepq_wait(cb84aafc,0,f19f3cac,1,0,...) at sleepq_wait+0x63 _cv_wait(cb84aafc,cb84ac74,c0f592d1,74,cb84ab04,...) at _cv_wait+0x260 usb_process(cb84aaf4,f19f3d28,c0f6f970,3d8,cb83a598,...) at usb_process+0x1a3 fork_exit(c091da10,cb84aaf4,f19f3d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf19f3d60, ebp = 0 --- Tracing command usb pid 15 tid 100046 td 0xcb848000 sched_switch(cb848000,0,104,1a3,6414a2b0,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb848000,0,c0f7b0e0,268,cb848000,...) at sleepq_switch+0x162 sleepq_wait(cb84aacc,0,f19f0cac,1,0,...) at sleepq_wait+0x63 _cv_wait(cb84aacc,cb84ac74,c0f592d1,74,cb84aad4,...) at _cv_wait+0x260 usb_process(cb84aac4,f19f0d28,c0f6f970,3d8,cb83a598,...) at usb_process+0x1a3 fork_exit(c091da10,cb84aac4,f19f0d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf19f0d60, ebp = 0 --- Tracing command usb pid 15 tid 100045 td 0xcb8482e0 sched_switch(cb8482e0,0,104,1a3,6414903e,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb8482e0,0,c0f7b0e0,268,cb8482e0,...) at sleepq_switch+0x162 sleepq_wait(cb842b5c,0,f19eccac,1,0,...) at sleepq_wait+0x63 _cv_wait(cb842b5c,cb842c74,c0f592d1,74,cb842b64,...) at _cv_wait+0x260 usb_process(cb842b54,f19ecd28,c0f6f970,3d8,cb83a598,...) at usb_process+0x1a3 fork_exit(c091da10,cb842b54,f19ecd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf19ecd60, ebp = 0 --- Tracing command usb pid 15 tid 100044 td 0xcb8485c0 sched_switch(cb8485c0,0,104,1a3,7d9e561,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb8485c0,0,c0f7b0e0,268,cb8485c0,...) at sleepq_switch+0x162 sleepq_wait(cb842b2c,0,f19e9cac,1,0,...) at sleepq_wait+0x63 _cv_wait(cb842b2c,cb842c74,c0f592d1,74,cb842b34,...) at _cv_wait+0x260 usb_process(cb842b24,f19e9d28,c0f6f970,3d8,cb83a598,...) at usb_process+0x1a3 fork_exit(c091da10,cb842b24,f19e9d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf19e9d60, ebp = 0 --- Tracing command usb pid 15 tid 100043 td 0xcb8488a0 sched_switch(cb8488a0,0,104,1a3,63b0d701,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb8488a0,0,c0f7b0e0,268,cb8488a0,...) at sleepq_switch+0x162 sleepq_wait(cb842afc,0,f19e6cac,1,0,...) at sleepq_wait+0x63 _cv_wait(cb842afc,cb842c74,c0f592d1,74,cb842b04,...) at _cv_wait+0x260 usb_process(cb842af4,f19e6d28,c0f6f970,3d8,cb83a598,...) at usb_process+0x1a3 fork_exit(c091da10,cb842af4,f19e6d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf19e6d60, ebp = 0 --- Tracing command usb pid 15 tid 100042 td 0xcb848b80 sched_switch(cb848b80,0,104,1a3,63b0c4d5,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb848b80,0,c0f7b0e0,268,cb848b80,...) at sleepq_switch+0x162 sleepq_wait(cb842acc,0,f19e3cac,1,0,...) at sleepq_wait+0x63 _cv_wait(cb842acc,cb842c74,c0f592d1,74,cb842ad4,...) at _cv_wait+0x260 usb_process(cb842ac4,f19e3d28,c0f6f970,3d8,cb83a598,...) at usb_process+0x1a3 fork_exit(c091da10,cb842ac4,f19e3d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf19e3d60, ebp = 0 --- Tracing command usb pid 15 tid 100040 td 0xcb835000 sched_switch(cb835000,0,104,1a3,63b0af87,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb835000,0,c0f7b0e0,268,cb835000,...) at sleepq_switch+0x162 sleepq_wait(cb83cb5c,0,f19dccac,1,0,...) at sleepq_wait+0x63 _cv_wait(cb83cb5c,cb83cc74,c0f592d1,74,cb83cb64,...) at _cv_wait+0x260 usb_process(cb83cb54,f19dcd28,c0f6f970,3d8,cb83a598,...) at usb_process+0x1a3 fork_exit(c091da10,cb83cb54,f19dcd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf19dcd60, ebp = 0 --- Tracing command usb pid 15 tid 100039 td 0xcb8352e0 sched_switch(cb8352e0,0,104,1a3,7d94443,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb8352e0,0,c0f7b0e0,268,cb8352e0,...) at sleepq_switch+0x162 sleepq_wait(cb83cb2c,0,f19d9cac,1,0,...) at sleepq_wait+0x63 _cv_wait(cb83cb2c,cb83cc74,c0f592d1,74,cb83cb34,...) at _cv_wait+0x260 usb_process(cb83cb24,f19d9d28,c0f6f970,3d8,cb83a598,...) at usb_process+0x1a3 fork_exit(c091da10,cb83cb24,f19d9d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf19d9d60, ebp = 0 --- Tracing command usb pid 15 tid 100038 td 0xcb8355c0 sched_switch(cb8355c0,0,104,1a3,634cc253,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb8355c0,0,c0f7b0e0,268,cb8355c0,...) at sleepq_switch+0x162 sleepq_wait(cb83cafc,0,f19d6cac,1,0,...) at sleepq_wait+0x63 _cv_wait(cb83cafc,cb83cc74,c0f592d1,74,cb83cb04,...) at _cv_wait+0x260 usb_process(cb83caf4,f19d6d28,c0f6f970,3d8,cb83a598,...) at usb_process+0x1a3 fork_exit(c091da10,cb83caf4,f19d6d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf19d6d60, ebp = 0 --- Tracing command usb pid 15 tid 100037 td 0xcb8358a0 sched_switch(cb8358a0,0,104,1a3,634cb155,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb8358a0,0,c0f7b0e0,268,cb8358a0,...) at sleepq_switch+0x162 sleepq_wait(cb83cacc,0,f19d3cac,1,0,...) at sleepq_wait+0x63 _cv_wait(cb83cacc,cb83cc74,c0f592d1,74,cb83cad4,...) at _cv_wait+0x260 usb_process(cb83cac4,f19d3d28,c0f6f970,3d8,cb83a598,...) at usb_process+0x1a3 fork_exit(c091da10,cb83cac4,f19d3d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf19d3d60, ebp = 0 --- Tracing command usb pid 15 tid 100035 td 0xcb838000 sched_switch(cb838000,0,104,1a3,634c9c28,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb838000,0,c0f7b0e0,268,cb838000,...) at sleepq_switch+0x162 sleepq_wait(cb831b5c,0,f19cccac,1,0,...) at sleepq_wait+0x63 _cv_wait(cb831b5c,cb831c74,c0f592d1,74,cb831b64,...) at _cv_wait+0x260 usb_process(cb831b54,f19ccd28,c0f6f970,3d8,cb83a598,...) at usb_process+0x1a3 fork_exit(c091da10,cb831b54,f19ccd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf19ccd60, ebp = 0 --- Tracing command usb pid 15 tid 100034 td 0xcb8382e0 sched_switch(cb8382e0,0,104,1a3,50f6603,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb8382e0,0,c0f7b0e0,268,cb8382e0,...) at sleepq_switch+0x162 sleepq_wait(cb831b2c,0,f19c9cac,1,0,...) at sleepq_wait+0x63 _cv_wait(cb831b2c,cb831c74,c0f592d1,74,cb831b34,...) at _cv_wait+0x260 usb_process(cb831b24,f19c9d28,c0f6f970,3d8,cb83a598,...) at usb_process+0x1a3 fork_exit(c091da10,cb831b24,f19c9d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf19c9d60, ebp = 0 --- Tracing command usb pid 15 tid 100033 td 0xcb8385c0 sched_switch(cb8385c0,0,104,1a3,62e82e4f,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb8385c0,0,c0f7b0e0,268,cb8385c0,...) at sleepq_switch+0x162 sleepq_wait(cb831afc,0,f19c6cac,1,0,...) at sleepq_wait+0x63 _cv_wait(cb831afc,cb831c74,c0f592d1,74,cb831b04,...) at _cv_wait+0x260 usb_process(cb831af4,f19c6d28,c0f6f970,3d8,cb83a598,...) at usb_process+0x1a3 fork_exit(c091da10,cb831af4,f19c6d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf19c6d60, ebp = 0 --- Tracing command usb pid 15 tid 100032 td 0xcb8388a0 sched_switch(cb8388a0,0,104,1a3,62e81c1c,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb8388a0,0,c0f7b0e0,268,cb8388a0,...) at sleepq_switch+0x162 sleepq_wait(cb831acc,0,f19c3cac,1,0,...) at sleepq_wait+0x63 _cv_wait(cb831acc,cb831c74,c0f592d1,74,cb831ad4,...) at _cv_wait+0x260 usb_process(cb831ac4,f19c3d28,c0f6f970,3d8,cb83a598,...) at usb_process+0x1a3 fork_exit(c091da10,cb831ac4,f19c3d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf19c3d60, ebp = 0 --- Tracing command yarrow pid 14 tid 100017 td 0xcb6df5c0 sched_switch(cb6df5c0,0,104,1a3,d1ca8a9,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb6df5c0,0,c0f7b0e0,28b,2,...) at sleepq_switch+0x162 sleepq_timedwait(c110e324,0,c0f67c52,2,0,...) at sleepq_timedwait+0x6b _sleep(c110e324,0,0,c0f67c52,64) at _sleep+0x36a pause(c0f67c52,64,c0f35350,111,0,...) at pause+0xa0 random_kthread(0,e53e0d28,c0f6f970,3d8,cb5cb000,...) at random_kthread+0x1ef fork_exit(c081b6c0,0,e53e0d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe53e0d60, ebp = 0 --- Tracing command geom pid 13 tid 100015 td 0xcb6dfb80 sched_switch(cb6dfb80,0,104,1a3,12d060bb,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(cb6dfb80,0,c0f7b0e0,268,0,...) at sleepq_switch+0x162 sleepq_wait(c110b568,5c,c0f67c52,0,0,...) at sleepq_wait+0x63 _sleep(c110b568,c110b4c8,25c,c0f67c52,0,...) at _sleep+0x39c g_io_schedule_down(cb6dfb80,0,c0f697a1,6c,e53dad14,...) at g_io_schedule_down+0x5b g_down_procbody(0,e53dad28,c0f6f970,3d8,cb5cb2cc,...) at g_down_procbody+0x9d fork_exit(c09d45f0,0,e53dad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe53dad60, ebp = 0 --- Tracing command geom pid 13 tid 100014 td 0xcb6e0000 cpustop_handler(2,e53d7b28,c0dad3e6,c0a67fa9,c111c180,...) at cpustop_handler+0x26 ipi_nmi_handler(c0a67fa9,c111c180,4,c0f77762,cb5cb2cc,...) at ipi_nmi_handler+0x35 trap(e53d7b34) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0539c5a, esp = 0xe53d7b74, ebp = 0xe53d7b84 --- acpi_timer_get_timecount_safe(c0fe5440,2bbea5e6,273bd8,85f,0,...) at acpi_timer_get_timecount_safe+0x1a binuptime(e53d7be0,a1f,e53d7bec,c110b4e8,c110b4e8,...) at binuptime+0x3d devstat_end_transaction(cdf3f0f0,4000,0,2,0,d57766f0) at devstat_end_transaction+0x2a devstat_end_transaction_bio(cdf3f0f0,d5776688,d5776688,ce2cd480,ce04a650,...) at devstat_end_transaction_bio+0x5d g_io_deliver(d5776688,0,cb58c1a0,e53d7ca4,c0ac3955,...) at g_io_deliver+0x1a1 g_std_done(ce3f5a18,0,c0f82707,c52,cb6e0000,...) at g_std_done+0x4a biodone(ce3f5a18,c110b4e8,25c,c0f67c52,0,...) at biodone+0xa5 g_io_schedule_up(cb6e0000,0,c0f697a1,5f,e53d7d14,...) at g_io_schedule_up+0xde g_up_procbody(0,e53d7d28,c0f6f970,3d8,cb5cb2cc,...) at g_up_procbody+0x9d fork_exit(c09d4690,0,e53d7d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe53d7d60, ebp = 0 --- Tracing command geom pid 13 tid 100013 td 0xcb5d02e0 sched_switch(cb5d02e0,0,104,1a3,b77220f,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(cb5d02e0,0,c0f7b0e0,268,0,...) at sleepq_switch+0x162 sleepq_wait(c110b55c,5c,c0f67c52,0,0,...) at sleepq_wait+0x63 _sleep(c110b55c,c110b48c,25c,c0f67c52,0,...) at _sleep+0x39c g_run_events(c111c180,0,c0f697a1,79,e53d4d14,...) at g_run_events+0x54b g_event_procbody(0,e53d4d28,c0f6f970,3d8,cb5cb2cc,...) at g_event_procbody+0x90 fork_exit(c09d4730,0,e53d4d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe53d4d60, ebp = 0 --- Tracing command intr pid 12 tid 100066 td 0xcb97a8a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100065 td 0xcb97ab80 sched_switch(cb97ab80,0,109,1a3,62e3a3c1,...) at sched_switch+0x3fc mi_switch(109,0,c0f6fc93,557,cb97ab80,...) at mi_switch+0x1ff ithread_loop(cb616000,f1a42d28,c0f6f970,3d8,cb5cb598,...) at ithread_loop+0x1fb fork_exit(c0a17810,cb616000,f1a42d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf1a42d60, ebp = 0 --- Tracing command intr pid 12 tid 100063 td 0xcb8492e0 sched_switch(cb8492e0,0,109,1a3,b2a02594,...) at sched_switch+0x3fc mi_switch(109,0,c0f6fc93,557,cb8492e0,...) at mi_switch+0x1ff ithread_loop(cb616530,f1a32d28,c0f6f970,3d8,cb5cb598,...) at ithread_loop+0x1fb fork_exit(c0a17810,cb616530,f1a32d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf1a32d60, ebp = 0 --- Tracing command intr pid 12 tid 100060 td 0xcb849b80 sched_switch(cb849b80,0,109,1a3,e6f91985,...) at sched_switch+0x3fc mi_switch(109,0,c0f6fc93,557,cb849b80,...) at mi_switch+0x1ff ithread_loop(cb6164f0,f1a26d28,c0f6f970,3d8,cb5cb598,...) at ithread_loop+0x1fb fork_exit(c0a17810,cb6164f0,f1a26d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf1a26d60, ebp = 0 --- Tracing command intr pid 12 tid 100059 td 0xcb854000 sched_switch(cb854000,0,109,1a3,f013e1c,...) at sched_switch+0x3fc mi_switch(109,0,c0f6fc93,557,cb854000,...) at mi_switch+0x1ff ithread_loop(cb616550,f1a1ed28,c0f6f970,3d8,cb5cb598,...) at ithread_loop+0x1fb fork_exit(c0a17810,cb616550,f1a1ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf1a1ed60, ebp = 0 --- Tracing command intr pid 12 tid 100054 td 0xcb856000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xcb849000 sched_switch(cb849000,0,109,1a3,87e6247d,...) at sched_switch+0x3fc mi_switch(109,0,c0f6fc93,557,cb849000,...) at mi_switch+0x1ff ithread_loop(cb6166b0,f19e0d28,c0f6f970,3d8,cb5cb598,...) at ithread_loop+0x1fb fork_exit(c0a17810,cb6166b0,f19e0d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf19e0d60, ebp = 0 --- Tracing command intr pid 12 tid 100036 td 0xcb835b80 sched_switch(cb835b80,0,109,1a3,826d700e,...) at sched_switch+0x3fc mi_switch(109,0,c0f6fc93,557,cb835b80,...) at mi_switch+0x1ff ithread_loop(cb6165a0,f19d0d28,c0f6f970,3d8,cb5cb598,...) at ithread_loop+0x1fb fork_exit(c0a17810,cb6165a0,f19d0d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf19d0d60, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xcb838b80 sched_switch(cb838b80,0,109,1a3,3704eea2,...) at sched_switch+0x3fc mi_switch(109,0,c0f6fc93,557,cb838b80,...) at mi_switch+0x1ff ithread_loop(cb6161d0,f19c0d28,c0f6f970,3d8,cb5cb598,...) at ithread_loop+0x1fb fork_exit(c0a17810,cb6161d0,f19c0d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf19c0d60, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xcb6e02e0 sched_switch(cb6e02e0,0,109,1a3,12d96da7,...) at sched_switch+0x3fc mi_switch(109,0,c0f6fc93,557,cb6e02e0,...) at mi_switch+0x1ff ithread_loop(cb616660,f186ad28,c0f6f970,3d8,cb5cb598,...) at ithread_loop+0x1fb fork_exit(c0a17810,cb616660,f186ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf186ad60, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xcb6e05c0 sched_switch(cb6e05c0,0,109,1a3,110bae36,...) at sched_switch+0x3fc mi_switch(109,0,c0f6fc93,557,cb6e05c0,...) at mi_switch+0x1ff ithread_loop(cb616580,f1866d28,c0f6f970,3d8,cb5cb598,...) at ithread_loop+0x1fb fork_exit(c0a17810,cb616580,f1866d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf1866d60, ebp = 0 --- Tracing command intr pid 12 tid 100028 td 0xcb6e08a0 sched_switch(cb6e08a0,0,109,1a3,54fc93f5,...) at sched_switch+0x3fc mi_switch(109,0,c0f6fc93,557,cb6e08a0,...) at mi_switch+0x1ff ithread_loop(cb616230,f1760d28,c0f6f970,3d8,cb5cb598,...) at ithread_loop+0x1fb fork_exit(c0a17810,cb616230,f1760d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf1760d60, ebp = 0 --- Tracing command intr pid 12 tid 100024 td 0xcb7c85c0 sched_switch(cb7c85c0,0,109,1a3,d6ce5714,...) at sched_switch+0x3fc mi_switch(109,0,c0f6fc93,557,cb7c85c0,...) at mi_switch+0x1ff ithread_loop(cb616730,e53f5d28,c0f6f970,3d8,cb5cb598,...) at ithread_loop+0x1fb fork_exit(c0a17810,cb616730,e53f5d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe53f5d60, ebp = 0 --- Tracing command intr pid 12 tid 100023 td 0xcb7c88a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100021 td 0xcb6178a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100018 td 0xcb6df2e0 sched_switch(cb6df2e0,0,109,1a3,12d9ed11,...) at sched_switch+0x3fc mi_switch(109,0,c0f6fc93,557,cb6df2e0,...) at mi_switch+0x1ff ithread_loop(cb616760,e53e3d28,c0f6f970,3d8,cb5cb598,...) at ithread_loop+0x1fb fork_exit(c0a17810,cb616760,e53e3d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe53e3d60, ebp = 0 --- Tracing command intr pid 12 tid 100012 td 0xcb5d05c0 sched_switch(cb5d05c0,0,109,1a3,f7a50bff,...) at sched_switch+0x3fc mi_switch(109,0,c0f6fc93,557,cb5d05c0,...) at mi_switch+0x1ff ithread_loop(cb6167a0,e53d1d28,c0f6f970,3d8,cb5cb598,...) at ithread_loop+0x1fb fork_exit(c0a17810,cb6167a0,e53d1d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe53d1d60, ebp = 0 --- Tracing command intr pid 12 tid 100011 td 0xcb5d08a0 sched_switch(cb5d08a0,0,109,1a3,25fc580,...) at sched_switch+0x3fc mi_switch(109,0,c0f6fc93,557,cb5d08a0,...) at mi_switch+0x1ff ithread_loop(cb6167b0,e53ced28,c0f6f970,3d8,cb5cb598,...) at ithread_loop+0x1fb fork_exit(c0a17810,cb6167b0,e53ced28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe53ced60, ebp = 0 --- Tracing command intr pid 12 tid 100010 td 0xcb5d0b80 sched_switch(cb5d0b80,0,109,1a3,6581d5f,...) at sched_switch+0x3fc mi_switch(109,0,c0f6fc93,557,cb5d0b80,...) at mi_switch+0x1ff ithread_loop(cb6167c0,e53cbd28,c0f6f970,3d8,cb5cb598,...) at ithread_loop+0x1fb fork_exit(c0a17810,cb6167c0,e53cbd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe53cbd60, ebp = 0 --- Tracing command intr pid 12 tid 100009 td 0xcb617000 sched_switch(cb617000,0,109,1a3,1277ac59,...) at sched_switch+0x3fc mi_switch(109,0,c0f6fc93,557,cb617000,...) at mi_switch+0x1ff ithread_loop(cb6167d0,cb3fed28,c0f6f970,3d8,cb5cb598,...) at ithread_loop+0x1fb fork_exit(c0a17810,cb6167d0,cb3fed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xcb3fed60, ebp = 0 --- Tracing command intr pid 12 tid 100008 td 0xcb6172e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100007 td 0xcb6175c0 sched_switch(cb6175c0,0,109,1a3,ee9fab71,...) at sched_switch+0x3fc mi_switch(109,0,c0f6fc93,557,cb6175c0,...) at mi_switch+0x1ff ithread_loop(cb6167f0,cb3f8d28,c0f6f970,3d8,cb5cb598,...) at ithread_loop+0x1fb fork_exit(c0a17810,cb6167f0,cb3f8d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xcb3f8d60, ebp = 0 --- Tracing command idle pid 11 tid 100006 td 0xcb5cd000 cpustop_handler(3,cb3f4c54,c0dad3e6,a30f880,cb5cd000,...) at cpustop_handler+0x26 ipi_nmi_handler(a30f880,cb5cd000,cb3e1cb4,cb3e1c80,cb5cb864,...) at ipi_nmi_handler+0x35 trap(cb3f4c60) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0a69ac5, esp = 0xcb3f4ca0, ebp = 0xcb3f4ce8 --- sched_idletd(0,cb3f4d28,c0f6f970,3d8,cb5cb864,...) at sched_idletd+0x1f5 fork_exit(c0a698d0,0,cb3f4d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xcb3f4d60, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xcb5cd2e0 sched_switch(cb5cd2e0,0,108,19e,12d9e461,...) at sched_switch+0x3fc mi_switch(108,0,c0f77762,a1d,cb5cd2e0,...) at mi_switch+0x1ff sched_idletd(0,cb3f1d28,c0f6f970,3d8,cb5cb864,...) at sched_idletd+0x28f fork_exit(c0a698d0,0,cb3f1d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xcb3f1d60, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xcb5cd5c0 cpustop_handler(1,cb3eec54,c0dad3e6,a309880,cb5cd5c0,...) at cpustop_handler+0x26 ipi_nmi_handler(a309880,cb5cd5c0,cb3dbcb4,cb3dbc80,cb5cb864,...) at ipi_nmi_handler+0x35 trap(cb3eec60) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0a69ac5, esp = 0xcb3eeca0, ebp = 0xcb3eece8 --- sched_idletd(0,cb3eed28,c0f6f970,3d8,cb5cb864,...) at sched_idletd+0x1f5 fork_exit(c0a698d0,0,cb3eed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xcb3eed60, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xcb5cd8a0 sched_switch(cb5cd8a0,0,108,19e,12cf866d,...) at sched_switch+0x3fc mi_switch(108,0,c0f77762,a1d,cb5cd8a0,...) at mi_switch+0x1ff sched_idletd(0,cb3ebd28,c0f6f970,3d8,cb5cb864,...) at sched_idletd+0x28f fork_exit(c0a698d0,0,cb3ebd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xcb3ebd60, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xcb5cdb80 sched_switch(cb5cdb80,0,104,1a3,539bc62d,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cb5cdb80,0,c0f7b0e0,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f7b0e0,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb5cbb30,6c,c0f7e025,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb5cbb30,cb5cbbb8,16c,c0f7e025,0,...) at _sleep+0x385 kern_wait(cb5cdb80,ffffffff,cb3e7c5c,0,0,...) at kern_wait+0x597 sys_wait4(cb5cdb80,cb3e7cec,c0fc78bc,c0f7de62,286,...) at sys_wait4+0x3b syscall(cb3e7d28) at syscall+0x2c7 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x80601ff, esp = 0xbfbfe8bc, ebp = 0xbfbfe8d8 --- Tracing command audit pid 10 tid 100001 td 0xcb5d0000 sched_switch(cb5d0000,0,104,1a3,62e658c4,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb5d0000,0,c0f7b0e0,268,cb5d0000,...) at sleepq_switch+0x162 sleepq_wait(c128b140,0,cb3e4c8c,1,0,...) at sleepq_wait+0x63 _cv_wait(c128b140,c128b124,c0fa6977,194,0,...) at _cv_wait+0x260 audit_worker(0,cb3e4d28,c0f6f970,3d8,cb5cc000,...) at audit_worker+0x84 fork_exit(c0c452f0,0,cb3e4d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xcb3e4d60, ebp = 0 --- Tracing command kernel pid 0 tid 172739 td 0xd4a2cb80 sched_switch(d4a2cb80,0,104,1a3,fab4f340,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(d4a2cb80,0,c0f7b0e0,268,0,...) at sleepq_switch+0x162 sleepq_wait(cded2240,0,c0f67c52,0,0,...) at sleepq_wait+0x63 _sleep(cded2240,cded2258,0,c0f67c52,0,...) at _sleep+0x39c taskqueue_thread_loop(cdf3ac20,f7a13d28,c0f6f970,3d8,c110b680,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a86970,cdf3ac20,f7a13d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf7a13d60, ebp = 0 --- Tracing command kernel pid 0 tid 172737 td 0xd4a2e000 sched_switch(d4a2e000,0,104,1a3,fab5679d,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(d4a2e000,0,c0f7b0e0,268,0,...) at sleepq_switch+0x162 sleepq_wait(cded2240,0,c0f67c52,0,0,...) at sleepq_wait+0x63 _sleep(cded2240,cded2258,0,c0f67c52,0,...) at _sleep+0x39c taskqueue_thread_loop(cdf3ac20,f7a10d28,c0f6f970,3d8,c110b680,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a86970,cdf3ac20,f7a10d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf7a10d60, ebp = 0 --- Tracing command kernel pid 0 tid 172736 td 0xd4a2e2e0 sched_switch(d4a2e2e0,0,104,1a3,fab55848,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(d4a2e2e0,0,c0f7b0e0,268,0,...) at sleepq_switch+0x162 sleepq_wait(cded2240,0,c0f67c52,0,0,...) at sleepq_wait+0x63 _sleep(cded2240,cded2258,0,c0f67c52,0,...) at _sleep+0x39c taskqueue_thread_loop(cdf3ac20,f72d2d28,c0f6f970,3d8,c110b680,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a86970,cdf3ac20,f72d2d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf72d2d60, ebp = 0 --- Tracing command kernel pid 0 tid 172732 td 0xd4a2e5c0 sched_switch(d4a2e5c0,0,104,1a3,fab57473,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(d4a2e5c0,0,c0f7b0e0,268,0,...) at sleepq_switch+0x162 sleepq_wait(cded2240,0,c0f67c52,0,0,...) at sleepq_wait+0x63 _sleep(cded2240,cded2258,0,c0f67c52,0,...) at _sleep+0x39c taskqueue_thread_loop(cdf3ac20,f7151d28,c0f6f970,3d8,c110b680,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a86970,cdf3ac20,f7151d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf7151d60, ebp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xcb97a000 sched_switch(cb97a000,0,104,1a3,5b54e444,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb97a000,0,c0f7b0e0,28b,2,...) at sleepq_switch+0x162 sleepq_timedwait(c110e324,0,c0f67c52,2,0,...) at sleepq_timedwait+0x6b _sleep(c110e324,0,0,c0f67c52,bb8) at _sleep+0x36a pause(c0f67c52,bb8,126,124,c110b708,...) at pause+0xa0 deadlkres(0,f1a4ed28,c0f6f970,3d8,c110b680,...) at deadlkres+0x324 fork_exit(c09f6a80,0,f1a4ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf1a4ed60, ebp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xcb97a2e0 sched_switch(cb97a2e0,0,104,1a3,3cd54d39,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb97a2e0,0,c0f7b0e0,268,cb97a2e0,...) at sleepq_switch+0x162 sleepq_wait(cdc27200,0,c0f76401,c0f67c52,0,...) at sleepq_wait+0x63 msleep_spin(cdc27200,cdc27218,c0f67c52,0,c0f7393b,...) at msleep_spin+0x259 taskqueue_thread_loop(c12ec800,f1a4bd28,c0f6f970,3d8,c110b680,...) at taskqueue_thread_loop+0x8f fork_exit(c0a86970,c12ec800,f1a4bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf1a4bd60, ebp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xcb8498a0 sched_switch(cb8498a0,0,104,1a3,abe7d9d,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb8498a0,0,c0f7b0e0,268,cb8498a0,...) at sleepq_switch+0x162 sleepq_wait(cb886500,0,c0f76401,c0f67c52,0,...) at sleepq_wait+0x63 msleep_spin(cb886500,cb886518,c0f67c52,0,c0f7393b,...) at msleep_spin+0x259 taskqueue_thread_loop(cb88b49c,f1a2cd28,c0f6f970,3d8,c110b680,...) at taskqueue_thread_loop+0x8f fork_exit(c0a86970,cb88b49c,f1a2cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf1a2cd60, ebp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xcb6e0b80 sched_switch(cb6e0b80,0,104,1a3,7cf74333,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb6e0b80,0,c0f7b0e0,268,cb6e0b80,...) at sleepq_switch+0x162 sleepq_wait(cb5a56c0,0,c0f76401,c0f67c52,0,...) at sleepq_wait+0x63 msleep_spin(cb5a56c0,cb5a56d8,c0f67c52,0,c0f7393b,...) at msleep_spin+0x259 taskqueue_thread_loop(c10d5738,e53fed28,c0f6f970,3d8,c110b680,...) at taskqueue_thread_loop+0x8f fork_exit(c0a86970,c10d5738,e53fed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe53fed60, ebp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xcb7c8000 sched_switch(cb7c8000,0,104,1a3,7cf7356e,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb7c8000,0,c0f7b0e0,268,cb7c8000,...) at sleepq_switch+0x162 sleepq_wait(cb5a56c0,0,c0f76401,c0f67c52,0,...) at sleepq_wait+0x63 msleep_spin(cb5a56c0,cb5a56d8,c0f67c52,0,c0f7393b,...) at msleep_spin+0x259 taskqueue_thread_loop(c10d5738,e53fbd28,c0f6f970,3d8,c110b680,...) at taskqueue_thread_loop+0x8f fork_exit(c0a86970,c10d5738,e53fbd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe53fbd60, ebp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xcb7c82e0 sched_switch(cb7c82e0,0,104,1a3,7cf724f6,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb7c82e0,0,c0f7b0e0,268,cb7c82e0,...) at sleepq_switch+0x162 sleepq_wait(cb5a56c0,0,c0f76401,c0f67c52,0,...) at sleepq_wait+0x63 msleep_spin(cb5a56c0,cb5a56d8,c0f67c52,0,c0f7393b,...) at msleep_spin+0x259 taskqueue_thread_loop(c10d5738,e53f8d28,c0f6f970,3d8,c110b680,...) at taskqueue_thread_loop+0x8f fork_exit(c0a86970,c10d5738,e53f8d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe53f8d60, ebp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xcb7c8b80 sched_switch(cb7c8b80,0,104,1a3,e5b0e3b1,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb7c8b80,0,c0f7b0e0,268,0,...) at sleepq_switch+0x162 sleepq_wait(cb5a5780,0,c0f67c52,0,0,...) at sleepq_wait+0x63 _sleep(cb5a5780,cb5a5798,0,c0f67c52,0,...) at _sleep+0x39c taskqueue_thread_loop(c112aeec,e53efd28,c0f6f970,3d8,c110b680,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a86970,c112aeec,e53efd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe53efd60, ebp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xcb617b80 sched_switch(cb617b80,0,104,1a3,7cf317f9,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb617b80,0,c0f7b0e0,268,0,...) at sleepq_switch+0x162 sleepq_wait(cb5a5800,0,c0f67c52,0,0,...) at sleepq_wait+0x63 _sleep(cb5a5800,cb5a5818,0,c0f67c52,0,...) at _sleep+0x39c taskqueue_thread_loop(c128b724,e53e9d28,c0f6f970,3d8,c110b680,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a86970,c128b724,e53e9d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe53e9d60, ebp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xcb6df000 sched_switch(cb6df000,0,104,1a3,7cf30603,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb6df000,0,c0f7b0e0,268,0,...) at sleepq_switch+0x162 sleepq_wait(cb5a5840,0,c0f67c52,0,0,...) at sleepq_wait+0x63 _sleep(cb5a5840,cb5a5858,0,c0f67c52,0,...) at _sleep+0x39c taskqueue_thread_loop(c110c018,e53e6d28,c0f6f970,3d8,c110b680,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a86970,c110c018,e53e6d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe53e6d60, ebp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xcb6df8a0 sched_switch(cb6df8a0,0,104,1a3,600d73c5,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb6df8a0,0,c0f7b0e0,268,0,...) at sleepq_switch+0x162 sleepq_wait(cb5a5c40,0,c0f67c52,0,0,...) at sleepq_wait+0x63 _sleep(cb5a5c40,cb5a5c58,0,c0f67c52,0,...) at _sleep+0x39c taskqueue_thread_loop(c1129900,e53ddd28,c0f6f970,3d8,c110b680,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a86970,c1129900,e53ddd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe53ddd60, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc110b950 sched_switch(c110b950,0,104,1a3,dc9fc377,...) at sched_switch+0x3fc mi_switch(104,0,c0f7b0e0,1f3,54,...) at mi_switch+0x1ff sleepq_switch(c110b950,0,c0f7b0e0,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c110b680,54,c0f78035,0,0,...) at sleepq_timedwait+0x6b _sleep(c110b680,0,54,c0f78035,2710,...) at _sleep+0x36a scheduler(0,181ec00,181ec00,181e000,1825000,...) at scheduler+0x240 mi_startup() at mi_startup+0xac begin() at begin+0x2c db:0:allt> call doadump Physical memory: 3435 MB Dumping 371 MB: 356 340 324 308 292 276 260 244 228 212 196 180 164 148 132 116 100 84 68 52 36 20 4 Dump complete = 0 db:0:doadump> reset (kgdb) bt #0 doadump (textdump=0x0) at pcpu.h:244 #1 0xc05122d9 in db_fncall (dummy1=0xc0a7807a, dummy2=0x0, dummy3=0xffffffff, dummy4=0xf63ba3f0 "\004;") at ../../../ddb/db_command.c:573 #2 0xc051270f in db_command (last_cmdp=0xc10d38fc, cmd_table=0x0, dopager=0x0) at ../../../ddb/db_command.c:449 #3 0xc05127c4 in db_command_script (command=0xc10d4808 "call doadump") at ../../../ddb/db_command.c:520 #4 0xc0516c00 in db_script_exec (scriptname=0xc10d4160 "doadump", warnifnotfound=Variable "warnifnotfound" is not available. ) at ../../../ddb/db_script.c:302 #5 0xc0516c91 in db_run_cmd (addr=0x1, have_addr=0x0, count=0xc12ace40, modif=0xf63ba528 "") at ../../../ddb/db_script.c:375 #6 0xc05126d1 in db_command (last_cmdp=0xc10d38fc, cmd_table=0x0, dopager=0x1) at ../../../ddb/db_command.c:449 #7 0xc051282a in db_command_loop () at ../../../ddb/db_command.c:502 #8 0xc051481d in db_trap (type=0x3, code=0x0) at ../../../ddb/db_main.c:231 #9 0xc0a78596 in kdb_trap (type=0x3, code=0x0, tf=0xf63ba6d8) at ../../../kern/subr_kdb.c:654 #10 0xc0dad9eb in trap (frame=0xf63ba6d8) at ../../../i386/i386/trap.c:710 #11 0xc0d971fc in calltrap () at ../../../i386/i386/exception.s:169 #12 0xc0a7807a in kdb_enter (why=0xc0f75698 "panic", msg=0xc0f75698 "panic") at cpufunc.h:71 #13 0xc0a4274c in panic (fmt=0xc0fb191a "vm_page_insert: offset %ju not minor than %ju") at ../../../kern/kern_shutdown.c:633 #14 0xc0cc16f4 in vm_page_insert (m=0xc48bfd40, object=0xd2cd04a0, pindex=0xffffffffffffffe9) at ../../../vm/vm_page.c:803 #15 0xc0cc39dc in vm_page_alloc (object=0xd2cd04a0, pindex=0xffffffffffffffe9, req=0x10222) at ../../../vm/vm_page.c:1273 #16 0xc0cc3f02 in vm_page_grab (object=0xd2cd04a0, pindex=0xffffffffffffffe9, allocflags=0x112a2) at ../../../vm/vm_page.c:2293 #17 0xc0ac5512 in allocbuf (bp=0xe53920c0, size=0x2000) at ../../../kern/vfs_bio.c:3067 #18 0xc0ac92c3 in getblk (vp=0xd3122c3c, blkno=0xfffffffffffffff4, size=0x2000, slpflag=0x0, slptimeo=0x0, flags=0x0) at ../../../kern/vfs_bio.c:2837 #19 0xc0c62dd3 in ffs_balloc_ufs2 (vp=0xd3122c3c, startoffset=Variable "startoffset" is not available. ) at ../../../ufs/ffs/ffs_balloc.c:795 #20 0xc0c8e8dd in ffs_write (ap=0xf63baba8) at ../../../ufs/ffs/ffs_vnops.c:721 #21 0xc0dd2866 in VOP_WRITE_APV (vop=0xc10bfd20, a=0xf63baba8) at vnode_if.c:951 #22 0xc0af20cc in vn_write (fp=0xcdf9a2d8, uio=0xf63bac40, active_cred=0xce001080, flags=0x0, td=0xcebed2e0) at vnode_if.h:413 #23 0xc0a912a5 in dofilewrite (td=0xcebed2e0, fd=0x4, fp=0xcdf9a2d8, auio=0xf63bac40, offset=0xffffffffffffffff, flags=0x0) at file.h:271 #24 0xc0a91918 in kern_writev (td=0xcebed2e0, fd=0x4, auio=0xf63bac40) at ../../../kern/sys_generic.c:459 #25 0xc0a91a2f in sys_write (td=0xcebed2e0, uap=0xf63bacec) at ../../../kern/sys_generic.c:375 #26 0xc0dacf27 in syscall (frame=0xf63bad28) at subr_syscall.c:135 #27 0xc0d97261 in Xint0x80_syscall () at ../../../i386/i386/exception.s:267 #28 0x00000033 in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb) f 14 #14 0xc0cc16f4 in vm_page_insert (m=0xc48bfd40, object=0xd2cd04a0, pindex=0xffffffffffffffe9) at ../../../vm/vm_page.c:803 803 KASSERT(pindex < neighbor->pindex, (kgdb) l 798 TAILQ_INSERT_TAIL(&object->memq, m, listq); 799 } else { 800 neighbor = vm_radix_lookup_ge(&object->rtree, pindex, 801 VM_RADIX_BLACK); 802 if (neighbor != NULL) { 803 KASSERT(pindex < neighbor->pindex, 804 ("vm_page_insert: offset %ju not minor than %ju", 805 (uintmax_t)pindex, (uintmax_t)neighbor->pindex)); 806 TAILQ_INSERT_BEFORE(neighbor, m, listq); 807 } else (kgdb) info loc neighbor = 0x0 cpindex = 0x3 (kgdb) p *m $1 = {pageq = {tqe_next = 0xc545a800, tqe_prev = 0xc128d6a0}, listq = {tqe_next = 0xc3486b00, tqe_prev = 0xd07cc8d4}, object = 0xd2cd04a0, pindex = 0xffffffffffffffe9, phys_addr = 0x9d876000, md = {pv_structs = {pvi_list = {tqh_first = 0x0, tqh_last = 0xc48bfd60}, pvi_siters = {pii_left = 0x0, pii_right = 0xc48bfd60}}, pat_mode = 0x6}, queue = 0xff, segind = 0x2, hold_count = 0x0, order = 0xb, pool = 0x0, cow = 0x0, wire_count = 0x1, aflags = 0x0, flags = 0x0, oflags = 0x0, act_count = 0x0, busy = 0x0, valid = 0x0, dirty = 0x0} (kgdb) p *object $2 = {mtx = {lock_object = {lo_name = 0xc0f7d3a8 "vm object", lo_flags = 0x1430000, lo_data = 0x0, lo_witness = 0xcb5759f0}, mtx_lock = 0xcebed2e0}, object_list = {tqe_next = 0x0, tqe_prev = 0xd0ad3670}, shadow_head = {lh_first = 0x0}, shadow_list = {le_next = 0x0, le_prev = 0xcf7a1428}, memq = {tqh_first = 0xc3929480, tqh_last = 0xc40ab348}, rtree = { rt_root = 0xc5cc200d}, size = 0x19, generation = 0x1, ref_count = 0x0, shadow_count = 0x0, memattr = 0x6, type = 0x2, flags = 0x0, pg_color = 0x0, paging_in_progress = 0x0, resident_page_count = 0x19, cached_page_count = 0x0, backing_object = 0x0, backing_object_offset = 0x0, pager_object_list = {tqe_next = 0x0, tqe_prev = 0x0}, rvq = {lh_first = 0x0}, handle = 0xd3122c3c, un_pager = {vnp = {vnp_size = 0x19000, writemappings = 0x0}, devp = {devp_pglist = {tqh_first = 0x19000, tqh_last = 0x0}, ops = 0x0}, sgp = {sgp_pglist = { tqh_first = 0x19000, tqh_last = 0x0}}, swp = {swp_bcount = 0x19000}}, cred = 0x0, charge = 0x0} (kgdb) f 17 #17 0xc0ac5512 in allocbuf (bp=0xe53920c0, size=0x2000) at ../../../kern/vfs_bio.c:3067 3067 m = vm_page_grab(obj, OFF_TO_IDX(bp->b_offset) + (kgdb) l 3062 * We can only test VPO_BUSY here. Blocking on 3063 * m->busy might lead to a deadlock: 3064 * vm_fault->getpages->cluster_read->allocbuf 3065 * Thus, we specify VM_ALLOC_IGN_SBUSY. 3066 */ 3067 m = vm_page_grab(obj, OFF_TO_IDX(bp->b_offset) + 3068 bp->b_npages, VM_ALLOC_NOBUSY | 3069 VM_ALLOC_SYSTEM | VM_ALLOC_WIRED | 3070 VM_ALLOC_RETRY | VM_ALLOC_IGN_SBUSY | 3071 VM_ALLOC_COUNT(desiredpages - bp->b_npages)); (kgdb) info loc m = Variable "m" is not available. (kgdb) p *bp $1 = {b_bufobj = 0xd3122d34, b_bcount = 0x0, b_caller1 = 0x0, b_data = 0xe9ba4000
, b_error = 0x0, b_iocmd = 0x2, b_ioflags = 0x0, b_iooffset = 0x182d000, b_resid = 0x0, b_iodone = 0, b_blkno = 0xfffffffffffffff4, b_offset = 0xfffffffffffe8000, b_bobufs = {tqe_next = 0x0, tqe_prev = 0xd3122d48}, b_left = 0x0, b_right = 0x0, b_vflags = 0x0, b_freelist = {tqe_next = 0xe53643e0, tqe_prev = 0xc1285320}, b_qindex = 0x0, b_flags = 0x20000000, b_xflags = 0x2, b_lock = {lock_object = {lo_name = 0xc0f83230 "bufwait", lo_flags = 0x5730000, lo_data = 0x0, lo_witness = 0xcb575308}, lk_lock = 0xcebed2e0, lk_exslpfail = 0x0, lk_timo = 0x0, lk_pri = 0x60, lk_stack = {depth = 0xc, pcs = {0xc0a293fe, 0xc0ac8463, 0xc0ac9165, 0xc0c62dd3, 0xc0c8e8dd, 0xc0dd2866, 0xc0af20cc, 0xc0a912a5, 0xc0a91918, 0xc0a91a2f, 0xc0dacf27, 0xc0d97261, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}}}, b_bufsize = 0x0, b_runningbufspace = 0x0, b_kvabase = 0xe9ba4000
, b_kvasize = 0x4000, b_lblkno = 0xfffffffffffffff4, b_vp = 0xd3122c3c, b_dirtyoff = 0x0, b_dirtyend = 0x0, b_rcred = 0x0, b_wcred = 0x0, b_saveaddr = 0xe9ba4000, b_pager = {pg_reqpage = 0x0}, b_cluster = {cluster_head = {tqh_first = 0xe514d360, tqh_last = 0xe527e100}, cluster_entry = { tqe_next = 0xe514d360, tqe_prev = 0xe527e100}}, b_pages = {0xc40ab340, 0x0 }, b_npages = 0x1, b_dep = {lh_first = 0x0}, b_fsprivate1 = 0x0, b_fsprivate2 = 0x0, b_fsprivate3 = 0x0, b_pin_count = 0x0} (kgdb) f 24 #24 0xc0a91918 in kern_writev (td=0xcebed2e0, fd=0x4, auio=0xf63bac40) at ../../../kern/sys_generic.c:459 459 error = dofilewrite(td, fd, fp, auio, (off_t)-1, 0); (kgdb) $ svn diff -x -p /var/tmp/vmcontention/sys Index: /var/tmp/vmcontention/sys/vm/vm_radix.c =================================================================== --- /var/tmp/vmcontention/sys/vm/vm_radix.c (revision 234481) +++ /var/tmp/vmcontention/sys/vm/vm_radix.c (working copy) @@ -59,19 +59,15 @@ #ifndef UMA_MD_SMALL_ALLOC #define VM_RADIX_RNODE_MAP_SCALE (1024 * 1024 / 2) -#define VM_RADIX_WIDTH 4 +#endif +#define VM_RADIX_WIDTH 5 + /* * Bits of height in root. * The mask of smaller power of 2 containing VM_RADIX_LIMIT. */ -#define VM_RADIX_HEIGHT 0x1f -#else -#define VM_RADIX_WIDTH 5 - -/* See the comment above. */ #define VM_RADIX_HEIGHT 0xf -#endif #define VM_RADIX_COUNT (1 << VM_RADIX_WIDTH) #define VM_RADIX_MASK (VM_RADIX_COUNT - 1) Index: /var/tmp/vmcontention/sys/vm/vm_mmap.c =================================================================== --- /var/tmp/vmcontention/sys/vm/vm_mmap.c (revision 234481) +++ /var/tmp/vmcontention/sys/vm/vm_mmap.c (working copy) @@ -81,6 +81,7 @@ __FBSDID("$FreeBSD$"); #include #include #include +#include #include #ifdef HWPMC_HOOKS @@ -887,11 +888,11 @@ RestartScan: object->type == OBJT_VNODE) { pindex = OFF_TO_IDX(current->offset + (addr - current->start)); - m = vm_page_lookup(object, pindex); mtx_lock(&vm_page_queue_free_mtx); - if (m == NULL && - vm_page_cache_lookup(object, - pindex) != NULL) + m = vm_radix_lookup(&object->rtree, + pindex, VM_RADIX_ANY); + if (m != NULL && + (m->flags & PG_CACHED) != 0) mincoreinfo = MINCORE_INCORE; mtx_unlock(&vm_page_queue_free_mtx); if (m != NULL && m->valid == 0) -- Test scenario: newfs3.sh newfs -b 8192 -f 8192 -O2 md5a on a 32 Mb FS