GENERIC HEAD from 2012-03-31 06:48:41 UTC, r233734M, vmcore.317 KDB: debugger backends: ddb KDB: current backend: ddb 524288K of memory above 4GB ignored Copyright (c) 1992-2012 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #0 r233734M: Sat Mar 31 09:44:07 CEST 2012 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 10 Model = 2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 4294967296 (4096 MB) avail memory = 3531657216 (3368 MB) : Trying to mount root from ufs:/dev/ad4s1a [rw]... Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/ad4s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1a: clean, 116104 free (1000 frags, 14388 blocks, 0.1% fragmentation) /dev/ad4s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1f: clean, 125865 free (5217 frags, 15081 blocks, 0.5% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 111642356 free (2404 frags, 13954994 blocks, 0.0% fragmentation) /dev/ad4s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1d: clean, 3271908 free (234972 frags, 379617 blocks, 2.3% fragmentation) /dev/ad4s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1e: clean, 17203637 free (44821 frags, 2144852 blocks, 0.2% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN re0: link state changed to UP Starting Network: lo0 re0 fwe0 fwip0. lo0: flags=8049 metric 0 mtu 16384 options=3 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0xa inet 127.0.0.1 netmask 0xff000000 nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 scopeid 0x1 nd6 options=29 media: Ethernet autoselect (100baseTX ) status: active fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 Starting devd. Starting Network: fwe0. fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 Starting Network: fwip0. fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/kde4/lib /usr/local/lib/compat /usr/local/lib/gcc46 /usr/local/lib/qt4 /usr/local/lib/virtualbox a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. savecore: error reading first dump header at offset 16942361560 in /dev/ada0s1b: Invalid argument savecore: unsaved dumps found but not saved Mar 31 09:58:04 x4 savecore: error reading first dump header at offset 16942361560 in /dev/ada0s1b: Invalid argument savecore: error reading first dump header at offset 16942361560 in /dev/ada0s1b: Invalid argument savecore: unsaved dumps found but not saved /var/crash/vmcore.316 not found Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 lock order reversal: 1st 0xe191f540 bufwait (bufwait) @ kern/vfs_bio.c:2652 2nd 0xcab03c00 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper(c0f77073,2e687361,38323a63,c0000a34,c1254920,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a7bb8b,c0f7ab20,c1254910,11c,f275f874,...) at kdb_backtrace+0x2a _witness_debugger(c0f7ab20,cab03c00,c0fab27a,c7d72610,c0faaf0c,...) at _witness_debugger+0x25 witness_checkorder(cab03c00,9,c0faaf03,11c,0,...) at witness_checkorder+0x86f _sx_xlock(cab03c00,0,c0faaf03,11c,ca7a2a6c,...) at _sx_xlock+0xa0 ufsdirhash_acquire(e191f4e0,ca7a2a6c,f275f9f0,e241ecc4,f275f944,...) at ufsdirhash_acquire+0x48 ufsdirhash_add(ca7a2a6c,f275f9f0,2cc4,f275f930,f275f934,...) at ufsdirhash_add+0x13 ufs_direnter(caae7d98,cad882b8,f275f9f0,f275fb80,e191fb60,...) at ufs_direnter+0x7a9 ufs_mkdir(f275fc10,c0fcc6f2,0,0,f275fba8,...) at ufs_mkdir+0xa6f VOP_MKDIR_APV(c10bc1a0,f275fc10,f275fb80,f275fba8,0,...) at VOP_MKDIR_APV+0xc5 kern_mkdirat(ca82d8a0,ffffff9c,28404020,0,1c0,...) at kern_mkdirat+0x291 kern_mkdir(ca82d8a0,28404020,0,1c0,f275fd1c,...) at kern_mkdir+0x2e sys_mkdir(ca82d8a0,f275fcec,c0fc517c,c0f7b832,202,...) at sys_mkdir+0x29 syscall(f275fd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x2817fb33, esp = 0xbfbfe8cc, ebp = 0xbfbfed78 --- Clearing /tmp (X related). Starting mountd. Starting nfsuserd. Starting nfsd. Recovering vi editor sessions:lock order reversal: 1st 0xcad81b38 ufs (ufs) @ kern/vfs_lookup.c:542 2nd 0xe1925520 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:260 3rd 0xcad81880 ufs (ufs) @ kern/vfs_subr.c:2167 KDB: stack backtrace: db_trace_self_wrapper(c0f77073,3a632e73,a303632,0,ffffffc0,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a7bb8b,c0f7ab39,c1254478,877,f274a354,...) at kdb_backtrace+0x2a _witness_debugger(c0f7ab39,cad81880,c0f69264,c7d725a8,c0f82b7b,...) at _witness_debugger+0x25 witness_checkorder(cad81880,9,c0f82b72,877,0,...) at witness_checkorder+0x86f __lockmgr_args(cad81880,80100,cad818ec,0,0,...) at __lockmgr_args+0x8c5 ffs_lock(f274a450,c0a8e11c,ca6c82e0,80100,cad81828,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c10bc1a0,f274a450,c7d6b1e0,c10cd360,cad81828,...) at VOP_LOCK1_APV+0xb5 _vn_lock(cad81828,80100,c0f82b72,877,4,...) at _vn_lock+0x78 vget(cad81828,80100,ca6c82e0,50,0,...) at vget+0xbb vfs_hash_get(ca759b40,15ee3d,80000,ca6c82e0,f274a59c,...) at vfs_hash_get+0xed ffs_vgetf(ca759b40,15ee3d,80000,f274a59c,1,...) at ffs_vgetf+0x49 softdep_sync_buf(cad81ae0,e19254c0,1,106,0,...) at softdep_sync_buf+0xac9 ffs_syncvnode(cad81ae0,1,0,f274a62c,c0a8bff7,...) at ffs_syncvnode+0x24c ffs_truncate(cad81ae0,200,0,880,ca75a680,...) at ffs_truncate+0x8b5 ufs_direnter(cad81ae0,cad81828,f274a914,f274abbc,0,...) at ufs_direnter+0x9a1 ufs_makeinode(f274abbc,c10bc760,f274ab00,f274aa5c,c0dd08c5,...) at ufs_makeinode+0x65d ufs_create(f274ab00,c0fcc8b8,0,0,f274ab7c,...) at ufs_create+0x30 VOP_CREATE_APV(c10bc1a0,f274ab00,f274abbc,f274aa98,0,...) at VOP_CREATE_APV+0xc5 vn_open_cred(f274ab7c,f274ac44,1b0,0,ca75a680,...) at vn_open_cred+0x205 vn_open(f274ab7c,f274ac44,1b0,ca78f230,4f76b8b9,...) at vn_open+0x3b kern_openat(ca6c82e0,ffffff9c,28839f60,0,a03,...) at kern_openat+0x1ec kern_open(ca6c82e0,28839f60,0,a02,1b0,...) at kern_open+0x35 sys_open(ca6c82e0,f274acec,c0fc517c,c0f7b832,206,...) at sys_open+0x30 syscall(f274ad28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x283ec193, esp = 0xbfbfc50c, ebp = 0xbfbfc598 --- . Updating motd:. Starting ntpd. Starting default moused. Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Local package initialization: backuplock order reversal: 1st 0xca8a4724 ufs (ufs) @ kern/vfs_mount.c:1251 2nd 0xca8a4b38 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1843 KDB: stack backtrace: db_trace_self_wrapper(c0f77073,38313a63,a3334,c7d6b7f8,ca80b950,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a7bb8b,c0f7ab20,c1254048,733,f27289bc,...) at kdb_backtrace+0x2a _witness_debugger(c0f7ab20,ca8a4b38,c0f6e1d4,c7d72408,c0fa7338,...) at _witness_debugger+0x25 witness_checkorder(ca8a4b38,9,c0fa732f,733,ca8a4ba4,...) at witness_checkorder+0x86f __lockmgr_args(ca8a4b38,80400,ca8a4ba4,0,0,...) at __lockmgr_args+0x8c5 vop_stdlock(f2728ab4,4,c0f712d3,80400,ca8a4ae0,...) at vop_stdlock+0x65 VOP_LOCK1_APV(c1091a00,f2728ab4,c1287e40,c10cd360,ca8a4ae0,...) at VOP_LOCK1_APV+0xb5 _vn_lock(ca8a4ae0,80400,c0fa732f,733,caae92d0,...) at _vn_lock+0x78 softdep_flushworklist(caae92d0,f2728b68,ca80b8a0,638,c0ae0b7a,...) at softdep_flushworklist+0x82 ffs_sync(caae92d0,1,f2728bbc,51c,c7c34000,...) at ffs_sync+0x533 dounmount(caae92d0,8080000,ca80b8a0,49e,f2728c04,...) at dounmount+0x3f8 sys_unmount(ca80b8a0,f2728cec,c0fc517c,c,206,...) at sys_unmount+0x421 syscall(f2728d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280e7f9b, esp = 0xbfbfe64c, ebp = 0xbfbfe718 --- ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes Mar 31 09:58:04 x4 savecore: error reading first dump header at offset 16942361560 in /dev/ada0s1b: Invalid argument ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 79660 files, 6671625 used, 111642356 free (2404 frags, 13954994 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 79660 files, 6671625 used, 111642356 free (2404 frags, 13954994 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmp watchdogd. Starting inetd. Sat Mar 31 10:01:21 CEST 2012 FreeBSD/i386 (x4.osted.lan) (console) login: Mar 31 10:07:13 x4 su: pho to root on /dev/pts/0 Mar 31 10:07:18 x4 mountd[1013]: can't delete exports for /mnt7: Invalid argument Mar 31 10:07:18 x4 mountd[1013]: can't delete exports for /mnt10: Invalid argument Mar 31 10:07:18 x4 mountd[1013]: can't delete exports for /mnt12: Device busy Mar 31 10:07:18 x4 mountd[1013]: can't delete exports for /mnt18: Invalid argument Mar 31 10:07:18 x4 mountd[1013]: can't delete exports for /mnt17: Invalid argument Mar 31 10:07:18 x4 mountd[1013]: can't delete exports for /mnt8: Invalid argument Mar 31 10:07:18 x4 mountd[1013]: can't delete exports for /mnt9: Invalid argument Mar 31 10:07:18 x4 mountd[1013]: can't delete exports for /mnt7: Invalid argument Mar 31 10:07:18 x4 mountd[1013]: can't delete exports for /mnt15: Invalid argument Mar 31 10:07:18 x4 mountd[1013]: can't delete exports for /mnt6: Invalid argument Mar 31 10:07:18 x4 mountd[1013]: can't delete exports for /mnt14: Invalid argument Mar 31 10:07:18 x4 mountd[1013]: can't delete exports for /mnt13: Invalid argument Mar 31 10:07:18 x4 mountd[1013]: can't delete exports for /mnt5: Invalid argument Mar 31 10:07:18 x4 mountd[1013]: can't delete exports for /mnt10: Device busy Mar 31 10:07:18 x4 mountd[1013]: can't delete exports for /mnt12: Invalid argument Mar 31 10:07:19 x4 mountd[1013]: can't delete exports for /mnt12: Invalid argument Mar 31 10:07:20 x4 mountd[1013]: can't delete exports for /mnt17: Invalid argument Mar 31 10:07:20 x4 mountd[1013]: can't delete exports for /mnt13: Invalid argument Mar 31 10:07:20 x4 mountd[1013]: can't delete exports for /mnt11: Invalid argument Mar 31 10:07:21 x4 mountd[1013]: can't delete exports for /mnt9: Invalid argument Mar 31 10:07:21 x4 mountd[1013]: can't delete exports for /mnt6: Invalid argument Mar 31 10:07:21 x4 mountd[1013]: can't delete exports for /mnt9: Invalid argument Mar 31 10:07:21 x4 mountd[1013]: can't delete exports for /mnt6: Invalid argument Mar 31 10:07:21 x4 mountd[1013]: can't delete exports for /mnt12: Invalid argument Mar 31 10:07:21 x4 mountd[1013]: can't delete exports for /mnt5: Invalid argument Mar 31 10:07:22 x4 mountd[1013]: can't delete exports for /mnt13: Invalid argument Mar 31 10:07:22 x4 mountd[1013]: can't delete exports for /mnt11: Invalid argument Mar 31 10:07:22 x4 mountd[1013]: can't delete exports for /mnt15: Invalid argument Mar 31 10:07:22 x4 mountd[1013]: can't delete exports for /mnt17: Invalid argument : Mar 31 11:09:54 x4 mountd[1013]: can't delete exports for /mnt14: Invalid argument Mar 31 11:09:54 x4 mountd[1013]: can't delete exports for /mnt16: Invalid argument Mar 31 11:09:54 x4 mountd[1013]: can't delete exports for /mnt17: Invalid argument Mar 31 11:09:54 x4 mountd[1013]: can't delete exports for /mnt13: Invalid argument Mar 31 11:09:54 x4 mountd[1013]: can't delete exports for /mnt7: Invalid argument Mar 31 11:09:54 x4 mountd[1013]: can't delete exports for /mnt10: Invalid argument Mar 31 11:10:07 x4 mountd[1013]: can't delete exports for /mnt7: Invalid argument Mar 31 11:10:07 x4 mountd[1013]: can't delete exports for /mnt16: Invalid argument Mar 31 11:10:07 x4 mountd[1013]: can't delete exports for /mnt11: Invalid argument Mar 31 11:10:07 x4 mountd[1013]: can't delete exports for /mnt5: Invalid argument Mar 31 11:10:07 x4 mountd[1013]: can't delete exports for /mnt19: Invalid argument Mar 31 11:10:07 x4 mountd[1013]: can't delete exports for /mnt14: Invalid argument fsync: giving up on dirty 0xcba8d828: tag devfs, type VCHR usecount 1, writecount 0, refcount 5 mountedhere 0xca751100 flags () v_object 0xcbdafb90 ref 0 pages 10 lock type devfs: EXCL by thread 0xcd752000 (pid 43253, umount, tid 100311) #0 0xc0a28a3e at __lockmgr_args+0xd6e #1 0xc0acdbd5 at vop_stdlock+0x65 #2 0xc0dcf8f5 at VOP_LOCK1_APV+0xb5 #3 0xc0aefe98 at _vn_lock+0x78 #4 0xc0c885d8 at ffs_sync+0x5f8 #5 0xc0ad89f8 at dounmount+0x3f8 #6 0xc0ad90e1 at sys_unmount+0x421 #7 0xc0daab23 at syscall+0x2c3 #8 0xc0d94f11 at Xint0x80_syscall+0x21 dev md5a Mar 31 11:10:21 x4 mountd[1013]: can't delete exports for /mnt11: Invalid argument Mar 31 11:10:21 x4 mountd[1013]: can't delete exports for /mnt14: Invalid argument Mar 31 11:10:21 x4 mountd[1013]: can't delete exports for /mnt13: Invalid argument Mar 31 11:10:21 x4 mountd[1013]: can't delete exports for /mnt10: Invalid argument Mar 31 11:10:21 x4 mountd[1013]: can't delete exports for /mnt17: Invalid argument Mar 31 11:10:21 x4 mountd[1013]: can't delete exports for /mnt7: Invalid argument Mar 31 11:10:26 x4 mountd[1013]: can't delete exports for /mnt18: Invalid argument : Mar 31 14:12:43 x4 mountd[1013]: can't delete exports for /mnt4: Invalid argument Mar 31 14:12:43 x4 mountd[1013]: can't delete exports for /mnt8: Invalid argument Mar 31 14:12:43 x4 mountd[1013]: can't delete exports for /mnt10: Invalid argument Mar 31 14:12:43 x4 mountd[1013]: can't delete exports for /mnt7: Invalid argument Mar 31 14:12:43 x4 mountd[1013]: can't delete exports for /mnt12: Invalid argument Mar 31 14:12:43 x4 mountd[1013]: can't delete exports for /mnt4: Invalid argument Mar 31 14:12:43 x4 mountd[1013]: can't delete exports for /mnt9: Invalid argument Mar 31 14:12:43 x4 mountd[1013]: can't delete exports for /mnt10: Invalid argument Mar 31 14:12:43 x4 mountd[1013]: can't delete exports for /mnt5: Invalid argument Mar 31 14:12:43 x4 mountd[1013]: can't delete exports for /mnt9: Invalid argument Mar 31 14:12:43 x4 mountd[1013]: can't delete exports for /mnt13: Invalid argument Mar 31 14:12:43 x4 mountd[1013]: can't delete exports for /mnt15: Invalid argument Mar 31 14:12:43 x4 mountd[1013]: can't delete exports for /mnt2: Invalid argument Mar 31 14:12:43 x4 mountd[1013]: can't delete exports for /mnt13: Invalid argument Mar 31 14:12:43 x4 mountd[1013]: can't delete exports for /mnt1: Invalid argument Mar 31 14:12:43 x4 mountd[1013]: can't delete exports for /mnt8: Invalid argument Mar 31 14:12:43 x4 mountd[1013]: can't delete exports for /mnt14: Invalid argument Mar 31 14:12:43 x4 mountd[1013]: can't delete exports for /mnt1: Invalid argument Mar 31 14:12:43 x4 mountd[1013]: can't delete exports for /mnt7: Invalid argument Mar 31 14:12:43 x4 mountd[1013]: can't delete exports for /mnt5: Invalid argument Mar 31 14:12:44 x4 mountd[1013]: can't delete exports for /mnt12: Invalid argument Mar 31 14:12:44 x4 mountd[1013]: can't delete exports for /mnt1: Invalid argument Mar 31 14:12:44 x4 mountd[1013]: can't delete exports for /mnt1: Invalid argument Mar 31 14:12:44 x4 mountd[1013]: can't delete exports for /mnt4: Invalid argument Mar 31 14:12:44 x4 mountd[1013]: can't delete exports for /mnt3: Invalid argument Mar 31 14:12:44 x4 mountd[1013]: can't delete exports for /mnt2: Invalid argument Mar 31 14:12:44 x4 mountd[1013]: can't delete exports for /mnt1: Invalid argument Mar 31 14:12:44 x4 mountd[1013]: can't delete exports for /mnt8: Invalid argument Mar 31 14:12:44 x4 mountd[1013]: can't delete exports for /mnt9: Invalid argument Mar 31 14:12:44 x4 mountd[1013]: can't delete exports for /mnt1: Invalid argument Mar 31 14:12:44 x4 mountd[1013]: can't delete exports for /mnt10: Invalid argument Mar 31 14:12:44 x4 mountd[1013]: can't delete exports for /mnt9: Invalid argument Mar 31 14:12:44 x4 mountd[1013]: can't delete exports for /mnt15: Invalid argument Mar 31 14:12:44 x4 mountd[1013]: can't delete exports for /mnt3: Invalid argument Mar 31 14:12:44 x4 mountd[1013]: can't delete exports for /mnt4: Invalid argument Mar 31 14:12:44 x4 mountd[1013]: can't delete exports for /mnt1: Invalid argument Mar 31 14:12:44 x4 mountd[1013]: can't delete exports for /mnt14: Invalid argument Mar 31 14:12:44 x4 mountd[1013]: can't delete exports for /mnt12: Invalid argument lock order reversal: 1st 0xe1971e60 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:260 2nd 0xd458091c snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:2307 KDB: stack backtrace: db_trace_self_wrapper(c0f77073,632e746f,3033323a,c1000a37,d2111d98,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a7bb8b,c0f7ab20,c124fe58,903,f2a43874,...) at kdb_backtrace+0x2a _witness_debugger(c0f7ab20,d458091c,c0fa6d94,c7d72f00,c0fa6d1e,...) at _witness_debugger+0x25 witness_checkorder(d458091c,9,c0fa6d15,903,0,...) at witness_checkorder+0x86f __lockmgr_args(d458091c,80900,d1520634,0,0,...) at __lockmgr_args+0x8c5 ffs_copyonwrite(d1520570,e1971e00,0,e1971e00,cb7e4ae0,...) at ffs_copyonwrite+0x2c2 ffs_geom_strategy(d1520668,e1971e00,f2a439d0,cb2512e0,cbe5fc24,...) at ffs_geom_strategy+0xeb ufs_strategy(f2a43a0c,c0fcc5b3,cbe5fc24,e1971e00,0,...) at ufs_strategy+0xd3 VOP_STRATEGY_APV(c10bc1a0,f2a43a0c,cbe5fc24,c10cd3c0,cb7e4ae0,...) at VOP_STRATEGY_APV+0xe5 bufstrategy(cb7e4bd8,e1971e00,eb,e1971e60,e1971e00,...) at bufstrategy+0x61 bufwrite(e1971e00,e1971e00,1,106,0,...) at bufwrite+0x159 ffs_syncvnode(cb7e4ae0,1,0,c10bc1a0,cb7e4bd8,...) at ffs_syncvnode+0x385 ffs_fsync(f2a43afc,c0fcbd6f,d15e9c3c,f2a43afc,0,...) at ffs_fsync+0x2f VOP_FSYNC_APV(c10bc1a0,f2a43afc,500800c,0,cb7e4ae0,...) at VOP_FSYNC_APV+0xc5 ufs_remove(f2a43c18,c0fcc7ab,0,0,d2111d98,...) at ufs_remove+0xd2 VOP_REMOVE_APV(c10bc1a0,f2a43c18,d2111d98,f2a43b90,0,...) at VOP_REMOVE_APV+0xf6 kern_unlinkat(cb2512e0,ffffff9c,bfbfe424,0,0,...) at kern_unlinkat+0x258 kern_unlink(cb2512e0,bfbfe424,0,f2a43d1c,c0daab23,...) at kern_unlink+0x2f sys_unlink(cb2512e0,f2a43cec,c0fc517c,c,206,...) at sys_unlink+0x22 syscall(f2a43d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28186f5f, esp = 0xbfbfdf5c, ebp = 0xbfbfe838 --- lock order reversal: 1st 0xd458091c snaplk (snaplk) @ kern/vfs_vnops.c:310 2nd 0xd2111df0 ufs (ufs) @ ufs/ffs/ffs_snapshot.c:1637 KDB: stack backtrace: db_trace_self_wrapper(c0f77073,a373336,cb251200,f2a435d0,246,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a7bb8b,c0f7ab20,c124fe48,665,f2a4367c,...) at kdb_backtrace+0x2a _witness_debugger(c0f7ab20,d2111df0,c0f69264,c7d725a8,c0fa6d1e,...) at _witness_debugger+0x25 witness_checkorder(d2111df0,9,c0fa6d15,665,0,...) at witness_checkorder+0x86f __lockmgr_args(d2111df0,80000,0,0,0,...) at __lockmgr_args+0x8c5 ffs_snapremove(d2111d98,c0fa6c53,c0f712d3,eb,d2111e90,...) at ffs_snapremove+0x11f ffs_truncate(d2111d98,0,0,c00,0,...) at ffs_truncate+0x647 ufs_inactive(f2a43a2c,c0fcc285,d2111e5c,d2111e5c,d2111d98,...) at ufs_inactive+0x1fb VOP_INACTIVE_APV(c10bc1a0,f2a43a2c,c0f82b72,96f,c10cd320,...) at VOP_INACTIVE_APV+0xc5 vinactive(c10bc1a0,f2a43a60,c0f82b72,8c6,0,...) at vinactive+0xb1 vputx(f2a43ac8,c0af18aa,d2111d98,f2a43aa4,c0f84370,...) at vputx+0x36c vput(d2111d98,f2a43aa4,c0f84370,136,0,...) at vput+0x10 vn_close(d2111d98,1,d38dec80,cb2512e0,28140000,...) at vn_close+0x19a vn_closefile(cbdf7000,cb2512e0,c10a2ac0,0,cbdf7000,...) at vn_closefile+0xe4 _fdrop(cbdf7000,cb2512e0,0,f2a43b8c,0,c0a8bcea,c124fe48,cb251390,c124fe48,c10a2ac0,cb2512e0,cbb9382c,79f,f2a43b9c,c0a4a4c5,cbb9382c,8,c0f6c3ec,cbdf7000) at _fdrop+0x43 closef(cbdf7000,cb2512e0,79f,79c,c7d6a340,...) at closef+0x2b0 fdfree(cb2512e0,0,c0f6d093,107,cbdbf354,...) at fdfree+0x3ea exit1(cb2512e0,0,f2a43d1c,c0daab23,cb2512e0,...) at exit1+0x573 sys_sys_exit(cb2512e0,f2a43cec,c0fc517c,c,286,...) at sys_sys_exit+0x1d syscall(f2a43d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (1, FreeBSD ELF32, sys_sys_exit), eip = 0x281182ff, esp = 0xbfbfdeec, ebp = 0xbfbfdef8 --- panic: __lockmgr_args: recursing on non recursive lockmgr devfs @ ../../../ufs/ffs/ffs_softdep.c:1843 cpuid = 3 KDB: enter: panic [ thread pid 57651 tid 100131 ] Stopped at kdb_enter+0x3a: movl $0,kdb_why db> run pho db:0:pho> bt Tracing pid 57651 tid 100131 td 0xca80c2e0 kdb_enter(c0f73030,c0f73030,c0f6fa44,f284694c,3,...) at kdb_enter+0x3a panic(c0f6fa44,c0f6fb80,c0f6e1d4,c0fa732f,733,...) at panic+0x18c __lockmgr_args(d15205c8,80400,d1520634,0,0,...) at __lockmgr_args+0x935 vop_stdlock(f2846a38,4,c0f712d3,80400,d1520570,...) at vop_stdlock+0x65 VOP_LOCK1_APV(c1091a00,f2846a38,c1287e40,c10cd360,d1520570,...) at VOP_LOCK1_APV+0xb5 _vn_lock(d1520570,80400,c0fa732f,733,d1520668,...) at _vn_lock+0x78 softdep_flushworklist(cbbcdb40,f2846ac0,ca80c2e0,2b0,0,...) at softdep_flushworklist+0x82 vop_stdfsync(f2846b4c,f2846ae0,0,c1091a00,f2846b4c,...) at vop_stdfsync+0x24b devfs_fsync(f2846b4c,c0fcbd6f,d1520570,d1520570,d1520668,...) at devfs_fsync+0x7c VOP_FSYNC_APV(c1091a00,f2846b4c,c0faa1f0,64e,c0ae0b7a,...) at VOP_FSYNC_APV+0xc5 ffs_sync(cbbcdb40,1,f2846bbc,51c,c7c34000,...) at ffs_sync+0x620 dounmount(cbbcdb40,8080000,ca80c2e0,49e,f2846c04,...) at dounmount+0x3f8 sys_unmount(ca80c2e0,f2846cec,c0fc517c,c,206,...) at sys_unmount+0x421 syscall(f2846d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280e7f9b, esp = 0xbfbfe0ac, ebp = 0xbfbfe178 --- db:0:bt> show allpcpu Current CPU: 3 cpuid = 0 dynamic pcpu = 0x757400 curthread = 0xc7dd18a0: pid 11 "idle: cpu0" curpcb = 0xc7b26d80 fpcurthread = none idlethread = 0xc7dd18a0: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x6a48400 curthread = 0xc7dd15c0: pid 11 "idle: cpu1" curpcb = 0xc7b29d80 fpcurthread = none idlethread = 0xc7dd15c0: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x6a4b400 curthread = 0xc7dd12e0: pid 11 "idle: cpu2" curpcb = 0xc7b2cd80 fpcurthread = none idlethread = 0xc7dd12e0: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x6a4e400 curthread = 0xca80c2e0: pid 57651 "umount" curpcb = 0xf2846d80 fpcurthread = none idlethread = 0xc7dd1000: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks Process 57651 (umount) thread 0xca80c2e0 (100131) exclusive sleep mutex Giant (Giant) r = 0 (0xc1109710) locked @ kern/vfs_mount.c:1166 exclusive lockmgr devfs (devfs) r = 0 (0xd15205c8) locked @ ufs/ffs/ffs_vfsops.c:1614 exclusive lockmgr ufs (ufs) r = 0 (0xcadec5c8) locked @ kern/vfs_mount.c:1251 db:0:alllocks> show lockedvnods Locked vnodes 0xcadec570: tag ufs, type VDIR usecount 1, writecount 0, refcount 1 mountedhere 0xcbbcdb40 flags () v_object 0xcb047094 ref 0 pages 0 lock type ufs: EXCL by thread 0xca80c2e0 (pid 57651, umount, tid 100131) #0 0xc0a28a3e at __lockmgr_args+0xd6e #1 0xc0c8e3a1 at ffs_lock+0xa1 #2 0xc0dcf8f5 at VOP_LOCK1_APV+0xb5 #3 0xc0aefe98 at _vn_lock+0x78 #4 0xc0ad868c at dounmount+0x8c #5 0xc0ad90e1 at sys_unmount+0x421 #6 0xc0daab23 at syscall+0x2c3 #7 0xc0d94f11 at Xint0x80_syscall+0x21 ino 235521, on dev ada0s1a 0xd1520570: tag devfs, type VCHR usecount 1, writecount 0, refcount 22 mountedhere 0xca845500 flags () v_object 0xcd44ede0 ref 0 pages 130 lock type devfs: EXCL by thread 0xca80c2e0 (pid 57651, umount, tid 100131) #0 0xc0a28a3e at __lockmgr_args+0xd6e #1 0xc0acdbd5 at vop_stdlock+0x65 #2 0xc0dcf8f5 at VOP_LOCK1_APV+0xb5 #3 0xc0aefe98 at _vn_lock+0x78 #4 0xc0c885d8 at ffs_sync+0x5f8 #5 0xc0ad89f8 at dounmount+0x3f8 #6 0xc0ad90e1 at sys_unmount+0x421 #7 0xc0daab23 at syscall+0x2c3 #8 0xc0d94f11 at Xint0x80_syscall+0x21 dev md5a db:0:lockedvnods> show mount 0xca758b40 /dev/ad4s1a on / (ufs) 0xca759000 devfs on /dev (devfs) 0xcaae95a0 /dev/ad4s1f on /home (ufs) 0xcaae9000 /dev/ad4s1d on /usr (ufs) 0xca759b40 /dev/ad4s1e on /var (ufs) 0xca759870 procfs on /proc (procfs) 0xcb08f000 /dev/label/tmp on /tmp (ufs) 0xcbbcdb40 /dev/md5a on /mnt (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 57651 56556 15971 0 R+ CPU 3 umount 57227 5063 5044 1001 S nanslp 0xc110b9a4 sleep 56587 0 0 0 DL mdwait 0xcd3f7800 [md5] 56556 15971 15971 0 S+ wait 0xcd9dd598 sh 15971 1298 15971 0 S+ wait 0xcb1b7864 sh 92846 92845 92846 1001 Ss+ ttyin 0xcb194e70 bash 92845 92843 92843 1001 S select 0xcbb60664 sshd 92843 1146 92843 0 Ss select 0xcbe08ea4 sshd 5064 5044 5044 1001 S piperd 0xcb1aec80 awk 5063 5044 5044 1001 S wait 0xca8042cc sh 5048 5047 5048 1001 Ss+ select 0xc8027ae4 top 5047 4971 4971 1001 S select 0xc8027a64 sshd 5044 5043 5044 1001 SWs wait 0xcae08864 sh 5043 4970 4970 1001 S select 0xca749764 sshd 5041 5038 5041 1001 Ss kqread 0xcae85a80 tail 5038 4972 4972 1001 S select 0xc8027764 sshd 4972 1146 4972 0 Ss select 0xca74a5e4 sshd 4971 1146 4971 0 Ss select 0xca7497e4 sshd 4970 1146 4970 0 Ss select 0xc80270a4 sshd 1298 1295 1298 0 S+ wait 0xca804864 bash 1295 1294 1295 0 SW+ pause 0xcae08324 csh 1294 1283 1294 1001 SW+ wait 0xcae04b30 su 1283 1282 1283 1001 SWs+ wait 0xca806b30 bash 1282 1280 1280 1001 S select 0xc817de64 sshd 1280 1146 1280 0 Ss select 0xca74ac64 sshd 1266 1 1266 0 Ss+ ttyin 0xc7ef1e70 getty 1265 1 1265 0 Ss+ ttyin 0xc8191070 getty 1264 1 1264 0 Ss+ ttyin 0xc8191270 getty 1263 1 1263 0 Ss+ ttyin 0xc8191470 getty 1262 1 1262 0 Ss+ ttyin 0xc7ef0070 getty 1261 1 1261 0 Ss+ ttyin 0xc7ef0270 getty 1260 1 1260 0 Ss+ ttyin 0xc7ef0470 getty 1259 1 1259 0 Ss+ ttyin 0xc7ef0670 getty 1258 1 1258 0 Ss+ ttyin 0xc7ef0870 getty 1241 1 1241 0 Ss select 0xca7490e4 inetd 1216 1 1216 0 Ss nanslp 0xc110b9a4 watchdogd 1157 1 1157 0 Ss nanslp 0xc110b9a4 cron 1152 1 1152 25 Ss pause 0xca826324 sendmail 1149 1 1149 0 Ss select 0xca717964 sendmail 1146 1 1146 0 Ss select 0xca717764 sshd 1115 1 1115 0 Ss select 0xca6aaae4 moused 1095 1 1095 0 Ss select 0xca74ad64 ntpd 1040 1035 1035 0 S (threaded) nfsd 100126 S rpcsvc 0xc7fbee50 nfsd: service 100125 S rpcsvc 0xc7fbee90 nfsd: service 100124 S rpcsvc 0xcab06010 nfsd: service 100081 S rpcsvc 0xcae0b150 nfsd: master 1035 1 1035 0 Ss select 0xca717724 nfsd 1033 1029 1029 0 S select 0xca717524 nfsuserd 1032 1029 1029 0 S select 0xca7492e4 nfsuserd 1031 1029 1029 0 S select 0xca717424 nfsuserd 1030 1029 1029 0 S select 0xca749324 nfsuserd 1029 1 1029 0 SWs pause 0xcac315f0 nfsuserd 1013 1 1013 0 Ss select 0xca6aab24 mountd 980 1 980 0 Ss select 0xca7173e4 rpcbind 961 1 961 0 Ss select 0xca7172a4 syslogd 838 1 838 0 Ss select 0xca773464 devd 19 0 0 0 DL sdflush 0xc1287e80 [softdepflush] 18 0 0 0 DL syncer 0xc1281b74 [syncer] 17 0 0 0 DL vlruwt 0xca6be598 [vnlru] 16 0 0 0 DL psleep 0xc1281808 [bufdaemon] 9 0 0 0 DL pgzero 0xc1289d5c [pagezero] 8 0 0 0 DL psleep 0xc1289948 [vmdaemon] 7 0 0 0 DL psleep 0xc1289910 [pagedaemon] 6 0 0 0 DL ccb_scan 0xc10ce954 [xpt_thrd] 5 0 0 0 DL waiting_ 0xc1283698 [sctp_iterator] 4 0 0 0 DL ctl_work 0xc8196000 [ctl_thrd] 3 0 0 0 DL - 0xc7f7723c [fdc0] 2 0 0 0 SL - 0xc8085000 [fw0_probe] 15 0 0 0 DL (threaded) [usb] 100058 D - 0xc805cd34 [usbus5] 100057 D - 0xc805cd04 [usbus5] 100056 D - 0xc805ccd4 [usbus5] 100055 D - 0xc805cca4 [usbus5] 100053 D - 0xc804fb5c [usbus4] 100052 D - 0xc804fb2c [usbus4] 100051 D - 0xc804fafc [usbus4] 100050 D - 0xc804facc [usbus4] 100049 D - 0xc804bb5c [usbus3] 100048 D - 0xc804bb2c [usbus3] 100047 D - 0xc804bafc [usbus3] 100046 D - 0xc804bacc [usbus3] 100045 D - 0xc8043b5c [usbus2] 100044 D - 0xc8043b2c [usbus2] 100043 D - 0xc8043afc [usbus2] 100042 D - 0xc8043acc [usbus2] 100040 D - 0xc803eb5c [usbus1] 100039 D - 0xc803eb2c [usbus1] 100038 D - 0xc803eafc [usbus1] 100037 D - 0xc803eacc [usbus1] 100035 D - 0xc802fb5c [usbus0] 100034 D - 0xc802fb2c [usbus0] 100033 D - 0xc802fafc [usbus0] 100032 D - 0xc802facc [usbus0] 14 0 0 0 DL - 0xc110a7a4 [yarrow] 13 0 0 0 DL (threaded) [geom] 100016 D - 0xc11079e8 [g_down] 100015 D - 0xc11079e4 [g_up] 100014 D - 0xc11079dc [g_event] 12 0 0 0 WL (threaded) [intr] 100078 I [swi6: mca:scan+] 100066 I [irq12: psm0] 100065 I [irq1: atkbd0] 100063 I [swi0: uart] 100060 I [irq20: fwohci0] 100059 I [irq14: ata0] 100054 I [irq19: ehci0] 100041 I [irq18: ohci2 ohci4] 100036 I [irq17: ohci1 ohci3] 100031 I [irq16: hdac1 ohci0] 100030 I [irq22: ahci0] 100029 I [irq257: re0] 100028 I [irq256: hdac0] 100027 I [swi6: task queue] 100026 I [swi6: Giant taskq] 100024 I [swi5: +] 100018 I [swi2: cambio] 100012 I [swi3: vm] 100011 I [swi1: netisr 0] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 I [swi4: clock] 100007 I [swi4: clock] 11 0 0 0 RL (threaded) [idle] 100006 CanRun [idle: cpu3] 100005 Run CPU 2 [idle: cpu2] 100004 Run CPU 1 [idle: cpu1] 100003 Run CPU 0 [idle: cpu0] 1 0 1 0 SLs wait 0xc7dcfb30 [init] 10 0 0 0 DL audit_wo 0xc12875c0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100068 D - 0xc110a7a4 [deadlkres] 100061 D - 0xc8084400 [fw0_taskq] 100025 D - 0xc7d9f700 [thread taskq] 100023 D - 0xc7d9f780 [ffs_trim taskq] 100022 D - 0xc7d9f7c0 [kqueue taskq] 100021 D - 0xc7d9f800 [acpi_task_2] 100020 D - 0xc7d9f800 [acpi_task_1] 100019 D - 0xc7d9f800 [acpi_task_0] 100013 D - 0xc7d9fc00 [firmware taskq] 100000 D sched 0xc1107b00 [swapper] db:0:ps> allt Tracing command umount pid 57651 tid 100131 td 0xca80c2e0 kdb_enter(c0f73030,c0f73030,c0f6fa44,f284694c,3,...) at kdb_enter+0x3a panic(c0f6fa44,c0f6fb80,c0f6e1d4,c0fa732f,733,...) at panic+0x18c __lockmgr_args(d15205c8,80400,d1520634,0,0,...) at __lockmgr_args+0x935 vop_stdlock(f2846a38,4,c0f712d3,80400,d1520570,...) at vop_stdlock+0x65 VOP_LOCK1_APV(c1091a00,f2846a38,c1287e40,c10cd360,d1520570,...) at VOP_LOCK1_APV+0xb5 _vn_lock(d1520570,80400,c0fa732f,733,d1520668,...) at _vn_lock+0x78 softdep_flushworklist(cbbcdb40,f2846ac0,ca80c2e0,2b0,0,...) at softdep_flushworklist+0x82 vop_stdfsync(f2846b4c,f2846ae0,0,c1091a00,f2846b4c,...) at vop_stdfsync+0x24b devfs_fsync(f2846b4c,c0fcbd6f,d1520570,d1520570,d1520668,...) at devfs_fsync+0x7c VOP_FSYNC_APV(c1091a00,f2846b4c,c0faa1f0,64e,c0ae0b7a,...) at VOP_FSYNC_APV+0xc5 ffs_sync(cbbcdb40,1,f2846bbc,51c,c7c34000,...) at ffs_sync+0x620 dounmount(cbbcdb40,8080000,ca80c2e0,49e,f2846c04,...) at dounmount+0x3f8 sys_unmount(ca80c2e0,f2846cec,c0fc517c,c,206,...) at sys_unmount+0x421 syscall(f2846d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280e7f9b, esp = 0xbfbfe0ac, ebp = 0xbfbfe178 --- Tracing command sleep pid 57227 tid 100301 td 0xcd754000 sched_switch(cd754000,0,104,1a3,111e46fc,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cd754000,0,c0f78a40,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(2711,c0a823b0,cd754000,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c110b9a4,6c,c0f74597,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c110b9a4,0,16c,c0f74597,2711,...) at _sleep+0x34f kern_nanosleep(cd754000,f2ad0c4c,f2ad0c54,a,0,...) at kern_nanosleep+0xc1 sys_nanosleep(cd754000,f2ad0cec,c0fc517c,c0f7c206,246,...) at sys_nanosleep+0x6f syscall(f2ad0d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2816e223, esp = 0xbfbfec5c, ebp = 0xbfbfeca8 --- Tracing command md5 pid 56587 tid 100129 td 0xca80c8a0 sched_switch(ca80c8a0,0,104,1a3,2d65dbfa,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(ca80c8a0,0,c0f78a40,268,0,...) at sleepq_switch+0x162 sleepq_wait(cd3f7800,5c,c0f19c62,0,0,...) at sleepq_wait+0x63 _sleep(cd3f7800,cd3f7820,25c,c0f19c62,0,...) at _sleep+0x39c md_kthread(cd3f7800,f2840d28,c0f6d310,3d8,cae05598,...) at md_kthread+0x11a fork_exit(c0778f20,cd3f7800,f2840d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf2840d60, ebp = 0 --- Tracing command sh pid 56556 tid 100342 td 0xcd9ff2e0 sched_switch(cd9ff2e0,0,104,1a3,23e3b481,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cd9ff2e0,0,c0f78a40,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a40,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cd9dd598,6c,c0f7b985,100,0,...) at sleepq_wait_sig+0x17 _sleep(cd9dd598,cd9dd620,16c,c0f7b985,0,...) at _sleep+0x385 kern_wait(cd9ff2e0,ffffffff,f2b4bc5c,2,0,...) at kern_wait+0x597 sys_wait4(cd9ff2e0,f2b4bcec,c0fc517c,c0f7b964,216,...) at sys_wait4+0x3b syscall(f2b4bd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe6ec, ebp = 0xbfbfe708 --- Tracing command sh pid 15971 tid 100159 td 0xcac35000 sched_switch(cac35000,0,104,1a3,e7a8c8ae,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(cac35000,0,c0f78a40,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a40,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb1b7864,6c,c0f7b985,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb1b7864,cb1b78ec,16c,c0f7b985,0,...) at _sleep+0x385 kern_wait(cac35000,ffffffff,f28a0c5c,2,0,...) at kern_wait+0x597 sys_wait4(cac35000,f28a0cec,c0fc517c,c0f7b964,216,...) at sys_wait4+0x3b syscall(f28a0d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe6fc, ebp = 0xbfbfe718 --- Tracing command bash pid 92846 tid 100213 td 0xcb2518a0 sched_switch(cb2518a0,0,104,1a3,aa186510,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb2518a0,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a3a,cb194e04,0,c0f712d3,cb2518a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb194e70,0,f2956aec,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cb194e70,cb194e04,c0f7d27c,527,0,...) at _cv_wait_sig+0x260 tty_wait(cb194e00,cb194e70,f2956c40,1,0,...) at tty_wait+0x71 ttydisc_read(cb194e00,f2956c40,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(ca843d00,f2956c40,0,0,1,...) at ttydev_read+0xaa devfs_read_f(cbc29e38,f2956c40,cbf27880,0,cb2518a0,...) at devfs_read_f+0x7e dofileread(f2956c40,ffffffff,ffffffff,0,f2956c1c,...) at dofileread+0x9e kern_readv(cb2518a0,0,f2956c40,f2956c60,1,...) at kern_readv+0x68 sys_read(cb2518a0,f2956cec,c0fc517c,c0f7b87a,246,...) at sys_read+0x4f syscall(f2956d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x283686e3, esp = 0xbfbfdfbc, ebp = 0xbfbfdfe8 --- Tracing command sshd pid 92845 tid 100147 td 0xcb1892e0 sched_switch(cb1892e0,0,104,1a3,aa192ab4,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb1892e0,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a3a,cbb60650,0,c0f712d3,cb1892e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cbb60664,0,f2876a54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cbb60664,cbb60650,c0f7b194,6ae,ca78f268,...) at _cv_wait_sig+0x260 seltdwait(ca78f268,58,cbf27680,cb1892e0,f2876ac8,...) at seltdwait+0xa2 kern_select(cb1892e0,c,288060b8,288060c0,0,0,20,cb1172cc,0) at kern_select+0x655 sys_select(cb1892e0,f2876cec,c0fc517c,c0f7bad9,206,...) at sys_select+0x66 syscall(f2876d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d6663, esp = 0xbfbfde2c, ebp = 0xbfbfde78 --- Tracing command sshd pid 92843 tid 100188 td 0xcaeb9000 sched_switch(caeb9000,0,104,1a3,6cd57f87,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(caeb9000,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a3a,cbe08e90,0,c0f712d3,caeb9000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cbe08ea4,0,f290aab8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cbe08ea4,cbe08e90,c0f7b194,6ae,f290ab40,...) at _cv_wait_sig+0x260 seltdwait(cab4b72c,c0f7b194,5ab,caeb9000,8,...) at seltdwait+0xa2 sys_poll(caeb9000,f290acec,c0fc517c,c0f636b1,202,...) at sys_poll+0x321 syscall(f290ad28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2846f33b, esp = 0xbfbfde8c, ebp = 0xbfbfdec8 --- Tracing command awk pid 5064 tid 100082 td 0xca7b55c0 sched_switch(ca7b55c0,0,104,1a3,10f5ce8e,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(ca7b55c0,0,c0f78a40,1a7,5c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a40,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb1aec80,5c,c0f7b3c3,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb1aec80,cb1aedf8,15c,c0f7b3c3,0,...) at _sleep+0x385 pipe_read(cbbe6b28,f270cc40,ca7c6a80,0,ca7b55c0,...) at pipe_read+0x427 dofileread(f270cc40,ffffffff,ffffffff,0,f270cc1c,...) at dofileread+0x9e kern_readv(ca7b55c0,0,f270cc40,f270cc60,1,...) at kern_readv+0x68 sys_read(ca7b55c0,f270ccec,c0fc517c,c0dda123,216,...) at sys_read+0x4f syscall(f270cd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281c86e3, esp = 0xbfbfe93c, ebp = 0xbfbfe958 --- Tracing command sh pid 5063 tid 100109 td 0xca80a5c0 sched_switch(ca80a5c0,0,104,1a3,1104db81,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(ca80a5c0,0,c0f78a40,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a40,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca8042cc,6c,c0f7b985,100,0,...) at sleepq_wait_sig+0x17 _sleep(ca8042cc,ca804354,16c,c0f7b985,0,...) at _sleep+0x385 kern_wait(ca80a5c0,ffffffff,f2782c5c,2,0,...) at kern_wait+0x597 sys_wait4(ca80a5c0,f2782cec,c0fc517c,c0f7b964,216,...) at sys_wait4+0x3b syscall(f2782d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x281765fb, esp = 0xbfbfe93c, ebp = 0xbfbfe958 --- Tracing command top pid 5048 tid 100180 td 0xcb1d32e0 sched_switch(cb1d32e0,0,104,1a3,d1b488f9,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb1d32e0,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f28f0a1c,c0a30a3a,c8027ad0,0,cb1d32e0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c8027ae4,0,f28f0a54,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c8027ae4,c8027ad0,3e9,6ae,ca7cb070,...) at _cv_timedwait_sig+0x270 seltdwait(f28f0c0c,f28f0c14,ca7c6e00,cb1d32e0,4b303248,...) at seltdwait+0x8a kern_select(cb1d32e0,2,bfbfebac,0,0,f28f0c58,20,1,0) at kern_select+0x655 sys_select(cb1d32e0,f28f0cec,c0fc517c,c0f4c3c2,246,...) at sys_select+0x66 syscall(f28f0d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281fd663, esp = 0xbfbfeb4c, ebp = 0xbfbfeca8 --- Tracing command sshd pid 5047 tid 100171 td 0xcaeba000 sched_switch(caeba000,0,104,1a3,d1b7cc77,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(caeba000,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a3a,c8027a50,0,c0f712d3,caeba000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c8027a64,0,f28d0a54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c8027a64,c8027a50,c0f7b194,6ae,ca7cb2d8,...) at _cv_wait_sig+0x260 seltdwait(ca7cb2d8,58,ca7a7c80,caeba000,f28d0ac8,...) at seltdwait+0xa2 kern_select(caeba000,a,288060b8,288060c0,0,0,20,cb1f22cc,0) at kern_select+0x655 sys_select(caeba000,f28d0cec,c0fc517c,c0f7bad9,206,...) at sys_select+0x66 syscall(f28d0d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d6663, esp = 0xbfbfde2c, ebp = 0xbfbfde78 --- Tracing command sh pid 5044 tid 100150 td 0xcb1888a0 Tracing command sshd pid 5043 tid 100258 td 0xcbb5e2e0 sched_switch(cbb5e2e0,0,104,1a3,1b2b9748,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cbb5e2e0,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a3a,ca749750,0,c0f712d3,cbb5e2e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca749764,0,f29f8a54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca749764,ca749750,c0f7b194,6ae,cb083070,...) at _cv_wait_sig+0x260 seltdwait(cb083070,58,ca7a7780,cbb5e2e0,c0cafb9e,...) at seltdwait+0xa2 kern_select(cbb5e2e0,c,288060b8,288060c0,0,0,20,cbb53000,0) at kern_select+0x655 sys_select(cbb5e2e0,f29f8cec,c0fc517c,c0f7bad9,206,...) at sys_select+0x66 syscall(f29f8d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d6663, esp = 0xbfbfde2c, ebp = 0xbfbfde78 --- Tracing command tail pid 5041 tid 100219 td 0xcb1875c0 sched_switch(cb1875c0,0,104,1a3,e738a070,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,68,...) at mi_switch+0x1ff sleepq_switch(cb1875c0,0,c0f78a40,1a7,68,...) at sleepq_switch+0x162 sleepq_catch_signals(3e8,c0a823b0,cb1875c0,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(cae85a80,68,c0f6cece,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(cae85a80,cae85a80,168,c0f6cece,3e8,...) at _sleep+0x34f kern_kevent(cb1875c0,4,0,1,f2968c40,...) at kern_kevent+0x374 sys_kevent(cb1875c0,f2968cec,c0fc517c,c0f4c3c2,286,...) at sys_kevent+0x19e syscall(f2968d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (363, FreeBSD ELF32, sys_kevent), eip = 0x2817213b, esp = 0xbfbfeb1c, ebp = 0xbfbfebd8 --- Tracing command sshd pid 5038 tid 100190 td 0xcb226b80 sched_switch(cb226b80,0,104,1a3,e71c1e16,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb226b80,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a3a,c8027750,0,c0f712d3,cb226b80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c8027764,0,f2911a54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c8027764,c8027750,c0f7b194,6ae,ca7cb000,...) at _cv_wait_sig+0x260 seltdwait(ca7cb000,58,cb283300,cb226b80,f2911ac8,...) at seltdwait+0xa2 kern_select(cb226b80,c,288060b8,288060c0,0,0,20,cb219864,0) at kern_select+0x655 sys_select(cb226b80,f2911cec,c0fc517c,c0f7bad9,206,...) at sys_select+0x66 syscall(f2911d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d6663, esp = 0xbfbfde2c, ebp = 0xbfbfde78 --- Tracing command sshd pid 4972 tid 100226 td 0xcb25fb80 sched_switch(cb25fb80,0,104,1a3,715aa906,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb25fb80,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a3a,ca74a5d0,0,c0f712d3,cb25fb80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca74a5e4,0,f2984ab8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca74a5e4,ca74a5d0,c0f7b194,6ae,f2984b40,...) at _cv_wait_sig+0x260 seltdwait(cbb9472c,c0f7b194,5ab,cb25fb80,0,...) at seltdwait+0xa2 sys_poll(cb25fb80,f2984cec,c0fc517c,c0dda123,202,...) at sys_poll+0x321 syscall(f2984d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2846f33b, esp = 0xbfbfde8c, ebp = 0xbfbfdec8 --- Tracing command sshd pid 4971 tid 100253 td 0xcb2528a0 sched_switch(cb2528a0,0,104,1a3,73601139,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb2528a0,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a3a,ca7497d0,0,c0f712d3,cb2528a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca7497e4,0,f29e9ab8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca7497e4,ca7497d0,c0f7b194,6ae,f29e9b40,...) at _cv_wait_sig+0x260 seltdwait(ca7bf12c,c0f7b194,5ab,cb2528a0,0,...) at seltdwait+0xa2 sys_poll(cb2528a0,f29e9cec,c0fc517c,c,202,...) at sys_poll+0x321 syscall(f29e9d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2846f33b, esp = 0xbfbfde8c, ebp = 0xbfbfdec8 --- Tracing command sshd pid 4970 tid 100218 td 0xcb1878a0 sched_switch(cb1878a0,0,104,1a3,725956c2,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb1878a0,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a3a,c8027090,0,c0f712d3,cb1878a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c80270a4,0,f2965ab8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c80270a4,c8027090,c0f7b194,6ae,f2965b40,...) at _cv_wait_sig+0x260 seltdwait(cbb9422c,c0f7b194,5ab,cb1878a0,0,...) at seltdwait+0xa2 sys_poll(cb1878a0,f2965cec,c0fc517c,c0dda123,202,...) at sys_poll+0x321 syscall(f2965d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2846f33b, esp = 0xbfbfde8c, ebp = 0xbfbfdec8 --- Tracing command bash pid 1298 tid 100098 td 0xca80ab80 sched_switch(ca80ab80,0,104,1a3,6706cfbc,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(ca80ab80,0,c0f78a40,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a40,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca804864,6c,c0f7b985,100,0,...) at sleepq_wait_sig+0x17 _sleep(ca804864,ca8048ec,16c,c0f7b985,0,...) at _sleep+0x385 kern_wait(ca80ab80,ffffffff,f274ec5c,6,0,...) at kern_wait+0x597 sys_wait4(ca80ab80,f274ecec,c0fc517c,c0f7b87a,216,...) at sys_wait4+0x3b syscall(f274ed28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282d55fb, esp = 0xbfbfe76c, ebp = 0xbfbfe788 --- Tracing command csh pid 1295 tid 100152 td 0xcb1882e0 Tracing command su pid 1294 tid 100132 td 0xcaebb5c0 Tracing command bash pid 1283 tid 100085 td 0xca80c000 Tracing command sshd pid 1282 tid 100105 td 0xca82d000 sched_switch(ca82d000,0,104,1a3,f113117,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca82d000,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a3a,c817de50,0,c0f712d3,ca82d000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c817de64,0,f276ba54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c817de64,c817de50,c0f7b194,6ae,ca7dd070,...) at _cv_wait_sig+0x260 seltdwait(ca7dd070,58,ca7c6b80,ca82d000,f276bac8,...) at seltdwait+0xa2 kern_select(ca82d000,c,288060b8,288060c0,0,0,20,ca826864,0) at kern_select+0x655 sys_select(ca82d000,f276bcec,c0fc517c,c0f7bad9,206,...) at sys_select+0x66 syscall(f276bd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d6663, esp = 0xbfbfde2c, ebp = 0xbfbfde78 --- Tracing command sshd pid 1280 tid 100149 td 0xcb188b80 sched_switch(cb188b80,0,104,1a3,f0709fcf,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(cb188b80,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a3a,ca74ac50,0,c0f712d3,cb188b80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca74ac64,0,f287cab8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca74ac64,ca74ac50,c0f7b194,6ae,f287cb40,...) at _cv_wait_sig+0x260 seltdwait(cad5f32c,c0f7b194,5ab,cb188b80,8,...) at seltdwait+0xa2 sys_poll(cb188b80,f287ccec,c0fc517c,c0f636b1,202,...) at sys_poll+0x321 syscall(f287cd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2846f33b, esp = 0xbfbfde8c, ebp = 0xbfbfdec8 --- Tracing command getty pid 1266 tid 100103 td 0xca82d5c0 sched_switch(ca82d5c0,0,104,1a3,2aa00dc1,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca82d5c0,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a40,160,0,ca82d5c0,ca82d5c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7ef1e70,0,c0f7d8a4,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7ef1e70,c1109710,c0f7d27c,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7ef1e00,c7ef1e70,f2763c40,1,0,...) at tty_wait+0x71 ttydisc_read(c7ef1e00,f2763c40,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c8193900,f2763c40,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca7cb6c8,f2763c40,c7dade80,0,ca82d5c0,...) at devfs_read_f+0x7e dofileread(f2763c40,ffffffff,ffffffff,0,f2763c1c,...) at dofileread+0x9e kern_readv(ca82d5c0,0,f2763c40,f2763c60,1,...) at kern_readv+0x68 sys_read(ca82d5c0,f2763cec,c0fc517c,c0ddee56,246,...) at sys_read+0x4f syscall(f2763d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a66e3, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1265 tid 100106 td 0xca82ab80 sched_switch(ca82ab80,0,104,1a3,2a816bd4,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca82ab80,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a40,160,0,ca82ab80,ca82ab80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c8191070,0,c0f7d8a4,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c8191070,c1109710,c0f7d27c,527,0,...) at _cv_wait_sig+0x260 tty_wait(c8191000,c8191070,f2770c40,1,0,...) at tty_wait+0x71 ttydisc_read(c8191000,f2770c40,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c8193a00,f2770c40,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca78e7e0,f2770c40,c7dade80,0,ca82ab80,...) at devfs_read_f+0x7e dofileread(f2770c40,ffffffff,ffffffff,0,f2770c1c,...) at dofileread+0x9e kern_readv(ca82ab80,0,f2770c40,f2770c60,1,...) at kern_readv+0x68 sys_read(ca82ab80,f2770cec,c0fc517c,c0ddee56,246,...) at sys_read+0x4f syscall(f2770d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a66e3, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1264 tid 100133 td 0xcaebb2e0 sched_switch(caebb2e0,0,104,1a3,2a959aab,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(caebb2e0,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a40,160,0,caebb2e0,caebb2e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c8191270,0,c0f7d8a4,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c8191270,c1109710,c0f7d27c,527,0,...) at _cv_wait_sig+0x260 tty_wait(c8191200,c8191270,f284cc40,1,0,...) at tty_wait+0x71 ttydisc_read(c8191200,f284cc40,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c8193b00,f284cc40,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca7dd310,f284cc40,c7dade80,0,caebb2e0,...) at devfs_read_f+0x7e dofileread(f284cc40,ffffffff,ffffffff,0,f284cc1c,...) at dofileread+0x9e kern_readv(caebb2e0,0,f284cc40,f284cc60,1,...) at kern_readv+0x68 sys_read(caebb2e0,f284ccec,c0fc517c,c0ddee56,246,...) at sys_read+0x4f syscall(f284cd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a66e3, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1263 tid 100127 td 0xca82a000 sched_switch(ca82a000,0,104,1a3,2aa2fe32,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca82a000,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a40,160,0,ca82a000,ca82a000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c8191470,0,c0f7d8a4,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c8191470,c1109710,c0f7d27c,527,0,...) at _cv_wait_sig+0x260 tty_wait(c8191400,c8191470,f283ac40,1,0,...) at tty_wait+0x71 ttydisc_read(c8191400,f283ac40,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c8193c00,f283ac40,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca78f1c0,f283ac40,c7dade80,0,ca82a000,...) at devfs_read_f+0x7e dofileread(f283ac40,ffffffff,ffffffff,0,f283ac1c,...) at dofileread+0x9e kern_readv(ca82a000,0,f283ac40,f283ac60,1,...) at kern_readv+0x68 sys_read(ca82a000,f283acec,c0fc517c,c0ddee56,246,...) at sys_read+0x4f syscall(f283ad28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a66e3, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1262 tid 100110 td 0xca80a2e0 sched_switch(ca80a2e0,0,104,1a3,2a7bfadf,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca80a2e0,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a40,160,0,ca80a2e0,ca80a2e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7ef0070,0,c0f7d8a4,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7ef0070,c1109710,c0f7d27c,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7ef0000,c7ef0070,f2787c40,1,0,...) at tty_wait+0x71 ttydisc_read(c7ef0000,f2787c40,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c806ec00,f2787c40,0,0,1,...) at ttydev_read+0xaa devfs_read_f(cae993f0,f2787c40,c7dade80,0,ca80a2e0,...) at devfs_read_f+0x7e dofileread(f2787c40,ffffffff,ffffffff,0,f2787c1c,...) at dofileread+0x9e kern_readv(ca80a2e0,0,f2787c40,f2787c60,1,...) at kern_readv+0x68 sys_read(ca80a2e0,f2787cec,c0fc517c,c0ddee56,246,...) at sys_read+0x4f syscall(f2787d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a66e3, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1261 tid 100095 td 0xca80b2e0 sched_switch(ca80b2e0,0,104,1a3,2a8eb631,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca80b2e0,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a40,160,0,ca80b2e0,ca80b2e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7ef0270,0,c0f7d8a4,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7ef0270,c1109710,c0f7d27c,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7ef0200,c7ef0270,f2740c40,1,0,...) at tty_wait+0x71 ttydisc_read(c7ef0200,f2740c40,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c806f900,f2740c40,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca78eb98,f2740c40,c7dade80,0,ca80b2e0,...) at devfs_read_f+0x7e dofileread(f2740c40,ffffffff,ffffffff,0,f2740c1c,...) at dofileread+0x9e kern_readv(ca80b2e0,0,f2740c40,f2740c60,1,...) at kern_readv+0x68 sys_read(ca80b2e0,f2740cec,c0fc517c,c0ddee56,246,...) at sys_read+0x4f syscall(f2740d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a66e3, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1260 tid 100139 td 0xca80a000 sched_switch(ca80a000,0,104,1a3,2a68d138,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca80a000,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a40,160,0,ca80a000,ca80a000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7ef0470,0,c0f7d8a4,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7ef0470,c1109710,c0f7d27c,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7ef0400,c7ef0470,f285ec40,1,0,...) at tty_wait+0x71 ttydisc_read(c7ef0400,f285ec40,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c806fa00,f285ec40,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca78e888,f285ec40,c7dade80,0,ca80a000,...) at devfs_read_f+0x7e dofileread(f285ec40,ffffffff,ffffffff,0,f285ec1c,...) at dofileread+0x9e kern_readv(ca80a000,0,f285ec40,f285ec60,1,...) at kern_readv+0x68 sys_read(ca80a000,f285ecec,c0fc517c,c0ddee56,246,...) at sys_read+0x4f syscall(f285ed28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a66e3, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1259 tid 100140 td 0xca807b80 sched_switch(ca807b80,0,104,1a3,2a917440,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca807b80,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a40,160,0,ca807b80,ca807b80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7ef0670,0,c0f7d8a4,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7ef0670,c1109710,c0f7d27c,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7ef0600,c7ef0670,f2861c40,1,0,...) at tty_wait+0x71 ttydisc_read(c7ef0600,f2861c40,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c806fb00,f2861c40,0,0,1,...) at ttydev_read+0xaa devfs_read_f(cb0831f8,f2861c40,c7dade80,0,ca807b80,...) at devfs_read_f+0x7e dofileread(f2861c40,ffffffff,ffffffff,0,f2861c1c,...) at dofileread+0x9e kern_readv(ca807b80,0,f2861c40,f2861c60,1,...) at kern_readv+0x68 sys_read(ca807b80,f2861cec,c0fc517c,c0ddee56,246,...) at sys_read+0x4f syscall(f2861d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a66e3, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command getty pid 1258 tid 100079 td 0xca6c85c0 sched_switch(ca6c85c0,0,104,1a3,86f68918,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca6c85c0,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a3a,c7ef0804,0,c0f712d3,ca6c85c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7ef0870,0,f2700aec,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7ef0870,c7ef0804,c0f7d27c,527,0,...) at _cv_wait_sig+0x260 tty_wait(c7ef0800,c7ef0870,f2700c40,1,0,...) at tty_wait+0x71 ttydisc_read(c7ef0800,f2700c40,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c7ed6d00,f2700c40,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ca78e770,f2700c40,c7dade80,0,ca6c85c0,...) at devfs_read_f+0x7e dofileread(f2700c40,ffffffff,ffffffff,0,f2700c1c,...) at dofileread+0x9e kern_readv(ca6c85c0,0,f2700c40,f2700c60,1,...) at kern_readv+0x68 sys_read(ca6c85c0,f2700cec,c0fc517c,c0ddee56,246,...) at sys_read+0x4f syscall(f2700d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281a66e3, esp = 0xbfbfed7c, ebp = 0xbfbfedb8 --- Tracing command inetd pid 1241 tid 100116 td 0xca6c7000 sched_switch(ca6c7000,0,104,1a3,1a987a68,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca6c7000,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a3a,ca7490d0,0,c0f712d3,ca6c7000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca7490e4,0,f27d1a54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca7490e4,ca7490d0,c0f7b194,6ae,cae99c08,...) at _cv_wait_sig+0x260 seltdwait(cae99c08,58,c7dade80,ca6c7000,e3,...) at seltdwait+0xa2 kern_select(ca6c7000,8,bfbfdfa0,0,0,0,20,cac30598,4) at kern_select+0x655 sys_select(ca6c7000,f27d1cec,c0fc517c,c0f7b9d1,202,...) at sys_select+0x66 syscall(f27d1d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281b8663, esp = 0xbfbfdf5c, ebp = 0xbfbfede8 --- Tracing command watchdogd pid 1216 tid 100097 td 0xca6c82e0 sched_switch(ca6c82e0,0,104,1a3,737a4a48,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(ca6c82e0,0,c0f78a40,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(ea61,c0a823b0,ca6c82e0,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c110b9a4,6c,c0f74597,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c110b9a4,0,16c,c0f74597,ea61,...) at _sleep+0x34f kern_nanosleep(ca6c82e0,f274ac4c,f274ac54,3c,0,...) at kern_nanosleep+0xc1 sys_nanosleep(ca6c82e0,f274acec,c0fc517c,c0ddee56,206,...) at sys_nanosleep+0x6f syscall(f274ad28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2819e223, esp = 0xbfbfecbc, ebp = 0xbfbfece8 --- Tracing command cron pid 1157 tid 100083 td 0xca7b52e0 sched_switch(ca7b52e0,0,104,1a3,f6e3ab38,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(ca7b52e0,0,c0f78a40,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(ea61,c0a823b0,ca7b52e0,3,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c110b9a4,6c,c0f74597,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c110b9a4,0,16c,c0f74597,ea61,...) at _sleep+0x34f kern_nanosleep(ca7b52e0,f2710c4c,f2710c54,3c,0,...) at kern_nanosleep+0xc1 sys_nanosleep(ca7b52e0,f2710cec,c0fc517c,c0f7be32,206,...) at sys_nanosleep+0x6f syscall(f2710d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28190223, esp = 0xbfbfec4c, ebp = 0xbfbfec78 --- Tracing command sendmail pid 1152 tid 100107 td 0xca82a8a0 sched_switch(ca82a8a0,0,104,1a3,8582bf51,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,74,...) at mi_switch+0x1ff sleepq_switch(ca82a8a0,0,c0f78a40,1a7,74,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a40,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca826324,74,c0e00bae,100,0,...) at sleepq_wait_sig+0x17 _sleep(ca826324,ca826354,174,c0e00bae,0,...) at _sleep+0x385 kern_sigsuspend(ca82a8a0,0,0,0,0,...) at kern_sigsuspend+0xba sys_sigsuspend(ca82a8a0,f2774cec,c0fc517c,c0f7b87a,202,...) at sys_sigsuspend+0x4d syscall(f2774d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x28349e5b, esp = 0xbfbfcf9c, ebp = 0xbfbfcfc8 --- Tracing command sendmail pid 1149 tid 100091 td 0xca7b45c0 sched_switch(ca7b45c0,0,104,1a3,2dd47700,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca7b45c0,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f2730a1c,c0a30a3a,ca717950,0,ca7b45c0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca717964,0,f2730a54,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca717964,ca717950,1389,6ae,ca7dd0a8,...) at _cv_timedwait_sig+0x270 seltdwait(f2730c0c,f2730c14,ca7a7400,ca7b45c0,c0a2d27d,...) at seltdwait+0x8a kern_select(ca7b45c0,5,bfbfc510,0,0,f2730c58,20,5,0) at kern_select+0x655 sys_select(ca7b45c0,f2730cec,c0fc517c,c0f7bd91,206,...) at sys_select+0x66 syscall(f2730d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x283f4663, esp = 0xbfbfc47c, ebp = 0xbfbfcfa8 --- Tracing command sshd pid 1146 tid 100137 td 0xcaeba5c0 sched_switch(caeba5c0,0,104,1a3,6b8fc9e6,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(caeba5c0,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a3a,ca717750,0,c0f712d3,caeba5c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca717764,0,f2858a54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca717764,ca717750,c0f7b194,6ae,cae99070,...) at _cv_wait_sig+0x260 seltdwait(cae99070,58,c7fc3e00,caeba5c0,c0cafb9e,...) at seltdwait+0xa2 kern_select(caeba5c0,9,2880c0b8,0,0,0,20,cac31b30,a) at kern_select+0x655 sys_select(caeba5c0,f2858cec,c0fc517c,c,206,...) at sys_select+0x66 syscall(f2858d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284d6663, esp = 0xbfbfdeec, ebp = 0xbfbfedf8 --- Tracing command moused pid 1115 tid 100093 td 0xca82e5c0 sched_switch(ca82e5c0,0,104,1a3,eb389484,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca82e5c0,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a3a,ca6aaad0,0,c0f712d3,ca82e5c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6aaae4,0,f2738a54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca6aaae4,ca6aaad0,c0f7b194,6ae,ca78f0a8,...) at _cv_wait_sig+0x260 seltdwait(ca78f0a8,58,c7dade80,ca82e5c0,f6,...) at seltdwait+0xa2 kern_select(ca82e5c0,400,bfbfea04,0,0,0,20,ca829000,1) at kern_select+0x655 sys_select(ca82e5c0,f2738cec,c0fc517c,c0ddee56,246,...) at sys_select+0x66 syscall(f2738d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281c5663, esp = 0xbfbfe99c, ebp = 0xbfbfeb28 --- Tracing command ntpd pid 1095 tid 100108 td 0xca82a5c0 sched_switch(ca82a5c0,0,104,1a3,1336085c,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca82a5c0,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a3a,ca74ad50,0,c0f712d3,ca82a5c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca74ad64,0,f277aa54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca74ad64,ca74ad50,c0f7b194,6ae,ca819118,...) at _cv_wait_sig+0x260 seltdwait(ca819118,58,c7dade80,ca82a5c0,0,...) at seltdwait+0xa2 kern_select(ca82a5c0,1c,bfbfece8,0,0,0,20,ca826000,0) at kern_select+0x655 sys_select(ca82a5c0,f277acec,c0fc517c,c0f7c218,202,...) at sys_select+0x66 syscall(f277ad28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28373663, esp = 0xbfbfecbc, ebp = 0xbfbfed88 --- Tracing command nfsd pid 1040 tid 100126 td 0xca7b18a0 sched_switch(ca7b18a0,0,104,1a3,28068bc4,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca7b18a0,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f2837be0,c0a30a3a,c7fbfa80,0,ca7b18a0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c7fbee50,0,f2837c18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7fbee50,c7fbfa80,1388,3b1,0,...) at _cv_timedwait_sig+0x270 svc_run_internal(f2837d14,c0a133f8,c7fbfa80,f2837d28,c0f6d310,...) at svc_run_internal+0x356 svc_thread_start(c7fbfa80,f2837d28,c0f6d310,3d8,ca7af864,...) at svc_thread_start+0x10 fork_exit(c0c338c0,c7fbfa80,f2837d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1040 tid 100125 td 0xca7b1b80 sched_switch(ca7b1b80,0,104,1a3,a5733282,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca7b1b80,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f2834be0,c0a30a3a,c7fbfa80,0,ca7b1b80,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c7fbee90,0,f2834c18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7fbee90,c7fbfa80,1388,3b1,0,...) at _cv_timedwait_sig+0x270 svc_run_internal(f2834d14,c0a133f8,c7fbfa80,f2834d28,c0f6d310,...) at svc_run_internal+0x356 svc_thread_start(c7fbfa80,f2834d28,c0f6d310,3d8,ca7af864,...) at svc_thread_start+0x10 fork_exit(c0c338c0,c7fbfa80,f2834d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1040 tid 100124 td 0xca7b4000 sched_switch(ca7b4000,0,104,1a3,99a6f10d,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca7b4000,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f2831be0,c0a30a3a,c7fbfa80,0,ca7b4000,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(cab06010,0,f2831c18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(cab06010,c7fbfa80,1388,3b1,0,...) at _cv_timedwait_sig+0x270 svc_run_internal(f2831d14,c0a133f8,c7fbfa80,f2831d28,c0f6d310,...) at svc_run_internal+0x356 svc_thread_start(c7fbfa80,f2831d28,c0f6d310,3d8,ca7af864,...) at svc_thread_start+0x10 fork_exit(c0c338c0,c7fbfa80,f2831d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1040 tid 100081 td 0xca7b58a0 sched_switch(ca7b58a0,0,104,1a3,1ecc9478,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca7b58a0,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f2708494,c0a30a3a,c7fbfa80,0,ca7b58a0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(cae0b150,0,f27084cc,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(cae0b150,c7fbfa80,1388,3b1,f2708514,...) at _cv_timedwait_sig+0x270 svc_run_internal(ca7b5a50,14,c0fa27fa,c0f64bbb,f270880c,...) at svc_run_internal+0x356 svc_run(c7fbfa80,0,c0f64b96,19f,c0f7af1a,...) at svc_run+0x7b nfsrvd_nfsd(ca7b58a0,f270880c,c,c1127fd8,246,...) at nfsrvd_nfsd+0x1c3 nfssvc_nfsd(ca7b58a0,f2708cec,bfbfe870,ca7b58a0,f2708d1c,...) at nfssvc_nfsd+0x177 sys_nfssvc(ca7b58a0,f2708cec,c0fc517c,c0f7bd91,206,...) at sys_nfssvc+0xeb syscall(f2708d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280e8a9b, esp = 0xbfbfe82c, ebp = 0xbfbfea98 --- Tracing command nfsd pid 1035 tid 100118 td 0xc817e8a0 sched_switch(c817e8a0,0,104,1a3,10335113,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c817e8a0,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a3a,ca717710,0,c0f712d3,c817e8a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca717724,0,f27d7a54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca717724,ca717710,c0f7b194,6ae,ca78f460,...) at _cv_wait_sig+0x260 seltdwait(ca78f460,58,c7dade80,c817e8a0,c0cafb9e,...) at seltdwait+0xa2 kern_select(c817e8a0,7,bfbfecb4,0,0,0,20,cac30000,1) at kern_select+0x655 sys_select(c817e8a0,f27d7cec,c0fc517c,c,202,...) at sys_select+0x66 syscall(f27d7d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28192663, esp = 0xbfbfea9c, ebp = 0xbfbfede8 --- Tracing command nfsuserd pid 1033 tid 100123 td 0xca82a2e0 sched_switch(ca82a2e0,0,104,1a3,c6b80d37,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca82a2e0,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f282ea1c,c0a30a3a,ca717510,0,ca82a2e0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca717524,0,f282ea54,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca717524,ca717510,7531,6ae,ca78fc40,...) at _cv_timedwait_sig+0x270 seltdwait(f282ec0c,f282ec14,c7dade80,ca82a2e0,f282eb14,...) at seltdwait+0x8a kern_select(ca82a2e0,4,bfbfebc4,0,0,f282ec58,20,1e,0) at kern_select+0x655 sys_select(ca82a2e0,f282ecec,c0fc517c,c0f7bac2,202,...) at sys_select+0x66 syscall(f282ed28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28191663, esp = 0xbfbfeb1c, ebp = 0xbfbfec58 --- Tracing command nfsuserd pid 1032 tid 100119 td 0xc817e5c0 sched_switch(c817e5c0,0,104,1a3,1a52aa97,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c817e5c0,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f27daa1c,c0a30a3a,ca7492d0,0,c817e5c0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca7492e4,0,f27daa54,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca7492e4,ca7492d0,7531,6ae,ca78fc40,...) at _cv_timedwait_sig+0x270 seltdwait(f27dac0c,f27dac14,c7dade80,c817e5c0,f27dab14,...) at seltdwait+0x8a kern_select(c817e5c0,4,bfbfebc4,0,0,f27dac58,20,1e,0) at kern_select+0x655 sys_select(c817e5c0,f27dacec,c0fc517c,c0f7bac2,202,...) at sys_select+0x66 syscall(f27dad28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28191663, esp = 0xbfbfeb1c, ebp = 0xbfbfec58 --- Tracing command nfsuserd pid 1031 tid 100100 td 0xca82e000 sched_switch(ca82e000,0,104,1a3,c51c0e70,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca82e000,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f2757a1c,c0a30a3a,ca717410,0,ca82e000,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca717424,0,f2757a54,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca717424,ca717410,7531,6ae,ca78fc40,...) at _cv_timedwait_sig+0x270 seltdwait(f2757c0c,f2757c14,c7dade80,ca82e000,c0cafb9e,...) at seltdwait+0x8a kern_select(ca82e000,4,bfbfebc4,0,0,f2757c58,20,1e,0) at kern_select+0x655 sys_select(ca82e000,f2757cec,c0fc517c,c0f7bac2,202,...) at sys_select+0x66 syscall(f2757d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28191663, esp = 0xbfbfeb1c, ebp = 0xbfbfec58 --- Tracing command nfsuserd pid 1030 tid 100090 td 0xca80b5c0 sched_switch(ca80b5c0,0,104,1a3,ac073623,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca80b5c0,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f272ca1c,c0a30a3a,ca749310,0,ca80b5c0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca749324,0,f272ca54,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca749324,ca749310,7531,6ae,ca78fc40,...) at _cv_timedwait_sig+0x270 seltdwait(f272cc0c,f272cc14,c7dade80,ca80b5c0,c0cafb9e,...) at seltdwait+0x8a kern_select(ca80b5c0,4,bfbfebc4,0,0,f272cc58,20,1e,0) at kern_select+0x655 sys_select(ca80b5c0,f272ccec,c0fc517c,c0f7bac2,202,...) at sys_select+0x66 syscall(f272cd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28191663, esp = 0xbfbfeb1c, ebp = 0xbfbfec58 --- Tracing command nfsuserd pid 1029 tid 100111 td 0xca6c8000 Tracing command mountd pid 1013 tid 100113 td 0xca6c78a0 sched_switch(ca6c78a0,0,104,1a3,7b11772,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca6c78a0,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a3a,ca6aab10,0,c0f712d3,ca6c78a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca6aab24,0,f27c8a54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca6aab24,ca6aab10,c0f7b194,6ae,ca78e460,...) at _cv_wait_sig+0x260 seltdwait(ca78e460,58,c7dade80,ca6c78a0,47d,...) at seltdwait+0xa2 kern_select(ca6c78a0,9,bfbfed04,0,0,0,20,cac31000,bfbfed04) at kern_select+0x655 sys_select(ca6c78a0,f27c8cec,c0fc517c,c0f62917,206,...) at sys_select+0x66 syscall(f27c8d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281aa663, esp = 0xbfbfec9c, ebp = 0xbfbfede8 --- Tracing command rpcbind pid 980 tid 100101 td 0xca82db80 sched_switch(ca82db80,0,104,1a3,f64287d0,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca82db80,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(f275ba80,c0a30a3a,ca7173d0,0,ca82db80,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ca7173e4,0,f275bab8,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ca7173e4,ca7173d0,7531,6ae,f275bb70,...) at _cv_timedwait_sig+0x270 seltdwait(f275bc40,f275bc48,5ab,ca82db80,f,...) at seltdwait+0x8a sys_poll(ca82db80,f275bcec,c0fc517c,c0f7bac2,212,...) at sys_poll+0x321 syscall(f275bd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2814a33b, esp = 0xbfbfcbac, ebp = 0xbfbfed78 --- Tracing command syslogd pid 961 tid 100086 td 0xca7b4b80 sched_switch(ca7b4b80,0,104,1a3,f959df63,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca7b4b80,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a3a,ca717290,0,c0f712d3,ca7b4b80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca7172a4,0,f271ca54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca7172a4,ca717290,c0f7b194,6ae,ca78f818,...) at _cv_wait_sig+0x260 seltdwait(ca78f818,58,c7dade80,ca7b4b80,58,...) at seltdwait+0xa2 kern_select(ca7b4b80,9,2847f0ac,0,0,0,20,ca6c0b30,0) at kern_select+0x655 sys_select(ca7b4b80,f271ccec,c0fc517c,c0fa7ffe,246,...) at sys_select+0x66 syscall(f271cd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a9663, esp = 0xbfbfe29c, ebp = 0xbfbfede8 --- Tracing command devd pid 838 tid 100114 td 0xca6c75c0 sched_switch(ca6c75c0,0,104,1a3,72976db,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(ca6c75c0,0,c0f78a40,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0a30a3a,ca773450,0,c0f712d3,ca6c75c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca773464,0,f27cba54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca773464,ca773450,c0f7b194,6ae,ca78f5e8,...) at _cv_wait_sig+0x260 seltdwait(ca78f5e8,58,c7dade80,ca6c75c0,c1254948,...) at seltdwait+0xa2 kern_select(ca6c75c0,5,bfbfe960,0,0,0,20,cac30b30,46) at kern_select+0x655 sys_select(ca6c75c0,f27cbcec,c0fc517c,c0dda123,206,...) at sys_select+0x66 syscall(f27cbd28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x809169b, esp = 0xbfbfe92c, ebp = 0xbfbfee08 --- Tracing command softdepflush pid 19 tid 100077 td 0xca6c8b80 sched_switch(ca6c8b80,0,104,1a3,f340a695,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,54,...) at mi_switch+0x1ff sleepq_switch(ca6c8b80,0,c0f78a40,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1287e80,54,c0fa986f,0,0,...) at sleepq_timedwait+0x6b _sleep(c1287e80,c1287e40,54,c0fa986f,3e8,...) at _sleep+0x36a softdep_flush(0,ee321d28,c0f6d310,3d8,ca6be000,...) at softdep_flush+0x266 fork_exit(c0c83450,0,ee321d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee321d60, ebp = 0 --- Tracing command syncer pid 18 tid 100076 td 0xc80578a0 sched_switch(c80578a0,0,104,1a3,d7049772,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80578a0,0,c0f78a40,28b,c80578a0,...) at sleepq_switch+0x162 sleepq_timedwait(c1281b74,0,ee31ec78,1,0,...) at sleepq_timedwait+0x6b _cv_timedwait(c1281b74,c1281b60,3e8,78b,4e20,...) at _cv_timedwait+0x270 sched_sync(0,ee31ed28,c0f6d310,3d8,ca6be2cc,...) at sched_sync+0x595 fork_exit(c0ae2c90,0,ee31ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee31ed60, ebp = 0 --- Tracing command vnlru pid 17 tid 100075 td 0xc8057b80 sched_switch(c8057b80,0,104,1a3,e0ed50e,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,60,...) at mi_switch+0x1ff sleepq_switch(c8057b80,0,c0f78a40,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(ca6be598,60,c0f83ada,0,0,...) at sleepq_timedwait+0x6b _sleep(ca6be598,c1281b34,260,c0f83ada,3e8,...) at _sleep+0x36a vnlru_proc(0,ee31bd28,c0f6d310,3d8,ca6be598,...) at vnlru_proc+0xe7 fork_exit(c0ae3920,0,ee31bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee31bd60, ebp = 0 --- Tracing command bufdaemon pid 16 tid 100074 td 0xc817b000 sched_switch(c817b000,0,104,1a3,f9ac2730,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,54,...) at mi_switch+0x1ff sleepq_switch(c817b000,0,c0f78a40,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1281808,54,c0f809b2,0,0,...) at sleepq_timedwait+0x6b _sleep(c1281808,c1281810,54,c0f809b2,3e8,...) at _sleep+0x36a buf_daemon(0,ee318d28,c0f6d310,3d8,ca6be864,...) at buf_daemon+0x175 fork_exit(c0ac7190,0,ee318d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee318d60, ebp = 0 --- Tracing command pagezero pid 9 tid 100073 td 0xc817b2e0 sched_switch(c817b2e0,0,104,1a3,288b64ba,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c817b2e0,0,c0f78a40,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1289d5c,0,c0fb0966,0,0,...) at sleepq_timedwait+0x6b _sleep(c1289d5c,c1288800,0,c0fb0966,493e0,...) at _sleep+0x36a vm_pagezero(0,ee315d28,c0f6d310,3d8,ca6beb30,...) at vm_pagezero+0xdc fork_exit(c0cca2e0,0,ee315d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee315d60, ebp = 0 --- Tracing command vmdaemon pid 8 tid 100072 td 0xc817b5c0 sched_switch(c817b5c0,0,104,1a3,608f5964,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,74,...) at mi_switch+0x1ff sleepq_switch(c817b5c0,0,c0f78a40,268,0,...) at sleepq_switch+0x162 sleepq_wait(c1289948,74,c0f809b2,0,0,...) at sleepq_wait+0x63 _sleep(c1289948,c128994c,74,c0f809b2,0,...) at _sleep+0x39c vm_daemon(0,ee312d28,c0f6d310,3d8,ca6c0000,...) at vm_daemon+0x59 fork_exit(c0cc3c30,0,ee312d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee312d60, ebp = 0 --- Tracing command pagedaemon pid 7 tid 100071 td 0xc817b8a0 sched_switch(c817b8a0,0,104,1a3,c85aa392,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,54,...) at mi_switch+0x1ff sleepq_switch(c817b8a0,0,c0f78a40,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1289910,54,c0f809b2,0,0,...) at sleepq_timedwait+0x6b _sleep(c1289910,c1288800,54,c0f809b2,1388,...) at _sleep+0x36a vm_pageout(0,ee30fd28,c0f6d310,3d8,c7dd02cc,...) at vm_pageout+0x2c7 fork_exit(c0cc4cb0,0,ee30fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee30fd60, ebp = 0 --- Tracing command xpt_thrd pid 6 tid 100070 td 0xc817bb80 sched_switch(c817bb80,0,104,1a3,d466272d,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c817bb80,0,c0f78a40,268,0,...) at sleepq_switch+0x162 sleepq_wait(c10ce954,5c,c0dd4927,0,0,...) at sleepq_wait+0x63 _sleep(c10ce954,c10ce998,5c,c0dd4927,0,...) at _sleep+0x39c xpt_scanner_thread(0,ee18cd28,c0f6d310,3d8,c7dd0598,...) at xpt_scanner_thread+0x47 fork_exit(c049e260,0,ee18cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee18cd60, ebp = 0 --- Tracing command sctp_iterator pid 5 tid 100069 td 0xc817c000 sched_switch(c817c000,0,104,1a3,2408cd76,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c817c000,0,c0f78a40,268,0,...) at sleepq_switch+0x162 sleepq_wait(c1283698,0,c0f9763f,0,0,...) at sleepq_wait+0x63 _sleep(c1283698,c1283660,0,c0f9763f,0,...) at _sleep+0x39c sctp_iterator_thread(0,ee189d28,c0f6d310,3d8,c7dd0864,...) at sctp_iterator_thread+0x5c fork_exit(c0b75a20,0,ee189d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee189d60, ebp = 0 --- Tracing command ctl_thrd pid 4 tid 100067 td 0xc817c5c0 sched_switch(c817c5c0,0,104,1a3,c21d22a1,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c817c5c0,0,c0f78a40,268,0,...) at sleepq_switch+0x162 sleepq_wait(c8196000,5c,c0ddf332,0,0,...) at sleepq_wait+0x63 _sleep(c8196000,c8196000,5c,c0ddf332,0,...) at _sleep+0x39c ctl_work_thread(c8196000,ee183d28,c0f6d310,3d8,c7dd0b30,...) at ctl_work_thread+0x22f6 fork_exit(c04c7700,c8196000,ee183d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee183d60, ebp = 0 --- Tracing command fdc0 pid 3 tid 100064 td 0xc817e000 sched_switch(c817e000,0,104,1a3,e71c19be,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c817e000,0,c0f78a40,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c7f7723c,5c,c0f65632,0,0,...) at sleepq_timedwait+0x6b _sleep(c7f7723c,c7f772f0,5c,c0f65632,3e8,...) at _sleep+0x36a fdc_thread(c7f77200,ee17ad28,c0f6d310,3d8,c803b000,...) at fdc_thread+0x27d fork_exit(c0d4c560,c7f77200,ee17ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee17ad60, ebp = 0 --- Tracing command fw0_probe pid 2 tid 100062 td 0xc80495c0 sched_switch(c80495c0,0,104,1a3,d46663e9,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(c80495c0,0,c0f78a40,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a40,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c8085000,6c,c0f65632,100,0,...) at sleepq_wait_sig+0x17 _sleep(c8085000,c8089488,16c,c0f65632,0,...) at _sleep+0x385 fw_bus_probe_thread(c8085000,ee16ad28,c0f6d310,3d8,c803b2cc,...) at fw_bus_probe_thread+0xa08 fork_exit(c06f72d0,c8085000,ee16ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee16ad60, ebp = 0 --- Tracing command usb pid 15 tid 100058 td 0xc80552e0 sched_switch(c80552e0,0,104,1a3,c218425f,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80552e0,0,c0f78a40,268,c80552e0,...) at sleepq_switch+0x162 sleepq_wait(c805cd34,0,ee153cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c805cd34,c805ce4c,c0f56cb1,74,c805cd3c,...) at _cv_wait+0x260 usb_process(c805cd2c,ee153d28,c0f6d310,3d8,c803b598,...) at usb_process+0x1a3 fork_exit(c091cfd0,c805cd2c,ee153d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee153d60, ebp = 0 --- Tracing command usb pid 15 tid 100057 td 0xc80555c0 sched_switch(c80555c0,0,104,1a3,3805a97d,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80555c0,0,c0f78a40,268,c80555c0,...) at sleepq_switch+0x162 sleepq_wait(c805cd04,0,ee150cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c805cd04,c805ce4c,c0f56cb1,74,c805cd0c,...) at _cv_wait+0x260 usb_process(c805ccfc,ee150d28,c0f6d310,3d8,c803b598,...) at usb_process+0x1a3 fork_exit(c091cfd0,c805ccfc,ee150d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee150d60, ebp = 0 --- Tracing command usb pid 15 tid 100056 td 0xc80558a0 sched_switch(c80558a0,0,104,1a3,c1b20797,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80558a0,0,c0f78a40,268,c80558a0,...) at sleepq_switch+0x162 sleepq_wait(c805ccd4,0,ee14dcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c805ccd4,c805ce4c,c0f56cb1,74,c805ccdc,...) at _cv_wait+0x260 usb_process(c805cccc,ee14dd28,c0f6d310,3d8,c803b598,...) at usb_process+0x1a3 fork_exit(c091cfd0,c805cccc,ee14dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee14dd60, ebp = 0 --- Tracing command usb pid 15 tid 100055 td 0xc8055b80 sched_switch(c8055b80,0,104,1a3,c1b1f646,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8055b80,0,c0f78a40,268,c8055b80,...) at sleepq_switch+0x162 sleepq_wait(c805cca4,0,ee14acac,1,0,...) at sleepq_wait+0x63 _cv_wait(c805cca4,c805ce4c,c0f56cb1,74,c805ccac,...) at _cv_wait+0x260 usb_process(c805cc9c,ee14ad28,c0f6d310,3d8,c803b598,...) at usb_process+0x1a3 fork_exit(c091cfd0,c805cc9c,ee14ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee14ad60, ebp = 0 --- Tracing command usb pid 15 tid 100053 td 0xc80572e0 sched_switch(c80572e0,0,104,1a3,c1b1e30b,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80572e0,0,c0f78a40,268,c80572e0,...) at sleepq_switch+0x162 sleepq_wait(c804fb5c,0,ee141cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c804fb5c,c804fc74,c0f56cb1,74,c804fb64,...) at _cv_wait+0x260 usb_process(c804fb54,ee141d28,c0f6d310,3d8,c803b598,...) at usb_process+0x1a3 fork_exit(c091cfd0,c804fb54,ee141d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee141d60, ebp = 0 --- Tracing command usb pid 15 tid 100052 td 0xc80575c0 sched_switch(c80575c0,0,104,1a3,3804a2e2,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80575c0,0,c0f78a40,268,c80575c0,...) at sleepq_switch+0x162 sleepq_wait(c804fb2c,0,ee13ecac,1,0,...) at sleepq_wait+0x63 _cv_wait(c804fb2c,c804fc74,c0f56cb1,74,c804fb34,...) at _cv_wait+0x260 usb_process(c804fb24,ee13ed28,c0f6d310,3d8,c803b598,...) at usb_process+0x1a3 fork_exit(c091cfd0,c804fb24,ee13ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee13ed60, ebp = 0 --- Tracing command usb pid 15 tid 100051 td 0xc8047000 sched_switch(c8047000,0,104,1a3,c14de1d3,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8047000,0,c0f78a40,268,c8047000,...) at sleepq_switch+0x162 sleepq_wait(c804fafc,0,ee13bcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c804fafc,c804fc74,c0f56cb1,74,c804fb04,...) at _cv_wait+0x260 usb_process(c804faf4,ee13bd28,c0f6d310,3d8,c803b598,...) at usb_process+0x1a3 fork_exit(c091cfd0,c804faf4,ee13bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee13bd60, ebp = 0 --- Tracing command usb pid 15 tid 100050 td 0xc80472e0 sched_switch(c80472e0,0,104,1a3,c14dd183,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80472e0,0,c0f78a40,268,c80472e0,...) at sleepq_switch+0x162 sleepq_wait(c804facc,0,ee138cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c804facc,c804fc74,c0f56cb1,74,c804fad4,...) at _cv_wait+0x260 usb_process(c804fac4,ee138d28,c0f6d310,3d8,c803b598,...) at usb_process+0x1a3 fork_exit(c091cfd0,c804fac4,ee138d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee138d60, ebp = 0 --- Tracing command usb pid 15 tid 100049 td 0xc80475c0 sched_switch(c80475c0,0,104,1a3,c14db9c9,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80475c0,0,c0f78a40,268,c80475c0,...) at sleepq_switch+0x162 sleepq_wait(c804bb5c,0,ee134cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c804bb5c,c804bc74,c0f56cb1,74,c804bb64,...) at _cv_wait+0x260 usb_process(c804bb54,ee134d28,c0f6d310,3d8,c803b598,...) at usb_process+0x1a3 fork_exit(c091cfd0,c804bb54,ee134d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee134d60, ebp = 0 --- Tracing command usb pid 15 tid 100048 td 0xc80478a0 sched_switch(c80478a0,0,104,1a3,380470a2,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80478a0,0,c0f78a40,268,c80478a0,...) at sleepq_switch+0x162 sleepq_wait(c804bb2c,0,ee131cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c804bb2c,c804bc74,c0f56cb1,74,c804bb34,...) at _cv_wait+0x260 usb_process(c804bb24,ee131d28,c0f6d310,3d8,c803b598,...) at usb_process+0x1a3 fork_exit(c091cfd0,c804bb24,ee131d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee131d60, ebp = 0 --- Tracing command usb pid 15 tid 100047 td 0xc8047b80 sched_switch(c8047b80,0,104,1a3,bb8d5c6e,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8047b80,0,c0f78a40,268,c8047b80,...) at sleepq_switch+0x162 sleepq_wait(c804bafc,0,ee12ecac,1,0,...) at sleepq_wait+0x63 _cv_wait(c804bafc,c804bc74,c0f56cb1,74,c804bb04,...) at _cv_wait+0x260 usb_process(c804baf4,ee12ed28,c0f6d310,3d8,c803b598,...) at usb_process+0x1a3 fork_exit(c091cfd0,c804baf4,ee12ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee12ed60, ebp = 0 --- Tracing command usb pid 15 tid 100046 td 0xc8048000 sched_switch(c8048000,0,104,1a3,bb8d4b25,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8048000,0,c0f78a40,268,c8048000,...) at sleepq_switch+0x162 sleepq_wait(c804bacc,0,ee12bcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c804bacc,c804bc74,c0f56cb1,74,c804bad4,...) at _cv_wait+0x260 usb_process(c804bac4,ee12bd28,c0f6d310,3d8,c803b598,...) at usb_process+0x1a3 fork_exit(c091cfd0,c804bac4,ee12bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee12bd60, ebp = 0 --- Tracing command usb pid 15 tid 100045 td 0xc80482e0 sched_switch(c80482e0,0,104,1a3,bb8d3712,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80482e0,0,c0f78a40,268,c80482e0,...) at sleepq_switch+0x162 sleepq_wait(c8043b5c,0,ee127cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8043b5c,c8043c74,c0f56cb1,74,c8043b64,...) at _cv_wait+0x260 usb_process(c8043b54,ee127d28,c0f6d310,3d8,c803b598,...) at usb_process+0x1a3 fork_exit(c091cfd0,c8043b54,ee127d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee127d60, ebp = 0 --- Tracing command usb pid 15 tid 100044 td 0xc80485c0 sched_switch(c80485c0,0,104,1a3,3804278a,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80485c0,0,c0f78a40,268,c80485c0,...) at sleepq_switch+0x162 sleepq_wait(c8043b2c,0,ee124cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8043b2c,c8043c74,c0f56cb1,74,c8043b34,...) at _cv_wait+0x260 usb_process(c8043b24,ee124d28,c0f6d310,3d8,c803b598,...) at usb_process+0x1a3 fork_exit(c091cfd0,c8043b24,ee124d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee124d60, ebp = 0 --- Tracing command usb pid 15 tid 100043 td 0xc80488a0 sched_switch(c80488a0,0,104,1a3,bb29bcf0,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80488a0,0,c0f78a40,268,c80488a0,...) at sleepq_switch+0x162 sleepq_wait(c8043afc,0,ee121cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8043afc,c8043c74,c0f56cb1,74,c8043b04,...) at _cv_wait+0x260 usb_process(c8043af4,ee121d28,c0f6d310,3d8,c803b598,...) at usb_process+0x1a3 fork_exit(c091cfd0,c8043af4,ee121d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee121d60, ebp = 0 --- Tracing command usb pid 15 tid 100042 td 0xc8048b80 sched_switch(c8048b80,0,104,1a3,bb29ab4a,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8048b80,0,c0f78a40,268,c8048b80,...) at sleepq_switch+0x162 sleepq_wait(c8043acc,0,ee11ecac,1,0,...) at sleepq_wait+0x63 _cv_wait(c8043acc,c8043c74,c0f56cb1,74,c8043ad4,...) at _cv_wait+0x260 usb_process(c8043ac4,ee11ed28,c0f6d310,3d8,c803b598,...) at usb_process+0x1a3 fork_exit(c091cfd0,c8043ac4,ee11ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee11ed60, ebp = 0 --- Tracing command usb pid 15 tid 100040 td 0xc8033000 sched_switch(c8033000,0,104,1a3,bb29968e,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8033000,0,c0f78a40,268,c8033000,...) at sleepq_switch+0x162 sleepq_wait(c803eb5c,0,ee117cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c803eb5c,c803ec74,c0f56cb1,74,c803eb64,...) at _cv_wait+0x260 usb_process(c803eb54,ee117d28,c0f6d310,3d8,c803b598,...) at usb_process+0x1a3 fork_exit(c091cfd0,c803eb54,ee117d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee117d60, ebp = 0 --- Tracing command usb pid 15 tid 100039 td 0xc80332e0 sched_switch(c80332e0,0,104,1a3,3803d6cf,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80332e0,0,c0f78a40,268,c80332e0,...) at sleepq_switch+0x162 sleepq_wait(c803eb2c,0,ee114cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c803eb2c,c803ec74,c0f56cb1,74,c803eb34,...) at _cv_wait+0x260 usb_process(c803eb24,ee114d28,c0f6d310,3d8,c803b598,...) at usb_process+0x1a3 fork_exit(c091cfd0,c803eb24,ee114d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee114d60, ebp = 0 --- Tracing command usb pid 15 tid 100038 td 0xc80335c0 sched_switch(c80335c0,0,104,1a3,bac5cfe9,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80335c0,0,c0f78a40,268,c80335c0,...) at sleepq_switch+0x162 sleepq_wait(c803eafc,0,ee111cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c803eafc,c803ec74,c0f56cb1,74,c803eb04,...) at _cv_wait+0x260 usb_process(c803eaf4,ee111d28,c0f6d310,3d8,c803b598,...) at usb_process+0x1a3 fork_exit(c091cfd0,c803eaf4,ee111d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee111d60, ebp = 0 --- Tracing command usb pid 15 tid 100037 td 0xc80338a0 sched_switch(c80338a0,0,104,1a3,bac5bf55,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80338a0,0,c0f78a40,268,c80338a0,...) at sleepq_switch+0x162 sleepq_wait(c803eacc,0,ee10ecac,1,0,...) at sleepq_wait+0x63 _cv_wait(c803eacc,c803ec74,c0f56cb1,74,c803ead4,...) at _cv_wait+0x260 usb_process(c803eac4,ee10ed28,c0f6d310,3d8,c803b598,...) at usb_process+0x1a3 fork_exit(c091cfd0,c803eac4,ee10ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee10ed60, ebp = 0 --- Tracing command usb pid 15 tid 100035 td 0xc8036000 sched_switch(c8036000,0,104,1a3,bac5ab1b,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c8036000,0,c0f78a40,268,c8036000,...) at sleepq_switch+0x162 sleepq_wait(c802fb5c,0,ee107cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c802fb5c,c802fc74,c0f56cb1,74,c802fb64,...) at _cv_wait+0x260 usb_process(c802fb54,ee107d28,c0f6d310,3d8,c803b598,...) at usb_process+0x1a3 fork_exit(c091cfd0,c802fb54,ee107d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee107d60, ebp = 0 --- Tracing command usb pid 15 tid 100034 td 0xc80362e0 sched_switch(c80362e0,0,104,1a3,3803aaa8,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80362e0,0,c0f78a40,268,c80362e0,...) at sleepq_switch+0x162 sleepq_wait(c802fb2c,0,ee104cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c802fb2c,c802fc74,c0f56cb1,74,c802fb34,...) at _cv_wait+0x260 usb_process(c802fb24,ee104d28,c0f6d310,3d8,c803b598,...) at usb_process+0x1a3 fork_exit(c091cfd0,c802fb24,ee104d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee104d60, ebp = 0 --- Tracing command usb pid 15 tid 100033 td 0xc80365c0 sched_switch(c80365c0,0,104,1a3,ba61c2e8,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80365c0,0,c0f78a40,268,c80365c0,...) at sleepq_switch+0x162 sleepq_wait(c802fafc,0,ee101cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c802fafc,c802fc74,c0f56cb1,74,c802fb04,...) at _cv_wait+0x260 usb_process(c802faf4,ee101d28,c0f6d310,3d8,c803b598,...) at usb_process+0x1a3 fork_exit(c091cfd0,c802faf4,ee101d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee101d60, ebp = 0 --- Tracing command usb pid 15 tid 100032 td 0xc80368a0 sched_switch(c80368a0,0,104,1a3,ba61b11b,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80368a0,0,c0f78a40,268,c80368a0,...) at sleepq_switch+0x162 sleepq_wait(c802facc,0,ee0fecac,1,0,...) at sleepq_wait+0x63 _cv_wait(c802facc,c802fc74,c0f56cb1,74,c802fad4,...) at _cv_wait+0x260 usb_process(c802fac4,ee0fed28,c0f6d310,3d8,c803b598,...) at usb_process+0x1a3 fork_exit(c091cfd0,c802fac4,ee0fed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee0fed60, ebp = 0 --- Tracing command yarrow pid 14 tid 100017 td 0xc7ed85c0 sched_switch(c7ed85c0,0,104,1a3,2760f6e7,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7ed85c0,0,c0f78a40,28b,2,...) at sleepq_switch+0x162 sleepq_timedwait(c110a7a4,0,c0f65632,2,0,...) at sleepq_timedwait+0x6b _sleep(c110a7a4,0,0,c0f65632,64) at _sleep+0x36a pause(c0f65632,64,c0f32d50,111,0,...) at pause+0xa0 random_kthread(0,c7b52d28,c0f6d310,3d8,c7dcf000,...) at random_kthread+0x1ef fork_exit(c081ad90,0,c7b52d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b52d60, ebp = 0 --- Tracing command geom pid 13 tid 100016 td 0xc7ed88a0 sched_switch(c7ed88a0,0,104,1a3,2d5e93e6,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c7ed88a0,0,c0f78a40,268,0,...) at sleepq_switch+0x162 sleepq_wait(c11079e8,5c,c0f65632,0,0,...) at sleepq_wait+0x63 _sleep(c11079e8,c1107948,25c,c0f65632,0,...) at _sleep+0x39c g_io_schedule_down(c7ed88a0,0,c0f67181,6c,c7b4ed14,...) at g_io_schedule_down+0x5b g_down_procbody(0,c7b4ed28,c0f6d310,3d8,c7dcf2cc,...) at g_down_procbody+0x9d fork_exit(c09d3e60,0,c7b4ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b4ed60, ebp = 0 --- Tracing command geom pid 13 tid 100015 td 0xc7ed8b80 sched_switch(c7ed8b80,0,104,1a3,2d662a4c,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c7ed8b80,0,c0f78a40,268,0,...) at sleepq_switch+0x162 sleepq_wait(c11079e4,5c,c0f65632,0,0,...) at sleepq_wait+0x63 _sleep(c11079e4,c1107968,25c,c0f65632,0,...) at _sleep+0x39c g_io_schedule_up(c7ed8b80,0,c0f67181,5f,c7b4bd14,...) at g_io_schedule_up+0x134 g_up_procbody(0,c7b4bd28,c0f6d310,3d8,c7dcf2cc,...) at g_up_procbody+0x9d fork_exit(c09d3f00,0,c7b4bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b4bd60, ebp = 0 --- Tracing command geom pid 13 tid 100014 td 0xc7ed9000 sched_switch(c7ed9000,0,104,1a3,72870cf,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,5c,...) at mi_switch+0x1ff sleepq_switch(c7ed9000,0,c0f78a40,268,0,...) at sleepq_switch+0x162 sleepq_wait(c11079dc,5c,c0f65632,0,0,...) at sleepq_wait+0x63 _sleep(c11079dc,c110790c,25c,c0f65632,0,...) at _sleep+0x39c g_run_events(c1118600,0,c0f67181,79,c7b48d14,...) at g_run_events+0x54b g_event_procbody(0,c7b48d28,c0f6d310,3d8,c7dcf2cc,...) at g_event_procbody+0x90 fork_exit(c09d3fa0,0,c7b48d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b48d60, ebp = 0 --- Tracing command intr pid 12 tid 100078 td 0xca6c88a0 sched_switch(ca6c88a0,0,109,1a3,76986eda,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d633,557,ca6c88a0,...) at mi_switch+0x1ff ithread_loop(c7e12550,ee324d28,c0f6d310,3d8,c7dcf598,...) at ithread_loop+0x1fb fork_exit(c0a16f00,c7e12550,ee324d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee324d60, ebp = 0 --- Tracing command intr pid 12 tid 100066 td 0xc817c8a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100065 td 0xc817cb80 sched_switch(c817cb80,0,109,1a3,ba5e90a0,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d633,557,c817cb80,...) at mi_switch+0x1ff ithread_loop(c7e12690,ee17dd28,c0f6d310,3d8,c7dcf598,...) at ithread_loop+0x1fb fork_exit(c0a16f00,c7e12690,ee17dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee17dd60, ebp = 0 --- Tracing command intr pid 12 tid 100063 td 0xc80492e0 sched_switch(c80492e0,0,109,1a3,86f660a9,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d633,557,c80492e0,...) at mi_switch+0x1ff ithread_loop(c7e126a0,ee16dd28,c0f6d310,3d8,c7dcf598,...) at ithread_loop+0x1fb fork_exit(c0a16f00,c7e126a0,ee16dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee16dd60, ebp = 0 --- Tracing command intr pid 12 tid 100060 td 0xc8049b80 sched_switch(c8049b80,0,109,1a3,aacad94e,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d633,557,c8049b80,...) at mi_switch+0x1ff ithread_loop(c7e126c0,ee161d28,c0f6d310,3d8,c7dcf598,...) at ithread_loop+0x1fb fork_exit(c0a16f00,c7e126c0,ee161d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee161d60, ebp = 0 --- Tracing command intr pid 12 tid 100059 td 0xc8055000 sched_switch(c8055000,0,109,1a3,676f09b3,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d633,557,c8055000,...) at mi_switch+0x1ff ithread_loop(c7e126d0,ee159d28,c0f6d310,3d8,c7dcf598,...) at ithread_loop+0x1fb fork_exit(c0a16f00,c7e126d0,ee159d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee159d60, ebp = 0 --- Tracing command intr pid 12 tid 100054 td 0xc8057000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xc8049000 sched_switch(c8049000,0,109,1a3,def48592,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d633,557,c8049000,...) at mi_switch+0x1ff ithread_loop(c7e126f0,ee11bd28,c0f6d310,3d8,c7dcf598,...) at ithread_loop+0x1fb fork_exit(c0a16f00,c7e126f0,ee11bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee11bd60, ebp = 0 --- Tracing command intr pid 12 tid 100036 td 0xc8033b80 sched_switch(c8033b80,0,109,1a3,d9e96d79,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d633,557,c8033b80,...) at mi_switch+0x1ff ithread_loop(c7e12700,ee10bd28,c0f6d310,3d8,c7dcf598,...) at ithread_loop+0x1fb fork_exit(c0a16f00,c7e12700,ee10bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee10bd60, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xc8036b80 sched_switch(c8036b80,0,109,1a3,8234d95,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d633,557,c8036b80,...) at mi_switch+0x1ff ithread_loop(c7e12710,ee0fbd28,c0f6d310,3d8,c7dcf598,...) at ithread_loop+0x1fb fork_exit(c0a16f00,c7e12710,ee0fbd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee0fbd60, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc7ed92e0 sched_switch(c7ed92e0,0,109,1a3,2d64de3b,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d633,557,c7ed92e0,...) at mi_switch+0x1ff ithread_loop(c7e12720,edfa5d28,c0f6d310,3d8,c7dcf598,...) at ithread_loop+0x1fb fork_exit(c0a16f00,c7e12720,edfa5d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xedfa5d60, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc7ed95c0 sched_switch(c7ed95c0,0,109,1a3,f1968d1,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d633,557,c7ed95c0,...) at mi_switch+0x1ff ithread_loop(c7e12730,edfa1d28,c0f6d310,3d8,c7dcf598,...) at ithread_loop+0x1fb fork_exit(c0a16f00,c7e12730,edfa1d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xedfa1d60, ebp = 0 --- Tracing command intr pid 12 tid 100028 td 0xc7ed98a0 sched_switch(c7ed98a0,0,109,1a3,ac9fc072,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d633,557,c7ed98a0,...) at mi_switch+0x1ff ithread_loop(c7e12750,c7ba1d28,c0f6d310,3d8,c7dcf598,...) at ithread_loop+0x1fb fork_exit(c0a16f00,c7e12750,c7ba1d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7ba1d60, ebp = 0 --- Tracing command intr pid 12 tid 100027 td 0xc7ed9b80 sched_switch(c7ed9b80,0,109,1a3,fa92f7e7,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d633,557,c7ed9b80,...) at mi_switch+0x1ff ithread_loop(c7e12760,c7b70d28,c0f6d310,3d8,c7dcf598,...) at ithread_loop+0x1fb fork_exit(c0a16f00,c7e12760,c7b70d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b70d60, ebp = 0 --- Tracing command intr pid 12 tid 100026 td 0xc7fc4000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100024 td 0xc7fc45c0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100018 td 0xc7ed82e0 sched_switch(c7ed82e0,0,109,1a3,2d652438,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d633,557,c7ed82e0,...) at mi_switch+0x1ff ithread_loop(c7e12790,c7b55d28,c0f6d310,3d8,c7dcf598,...) at ithread_loop+0x1fb fork_exit(c0a16f00,c7e12790,c7b55d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b55d60, ebp = 0 --- Tracing command intr pid 12 tid 100012 td 0xc7dd25c0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100011 td 0xc7dd28a0 sched_switch(c7dd28a0,0,109,1a3,8ecefecd,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d633,557,c7dd28a0,...) at mi_switch+0x1ff ithread_loop(c7e127b0,c7b3fd28,c0f6d310,3d8,c7dcf598,...) at ithread_loop+0x1fb fork_exit(c0a16f00,c7e127b0,c7b3fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b3fd60, ebp = 0 --- Tracing command intr pid 12 tid 100010 td 0xc7dd2b80 sched_switch(c7dd2b80,0,109,1a3,2428a831,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d633,557,c7dd2b80,...) at mi_switch+0x1ff ithread_loop(c7e127c0,c7b3cd28,c0f6d310,3d8,c7dcf598,...) at ithread_loop+0x1fb fork_exit(c0a16f00,c7e127c0,c7b3cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b3cd60, ebp = 0 --- Tracing command intr pid 12 tid 100009 td 0xc7e13000 sched_switch(c7e13000,0,109,1a3,1ca5c48b,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d633,557,c7e13000,...) at mi_switch+0x1ff ithread_loop(c7e127d0,c7b39d28,c0f6d310,3d8,c7dcf598,...) at ithread_loop+0x1fb fork_exit(c0a16f00,c7e127d0,c7b39d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b39d60, ebp = 0 --- Tracing command intr pid 12 tid 100008 td 0xc7e132e0 sched_switch(c7e132e0,0,109,1a3,e0e9811,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d633,557,c7e132e0,...) at mi_switch+0x1ff ithread_loop(c7e127e0,c7b36d28,c0f6d310,3d8,c7dcf598,...) at ithread_loop+0x1fb fork_exit(c0a16f00,c7e127e0,c7b36d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b36d60, ebp = 0 --- Tracing command intr pid 12 tid 100007 td 0xc7e135c0 sched_switch(c7e135c0,0,109,1a3,2cd92ef7,...) at sched_switch+0x3fc mi_switch(109,0,c0f6d633,557,c7e135c0,...) at mi_switch+0x1ff ithread_loop(c7e127f0,c7b33d28,c0f6d310,3d8,c7dcf598,...) at ithread_loop+0x1fb fork_exit(c0a16f00,c7e127f0,c7b33d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b33d60, ebp = 0 --- Tracing command idle pid 11 tid 100006 td 0xc7dd1000 sched_switch(c7dd1000,0,108,19e,2d662280,...) at sched_switch+0x3fc mi_switch(108,0,c0f75102,a19,c7dd1000,...) at mi_switch+0x1ff sched_idletd(0,c7b2fd28,c0f6d310,3d8,c7dcf864,...) at sched_idletd+0x28f fork_exit(c0a68ae0,0,c7b2fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b2fd60, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc7dd12e0 cpustop_handler(2,c7b2cbfc,c0daafb6,c7b2cba0,c0dc569e,...) at cpustop_handler+0x26 ipi_nmi_handler(c7b2cba0,c0dc569e,c110ba80,c7dd12e0,c7dcf864,...) at ipi_nmi_handler+0x35 trap(c7b2cc08) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0d90805, esp = 0xc7b2cc48, ebp = 0xc7b2cc48 --- acpi_cpu_c1(c7b2cc64,c10cef30,2,317,3bcc,...) at acpi_cpu_c1+0x5 acpi_cpu_idle(0,c7b2cc98,c0d9da19,0,2,...) at acpi_cpu_idle+0x122 cpu_idle_acpi(0,2,0,2,c7b2cce8,...) at cpu_idle_acpi+0x2f cpu_idle(0,c7b2ccc0,c0f75102,a1b,c7dd12e0,...) at cpu_idle+0x89 sched_idletd(0,c7b2cd28,c0f6d310,3d8,c7dcf864,...) at sched_idletd+0x235 fork_exit(c0a68ae0,0,c7b2cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b2cd60, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc7dd15c0 cpustop_handler(1,c7b29c30,c0daafb6,0,c7b29bf8,...) at cpustop_handler+0x26 ipi_nmi_handler(0,c7b29bf8,1ec6ea6,c0d9acad,c7dcf864,...) at ipi_nmi_handler+0x35 trap(c7b29c3c) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0d9acad, esp = 0xc7b29c7c, ebp = 0xc7b29c80 --- cpu_idle_mwait(1,2710,c1118c80,2,c7b29ce8,...) at cpu_idle_mwait+0x4d cpu_idle(1,c7b29cc0,c0f75102,a1b,c7dd15c0,...) at cpu_idle+0x30 sched_idletd(0,c7b29d28,c0f6d310,3d8,c7dcf864,...) at sched_idletd+0x235 fork_exit(c0a68ae0,0,c7b29d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b29d60, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xc7dd18a0 cpustop_handler(0,c7b26c30,c0daafb6,4,c0f712d3,...) at cpustop_handler+0x26 ipi_nmi_handler(4,c0f712d3,119,c7dd18a0,c7dcf864,...) at ipi_nmi_handler+0x35 trap(c7b26c3c) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0d9acad, esp = 0xc7b26c7c, ebp = 0xc7b26c80 --- cpu_idle_mwait(1,2710,c1118600,2,c7b26ce8,...) at cpu_idle_mwait+0x4d cpu_idle(1,c7b26cc0,c0f75102,a1b,c7dd18a0,...) at cpu_idle+0x30 sched_idletd(0,c7b26d28,c0f6d310,3d8,c7dcf864,...) at sched_idletd+0x235 fork_exit(c0a68ae0,0,c7b26d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b26d60, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc7dd1b80 sched_switch(c7dd1b80,0,104,1a3,d0994f8e,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,6c,...) at mi_switch+0x1ff sleepq_switch(c7dd1b80,0,c0f78a40,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0f78a40,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7dcfb30,6c,c0f7b985,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7dcfb30,c7dcfbb8,16c,c0f7b985,0,...) at _sleep+0x385 kern_wait(c7dd1b80,ffffffff,c7b22c5c,0,0,...) at kern_wait+0x597 sys_wait4(c7dd1b80,c7b22cec,c0fc517c,c0f7b7c2,286,...) at sys_wait4+0x3b syscall(c7b22d28) at syscall+0x2c3 Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x80601ff, esp = 0xbfbfe8bc, ebp = 0xbfbfe8d8 --- Tracing command audit pid 10 tid 100001 td 0xc7dd2000 sched_switch(c7dd2000,0,104,1a3,ba5ff1dd,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7dd2000,0,c0f78a40,268,c7dd2000,...) at sleepq_switch+0x162 sleepq_wait(c12875c0,0,c7b1fc8c,1,0,...) at sleepq_wait+0x63 _cv_wait(c12875c0,c12875a4,c0fa4277,194,0,...) at _cv_wait+0x260 audit_worker(0,c7b1fd28,c0f6d310,3d8,c7dd0000,...) at audit_worker+0x84 fork_exit(c0c43c00,0,c7b1fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b1fd60, ebp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xc817c2e0 sched_switch(c817c2e0,0,104,1a3,fd386739,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c817c2e0,0,c0f78a40,28b,2,...) at sleepq_switch+0x162 sleepq_timedwait(c110a7a4,0,c0f65632,2,0,...) at sleepq_timedwait+0x6b _sleep(c110a7a4,0,0,c0f65632,bb8) at _sleep+0x36a pause(c0f65632,bb8,126,124,c1107b88,...) at pause+0xa0 deadlkres(0,ee186d28,c0f6d310,3d8,c1107b00,...) at deadlkres+0x324 fork_exit(c09f62b0,0,ee186d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee186d60, ebp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xc80498a0 sched_switch(c80498a0,0,104,1a3,25c545ef,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c80498a0,0,c0f78a40,268,c80498a0,...) at sleepq_switch+0x162 sleepq_wait(c8084400,0,c0f73da1,c0f65632,0,...) at sleepq_wait+0x63 msleep_spin(c8084400,c8084418,c0f65632,0,c0f712d3,...) at msleep_spin+0x259 taskqueue_thread_loop(c808949c,ee167d28,c0f6d310,3d8,c1107b00,...) at taskqueue_thread_loop+0x8f fork_exit(c0a85a30,c808949c,ee167d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee167d60, ebp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xc7fc42e0 sched_switch(c7fc42e0,0,104,1a3,5e2f5cdb,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7fc42e0,0,c0f78a40,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7d9f700,0,c0f65632,0,0,...) at sleepq_wait+0x63 _sleep(c7d9f700,c7d9f718,0,c0f65632,0,...) at _sleep+0x39c taskqueue_thread_loop(c112736c,c7b6ad28,c0f6d310,3d8,c1107b00,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a85a30,c112736c,c7b6ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b6ad60, ebp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xc7fc48a0 sched_switch(c7fc48a0,0,104,1a3,a20d5976,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7fc48a0,0,c0f78a40,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7d9f780,0,c0f65632,0,0,...) at sleepq_wait+0x63 _sleep(c7d9f780,c7d9f798,0,c0f65632,0,...) at _sleep+0x39c taskqueue_thread_loop(c1287ba4,c7b64d28,c0f6d310,3d8,c1107b00,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a85a30,c1287ba4,c7b64d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b64d60, ebp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xc7fc4b80 sched_switch(c7fc4b80,0,104,1a3,d46a2ee1,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7fc4b80,0,c0f78a40,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7d9f7c0,0,c0f65632,0,0,...) at sleepq_wait+0x63 _sleep(c7d9f7c0,c7d9f7d8,0,c0f65632,0,...) at _sleep+0x39c taskqueue_thread_loop(c1108498,c7b61d28,c0f6d310,3d8,c1107b00,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a85a30,c1108498,c7b61d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b61d60, ebp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xc7e138a0 sched_switch(c7e138a0,0,104,1a3,d46a1c1e,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7e138a0,0,c0f78a40,268,c7e138a0,...) at sleepq_switch+0x162 sleepq_wait(c7d9f800,0,c0f73da1,c0f65632,0,...) at sleepq_wait+0x63 msleep_spin(c7d9f800,c7d9f818,c0f65632,0,c0f712d3,...) at msleep_spin+0x259 taskqueue_thread_loop(c10d1bb8,c7b5ed28,c0f6d310,3d8,c1107b00,...) at taskqueue_thread_loop+0x8f fork_exit(c0a85a30,c10d1bb8,c7b5ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b5ed60, ebp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xc7e13b80 sched_switch(c7e13b80,0,104,1a3,d46a0d24,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7e13b80,0,c0f78a40,268,c7e13b80,...) at sleepq_switch+0x162 sleepq_wait(c7d9f800,0,c0f73da1,c0f65632,0,...) at sleepq_wait+0x63 msleep_spin(c7d9f800,c7d9f818,c0f65632,0,c0f712d3,...) at msleep_spin+0x259 taskqueue_thread_loop(c10d1bb8,c7b5bd28,c0f6d310,3d8,c1107b00,...) at taskqueue_thread_loop+0x8f fork_exit(c0a85a30,c10d1bb8,c7b5bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b5bd60, ebp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xc7ed8000 sched_switch(c7ed8000,0,104,1a3,d469fb76,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7ed8000,0,c0f78a40,268,c7ed8000,...) at sleepq_switch+0x162 sleepq_wait(c7d9f800,0,c0f73da1,c0f65632,0,...) at sleepq_wait+0x63 msleep_spin(c7d9f800,c7d9f818,c0f65632,0,c0f712d3,...) at msleep_spin+0x259 taskqueue_thread_loop(c10d1bb8,c7b58d28,c0f6d310,3d8,c1107b00,...) at taskqueue_thread_loop+0x8f fork_exit(c0a85a30,c10d1bb8,c7b58d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b58d60, ebp = 0 --- Tracing command kernel pid 0 tid 100013 td 0xc7dd22e0 sched_switch(c7dd22e0,0,104,1a3,986608b3,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,0,...) at mi_switch+0x1ff sleepq_switch(c7dd22e0,0,c0f78a40,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7d9fc00,0,c0f65632,0,0,...) at sleepq_wait+0x63 _sleep(c7d9fc00,c7d9fc18,0,c0f65632,0,...) at _sleep+0x39c taskqueue_thread_loop(c1125d80,c7b45d28,c0f6d310,3d8,c1107b00,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a85a30,c1125d80,c7b45d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b45d60, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc1107dd0 sched_switch(c1107dd0,0,104,1a3,9b7ac2a3,...) at sched_switch+0x3fc mi_switch(104,0,c0f78a40,1f3,54,...) at mi_switch+0x1ff sleepq_switch(c1107dd0,0,c0f78a40,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1107b00,54,c0f759d5,0,0,...) at sleepq_timedwait+0x6b _sleep(c1107b00,0,54,c0f759d5,2710,...) at _sleep+0x36a scheduler(0,181ec00,181ec00,181e000,1825000,...) at scheduler+0x240 mi_startup() at mi_startup+0xac begin() at begin+0x2c db:0:allt> call doadump Physical memory: 3435 MB Dumping 448 MB: 433 417 401 385 369 353 337 321 305 289 273 257 241 225 209 193 177 161 145 129 113 97 81 65 49 33 17 1 Dump complete = 0 db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 3 (kgdb) bt #0 doadump (textdump=0xf2846550) at pcpu.h:244 #1 0xc0512339 in db_fncall (dummy1=0xc0a771fa, dummy2=0x0, dummy3=0xffffffff, dummy4=0xf28465e4 "¿e\204¿") at ../../../ddb/db_command.c:573 #2 0xc051276f in db_command (last_cmdp=0xc10cfd7c, cmd_table=0x0, dopager=0x0) at ../../../ddb/db_command.c:449 #3 0xc0512824 in db_command_script (command=0xc10d0c88 "call doadump") at ../../../ddb/db_command.c:520 #4 0xc0516c10 in db_script_exec (scriptname=0xc10d05e0 "doadump", warnifnotfound=Variable "warnifnotfound" is not available. ) at ../../../ddb/db_script.c:302 #5 0xc0516ca1 in db_run_cmd (addr=0x1, have_addr=0x0, count=0xc12a92c0, modif=0xf284671c "") at ../../../ddb/db_script.c:375 #6 0xc0512731 in db_command (last_cmdp=0xc10cfd7c, cmd_table=0x0, dopager=0x1) at ../../../ddb/db_command.c:449 #7 0xc051288a in db_command_loop () at ../../../ddb/db_command.c:502 #8 0xc051487d in db_trap (type=0x3, code=0x0) at ../../../ddb/db_main.c:229 #9 0xc0a77696 in kdb_trap (type=0x3, code=0x0, tf=0xf28468cc) at ../../../kern/subr_kdb.c:629 #10 0xc0dab5cb in trap (frame=0xf28468cc) at ../../../i386/i386/trap.c:711 #11 0xc0d94eac in calltrap () at ../../../i386/i386/exception.s:169 #12 0xc0a771fa in kdb_enter (why=0xc0f73030 "panic", msg=0xc0f73030 "panic") at cpufunc.h:71 #13 0xc0a41d8c in panic (fmt=0xc0f6fa44 "%s: recursing on non recursive lockmgr %s @ %s:%d\n") at ../../../kern/kern_shutdown.c:633 #14 0xc0a28605 in __lockmgr_args (lk=0xd15205c8, flags=Variable "flags" is not available. ) at ../../../kern/kern_lock.c:741 #15 0xc0acdbd5 in vop_stdlock (ap=0xf2846a38) at lockmgr.h:97 #16 0xc0dcf8f5 in VOP_LOCK1_APV (vop=0xc10aa940, a=0xf2846a38) at vnode_if.c:1988 #17 0xc0aefe98 in _vn_lock (vp=0xd1520570, flags=0x80400, file=0xc0fa732f "../../../ufs/ffs/ffs_softdep.c", line=0x733) at vnode_if.h:859 #18 0xc0c83272 in softdep_flushworklist (oldmnt=0xcbbcdb40, countp=0xf2846ac0, td=0xca80c2e0) at ../../../ufs/ffs/ffs_softdep.c:1843 #19 0xc0ace1db in vop_stdfsync (ap=0xf2846b4c) at ../../../kern/vfs_default.c:691 #20 0xc0953c6c in devfs_fsync (ap=0xf2846b4c) at ../../../fs/devfs/devfs_vnops.c:646 #21 0xc0dccf55 in VOP_FSYNC_APV (vop=0xc1091a00, a=0xf2846b4c) at vnode_if.c:1267 #22 0xc0c88600 in ffs_sync (mp=0xcbbcdb40, waitfor=0x1) at vnode_if.h:549 #23 0xc0ad89f8 in dounmount (mp=0xcbbcdb40, flags=0x8080000, td=0xca80c2e0) at ../../../kern/vfs_mount.c:1326 #24 0xc0ad90e1 in sys_unmount (td=0xca80c2e0, uap=0xf2846cec) at ../../../kern/vfs_mount.c:1226 #25 0xc0daab23 in syscall (frame=0xf2846d28) at subr_syscall.c:135 #26 0xc0d94f11 in Xint0x80_syscall () at ../../../i386/i386/exception.s:267 #27 0x00000033 in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb) f 18 #18 0xc0c83272 in softdep_flushworklist (oldmnt=0xcbbcdb40, countp=0xf2846ac0, td=0xca80c2e0) at ../../../ufs/ffs/ffs_softdep.c:1843 1843 vn_lock(devvp, LK_EXCLUSIVE | LK_RETRY); (kgdb) l 1838 */ 1839 ump = VFSTOUFS(oldmnt); 1840 devvp = ump->um_devvp; 1841 while ((count = softdep_process_worklist(oldmnt, 1)) > 0) { 1842 *countp += count; 1843 vn_lock(devvp, LK_EXCLUSIVE | LK_RETRY); 1844 error = VOP_FSYNC(devvp, MNT_WAIT, td); 1845 VOP_UNLOCK(devvp, 0); 1846 if (error) 1847 break; (kgdb) info loc devvp = (struct vnode *) 0xd1520570 count = Variable "count" is not available. (kgdb) p *devvp $1 = {v_type = VCHR, v_tag = 0xc0f6e1d4 "devfs", v_op = 0xc1091a00, v_data = 0xd4b05780, v_mount = 0xca759000, v_nmntvnodes = {tqe_next = 0x0, tqe_prev = 0xd22b1428}, v_un = { vu_mount = 0xca845500, vu_socket = 0xca845500, vu_cdev = 0xca845500, vu_fifoinfo = 0xca845500}, v_hashlist = {le_next = 0x0, le_prev = 0x0}, v_hash = 0x0, v_cache_src = {lh_first = 0x0}, v_cache_dst = {tqh_first = 0x0, tqh_last = 0xd15205a0}, v_cache_dd = 0x0, v_cstart = 0x0, v_lasta = 0x0, v_lastw = 0x0, v_clen = 0x0, v_lock = {lock_object = {lo_name = 0xc0f6e1d4 "devfs", lo_flags = 0x5730000, lo_data = 0x0, lo_witness = 0xc7d72408}, lk_lock = 0xca80c2e0, lk_exslpfail = 0x0, lk_timo = 0x33, lk_pri = 0x60, lk_stack = {depth = 0x9, pcs = {0xc0a28a3e, 0xc0acdbd5, 0xc0dcf8f5, 0xc0aefe98, 0xc0c885d8, 0xc0ad89f8, 0xc0ad90e1, 0xc0daab23, 0xc0d94f11, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}}}, v_interlock = {lock_object = { lo_name = 0xc0f7acf8 "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc7d6b1e0}, mtx_lock = 0x4}, v_vnlock = 0xd15205c8, v_holdcnt = 0x16, v_usecount = 0x1, v_iflag = 0x0, v_vflag = 0x0, v_writecount = 0x0, v_freelist = {tqe_next = 0x0, tqe_prev = 0xd03c0e88}, v_bufobj = {bo_mtx = {lock_object = {lo_name = 0xc0f83aaf "bufobj interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc7d70ba8}, mtx_lock = 0x4}, bo_clean = {bv_hd = {tqh_first = 0xe1a07460, tqh_last = 0xe197d298}, bv_root = 0xe1ba5720, bv_cnt = 0xd}, bo_dirty = {bv_hd = {tqh_first = 0xe192ed80, tqh_last = 0xe18fa258}, bv_root = 0xe1a18a40, bv_cnt = 0x7}, bo_numoutput = 0x0, bo_flag = 0x1, bo_ops = 0xc10bbdf4, bo_bsize = 0x200, bo_object = 0xcd44ede0, bo_synclist = {le_next = 0xca473e90, le_prev = 0xc7dcddd0}, bo_private = 0xd0aef300, __bo_vnode = 0xd1520570}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0} (kgdb) $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/ufs/ffs/ffs_softdep.c =================================================================== --- /usr/src/sys/ufs/ffs/ffs_softdep.c (revision 233734) +++ /usr/src/sys/ufs/ffs/ffs_softdep.c (working copy) @@ -1821,13 +1821,21 @@ softdep_flushworklist(oldmnt, countp, td) int count, error = 0; struct ufsmount *ump; + *countp = 0; + if (!MOUNTEDSOFTDEP(oldmnt)) + return (0); /* + * We set TDP_SOFTDEP to avoid recursively processing the worklist. + */ + if (td->td_pflags & TDP_SOFTDEP) + return (0); + td->td_pflags |= TDP_SOFTDEP; + /* * Alternately flush the block device associated with the mount * point and process any dependencies that the flushing * creates. We continue until no more worklist dependencies * are found. */ - *countp = 0; ump = VFSTOUFS(oldmnt); devvp = ump->um_devvp; while ((count = softdep_process_worklist(oldmnt, 1)) > 0) { @@ -1838,6 +1846,7 @@ softdep_flushworklist(oldmnt, countp, td) if (error) break; } + td->td_pflags &= ~TDP_SOFTDEP; return (error); } Index: /usr/src/sys/ufs/ffs/ffs_vfsops.c =================================================================== --- /usr/src/sys/ufs/ffs/ffs_vfsops.c (revision 233734) +++ /usr/src/sys/ufs/ffs/ffs_vfsops.c (working copy) @@ -409,6 +409,10 @@ ffs_mount(struct mount *mp) } if (devvp->v_type == VCHR && devvp->v_rdev != NULL) devvp->v_rdev->si_mountpt = mp; + else + printf("mount1 %s: %s has NULL v_rdev\n", + mp->mnt_stat.f_mntonname, + mp->mnt_stat.f_mntfromname); if (fs->fs_snapinum[0] != 0) ffs_snapshot_mount(mp); vn_finished_write(mp); @@ -1054,6 +1058,10 @@ ffs_mountfs(devvp, mp, td) } if (devvp->v_type == VCHR && devvp->v_rdev != NULL) devvp->v_rdev->si_mountpt = mp; + else + printf("mount2 %s: %s has NULL v_rdev\n", + mp->mnt_stat.f_mntonname, + mp->mnt_stat.f_mntfromname); if (fs->fs_snapinum[0] != 0) ffs_snapshot_mount(mp); fs->fs_fmod = 1; @@ -1301,6 +1309,9 @@ ffs_unmount(mp, mntflags) PICKUP_GIANT(); if (ump->um_devvp->v_type == VCHR && ump->um_devvp->v_rdev != NULL) ump->um_devvp->v_rdev->si_mountpt = NULL; + else + printf("unmount %s: %s has NULL v_rdev\n", + mp->mnt_stat.f_mntonname, mp->mnt_stat.f_mntfromname); vrele(ump->um_devvp); dev_rel(ump->um_dev); mtx_destroy(UFS_MTX(ump)); Index: /usr/src/sys/kern/vfs_default.c =================================================================== --- /usr/src/sys/kern/vfs_default.c (revision 233734) +++ /usr/src/sys/kern/vfs_default.c (working copy) @@ -611,6 +611,8 @@ vop_stdbmap(ap) return (0); } +int softdep_flushworklist(struct mount *, int *, struct thread *); + int vop_stdfsync(ap) struct vop_fsync_args /* { @@ -624,12 +626,13 @@ vop_stdfsync(ap) struct buf *bp; struct bufobj *bo; struct buf *nbp; - int error = 0; + struct mount *mp; + int count, error = 0; int maxretry = 1000; /* large, arbitrarily chosen */ bo = &vp->v_bufobj; +loop1: BO_LOCK(bo); -loop1: /* * MARK/SCAN initialization to avoid infinite loops. */ @@ -681,8 +684,14 @@ loop2: TAILQ_FOREACH(bp, &bo->bo_dirty.bv_hd, b_bobufs) if ((error = bp->b_error) == 0) continue; - if (error == 0 && --maxretry >= 0) + if (error == 0 && --maxretry >= 0) { + BO_UNLOCK(bo); + if (vp->v_type == VCHR && vp->v_rdev != NULL && + (mp = vp->v_rdev->si_mountpt) != NULL) + softdep_flushworklist(mp, &count, + ap->a_td); goto loop1; + } error = EAGAIN; } } -- Test scenario: ffs_blkfree.sh