GENERIC HEAD from 2013-09-10 05:49:31 UTC, r255441, vmcore.695 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb 4718592K of memory above 4GB ignored Copyright (c) 1992-2013 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #1 r255441: Tue Sep 10 11:45:55 CEST 2013 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 FreeBSD clang version 3.3 (tags/RELEASE_33/final 183502) 20130610 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.01-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 0x10 Model = 0x2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 8589934592 (8192 MB) avail memory = 3536498688 (3372 MB) : Trying to mount root from ufs:/dev/ad4s1a [rw]... Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/ad4s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1a: clean, 590250 free (3506 frags, 73343 blocks, 0.3% fragmentation) /dev/ad4s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1f: clean, 615514 free (8506 frags, 75876 blocks, 0.8% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 94397111 free (14799 frags, 11797789 blocks, 0.0% fragmentation) /dev/ad4s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1d: clean, 3757323 free (212779 frags, 443068 blocks, 2.1% fragmentation) /dev/ad4s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1e: clean, 12064204 free (90428 frags, 1496722 blocks, 0.4% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN Starting Network: lo0 re0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 scopeid 0x1 nd6 options=29 media: Ethernet autoselect (none) status: no carrier Starting devd. add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 re0: link state changed to UP ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/kde4/lib /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/gcc46 /usr/local/lib/mysql /usr/local/lib/nss /usr/local/lib/pth /usr/local/lib/qt4 /usr/local/lib/virtualbox a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. savecore: couldn't find media and/or sector size of /var/crash: Inappropriate ioctl for device Sep 10 12:00:28 x4 savecore: couldn't find media and/or sector size of /var/crash: Inappropriate ioctl for device No core dumps found. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 lock order reversal: 1st 0xe4103274 bufwait (bufwait) @ kern/vfs_bio.c:3059 2nd 0xc8984600 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper(c11a0bfc,e410321c,0,0,0,...) at db_trace_self_wrapper+0x2d/frame 0xed7b5760 kdb_backtrace(c11a4801,c8984600,c11d71f9,c81983a0,c11d6e3e,...) at kdb_backtrace+0x30/frame 0xed7b57c8 witness_checkorder(c8984600,9,c11d6e35,11c,0,...) at witness_checkorder+0xc8a/frame 0xed7b5818 _sx_xlock(c8984600,0,c11d6e35,11c,c8e00000,...) at _sx_xlock+0x77/frame 0xed7b5848 ufsdirhash_add(c8ab1e80,ed7b5940,11d0,ed7b58c8,ed7b58cc,...) at ufsdirhash_add+0x4a/frame 0xed7b5878 ufs_direnter(c85a9e10,c8e5be10,ed7b5940,ed7b5b64,e4106da8,...) at ufs_direnter+0x63b/frame 0xed7b58f8 ufs_mkdir(ed7b5c00,c11fef17,c11d0a56,c85a9e10,ed7b5bfc,...) at ufs_mkdir+0x884/frame 0xed7b5a98 VOP_MKDIR_APV(c12c9fdc,ed7b5c00,ed7b5b64,ed7b5b90,28803020,...) at VOP_MKDIR_APV+0x124/frame 0xed7b5ac8 kern_mkdirat(c8a8c930,ffffff9c,28803020,0,1c0) at kern_mkdirat+0x22b/frame 0xed7b5c24 sys_mkdir(c8a8c930,ed7b5cc8,14,c119ec89,7bb,...) at sys_mkdir+0x31/frame 0xed7b5c40 syscall(ed7b5d08) at syscall+0x2ed/frame 0xed7b5cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed7b5cfc --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x28175877, esp = 0xbfbfd92c, ebp = 0xbfbfddd0 --- Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Recovering vi editor sessions:. Updating motd:. Starting ntpd. Starting powerd. Removing stale Samba tdb files: ....... done Starting nmbd. Starting smbd. Starting winbindd. Starting smartd. Starting default moused. Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Local package initialization: backuplock order reversal: 1st 0xc85a9e44 ufs (ufs) @ kern/vfs_subr.c:2099 2nd 0xe4103274 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:262 3rd 0xc903946c ufs (ufs) @ kern/vfs_subr.c:2099 lock order reversal: KDB: stack backtrace: 1st 0xc85a9a0c syncer (syncer) @ kern/vfs_subr.c:1718 d 2nd 0xc92108a4 ufs (ufs) @ kern/vfs_subr.c:2099 bKDB: stack backtrace: _traced_bs_etlrfa_cwer_aspeplefr_(wcr1a1pap0ebrf(cc,181,ac01b1faca,f06,00,,60e,c0,,c.8.1.8)3 1aat0 ,...)d ba_tt race_dsbe_ltfr_warcaep_pseerl+f0_xw2rda/pfprearm+e0 x02xde/df7r1a6m9e4 00 xf84c55f8 kdb_backtrace(ck1d1ba_4b8a0c1k,tcr9a2c1e0(8ca141,ac418118ab,ac8960,3c984169c8,3c3181,8cb1a18a6d,ecf8a1,9.8.3.3)8 ,act1 1adefa,.k.d.b)_ baatc ktrace+0kxd3b0_/bfarcakmter a0cxee+d07x13609/af8r ame 0xf84c5660 witness_checkorwdietrn(ecs9s2_1c0h8eac4k,o9r,dce1r1(acd9e0f319,4863c3,,9c,9c21110a9d1e0f,1.,.8.3)3 ,act9 0394d8,.w.i.t)n easts _checkorwdietrn+e0sxsc_8cah/fercakmoer d0exre+d07x1c689af/8f rame 0xf84c56b0_ _lockmgr_args(c_9_2l1o0c8kam4g,r8_0a5r0g0s,(cc9920130994160c,,08,001,0.0.,.c)9 0a3t9 4d8,0,0,_._.l.o)c kamtg r_args+_0_xl8o1c5k/mfgrra_maer g0sx+e0dx781165a/cfcr ame 0xf84c5784 ffs_lock(ed716b5f0f,sc_8l1o8c9kc(1f08,4cc8519880480,8c,8c18814819ec01,0c,8c188199d8b400,8c,8.1.8.4)1 ea0t, c8189db0f,f.s._.l)o cakt+0 xad/framef f0sx_eldo7c1k6+b00xca d/frame 0xf84c5V7OcP4_ LOCK1_APV(c12c9VfOdPc_,LeOdC7K116_bA5P0V,(cc11428cd90f2d8c,,cf18448cd5081088,,ce1420dee84abd88,,.f.8.4)c 5a8t4 4,c12de4VbO8P,_.L.O.C)K 1a_tA PV+0x104V/OfPr_aLmOeC K01x_eAdP7V1+60bx3180 4/frame 0xf84c5_7vfn0_ lock(c9210870,8_0v5n0_0l,occ1k1(acd9e0f319,483383,,8c01110a0d,ecf111,a.d.e.f)1 ,a8t3 3,c11ad1_3v9n,_.l.o.c)k +a0tx ca/frame_ v0nx_eldo7c1k6+b07x8c a/frame 0xf84c5v8g3e0t (c9210870,80500v,gce8t8(3c09301309,413288,18,0c180d0f,9c89d34e,1.6.2.0), 5a7t, 0,v.g.e.t)+ 0axt7 7/frame v0gxeetd+701x67b7b/0f rame 0xf84c5868v fs_msync(c8df98vcf4s,_2h,a2s,he_4g0e,tc(8cd8fd9f89cb4b,0.,.6.d)4 0a0t, 80000,c9v3fes1_6m2s0y,nfc8+40cx5a907/cf,r.a.m.e) 0axte d716bf8 vfs_hash_get+0xsfyfnc/_ffrsaymnec (0exdf78146cc5a889,4c 11fedf2,80400,cf1f1sa_dvegfe1t,f6(bc68,d.f.9.b)b 0a,t6 d400,800s0y0n,cf_8f4scy5n9c7+c0,x11,1.e./.f)r aamte 0xed716fcf2s0_ vgetf+0x47/framVeO P0_xFfS8Y4NcC5_8AfP0V (c12adc38,ed716fclau8s,hc_1p1aagdeedfe1p,_6dbe6p,0s,(.c.8.5)a 9aet1 0,c8df9bVbO0P,_cF8SeY4NcC0_bA0P,Vc+101xa152046/0f,rca1m2ea 500x2e8d,7.1.6.c)5 0a t flush_spcahgeedd_espy_ndce(p0s,+e0dx72156ad/0f8r,acm1e1 905xff0844,c35d95a,80 ,...) at sosfcthdeedp__ssyynncc+_0bxu3f8(fc/8f5raa9mee1 00,xee4d1701362c1ccc, 1,0,0,...) at fork_existo(fct0dbe7pc_7s7y0n,c0_,beudf7+106xd4078f)/ farta me 0xf8f4ocr5ka_3e0x it+0x7f/frame 0fxfesd_7s1y6nccfv4n ode(c85af9oer1k0_,tr1a,m0p,o6l1ian,ef(8)4 ca5ta c8,...) faotr k_trampoflfisn_es+y0nxc8v/nfordaem+e0 x02x8e7/df7r1a6mcef 40 x-f-8-4 ct5raa8p8 0, eip = 0, espf f=s _0sxyendc7(1c68dd4f09,b be0b,p1 ,=f 804 c-5-b-4 8,518,c12a3eb0,...) at ffs_sync+0x23e/frame 0xf84c5b10 dounmount(c8df9bb0,8080000,c93e1620,494,0,...) at dounmount+0x49f/frame 0xf84c5b70 sys_unmount(c93e1620,f84c5cc8,c0f75630,e4343c90,0,...) at sys_unmount+0x3a1/frame 0xf84c5c40 syscall(f84c5d08) at syscall+0x2ed/frame 0xf84c5cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84c5cfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c1f0b, esp = 0xbfbfd6a4, ebp = 0xbfbfd770 --- lock order reversal: 1st 0xc85aa5d4 ufs (ufs) @ kern/vfs_mount.c:1237 2nd 0xc8add304 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1903 KDB: stack backtrace: db_trace_self_wrapper(c11a0bfc,962,c9039ec0,c9039e10,2,...) at db_trace_self_wrapper+0x2d/frame 0xf84c5808 kdb_backtrace(c11a4801,c8add304,c1197844,c8198198,c11d341b,...) at kdb_backtrace+0x30/frame 0xf84c5870 witness_checkorder(c8add304,9,c11d3412,76f,0,...) at witness_checkorder+0xc8a/frame 0xf84c58c0 __lockmgr_args(c8add304,80400,c8add370,0,0,0,c11d3412,76f) at __lockmgr_args+0x815/frame 0xf84c5994 vop_stdlock(f84c5a08,c93e1620,0,0,c8df9bb0,...) at vop_stdlock+0x53/frame 0xf84c59c4 VOP_LOCK1_APV(c1293f00,f84c5a08,c12adebc,c8de1c00,c12de4b8,...) at VOP_LOCK1_APV+0x104/frame 0xf84c59f0 _vn_lock(c8add2d0,80400,c11d3412,76f,c8de1c00,...) at _vn_lock+0xca/frame 0xf84c5a2c softdep_flushworklist(c8df9bb0,f84c5adc,c93e1620,62e,f84c5ac8,...) at softdep_flushworklist+0xaa/frame 0xf84c5a88 ffs_sync(c8df9bb0,1,f84c5b48,518,c12a3eb0,...) at ffs_sync+0x2e5/frame 0xf84c5b10 dounmount(c8df9bb0,8080000,c93e1620,494,0,...) at dounmount+0x49f/frame 0xf84c5b70 sys_unmount(c93e1620,f84c5cc8,c0f75630,e4343c90,0,...) at sys_unmount+0x3a1/frame 0xf84c5c40 syscall(f84c5d08) at syscall+0x2ed/frame 0xf84c5cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84c5cfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c1f0b, esp = 0xbfbfd6a4, ebp = 0xbfbfd770 --- ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 134053 files, 23916870 used, 94397111 free (14799 frags, 11797789 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmp watchdogd. Starting inetd. Tue Sep 10 12:02:28 CEST 2013 FreeBSD/i386 (x4.osted.lan) (console) login: Sep 10 12:07:27 x4 su: pho to root on /dev/pts/0 panic: handle_written_inodeblock: live inodedep 0xcc731200 cpuid = 0 KDB: stack backtrace: db_trace_self_wrapper(c11a0bfc,4400,3,7fffffff,4,...) at db_trace_self_wrapper+0x2d/frame 0xe436f928 kdb_backtrace(c11f69bb,0,c11d4b85,e436f9e4,c0d3674c,...) at kdb_backtrace+0x30/frame 0xe436f990 vpanic(e436f9e4,e436fae8,c0d460bf,c11d4b85,cc731200,...) at vpanic+0x11f/frame 0xe436f9cc panic(c11d4b85,cc731200,100,ca3eed68,e436fa20,...) at panic+0x12/frame 0xe436f9d8 handle_written_inodeblock(cc731200,e42f31f0,29d7,246,202,...) at handle_written_inodeblock+0xe5f/frame 0xe436fae8 softdep_disk_write_complete(e42f31f0,e42f31f0) at softdep_disk_write_complete+0x19a/frame 0xe436fb68 buf_complete(e42f31f0,c1b82780,c99043d8,e436fbbc,c0d784ff,...) at buf_complete+0x29/frame 0xe436fb78 bufdone_finish(e42f31f0,c838c000,e42f31f0,ca3eed68,e42f31f0,...) at bufdone_finish+0x36/frame 0xe436fbf0 bufdone(e42f31f0,0,c118ae26,9d,c82c3a80) at bufdone+0xd2/frame 0xe436fc0c g_vfs_done(c99043d8,0,c11aaf60,e01,c131177c,...) at g_vfs_done+0x22c/frame 0xe436fc34 biodone(c99043d8,0,c1189e7c,61,0,...) at biodone+0x143/frame 0xe436fc80 g_io_schedule_up(c838c000,0,c1189eb2,5f,e436fcf4,...) at g_io_schedule_up+0x129/frame 0xe436fcb4 g_up_procbody(0,e436fd08,c1195f04,3d5,0,...) at g_up_procbody+0x9d/frame 0xe436fccc fork_exit(c0a23310,0,e436fd08) at fork_exit+0x7f/frame 0xe436fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe436fcf4 --- trap 0, eip = 0, esp = 0xe436fd40, ebp = 0 --- KDB: enter: panic [ thread pid 13 tid 100014 ] Stopped at kdb_enter+0x3d: movl $0,kdb_why db> run pho db:0:pho> bt Tracing pid 13 tid 100014 td 0xc838c000 kdb_enter(c119c655,c119c655,c11d4b85,e436f9e4,c0d3674c,...) at kdb_enter+0x3d/frame 0xe436f990 vpanic(e436f9e4,e436fae8,c0d460bf,c11d4b85,cc731200,...) at vpanic+0x143/frame 0xe436f9cc panic(c11d4b85,cc731200,100,ca3eed68,e436fa20,...) at panic+0x12/frame 0xe436f9d8 handle_written_inodeblock(cc731200,e42f31f0,29d7,246,202,...) at handle_written_inodeblock+0xe5f/frame 0xe436fae8 softdep_disk_write_complete(e42f31f0,e42f31f0) at softdep_disk_write_complete+0x19a/frame 0xe436fb68 buf_complete(e42f31f0,c1b82780,c99043d8,e436fbbc,c0d784ff,...) at buf_complete+0x29/frame 0xe436fb78 bufdone_finish(e42f31f0,c838c000,e42f31f0,ca3eed68,e42f31f0,...) at bufdone_finish+0x36/frame 0xe436fbf0 bufdone(e42f31f0,0,c118ae26,9d,c82c3a80) at bufdone+0xd2/frame 0xe436fc0c g_vfs_done(c99043d8,0,c11aaf60,e01,c131177c,...) at g_vfs_done+0x22c/frame 0xe436fc34 biodone(c99043d8,0,c1189e7c,61,0,...) at biodone+0x143/frame 0xe436fc80 g_io_schedule_up(c838c000,0,c1189eb2,5f,e436fcf4,...) at g_io_schedule_up+0x129/frame 0xe436fcb4 g_up_procbody(0,e436fd08,c1195f04,3d5,0,...) at g_up_procbody+0x9d/frame 0xe436fccc fork_exit(c0a23310,0,e436fd08) at fork_exit+0x7f/frame 0xe436fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe436fcf4 --- trap 0, eip = 0, esp = 0xe436fd40, ebp = 0 --- db:0:bt> show allpcpu Current CPU: 0 cpuid = 0 dynamic pcpu = 0x544080 curthread = 0xc838c000: pid 13 "g_up" curpcb = 0xe436fd60 fpcurthread = none idlethread = 0xc82e7000: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x2305c080 curthread = 0xc8b2f310: pid 1025 "swap" curpcb = 0xf84d0d60 fpcurthread = none idlethread = 0xc82e6c40: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x2305f080 curthread = 0xc9dc0000: pid 1024 "swap" curpcb = 0xf84f7d60 fpcurthread = none idlethread = 0xc82e6930: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x23062080 curthread = 0xc9dbec40: pid 1023 "swap" curpcb = 0xf84fad60 fpcurthread = none idlethread = 0xc82e6620: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks Process 1036 (umount) thread 0xc9dc5930 (100161) exclusive lockmgr bufwait (bufwait) r = 0 (0xe42f3248) locked @ kern/vfs_bio.c:3059 exclusive lockmgr ufs (ufs) r = 0 (0xcb383cdc) locked @ kern/vfs_subr.c:2099 exclusive lockmgr bufwait (bufwait) r = 0 (0xe4285004) locked @ ufs/ffs/ffs_vnops.c:262 exclusive lockmgr ufs (ufs) r = 0 (0xc9dcd5d4) locked @ kern/vfs_subr.c:2099 exclusive lockmgr ufs (ufs) r = 0 (0xc913bcdc) locked @ kern/vfs_mount.c:1237 Process 13 (geom) thread 0xc838c000 (100014) exclusive rw Softdep Lock (Softdep Lock) r = 0 (0xc149128c) locked @ ufs/ffs/ffs_softdep.c:10711 db:0:alllocks> show lockedvnods Locked vnodes 0xc913bca8: tag ufs, type VDIR usecount 1, writecount 0, refcount 1 mountedhere 0xc8df9000 flags (VI_ACTIVE) v_object 0xc8b176b4 ref 0 pages 0 lock type ufs: EXCL by thread 0xc9dc5930 (pid 1036, umount, tid 100161) #0 0xc0aa764e at __lockmgr_args+0x108e #1 0xc0d5876d at ffs_lock+0xad #2 0xc0f94c44 at VOP_LOCK1_APV+0x104 #3 0xc0b8810a at _vn_lock+0xca #4 0xc0b6e819 at dounmount+0x99 #5 0xc0b6e741 at sys_unmount+0x3a1 #6 0xc0f6ec3d at syscall+0x2ed #7 0xc0f56ed1 at Xint0x80_syscall+0x21 ino 235521, on dev ada0s1a 0xc9dcd5a0: tag ufs, type VDIR usecount 6, writecount 0, refcount 23 mountedhere 0 flags (VI_ACTIVE) v_object 0xcb3964e0 ref 0 pages 118 lock type ufs: EXCL by thread 0xc9dc5930 (pid 1036, umount, tid 100161) #0 0xc0aa764e at __lockmgr_args+0x108e #1 0xc0d5876d at ffs_lock+0xad #2 0xc0f94c44 at VOP_LOCK1_APV+0x104 #3 0xc0b8810a at _vn_lock+0xca #4 0xc0b75807 at vget+0x77 #5 0xc0d56e32 at ffs_sync+0x222 #6 0xc0b6ec1f at dounmount+0x49f #7 0xc0b6e741 at sys_unmount+0x3a1 #8 0xc0f6ec3d at syscall+0x2ed #9 0xc0f56ed1 at Xint0x80_syscall+0x21 ino 160512, on dev md5a 0xcb383ca8: tag ufs, type VREG usecount 1, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE) v_object 0xcb57d7ec ref 0 pages 0 lock type ufs: EXCL by thread 0xc9dc5930 (pid 1036, umount, tid 100161) #0 0xc0aa764e at __lockmgr_args+0x108e #1 0xc0d5876d at ffs_lock+0xad #2 0xc0f94c44 at VOP_LOCK1_APV+0x104 #3 0xc0b8810a at _vn_lock+0xca #4 0xc0b75807 at vget+0x77 #5 0xc0b6920f at vfs_hash_get+0xff #6 0xc0d53137 at ffs_vgetf+0x47 #7 0xc0d3fcf7 at flush_pagedep_deps+0x547 #8 0xc0d3f6af at softdep_sync_buf+0x47f #9 0xc0d595d7 at ffs_syncvnode+0x287 #10 0xc0d56e4e at ffs_sync+0x23e #11 0xc0b6ec1f at dounmount+0x49f #12 0xc0b6e741 at sys_unmount+0x3a1 #13 0xc0f6ec3d at syscall+0x2ed #14 0xc0f56ed1 at Xint0x80_syscall+0x21 ino 161985, on dev md5a db:0:lockedvnods> show mount 0xc8a3e2ec /dev/ad4s1a on / (ufs) 0xc8a3e5d8 devfs on /dev (devfs) 0xc8dfa000 /dev/ad4s1f on /home (ufs) 0xc8df98c4 /dev/ad4s1d on /usr (ufs) 0xc8df95d8 /dev/ad4s1e on /var (ufs) 0xc8df92ec procfs on /proc (procfs) 0xc8a3e000 /dev/label/tmp on /tmp (ufs) 0xc8df9000 /dev/md5a on /mnt (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 1036 994 994 0 D+ biowr 0xe42f31f0 umount 1031 994 994 0 R+ (threaded) mv4 100173 RunQ mv4 100172 RunQ mv4 100160 S uwait 0xc8a36a80 mv4 1030 994 994 0 T+ (threaded) mv4 100168 D vfs_busy 0xc8df9000 mv4 100164 s mv4 1028 994 994 0 T+ (threaded) mv4 100169 RunQ mv4 100162 s mv4 1025 1022 1017 0 R CPU 1 swap 1024 1022 1017 0 R CPU 2 swap 1023 1022 1017 0 R CPU 3 swap 1022 1017 1017 0 S wait 0xc9db88b8 swap 1017 1 1017 0 Ss nanslp 0xc1314501 swap 1012 0 0 0 DL mdwait 0xcbd14000 [md5] 994 866 994 0 S+ wait 0xc8b2c2e8 sh 934 929 934 1001 S+ select 0xc8a41564 top 929 928 929 1001 Ss+ wait 0xc9dc42e8 bash 928 926 926 1001 S select 0xc8a415a4 sshd 926 730 926 0 Ss select 0xc8a41664 sshd 866 863 866 0 S+ wait 0xc8b968b8 bash 863 862 863 0 S+ pause 0xc8a8a91c csh 862 856 862 1001 S+ wait 0xc8b2d000 su 856 855 856 1001 Ss+ wait 0xc93f1000 bash 855 853 853 1001 S select 0xc8a41924 sshd 853 730 853 0 Ss select 0xc8f86d24 sshd 842 1 842 0 Ss+ ttyin 0xc8435470 getty 841 1 841 0 Ss+ ttyin 0xc8435670 getty 840 1 840 0 Ss+ ttyin 0xc8435870 getty 839 1 839 0 Ss+ ttyin 0xc8435a70 getty 838 1 838 0 Ss+ ttyin 0xc8435c70 getty 837 1 837 0 Ss+ ttyin 0xc8435e70 getty 836 1 836 0 Ss+ ttyin 0xc8437070 getty 835 1 835 0 Ss+ ttyin 0xc8437270 getty 834 1 834 0 Ss+ ttyin 0xc8437470 getty 817 1 817 0 Ss select 0xc8a416e4 inetd 792 1 792 0 Ss nanslp 0xc1314503 watchdogd 741 1 741 0 Ss nanslp 0xc1314500 cron 736 1 736 25 Ss pause 0xc891834c sendmail 733 1 733 0 Ss select 0xc8f86ba4 sendmail 730 1 730 0 Ss select 0xc8f86c24 sshd 698 1 698 0 Ss select 0xc8f86de4 moused 690 1 689 0 S nanslp 0xc1314502 smartd 688 676 676 0 S select 0xc8a41a64 winbindd 687 674 674 0 S select 0xc8f86ce4 smbd 676 1 676 0 Ss select 0xc8f86c64 winbindd 674 1 674 0 Ss select 0xc8f86ea4 smbd 672 1 672 0 Ss select 0xc8b872e4 nmbd 649 1 649 0 Ss select 0xc8a41ee4 powerd 646 1 646 0 Ss select 0xc8f86ee4 ntpd 590 585 585 0 S (threaded) nfsd 100096 S rpcsvc 0xc8ad7f50 nfsd: service 100095 S rpcsvc 0xc8ad8010 nfsd: service 100094 S rpcsvc 0xc8ad8050 nfsd: service 100085 S rpcsvc 0xc8b90090 nfsd: master 585 1 585 0 Ss select 0xc84af364 nfsd 579 1 579 0 Ss select 0xc8a42024 mountd 572 568 568 0 S select 0xc8b873a4 nfsuserd 571 568 568 0 S select 0xc8a420a4 nfsuserd 570 568 568 0 S select 0xc8a42164 nfsuserd 569 568 568 0 S select 0xc8a420e4 nfsuserd 568 1 568 0 Ss pause 0xc8a8934c nfsuserd 540 1 540 0 Ss select 0xc8a422e4 rpcbind 525 1 525 0 Ss select 0xc8a42264 syslogd 414 1 414 0 Ss select 0xc8f873e4 devd 17 0 0 0 DL sdflush 0xc149130c [softdepflush] 16 0 0 0 DL vlruwt 0xc89178b8 [vnlru] 9 0 0 0 DL syncer 0xc148d060 [syncer] 8 0 0 0 DL psleep 0xc148cb84 [bufdaemon] 7 0 0 0 DL pgzero 0xc1491f24 [pagezero] 6 0 0 0 DL psleep 0xc1491c48 [vmdaemon] 5 0 0 0 DL psleep 0xc14ea104 [pagedaemon] 4 0 0 0 DL ccb_scan 0xc12e1ca0 [xpt_thrd] 3 0 0 0 DL waiting_ 0xc14e6adc [sctp_iterator] 2 0 0 0 DL - 0xc84a143c [fdc0] 15 0 0 0 DL (threaded) [usb] 100058 D - 0xc8516d34 [usbus5] 100057 D - 0xc8516d04 [usbus5] 100056 D - 0xc8516cd4 [usbus5] 100055 D - 0xc8516ca4 [usbus5] 100053 D - 0xc850fb5c [usbus4] 100052 D - 0xc850fb2c [usbus4] 100051 D - 0xc850fafc [usbus4] 100050 D - 0xc850facc [usbus4] 100049 D - 0xc8508b5c [usbus3] 100048 D - 0xc8508b2c [usbus3] 100047 D - 0xc8508afc [usbus3] 100046 D - 0xc8508acc [usbus3] 100045 D - 0xc8502b5c [usbus2] 100044 D - 0xc8502b2c [usbus2] 100043 D - 0xc8502afc [usbus2] 100042 D - 0xc8502acc [usbus2] 100040 D - 0xc84f9b5c [usbus1] 100039 D - 0xc84f9b2c [usbus1] 100038 D - 0xc84f9afc [usbus1] 100037 D - 0xc84f9acc [usbus1] 100035 D - 0xc84f0b5c [usbus0] 100034 D - 0xc84f0b2c [usbus0] 100033 D - 0xc84f0afc [usbus0] 100032 D - 0xc84f0acc [usbus0] 14 0 0 0 DL - 0xc12f99b0 [rand_harvestq] 13 0 0 0 RL (threaded) [geom] 100015 D - 0xc14e2c4c [g_down] 100014 Run CPU 0 [g_up] 100013 D - 0xc14e2c44 [g_event] 12 0 0 0 WL (threaded) [intr] 100063 I [irq12: psm0] 100062 I [irq1: atkbd0] 100060 I [swi0: uart] 100059 I [irq14: ata0] 100054 I [irq19: ehci0] 100041 I [irq18: ohci2 ohci4] 100036 I [irq17: ohci1 ohci3] 100031 I [irq16: hdac1 ohci0] 100030 I [irq22: ahci0] 100029 I [irq257: re0] 100028 I [irq256: hdac0] 100027 I [swi6: Giant taskq] 100026 I [swi6: task queue] 100021 I [swi2: cambio] 100020 I [swi5: fast taskq] 100012 I [swi1: netisr 0] 100011 I [swi4: clock] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 I [swi4: clock] 100007 I [swi3: vm] 11 0 0 0 RL (threaded) [idle] 100006 CanRun [idle: cpu3] 100005 CanRun [idle: cpu2] 100004 CanRun [idle: cpu1] 100003 CanRun [idle: cpu0] 1 0 1 0 SLs wait 0xc82e22e8 [init] 10 0 0 0 DL audit_wo 0xc14e89b8 [audit] 0 0 0 0 DLs (threaded) [kernel] 100065 D - 0xc13133ff [deadlkres] 100064 D - 0xc8399b80 [mca taskq] 100025 D - 0xc8399d00 [acpi_task_2] 100024 D - 0xc8399d00 [acpi_task_1] 100023 D - 0xc8399d00 [acpi_task_0] 100022 D - 0xc8399d80 [kqueue taskq] 100019 D - 0xc8399e80 [ffs_trim taskq] 100018 D - 0xc8399f00 [thread taskq] 100016 D - 0xc839a000 [firmware taskq] 100000 D swapin 0xc14e2cc4 [swapper] db:0:ps> allt Tracing command umount pid 1036 tid 100161 td 0xc9dc5930 sched_switch(c9dc5930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf8517694 mi_switch(104,0,c11a2855,1f5,162,...) at mi_switch+0x1c9/frame 0xf85176c8 sleepq_switch(c9dc5930,0,c11a2855,26b,e42f31f0,...) at sleepq_switch+0x1c5/frame 0xf85176fc sleepq_wait(e42f31f0,5c,c11ab3a6,0,0,...) at sleepq_wait+0x48/frame 0xf8517720 _sleep(e42f31f0,c819d09c,5c,c11ab3a6,0,...) at _sleep+0x385/frame 0xf851777c bwait(e42f31f0,5c,c11ab3a6,f8517804,5c,...) at bwait+0xc6/frame 0xf85177dc bufwait(e42f31f0,8000,c0b58534,c148ce4c,1,...) at bufwait+0x6d/frame 0xf8517804 bufwrite(e42f31f0,c11d6145,825,c8df9000,0,0,cc365e00,1,e42f31f0) at bufwrite+0x251/frame 0xf8517844 ffs_bufwrite(e42f31f0,cabb4e00,100,8000,0,...) at ffs_bufwrite+0x147/frame 0xf8517878 ffs_update(cb383ca8,1,80000,f851797c,1,...) at ffs_update+0x34d/frame 0xf85178f0 flush_pagedep_deps(c9dcd5a0,c8df9000,cbacb534,c11a5060,e41d20f0,...) at flush_pagedep_deps+0x578/frame 0xf85179a8 softdep_sync_buf(c9dcd5a0,e4284fac,1,0,0,...) at softdep_sync_buf+0x47f/frame 0xf8517a30 ffs_syncvnode(c9dcd5a0,1,0,62e,f8517ac8,...) at ffs_syncvnode+0x287/frame 0xf8517a88 ffs_sync(c8df9000,1,f8517b48,518,c12a3eb0,...) at ffs_sync+0x23e/frame 0xf8517b10 dounmount(c8df9000,8080000,c9dc5930,494,0,...) at dounmount+0x49f/frame 0xf8517b70 sys_unmount(c9dc5930,f8517cc8,c11f8136,d6,0,...) at sys_unmount+0x3a1/frame 0xf8517c40 syscall(f8517d08) at syscall+0x2ed/frame 0xf8517cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8517cfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c1f0b, esp = 0xbfbfd0f4, ebp = 0xbfbfd1c0 --- Tracing command mv4 pid 1031 tid 100173 td 0xc8b2fc40 sched_switch(c8b2fc40,0,602,1b6,f8557b1c,...) at sched_switch+0x4b9/frame 0xf8557af8 mi_switch(602,0,c119cd1c,d3,c8b2fc40,...) at mi_switch+0x1c9/frame 0xf8557b2c critical_exit(c8b2fc40,0,0) at critical_exit+0xa3/frame 0xf8557b48 ipi_bitmap_handler(8,28,28,c1320700,5f,...) at ipi_bitmap_handler+0x6b/frame 0xf8557b68 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x2f/frame 0xf8557b68 --- interrupt, eip = 0xc0ab0aa1, esp = 0xf8557bb0, ebp = 0xf8557c18 --- thread_lock_flags_(c8b2fc40,0,c119ec89,a0f,0,...) at thread_lock_flags_+0x251/frame 0xf8557c18 sched_relinquish(c8b2fc40,f8557cfc,c0f6ec3d,c8b2fc40,f8557cc8,...) at sched_relinquish+0x2a/frame 0xf8557c34 sys_sched_yield(c8b2fc40,f8557cc8,c0f75630,c1825c90,0,...) at sys_sched_yield+0x13/frame 0xf8557c40 syscall(f8557d08) at syscall+0x2ed/frame 0xf8557cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8557cfc --- syscall (331, FreeBSD ELF32, sys_sched_yield), eip = 0x280e16db, esp = 0xbf7fbf14, ebp = 0xbf7fbfa0 --- Tracing command mv4 pid 1031 tid 100172 td 0xc9dc5310 sched_switch(c9dc5310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf8554a64 mi_switch(104,0,c11a2855,1f5,c0b0a9c0,...) at mi_switch+0x1c9/frame 0xf8554a98 sleepq_switch(c9dc5310,0,c11a2855,1ab,8,...) at sleepq_switch+0x1c5/frame 0xf8554acc sleepq_catch_signals(c0b0a9c0,c9dc5310,3,201,3,...) at sleepq_catch_signals+0x36c/frame 0xf8554b14 sleepq_timedwait_sig(c1314503,6c,339,68db,0,...) at sleepq_timedwait_sig+0x14/frame 0xf8554b3c _sleep(c1314503,0,16c,c119dd66,9b60e082,...) at _sleep+0x33c/frame 0xf8554b98 kern_nanosleep(bf8fce80,f8554c18,f8554c20,0,0,...) at kern_nanosleep+0x158/frame 0xf8554c00 sys_nanosleep(c9dc5310,f8554cc8,14,c119ec89,7bb,...) at sys_nanosleep+0x6b/frame 0xf8554c40 syscall(f8554d08) at syscall+0x2ed/frame 0xf8554cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8554cfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28186d43, esp = 0xbf8fce74, ebp = 0xbf8fce98 --- Tracing command mv4 pid 1031 tid 100160 td 0xc93e0620 sched_switch(c93e0620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf8514a40 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xf8514a74 sleepq_switch(c93e0620,0,c11a2855,1ab,f8514aec,...) at sleepq_switch+0x1c5/frame 0xf8514aa8 sleepq_catch_signals(0,c11a2855,162,15f0,c8a36a80,...) at sleepq_catch_signals+0x36c/frame 0xf8514af0 sleepq_wait_sig(c8a36a80,0,c119e43f,100,0,...) at sleepq_wait_sig+0x14/frame 0xf8514b14 _sleep(c8a36a80,c131dbb8,300,c119e43f,0,...) at _sleep+0x364/frame 0xf8514b70 umtxq_sleep(0,0,c119e2a8,1c2,28803800,...) at umtxq_sleep+0x155/frame 0xf8514bd0 do_wait(1874d,0,0,0,f8514cc8,...) at do_wait+0x15d/frame 0xf8514c10 __umtx_op_wait(c93e0620,f8514cc8,c11f8136,d6,0,...) at __umtx_op_wait+0x9f/frame 0xf8514c40 syscall(f8514d08) at syscall+0x2ed/frame 0xf8514cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8514cfc --- syscall (454, FreeBSD ELF32, sys__umtx_op), eip = 0x2807d5e3, esp = 0xbfbfd79c, ebp = 0xbfbfd7b8 --- Tracing command mv4 pid 1030 tid 100168 td 0xc93e0310 sched_switch(c93e0310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf85487a0 mi_switch(104,0,c11a2855,1f5,162,...) at mi_switch+0x1c9/frame 0xf85487d4 sleepq_switch(c93e0310,0,c11a2855,26b,c8df9000,...) at sleepq_switch+0x1c5/frame 0xf8548808 sleepq_wait(c8df9000,60,c11adf0a,0,0,...) at sleepq_wait+0x48/frame 0xf854882c _sleep(c8df9000,c8df9000,260,c11adf0a,0,...) at _sleep+0x385/frame 0xf8548888 vfs_busy(c8df9000,0,c12c9fdc,f85488e0,f8548948,...) at vfs_busy+0xb8/frame 0xf85488c0 ufs_rename(f8548bf0,f8548aa0,c0b6b69c,f8548b0c,0,...) at ufs_rename+0x11c/frame 0xf8548a74 VOP_RENAME_APV(c12c9fdc,f8548bf0,0,1,f8548b3c,...) at VOP_RENAME_APV+0xfe/frame 0xf8548aa0 kern_renameat(c93e0310,ffffff9c,bf8fcf40,ffffff9c,bf8fcef0,0) at kern_renameat+0x4bb/frame 0xf8548c20 sys_rename(c93e0310,f8548cc8,c0f75630,e433dc90,0,...) at sys_rename+0x39/frame 0xf8548c40 syscall(f8548d08) at syscall+0x2ed/frame 0xf8548cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8548cfc --- syscall (128, FreeBSD ELF32, sys_rename), eip = 0x280e1d1b, esp = 0xbf8fceb8, ebp = 0xbf8fcfa0 --- Tracing command mv4 pid 1030 tid 100164 td 0xc9dbe000 sched_switch(c9dbe000,0,10a,1bb,c119daa2,...) at sched_switch+0x4b9/frame 0xf853cb30 mi_switch(10a,0,c119daa2,371,cbc77308,...) at mi_switch+0x1c9/frame 0xf853cb64 thread_suspend_switch(c9dbe000,4,c119daa2,24c,4,...) at thread_suspend_switch+0x18f/frame 0xf853cb98 thread_single(1,0,c1195c80,9b,0,...) at thread_single+0x3c8/frame 0xf853cbd0 exit1(c9dbe000,100,f853ccfc,c0f6ec3d,c9dbe000,...) at exit1+0x9e/frame 0xf853cc30 sys_sys_exit(c9dbe000,f853ccc8,14,c119ec89,7bb,...) at sys_sys_exit+0x1d/frame 0xf853cc40 syscall(f853cd08) at syscall+0x2ed/frame 0xf853ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf853ccfc --- syscall (1, FreeBSD ELF32, sys_sys_exit), eip = 0x28144fe3, esp = 0xbf9fdeb4, ebp = 0xbf9fdec4 --- Tracing command mv4 pid 1028 tid 100169 td 0xcbd50c40 sched_switch(cbd50c40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf854b784 mi_switch(104,0,c11a2855,1f5,162,...) at mi_switch+0x1c9/frame 0xf854b7b8 sleepq_switch(cbd50c40,0,c11a2855,26b,60,...) at sleepq_switch+0x1c5/frame 0xf854b7ec sleepq_wait(cb247cdc,60,c118ba86,4,1,...) at sleepq_wait+0x48/frame 0xf854b810 sleeplk(cb247d48,c118ba86,60,33,1,...) at sleeplk+0x126/frame 0xf854b858 __lockmgr_args(cb247cdc,200400,cb247d48,0,0,...) at __lockmgr_args+0x610/frame 0xf854b92c ffs_lock(f854b9b0,c1b81b10,c1b81b00,f854b9b0,c0aafeab,...) at ffs_lock+0xad/frame 0xf854b96c VOP_LOCK1_APV(c12c9fdc,f854b9b0,c11a5060,5,c12de4b8,...) at VOP_LOCK1_APV+0x104/frame 0xf854b998 _vn_lock(cb247ca8,200400,c11ad307,20c,f854ba20,...) at _vn_lock+0xca/frame 0xf854b9d8 lookup(f854bb78,c11ad307,10e,cf,0,...) at lookup+0xf9/frame 0xf854ba40 namei(f854bb78,2,400000c,0,bf7fbf44,...) at namei+0x51d/frame 0xf854bad8 kern_unlinkat(cbd50c40,ffffff9c,bf7fbf44,0,0) at kern_unlinkat+0xb1/frame 0xf854bc24 sys_unlink(cbd50c40,f854bcc8,14,c119ec89,7bb,...) at sys_unlink+0x32/frame 0xf854bc40 syscall(f854bd08) at syscall+0x2ed/frame 0xf854bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf854bcfc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28194e07, esp = 0xbf7fbf14, ebp = 0xbf7fbfa0 --- Tracing command mv4 pid 1028 tid 100162 td 0xc93e0000 sched_switch(c93e0000,0,10a,1bb,c119daa2,...) at sched_switch+0x4b9/frame 0xf851ab30 mi_switch(10a,0,c119daa2,371,c9db8020,...) at mi_switch+0x1c9/frame 0xf851ab64 thread_suspend_switch(c93e0000,4,c119daa2,24c,4,...) at thread_suspend_switch+0x18f/frame 0xf851ab98 thread_single(1,0,c1195c80,9b,0,...) at thread_single+0x3c8/frame 0xf851abd0 exit1(c93e0000,100,f851acfc,c0f6ec3d,c93e0000,...) at exit1+0x9e/frame 0xf851ac30 sys_sys_exit(c93e0000,f851acc8,14,c119ec89,7bb,...) at sys_sys_exit+0x1d/frame 0xf851ac40 syscall(f851ad08) at syscall+0x2ed/frame 0xf851acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf851acfc --- syscall (1, FreeBSD ELF32, sys_sys_exit), eip = 0x28144fe3, esp = 0xbf9fdeb4, ebp = 0xbf9fdec4 --- Tracing command swap pid 1025 tid 100119 td 0xc8b2f310 cpustop_handler(1,13,f84d0cfc,c0f6d7ce,c1320e10,...) at cpustop_handler+0x2f/frame 0xf84d0ba8 ipi_nmi_handler(c1320e10,c8b9f310,c1320e00,c8b9f5f0,f84d0be4,...) at ipi_nmi_handler+0x37/frame 0xf84d0bb8 trap(f84d0d08) at trap+0x3e/frame 0xf84d0cfc calltrap() at calltrap+0x6/frame 0xf84d0cfc --- trap 0x13, eip = 0x80494aa, esp = 0xbfbfd7a0, ebp = 0xbfbfd7b8 --- Tracing command swap pid 1024 tid 100130 td 0xc9dc0000 cpustop_handler(2,13,f84f7cfc,c0f6d7ce,c1321510,...) at cpustop_handler+0x2f/frame 0xf84f7ba8 ipi_nmi_handler(c1321510,2,40c931,0,0,...) at ipi_nmi_handler+0x37/frame 0xf84f7bb8 trap(f84f7d08) at trap+0x3e/frame 0xf84f7cfc calltrap() at calltrap+0x6/frame 0xf84f7cfc --- trap 0x13, eip = 0x80494aa, esp = 0xbfbfd7a0, ebp = 0xbfbfd7b8 --- Tracing command swap pid 1023 tid 100156 td 0xc9dbec40 cpustop_handler(3,13,f84facfc,c0f6d7ce,c1321c10,...) at cpustop_handler+0x2f/frame 0xf84faba8 ipi_nmi_handler(c1321c10,3,40e0a0,0,0,...) at ipi_nmi_handler+0x37/frame 0xf84fabb8 trap(f84fad08) at trap+0x3e/frame 0xf84facfc calltrap() at calltrap+0x6/frame 0xf84facfc --- trap 0x13, eip = 0x80494aa, esp = 0xbfbfd7a0, ebp = 0xbfbfd7b8 --- Tracing command swap pid 1022 tid 100153 td 0xc9dbf000 sched_switch(c9dbf000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf850998c mi_switch(104,0,c11a2855,1f5,c11a2855,...) at mi_switch+0x1c9/frame 0xf85099c0 sleepq_switch(c9dbf000,0,c11a2855,1ab,f8509a38,...) at sleepq_switch+0x1c5/frame 0xf85099f4 sleepq_catch_signals(0,c11a2855,162,480,c9db88b8,...) at sleepq_catch_signals+0x36c/frame 0xf8509a3c sleepq_wait_sig(c9db88b8,6c,c11a64e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf8509a60 _sleep(c9db88b8,c9db894c,16c,c11a64e1,0,...) at _sleep+0x364/frame 0xf8509abc kern_wait6(c9dbf000,0,3ff,0,f8509b4c,...) at kern_wait6+0x45c/frame 0xf8509b20 sys_wait4(c9dbf000,f8509cc8,1,0,c9dbf000,...) at sys_wait4+0x94/frame 0xf8509c40 syscall(f8509d08) at syscall+0x2ed/frame 0xf8509cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8509cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x280eceb3, esp = 0xbfbfd7a0, ebp = 0xbfbfd7b8 --- Tracing command swap pid 1017 tid 100076 td 0xc8a93c40 sched_switch(c8a93c40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed723a64 mi_switch(104,0,c11a2855,1f5,c0b0a9c0,...) at mi_switch+0x1c9/frame 0xed723a98 sleepq_switch(c8a93c40,0,c11a2855,1ab,8,...) at sleepq_switch+0x1c5/frame 0xed723acc sleepq_catch_signals(c0b0a9c0,c8a93c40,1,201,1,...) at sleepq_catch_signals+0x36c/frame 0xed723b14 sleepq_timedwait_sig(c1314501,6c,33a,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xed723b3c _sleep(c1314501,0,16c,c119dd66,1f190745,...) at _sleep+0x33c/frame 0xed723b98 kern_nanosleep(bfbfd780,ed723c18,ed723c20,ed723cc8,1,...) at kern_nanosleep+0x158/frame 0xed723c00 sys_nanosleep(c8a93c40,ed723cc8,c0f75630,c1825c90,0,...) at sys_nanosleep+0x6b/frame 0xed723c40 syscall(ed723d08) at syscall+0x2ed/frame 0xed723cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed723cfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28179d43, esp = 0xbfbfd774, ebp = 0xbfbfd7b8 --- Tracing command md5 pid 1012 tid 100081 td 0xc8b9f310 sched_switch(c8b9f310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed744ba0 mi_switch(104,0,c11a2855,1f5,162,...) at mi_switch+0x1c9/frame 0xed744bd4 sleepq_switch(c8b9f310,0,c11a2855,26b,cbd14000,...) at sleepq_switch+0x1c5/frame 0xed744c08 sleepq_wait(cbd14000,5c,c1135bc2,0,0,...) at sleepq_wait+0x48/frame 0xed744c2c _sleep(cbd14000,cbd14020,25c,c1135bc2,0,...) at _sleep+0x385/frame 0xed744c88 md_kthread(cbd14000,ed744d08,c1195f04,3d5,0,...) at md_kthread+0x118/frame 0xed744ccc fork_exit(c07a3240,cbd14000,ed744d08) at fork_exit+0x7f/frame 0xed744cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed744cf4 --- trap 0, eip = 0, esp = 0xed744d40, ebp = 0 --- Tracing command sh pid 994 tid 100125 td 0xc8a94930 sched_switch(c8a94930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84e498c mi_switch(104,0,c11a2855,1f5,c11a2855,...) at mi_switch+0x1c9/frame 0xf84e49c0 sleepq_switch(c8a94930,0,c11a2855,1ab,f84e4a38,...) at sleepq_switch+0x1c5/frame 0xf84e49f4 sleepq_catch_signals(0,c11a2855,162,3f0,c8b2c2e8,...) at sleepq_catch_signals+0x36c/frame 0xf84e4a3c sleepq_wait_sig(c8b2c2e8,6c,c11a64e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf84e4a60 _sleep(c8b2c2e8,c8b2c37c,16c,c11a64e1,0,...) at _sleep+0x364/frame 0xf84e4abc kern_wait6(c8a94930,7,0,0,f84e4b4c,...) at kern_wait6+0x45c/frame 0xf84e4b20 sys_wait4(c8a94930,f84e4cc8,c11f8136,e9,0,...) at sys_wait4+0x94/frame 0xf84e4c40 syscall(f84e4d08) at syscall+0x2ed/frame 0xf84e4cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84e4cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x28151eb3, esp = 0xbfbfd800, ebp = 0xbfbfd818 --- Tracing command top pid 934 tid 100150 td 0xc8b9f930 sched_switch(c8b9f930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf85338f8 mi_switch(104,0,c11a2855,1f5,3fe,...) at mi_switch+0x1c9/frame 0xf853392c sleepq_switch(c8b9f930,0,c11a2855,1ab,c119a0e5,...) at sleepq_switch+0x1c5/frame 0xf8533960 sleepq_catch_signals(c12a3eb0,f85339d0,c0aaf809,c8a41560,0,...) at sleepq_catch_signals+0x36c/frame 0xf85339a8 sleepq_timedwait_sig(c8a41564,0,f8533a08,20000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf85339d0 _cv_timedwait_sig_sbt(c8a41564,c8a41550,1f9bd6cd,33b,20000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf8533a1c seltdwait(33b,20000000,0,c8b9f930,f8533bc8,...) at seltdwait+0xbc/frame 0xf8533a50 kern_select(c8b9f930,2,bfbfda38,0,0,...) at kern_select+0x883/frame 0xf8533bf8 sys_select(c8b9f930,f8533cc8,c0f75630,e4343c90,0,...) at sys_select+0x69/frame 0xf8533c40 syscall(f8533d08) at syscall+0x2ed/frame 0xf8533cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8533cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281f99c7, esp = 0xbfbfd9dc, ebp = 0xbfbfdb44 --- Tracing command bash pid 929 tid 100148 td 0xc9dc5c40 sched_switch(c9dc5c40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf852d98c mi_switch(104,0,c11a2855,1f5,c11a2855,...) at mi_switch+0x1c9/frame 0xf852d9c0 sleepq_switch(c9dc5c40,0,c11a2855,1ab,f852da38,...) at sleepq_switch+0x1c5/frame 0xf852d9f4 sleepq_catch_signals(0,c11a2855,162,ff0,c9dc42e8,...) at sleepq_catch_signals+0x36c/frame 0xf852da3c sleepq_wait_sig(c9dc42e8,6c,c11a64e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf852da60 _sleep(c9dc42e8,c9dc437c,16c,c11a64e1,0,...) at _sleep+0x364/frame 0xf852dabc kern_wait6(c9dc5c40,7,0,0,f852db4c,...) at kern_wait6+0x45c/frame 0xf852db20 sys_wait4(c9dc5c40,f852dcc8,c0f75630,c1825c90,0,...) at sys_wait4+0x94/frame 0xf852dc40 syscall(f852dd08) at syscall+0x2ed/frame 0xf852dcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf852dcfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282b0eb3, esp = 0xbfbfd9b0, ebp = 0xbfbfd9c8 --- Tracing command sshd pid 928 tid 100147 td 0xc9dc6000 sched_switch(c9dc6000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf852a904 mi_switch(104,0,c11a2855,1f5,200046,...) at mi_switch+0x1c9/frame 0xf852a938 sleepq_switch(c9dc6000,0,c11a2855,1ab,c8a415a0,...) at sleepq_switch+0x1c5/frame 0xf852a96c sleepq_catch_signals(f852a9d8,c0aaf809,c8a415a0,0,0,...) at sleepq_catch_signals+0x36c/frame 0xf852a9b4 sleepq_wait_sig(c8a415a4,0,f852aa08,101,0,...) at sleepq_wait_sig+0x14/frame 0xf852a9d8 _cv_wait_sig(c8a415a4,c8a41590,c11a5c63,6d8,1b2,...) at _cv_wait_sig+0x200/frame 0xf852aa1c seltdwait(ffffffff,0,0,c9dc6000,f852abc8,...) at seltdwait+0x90/frame 0xf852aa50 kern_select(c9dc6000,c,28c0c1c8,28c0c1d0,0,...) at kern_select+0x883/frame 0xf852abf8 sys_select(c9dc6000,f852acc8,c0f75630,e433dc90,0,...) at sys_select+0x69/frame 0xf852ac40 syscall(f852ad08) at syscall+0x2ed/frame 0xf852acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf852acfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x285329c7, esp = 0xbfbfd374, ebp = 0xbfbfd3c0 --- Tracing command sshd pid 926 tid 100134 td 0xc9dc6930 sched_switch(c9dc6930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf850396c mi_switch(104,0,c11a2855,1f5,200046,...) at mi_switch+0x1c9/frame 0xf85039a0 sleepq_switch(c9dc6930,0,c11a2855,1ab,c8a41660,...) at sleepq_switch+0x1c5/frame 0xf85039d4 sleepq_catch_signals(f8503a40,c0aaf809,c8a41660,0,0,...) at sleepq_catch_signals+0x36c/frame 0xf8503a1c sleepq_wait_sig(c8a41664,0,f8503a70,101,0,...) at sleepq_wait_sig+0x14/frame 0xf8503a40 _cv_wait_sig(c8a41664,c8a41650,c11a5c63,6d8,5d5,...) at _cv_wait_sig+0x200/frame 0xf8503a84 seltdwait(ffffffff,0,0,c9dc6930,0,...) at seltdwait+0x90/frame 0xf8503ab8 sys_poll(c9dc6930,f8503cc8,c0f75630,e4340c90,0,...) at sys_poll+0x46d/frame 0xf8503c40 syscall(f8503d08) at syscall+0x2ed/frame 0xf8503cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf8503cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284c8b1f, esp = 0xbfbfd3bc, ebp = 0xbfbfd408 --- Tracing command bash pid 866 tid 100082 td 0xc8b9f000 sched_switch(c8b9f000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed74898c mi_switch(104,0,c11a2855,1f5,c11a2855,...) at mi_switch+0x1c9/frame 0xed7489c0 sleepq_switch(c8b9f000,0,c11a2855,1ab,ed748a38,...) at sleepq_switch+0x1c5/frame 0xed7489f4 sleepq_catch_signals(0,c11a2855,162,1380,c8b968b8,...) at sleepq_catch_signals+0x36c/frame 0xed748a3c sleepq_wait_sig(c8b968b8,6c,c11a64e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xed748a60 _sleep(c8b968b8,c8b9694c,16c,c11a64e1,0,...) at _sleep+0x364/frame 0xed748abc kern_wait6(c8b9f000,7,0,0,ed748b4c,...) at kern_wait6+0x45c/frame 0xed748b20 sys_wait4(c8b9f000,ed748cc8,8,c119cd1c,db,...) at sys_wait4+0x94/frame 0xed748c40 syscall(ed748d08) at syscall+0x2ed/frame 0xed748cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed748cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282b0eb3, esp = 0xbfbfd790, ebp = 0xbfbfd7a8 --- Tracing command csh pid 863 tid 100075 td 0xc8a94000 sched_switch(c8a94000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed720aa0 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xed720ad4 sleepq_switch(c8a94000,0,c11a2855,1ab,ed720b4c,...) at sleepq_switch+0x1c5/frame 0xed720b08 sleepq_catch_signals(0,c11a2855,162,10f8,c8a8a91c,...) at sleepq_catch_signals+0x36c/frame 0xed720b50 sleepq_wait_sig(c8a8a91c,74,c0fc89b4,100,0,...) at sleepq_wait_sig+0x14/frame 0xed720b74 _sleep(c8a8a91c,c8a8a94c,174,c0fc89b4,0,...) at _sleep+0x364/frame 0xed720bd0 kern_sigsuspend(c8a94000,0,0,0,0,...) at kern_sigsuspend+0xfb/frame 0xed720c10 sys_sigsuspend(c8a94000,ed720cc8,c11f8136,e9,0,...) at sys_sigsuspend+0x58/frame 0xed720c40 syscall(ed720d08) at syscall+0x2ed/frame 0xed720cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed720cfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2816c65b, esp = 0xbfbfd104, ebp = 0xbfbfd16c --- Tracing command su pid 862 tid 100107 td 0xc8b2f620 sched_switch(c8b2f620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84a298c mi_switch(104,0,c11a2855,1f5,c11a2855,...) at mi_switch+0x1c9/frame 0xf84a29c0 sleepq_switch(c8b2f620,0,c11a2855,1ab,f84a2a38,...) at sleepq_switch+0x1c5/frame 0xf84a29f4 sleepq_catch_signals(0,c11a2855,162,1380,c8b2d000,...) at sleepq_catch_signals+0x36c/frame 0xf84a2a3c sleepq_wait_sig(c8b2d000,6c,c11a64e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf84a2a60 _sleep(c8b2d000,c8b2d094,16c,c11a64e1,0,...) at _sleep+0x364/frame 0xf84a2abc kern_wait6(c8b2f620,0,35f,0,f84a2b4c,...) at kern_wait6+0x45c/frame 0xf84a2b20 sys_wait4(c8b2f620,f84a2cc8,c0f75630,e4340c90,0,...) at sys_wait4+0x94/frame 0xf84a2c40 syscall(f84a2d08) at syscall+0x2ed/frame 0xf84a2cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84a2cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2810feb3, esp = 0xbfbfd620, ebp = 0xbfbfd638 --- Tracing command bash pid 856 tid 100116 td 0xc93e1620 sched_switch(c93e1620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84c598c mi_switch(104,0,c11a2855,1f5,c11a2855,...) at mi_switch+0x1c9/frame 0xf84c59c0 sleepq_switch(c93e1620,0,c11a2855,1ab,f84c5a38,...) at sleepq_switch+0x1c5/frame 0xf84c59f4 sleepq_catch_signals(0,c11a2855,162,180,c93f1000,...) at sleepq_catch_signals+0x36c/frame 0xf84c5a3c sleepq_wait_sig(c93f1000,6c,c11a64e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf84c5a60 _sleep(c93f1000,c93f1094,16c,c11a64e1,0,...) at _sleep+0x364/frame 0xf84c5abc kern_wait6(c93e1620,7,0,0,f84c5b4c,...) at kern_wait6+0x45c/frame 0xf84c5b20 sys_wait4(c93e1620,f84c5cc8,c0f75630,e4343c90,0,...) at sys_wait4+0x94/frame 0xf84c5c40 syscall(f84c5d08) at syscall+0x2ed/frame 0xf84c5cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84c5cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282b0eb3, esp = 0xbfbfd9b0, ebp = 0xbfbfd9c8 --- Tracing command sshd pid 855 tid 100120 td 0xc9191310 sched_switch(c9191310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84d3904 mi_switch(104,0,c11a2855,1f5,200046,...) at mi_switch+0x1c9/frame 0xf84d3938 sleepq_switch(c9191310,0,c11a2855,1ab,c8a41920,...) at sleepq_switch+0x1c5/frame 0xf84d396c sleepq_catch_signals(f84d39d8,c0aaf809,c8a41920,0,0,...) at sleepq_catch_signals+0x36c/frame 0xf84d39b4 sleepq_wait_sig(c8a41924,0,f84d3a08,101,0,...) at sleepq_wait_sig+0x14/frame 0xf84d39d8 _cv_wait_sig(c8a41924,c8a41910,c11a5c63,6d8,1b2,...) at _cv_wait_sig+0x200/frame 0xf84d3a1c seltdwait(ffffffff,0,0,c9191310,f84d3bc8,...) at seltdwait+0x90/frame 0xf84d3a50 kern_select(c9191310,c,28c0c1c8,28c0c1d0,0,...) at kern_select+0x883/frame 0xf84d3bf8 sys_select(c9191310,f84d3cc8,c0f75630,c1825c90,0,...) at sys_select+0x69/frame 0xf84d3c40 syscall(f84d3d08) at syscall+0x2ed/frame 0xf84d3cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84d3cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x285329c7, esp = 0xbfbfd374, ebp = 0xbfbfd3c0 --- Tracing command sshd pid 853 tid 100121 td 0xc9191000 sched_switch(c9191000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84d796c mi_switch(104,0,c11a2855,1f5,200046,...) at mi_switch+0x1c9/frame 0xf84d79a0 sleepq_switch(c9191000,0,c11a2855,1ab,c8f86d20,...) at sleepq_switch+0x1c5/frame 0xf84d79d4 sleepq_catch_signals(f84d7a40,c0aaf809,c8f86d20,0,0,...) at sleepq_catch_signals+0x36c/frame 0xf84d7a1c sleepq_wait_sig(c8f86d24,0,f84d7a70,101,0,...) at sleepq_wait_sig+0x14/frame 0xf84d7a40 _cv_wait_sig(c8f86d24,c8f86d10,c11a5c63,6d8,5d5,...) at _cv_wait_sig+0x200/frame 0xf84d7a84 seltdwait(ffffffff,0,0,c9191000,0,...) at seltdwait+0x90/frame 0xf84d7ab8 sys_poll(c9191000,f84d7cc8,c0f75630,e4340c90,0,...) at sys_poll+0x46d/frame 0xf84d7c40 syscall(f84d7d08) at syscall+0x2ed/frame 0xf84d7cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84d7cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284c8b1f, esp = 0xbfbfd3bc, ebp = 0xbfbfd408 --- Tracing command getty pid 842 tid 100083 td 0xc8a93930 sched_switch(c8a93930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed74d9a0 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xed74d9d4 sleepq_switch(c8a93930,0,c11a2855,1ab,ed74da4c,...) at sleepq_switch+0x1c5/frame 0xed74da08 sleepq_catch_signals(0,c11a2855,162,360,1,...) at sleepq_catch_signals+0x36c/frame 0xed74da50 sleepq_wait_sig(c8435470,0,c11a7dfd,101,0,...) at sleepq_wait_sig+0x14/frame 0xed74da74 _cv_wait_sig(c8435470,c14e35d0,c11a7de9,531,ed74dc10,...) at _cv_wait_sig+0x200/frame 0xed74dab8 tty_wait(c8435400,c8435470,ed74dc10,1,0,...) at tty_wait+0x4b/frame 0xed74dadc ttydisc_read(c8435400,ed74dc10,0,a1,0,...) at ttydisc_read+0x377/frame 0xed74db20 ttydev_read(c854d300,ed74dc10,0,1,0,...) at ttydev_read+0x81/frame 0xed74db40 devfs_read_f(c8ab9428,ed74dc10,c82c0e80,0,c8a93930,...) at devfs_read_f+0x84/frame 0xed74db74 dofileread(c8ab9428,ed74dc10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xed74dba8 kern_readv(c8a93930,0,ed74dc10,0,bfbfddfb,...) at kern_readv+0x96/frame 0xed74dbf0 sys_read(c8a93930,ed74dcc8,c0f75630,e4340c90,0,...) at sys_read+0x5c/frame 0xed74dc40 syscall(ed74dd08) at syscall+0x2ed/frame 0xed74dcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed74dcfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819da07, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 841 tid 100091 td 0xc8a8cc40 sched_switch(c8a8cc40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed7ac9a0 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xed7ac9d4 sleepq_switch(c8a8cc40,0,c11a2855,1ab,ed7aca4c,...) at sleepq_switch+0x1c5/frame 0xed7aca08 sleepq_catch_signals(0,c11a2855,162,390,1,...) at sleepq_catch_signals+0x36c/frame 0xed7aca50 sleepq_wait_sig(c8435670,0,c11a7dfd,101,0,...) at sleepq_wait_sig+0x14/frame 0xed7aca74 _cv_wait_sig(c8435670,c14e35d0,c11a7de9,531,ed7acc10,...) at _cv_wait_sig+0x200/frame 0xed7acab8 tty_wait(c8435600,c8435670,ed7acc10,1,0,...) at tty_wait+0x4b/frame 0xed7acadc ttydisc_read(c8435600,ed7acc10,0,a1,0,...) at ttydisc_read+0x377/frame 0xed7acb20 ttydev_read(c854d400,ed7acc10,0,1,0,...) at ttydev_read+0x81/frame 0xed7acb40 devfs_read_f(c8a9caf0,ed7acc10,c82c0e80,0,c8a8cc40,...) at devfs_read_f+0x84/frame 0xed7acb74 dofileread(c8a9caf0,ed7acc10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xed7acba8 kern_readv(c8a8cc40,0,ed7acc10,0,bfbfddfb,...) at kern_readv+0x96/frame 0xed7acbf0 sys_read(c8a8cc40,ed7accc8,ef,afbe82d2,87,...) at sys_read+0x5c/frame 0xed7acc40 syscall(ed7acd08) at syscall+0x2ed/frame 0xed7accfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed7accfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819da07, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 840 tid 100111 td 0xc8b97c40 sched_switch(c8b97c40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84b19a0 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xf84b19d4 sleepq_switch(c8b97c40,0,c11a2855,1ab,f84b1a4c,...) at sleepq_switch+0x1c5/frame 0xf84b1a08 sleepq_catch_signals(0,c11a2855,162,3c0,1,...) at sleepq_catch_signals+0x36c/frame 0xf84b1a50 sleepq_wait_sig(c8435870,0,c11a7dfd,101,0,...) at sleepq_wait_sig+0x14/frame 0xf84b1a74 _cv_wait_sig(c8435870,c14e35d0,c11a7de9,531,f84b1c10,...) at _cv_wait_sig+0x200/frame 0xf84b1ab8 tty_wait(c8435800,c8435870,f84b1c10,1,0,...) at tty_wait+0x4b/frame 0xf84b1adc ttydisc_read(c8435800,f84b1c10,0,a1,0,...) at ttydisc_read+0x377/frame 0xf84b1b20 ttydev_read(c854d500,f84b1c10,0,1,0,...) at ttydev_read+0x81/frame 0xf84b1b40 devfs_read_f(c8a9db98,f84b1c10,c82c0e80,0,c8b97c40,...) at devfs_read_f+0x84/frame 0xf84b1b74 dofileread(c8a9db98,f84b1c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf84b1ba8 kern_readv(c8b97c40,0,f84b1c10,0,bfbfddfb,...) at kern_readv+0x96/frame 0xf84b1bf0 sys_read(c8b97c40,f84b1cc8,c0f75630,e433dc90,0,...) at sys_read+0x5c/frame 0xf84b1c40 syscall(f84b1d08) at syscall+0x2ed/frame 0xf84b1cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84b1cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819da07, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 839 tid 100122 td 0xc8b2f000 sched_switch(c8b2f000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84db9a0 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xf84db9d4 sleepq_switch(c8b2f000,0,c11a2855,1ab,f84dba4c,...) at sleepq_switch+0x1c5/frame 0xf84dba08 sleepq_catch_signals(0,c11a2855,162,3f0,1,...) at sleepq_catch_signals+0x36c/frame 0xf84dba50 sleepq_wait_sig(c8435a70,0,c11a7dfd,101,0,...) at sleepq_wait_sig+0x14/frame 0xf84dba74 _cv_wait_sig(c8435a70,c14e35d0,c11a7de9,531,f84dbc10,...) at _cv_wait_sig+0x200/frame 0xf84dbab8 tty_wait(c8435a00,c8435a70,f84dbc10,1,0,...) at tty_wait+0x4b/frame 0xf84dbadc ttydisc_read(c8435a00,f84dbc10,0,a1,0,...) at ttydisc_read+0x377/frame 0xf84dbb20 ttydev_read(c854d600,f84dbc10,0,1,0,...) at ttydev_read+0x81/frame 0xf84dbb40 devfs_read_f(c8aba7e0,f84dbc10,c82c0e80,0,c8b2f000,...) at devfs_read_f+0x84/frame 0xf84dbb74 dofileread(c8aba7e0,f84dbc10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf84dbba8 kern_readv(c8b2f000,0,f84dbc10,0,bfbfddfb,...) at kern_readv+0x96/frame 0xf84dbbf0 sys_read(c8b2f000,f84dbcc8,c11f8136,d6,0,...) at sys_read+0x5c/frame 0xf84dbc40 syscall(f84dbd08) at syscall+0x2ed/frame 0xf84dbcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84dbcfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819da07, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 838 tid 100118 td 0xc93e1000 sched_switch(c93e1000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84cd9a0 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xf84cd9d4 sleepq_switch(c93e1000,0,c11a2855,1ab,f84cda4c,...) at sleepq_switch+0x1c5/frame 0xf84cda08 sleepq_catch_signals(0,c11a2855,162,420,1,...) at sleepq_catch_signals+0x36c/frame 0xf84cda50 sleepq_wait_sig(c8435c70,0,c11a7dfd,101,0,...) at sleepq_wait_sig+0x14/frame 0xf84cda74 _cv_wait_sig(c8435c70,c14e35d0,c11a7de9,531,f84cdc10,...) at _cv_wait_sig+0x200/frame 0xf84cdab8 tty_wait(c8435c00,c8435c70,f84cdc10,1,0,...) at tty_wait+0x4b/frame 0xf84cdadc ttydisc_read(c8435c00,f84cdc10,0,a1,0,...) at ttydisc_read+0x377/frame 0xf84cdb20 ttydev_read(c854d700,f84cdc10,0,1,0,...) at ttydev_read+0x81/frame 0xf84cdb40 devfs_read_f(c8a9c9d8,f84cdc10,c82c0e80,0,c93e1000,...) at devfs_read_f+0x84/frame 0xf84cdb74 dofileread(c8a9c9d8,f84cdc10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf84cdba8 kern_readv(c93e1000,0,f84cdc10,0,bfbfddfb,...) at kern_readv+0x96/frame 0xf84cdbf0 sys_read(c93e1000,f84cdcc8,c0f75630,e433dc90,0,...) at sys_read+0x5c/frame 0xf84cdc40 syscall(f84cdd08) at syscall+0x2ed/frame 0xf84cdcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84cdcfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819da07, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 837 tid 100101 td 0xc9191620 sched_switch(c9191620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed7da9a0 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xed7da9d4 sleepq_switch(c9191620,0,c11a2855,1ab,ed7daa4c,...) at sleepq_switch+0x1c5/frame 0xed7daa08 sleepq_catch_signals(0,c11a2855,162,450,1,...) at sleepq_catch_signals+0x36c/frame 0xed7daa50 sleepq_wait_sig(c8435e70,0,c11a7dfd,101,0,...) at sleepq_wait_sig+0x14/frame 0xed7daa74 _cv_wait_sig(c8435e70,c14e35d0,c11a7de9,531,ed7dac10,...) at _cv_wait_sig+0x200/frame 0xed7daab8 tty_wait(c8435e00,c8435e70,ed7dac10,1,0,...) at tty_wait+0x4b/frame 0xed7daadc ttydisc_read(c8435e00,ed7dac10,0,a1,0,...) at ttydisc_read+0x377/frame 0xed7dab20 ttydev_read(c854d800,ed7dac10,0,1,0,...) at ttydev_read+0x81/frame 0xed7dab40 devfs_read_f(c8a9cb28,ed7dac10,c82c0e80,0,c9191620,...) at devfs_read_f+0x84/frame 0xed7dab74 dofileread(c8a9cb28,ed7dac10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xed7daba8 kern_readv(c9191620,0,ed7dac10,0,bfbfddfb,...) at kern_readv+0x96/frame 0xed7dabf0 sys_read(c9191620,ed7dacc8,c0f75630,e4343c90,0,...) at sys_read+0x5c/frame 0xed7dac40 syscall(ed7dad08) at syscall+0x2ed/frame 0xed7dacfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed7dacfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819da07, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 836 tid 100124 td 0xc93e0c40 sched_switch(c93e0c40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84e19a0 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xf84e19d4 sleepq_switch(c93e0c40,0,c11a2855,1ab,f84e1a4c,...) at sleepq_switch+0x1c5/frame 0xf84e1a08 sleepq_catch_signals(0,c11a2855,162,0,1,...) at sleepq_catch_signals+0x36c/frame 0xf84e1a50 sleepq_wait_sig(c8437070,0,c11a7dfd,101,0,...) at sleepq_wait_sig+0x14/frame 0xf84e1a74 _cv_wait_sig(c8437070,c14e35d0,c11a7de9,531,f84e1c10,...) at _cv_wait_sig+0x200/frame 0xf84e1ab8 tty_wait(c8437000,c8437070,f84e1c10,1,0,...) at tty_wait+0x4b/frame 0xf84e1adc ttydisc_read(c8437000,f84e1c10,0,a1,0,...) at ttydisc_read+0x377/frame 0xf84e1b20 ttydev_read(c854d900,f84e1c10,0,1,0,...) at ttydev_read+0x81/frame 0xf84e1b40 devfs_read_f(c8a9cbd0,f84e1c10,c82c0e80,0,c93e0c40,...) at devfs_read_f+0x84/frame 0xf84e1b74 dofileread(c8a9cbd0,f84e1c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf84e1ba8 kern_readv(c93e0c40,0,f84e1c10,0,bfbfddfb,...) at kern_readv+0x96/frame 0xf84e1bf0 sys_read(c93e0c40,f84e1cc8,c11f8136,d6,0,...) at sys_read+0x5c/frame 0xf84e1c40 syscall(f84e1d08) at syscall+0x2ed/frame 0xf84e1cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84e1cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819da07, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 835 tid 100127 td 0xc8a94620 sched_switch(c8a94620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84ea9a0 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xf84ea9d4 sleepq_switch(c8a94620,0,c11a2855,1ab,f84eaa4c,...) at sleepq_switch+0x1c5/frame 0xf84eaa08 sleepq_catch_signals(0,c11a2855,162,30,1,...) at sleepq_catch_signals+0x36c/frame 0xf84eaa50 sleepq_wait_sig(c8437270,0,c11a7dfd,101,0,...) at sleepq_wait_sig+0x14/frame 0xf84eaa74 _cv_wait_sig(c8437270,c14e35d0,c11a7de9,531,f84eac10,...) at _cv_wait_sig+0x200/frame 0xf84eaab8 tty_wait(c8437200,c8437270,f84eac10,1,0,...) at tty_wait+0x4b/frame 0xf84eaadc ttydisc_read(c8437200,f84eac10,0,a1,0,...) at ttydisc_read+0x377/frame 0xf84eab20 ttydev_read(c854da00,f84eac10,0,1,0,...) at ttydev_read+0x81/frame 0xf84eab40 devfs_read_f(c8ad6f50,f84eac10,c82c0e80,0,c8a94620,...) at devfs_read_f+0x84/frame 0xf84eab74 dofileread(c8ad6f50,f84eac10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf84eaba8 kern_readv(c8a94620,0,f84eac10,0,bfbfddfb,...) at kern_readv+0x96/frame 0xf84eabf0 sys_read(c8a94620,f84eacc8,c0f75630,e4340c90,0,...) at sys_read+0x5c/frame 0xf84eac40 syscall(f84ead08) at syscall+0x2ed/frame 0xf84eacfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84eacfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819da07, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 834 tid 100126 td 0xc8b97620 sched_switch(c8b97620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84e79a0 mi_switch(104,0,c11a2855,1f5,46,...) at mi_switch+0x1c9/frame 0xf84e79d4 sleepq_switch(c8b97620,0,c11a2855,1ab,c8437414,...) at sleepq_switch+0x1c5/frame 0xf84e7a08 sleepq_catch_signals(f84e7a74,c0aaf809,c8437414,0,0,...) at sleepq_catch_signals+0x36c/frame 0xf84e7a50 sleepq_wait_sig(c8437470,0,f84e7aa4,101,0,...) at sleepq_wait_sig+0x14/frame 0xf84e7a74 _cv_wait_sig(c8437470,c8437404,c11a7de9,531,f84e7c10,...) at _cv_wait_sig+0x200/frame 0xf84e7ab8 tty_wait(c8437400,c8437470,f84e7c10,1,0,...) at tty_wait+0x4b/frame 0xf84e7adc ttydisc_read(c8437400,f84e7c10,0,a1,0,...) at ttydisc_read+0x377/frame 0xf84e7b20 ttydev_read(c82d1b00,f84e7c10,0,1,0,...) at ttydev_read+0x81/frame 0xf84e7b40 devfs_read_f(c8af42d8,f84e7c10,c82c0e80,0,c8b97620,...) at devfs_read_f+0x84/frame 0xf84e7b74 dofileread(c8af42d8,f84e7c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf84e7ba8 kern_readv(c8b97620,0,f84e7c10,0,bfbfddfb,...) at kern_readv+0x96/frame 0xf84e7bf0 sys_read(c8b97620,f84e7cc8,c0f75630,c1825c90,0,...) at sys_read+0x5c/frame 0xf84e7c40 syscall(f84e7d08) at syscall+0x2ed/frame 0xf84e7cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84e7cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2819da07, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command inetd pid 817 tid 100109 td 0xc8b9e000 sched_switch(c8b9e000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84ab904 mi_switch(104,0,c11a2855,1f5,46,...) at mi_switch+0x1c9/frame 0xf84ab938 sleepq_switch(c8b9e000,0,c11a2855,1ab,c8a416e0,...) at sleepq_switch+0x1c5/frame 0xf84ab96c sleepq_catch_signals(f84ab9d8,c0aaf809,c8a416e0,0,0,...) at sleepq_catch_signals+0x36c/frame 0xf84ab9b4 sleepq_wait_sig(c8a416e4,0,f84aba08,101,0,...) at sleepq_wait_sig+0x14/frame 0xf84ab9d8 _cv_wait_sig(c8a416e4,c8a416d0,c11a5c63,6d8,c0b2631d,...) at _cv_wait_sig+0x200/frame 0xf84aba1c seltdwait(ffffffff,0,0,c8b9e000,f84abbc8,...) at seltdwait+0x90/frame 0xf84aba50 kern_select(c8b9e000,8,bfbfd070,0,0,...) at kern_select+0x883/frame 0xf84abbf8 sys_select(c8b9e000,f84abcc8,c0f75630,e4343c90,0,...) at sys_select+0x69/frame 0xf84abc40 syscall(f84abd08) at syscall+0x2ed/frame 0xf84abcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84abcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281b09c7, esp = 0xbfbfd014, ebp = 0xbfbfde34 --- Tracing command watchdogd pid 792 tid 100114 td 0xc8b97930 sched_switch(c8b97930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84bfa64 mi_switch(104,0,c11a2855,1f5,c0b0a9c0,...) at mi_switch+0x1c9/frame 0xf84bfa98 sleepq_switch(c8b97930,0,c11a2855,1ab,8,...) at sleepq_switch+0x1c5/frame 0xf84bfacc sleepq_catch_signals(c0b0a9c0,c8b97930,3,201,3,...) at sleepq_catch_signals+0x36c/frame 0xf84bfb14 sleepq_timedwait_sig(c1314503,6c,358,c0000000,3,...) at sleepq_timedwait_sig+0x14/frame 0xf84bfb3c _sleep(c1314503,0,16c,c119dd66,ca9def1e,...) at _sleep+0x33c/frame 0xf84bfb98 kern_nanosleep(bfbfdcb0,f84bfc18,f84bfc20,c8b657c0,3c,...) at kern_nanosleep+0x158/frame 0xf84bfc00 sys_nanosleep(c8b97930,f84bfcc8,c11f8136,e9,0,...) at sys_nanosleep+0x6b/frame 0xf84bfc40 syscall(f84bfd08) at syscall+0x2ed/frame 0xf84bfcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84bfcfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28178d43, esp = 0xbfbfdca4, ebp = 0xbfbfdce8 --- Tracing command cron pid 741 tid 100113 td 0xc93e1c40 sched_switch(c93e1c40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84baa64 mi_switch(104,0,c11a2855,1f5,c0b0a9c0,...) at mi_switch+0x1c9/frame 0xf84baa98 sleepq_switch(c93e1c40,0,c11a2855,1ab,8,...) at sleepq_switch+0x1c5/frame 0xf84baacc sleepq_catch_signals(c0b0a9c0,c93e1c40,0,201,0,...) at sleepq_catch_signals+0x36c/frame 0xf84bab14 sleepq_timedwait_sig(c1314500,6c,36a,8fbeabc2,4,...) at sleepq_timedwait_sig+0x14/frame 0xf84bab3c _sleep(c1314500,0,16c,c119dd66,545b8a7a,...) at _sleep+0x33c/frame 0xf84bab98 kern_nanosleep(bfbfde28,f84bac18,f84bac20,f84bacc8,48,...) at kern_nanosleep+0x158/frame 0xf84bac00 sys_nanosleep(c93e1c40,f84bacc8,ef,128ca1d0,2ee,...) at sys_nanosleep+0x6b/frame 0xf84bac40 syscall(f84bad08) at syscall+0x2ed/frame 0xf84bacfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84bacfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28187d43, esp = 0xbfbfdcb4, ebp = 0xbfbfde44 --- Tracing command sendmail pid 736 tid 100112 td 0xc93e2000 sched_switch(c93e2000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84b5aa0 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xf84b5ad4 sleepq_switch(c93e2000,0,c11a2855,1ab,f84b5b4c,...) at sleepq_switch+0x1c5/frame 0xf84b5b08 sleepq_catch_signals(0,c11a2855,162,1368,c891834c,...) at sleepq_catch_signals+0x36c/frame 0xf84b5b50 sleepq_wait_sig(c891834c,74,c0fc89b4,100,0,...) at sleepq_wait_sig+0x14/frame 0xf84b5b74 _sleep(c891834c,c891837c,174,c0fc89b4,0,...) at _sleep+0x364/frame 0xf84b5bd0 kern_sigsuspend(c93e2000,0,0,0,0,...) at kern_sigsuspend+0xfb/frame 0xf84b5c10 sys_sigsuspend(c93e2000,f84b5cc8,1,0,c93e2000,...) at sys_sigsuspend+0x58/frame 0xf84b5c40 syscall(f84b5d08) at syscall+0x2ed/frame 0xf84b5cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84b5cfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2835a65b, esp = 0xbfbfc9dc, ebp = 0xbfbfca08 --- Tracing command sendmail pid 733 tid 100110 td 0xc93e2310 sched_switch(c93e2310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84ae8f8 mi_switch(104,0,c11a2855,1f5,3fe,...) at mi_switch+0x1c9/frame 0xf84ae92c sleepq_switch(c93e2310,0,c11a2855,1ab,c119a0e5,...) at sleepq_switch+0x1c5/frame 0xf84ae960 sleepq_catch_signals(c12a3eb0,f84ae9d0,c0aaf809,c8f86ba0,0,...) at sleepq_catch_signals+0x36c/frame 0xf84ae9a8 sleepq_timedwait_sig(c8f86ba4,0,f84aea08,50000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf84ae9d0 _cv_timedwait_sig_sbt(c8f86ba4,c8f86b90,61a820cb,33a,50000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xf84aea1c seltdwait(33a,50000000,0,c93e2310,f84aebc8,...) at seltdwait+0xbc/frame 0xf84aea50 kern_select(c93e2310,5,bfbfbfc8,0,0,...) at kern_select+0x883/frame 0xf84aebf8 sys_select(c93e2310,f84aecc8,f84aec8c,c0a94b70,c1321510,...) at sys_select+0x69/frame 0xf84aec40 syscall(f84aed08) at syscall+0x2ed/frame 0xf84aecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84aecfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284229c7, esp = 0xbfbfbf2c, ebp = 0xbfbfc9e8 --- Tracing command sshd pid 730 tid 100108 td 0xc93e2620 sched_switch(c93e2620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xf84a7904 mi_switch(104,0,c11a2855,1f5,200046,...) at mi_switch+0x1c9/frame 0xf84a7938 sleepq_switch(c93e2620,0,c11a2855,1ab,c8f86c20,...) at sleepq_switch+0x1c5/frame 0xf84a796c sleepq_catch_signals(f84a79d8,c0aaf809,c8f86c20,0,0,...) at sleepq_catch_signals+0x36c/frame 0xf84a79b4 sleepq_wait_sig(c8f86c24,0,f84a7a08,101,0,...) at sleepq_wait_sig+0x14/frame 0xf84a79d8 _cv_wait_sig(c8f86c24,c8f86c10,c11a5c63,6d8,c0b2631d,...) at _cv_wait_sig+0x200/frame 0xf84a7a1c seltdwait(ffffffff,0,0,c93e2620,f84a7bc8,...) at seltdwait+0x90/frame 0xf84a7a50 kern_select(c93e2620,7,28c0c148,0,0,...) at kern_select+0x883/frame 0xf84a7bf8 sys_select(c93e2620,f84a7cc8,0,0,0,...) at sys_select+0x69/frame 0xf84a7c40 syscall(f84a7d08) at syscall+0x2ed/frame 0xf84a7cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf84a7cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x285329c7, esp = 0xbfbfd424, ebp = 0xbfbfde44 --- Tracing command moused pid 698 tid 100106 td 0xc8b9e310 sched_switch(c8b9e310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed7ea904 mi_switch(104,0,c11a2855,1f5,46,...) at mi_switch+0x1c9/frame 0xed7ea938 sleepq_switch(c8b9e310,0,c11a2855,1ab,c8f86de0,...) at sleepq_switch+0x1c5/frame 0xed7ea96c sleepq_catch_signals(ed7ea9d8,c0aaf809,c8f86de0,0,0,...) at sleepq_catch_signals+0x36c/frame 0xed7ea9b4 sleepq_wait_sig(c8f86de4,0,ed7eaa08,101,0,...) at sleepq_wait_sig+0x14/frame 0xed7ea9d8 _cv_wait_sig(c8f86de4,c8f86dd0,c11a5c63,6d8,c8b9e310,...) at _cv_wait_sig+0x200/frame 0xed7eaa1c seltdwait(ffffffff,0,0,c8b9e310,ed7eabc8,...) at seltdwait+0x90/frame 0xed7eaa50 kern_select(c8b9e310,400,bfbfdcb0,0,0,...) at kern_select+0x883/frame 0xed7eabf8 sys_select(c8b9e310,ed7eacc8,c0f75630,e433dc90,0,...) at sys_select+0x69/frame 0xed7eac40 syscall(ed7ead08) at syscall+0x2ed/frame 0xed7eacfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed7eacfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281c29c7, esp = 0xbfbfd894, ebp = 0xbfbfde24 --- Tracing command smartd pid 690 tid 100078 td 0xc882f930 sched_switch(c882f930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed730a64 mi_switch(104,0,c11a2855,1f5,c0b0a9c0,...) at mi_switch+0x1c9/frame 0xed730a98 sleepq_switch(c882f930,0,c11a2855,1ab,8,...) at sleepq_switch+0x1c5/frame 0xed730acc sleepq_catch_signals(c0b0a9c0,c882f930,2,201,2,...) at sleepq_catch_signals+0x36c/frame 0xed730b14 sleepq_timedwait_sig(c1314502,6c,71c,80000000,70,...) at sleepq_timedwait_sig+0x14/frame 0xed730b3c _sleep(c1314502,0,16c,c119dd66,1ed0511,...) at _sleep+0x33c/frame 0xed730b98 kern_nanosleep(bfbf53c8,ed730c18,ed730c20,ed730cc8,708,...) at kern_nanosleep+0x158/frame 0xed730c00 sys_nanosleep(c882f930,ed730cc8,c0f75630,e4340c90,0,...) at sys_nanosleep+0x6b/frame 0xed730c40 syscall(ed730d08) at syscall+0x2ed/frame 0xed730cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed730cfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x282f0d43, esp = 0xbfbf53bc, ebp = 0xbfbf5400 --- Tracing command winbindd pid 688 tid 100099 td 0xc8b9e930 sched_switch(c8b9e930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed7d2960 mi_switch(104,0,c11a2855,1f5,3fe,...) at mi_switch+0x1c9/frame 0xed7d2994 sleepq_switch(c8b9e930,0,c11a2855,1ab,c119a0e5,...) at sleepq_switch+0x1c5/frame 0xed7d29c8 sleepq_catch_signals(c12a3eb0,ed7d2a38,c0aaf809,c8a41a60,0,...) at sleepq_catch_signals+0x36c/frame 0xed7d2a10 sleepq_timedwait_sig(c8a41a64,0,ed7d2a70,b7fbe76c,20c49,...) at sleepq_timedwait_sig+0x14/frame 0xed7d2a38 _cv_timedwait_sig_sbt(c8a41a64,c8a41a50,22bb8d7,20c708,b7fbe76c,...) at _cv_timedwait_sig_sbt+0x228/frame 0xed7d2a84 seltdwait(20c708,b7fbe76c,20c49,c8b9e930,0,...) at seltdwait+0xbc/frame 0xed7d2ab8 sys_poll(c8b9e930,ed7d2cc8,c0f75630,e4343c90,0,...) at sys_poll+0x46d/frame 0xed7d2c40 syscall(ed7d2d08) at syscall+0x2ed/frame 0xed7d2cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed7d2cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2193bb1f, esp = 0xbfbfc47c, ebp = 0xbfbfc4b8 --- Tracing command smbd pid 687 tid 100105 td 0xc8b2f930 sched_switch(c8b2f930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed7e7960 mi_switch(104,0,c11a2855,1f5,3fe,...) at mi_switch+0x1c9/frame 0xed7e7994 sleepq_switch(c8b2f930,0,c11a2855,1ab,c119a0e5,...) at sleepq_switch+0x1c5/frame 0xed7e79c8 sleepq_catch_signals(c12a3eb0,ed7e7a38,c0aaf809,c8f86ce0,0,...) at sleepq_catch_signals+0x36c/frame 0xed7e7a10 sleepq_timedwait_sig(c8f86ce4,0,ed7e7a70,b7fbe76c,20c49,...) at sleepq_timedwait_sig+0x14/frame 0xed7e7a38 _cv_timedwait_sig_sbt(c8f86ce4,c8f86cd0,e9597557,20c4ae,b7fbe76c,...) at _cv_timedwait_sig_sbt+0x228/frame 0xed7e7a84 seltdwait(20c4ae,b7fbe76c,20c49,c8b2f930,0,...) at seltdwait+0xbc/frame 0xed7e7ab8 sys_poll(c8b2f930,ed7e7cc8,0,0,0,...) at sys_poll+0x46d/frame 0xed7e7c40 syscall(ed7e7d08) at syscall+0x2ed/frame 0xed7e7cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed7e7cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x21b64b1f, esp = 0xbfbfd9ec, ebp = 0xbfbfda28 --- Tracing command winbindd pid 676 tid 100098 td 0xc9191930 sched_switch(c9191930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed7ce960 mi_switch(104,0,c11a2855,1f5,3fe,...) at mi_switch+0x1c9/frame 0xed7ce994 sleepq_switch(c9191930,0,c11a2855,1ab,c119a0e5,...) at sleepq_switch+0x1c5/frame 0xed7ce9c8 sleepq_catch_signals(c12a3eb0,ed7cea38,c0aaf809,c8f86c60,0,...) at sleepq_catch_signals+0x36c/frame 0xed7cea10 sleepq_timedwait_sig(c8f86c64,0,ed7cea70,bfffea52,12,...) at sleepq_timedwait_sig+0x14/frame 0xed7cea38 _cv_timedwait_sig_sbt(c8f86c64,c8f86c50,826be72e,398,bfffea52,...) at _cv_timedwait_sig_sbt+0x228/frame 0xed7cea84 seltdwait(398,bfffea52,12,c9191930,0,...) at seltdwait+0xbc/frame 0xed7ceab8 sys_poll(c9191930,ed7cecc8,c0f75630,e4340c90,0,...) at sys_poll+0x46d/frame 0xed7cec40 syscall(ed7ced08) at syscall+0x2ed/frame 0xed7cecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed7cecfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2193bb1f, esp = 0xbfbfdbcc, ebp = 0xbfbfdc08 --- Tracing command smbd pid 674 tid 100097 td 0xc9191c40 sched_switch(c9191c40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed7ca960 mi_switch(104,0,c11a2855,1f5,3fe,...) at mi_switch+0x1c9/frame 0xed7ca994 sleepq_switch(c9191c40,0,c11a2855,1ab,c119a0e5,...) at sleepq_switch+0x1c5/frame 0xed7ca9c8 sleepq_catch_signals(c12a3eb0,ed7caa38,c0aaf809,c8f86ea0,0,...) at sleepq_catch_signals+0x36c/frame 0xed7caa10 sleepq_timedwait_sig(c8f86ea4,0,ed7caa70,bfdf370e,3,...) at sleepq_timedwait_sig+0x14/frame 0xed7caa38 _cv_timedwait_sig_sbt(c8f86ea4,c8f86e90,c478cc47,35c,bfdf370e,...) at _cv_timedwait_sig_sbt+0x228/frame 0xed7caa84 seltdwait(35c,bfdf370e,3,c9191c40,0,...) at seltdwait+0xbc/frame 0xed7caab8 sys_poll(c9191c40,ed7cacc8,0,0,c9191c40,...) at sys_poll+0x46d/frame 0xed7cac40 syscall(ed7cad08) at syscall+0x2ed/frame 0xed7cacfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed7cacfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x21b64b1f, esp = 0xbfbfda9c, ebp = 0xbfbfdad8 --- Tracing command nmbd pid 672 tid 100102 td 0xc8831c40 sched_switch(c8831c40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed7de960 mi_switch(104,0,c11a2855,1f5,3fe,...) at mi_switch+0x1c9/frame 0xed7de994 sleepq_switch(c8831c40,0,c11a2855,1ab,c119a0e5,...) at sleepq_switch+0x1c5/frame 0xed7de9c8 sleepq_catch_signals(c12a3eb0,ed7dea38,c0aaf809,c8b872e0,0,...) at sleepq_catch_signals+0x36c/frame 0xed7dea10 sleepq_timedwait_sig(c8b872e4,0,ed7dea70,9fffff47,0,...) at sleepq_timedwait_sig+0x14/frame 0xed7dea38 _cv_timedwait_sig_sbt(c8b872e4,c8b872d0,66022ebc,33a,9fffff47,...) at _cv_timedwait_sig_sbt+0x228/frame 0xed7dea84 seltdwait(33a,9fffff47,0,c8831c40,0,...) at seltdwait+0xbc/frame 0xed7deab8 sys_poll(c8831c40,ed7decc8,ed7dec8c,c0a94b70,c1321c10,...) at sys_poll+0x46d/frame 0xed7dec40 syscall(ed7ded08) at syscall+0x2ed/frame 0xed7decfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed7decfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x21564b1f, esp = 0xbfbfdb1c, ebp = 0xbfbfdb58 --- Tracing command powerd pid 649 tid 100100 td 0xc8b9e620 sched_switch(c8b9e620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed7d68f8 mi_switch(104,0,c11a2855,1f5,3fe,...) at mi_switch+0x1c9/frame 0xed7d692c sleepq_switch(c8b9e620,0,c11a2855,1ab,c119a0e5,...) at sleepq_switch+0x1c5/frame 0xed7d6960 sleepq_catch_signals(c12a3eb0,ed7d69d0,c0aaf809,c8a41ee0,0,...) at sleepq_catch_signals+0x36c/frame 0xed7d69a8 sleepq_timedwait_sig(c8a41ee4,0,ed7d6a08,3ffffff,0,...) at sleepq_timedwait_sig+0x14/frame 0xed7d69d0 _cv_timedwait_sig_sbt(c8a41ee4,c8a41ed0,b7ac61f6,339,3ffffff,...) at _cv_timedwait_sig_sbt+0x228/frame 0xed7d6a1c seltdwait(339,3ffffff,0,c0aabb84,c1babd20,...) at seltdwait+0xbc/frame 0xed7d6a50 kern_select(c8b9e620,0,bfbfdd90,0,bfbfdd90,...) at kern_select+0x883/frame 0xed7d6bf8 sys_select(c8b9e620,ed7d6cc8,c0f75630,e4340c90,0,...) at sys_select+0x69/frame 0xed7d6c40 syscall(ed7d6d08) at syscall+0x2ed/frame 0xed7d6cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed7d6cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2819b9c7, esp = 0xbfbfdd0c, ebp = 0xbfbfde44 --- Tracing command ntpd pid 646 tid 100088 td 0xc8a93620 sched_switch(c8a93620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed795904 mi_switch(104,0,c11a2855,1f5,200046,...) at mi_switch+0x1c9/frame 0xed795938 sleepq_switch(c8a93620,0,c11a2855,1ab,c8f86ee0,...) at sleepq_switch+0x1c5/frame 0xed79596c sleepq_catch_signals(ed7959d8,c0aaf809,c8f86ee0,0,0,...) at sleepq_catch_signals+0x36c/frame 0xed7959b4 sleepq_wait_sig(c8f86ee4,0,ed795a08,101,0,...) at sleepq_wait_sig+0x14/frame 0xed7959d8 _cv_wait_sig(c8f86ee4,c8f86ed0,c11a5c63,6d8,c0b2631d,...) at _cv_wait_sig+0x200/frame 0xed795a1c seltdwait(ffffffff,0,0,c8a93620,ed795bc8,...) at seltdwait+0x90/frame 0xed795a50 kern_select(c8a93620,1c,bfbfdd48,0,0,...) at kern_select+0x883/frame 0xed795bf8 sys_select(c8a93620,ed795cc8,0,0,c8a93620,...) at sys_select+0x69/frame 0xed795c40 syscall(ed795d08) at syscall+0x2ed/frame 0xed795cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed795cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x283a09c7, esp = 0xbfbfdd24, ebp = 0xbfbfdde4 --- Tracing command nfsd pid 590 tid 100096 td 0xc8a8c000 sched_switch(c8a8c000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed7c5a8c mi_switch(104,0,c11a2855,1f5,c0b0a9c0,...) at mi_switch+0x1c9/frame 0xed7c5ac0 sleepq_switch(c8a8c000,0,c11a2855,1ab,c119a0e5,...) at sleepq_switch+0x1c5/frame 0xed7c5af4 sleepq_catch_signals(c12a3eb0,ed7c5b64,c0aaf809,c8487e90,0,...) at sleepq_catch_signals+0x36c/frame 0xed7c5b3c sleepq_timedwait_sig(c8ad7f50,0,ed7c5b9c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xed7c5b64 _cv_timedwait_sig_sbt(c8ad7f50,c8487e80,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x228/frame 0xed7c5bb0 svc_run_internal(ed7c5cf4,c0a9249f,c8487e80,ed7c5d08,c1195f04,...) at svc_run_internal+0xa86/frame 0xed7c5cc4 svc_thread_start(c8487e80,ed7c5d08,c1195f04,3d5,0,...) at svc_thread_start+0xd/frame 0xed7c5ccc fork_exit(c0ce51f0,c8487e80,ed7c5d08) at fork_exit+0x7f/frame 0xed7c5cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed7c5cf4 --- trap 0xa683ce2e, eip = 0xc, esp = 0x33, ebp = 0xbfbfd937 --- Tracing command nfsd pid 590 tid 100095 td 0xc8a8c310 sched_switch(c8a8c310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed7c2a8c mi_switch(104,0,c11a2855,1f5,c0b0a9c0,...) at mi_switch+0x1c9/frame 0xed7c2ac0 sleepq_switch(c8a8c310,0,c11a2855,1ab,c119a0e5,...) at sleepq_switch+0x1c5/frame 0xed7c2af4 sleepq_catch_signals(c12a3eb0,ed7c2b64,c0aaf809,c8487e90,0,...) at sleepq_catch_signals+0x36c/frame 0xed7c2b3c sleepq_timedwait_sig(c8ad8010,0,ed7c2b9c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xed7c2b64 _cv_timedwait_sig_sbt(c8ad8010,c8487e80,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x228/frame 0xed7c2bb0 svc_run_internal(ed7c2cf4,c0a9249f,c8487e80,ed7c2d08,c1195f04,...) at svc_run_internal+0xa86/frame 0xed7c2cc4 svc_thread_start(c8487e80,ed7c2d08,c1195f04,3d5,0,...) at svc_thread_start+0xd/frame 0xed7c2ccc fork_exit(c0ce51f0,c8487e80,ed7c2d08) at fork_exit+0x7f/frame 0xed7c2cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed7c2cf4 --- trap 0xa683ce2e, eip = 0xc, esp = 0x33, ebp = 0xbfbfd937 --- Tracing command nfsd pid 590 tid 100094 td 0xc8a8c620 sched_switch(c8a8c620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed7bfa8c mi_switch(104,0,c11a2855,1f5,c0b0a9c0,...) at mi_switch+0x1c9/frame 0xed7bfac0 sleepq_switch(c8a8c620,0,c11a2855,1ab,c119a0e5,...) at sleepq_switch+0x1c5/frame 0xed7bfaf4 sleepq_catch_signals(c12a3eb0,ed7bfb64,c0aaf809,c8487e90,0,...) at sleepq_catch_signals+0x36c/frame 0xed7bfb3c sleepq_timedwait_sig(c8ad8050,0,ed7bfb9c,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xed7bfb64 _cv_timedwait_sig_sbt(c8ad8050,c8487e80,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x228/frame 0xed7bfbb0 svc_run_internal(ed7bfcf4,c0a9249f,c8487e80,ed7bfd08,c1195f04,...) at svc_run_internal+0xa86/frame 0xed7bfcc4 svc_thread_start(c8487e80,ed7bfd08,c1195f04,3d5,0,...) at svc_thread_start+0xd/frame 0xed7bfccc fork_exit(c0ce51f0,c8487e80,ed7bfd08) at fork_exit+0x7f/frame 0xed7bfcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed7bfcf4 --- trap 0xa683ce2e, eip = 0xc, esp = 0x33, ebp = 0xbfbfd937 --- Tracing command nfsd pid 590 tid 100085 td 0xc882f310 sched_switch(c882f310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed76c2e4 mi_switch(104,0,c11a2855,1f5,c0b0a9c0,...) at mi_switch+0x1c9/frame 0xed76c318 sleepq_switch(c882f310,0,c11a2855,1ab,c119a0e5,...) at sleepq_switch+0x1c5/frame 0xed76c34c sleepq_catch_signals(c12a3eb0,ed76c3bc,c0aaf809,c8487e90,0,...) at sleepq_catch_signals+0x36c/frame 0xed76c394 sleepq_timedwait_sig(c8b90090,0,ed76c3f4,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xed76c3bc _cv_timedwait_sig_sbt(c8b90090,c8487e80,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x228/frame 0xed76c408 svc_run_internal(c0ce51f0,c8487e80,c8916ba0,ed76c548,0,...) at svc_run_internal+0xa86/frame 0xed76c51c svc_run(c8487e80,0,c11876fd,1b5,ff0,...) at svc_run+0xc3/frame 0xed76c558 nfsrvd_nfsd(c882f310,ed76c6c0,c,ed58104c,0,...) at nfsrvd_nfsd+0x1a2/frame 0xed76c690 nfssvc_nfsd(c882f310,ed76ccc8,0,c882f310,ed76ccfc,...) at nfssvc_nfsd+0x11c/frame 0xed76cc28 sys_nfssvc(c882f310,ed76ccc8,c11f8136,d6,0,...) at sys_nfssvc+0xbf/frame 0xed76cc40 syscall(ed76cd08) at syscall+0x2ed/frame 0xed76ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed76ccfc --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280c2c8b, esp = 0xbfbfd7e4, ebp = 0xbfbfda58 --- Tracing command nfsd pid 585 tid 100087 td 0xc882f000 sched_switch(c882f000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed791904 mi_switch(104,0,c11a2855,1f5,46,...) at mi_switch+0x1c9/frame 0xed791938 sleepq_switch(c882f000,0,c11a2855,1ab,c84af360,...) at sleepq_switch+0x1c5/frame 0xed79196c sleepq_catch_signals(ed7919d8,c0aaf809,c84af360,0,0,...) at sleepq_catch_signals+0x36c/frame 0xed7919b4 sleepq_wait_sig(c84af364,0,ed791a08,101,0,...) at sleepq_wait_sig+0x14/frame 0xed7919d8 _cv_wait_sig(c84af364,c84af350,c11a5c63,6d8,c0b2631d,...) at _cv_wait_sig+0x200/frame 0xed791a1c seltdwait(ffffffff,0,0,c882f000,ed791bc8,...) at seltdwait+0x90/frame 0xed791a50 kern_select(c882f000,7,bfbfdc30,0,0,...) at kern_select+0x883/frame 0xed791bf8 sys_select(c882f000,ed791cc8,c0f75630,c1825c90,0,...) at sys_select+0x69/frame 0xed791c40 syscall(ed791d08) at syscall+0x2ed/frame 0xed791cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed791cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2818a9c7, esp = 0xbfbfda5c, ebp = 0xbfbfde34 --- Tracing command mountd pid 579 tid 100084 td 0xc8b9ec40 sched_switch(c8b9ec40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed769904 mi_switch(104,0,c11a2855,1f5,46,...) at mi_switch+0x1c9/frame 0xed769938 sleepq_switch(c8b9ec40,0,c11a2855,1ab,c8a42020,...) at sleepq_switch+0x1c5/frame 0xed76996c sleepq_catch_signals(ed7699d8,c0aaf809,c8a42020,0,0,...) at sleepq_catch_signals+0x36c/frame 0xed7699b4 sleepq_wait_sig(c8a42024,0,ed769a08,101,0,...) at sleepq_wait_sig+0x14/frame 0xed7699d8 _cv_wait_sig(c8a42024,c8a42010,c11a5c63,6d8,c0b2631d,...) at _cv_wait_sig+0x200/frame 0xed769a1c seltdwait(ffffffff,0,0,c8b9ec40,ed769bc8,...) at seltdwait+0x90/frame 0xed769a50 kern_select(c8b9ec40,9,bfbfdd50,0,0,...) at kern_select+0x883/frame 0xed769bf8 sys_select(c8b9ec40,ed769cc8,0,0,c8b9ec40,...) at sys_select+0x69/frame 0xed769c40 syscall(ed769d08) at syscall+0x2ed/frame 0xed769cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed769cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a19c7, esp = 0xbfbfdd0c, ebp = 0xbfbfde34 --- Tracing command nfsuserd pid 572 tid 100093 td 0xc8b38000 sched_switch(c8b38000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed7bb8f8 mi_switch(104,0,c11a2855,1f5,3fe,...) at mi_switch+0x1c9/frame 0xed7bb92c sleepq_switch(c8b38000,0,c11a2855,1ab,c119a0e5,...) at sleepq_switch+0x1c5/frame 0xed7bb960 sleepq_catch_signals(c12a3eb0,ed7bb9d0,c0aaf809,c8b873a0,0,...) at sleepq_catch_signals+0x36c/frame 0xed7bb9a8 sleepq_timedwait_sig(c8b873a4,0,ed7bba08,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xed7bb9d0 _cv_timedwait_sig_sbt(c8b873a4,c8b87390,9bc50503,33a,e0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xed7bba1c seltdwait(33a,e0000000,1,c8b38000,ed7bbbc8,...) at seltdwait+0xbc/frame 0xed7bba50 kern_select(c8b38000,4,bfbfdc10,0,0,...) at kern_select+0x883/frame 0xed7bbbf8 sys_select(c8b38000,ed7bbcc8,7bb,2,ed7bbcc4,...) at sys_select+0x69/frame 0xed7bbc40 syscall(ed7bbd08) at syscall+0x2ed/frame 0xed7bbcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed7bbcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281899c7, esp = 0xbfbfdb6c, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 571 tid 100077 td 0xc8b38930 sched_switch(c8b38930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed72b8f8 mi_switch(104,0,c11a2855,1f5,3fe,...) at mi_switch+0x1c9/frame 0xed72b92c sleepq_switch(c8b38930,0,c11a2855,1ab,c119a0e5,...) at sleepq_switch+0x1c5/frame 0xed72b960 sleepq_catch_signals(c12a3eb0,ed72b9d0,c0aaf809,c8a420a0,0,...) at sleepq_catch_signals+0x36c/frame 0xed72b9a8 sleepq_timedwait_sig(c8a420a4,0,ed72ba08,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xed72b9d0 _cv_timedwait_sig_sbt(c8a420a4,c8a42090,4c68a2f5,33b,e0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xed72ba1c seltdwait(33b,e0000000,1,c8b38930,ed72bbc8,...) at seltdwait+0xbc/frame 0xed72ba50 kern_select(c8b38930,4,bfbfdc10,0,0,...) at kern_select+0x883/frame 0xed72bbf8 sys_select(c8b38930,ed72bcc8,c0f75630,c1825c90,0,...) at sys_select+0x69/frame 0xed72bc40 syscall(ed72bd08) at syscall+0x2ed/frame 0xed72bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed72bcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281899c7, esp = 0xbfbfdb6c, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 570 tid 100089 td 0xc8a93310 sched_switch(c8a93310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed7988f8 mi_switch(104,0,c11a2855,1f5,3fe,...) at mi_switch+0x1c9/frame 0xed79892c sleepq_switch(c8a93310,0,c11a2855,1ab,c119a0e5,...) at sleepq_switch+0x1c5/frame 0xed798960 sleepq_catch_signals(c12a3eb0,ed7989d0,c0aaf809,c8a42160,0,...) at sleepq_catch_signals+0x36c/frame 0xed7989a8 sleepq_timedwait_sig(c8a42164,0,ed798a08,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xed7989d0 _cv_timedwait_sig_sbt(c8a42164,c8a42150,5d8fdb67,33a,e0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xed798a1c seltdwait(33a,e0000000,1,c8a93310,ed798bc8,...) at seltdwait+0xbc/frame 0xed798a50 kern_select(c8a93310,4,bfbfdc10,0,0,...) at kern_select+0x883/frame 0xed798bf8 sys_select(c8a93310,ed798cc8,c0f75630,e4340c90,0,...) at sys_select+0x69/frame 0xed798c40 syscall(ed798d08) at syscall+0x2ed/frame 0xed798cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed798cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281899c7, esp = 0xbfbfdb6c, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 569 tid 100090 td 0xc8a93000 sched_switch(c8a93000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed7a98f8 mi_switch(104,0,c11a2855,1f5,3fe,...) at mi_switch+0x1c9/frame 0xed7a992c sleepq_switch(c8a93000,0,c11a2855,1ab,c119a0e5,...) at sleepq_switch+0x1c5/frame 0xed7a9960 sleepq_catch_signals(c12a3eb0,ed7a99d0,c0aaf809,c8a420e0,0,...) at sleepq_catch_signals+0x36c/frame 0xed7a99a8 sleepq_timedwait_sig(c8a420e4,0,ed7a9a08,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xed7a99d0 _cv_timedwait_sig_sbt(c8a420e4,c8a420d0,de96013d,33a,e0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xed7a9a1c seltdwait(33a,e0000000,1,c8a93000,ed7a9bc8,...) at seltdwait+0xbc/frame 0xed7a9a50 kern_select(c8a93000,4,bfbfdc10,0,0,...) at kern_select+0x883/frame 0xed7a9bf8 sys_select(c8a93000,ed7a9cc8,c11f8136,d6,0,...) at sys_select+0x69/frame 0xed7a9c40 syscall(ed7a9d08) at syscall+0x2ed/frame 0xed7a9cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed7a9cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281899c7, esp = 0xbfbfdb6c, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 568 tid 100092 td 0xc8a8c930 sched_switch(c8a8c930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed7b5aa0 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xed7b5ad4 sleepq_switch(c8a8c930,0,c11a2855,1ab,ed7b5b4c,...) at sleepq_switch+0x1c5/frame 0xed7b5b08 sleepq_catch_signals(0,c11a2855,162,14e8,c8a8934c,...) at sleepq_catch_signals+0x36c/frame 0xed7b5b50 sleepq_wait_sig(c8a8934c,74,c0fc89b4,100,0,...) at sleepq_wait_sig+0x14/frame 0xed7b5b74 _sleep(c8a8934c,c8a8937c,174,c0fc89b4,0,...) at _sleep+0x364/frame 0xed7b5bd0 kern_sigsuspend(c8a8c930,0,0,0,0,...) at kern_sigsuspend+0xfb/frame 0xed7b5c10 sys_sigsuspend(c8a8c930,ed7b5cc8,c0f75630,e433dc90,0,...) at sys_sigsuspend+0x58/frame 0xed7b5c40 syscall(ed7b5d08) at syscall+0x2ed/frame 0xed7b5cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed7b5cfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x280c165b, esp = 0xbfbfdcac, ebp = 0xbfbfde44 --- Tracing command rpcbind pid 540 tid 100080 td 0xc882f620 sched_switch(c882f620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed73e960 mi_switch(104,0,c11a2855,1f5,3fe,...) at mi_switch+0x1c9/frame 0xed73e994 sleepq_switch(c882f620,0,c11a2855,1ab,c119a0e5,...) at sleepq_switch+0x1c5/frame 0xed73e9c8 sleepq_catch_signals(c12a3eb0,ed73ea38,c0aaf809,c8a422e0,0,...) at sleepq_catch_signals+0x36c/frame 0xed73ea10 sleepq_timedwait_sig(c8a422e4,0,ed73ea70,dffffdd5,1,...) at sleepq_timedwait_sig+0x14/frame 0xed73ea38 _cv_timedwait_sig_sbt(c8a422e4,c8a422d0,de95de8d,33a,dffffdd5,...) at _cv_timedwait_sig_sbt+0x228/frame 0xed73ea84 seltdwait(33a,dffffdd5,1,c882f620,0,...) at seltdwait+0xbc/frame 0xed73eab8 sys_poll(c882f620,ed73ecc8,c0f75630,e433dc90,0,...) at sys_poll+0x46d/frame 0xed73ec40 syscall(ed73ed08) at syscall+0x2ed/frame 0xed73ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed73ecfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2813eb1f, esp = 0xbfbfbbfc, ebp = 0xbfbfddd8 --- Tracing command syslogd pid 525 tid 100086 td 0xc8b38310 sched_switch(c8b38310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed78c904 mi_switch(104,0,c11a2855,1f5,46,...) at mi_switch+0x1c9/frame 0xed78c938 sleepq_switch(c8b38310,0,c11a2855,1ab,c8a42260,...) at sleepq_switch+0x1c5/frame 0xed78c96c sleepq_catch_signals(ed78c9d8,c0aaf809,c8a42260,0,0,...) at sleepq_catch_signals+0x36c/frame 0xed78c9b4 sleepq_wait_sig(c8a42264,0,ed78ca08,101,0,...) at sleepq_wait_sig+0x14/frame 0xed78c9d8 _cv_wait_sig(c8a42264,c8a42250,c11a5c63,6d8,c8b38310,...) at _cv_wait_sig+0x200/frame 0xed78ca1c seltdwait(ffffffff,0,0,c8b38310,ed78cbc8,...) at seltdwait+0x90/frame 0xed78ca50 kern_select(c8b38310,9,28844108,0,0,...) at kern_select+0x883/frame 0xed78cbf8 sys_select(c8b38310,ed78ccc8,0,0,c8b38310,...) at sys_select+0x69/frame 0xed78cc40 syscall(ed78cd08) at syscall+0x2ed/frame 0xed78ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed78ccfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a09c7, esp = 0xbfbfceac, ebp = 0xbfbfde34 --- Tracing command devd pid 414 tid 100079 td 0xc8b38620 sched_switch(c8b38620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed7348f8 mi_switch(104,0,c11a2855,1f5,3fe,...) at mi_switch+0x1c9/frame 0xed73492c sleepq_switch(c8b38620,0,c11a2855,1ab,c119a0e5,...) at sleepq_switch+0x1c5/frame 0xed734960 sleepq_catch_signals(c12a3eb0,ed7349d0,c0aaf809,c8f873e0,0,...) at sleepq_catch_signals+0x36c/frame 0xed7349a8 sleepq_timedwait_sig(c8f873e4,0,ed734a08,c0000000,3,...) at sleepq_timedwait_sig+0x14/frame 0xed7349d0 _cv_timedwait_sig_sbt(c8f873e4,c8f873d0,dabe9e3e,36b,c0000000,...) at _cv_timedwait_sig_sbt+0x228/frame 0xed734a1c seltdwait(36b,c0000000,3,c8b38620,ed734bc8,...) at seltdwait+0xbc/frame 0xed734a50 kern_select(c8b38620,5,bfbfbd98,0,0,...) at kern_select+0x883/frame 0xed734bf8 sys_select(c8b38620,ed734cc8,ed734c8c,c0a94b70,c1321c10,...) at sys_select+0x69/frame 0xed734c40 syscall(ed734d08) at syscall+0x2ed/frame 0xed734cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xed734cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x8095f33, esp = 0xbfbfbd3c, ebp = 0xbfbfde54 --- Tracing command softdepflush pid 17 tid 100074 td 0xc882fc40 sched_switch(c882fc40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed71cb48 mi_switch(104,0,c11a2855,1f5,101,...) at mi_switch+0x1c9/frame 0xed71cb7c sleepq_switch(c882fc40,0,c11a2855,28e,c149130c,...) at sleepq_switch+0x1c5/frame 0xed71cbb0 sleepq_timedwait(c149130c,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xed71cbd4 _sleep(c149130c,c149128c,54,c11d5d93,fffffed8,...) at _sleep+0x350/frame 0xed71cc30 softdep_flush(0,ed71cd08,c1195f04,3d5,0,...) at softdep_flush+0x376/frame 0xed71cccc fork_exit(c0d51910,0,ed71cd08) at fork_exit+0x7f/frame 0xed71ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed71ccf4 --- trap 0, eip = 0, esp = 0xed71cd40, ebp = 0 --- Tracing command vnlru pid 16 tid 100073 td 0xc8830000 sched_switch(c8830000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed719b78 mi_switch(104,0,c11a2855,1f5,101,...) at mi_switch+0x1c9/frame 0xed719bac sleepq_switch(c8830000,0,c11a2855,28e,c89178b8,...) at sleepq_switch+0x1c5/frame 0xed719be0 sleepq_timedwait(c89178b8,60,0,0,0,...) at sleepq_timedwait+0x48/frame 0xed719c04 _sleep(c89178b8,c148d018,260,c11af2b9,fffffed8,...) at _sleep+0x350/frame 0xed719c60 vnlru_proc(0,ed719d08,c1195f04,3d5,0,...) at vnlru_proc+0xcf/frame 0xed719ccc fork_exit(c0b7d010,0,ed719d08) at fork_exit+0x7f/frame 0xed719cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed719cf4 --- trap 0, eip = 0, esp = 0xed719d40, ebp = 0 --- Tracing command syncer pid 9 tid 100072 td 0xc8830310 sched_switch(c8830310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed716b78 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xed716bac sleepq_switch(c8830310,0,c11a2855,28e,0,...) at sleepq_switch+0x1c5/frame 0xed716be0 sleepq_timedwait(c148d060,0,ed716c3c,0,0,...) at sleepq_timedwait+0x48/frame 0xed716c04 _cv_timedwait_sbt(c148d060,c148d040,fffffed8,0,0,...) at _cv_timedwait_sbt+0x228/frame 0xed716c50 sched_sync(0,ed716d08,c1195f04,3d5,0,...) at sched_sync+0x682/frame 0xed716ccc fork_exit(c0b7c770,0,ed716d08) at fork_exit+0x7f/frame 0xed716cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed716cf4 --- trap 0, eip = 0, esp = 0xed716d40, ebp = 0 --- Tracing command bufdaemon pid 8 tid 100071 td 0xc8830620 sched_switch(c8830620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed713b3c mi_switch(104,0,c11a2855,1f5,101,...) at mi_switch+0x1c9/frame 0xed713b70 sleepq_switch(c8830620,0,c11a2855,28e,c148cb84,...) at sleepq_switch+0x1c5/frame 0xed713ba4 sleepq_timedwait(c148cb84,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xed713bc8 _sleep(c148cb84,c148cb00,54,c11abc7c,fffffed8,...) at _sleep+0x350/frame 0xed713c24 buf_daemon(0,ed713d08,c1195f04,3d5,0,...) at buf_daemon+0x290/frame 0xed713ccc fork_exit(c0b5fdb0,0,ed713d08) at fork_exit+0x7f/frame 0xed713cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed713cf4 --- trap 0, eip = 0, esp = 0xed713d40, ebp = 0 --- Tracing command pagezero pid 7 tid 100070 td 0xc8830930 sched_switch(c8830930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed710bac mi_switch(104,0,c11a2855,1f5,101,...) at mi_switch+0x1c9/frame 0xed710be0 sleepq_switch(c8830930,0,c11a2855,28e,c1491f24,...) at sleepq_switch+0x1c5/frame 0xed710c14 sleepq_timedwait(c1491f24,0,12b,0,0,...) at sleepq_timedwait+0x48/frame 0xed710c38 _sleep(c1491f24,c14ea080,0,c11dd461,fffea520,...) at _sleep+0x350/frame 0xed710c94 vm_pagezero(0,ed710d08,c1195f04,3d5,0,...) at vm_pagezero+0xc2/frame 0xed710ccc fork_exit(c0d99de0,0,ed710d08) at fork_exit+0x7f/frame 0xed710cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed710cf4 --- trap 0, eip = 0, esp = 0xed710d40, ebp = 0 --- Tracing command vmdaemon pid 6 tid 100069 td 0xc8830c40 sched_switch(c8830c40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed70db78 mi_switch(104,0,c11a2855,1f5,162,...) at mi_switch+0x1c9/frame 0xed70dbac sleepq_switch(c8830c40,0,c11a2855,26b,c1491c48,...) at sleepq_switch+0x1c5/frame 0xed70dbe0 sleepq_wait(c1491c48,74,c11abc7c,0,0,...) at sleepq_wait+0x48/frame 0xed70dc04 _sleep(c1491c48,c1491c30,74,c11abc7c,0,...) at _sleep+0x385/frame 0xed70dc60 vm_daemon(0,ed70dd08,c1195f04,3d5,0,...) at vm_daemon+0xac/frame 0xed70dccc fork_exit(c0d923f0,0,ed70dd08) at fork_exit+0x7f/frame 0xed70dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed70dcf4 --- trap 0, eip = 0, esp = 0xed70dd40, ebp = 0 --- Tracing command pagedaemon pid 5 tid 100068 td 0xc8831000 sched_switch(c8831000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed70ab80 mi_switch(104,0,c11a2855,1f5,101,...) at mi_switch+0x1c9/frame 0xed70abb4 sleepq_switch(c8831000,0,c11a2855,28e,c14ea104,...) at sleepq_switch+0x1c5/frame 0xed70abe8 sleepq_timedwait(c14ea104,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xed70ac0c _sleep(c14ea104,c14ea080,54,c11abc7c,fffffed8,...) at _sleep+0x350/frame 0xed70ac68 vm_pageout(0,ed70ad08,c1195f04,3d5,0,...) at vm_pageout+0x242/frame 0xed70accc fork_exit(c0d92c10,0,ed70ad08) at fork_exit+0x7f/frame 0xed70acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed70acf4 --- trap 0, eip = 0, esp = 0xed70ad40, ebp = 0 --- Tracing command xpt_thrd pid 4 tid 100067 td 0xc8831310 sched_switch(c8831310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed587bb0 mi_switch(104,0,c11a2855,1f5,162,...) at mi_switch+0x1c9/frame 0xed587be4 sleepq_switch(c8831310,0,c11a2855,26b,c12e1ca0,...) at sleepq_switch+0x1c5/frame 0xed587c18 sleepq_wait(c12e1ca0,5c,c0f9d3ba,0,0,...) at sleepq_wait+0x48/frame 0xed587c3c _sleep(c12e1ca0,c12e1cf0,5c,c0f9d3ba,0,...) at _sleep+0x385/frame 0xed587c98 xpt_scanner_thread(0,ed587d08,c1195f04,3d5,0,...) at xpt_scanner_thread+0x11c/frame 0xed587ccc fork_exit(c04c3a20,0,ed587d08) at fork_exit+0x7f/frame 0xed587cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed587cf4 --- trap 0, eip = 0, esp = 0xed587d40, ebp = 0 --- Tracing command sctp_iterator pid 3 tid 100066 td 0xc8831620 sched_switch(c8831620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed584bb8 mi_switch(104,0,c11a2855,1f5,162,...) at mi_switch+0x1c9/frame 0xed584bec sleepq_switch(c8831620,0,c11a2855,26b,c14e6adc,...) at sleepq_switch+0x1c5/frame 0xed584c20 sleepq_wait(c14e6adc,0,c11c29e5,0,0,...) at sleepq_wait+0x48/frame 0xed584c44 _sleep(c14e6adc,c14e6aa4,0,c11c29e5,0,...) at _sleep+0x385/frame 0xed584ca0 sctp_iterator_thread(0,ed584d08,c1195f04,3d5,0,...) at sctp_iterator_thread+0x7c/frame 0xed584ccc fork_exit(c0c1cdc0,0,ed584d08) at fork_exit+0x7f/frame 0xed584cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed584cf4 --- trap 0, eip = 0, esp = 0xed584d40, ebp = 0 --- Tracing command fdc0 pid 2 tid 100061 td 0xc8511310 sched_switch(c8511310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed574b48 mi_switch(104,0,c11a2855,1f5,101,...) at mi_switch+0x1c9/frame 0xed574b7c sleepq_switch(c8511310,0,c11a2855,28e,c84a143c,...) at sleepq_switch+0x1c5/frame 0xed574bb0 sleepq_timedwait(c84a143c,5c,0,0,0,...) at sleepq_timedwait+0x48/frame 0xed574bd4 _sleep(c84a143c,c84a14f0,5c,c118818e,fffffed8,...) at _sleep+0x350/frame 0xed574c30 fdc_thread(c84a1400,ed574d08,c1195f04,3d5,0,...) at fdc_thread+0x8a7/frame 0xed574ccc fork_exit(c0ef6ee0,c84a1400,ed574d08) at fork_exit+0x7f/frame 0xed574cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed574cf4 --- trap 0, eip = 0, esp = 0xed574d40, ebp = 0 --- Tracing command usb pid 15 tid 100058 td 0xc8511c40 sched_switch(c8511c40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed550bd4 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xed550c08 sleepq_switch(c8511c40,0,c11a2855,26b,c8511c40,...) at sleepq_switch+0x1c5/frame 0xed550c3c sleepq_wait(c8516d34,0,ed550c90,1,0,...) at sleepq_wait+0x48/frame 0xed550c60 _cv_wait(c8516d34,c8516e4c,c11796fb,77,c8516d3c,...) at _cv_wait+0x1f9/frame 0xed550ca4 usb_process(c8516d2c,ed550d08,c1195f04,3d5,0,...) at usb_process+0xe6/frame 0xed550ccc fork_exit(c0973fa0,c8516d2c,ed550d08) at fork_exit+0x7f/frame 0xed550cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed550cf4 --- trap 0, eip = 0, esp = 0xed550d40, ebp = 0 --- Tracing command usb pid 15 tid 100057 td 0xc8512000 sched_switch(c8512000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed54dbd4 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xed54dc08 sleepq_switch(c8512000,0,c11a2855,26b,c8512000,...) at sleepq_switch+0x1c5/frame 0xed54dc3c sleepq_wait(c8516d04,0,ed54dc90,1,0,...) at sleepq_wait+0x48/frame 0xed54dc60 _cv_wait(c8516d04,c8516e4c,c11796fb,77,c8516d0c,...) at _cv_wait+0x1f9/frame 0xed54dca4 usb_process(c8516cfc,ed54dd08,c1195f04,3d5,0,...) at usb_process+0xe6/frame 0xed54dccc fork_exit(c0973fa0,c8516cfc,ed54dd08) at fork_exit+0x7f/frame 0xed54dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed54dcf4 --- trap 0, eip = 0, esp = 0xed54dd40, ebp = 0 --- Tracing command usb pid 15 tid 100056 td 0xc8512310 sched_switch(c8512310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed54abd4 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xed54ac08 sleepq_switch(c8512310,0,c11a2855,26b,c8512310,...) at sleepq_switch+0x1c5/frame 0xed54ac3c sleepq_wait(c8516cd4,0,ed54ac90,1,0,...) at sleepq_wait+0x48/frame 0xed54ac60 _cv_wait(c8516cd4,c8516e4c,c11796fb,77,c8516cdc,...) at _cv_wait+0x1f9/frame 0xed54aca4 usb_process(c8516ccc,ed54ad08,c1195f04,3d5,0,...) at usb_process+0xe6/frame 0xed54accc fork_exit(c0973fa0,c8516ccc,ed54ad08) at fork_exit+0x7f/frame 0xed54acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed54acf4 --- trap 0, eip = 0, esp = 0xed54ad40, ebp = 0 --- Tracing command usb pid 15 tid 100055 td 0xc8512620 sched_switch(c8512620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed547bd4 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xed547c08 sleepq_switch(c8512620,0,c11a2855,26b,c8512620,...) at sleepq_switch+0x1c5/frame 0xed547c3c sleepq_wait(c8516ca4,0,ed547c90,1,0,...) at sleepq_wait+0x48/frame 0xed547c60 _cv_wait(c8516ca4,c8516e4c,c11796fb,77,c8516cac,...) at _cv_wait+0x1f9/frame 0xed547ca4 usb_process(c8516c9c,ed547d08,c1195f04,3d5,0,...) at usb_process+0xe6/frame 0xed547ccc fork_exit(c0973fa0,c8516c9c,ed547d08) at fork_exit+0x7f/frame 0xed547cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed547cf4 --- trap 0, eip = 0, esp = 0xed547d40, ebp = 0 --- Tracing command usb pid 15 tid 100053 td 0xc8512c40 sched_switch(c8512c40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed53ebd4 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xed53ec08 sleepq_switch(c8512c40,0,c11a2855,26b,c8512c40,...) at sleepq_switch+0x1c5/frame 0xed53ec3c sleepq_wait(c850fb5c,0,ed53ec90,1,0,...) at sleepq_wait+0x48/frame 0xed53ec60 _cv_wait(c850fb5c,c850fc74,c11796fb,77,c850fb64,...) at _cv_wait+0x1f9/frame 0xed53eca4 usb_process(c850fb54,ed53ed08,c1195f04,3d5,0,...) at usb_process+0xe6/frame 0xed53eccc fork_exit(c0973fa0,c850fb54,ed53ed08) at fork_exit+0x7f/frame 0xed53ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed53ecf4 --- trap 0, eip = 0, esp = 0xed53ed40, ebp = 0 --- Tracing command usb pid 15 tid 100052 td 0xc848ac40 sched_switch(c848ac40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed53bbd4 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xed53bc08 sleepq_switch(c848ac40,0,c11a2855,26b,c848ac40,...) at sleepq_switch+0x1c5/frame 0xed53bc3c sleepq_wait(c850fb2c,0,ed53bc90,1,0,...) at sleepq_wait+0x48/frame 0xed53bc60 _cv_wait(c850fb2c,c850fc74,c11796fb,77,c850fb34,...) at _cv_wait+0x1f9/frame 0xed53bca4 usb_process(c850fb24,ed53bd08,c1195f04,3d5,0,...) at usb_process+0xe6/frame 0xed53bccc fork_exit(c0973fa0,c850fb24,ed53bd08) at fork_exit+0x7f/frame 0xed53bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed53bcf4 --- trap 0, eip = 0, esp = 0xed53bd40, ebp = 0 --- Tracing command usb pid 15 tid 100051 td 0xc84ff000 sched_switch(c84ff000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed538bd4 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xed538c08 sleepq_switch(c84ff000,0,c11a2855,26b,c84ff000,...) at sleepq_switch+0x1c5/frame 0xed538c3c sleepq_wait(c850fafc,0,ed538c90,1,0,...) at sleepq_wait+0x48/frame 0xed538c60 _cv_wait(c850fafc,c850fc74,c11796fb,77,c850fb04,...) at _cv_wait+0x1f9/frame 0xed538ca4 usb_process(c850faf4,ed538d08,c1195f04,3d5,0,...) at usb_process+0xe6/frame 0xed538ccc fork_exit(c0973fa0,c850faf4,ed538d08) at fork_exit+0x7f/frame 0xed538cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed538cf4 --- trap 0, eip = 0, esp = 0xed538d40, ebp = 0 --- Tracing command usb pid 15 tid 100050 td 0xc84ff310 sched_switch(c84ff310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed535bd4 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xed535c08 sleepq_switch(c84ff310,0,c11a2855,26b,c84ff310,...) at sleepq_switch+0x1c5/frame 0xed535c3c sleepq_wait(c850facc,0,ed535c90,1,0,...) at sleepq_wait+0x48/frame 0xed535c60 _cv_wait(c850facc,c850fc74,c11796fb,77,c850fad4,...) at _cv_wait+0x1f9/frame 0xed535ca4 usb_process(c850fac4,ed535d08,c1195f04,3d5,0,...) at usb_process+0xe6/frame 0xed535ccc fork_exit(c0973fa0,c850fac4,ed535d08) at fork_exit+0x7f/frame 0xed535cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed535cf4 --- trap 0, eip = 0, esp = 0xed535d40, ebp = 0 --- Tracing command usb pid 15 tid 100049 td 0xc84ff620 sched_switch(c84ff620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed531bd4 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xed531c08 sleepq_switch(c84ff620,0,c11a2855,26b,c84ff620,...) at sleepq_switch+0x1c5/frame 0xed531c3c sleepq_wait(c8508b5c,0,ed531c90,1,0,...) at sleepq_wait+0x48/frame 0xed531c60 _cv_wait(c8508b5c,c8508c74,c11796fb,77,c8508b64,...) at _cv_wait+0x1f9/frame 0xed531ca4 usb_process(c8508b54,ed531d08,c1195f04,3d5,0,...) at usb_process+0xe6/frame 0xed531ccc fork_exit(c0973fa0,c8508b54,ed531d08) at fork_exit+0x7f/frame 0xed531cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed531cf4 --- trap 0, eip = 0, esp = 0xed531d40, ebp = 0 --- Tracing command usb pid 15 tid 100048 td 0xc84ff930 sched_switch(c84ff930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed52ebd4 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xed52ec08 sleepq_switch(c84ff930,0,c11a2855,26b,c84ff930,...) at sleepq_switch+0x1c5/frame 0xed52ec3c sleepq_wait(c8508b2c,0,ed52ec90,1,0,...) at sleepq_wait+0x48/frame 0xed52ec60 _cv_wait(c8508b2c,c8508c74,c11796fb,77,c8508b34,...) at _cv_wait+0x1f9/frame 0xed52eca4 usb_process(c8508b24,ed52ed08,c1195f04,3d5,0,...) at usb_process+0xe6/frame 0xed52eccc fork_exit(c0973fa0,c8508b24,ed52ed08) at fork_exit+0x7f/frame 0xed52ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed52ecf4 --- trap 0, eip = 0, esp = 0xed52ed40, ebp = 0 --- Tracing command usb pid 15 tid 100047 td 0xc84ffc40 sched_switch(c84ffc40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed52bbd4 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xed52bc08 sleepq_switch(c84ffc40,0,c11a2855,26b,c84ffc40,...) at sleepq_switch+0x1c5/frame 0xed52bc3c sleepq_wait(c8508afc,0,ed52bc90,1,0,...) at sleepq_wait+0x48/frame 0xed52bc60 _cv_wait(c8508afc,c8508c74,c11796fb,77,c8508b04,...) at _cv_wait+0x1f9/frame 0xed52bca4 usb_process(c8508af4,ed52bd08,c1195f04,3d5,0,...) at usb_process+0xe6/frame 0xed52bccc fork_exit(c0973fa0,c8508af4,ed52bd08) at fork_exit+0x7f/frame 0xed52bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed52bcf4 --- trap 0, eip = 0, esp = 0xed52bd40, ebp = 0 --- Tracing command usb pid 15 tid 100046 td 0xc8500000 sched_switch(c8500000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed528bd4 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xed528c08 sleepq_switch(c8500000,0,c11a2855,26b,c8500000,...) at sleepq_switch+0x1c5/frame 0xed528c3c sleepq_wait(c8508acc,0,ed528c90,1,0,...) at sleepq_wait+0x48/frame 0xed528c60 _cv_wait(c8508acc,c8508c74,c11796fb,77,c8508ad4,...) at _cv_wait+0x1f9/frame 0xed528ca4 usb_process(c8508ac4,ed528d08,c1195f04,3d5,0,...) at usb_process+0xe6/frame 0xed528ccc fork_exit(c0973fa0,c8508ac4,ed528d08) at fork_exit+0x7f/frame 0xed528cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed528cf4 --- trap 0, eip = 0, esp = 0xed528d40, ebp = 0 --- Tracing command usb pid 15 tid 100045 td 0xc8500310 sched_switch(c8500310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed524bd4 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xed524c08 sleepq_switch(c8500310,0,c11a2855,26b,c8500310,...) at sleepq_switch+0x1c5/frame 0xed524c3c sleepq_wait(c8502b5c,0,ed524c90,1,0,...) at sleepq_wait+0x48/frame 0xed524c60 _cv_wait(c8502b5c,c8502c74,c11796fb,77,c8502b64,...) at _cv_wait+0x1f9/frame 0xed524ca4 usb_process(c8502b54,ed524d08,c1195f04,3d5,0,...) at usb_process+0xe6/frame 0xed524ccc fork_exit(c0973fa0,c8502b54,ed524d08) at fork_exit+0x7f/frame 0xed524cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed524cf4 --- trap 0, eip = 0, esp = 0xed524d40, ebp = 0 --- Tracing command usb pid 15 tid 100044 td 0xc8500620 sched_switch(c8500620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed521bd4 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xed521c08 sleepq_switch(c8500620,0,c11a2855,26b,c8500620,...) at sleepq_switch+0x1c5/frame 0xed521c3c sleepq_wait(c8502b2c,0,ed521c90,1,0,...) at sleepq_wait+0x48/frame 0xed521c60 _cv_wait(c8502b2c,c8502c74,c11796fb,77,c8502b34,...) at _cv_wait+0x1f9/frame 0xed521ca4 usb_process(c8502b24,ed521d08,c1195f04,3d5,0,...) at usb_process+0xe6/frame 0xed521ccc fork_exit(c0973fa0,c8502b24,ed521d08) at fork_exit+0x7f/frame 0xed521cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed521cf4 --- trap 0, eip = 0, esp = 0xed521d40, ebp = 0 --- Tracing command usb pid 15 tid 100043 td 0xc8500930 sched_switch(c8500930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed51ebd4 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xed51ec08 sleepq_switch(c8500930,0,c11a2855,26b,c8500930,...) at sleepq_switch+0x1c5/frame 0xed51ec3c sleepq_wait(c8502afc,0,ed51ec90,1,0,...) at sleepq_wait+0x48/frame 0xed51ec60 _cv_wait(c8502afc,c8502c74,c11796fb,77,c8502b04,...) at _cv_wait+0x1f9/frame 0xed51eca4 usb_process(c8502af4,ed51ed08,c1195f04,3d5,0,...) at usb_process+0xe6/frame 0xed51eccc fork_exit(c0973fa0,c8502af4,ed51ed08) at fork_exit+0x7f/frame 0xed51ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed51ecf4 --- trap 0, eip = 0, esp = 0xed51ed40, ebp = 0 --- Tracing command usb pid 15 tid 100042 td 0xc8500c40 sched_switch(c8500c40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed51bbd4 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xed51bc08 sleepq_switch(c8500c40,0,c11a2855,26b,c8500c40,...) at sleepq_switch+0x1c5/frame 0xed51bc3c sleepq_wait(c8502acc,0,ed51bc90,1,0,...) at sleepq_wait+0x48/frame 0xed51bc60 _cv_wait(c8502acc,c8502c74,c11796fb,77,c8502ad4,...) at _cv_wait+0x1f9/frame 0xed51bca4 usb_process(c8502ac4,ed51bd08,c1195f04,3d5,0,...) at usb_process+0xe6/frame 0xed51bccc fork_exit(c0973fa0,c8502ac4,ed51bd08) at fork_exit+0x7f/frame 0xed51bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed51bcf4 --- trap 0, eip = 0, esp = 0xed51bd40, ebp = 0 --- Tracing command usb pid 15 tid 100040 td 0xc8501310 sched_switch(c8501310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed514bd4 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xed514c08 sleepq_switch(c8501310,0,c11a2855,26b,c8501310,...) at sleepq_switch+0x1c5/frame 0xed514c3c sleepq_wait(c84f9b5c,0,ed514c90,1,0,...) at sleepq_wait+0x48/frame 0xed514c60 _cv_wait(c84f9b5c,c84f9c74,c11796fb,77,c84f9b64,...) at _cv_wait+0x1f9/frame 0xed514ca4 usb_process(c84f9b54,ed514d08,c1195f04,3d5,0,...) at usb_process+0xe6/frame 0xed514ccc fork_exit(c0973fa0,c84f9b54,ed514d08) at fork_exit+0x7f/frame 0xed514cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed514cf4 --- trap 0, eip = 0, esp = 0xed514d40, ebp = 0 --- Tracing command usb pid 15 tid 100039 td 0xc838c310 sched_switch(c838c310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed511bd4 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xed511c08 sleepq_switch(c838c310,0,c11a2855,26b,c838c310,...) at sleepq_switch+0x1c5/frame 0xed511c3c sleepq_wait(c84f9b2c,0,ed511c90,1,0,...) at sleepq_wait+0x48/frame 0xed511c60 _cv_wait(c84f9b2c,c84f9c74,c11796fb,77,c84f9b34,...) at _cv_wait+0x1f9/frame 0xed511ca4 usb_process(c84f9b24,ed511d08,c1195f04,3d5,0,...) at usb_process+0xe6/frame 0xed511ccc fork_exit(c0973fa0,c84f9b24,ed511d08) at fork_exit+0x7f/frame 0xed511cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed511cf4 --- trap 0, eip = 0, esp = 0xed511d40, ebp = 0 --- Tracing command usb pid 15 tid 100038 td 0xc838c620 sched_switch(c838c620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed50ebd4 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xed50ec08 sleepq_switch(c838c620,0,c11a2855,26b,c838c620,...) at sleepq_switch+0x1c5/frame 0xed50ec3c sleepq_wait(c84f9afc,0,ed50ec90,1,0,...) at sleepq_wait+0x48/frame 0xed50ec60 _cv_wait(c84f9afc,c84f9c74,c11796fb,77,c84f9b04,...) at _cv_wait+0x1f9/frame 0xed50eca4 usb_process(c84f9af4,ed50ed08,c1195f04,3d5,0,...) at usb_process+0xe6/frame 0xed50eccc fork_exit(c0973fa0,c84f9af4,ed50ed08) at fork_exit+0x7f/frame 0xed50ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed50ecf4 --- trap 0, eip = 0, esp = 0xed50ed40, ebp = 0 --- Tracing command usb pid 15 tid 100037 td 0xc838c930 sched_switch(c838c930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed50bbd4 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xed50bc08 sleepq_switch(c838c930,0,c11a2855,26b,c838c930,...) at sleepq_switch+0x1c5/frame 0xed50bc3c sleepq_wait(c84f9acc,0,ed50bc90,1,0,...) at sleepq_wait+0x48/frame 0xed50bc60 _cv_wait(c84f9acc,c84f9c74,c11796fb,77,c84f9ad4,...) at _cv_wait+0x1f9/frame 0xed50bca4 usb_process(c84f9ac4,ed50bd08,c1195f04,3d5,0,...) at usb_process+0xe6/frame 0xed50bccc fork_exit(c0973fa0,c84f9ac4,ed50bd08) at fork_exit+0x7f/frame 0xed50bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed50bcf4 --- trap 0, eip = 0, esp = 0xed50bd40, ebp = 0 --- Tracing command usb pid 15 tid 100035 td 0xc8489000 sched_switch(c8489000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed504bd4 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xed504c08 sleepq_switch(c8489000,0,c11a2855,26b,c8489000,...) at sleepq_switch+0x1c5/frame 0xed504c3c sleepq_wait(c84f0b5c,0,ed504c90,1,0,...) at sleepq_wait+0x48/frame 0xed504c60 _cv_wait(c84f0b5c,c84f0c74,c11796fb,77,c84f0b64,...) at _cv_wait+0x1f9/frame 0xed504ca4 usb_process(c84f0b54,ed504d08,c1195f04,3d5,0,...) at usb_process+0xe6/frame 0xed504ccc fork_exit(c0973fa0,c84f0b54,ed504d08) at fork_exit+0x7f/frame 0xed504cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed504cf4 --- trap 0, eip = 0, esp = 0xed504d40, ebp = 0 --- Tracing command usb pid 15 tid 100034 td 0xc8489310 sched_switch(c8489310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed501bd4 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xed501c08 sleepq_switch(c8489310,0,c11a2855,26b,c8489310,...) at sleepq_switch+0x1c5/frame 0xed501c3c sleepq_wait(c84f0b2c,0,ed501c90,1,0,...) at sleepq_wait+0x48/frame 0xed501c60 _cv_wait(c84f0b2c,c84f0c74,c11796fb,77,c84f0b34,...) at _cv_wait+0x1f9/frame 0xed501ca4 usb_process(c84f0b24,ed501d08,c1195f04,3d5,0,...) at usb_process+0xe6/frame 0xed501ccc fork_exit(c0973fa0,c84f0b24,ed501d08) at fork_exit+0x7f/frame 0xed501cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed501cf4 --- trap 0, eip = 0, esp = 0xed501d40, ebp = 0 --- Tracing command usb pid 15 tid 100033 td 0xc8489620 sched_switch(c8489620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed4febd4 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xed4fec08 sleepq_switch(c8489620,0,c11a2855,26b,c8489620,...) at sleepq_switch+0x1c5/frame 0xed4fec3c sleepq_wait(c84f0afc,0,ed4fec90,1,0,...) at sleepq_wait+0x48/frame 0xed4fec60 _cv_wait(c84f0afc,c84f0c74,c11796fb,77,c84f0b04,...) at _cv_wait+0x1f9/frame 0xed4feca4 usb_process(c84f0af4,ed4fed08,c1195f04,3d5,0,...) at usb_process+0xe6/frame 0xed4feccc fork_exit(c0973fa0,c84f0af4,ed4fed08) at fork_exit+0x7f/frame 0xed4fecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed4fecf4 --- trap 0, eip = 0, esp = 0xed4fed40, ebp = 0 --- Tracing command usb pid 15 tid 100032 td 0xc8489930 sched_switch(c8489930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed4fbbd4 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xed4fbc08 sleepq_switch(c8489930,0,c11a2855,26b,c8489930,...) at sleepq_switch+0x1c5/frame 0xed4fbc3c sleepq_wait(c84f0acc,0,ed4fbc90,1,0,...) at sleepq_wait+0x48/frame 0xed4fbc60 _cv_wait(c84f0acc,c84f0c74,c11796fb,77,c84f0ad4,...) at _cv_wait+0x1f9/frame 0xed4fbca4 usb_process(c84f0ac4,ed4fbd08,c1195f04,3d5,0,...) at usb_process+0xe6/frame 0xed4fbccc fork_exit(c0973fa0,c84f0ac4,ed4fbd08) at fork_exit+0x7f/frame 0xed4fbcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed4fbcf4 --- trap 0, eip = 0, esp = 0xed4fbd40, ebp = 0 --- Tracing command rand_harvestq pid 14 tid 100017 td 0xc838b620 sched_switch(c838b620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xe4378bb4 mi_switch(104,0,c11a2855,1f5,c132f750,...) at mi_switch+0x1c9/frame 0xe4378be8 sleepq_switch(c838b620,0,c11a2855,28e,c12f99b0,...) at sleepq_switch+0x1c5/frame 0xe4378c1c sleepq_timedwait(c12f99b0,0,c119d2bd,c118818e,0,...) at sleepq_timedwait+0x48/frame 0xe4378c40 msleep_spin_sbt(c12f99b0,c14dcb4c,c118818e,19999999,0,...) at msleep_spin_sbt+0x225/frame 0xe4378c88 random_kthread(c08631b0,e4378d08,c1195f04,3d5,0,...) at random_kthread+0x1cb/frame 0xe4378ccc fork_exit(c0862230,c08631b0,e4378d08) at fork_exit+0x7f/frame 0xe4378cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4378cf4 --- trap 0, eip = 0, esp = 0xe4378d40, ebp = 0 --- Tracing command geom pid 13 tid 100015 td 0xc838bc40 sched_switch(c838bc40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xe4372b70 mi_switch(104,0,c11a2855,1f5,162,...) at mi_switch+0x1c9/frame 0xe4372ba4 sleepq_switch(c838bc40,0,c11a2855,26b,c14e2c4c,...) at sleepq_switch+0x1c5/frame 0xe4372bd8 sleepq_wait(c14e2c4c,5c,c118818e,0,0,...) at sleepq_wait+0x48/frame 0xe4372bfc _sleep(c14e2c4c,c131175c,25c,c118818e,0,...) at _sleep+0x385/frame 0xe4372c58 g_io_schedule_down(c838bc40,0,c1189eb2,6c,e4372cf4,...) at g_io_schedule_down+0x5c/frame 0xe4372cb4 g_down_procbody(0,e4372d08,c1195f04,3d5,0,...) at g_down_procbody+0x9d/frame 0xe4372ccc fork_exit(c0a233b0,0,e4372d08) at fork_exit+0x7f/frame 0xe4372cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4372cf4 --- trap 0, eip = 0, esp = 0xe4372d40, ebp = 0 --- Tracing command geom pid 13 tid 100014 td 0xc838c000 kdb_enter(c119c655,c119c655,c11d4b85,e436f9e4,c0d3674c,...) at kdb_enter+0x3d/frame 0xe436f990 vpanic(e436f9e4,e436fae8,c0d460bf,c11d4b85,cc731200,...) at vpanic+0x143/frame 0xe436f9cc panic(c11d4b85,cc731200,100,ca3eed68,e436fa20,...) at panic+0x12/frame 0xe436f9d8 handle_written_inodeblock(cc731200,e42f31f0,29d7,246,202,...) at handle_written_inodeblock+0xe5f/frame 0xe436fae8 softdep_disk_write_complete(e42f31f0,e42f31f0) at softdep_disk_write_complete+0x19a/frame 0xe436fb68 buf_complete(e42f31f0,c1b82780,c99043d8,e436fbbc,c0d784ff,...) at buf_complete+0x29/frame 0xe436fb78 bufdone_finish(e42f31f0,c838c000,e42f31f0,ca3eed68,e42f31f0,...) at bufdone_finish+0x36/frame 0xe436fbf0 bufdone(e42f31f0,0,c118ae26,9d,c82c3a80) at bufdone+0xd2/frame 0xe436fc0c g_vfs_done(c99043d8,0,c11aaf60,e01,c131177c,...) at g_vfs_done+0x22c/frame 0xe436fc34 biodone(c99043d8,0,c1189e7c,61,0,...) at biodone+0x143/frame 0xe436fc80 g_io_schedule_up(c838c000,0,c1189eb2,5f,e436fcf4,...) at g_io_schedule_up+0x129/frame 0xe436fcb4 g_up_procbody(0,e436fd08,c1195f04,3d5,0,...) at g_up_procbody+0x9d/frame 0xe436fccc fork_exit(c0a23310,0,e436fd08) at fork_exit+0x7f/frame 0xe436fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe436fcf4 --- trap 0, eip = 0, esp = 0xe436fd40, ebp = 0 --- Tracing command geom pid 13 tid 100013 td 0xc82e3000 sched_switch(c82e3000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xe436cba8 mi_switch(104,0,c11a2855,1f5,162,...) at mi_switch+0x1c9/frame 0xe436cbdc sleepq_switch(c82e3000,0,c11a2855,26b,c14e2c44,...) at sleepq_switch+0x1c5/frame 0xe436cc10 sleepq_wait(c14e2c44,5c,c118818e,0,0,...) at sleepq_wait+0x48/frame 0xe436cc34 _sleep(c14e2c44,c1311734,25c,c118818e,0,...) at _sleep+0x385/frame 0xe436cc90 g_run_events(0,e436cd08,c1195f04,3d5,0,...) at g_run_events+0x586/frame 0xe436cccc fork_exit(c0a23270,0,e436cd08) at fork_exit+0x7f/frame 0xe436ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe436ccf4 --- trap 0, eip = 0, esp = 0xe436cd40, ebp = 0 --- Tracing command intr pid 12 tid 100063 td 0xc8501c40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100062 td 0xc8511000 sched_switch(c8511000,0,109,1bb,0,...) at sched_switch+0x4b9/frame 0xed577c60 mi_switch(109,0,c1196175,55a,8,...) at mi_switch+0x1c9/frame 0xed577c94 ithread_loop(c83275d0,ed577d08,c1195f04,3d5,0,...) at ithread_loop+0x201/frame 0xed577ccc fork_exit(c0a95440,c83275d0,ed577d08) at fork_exit+0x7f/frame 0xed577cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed577cf4 --- trap 0, eip = 0, esp = 0xed577d40, ebp = 0 --- Tracing command intr pid 12 tid 100060 td 0xc8511620 sched_switch(c8511620,0,109,1bb,0,...) at sched_switch+0x4b9/frame 0xed567c60 mi_switch(109,0,c1196175,55a,8,...) at mi_switch+0x1c9/frame 0xed567c94 ithread_loop(c83275e0,ed567d08,c1195f04,3d5,0,...) at ithread_loop+0x201/frame 0xed567ccc fork_exit(c0a95440,c83275e0,ed567d08) at fork_exit+0x7f/frame 0xed567cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed567cf4 --- trap 0, eip = 0, esp = 0xed567d40, ebp = 0 --- Tracing command intr pid 12 tid 100059 td 0xc8511930 sched_switch(c8511930,0,109,1bb,0,...) at sched_switch+0x4b9/frame 0xed556c60 mi_switch(109,0,c1196175,55a,8,...) at mi_switch+0x1c9/frame 0xed556c94 ithread_loop(c8327610,ed556d08,c1195f04,3d5,0,...) at ithread_loop+0x201/frame 0xed556ccc fork_exit(c0a95440,c8327610,ed556d08) at fork_exit+0x7f/frame 0xed556cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed556cf4 --- trap 0, eip = 0, esp = 0xed556d40, ebp = 0 --- Tracing command intr pid 12 tid 100054 td 0xc8512930 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xc8501000 sched_switch(c8501000,0,109,1bb,0,...) at sched_switch+0x4b9/frame 0xed518c60 mi_switch(109,0,c1196175,55a,8,...) at mi_switch+0x1c9/frame 0xed518c94 ithread_loop(c8327630,ed518d08,c1195f04,3d5,0,...) at ithread_loop+0x201/frame 0xed518ccc fork_exit(c0a95440,c8327630,ed518d08) at fork_exit+0x7f/frame 0xed518cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed518cf4 --- trap 0, eip = 0, esp = 0xed518d40, ebp = 0 --- Tracing command intr pid 12 tid 100036 td 0xc838cc40 sched_switch(c838cc40,0,109,1bb,0,...) at sched_switch+0x4b9/frame 0xed508c60 mi_switch(109,0,c1196175,55a,8,...) at mi_switch+0x1c9/frame 0xed508c94 ithread_loop(c8327640,ed508d08,c1195f04,3d5,0,...) at ithread_loop+0x201/frame 0xed508ccc fork_exit(c0a95440,c8327640,ed508d08) at fork_exit+0x7f/frame 0xed508cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed508cf4 --- trap 0, eip = 0, esp = 0xed508d40, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xc8489c40 sched_switch(c8489c40,0,109,1bb,0,...) at sched_switch+0x4b9/frame 0xed4f8c60 mi_switch(109,0,c1196175,55a,8,...) at mi_switch+0x1c9/frame 0xed4f8c94 ithread_loop(c8327650,ed4f8d08,c1195f04,3d5,0,...) at ithread_loop+0x201/frame 0xed4f8ccc fork_exit(c0a95440,c8327650,ed4f8d08) at fork_exit+0x7f/frame 0xed4f8cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed4f8cf4 --- trap 0, eip = 0, esp = 0xed4f8d40, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc848a000 sched_switch(c848a000,0,109,1bb,0,...) at sched_switch+0x4b9/frame 0xf0ad6c60 mi_switch(109,0,c1196175,55a,8,...) at mi_switch+0x1c9/frame 0xf0ad6c94 ithread_loop(c83276e0,f0ad6d08,c1195f04,3d5,0,...) at ithread_loop+0x201/frame 0xf0ad6ccc fork_exit(c0a95440,c83276e0,f0ad6d08) at fork_exit+0x7f/frame 0xf0ad6cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf0ad6cf4 --- trap 0, eip = 0, esp = 0xf0ad6d40, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc848a310 sched_switch(c848a310,0,109,1bb,0,...) at sched_switch+0x4b9/frame 0xf0ad2c60 mi_switch(109,0,c1196175,55a,8,...) at mi_switch+0x1c9/frame 0xf0ad2c94 ithread_loop(c83276f0,f0ad2d08,c1195f04,3d5,0,...) at ithread_loop+0x201/frame 0xf0ad2ccc fork_exit(c0a95440,c83276f0,f0ad2d08) at fork_exit+0x7f/frame 0xf0ad2cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf0ad2cf4 --- trap 0, eip = 0, esp = 0xf0ad2d40, ebp = 0 --- Tracing command intr pid 12 tid 100028 td 0xc848a620 sched_switch(c848a620,0,109,1bb,0,...) at sched_switch+0x4b9/frame 0xe43c9c60 mi_switch(109,0,c1196175,55a,8,...) at mi_switch+0x1c9/frame 0xe43c9c94 ithread_loop(c8327700,e43c9d08,c1195f04,3d5,0,...) at ithread_loop+0x201/frame 0xe43c9ccc fork_exit(c0a95440,c8327700,e43c9d08) at fork_exit+0x7f/frame 0xe43c9cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe43c9cf4 --- trap 0, eip = 0, esp = 0xe43c9d40, ebp = 0 --- Tracing command intr pid 12 tid 100027 td 0xc848a930 sched_switch(c848a930,0,109,1bb,0,...) at sched_switch+0x4b9/frame 0xe4397c60 mi_switch(109,0,c1196175,55a,8,...) at mi_switch+0x1c9/frame 0xe4397c94 ithread_loop(c8327710,e4397d08,c1195f04,3d5,0,...) at ithread_loop+0x201/frame 0xe4397ccc fork_exit(c0a95440,c8327710,e4397d08) at fork_exit+0x7f/frame 0xe4397cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4397cf4 --- trap 0, eip = 0, esp = 0xe4397d40, ebp = 0 --- Tracing command intr pid 12 tid 100026 td 0xc82e7930 sched_switch(c82e7930,0,109,1bb,0,...) at sched_switch+0x4b9/frame 0xe4394c60 mi_switch(109,0,c1196175,55a,8,...) at mi_switch+0x1c9/frame 0xe4394c94 ithread_loop(c8327720,e4394d08,c1195f04,3d5,0,...) at ithread_loop+0x201/frame 0xe4394ccc fork_exit(c0a95440,c8327720,e4394d08) at fork_exit+0x7f/frame 0xe4394cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4394cf4 --- trap 0, eip = 0, esp = 0xe4394d40, ebp = 0 --- Tracing command intr pid 12 tid 100021 td 0xc838a930 sched_switch(c838a930,0,109,1bb,0,...) at sched_switch+0x4b9/frame 0xe4385c60 mi_switch(109,0,c1196175,55a,8,...) at mi_switch+0x1c9/frame 0xe4385c94 ithread_loop(c8327750,e4385d08,c1195f04,3d5,0,...) at ithread_loop+0x201/frame 0xe4385ccc fork_exit(c0a95440,c8327750,e4385d08) at fork_exit+0x7f/frame 0xe4385cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4385cf4 --- trap 0, eip = 0, esp = 0xe4385d40, ebp = 0 --- Tracing command intr pid 12 tid 100020 td 0xc838ac40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100012 td 0xc82e3310 sched_switch(c82e3310,0,109,1bb,0,...) at sched_switch+0x4b9/frame 0xe4369c60 mi_switch(109,0,c1196175,55a,8,...) at mi_switch+0x1c9/frame 0xe4369c94 ithread_loop(c8327770,e4369d08,c1195f04,3d5,0,...) at ithread_loop+0x201/frame 0xe4369ccc fork_exit(c0a95440,c8327770,e4369d08) at fork_exit+0x7f/frame 0xe4369cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4369cf4 --- trap 0, eip = 0, esp = 0xe4369d40, ebp = 0 --- Tracing command intr pid 12 tid 100011 td 0xc82e3620 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100010 td 0xc82e3930 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100009 td 0xc82e3c40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100008 td 0xc82e6000 sched_switch(c82e6000,0,109,1bb,0,...) at sched_switch+0x4b9/frame 0xe435dc60 mi_switch(109,0,c1196175,55a,8,...) at mi_switch+0x1c9/frame 0xe435dc94 ithread_loop(c83277b0,e435dd08,c1195f04,3d5,0,...) at ithread_loop+0x201/frame 0xe435dccc fork_exit(c0a95440,c83277b0,e435dd08) at fork_exit+0x7f/frame 0xe435dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe435dcf4 --- trap 0, eip = 0, esp = 0xe435dd40, ebp = 0 --- Tracing command intr pid 12 tid 100007 td 0xc82e6310 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100006 td 0xc82e6620 sched_switch(c82e6620,0,108,1b6,c119ec89,...) at sched_switch+0x4b9/frame 0xe4356c1c mi_switch(108,0,c119ec89,40f,c1321c88,...) at mi_switch+0x1c9/frame 0xe4356c50 sched_idletd(0,e4356d08,c1195f04,3d5,0,...) at sched_idletd+0x43b/frame 0xe4356ccc fork_exit(c0aed4f0,0,e4356d08) at fork_exit+0x7f/frame 0xe4356cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4356cf4 --- trap 0, eip = 0, esp = 0xe4356d40, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc82e6930 sched_switch(c82e6930,0,108,1b6,c119ec89,...) at sched_switch+0x4b9/frame 0xe4353c1c mi_switch(108,0,c119ec89,40f,c1321588,...) at mi_switch+0x1c9/frame 0xe4353c50 sched_idletd(0,e4353d08,c1195f04,3d5,0,...) at sched_idletd+0x43b/frame 0xe4353ccc fork_exit(c0aed4f0,0,e4353d08) at fork_exit+0x7f/frame 0xe4353cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4353cf4 --- trap 0, eip = 0, esp = 0xe4353d40, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc82e6c40 sched_switch(c82e6c40,0,108,1b6,c119ec89,...) at sched_switch+0x4b9/frame 0xe4350c1c mi_switch(108,0,c119ec89,40f,c1320e88,...) at mi_switch+0x1c9/frame 0xe4350c50 sched_idletd(0,e4350d08,c1195f04,3d5,0,...) at sched_idletd+0x43b/frame 0xe4350ccc fork_exit(c0aed4f0,0,e4350d08) at fork_exit+0x7f/frame 0xe4350cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4350cf4 --- trap 0, eip = 0, esp = 0xe4350d40, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xc82e7000 sched_switch(c82e7000,0,108,1b6,c119ec89,...) at sched_switch+0x4b9/frame 0xe434dc1c mi_switch(108,0,c119ec89,40f,c1320788,...) at mi_switch+0x1c9/frame 0xe434dc50 sched_idletd(0,e434dd08,c1195f04,3d5,0,...) at sched_idletd+0x43b/frame 0xe434dccc fork_exit(c0aed4f0,0,e434dd08) at fork_exit+0x7f/frame 0xe434dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe434dcf4 --- trap 0, eip = 0, esp = 0xe434dd40, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc82e7310 sched_switch(c82e7310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xe434998c mi_switch(104,0,c11a2855,1f5,c11a2855,...) at mi_switch+0x1c9/frame 0xe43499c0 sleepq_switch(c82e7310,0,c11a2855,1ab,e4349a38,...) at sleepq_switch+0x1c5/frame 0xe43499f4 sleepq_catch_signals(0,c11a2855,162,12f0,c82e22e8,...) at sleepq_catch_signals+0x36c/frame 0xe4349a3c sleepq_wait_sig(c82e22e8,6c,c11a64e1,100,0,...) at sleepq_wait_sig+0x14/frame 0xe4349a60 _sleep(c82e22e8,c82e237c,16c,c11a64e1,0,...) at _sleep+0x364/frame 0xe4349abc kern_wait6(c82e7310,7,0,0,e4349b4c,...) at kern_wait6+0x45c/frame 0xe4349b20 sys_wait4(c82e7310,e4349cc8,c11f8136,d6,e4349ccc,...) at sys_wait4+0x94/frame 0xe4349c40 syscall(e4349d08) at syscall+0x2ed/frame 0xe4349cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xe4349cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x805eb07, esp = 0xbfbfd8f4, ebp = 0xbfbfd908 --- Tracing command audit pid 10 tid 100001 td 0xc82e7620 sched_switch(c82e7620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xe4346ba8 mi_switch(104,0,c11a2855,1f5,8,...) at mi_switch+0x1c9/frame 0xe4346bdc sleepq_switch(c82e7620,0,c11a2855,26b,c82e7620,...) at sleepq_switch+0x1c5/frame 0xe4346c10 sleepq_wait(c14e89b8,0,e4346c64,1,0,...) at sleepq_wait+0x48/frame 0xe4346c34 _cv_wait(c14e89b8,c14e8944,c11cf222,18d,0,...) at _cv_wait+0x1f9/frame 0xe4346c78 audit_worker(0,e4346d08,c1195f04,3d5,0,...) at audit_worker+0x94/frame 0xe4346ccc fork_exit(c0cf32d0,0,e4346d08) at fork_exit+0x7f/frame 0xe4346cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4346cf4 --- trap 0, eip = 0, esp = 0xe4346d40, ebp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xc8501620 sched_switch(c8501620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed580b68 mi_switch(104,0,c11a2855,1f5,101,...) at mi_switch+0x1c9/frame 0xed580b9c sleepq_switch(c8501620,0,c11a2855,28e,c13133ff,...) at sleepq_switch+0x1c5/frame 0xed580bd0 sleepq_timedwait(c13133ff,0,2,0,0,...) at sleepq_timedwait+0x48/frame 0xed580bf4 _sleep(c13133ff,0,0,c118818e,fffffc88,...) at _sleep+0x350/frame 0xed580c50 pause_sbt(c118818e,fffffc88,2,0,0,...) at pause_sbt+0xe9/frame 0xed580c8c deadlkres(0,ed580d08,c1195f04,3d5,0,...) at deadlkres+0x82/frame 0xed580ccc fork_exit(c0a73700,0,ed580d08) at fork_exit+0x7f/frame 0xed580cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed580cf4 --- trap 0, eip = 0, esp = 0xed580d40, ebp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xc8501930 sched_switch(c8501930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xed57dbc0 mi_switch(104,0,c11a2855,1f5,c132f600,...) at mi_switch+0x1c9/frame 0xed57dbf4 sleepq_switch(c8501930,0,c11a2855,26b,c8399b80,...) at sleepq_switch+0x1c5/frame 0xed57dc28 sleepq_wait(c8399b80,0,c119d2bd,c118818e,0,...) at sleepq_wait+0x48/frame 0xed57dc4c msleep_spin_sbt(c8399b80,c8399b98,c118818e,0,0,...) at msleep_spin_sbt+0x239/frame 0xed57dc94 taskqueue_thread_loop(c14da680,ed57dd08,c1195f04,3d5,0,...) at taskqueue_thread_loop+0xcc/frame 0xed57dccc fork_exit(c0b0ec80,c14da680,ed57dd08) at fork_exit+0x7f/frame 0xed57dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xed57dcf4 --- trap 0, eip = 0, esp = 0xed57dd40, ebp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xc82e7c40 sched_switch(c82e7c40,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xe4391bc0 mi_switch(104,0,c11a2855,1f5,c1330230,...) at mi_switch+0x1c9/frame 0xe4391bf4 sleepq_switch(c82e7c40,0,c11a2855,26b,c8399d00,...) at sleepq_switch+0x1c5/frame 0xe4391c28 sleepq_wait(c8399d00,0,c119d2bd,c118818e,0,...) at sleepq_wait+0x48/frame 0xe4391c4c msleep_spin_sbt(c8399d00,c8399d18,c118818e,0,0,...) at msleep_spin_sbt+0x239/frame 0xe4391c94 taskqueue_thread_loop(c14db1a4,e4391d08,c1195f04,3d5,0,...) at taskqueue_thread_loop+0xcc/frame 0xe4391ccc fork_exit(c0b0ec80,c14db1a4,e4391d08) at fork_exit+0x7f/frame 0xe4391cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4391cf4 --- trap 0, eip = 0, esp = 0xe4391d40, ebp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xc838a000 sched_switch(c838a000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xe438ebc0 mi_switch(104,0,c11a2855,1f5,c1330230,...) at mi_switch+0x1c9/frame 0xe438ebf4 sleepq_switch(c838a000,0,c11a2855,26b,c8399d00,...) at sleepq_switch+0x1c5/frame 0xe438ec28 sleepq_wait(c8399d00,0,c119d2bd,c118818e,0,...) at sleepq_wait+0x48/frame 0xe438ec4c msleep_spin_sbt(c8399d00,c8399d18,c118818e,0,0,...) at msleep_spin_sbt+0x239/frame 0xe438ec94 taskqueue_thread_loop(c14db1a4,e438ed08,c1195f04,3d5,0,...) at taskqueue_thread_loop+0xcc/frame 0xe438eccc fork_exit(c0b0ec80,c14db1a4,e438ed08) at fork_exit+0x7f/frame 0xe438ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe438ecf4 --- trap 0, eip = 0, esp = 0xe438ed40, ebp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xc838a310 sched_switch(c838a310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xe438bbc0 mi_switch(104,0,c11a2855,1f5,c1330230,...) at mi_switch+0x1c9/frame 0xe438bbf4 sleepq_switch(c838a310,0,c11a2855,26b,c8399d00,...) at sleepq_switch+0x1c5/frame 0xe438bc28 sleepq_wait(c8399d00,0,c119d2bd,c118818e,0,...) at sleepq_wait+0x48/frame 0xe438bc4c msleep_spin_sbt(c8399d00,c8399d18,c118818e,0,0,...) at msleep_spin_sbt+0x239/frame 0xe438bc94 taskqueue_thread_loop(c14db1a4,e438bd08,c1195f04,3d5,0,...) at taskqueue_thread_loop+0xcc/frame 0xe438bccc fork_exit(c0b0ec80,c14db1a4,e438bd08) at fork_exit+0x7f/frame 0xe438bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe438bcf4 --- trap 0, eip = 0, esp = 0xe438bd40, ebp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xc838a620 sched_switch(c838a620,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xe4388bac mi_switch(104,0,c11a2855,1f5,162,...) at mi_switch+0x1c9/frame 0xe4388be0 sleepq_switch(c838a620,0,c11a2855,26b,c8399d80,...) at sleepq_switch+0x1c5/frame 0xe4388c14 sleepq_wait(c8399d80,0,c118818e,0,0,...) at sleepq_wait+0x48/frame 0xe4388c38 _sleep(c8399d80,c8399d98,0,c118818e,0,...) at _sleep+0x385/frame 0xe4388c94 taskqueue_thread_loop(c14e3448,e4388d08,c1195f04,3d5,0,...) at taskqueue_thread_loop+0x129/frame 0xe4388ccc fork_exit(c0b0ec80,c14e3448,e4388d08) at fork_exit+0x7f/frame 0xe4388cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4388cf4 --- trap 0, eip = 0, esp = 0xe4388d40, ebp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xc838b000 sched_switch(c838b000,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xe437fbac mi_switch(104,0,c11a2855,1f5,162,...) at mi_switch+0x1c9/frame 0xe437fbe0 sleepq_switch(c838b000,0,c11a2855,26b,c8399e80,...) at sleepq_switch+0x1c5/frame 0xe437fc14 sleepq_wait(c8399e80,0,c118818e,0,0,...) at sleepq_wait+0x48/frame 0xe437fc38 _sleep(c8399e80,c8399e98,0,c118818e,0,...) at _sleep+0x385/frame 0xe437fc94 taskqueue_thread_loop(c14e89f0,e437fd08,c1195f04,3d5,0,...) at taskqueue_thread_loop+0x129/frame 0xe437fccc fork_exit(c0b0ec80,c14e89f0,e437fd08) at fork_exit+0x7f/frame 0xe437fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe437fcf4 --- trap 0, eip = 0, esp = 0xe437fd40, ebp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xc838b310 sched_switch(c838b310,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xe437cbac mi_switch(104,0,c11a2855,1f5,162,...) at mi_switch+0x1c9/frame 0xe437cbe0 sleepq_switch(c838b310,0,c11a2855,26b,c8399f00,...) at sleepq_switch+0x1c5/frame 0xe437cc14 sleepq_wait(c8399f00,0,c118818e,0,0,...) at sleepq_wait+0x48/frame 0xe437cc38 _sleep(c8399f00,c8399f18,0,c118818e,0,...) at _sleep+0x385/frame 0xe437cc94 taskqueue_thread_loop(c14e6340,e437cd08,c1195f04,3d5,0,...) at taskqueue_thread_loop+0x129/frame 0xe437cccc fork_exit(c0b0ec80,c14e6340,e437cd08) at fork_exit+0x7f/frame 0xe437ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe437ccf4 --- trap 0, eip = 0, esp = 0xe437cd40, ebp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xc838b930 sched_switch(c838b930,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xe4375bac mi_switch(104,0,c11a2855,1f5,162,...) at mi_switch+0x1c9/frame 0xe4375be0 sleepq_switch(c838b930,0,c11a2855,26b,c839a000,...) at sleepq_switch+0x1c5/frame 0xe4375c14 sleepq_wait(c839a000,0,c118818e,0,0,...) at sleepq_wait+0x48/frame 0xe4375c38 _sleep(c839a000,c839a018,0,c118818e,0,...) at _sleep+0x385/frame 0xe4375c94 taskqueue_thread_loop(c132e844,e4375d08,c1195f04,3d5,0,...) at taskqueue_thread_loop+0x129/frame 0xe4375ccc fork_exit(c0b0ec80,c132e844,e4375d08) at fork_exit+0x7f/frame 0xe4375cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4375cf4 --- trap 0, eip = 0, esp = 0xe4375d40, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc14e2fb0 sched_switch(c14e2fb0,0,104,1bb,c0ab0e3e,...) at sched_switch+0x4b9/frame 0xc1820c2c mi_switch(104,0,c11a2855,1f5,101,...) at mi_switch+0x1c9/frame 0xc1820c60 sleepq_switch(c14e2fb0,0,c11a2855,28e,c14e2cc4,...) at sleepq_switch+0x1c5/frame 0xc1820c94 sleepq_timedwait(c14e2cc4,54,9,0,0,...) at sleepq_timedwait+0x48/frame 0xc1820cb8 _sleep(c14e2cc4,0,54,c11da5a2,fffff470,...) at _sleep+0x350/frame 0xc1820d14 swapper() at swapper+0x24f/frame 0xc1820d58 begin() at begin+0x2c db:0:allt> call doadump Physical memory: 3435 MB Dumping 318 MB: 303 287 271 255 239 223 207 191 175 159 143 127 111 95 79 63 47 31 15 Dump complete = 0 db:0:doadump> reset (kgdb) bt #0 doadump (textdump=0xa) at pcpu.h:232 #1 0xc051f5bd in db_fncall (dummy1=0x19, dummy2=0x0, dummy3=0xc12e37f4, dummy4=0xe436f5a0 "") at ../../../ddb/db_command.c:578 #2 0xc051f2a7 in db_command (cmd_table=) at ../../../ddb/db_command.c:449 #3 0xc05231e4 in db_script_exec (scriptname=0xc14daf04 "doadump", warnifnotfound=) at ../../../ddb/db_script.c:302 #4 0xc051f2a7 in db_command (cmd_table=) at ../../../ddb/db_command.c:449 #5 0xc051efc0 in db_command_loop () at ../../../ddb/db_command.c:502 #6 0xc0521850 in db_trap (type=, code=0x0) at ../../../ddb/db_main.c:231 #7 0xc0afe748 in kdb_trap (type=, code=, tf=) at ../../../kern/subr_kdb.c:654 #8 0xc0f6df5f in trap (frame=) at ../../../i386/i386/trap.c:720 #9 0xc0f56e3c in calltrap () at ../../../i386/i386/exception.s:170 #10 0xc0afdfed in kdb_enter (why=0xc119c655 "panic", msg=) at cpufunc.h:71 #11 0xc0ac52a3 in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:747 #12 0xc0ac52e2 in panic (fmt=0xc11d4b85 "handle_written_inodeblock: live inodedep %p") at ../../../kern/kern_shutdown.c:683 #13 0xc0d460bf in handle_written_inodeblock (inodedep=0xcc731200, bp=0xe42f31f0) at ../../../ufs/ffs/ffs_softdep.c:11277 #14 0xc0d2825a in softdep_disk_write_complete (bp=0xe42f31f0) at ../../../ufs/ffs/ffs_softdep.c:10726 #15 0xc0b5c119 in buf_complete (bp=0xe42f31f0) at buf.h:420 #16 0xc0b5bb56 in bufdone_finish (bp=0xe42f31f0) at ../../../kern/vfs_bio.c:3781 #17 0xc0b5b7e2 in bufdone (bp=0xe42f31f0) at ../../../kern/vfs_bio.c:3769 #18 0xc0a287ac in g_vfs_done (bip=) at ../../../geom/geom_vfs.c:161 #19 0xc0b5b023 in biodone (bp=0xc99043d8) at ../../../kern/vfs_bio.c:3587 #20 0xc0a22cc9 in g_io_schedule_up (tp=0xc838c000) at ../../../geom/geom_io.c:796 #21 0xc0a233ad in g_up_procbody (arg=0x0) at ../../../geom/geom_kern.c:97 #22 0xc0a9249f in fork_exit (callout=0xc0a23310 ) at ../../../kern/kern_fork.c:989 #23 0xc0f56ee4 in fork_trampoline () at ../../../i386/i386/exception.s:279 Current language: auto; currently minimal (kgdb) f 13 #13 0xc0d460bf in handle_written_inodeblock (inodedep=0xcc731200, bp=0xe42f31f0) at ../../../ufs/ffs/ffs_softdep.c:11277 11277 panic("handle_written_inodeblock: live inodedep %p", (kgdb) l 11272 * the state here so free_inodedep() can succeed. 11273 */ 11274 if (inodedep->id_state & GOINGAWAY) 11275 inodedep->id_state |= COMPLETE | DEPCOMPLETE; 11276 if (free_inodedep(inodedep) == 0) 11277 panic("handle_written_inodeblock: live inodedep %p", 11278 inodedep); 11279 add_to_worklist(&freefile->fx_list, 0); 11280 return (0); 11281 } (kgdb) info loc freefile = (struct freefile *) 0xcdd3dee0 adp = (struct allocdirect *) 0x0 nextadp = (struct allocdirect *) 0xc149129c dp1 = (struct ufs1_dinode *) 0x0 dp2 = (struct ufs2_dinode *) 0xe8ff8700 wkhd = {lh_first = 0x0} hadchanges = 0x1 fstype = 0x2 freelink = 0x0 (kgdb) p *inodedep $1 = {id_list = {wk_list = {le_next = 0xcd10eb00, le_prev = 0xe42f3378}, wk_mp = 0xc8df9000, wk_type = 0x1, wk_state = 0x10d}, id_hash = {le_next = 0x0, le_prev = 0xc86b3db0}, id_unlinked = {tqe_next = 0x70707070, tqe_prev = 0x70707070}, id_fs = 0xcbd4b000, id_ino = 0x278c7, id_nlinkdelta = 0x0, id_savednlink = 0xffff, id_deps = { le_next = 0x70707070, le_prev = 0x70707070}, id_bmsafemap = 0xc89bb180, id_mkdiradd = 0x0, id_inoreflst = {tqh_first = 0xcbd6bb40, tqh_last = 0xcbd6bb50}, id_savedextsize = 0xffffffff, id_savedsize = 0xffffffffffffffff, id_dirremhd = {lh_first = 0x0}, id_pendinghd = {lh_first = 0x0}, id_bufwait = {lh_first = 0x0}, id_inowait = { lh_first = 0x0}, id_inoupdt = {tqh_first = 0x0, tqh_last = 0xcc731260}, id_newinoupdt = {tqh_first = 0x0, tqh_last = 0xcc731268}, id_extupdt = {tqh_first = 0x0, tqh_last = 0xcc731270}, id_newextupdt = {tqh_first = 0x0, tqh_last = 0xcc731278}, id_freeblklst = {tqh_first = 0x0, tqh_last = 0xcc731280}, id_un = {idu_savedino1 = 0x0, idu_savedino2 = 0x0}} (kgdb) #define ATTACHED 0x000001 #define COMPLETE 0x000004 #define DEPCOMPLETE 0x000008 #define GOINGAWAY 0x000100 /* indirdep, jremref only */ $ svn diff -x -p /usr/src/sys -- Test scenario: wip/mv4.sh