GENERIC HEAD from 2011-06-13 04:31:57 UTC, r223036M, vmcore.163 KDB: debugger backends: ddb KDB: current backend: ddb 524288K of memory above 4GB ignored Copyright (c) 1992-2011 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 9.0-CURRENT #1 r223036M: Tue Jun 14 07:54:08 CEST 2011 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 10 Model = 2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 4294967296 (4096 MB) avail memory = 3531759616 (3368 MB) : Trying to mount root from ufs:/dev/ad4s1a [rw]... Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/ad4s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1a: clean, 333639 free (2671 frags, 41371 blocks, 0.3% fragmentation) /dev/ad4s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1f: clean, 197359 free (4479 frags, 24110 blocks, 0.4% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 94307269 free (2957 frags, 11788039 blocks, 0.0% fragmentation) /dev/ad4s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1d: clean, 2336806 free (222182 frags, 264328 blocks, 2.2% fragmentation) /dev/ad4s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1e: clean, 6351699 free (48363 frags, 787917 blocks, 0.2% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN Starting Network: lo0 re0 fwe0 fwip0. lo0: flags=8049 metric 0 mtu 16384 options=3 inet 127.0.0.1 netmask 0xff000000 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0xa nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=389b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 tentative scopeid 0x1 nd6 options=29 media: Ethernet autoselect (none) status: no carrier fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 Starting devd. Starting Network: usbus0. Starting Network: usbus1. Starting Network: usbus2. Starting Network: usbus3. Starting Network: usbus4. Starting Network: usbus5. Starting Network: fwe0. fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 re0: link state changed to UP Starting Network: fwip0. fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/kde4/lib /usr/local/lib /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/nss /usr/local/lib/qt4 /usr/local/lib/virtualbox /usr/local/lib/wine a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. No core dumps found. Additional ABI support: linuxkldload: can't load linux: No such file or directory /etc/rc: WARNING: Unable to load kernel module linux . Starting rpcbind. kldload: can't load nfsclient: No such file or directory /etc/rc: WARNING: Unable to load kernel module nfsclient lock order reversal: 1st 0xe0b1b780 bufwait (bufwait) @ kern/vfs_bio.c:2658 2nd 0xc7d56a00 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper(c0ef22b6,2e687361,38323a63,c7000a34,a7a,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a34ceb,c0ef5cbf,c715e308,c7162408,ef646894,...) at kdb_backtrace+0x2a _witness_debugger(c0ef5cbf,c7d56a00,c0f24f62,c7162408,c0f24bf4,...) at _witness_debugger+0x25 witness_checkorder(c7d56a00,9,c0f24beb,11c,0,...) at witness_checkorder+0x839 _sx_xlock(c7d56a00,0,c0f24beb,11c,c7bb0074,...) at _sx_xlock+0x85 ufsdirhash_acquire(e0b1b720,ef6469ec,7c,e1785994,ef646964,...) at ufsdirhash_acquire+0x48 ufsdirhash_add(c7bb0074,ef6469ec,1994,ef646950,ef646954,...) at ufsdirhash_add+0x13 ufs_direnter(c7b95570,c7d5dd98,ef6469ec,ef646bd0,e0b1bda0,...) at ufs_direnter+0x749 ufs_mkdir(ef646bf8,c0f42ee7,0,0,ef646b3c,...) at ufs_mkdir+0x936 VOP_MKDIR_APV(c1030660,ef646bf8,ef646bd0,ef646b3c,0,...) at VOP_MKDIR_APV+0xc5 kern_mkdirat(c780a000,ffffff9c,28404020,0,1c0,...) at kern_mkdirat+0x225 kern_mkdir(c780a000,28404020,0,1c0,ef646c7c,...) at kern_mkdir+0x2e mkdir(c780a000,ef646cec,ef646d28,c0ef450a,0,...) at mkdir+0x29 syscallenter(c780a000,ef646ce4,ef646ce4,0,0,...) at syscallenter+0x263 syscall(ef646d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, mkdir), eip = 0x281726e3, esp = 0xbfbfe8cc, ebp = 0xbfbfed78 --- Clearing /tmp (X related). kldload: can't load nfsserver: No such file or directory /etc/rc: WARNING: Unable to load kernel module nfsserver Starting mountd. NFSv4 is disabled Starting nfsd. Recovering vi editor sessions:lock order reversal: 1st 0xc7dadc94 ufs (ufs) @ kern/vfs_lookup.c:501 2nd 0xe0b22120 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:261 3rd 0xc7dad9dc ufs (ufs) @ kern/vfs_subr.c:2134 KDB: stack backtrace: db_trace_self_wrapper(c0ef22b6,3a632e73,a313632,34826d00,1,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a34ceb,c0ef5cd8,c715e308,c71623a0,ef6bf344,...) at kdb_backtrace+0x2a _witness_debugger(c0ef5cd8,c7dad9dc,c0ee5070,c71623a0,c0efd8db,...) at _witness_debugger+0x25 witness_checkorder(c7dad9dc,9,c0efd8d2,856,0,...) at witness_checkorder+0x839 __lockmgr_args(c7dad9dc,80100,c7dada48,0,0,...) at __lockmgr_args+0x814 ffs_lock(ef6bf468,c0a465db,c0efcc37,80100,c7dad984,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c1030660,ef6bf468,c78940b0,c104b660,c7dad984,...) at VOP_LOCK1_APV+0xb5 _vn_lock(c7dad984,80100,c0efd8d2,856,4,...) at _vn_lock+0x78 vget(c7dad984,80100,c7894000,50,0,...) at vget+0xbb vfs_hash_get(c7860b50,15f4ab,80000,c7894000,ef6bf5ac,...) at vfs_hash_get+0xed ffs_vgetf(c7860b50,15f4ab,80000,ef6bf5ac,1,...) at ffs_vgetf+0x49 softdep_sync_buf(c7dadc3c,e0b220c0,1,107,0,...) at softdep_sync_buf+0xac9 ffs_syncvnode(c7dadc3c,1,c715e308,c11d0a40,ef6bf63c,...) at ffs_syncvnode+0x238 ffs_truncate(c7dadc3c,200,0,880,c741fc80,...) at ffs_truncate+0x80b ufs_direnter(c7dadc3c,c7dad984,ef6bf914,ef6bfba4,0,...) at ufs_direnter+0x924 ufs_makeinode(ef6bfba4,c1030be0,ef6bfb00,ef6bfa5c,c0d4d6d5,...) at ufs_makeinode+0x5e5 ufs_create(ef6bfb00,c0f430ad,0,0,ef6bfb78,...) at ufs_create+0x30 VOP_CREATE_APV(c1030660,ef6bfb00,ef6bfba4,ef6bfa98,0,...) at VOP_CREATE_APV+0xc5 vn_open_cred(ef6bfb78,ef6bfc2c,1b0,0,c741fc80,...) at vn_open_cred+0x205 vn_open(ef6bfb78,ef6bfc2c,1b0,c78bd700,0,...) at vn_open+0x3b kern_openat(c7894000,ffffff9c,28839f60,0,a03,...) at kern_openat+0x12f kern_open(c7894000,28839f60,0,a02,1b0,...) at kern_open+0x35 open(c7894000,ef6bfcec,ef6bfd28,c0ef450a,0,...) at open+0x30 syscallenter(c7894000,ef6bfce4,ef6bfce4,0,0,...) at syscallenter+0x263 syscall(ef6bfd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, open), eip = 0x283d1723, esp = 0xbfbfc4fc, ebp = 0xbfbfc588 --- . Updating motd:. Starting ntpd. Starting default moused. Expensive timeout(9) function: 0xc084e330(0xc1226800) 0.012502147 s Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Local package initialization: backuplock order reversal: 1st 0xc78ff9dc ufs (ufs) @ kern/vfs_mount.c:1193 2nd 0xc78ff058 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1826 KDB: stack backtrace: db_trace_self_wrapper(c0ef22b6,38313a63,a3632,c0f265e1,c19b3888,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a34ceb,c0ef5cbf,c71623a0,c7162268,ef6b6a04,...) at kdb_backtrace+0x2a _witness_debugger(c0ef5cbf,c78ff058,c0edcee7,c7162268,c0f211e9,...) at _witness_debugger+0x25 witness_checkorder(c78ff058,9,c0f211e0,722,c78ff0c4,...) at witness_checkorder+0x839 __lockmgr_args(c78ff058,80400,c78ff0c4,0,0,...) at __lockmgr_args+0x814 vop_stdlock(ef6b6b24,4,c0eec987,80400,c78ff000,...) at vop_stdlock+0x65 VOP_LOCK1_APV(c1006160,ef6b6b24,c1204530,c104b660,c78ff000,...) at VOP_LOCK1_APV+0xb5 _vn_lock(c78ff000,80400,c0f211e0,722,c7b972d4,...) at _vn_lock+0x78 softdep_flushworklist(c7b972d4,ef6b6bd0,c78948a0,576,0,...) at softdep_flushworklist+0x47 ffs_sync(c7b972d4,1,ef6b6c14,4ee,80,...) at ffs_sync+0x2fd dounmount(c7b972d4,8080000,c78948a0,473,5b85c5ea,...) at dounmount+0x447 unmount(c78948a0,ef6b6cec,28176785,1,0,...) at unmount+0x310 syscallenter(c78948a0,ef6b6ce4,c0d2a54d,c1086470,0,...) at syscallenter+0x263 syscall(ef6b6d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (22, FreeBSD ELF32, unmount), eip = 0x280dcddb, esp = 0xbfbfe64c, ebp = 0xbfbfe718 --- ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes Jun 14 07:56:21 x4 su: pho to root on /dev/pts/1 ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 101377 files, 24006712 used, 94307269 free (2957 frags, 11788039 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 101377 files, 24006712 used, 94307269 free (2957 frags, 11788039 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmp watchdogd. Starting inetd. Tue Jun 14 07:59:04 CEST 2011 FreeBSD/i386 (x4.osted.lan) (console) login: lock order reversal: 1st 0xe0c37560 bufwait (bufwait) @ kern/vfs_bio.c:2658 2nd 0xc7bd351c snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:815 KDB: stack backtrace: db_trace_self_wrapper(c0ef22b6,632e746f,3531383a,ef6c000a,c0a465db,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0a34ceb,c0ef5cbf,c715e308,c71628e8,ef6cb50c,...) at kdb_backtrace+0x2a _witness_debugger(c0ef5cbf,c7bd351c,c0f20c85,c71628e8,c0f20c0f,...) at _witness_debugger+0x25 witness_checkorder(c7bd351c,9,c0f20c06,32f,ca881790,...) at witness_checkorder+0x839 __lockmgr_args(c7bd351c,80400,ca881790,0,0,...) at __lockmgr_args+0x814 ffs_lock(ef6cb630,e0b3f860,100000,80400,ca8816cc,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c1030660,ef6cb630,e0b3f908,c104b660,ca8816cc,...) at VOP_LOCK1_APV+0xb5 _vn_lock(ca8816cc,80400,c0f20c06,32f,0,...) at _vn_lock+0x78 ffs_snapshot(c834eb50,c7411380,c0f24090,176,ef6cb980,...) at ffs_snapshot+0x2946 ffs_mount(c834eb50,c88e4300,ff,393,0,...) at ffs_mount+0x15a0 vfs_donmount(c7cc7b80,211300,c7d54480,c7d54480,c7921834,...) at vfs_donmount+0x1147 nmount(c7cc7b80,ef6cbcec,ef6cbd28,c0ef450a,0,...) at nmount+0x84 syscallenter(c7cc7b80,ef6cbce4,ef6cbce4,0,0,...) at syscallenter+0x263 syscall(ef6cbd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (378, FreeBSD ELF32, nmount), eip = 0x280daa5b, esp = 0xbfbfe0ec, ebp = 0xbfbfe868 --- fsync: giving up on dirty 0xc83cc000: tag devfs, type VCHR usecount 1, writecount 0, refcount 277 mountedhere 0xc80df700 flags (VV_COPYONWRITE) v_object 0xc83be198 ref 0 pages 2222 lock type devfs: EXCL by thread 0xc7cc65c0 (pid 2629) #0 0xc09e43ae at __lockmgr_args+0xbfe #1 0xc0a84395 at vop_stdlock+0x65 #2 0xc0d4c705 at VOP_LOCK1_APV+0xb5 #3 0xc0aa4328 at _vn_lock+0x78 #4 0xc0c2e5f7 at softdep_flushworklist+0x47 #5 0xc0c31ecd at ffs_sync+0x2fd #6 0xc0aa4102 at vfs_write_suspend+0x122 #7 0xc0c16921 at ffs_snapshot+0xc91 #8 0xc0c33e10 at ffs_mount+0x15a0 #9 0xc0a8db27 at vfs_donmount+0x1147 #10 0xc0a8e194 at nmount+0x84 #11 0xc0a3efa3 at syscallenter+0x263 #12 0xc0d29cef at syscall+0x4f #13 0xc0d133b1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xc83cc000: tag devfs, type VCHR usecount 1, writecount 0, refcount 277 mountedhere 0xc80df700 flags (VV_COPYONWRITE) v_object 0xc83be198 ref 0 pages 2222 lock type devfs: EXCL by thread 0xc7cc65c0 (pid 2629) #0 0xc09e43ae at __lockmgr_args+0xbfe #1 0xc0a84395 at vop_stdlock+0x65 #2 0xc0d4c705 at VOP_LOCK1_APV+0xb5 #3 0xc0aa4328 at _vn_lock+0x78 #4 0xc0c31fa5 at ffs_sync+0x3d5 #5 0xc0aa4102 at vfs_write_suspend+0x122 #6 0xc0c16921 at ffs_snapshot+0xc91 #7 0xc0c33e10 at ffs_mount+0x15a0 #8 0xc0a8db27 at vfs_donmount+0x1147 #9 0xc0a8e194 at nmount+0x84 #10 0xc0a3efa3 at syscallenter+0x263 #11 0xc0d29cef at syscall+0x4f #12 0xc0d133b1 at Xint0x80_syscall+0x21 dev md5a fsync: giving up on dirty 0xc83cc000: tag devfs, type VCHR usecount 1, writecount 0, refcount 50 mountedhere 0xc80df700 flags (VV_COPYONWRITE) v_object 0xc83be198 ref 0 pages 2206 lock type devfs: EXCL by thread 0xc78945c0 (pid 2647) #0 0xc09e43ae at __lockmgr_args+0xbfe #1 0xc0a84395 at vop_stdlock+0x65 #2 0xc0d4c705 at VOP_LOCK1_APV+0xb5 #3 0xc0aa4328 at _vn_lock+0x78 #4 0xc0c2e5f7 at softdep_flushworklist+0x47 #5 0xc0c31ecd at ffs_sync+0x2fd #6 0xc0aa4102 at vfs_write_suspend+0x122 #7 0xc0c16921 at ffs_snapshot+0xc91 #8 0xc0c33e10 at ffs_mount+0x15a0 #9 0xc0a8db27 at vfs_donmount+0x1147 #10 0xc0a8e194 at nmount+0x84 #11 0xc0a3efa3 at syscallenter+0x263 #12 0xc0d29cef at syscall+0x4f #13 0xc0d133b1 at Xint0x80_syscall+0x21 dev md5a Jun 14 07:59:34 x4 kernel: pid 18 (softdepflush), uid 0 inumber 7 on /mnt: filesystem full Jun 14 08:55:36 x4 su: pho to root on /dev/pts/2 ~KDB: enter: Line break on console [ thread pid 11 tid 100003 ] Stopped at kdb_enter+0x3a: movl $0,kdb_why db> run pho db:0:pho> bt Tracing pid 11 tid 100003 td 0xc71be8a0 kdb_enter(c0d6755e,c0eb8210,0,c756f080,0,...) at kdb_enter+0x3a uart_intr(c756f000,0,c1228ea0,c6f37be8,0,...) at uart_intr+0x126 intr_event_handle(c7188800,c6f37c10,c6f37c34,0,c73ea200,...) at intr_event_handle+0x76 intr_execute_handlers(c72020d0,c6f37c10,0,c6f37c50,c0d13715,...) at intr_execute_handlers+0x49 lapic_handle_intr(3c,c6f37c10) at lapic_handle_intr+0x36 Xapic_isr1() at Xapic_isr1+0x35 --- interrupt, eip = 0xc0d0ed15, esp = 0xc6f37c50, ebp = 0xc6f37c50 --- acpi_cpu_c1(c6f37c6c,c104cd50,0,300,eea,...) at acpi_cpu_c1+0x5 acpi_cpu_idle(0,c6f37ca0,c0d1cf39,0,ffffffff,...) at acpi_cpu_idle+0x122 cpu_idle_acpi(0,ffffffff,c1094a00,2,c6f37ce8,...) at cpu_idle_acpi+0x2f cpu_idle(0,c6f37cc4,c0ef03ab,a05,c71be8a0,...) at cpu_idle+0x89 sched_idletd(0,c6f37d28,c0ee8cf0,390,c71bc834,...) at sched_idletd+0x263 fork_exit(c0a21f70,0,c6f37d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f37d60, ebp = 0 --- db:0:bt> show allpcpu Current CPU: 0 cpuid = 0 dynamic pcpu = 0x7d9280 curthread = 0xc71be8a0: pid 11 "idle: cpu0" curpcb = 0xc6f37d80 fpcurthread = none idlethread = 0xc71be8a0: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x5edb280 curthread = 0xc71be5c0: pid 11 "idle: cpu1" curpcb = 0xc6f3ad80 fpcurthread = none idlethread = 0xc71be5c0: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x5ede280 curthread = 0xc74488a0: pid 18 "softdepflush" curpcb = 0xed40ed80 fpcurthread = none idlethread = 0xc71be2e0: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x5ee1280 curthread = 0xc71be000: pid 11 "idle: cpu3" curpcb = 0xc6f40d80 fpcurthread = none idlethread = 0xc71be000: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks Process 5333 (sshd) thread 0xcb6e95c0 (100194) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xc7e2056c) locked @ kern/uipc_sockbuf.c:148 Process 2716 (ls) thread 0xc789b2e0 (100084) shared lockmgr ufs (ufs) r = 0 (0xc83c6df0) locked @ kern/vfs_lookup.c:501 Process 2653 (suj21) thread 0xc794c8a0 (100142) exclusive lockmgr ufs (ufs) r = 0 (0xc9e97724) locked @ kern/vfs_vnops.c:612 Process 2176 (sshd) thread 0xc812d000 (100162) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xc7bd556c) locked @ kern/uipc_sockbuf.c:148 Process 2149 (sshd) thread 0xc794fb80 (100157) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xc7e2070c) locked @ kern/uipc_sockbuf.c:148 Process 2148 (sshd) thread 0xc7cc6000 (100156) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xc7f2456c) locked @ kern/uipc_sockbuf.c:148 Process 2147 (sshd) thread 0xc7cc62e0 (100155) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xc7d89d8c) locked @ kern/uipc_sockbuf.c:148 Process 18 (softdepflush) thread 0xc74488a0 (100076) exclusive sleep mutex Softdep Lock (Softdep Lock) r = 0 (0xc1204530) locked @ ufs/ffs/ffs_softdep.c:12462 exclusive lockmgr snaplk (snaplk) r = 0 (0xc7bd351c) locked @ ufs/ffs/ffs_snapshot.c:1749 Process 16 (syncer) thread 0xc7577000 (100074) exclusive lockmgr bufwait (bufwait) r = 0 (0xe0c8ee20) locked @ kern/vfs_bio.c:2658 exclusive lockmgr ufs (ufs) r = 0 (0xc83ec724) locked @ kern/vfs_subr.c:2134 exclusive lockmgr syncer (syncer) r = 0 (0xc83ec880) locked @ kern/vfs_subr.c:1734 Process 9 (bufdaemon) thread 0xc75772e0 (100073) exclusive lockmgr ufs (ufs) r = 0 (0xca4731b4) locked @ kern/vfs_bio.c:2372 db:0:alllocks> show lockedvnods Locked vnodes 0xc83c6d98: 0xc83c6d98: tag ufs, type VDIR tag ufs, type VDIR usecount 5, writecount 0, refcount 8 mountedhere 0 usecount 5, writecount 0, refcount 8 mountedhere 0 flags (VV_ROOT) flags (VV_ROOT) v_object 0xc83323b8 ref 0 pages 1 v_object 0xc83323b8 ref 0 pages 1 lock type ufs: SHARED (count 1) lock type ufs: SHARED (count 1) #0 0xc09e3d55 at __lockmgr_args+0x5a5 #0 0xc09e3d55 at __lockmgr_args+0x5a5 #1 0xc0c36a41 at ffs_lock+0xa1 #1 0xc0c36a41 at ffs_lock+0xa1 #2 0xc0d4c705 at VOP_LOCK1_APV+0xb5 #2 0xc0d4c705 at VOP_LOCK1_APV+0xb5 #3 0xc0aa4328 at _vn_lock+0x78 #3 0xc0aa4328 at _vn_lock+0x78 #4 0xc0a9745b at vget+0xbb #4 0xc0a9745b at vget+0xbb #5 0xc0a8840d at vfs_hash_get+0xed #5 0xc0a8840d at vfs_hash_get+0xed #6 0xc0c30f39 at ffs_vgetf+0x49 #6 0xc0c30f39 at ffs_vgetf+0x49 #7 0xc0c3149e at ffs_vget+0x2e #7 0xc0c3149e at ffs_vget+0x2e #8 0xc0c44df8 at ufs_root+0x28 #8 0xc0c44df8 at ufs_root+0x28 #9 0xc0a89a71 at lookup+0x9a1 #9 0xc0a89a71 at lookup+0x9a1 #10 0xc0a8a5b2 at namei+0x592 #10 0xc0a8a5b2 at namei+0x592 #11 0xc0a9cb6c at kern_statfs+0x8c #11 0xc0a9cb6c at kern_statfs+0x8c #12 0xc0a9cdab at statfs+0x3b #12 0xc0a9cdab at statfs+0x3b #13 0xc0a3efa3 at syscallenter+0x263 #13 0xc0a3efa3 at syscallenter+0x263 #14 0xc0d29cef at syscall+0x4f #14 0xc0d29cef at syscall+0x4f #15 0xc0d133b1 at Xint0x80_syscall+0x21 #15 0xc0d133b1 at Xint0x80_syscall+0x21 ino 2, on dev md5a ino 2, on dev md5a 0xc83ec828: 0xc83ec828: tag syncer, type VNON tag syncer, type VNON usecount 1, writecount 0, refcount 2 mountedhere 0 usecount 1, writecount 0, refcount 2 mountedhere 0 flags () flags () lock type syncer: EXCL by thread 0xc7577000 (pid 16) lock type syncer: EXCL by thread 0xc7577000 (pid 16) #0 0xc09e43ae at __lockmgr_args+0xbfe #0 0xc09e43ae at __lockmgr_args+0xbfe #1 0xc0a84395 at vop_stdlock+0x65 #1 0xc0a84395 at vop_stdlock+0x65 #2 0xc0d4c705 at VOP_LOCK1_APV+0xb5 #2 0xc0d4c705 at VOP_LOCK1_APV+0xb5 #3 0xc0aa4328 at _vn_lock+0x78 #3 0xc0aa4328 at _vn_lock+0x78 #4 0xc0a96b62 at sync_vnode+0x142 #4 0xc0a96b62 at sync_vnode+0x142 #5 0xc0a96ee2 at sched_sync+0x282 #5 0xc0a96ee2 at sched_sync+0x282 #6 0xc09cf528 at fork_exit+0xb8 #6 0xc09cf528 at fork_exit+0xb8 #7 0xc0d133c4 at fork_trampoline+0x8 #7 0xc0d133c4 at fork_trampoline+0x8 0xc83ec6cc: 0xc83ec6cc: tag ufs, type VDIR tag ufs, type VDIR usecount 1, writecount 0, refcount 5 mountedhere 0 usecount 1, writecount 0, refcount 5 mountedhere 0 flags () flags () v_object 0xc7daf440 ref 0 pages 2 v_object 0xc7daf440 ref 0 pages 2 lock type ufs: EXCL by thread 0xc7577000 (pid 16) lock type ufs: EXCL by thread 0xc7577000 (pid 16) with shared waiters pending with shared waiters pending #0 0xc09e43ae at __lockmgr_args+0xbfe #0 0xc09e43ae at __lockmgr_args+0xbfe #1 0xc0c36a41 at ffs_lock+0xa1 #1 0xc0c36a41 at ffs_lock+0xa1 #2 0xc0d4c705 at VOP_LOCK1_APV+0xb5 #2 0xc0d4c705 at VOP_LOCK1_APV+0xb5 #3 0xc0aa4328 at _vn_lock+0x78 #3 0xc0aa4328 at _vn_lock+0x78 #4 0xc0a9745b at vget+0xbb #4 0xc0a9745b at vget+0xbb #5 0xc0c31de6 at ffs_sync+0x216 #5 0xc0c31de6 at ffs_sync+0x216 #6 0xc0a99d3f at sync_fsync+0x18f #6 0xc0a99d3f at sync_fsync+0x18f #7 0xc0d4af35 at VOP_FSYNC_APV+0xc5 #7 0xc0d4af35 at VOP_FSYNC_APV+0xc5 #8 0xc0a96b8b at sync_vnode+0x16b #8 0xc0a96b8b at sync_vnode+0x16b #9 0xc0a96ee2 at sched_sync+0x282 #9 0xc0a96ee2 at sched_sync+0x282 #10 0xc09cf528 at fork_exit+0xb8 #10 0xc09cf528 at fork_exit+0xb8 #11 0xc0d133c4 at fork_trampoline+0x8 #11 0xc0d133c4 at fork_trampoline+0x8 ino 32768, on dev md5a ino 32768, on dev md5a 0xca8816cc: 0xca8816cc: tag ufs, type VREG tag ufs, type VREG usecount 1, writecount 0, refcount 270 mountedhere 0 usecount 1, writecount 0, refcount 270 mountedhere 0 flags (VV_SYSTEM) flags (VV_SYSTEM) v_object 0xca7becc0 ref 0 pages 108720 v_object 0xca7becc0 ref 0 pages 108720 lock type snaplk: EXCL by thread 0xc74488a0 (pid 18) lock type snaplk: EXCL by thread 0xc74488a0 (pid 18) with exclusive waiters pending with exclusive waiters pending #0 0xc09e43ae at __lockmgr_args+0xbfe #0 0xc09e43ae at __lockmgr_args+0xbfe #1 0xc0c1164a at ffs_snapblkfree+0xea #1 0xc0c1164a at ffs_snapblkfree+0xea #2 0xc0c057b5 at ffs_blkfree+0x55 #2 0xc0c057b5 at ffs_blkfree+0x55 #3 0xc0c1c219 at handle_workitem_freefrag+0xe9 #3 0xc0c1c219 at handle_workitem_freefrag+0xe9 #4 0xc0c1da8d at process_worklist_item+0x2cd #4 0xc0c1da8d at process_worklist_item+0x2cd #5 0xc0c2e498 at softdep_process_worklist+0x88 #5 0xc0c2e498 at softdep_process_worklist+0x88 #6 0xc0c2ea60 at softdep_flush+0x2a0 #6 0xc0c2ea60 at softdep_flush+0x2a0 #7 0xc09cf528 at fork_exit+0xb8 #7 0xc09cf528 at fork_exit+0xb8 #8 0xc0d133c4 at fork_trampoline+0x8 #8 0xc0d133c4 at fork_trampoline+0x8 ino 8302, on dev md5a ino 8302, on dev md5a 0xc86826cc: 0xc86826cc: tag ufs, type VREG tag ufs, type VREG usecount 1, writecount 0, refcount 1044 mountedhere 0 usecount 1, writecount 0, refcount 1044 mountedhere 0 flags (VV_SYSTEM) flags (VV_SYSTEM) v_object 0xca846440 ref 0 pages 25512 v_object 0xca846440 ref 0 pages 25512 lock type snaplk: EXCL by thread 0xc74488a0 (pid 18) lock type snaplk: EXCL by thread 0xc74488a0 (pid 18) with exclusive waiters pending with exclusive waiters pending #0 0xc09e43ae at __lockmgr_args+0xbfe #0 0xc09e43ae at __lockmgr_args+0xbfe #1 0xc0c1164a at ffs_snapblkfree+0xea #1 0xc0c1164a at ffs_snapblkfree+0xea #2 0xc0c057b5 at ffs_blkfree+0x55 #2 0xc0c057b5 at ffs_blkfree+0x55 #3 0xc0c1c219 at handle_workitem_freefrag+0xe9 #3 0xc0c1c219 at handle_workitem_freefrag+0xe9 #4 0xc0c1da8d at process_worklist_item+0x2cd #4 0xc0c1da8d at process_worklist_item+0x2cd #5 0xc0c2e498 at softdep_process_worklist+0x88 #5 0xc0c2e498 at softdep_process_worklist+0x88 #6 0xc0c2ea60 at softdep_flush+0x2a0 #6 0xc0c2ea60 at softdep_flush+0x2a0 #7 0xc09cf528 at fork_exit+0xb8 #7 0xc09cf528 at fork_exit+0xb8 #8 0xc0d133c4 at fork_trampoline+0x8 #8 0xc0d133c4 at fork_trampoline+0x8 ino 7, on dev md5a ino 7, on dev md5a 0xca47315c: 0xca47315c: tag ufs, type VREG tag ufs, type VREG usecount 0, writecount 0, refcount 2 mountedhere 0 usecount 0, writecount 0, refcount 2 mountedhere 0 flags () flags () v_object 0xc8c35b28 ref 0 pages 7 v_object 0xc8c35b28 ref 0 pages 7 lock type ufs: EXCL by thread 0xc75772e0 (pid 9) lock type ufs: EXCL by thread 0xc75772e0 (pid 9) #0 0xc09e43ae at __lockmgr_args+0xbfe #0 0xc09e43ae at __lockmgr_args+0xbfe #1 0xc0c36a41 at ffs_lock+0xa1 #1 0xc0c36a41 at ffs_lock+0xa1 #2 0xc0d4c705 at VOP_LOCK1_APV+0xb5 #2 0xc0d4c705 at VOP_LOCK1_APV+0xb5 #3 0xc0aa4328 at _vn_lock+0x78 #3 0xc0aa4328 at _vn_lock+0x78 #4 0xc0a7dfeb at flushbufqueues+0x56b #4 0xc0a7dfeb at flushbufqueues+0x56b #5 0xc0a7e2e9 at buf_do_flush+0x19 #5 0xc0a7e2e9 at buf_do_flush+0x19 #6 0xc0a7e4ba at buf_daemon+0xea #6 0xc0a7e4ba at buf_daemon+0xea #7 0xc09cf528 at fork_exit+0xb8 #7 0xc09cf528 at fork_exit+0xb8 #8 0xc0d133c4 at fork_trampoline+0x8 #8 0xc0d133c4 at fork_trampoline+0x8 ino 33451, on dev md5a ino 33451, on dev md5a 0xc9e976cc: 0xc9e976cc: tag ufs, type VREG tag ufs, type VREG usecount 1, writecount 1, refcount 1 mountedhere 0 usecount 1, writecount 1, refcount 1 mountedhere 0 flags () flags () v_object 0xc91eacc0 ref 0 pages 0 v_object 0xc91eacc0 ref 0 pages 0 lock type ufs: EXCL by thread 0xc794c8a0 (pid 2653) lock type ufs: EXCL by thread 0xc794c8a0 (pid 2653) #0 0xc09e43ae at __lockmgr_args+0xbfe #0 0xc09e43ae at __lockmgr_args+0xbfe #1 0xc0c36a41 at ffs_lock+0xa1 #1 0xc0c36a41 at ffs_lock+0xa1 #2 0xc0d4c705 at VOP_LOCK1_APV+0xb5 #2 0xc0d4c705 at VOP_LOCK1_APV+0xb5 #3 0xc0aa4328 at _vn_lock+0x78 #3 0xc0aa4328 at _vn_lock+0x78 #4 0xc0aa5696 at vn_write+0x156 #4 0xc0aa5696 at vn_write+0x156 #5 0xc0a48f75 at dofilewrite+0x95 #5 0xc0a48f75 at dofilewrite+0x95 #6 0xc0a4a718 at kern_writev+0x58 #6 0xc0a4a718 at kern_writev+0x58 #7 0xc0a4a82f at write+0x4f #7 0xc0a4a82f at write+0x4f #8 0xc0a3efa3 at syscallenter+0x263 #8 0xc0a3efa3 at syscallenter+0x263 #9 0xc0d29cef at syscall+0x4f #9 0xc0d29cef at syscall+0x4f #10 0xc0d133b1 at Xint0x80_syscall+0x21 #10 0xc0d133b1 at Xint0x80_syscall+0x21 ino 50263, on dev md5a ino 50263, on dev md5a db:0:lockedvnods> show mount 0xc785fb50 /dev/ad4s1a on / (ufs) 0xc7860000 devfs on /dev (devfs) 0xc7b975a8 /dev/ad4s1f on /home (ufs) 0xc7b97000 /dev/ad4s1d on /usr (ufs) 0xc7860b50 /dev/ad4s1e on /var (ufs) 0xc786087c procfs on /proc (procfs) 0xc834f000 /dev/label/tmp on /tmp (ufs) 0xc834eb50 /dev/md5a on /mnt (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 8114 2159 2157 1001 S nanslp 0xc1087d84 sleep 7756 7752 7756 0 S+ ttyin 0xc7772870 bash 7752 7751 7752 0 S+ pause 0xcb71c314 csh 7751 5336 7751 1001 S+ wait 0xc7806578 su 5336 5335 5336 1001 Ss+ wait 0xcb6e5834 bash 5335 5333 5333 1001 S select 0xcad46724 sshd 5333 2088 5333 0 Ss sbwait 0xc7e20598 sshd 2716 2715 2470 0 D ufs 0xc83ec724 ls 2715 2470 2470 0 S wait 0xc7d9f2bc sh 2653 2652 2653 1001 DL+ snaplk 0xc7bd351c suj21 2652 2566 2566 0 S+ wait 0xc8315578 su 2585 0 0 0 DL mdwait 0xc8160800 [md5] 2566 2245 2566 0 S+ wait 0xc7893000 sh 2550 1 2550 0 Ss+ ttyin 0xc7584070 getty 2549 1 2549 0 Ss+ ttyin 0xc7584270 getty 2548 1 2548 0 Ss+ ttyin 0xc7584470 getty 2547 1 2547 0 Ss+ ttyin 0xc72e7070 getty 2546 1 2546 0 Ss+ ttyin 0xc72e7270 getty 2545 1 2545 0 Ss+ ttyin 0xc72e7470 getty 2544 1 2544 0 Ss+ ttyin 0xc72e7670 getty 2543 1 2543 0 Ss+ ttyin 0xc72e7870 getty 2542 1 2542 0 Ss+ ttyin 0xc72e7a70 getty 2502 1 2502 0 Ss select 0xc790eae4 inetd 2470 1 2470 0 Ss wait 0xc7d9faf0 watchdogd 2245 2225 2245 0 S+ wait 0xc8316af0 bash 2225 2224 2225 0 S+ pause 0xc7806314 csh 2224 2204 2224 0 S+ wait 0xc791f2bc su 2204 2200 2204 0 S+ wait 0xc791faf0 bash 2200 2199 2200 0 S+ pause 0xc7d8b314 csh 2199 2179 2199 1001 S+ wait 0xc79072bc su 2179 2178 2179 1001 Ss+ wait 0xc80f92bc bash 2178 2176 2176 1001 S select 0xc7950024 sshd 2176 2088 2176 0 Ss sbwait 0xc7bd5598 sshd 2160 2157 2157 1001 S piperd 0xc7e1a000 awk 2159 2157 2157 1001 S wait 0xc7907000 sh 2158 2155 2158 1001 Ss+ select 0xc7899064 top 2157 2153 2157 1001 Ss wait 0xc80f9af0 sh 2156 2154 2156 1001 Ss kqread 0xc7b8a700 tail 2155 2148 2148 1001 S select 0xc79500e4 sshd 2154 2149 2149 1001 S select 0xc790da64 sshd 2153 2147 2147 1001 S select 0xc7899464 sshd 2149 2088 2149 0 Ss sbwait 0xc7e20738 sshd 2148 2088 2148 0 Ss sbwait 0xc7f24598 sshd 2147 2088 2147 0 Ss sbwait 0xc7d89db8 sshd 2108 1 2108 0 Ss nanslp 0xc1087d84 cron 2100 1 2100 25 Ss pause 0xc7cc45d0 sendmail 2096 1 2096 0 Ss select 0xc79501e4 sendmail 2088 1 2088 0 Ss select 0xc7950224 sshd 2028 1 2028 0 Ss select 0xc7950264 moused 1968 1 1968 0 Ss select 0xc7d911e4 ntpd 1850 1849 1849 0 S (threaded) nfsd 100131 S rpcsvc 0xc77ed610 nfsd: service 100130 S rpcsvc 0xc77ed650 nfsd: service 100129 S rpcsvc 0xc77ed690 nfsd: service 100081 S rpcsvc 0xc77eeb90 nfsd: master 1849 1 1849 0 Ss select 0xc78995e4 nfsd 1839 1 1839 0 Ss select 0xc7899624 mountd 1739 1 1739 0 Ss select 0xc790dbe4 rpcbind 1710 1 1710 0 Ss select 0xc79502a4 syslogd 1509 1 1509 0 Ss select 0xc79502e4 devd 18 0 0 0 RL CPU 2 [softdepflush] 17 0 0 0 DL vlruwt 0xc7805578 [vnlru] 16 0 0 0 DL snaplk 0xc7bd351c [syncer] 9 0 0 0 DL snaplk 0xc7bd351c [bufdaemon] 8 0 0 0 DL pgzero 0xc12063dc [pagezero] 7 0 0 0 DL psleep 0xc1205fc8 [vmdaemon] 6 0 0 0 DL psleep 0xc1205f90 [pagedaemon] 5 0 0 0 DL ccb_scan 0xc104cad4 [xpt_thrd] 4 0 0 0 DL waiting_ 0xc11ffa98 [sctp_iterator] 3 0 0 0 DL - 0xc73eae3c [fdc0] 2 0 0 0 SL - 0xc746f000 [fw0_probe] 15 0 0 0 DL (threaded) [usb] 100058 D - 0xc744dd34 [usbus5] 100057 D - 0xc744dd04 [usbus5] 100056 D - 0xc744dcd4 [usbus5] 100055 D - 0xc744dca4 [usbus5] 100053 D - 0xc743fb5c [usbus4] 100052 D - 0xc743fb2c [usbus4] 100051 D - 0xc743fafc [usbus4] 100050 D - 0xc743facc [usbus4] 100049 D - 0xc7439b5c [usbus3] 100048 D - 0xc7439b2c [usbus3] 100047 D - 0xc7439afc [usbus3] 100046 D - 0xc7439acc [usbus3] 100045 D - 0xc7431b5c [usbus2] 100044 D - 0xc7431b2c [usbus2] 100043 D - 0xc7431afc [usbus2] 100042 D - 0xc7431acc [usbus2] 100040 D - 0xc742ab5c [usbus1] 100039 D - 0xc742ab2c [usbus1] 100038 D - 0xc742aafc [usbus1] 100037 D - 0xc742aacc [usbus1] 100035 D - 0xc7421b5c [usbus0] 100034 D - 0xc7421b2c [usbus0] 100033 D - 0xc7421afc [usbus0] 100032 D - 0xc7421acc [usbus0] 14 0 0 0 DL - 0xc1086b84 [yarrow] 13 0 0 0 DL (threaded) [geom] 100015 D - 0xc10847a8 [g_down] 100014 D - 0xc10847a4 [g_up] 100013 D - 0xc108479c [g_event] 12 0 0 0 WL (threaded) [intr] 100066 I [irq12: psm0] 100065 I [irq1: atkbd0] 100063 I [swi0: uart] 100060 I [irq20: fwohci0] 100059 I [irq14: ata0] 100054 I [irq19: ehci0] 100041 I [irq18: ohci2 ohci4] 100036 I [irq17: ohci1 ohci3] 100031 I [irq16: hdac1 ohci0] 100030 I [irq22: ahci0] 100029 I [irq257: re0] 100028 I [irq256: hdac0] 100027 I [swi5: +] 100026 I [swi2: cambio] 100021 I [swi6: task queue] 100019 I [swi6: Giant taskq] 100012 I [swi3: vm] 100011 I [swi4: clock] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 I [swi4: clock] 100007 I [swi1: netisr 0] 11 0 0 0 RL (threaded) [idle] 100006 Run CPU 3 [idle: cpu3] 100005 CanRun [idle: cpu2] 100004 Run CPU 1 [idle: cpu1] 100003 Run CPU 0 [idle: cpu0] 1 0 1 0 SLs wait 0xc71bcaf0 [init] 10 0 0 0 DL audit_wo 0xc1203d00 [audit] 0 0 0 0 DLs (threaded) [kernel] 100077 D - 0xc77edc80 [mca taskq] 100067 D - 0xc1086b84 [deadlkres] 100061 D - 0xc746e100 [fw0_taskq] 100025 D - 0xc7353480 [acpi_task_2] 100024 D - 0xc7353480 [acpi_task_1] 100023 D - 0xc7353480 [acpi_task_0] 100022 D - 0xc73534c0 [kqueue taskq] 100020 D - 0xc7353540 [ffs_trim taskq] 100018 D - 0xc73535c0 [thread taskq] 100016 D - 0xc7176b40 [firmware taskq] 100000 D sched 0xc1084880 [swapper] db:0:ps> allt Tracing command sleep pid 8114 tid 100210 td 0xcb7228a0 sched_switch(cb7228a0,0,104,191,a90985eb,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(cb7228a0,0,c0ef3b80,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(2711,c0a3b4c0,cb7228a0,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1087d84,6c,c0eef8d7,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1087d84,0,16c,c0eef8d7,2711,...) at _sleep+0x328 kern_nanosleep(cb7228a0,ef851c34,ef851c3c,a,0,...) at kern_nanosleep+0xc1 nanosleep(cb7228a0,ef851cec,ef851d28,c0ef450a,0,...) at nanosleep+0x6f syscallenter(cb7228a0,ef851ce4,ef851ce4,0,0,...) at syscallenter+0x263 syscall(ef851d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28165c07, esp = 0xbfbfec5c, ebp = 0xbfbfeca8 --- Tracing command bash pid 7756 tid 100080 td 0xc780a5c0 sched_switch(c780a5c0,0,104,191,6d3ddaac,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c780a5c0,0,c0ef3b80,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c09ec26a,c7772804,0,c0eec987,c780a5c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7772870,0,ef609ad8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7772870,c7772804,c0ef823c,514,0,...) at _cv_wait_sig+0x243 tty_wait(c7772800,c7772870,ef609c28,1,0,...) at tty_wait+0x71 ttydisc_read(c7772800,ef609c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c8825c00,ef609c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7b87e38,ef609c28,c7e07580,0,c780a5c0,...) at devfs_read_f+0x7e dofileread(ef609c28,ffffffff,ffffffff,0,c7b87e38,...) at dofileread+0x9e kern_readv(c780a5c0,0,ef609c28,ef609c48,1,...) at kern_readv+0x58 read(c780a5c0,ef609cec,ef609d28,c0ef450a,0,...) at read+0x4f syscallenter(c780a5c0,ef609ce4,ef609ce4,0,0,...) at syscallenter+0x263 syscall(ef609d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x283546c3, esp = 0xbfbfdddc, ebp = 0xbfbfde08 --- Tracing command csh pid 7752 tid 100211 td 0xcb7225c0 sched_switch(cb7225c0,0,104,191,db08aa8,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,74,...) at mi_switch+0x1eb sleepq_switch(cb7225c0,0,c0ef3b80,1a7,74,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb71c314,74,c0d78a8e,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb71c314,cb71c344,174,c0d78a8e,0,...) at _sleep+0x35c kern_sigsuspend(cb7225c0,0,0,0,0,...) at kern_sigsuspend+0xba sigsuspend(cb7225c0,ef854cec,ef854d28,c0ef450a,0,...) at sigsuspend+0x4d syscallenter(cb7225c0,ef854ce4,ef854ce4,0,0,...) at syscallenter+0x263 syscall(ef854d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2818acfb, esp = 0xbfbfe5ac, ebp = 0xbfbfe618 --- Tracing command su pid 7751 tid 100090 td 0xc789a5c0 sched_switch(c789a5c0,0,104,191,bb63e0c1,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c789a5c0,0,c0ef3b80,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7806578,6c,c0ef695e,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7806578,c7806600,16c,c0ef695e,0,...) at _sleep+0x35c kern_wait(c789a5c0,1e48,ef639c44,2,0,...) at kern_wait+0xbe6 wait4(c789a5c0,ef639cec,281c8da8,1,0,...) at wait4+0x3b syscallenter(c789a5c0,ef639ce4,c0d2a54d,c1086470,0,...) at syscallenter+0x263 syscall(ef639d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x281239ab, esp = 0xbfbfe5dc, ebp = 0xbfbfe5f8 --- Tracing command bash pid 5336 tid 100192 td 0xcb6e9b80 sched_switch(cb6e9b80,0,104,191,970d04ec,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(cb6e9b80,0,c0ef3b80,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cb6e5834,6c,c0ef695e,100,0,...) at sleepq_wait_sig+0x17 _sleep(cb6e5834,cb6e58bc,16c,c0ef695e,0,...) at _sleep+0x35c kern_wait(cb6e9b80,ffffffff,ef801c44,6,0,...) at kern_wait+0xbe6 wait4(cb6e9b80,ef801cec,ef801d28,c0ef450a,0,...) at wait4+0x3b syscallenter(cb6e9b80,ef801ce4,ef801ce4,0,0,...) at syscallenter+0x263 syscall(ef801d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x282c39ab, esp = 0xbfbfe97c, ebp = 0xbfbfe998 --- Tracing command sshd pid 5335 tid 100102 td 0xc794f2e0 sched_switch(c794f2e0,0,104,191,6d3ee237,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c794f2e0,0,c0ef3b80,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c09ec26a,cad46710,0,c0eec987,c794f2e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cad46724,0,ef66ea4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cad46724,cad46710,c0ef61d1,627,c7ca24d0,...) at _cv_wait_sig+0x243 seltdwait(c7ca24d0,58,c7e07380,c794f2e0,246,...) at seltdwait+0xa2 kern_select(c794f2e0,c,288060b4,288060bc,0,0,20,c791f000,c791f000) at kern_select+0x504 select(c794f2e0,ef66ecec,ef66ed28,c0ef450a,0,...) at select+0x66 syscallenter(c794f2e0,ef66ece4,ef66ece4,0,0,...) at syscallenter+0x263 syscall(ef66ed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x284c4643, esp = 0xbfbfe19c, ebp = 0xbfbfe1e8 --- Tracing command sshd pid 5333 tid 100194 td 0xcb6e95c0 sched_switch(cb6e95c0,0,104,191,dea1debd,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,68,...) at mi_switch+0x1eb sleepq_switch(cb6e95c0,0,c0ef3b80,1a7,68,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7e20598,68,c0efa021,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7e20598,c7e20558,168,c0efa021,0) at _sleep+0x35c sbwait(c7e20534,4,c0efa0f9,5ec,c7e20558,...) at sbwait+0x76 soreceive_generic(c7e204e0,0,ef807c28,0,0,...) at soreceive_generic+0x3f0 soreceive(c7e204e0,0,ef807c28,0,0,0) at soreceive+0x38 soo_read(c78bd5b0,ef807c28,c7903900,0,cb6e95c0,...) at soo_read+0x4e dofileread(ef807c28,ffffffff,ffffffff,0,c78bd5b0,...) at dofileread+0x9e kern_readv(cb6e95c0,5,ef807c28,ef807c48,1,...) at kern_readv+0x58 read(cb6e95c0,ef807cec,ef807d28,c0ef450a,0,...) at read+0x4f syscallenter(cb6e95c0,ef807ce4,ef807ce4,0,0,...) at syscallenter+0x263 syscall(ef807d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x284c46c3, esp = 0xbfbfdd3c, ebp = 0xbfbfdd78 --- Tracing command ls pid 2716 tid 100084 td 0xc789b2e0 sched_switch(c789b2e0,0,104,191,600d439f,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,60,...) at mi_switch+0x1eb sleepq_switch(c789b2e0,0,c0ef3b80,268,c83ec724,...) at sleepq_switch+0x162 sleepq_wait(c83ec724,60,c0ee5070,4,1,...) at sleepq_wait+0x63 __lockmgr_args(c83ec724,200100,c83ec790,0,0,...) at __lockmgr_args+0x4cf ffs_lock(ef61d8e4,c0a465db,c0efc1e9,200100,c83ec6cc,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c1030660,ef61d8e4,c789b390,c104b660,c83ec6cc,...) at VOP_LOCK1_APV+0xb5 _vn_lock(c83ec6cc,200100,c0efd8d2,856,0,...) at _vn_lock+0x78 vget(c83ec6cc,200100,c789b2e0,244,0,...) at vget+0xbb cache_lookup(c83c6d98,ef61db44,ef61db58,ef61db44,c719fe00,...) at cache_lookup+0x67b vfs_cache_lookup(ef61da20,c0efe643,c104b2a0,200000,ef61db2c,...) at vfs_cache_lookup+0xad VOP_LOOKUP_APV(c1030660,ef61da20,ef61db58,1f5,ef61db44,...) at VOP_LOOKUP_APV+0xe5 lookup(ef61db2c,c0efcd1d,ee,c9,ffffff9c,...) at lookup+0x67b namei(ef61db2c,ef61dacc,60,0,c789b2e0,...) at namei+0x592 kern_statat_vnhook(c789b2e0,200,ffffff9c,2841e2b8,0,...) at kern_statat_vnhook+0x72 kern_statat(c789b2e0,200,ffffff9c,2841e2b8,0,...) at kern_statat+0x3c kern_lstat(c789b2e0,2841e2b8,0,ef61dbe8,86,...) at kern_lstat+0x36 lstat(c789b2e0,ef61dcec,ef61dd28,c0ef450a,0,...) at lstat+0x2f syscallenter(c789b2e0,ef61dce4,ef61dce4,0,0,...) at syscallenter+0x263 syscall(ef61dd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (190, FreeBSD ELF32, lstat), eip = 0x281c86a3, esp = 0xbfbfe57c, ebp = 0xbfbfe608 --- Tracing command sh pid 2715 tid 100143 td 0xc794c5c0 sched_switch(c794c5c0,0,104,191,5ecb664a,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c794c5c0,0,c0ef3b80,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7d9f2bc,6c,c0ef695e,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7d9f2bc,c7d9f344,16c,c0ef695e,0,...) at _sleep+0x35c kern_wait(c794c5c0,ffffffff,ef72fc44,2,0,...) at kern_wait+0xbe6 wait4(c794c5c0,ef72fcec,2820fda8,1,0,...) at wait4+0x3b syscallenter(c794c5c0,ef72fce4,c0d2a54d,c1086470,0,...) at syscallenter+0x263 syscall(ef72fd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2816a9ab, esp = 0xbfbfeb0c, ebp = 0xbfbfeb28 --- Tracing command suj21 pid 2653 tid 100142 td 0xc794c8a0 sched_switch(c794c8a0,0,104,191,8dbe289f,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,60,...) at mi_switch+0x1eb sleepq_switch(c794c8a0,0,c0ef3b80,268,60,...) at sleepq_switch+0x162 sleepq_wait(c7bd351c,60,c0f20c85,4,0,...) at sleepq_wait+0x63 __lockmgr_args(c7bd351c,80900,c83cc0c4,0,0,...) at __lockmgr_args+0xb1f ffs_snapblkfree(c8341000,c83cc000,1139f,0,1000,...) at ffs_snapblkfree+0xea ffs_blkfree(c7be8100,c8341000,c83cc000,1139f,0,...) at ffs_blkfree+0x55 handle_workitem_freefrag(0,ef72c79c,2,6b2,ef72c7a0,...) at handle_workitem_freefrag+0xe9 process_worklist_item(c1204530,0,c0f211e0,30ae,ffffc575,...) at process_worklist_item+0x2cd softdep_request_cleanup(c8341000,c9e976cc,ca889280,4,1,...) at softdep_request_cleanup+0x349 ffs_alloc(c924eae0,0,0,30008,0,...) at ffs_alloc+0x3eb ffs_balloc_ufs2(c9e976cc,0,0,1000,ca889280,...) at ffs_balloc_ufs2+0x110c ffs_write(ef72cb94,c0f42fe3,c9e976cc,0,c9e976cc,...) at ffs_write+0x2ad VOP_WRITE_APV(c1030660,ef72cb94,c9e976cc,264,0,...) at VOP_WRITE_APV+0x136 vn_write(c78bdce8,ef72cc28,ca889280,0,c794c8a0,...) at vn_write+0x1ca dofilewrite(ef72cc28,ffffffff,ffffffff,0,c78bdce8,...) at dofilewrite+0x95 kern_writev(c794c8a0,3,ef72cc28,ef72cc48,1,...) at kern_writev+0x58 write(c794c8a0,ef72ccec,ef72cd28,c0ef450a,0,...) at write+0x4f syscallenter(c794c8a0,ef72cce4,ef72cce4,0,c1095700,...) at syscallenter+0x263 syscall(ef72cd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x281816a3, esp = 0xbfbfe7dc, ebp = 0xbfbfe888 --- Tracing command su pid 2652 tid 100173 td 0xc832c2e0 sched_switch(c832c2e0,0,104,191,fff66c3b,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c832c2e0,0,c0ef3b80,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c8315578,6c,c0ef695e,100,0,...) at sleepq_wait_sig+0x17 _sleep(c8315578,c8315600,16c,c0ef695e,0,...) at _sleep+0x35c kern_wait(c832c2e0,a5d,ef7b2c44,2,0,...) at kern_wait+0xbe6 wait4(c832c2e0,ef7b2cec,281c8da8,1,0,...) at wait4+0x3b syscallenter(c832c2e0,ef7b2ce4,c0d2a54d,c1086470,0,...) at syscallenter+0x263 syscall(ef7b2d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x281239ab, esp = 0xbfbfe33c, ebp = 0xbfbfe358 --- Tracing command md5 pid 2585 tid 100110 td 0xc790f2e0 sched_switch(c790f2e0,0,104,191,8dbfcfb2,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,5c,...) at mi_switch+0x1eb sleepq_switch(c790f2e0,0,c0ef3b80,268,0,...) at sleepq_switch+0x162 sleepq_wait(c8160800,5c,c0e8c6b1,0,0,...) at sleepq_wait+0x63 _sleep(c8160800,c8160820,25c,c0e8c6b1,0,...) at _sleep+0x372 md_kthread(c8160800,ef68fd28,c0ee8cf0,390,c7904000,...) at md_kthread+0x11a fork_exit(c072f8a0,c8160800,ef68fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xef68fd60, ebp = 0 --- Tracing command sh pid 2566 tid 100085 td 0xc789b000 sched_switch(c789b000,0,104,191,fe9e0ff4,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c789b000,0,c0ef3b80,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7893000,6c,c0ef695e,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7893000,c7893088,16c,c0ef695e,0,...) at _sleep+0x35c kern_wait(c789b000,ffffffff,ef621c44,2,0,...) at kern_wait+0xbe6 wait4(c789b000,ef621cec,ef621d28,c0ef450a,0,...) at wait4+0x3b syscallenter(c789b000,ef621ce4,ef621ce4,0,0,...) at syscallenter+0x263 syscall(ef621d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2816a9ab, esp = 0xbfbfe81c, ebp = 0xbfbfe838 --- Tracing command getty pid 2550 tid 100141 td 0xc794cb80 sched_switch(c794cb80,0,104,191,34caf5f5,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c794cb80,0,c0ef3b80,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,c794cb80,c794cb80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7584070,0,c0ef889e,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7584070,c1086470,c0ef823c,514,0,...) at _cv_wait_sig+0x243 tty_wait(c7584000,c7584070,ef729c28,1,0,...) at tty_wait+0x71 ttydisc_read(c7584000,ef729c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c7585600,ef729c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c789e1c0,ef729c28,c719fe00,0,c794cb80,...) at devfs_read_f+0x7e dofileread(ef729c28,ffffffff,ffffffff,0,c789e1c0,...) at dofileread+0x9e kern_readv(c794cb80,0,ef729c28,ef729c48,1,...) at kern_readv+0x58 read(c794cb80,ef729cec,ef729d28,c0ef450a,0,...) at read+0x4f syscallenter(c794cb80,ef729ce4,ef729ce4,0,0,...) at syscallenter+0x263 syscall(ef729d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x281966c3, esp = 0xbfbfed8c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2549 tid 100158 td 0xc794f8a0 sched_switch(c794f8a0,0,104,191,34d647dc,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c794f8a0,0,c0ef3b80,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,c794f8a0,c794f8a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7584270,0,c0ef889e,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7584270,c1086470,c0ef823c,514,0,...) at _cv_wait_sig+0x243 tty_wait(c7584200,c7584270,ef77bc28,1,0,...) at tty_wait+0x71 ttydisc_read(c7584200,ef77bc28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c7460500,ef77bc28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c79278c0,ef77bc28,c719fe00,0,c794f8a0,...) at devfs_read_f+0x7e dofileread(ef77bc28,ffffffff,ffffffff,0,c79278c0,...) at dofileread+0x9e kern_readv(c794f8a0,0,ef77bc28,ef77bc48,1,...) at kern_readv+0x58 read(c794f8a0,ef77bcec,ef77bd28,c0ef450a,0,...) at read+0x4f syscallenter(c794f8a0,ef77bce4,ef77bce4,0,0,...) at syscallenter+0x263 syscall(ef77bd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x281966c3, esp = 0xbfbfed8c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2548 tid 100179 td 0xc832b000 sched_switch(c832b000,0,104,191,34aa334f,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c832b000,0,c0ef3b80,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,c832b000,c832b000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7584470,0,c0ef889e,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7584470,c1086470,c0ef823c,514,0,...) at _cv_wait_sig+0x243 tty_wait(c7584400,c7584470,ef7c7c28,1,0,...) at tty_wait+0x71 ttydisc_read(c7584400,ef7c7c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c7460600,ef7c7c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c78bd620,ef7c7c28,c719fe00,0,c832b000,...) at devfs_read_f+0x7e dofileread(ef7c7c28,ffffffff,ffffffff,0,c78bd620,...) at dofileread+0x9e kern_readv(c832b000,0,ef7c7c28,ef7c7c48,1,...) at kern_readv+0x58 read(c832b000,ef7c7cec,ef7c7d28,c0ef450a,0,...) at read+0x4f syscallenter(c832b000,ef7c7ce4,ef7c7ce4,0,0,...) at syscallenter+0x263 syscall(ef7c7d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x281966c3, esp = 0xbfbfed8c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2547 tid 100151 td 0xc7cc7000 sched_switch(c7cc7000,0,104,191,34b30da7,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7cc7000,0,c0ef3b80,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,c7cc7000,c7cc7000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c72e7070,0,c0ef889e,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c72e7070,c1086470,c0ef823c,514,0,...) at _cv_wait_sig+0x243 tty_wait(c72e7000,c72e7070,ef763c28,1,0,...) at tty_wait+0x71 ttydisc_read(c72e7000,ef763c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c7460700,ef763c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c789d460,ef763c28,c719fe00,0,c7cc7000,...) at devfs_read_f+0x7e dofileread(ef763c28,ffffffff,ffffffff,0,c789d460,...) at dofileread+0x9e kern_readv(c7cc7000,0,ef763c28,ef763c48,1,...) at kern_readv+0x58 read(c7cc7000,ef763cec,ef763d28,c0ef450a,0,...) at read+0x4f syscallenter(c7cc7000,ef763ce4,ef763ce4,0,0,...) at syscallenter+0x263 syscall(ef763d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x281966c3, esp = 0xbfbfed8c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2546 tid 100089 td 0xc789a8a0 sched_switch(c789a8a0,0,104,191,34d0d2d7,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c789a8a0,0,c0ef3b80,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,c789a8a0,c789a8a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c72e7270,0,c0ef889e,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c72e7270,c1086470,c0ef823c,514,0,...) at _cv_wait_sig+0x243 tty_wait(c72e7200,c72e7270,ef634c28,1,0,...) at tty_wait+0x71 ttydisc_read(c72e7200,ef634c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c7460800,ef634c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7b87428,ef634c28,c719fe00,0,c789a8a0,...) at devfs_read_f+0x7e dofileread(ef634c28,ffffffff,ffffffff,0,c7b87428,...) at dofileread+0x9e kern_readv(c789a8a0,0,ef634c28,ef634c48,1,...) at kern_readv+0x58 read(c789a8a0,ef634cec,ef634d28,c0ef450a,0,...) at read+0x4f syscallenter(c789a8a0,ef634ce4,ef634ce4,0,0,...) at syscallenter+0x263 syscall(ef634d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x281966c3, esp = 0xbfbfed8c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2545 tid 100124 td 0xc7d94000 sched_switch(c7d94000,0,104,191,34e07067,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7d94000,0,c0ef3b80,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,c7d94000,c7d94000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c72e7470,0,c0ef889e,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c72e7470,c1086470,c0ef823c,514,0,...) at _cv_wait_sig+0x243 tty_wait(c72e7400,c72e7470,ef6eec28,1,0,...) at tty_wait+0x71 ttydisc_read(c72e7400,ef6eec28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c7460900,ef6eec28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c78bdb28,ef6eec28,c719fe00,0,c7d94000,...) at devfs_read_f+0x7e dofileread(ef6eec28,ffffffff,ffffffff,0,c78bdb28,...) at dofileread+0x9e kern_readv(c7d94000,0,ef6eec28,ef6eec48,1,...) at kern_readv+0x58 read(c7d94000,ef6eecec,ef6eed28,c0ef450a,0,...) at read+0x4f syscallenter(c7d94000,ef6eece4,ef6eece4,0,0,...) at syscallenter+0x263 syscall(ef6eed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x281966c3, esp = 0xbfbfed8c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2544 tid 100103 td 0xc79108a0 sched_switch(c79108a0,0,104,191,34a22440,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c79108a0,0,c0ef3b80,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,c79108a0,c79108a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c72e7670,0,c0ef889e,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c72e7670,c1086470,c0ef823c,514,0,...) at _cv_wait_sig+0x243 tty_wait(c72e7600,c72e7670,ef673c28,1,0,...) at tty_wait+0x71 ttydisc_read(c72e7600,ef673c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c7460a00,ef673c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c789d0e0,ef673c28,c719fe00,0,c79108a0,...) at devfs_read_f+0x7e dofileread(ef673c28,ffffffff,ffffffff,0,c789d0e0,...) at dofileread+0x9e kern_readv(c79108a0,0,ef673c28,ef673c48,1,...) at kern_readv+0x58 read(c79108a0,ef673cec,ef673d28,c0ef450a,0,...) at read+0x4f syscallenter(c79108a0,ef673ce4,ef673ce4,0,0,...) at syscallenter+0x263 syscall(ef673d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x281966c3, esp = 0xbfbfed8c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2543 tid 100125 td 0xc7d93b80 sched_switch(c7d93b80,0,104,191,34b91abd,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7d93b80,0,c0ef3b80,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,c7d93b80,c7d93b80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c72e7870,0,c0ef889e,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c72e7870,c1086470,c0ef823c,514,0,...) at _cv_wait_sig+0x243 tty_wait(c72e7800,c72e7870,ef6f2c28,1,0,...) at tty_wait+0x71 ttydisc_read(c72e7800,ef6f2c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c7460b00,ef6f2c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7b879d8,ef6f2c28,c719fe00,0,c7d93b80,...) at devfs_read_f+0x7e dofileread(ef6f2c28,ffffffff,ffffffff,0,c7b879d8,...) at dofileread+0x9e kern_readv(c7d93b80,0,ef6f2c28,ef6f2c48,1,...) at kern_readv+0x58 read(c7d93b80,ef6f2cec,ef6f2d28,c0ef450a,0,...) at read+0x4f syscallenter(c7d93b80,ef6f2ce4,ef6f2ce4,0,0,...) at syscallenter+0x263 syscall(ef6f2d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x281966c3, esp = 0xbfbfed8c, ebp = 0xbfbfedb8 --- Tracing command getty pid 2542 tid 100078 td 0xc789bb80 sched_switch(c789bb80,0,104,191,bbff4a0e,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c789bb80,0,c0ef3b80,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c09ec26a,c72e7a04,0,c0eec987,c789bb80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c72e7a70,0,ef601ad8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c72e7a70,c72e7a04,c0ef823c,514,0,...) at _cv_wait_sig+0x243 tty_wait(c72e7a00,c72e7a70,ef601c28,1,0,...) at tty_wait+0x71 ttydisc_read(c72e7a00,ef601c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c72c6c00,ef601c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c78bd460,ef601c28,c719fe00,0,c789bb80,...) at devfs_read_f+0x7e dofileread(ef601c28,ffffffff,ffffffff,0,c78bd460,...) at dofileread+0x9e kern_readv(c789bb80,0,ef601c28,ef601c48,1,...) at kern_readv+0x58 read(c789bb80,ef601cec,ef601d28,c0ef450a,0,...) at read+0x4f syscallenter(c789bb80,ef601ce4,ef601ce4,0,0,...) at syscallenter+0x263 syscall(ef601d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x281966c3, esp = 0xbfbfed8c, ebp = 0xbfbfedb8 --- Tracing command inetd pid 2502 tid 100138 td 0xc794e2e0 sched_switch(c794e2e0,0,104,191,20e1b977,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c794e2e0,0,c0ef3b80,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c09ec26a,c790ead0,0,c0eec987,c794e2e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c790eae4,0,ef71fa4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c790eae4,c790ead0,c0ef61d1,627,c7927230,...) at _cv_wait_sig+0x243 seltdwait(c7927230,58,c719fe00,c794e2e0,c794e390,...) at seltdwait+0xa2 kern_select(c794e2e0,6,bfbfdfa0,0,0,0,20,c7da0000,c7da0000) at kern_select+0x504 select(c794e2e0,ef71fcec,ef71fd28,c0ef450a,0,...) at select+0x66 syscallenter(c794e2e0,ef71fce4,ef71fce4,0,0,...) at syscallenter+0x263 syscall(ef71fd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x281a8643, esp = 0xbfbfdf5c, ebp = 0xbfbfede8 --- Tracing command watchdogd pid 2470 tid 100139 td 0xc794e000 sched_switch(c794e000,0,104,191,5e6e56da,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c794e000,0,c0ef3b80,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7d9faf0,6c,c0ef695e,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7d9faf0,c7d9fb78,16c,c0ef695e,0,...) at _sleep+0x35c kern_wait(c794e000,a9b,ef722c44,0,0,...) at kern_wait+0xbe6 wait4(c794e000,ef722cec,bfbfec4c,1,0,...) at wait4+0x3b syscallenter(c794e000,ef722ce4,c0d2a54d,c1086470,0,...) at syscallenter+0x263 syscall(ef722d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2811c9ab, esp = 0xbfbfec3c, ebp = 0xbfbfece8 --- Tracing command bash pid 2245 tid 100166 td 0xc832e8a0 sched_switch(c832e8a0,0,104,191,79a42d7e,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c832e8a0,0,c0ef3b80,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c8316af0,6c,c0ef695e,100,0,...) at sleepq_wait_sig+0x17 _sleep(c8316af0,c8316b78,16c,c0ef695e,0,...) at _sleep+0x35c kern_wait(c832e8a0,ffffffff,ef79bc44,6,0,...) at kern_wait+0xbe6 wait4(c832e8a0,ef79bcec,ef79bd28,c0ef450a,0,...) at wait4+0x3b syscallenter(c832e8a0,ef79bce4,ef79bce4,0,0,...) at syscallenter+0x263 syscall(ef79bd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x282c39ab, esp = 0xbfbfe78c, ebp = 0xbfbfe7a8 --- Tracing command csh pid 2225 tid 100091 td 0xc789a2e0 sched_switch(c789a2e0,0,104,191,cf859084,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,74,...) at mi_switch+0x1eb sleepq_switch(c789a2e0,0,c0ef3b80,1a7,74,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7806314,74,c0d78a8e,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7806314,c7806344,174,c0d78a8e,0,...) at _sleep+0x35c kern_sigsuspend(c789a2e0,0,0,0,0,...) at kern_sigsuspend+0xba sigsuspend(c789a2e0,ef63dcec,ef63dd28,c0ef450a,0,...) at sigsuspend+0x4d syscallenter(c789a2e0,ef63dce4,ef63dce4,0,c1095700,...) at syscallenter+0x263 syscall(ef63dd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2818acfb, esp = 0xbfbfe4fc, ebp = 0xbfbfe568 --- Tracing command su pid 2224 tid 100101 td 0xc75792e0 sched_switch(c75792e0,0,104,191,724a3ffd,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c75792e0,0,c0ef3b80,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c791f2bc,6c,c0ef695e,100,0,...) at sleepq_wait_sig+0x17 _sleep(c791f2bc,c791f344,16c,c0ef695e,0,...) at _sleep+0x35c kern_wait(c75792e0,8b1,ef66bc44,2,0,...) at kern_wait+0xbe6 wait4(c75792e0,ef66bcec,281c8da8,1,0,...) at wait4+0x3b syscallenter(c75792e0,ef66bce4,c0d2a54d,c1086470,0,...) at syscallenter+0x263 syscall(ef66bd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x281239ab, esp = 0xbfbfe53c, ebp = 0xbfbfe558 --- Tracing command bash pid 2204 tid 100098 td 0xc7579b80 sched_switch(c7579b80,0,104,191,71176276,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c7579b80,0,c0ef3b80,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c791faf0,6c,c0ef695e,100,0,...) at sleepq_wait_sig+0x17 _sleep(c791faf0,c791fb78,16c,c0ef695e,0,...) at _sleep+0x35c kern_wait(c7579b80,ffffffff,ef662c44,6,0,...) at kern_wait+0xbe6 wait4(c7579b80,ef662cec,ef662d28,c0ef450a,0,...) at wait4+0x3b syscallenter(c7579b80,ef662ce4,ef662ce4,0,0,...) at syscallenter+0x263 syscall(ef662d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x282c39ab, esp = 0xbfbfe76c, ebp = 0xbfbfe788 --- Tracing command csh pid 2200 tid 100127 td 0xc7d935c0 sched_switch(c7d935c0,0,104,191,5045fd6f,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,74,...) at mi_switch+0x1eb sleepq_switch(c7d935c0,0,c0ef3b80,1a7,74,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7d8b314,74,c0d78a8e,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7d8b314,c7d8b344,174,c0d78a8e,0,...) at _sleep+0x35c kern_sigsuspend(c7d935c0,0,0,0,0,...) at kern_sigsuspend+0xba sigsuspend(c7d935c0,ef6facec,ef6fad28,c0ef450a,0,...) at sigsuspend+0x4d syscallenter(c7d935c0,ef6face4,ef6face4,0,0,...) at syscallenter+0x263 syscall(ef6fad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2818acfb, esp = 0xbfbfe58c, ebp = 0xbfbfe5f8 --- Tracing command su pid 2199 tid 100104 td 0xc79105c0 sched_switch(c79105c0,0,104,191,fcaf055d,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c79105c0,0,c0ef3b80,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c79072bc,6c,c0ef695e,100,0,...) at sleepq_wait_sig+0x17 _sleep(c79072bc,c7907344,16c,c0ef695e,0,...) at _sleep+0x35c kern_wait(c79105c0,898,ef677c44,2,0,...) at kern_wait+0xbe6 wait4(c79105c0,ef677cec,281c8da8,1,0,...) at wait4+0x3b syscallenter(c79105c0,ef677ce4,c0d2a54d,c1086470,0,...) at syscallenter+0x263 syscall(ef677d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x281239ab, esp = 0xbfbfe5bc, ebp = 0xbfbfe5d8 --- Tracing command bash pid 2179 tid 100163 td 0xc812ab80 sched_switch(c812ab80,0,104,191,f1d97322,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c812ab80,0,c0ef3b80,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c80f92bc,6c,c0ef695e,100,0,...) at sleepq_wait_sig+0x17 _sleep(c80f92bc,c80f9344,16c,c0ef695e,0,...) at _sleep+0x35c kern_wait(c812ab80,ffffffff,ef78dc44,6,0,...) at kern_wait+0xbe6 wait4(c812ab80,ef78dcec,ef78dd28,c0ef450a,0,...) at wait4+0x3b syscallenter(c812ab80,ef78dce4,ef78dce4,0,0,...) at syscallenter+0x263 syscall(ef78dd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x282c39ab, esp = 0xbfbfe97c, ebp = 0xbfbfe998 --- Tracing command sshd pid 2178 tid 100164 td 0xc812a8a0 sched_switch(c812a8a0,0,104,191,e4a1da37,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c812a8a0,0,c0ef3b80,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c09ec26a,c7950010,0,c0eec987,c812a8a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7950024,0,ef790a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7950024,c7950010,c0ef61d1,627,c789d310,...) at _cv_wait_sig+0x243 seltdwait(c789d310,58,c7903100,c812a8a0,246,...) at seltdwait+0xa2 kern_select(c812a8a0,c,288060b4,288060bc,0,0,20,c80f9000,c80f9000) at kern_select+0x504 select(c812a8a0,ef790cec,ef790d28,c0ef450a,0,...) at select+0x66 syscallenter(c812a8a0,ef790ce4,ef790ce4,0,c1094a00,...) at syscallenter+0x263 syscall(ef790d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x284c4643, esp = 0xbfbfe19c, ebp = 0xbfbfe1e8 --- Tracing command sshd pid 2176 tid 100162 td 0xc812d000 sched_switch(c812d000,0,104,191,74df4aa,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,68,...) at mi_switch+0x1eb sleepq_switch(c812d000,0,c0ef3b80,1a7,68,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7bd5598,68,c0efa021,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7bd5598,c7bd5558,168,c0efa021,0) at _sleep+0x35c sbwait(c7bd5534,4,c0efa0f9,5ec,c7bd5558,...) at sbwait+0x76 soreceive_generic(c7bd54e0,0,ef78ac28,0,0,...) at soreceive_generic+0x3f0 soreceive(c7bd54e0,0,ef78ac28,0,0,0) at soreceive+0x38 soo_read(c7b876c8,ef78ac28,c7b8ab80,0,c812d000,...) at soo_read+0x4e dofileread(ef78ac28,ffffffff,ffffffff,0,c7b876c8,...) at dofileread+0x9e kern_readv(c812d000,5,ef78ac28,ef78ac48,1,...) at kern_readv+0x58 read(c812d000,ef78acec,ef78ad28,c0ef450a,0,...) at read+0x4f syscallenter(c812d000,ef78ace4,ef78ace4,0,c1094a00,...) at syscallenter+0x263 syscall(ef78ad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x284c46c3, esp = 0xbfbfdd3c, ebp = 0xbfbfdd78 --- Tracing command awk pid 2160 tid 100092 td 0xc780a000 sched_switch(c780a000,0,104,191,a8c81f6b,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,5c,...) at mi_switch+0x1eb sleepq_switch(c780a000,0,c0ef3b80,1a7,5c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7e1a000,5c,c0ef638f,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7e1a000,c7e1a170,15c,c0ef638f,0,...) at _sleep+0x35c pipe_read(c78bdaf0,ef646c28,c7861980,0,c780a000,...) at pipe_read+0x417 dofileread(ef646c28,ffffffff,ffffffff,0,c78bdaf0,...) at dofileread+0x9e kern_readv(c780a000,0,ef646c28,ef646c48,1,...) at kern_readv+0x58 read(c780a000,ef646cec,ef646d80,ef646c88,0,...) at read+0x4f syscallenter(c780a000,ef646ce4,c0d2a206,0,0,...) at syscallenter+0x263 syscall(ef646d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x281b86c3, esp = 0xbfbfe93c, ebp = 0xbfbfe958 --- Tracing command sh pid 2159 tid 100105 td 0xc79102e0 sched_switch(c79102e0,0,104,191,a8dbb6d2,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c79102e0,0,c0ef3b80,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7907000,6c,c0ef695e,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7907000,c7907088,16c,c0ef695e,0,...) at _sleep+0x35c kern_wait(c79102e0,ffffffff,ef67bc44,2,0,...) at kern_wait+0xbe6 wait4(c79102e0,ef67bcec,ef67bd28,c0ef450a,0,...) at wait4+0x3b syscallenter(c79102e0,ef67bce4,ef67bce4,0,0,...) at syscallenter+0x263 syscall(ef67bd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2816a9ab, esp = 0xbfbfe97c, ebp = 0xbfbfe998 --- Tracing command top pid 2158 tid 100128 td 0xc7d932e0 sched_switch(c7d932e0,0,104,191,9db56cba,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7d932e0,0,c0ef3b80,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(ef6fea14,c09ec26a,c7899050,0,c7d932e0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c7899064,0,ef6fea4c,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7899064,c7899050,3e9,627,c78bd0a8,...) at _cv_timedwait_sig+0x252 seltdwait(ef6febf8,ef6fec00,c741f800,c7d932e0,325b1b0a,...) at seltdwait+0x8a kern_select(c7d932e0,2,bfbfebac,0,0,ef6fec40,20,1,0) at kern_select+0x504 select(c7d932e0,ef6fecec,ef6fed28,c0ef450a,0,...) at select+0x66 syscallenter(c7d932e0,ef6fece4,ef6fece4,0,0,...) at syscallenter+0x263 syscall(ef6fed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x281ee643, esp = 0xbfbfeb4c, ebp = 0xbfbfeca8 --- Tracing command sh pid 2157 tid 100160 td 0xc812d5c0 sched_switch(c812d5c0,0,104,191,b298f770,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c812d5c0,0,c0ef3b80,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c80f9af0,6c,c0ef695e,100,0,...) at sleepq_wait_sig+0x17 _sleep(c80f9af0,c80f9b78,16c,c0ef695e,0,...) at _sleep+0x35c kern_wait(c812d5c0,ffffffff,ef781c44,2,0,...) at kern_wait+0xbe6 wait4(c812d5c0,ef781cec,2820fda8,1,0,...) at wait4+0x3b syscallenter(c812d5c0,ef781ce4,c0d2a54d,c1086470,0,...) at syscallenter+0x263 syscall(ef781d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2816a9ab, esp = 0xbfbfeb2c, ebp = 0xbfbfeb48 --- Tracing command tail pid 2156 tid 100113 td 0xc78948a0 sched_switch(c78948a0,0,104,191,b4b73f9a,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,68,...) at mi_switch+0x1eb sleepq_switch(c78948a0,0,c0ef3b80,1a7,68,...) at sleepq_switch+0x162 sleepq_catch_signals(3e9,c0a3b4c0,c78948a0,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c7b8a700,68,c0ee88f4,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c7b8a700,c7b8a700,168,c0ee88f4,3e9,...) at _sleep+0x328 kern_kevent(c78948a0,4,0,1,ef6b6c28,...) at kern_kevent+0x364 kevent(c78948a0,ef6b6cec,ef6b6d28,c0ef450a,0,...) at kevent+0x19e syscallenter(c78948a0,ef6b6ce4,ef6b6ce4,0,c1094a00,...) at syscallenter+0x263 syscall(ef6b6d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (363, FreeBSD ELF32, kevent), eip = 0x28169d3b, esp = 0xbfbfeb1c, ebp = 0xbfbfebd8 --- Tracing command sshd pid 2155 tid 100122 td 0xc7cc75c0 sched_switch(c7cc75c0,0,104,191,9db86d59,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7cc75c0,0,c0ef3b80,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c09ec26a,c79500d0,0,c0eec987,c7cc75c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c79500e4,0,ef6d1a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c79500e4,c79500d0,c0ef61d1,627,c78bdab8,...) at _cv_wait_sig+0x243 seltdwait(c78bdab8,58,c741f400,c7cc75c0,246,...) at seltdwait+0xa2 kern_select(c7cc75c0,a,288060b4,288060bc,0,0,20,c79212bc,c79212bc) at kern_select+0x504 select(c7cc75c0,ef6d1cec,ef6d1d28,c0ef450a,0,...) at select+0x66 syscallenter(c7cc75c0,ef6d1ce4,ef6d1ce4,0,0,...) at syscallenter+0x263 syscall(ef6d1d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x284c4643, esp = 0xbfbfe19c, ebp = 0xbfbfe1e8 --- Tracing command sshd pid 2154 tid 100159 td 0xc794f5c0 sched_switch(c794f5c0,0,104,191,bb90b5f0,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c794f5c0,0,c0ef3b80,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c09ec26a,c790da50,0,c0eec987,c794f5c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c790da64,0,ef77ea4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c790da64,c790da50,c0ef61d1,627,c789ec78,...) at _cv_wait_sig+0x243 seltdwait(c789ec78,58,c7861c80,c794f5c0,246,...) at seltdwait+0xa2 kern_select(c794f5c0,c,288060b4,288060bc,0,0,20,c80fa000,c80fa000) at kern_select+0x504 select(c794f5c0,ef77ecec,ef77ed28,c0ef450a,0,...) at select+0x66 syscallenter(c794f5c0,ef77ece4,ef77ece4,0,0,...) at syscallenter+0x263 syscall(ef77ed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x284c4643, esp = 0xbfbfe19c, ebp = 0xbfbfe1e8 --- Tracing command sshd pid 2153 tid 100121 td 0xc7cc78a0 sched_switch(c7cc78a0,0,104,191,8730571f,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7cc78a0,0,c0ef3b80,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c09ec26a,c7899450,0,c0eec987,c7cc78a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7899464,0,ef6cea4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7899464,c7899450,c0ef61d1,627,c789d428,...) at _cv_wait_sig+0x243 seltdwait(c789d428,58,c7903300,c7cc78a0,f33,...) at seltdwait+0xa2 kern_select(c7cc78a0,c,288060b4,288060bc,0,0,20,c7921578,c7921578) at kern_select+0x504 select(c7cc78a0,ef6cecec,ef6ced28,c0ef450a,0,...) at select+0x66 syscallenter(c7cc78a0,ef6cece4,ef6cece4,0,0,...) at syscallenter+0x263 syscall(ef6ced28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x284c4643, esp = 0xbfbfe19c, ebp = 0xbfbfe1e8 --- Tracing command sshd pid 2149 tid 100157 td 0xc794fb80 sched_switch(c794fb80,0,104,191,86f3610c,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,68,...) at mi_switch+0x1eb sleepq_switch(c794fb80,0,c0ef3b80,1a7,68,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7e20738,68,c0efa021,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7e20738,c7e206f8,168,c0efa021,0) at _sleep+0x35c sbwait(c7e206d4,4,c0efa0f9,5ec,c7e206f8,...) at sbwait+0x76 soreceive_generic(c7e20680,0,ef777c28,0,0,...) at soreceive_generic+0x3f0 soreceive(c7e20680,0,ef777c28,0,0,0) at soreceive+0x38 soo_read(c789d9a0,ef777c28,c7903c00,0,c794fb80,...) at soo_read+0x4e dofileread(ef777c28,ffffffff,ffffffff,0,c789d9a0,...) at dofileread+0x9e kern_readv(c794fb80,5,ef777c28,ef777c48,1,...) at kern_readv+0x58 read(c794fb80,ef777cec,ef777d28,c0ef450a,0,...) at read+0x4f syscallenter(c794fb80,ef777ce4,ef777ce4,0,0,...) at syscallenter+0x263 syscall(ef777d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x284c46c3, esp = 0xbfbfdd3c, ebp = 0xbfbfdd78 --- Tracing command sshd pid 2148 tid 100156 td 0xc7cc6000 sched_switch(c7cc6000,0,104,191,8c963983,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,68,...) at mi_switch+0x1eb sleepq_switch(c7cc6000,0,c0ef3b80,1a7,68,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7f24598,68,c0efa021,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7f24598,c7f24558,168,c0efa021,0) at _sleep+0x35c sbwait(c7f24534,4,c0efa0f9,5ec,c7f24558,...) at sbwait+0x76 soreceive_generic(c7f244e0,0,ef774c28,0,0,...) at soreceive_generic+0x3f0 soreceive(c7f244e0,0,ef774c28,0,0,0) at soreceive+0x38 soo_read(c79279d8,ef774c28,c7e07080,0,c7cc6000,...) at soo_read+0x4e dofileread(ef774c28,ffffffff,ffffffff,0,c79279d8,...) at dofileread+0x9e kern_readv(c7cc6000,5,ef774c28,ef774c48,1,...) at kern_readv+0x58 read(c7cc6000,ef774cec,2888a010,1,0,...) at read+0x4f syscallenter(c7cc6000,ef774ce4,c0d2a54d,c1086470,0,...) at syscallenter+0x263 syscall(ef774d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x284c46c3, esp = 0xbfbfdd3c, ebp = 0xbfbfdd78 --- Tracing command sshd pid 2147 tid 100155 td 0xc7cc62e0 sched_switch(c7cc62e0,0,104,191,86f0c249,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,68,...) at mi_switch+0x1eb sleepq_switch(c7cc62e0,0,c0ef3b80,1a7,68,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7d89db8,68,c0efa021,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7d89db8,c7d89d78,168,c0efa021,0) at _sleep+0x35c sbwait(c7d89d54,4,c0efa0f9,5ec,c7d89d78,...) at sbwait+0x76 soreceive_generic(c7d89d00,0,ef771c28,0,0,...) at soreceive_generic+0x3f0 soreceive(c7d89d00,0,ef771c28,0,0,0) at soreceive+0x38 soo_read(c789d700,ef771c28,c7861880,0,c7cc62e0,...) at soo_read+0x4e dofileread(ef771c28,ffffffff,ffffffff,0,c789d700,...) at dofileread+0x9e kern_readv(c7cc62e0,5,ef771c28,ef771c48,1,...) at kern_readv+0x58 read(c7cc62e0,ef771cec,ef771d28,c0ef450a,0,...) at read+0x4f syscallenter(c7cc62e0,ef771ce4,ef771ce4,0,0,...) at syscallenter+0x263 syscall(ef771d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x284c46c3, esp = 0xbfbfdd3c, ebp = 0xbfbfdd78 --- Tracing command cron pid 2108 tid 100137 td 0xc794e5c0 sched_switch(c794e5c0,0,104,191,1c9d5449,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c794e5c0,0,c0ef3b80,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(ea61,c0a3b4c0,c794e5c0,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1087d84,6c,c0eef8d7,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1087d84,0,16c,c0eef8d7,ea61,...) at _sleep+0x328 kern_nanosleep(c794e5c0,ef71cc34,ef71cc3c,3c,0,...) at kern_nanosleep+0xc1 nanosleep(c794e5c0,ef71ccec,ef71cd28,c0ef450a,0,...) at nanosleep+0x6f syscallenter(c794e5c0,ef71cce4,ef71cce4,0,0,...) at syscallenter+0x263 syscall(ef71cd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28184c07, esp = 0xbfbfec4c, ebp = 0xbfbfec78 --- Tracing command sendmail pid 2100 tid 100116 td 0xc7894000 sched_switch(c7894000,0,104,191,9e012f61,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,74,...) at mi_switch+0x1eb sleepq_switch(c7894000,0,c0ef3b80,1a7,74,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7cc45d0,74,c0d78a8e,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7cc45d0,c7cc4600,174,c0d78a8e,0,...) at _sleep+0x35c kern_sigsuspend(c7894000,0,0,0,0,...) at kern_sigsuspend+0xba sigsuspend(c7894000,ef6bfcec,ef6bfd28,c0ef450a,0,...) at sigsuspend+0x4d syscallenter(c7894000,ef6bfce4,ef6bfce4,0,0,...) at syscallenter+0x263 syscall(ef6bfd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x28338cfb, esp = 0xbfbfcf9c, ebp = 0xbfbfcfc8 --- Tracing command sendmail pid 2096 tid 100115 td 0xc78942e0 sched_switch(c78942e0,0,104,191,51786723,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c78942e0,0,c0ef3b80,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(ef6bca14,c09ec26a,c79501d0,0,c78942e0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c79501e4,0,ef6bca4c,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c79501e4,c79501d0,1389,627,c78bd770,...) at _cv_timedwait_sig+0x252 seltdwait(ef6bcbf8,ef6bcc00,c7e07800,c78942e0,ef6bcaf8,...) at seltdwait+0x8a kern_select(c78942e0,5,bfbfc510,0,0,ef6bcc40,20,5,0) at kern_select+0x504 select(c78942e0,ef6bccec,ef6bcd28,c0ef450a,0,...) at select+0x66 syscallenter(c78942e0,ef6bcce4,ef6bcce4,0,0,...) at syscallenter+0x263 syscall(ef6bcd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x283e0643, esp = 0xbfbfc47c, ebp = 0xbfbfcfa8 --- Tracing command sshd pid 2088 tid 100079 td 0xc780a8a0 sched_switch(c780a8a0,0,104,191,dd5980b8,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c780a8a0,0,c0ef3b80,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c09ec26a,c7950210,0,c0eec987,c780a8a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7950224,0,ef605a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7950224,c7950210,c0ef61d1,627,c7ca2850,...) at _cv_wait_sig+0x243 seltdwait(c7ca2850,58,c7e07180,c780a8a0,f33,...) at seltdwait+0xa2 kern_select(c780a8a0,5,288cc0b4,0,0,0,20,c7805000,c7805000) at kern_select+0x504 select(c780a8a0,ef605cec,2880a070,1,0,...) at select+0x66 syscallenter(c780a8a0,ef605ce4,c0d2a54d,c1086470,0,...) at syscallenter+0x263 syscall(ef605d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x284c4643, esp = 0xbfbfe25c, ebp = 0xbfbfedf8 --- Tracing command moused pid 2028 tid 100108 td 0xc790f8a0 sched_switch(c790f8a0,0,104,191,613dd69,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c790f8a0,0,c0ef3b80,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c09ec26a,c7950250,0,c0eec987,c790f8a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7950264,0,ef687a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7950264,c7950250,c0ef61d1,627,c789e3f0,...) at _cv_wait_sig+0x243 seltdwait(c789e3f0,58,c719fe00,c790f8a0,14,...) at seltdwait+0xa2 kern_select(c790f8a0,6,bfbfea04,0,0,0,20,c7904578,c7904578) at kern_select+0x504 select(c790f8a0,ef687cec,ef687d28,c0ef450a,0,...) at select+0x66 syscallenter(c790f8a0,ef687ce4,ef687ce4,0,0,...) at syscallenter+0x263 syscall(ef687d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x281b3643, esp = 0xbfbfe99c, ebp = 0xbfbfeb28 --- Tracing command ntpd pid 1968 tid 100148 td 0xc79115c0 sched_switch(c79115c0,0,104,191,bd837c86,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c79115c0,0,c0ef3b80,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c09ec26a,c7d911d0,0,c0eec987,c79115c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7d911e4,0,ef73ea4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7d911e4,c7d911d0,c0ef61d1,627,c7ca2268,...) at _cv_wait_sig+0x243 seltdwait(c7ca2268,58,c719fe00,c79115c0,0,...) at seltdwait+0xa2 kern_select(c79115c0,1c,bfbfece8,0,0,0,20,c7d8c2bc,c7d8c2bc) at kern_select+0x504 select(c79115c0,ef73ecec,ef73ed80,ef73ec88,0,...) at select+0x66 syscallenter(c79115c0,ef73ece4,c0d2a206,fffffffe,246,...) at syscallenter+0x263 syscall(ef73ed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x28362643, esp = 0xbfbfecbc, ebp = 0xbfbfed88 --- Tracing command nfsd pid 1850 tid 100131 td 0xc79088a0 sched_switch(c79088a0,0,104,191,57e89cad,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c79088a0,0,c0ef3b80,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(ef708be0,c09ec26a,c743eb80,0,c79088a0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c77ed610,0,ef708c18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c77ed610,c743eb80,1388,3b1,0,...) at _cv_timedwait_sig+0x252 svc_run_internal(ef708d14,c09cf528,c743eb80,ef708d28,c0ee8cf0,...) at svc_run_internal+0x356 svc_thread_start(c743eb80,ef708d28,c0ee8cf0,390,c7429834,...) at svc_thread_start+0x10 fork_exit(c0bdfbe0,c743eb80,ef708d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x804c12e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1850 tid 100130 td 0xc7908b80 sched_switch(c7908b80,0,104,191,9c5b223c,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7908b80,0,c0ef3b80,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(ef705be0,c09ec26a,c743eb80,0,c7908b80,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c77ed650,0,ef705c18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c77ed650,c743eb80,1388,3b1,0,...) at _cv_timedwait_sig+0x252 svc_run_internal(ef705d14,c09cf528,c743eb80,ef705d28,c0ee8cf0,...) at svc_run_internal+0x356 svc_thread_start(c743eb80,ef705d28,c0ee8cf0,390,c7429834,...) at svc_thread_start+0x10 fork_exit(c0bdfbe0,c743eb80,ef705d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x804c12e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1850 tid 100129 td 0xc790f000 sched_switch(c790f000,0,104,191,9c5afad4,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c790f000,0,c0ef3b80,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(ef702be0,c09ec26a,c743eb80,0,c790f000,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c77ed690,0,ef702c18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c77ed690,c743eb80,1388,3b1,0,...) at _cv_timedwait_sig+0x252 svc_run_internal(ef702d14,c09cf528,c743eb80,ef702d28,c0ee8cf0,...) at svc_run_internal+0x356 svc_thread_start(c743eb80,ef702d28,c0ee8cf0,390,c7429834,...) at svc_thread_start+0x10 fork_exit(c0bdfbe0,c743eb80,ef702d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x804c12e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1850 tid 100081 td 0xc780a2e0 sched_switch(c780a2e0,0,104,191,9c5b30ca,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c780a2e0,0,c0ef3b80,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(ef60d5b4,c09ec26a,c743eb80,0,c780a2e0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c77eeb90,0,ef60d5ec,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c77eeb90,c743eb80,1388,3b1,ef60d634,...) at _cv_timedwait_sig+0x252 svc_run_internal(c780a490,14,c0f1c9da,c0ee09bb,ef60d7f4,...) at svc_run_internal+0x356 svc_run(c743eb80,0,c0ee0996,19d,ef60dc38,...) at svc_run+0x7b nfsrvd_nfsd(c780a2e0,ef60d7f4,c,c1204e80,ef60d720,...) at nfsrvd_nfsd+0x8e nfssvc_nfsd(c780a2e0,ef60dcec,c7429834,0,ef60dc7c,...) at nfssvc_nfsd+0x167 nfssvc(c780a2e0,ef60dcec,ef60dd28,c0ef450a,0,...) at nfssvc+0xeb syscallenter(c780a2e0,ef60dce4,ef60dce4,0,0,...) at syscallenter+0x263 syscall(ef60dd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (155, FreeBSD ELF32, nfssvc), eip = 0x280dd8db, esp = 0xbfbfe82c, ebp = 0xbfbfea98 --- Tracing command nfsd pid 1849 tid 100094 td 0xc78088a0 sched_switch(c78088a0,0,104,191,85974e2,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c78088a0,0,c0ef3b80,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c09ec26a,c78995d0,0,c0eec987,c78088a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c78995e4,0,ef652a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c78995e4,c78995d0,c0ef61d1,627,c7ca2dc8,...) at _cv_wait_sig+0x243 seltdwait(c7ca2dc8,58,c719fe00,c78088a0,f33,...) at seltdwait+0xa2 kern_select(c78088a0,7,bfbfecb4,0,0,0,20,c7920834,c7920834) at kern_select+0x504 select(c78088a0,ef652cec,bfbffff4,1,0,...) at select+0x66 syscallenter(c78088a0,ef652ce4,c0d2a54d,c1086470,0,...) at syscallenter+0x263 syscall(ef652d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x28184643, esp = 0xbfbfea9c, ebp = 0xbfbfede8 --- Tracing command mountd pid 1839 tid 100118 td 0xc7cc82e0 sched_switch(c7cc82e0,0,104,191,ebfb590c,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7cc82e0,0,c0ef3b80,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c09ec26a,c7899610,0,c0eec987,c7cc82e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c7899624,0,ef6c5a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7899624,c7899610,c0ef61d1,627,c7b87310,...) at _cv_wait_sig+0x243 seltdwait(c7b87310,58,c719fe00,c7cc82e0,c11d0eb8,...) at seltdwait+0xa2 kern_select(c7cc82e0,9,bfbfecf4,0,0,0,20,c7cc4000,c7cc4000) at kern_select+0x504 select(c7cc82e0,ef6c5cec,ef6c5d28,c0ef450a,0,...) at select+0x66 syscallenter(c7cc82e0,ef6c5ce4,ef6c5ce4,0,0,...) at syscallenter+0x263 syscall(ef6c5d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x2819a643, esp = 0xbfbfec8c, ebp = 0xbfbfedd8 --- Tracing command rpcbind pid 1739 tid 100083 td 0xc789b5c0 sched_switch(c789b5c0,0,104,191,4d3775fd,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c789b5c0,0,c0ef3b80,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(ef618a6c,c09ec26a,c790dbd0,0,c789b5c0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c790dbe4,0,ef618aa4,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c790dbe4,c790dbd0,7531,627,ef618b5c,...) at _cv_timedwait_sig+0x252 seltdwait(ef618c2c,ef618c34,535,c789b5c0,ef618b2c,...) at seltdwait+0x8a poll(c789b5c0,ef618cec,ef618d28,c0ef450a,0,...) at poll+0x300 syscallenter(c789b5c0,ef618ce4,ef618ce4,0,0,...) at syscallenter+0x263 syscall(ef618d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, poll), eip = 0x2813f81b, esp = 0xbfbfcbac, ebp = 0xbfbfed78 --- Tracing command syslogd pid 1710 tid 100111 td 0xc789a000 sched_switch(c789a000,0,104,191,d25e7fc7,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c789a000,0,c0ef3b80,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c09ec26a,c7950290,0,c0eec987,c789a000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c79502a4,0,ef6b0a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c79502a4,c7950290,c0ef61d1,627,c7d372d8,...) at _cv_wait_sig+0x243 seltdwait(c7d372d8,58,c719fe00,c789a000,0,...) at seltdwait+0xa2 kern_select(c789a000,9,2847f0ac,0,0,0,20,c7cc5578,c7cc5578) at kern_select+0x504 select(c789a000,ef6b0cec,ef6b0d28,c0ef450a,0,...) at select+0x66 syscallenter(c789a000,ef6b0ce4,ef6b0ce4,0,246,...) at syscallenter+0x263 syscall(ef6b0d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x28199643, esp = 0xbfbfe29c, ebp = 0xbfbfede8 --- Tracing command devd pid 1509 tid 100117 td 0xc7cc85c0 sched_switch(c7cc85c0,0,104,191,de6507c2,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7cc85c0,0,c0ef3b80,1a7,0,...) at sleepq_switch+0x162 sleepq_catch_signals(c09ec26a,c79502d0,0,c0eec987,c7cc85c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c79502e4,0,ef6c2a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c79502e4,c79502d0,c0ef61d1,627,c7ca2188,...) at _cv_wait_sig+0x243 seltdwait(c7ca2188,58,c719fe00,c7cc85c0,c0f265e1,...) at seltdwait+0xa2 kern_select(c7cc85c0,5,bfbfe960,0,0,0,20,c7cc42bc,c7cc42bc) at kern_select+0x504 select(c7cc85c0,ef6c2cec,ef6c2d28,c0ef450a,0,...) at select+0x66 syscallenter(c7cc85c0,ef6c2ce4,ef6c2ce4,0,0,...) at syscallenter+0x263 syscall(ef6c2d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x808b99b, esp = 0xbfbfe92c, ebp = 0xbfbfee08 --- Tracing command softdepflush pid 18 tid 100076 td 0xc74488a0 cpustop_handler(4,ed40e8dc,c0d29e06,c0f3e2a3,f4,...) at cpustop_handler+0x49 ipi_nmi_handler(c0f3e2a3,f4,eea,99ea469e,c78052bc,...) at ipi_nmi_handler+0x44 trap(ed40e8e8) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0c2cdf2, esp = 0xed40e928, ebp = 0xed40e958 --- process_truncates(c1204530,0,c0f211e0,30ae,ed40e994,...) at process_truncates+0x42 softdep_request_cleanup(c8341000,c86826cc,c71a0000,4,0,...) at softdep_request_cleanup+0x32c ffs_balloc_ufs2(c86826cc,12300000,0,8000,c71a0000,...) at ffs_balloc_ufs2+0x1bc0 ffs_snapblkfree(c8341000,c83cc000,12305,0,3000,...) at ffs_snapblkfree+0x57e ffs_blkfree(c7be8100,c8341000,c83cc000,12305,0,...) at ffs_blkfree+0x55 handle_workitem_freefrag(0,ed40ec6c,2,6b2,ed40ec70,...) at handle_workitem_freefrag+0xe9 process_worklist_item(c1204548,0,c0f211e0,5e1,c74488a0,...) at process_worklist_item+0x2cd softdep_process_worklist(c834eb50,0,c0f211e0,559,3e8,...) at softdep_process_worklist+0x88 softdep_flush(0,ed40ed28,c0ee8cf0,390,c78052bc,...) at softdep_flush+0x2a0 fork_exit(c0c2e7c0,0,ed40ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed40ed60, ebp = 0 --- Tracing command vnlru pid 17 tid 100075 td 0xc7448b80 sched_switch(c7448b80,0,104,191,dd0cf7b3,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,60,...) at mi_switch+0x1eb sleepq_switch(c7448b80,0,c0ef3b80,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c7805578,60,c0efe844,0,0,...) at sleepq_timedwait+0x6b _sleep(c7805578,c11fdf34,260,c0efe844,3e8,...) at _sleep+0x342 vnlru_proc(0,ed40bd28,c0ee8cf0,390,c7805578,...) at vnlru_proc+0xe7 fork_exit(c0a98cc0,0,ed40bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed40bd60, ebp = 0 --- Tracing command syncer pid 16 tid 100074 td 0xc7577000 sched_switch(c7577000,0,104,191,fa63ebd4,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,60,...) at mi_switch+0x1eb sleepq_switch(c7577000,0,c0ef3b80,268,60,...) at sleepq_switch+0x162 sleepq_wait(c7bd351c,60,c0f20c85,4,0,...) at sleepq_wait+0x63 __lockmgr_args(c7bd351c,80900,c83cc0c4,0,0,...) at __lockmgr_args+0xb1f ffs_copyonwrite(c83cc000,e0c8edc0,e0c8edc0,0,0,...) at ffs_copyonwrite+0x2c2 ffs_geom_strategy(c83cc0f8,e0c8edc0,df,e0c8edc0,c7fec4fc,...) at ffs_geom_strategy+0xeb bufwrite(e0c8edc0,0,c0f24090,76a,0) at bufwrite+0x159 ffs_bufwrite(e0c8edc0,c83c9b00,100,8000,0,...) at ffs_bufwrite+0x290 ffs_update(c83ec6cc,3,c0f246b9,12f,0,...) at ffs_update+0x28c ffs_syncvnode(c83ec6cc,3,c7577000,568,c0eec987,...) at ffs_syncvnode+0x423 ffs_sync(c834eb50,3,c0efd8d2,db7,c834eb50,...) at ffs_sync+0x26f sync_fsync(ed408c6c,c0f42941,c83ec8ec,ed408c6c,c83ec828,...) at sync_fsync+0x18f VOP_FSYNC_APV(c101eea0,ed408c6c,c0efd8d2,6c6,c7577000,...) at VOP_FSYNC_APV+0xc5 sync_vnode(c11fdf74,c11fdf60,3e8,76a,4e20,...) at sync_vnode+0x16b sched_sync(0,ed408d28,c0ee8cf0,390,c7805834,...) at sched_sync+0x282 fork_exit(c0a96c60,0,ed408d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed408d60, ebp = 0 --- Tracing command bufdaemon pid 9 tid 100073 td 0xc75772e0 sched_switch(c75772e0,0,104,191,8dbdbd37,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,60,...) at mi_switch+0x1eb sleepq_switch(c75772e0,0,c0ef3b80,268,60,...) at sleepq_switch+0x162 sleepq_wait(c7bd351c,60,c0f20c85,4,0,...) at sleepq_wait+0x63 __lockmgr_args(c7bd351c,80900,c83cc0c4,0,0,...) at __lockmgr_args+0xb1f ffs_copyonwrite(c83cc000,e0b6f700,0,e0b6f700,ca47315c,...) at ffs_copyonwrite+0x2c2 ffs_geom_strategy(c83cc0f8,e0b6f700,ed405b5c,3,c75772e0,...) at ffs_geom_strategy+0xeb ufs_strategy(ed405b98,c0f42da8,c75772e0,e0b6f700,4,...) at ufs_strategy+0xd3 VOP_STRATEGY_APV(c1030660,ed405b98,c0efaf2b,c104b6c0,ca47315c,...) at VOP_STRATEGY_APV+0xe5 bufstrategy(ca473254,e0b6f700,3a6,7000,0,...) at bufstrategy+0x61 bufwrite(e0b6f700,0,c0efaf2b,6dc,c0efdb1f,...) at bufwrite+0x159 vfs_bio_awrite(e0b6f700,0,c0efaf2b,945,0,...) at vfs_bio_awrite+0x318 flushbufqueues(d0,c0eec987,c7805b78,391,391,...) at flushbufqueues+0x5b0 buf_do_flush(ffffffff,0,c0efaf2b,8ac,64,...) at buf_do_flush+0x19 buf_daemon(0,ed405d28,c0ee8cf0,390,c7805af0,...) at buf_daemon+0xea fork_exit(c0a7e3d0,0,ed405d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed405d60, ebp = 0 --- Tracing command pagezero pid 8 tid 100072 td 0xc75775c0 sched_switch(c75775c0,0,104,191,247367a,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c75775c0,0,c0ef3b80,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c12063dc,0,c0f2a0a8,0,0,...) at sleepq_timedwait+0x6b _sleep(c12063dc,c1204e80,0,c0f2a0a8,493e0,...) at _sleep+0x342 vm_pagezero(0,ed402d28,c0ee8cf0,390,c7806000,...) at vm_pagezero+0xdc fork_exit(c0c725f0,0,ed402d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed402d60, ebp = 0 --- Tracing command vmdaemon pid 7 tid 100071 td 0xc75778a0 sched_switch(c75778a0,0,104,191,2b2dd6d6,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,74,...) at mi_switch+0x1eb sleepq_switch(c75778a0,0,c0ef3b80,268,0,...) at sleepq_switch+0x162 sleepq_wait(c1205fc8,74,c0efb872,0,0,...) at sleepq_wait+0x63 _sleep(c1205fc8,c1205fcc,74,c0efb872,0,...) at _sleep+0x372 vm_daemon(0,ed3ffd28,c0ee8cf0,390,c71bd2bc,...) at vm_daemon+0x59 fork_exit(c0c6c1a0,0,ed3ffd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed3ffd60, ebp = 0 --- Tracing command pagedaemon pid 6 tid 100070 td 0xc7577b80 sched_switch(c7577b80,0,104,191,f41f732c,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,54,...) at mi_switch+0x1eb sleepq_switch(c7577b80,0,c0ef3b80,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1205f90,54,c0efb872,0,0,...) at sleepq_timedwait+0x6b _sleep(c1205f90,c1204e80,54,c0efb872,1388,...) at _sleep+0x342 vm_pageout(0,ed3fcd28,c0ee8cf0,390,c71bd578,...) at vm_pageout+0x2c7 fork_exit(c0c6d1d0,0,ed3fcd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed3fcd60, ebp = 0 --- Tracing command xpt_thrd pid 5 tid 100069 td 0xc7578000 sched_switch(c7578000,0,104,191,314b39ec,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,5c,...) at mi_switch+0x1eb sleepq_switch(c7578000,0,c0ef3b80,268,0,...) at sleepq_switch+0x162 sleepq_wait(c104cad4,5c,c0d516d2,0,0,...) at sleepq_wait+0x63 _sleep(c104cad4,c104cb18,5c,c0d516d2,0,...) at _sleep+0x372 xpt_scanner_thread(0,ed399d28,c0ee8cf0,390,c71bd834,...) at xpt_scanner_thread+0x47 fork_exit(c0490860,0,ed399d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed399d60, ebp = 0 --- Tracing command sctp_iterator pid 4 tid 100068 td 0xc75782e0 sched_switch(c75782e0,0,104,191,1f371489,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c75782e0,0,c0ef3b80,268,0,...) at sleepq_switch+0x162 sleepq_wait(c11ffa98,0,c0f11a7f,0,0,...) at sleepq_wait+0x63 _sleep(c11ffa98,c11ffa60,0,c0f11a7f,0,...) at _sleep+0x372 sctp_iterator_thread(0,ed396d28,c0ee8cf0,390,c71bdaf0,...) at sctp_iterator_thread+0x5c fork_exit(c0b285f0,0,ed396d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed396d60, ebp = 0 --- Tracing command fdc0 pid 3 tid 100064 td 0xc7579000 sched_switch(c7579000,0,104,191,d7942533,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,5c,...) at mi_switch+0x1eb sleepq_switch(c7579000,0,c0ef3b80,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c73eae3c,5c,c0ee1472,0,0,...) at sleepq_timedwait+0x6b _sleep(c73eae3c,c73eaef0,5c,c0ee1472,3e8,...) at _sleep+0x342 fdc_thread(c73eae00,ed38ad28,c0ee8cf0,390,c7429000,...) at fdc_thread+0x27d fork_exit(c0cf1870,c73eae00,ed38ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed38ad60, ebp = 0 --- Tracing command fw0_probe pid 2 tid 100062 td 0xc74375c0 sched_switch(c74375c0,0,104,191,314b9c39,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c74375c0,0,c0ef3b80,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c746f000,6c,c0ee1472,100,0,...) at sleepq_wait_sig+0x17 _sleep(c746f000,c7473488,16c,c0ee1472,0,...) at _sleep+0x35c fw_bus_probe_thread(c746f000,ed37ad28,c0ee8cf0,390,c74292bc,...) at fw_bus_probe_thread+0xa08 fork_exit(c06b2c30,c746f000,ed37ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed37ad60, ebp = 0 --- Tracing command usb pid 15 tid 100058 td 0xc74452e0 sched_switch(c74452e0,0,104,191,1ebc1721,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c74452e0,0,c0ef3b80,268,c74452e0,...) at sleepq_switch+0x162 sleepq_wait(c744dd34,0,ed363cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c744dd34,c744ddd4,c0ebfa7e,6b,c744dd3c,...) at _cv_wait+0x243 usb_process(c744dd2c,ed363d28,c0ee8cf0,390,c7429578,...) at usb_process+0x193 fork_exit(c08a2ef0,c744dd2c,ed363d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed363d60, ebp = 0 --- Tracing command usb pid 15 tid 100057 td 0xc74455c0 sched_switch(c74455c0,0,104,191,99ca3198,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c74455c0,0,c0ef3b80,268,c74455c0,...) at sleepq_switch+0x162 sleepq_wait(c744dd04,0,ed360cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c744dd04,c744ddd4,c0ebfa7e,6b,c744dd0c,...) at _cv_wait+0x243 usb_process(c744dcfc,ed360d28,c0ee8cf0,390,c7429578,...) at usb_process+0x193 fork_exit(c08a2ef0,c744dcfc,ed360d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed360d60, ebp = 0 --- Tracing command usb pid 15 tid 100056 td 0xc74458a0 sched_switch(c74458a0,0,104,191,1e54af85,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c74458a0,0,c0ef3b80,268,c74458a0,...) at sleepq_switch+0x162 sleepq_wait(c744dcd4,0,ed35dcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c744dcd4,c744ddd4,c0ebfa7e,6b,c744dcdc,...) at _cv_wait+0x243 usb_process(c744dccc,ed35dd28,c0ee8cf0,390,c7429578,...) at usb_process+0x193 fork_exit(c08a2ef0,c744dccc,ed35dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed35dd60, ebp = 0 --- Tracing command usb pid 15 tid 100055 td 0xc7445b80 sched_switch(c7445b80,0,104,191,1e549da9,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7445b80,0,c0ef3b80,268,c7445b80,...) at sleepq_switch+0x162 sleepq_wait(c744dca4,0,ed35acac,1,0,...) at sleepq_wait+0x63 _cv_wait(c744dca4,c744ddd4,c0ebfa7e,6b,c744dcac,...) at _cv_wait+0x243 usb_process(c744dc9c,ed35ad28,c0ee8cf0,390,c7429578,...) at usb_process+0x193 fork_exit(c08a2ef0,c744dc9c,ed35ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed35ad60, ebp = 0 --- Tracing command usb pid 15 tid 100053 td 0xc74482e0 sched_switch(c74482e0,0,104,191,1e548961,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c74482e0,0,c0ef3b80,268,c74482e0,...) at sleepq_switch+0x162 sleepq_wait(c743fb5c,0,ed351cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c743fb5c,c743fbfc,c0ebfa7e,6b,c743fb64,...) at _cv_wait+0x243 usb_process(c743fb54,ed351d28,c0ee8cf0,390,c7429578,...) at usb_process+0x193 fork_exit(c08a2ef0,c743fb54,ed351d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed351d60, ebp = 0 --- Tracing command usb pid 15 tid 100052 td 0xc74485c0 sched_switch(c74485c0,0,104,191,99c91dfb,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c74485c0,0,c0ef3b80,268,c74485c0,...) at sleepq_switch+0x162 sleepq_wait(c743fb2c,0,ed34ecac,1,0,...) at sleepq_wait+0x63 _cv_wait(c743fb2c,c743fbfc,c0ebfa7e,6b,c743fb34,...) at _cv_wait+0x243 usb_process(c743fb24,ed34ed28,c0ee8cf0,390,c7429578,...) at usb_process+0x193 fork_exit(c08a2ef0,c743fb24,ed34ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed34ed60, ebp = 0 --- Tracing command usb pid 15 tid 100051 td 0xc7435000 sched_switch(c7435000,0,104,191,1df07fd9,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7435000,0,c0ef3b80,268,c7435000,...) at sleepq_switch+0x162 sleepq_wait(c743fafc,0,ed34bcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c743fafc,c743fbfc,c0ebfa7e,6b,c743fb04,...) at _cv_wait+0x243 usb_process(c743faf4,ed34bd28,c0ee8cf0,390,c7429578,...) at usb_process+0x193 fork_exit(c08a2ef0,c743faf4,ed34bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed34bd60, ebp = 0 --- Tracing command usb pid 15 tid 100050 td 0xc74352e0 sched_switch(c74352e0,0,104,191,1df070b3,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c74352e0,0,c0ef3b80,268,c74352e0,...) at sleepq_switch+0x162 sleepq_wait(c743facc,0,ed348cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c743facc,c743fbfc,c0ebfa7e,6b,c743fad4,...) at _cv_wait+0x243 usb_process(c743fac4,ed348d28,c0ee8cf0,390,c7429578,...) at usb_process+0x193 fork_exit(c08a2ef0,c743fac4,ed348d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed348d60, ebp = 0 --- Tracing command usb pid 15 tid 100049 td 0xc74355c0 sched_switch(c74355c0,0,104,191,1df05a2b,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c74355c0,0,c0ef3b80,268,c74355c0,...) at sleepq_switch+0x162 sleepq_wait(c7439b5c,0,ed345cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7439b5c,c7439bfc,c0ebfa7e,6b,c7439b64,...) at _cv_wait+0x243 usb_process(c7439b54,ed345d28,c0ee8cf0,390,c7429578,...) at usb_process+0x193 fork_exit(c08a2ef0,c7439b54,ed345d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed345d60, ebp = 0 --- Tracing command usb pid 15 tid 100048 td 0xc74358a0 sched_switch(c74358a0,0,104,191,99c8722f,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c74358a0,0,c0ef3b80,268,c74358a0,...) at sleepq_switch+0x162 sleepq_wait(c7439b2c,0,ed342cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7439b2c,c7439bfc,c0ebfa7e,6b,c7439b34,...) at _cv_wait+0x243 usb_process(c7439b24,ed342d28,c0ee8cf0,390,c7429578,...) at usb_process+0x193 fork_exit(c08a2ef0,c7439b24,ed342d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed342d60, ebp = 0 --- Tracing command usb pid 15 tid 100047 td 0xc7435b80 sched_switch(c7435b80,0,104,191,1823300a,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7435b80,0,c0ef3b80,268,c7435b80,...) at sleepq_switch+0x162 sleepq_wait(c7439afc,0,ed33fcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7439afc,c7439bfc,c0ebfa7e,6b,c7439b04,...) at _cv_wait+0x243 usb_process(c7439af4,ed33fd28,c0ee8cf0,390,c7429578,...) at usb_process+0x193 fork_exit(c08a2ef0,c7439af4,ed33fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed33fd60, ebp = 0 --- Tracing command usb pid 15 tid 100046 td 0xc7436000 sched_switch(c7436000,0,104,191,18231eca,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7436000,0,c0ef3b80,268,c7436000,...) at sleepq_switch+0x162 sleepq_wait(c7439acc,0,ed33ccac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7439acc,c7439bfc,c0ebfa7e,6b,c7439ad4,...) at _cv_wait+0x243 usb_process(c7439ac4,ed33cd28,c0ee8cf0,390,c7429578,...) at usb_process+0x193 fork_exit(c08a2ef0,c7439ac4,ed33cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed33cd60, ebp = 0 --- Tracing command usb pid 15 tid 100045 td 0xc74362e0 sched_switch(c74362e0,0,104,191,18230b74,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c74362e0,0,c0ef3b80,268,c74362e0,...) at sleepq_switch+0x162 sleepq_wait(c7431b5c,0,ed339cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7431b5c,c7431bfc,c0ebfa7e,6b,c7431b64,...) at _cv_wait+0x243 usb_process(c7431b54,ed339d28,c0ee8cf0,390,c7429578,...) at usb_process+0x193 fork_exit(c08a2ef0,c7431b54,ed339d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed339d60, ebp = 0 --- Tracing command usb pid 15 tid 100044 td 0xc74365c0 sched_switch(c74365c0,0,104,191,99c7e407,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c74365c0,0,c0ef3b80,268,c74365c0,...) at sleepq_switch+0x162 sleepq_wait(c7431b2c,0,ed336cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7431b2c,c7431bfc,c0ebfa7e,6b,c7431b34,...) at _cv_wait+0x243 usb_process(c7431b24,ed336d28,c0ee8cf0,390,c7429578,...) at usb_process+0x193 fork_exit(c08a2ef0,c7431b24,ed336d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed336d60, ebp = 0 --- Tracing command usb pid 15 tid 100043 td 0xc74368a0 sched_switch(c74368a0,0,104,191,17bf06a6,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c74368a0,0,c0ef3b80,268,c74368a0,...) at sleepq_switch+0x162 sleepq_wait(c7431afc,0,ed333cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7431afc,c7431bfc,c0ebfa7e,6b,c7431b04,...) at _cv_wait+0x243 usb_process(c7431af4,ed333d28,c0ee8cf0,390,c7429578,...) at usb_process+0x193 fork_exit(c08a2ef0,c7431af4,ed333d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed333d60, ebp = 0 --- Tracing command usb pid 15 tid 100042 td 0xc7436b80 sched_switch(c7436b80,0,104,191,17bef385,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7436b80,0,c0ef3b80,268,c7436b80,...) at sleepq_switch+0x162 sleepq_wait(c7431acc,0,e0ffdcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7431acc,c7431bfc,c0ebfa7e,6b,c7431ad4,...) at _cv_wait+0x243 usb_process(c7431ac4,e0ffdd28,c0ee8cf0,390,c7429578,...) at usb_process+0x193 fork_exit(c08a2ef0,c7431ac4,e0ffdd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0ffdd60, ebp = 0 --- Tracing command usb pid 15 tid 100040 td 0xc7425000 sched_switch(c7425000,0,104,191,17bedf69,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7425000,0,c0ef3b80,268,c7425000,...) at sleepq_switch+0x162 sleepq_wait(c742ab5c,0,e0ff6cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c742ab5c,c742abfc,c0ebfa7e,6b,c742ab64,...) at _cv_wait+0x243 usb_process(c742ab54,e0ff6d28,c0ee8cf0,390,c7429578,...) at usb_process+0x193 fork_exit(c08a2ef0,c742ab54,e0ff6d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0ff6d60, ebp = 0 --- Tracing command usb pid 15 tid 100039 td 0xc74252e0 sched_switch(c74252e0,0,104,191,9923b102,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c74252e0,0,c0ef3b80,268,c74252e0,...) at sleepq_switch+0x162 sleepq_wait(c742ab2c,0,e0ff3cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c742ab2c,c742abfc,c0ebfa7e,6b,c742ab34,...) at _cv_wait+0x243 usb_process(c742ab24,e0ff3d28,c0ee8cf0,390,c7429578,...) at usb_process+0x193 fork_exit(c08a2ef0,c742ab24,e0ff3d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0ff3d60, ebp = 0 --- Tracing command usb pid 15 tid 100038 td 0xc74255c0 sched_switch(c74255c0,0,104,191,175aff14,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c74255c0,0,c0ef3b80,268,c74255c0,...) at sleepq_switch+0x162 sleepq_wait(c742aafc,0,e0ff0cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c742aafc,c742abfc,c0ebfa7e,6b,c742ab04,...) at _cv_wait+0x243 usb_process(c742aaf4,e0ff0d28,c0ee8cf0,390,c7429578,...) at usb_process+0x193 fork_exit(c08a2ef0,c742aaf4,e0ff0d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0ff0d60, ebp = 0 --- Tracing command usb pid 15 tid 100037 td 0xc74258a0 sched_switch(c74258a0,0,104,191,175aeb9e,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c74258a0,0,c0ef3b80,268,c74258a0,...) at sleepq_switch+0x162 sleepq_wait(c742aacc,0,e0fedcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c742aacc,c742abfc,c0ebfa7e,6b,c742aad4,...) at _cv_wait+0x243 usb_process(c742aac4,e0fedd28,c0ee8cf0,390,c7429578,...) at usb_process+0x193 fork_exit(c08a2ef0,c742aac4,e0fedd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0fedd60, ebp = 0 --- Tracing command usb pid 15 tid 100035 td 0xc7427000 sched_switch(c7427000,0,104,191,175ad3da,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7427000,0,c0ef3b80,268,c7427000,...) at sleepq_switch+0x162 sleepq_wait(c7421b5c,0,e0fe6cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7421b5c,c7421bfc,c0ebfa7e,6b,c7421b64,...) at _cv_wait+0x243 usb_process(c7421b54,e0fe6d28,c0ee8cf0,390,c7429578,...) at usb_process+0x193 fork_exit(c08a2ef0,c7421b54,e0fe6d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0fe6d60, ebp = 0 --- Tracing command usb pid 15 tid 100034 td 0xc74272e0 sched_switch(c74272e0,0,104,191,99232f3c,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c74272e0,0,c0ef3b80,268,c74272e0,...) at sleepq_switch+0x162 sleepq_wait(c7421b2c,0,e0fe3cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7421b2c,c7421bfc,c0ebfa7e,6b,c7421b34,...) at _cv_wait+0x243 usb_process(c7421b24,e0fe3d28,c0ee8cf0,390,c7429578,...) at usb_process+0x193 fork_exit(c08a2ef0,c7421b24,e0fe3d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0fe3d60, ebp = 0 --- Tracing command usb pid 15 tid 100033 td 0xc74275c0 sched_switch(c74275c0,0,104,191,16f6bb41,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c74275c0,0,c0ef3b80,268,c74275c0,...) at sleepq_switch+0x162 sleepq_wait(c7421afc,0,e0fe0cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7421afc,c7421bfc,c0ebfa7e,6b,c7421b04,...) at _cv_wait+0x243 usb_process(c7421af4,e0fe0d28,c0ee8cf0,390,c7429578,...) at usb_process+0x193 fork_exit(c08a2ef0,c7421af4,e0fe0d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0fe0d60, ebp = 0 --- Tracing command usb pid 15 tid 100032 td 0xc74278a0 sched_switch(c74278a0,0,104,191,16f6a7ad,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c74278a0,0,c0ef3b80,268,c74278a0,...) at sleepq_switch+0x162 sleepq_wait(c7421acc,0,e0fddcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c7421acc,c7421bfc,c0ebfa7e,6b,c7421ad4,...) at _cv_wait+0x243 usb_process(c7421ac4,e0fddd28,c0ee8cf0,390,c7429578,...) at usb_process+0x193 fork_exit(c08a2ef0,c7421ac4,e0fddd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0fddd60, ebp = 0 --- Tracing command yarrow pid 14 tid 100017 td 0xc72cd5c0 sched_switch(c72cd5c0,0,104,191,e6ec15ea,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c72cd5c0,0,c0ef3b80,28b,2,...) at sleepq_switch+0x162 sleepq_timedwait(c1086b84,0,c0ee1472,2,0,...) at sleepq_timedwait+0x6b _sleep(c1086b84,0,0,c0ee1472,64,...) at _sleep+0x342 pause(c0ee1472,64,c0ea088e,111,0,...) at pause+0x47 random_kthread(0,c6f62d28,c0ee8cf0,390,c71bc000,...) at random_kthread+0x1ef fork_exit(c07c3800,0,c6f62d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f62d60, ebp = 0 --- Tracing command geom pid 13 tid 100015 td 0xc72cdb80 sched_switch(c72cdb80,0,104,191,6bb992e9,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,5c,...) at mi_switch+0x1eb sleepq_switch(c72cdb80,0,c0ef3b80,268,0,...) at sleepq_switch+0x162 sleepq_wait(c10847a8,5c,c0ee1472,0,0,...) at sleepq_wait+0x63 _sleep(c10847a8,c1084708,25c,c0ee1472,0,...) at _sleep+0x372 g_io_schedule_down(c72cdb80,0,c0ee2fc5,6c,c6f5cd14,...) at g_io_schedule_down+0x5b g_down_procbody(0,c6f5cd28,c0ee8cf0,390,c71bc2bc,...) at g_down_procbody+0x9d fork_exit(c0991b90,0,c6f5cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f5cd60, ebp = 0 --- Tracing command geom pid 13 tid 100014 td 0xc72ce000 sched_switch(c72ce000,0,104,191,6c38d23d,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,5c,...) at mi_switch+0x1eb sleepq_switch(c72ce000,0,c0ef3b80,268,0,...) at sleepq_switch+0x162 sleepq_wait(c10847a4,5c,c0ee1472,0,0,...) at sleepq_wait+0x63 _sleep(c10847a4,c1084728,25c,c0ee1472,0,...) at _sleep+0x372 g_io_schedule_up(c72ce000,0,c0ee2fc5,5f,c6f59d14,...) at g_io_schedule_up+0x134 g_up_procbody(0,c6f59d28,c0ee8cf0,390,c71bc2bc,...) at g_up_procbody+0x9d fork_exit(c0991c30,0,c6f59d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f59d60, ebp = 0 --- Tracing command geom pid 13 tid 100013 td 0xc71bf2e0 sched_switch(c71bf2e0,0,104,191,eb8b1490,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,5c,...) at mi_switch+0x1eb sleepq_switch(c71bf2e0,0,c0ef3b80,268,0,...) at sleepq_switch+0x162 sleepq_wait(c108479c,5c,c0ee1472,0,0,...) at sleepq_wait+0x63 _sleep(c108479c,c10846cc,25c,c0ee1472,0,...) at _sleep+0x372 g_run_events(c1094a00,0,c0ee2fc5,79,c6f56d14,...) at g_run_events+0x526 g_event_procbody(0,c6f56d28,c0ee8cf0,390,c71bc2bc,...) at g_event_procbody+0x90 fork_exit(c0991cd0,0,c6f56d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f56d60, ebp = 0 --- Tracing command intr pid 12 tid 100066 td 0xc75788a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100065 td 0xc7578b80 sched_switch(c7578b80,0,109,191,16f1c552,...) at sched_switch+0x3bc mi_switch(109,0,c0ee9013,554,c7578b80,...) at mi_switch+0x1eb ithread_loop(c71ba9f0,ed38dd28,c0ee8cf0,390,c71bc578,...) at ithread_loop+0x1fb fork_exit(c09d30b0,c71ba9f0,ed38dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed38dd60, ebp = 0 --- Tracing command intr pid 12 tid 100063 td 0xc74372e0 sched_switch(c74372e0,0,109,191,bbff0c73,...) at sched_switch+0x3bc mi_switch(109,0,c0ee9013,554,c74372e0,...) at mi_switch+0x1eb ithread_loop(c71baa00,ed37dd28,c0ee8cf0,390,c71bc578,...) at ithread_loop+0x1fb fork_exit(c09d30b0,c71baa00,ed37dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed37dd60, ebp = 0 --- Tracing command intr pid 12 tid 100060 td 0xc7437b80 sched_switch(c7437b80,0,109,191,c8bcaca,...) at sched_switch+0x3bc mi_switch(109,0,c0ee9013,554,c7437b80,...) at mi_switch+0x1eb ithread_loop(c71baa30,ed371d28,c0ee8cf0,390,c71bc578,...) at ithread_loop+0x1fb fork_exit(c09d30b0,c71baa30,ed371d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed371d60, ebp = 0 --- Tracing command intr pid 12 tid 100059 td 0xc7445000 sched_switch(c7445000,0,109,191,28111416,...) at sched_switch+0x3bc mi_switch(109,0,c0ee9013,554,c7445000,...) at mi_switch+0x1eb ithread_loop(c71baa60,ed369d28,c0ee8cf0,390,c71bc578,...) at ithread_loop+0x1fb fork_exit(c09d30b0,c71baa60,ed369d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed369d60, ebp = 0 --- Tracing command intr pid 12 tid 100054 td 0xc7448000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xc7437000 sched_switch(c7437000,0,109,191,3bfcdba6,...) at sched_switch+0x3bc mi_switch(109,0,c0ee9013,554,c7437000,...) at mi_switch+0x1eb ithread_loop(c71baa80,e0ffad28,c0ee8cf0,390,c71bc578,...) at ithread_loop+0x1fb fork_exit(c09d30b0,c71baa80,e0ffad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0ffad60, ebp = 0 --- Tracing command intr pid 12 tid 100036 td 0xc7425b80 sched_switch(c7425b80,0,109,191,3684409f,...) at sched_switch+0x3bc mi_switch(109,0,c0ee9013,554,c7425b80,...) at mi_switch+0x1eb ithread_loop(c71baa90,e0fead28,c0ee8cf0,390,c71bc578,...) at ithread_loop+0x1fb fork_exit(c09d30b0,c71baa90,e0fead28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0fead60, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xc7427b80 sched_switch(c7427b80,0,109,191,a033477,...) at sched_switch+0x3bc mi_switch(109,0,c0ee9013,554,c7427b80,...) at mi_switch+0x1eb ithread_loop(c71baaa0,e0fdad28,c0ee8cf0,390,c71bc578,...) at ithread_loop+0x1fb fork_exit(c09d30b0,c71baaa0,e0fdad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0fdad60, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc72ce2e0 sched_switch(c72ce2e0,0,109,191,6c36f77b,...) at sched_switch+0x3bc mi_switch(109,0,c0ee9013,554,c72ce2e0,...) at mi_switch+0x1eb ithread_loop(c71bab30,e0e84d28,c0ee8cf0,390,c71bc578,...) at ithread_loop+0x1fb fork_exit(c09d30b0,c71bab30,e0e84d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0e84d60, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc72ce5c0 sched_switch(c72ce5c0,0,109,191,a8662e8b,...) at sched_switch+0x3bc mi_switch(109,0,c0ee9013,554,c72ce5c0,...) at mi_switch+0x1eb ithread_loop(c71bab40,e0e80d28,c0ee8cf0,390,c71bc578,...) at ithread_loop+0x1fb fork_exit(c09d30b0,c71bab40,e0e80d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe0e80d60, ebp = 0 --- Tracing command intr pid 12 tid 100028 td 0xc72ce8a0 sched_switch(c72ce8a0,0,109,191,d2daa23,...) at sched_switch+0x3bc mi_switch(109,0,c0ee9013,554,c72ce8a0,...) at mi_switch+0x1eb ithread_loop(c71bab50,c6fb1d28,c0ee8cf0,390,c71bc578,...) at ithread_loop+0x1fb fork_exit(c09d30b0,c71bab50,c6fb1d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6fb1d60, ebp = 0 --- Tracing command intr pid 12 tid 100027 td 0xc72ceb80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100026 td 0xc73b4000 sched_switch(c73b4000,0,109,191,6c37e8e3,...) at sched_switch+0x3bc mi_switch(109,0,c0ee9013,554,c73b4000,...) at mi_switch+0x1eb ithread_loop(c71bab80,c6f7dd28,c0ee8cf0,390,c71bc578,...) at ithread_loop+0x1fb fork_exit(c09d30b0,c71bab80,c6f7dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f7dd60, ebp = 0 --- Tracing command intr pid 12 tid 100021 td 0xc72048a0 sched_switch(c72048a0,0,109,191,f601cfd6,...) at sched_switch+0x3bc mi_switch(109,0,c0ee9013,554,c72048a0,...) at mi_switch+0x1eb ithread_loop(c71babc0,c6f6ed28,c0ee8cf0,390,c71bc578,...) at ithread_loop+0x1fb fork_exit(c09d30b0,c71babc0,c6f6ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f6ed60, ebp = 0 --- Tracing command intr pid 12 tid 100019 td 0xc72cd000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100012 td 0xc71bf5c0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100011 td 0xc71bf8a0 sched_switch(c71bf8a0,0,109,191,b1468f75,...) at sched_switch+0x3bc mi_switch(109,0,c0ee9013,554,c71bf8a0,...) at mi_switch+0x1eb ithread_loop(c71babf0,c6f50d28,c0ee8cf0,390,c71bc578,...) at ithread_loop+0x1fb fork_exit(c09d30b0,c71babf0,c6f50d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f50d60, ebp = 0 --- Tracing command intr pid 12 tid 100010 td 0xc71bfb80 sched_switch(c71bfb80,0,109,191,9d7e6184,...) at sched_switch+0x3bc mi_switch(109,0,c0ee9013,554,c71bfb80,...) at mi_switch+0x1eb ithread_loop(c71bac00,c6f4dd28,c0ee8cf0,390,c71bc578,...) at ithread_loop+0x1fb fork_exit(c09d30b0,c71bac00,c6f4dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f4dd60, ebp = 0 --- Tracing command intr pid 12 tid 100009 td 0xc7204000 sched_switch(c7204000,0,109,191,dc30f67d,...) at sched_switch+0x3bc mi_switch(109,0,c0ee9013,554,c7204000,...) at mi_switch+0x1eb ithread_loop(c71bac10,c6f4ad28,c0ee8cf0,390,c71bc578,...) at ithread_loop+0x1fb fork_exit(c09d30b0,c71bac10,c6f4ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f4ad60, ebp = 0 --- Tracing command intr pid 12 tid 100008 td 0xc72042e0 sched_switch(c72042e0,0,109,191,ed777c38,...) at sched_switch+0x3bc mi_switch(109,0,c0ee9013,554,c72042e0,...) at mi_switch+0x1eb ithread_loop(c71bac20,c6f47d28,c0ee8cf0,390,c71bc578,...) at ithread_loop+0x1fb fork_exit(c09d30b0,c71bac20,c6f47d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f47d60, ebp = 0 --- Tracing command intr pid 12 tid 100007 td 0xc72045c0 sched_switch(c72045c0,0,109,191,fb68028,...) at sched_switch+0x3bc mi_switch(109,0,c0ee9013,554,c72045c0,...) at mi_switch+0x1eb ithread_loop(c71bac30,c6f44d28,c0ee8cf0,390,c71bc578,...) at ithread_loop+0x1fb fork_exit(c09d30b0,c71bac30,c6f44d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f44d60, ebp = 0 --- Tracing command idle pid 11 tid 100006 td 0xc71be000 cpustop_handler(8,c6f40c04,c0d29e06,f4,0,...) at cpustop_handler+0x49 ipi_nmi_handler(f4,0,1ce2b98,c0d0ed15,c71bc834,...) at ipi_nmi_handler+0x44 trap(c6f40c10) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0d0ed15, esp = 0xc6f40c50, ebp = 0xc6f40c50 --- acpi_cpu_c1(c6f40c6c,c104cd50,3,300,eea,...) at acpi_cpu_c1+0x5 acpi_cpu_idle(0,c6f40ca0,c0d1cf39,0,ffffffff,...) at acpi_cpu_idle+0x122 cpu_idle_acpi(0,ffffffff,c1095d80,2,c6f40ce8,...) at cpu_idle_acpi+0x2f cpu_idle(0,c6f40cc4,c0ef03ab,3bb,c71be000,...) at cpu_idle+0x89 sched_idletd(0,c6f40d28,c0ee8cf0,390,c71bc834,...) at sched_idletd+0x263 fork_exit(c0a21f70,0,c6f40d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f40d60, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc71be2e0 sched_switch(c71be2e0,0,108,18c,ba2afeab,...) at sched_switch+0x3bc mi_switch(108,0,c0ef03ab,3b9,c71be2e0,...) at mi_switch+0x1eb sched_idletd(0,c6f3dd28,c0ee8cf0,390,c71bc834,...) at sched_idletd+0x19f fork_exit(c0a21f70,0,c6f3dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f3dd60, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc71be5c0 cpustop_handler(2,c6f3ac04,c0d29e06,f4,0,...) at cpustop_handler+0x49 ipi_nmi_handler(f4,0,0,c12291cc,c71bc834,...) at ipi_nmi_handler+0x44 trap(c6f3ac10) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0d0ed15, esp = 0xc6f3ac50, ebp = 0xc6f3ac50 --- acpi_cpu_c1(c6f3ac6c,c104cd50,1,300,eea,...) at acpi_cpu_c1+0x5 acpi_cpu_idle(0,c6f3aca0,c0d1cf39,0,ffffffff,...) at acpi_cpu_idle+0x122 cpu_idle_acpi(0,ffffffff,c1095080,2,c6f3ace8,...) at cpu_idle_acpi+0x2f cpu_idle(0,c6f3acc4,c0ef03ab,a05,c71be5c0,...) at cpu_idle+0x89 sched_idletd(0,c6f3ad28,c0ee8cf0,390,c71bc834,...) at sched_idletd+0x263 fork_exit(c0a21f70,0,c6f3ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f3ad60, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xc71be8a0 kdb_enter(c0d6755e,c0eb8210,0,c756f080,0,...) at kdb_enter+0x3a uart_intr(c756f000,0,c1228ea0,c6f37be8,0,...) at uart_intr+0x126 intr_event_handle(c7188800,c6f37c10,c6f37c34,0,c73ea200,...) at intr_event_handle+0x76 intr_execute_handlers(c72020d0,c6f37c10,0,c6f37c50,c0d13715,...) at intr_execute_handlers+0x49 lapic_handle_intr(3c,c6f37c10) at lapic_handle_intr+0x36 Xapic_isr1() at Xapic_isr1+0x35 --- interrupt, eip = 0xc0d0ed15, esp = 0xc6f37c50, ebp = 0xc6f37c50 --- acpi_cpu_c1(c6f37c6c,c104cd50,0,300,eea,...) at acpi_cpu_c1+0x5 acpi_cpu_idle(0,c6f37ca0,c0d1cf39,0,ffffffff,...) at acpi_cpu_idle+0x122 cpu_idle_acpi(0,ffffffff,c1094a00,2,c6f37ce8,...) at cpu_idle_acpi+0x2f cpu_idle(0,c6f37cc4,c0ef03ab,a05,c71be8a0,...) at cpu_idle+0x89 sched_idletd(0,c6f37d28,c0ee8cf0,390,c71bc834,...) at sched_idletd+0x263 fork_exit(c0a21f70,0,c6f37d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f37d60, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc71beb80 sched_switch(c71beb80,0,104,191,3d097d94,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,6c,...) at mi_switch+0x1eb sleepq_switch(c71beb80,0,c0ef3b80,1a7,6c,...) at sleepq_switch+0x162 sleepq_catch_signals(c0ef3b80,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c71bcaf0,6c,c0ef695e,100,0,...) at sleepq_wait_sig+0x17 _sleep(c71bcaf0,c71bcb78,16c,c0ef695e,0,...) at _sleep+0x35c kern_wait(c71beb80,ffffffff,c6f33c44,0,0,...) at kern_wait+0xbe6 wait4(c71beb80,c6f33cec,c6f33d28,c0ef450a,0,...) at wait4+0x3b syscallenter(c71beb80,c6f33ce4,c6f33ce4,0,0,...) at syscallenter+0x263 syscall(c6f33d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x8060de7, esp = 0xbfbfe8bc, ebp = 0xbfbfe8d8 --- Tracing command audit pid 10 tid 100001 td 0xc71bf000 sched_switch(c71bf000,0,104,191,16f46732,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c71bf000,0,c0ef3b80,268,c71bf000,...) at sleepq_switch+0x162 sleepq_wait(c1203d00,0,c6f30c8c,1,0,...) at sleepq_wait+0x63 _cv_wait(c1203d00,c1203ce4,c0f1e457,194,0,...) at _cv_wait+0x243 audit_worker(0,c6f30d28,c0ee8cf0,390,c71bd000,...) at audit_worker+0x84 fork_exit(c0befd30,0,c6f30d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f30d60, ebp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xc780ab80 sched_switch(c780ab80,0,104,191,f1027ca4,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c780ab80,0,c0ef3b80,268,0,...) at sleepq_switch+0x162 sleepq_wait(c77edc80,0,c0ee1472,0,0,...) at sleepq_wait+0x63 _sleep(c77edc80,c77edc98,0,c0ee1472,0,...) at _sleep+0x372 taskqueue_thread_loop(c125b820,ef5fdd28,c0ee8cf0,390,c1084880,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a3ebe0,c125b820,ef5fdd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xef5fdd60, ebp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xc75785c0 sched_switch(c75785c0,0,104,191,6b547dc7,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c75785c0,0,c0ef3b80,28b,2,...) at sleepq_switch+0x162 sleepq_timedwait(c1086b84,0,c0ee1472,2,0,...) at sleepq_timedwait+0x6b _sleep(c1086b84,0,0,c0ee1472,bb8,...) at _sleep+0x342 pause(c0ee1472,bb8,124,122,c1084908,...) at pause+0x47 deadlkres(0,ed393d28,c0ee8cf0,390,c1084880,...) at deadlkres+0x324 fork_exit(c09b3780,0,ed393d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed393d60, ebp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xc74378a0 sched_switch(c74378a0,0,104,191,ed77f0d3,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c74378a0,0,c0ef3b80,268,0,...) at sleepq_switch+0x162 sleepq_wait(c746e100,0,c0eef101,c0ee1472,0,...) at sleepq_wait+0x63 msleep_spin(c746e100,c746e118,c0ee1472,0,c0eec987,...) at msleep_spin+0x21d taskqueue_thread_loop(c747349c,ed377d28,c0ee8cf0,390,c1084880,...) at taskqueue_thread_loop+0x8f fork_exit(c0a3ebe0,c747349c,ed377d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xed377d60, ebp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xc73b42e0 sched_switch(c73b42e0,0,104,191,31512f6e,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c73b42e0,0,c0ef3b80,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7353480,0,c0eef101,c0ee1472,0,...) at sleepq_wait+0x63 msleep_spin(c7353480,c7353498,c0ee1472,0,c0eec987,...) at msleep_spin+0x21d taskqueue_thread_loop(c104f9b8,c6f7ad28,c0ee8cf0,390,c1084880,...) at taskqueue_thread_loop+0x8f fork_exit(c0a3ebe0,c104f9b8,c6f7ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f7ad60, ebp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xc73b45c0 sched_switch(c73b45c0,0,104,191,31511f41,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c73b45c0,0,c0ef3b80,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7353480,0,c0eef101,c0ee1472,0,...) at sleepq_wait+0x63 msleep_spin(c7353480,c7353498,c0ee1472,0,c0eec987,...) at msleep_spin+0x21d taskqueue_thread_loop(c104f9b8,c6f77d28,c0ee8cf0,390,c1084880,...) at taskqueue_thread_loop+0x8f fork_exit(c0a3ebe0,c104f9b8,c6f77d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f77d60, ebp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xc73b48a0 sched_switch(c73b48a0,0,104,191,31510d3b,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c73b48a0,0,c0ef3b80,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7353480,0,c0eef101,c0ee1472,0,...) at sleepq_wait+0x63 msleep_spin(c7353480,c7353498,c0ee1472,0,c0eec987,...) at msleep_spin+0x21d taskqueue_thread_loop(c104f9b8,c6f74d28,c0ee8cf0,390,c1084880,...) at taskqueue_thread_loop+0x8f fork_exit(c0a3ebe0,c104f9b8,c6f74d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f74d60, ebp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xc73b4b80 sched_switch(c73b4b80,0,104,191,314bf6f8,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c73b4b80,0,c0ef3b80,268,0,...) at sleepq_switch+0x162 sleepq_wait(c73534c0,0,c0ee1472,0,0,...) at sleepq_wait+0x63 _sleep(c73534c0,c73534d8,0,c0ee1472,0,...) at _sleep+0x372 taskqueue_thread_loop(c1085218,c6f71d28,c0ee8cf0,390,c1084880,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a3ebe0,c1085218,c6f71d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f71d60, ebp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xc7204b80 sched_switch(c7204b80,0,104,191,314be617,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c7204b80,0,c0ef3b80,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7353540,0,c0ee1472,0,0,...) at sleepq_wait+0x63 _sleep(c7353540,c7353558,0,c0ee1472,0,...) at _sleep+0x372 taskqueue_thread_loop(c12042e4,c6f6bd28,c0ee8cf0,390,c1084880,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a3ebe0,c12042e4,c6f6bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f6bd60, ebp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xc72cd2e0 sched_switch(c72cd2e0,0,104,191,29b8b490,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c72cd2e0,0,c0ef3b80,268,0,...) at sleepq_switch+0x162 sleepq_wait(c73535c0,0,c0ee1472,0,0,...) at sleepq_wait+0x63 _sleep(c73535c0,c73535d8,0,c0ee1472,0,...) at _sleep+0x372 taskqueue_thread_loop(c10a3788,c6f65d28,c0ee8cf0,390,c1084880,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a3ebe0,c10a3788,c6f65d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f65d60, ebp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xc72cd8a0 sched_switch(c72cd8a0,0,104,191,5088c147,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,0,...) at mi_switch+0x1eb sleepq_switch(c72cd8a0,0,c0ef3b80,268,0,...) at sleepq_switch+0x162 sleepq_wait(c7176b40,0,c0ee1472,0,0,...) at sleepq_wait+0x63 _sleep(c7176b40,c7176b58,0,c0ee1472,0,...) at _sleep+0x372 taskqueue_thread_loop(c10a21a0,c6f5fd28,c0ee8cf0,390,c1084880,...) at taskqueue_thread_loop+0xb5 fork_exit(c0a3ebe0,c10a21a0,c6f5fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f5fd60, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc1084b40 sched_switch(c1084b40,0,104,191,f6614bb5,...) at sched_switch+0x3bc mi_switch(104,0,c0ef3b80,1f3,54,...) at mi_switch+0x1eb sleepq_switch(c1084b40,0,c0ef3b80,28b,0,...) at sleepq_switch+0x162 sleepq_timedwait(c1084880,54,c0ef0cbd,0,0,...) at sleepq_timedwait+0x6b _sleep(c1084880,0,54,c0ef0cbd,2710,...) at _sleep+0x342 scheduler(0,181ec00,181ec00,181e000,1825000,...) at scheduler+0x240 mi_startup() at mi_startup+0xac begin() at begin+0x2c db:0:allt> call doadump Physical memory: 3435 MB Physical memory: 3435 MB Dumping 275 MB:Dumping 275 MB: 260 260 244 244 228 228 212 212 196 196 180 180 164 164 148 148 132 132 116 116 100 100 84 84 68 68 52 52 36 36 20 20 4 4 Dump complete Dump complete = 0 db:0:doadump> reset (kgdb) bt #0 sched_switch (td=0xc794c8a0, newtd=0xc71be5c0, flags=0x104) at ../../../kern/sched_ule.c:1854 #1 0xc0a04beb in mi_switch (flags=0x104, newtd=0x0) at ../../../kern/kern_synch.c:448 #2 0xc0a3ba22 in sleepq_switch (wchan=0xc7bd351c, pri=0x60) at ../../../kern/subr_sleepqueue.c:538 #3 0xc0a3c753 in sleepq_wait (wchan=0xc7bd351c, pri=0x60) at ../../../kern/subr_sleepqueue.c:617 #4 0xc09e42cf in __lockmgr_args (lk=0xc7bd351c, flags=0x80900, ilk=0xc83cc0c4, wmesg=0x0, pri=0x0, timo=0x0, file=0xc0f20c06 "../../../ufs/ffs/ffs_snapshot.c", line=0x6d5) at ../../../kern/kern_lock.c:217 #5 0xc0c1164a in ffs_snapblkfree (fs=0xc8341000, devvp=0xc83cc000, bno=0x1139f, size=0x1000, inum=0x404c, wkhd=0xef72c768) at lockmgr.h:97 #6 0xc0c057b5 in ffs_blkfree (ump=0xc7be8100, fs=0xc8341000, devvp=0xc83cc000, bno=0x1139f, size=0x1000, inum=0x404c, dephd=0xef72c768) at ../../../ufs/ffs/ffs_alloc.c:2036 #7 0xc0c1c219 in handle_workitem_freefrag (freefrag=0xc87f4000) at ../../../ufs/ffs/ffs_softdep.c:5218 #8 0xc0c1da8d in process_worklist_item (mp=0xc834eb50, target=0x1, flags=0x200) at ../../../ufs/ffs/ffs_softdep.c:1731 #9 0xc0c2d6f9 in softdep_request_cleanup (fs=0xc8341000, vp=0xc9e976cc, cred=0xca889280, resource=0x4) at ../../../ufs/ffs/ffs_softdep.c:12465 #10 0xc0c0819b in ffs_alloc (ip=0xc924eae0, lbn=0x0, bpref=0x30008, size=0x1000, flags=0x2010000, cred=0xca889280, bnp=0xef72ca1c) at ../../../ufs/ffs/ffs_alloc.c:222 #11 0xc0c0c13c in ffs_balloc_ufs2 (vp=0xc9e976cc, startoffset=Variable "startoffset" is not available. ) at ../../../ufs/ffs/ffs_balloc.c:735 #12 0xc0c3600d in ffs_write (ap=0xef72cb94) at ../../../ufs/ffs/ffs_vnops.c:716 #13 0xc0d4d236 in VOP_WRITE_APV (vop=0xc1030660, a=0xef72cb94) at vnode_if.c:951 #14 0xc0aa570a in vn_write (fp=0xc78bdce8, uio=0xef72cc28, active_cred=0xca889280, flags=0x0, td=0xc794c8a0) at vnode_if.h:413 #15 0xc0a48f75 in dofilewrite (td=0xc794c8a0, fd=0x3, fp=0xc78bdce8, auio=0xef72cc28, offset=0xffffffffffffffff, flags=0x0) at file.h:239 #16 0xc0a4a718 in kern_writev (td=0xc794c8a0, fd=0x3, auio=0xef72cc28) at ../../../kern/sys_generic.c:447 #17 0xc0a4a82f in write (td=0xc794c8a0, uap=0xef72ccec) at ../../../kern/sys_generic.c:363 #18 0xc0a3efa3 in syscallenter (td=0xc794c8a0, sa=0xef72cce4) at ../../../kern/subr_trap.c:344 #19 0xc0d29cef in syscall (frame=0xef72cd28) at ../../../i386/i386/trap.c:1082 #20 0xc0d133b1 in Xint0x80_syscall () at ../../../i386/i386/exception.s:266 #21 0x00000033 in ?? () (kgdb) f 4 #4 0xc09e42cf in __lockmgr_args (lk=0xc7bd351c, flags=0x80900, ilk=0xc83cc0c4, wmesg=0x0, pri=0x0, timo=0x0, file=0xc0f20c06 "../../../ufs/ffs/ffs_snapshot.c", line=0x6d5) at ../../../kern/kern_lock.c:217 217 sleepq_wait(&lk->lock_object, pri); (kgdb) p *lk $1 = {lock_object = {lo_name = 0xc0f20c85 "snaplk", lo_flags = 0x57b0008, lo_data = 0x0, lo_witness = 0xc71628e8}, lk_lock = 0xc74488a4, lk_exslpfail = 0x3, lk_timo = 0x33, lk_pri = 0x60, lk_stack = {depth = 0x9, pcs = {0xc09e43ae, 0xc0c1164a, 0xc0c057b5, 0xc0c1c219, 0xc0c1da8d, 0xc0c2e498, 0xc0c2ea60, 0xc09cf528, 0xc0d133c4, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}}} (kgdb) f 5 #5 0xc0c1164a in ffs_snapblkfree (fs=0xc8341000, devvp=0xc83cc000, bno=0x1139f, size=0x1000, inum=0x404c, wkhd=0xef72c768) at lockmgr.h:97 97 return (__lockmgr_args(lk, flags, (ilk != NULL) ? &ilk->lock_object : (kgdb) f 6 #6 0xc0c057b5 in ffs_blkfree (ump=0xc7be8100, fs=0xc8341000, devvp=0xc83cc000, bno=0x1139f, size=0x1000, inum=0x404c, dephd=0xef72c768) at ../../../ufs/ffs/ffs_alloc.c:2036 2036 if (devvp->v_type != VREG && (kgdb) l 2031 * Check to see if a snapshot wants to claim the block. 2032 * Check that devvp is a normal disk device, not a snapshot, 2033 * it has a snapshot(s) associated with it, and one of the 2034 * snapshots wants to claim the block. 2035 */ 2036 if (devvp->v_type != VREG && 2037 (devvp->v_vflag & VV_COPYONWRITE) && 2038 ffs_snapblkfree(fs, devvp, bno, size, inum, dephd)) { 2039 return; 2040 } (kgdb) p *fs $2 = {fs_firstfield = 0x0, fs_unused_1 = 0x0, fs_sblkno = 0x18, fs_cblkno = 0x20, fs_iblkno = 0x28, fs_dblkno = 0x428, fs_old_cgoffset = 0x0, fs_old_cgmask = 0x0, fs_old_time = 0x0, fs_old_size = 0x0, fs_old_dsize = 0x0, fs_ncg = 0x4, fs_bsize = 0x8000, fs_fsize = 0x1000, fs_frag = 0x8, fs_minfree = 0x8, fs_old_rotdelay = 0x0, fs_old_rps = 0x0, fs_bmask = 0xffff8000, fs_fmask = 0xfffff000, fs_bshift = 0xf, fs_fshift = 0xc, fs_maxcontig = 0x4, fs_maxbpg = 0x1000, fs_fragshift = 0x3, fs_fsbtodb = 0x3, fs_sbsize = 0x1000, fs_spare1 = {0x0, 0x0}, fs_nindir = 0x1000, fs_inopb = 0x80, fs_old_nspf = 0x0, fs_optim = 0x1, fs_old_npsect = 0x0, fs_old_interleave = 0x0, fs_old_trackskew = 0x0, fs_id = {0x4df6f8b1, 0x5f41c69d}, fs_old_csaddr = 0x0, fs_cssize = 0x1000, fs_cgsize = 0x3000, fs_spare2 = 0x0, fs_old_nsect = 0x0, fs_old_spc = 0x0, fs_old_ncyl = 0x0, fs_old_cpg = 0x0, fs_ipg = 0x4000, fs_fpg = 0x10000, fs_old_cstotal = {cs_ndir = 0x0, cs_nbfree = 0x0, cs_nifree = 0x0, cs_nffree = 0x0}, fs_fmod = 0x1, fs_clean = 0x0, fs_ronly = 0x0, fs_old_flags = 0x80, fs_fsmnt = "/mnt", '\0' , fs_volname = '\0' , fs_swuid = 0x0, fs_pad = 0x0, fs_cgrotor = 0x2, fs_ocsp = {0x0 }, fs_contigdirs = 0xc83e7010 "", fs_csp = 0xc83e6000, fs_maxcluster = 0xc83e7000, fs_active = 0x0, fs_old_cpc = 0x0, fs_maxbsize = 0x8000, fs_unrefs = 0x0, fs_sparecon64 = {0x0 }, fs_sblockloc = 0x10000, fs_cstotal = {cs_ndir = 0x5b, cs_nbfree = 0x0, cs_nifree = 0xced6, cs_nffree = 0x4323, cs_numclusters = 0x0, cs_spare = {0x0, 0x0, 0x0}}, fs_time = 0x4df6f8c4, fs_size = 0x3fffe, fs_dsize = 0x3efa5, fs_csaddr = 0x428, fs_pendingblocks = 0x6da8, fs_pendinginodes = 0x0, fs_snapinum = {0x206e, 0x7, 0x0 }, fs_avgfilesize = 0x4000, fs_avgfpdir = 0x40, fs_save_cgsize = 0x0, fs_mtime = 0x4df6f8b1, fs_sujfree = 0x0, fs_sparecon32 = { 0x0 }, fs_flags = 0xa, fs_contigsumsize = 0x4, fs_maxsymlinklen = 0x78, fs_old_inodefmt = 0x0, fs_maxfilesize = 0x800800805ffff, fs_qbmask = 0x7fff, fs_qfmask = 0xfff, fs_state = 0x0, fs_old_postblformat = 0x0, fs_old_nrpos = 0x0, fs_spare5 = {0x0, 0x0}, fs_magic = 0x19540119} (kgdb) p *devvp $3 = {v_type = VCHR, v_tag = 0xc0edcee7 "devfs", v_op = 0xc1006160, v_data = 0xc7d54600, v_mount = 0xc7860000, v_nmntvnodes = {tqe_next = 0xc91fb984, tqe_prev = 0xc83892cc}, v_un = {vu_mount = 0xc80df700, vu_socket = 0xc80df700, vu_cdev = 0xc80df700, vu_fifoinfo = 0xc80df700}, v_hashlist = {le_next = 0x0, le_prev = 0x0}, v_hash = 0x0, v_cache_src = {lh_first = 0x0}, v_cache_dst = {tqh_first = 0x0, tqh_last = 0xc83cc030}, v_cache_dd = 0x0, v_cstart = 0x0, v_lasta = 0x0, v_lastw = 0x0, v_clen = 0x0, v_lock = {lock_object = {lo_name = 0xc0edcee7 "devfs", lo_flags = 0x5730000, lo_data = 0x0, lo_witness = 0xc7162268}, lk_lock = 0x1, lk_exslpfail = 0x0, lk_timo = 0x33, lk_pri = 0x60, lk_stack = {depth = 0xf, pcs = {0xc09e3d55, 0xc0a84395, 0xc0d4c705, 0xc0aa4328, 0xc0913e4f, 0xc0914169, 0xc0d4b475, 0xc0aa3859, 0xc0a9b8fd, 0xc0a9ba1c, 0xc0a9ba56, 0xc0a9baff, 0xc0a3efa3, 0xc0d29cef, 0xc0d133b1, 0x0, 0x0, 0x0}}}, v_interlock = {lock_object = {lo_name = 0xc0ef5eb9 "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc715b1e0}, mtx_lock = 0x4}, v_vnlock = 0xc83cc058, v_holdcnt = 0x34, v_usecount = 0x1, v_iflag = 0x0, v_vflag = 0x40, v_writecount = 0x0, v_freelist = {tqe_next = 0x0, tqe_prev = 0xc78e3918}, v_bufobj = {bo_mtx = {lock_object = {lo_name = 0xc0efe819 "bufobj interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc7160938}, mtx_lock = 0x4}, bo_clean = {bv_hd = {tqh_first = 0xe0c15b20, tqh_last = 0xe0b9d5b8}, bv_root = 0xe0c8edc0, bv_cnt = 0xf}, bo_dirty = {bv_hd = {tqh_first = 0xe0c311e0, tqh_last = 0xe0c8fe38}, bv_root = 0xe0b62d80, bv_cnt = 0x23}, bo_numoutput = 0x1, bo_flag = 0x1, bo_ops = 0xc10302f0, bo_bsize = 0x200, bo_object = 0xc83be198, bo_synclist = {le_next = 0x0, le_prev = 0xc72d0970}, bo_private = 0xc780c5c0, __bo_vnode = 0xc83cc000}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0} (kgdb) (kgdb) proc 18 [Switching to thread 78 (Thread 100076)]#0 cpustop_handler () at ../../../i386/i386/mp_machdep.c:1516 1516 CPU_OR_ATOMIC(&stopped_cpus, &cpumask); (kgdb) bt #0 cpustop_handler () at ../../../i386/i386/mp_machdep.c:1516 #1 0xc0d1fd74 in ipi_nmi_handler () at ../../../i386/i386/mp_machdep.c:1494 #2 0xc0d29e06 in trap (frame=0xed40e8e8) at ../../../i386/i386/trap.c:219 #3 0xc0d1334c in calltrap () at ../../../i386/i386/exception.s:168 #4 0xc0c2cdf2 in process_truncates (vp=0xc86826cc) at ../../../ufs/ffs/ffs_softdep.c:1617 #5 0xc0c2d6dc in softdep_request_cleanup (fs=0xc8341000, vp=0xc86826cc, cred=0xc71a0000, resource=0x4) at ../../../ufs/ffs/ffs_softdep.c:12464 #6 0xc0c0cbf0 in ffs_balloc_ufs2 (vp=0xc86826cc, startoffset=Variable "startoffset" is not available. ) at ../../../ufs/ffs/ffs_balloc.c:896 #7 0xc0c11ade in ffs_snapblkfree (fs=0xc8341000, devvp=0xc83cc000, bno=0x12305, size=0x3000, inum=0x404a, wkhd=0xed40ec38) at ../../../ufs/ffs/ffs_snapshot.c:1860 #8 0xc0c057b5 in ffs_blkfree (ump=0xc7be8100, fs=0xc8341000, devvp=0xc83cc000, bno=0x12305, size=0x3000, inum=0x404a, dephd=0xed40ec38) at ../../../ufs/ffs/ffs_alloc.c:2036 #9 0xc0c1c219 in handle_workitem_freefrag (freefrag=0xc87f4040) at ../../../ufs/ffs/ffs_softdep.c:5218 #10 0xc0c1da8d in process_worklist_item (mp=0xc834eb50, target=0xa, flags=0x200) at ../../../ufs/ffs/ffs_softdep.c:1731 #11 0xc0c2e498 in softdep_process_worklist (mp=0xc834eb50, full=0x0) at ../../../ufs/ffs/ffs_softdep.c:1509 #12 0xc0c2ea60 in softdep_flush () at ../../../ufs/ffs/ffs_softdep.c:1365 #13 0xc09cf528 in fork_exit (callout=0xc0c2e7c0 , arg=0x0, frame=0xed40ed28) at ../../../kern/kern_fork.c:920 #14 0xc0d133c4 in fork_trampoline () at ../../../i386/i386/exception.s:275 (kgdb) f 4 #4 0xc0c2cdf2 in process_truncates (vp=0xc86826cc) at ../../../ufs/ffs/ffs_softdep.c:1617 1617 inum = VTOI(vp)->i_number; (kgdb) l 1612 int cgwait; 1613 1614 mtx_assert(&lk, MA_OWNED); 1615 1616 mp = vp->v_mount; 1617 inum = VTOI(vp)->i_number; 1618 for (;;) { 1619 if (inodedep_lookup(mp, inum, 0, &inodedep) == 0) 1620 return; 1621 cgwait = 0; (kgdb) p *vp $4 = {v_type = VREG, v_tag = 0xc0ee5070 "ufs", v_op = 0xc1030660, v_data = 0xc8630910, v_mount = 0xc834eb50, v_nmntvnodes = {tqe_next = 0xca6aac3c, tqe_prev = 0xca8816e0}, v_un = {vu_mount = 0x0, vu_socket = 0x0, vu_cdev = 0x0, vu_fifoinfo = 0x0}, v_hashlist = {le_next = 0x0, le_prev = 0xc759c354}, v_hash = 0x7, v_cache_src = { lh_first = 0x0}, v_cache_dst = {tqh_first = 0xc94b08b8, tqh_last = 0xc94b08c8}, v_cache_dd = 0x0, v_cstart = 0x0, v_lasta = 0x0, v_lastw = 0x0, v_clen = 0x0, v_lock = { lock_object = {lo_name = 0xc0ee5070 "ufs", lo_flags = 0x57b0000, lo_data = 0x0, lo_witness = 0xc71623a0}, lk_lock = 0x1, lk_exslpfail = 0x0, lk_timo = 0x33, lk_pri = 0x60, lk_stack = {depth = 0xb, pcs = {0xc09e43ae, 0xc0c36a41, 0xc0d4c705, 0xc0aa4328, 0xc0c169b9, 0xc0c33e10, 0xc0a8db27, 0xc0a8e194, 0xc0a3efa3, 0xc0d29cef, 0xc0d133b1, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}}}, v_interlock = {lock_object = {lo_name = 0xc0ef5eb9 "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc715b1e0}, mtx_lock = 0x4}, v_vnlock = 0xc7bd351c, v_holdcnt = 0x414, v_usecount = 0x1, v_iflag = 0x0, v_vflag = 0x80, v_writecount = 0x0, v_freelist = { tqe_next = 0x0, tqe_prev = 0x0}, v_bufobj = {bo_mtx = {lock_object = {lo_name = 0xc0efe819 "bufobj interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc7160938}, mtx_lock = 0x4}, bo_clean = {bv_hd = {tqh_first = 0xe0c8cee0, tqh_last = 0xe0b6d6b8}, bv_root = 0xe0c012e0, bv_cnt = 0x40b}, bo_dirty = { bv_hd = {tqh_first = 0xe0bb4e80, tqh_last = 0xe0b0ab38}, bv_root = 0xe0b5c0a0, bv_cnt = 0x7}, bo_numoutput = 0x0, bo_flag = 0x1, bo_ops = 0xc101d7e0, bo_bsize = 0x8000, bo_object = 0xca846440, bo_synclist = {le_next = 0x0, le_prev = 0xca88180c}, bo_private = 0xc86826cc, __bo_vnode = 0xc86826cc}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0} (kgdb) f 5 #5 0xc0c2d6dc in softdep_request_cleanup (fs=0xc8341000, vp=0xc86826cc, cred=0xc71a0000, resource=0x4) at ../../../ufs/ffs/ffs_softdep.c:12464 12464 process_truncates(vp); (kgdb) l 12459 (resource == FLUSH_INODES_WAIT && fs->fs_pendinginodes > 0 && 12460 fs->fs_cstotal.cs_nifree <= needed)) { 12461 UFS_UNLOCK(ump); 12462 ACQUIRE_LOCK(&lk); 12463 process_removes(vp); 12464 process_truncates(vp); 12465 if (ump->softdep_on_worklist > 0 && 12466 process_worklist_item(UFSTOVFS(ump), 1, LK_NOWAIT) != 0) { 12467 stat_worklist_push += 1; 12468 FREE_LOCK(&lk); (kgdb) info loc ump = (struct ufsmount *) 0xc7be8100 mp = (struct mount *) 0xc834eb50 lvp = (struct vnode *) 0xc86826cc mvp = (struct vnode *) 0x0 starttime = 0x4df6f8c6 needed = 0x10 error = Variable "error" is not available. (kgdb) p fs->fs_cstotal.cs_nifree $5 = 0xced6 (kgdb) $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/ufs/ffs/ffs_softdep.c =================================================================== --- /usr/src/sys/ufs/ffs/ffs_softdep.c (revision 223036) +++ /usr/src/sys/ufs/ffs/ffs_softdep.c (working copy) @@ -10417,6 +10417,10 @@ softdep_disk_write_complete(bp) WORKLIST_INSERT(&reattach, wk); continue; + case D_FREEDEP: + free_freedep(WK_FREEDEP(wk)); + continue; + default: panic("handle_disk_write_complete: Unknown type %s", TYPENAME(wk->wk_type)); -- Test scenario: $ ./suj21.sh (Non root test program) Local config: x4 newfs: soft updates journaling set load: 2.00 cmd: suj21 2653 [snaplk] 1809.74r 0.02u 1.09s 0% 672k load: 1.03 cmd: suj21 2653 [snaplk] 3100.07r 0.02u 1.09s 0% 672k load: 1.00 cmd: suj21 2653 [snaplk] 3403.34r 0.02u 1.09s 0% 672k load: 1.00 cmd: suj21 2653 [snaplk] 3583.58r 0.02u 1.09s 0% 672k $ df -hi /mnt Filesystem Size Used Avail Capacity iused ifree %iused Mounted on /dev/md5a 1G 926M 240k 100% 12k 53k 19% /mnt $