GENERIC HEAD from , 1a3996aabaa(ino64)-dirty, vmcore.993 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2017 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 12.0-CURRENT #0 1a3996aabaa(ino64)-dirty: Sun Feb 19 17:22:31 CET 2017 pho@x4.osted.lan:/tmp/freebsd/sys/i386/compile/PHO i386 FreeBSD clang version 3.9.1 (tags/RELEASE_391/final 289601) (based on LLVM 3.9.1) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin="AuthenticAMD" Id=0x100f23 Family=0x10 Model=0x2 Stepping=3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff SVM: NP,NAsids=64 TSC: P-state invariant real memory = 8589934592 (8192 MB) avail memory = 3525517312 (3362 MB) : Trying to mount root from ufs:/dev/ada0s1a [rw]... Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. warning: total configured swap (4194304 pages) exceeds maximum recommended amount (2097312 pages). warning: increase kern.maxswzone or reduce amount of swap. Starting file system checks: /dev/ada0s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1a: clean, 627123 free (2787 frags, 78042 blocks, 0.3% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 55004291 free (24379 frags, 6872489 blocks, 0.0% fragmentation) /dev/ada0s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1f: clean, 835645 free (10669 frags, 103122 blocks, 1.1% fragmentation) /dev/ada0s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1d: clean, 1653121 free (274049 frags, 172384 blocks, 2.7% fragmentation) /dev/ada0s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1e: clean, 3893684 free (292988 frags, 450087 blocks, 1.2% fragmentation) Mounting local file systems:. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/arduino/lib /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/gcc49 /usr/local/lib/mysql /usr/local/lib/nss /usr/local/lib/perl5/5.24/mach/CORE /usr/local/lib/pth /usr/local/lib/qt4 /usr/local/llvm37/lib /usr/local/llvm39/lib a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Setting hostname: x4.osted.lan. Setting up harvesting:[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,NET_ETHER,NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy:uhub5: 10 ports with 10 removable, self powered . re0: link state changed to DOWN Starting Network: lo0 re0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 groups: lo re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 scopeid 0x1 nd6 options=23 media: Ethernet autoselect (none) status: no carrier Starting devd. re0: link state changed to UP add net default: gateway 192.168.1.1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Starting rtsold. Creating and/or trimming log files. Starting syslogd. Starting rpcbind. NFS access cache time=60 Starting watchdogd. Starting ddb. No core dumps found. Additional ABI support: linux. lock order reversal: 1st 0xe4908880 bufwait (bufwait) @ kern/vfs_bio.c:3500 2nd 0xc9cc7800 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:281 stack backtrace: #0 0xc0c91f61 at witness_debugger+0x81 #1 0xc0c91e82 at witness_checkorder+0xd12 #2 0xc0c37fcd at _sx_xlock+0x6d #3 0xc0f28f03 at ufsdirhash_add+0x53 #4 0xc0f2d8a1 at ufs_direnter+0x4a1 #5 0xc0f36a6a at ufs_mkdir+0x83a #6 0xc11ff199 at VOP_MKDIR_APV+0xf9 #7 0xc0d0909d at kern_mkdirat+0x21d #8 0xc0d08e71 at sys_mkdir+0x31 #9 0xc11cc9b5 at syscall+0x3b5 #10 0xc11b75fe at Xint0x80_syscall+0x2e Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Starting statd. Starting lockd. Recovering vi editor sessions:lock order reversal: 1st 0xca2cc034 ufs (ufs) @ kern/vfs_lookup.c:669 2nd 0xe4924a80 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:280 3rd 0xca2e473c ufs (ufs) @ kern/vfs_subr.c:2600 stack backtrace: #0 0xc0c91f61 at witness_debugger+0x81 #1 0xc0c91e82 at witness_checkorder+0xd12 #2 0xc0c05641 at __lockmgr_args+0x721 #3 0xc0f23387 at ffs_lock+0x97 #4 0xc11fff30 at VOP_LOCK1_APV+0xe0 #5 0xc0d0c4e7 at _vn_lock+0xb7 #6 0xc0cf901d at vget+0x8d #7 0xc0cea7e1 at vfs_hash_get+0xd1 #8 0xc0f1e644 at ffs_vgetf+0x44 #9 0xc0f14756 at softdep_sync_buf+0xbb6 #10 0xc0f240cf at ffs_syncvnode+0x2ef #11 0xc0ef7d65 at ffs_truncate+0x985 #12 0xc0f2da68 at ufs_direnter+0x668 #13 0xc0f37876 at ufs_makeinode+0x546 #14 0xc0f33378 at ufs_create+0x38 #15 0xc11fcb09 at VOP_CREATE_APV+0xf9 #16 0xc0d0bcf2 at vn_open_cred+0x272 #17 0xc0d0ba6d at vn_open+0x3d . Updating motd:. Mounting late file systems:. Starting ntpd. Starting powerd. Starting smartd. Feb 19 21:19:21 x4 smartd[668]: Device: /dev/ada0, WARNING: A firmware update for this drive may be available, Feb 19 21:19:21 x4 smartd[668]: see the following Seagate web pages: Feb 19 21:19:21 x4 smartd[668]: http://knowledge.seagate.com/articles/en_US/FAQ/207931en Feb 19 21:19:21 x4 smartd[668]: http://knowledge.seagate.com/articles/en_US/FAQ/213891en Configuring vt: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting sendmail_submit. Starting sendmail_msp_queue. Starting cron. Local package initialization: backuplock order reversal: 1st 0xc97d5b74 ufs (ufs) @ kern/vfs_mount.c:1277 2nd 0xc9662cdc devfs (devfs) @ ufs/ffs/ffs_softdep.c:1908 stack backtrace: #0 0xc0c91f61 at witness_debugger+0x81 #1 0xc0c91e82 at witness_checkorder+0xd12 #2 0xc0c04e56 at lockmgr_lock_fast_path+0x1d6 #3 0xc0ce685b at vop_stdlock+0x3b #4 0xc11fff30 at VOP_LOCK1_APV+0xe0 #5 0xc0d0c4e7 at _vn_lock+0xb7 #6 0xc0f01628 at softdep_flushworklist+0x68 #7 0xc0f218f2 at ffs_sync+0x2b2 #8 0xc0d0dcb5 at vfs_write_suspend+0x1c5 #9 0xc0d0dee5 at vfs_write_suspend_umnt+0x45 #10 0xc0f21063 at ffs_unmount+0xa3 #11 0xc0cf0db2 at dounmount+0x712 #12 0xc0cf0595 at sys_unmount+0x315 #13 0xc11cc9b5 at syscall+0x3b5 #14 0xc11b75fe at Xint0x80_syscall+0x2e ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes No such /tmp/freebsd/sys/i386/compile/PHO ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 762034 files, 63309690 used, 55004291 free (24379 frags, 6872489 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmp. Starting default moused. Starting inetd. Sun Feb 19 21:21 FreeBSD/i386 (x4.osted.lan) (ttyu0) login: Feb 19 21:22:18 x4 su: pho to root on /dev/pts/0 20170219 21:25:08 all (1/475): ptrace3.sh 20170219 21:25:19 all (2/475): uma_zalloc_arg.sh 20170219 21:25:22 all (3/475): readdir.sh 20170219 21:40:22 all (4/475): mount.sh 20170219 21:40:25 all (5/475): jumbo.sh Expensive timeout(9) function: 0xc0a5d750(0xc90e4aa0) 0.122597979 s [zone: mbuf_jumbo_page] kern.ipc.nmbjumbop limit reached umtx leak: 264/864. 20170219 21:42:53 all (6/475): holdcnt02.sh 20170219 21:42:55 all (7/475): mkfifo2d.sh umtx leak: 24/888. 20170219 21:50:11 all (8/475): revoke.sh 20170219 21:50:14 all (9/475): mount2.sh lock order reversal: 1st 0xcb15d028 filedesc structure (filedesc structure) @ kern/kern_descrip.c:839 2nd 0xc9cf15d4 ufs (ufs) @ kern/vfs_subr.c:5021 stack backtrace: #0 0xc0c91f61 at witness_debugger+0x81 #1 0xc0c91e82 at witness_checkorder+0xd12 #2 0xc0c05641 at __lockmgr_args+0x721 #3 0xc0f23387 at ffs_lock+0x97 #4 0xc11fff30 at VOP_LOCK1_APV+0xe0 #5 0xc0d0c4e7 at _vn_lock+0xb7 #6 0xc0cfb959 at vfs_knllock+0x29 #7 0xc0be62af at knlist_remove_kq+0x8f #8 0xc0be620f at knlist_remove+0x1f #9 0xc0d009ff at filt_vfsdetach+0x2f #10 0xc0be6f0b at knote_fdclose+0x19b #11 0xc0bd94d3 at closefp+0x63 #12 0xc0bd7a62 at kern_dup+0x622 #13 0xc0bd7431 at sys_dup2+0x31 #14 0xc11cc9b5 at syscall+0x3b5 #15 0xc11b75fe at Xint0x80_syscall+0x2e freework leak: 192/199. 20170219 22:08:14 all (10/475): newfs5.sh 20170219 22:08:24 all (11/475): thr3.sh umtx leak: 480/1368. 20170219 22:11:31 all (12/475): umountf5.sh Feb 19 22:11:36 x4 kernel: pid 88207 (mkdir), uid 0 inumber 883 on /mnt: out of inodes Feb 19 22:11:50 x4 kernel: pid 88241 (creat), uid 0 inumber 771 on /mnt: out of inodes Feb 19 22:11:57 x4 kernel: pid 88240 (creat), uid 0 inumber 770 on /mnt: out of inodes newblk leak: 604/634. 20170219 22:12:09 all (13/475): mlockall5.sh 20170219 22:12:12 all (14/475): tmpfs11.sh 20170219 22:27:38 all (15/475): tmpfs10.sh 20170219 22:28:31 all (16/475): isofs2.sh 20170219 22:28:34 all (17/475): nfs15lockd3.sh 20170219 22:28:52 all (18/475): mmap7.sh lock order reversal: 1st 0xca4dda0c syncer (syncer) @ kern/vfs_subr.c:2150 2nd 0xd2f8d73c ufs (ufs) @ kern/vfs_subr.c:2600 stack backtrace: #0 0xc0c91f61 at witness_debugger+0x81 #1 0xc0c91e82 at witness_checkorder+0xd12 #2 0xc0c05641 at __lockmgr_args+0x721 #3 0xc0f23387 at ffs_lock+0x97 #4 0xc11fff30 at VOP_LOCK1_APV+0xe0 #5 0xc0d0c4e7 at _vn_lock+0xb7 #6 0xc0cf901d at vget+0x8d #7 0xc0cfb4ca at vfs_msync+0xaa #8 0xc0d00672 at sync_fsync+0xe2 #9 0xc11fe9c9 at VOP_FSYNC_APV+0xf9 #10 0xc0cfe555 at sched_sync+0x2a5 #11 0xc0bf0f1e at fork_exit+0x7e #12 0xc11b7610 at fork_trampoline+0x8 20170219 22:30:13 all (19/475): swap2.sh 20170219 22:35:44 all (20/475): nfs7.sh 20170219 22:55:06 all (21/475): rename3.sh 20170219 22:57:50 all (22/475): fullpath.sh 20170219 22:59:00 all (23/475): ffs_blkfree.sh lock order reversal: 1st 0xe4a9d9c0 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:280 2nd 0xd15bd51c snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:2298 stack backtrace: #0 0xc0c91f61 at witness_debugger+0x81 #1 0xc0c91e82 at witness_checkorder+0xd12 #2 0xc0c05641 at __lockmgr_args+0x721 #3 0xc0f003cf at ffs_copyonwrite+0x1df #4 0xc0f22225 at ffs_geom_strategy+0x85 #5 0xc0f370a4 at ufs_strategy+0xb4 #6 0xc120047a at VOP_STRATEGY_APV+0x10a #7 0xc0cd4ecd at bufstrategy+0x4d #8 0xc0cd4c79 at bufwrite+0x1c9 #9 0xc0f24185 at ffs_syncvnode+0x3a5 #10 0xc0f23206 at ffs_fsync+0x26 #11 0xc11fe9c9 at VOP_FSYNC_APV+0xf9 #12 0xc0f34971 at ufs_remove+0xe1 #13 0xc11febc2 at VOP_REMOVE_APV+0x122 #14 0xc0d04fce at kern_unlinkat+0x25e #15 0xc0d04d6a at sys_unlink+0x3a #16 0xc11cc9b5 at syscall+0x3b5 #17 0xc11b75fe at Xint0x80_syscall+0x2e lock order reversal: 1st 0xd15bd51c snaplk (snaplk) @ kern/vfs_vnops.c:447 2nd 0xcc92d5d4 ufs (ufs) @ ufs/ffs/ffs_snapshot.c:1629 stack backtrace: #0 0xc0c91f61 at witness_debugger+0x81 #1 0xc0c91e82 at witness_checkorder+0xd12 #2 0xc0c05641 at __lockmgr_args+0x721 #3 0xc0efe429 at ffs_snapremove+0x119 #4 0xc0ef7910 at ffs_truncate+0x530 #5 0xc0f2bebd at ufs_inactive+0x1ed #6 0xc11ffb99 at VOP_INACTIVE_APV+0xf9 #7 0xc0cf9495 at vinactive+0x115 #8 0xc0cf9b49 at vputx+0x359 #9 0xc0d0c6c9 at vn_close1+0x129 #10 0xc0d0b271 at vn_closefile+0x51 #11 0xc0bd8e31 at _fdrop+0x21 #12 0xc0bdc1de at closef+0x21e #13 0xc0bdbcbe at fdescfree_fds+0x7e #14 0xc0bdb81f at fdescfree+0x4bf #15 0xc0beba9f at exit1+0x5df #16 0xc0beb4b2 at sys_sys_exit+0x22 #17 0xc11cc9b5 at syscall+0x3b5 20170219 22:59:20 all (24/475): quota10.sh lock order reversal: 1st 0xd2f43748 FFS (FFS Lock) @ ufs/ufs/ufs_quota.c:728 2nd 0xd380f000 struct mount mtx (struct mount mtx) @ ufs/ufs/ufs_quota.c:734 stack backtrace: #0 0xc0c91f61 at witness_debugger+0x81 #1 0xc0c91e82 at witness_checkorder+0xd12 #2 0xc0c0ed65 at __mtx_lock_flags+0x95 #3 0xc0f3110c at quotaoff_inchange+0x7c #4 0xc0f3121f at quotaoff+0xbf #5 0xc0f32a7f at ufs_quotactl+0x11f #6 0xc0d00fa1 at sys_quotactl+0x151 #7 0xc11cc9b5 at syscall+0x3b5 #8 0xc11b75fe at Xint0x80_syscall+0x2e freework leak: 1/200. 20170219 23:04:01 all (25/475): contigmalloc.sh 20170219 23:06:21 all (26/475): union.sh 20170219 23:16:47 all (27/475): mkfifo6.sh 20170219 23:16:58 all (28/475): marcus5.sh Feb 20 08:26:21 x4 su: pho to root on /dev/pts/2 Stopping inetd. Waiting for PIDS: 844. Stopping moused. Waiting for PIDS: 814. Shutting down local packages:. Stopping cron. Waiting for PIDS: 718. Stopping sshd. Waiting for PIDS: 707. Stopping smartd. Waiting for PIDS: 670. Stopping powerd. Waiting for PIDS: 640. Stopping ntpd. Waiting for PIDS: 637. Stopping lockd. Waiting for PIDS: 580. Stopping statd. Waiting for PIDS: 576. Stopping nfsd. Waiting for PIDS: 572 575. Stopping mountd. Waiting for PIDS: 566. Stopping nfsuserd. Waiting for PIDS: 555 556 557 559 560. Stopping watchdogd. Waiting for PIDS: 514. Stopping rpcbind. Waiting for PIDS: 430. Stopping rtsold. Waiting for PIDS: 387. Stopping devd. Waiting for PIDS: 345. Writing entropy file:. Writing early boot entropy file:. . Terminated Feb 20 08:29:24 x4 syslogd: exiting on signal 15 Feb 20 08:29:44 init: some processes would not die; ps axl advised Enter full pathname of shell or RETURN for /bin/sh: # ps -l UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 0 46239 1 0 20 0 6600 2828 wait Ss u0 0:00.01 -sh (sh) 0 46240 46239 0 20 0 6540 2368 - R+ u0 0:00.00 ps -l 0 72280 1 0 20 0 5992 1768 mntref D 0- 0:03.20 umount /mnt # mount /dev/ada0s1a on / (ufs, local) devfs on /dev (devfs, local, multilabel) /dev/ada0s1f on /home (ufs, NFS exported, local, soft-updates) /dev/ada0s1d on /usr (ufs, local, soft-updates) /dev/ada0s1e on /var (ufs, local, journaled soft-updates) procfs on /proc (procfs, local) fdescfs on /dev/fd (fdescfs) linprocfs on /compat/linux/proc (linprocfs, local) /dev/label/tmp on /tmp (ufs, NFS exported, local, soft-updates, acls) # # KDB: enter: Break to debugger [ thread pid 11 tid 100005 ] Stopped at kdb_alt_break_internal+0xec: movl $0,kdb_why db> run pho db:0:pho> bt Tracing pid 11 tid 100005 td 0xc8e6a000 kdb_alt_break_internal(0,e4b36adc,c0a3d4f7,2,c9136884,...) at kdb_alt_break_internal+0xec/frame 0xe4b36ab0 kdb_alt_break(2,c9136884,c1584eab,0,40000,...) at kdb_alt_break+0x16/frame 0xe4b36abc uart_intr_rxready(c9136800,c1abcc10,0,c15bc6e1,39a,...) at uart_intr_rxready+0x87/frame 0xe4b36adc uart_intr(c9136800,0,23247c00,c1abcc10,c8e6a000,...) at uart_intr+0x120/frame 0xe4b36b1c intr_event_handle(c8e53a80,e4b36b98,ffffffff,2,0,...) at intr_event_handle+0x7a/frame 0xe4b36b48 intr_execute_handlers(c8ce8908,e4b36b98,2) at intr_execute_handlers+0x42/frame 0xe4b36b68 lapic_handle_intr(30,e4b36b98) at lapic_handle_intr+0x5d/frame 0xe4b36b88 Xapic_isr1() at Xapic_isr1+0x55/frame 0xe4b36b88 --- interrupt, eip = 0xc11e59a5, esp = 0xe4b36bd8, ebp = 0xe4b36bd8 --- acpi_cpu_c1(e4b36c2c,c11d50e9,e4b1ac90,0,c17d3317,...) at acpi_cpu_c1+0x5/frame 0xe4b36bd8 acpi_cpu_idle(5bfe9469,0,5bfe9469,e4b36c48,c11e5d6a,...) at acpi_cpu_idle+0x31e/frame 0xe4b36c18 cpu_idle_acpi(5bfe9469,0,c1abcc00,4,c8e6a000,...) at cpu_idle_acpi+0x3f/frame 0xe4b36c2c cpu_idle(0,e4b36c80,c15c7d3f,a57,0,...) at cpu_idle+0x9a/frame 0xe4b36c48 sched_idletd(0,e4b36ce8,c15bc328,406,0,...) at sched_idletd+0x3d2/frame 0xe4b36cac fork_exit(c0c5ddd0,0,e4b36ce8) at fork_exit+0x7e/frame 0xe4b36cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b36cd4 --- trap 0, eip = 0, esp = 0xe4b36d20, ebp = 0 --- db:0:bt> show allpcpu Current CPU: 2 cpuid = 0 dynamic pcpu = 0x754c00 curthread = 0xc8e6a6c0: pid 11 tid 100003 "idle: cpu0" curpcb = 0xe4b30d40 fpcurthread = none idlethread = 0xc8e6a6c0: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x23244c00 curthread = 0xc8e6a360: pid 11 tid 100004 "idle: cpu1" curpcb = 0xe4b33d40 fpcurthread = none idlethread = 0xc8e6a360: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x23247c00 curthread = 0xc8e6a000: pid 11 tid 100005 "idle: cpu2" curpcb = 0xe4b36d40 fpcurthread = none idlethread = 0xc8e6a000: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x2324ac00 curthread = 0xc8e69a20: pid 11 tid 100006 "idle: cpu3" curpcb = 0xe4b39d40 fpcurthread = none idlethread = 0xc8e69a20: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks db:0:alllocks> show lockedvnods Locked vnodes db:0:lockedvnods> show mount 0xc9707000 /dev/ada0s1a on / (ufs) 0xc964a000 devfs on /dev (devfs) 0xc9aaf000 /dev/ada0s1f on /home (ufs) 0xc9aad000 /dev/ada0s1d on /usr (ufs) 0xc9b98000 /dev/ada0s1e on /var (ufs) 0xc9b97000 procfs on /proc (procfs) 0xc9b96000 fdescfs on /dev/fd (fdescfs) 0xc9c84000 linprocfs on /compat/linux/proc (linprocfs) 0xc9aae000 /dev/label/tmp on /tmp (ufs) More info: show mount db:0:mount> show page vm_cnt.v_free_count: 18329 vm_cnt.v_inactive_count: 183247 vm_cnt.v_active_count: 2796 vm_cnt.v_laundry_count: 608083 vm_cnt.v_wire_count: 50329 vm_cnt.v_free_reserved: 1173 vm_cnt.v_free_min: 5485 vm_cnt.v_free_target: 18421 vm_cnt.v_inactive_target: 27631 db:0:page> ps pid ppid pgrp uid state wmesg wchan cmd 46239 1 46239 0 Ss+ ttyin 0xc8fb4674 sh 72280 1 31260 0 D+ mntref 0xcbfd9000 umount 18417 0 0 0 DL mdwait 0xca2bf000 [md5] 22 0 0 0 DL syncer 0xc1b294dc [syncer] 21 0 0 0 DL vlruwt 0xc93b16a8 [vnlru] 20 0 0 0 DL (threaded) [bufdaemon] 100083 D psleep 0xc1b28204 [bufdaemon] 100103 D sdflush 0xc97a6684 [/home worker] 100105 D sdflush 0xc97a6284 [/usr worker] 100106 D sdflush 0xc97a6084 [/var worker] 100180 D sdflush 0xc978dc84 [/tmp worker] 19 0 0 0 DL - 0xc1b28e4c [bufspacedaemon] 18 0 0 0 DL psleep 0xc1b2f02c [vmdaemon] 17 0 0 0 DL (threaded) [pagedaemon] 100080 D psleep 0xc1b8f985 [pagedaemon] 100086 D launds 0xc1b2eff4 [laundry: dom0] 100087 D umarcl 0xc1b2ec20 [uma] 16 0 0 0 DL - 0xc1b27bdc [soaiod4] 15 0 0 0 DL - 0xc1b27bdc [soaiod3] 9 0 0 0 DL - 0xc1b27bdc [soaiod2] 8 0 0 0 DL - 0xc1b27bdc [soaiod1] 7 0 0 0 DL - 0xc1986f08 [rand_harvestq] 6 0 0 0 DL waiting 0xc1b8b1ec [sctp_iterator] 5 0 0 0 DL - 0xc907b03c [fdc0] 14 0 0 0 DL (threaded) [usb] 100033 D - 0xc907cacc [usbus0] 100034 D - 0xc907cafc [usbus0] 100035 D - 0xc907cb2c [usbus0] 100036 D - 0xc907cb5c [usbus0] 100037 D - 0xc907cb8c [usbus0] 100039 D - 0xc90dbacc [usbus1] 100040 D - 0xc90dbafc [usbus1] 100041 D - 0xc90dbb2c [usbus1] 100042 D - 0xc90dbb5c [usbus1] 100043 D - 0xc90dbb8c [usbus1] 100045 D - 0xc90e4acc [usbus2] 100046 D - 0xc90e4afc [usbus2] 100047 D - 0xc90e4b2c [usbus2] 100048 D - 0xc90e4b5c [usbus2] 100049 D - 0xc90e4b8c [usbus2] 100050 D - 0xc90e6acc [usbus3] 100051 D - 0xc90e6afc [usbus3] 100052 D - 0xc90e6b2c [usbus3] 100053 D - 0xc90e6b5c [usbus3] 100054 D - 0xc90e6b8c [usbus3] 100055 D - 0xc90f8acc [usbus4] 100056 D - 0xc90f8afc [usbus4] 100057 D - 0xc90f8b2c [usbus4] 100058 D - 0xc90f8b5c [usbus4] 100059 D - 0xc90f8b8c [usbus4] 100061 D - 0xc9093ca4 [usbus5] 100062 D - 0xc9093cd4 [usbus5] 100063 D - 0xc9093d04 [usbus5] 100064 D - 0xc9093d34 [usbus5] 100065 D - 0xc9093d64 [usbus5] 4 0 0 0 DL (threaded) [cam] 100028 D - 0xc18d3400 [doneq0] 100075 D - 0xc18d32ac [scanner] 3 0 0 0 DL crypto_ 0xc1b2df98 [crypto returns] 2 0 0 0 DL crypto_ 0xc1b2dee0 [crypto] 13 0 0 0 DL (threaded) [geom] 100019 D - 0xc1b86330 [g_event] 100020 D - 0xc1b86334 [g_up] 100021 D - 0xc1b86338 [g_down] 12 0 0 0 WL (threaded) [intr] 100007 I [swi4: clock (0)] 100008 I [swi4: clock (1)] 100009 I [swi4: clock (2)] 100010 I [swi4: clock (3)] 100011 I [swi3: vm] 100012 I [swi1: netisr 0] 100013 I [swi6: task queue] 100014 I [swi6: Giant taskq] 100017 I [swi5: fast taskq] 100029 I [irq256: hdac0] 100030 I [irq257: re0] 100031 I [irq22: ahci0] 100032 I [irq16: hdac1 ohci0] 100038 I [irq17: ohci1 ohci3] 100044 I [irq18: ohci2 ohci4] 100060 I [irq19: ehci0] 100066 I [irq14: ata0] 100067 I [swi0: uart] 100069 I [irq1: atkbd0] 100070 I [irq12: psm0] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 1 0 1 0 SLs wait 0xc8e5c9fc [init] 10 0 0 0 DL audit_w 0xc1b8e0fc [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xc1b86364 [swapper] 100015 D - 0xc8e62080 [thread taskq] 100016 D - 0xc8e62000 [aiod_kick taskq] 100018 D - 0xc8e61e80 [kqueue_ctx taskq] 100022 D - 0xc8e61e00 [firmware taskq] 100025 D - 0xc8e61d80 [acpi_task_0] 100026 D - 0xc8e61d80 [acpi_task_1] 100027 D - 0xc8e61d80 [acpi_task_2] 100071 D - 0xc8e60200 [mca taskq] 100074 D - 0xc8e61700 [CAM taskq] 100088 D - 0xc8e5fb00 [if_config_tqg_0] 100089 D - 0xc8e5fa80 [if_io_tqg_0] 100090 D - 0xc8e5fa00 [if_io_tqg_1] 100091 D - 0xc8e5f980 [if_io_tqg_2] 100092 D - 0xc8e5f900 [if_io_tqg_3] db:0:ps> allt Tracing command sh pid 46239 tid 100122 td 0xca079360 sched_switch(ca079360,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xf3495924 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xf3495958 sleepq_switch(ca079360,0,c15cc031,1c2,190,...) at sleepq_switch+0xf7/frame 0xf3495990 sleepq_catch_signals(f34959f4,c0c0ec30,c8fb4614,0,ca079360,...) at sleepq_catch_signals+0x352/frame 0xf34959d0 sleepq_wait_sig(c8fb4674,0,f3495a14,101,0,...) at sleepq_wait_sig+0x14/frame 0xf34959f4 _cv_wait_sig(c8fb4674,c8fb4604,c15d1f4d,5a8,1,...) at _cv_wait_sig+0x21f/frame 0xf3495a34 tty_wait(c8fb4600,c8fb4674,f3495b90,1,0,...) at tty_wait+0x4b/frame 0xf3495a58 ttydisc_read(c8fb4600,f3495b90,0,d0,c1896674,...) at ttydisc_read+0x3c3/frame 0xf3495a98 ttydev_read(c8cff600,f3495b90,0,ca079360,f3495af4,...) at ttydev_read+0x55/frame 0xf3495ab8 devfs_read_f(c979f268,f3495b90,c8e28e00,0,ca079360,...) at devfs_read_f+0xc5/frame 0xf3495af0 dofileread(c979f268,f3495b90,ffffffff,ffffffff,0,...) at dofileread+0xaf/frame 0xf3495b20 kern_readv(ca079360,0,f3495b90,2,bfbfec7a,...) at kern_readv+0x93/frame 0xf3495b70 sys_read(ca079360,f3495c00,c15bbd67,4,0,...) at sys_read+0x59/frame 0xf3495bc0 syscall(f3495ce8) at syscall+0x3b5/frame 0xf3495cdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xf3495cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282062e7, esp = 0xbfbfec34, ebp = 0xbfbfec48 --- Tracing command umount pid 72280 tid 101508 td 0xc9f44000 sched_switch(c9f44000,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xc86ac96c mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xc86ac9a0 sleepq_switch(c9f44000,0,c15cc031,298,0,...) at sleepq_switch+0xf7/frame 0xc86ac9d8 sleepq_wait(cbfd9000,60,c15d83b7,0,0,...) at sleepq_wait+0x48/frame 0xc86ac9fc _sleep(cbfd9000,cbfd9000,60,c15d83b7,0,...) at _sleep+0x350/frame 0xc86aca50 vfs_mount_destroy(cbfd9000,10,0,597,c1af1834,...) at vfs_mount_destroy+0xa4/frame 0xc86aca88 dounmount(cbfd9000,8000000,c9f44000,496,0,...) at dounmount+0xaf7/frame 0xc86acae8 sys_unmount(c9f44000,c86acc00,c15bbd67,4,acf5d0e,...) at sys_unmount+0x315/frame 0xc86acbc0 syscall(c86acce8) at syscall+0x3b5/frame 0xc86accdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xc86accdc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280a842f, esp = 0xbfbfd424, ebp = 0xbfbfd900 --- Tracing command md5 pid 18417 tid 101478 td 0xd3a576c0 sched_switch(d3a576c0,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xc864db84 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xc864dbb8 sleepq_switch(d3a576c0,0,c15cc031,298,0,...) at sleepq_switch+0xf7/frame 0xc864dbf0 sleepq_wait(ca2bf000,5c,c12e918a,0,0,...) at sleepq_wait+0x48/frame 0xc864dc14 _sleep(ca2bf000,ca2bf020,25c,c12e918a,0,...) at _sleep+0x350/frame 0xc864dc68 md_kthread(ca2bf000,c864dce8,c15bc328,406,0,...) at md_kthread+0x1c7/frame 0xc864dcac fork_exit(c07d2df0,ca2bf000,c864dce8) at fork_exit+0x7e/frame 0xc864dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xc864dcd4 --- trap 0, eip = 0, esp = 0xc864dd20, ebp = 0 --- Tracing command syncer pid 22 tid 100085 td 0xc93b7000 sched_switch(c93b7000,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedf18b74 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedf18ba8 sleepq_switch(c93b7000,0,c15cc031,2bb,0,...) at sleepq_switch+0xf7/frame 0xedf18be0 sleepq_timedwait(c1b294dc,0,edf18c28,0,0,...) at sleepq_timedwait+0x48/frame 0xedf18c04 _cv_timedwait_sbt(c1b294dc,c1b294bc,fffffed8,0,0,...) at _cv_timedwait_sbt+0x24b/frame 0xedf18c48 sched_sync(0,edf18ce8,c15bc328,406,0,...) at sched_sync+0x6c6/frame 0xedf18cac fork_exit(c0cfe2b0,0,edf18ce8) at fork_exit+0x7e/frame 0xedf18cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf18cd4 --- trap 0, eip = 0, esp = 0xedf18d20, ebp = 0 --- Tracing command vnlru pid 21 tid 100084 td 0xc93b7360 sched_switch(c93b7360,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedf15b4c mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedf15b80 sleepq_switch(c93b7360,0,c15cc031,2bb,0,...) at sleepq_switch+0xf7/frame 0xedf15bb8 sleepq_timedwait(c93b16a8,60,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedf15bdc _sleep(c93b16a8,c1b29488,260,c15d9cc4,fffffed8,...) at _sleep+0x324/frame 0xedf15c30 vnlru_proc(0,edf15ce8,c15bc328,406,0,...) at vnlru_proc+0xbf/frame 0xedf15cac fork_exit(c0cfd920,0,edf15ce8) at fork_exit+0x7e/frame 0xedf15cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf15cd4 --- trap 0, eip = 0, esp = 0xedf15d20, ebp = 0 --- Tracing command bufdaemon pid 20 tid 100083 td 0xc93b76c0 sched_switch(c93b76c0,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedf12b94 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedf12bc8 sleepq_switch(c93b76c0,0,c15cc031,2bb,0,...) at sleepq_switch+0xf7/frame 0xedf12c00 sleepq_timedwait(c1b28204,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedf12c24 _sleep(c1b28204,c1b28180,54,c15d67be,fffffed8,...) at _sleep+0x324/frame 0xedf12c78 buf_daemon(0,edf12ce8,c15bc328,406,0,...) at buf_daemon+0x8c/frame 0xedf12cac fork_exit(c0cdc540,0,edf12ce8) at fork_exit+0x7e/frame 0xedf12cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf12cd4 --- trap 0, eip = 0, esp = 0xedf12d20, ebp = 0 --- Tracing command bufdaemon pid 20 tid 100103 td 0xc982da20 sched_switch(c982da20,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedf62b84 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedf62bb8 sleepq_switch(c982da20,0,c15cc031,2bb,0,...) at sleepq_switch+0xf7/frame 0xedf62bf0 sleepq_timedwait(c97a6684,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedf62c14 _sleep(c97a6684,c97a6600,54,c16110f5,7fffff6c,...) at _sleep+0x324/frame 0xedf62c68 softdep_flush(c9aaf000,edf62ce8,c15bc328,406,0,...) at softdep_flush+0x196/frame 0xedf62cac fork_exit(c0f04c60,c9aaf000,edf62ce8) at fork_exit+0x7e/frame 0xedf62cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf62cd4 --- trap 0, eip = 0, esp = 0xedf62d20, ebp = 0 --- Tracing command bufdaemon pid 20 tid 100105 td 0xc982d360 sched_switch(c982d360,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedf68b84 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedf68bb8 sleepq_switch(c982d360,0,c15cc031,2bb,0,...) at sleepq_switch+0xf7/frame 0xedf68bf0 sleepq_timedwait(c97a6284,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedf68c14 _sleep(c97a6284,c97a6200,54,c16110f5,7fffff6c,...) at _sleep+0x324/frame 0xedf68c68 softdep_flush(c9aad000,edf68ce8,c15bc328,406,0,...) at softdep_flush+0x196/frame 0xedf68cac fork_exit(c0f04c60,c9aad000,edf68ce8) at fork_exit+0x7e/frame 0xedf68cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf68cd4 --- trap 0, eip = 0, esp = 0xedf68d20, ebp = 0 --- Tracing command bufdaemon pid 20 tid 100106 td 0xc982d000 sched_switch(c982d000,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedf6bb84 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedf6bbb8 sleepq_switch(c982d000,0,c15cc031,2bb,0,...) at sleepq_switch+0xf7/frame 0xedf6bbf0 sleepq_timedwait(c97a6084,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedf6bc14 _sleep(c97a6084,c97a6000,54,c16110f5,7fffff6c,...) at _sleep+0x324/frame 0xedf6bc68 softdep_flush(c9b98000,edf6bce8,c15bc328,406,0,...) at softdep_flush+0x196/frame 0xedf6bcac fork_exit(c0f04c60,c9b98000,edf6bce8) at fork_exit+0x7e/frame 0xedf6bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf6bcd4 --- trap 0, eip = 0, esp = 0xedf6bd20, ebp = 0 --- Tracing command bufdaemon pid 20 tid 100180 td 0xca4f76c0 sched_switch(ca4f76c0,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xf355eb84 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xf355ebb8 sleepq_switch(ca4f76c0,0,c15cc031,2bb,0,...) at sleepq_switch+0xf7/frame 0xf355ebf0 sleepq_timedwait(c978dc84,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xf355ec14 _sleep(c978dc84,c978dc00,54,c16110f5,7fffff6c,...) at _sleep+0x324/frame 0xf355ec68 softdep_flush(c9aae000,f355ece8,c15bc328,406,0,...) at softdep_flush+0x196/frame 0xf355ecac fork_exit(c0f04c60,c9aae000,f355ece8) at fork_exit+0x7e/frame 0xf355ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf355ecd4 --- trap 0, eip = 0, esp = 0xf355ed20, ebp = 0 --- Tracing command bufspacedaemon pid 19 tid 100082 td 0xc93b7a20 sched_switch(c93b7a20,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedf0fb94 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedf0fbc8 sleepq_switch(c93b7a20,0,c15cc031,2bb,0,...) at sleepq_switch+0xf7/frame 0xedf0fc00 sleepq_timedwait(c1b28e4c,5c,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedf0fc24 _sleep(c1b28e4c,c1b28c00,25c,c15ac19b,fffffed8,...) at _sleep+0x324/frame 0xedf0fc78 bufspace_daemon(0,edf0fce8,c15bc328,406,0,...) at bufspace_daemon+0x1ff/frame 0xedf0fcac fork_exit(c0cdbef0,0,edf0fce8) at fork_exit+0x7e/frame 0xedf0fcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf0fcd4 --- trap 0, eip = 0, esp = 0xedf0fd20, ebp = 0 --- Tracing command vmdaemon pid 18 tid 100081 td 0xc93b8000 sched_switch(c93b8000,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedf0cb4c mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedf0cb80 sleepq_switch(c93b8000,0,c15cc031,298,0,...) at sleepq_switch+0xf7/frame 0xedf0cbb8 sleepq_wait(c1b2f02c,74,c15d67be,0,0,...) at sleepq_wait+0x48/frame 0xedf0cbdc _sleep(c1b2f02c,c1b2f014,74,c15d67be,0,...) at _sleep+0x350/frame 0xedf0cc30 vm_daemon(0,edf0cce8,c15bc328,406,0,...) at vm_daemon+0xa9/frame 0xedf0ccac fork_exit(c0f63a00,0,edf0cce8) at fork_exit+0x7e/frame 0xedf0ccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf0ccd4 --- trap 0, eip = 0, esp = 0xedf0cd20, ebp = 0 --- Tracing command pagedaemon pid 17 tid 100080 td 0xc93b8360 sched_switch(c93b8360,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedf09b6c mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedf09ba0 sleepq_switch(c93b8360,0,c15cc031,2bb,0,...) at sleepq_switch+0xf7/frame 0xedf09bd8 sleepq_timedwait(c1b8f985,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedf09bfc _sleep(c1b8f985,c1b8f900,254,c15d67be,fffffed8,...) at _sleep+0x324/frame 0xedf09c50 vm_pageout(0,edf09ce8,c15bc328,406,0,...) at vm_pageout+0x307/frame 0xedf09cac fork_exit(c0f61480,0,edf09ce8) at fork_exit+0x7e/frame 0xedf09cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf09cd4 --- trap 0, eip = 0, esp = 0xedf09d20, ebp = 0 --- Tracing command pagedaemon pid 17 tid 100086 td 0xc9618a20 sched_switch(c9618a20,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedf1bb30 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedf1bb64 sleepq_switch(c9618a20,0,c15cc031,298,0,...) at sleepq_switch+0xf7/frame 0xedf1bb9c sleepq_wait(c1b2eff4,54,c16195ba,0,0,...) at sleepq_wait+0x48/frame 0xedf1bbc0 _sleep(c1b2eff4,c1b8f680,54,c16195ba,0,...) at _sleep+0x350/frame 0xedf1bc14 vm_pageout_laundry_worker(0,edf1bce8,c15bc328,406,0,...) at vm_pageout_laundry_worker+0xb76/frame 0xedf1bcac fork_exit(c0f62420,0,edf1bce8) at fork_exit+0x7e/frame 0xedf1bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf1bcd4 --- trap 0, eip = 0, esp = 0xedf1bd20, ebp = 0 --- Tracing command pagedaemon pid 17 tid 100087 td 0xc96186c0 sched_switch(c96186c0,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedf1eb9c mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedf1ebd0 sleepq_switch(c96186c0,0,c15cc031,298,c1b2ec0c,...) at sleepq_switch+0xf7/frame 0xedf1ec08 sleepq_wait(c1b2ec20,54,edf1ec5c,0,0,...) at sleepq_wait+0x48/frame 0xedf1ec2c _sleep(c1b2ec20,c1b2ec0c,54,c1615d75,0,...) at _sleep+0x350/frame 0xedf1ec80 uma_reclaim_worker(0,edf1ece8,c15bc328,406,0,...) at uma_reclaim_worker+0x90/frame 0xedf1ecac fork_exit(c0f42b40,0,edf1ece8) at fork_exit+0x7e/frame 0xedf1ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf1ecd4 --- trap 0, eip = 0, esp = 0xedf1ed20, ebp = 0 --- Tracing command soaiod4 pid 16 tid 100079 td 0xc93b86c0 sched_switch(c93b86c0,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedf06b8c mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedf06bc0 sleepq_switch(c93b86c0,0,c15cc031,2bb,0,...) at sleepq_switch+0xf7/frame 0xedf06bf8 sleepq_timedwait(c1b27bdc,0,1d,0,0,...) at sleepq_timedwait+0x48/frame 0xedf06c1c _sleep(c1b27bdc,c1b27bbc,0,c15ac19b,ffffdd50,...) at _sleep+0x324/frame 0xedf06c70 soaio_kproc_loop(4,edf06ce8,c15bc328,406,0,...) at soaio_kproc_loop+0x13d/frame 0xedf06cac fork_exit(c0ca0ea0,4,edf06ce8) at fork_exit+0x7e/frame 0xedf06cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf06cd4 --- trap 0, eip = 0, esp = 0xedf06d20, ebp = 0 --- Tracing command soaiod3 pid 15 tid 100078 td 0xc90f3360 sched_switch(c90f3360,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedf03b8c mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedf03bc0 sleepq_switch(c90f3360,0,c15cc031,2bb,0,...) at sleepq_switch+0xf7/frame 0xedf03bf8 sleepq_timedwait(c1b27bdc,0,1d,0,0,...) at sleepq_timedwait+0x48/frame 0xedf03c1c _sleep(c1b27bdc,c1b27bbc,0,c15ac19b,ffffdd50,...) at _sleep+0x324/frame 0xedf03c70 soaio_kproc_loop(3,edf03ce8,c15bc328,406,0,...) at soaio_kproc_loop+0x13d/frame 0xedf03cac fork_exit(c0ca0ea0,3,edf03ce8) at fork_exit+0x7e/frame 0xedf03cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf03cd4 --- trap 0, eip = 0, esp = 0xedf03d20, ebp = 0 --- Tracing command soaiod2 pid 9 tid 100077 td 0xc90f36c0 sched_switch(c90f36c0,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedf00b8c mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedf00bc0 sleepq_switch(c90f36c0,0,c15cc031,2bb,0,...) at sleepq_switch+0xf7/frame 0xedf00bf8 sleepq_timedwait(c1b27bdc,0,1d,0,0,...) at sleepq_timedwait+0x48/frame 0xedf00c1c _sleep(c1b27bdc,c1b27bbc,0,c15ac19b,ffffdd50,...) at _sleep+0x324/frame 0xedf00c70 soaio_kproc_loop(2,edf00ce8,c15bc328,406,0,...) at soaio_kproc_loop+0x13d/frame 0xedf00cac fork_exit(c0ca0ea0,2,edf00ce8) at fork_exit+0x7e/frame 0xedf00cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf00cd4 --- trap 0, eip = 0, esp = 0xedf00d20, ebp = 0 --- Tracing command soaiod1 pid 8 tid 100076 td 0xc90f3a20 sched_switch(c90f3a20,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedefdb8c mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedefdbc0 sleepq_switch(c90f3a20,0,c15cc031,2bb,0,...) at sleepq_switch+0xf7/frame 0xedefdbf8 sleepq_timedwait(c1b27bdc,0,1d,0,0,...) at sleepq_timedwait+0x48/frame 0xedefdc1c _sleep(c1b27bdc,c1b27bbc,0,c15ac19b,ffffdd50,...) at _sleep+0x324/frame 0xedefdc70 soaio_kproc_loop(1,edefdce8,c15bc328,406,0,...) at soaio_kproc_loop+0x13d/frame 0xedefdcac fork_exit(c0ca0ea0,1,edefdce8) at fork_exit+0x7e/frame 0xedefdcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedefdcd4 --- trap 0, eip = 0, esp = 0xedefdd20, ebp = 0 --- Tracing command rand_harvestq pid 7 tid 100073 td 0xc91256c0 sched_switch(c91256c0,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedd74b74 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedd74ba8 sleepq_switch(c91256c0,0,c15cc031,2bb,0,...) at sleepq_switch+0xf7/frame 0xedd74be0 sleepq_timedwait(c1986f08,0,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedd74c04 _sleep(c1986f08,0,0,c15ac19b,19999999,...) at _sleep+0x324/frame 0xedd74c58 random_kthread(0,edd74ce8,c15bc328,406,0,...) at random_kthread+0x6c/frame 0xedd74cac fork_exit(c0953bf0,0,edd74ce8) at fork_exit+0x7e/frame 0xedd74cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd74cd4 --- trap 0, eip = 0, esp = 0xedd74d20, ebp = 0 --- Tracing command sctp_iterator pid 6 tid 100072 td 0xc9125a20 sched_switch(c9125a20,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedd71b9c mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedd71bd0 sleepq_switch(c9125a20,0,c15cc031,298,0,...) at sleepq_switch+0xf7/frame 0xedd71c08 sleepq_wait(c1b8b1ec,0,c15f3977,0,0,...) at sleepq_wait+0x48/frame 0xedd71c2c _sleep(c1b8b1ec,c1b8b1b4,0,c15f3977,0,...) at _sleep+0x350/frame 0xedd71c80 sctp_iterator_thread(0,edd71ce8,c15bc328,406,0,...) at sctp_iterator_thread+0x7c/frame 0xedd71cac fork_exit(c0dbc860,0,edd71ce8) at fork_exit+0x7e/frame 0xedd71cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd71cd4 --- trap 0, eip = 0, esp = 0xedd71d20, ebp = 0 --- Tracing command fdc0 pid 5 tid 100068 td 0xc9126a20 sched_switch(c9126a20,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedd64b44 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedd64b78 sleepq_switch(c9126a20,0,c15cc031,298,0,...) at sleepq_switch+0xf7/frame 0xedd64bb0 sleepq_wait(c907b03c,5c,c15ac19b,0,0,...) at sleepq_wait+0x48/frame 0xedd64bd4 _sleep(c907b03c,c907b0f0,5c,c15ac19b,0,...) at _sleep+0x350/frame 0xedd64c28 fdc_thread(c907b000,edd64ce8,c15bc328,406,0,...) at fdc_thread+0x2fc/frame 0xedd64cac fork_exit(c1136bd0,c907b000,edd64ce8) at fork_exit+0x7e/frame 0xedd64cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd64cd4 --- trap 0, eip = 0, esp = 0xedd64d20, ebp = 0 --- Tracing command usb pid 14 tid 100033 td 0xc902b000 sched_switch(c902b000,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xf0ffcbb4 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xf0ffcbe8 sleepq_switch(c902b000,0,c15cc031,298,c902b000,...) at sleepq_switch+0xf7/frame 0xf0ffcc20 sleepq_wait(c907cacc,0,f0ffcc64,1,0,...) at sleepq_wait+0x48/frame 0xf0ffcc44 _cv_wait(c907cacc,c907ccf8,c158ed4e,76,c907cad4,...) at _cv_wait+0x21e/frame 0xf0ffcc84 usb_process(c907cac4,f0ffcce8,c15bc328,406,0,...) at usb_process+0x150/frame 0xf0ffccac fork_exit(c0a77d30,c907cac4,f0ffcce8) at fork_exit+0x7e/frame 0xf0ffccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf0ffccd4 --- trap 0, eip = 0, esp = 0xf0ffcd20, ebp = 0 --- Tracing command usb pid 14 tid 100034 td 0xc902aa20 sched_switch(c902aa20,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xf0fffbb4 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xf0fffbe8 sleepq_switch(c902aa20,0,c15cc031,298,c902aa20,...) at sleepq_switch+0xf7/frame 0xf0fffc20 sleepq_wait(c907cafc,0,f0fffc64,1,0,...) at sleepq_wait+0x48/frame 0xf0fffc44 _cv_wait(c907cafc,c907ccf8,c158ed4e,76,c907cb04,...) at _cv_wait+0x21e/frame 0xf0fffc84 usb_process(c907caf4,f0fffce8,c15bc328,406,0,...) at usb_process+0x150/frame 0xf0fffcac fork_exit(c0a77d30,c907caf4,f0fffce8) at fork_exit+0x7e/frame 0xf0fffcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf0fffcd4 --- trap 0, eip = 0, esp = 0xf0fffd20, ebp = 0 --- Tracing command usb pid 14 tid 100035 td 0xc902a6c0 sched_switch(c902a6c0,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedce1bb4 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedce1be8 sleepq_switch(c902a6c0,0,c15cc031,298,c902a6c0,...) at sleepq_switch+0xf7/frame 0xedce1c20 sleepq_wait(c907cb2c,0,edce1c64,1,0,...) at sleepq_wait+0x48/frame 0xedce1c44 _cv_wait(c907cb2c,c907ccf8,c158ed4e,76,c907cb34,...) at _cv_wait+0x21e/frame 0xedce1c84 usb_process(c907cb24,edce1ce8,c15bc328,406,0,...) at usb_process+0x150/frame 0xedce1cac fork_exit(c0a77d30,c907cb24,edce1ce8) at fork_exit+0x7e/frame 0xedce1cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedce1cd4 --- trap 0, eip = 0, esp = 0xedce1d20, ebp = 0 --- Tracing command usb pid 14 tid 100036 td 0xc902a360 sched_switch(c902a360,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedce4bb4 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedce4be8 sleepq_switch(c902a360,0,c15cc031,298,c902a360,...) at sleepq_switch+0xf7/frame 0xedce4c20 sleepq_wait(c907cb5c,0,edce4c64,1,0,...) at sleepq_wait+0x48/frame 0xedce4c44 _cv_wait(c907cb5c,c907ccf8,c158ed4e,76,c907cb64,...) at _cv_wait+0x21e/frame 0xedce4c84 usb_process(c907cb54,edce4ce8,c15bc328,406,0,...) at usb_process+0x150/frame 0xedce4cac fork_exit(c0a77d30,c907cb54,edce4ce8) at fork_exit+0x7e/frame 0xedce4cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedce4cd4 --- trap 0, eip = 0, esp = 0xedce4d20, ebp = 0 --- Tracing command usb pid 14 tid 100037 td 0xc902a000 sched_switch(c902a000,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedce7bb4 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedce7be8 sleepq_switch(c902a000,0,c15cc031,298,c902a000,...) at sleepq_switch+0xf7/frame 0xedce7c20 sleepq_wait(c907cb8c,0,edce7c64,1,0,...) at sleepq_wait+0x48/frame 0xedce7c44 _cv_wait(c907cb8c,c907ccf8,c158ed4e,76,c907cb94,...) at _cv_wait+0x21e/frame 0xedce7c84 usb_process(c907cb84,edce7ce8,c15bc328,406,0,...) at usb_process+0x150/frame 0xedce7cac fork_exit(c0a77d30,c907cb84,edce7ce8) at fork_exit+0x7e/frame 0xedce7cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedce7cd4 --- trap 0, eip = 0, esp = 0xedce7d20, ebp = 0 --- Tracing command usb pid 14 tid 100039 td 0xc8f356c0 sched_switch(c8f356c0,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedceebb4 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedceebe8 sleepq_switch(c8f356c0,0,c15cc031,298,c8f356c0,...) at sleepq_switch+0xf7/frame 0xedceec20 sleepq_wait(c90dbacc,0,edceec64,1,0,...) at sleepq_wait+0x48/frame 0xedceec44 _cv_wait(c90dbacc,c90dbcf8,c158ed4e,76,c90dbad4,...) at _cv_wait+0x21e/frame 0xedceec84 usb_process(c90dbac4,edceece8,c15bc328,406,0,...) at usb_process+0x150/frame 0xedceecac fork_exit(c0a77d30,c90dbac4,edceece8) at fork_exit+0x7e/frame 0xedceecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedceecd4 --- trap 0, eip = 0, esp = 0xedceed20, ebp = 0 --- Tracing command usb pid 14 tid 100040 td 0xc90e3a20 sched_switch(c90e3a20,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedcf1bb4 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedcf1be8 sleepq_switch(c90e3a20,0,c15cc031,298,c90e3a20,...) at sleepq_switch+0xf7/frame 0xedcf1c20 sleepq_wait(c90dbafc,0,edcf1c64,1,0,...) at sleepq_wait+0x48/frame 0xedcf1c44 _cv_wait(c90dbafc,c90dbcf8,c158ed4e,76,c90dbb04,...) at _cv_wait+0x21e/frame 0xedcf1c84 usb_process(c90dbaf4,edcf1ce8,c15bc328,406,0,...) at usb_process+0x150/frame 0xedcf1cac fork_exit(c0a77d30,c90dbaf4,edcf1ce8) at fork_exit+0x7e/frame 0xedcf1cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedcf1cd4 --- trap 0, eip = 0, esp = 0xedcf1d20, ebp = 0 --- Tracing command usb pid 14 tid 100041 td 0xc90e36c0 sched_switch(c90e36c0,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedcf4bb4 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedcf4be8 sleepq_switch(c90e36c0,0,c15cc031,298,c90e36c0,...) at sleepq_switch+0xf7/frame 0xedcf4c20 sleepq_wait(c90dbb2c,0,edcf4c64,1,0,...) at sleepq_wait+0x48/frame 0xedcf4c44 _cv_wait(c90dbb2c,c90dbcf8,c158ed4e,76,c90dbb34,...) at _cv_wait+0x21e/frame 0xedcf4c84 usb_process(c90dbb24,edcf4ce8,c15bc328,406,0,...) at usb_process+0x150/frame 0xedcf4cac fork_exit(c0a77d30,c90dbb24,edcf4ce8) at fork_exit+0x7e/frame 0xedcf4cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedcf4cd4 --- trap 0, eip = 0, esp = 0xedcf4d20, ebp = 0 --- Tracing command usb pid 14 tid 100042 td 0xc90e3360 sched_switch(c90e3360,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedcf7bb4 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedcf7be8 sleepq_switch(c90e3360,0,c15cc031,298,c90e3360,...) at sleepq_switch+0xf7/frame 0xedcf7c20 sleepq_wait(c90dbb5c,0,edcf7c64,1,0,...) at sleepq_wait+0x48/frame 0xedcf7c44 _cv_wait(c90dbb5c,c90dbcf8,c158ed4e,76,c90dbb64,...) at _cv_wait+0x21e/frame 0xedcf7c84 usb_process(c90dbb54,edcf7ce8,c15bc328,406,0,...) at usb_process+0x150/frame 0xedcf7cac fork_exit(c0a77d30,c90dbb54,edcf7ce8) at fork_exit+0x7e/frame 0xedcf7cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedcf7cd4 --- trap 0, eip = 0, esp = 0xedcf7d20, ebp = 0 --- Tracing command usb pid 14 tid 100043 td 0xc90e3000 sched_switch(c90e3000,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedcfabb4 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedcfabe8 sleepq_switch(c90e3000,0,c15cc031,298,c90e3000,...) at sleepq_switch+0xf7/frame 0xedcfac20 sleepq_wait(c90dbb8c,0,edcfac64,1,0,...) at sleepq_wait+0x48/frame 0xedcfac44 _cv_wait(c90dbb8c,c90dbcf8,c158ed4e,76,c90dbb94,...) at _cv_wait+0x21e/frame 0xedcfac84 usb_process(c90dbb84,edcface8,c15bc328,406,0,...) at usb_process+0x150/frame 0xedcfacac fork_exit(c0a77d30,c90dbb84,edcface8) at fork_exit+0x7e/frame 0xedcfacd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedcfacd4 --- trap 0, eip = 0, esp = 0xedcfad20, ebp = 0 --- Tracing command usb pid 14 tid 100045 td 0xc90e26c0 sched_switch(c90e26c0,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedd01bb4 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedd01be8 sleepq_switch(c90e26c0,0,c15cc031,298,c90e26c0,...) at sleepq_switch+0xf7/frame 0xedd01c20 sleepq_wait(c90e4acc,0,edd01c64,1,0,...) at sleepq_wait+0x48/frame 0xedd01c44 _cv_wait(c90e4acc,c90e4cf8,c158ed4e,76,c90e4ad4,...) at _cv_wait+0x21e/frame 0xedd01c84 usb_process(c90e4ac4,edd01ce8,c15bc328,406,0,...) at usb_process+0x150/frame 0xedd01cac fork_exit(c0a77d30,c90e4ac4,edd01ce8) at fork_exit+0x7e/frame 0xedd01cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd01cd4 --- trap 0, eip = 0, esp = 0xedd01d20, ebp = 0 --- Tracing command usb pid 14 tid 100046 td 0xc90e2360 sched_switch(c90e2360,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedd04bb4 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedd04be8 sleepq_switch(c90e2360,0,c15cc031,298,c90e2360,...) at sleepq_switch+0xf7/frame 0xedd04c20 sleepq_wait(c90e4afc,0,edd04c64,1,0,...) at sleepq_wait+0x48/frame 0xedd04c44 _cv_wait(c90e4afc,c90e4cf8,c158ed4e,76,c90e4b04,...) at _cv_wait+0x21e/frame 0xedd04c84 usb_process(c90e4af4,edd04ce8,c15bc328,406,0,...) at usb_process+0x150/frame 0xedd04cac fork_exit(c0a77d30,c90e4af4,edd04ce8) at fork_exit+0x7e/frame 0xedd04cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd04cd4 --- trap 0, eip = 0, esp = 0xedd04d20, ebp = 0 --- Tracing command usb pid 14 tid 100047 td 0xc90e2000 sched_switch(c90e2000,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedd07bb4 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedd07be8 sleepq_switch(c90e2000,0,c15cc031,298,c90e2000,...) at sleepq_switch+0xf7/frame 0xedd07c20 sleepq_wait(c90e4b2c,0,edd07c64,1,0,...) at sleepq_wait+0x48/frame 0xedd07c44 _cv_wait(c90e4b2c,c90e4cf8,c158ed4e,76,c90e4b34,...) at _cv_wait+0x21e/frame 0xedd07c84 usb_process(c90e4b24,edd07ce8,c15bc328,406,0,...) at usb_process+0x150/frame 0xedd07cac fork_exit(c0a77d30,c90e4b24,edd07ce8) at fork_exit+0x7e/frame 0xedd07cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd07cd4 --- trap 0, eip = 0, esp = 0xedd07d20, ebp = 0 --- Tracing command usb pid 14 tid 100048 td 0xc90e1a20 sched_switch(c90e1a20,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedd0abb4 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedd0abe8 sleepq_switch(c90e1a20,0,c15cc031,298,c90e1a20,...) at sleepq_switch+0xf7/frame 0xedd0ac20 sleepq_wait(c90e4b5c,0,edd0ac64,1,0,...) at sleepq_wait+0x48/frame 0xedd0ac44 _cv_wait(c90e4b5c,c90e4cf8,c158ed4e,76,c90e4b64,...) at _cv_wait+0x21e/frame 0xedd0ac84 usb_process(c90e4b54,edd0ace8,c15bc328,406,0,...) at usb_process+0x150/frame 0xedd0acac fork_exit(c0a77d30,c90e4b54,edd0ace8) at fork_exit+0x7e/frame 0xedd0acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd0acd4 --- trap 0, eip = 0, esp = 0xedd0ad20, ebp = 0 --- Tracing command usb pid 14 tid 100049 td 0xc90e16c0 sched_switch(c90e16c0,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedd0dbb4 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedd0dbe8 sleepq_switch(c90e16c0,0,c15cc031,298,c90e16c0,...) at sleepq_switch+0xf7/frame 0xedd0dc20 sleepq_wait(c90e4b8c,0,edd0dc64,1,0,...) at sleepq_wait+0x48/frame 0xedd0dc44 _cv_wait(c90e4b8c,c90e4cf8,c158ed4e,76,c90e4b94,...) at _cv_wait+0x21e/frame 0xedd0dc84 usb_process(c90e4b84,edd0dce8,c15bc328,406,0,...) at usb_process+0x150/frame 0xedd0dcac fork_exit(c0a77d30,c90e4b84,edd0dce8) at fork_exit+0x7e/frame 0xedd0dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd0dcd4 --- trap 0, eip = 0, esp = 0xedd0dd20, ebp = 0 --- Tracing command usb pid 14 tid 100050 td 0xc90e1360 sched_switch(c90e1360,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedd11bb4 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedd11be8 sleepq_switch(c90e1360,0,c15cc031,298,c90e1360,...) at sleepq_switch+0xf7/frame 0xedd11c20 sleepq_wait(c90e6acc,0,edd11c64,1,0,...) at sleepq_wait+0x48/frame 0xedd11c44 _cv_wait(c90e6acc,c90e6cf8,c158ed4e,76,c90e6ad4,...) at _cv_wait+0x21e/frame 0xedd11c84 usb_process(c90e6ac4,edd11ce8,c15bc328,406,0,...) at usb_process+0x150/frame 0xedd11cac fork_exit(c0a77d30,c90e6ac4,edd11ce8) at fork_exit+0x7e/frame 0xedd11cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd11cd4 --- trap 0, eip = 0, esp = 0xedd11d20, ebp = 0 --- Tracing command usb pid 14 tid 100051 td 0xc90e1000 sched_switch(c90e1000,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedd14bb4 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedd14be8 sleepq_switch(c90e1000,0,c15cc031,298,c90e1000,...) at sleepq_switch+0xf7/frame 0xedd14c20 sleepq_wait(c90e6afc,0,edd14c64,1,0,...) at sleepq_wait+0x48/frame 0xedd14c44 _cv_wait(c90e6afc,c90e6cf8,c158ed4e,76,c90e6b04,...) at _cv_wait+0x21e/frame 0xedd14c84 usb_process(c90e6af4,edd14ce8,c15bc328,406,0,...) at usb_process+0x150/frame 0xedd14cac fork_exit(c0a77d30,c90e6af4,edd14ce8) at fork_exit+0x7e/frame 0xedd14cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd14cd4 --- trap 0, eip = 0, esp = 0xedd14d20, ebp = 0 --- Tracing command usb pid 14 tid 100052 td 0xc902ca20 sched_switch(c902ca20,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedd17bb4 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedd17be8 sleepq_switch(c902ca20,0,c15cc031,298,c902ca20,...) at sleepq_switch+0xf7/frame 0xedd17c20 sleepq_wait(c90e6b2c,0,edd17c64,1,0,...) at sleepq_wait+0x48/frame 0xedd17c44 _cv_wait(c90e6b2c,c90e6cf8,c158ed4e,76,c90e6b34,...) at _cv_wait+0x21e/frame 0xedd17c84 usb_process(c90e6b24,edd17ce8,c15bc328,406,0,...) at usb_process+0x150/frame 0xedd17cac fork_exit(c0a77d30,c90e6b24,edd17ce8) at fork_exit+0x7e/frame 0xedd17cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd17cd4 --- trap 0, eip = 0, esp = 0xedd17d20, ebp = 0 --- Tracing command usb pid 14 tid 100053 td 0xc90f3000 sched_switch(c90f3000,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedd1abb4 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedd1abe8 sleepq_switch(c90f3000,0,c15cc031,298,c90f3000,...) at sleepq_switch+0xf7/frame 0xedd1ac20 sleepq_wait(c90e6b5c,0,edd1ac64,1,0,...) at sleepq_wait+0x48/frame 0xedd1ac44 _cv_wait(c90e6b5c,c90e6cf8,c158ed4e,76,c90e6b64,...) at _cv_wait+0x21e/frame 0xedd1ac84 usb_process(c90e6b54,edd1ace8,c15bc328,406,0,...) at usb_process+0x150/frame 0xedd1acac fork_exit(c0a77d30,c90e6b54,edd1ace8) at fork_exit+0x7e/frame 0xedd1acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd1acd4 --- trap 0, eip = 0, esp = 0xedd1ad20, ebp = 0 --- Tracing command usb pid 14 tid 100054 td 0xc90f2a20 sched_switch(c90f2a20,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedd1dbb4 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedd1dbe8 sleepq_switch(c90f2a20,0,c15cc031,298,c90f2a20,...) at sleepq_switch+0xf7/frame 0xedd1dc20 sleepq_wait(c90e6b8c,0,edd1dc64,1,0,...) at sleepq_wait+0x48/frame 0xedd1dc44 _cv_wait(c90e6b8c,c90e6cf8,c158ed4e,76,c90e6b94,...) at _cv_wait+0x21e/frame 0xedd1dc84 usb_process(c90e6b84,edd1dce8,c15bc328,406,0,...) at usb_process+0x150/frame 0xedd1dcac fork_exit(c0a77d30,c90e6b84,edd1dce8) at fork_exit+0x7e/frame 0xedd1dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd1dcd4 --- trap 0, eip = 0, esp = 0xedd1dd20, ebp = 0 --- Tracing command usb pid 14 tid 100055 td 0xc90f26c0 sched_switch(c90f26c0,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedd21bb4 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedd21be8 sleepq_switch(c90f26c0,0,c15cc031,298,c90f26c0,...) at sleepq_switch+0xf7/frame 0xedd21c20 sleepq_wait(c90f8acc,0,edd21c64,1,0,...) at sleepq_wait+0x48/frame 0xedd21c44 _cv_wait(c90f8acc,c90f8cf8,c158ed4e,76,c90f8ad4,...) at _cv_wait+0x21e/frame 0xedd21c84 usb_process(c90f8ac4,edd21ce8,c15bc328,406,0,...) at usb_process+0x150/frame 0xedd21cac fork_exit(c0a77d30,c90f8ac4,edd21ce8) at fork_exit+0x7e/frame 0xedd21cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd21cd4 --- trap 0, eip = 0, esp = 0xedd21d20, ebp = 0 --- Tracing command usb pid 14 tid 100056 td 0xc90f2360 sched_switch(c90f2360,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedd24bb4 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedd24be8 sleepq_switch(c90f2360,0,c15cc031,298,c90f2360,...) at sleepq_switch+0xf7/frame 0xedd24c20 sleepq_wait(c90f8afc,0,edd24c64,1,0,...) at sleepq_wait+0x48/frame 0xedd24c44 _cv_wait(c90f8afc,c90f8cf8,c158ed4e,76,c90f8b04,...) at _cv_wait+0x21e/frame 0xedd24c84 usb_process(c90f8af4,edd24ce8,c15bc328,406,0,...) at usb_process+0x150/frame 0xedd24cac fork_exit(c0a77d30,c90f8af4,edd24ce8) at fork_exit+0x7e/frame 0xedd24cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd24cd4 --- trap 0, eip = 0, esp = 0xedd24d20, ebp = 0 --- Tracing command usb pid 14 tid 100057 td 0xc90f2000 sched_switch(c90f2000,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedd27bb4 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedd27be8 sleepq_switch(c90f2000,0,c15cc031,298,c90f2000,...) at sleepq_switch+0xf7/frame 0xedd27c20 sleepq_wait(c90f8b2c,0,edd27c64,1,0,...) at sleepq_wait+0x48/frame 0xedd27c44 _cv_wait(c90f8b2c,c90f8cf8,c158ed4e,76,c90f8b34,...) at _cv_wait+0x21e/frame 0xedd27c84 usb_process(c90f8b24,edd27ce8,c15bc328,406,0,...) at usb_process+0x150/frame 0xedd27cac fork_exit(c0a77d30,c90f8b24,edd27ce8) at fork_exit+0x7e/frame 0xedd27cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd27cd4 --- trap 0, eip = 0, esp = 0xedd27d20, ebp = 0 --- Tracing command usb pid 14 tid 100058 td 0xc90f1a20 sched_switch(c90f1a20,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedd2abb4 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedd2abe8 sleepq_switch(c90f1a20,0,c15cc031,298,c90f1a20,...) at sleepq_switch+0xf7/frame 0xedd2ac20 sleepq_wait(c90f8b5c,0,edd2ac64,1,0,...) at sleepq_wait+0x48/frame 0xedd2ac44 _cv_wait(c90f8b5c,c90f8cf8,c158ed4e,76,c90f8b64,...) at _cv_wait+0x21e/frame 0xedd2ac84 usb_process(c90f8b54,edd2ace8,c15bc328,406,0,...) at usb_process+0x150/frame 0xedd2acac fork_exit(c0a77d30,c90f8b54,edd2ace8) at fork_exit+0x7e/frame 0xedd2acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd2acd4 --- trap 0, eip = 0, esp = 0xedd2ad20, ebp = 0 --- Tracing command usb pid 14 tid 100059 td 0xc90f16c0 sched_switch(c90f16c0,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedd2dbb4 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedd2dbe8 sleepq_switch(c90f16c0,0,c15cc031,298,c90f16c0,...) at sleepq_switch+0xf7/frame 0xedd2dc20 sleepq_wait(c90f8b8c,0,edd2dc64,1,0,...) at sleepq_wait+0x48/frame 0xedd2dc44 _cv_wait(c90f8b8c,c90f8cf8,c158ed4e,76,c90f8b94,...) at _cv_wait+0x21e/frame 0xedd2dc84 usb_process(c90f8b84,edd2dce8,c15bc328,406,0,...) at usb_process+0x150/frame 0xedd2dcac fork_exit(c0a77d30,c90f8b84,edd2dce8) at fork_exit+0x7e/frame 0xedd2dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd2dcd4 --- trap 0, eip = 0, esp = 0xedd2dd20, ebp = 0 --- Tracing command usb pid 14 tid 100061 td 0xc90f1000 sched_switch(c90f1000,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedd35bb4 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedd35be8 sleepq_switch(c90f1000,0,c15cc031,298,c90f1000,...) at sleepq_switch+0xf7/frame 0xedd35c20 sleepq_wait(c9093ca4,0,edd35c64,1,0,...) at sleepq_wait+0x48/frame 0xedd35c44 _cv_wait(c9093ca4,c9093ed0,c158ed4e,76,c9093cac,...) at _cv_wait+0x21e/frame 0xedd35c84 usb_process(c9093c9c,edd35ce8,c15bc328,406,0,...) at usb_process+0x150/frame 0xedd35cac fork_exit(c0a77d30,c9093c9c,edd35ce8) at fork_exit+0x7e/frame 0xedd35cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd35cd4 --- trap 0, eip = 0, esp = 0xedd35d20, ebp = 0 --- Tracing command usb pid 14 tid 100062 td 0xc90f0a20 sched_switch(c90f0a20,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedd38bb4 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedd38be8 sleepq_switch(c90f0a20,0,c15cc031,298,c90f0a20,...) at sleepq_switch+0xf7/frame 0xedd38c20 sleepq_wait(c9093cd4,0,edd38c64,1,0,...) at sleepq_wait+0x48/frame 0xedd38c44 _cv_wait(c9093cd4,c9093ed0,c158ed4e,76,c9093cdc,...) at _cv_wait+0x21e/frame 0xedd38c84 usb_process(c9093ccc,edd38ce8,c15bc328,406,0,...) at usb_process+0x150/frame 0xedd38cac fork_exit(c0a77d30,c9093ccc,edd38ce8) at fork_exit+0x7e/frame 0xedd38cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd38cd4 --- trap 0, eip = 0, esp = 0xedd38d20, ebp = 0 --- Tracing command usb pid 14 tid 100063 td 0xc90f06c0 sched_switch(c90f06c0,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedd3bbb4 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedd3bbe8 sleepq_switch(c90f06c0,0,c15cc031,298,c90f06c0,...) at sleepq_switch+0xf7/frame 0xedd3bc20 sleepq_wait(c9093d04,0,edd3bc64,1,0,...) at sleepq_wait+0x48/frame 0xedd3bc44 _cv_wait(c9093d04,c9093ed0,c158ed4e,76,c9093d0c,...) at _cv_wait+0x21e/frame 0xedd3bc84 usb_process(c9093cfc,edd3bce8,c15bc328,406,0,...) at usb_process+0x150/frame 0xedd3bcac fork_exit(c0a77d30,c9093cfc,edd3bce8) at fork_exit+0x7e/frame 0xedd3bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd3bcd4 --- trap 0, eip = 0, esp = 0xedd3bd20, ebp = 0 --- Tracing command usb pid 14 tid 100064 td 0xc90f0360 sched_switch(c90f0360,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedd3ebb4 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedd3ebe8 sleepq_switch(c90f0360,0,c15cc031,298,c90f0360,...) at sleepq_switch+0xf7/frame 0xedd3ec20 sleepq_wait(c9093d34,0,edd3ec64,1,0,...) at sleepq_wait+0x48/frame 0xedd3ec44 _cv_wait(c9093d34,c9093ed0,c158ed4e,76,c9093d3c,...) at _cv_wait+0x21e/frame 0xedd3ec84 usb_process(c9093d2c,edd3ece8,c15bc328,406,0,...) at usb_process+0x150/frame 0xedd3ecac fork_exit(c0a77d30,c9093d2c,edd3ece8) at fork_exit+0x7e/frame 0xedd3ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd3ecd4 --- trap 0, eip = 0, esp = 0xedd3ed20, ebp = 0 --- Tracing command usb pid 14 tid 100065 td 0xc90f0000 sched_switch(c90f0000,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedd41bb4 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedd41be8 sleepq_switch(c90f0000,0,c15cc031,298,c90f0000,...) at sleepq_switch+0xf7/frame 0xedd41c20 sleepq_wait(c9093d64,0,edd41c64,1,0,...) at sleepq_wait+0x48/frame 0xedd41c44 _cv_wait(c9093d64,c9093ed0,c158ed4e,76,c9093d6c,...) at _cv_wait+0x21e/frame 0xedd41c84 usb_process(c9093d5c,edd41ce8,c15bc328,406,0,...) at usb_process+0x150/frame 0xedd41cac fork_exit(c0a77d30,c9093d5c,edd41ce8) at fork_exit+0x7e/frame 0xedd41cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd41cd4 --- trap 0, eip = 0, esp = 0xedd41d20, ebp = 0 --- Tracing command cam pid 4 tid 100028 td 0xc902c360 sched_switch(c902c360,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xe4b7cb7c mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xe4b7cbb0 sleepq_switch(c902c360,0,c15cc031,298,0,...) at sleepq_switch+0xf7/frame 0xe4b7cbe8 sleepq_wait(c18d3400,5c,c15ac19b,0,0,...) at sleepq_wait+0x48/frame 0xe4b7cc0c _sleep(c18d3400,c18d3380,5c,c15ac19b,0,...) at _sleep+0x350/frame 0xe4b7cc60 xpt_done_td(c18d3380,e4b7cce8,c15bc328,406,0,...) at xpt_done_td+0x9e/frame 0xe4b7ccac fork_exit(c04e0740,c18d3380,e4b7cce8) at fork_exit+0x7e/frame 0xe4b7ccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b7ccd4 --- trap 0, eip = 0, esp = 0xe4b7cd20, ebp = 0 --- Tracing command cam pid 4 tid 100075 td 0xc9125000 sched_switch(c9125000,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedd7ab74 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedd7aba8 sleepq_switch(c9125000,0,c15cc031,298,0,...) at sleepq_switch+0xf7/frame 0xedd7abe0 sleepq_wait(c18d32ac,5c,c15ac19b,0,0,...) at sleepq_wait+0x48/frame 0xedd7ac04 _sleep(c18d32ac,c18d32fc,5c,c15ac19b,0,...) at _sleep+0x350/frame 0xedd7ac58 xpt_scanner_thread(0,edd7ace8,c15bc328,406,0,...) at xpt_scanner_thread+0xa2/frame 0xedd7acac fork_exit(c04e0ad0,0,edd7ace8) at fork_exit+0x7e/frame 0xedd7acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd7acd4 --- trap 0, eip = 0, esp = 0xedd7ad20, ebp = 0 --- Tracing command crypto returns pid 3 tid 100024 td 0xc8e6ba20 sched_switch(c8e6ba20,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xe4b70b7c mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xe4b70bb0 sleepq_switch(c8e6ba20,0,c15cc031,298,0,...) at sleepq_switch+0xf7/frame 0xe4b70be8 sleepq_wait(c1b2df98,6c,c1608b10,0,0,...) at sleepq_wait+0x48/frame 0xe4b70c0c _sleep(c1b2df98,c1b2df84,6c,c1608b10,0,...) at _sleep+0x350/frame 0xe4b70c60 crypto_ret_proc(0,e4b70ce8,c15bc328,406,0,...) at crypto_ret_proc+0x1f5/frame 0xe4b70cac fork_exit(c0eaeaf0,0,e4b70ce8) at fork_exit+0x7e/frame 0xe4b70cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b70cd4 --- trap 0, eip = 0, esp = 0xe4b70d20, ebp = 0 --- Tracing command crypto pid 2 tid 100023 td 0xc8f33000 sched_switch(c8f33000,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xe4b6db88 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xe4b6dbbc sleepq_switch(c8f33000,0,c15cc031,298,0,...) at sleepq_switch+0xf7/frame 0xe4b6dbf4 sleepq_wait(c1b2dee0,6c,c1608b04,0,0,...) at sleepq_wait+0x48/frame 0xe4b6dc18 _sleep(c1b2dee0,c1b2dec8,6c,c1608b04,0,...) at _sleep+0x350/frame 0xe4b6dc6c crypto_proc(0,e4b6dce8,c15bc328,406,0,...) at crypto_proc+0x297/frame 0xe4b6dcac fork_exit(c0eae6e0,0,e4b6dce8) at fork_exit+0x7e/frame 0xe4b6dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b6dcd4 --- trap 0, eip = 0, esp = 0xe4b6dd20, ebp = 0 --- Tracing command geom pid 13 tid 100019 td 0xc8f34000 sched_switch(c8f34000,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xe4b61b8c mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xe4b61bc0 sleepq_switch(c8f34000,0,c15cc031,298,0,...) at sleepq_switch+0xf7/frame 0xe4b61bf8 sleepq_wait(c1b86330,5c,c15ac19b,0,0,...) at sleepq_wait+0x48/frame 0xe4b61c1c _sleep(c1b86330,c1aab8e8,25c,c15ac19b,0,...) at _sleep+0x350/frame 0xe4b61c70 g_run_events(0,e4b61ce8,c15bc328,406,0,...) at g_run_events+0x65/frame 0xe4b61cac fork_exit(c0b79870,0,e4b61ce8) at fork_exit+0x7e/frame 0xe4b61cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b61cd4 --- trap 0, eip = 0, esp = 0xe4b61d20, ebp = 0 --- Tracing command geom pid 13 tid 100020 td 0xc8f33a20 sched_switch(c8f33a20,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xe4b64b7c mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xe4b64bb0 sleepq_switch(c8f33a20,0,c15cc031,298,0,...) at sleepq_switch+0xf7/frame 0xe4b64be8 sleepq_wait(c1b86334,5c,c15ac19b,0,0,...) at sleepq_wait+0x48/frame 0xe4b64c0c _sleep(c1b86334,c1aab930,25c,c15ac19b,0,...) at _sleep+0x350/frame 0xe4b64c60 g_io_schedule_up(c8f33a20,0,c15ae0d2,5f,e4b64cd4,...) at g_io_schedule_up+0xcf/frame 0xe4b64c94 g_up_procbody(0,e4b64ce8,c15bc328,406,0,...) at g_up_procbody+0x7d/frame 0xe4b64cac fork_exit(c0b798f0,0,e4b64ce8) at fork_exit+0x7e/frame 0xe4b64cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b64cd4 --- trap 0, eip = 0, esp = 0xe4b64d20, ebp = 0 --- Tracing command geom pid 13 tid 100021 td 0xc8f336c0 sched_switch(c8f336c0,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xe4b67b78 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xe4b67bac sleepq_switch(c8f336c0,0,c15cc031,298,0,...) at sleepq_switch+0xf7/frame 0xe4b67be4 sleepq_wait(c1b86338,5c,c15ac19b,0,0,...) at sleepq_wait+0x48/frame 0xe4b67c08 _sleep(c1b86338,c1aab910,25c,c15ac19b,0,...) at _sleep+0x350/frame 0xe4b67c5c g_io_schedule_down(c8f336c0,0,c15ae0d2,6b,e4b67cd4,...) at g_io_schedule_down+0xec/frame 0xe4b67c94 g_down_procbody(0,e4b67ce8,c15bc328,406,0,...) at g_down_procbody+0x7d/frame 0xe4b67cac fork_exit(c0b79970,0,e4b67ce8) at fork_exit+0x7e/frame 0xe4b67cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b67cd4 --- trap 0, eip = 0, esp = 0xe4b67d20, ebp = 0 --- Tracing command intr pid 12 tid 100007 td 0xc8e696c0 sched_switch(c8e696c0,0,109,191,9,...) at sched_switch+0x48e/frame 0xe4b3dc3c mi_switch(109,0,c15bc6e1,555,c15bc328,...) at mi_switch+0x18c/frame 0xe4b3dc70 ithread_loop(c8ebb020,e4b3dce8,c15bc328,406,0,...) at ithread_loop+0x1f0/frame 0xe4b3dcac fork_exit(c0bf3c60,c8ebb020,e4b3dce8) at fork_exit+0x7e/frame 0xe4b3dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b3dcd4 --- trap 0, eip = 0, esp = 0xe4b3dd20, ebp = 0 --- Tracing command intr pid 12 tid 100008 td 0xc8e69360 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100009 td 0xc8e69000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100010 td 0xc8e5ea20 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100011 td 0xc8e5e6c0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100012 td 0xc8e5e360 sched_switch(c8e5e360,0,109,191,9,...) at sched_switch+0x48e/frame 0xe4b4cc3c mi_switch(109,0,c15bc6e1,555,c15bc328,...) at mi_switch+0x18c/frame 0xe4b4cc70 ithread_loop(c8ebaf70,e4b4cce8,c15bc328,406,0,...) at ithread_loop+0x1f0/frame 0xe4b4ccac fork_exit(c0bf3c60,c8ebaf70,e4b4cce8) at fork_exit+0x7e/frame 0xe4b4ccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b4ccd4 --- trap 0, eip = 0, esp = 0xe4b4cd20, ebp = 0 --- Tracing command intr pid 12 tid 100013 td 0xc8e5e000 sched_switch(c8e5e000,0,109,191,9,...) at sched_switch+0x48e/frame 0xe4b4fc3c mi_switch(109,0,c15bc6e1,555,c15bc328,...) at mi_switch+0x18c/frame 0xe4b4fc70 ithread_loop(c8ebaf60,e4b4fce8,c15bc328,406,0,...) at ithread_loop+0x1f0/frame 0xe4b4fcac fork_exit(c0bf3c60,c8ebaf60,e4b4fce8) at fork_exit+0x7e/frame 0xe4b4fcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b4fcd4 --- trap 0, eip = 0, esp = 0xe4b4fd20, ebp = 0 --- Tracing command intr pid 12 tid 100014 td 0xc8f35360 sched_switch(c8f35360,0,109,191,9,...) at sched_switch+0x48e/frame 0xe4b52c3c mi_switch(109,0,c15bc6e1,555,c15bc328,...) at mi_switch+0x18c/frame 0xe4b52c70 ithread_loop(c8ebaf50,e4b52ce8,c15bc328,406,0,...) at ithread_loop+0x1f0/frame 0xe4b52cac fork_exit(c0bf3c60,c8ebaf50,e4b52ce8) at fork_exit+0x7e/frame 0xe4b52cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b52cd4 --- trap 0, eip = 0, esp = 0xe4b52d20, ebp = 0 --- Tracing command intr pid 12 tid 100017 td 0xc8f346c0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100029 td 0xc902c000 sched_switch(c902c000,0,109,191,9,...) at sched_switch+0x48e/frame 0xe4baec3c mi_switch(109,0,c15bc6e1,555,c15bc328,...) at mi_switch+0x18c/frame 0xe4baec70 ithread_loop(c8ebaf30,e4baece8,c15bc328,406,0,...) at ithread_loop+0x1f0/frame 0xe4baecac fork_exit(c0bf3c60,c8ebaf30,e4baece8) at fork_exit+0x7e/frame 0xe4baecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4baecd4 --- trap 0, eip = 0, esp = 0xe4baed20, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc902ba20 sched_switch(c902ba20,0,109,191,9,...) at sched_switch+0x48e/frame 0xf0eb6c3c mi_switch(109,0,c15bc6e1,555,c15bc328,...) at mi_switch+0x18c/frame 0xf0eb6c70 ithread_loop(c8ebaf20,f0eb6ce8,c15bc328,406,0,...) at ithread_loop+0x1f0/frame 0xf0eb6cac fork_exit(c0bf3c60,c8ebaf20,f0eb6ce8) at fork_exit+0x7e/frame 0xf0eb6cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf0eb6cd4 --- trap 0, eip = 0, esp = 0xf0eb6d20, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xc902b6c0 sched_switch(c902b6c0,0,109,191,9,...) at sched_switch+0x48e/frame 0xf0ebac3c mi_switch(109,0,c15bc6e1,555,c15bc328,...) at mi_switch+0x18c/frame 0xf0ebac70 ithread_loop(c8ebaf10,f0ebace8,c15bc328,406,0,...) at ithread_loop+0x1f0/frame 0xf0ebacac fork_exit(c0bf3c60,c8ebaf10,f0ebace8) at fork_exit+0x7e/frame 0xf0ebacd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf0ebacd4 --- trap 0, eip = 0, esp = 0xf0ebad20, ebp = 0 --- Tracing command intr pid 12 tid 100032 td 0xc902b360 sched_switch(c902b360,0,109,191,9,...) at sched_switch+0x48e/frame 0xf0ff9c3c mi_switch(109,0,c15bc6e1,555,c15bc328,...) at mi_switch+0x18c/frame 0xf0ff9c70 ithread_loop(c8ebaf00,f0ff9ce8,c15bc328,406,0,...) at ithread_loop+0x1f0/frame 0xf0ff9cac fork_exit(c0bf3c60,c8ebaf00,f0ff9ce8) at fork_exit+0x7e/frame 0xf0ff9cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf0ff9cd4 --- trap 0, eip = 0, esp = 0xf0ff9d20, ebp = 0 --- Tracing command intr pid 12 tid 100038 td 0xc8f35a20 sched_switch(c8f35a20,0,109,191,9,...) at sched_switch+0x48e/frame 0xedcebc3c mi_switch(109,0,c15bc6e1,555,c15bc328,...) at mi_switch+0x18c/frame 0xedcebc70 ithread_loop(c8ebaef0,edcebce8,c15bc328,406,0,...) at ithread_loop+0x1f0/frame 0xedcebcac fork_exit(c0bf3c60,c8ebaef0,edcebce8) at fork_exit+0x7e/frame 0xedcebcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedcebcd4 --- trap 0, eip = 0, esp = 0xedcebd20, ebp = 0 --- Tracing command intr pid 12 tid 100044 td 0xc90e2a20 sched_switch(c90e2a20,0,109,191,9,...) at sched_switch+0x48e/frame 0xedcfec3c mi_switch(109,0,c15bc6e1,555,c15bc328,...) at mi_switch+0x18c/frame 0xedcfec70 ithread_loop(c8ebaee0,edcfece8,c15bc328,406,0,...) at ithread_loop+0x1f0/frame 0xedcfecac fork_exit(c0bf3c60,c8ebaee0,edcfece8) at fork_exit+0x7e/frame 0xedcfecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedcfecd4 --- trap 0, eip = 0, esp = 0xedcfed20, ebp = 0 --- Tracing command intr pid 12 tid 100060 td 0xc90f1360 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100066 td 0xc9127360 sched_switch(c9127360,0,109,191,9,...) at sched_switch+0x48e/frame 0xedd46c3c mi_switch(109,0,c15bc6e1,555,c1abbe00,...) at mi_switch+0x18c/frame 0xedd46c70 ithread_loop(c8ebaea0,edd46ce8,c15bc328,406,0,...) at ithread_loop+0x1f0/frame 0xedd46cac fork_exit(c0bf3c60,c8ebaea0,edd46ce8) at fork_exit+0x7e/frame 0xedd46cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd46cd4 --- trap 0, eip = 0, esp = 0xedd46d20, ebp = 0 --- Tracing command intr pid 12 tid 100067 td 0xc9127000 sched_switch(c9127000,0,109,191,9,...) at sched_switch+0x48e/frame 0xedd57c3c mi_switch(109,0,c15bc6e1,555,c15bc328,...) at mi_switch+0x18c/frame 0xedd57c70 ithread_loop(c8ebae80,edd57ce8,c15bc328,406,0,...) at ithread_loop+0x1f0/frame 0xedd57cac fork_exit(c0bf3c60,c8ebae80,edd57ce8) at fork_exit+0x7e/frame 0xedd57cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd57cd4 --- trap 0, eip = 0, esp = 0xedd57d20, ebp = 0 --- Tracing command intr pid 12 tid 100069 td 0xc91266c0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100070 td 0xc9126360 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xc8e6a6c0 (CPU 0) cpustop_handler(0,13,e4b30b8c,c11cb4c0,c15b8d8a,...) at cpustop_handler+0x25/frame 0xe4b30a40 ipi_nmi_handler(c15b8d8a,2fc,0,c1aadb58,c1abbe10,...) at ipi_nmi_handler+0x36/frame 0xe4b30a50 trap(e4b30b98) at trap+0x30/frame 0xe4b30b8c calltrap() at calltrap+0x6/frame 0xe4b30b8c --- trap 0x13, eip = 0xc11e59a5, esp = 0xe4b30bd8, ebp = 0xe4b30bd8 --- acpi_cpu_c1(e4b30c2c,c11d50e9,c2027c90,0,c17d3317,...) at acpi_cpu_c1+0x5/frame 0xe4b30bd8 acpi_cpu_idle(12c8e48,0,12c8e48,e4b30c48,c11e5d6a,...) at acpi_cpu_idle+0x31e/frame 0xe4b30c18 cpu_idle_acpi(12c8e48,0,c1abbe00,0,c8e6a6c0,...) at cpu_idle_acpi+0x3f/frame 0xe4b30c2c cpu_idle(0,e4b30c80,c15c7d3f,a57,0,...) at cpu_idle+0x9a/frame 0xe4b30c48 sched_idletd(0,e4b30ce8,c15bc328,406,0,...) at sched_idletd+0x3d2/frame 0xe4b30cac fork_exit(c0c5ddd0,0,e4b30ce8) at fork_exit+0x7e/frame 0xe4b30cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b30cd4 --- trap 0, eip = 0, esp = 0xe4b30d20, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc8e6a360 (CPU 1) cpustop_handler(1,13,e4b33b8c,c11cb4c0,3c9,...) at cpustop_handler+0x25/frame 0xe4b33a40 ipi_nmi_handler(3c9,c15cc031,2fc,3c9,c8e6a360,...) at ipi_nmi_handler+0x36/frame 0xe4b33a50 trap(e4b33b98) at trap+0x30/frame 0xe4b33b8c calltrap() at calltrap+0x6/frame 0xe4b33b8c --- trap 0x13, eip = 0xc11e59a5, esp = 0xe4b33bd8, ebp = 0xe4b33bd8 --- acpi_cpu_c1(e4b33c2c,c11d50e9,e4b17c90,0,c17d3317,...) at acpi_cpu_c1+0x5/frame 0xe4b33bd8 acpi_cpu_idle(3f4af194,0,3f4af194,e4b33c48,c11e5d6a,...) at acpi_cpu_idle+0x31e/frame 0xe4b33c18 cpu_idle_acpi(3f4af194,0,c1abc500,5,c8e6a360,...) at cpu_idle_acpi+0x3f/frame 0xe4b33c2c cpu_idle(0,e4b33c80,c15c7d3f,a57,0,...) at cpu_idle+0x9a/frame 0xe4b33c48 sched_idletd(0,e4b33ce8,c15bc328,406,0,...) at sched_idletd+0x3d2/frame 0xe4b33cac fork_exit(c0c5ddd0,0,e4b33ce8) at fork_exit+0x7e/frame 0xe4b33cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b33cd4 --- trap 0, eip = 0, esp = 0xe4b33d20, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc8e6a000 (CPU 2) kdb_alt_break_internal(0,e4b36adc,c0a3d4f7,2,c9136884,...) at kdb_alt_break_internal+0xec/frame 0xe4b36ab0 kdb_alt_break(2,c9136884,c1584eab,0,40000,...) at kdb_alt_break+0x16/frame 0xe4b36abc uart_intr_rxready(c9136800,c1abcc10,0,c15bc6e1,39a,...) at uart_intr_rxready+0x87/frame 0xe4b36adc uart_intr(c9136800,0,23247c00,c1abcc10,c8e6a000,...) at uart_intr+0x120/frame 0xe4b36b1c intr_event_handle(c8e53a80,e4b36b98,ffffffff,2,0,...) at intr_event_handle+0x7a/frame 0xe4b36b48 intr_execute_handlers(c8ce8908,e4b36b98,2) at intr_execute_handlers+0x42/frame 0xe4b36b68 lapic_handle_intr(30,e4b36b98) at lapic_handle_intr+0x5d/frame 0xe4b36b88 Xapic_isr1() at Xapic_isr1+0x55/frame 0xe4b36b88 --- interrupt, eip = 0xc11e59a5, esp = 0xe4b36bd8, ebp = 0xe4b36bd8 --- acpi_cpu_c1(e4b36c2c,c11d50e9,e4b1ac90,0,c17d3317,...) at acpi_cpu_c1+0x5/frame 0xe4b36bd8 acpi_cpu_idle(5bfe9469,0,5bfe9469,e4b36c48,c11e5d6a,...) at acpi_cpu_idle+0x31e/frame 0xe4b36c18 cpu_idle_acpi(5bfe9469,0,c1abcc00,4,c8e6a000,...) at cpu_idle_acpi+0x3f/frame 0xe4b36c2c cpu_idle(0,e4b36c80,c15c7d3f,a57,0,...) at cpu_idle+0x9a/frame 0xe4b36c48 sched_idletd(0,e4b36ce8,c15bc328,406,0,...) at sched_idletd+0x3d2/frame 0xe4b36cac fork_exit(c0c5ddd0,0,e4b36ce8) at fork_exit+0x7e/frame 0xe4b36cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b36cd4 --- trap 0, eip = 0, esp = 0xe4b36d20, ebp = 0 --- Tracing command idle pid 11 tid 100006 td 0xc8e69a20 (CPU 3) cpustop_handler(3,13,e4b39b8c,c11cb4c0,a,...) at cpustop_handler+0x25/frame 0xe4b39a40 ipi_nmi_handler(a,c15c6a92,229,c1b47d34,3,...) at ipi_nmi_handler+0x36/frame 0xe4b39a50 trap(e4b39b98) at trap+0x30/frame 0xe4b39b8c calltrap() at calltrap+0x6/frame 0xe4b39b8c --- trap 0x13, eip = 0xc11e59a5, esp = 0xe4b39bd8, ebp = 0xe4b39bd8 --- acpi_cpu_c1(e4b39c2c,c11d50e9,e4b1dc90,0,c17d3317,...) at acpi_cpu_c1+0x5/frame 0xe4b39bd8 acpi_cpu_idle(7f1e2be0,0,7f1e2be0,e4b39c48,c11e5d6a,...) at acpi_cpu_idle+0x31e/frame 0xe4b39c18 cpu_idle_acpi(7f1e2be0,0,c1abd300,1,c8e69a20,...) at cpu_idle_acpi+0x3f/frame 0xe4b39c2c cpu_idle(0,e4b39c80,c15c7d3f,407,0,...) at cpu_idle+0x9a/frame 0xe4b39c48 sched_idletd(0,e4b39ce8,c15bc328,406,0,...) at sched_idletd+0x3d2/frame 0xe4b39cac fork_exit(c0c5ddd0,0,e4b39ce8) at fork_exit+0x7e/frame 0xe4b39cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b39cd4 --- trap 0, eip = 0, esp = 0xe4b39d20, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc8e6aa20 sched_switch(c8e6aa20,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xe4b2c918 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xe4b2c94c sleepq_switch(c8e6aa20,0,c15cc031,1c2,1a8,...) at sleepq_switch+0xf7/frame 0xe4b2c984 sleepq_catch_signals(c15cc031,170,c8e5cab4,9f,100,...) at sleepq_catch_signals+0x352/frame 0xe4b2c9c4 sleepq_wait_sig(c8e5c9fc,6c,c15d02c3,100,0,...) at sleepq_wait_sig+0x14/frame 0xe4b2c9e8 _sleep(c8e5c9fc,c8e5caa4,16c,c15d02c3,0,...) at _sleep+0x33d/frame 0xe4b2ca3c kern_wait6(c8e6aa20,7,0,0,e4b2cacc,...) at kern_wait6+0x4b1/frame 0xe4b2caa0 sys_wait4(c8e6aa20,e4b2cc00,c15bbd67,4,c8e74ab8,...) at sys_wait4+0x87/frame 0xe4b2cbc0 syscall(e4b2cce8) at syscall+0x3b5/frame 0xe4b2ccdc Xint0x80_syscall() at Xint0x80_syscall+0x2e/frame 0xe4b2ccdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x8065597, esp = 0xbfbfe844, ebp = 0xbfbfe858 --- Tracing command audit pid 10 tid 100001 td 0xc8e6b000 sched_switch(c8e6b000,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xe4b29b88 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xe4b29bbc sleepq_switch(c8e6b000,0,c15cc031,298,c8e6b000,...) at sleepq_switch+0xf7/frame 0xe4b29bf4 sleepq_wait(c1b8e0fc,0,e4b29c38,1,0,...) at sleepq_wait+0x48/frame 0xe4b29c18 _cv_wait(c1b8e0fc,c1b8e088,c160b046,1ab,8,...) at _cv_wait+0x21e/frame 0xe4b29c58 audit_worker(0,e4b29ce8,c15bc328,406,0,...) at audit_worker+0x94/frame 0xe4b29cac fork_exit(c0ecfb20,0,e4b29ce8) at fork_exit+0x7e/frame 0xe4b29cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b29cd4 --- trap 0, eip = 0, esp = 0xe4b29d20, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc1b866c0 sched_switch(c1b866c0,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xc2022c0c mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xc2022c40 sleepq_switch(c1b866c0,0,c15cc031,2bb,0,...) at sleepq_switch+0xf7/frame 0xc2022c78 sleepq_timedwait(c1b86364,54,9,0,0,...) at sleepq_timedwait+0x48/frame 0xc2022c9c _sleep(c1b86364,0,54,c161692a,fffff470,...) at _sleep+0x324/frame 0xc2022cf0 swapper() at swapper+0x2c4/frame 0xc2022d38 begin() at begin+0x22 Tracing command kernel pid 0 tid 100015 td 0xc8f35000 sched_switch(c8f35000,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xe4b55b90 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xe4b55bc4 sleepq_switch(c8f35000,0,c15cc031,298,0,...) at sleepq_switch+0xf7/frame 0xe4b55bfc sleepq_wait(c8e62080,0,c15ac19b,0,0,...) at sleepq_wait+0x48/frame 0xe4b55c20 _sleep(c8e62080,c8e6209c,0,c15ac19b,0,...) at _sleep+0x350/frame 0xe4b55c74 taskqueue_thread_loop(c1b8aa1c,e4b55ce8,c15bc328,406,0,...) at taskqueue_thread_loop+0x144/frame 0xe4b55cac fork_exit(c0c859a0,c1b8aa1c,e4b55ce8) at fork_exit+0x7e/frame 0xe4b55cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b55cd4 --- trap 0, eip = 0, esp = 0xe4b55d20, ebp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xc8f34a20 sched_switch(c8f34a20,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xe4b58b90 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xe4b58bc4 sleepq_switch(c8f34a20,0,c15cc031,298,0,...) at sleepq_switch+0xf7/frame 0xe4b58bfc sleepq_wait(c8e62000,0,c15ac19b,0,0,...) at sleepq_wait+0x48/frame 0xe4b58c20 _sleep(c8e62000,c8e6201c,0,c15ac19b,0,...) at _sleep+0x350/frame 0xe4b58c74 taskqueue_thread_loop(c1b8aa98,e4b58ce8,c15bc328,406,0,...) at taskqueue_thread_loop+0x144/frame 0xe4b58cac fork_exit(c0c859a0,c1b8aa98,e4b58ce8) at fork_exit+0x7e/frame 0xe4b58cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b58cd4 --- trap 0, eip = 0, esp = 0xe4b58d20, ebp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xc8f34360 sched_switch(c8f34360,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xe4b5eb90 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xe4b5ebc4 sleepq_switch(c8f34360,0,c15cc031,298,0,...) at sleepq_switch+0xf7/frame 0xe4b5ebfc sleepq_wait(c8e61e80,0,c15ac19b,0,0,...) at sleepq_wait+0x48/frame 0xe4b5ec20 _sleep(c8e61e80,c8e61e9c,0,c15ac19b,0,...) at _sleep+0x350/frame 0xe4b5ec74 taskqueue_thread_loop(c1b86c40,e4b5ece8,c15bc328,406,0,...) at taskqueue_thread_loop+0x144/frame 0xe4b5ecac fork_exit(c0c859a0,c1b86c40,e4b5ece8) at fork_exit+0x7e/frame 0xe4b5ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b5ecd4 --- trap 0, eip = 0, esp = 0xe4b5ed20, ebp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xc8f33360 sched_switch(c8f33360,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xe4b6ab90 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xe4b6abc4 sleepq_switch(c8f33360,0,c15cc031,298,0,...) at sleepq_switch+0xf7/frame 0xe4b6abfc sleepq_wait(c8e61e00,0,c15ac19b,0,0,...) at sleepq_wait+0x48/frame 0xe4b6ac20 _sleep(c8e61e00,c8e61e1c,0,c15ac19b,0,...) at _sleep+0x350/frame 0xe4b6ac74 taskqueue_thread_loop(c1ac9f20,e4b6ace8,c15bc328,406,0,...) at taskqueue_thread_loop+0x144/frame 0xe4b6acac fork_exit(c0c859a0,c1ac9f20,e4b6ace8) at fork_exit+0x7e/frame 0xe4b6acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b6acd4 --- trap 0, eip = 0, esp = 0xe4b6ad20, ebp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xc8e6b6c0 sched_switch(c8e6b6c0,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xe4b73ba0 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xe4b73bd4 sleepq_switch(c8e6b6c0,0,c15cc031,298,c8e61d80,...) at sleepq_switch+0xf7/frame 0xe4b73c0c sleepq_wait(c8e61d80,0,c15c5bc5,c15ac19b,0,...) at sleepq_wait+0x48/frame 0xe4b73c30 msleep_spin_sbt(c8e61d80,c8e61d9c,c15ac19b,0,0,...) at msleep_spin_sbt+0x226/frame 0xe4b73c74 taskqueue_thread_loop(c1b7c484,e4b73ce8,c15bc328,406,0,...) at taskqueue_thread_loop+0xf3/frame 0xe4b73cac fork_exit(c0c859a0,c1b7c484,e4b73ce8) at fork_exit+0x7e/frame 0xe4b73cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b73cd4 --- trap 0, eip = 0, esp = 0xe4b73d20, ebp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xc8e6b360 sched_switch(c8e6b360,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xe4b76ba0 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xe4b76bd4 sleepq_switch(c8e6b360,0,c15cc031,298,c8e61d80,...) at sleepq_switch+0xf7/frame 0xe4b76c0c sleepq_wait(c8e61d80,0,c15c5bc5,c15ac19b,0,...) at sleepq_wait+0x48/frame 0xe4b76c30 msleep_spin_sbt(c8e61d80,c8e61d9c,c15ac19b,0,0,...) at msleep_spin_sbt+0x226/frame 0xe4b76c74 taskqueue_thread_loop(c1b7c484,e4b76ce8,c15bc328,406,0,...) at taskqueue_thread_loop+0xf3/frame 0xe4b76cac fork_exit(c0c859a0,c1b7c484,e4b76ce8) at fork_exit+0x7e/frame 0xe4b76cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b76cd4 --- trap 0, eip = 0, esp = 0xe4b76d20, ebp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xc902c6c0 sched_switch(c902c6c0,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xe4b79ba0 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xe4b79bd4 sleepq_switch(c902c6c0,0,c15cc031,298,c8e61d80,...) at sleepq_switch+0xf7/frame 0xe4b79c0c sleepq_wait(c8e61d80,0,c15c5bc5,c15ac19b,0,...) at sleepq_wait+0x48/frame 0xe4b79c30 msleep_spin_sbt(c8e61d80,c8e61d9c,c15ac19b,0,0,...) at msleep_spin_sbt+0x226/frame 0xe4b79c74 taskqueue_thread_loop(c1b7c484,e4b79ce8,c15bc328,406,0,...) at taskqueue_thread_loop+0xf3/frame 0xe4b79cac fork_exit(c0c859a0,c1b7c484,e4b79ce8) at fork_exit+0x7e/frame 0xe4b79cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b79cd4 --- trap 0, eip = 0, esp = 0xe4b79d20, ebp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xc9126000 sched_switch(c9126000,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedd6dba0 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedd6dbd4 sleepq_switch(c9126000,0,c15cc031,298,c8e60200,...) at sleepq_switch+0xf7/frame 0xedd6dc0c sleepq_wait(c8e60200,0,c15c5bc5,c15ac19b,0,...) at sleepq_wait+0x48/frame 0xedd6dc30 msleep_spin_sbt(c8e60200,c8e6021c,c15ac19b,0,0,...) at msleep_spin_sbt+0x226/frame 0xedd6dc74 taskqueue_thread_loop(c1b7a8b8,edd6dce8,c15bc328,406,0,...) at taskqueue_thread_loop+0xf3/frame 0xedd6dcac fork_exit(c0c859a0,c1b7a8b8,edd6dce8) at fork_exit+0x7e/frame 0xedd6dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd6dcd4 --- trap 0, eip = 0, esp = 0xedd6dd20, ebp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xc9125360 sched_switch(c9125360,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedd77b90 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedd77bc4 sleepq_switch(c9125360,0,c15cc031,298,0,...) at sleepq_switch+0xf7/frame 0xedd77bfc sleepq_wait(c8e61700,0,c15ac19b,0,0,...) at sleepq_wait+0x48/frame 0xedd77c20 _sleep(c8e61700,c8e6171c,0,c15ac19b,0,...) at _sleep+0x350/frame 0xedd77c74 taskqueue_thread_loop(c18d3324,edd77ce8,c15bc328,406,0,...) at taskqueue_thread_loop+0x144/frame 0xedd77cac fork_exit(c0c859a0,c18d3324,edd77ce8) at fork_exit+0x7e/frame 0xedd77cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd77cd4 --- trap 0, eip = 0, esp = 0xedd77d20, ebp = 0 --- Tracing command kernel pid 0 tid 100088 td 0xc93b6a20 sched_switch(c93b6a20,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedf21ba0 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedf21bd4 sleepq_switch(c93b6a20,0,c15cc031,298,c8e5fb00,...) at sleepq_switch+0xf7/frame 0xedf21c0c sleepq_wait(c8e5fb00,0,c15c5bc5,c15ac19b,0,...) at sleepq_wait+0x48/frame 0xedf21c30 msleep_spin_sbt(c8e5fb00,c8e5fb1c,c15ac19b,0,0,...) at msleep_spin_sbt+0x226/frame 0xedf21c74 gtaskqueue_thread_loop(c8f25c04,edf21ce8,c15bc328,406,0,...) at gtaskqueue_thread_loop+0xf3/frame 0xedf21cac fork_exit(c0c71630,c8f25c04,edf21ce8) at fork_exit+0x7e/frame 0xedf21cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf21cd4 --- trap 0, eip = 0, esp = 0xedf21d20, ebp = 0 --- Tracing command kernel pid 0 tid 100089 td 0xc93b66c0 sched_switch(c93b66c0,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedf24ba0 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedf24bd4 sleepq_switch(c93b66c0,0,c15cc031,298,c8e5fa80,...) at sleepq_switch+0xf7/frame 0xedf24c0c sleepq_wait(c8e5fa80,0,c15c5bc5,c15ac19b,0,...) at sleepq_wait+0x48/frame 0xedf24c30 msleep_spin_sbt(c8e5fa80,c8e5fa9c,c15ac19b,0,0,...) at msleep_spin_sbt+0x226/frame 0xedf24c74 gtaskqueue_thread_loop(c8f26004,edf24ce8,c15bc328,406,0,...) at gtaskqueue_thread_loop+0xf3/frame 0xedf24cac fork_exit(c0c71630,c8f26004,edf24ce8) at fork_exit+0x7e/frame 0xedf24cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf24cd4 --- trap 0, eip = 0, esp = 0xedf24d20, ebp = 0 --- Tracing command kernel pid 0 tid 100090 td 0xc93b6360 sched_switch(c93b6360,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedf27ba0 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedf27bd4 sleepq_switch(c93b6360,0,c15cc031,298,c8e5fa00,...) at sleepq_switch+0xf7/frame 0xedf27c0c sleepq_wait(c8e5fa00,0,c15c5bc5,c15ac19b,0,...) at sleepq_wait+0x48/frame 0xedf27c30 msleep_spin_sbt(c8e5fa00,c8e5fa1c,c15ac19b,0,0,...) at msleep_spin_sbt+0x226/frame 0xedf27c74 gtaskqueue_thread_loop(c8f26014,edf27ce8,c15bc328,406,0,...) at gtaskqueue_thread_loop+0xf3/frame 0xedf27cac fork_exit(c0c71630,c8f26014,edf27ce8) at fork_exit+0x7e/frame 0xedf27cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf27cd4 --- trap 0, eip = 0, esp = 0xedf27d20, ebp = 0 --- Tracing command kernel pid 0 tid 100091 td 0xc93b6000 sched_switch(c93b6000,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedf2aba0 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedf2abd4 sleepq_switch(c93b6000,0,c15cc031,298,c8e5f980,...) at sleepq_switch+0xf7/frame 0xedf2ac0c sleepq_wait(c8e5f980,0,c15c5bc5,c15ac19b,0,...) at sleepq_wait+0x48/frame 0xedf2ac30 msleep_spin_sbt(c8e5f980,c8e5f99c,c15ac19b,0,0,...) at msleep_spin_sbt+0x226/frame 0xedf2ac74 gtaskqueue_thread_loop(c8f26024,edf2ace8,c15bc328,406,0,...) at gtaskqueue_thread_loop+0xf3/frame 0xedf2acac fork_exit(c0c71630,c8f26024,edf2ace8) at fork_exit+0x7e/frame 0xedf2acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf2acd4 --- trap 0, eip = 0, esp = 0xedf2ad20, ebp = 0 --- Tracing command kernel pid 0 tid 100092 td 0xc9127a20 sched_switch(c9127a20,0,104,191,c0c1054b,...) at sched_switch+0x48e/frame 0xedf2dba0 mi_switch(104,0,c15cc031,222,0,...) at mi_switch+0x18c/frame 0xedf2dbd4 sleepq_switch(c9127a20,0,c15cc031,298,c8e5f900,...) at sleepq_switch+0xf7/frame 0xedf2dc0c sleepq_wait(c8e5f900,0,c15c5bc5,c15ac19b,0,...) at sleepq_wait+0x48/frame 0xedf2dc30 msleep_spin_sbt(c8e5f900,c8e5f91c,c15ac19b,0,0,...) at msleep_spin_sbt+0x226/frame 0xedf2dc74 gtaskqueue_thread_loop(c8f26034,edf2dce8,c15bc328,406,0,...) at gtaskqueue_thread_loop+0xf3/frame 0xedf2dcac fork_exit(c0c71630,c8f26034,edf2dce8) at fork_exit+0x7e/frame 0xedf2dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf2dcd4 --- trap 0, eip = 0, esp = 0xedf2dd20, ebp = 0 --- db:0:allt> dump Physical memory: 3427 MB Dumping 238 MB: 223 207 191 175 159 143 127 111 95 79 63 47 31 15 Dump complete db:0:dump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 2 (kgdb) proc 72280 [Switching to thread 99 (Thread 101508)]#0 sched_switch (td=, newtd=, flags=) at ../../../kern/sched_ule.c:1973 1973 cpuid = PCPU_GET(cpuid); Current language: auto; currently minimal (kgdb) bt #0 sched_switch (td=, newtd=, flags=) at ../../../kern/sched_ule.c:1973 #1 0xc0c3a48c in mi_switch (flags=) at ../../../kern/kern_synch.c:450 #2 0xc0c80547 in sleepq_switch (wchan=, pri=0x60) at ../../../kern/subr_sleepqueue.c:586 #3 0xc0c803f8 in sleepq_wait (wchan=0xcbfd9000, pri=0x60) at ../../../kern/subr_sleepqueue.c:665 #4 0xc0c39c50 in _sleep (lock=, priority=, wmesg=, sbt=0x0, pr=0x0, flags=) at ../../../kern/kern_synch.c:223 #5 0xc0cefca4 in vfs_mount_destroy (mp=) at ../../../kern/vfs_mount.c:505 #6 0xc0cf1197 in dounmount (mp=, flags=, td=) at ../../../kern/vfs_mount.c:1440 #7 0xc0cf0595 in sys_unmount (td=, uap=) at ../../../kern/vfs_mount.c:1215 #8 0xc11cc9b5 in syscall (frame=) at subr_syscall.c:135 #9 0xc11b75fe in Xint0x80_syscall () at ../../../i386/i386/exception.s:277 #10 0x00000033 in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb) f 5 #5 0xc0cefca4 in vfs_mount_destroy (mp=) at ../../../kern/vfs_mount.c:505 505 msleep(mp, MNT_MTX(mp), PVFS, "mntref", 0); (kgdb) l 500 if (mp->mnt_kern_flag & MNTK_MWAIT) { 501 mp->mnt_kern_flag &= ~MNTK_MWAIT; 502 wakeup(mp); 503 } 504 while (mp->mnt_ref) 505 msleep(mp, MNT_MTX(mp), PVFS, "mntref", 0); 506 KASSERT(mp->mnt_ref == 0, 507 ("%s: invalid refcount in the drain path @ %s:%d", __func__, 508 __FILE__, __LINE__)); 509 if (mp->mnt_writeopcount != 0) (kgdb) info loc No locals. (kgdb) p *(struct mount*)0xcbfd9000 $1 = {mnt_mtx = {lock_object = {lo_name = 0xc15cec09 "struct mount mtx", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc89a9588}, mtx_lock = 0x4}, mnt_gen = 0x2da, mnt_list = {tqe_next = 0x0, tqe_prev = 0xc9aae018}, mnt_op = 0xc18b9670, mnt_vfc = 0xc18b9708, mnt_vnodecovered = 0xca02d000, mnt_syncer = 0x0, mnt_ref = 0x10, mnt_nvnodelist = {tqh_first = 0x0, tqh_last = 0xcbfd9034}, mnt_nvnodelistsize = 0x0, mnt_writeopcount = 0x0, mnt_kern_flag = 0x4180616c, mnt_flag = 0x300, mnt_opt = 0xd3831280, mnt_optnew = 0x0, mnt_maxsymlinklen = 0x78, mnt_stat = {f_version = 0x20140518, f_type = 0x35, f_flags = 0x201300, f_bsize = 0x1000, f_iosize = 0x8000, f_blocks = 0x134efd, f_bfree = 0x134b3b, f_bavail = 0x11bfcb, f_files = 0xb057e, f_ffree = 0x9a514, f_syncwrites = 0x60d667, f_asyncwrites = 0x1381a5, f_syncreads = 0x7a07, f_asyncreads = 0x85c, f_spare = 0xcbfd90c4, f_namemax = 0xff, f_owner = 0x0, f_fsid = {val = 0xcbfd911c}, f_charspare = 0xcbfd9124 "", f_fstypename = 0xcbfd9174 "ufs", f_mntfromname = 0xcbfd9184 "/dev/md5a", f_mntonname = 0xcbfd9584 "/mnt"}, mnt_cred = 0xca61cd00, mnt_data = 0x0, mnt_time = 0x0, mnt_iosize_max = 0x20000, mnt_export = 0xd3370d80, mnt_label = 0x0, mnt_hashseed = 0x4a6bfdb6, mnt_lockref = 0x0, mnt_secondary_writes = 0x0, mnt_secondary_accwrites = 0x7e4a534, mnt_susp_owner = 0x0, mnt_gjprovider = 0x0, mnt_listmtx = {lock_object = { lo_name = 0xc15d8759 "struct mount vlist mtx", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc89b2558}, mtx_lock = 0x4}, mnt_activevnodelist = {tqh_first = 0x0, tqh_last = 0xcbfd99c8}, mnt_activevnodelistsize = 0x0, mnt_tmpfreevnodelist = {tqh_first = 0x0, tqh_last = 0xcbfd99d4}, mnt_tmpfreevnodelistsize = 0x0, mnt_explock = {lock_object = {lo_name = 0xc15abb87 "explock", lo_flags = 0x6730000, lo_data = 0x0, lo_witness = 0xc89b0af0}, lk_lock = 0x1, lk_exslpfail = 0x0, lk_timo = 0x0, lk_pri = 0x60, lk_stack = {depth = 0x6, pcs = 0xcbfd9a04}}, mnt_upper_link = {tqe_next = 0x0, tqe_prev = 0x0}, mnt_uppers = {tqh_first = 0x0, tqh_last = 0xcbfd9a54}} (kgdb) $ svn diff -x -p /tmp/freebsd/sys -- Test scenario: misc/marcus5.sh