GENERIC from Thu Mar 8 20:39:43 2018 +0200, r330665+pcid 1e91ffda3c4, vmcore.1075 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2018 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 12.0-CURRENT #0 r330665+1e91ffda3c4(pcid): Thu Mar 8 20:27:44 CET 2018 pho@x4.osted.lan:/var/tmp/deviant2/sys/i386/compile/PHO i386 FreeBSD clang version 6.0.0 (branches/release_60 325330) (based on LLVM 6.0.0) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Entering uma_startup with 10 boot pages configured startup_alloc from "UMA Kegs", 9 boot pages left startup_alloc from "UMA Zones", 8 boot pages left startup_alloc from "UMA Hash", 7 boot pages left startup_alloc from "UMA Zones", 6 boot pages left startup_alloc from "vmem btag", 5 boot pages left startup_alloc from "MAP", 4 boot pages left startup_alloc from "UMA Kegs", 3 boot pages left startup_alloc from "KMAP ENTRY", 2 boot pages left startup_alloc from "vmem", 1 boot pages left Entering uma_startup2 with 0 boot pages left VT(vga): resolution 640x480 CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin="AuthenticAMD" Id=0x100f23 Family=0x10 Model=0x2 Stepping=3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff SVM: NP,NAsids=64 TSC: P-state invariant real memory = 8589934592 (8192 MB) avail memory = 3525681152 (3362 MB) : Trying to mount root from ufs:/dev/ada0s1a [rw]... uhub0: 2 ports with 2 removable, self powered uhub2: 2 ports with 2 removable, self powered uhub4: 2 ports with 2 removable, self powered uhub3: 2 ports with 2 removable, self powered uhub5: 2 ports with 2 removable, self powered Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. eval: limits: not found /etc/rc: WARNING: failed to start ddb warning: total configured swap (4194304 pages) exceeds maximum recommended amount (1725680 pages). warning: increase kern.maxswzone or reduce amount of swap. Starting file system checks: /dev/ada0s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1a: clean, 485732 free (2220 frags, 60439 blocks, 0.2% fragmentation) /dev/ada0s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1f: clean, 845769 free (11201 frags, 104321 blocks, 1.1% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 45719314 free (42786 frags, 5709566 blocks, 0.0% fragmentation) /dev/ada0s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1d: clean, 1484094 free (343174 frags, 142615 blocks, 3.4% fragmentation) /dev/ada0s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1e: clean, 4276470 free (209030 frags, 508430 blocks, 0.8% fragmentation) Mounting local filesystems:. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/arduino/lib /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/gcc49 /usr/local/lib/mysql /usr/local/lib/nss /usr/local/lib/perl5/5.24/mach/CORE /usr/local/lib/pth /usr/local/lib/qt4 /usr/local/llvm37/lib /usr/local/llvm39/lib a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Setting hostname: x4.osted.lan. uhub1: 10 ports with 10 removable, self powered Setting up harvesting: [UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,NET_ETHER,NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . re0: link state changed to DOWN Starting Network: lo0 re0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe8lock order reversal: (sleepable after non-sleepable) 1st 0x1b17dcfc if_addr_lock (if_addr_lock) @ net/if.c:1475 2nd 0x1ff8980 cpslk (cpslk) @ i386/i386/copyout.c:75 stack backtrace: 0::1%lo0 prefixl#0 0x10eb181 at witness_debuggeen 64 scopeid 0xr+0x81 #1 0x10eb048 at witness_2 inet 127.0.checkorder+0xcd8 #2 0x108b604 a0.1 netmask 0xfft _sx_xlock+0x64 #3 0x163d313 a000000 nd6 opt cp_fast0+0xf3 #4 0x163d673 attions=21 oo_ioctl+0x1b1 #7 0x10f09b9 at kern_ioctl+0x2b9 #8 0x10f0698 at sys_ioctl+0x118 #9 0x1656a1e at syscall+0x6ee #10 0xffc01293 at PTDpde+0x229b groups: lo re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 nd6 options=29 media: Ethernet autoselect (none) status: no carrier Starting devd. re0: link state changed to UP add host 127.0.0.1: gateway lo0 fib 0: route already in table add net default: gateway 192.168.1.1 add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Starting rpcbind. NFS access cache time=60 Starting watchdogd. No core dumps found. Additional ABI support: linux. lock order reversal: 1st 0xb9dbbe4 bufwait (bufwait) @ kern/vfs_bio.c:3735 2nd 0x1f04ca00 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:289 stack backtrace: #0 0x10eb181 at witness_debugger+0x81 #1 0x10eb048 at witness_checkorder+0xcd8 #2 0x108b604 at _sx_xlock+0x64 #3 0x13a7a83 at ufsdirhash_add+0x53 #4 0x13ac5ef at ufs_direnter+0x4df #5 0x13b5772 at ufs_mkdir+0x852 #6 0x168aa56 at VOP_MKDIR_APV+0xf6 #7 0x1168d4e at kern_mkdirat+0x21e #8 0x1168b21 at sys_mkdir+0x31 #9 0x1656a1e at syscall+0x6ee #10 0xffc01293 at PTDpde+0x229b Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Starting statd. Starting lockd. Recovering vi editor sessions:. Updating motd:. Mounting late filesystems:. Starting ntpd. Starting powerd. Starting smartd. Mar 8 20:44:19 x4 smartd[630]: Device: /dev/ada0, WARNING: A firmware update for this drive may be available, Mar 8 20:44:19 x4 smartd[630]: see the following Seagate web pages: Mar 8 20:44:19 x4 smartd[630]: http://knowledge.seagate.com/articles/en_US/FAQ/207931en Mar 8 20:44:19 x4 smartd[630]: http://knowledge.seagate.com/articles/en_US/FAQ/213891en Configuring vt: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting sendmail_submit. Starting sendmail_msp_queue. Starting cron. Local package initialization: backuplock order reversal: 1st 0x1b7bd1a0 ufs (ufs) @ kern/vfs_subr.c:2602 2nd 0xb9dbd80 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:282 3rd 0x1f39f1a0 ufs (ufs) @ kern/vfs_subr.c:2602 stack backtrace: #0 0x10eb181 at witness_debugger+0x81 #1 0x10eb048 at witness_checkorder+0xcd8 #2 0x10554fb at lockmgr_xlock_hard+0x5b #3 0x1055d2f at __lockmgr_args+0x3df #4 0x13a2047 at ffs_lock+0xa7 #5 0x168b85a at VOP_LOCK1_APV+0xda #6 0x116c301 at _vn_lock+0x61 #7 0x1158231 at vget+0xc1 #8 0x11494a2 at vfs_hash_get+0xd2 #9 0x139cd24 at ffs_vgetf+0x44 #10 0x1391b47 at softdep_sync_buf+0x357 #11 0x13a2eef at ffs_syncvnode+0x2df #12 0x13a01b8 at ffs_sync+0x248 #13 0x116da94 at vfs_write_suspend+0x1c4 #14 0x116dcc5 at vfs_write_suspend_umnt+0x45 #15 0x139f894 at ffs_unmount+0xb4 #16 0x114fbc3 at dounmount+0x583 #17 0x114f535 at sys_unmount+0x315 lock order reversal: 1st 0x1b7bd8bc ufs (ufs) @ kern/vfs_mount.c:1280 2nd 0x1b7bde6c devfs (devfs) @ ufs/ffs/ffs_softdep.c:1912 stack backtrace: #0 0x10eb181 at witness_debugger+0x81 #1 0x10eb048 at witness_checkorder+0xcd8 #2 0x1055075 at lockmgr_lock_fast_path+0x195 #3 0x11455cb at vop_stdlock+0x3b #4 0x168b85a at VOP_LOCK1_APV+0xda #5 0x116c301 at _vn_lock+0x61 #6 0x137f065 at softdep_flushworklist+0x65 #7 0x13a042a at ffs_sync+0x4ba #8 0x116da94 at vfs_write_suspend+0x1c4 #9 0x116dcc5 at vfs_write_suspend_umnt+0x45 #10 0x139f894 at ffs_unmount+0xb4 #11 0x114fbc3 at dounmount+0x583 #12 0x114f535 at sys_unmount+0x315 #13 0x1656a1e at syscall+0x6ee #14 0xffc01293 at PTDpde+0x229b ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes 78** Phase 2 - Check Pathnames lock order reversal: 1st 0x1b7840e0 FFS2 dinode (UMA zone) @ vm/uma_core.c:3731 2nd 0x1d51b80 vm page (vm page) @ i386/i386/copyout.c:91 stack backtrace: #0 0x10eb181 at witness_debugger+0x81 #1 0x10eb048 at witness_checkorder+0xcd8 #2 0x105f95e at __mtx_lock_flags+0x8e #3 0x163d421 at cp_fast0+0x201 #4 0x163d673 at copyout+0x63 #5 0x10e3609 at copyout_nofault+0x29 #6 0x1090d04 at sysctl_old_user+0x74 #7 0x10912ef at sbuf_sysctl_drain+0x1f #8 0x10d5d1c at sbuf_drain+0x5c #9 0x10d5189 at sbuf_put_bytes+0x79 #10 0x10d50f8 at sbuf_bcat+0x18 #11 0x13c3cad at sysctl_vm_zone_stats+0x33d #12 0x10913fc at sysctl_root_handler_locked+0xac #13 0x1090a95 at sysctl_root+0x255 #14 0x1091080 at userland_sysctl+0x190 #15 0x1090eae at sys___sysctl+0x8e #16 0x1656a1e at syscall+0x6ee #17 0xffc01293 at PTDpde+0x229b Mar 8 20:47:04 x4 su: pho to root on /dev/pts/1 ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 1190861 files, 72594667 used, 45719314 free (42786 frags, 5709566 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** lock order reversal: 1st 0x1d51900 vm page (vm page) @ vm/vm_page.c:1007 2nd 0x2baf9a0 256 Bucket (256 Bucket) @ vm/uma_core.c:3842 stack backtrace: #0 0x10eb181 at witness_debugger+0x81 #1 0x10eb048 at witness_checkorder+0xcd8 #2 0x105f95e at __mtx_lock_flags+0x8e #3 0x13c077c at uma_dbg_alloc+0x5c #4 0x13c05d1 at uma_zalloc_arg+0x591 #5 0x13c0c9c at uma_zfree_arg+0x35c #6 0x13eba62 at vm_radix_remove+0x192 #7 0x13ddaf6 at vm_page_remove+0x96 #8 0x13e16b8 at vm_page_free_prep+0xe8 #9 0x13d93fd at vm_object_page_remove+0x22d #10 0x13d0e51 at vm_map_entry_delete+0x121 #11 0x13cdc8c at vm_map_delete+0x37c #12 0x13d10dc at vm_map_remove+0x8c #13 0x13cbbeb at vmspace_exit+0xcb #14 0x103a7cc at exit1+0x6ac #15 0x103a112 at sys_sys_exit+0x22 #16 0x1656a1e at syscall+0x6ee #17 0xffc01293 at PTDpde+0x229b fsck -y /tmp. Starting nfscbd. Starting default mousedmoused: unable to open /dev/psm0: No such file or directory . Starting inetd. Thu Mar 8 20:47 FreeBSD/i386 (x4.osted.lan) (ttyu0) login: 20180308 20:49:38 all (1/561): mmap25.sh 20180308 20:49:49 all (2/561): nullfs7.sh GEOM leak: 4/321 20180308 20:49:54 all (3/561): signal0.sh lock order reversal: 1st 0x1ff8980 cpslk (cpslk) @ i386/i386/copyout.c:75 2nd 0xb9792b4 bufwait (bufwait) @ vm/vm_pager.c:374 stack backtrace: #0 0x10eb181 at witness_debugger+0x81 #1 0x10eb048 at witness_checkorder+0xcd8 #2 0x10554fb at lockmgr_xlock_hard+0x5b #3 0x1055d2f at __lockmgr_args+0x3df #4 0x13e7ddc at getpbuf+0x22c #5 0x13b8bf9 at swap_pager_getpages+0x39 #6 0x13e78d3 at vm_pager_get_pages+0x53 #7 0x13c6456 at vm_fault_hold+0xea6 #8 0x13c5573 at vm_fault+0x83 #9 0x1655fce at trap_pfault+0xfe #10 0x16555a3 at trap+0x413 #11 0xffc010e5 at PTDpde+0x20ed #12 0x163d6c1 at copyout_fast0+0x21 #13 0x163d38a at cp_fast0+0x16a #14 0x163d673 at copyout+0x63 #15 0x10e3ae0 at uiomove_faultflag+0x150 #16 0x10e397f at uiomove+0x1f #17 0x10f2cdf at pipe_read+0x26f lock order reversal: 1st 0x1d51700 vm page (vm page) @ vm/vm_object.c:1702 2nd 0x2baf700 32 Bucket (32 Bucket) @ vm/uma_core.c:3842 stack backtrace: #0 0x10eb181 at witness_debugger+0x81 #1 0x10eb048 at witness_checkorder+0xcd8 #2 0x105f95e at __mtx_lock_flags+0x8e #3 0x13c0e94 at uma_dbg_free+0x64 #4 0x13c0995 at uma_zfree_arg+0x55 #5 0x13c017a at uma_zalloc_arg+0x13a #6 0x13c0c9c at uma_zfree_arg+0x35c #7 0x13eba62 at vm_radix_remove+0x192 #8 0x13ddaf6 at vm_page_remove+0x96 #9 0x13e16b8 at vm_page_free_prep+0xe8 #10 0x13dd0ea at vm_page_free_toq+0x1a #11 0x13da656 at vm_object_collapse_scan+0x3e6 #12 0x13d7afb at vm_object_collapse+0x11b #13 0x13d7652 at vm_object_deallocate+0x4d2 #14 0x13cbf4a at vm_map_process_deferred+0x9a #15 0x13d1127 at vm_map_remove+0xd7 #16 0x13cbbeb at vmspace_exit+0xcb #17 0x103a7cc at exit1+0x6ac lock order reversal: 1st 0x1d51700 vm page (vm page) @ vm/vm_page.c:1584 2nd 0x2baf620 16 Bucket (16 Bucket) @ vm/uma_core.c:2558 stack backtrace: #0 0x10eb181 at witness_debugger+0x81 #1 0x10eb048 at witness_checkorder+0xcd8 #2 0x105f95e at __mtx_lock_flags+0x8e #3 0x13c41fa at zone_fetch_slab+0x4a #4 0x13c42ab at zone_import+0x3b #5 0x13bf7ed at zone_alloc_item+0x3d #6 0x13c06ac at uma_zalloc_arg+0x66c #7 0x13c10d9 at bucket_alloc+0x99 #8 0x13c0357 at uma_zalloc_arg+0x317 #9 0x13c0c9c at uma_zfree_arg+0x35c #10 0x13eba62 at vm_radix_remove+0x192 #11 0x13ddaf6 at vm_page_remove+0x96 #12 0x13ddf64 at vm_page_rename+0xd4 #13 0x13da55e at vm_object_collapse_scan+0x2ee #14 0x13d7afb at vm_object_collapse+0x11b #15 0x13d7652 at vm_object_deallocate+0x4d2 #16 0x13cbf4a at vm_map_process_deferred+0x9a #17 0x13d1127 at vm_map_remove+0xd7 20180308 21:01:53 all (1/561): cmp.sh 20180308 21:04:40 all (1/93): churn.sh lock order reversal: 1st 0x1d51b40 vm page (vm page) @ vm/vm_page.c:1007 2nd 0x2baf8c0 128 Bucket (128 Bucket) @ vm/uma_core.c:3842 stack backtrace: #0 0x10eb181 at witness_debugger+0x81 #1 0x10eb048 at witness_checkorder+0xcd8 #2 0x105f95e at __mtx_lock_flags+0x8e #3 0x13c0e94 at uma_dbg_free+0x64 #4 0x13c0995 at uma_zfree_arg+0x55 #5 0x13c017a at uma_zalloc_arg+0x13a #6 0x13c0c9c at uma_zfree_arg+0x35c #7 0x13eba62 at vm_radix_remove+0x192 #8 0x13ddaf6 at vm_page_remove+0x96 #9 0x13e16b8 at vm_page_free_prep+0xe8 #10 0x13d93fd at vm_object_page_remove+0x22d #11 0x13d0e51 at vm_map_entry_delete+0x121 #12 0x13cdc8c at vm_map_delete+0x37c #13 0x13d503b at kern_munmap+0x8b #14 0x13d4fa1 at sys_munmap+0x21 #15 0x1656a1e at syscall+0x6ee #16 0xffc01293 at PTDpde+0x229b 20180308 21:14:50 all (2/93): context2.sh 20180308 21:19:55 all (3/93): datamove3.sh lock order reversal: 1st 0x1f4481a0 syncer (syncer) @ kern/vfs_subr.c:2152 2nd 0x21095478 ufs (ufs) @ kern/vfs_subr.c:2602 stack backtrace: #0 0x10eb181 at witness_debugger+0x81 #1 0x10eb048 at witness_checkorder+0xcd8 #2 0x10554fb at lockmgr_xlock_hard+0x5b #3 0x1055d2f at __lockmgr_args+0x3df #4 0x13a2047 at ffs_lock+0xa7 #5 0x168b85a at VOP_LOCK1_APV+0xda #6 0x116c301 at _vn_lock+0x61 #7 0x1158231 at vget+0xc1 #8 0x115a70a at vfs_msync+0xaa #9 0x115ff72 at sync_fsync+0xe2 #10 0x168a256 at VOP_FSYNC_APV+0xf6 #11 0x115da56 at sched_sync+0x2b6 #12 0x104005e at fork_exit+0x7e #13 0xffc012a6 at PTDpde+0x22ae Mar 8 21:29:03 x4 su: pho to root on /dev/pts/2 Stopping inetd. Waiting for PIDS: 5115. Stopping nfscbd. Waiting for PIDS: 5080 5081. Shutting down local packages:. Stopping cron. Waiting for PIDS: 680. Stopping sshd. Waiting for PIDS: 670. Stopping smartd. Waiting for PIDS: 632. Stopping powerd. Waiting for PIDS: 602. Stopping ntpd. Waiting for PIDS: 599. Stopping lockd. Waiting for PIDS: 561. Stopping statd. Waiting for PIDS: 558. Stopping nfsd. Waiting for PIDS: 554 557. Stopping mountd. Waiting for PIDS: 548. Stopping nfsuserd. Waiting for PIDS: 540 541. Stopping watchdogd. Waiting for PIDS: 498. Stopping rpcbind. Waiting for PIDS: 414. Stopping devd. Waiting for PIDS: 333. Writing entropy file:. Writing early boot entropy file:. . Mar 8 21:30:52 x4 syslogd: exiting on signal 15 Mar 8 21:31:12 init: some processes would not die; ps axl advised Enter full pathname of shell or RETURN for /bin/sh: # ps -l UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 0 85257 1 0 20 0 5368 2740 wait Ss u0 0:00.01 -sh (sh) 0 85259 85257 0 20 0 5000 2524 - R+ u0 0:00.00 ps -l 0 21110 1 0 20 0 4736 2220 ufs D 1- 0:00.01 /tmp/datamove3 0 21119 21110 0 20 0 4736 1112 ufs D 1- 0:00.00 /tmp/datamove3 # procstat -k 21110 21119 PID TID COMM TDNAME KSTACK 21110 100186 datamove3 - mi_switch sleepq_switch sleepq_wait sleeplk lockmgr_slock_hard __lockmgr_args ffs_lock VOP_LOCK1_APV _vn_lock vget vm_fault_hold vm_fault_quick_hold_pages cp_fast0 copyin uiomove_fromphys ffs_write VOP_WRITE_APV vn_write 21119 100269 datamove3 - mi_switch sleepq_switch sleepq_wait sleeplk lockmgr_slock_hard __lockmgr_args ffs_lock VOP_LOCK1_APV _vn_lock vget vm_fault_hold vm_fault_quick_hold_pages cp_fast0 copyin uiomove_fromphys ffs_write VOP_WRITE_APV vn_write # KDB: enter: Break to debugger [ thread pid 11 tid 100006 ] Stopped at kdb_alt_break_internal+0xf0: movl $0,kdb_why db> run pho db:0:pho> bt Tracing pid 11 tid 100006 td 0x18d11a80 kdb_alt_break_internal(0,14d25acc,e7df87,2,1af52888,...) at kdb_alt_break_internal+0xf0/frame 0x14d25aa0 kdb_alt_break(2,1af52888,1a13c93,0,40000,...) at kdb_alt_break+0x16/frame 0x14d25aac uart_intr_rxready(1af52800,b1f,bbd8c40,18d11a80,14d25af0,...) at uart_intr_rxready+0x87/frame 0x14d25acc uart_intr(1af52800,0,b1f,1,18d11a80,...) at uart_intr+0x130/frame 0x14d25b0c intr_event_handle(18d6de00,14d25ba0,1f5979c,18d7f700,1,...) at intr_event_handle+0xa5/frame 0x14d25b38 intr_execute_handlers(18d69120,14d25ba0,3) at intr_execute_handlers+0xa5/frame 0x14d25b70 lapic_handle_intr(32,14d25ba0,8,28,28,...) at lapic_handle_intr+0x5e/frame 0x14d25b90 Xapic_isr1_pti() at PTDpde+0x2a78/frame 0x14d25b90 --- interrupt, eip = 0x166e0e5, esp = 0x14d25be0, ebp = 0x14d25be0 --- acpi_cpu_c1(14d25c34,165d7d2,bbd8c50,0,1c5f51f,...) at acpi_cpu_c1+0x5/frame 0x14d25be0 acpi_cpu_idle(1b1f668a,0,1b1f668a,14d25c50,166e4aa,...) at acpi_cpu_idle+0x30b/frame 0x14d25c20 cpu_idle_acpi(1b1f668a,0,1f59740,2,ffffffff,...) at cpu_idle_acpi+0x3f/frame 0x14d25c34 cpu_idle(0,14d25c80,1a58828,aea,2,...) at cpu_idle+0x9a/frame 0x14d25c50 sched_idletd(0,14d25ce8,1a4c1ec,407,0,...) at sched_idletd+0x236/frame 0x14d25cac fork_exit(10b2a30,0,14d25ce8,0,0,...) at fork_exit+0x7e/frame 0x14d25cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x14d25cd4 --- trap 0, eip = 0, esp = 0x14d25d20, ebp = 0 --- (null)() at 0 db:0:pho> show allpcpu Current CPU: 3 cpuid = 0 dynamic pcpu = 0x6bd2c0 curthread = 0x18d12700: pid 11 tid 100003 "idle: cpu0" curpcb = 0x14d16d40 fpcurthread = none idlethread = 0x18d12700: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 trampstk = 0xffc02ff0 kesp0 = 0x14d16d30 common_tssp = 0xffc00260 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0x9e642c0 curthread = 0x18d12380: pid 11 tid 100004 "idle: cpu1" curpcb = 0x14d1bd40 fpcurthread = none idlethread = 0x18d12380: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 trampstk = 0xffc04ff0 kesp0 = 0x14d1bd30 common_tssp = 0xffc002c8 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0x9e692c0 curthread = 0x18d12000: pid 11 tid 100005 "idle: cpu2" curpcb = 0x14d20d40 fpcurthread = none idlethread = 0x18d12000: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 trampstk = 0xffc05ff0 kesp0 = 0x14d20d30 common_tssp = 0xffc00330 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0x9e6e2c0 curthread = 0x18d11a80: pid 11 tid 100006 "idle: cpu3" curpcb = 0x14d25d40 fpcurthread = none idlethread = 0x18d11a80: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 trampstk = 0xffc06ff0 kesp0 = 0x14d25d30 common_tssp = 0xffc00398 curvnet = 0 spin locks held: db:0:pho> show alllocks Process 21119 (datamove3) thread 0x1eea0a80 (100269) exclusive lockmgr bufwait (bufwait) r = 0 (0xbad633c) locked @ kern/vfs_bio.c:1531 exclusive lockmgr ufs (ufs) r = 0 (0x1af4cd00) locked @ kern/vfs_vnops.c:883 Process 21110 (datamove3) thread 0x1f58ea80 (100186) exclusive lockmgr bufwait (bufwait) r = 0 (0xba90e60) locked @ kern/vfs_bio.c:1531 exclusive lockmgr ufs (ufs) r = 0 (0x2109b30c) locked @ kern/vfs_vnops.c:883 db:0:pho> show lockedvnods Locked vnodes vnode 0x1af4cccc: tag ufs, type VREG usecount 3, writecount 2, refcount 9 flags (VI_ACTIVE) v_object 0x212f4270 ref 2 pages 10 cleanbuf 3 dirtybuf 0 lock type ufs: EXCL by thread 0x1eea0a80 (pid 21119, datamove3, tid 100269) with shared waiters pending #0 0x10557ff at lockmgr_xlock_hard+0x35f #1 0x1055d2f at __lockmgr_args+0x3df #2 0x13a2047 at ffs_lock+0xa7 #3 0x168b85a at VOP_LOCK1_APV+0xda #4 0x116c301 at _vn_lock+0x61 #5 0x116f21d at vn_write+0x1bd #6 0x116ec73 at vn_io_fault_doio+0x83 #7 0x116ca15 at vn_io_fault1+0x165 #8 0x116abd7 at vn_io_fault+0x1e7 #9 0x10f0282 at dofilewrite+0xb2 #10 0x10efea3 at kern_writev+0x93 #11 0x10efdf4 at sys_write+0x54 #12 0x1656a1e at syscall+0x6ee #13 0xffc01293 at PTDpde+0x229b ino 17428564, on dev label/tmp vnode 0x2109b2d8: tag ufs, type VREG usecount 3, writecount 2, refcount 9 flags (VI_ACTIVE) v_object 0x210bcd68 ref 2 pages 10 cleanbuf 3 dirtybuf 0 lock type ufs: EXCL by thread 0x1f58ea80 (pid 21110, datamove3, tid 100186) with shared waiters pending #0 0x10557ff at lockmgr_xlock_hard+0x35f #1 0x1055d2f at __lockmgr_args+0x3df #2 0x13a2047 at ffs_lock+0xa7 #3 0x168b85a at VOP_LOCK1_APV+0xda #4 0x116c301 at _vn_lock+0x61 #5 0x116f21d at vn_write+0x1bd #6 0x116ec73 at vn_io_fault_doio+0x83 #7 0x116ca15 at vn_io_fault1+0x165 #8 0x116abd7 at vn_io_fault+0x1e7 #9 0x10f0282 at dofilewrite+0xb2 #10 0x10efea3 at kern_writev+0x93 #11 0x10efdf4 at sys_write+0x54 #12 0x1656a1e at syscall+0x6ee #13 0xffc01293 at PTDpde+0x229b ino 17428569, on dev label/tmp db:0:pho> show mount 0x1b782000 /dev/ada0s1a on / (ufs) 0x1b65a000 devfs on /dev (devfs) 0x1ed91000 /dev/ada0s1f on /home (ufs) 0x1ed8f000 /dev/ada0s1d on /usr (ufs) 0x1ef59000 /dev/ada0s1e on /var (ufs) 0x1ef58000 procfs on /proc (procfs) 0x1f54f000 /dev/label/tmp on /tmp (ufs) More info: show mount db:0:pho> show page vm_cnt.v_free_count: 815054 vm_cnt.v_inactive_count: 9982 vm_cnt.v_active_count: 1522 vm_cnt.v_laundry_count: 16 vm_cnt.v_wire_count: 36267 vm_cnt.v_free_reserved: 1189 vm_cnt.v_free_min: 5502 vm_cnt.v_free_target: 18441 vm_cnt.v_inactive_target: 27661 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 -- -- -- -- 10 (004096K) | 000498 09 (002048K) | 000129 08 (001024K) | 000224 07 (000512K) | 000390 06 (000256K) | 000559 05 (000128K) | 000948 04 (000064K) | 001604 03 (000032K) | 002323 02 (000016K) | 002676 01 (000008K) | 000787 00 (000004K) | 001136 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 -- -- -- -- 10 (004096K) | 000001 09 (002048K) | 000001 08 (001024K) | 000001 07 (000512K) | 000000 06 (000256K) | 000001 05 (000128K) | 000001 04 (000064K) | 000001 03 (000032K) | 000002 02 (000016K) | 000003 01 (000008K) | 000003 00 (000004K) | 000001 db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 85257 1 85257 0 Ss+ ttyin 0x18f71c74 sh 21119 21110 97933 0 D+ ufs 0x2109b30c datamove3 21110 1 97933 0 D+ (threaded) datamove3 100186 D ufs 0x1af4cd00 datamove3 24 0 0 0 DL vlruwt 0x18d0d000 [vnlru] 23 0 0 0 DL syncer 0x1fc87dc [syncer] 22 0 0 0 DL (threaded) [bufdaemon] 100097 D psleep 0x1fc816c [bufdaemon] 100100 D - 0x1d24fc0 [bufspacedaemon-0] 100113 D sdflush 0x1b6c9a84 [/home worker] 100115 D sdflush 0x1b4aa484 [/usr worker] 100116 D sdflush 0x1b4aa284 [/var worker] 100245 D sdflush 0x1b4aa884 [/tmp worker] 21 0 0 0 DL psleep 0x1fcd664 [vmdaemon] 20 0 0 0 DL (threaded) [pagedaemon] 100095 D psleep 0x1ff78e8 [dom0] 100098 D launds 0x1ff78f0 [laundry: dom0] 100102 D umarcl 0x13c2160 [uma] 19 0 0 0 DL - 0x1e23320 [rand_harvestq] 18 0 0 0 DL waiting 0x1ff6bd8 [sctp_iterator] 17 0 0 0 DL - 0x1fc7d98 [soaiod4] 16 0 0 0 DL - 0x1fc7d98 [soaiod3] 15 0 0 0 DL - 0x1fc7d98 [soaiod2] 9 0 0 0 DL - 0x1fc7d98 [soaiod1] 8 0 0 0 DL - 0x18ffb23c [fdc0] 14 0 0 0 DL (threaded) [usb] 100046 D - 0x1ac35acc [usbus0] 100047 D - 0x1ac35afc [usbus0] 100048 D - 0x1ac35b2c [usbus0] 100049 D - 0x1ac35b5c [usbus0] 100050 D - 0x1ac35b8c [usbus0] 100052 D - 0x1aeefacc [usbus1] 100053 D - 0x1aeefafc [usbus1] 100054 D - 0x1aeefb2c [usbus1] 100055 D - 0x1aeefb5c [usbus1] 100056 D - 0x1aeefb8c [usbus1] 100058 D - 0x1aef6acc [usbus2] 100059 D - 0x1aef6afc [usbus2] 100060 D - 0x1aef6b2c [usbus2] 100061 D - 0x1aef6b5c [usbus2] 100062 D - 0x1aef6b8c [usbus2] 100063 D - 0x1aefaacc [usbus3] 100064 D - 0x1aefaafc [usbus3] 100065 D - 0x1aefab2c [usbus3] 100066 D - 0x1aefab5c [usbus3] 100067 D - 0x1aefab8c [usbus3] 100068 D - 0x1af01acc [usbus4] 100069 D - 0x1af01afc [usbus4] 100070 D - 0x1af01b2c [usbus4] 100071 D - 0x1af01b5c [usbus4] 100072 D - 0x1af01b8c [usbus4] 100074 D - 0x1ac25ca4 [usbus5] 100075 D - 0x1ac25cd4 [usbus5] 100076 D - 0x1ac25d04 [usbus5] 100077 D - 0x1ac25d34 [usbus5] 100078 D - 0x1ac25d64 [usbus5] 7 0 0 0 DL (threaded) [cam] 100041 D - 0x1d706c0 [doneq0] 100094 D - 0x1d705ec [scanner] 6 0 0 0 DL crypto_ 0x18e960c4 [crypto returns 3] 5 0 0 0 DL crypto_ 0x18e9608c [crypto returns 2] 4 0 0 0 DL crypto_ 0x18e96054 [crypto returns 1] 3 0 0 0 DL crypto_ 0x18e9601c [crypto returns 0] 2 0 0 0 DL crypto_ 0x1fcc5b4 [crypto] 13 0 0 0 DL (threaded) [geom] 100028 D - 0x1ff3060 [g_event] 100029 D - 0x1ff3064 [g_up] 100030 D - 0x1ff3068 [g_down] 12 0 0 0 WL (threaded) [intr] 100007 I [swi6: task queue] 100008 I [swi6: Giant taskq] 100010 I [swi5: fast taskq] 100022 I [swi4: clock (0)] 100023 I [swi4: clock (1)] 100024 I [swi4: clock (2)] 100025 I [swi4: clock (3)] 100026 I [swi1: netisr 0] 100027 I [swi3: vm] 100042 I [irq256: hdac0] 100043 I [irq257: re0] 100044 I [irq22: ahci0] 100045 I [irq16: hdac1 ohci0] 100051 I [irq17: ohci1 ohci3] 100057 I [irq18: ohci2 ohci4] 100073 I [irq19: ehci0] 100079 I [irq14: ata0] 100080 I [swi0: uart] 100082 I [irq1: atkbd0] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 1 0 1 0 SLs wait 0x18d0ea08 [init] 10 0 0 0 DL audit_w 0x1ff7390 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0x1ff3084 [swapper] 100009 D - 0x18d6d200 [thread taskq] 100011 D - 0x18d6d080 [kqueue_ctx taskq] 100012 D - 0x18d6d000 [aiod_kick taskq] 100013 D - 0x18d7b000 [if_io_tqg_0] 100014 D - 0x18d7af00 [if_io_tqg_1] 100015 D - 0x18d7ae80 [if_io_tqg_2] 100016 D - 0x18d7ae00 [if_io_tqg_3] 100017 D - 0x18d91080 [if_config_tqg_0] 100018 D - 0x18d91000 [softirq_0] 100019 D - 0x18d90f00 [softirq_1] 100020 D - 0x18d90e80 [softirq_2] 100021 D - 0x18d90e00 [softirq_3] 100031 D - 0x18dcfd00 [firmware taskq] 100032 D - 0x18dcfc80 [crypto_0] 100033 D - 0x18dcfc80 [crypto_1] 100034 D - 0x18dcfc80 [crypto_2] 100035 D - 0x18dcfc80 [crypto_3] 100083 D - 0x18ffce00 [mca taskq] 100090 D - 0x1b22ac00 [acpi_task_0] 100091 D - 0x1b22ac00 [acpi_task_1] 100092 D - 0x1b22ac00 [acpi_task_2] 100093 D - 0x18dcfc00 [CAM taskq] db:0:pho> allt Tracing command sh pid 85257 tid 100217 td 0x1b653700 sched_switch(1b653700,0,104,189,1f59080,...) at sched_switch+0x80c/frame 0x14d3e940 mi_switch(104,0,1a5d1f5,22b,1b653700,...) at mi_switch+0x1f3/frame 0x14d3e97c sleepq_switch(1b653700,0,1a5d1f5,1ca,0,...) at sleepq_switch+0x110/frame 0x14d3e9b0 sleepq_catch_signals(14d3ea18,105f830,18f71c14,0,0,...) at sleepq_catch_signals+0x360/frame 0x14d3e9f4 sleepq_wait_sig(18f71c74,0,14d3ea38,101,0,...) at sleepq_wait_sig+0x14/frame 0x14d3ea18 _cv_wait_sig(18f71c74,18f71c04,1a63211,5aa,14d3ebb8,...) at _cv_wait_sig+0x21f/frame 0x14d3ea5c tty_wait(18f71c00,18f71c74,14d3ebb8,1,0,...) at tty_wait+0x4b/frame 0x14d3ea80 ttydisc_read(18f71c00,14d3ebb8,0,d2,1d2183c,...) at ttydisc_read+0x238/frame 0x14d3eac0 ttydev_read(18dc6900,14d3ebb8,0,1b653700,14d3eb6c,...) at ttydev_read+0x55/frame 0x14d3eae0 devfs_read_f(1b7e3000,14d3ebb8,18ce1e00,0,1b653700,...) at devfs_read_f+0xc5/frame 0x14d3eb18 dofileread(1b7e3000,14d3ebb8,ffffffff,ffffffff,0,...) at dofileread+0xab/frame 0x14d3eb48 kern_readv(1b653700,0,14d3ebb8,14d3ebe8,ffbfec6a,...) at kern_readv+0x93/frame 0x14d3eb98 sys_read(1b653700,1b653984,1a4bc2b,4,1c5f51f,...) at sys_read+0x54/frame 0x14d3ebe8 syscall(14d3ece8,3b,3b,3b,8068534,...) at syscall+0x6ee/frame 0x14d3ecdc Xint0x80_syscall() at PTDpde+0x229b/frame 0x14d3ecdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x282486ef, esp = 0xffbfec24, ebp = 0xffbfec38 --- _end(0,0,0,0,0,...) at 0x282486ef/frame 0xffbfec38 (null)() at 0 Tracing command datamove3 pid 21119 tid 100269 td 0x1eea0a80 sched_switch(1eea0a80,0,104,189,1f589c0,...) at sched_switch+0x80c/frame 0x14f4e3c0 mi_switch(104,0,1a5d1f5,22b,1eea0a80,...) at mi_switch+0x1f3/frame 0x14f4e3fc sleepq_switch(1eea0a80,0,1a5d1f5,2b3,2109b30c,...) at sleepq_switch+0x110/frame 0x14f4e430 sleepq_wait(2109b30c,60,1a40185,4,1,...) at sleepq_wait+0x48/frame 0x14f4e454 sleeplk(2109b378,1a40185,60,33,1,...) at sleeplk+0x1a0/frame 0x14f4e498 lockmgr_slock_hard(2109b378,1a6a55d,a2a,14f4e538,1,...) at lockmgr_slock_hard+0x2a7/frame 0x14f4e4f0 __lockmgr_args(2109b30c,200401,2109b378,0,0,...) at __lockmgr_args+0x411/frame 0x14f4e564 ffs_lock(14f4e5e0,1f6,14f4e5d0,107d466,210bcd68,...) at ffs_lock+0xa7/frame 0x14f4e59c VOP_LOCK1_APV(1d4f070,14f4e5e0,2109b2d8,2109b2d8,1d67094,...) at VOP_LOCK1_APV+0xda/frame 0x14f4e5c8 _vn_lock(2109b2d8,200401,1a6a55d,a2a,2109b2d8,...) at _vn_lock+0x61/frame 0x14f4e608 vget(2109b2d8,200401,1eea0a80,90,14f4e684,...) at vget+0xc1/frame 0x14f4e640 vm_fault_hold(1eec3000,2847a000,1,0,14f4e774,...) at vm_fault_hold+0x2b1/frame 0x14f4e718 vm_fault_quick_hold_pages(1eec3000,2847a000,1000,1,14f4e774,...) at vm_fault_quick_hold_pages+0x127/frame 0x14f4e754 cp_fast0(0,163d5e0,14f4e7b8,18d1f000,19505000,...) at cp_fast0+0x69/frame 0x14f4e7a0 copyin(2847a000,19505000,1000,1000,1000,...) at copyin+0x63/frame 0x14f4e7d4 uiomove_fromphys(bad63e8,0,2000,14f4ebb8,18ce0c00,...) at uiomove_fromphys+0x133/frame 0x14f4e808 ffs_write(14f4e988,1c6af01,105ffa5,1af4cccc,0,...) at ffs_write+0x37c/frame 0x14f4e888 VOP_WRITE_APV(1d4f070,14f4e988,1af4cccc,373,40001,...) at VOP_WRITE_APV+0x187/frame 0x14f4e958 vn_write(bbffa10,14f4ebb8,18ce0c00,1,1eea0a80,...) at vn_write+0x311/frame 0x14f4e9b8 vn_io_fault_doio(1eea0a80,0,1a5d1f5,126,1eea0b4c,...) at vn_io_fault_doio+0x83/frame 0x14f4ea00 vn_io_fault1(1eea0a80,0,0,ffffffff,7fffffff,...) at vn_io_fault1+0x165/frame 0x14f4eac8 vn_io_fault(bbffa10,14f4ebb8,18ce0c00,0,1eea0a80,...) at vn_io_fault+0x1e7/frame 0x14f4eb14 dofilewrite(bbffa10,14f4ebb8,ffffffff,ffffffff,0,...) at dofilewrite+0xb2/frame 0x14f4eb48 kern_writev(1eea0a80,3,14f4ebb8,14f4ebe8,2847a000,...) at kern_writev+0x93/frame 0x14f4eb98 sys_write(1eea0a80,1eea0d04,1a4bc2b,4,14f4ec48,...) at sys_write+0x54/frame 0x14f4ebe8 syscall(14f4ece8,3b,3b,3b,28474000,...) at syscall+0x6ee/frame 0x14f4ecdc Xint0x80_syscall() at PTDpde+0x229b/frame 0x14f4ecdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x282216cf, esp = 0xffbfe6f4, ebp = 0xffbfe710 --- _end(0,0,0,0,0,...) at 0x282216cf/frame 0xffbfe710 (null)() at 0 Tracing command datamove3 pid 21110 tid 100186 td 0x1f58ea80 sched_switch(1f58ea80,0,104,189,1f59080,...) at sched_switch+0x80c/frame 0x1d76e3c0 mi_switch(104,0,1a5d1f5,22b,1f58ea80,...) at mi_switch+0x1f3/frame 0x1d76e3fc sleepq_switch(1f58ea80,0,1a5d1f5,2b3,1af4cd00,...) at sleepq_switch+0x110/frame 0x1d76e430 sleepq_wait(1af4cd00,60,1a40185,4,1,...) at sleepq_wait+0x48/frame 0x1d76e454 sleeplk(1af4cd6c,1a40185,60,33,1,...) at sleeplk+0x1a0/frame 0x1d76e498 lockmgr_slock_hard(1af4cd6c,1a6a55d,a2a,1d76e538,1,...) at lockmgr_slock_hard+0x2a7/frame 0x1d76e4f0 __lockmgr_args(1af4cd00,200401,1af4cd6c,0,0,...) at __lockmgr_args+0x411/frame 0x1d76e564 ffs_lock(1d76e5e0,1f6,1d76e5d0,107d466,212f4270,...) at ffs_lock+0xa7/frame 0x1d76e59c VOP_LOCK1_APV(1d4f070,1d76e5e0,1af4cccc,1af4cccc,1d67094,...) at VOP_LOCK1_APV+0xda/frame 0x1d76e5c8 _vn_lock(1af4cccc,200401,1a6a55d,a2a,1af4cccc,...) at _vn_lock+0x61/frame 0x1d76e608 vget(1af4cccc,200401,1f58ea80,90,1d76e684,...) at vget+0xc1/frame 0x1d76e640 vm_fault_hold(18d1ae80,2847c000,1,0,1d76e774,...) at vm_fault_hold+0x2b1/frame 0x1d76e718 vm_fault_quick_hold_pages(18d1ae80,2847c000,1000,1,1d76e774,...) at vm_fault_quick_hold_pages+0x127/frame 0x1d76e754 cp_fast0(0,163d5e0,1d76e7b8,18d1f000,1950b000,...) at cp_fast0+0x69/frame 0x1d76e7a0 copyin(2847c000,1950b000,1000,1000,1000,...) at copyin+0x63/frame 0x1d76e7d4 uiomove_fromphys(ba90f0c,0,2000,1d76ebb8,18ce0c00,...) at uiomove_fromphys+0x133/frame 0x1d76e808 ffs_write(1d76e988,1c6af01,105ffa5,2109b2d8,0,...) at ffs_write+0x37c/frame 0x1d76e888 VOP_WRITE_APV(1d4f070,1d76e988,2109b2d8,373,40001,...) at VOP_WRITE_APV+0x187/frame 0x1d76e958 vn_write(1b7eeea8,1d76ebb8,18ce0c00,1,1f58ea80,...) at vn_write+0x311/frame 0x1d76e9b8 vn_io_fault_doio(1f58ea80,0,1a5d1f5,126,1f58eb4c,...) at vn_io_fault_doio+0x83/frame 0x1d76ea00 vn_io_fault1(1f58ea80,0,0,ffffffff,7fffffff,...) at vn_io_fault1+0x165/frame 0x1d76eac8 vn_io_fault(1b7eeea8,1d76ebb8,18ce0c00,0,1f58ea80,...) at vn_io_fault+0x1e7/frame 0x1d76eb14 dofilewrite(1b7eeea8,1d76ebb8,ffffffff,ffffffff,0,...) at dofilewrite+0xb2/frame 0x1d76eb48 kern_writev(1f58ea80,4,1d76ebb8,1d76ebe8,2847c000,...) at kern_writev+0x93/frame 0x1d76eb98 sys_write(1f58ea80,1f58ed04,1a4bc2b,4,1c5f51f,...) at sys_write+0x54/frame 0x1d76ebe8 syscall(1d76ece8,3b,3b,3b,28474000,...) at syscall+0x6ee/frame 0x1d76ecdc Xint0x80_syscall() at PTDpde+0x229b/frame 0x1d76ecdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x282216cf, esp = 0xffbfe6f4, ebp = 0xffbfe710 --- _end(0,0,0,0,0,...) at 0x282216cf/frame 0xffbfe710 (null)() at 0 Tracing command vnlru pid 24 tid 100101 td 0x18d7e700 sched_switch(18d7e700,0,104,189,1f58300,...) at sched_switch+0x80c/frame 0x1ea98b30 mi_switch(104,0,1a5d1f5,22b,18d7e700,...) at mi_switch+0x1f3/frame 0x1ea98b6c sleepq_switch(18d7e700,0,1a5d1f5,2d6,b20,...) at sleepq_switch+0x110/frame 0x1ea98ba0 sleepq_timedwait(18d0d000,60,0,0,0,...) at sleepq_timedwait+0x53/frame 0x1ea98bdc _sleep(18d0d000,1fc8788,260,1a6b445,fffffed8,...) at _sleep+0x332/frame 0x1ea98c30 vnlru_proc(0,1ea98ce8,1a4c1ec,407,0,...) at vnlru_proc+0xbc/frame 0x1ea98cac fork_exit(115ce20,0,1ea98ce8,0,0,...) at fork_exit+0x7e/frame 0x1ea98cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ea98cd4 --- trap 0, eip = 0, esp = 0x1ea98d20, ebp = 0 --- (null)() at 0 Tracing command syncer pid 23 tid 100099 td 0x18d7ea80 sched_switch(18d7ea80,0,104,189,1f58300,...) at sched_switch+0x80c/frame 0x1ea8eb48 mi_switch(104,0,1a5d1f5,22b,18d7ea80,...) at mi_switch+0x1f3/frame 0x1ea8eb84 sleepq_switch(18d7ea80,0,1a5d1f5,2d6,18d7ea80,...) at sleepq_switch+0x110/frame 0x1ea8ebb8 sleepq_timedwait(1fc87dc,0,1ea8ec1c,0,0,...) at sleepq_timedwait+0x53/frame 0x1ea8ebf8 _cv_timedwait_sbt(1fc87dc,1fc87bc,fffffed8,0,0,...) at _cv_timedwait_sbt+0x24a/frame 0x1ea8ec40 sched_sync(0,1ea8ece8,1a4c1ec,407,0,...) at sched_sync+0x6e0/frame 0x1ea8ecac fork_exit(115d7a0,0,1ea8ece8,0,0,...) at fork_exit+0x7e/frame 0x1ea8ecd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ea8ecd4 --- trap 0, eip = 0, esp = 0x1ea8ed20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 22 tid 100097 td 0x18d7f000 sched_switch(18d7f000,0,104,189,1f589c0,...) at sched_switch+0x80c/frame 0x1d6a8b78 mi_switch(104,0,1a5d1f5,22b,18d7f000,...) at mi_switch+0x1f3/frame 0x1d6a8bb4 sleepq_switch(18d7f000,0,1a5d1f5,2d6,b20,...) at sleepq_switch+0x110/frame 0x1d6a8be8 sleepq_timedwait(1fc816c,54,0,0,0,...) at sleepq_timedwait+0x53/frame 0x1d6a8c24 _sleep(1fc816c,1d23d00,54,1a67df8,fffffed8,...) at _sleep+0x332/frame 0x1d6a8c78 buf_daemon(0,1d6a8ce8,1a4c1ec,407,0,...) at buf_daemon+0xfc/frame 0x1d6a8cac fork_exit(113a260,0,1d6a8ce8,0,0,...) at fork_exit+0x7e/frame 0x1d6a8cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1d6a8cd4 --- trap 0, eip = 0, esp = 0x1d6a8d20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 22 tid 100100 td 0x1af7b000 sched_switch(1af7b000,0,104,189,1f58300,...) at sched_switch+0x80c/frame 0x1ea93b60 mi_switch(104,0,1a5d1f5,22b,1af7b000,...) at mi_switch+0x1f3/frame 0x1ea93b9c sleepq_switch(1af7b000,0,1a5d1f5,2d6,b20,...) at sleepq_switch+0x110/frame 0x1ea93bd0 sleepq_timedwait(1d24fc0,5c,0,0,0,...) at sleepq_timedwait+0x53/frame 0x1ea93c0c _sleep(1d24fc0,1d24f40,25c,1a3c3cb,fffffed8,...) at _sleep+0x332/frame 0x1ea93c60 bufspace_daemon(1d23e80,1ea93ce8,1a4c1ec,407,0,...) at bufspace_daemon+0x2d2/frame 0x1ea93cac fork_exit(113a600,1d23e80,1ea93ce8,0,0,...) at fork_exit+0x7e/frame 0x1ea93cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ea93cd4 --- trap 0, eip = 0, esp = 0x1ea93d20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 22 tid 100113 td 0x18d7e000 sched_switch(18d7e000,0,104,189,1f59080,...) at sched_switch+0x80c/frame 0x1eae1b70 mi_switch(104,0,1a5d1f5,22b,18d7e000,...) at mi_switch+0x1f3/frame 0x1eae1bac sleepq_switch(18d7e000,0,1a5d1f5,2d6,b20,...) at sleepq_switch+0x110/frame 0x1eae1be0 sleepq_timedwait(1b6c9a84,54,0,0,0,...) at sleepq_timedwait+0x53/frame 0x1eae1c1c _sleep(1b6c9a84,1b6c9a00,54,1aa32c1,7fffff6c,...) at _sleep+0x332/frame 0x1eae1c70 softdep_flush(1ed91000,1eae1ce8,1a4c1ec,407,0,...) at softdep_flush+0x199/frame 0x1eae1cac fork_exit(13826e0,1ed91000,1eae1ce8,0,0,...) at fork_exit+0x7e/frame 0x1eae1cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1eae1cd4 --- trap 0, eip = 0, esp = 0x1eae1d20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 22 tid 100115 td 0x18d13700 sched_switch(18d13700,0,104,189,1f59080,...) at sched_switch+0x80c/frame 0x1eaebb70 mi_switch(104,0,1a5d1f5,22b,18d13700,...) at mi_switch+0x1f3/frame 0x1eaebbac sleepq_switch(18d13700,0,1a5d1f5,2d6,b1f,...) at sleepq_switch+0x110/frame 0x1eaebbe0 sleepq_timedwait(1b4aa484,54,0,0,0,...) at sleepq_timedwait+0x53/frame 0x1eaebc1c _sleep(1b4aa484,1b4aa400,54,1aa32c1,7fffff6c,...) at _sleep+0x332/frame 0x1eaebc70 softdep_flush(1ed8f000,1eaebce8,1a4c1ec,407,0,...) at softdep_flush+0x199/frame 0x1eaebcac fork_exit(13826e0,1ed8f000,1eaebce8,0,0,...) at fork_exit+0x7e/frame 0x1eaebcd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1eaebcd4 --- trap 0, eip = 0, esp = 0x1eaebd20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 22 tid 100116 td 0x18d13380 sched_switch(18d13380,0,104,189,1f589c0,...) at sched_switch+0x80c/frame 0x1eaf0b70 mi_switch(104,0,1a5d1f5,22b,18d13380,...) at mi_switch+0x1f3/frame 0x1eaf0bac sleepq_switch(18d13380,0,1a5d1f5,2d6,b20,...) at sleepq_switch+0x110/frame 0x1eaf0be0 sleepq_timedwait(1b4aa284,54,0,0,0,...) at sleepq_timedwait+0x53/frame 0x1eaf0c1c _sleep(1b4aa284,1b4aa200,54,1aa32c1,7fffff6c,...) at _sleep+0x332/frame 0x1eaf0c70 softdep_flush(1ef59000,1eaf0ce8,1a4c1ec,407,0,...) at softdep_flush+0x199/frame 0x1eaf0cac fork_exit(13826e0,1ef59000,1eaf0ce8,0,0,...) at fork_exit+0x7e/frame 0x1eaf0cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1eaf0cd4 --- trap 0, eip = 0, esp = 0x1eaf0d20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 22 tid 100245 td 0x1f495700 sched_switch(1f495700,0,104,189,1f58300,...) at sched_switch+0x80c/frame 0x14e9db70 mi_switch(104,0,1a5d1f5,22b,1f495700,...) at mi_switch+0x1f3/frame 0x14e9dbac sleepq_switch(1f495700,0,1a5d1f5,2d6,b1f,...) at sleepq_switch+0x110/frame 0x14e9dbe0 sleepq_timedwait(1b4aa884,54,0,0,0,...) at sleepq_timedwait+0x53/frame 0x14e9dc1c _sleep(1b4aa884,1b4aa800,54,1aa32c1,7fffff6c,...) at _sleep+0x332/frame 0x14e9dc70 softdep_flush(1f54f000,14e9dce8,1a4c1ec,407,0,...) at softdep_flush+0x199/frame 0x14e9dcac fork_exit(13826e0,1f54f000,14e9dce8,0,0,...) at fork_exit+0x7e/frame 0x14e9dcd4 fork_trampoline() at PTDpde+0x22ae/frame 0x14e9dcd4 --- trap 0, eip = 0, esp = 0x14e9dd20, ebp = 0 --- (null)() at 0 Tracing command vmdaemon pid 21 tid 100096 td 0x18d7f380 sched_switch(18d7f380,0,104,189,1f59740,...) at sched_switch+0x80c/frame 0x1abfdb50 mi_switch(104,0,1a5d1f5,22b,18d7f380,...) at mi_switch+0x1f3/frame 0x1abfdb8c sleepq_switch(18d7f380,0,1a5d1f5,2b3,18d7f380,...) at sleepq_switch+0x110/frame 0x1abfdbc0 sleepq_wait(1fcd664,74,1a67df8,0,0,...) at sleepq_wait+0x48/frame 0x1abfdbe4 _sleep(1fcd664,1fcd650,74,1a67df8,0,...) at _sleep+0x396/frame 0x1abfdc38 vm_daemon(0,1abfdce8,1a4c1ec,407,0,...) at vm_daemon+0xa6/frame 0x1abfdcac fork_exit(13eeb20,0,1abfdce8,0,0,...) at fork_exit+0x7e/frame 0x1abfdcd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1abfdcd4 --- trap 0, eip = 0, esp = 0x1abfdd20, ebp = 0 --- (null)() at 0 Tracing command pagedaemon pid 20 tid 100095 td 0x18d7f700 sched_switch(18d7f700,0,104,189,1f59740,...) at sched_switch+0x80c/frame 0x1abf8ad8 mi_switch(104,0,1a5d1f5,22b,18d7f700,...) at mi_switch+0x1f3/frame 0x1abf8b14 sleepq_switch(18d7f700,0,1a5d1f5,2d6,b1f,...) at sleepq_switch+0x110/frame 0x1abf8b48 sleepq_timedwait(1ff78e8,54,0,0,0,...) at sleepq_timedwait+0x53/frame 0x1abf8b84 _sleep(1ff78e8,1ff7780,254,1a67df8,1999997c,...) at _sleep+0x332/frame 0x1abf8bd8 vm_pageout_worker(0,0,18d0e000,0,0,...) at vm_pageout_worker+0x2cb/frame 0x1abf8c7c vm_pageout(0,1abf8ce8,1a4c1ec,407,0,...) at vm_pageout+0x16a/frame 0x1abf8cac fork_exit(13e4a90,0,1abf8ce8,0,0,...) at fork_exit+0x7e/frame 0x1abf8cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1abf8cd4 --- trap 0, eip = 0, esp = 0x1abf8d20, ebp = 0 --- (null)() at 0 Tracing command pagedaemon pid 20 tid 100098 td 0x18dc0a80 sched_switch(18dc0a80,0,104,189,1f589c0,...) at sched_switch+0x80c/frame 0x1ea89b18 mi_switch(104,0,1a5d1f5,22b,18dc0a80,...) at mi_switch+0x1f3/frame 0x1ea89b54 sleepq_switch(18dc0a80,0,1a5d1f5,2b3,18dc0a80,...) at sleepq_switch+0x110/frame 0x1ea89b88 sleepq_wait(1ff78f0,54,1aac046,0,0,...) at sleepq_wait+0x48/frame 0x1ea89bac _sleep(1ff78f0,1ff7700,54,1aac046,0,...) at _sleep+0x396/frame 0x1ea89c00 vm_pageout_laundry_worker(0,1ea89ce8,1a4c1ec,407,0,...) at vm_pageout_laundry_worker+0xd18/frame 0x1ea89cac fork_exit(13e4c60,0,1ea89ce8,0,0,...) at fork_exit+0x7e/frame 0x1ea89cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ea89cd4 --- trap 0, eip = 0, esp = 0x1ea89d20, ebp = 0 --- (null)() at 0 Tracing command pagedaemon pid 20 tid 100102 td 0x1b653380 sched_switch(1b653380,0,104,189,1f58300,...) at sched_switch+0x80c/frame 0x1ea9db70 mi_switch(104,0,1a5d1f5,22b,1b653380,...) at mi_switch+0x1f3/frame 0x1ea9dbac sleepq_switch(1b653380,0,1a5d1f5,2d6,1f675c4,...) at sleepq_switch+0x110/frame 0x1ea9dbe0 sleepq_timedwait(13c2160,54,1ea9dc50,0,0,...) at sleepq_timedwait+0x53/frame 0x1ea9dc20 _sleep(13c2160,1fcd41c,54,1aa827b,fffffed8,...) at _sleep+0x332/frame 0x1ea9dc74 uma_reclaim_worker(0,1ea9dce8,1a4c1ec,407,0,...) at uma_reclaim_worker+0x147/frame 0x1ea9dcac fork_exit(13c27f0,0,1ea9dce8,0,0,...) at fork_exit+0x7e/frame 0x1ea9dcd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ea9dcd4 --- trap 0, eip = 0, esp = 0x1ea9dd20, ebp = 0 --- (null)() at 0 Tracing command rand_harvestq pid 19 tid 100089 td 0x1b111a80 sched_switch(1b111a80,0,104,189,1f589c0,...) at sched_switch+0x80c/frame 0x1abdab48 mi_switch(104,0,1a5d1f5,22b,1b111a80,...) at mi_switch+0x1f3/frame 0x1abdab84 sleepq_switch(1b111a80,0,1a5d1f5,2d6,b1f,...) at sleepq_switch+0x110/frame 0x1abdabb8 sleepq_timedwait(1e23320,0,0,0,0,...) at sleepq_timedwait+0x53/frame 0x1abdabf4 _sleep(1e23320,0,0,1a3c3cb,19999999,...) at _sleep+0x332/frame 0x1abdac48 random_kthread(0,1abdace8,1a4c1ec,407,0,...) at random_kthread+0x7c/frame 0x1abdacac fork_exit(d8b400,0,1abdace8,0,0,...) at fork_exit+0x7e/frame 0x1abdacd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1abdacd4 --- trap 0, eip = 0, esp = 0x1abdad20, ebp = 0 --- (null)() at 0 Tracing command sctp_iterator pid 18 tid 100088 td 0x1b113000 sched_switch(1b113000,0,104,189,1f59740,...) at sched_switch+0x80c/frame 0x1abd5b98 mi_switch(104,0,1a5d1f5,22b,1b113000,...) at mi_switch+0x1f3/frame 0x1abd5bd4 sleepq_switch(1b113000,0,1a5d1f5,2b3,1b113000,...) at sleepq_switch+0x110/frame 0x1abd5c08 sleepq_wait(1ff6bd8,0,1a85c5f,0,0,...) at sleepq_wait+0x48/frame 0x1abd5c2c _sleep(1ff6bd8,1ff6ba0,0,1a85c5f,0,...) at _sleep+0x396/frame 0x1abd5c80 sctp_iterator_thread(0,1abd5ce8,1a4c1ec,407,0,...) at sctp_iterator_thread+0x7c/frame 0x1abd5cac fork_exit(1228af0,0,1abd5ce8,0,0,...) at fork_exit+0x7e/frame 0x1abd5cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1abd5cd4 --- trap 0, eip = 0, esp = 0x1abd5d20, ebp = 0 --- (null)() at 0 Tracing command soaiod4 pid 17 tid 100087 td 0x1b113380 sched_switch(1b113380,0,104,189,1f58300,...) at sched_switch+0x80c/frame 0x1abcfb70 mi_switch(104,0,1a5d1f5,22b,1b113380,...) at mi_switch+0x1f3/frame 0x1abcfbac sleepq_switch(1b113380,0,1a5d1f5,2d6,b23,...) at sleepq_switch+0x110/frame 0x1abcfbe0 sleepq_timedwait(1fc7d98,0,1d,0,0,...) at sleepq_timedwait+0x53/frame 0x1abcfc1c _sleep(1fc7d98,1fc7d78,0,1a3c3cb,ffffdd50,...) at _sleep+0x332/frame 0x1abcfc70 soaio_kproc_loop(4,1abcfce8,1a4c1ec,407,0,...) at soaio_kproc_loop+0x1a7/frame 0x1abcfcac fork_exit(10fa5c0,4,1abcfce8,0,0,...) at fork_exit+0x7e/frame 0x1abcfcd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1abcfcd4 --- trap 0, eip = 0, esp = 0x1abcfd20, ebp = 0 --- (null)() at 0 Tracing command soaiod3 pid 16 tid 100086 td 0x1b113700 sched_switch(1b113700,0,104,189,1f59080,...) at sched_switch+0x80c/frame 0x1abcab70 mi_switch(104,0,1a5d1f5,22b,1b113700,...) at mi_switch+0x1f3/frame 0x1abcabac sleepq_switch(1b113700,0,1a5d1f5,2d6,b24,...) at sleepq_switch+0x110/frame 0x1abcabe0 sleepq_timedwait(1fc7d98,0,1d,0,0,...) at sleepq_timedwait+0x53/frame 0x1abcac1c _sleep(1fc7d98,1fc7d78,0,1a3c3cb,ffffdd50,...) at _sleep+0x332/frame 0x1abcac70 soaio_kproc_loop(3,1abcace8,1a4c1ec,407,0,...) at soaio_kproc_loop+0x1a7/frame 0x1abcacac fork_exit(10fa5c0,3,1abcace8,0,0,...) at fork_exit+0x7e/frame 0x1abcacd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1abcacd4 --- trap 0, eip = 0, esp = 0x1abcad20, ebp = 0 --- (null)() at 0 Tracing command soaiod2 pid 15 tid 100085 td 0x1b113a80 sched_switch(1b113a80,0,104,189,1f58300,...) at sched_switch+0x80c/frame 0x1abc5b70 mi_switch(104,0,1a5d1f5,22b,1b113a80,...) at mi_switch+0x1f3/frame 0x1abc5bac sleepq_switch(1b113a80,0,1a5d1f5,2d6,b24,...) at sleepq_switch+0x110/frame 0x1abc5be0 sleepq_timedwait(1fc7d98,0,1d,0,0,...) at sleepq_timedwait+0x53/frame 0x1abc5c1c _sleep(1fc7d98,1fc7d78,0,1a3c3cb,ffffdd50,...) at _sleep+0x332/frame 0x1abc5c70 soaio_kproc_loop(2,1abc5ce8,1a4c1ec,407,0,...) at soaio_kproc_loop+0x1a7/frame 0x1abc5cac fork_exit(10fa5c0,2,1abc5ce8,0,0,...) at fork_exit+0x7e/frame 0x1abc5cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1abc5cd4 --- trap 0, eip = 0, esp = 0x1abc5d20, ebp = 0 --- (null)() at 0 Tracing command soaiod1 pid 9 tid 100084 td 0x1b114000 sched_switch(1b114000,0,104,189,1f59080,...) at sched_switch+0x80c/frame 0x1abc0b70 mi_switch(104,0,1a5d1f5,22b,1b114000,...) at mi_switch+0x1f3/frame 0x1abc0bac sleepq_switch(1b114000,0,1a5d1f5,2d6,b25,...) at sleepq_switch+0x110/frame 0x1abc0be0 sleepq_timedwait(1fc7d98,0,1d,0,0,...) at sleepq_timedwait+0x53/frame 0x1abc0c1c _sleep(1fc7d98,1fc7d78,0,1a3c3cb,ffffdd50,...) at _sleep+0x332/frame 0x1abc0c70 soaio_kproc_loop(1,1abc0ce8,1a4c1ec,407,0,...) at soaio_kproc_loop+0x1a7/frame 0x1abc0cac fork_exit(10fa5c0,1,1abc0ce8,0,0,...) at fork_exit+0x7e/frame 0x1abc0cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1abc0cd4 --- trap 0, eip = 0, esp = 0x1abc0d20, ebp = 0 --- (null)() at 0 Tracing command fdc0 pid 8 tid 100081 td 0x1af7ba80 sched_switch(1af7ba80,0,104,189,1f58300,...) at sched_switch+0x80c/frame 0x1abb1b40 mi_switch(104,0,1a5d1f5,22b,1af7ba80,...) at mi_switch+0x1f3/frame 0x1abb1b7c sleepq_switch(1af7ba80,0,1a5d1f5,2b3,1af7ba80,...) at sleepq_switch+0x110/frame 0x1abb1bb0 sleepq_wait(18ffb23c,5c,1a3c3cb,0,0,...) at sleepq_wait+0x48/frame 0x1abb1bd4 _sleep(18ffb23c,18ffb2f0,5c,1a3c3cb,0,...) at _sleep+0x396/frame 0x1abb1c28 fdc_thread(18ffb200,1abb1ce8,1a4c1ec,407,0,...) at fdc_thread+0x336/frame 0x1abb1cac fork_exit(15c27a0,18ffb200,1abb1ce8,0,0,...) at fork_exit+0x7e/frame 0x1abb1cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1abb1cd4 --- trap 0, eip = 0, esp = 0x1abb1d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100046 td 0x1ac47000 sched_switch(1ac47000,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1aaf9ba8 mi_switch(104,0,1a5d1f5,22b,1ac47000,...) at mi_switch+0x1f3/frame 0x1aaf9be8 sleepq_switch(1ac47000,0,1a5d1f5,2b3,1d17d38,...) at sleepq_switch+0x110/frame 0x1aaf9c1c sleepq_wait(1ac35acc,0,1aaf9c60,1,0,...) at sleepq_wait+0x48/frame 0x1aaf9c40 _cv_wait(1ac35acc,1ac35cf8,1a1ded6,78,1ac35ad4,...) at _cv_wait+0x21f/frame 0x1aaf9c84 usb_process(1ac35ac4,1aaf9ce8,1a4c1ec,407,0,...) at usb_process+0x140/frame 0x1aaf9cac fork_exit(ebbc20,1ac35ac4,1aaf9ce8,0,0,...) at fork_exit+0x7e/frame 0x1aaf9cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aaf9cd4 --- trap 0, eip = 0, esp = 0x1aaf9d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100047 td 0x1ac46a80 sched_switch(1ac46a80,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1aafeba8 mi_switch(104,0,1a5d1f5,22b,1ac46a80,...) at mi_switch+0x1f3/frame 0x1aafebe8 sleepq_switch(1ac46a80,0,1a5d1f5,2b3,1d17d38,...) at sleepq_switch+0x110/frame 0x1aafec1c sleepq_wait(1ac35afc,0,1aafec60,1,0,...) at sleepq_wait+0x48/frame 0x1aafec40 _cv_wait(1ac35afc,1ac35cf8,1a1ded6,78,1ac35b04,...) at _cv_wait+0x21f/frame 0x1aafec84 usb_process(1ac35af4,1aafece8,1a4c1ec,407,0,...) at usb_process+0x140/frame 0x1aafecac fork_exit(ebbc20,1ac35af4,1aafece8,0,0,...) at fork_exit+0x7e/frame 0x1aafecd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aafecd4 --- trap 0, eip = 0, esp = 0x1aafed20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100048 td 0x1ac46700 sched_switch(1ac46700,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1ab03ba8 mi_switch(104,0,1a5d1f5,22b,1ac46700,...) at mi_switch+0x1f3/frame 0x1ab03be8 sleepq_switch(1ac46700,0,1a5d1f5,2b3,1d17d38,...) at sleepq_switch+0x110/frame 0x1ab03c1c sleepq_wait(1ac35b2c,0,1ab03c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab03c40 _cv_wait(1ac35b2c,1ac35cf8,1a1ded6,78,1ac35b34,...) at _cv_wait+0x21f/frame 0x1ab03c84 usb_process(1ac35b24,1ab03ce8,1a4c1ec,407,0,...) at usb_process+0x140/frame 0x1ab03cac fork_exit(ebbc20,1ac35b24,1ab03ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab03cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ab03cd4 --- trap 0, eip = 0, esp = 0x1ab03d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100049 td 0x1ac46380 sched_switch(1ac46380,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1ab08ba8 mi_switch(104,0,1a5d1f5,22b,1ac46380,...) at mi_switch+0x1f3/frame 0x1ab08be8 sleepq_switch(1ac46380,0,1a5d1f5,2b3,1d17d38,...) at sleepq_switch+0x110/frame 0x1ab08c1c sleepq_wait(1ac35b5c,0,1ab08c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab08c40 _cv_wait(1ac35b5c,1ac35cf8,1a1ded6,78,1ac35b64,...) at _cv_wait+0x21f/frame 0x1ab08c84 usb_process(1ac35b54,1ab08ce8,1a4c1ec,407,0,...) at usb_process+0x140/frame 0x1ab08cac fork_exit(ebbc20,1ac35b54,1ab08ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab08cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ab08cd4 --- trap 0, eip = 0, esp = 0x1ab08d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100050 td 0x1ac46000 sched_switch(1ac46000,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1ab0dba8 mi_switch(104,0,1a5d1f5,22b,1ac46000,...) at mi_switch+0x1f3/frame 0x1ab0dbe8 sleepq_switch(1ac46000,0,1a5d1f5,2b3,1d17d38,...) at sleepq_switch+0x110/frame 0x1ab0dc1c sleepq_wait(1ac35b8c,0,1ab0dc60,1,0,...) at sleepq_wait+0x48/frame 0x1ab0dc40 _cv_wait(1ac35b8c,1ac35cf8,1a1ded6,78,1ac35b94,...) at _cv_wait+0x21f/frame 0x1ab0dc84 usb_process(1ac35b84,1ab0dce8,1a4c1ec,407,0,...) at usb_process+0x140/frame 0x1ab0dcac fork_exit(ebbc20,1ac35b84,1ab0dce8,0,0,...) at fork_exit+0x7e/frame 0x1ab0dcd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ab0dcd4 --- trap 0, eip = 0, esp = 0x1ab0dd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100052 td 0x1ac3d700 sched_switch(1ac3d700,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1ab18ba8 mi_switch(104,0,1a5d1f5,22b,1ac3d700,...) at mi_switch+0x1f3/frame 0x1ab18be8 sleepq_switch(1ac3d700,0,1a5d1f5,2b3,1d17d38,...) at sleepq_switch+0x110/frame 0x1ab18c1c sleepq_wait(1aeefacc,0,1ab18c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab18c40 _cv_wait(1aeefacc,1aeefcf8,1a1ded6,78,1aeefad4,...) at _cv_wait+0x21f/frame 0x1ab18c84 usb_process(1aeefac4,1ab18ce8,1a4c1ec,407,0,...) at usb_process+0x140/frame 0x1ab18cac fork_exit(ebbc20,1aeefac4,1ab18ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab18cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ab18cd4 --- trap 0, eip = 0, esp = 0x1ab18d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100053 td 0x1ac3d380 sched_switch(1ac3d380,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1ab1dba8 mi_switch(104,0,1a5d1f5,22b,1ac3d380,...) at mi_switch+0x1f3/frame 0x1ab1dbe8 sleepq_switch(1ac3d380,0,1a5d1f5,2b3,1d17d38,...) at sleepq_switch+0x110/frame 0x1ab1dc1c sleepq_wait(1aeefafc,0,1ab1dc60,1,0,...) at sleepq_wait+0x48/frame 0x1ab1dc40 _cv_wait(1aeefafc,1aeefcf8,1a1ded6,78,1aeefb04,...) at _cv_wait+0x21f/frame 0x1ab1dc84 usb_process(1aeefaf4,1ab1dce8,1a4c1ec,407,0,...) at usb_process+0x140/frame 0x1ab1dcac fork_exit(ebbc20,1aeefaf4,1ab1dce8,0,0,...) at fork_exit+0x7e/frame 0x1ab1dcd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ab1dcd4 --- trap 0, eip = 0, esp = 0x1ab1dd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100054 td 0x1ac3d000 sched_switch(1ac3d000,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1ab22ba8 mi_switch(104,0,1a5d1f5,22b,1ac3d000,...) at mi_switch+0x1f3/frame 0x1ab22be8 sleepq_switch(1ac3d000,0,1a5d1f5,2b3,1d17d38,...) at sleepq_switch+0x110/frame 0x1ab22c1c sleepq_wait(1aeefb2c,0,1ab22c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab22c40 _cv_wait(1aeefb2c,1aeefcf8,1a1ded6,78,1aeefb34,...) at _cv_wait+0x21f/frame 0x1ab22c84 usb_process(1aeefb24,1ab22ce8,1a4c1ec,407,0,...) at usb_process+0x140/frame 0x1ab22cac fork_exit(ebbc20,1aeefb24,1ab22ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab22cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ab22cd4 --- trap 0, eip = 0, esp = 0x1ab22d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100055 td 0x1aef5380 sched_switch(1aef5380,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1ab27ba8 mi_switch(104,0,1a5d1f5,22b,1aef5380,...) at mi_switch+0x1f3/frame 0x1ab27be8 sleepq_switch(1aef5380,0,1a5d1f5,2b3,1d17d38,...) at sleepq_switch+0x110/frame 0x1ab27c1c sleepq_wait(1aeefb5c,0,1ab27c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab27c40 _cv_wait(1aeefb5c,1aeefcf8,1a1ded6,78,1aeefb64,...) at _cv_wait+0x21f/frame 0x1ab27c84 usb_process(1aeefb54,1ab27ce8,1a4c1ec,407,0,...) at usb_process+0x140/frame 0x1ab27cac fork_exit(ebbc20,1aeefb54,1ab27ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab27cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ab27cd4 --- trap 0, eip = 0, esp = 0x1ab27d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100056 td 0x1aef5000 sched_switch(1aef5000,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1ab2cba8 mi_switch(104,0,1a5d1f5,22b,1aef5000,...) at mi_switch+0x1f3/frame 0x1ab2cbe8 sleepq_switch(1aef5000,0,1a5d1f5,2b3,1d17d38,...) at sleepq_switch+0x110/frame 0x1ab2cc1c sleepq_wait(1aeefb8c,0,1ab2cc60,1,0,...) at sleepq_wait+0x48/frame 0x1ab2cc40 _cv_wait(1aeefb8c,1aeefcf8,1a1ded6,78,1aeefb94,...) at _cv_wait+0x21f/frame 0x1ab2cc84 usb_process(1aeefb84,1ab2cce8,1a4c1ec,407,0,...) at usb_process+0x140/frame 0x1ab2ccac fork_exit(ebbc20,1aeefb84,1ab2cce8,0,0,...) at fork_exit+0x7e/frame 0x1ab2ccd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ab2ccd4 --- trap 0, eip = 0, esp = 0x1ab2cd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100058 td 0x1aef4700 sched_switch(1aef4700,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1ab37ba8 mi_switch(104,0,1a5d1f5,22b,1aef4700,...) at mi_switch+0x1f3/frame 0x1ab37be8 sleepq_switch(1aef4700,0,1a5d1f5,2b3,1d17d38,...) at sleepq_switch+0x110/frame 0x1ab37c1c sleepq_wait(1aef6acc,0,1ab37c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab37c40 _cv_wait(1aef6acc,1aef6cf8,1a1ded6,78,1aef6ad4,...) at _cv_wait+0x21f/frame 0x1ab37c84 usb_process(1aef6ac4,1ab37ce8,1a4c1ec,407,0,...) at usb_process+0x140/frame 0x1ab37cac fork_exit(ebbc20,1aef6ac4,1ab37ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab37cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ab37cd4 --- trap 0, eip = 0, esp = 0x1ab37d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100059 td 0x1aef4380 sched_switch(1aef4380,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1ab3cba8 mi_switch(104,0,1a5d1f5,22b,1aef4380,...) at mi_switch+0x1f3/frame 0x1ab3cbe8 sleepq_switch(1aef4380,0,1a5d1f5,2b3,1d17d38,...) at sleepq_switch+0x110/frame 0x1ab3cc1c sleepq_wait(1aef6afc,0,1ab3cc60,1,0,...) at sleepq_wait+0x48/frame 0x1ab3cc40 _cv_wait(1aef6afc,1aef6cf8,1a1ded6,78,1aef6b04,...) at _cv_wait+0x21f/frame 0x1ab3cc84 usb_process(1aef6af4,1ab3cce8,1a4c1ec,407,0,...) at usb_process+0x140/frame 0x1ab3ccac fork_exit(ebbc20,1aef6af4,1ab3cce8,0,0,...) at fork_exit+0x7e/frame 0x1ab3ccd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ab3ccd4 --- trap 0, eip = 0, esp = 0x1ab3cd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100060 td 0x1aef4000 sched_switch(1aef4000,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1ab41ba8 mi_switch(104,0,1a5d1f5,22b,1aef4000,...) at mi_switch+0x1f3/frame 0x1ab41be8 sleepq_switch(1aef4000,0,1a5d1f5,2b3,1d17d38,...) at sleepq_switch+0x110/frame 0x1ab41c1c sleepq_wait(1aef6b2c,0,1ab41c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab41c40 _cv_wait(1aef6b2c,1aef6cf8,1a1ded6,78,1aef6b34,...) at _cv_wait+0x21f/frame 0x1ab41c84 usb_process(1aef6b24,1ab41ce8,1a4c1ec,407,0,...) at usb_process+0x140/frame 0x1ab41cac fork_exit(ebbc20,1aef6b24,1ab41ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab41cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ab41cd4 --- trap 0, eip = 0, esp = 0x1ab41d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100061 td 0x1aef3a80 sched_switch(1aef3a80,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1ab46ba8 mi_switch(104,0,1a5d1f5,22b,1aef3a80,...) at mi_switch+0x1f3/frame 0x1ab46be8 sleepq_switch(1aef3a80,0,1a5d1f5,2b3,1d17d38,...) at sleepq_switch+0x110/frame 0x1ab46c1c sleepq_wait(1aef6b5c,0,1ab46c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab46c40 _cv_wait(1aef6b5c,1aef6cf8,1a1ded6,78,1aef6b64,...) at _cv_wait+0x21f/frame 0x1ab46c84 usb_process(1aef6b54,1ab46ce8,1a4c1ec,407,0,...) at usb_process+0x140/frame 0x1ab46cac fork_exit(ebbc20,1aef6b54,1ab46ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab46cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ab46cd4 --- trap 0, eip = 0, esp = 0x1ab46d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100062 td 0x1aef3700 sched_switch(1aef3700,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1ab4bba8 mi_switch(104,0,1a5d1f5,22b,1aef3700,...) at mi_switch+0x1f3/frame 0x1ab4bbe8 sleepq_switch(1aef3700,0,1a5d1f5,2b3,1d17d38,...) at sleepq_switch+0x110/frame 0x1ab4bc1c sleepq_wait(1aef6b8c,0,1ab4bc60,1,0,...) at sleepq_wait+0x48/frame 0x1ab4bc40 _cv_wait(1aef6b8c,1aef6cf8,1a1ded6,78,1aef6b94,...) at _cv_wait+0x21f/frame 0x1ab4bc84 usb_process(1aef6b84,1ab4bce8,1a4c1ec,407,0,...) at usb_process+0x140/frame 0x1ab4bcac fork_exit(ebbc20,1aef6b84,1ab4bce8,0,0,...) at fork_exit+0x7e/frame 0x1ab4bcd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ab4bcd4 --- trap 0, eip = 0, esp = 0x1ab4bd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100063 td 0x1aef3380 sched_switch(1aef3380,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1ab51ba8 mi_switch(104,0,1a5d1f5,22b,1aef3380,...) at mi_switch+0x1f3/frame 0x1ab51be8 sleepq_switch(1aef3380,0,1a5d1f5,2b3,1d17d38,...) at sleepq_switch+0x110/frame 0x1ab51c1c sleepq_wait(1aefaacc,0,1ab51c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab51c40 _cv_wait(1aefaacc,1aefacf8,1a1ded6,78,1aefaad4,...) at _cv_wait+0x21f/frame 0x1ab51c84 usb_process(1aefaac4,1ab51ce8,1a4c1ec,407,0,...) at usb_process+0x140/frame 0x1ab51cac fork_exit(ebbc20,1aefaac4,1ab51ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab51cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ab51cd4 --- trap 0, eip = 0, esp = 0x1ab51d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100064 td 0x1aef3000 sched_switch(1aef3000,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1ab56ba8 mi_switch(104,0,1a5d1f5,22b,1aef3000,...) at mi_switch+0x1f3/frame 0x1ab56be8 sleepq_switch(1aef3000,0,1a5d1f5,2b3,1d17d38,...) at sleepq_switch+0x110/frame 0x1ab56c1c sleepq_wait(1aefaafc,0,1ab56c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab56c40 _cv_wait(1aefaafc,1aefacf8,1a1ded6,78,1aefab04,...) at _cv_wait+0x21f/frame 0x1ab56c84 usb_process(1aefaaf4,1ab56ce8,1a4c1ec,407,0,...) at usb_process+0x140/frame 0x1ab56cac fork_exit(ebbc20,1aefaaf4,1ab56ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab56cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ab56cd4 --- trap 0, eip = 0, esp = 0x1ab56d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100065 td 0x1ac48a80 sched_switch(1ac48a80,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1ab5bba8 mi_switch(104,0,1a5d1f5,22b,1ac48a80,...) at mi_switch+0x1f3/frame 0x1ab5bbe8 sleepq_switch(1ac48a80,0,1a5d1f5,2b3,1d17d38,...) at sleepq_switch+0x110/frame 0x1ab5bc1c sleepq_wait(1aefab2c,0,1ab5bc60,1,0,...) at sleepq_wait+0x48/frame 0x1ab5bc40 _cv_wait(1aefab2c,1aefacf8,1a1ded6,78,1aefab34,...) at _cv_wait+0x21f/frame 0x1ab5bc84 usb_process(1aefab24,1ab5bce8,1a4c1ec,407,0,...) at usb_process+0x140/frame 0x1ab5bcac fork_exit(ebbc20,1aefab24,1ab5bce8,0,0,...) at fork_exit+0x7e/frame 0x1ab5bcd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ab5bcd4 --- trap 0, eip = 0, esp = 0x1ab5bd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100066 td 0x1ac48700 sched_switch(1ac48700,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1ab60ba8 mi_switch(104,0,1a5d1f5,22b,1ac48700,...) at mi_switch+0x1f3/frame 0x1ab60be8 sleepq_switch(1ac48700,0,1a5d1f5,2b3,1d17d38,...) at sleepq_switch+0x110/frame 0x1ab60c1c sleepq_wait(1aefab5c,0,1ab60c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab60c40 _cv_wait(1aefab5c,1aefacf8,1a1ded6,78,1aefab64,...) at _cv_wait+0x21f/frame 0x1ab60c84 usb_process(1aefab54,1ab60ce8,1a4c1ec,407,0,...) at usb_process+0x140/frame 0x1ab60cac fork_exit(ebbc20,1aefab54,1ab60ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab60cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ab60cd4 --- trap 0, eip = 0, esp = 0x1ab60d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100067 td 0x1ac48380 sched_switch(1ac48380,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1ab65ba8 mi_switch(104,0,1a5d1f5,22b,1ac48380,...) at mi_switch+0x1f3/frame 0x1ab65be8 sleepq_switch(1ac48380,0,1a5d1f5,2b3,1d17d38,...) at sleepq_switch+0x110/frame 0x1ab65c1c sleepq_wait(1aefab8c,0,1ab65c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab65c40 _cv_wait(1aefab8c,1aefacf8,1a1ded6,78,1aefab94,...) at _cv_wait+0x21f/frame 0x1ab65c84 usb_process(1aefab84,1ab65ce8,1a4c1ec,407,0,...) at usb_process+0x140/frame 0x1ab65cac fork_exit(ebbc20,1aefab84,1ab65ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab65cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ab65cd4 --- trap 0, eip = 0, esp = 0x1ab65d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100068 td 0x1af07700 sched_switch(1af07700,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1ab6bba8 mi_switch(104,0,1a5d1f5,22b,1af07700,...) at mi_switch+0x1f3/frame 0x1ab6bbe8 sleepq_switch(1af07700,0,1a5d1f5,2b3,1d17d38,...) at sleepq_switch+0x110/frame 0x1ab6bc1c sleepq_wait(1af01acc,0,1ab6bc60,1,0,...) at sleepq_wait+0x48/frame 0x1ab6bc40 _cv_wait(1af01acc,1af01cf8,1a1ded6,78,1af01ad4,...) at _cv_wait+0x21f/frame 0x1ab6bc84 usb_process(1af01ac4,1ab6bce8,1a4c1ec,407,0,...) at usb_process+0x140/frame 0x1ab6bcac fork_exit(ebbc20,1af01ac4,1ab6bce8,0,0,...) at fork_exit+0x7e/frame 0x1ab6bcd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ab6bcd4 --- trap 0, eip = 0, esp = 0x1ab6bd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100069 td 0x1af07380 sched_switch(1af07380,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1ab70ba8 mi_switch(104,0,1a5d1f5,22b,1af07380,...) at mi_switch+0x1f3/frame 0x1ab70be8 sleepq_switch(1af07380,0,1a5d1f5,2b3,1d17d38,...) at sleepq_switch+0x110/frame 0x1ab70c1c sleepq_wait(1af01afc,0,1ab70c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab70c40 _cv_wait(1af01afc,1af01cf8,1a1ded6,78,1af01b04,...) at _cv_wait+0x21f/frame 0x1ab70c84 usb_process(1af01af4,1ab70ce8,1a4c1ec,407,0,...) at usb_process+0x140/frame 0x1ab70cac fork_exit(ebbc20,1af01af4,1ab70ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab70cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ab70cd4 --- trap 0, eip = 0, esp = 0x1ab70d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100070 td 0x1af07000 sched_switch(1af07000,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1ab75ba8 mi_switch(104,0,1a5d1f5,22b,1af07000,...) at mi_switch+0x1f3/frame 0x1ab75be8 sleepq_switch(1af07000,0,1a5d1f5,2b3,1d17d38,...) at sleepq_switch+0x110/frame 0x1ab75c1c sleepq_wait(1af01b2c,0,1ab75c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab75c40 _cv_wait(1af01b2c,1af01cf8,1a1ded6,78,1af01b34,...) at _cv_wait+0x21f/frame 0x1ab75c84 usb_process(1af01b24,1ab75ce8,1a4c1ec,407,0,...) at usb_process+0x140/frame 0x1ab75cac fork_exit(ebbc20,1af01b24,1ab75ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab75cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ab75cd4 --- trap 0, eip = 0, esp = 0x1ab75d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100071 td 0x1af06a80 sched_switch(1af06a80,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1ab7aba8 mi_switch(104,0,1a5d1f5,22b,1af06a80,...) at mi_switch+0x1f3/frame 0x1ab7abe8 sleepq_switch(1af06a80,0,1a5d1f5,2b3,1d17d38,...) at sleepq_switch+0x110/frame 0x1ab7ac1c sleepq_wait(1af01b5c,0,1ab7ac60,1,0,...) at sleepq_wait+0x48/frame 0x1ab7ac40 _cv_wait(1af01b5c,1af01cf8,1a1ded6,78,1af01b64,...) at _cv_wait+0x21f/frame 0x1ab7ac84 usb_process(1af01b54,1ab7ace8,1a4c1ec,407,0,...) at usb_process+0x140/frame 0x1ab7acac fork_exit(ebbc20,1af01b54,1ab7ace8,0,0,...) at fork_exit+0x7e/frame 0x1ab7acd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ab7acd4 --- trap 0, eip = 0, esp = 0x1ab7ad20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100072 td 0x1af06700 sched_switch(1af06700,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1ab7fba8 mi_switch(104,0,1a5d1f5,22b,1af06700,...) at mi_switch+0x1f3/frame 0x1ab7fbe8 sleepq_switch(1af06700,0,1a5d1f5,2b3,1d17d38,...) at sleepq_switch+0x110/frame 0x1ab7fc1c sleepq_wait(1af01b8c,0,1ab7fc60,1,0,...) at sleepq_wait+0x48/frame 0x1ab7fc40 _cv_wait(1af01b8c,1af01cf8,1a1ded6,78,1af01b94,...) at _cv_wait+0x21f/frame 0x1ab7fc84 usb_process(1af01b84,1ab7fce8,1a4c1ec,407,0,...) at usb_process+0x140/frame 0x1ab7fcac fork_exit(ebbc20,1af01b84,1ab7fce8,0,0,...) at fork_exit+0x7e/frame 0x1ab7fcd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ab7fcd4 --- trap 0, eip = 0, esp = 0x1ab7fd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100074 td 0x1af06000 sched_switch(1af06000,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1ab8aba8 mi_switch(104,0,1a5d1f5,22b,1af06000,...) at mi_switch+0x1f3/frame 0x1ab8abe8 sleepq_switch(1af06000,0,1a5d1f5,2b3,1d17d38,...) at sleepq_switch+0x110/frame 0x1ab8ac1c sleepq_wait(1ac25ca4,0,1ab8ac60,1,0,...) at sleepq_wait+0x48/frame 0x1ab8ac40 _cv_wait(1ac25ca4,1ac25ed0,1a1ded6,78,1ac25cac,...) at _cv_wait+0x21f/frame 0x1ab8ac84 usb_process(1ac25c9c,1ab8ace8,1a4c1ec,407,0,...) at usb_process+0x140/frame 0x1ab8acac fork_exit(ebbc20,1ac25c9c,1ab8ace8,0,0,...) at fork_exit+0x7e/frame 0x1ab8acd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ab8acd4 --- trap 0, eip = 0, esp = 0x1ab8ad20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100075 td 0x1af05a80 sched_switch(1af05a80,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1ab8fba8 mi_switch(104,0,1a5d1f5,22b,1af05a80,...) at mi_switch+0x1f3/frame 0x1ab8fbe8 sleepq_switch(1af05a80,0,1a5d1f5,2b3,1d17d38,...) at sleepq_switch+0x110/frame 0x1ab8fc1c sleepq_wait(1ac25cd4,0,1ab8fc60,1,0,...) at sleepq_wait+0x48/frame 0x1ab8fc40 _cv_wait(1ac25cd4,1ac25ed0,1a1ded6,78,1ac25cdc,...) at _cv_wait+0x21f/frame 0x1ab8fc84 usb_process(1ac25ccc,1ab8fce8,1a4c1ec,407,0,...) at usb_process+0x140/frame 0x1ab8fcac fork_exit(ebbc20,1ac25ccc,1ab8fce8,0,0,...) at fork_exit+0x7e/frame 0x1ab8fcd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ab8fcd4 --- trap 0, eip = 0, esp = 0x1ab8fd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100076 td 0x1af05700 sched_switch(1af05700,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1ab94ba8 mi_switch(104,0,1a5d1f5,22b,1af05700,...) at mi_switch+0x1f3/frame 0x1ab94be8 sleepq_switch(1af05700,0,1a5d1f5,2b3,1d17d38,...) at sleepq_switch+0x110/frame 0x1ab94c1c sleepq_wait(1ac25d04,0,1ab94c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab94c40 _cv_wait(1ac25d04,1ac25ed0,1a1ded6,78,1ac25d0c,...) at _cv_wait+0x21f/frame 0x1ab94c84 usb_process(1ac25cfc,1ab94ce8,1a4c1ec,407,0,...) at usb_process+0x140/frame 0x1ab94cac fork_exit(ebbc20,1ac25cfc,1ab94ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab94cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ab94cd4 --- trap 0, eip = 0, esp = 0x1ab94d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100077 td 0x1af05380 sched_switch(1af05380,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1ab99ba8 mi_switch(104,0,1a5d1f5,22b,1af05380,...) at mi_switch+0x1f3/frame 0x1ab99be8 sleepq_switch(1af05380,0,1a5d1f5,2b3,1d17d38,...) at sleepq_switch+0x110/frame 0x1ab99c1c sleepq_wait(1ac25d34,0,1ab99c60,1,0,...) at sleepq_wait+0x48/frame 0x1ab99c40 _cv_wait(1ac25d34,1ac25ed0,1a1ded6,78,1ac25d3c,...) at _cv_wait+0x21f/frame 0x1ab99c84 usb_process(1ac25d2c,1ab99ce8,1a4c1ec,407,0,...) at usb_process+0x140/frame 0x1ab99cac fork_exit(ebbc20,1ac25d2c,1ab99ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab99cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ab99cd4 --- trap 0, eip = 0, esp = 0x1ab99d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 14 tid 100078 td 0x1af05000 sched_switch(1af05000,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1ab9eba8 mi_switch(104,0,1a5d1f5,22b,1af05000,...) at mi_switch+0x1f3/frame 0x1ab9ebe8 sleepq_switch(1af05000,0,1a5d1f5,2b3,1d17d38,...) at sleepq_switch+0x110/frame 0x1ab9ec1c sleepq_wait(1ac25d64,0,1ab9ec60,1,0,...) at sleepq_wait+0x48/frame 0x1ab9ec40 _cv_wait(1ac25d64,1ac25ed0,1a1ded6,78,1ac25d6c,...) at _cv_wait+0x21f/frame 0x1ab9ec84 usb_process(1ac25d5c,1ab9ece8,1a4c1ec,407,0,...) at usb_process+0x140/frame 0x1ab9ecac fork_exit(ebbc20,1ac25d5c,1ab9ece8,0,0,...) at fork_exit+0x7e/frame 0x1ab9ecd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ab9ecd4 --- trap 0, eip = 0, esp = 0x1ab9ed20, ebp = 0 --- (null)() at 0 Tracing command cam pid 7 tid 100041 td 0x18e5e000 sched_switch(18e5e000,0,104,189,1f58300,...) at sched_switch+0x80c/frame 0x1aaafb78 mi_switch(104,0,1a5d1f5,22b,18e5e000,...) at mi_switch+0x1f3/frame 0x1aaafbb4 sleepq_switch(18e5e000,0,1a5d1f5,2b3,18e5e000,...) at sleepq_switch+0x110/frame 0x1aaafbe8 sleepq_wait(1d706c0,5c,1a3c3cb,0,0,...) at sleepq_wait+0x48/frame 0x1aaafc0c _sleep(1d706c0,1d70680,5c,1a3c3cb,0,...) at _sleep+0x396/frame 0x1aaafc60 xpt_done_td(1d70680,1aaafce8,1a4c1ec,407,0,...) at xpt_done_td+0x9b/frame 0x1aaafcac fork_exit(8e2820,1d70680,1aaafce8,0,0,...) at fork_exit+0x7e/frame 0x1aaafcd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aaafcd4 --- trap 0, eip = 0, esp = 0x1aaafd20, ebp = 0 --- (null)() at 0 Tracing command cam pid 7 tid 100094 td 0x1aff6700 sched_switch(1aff6700,0,104,189,1f59080,...) at sched_switch+0x80c/frame 0x1abf3b70 mi_switch(104,0,1a5d1f5,22b,1aff6700,...) at mi_switch+0x1f3/frame 0x1abf3bac sleepq_switch(1aff6700,0,1a5d1f5,2b3,1aff6700,...) at sleepq_switch+0x110/frame 0x1abf3be0 sleepq_wait(1d705ec,5c,1a3c3cb,0,0,...) at sleepq_wait+0x48/frame 0x1abf3c04 _sleep(1d705ec,1d70640,5c,1a3c3cb,0,...) at _sleep+0x396/frame 0x1abf3c58 xpt_scanner_thread(0,1abf3ce8,1a4c1ec,407,0,...) at xpt_scanner_thread+0x97/frame 0x1abf3cac fork_exit(8e2ba0,0,1abf3ce8,0,0,...) at fork_exit+0x7e/frame 0x1abf3cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1abf3cd4 --- trap 0, eip = 0, esp = 0x1abf3d20, ebp = 0 --- (null)() at 0 Tracing command crypto returns 3 pid 6 tid 100040 td 0x18e5e380 sched_switch(18e5e380,0,104,189,1f58300,...) at sched_switch+0x80c/frame 0x1aaaab70 mi_switch(104,0,1a5d1f5,22b,18e5e380,...) at mi_switch+0x1f3/frame 0x1aaaabac sleepq_switch(18e5e380,0,1a5d1f5,2b3,18e5e380,...) at sleepq_switch+0x110/frame 0x1aaaabe0 sleepq_wait(18e960c4,6c,1a9a549,0,0,...) at sleepq_wait+0x48/frame 0x1aaaac04 _sleep(18e960c4,18e960a8,6c,1a9a549,0,...) at _sleep+0x396/frame 0x1aaaac58 crypto_ret_proc(18e960a8,1aaaace8,1a4c1ec,407,0,...) at crypto_ret_proc+0x241/frame 0x1aaaacac fork_exit(132a0d0,18e960a8,1aaaace8,0,0,...) at fork_exit+0x7e/frame 0x1aaaacd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aaaacd4 --- trap 0, eip = 0, esp = 0x1aaaad20, ebp = 0 --- (null)() at 0 Tracing command crypto returns 2 pid 5 tid 100039 td 0x18e5e700 sched_switch(18e5e700,0,104,189,1f59740,...) at sched_switch+0x80c/frame 0x1aaa5b70 mi_switch(104,0,1a5d1f5,22b,18e5e700,...) at mi_switch+0x1f3/frame 0x1aaa5bac sleepq_switch(18e5e700,0,1a5d1f5,2b3,18e5e700,...) at sleepq_switch+0x110/frame 0x1aaa5be0 sleepq_wait(18e9608c,6c,1a9a549,0,0,...) at sleepq_wait+0x48/frame 0x1aaa5c04 _sleep(18e9608c,18e96070,6c,1a9a549,0,...) at _sleep+0x396/frame 0x1aaa5c58 crypto_ret_proc(18e96070,1aaa5ce8,1a4c1ec,407,0,...) at crypto_ret_proc+0x241/frame 0x1aaa5cac fork_exit(132a0d0,18e96070,1aaa5ce8,0,0,...) at fork_exit+0x7e/frame 0x1aaa5cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aaa5cd4 --- trap 0, eip = 0, esp = 0x1aaa5d20, ebp = 0 --- (null)() at 0 Tracing command crypto returns 1 pid 4 tid 100038 td 0x18e5ea80 sched_switch(18e5ea80,0,104,189,1f59080,...) at sched_switch+0x80c/frame 0x1aaa0b70 mi_switch(104,0,1a5d1f5,22b,18e5ea80,...) at mi_switch+0x1f3/frame 0x1aaa0bac sleepq_switch(18e5ea80,0,1a5d1f5,2b3,18e5ea80,...) at sleepq_switch+0x110/frame 0x1aaa0be0 sleepq_wait(18e96054,6c,1a9a549,0,0,...) at sleepq_wait+0x48/frame 0x1aaa0c04 _sleep(18e96054,18e96038,6c,1a9a549,0,...) at _sleep+0x396/frame 0x1aaa0c58 crypto_ret_proc(18e96038,1aaa0ce8,1a4c1ec,407,0,...) at crypto_ret_proc+0x241/frame 0x1aaa0cac fork_exit(132a0d0,18e96038,1aaa0ce8,0,0,...) at fork_exit+0x7e/frame 0x1aaa0cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aaa0cd4 --- trap 0, eip = 0, esp = 0x1aaa0d20, ebp = 0 --- (null)() at 0 Tracing command crypto returns 0 pid 3 tid 100037 td 0x18e5f000 sched_switch(18e5f000,0,104,189,1f58300,...) at sched_switch+0x80c/frame 0x1aa9bb70 mi_switch(104,0,1a5d1f5,22b,18e5f000,...) at mi_switch+0x1f3/frame 0x1aa9bbac sleepq_switch(18e5f000,0,1a5d1f5,2b3,18e5f000,...) at sleepq_switch+0x110/frame 0x1aa9bbe0 sleepq_wait(18e9601c,6c,1a9a549,0,0,...) at sleepq_wait+0x48/frame 0x1aa9bc04 _sleep(18e9601c,18e96000,6c,1a9a549,0,...) at _sleep+0x396/frame 0x1aa9bc58 crypto_ret_proc(18e96000,1aa9bce8,1a4c1ec,407,0,...) at crypto_ret_proc+0x241/frame 0x1aa9bcac fork_exit(132a0d0,18e96000,1aa9bce8,0,0,...) at fork_exit+0x7e/frame 0x1aa9bcd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aa9bcd4 --- trap 0, eip = 0, esp = 0x1aa9bd20, ebp = 0 --- (null)() at 0 Tracing command crypto pid 2 tid 100036 td 0x18e5f380 sched_switch(18e5f380,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1aa96b80 mi_switch(104,0,1a5d1f5,22b,18e5f380,...) at mi_switch+0x1f3/frame 0x1aa96bc0 sleepq_switch(18e5f380,0,1a5d1f5,2b3,18e5f380,...) at sleepq_switch+0x110/frame 0x1aa96bf4 sleepq_wait(1fcc5b4,6c,1a9a53d,0,0,...) at sleepq_wait+0x48/frame 0x1aa96c18 _sleep(1fcc5b4,1fcc59c,6c,1a9a53d,0,...) at _sleep+0x396/frame 0x1aa96c6c crypto_proc(0,1aa96ce8,1a4c1ec,407,0,...) at crypto_proc+0x2a7/frame 0x1aa96cac fork_exit(1329cd0,0,1aa96ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa96cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aa96cd4 --- trap 0, eip = 0, esp = 0x1aa96d20, ebp = 0 --- (null)() at 0 Tracing command geom pid 13 tid 100028 td 0x18d80a80 sched_switch(18d80a80,0,104,189,1f589c0,...) at sched_switch+0x80c/frame 0x1aa6eb88 mi_switch(104,0,1a5d1f5,22b,18d80a80,...) at mi_switch+0x1f3/frame 0x1aa6ebc4 sleepq_switch(18d80a80,0,1a5d1f5,2b3,18d80a80,...) at sleepq_switch+0x110/frame 0x1aa6ebf8 sleepq_wait(1ff3060,5c,1a3c3cb,0,0,...) at sleepq_wait+0x48/frame 0x1aa6ec1c _sleep(1ff3060,1f47da8,25c,1a3c3cb,0,...) at _sleep+0x396/frame 0x1aa6ec70 g_run_events(0,1aa6ece8,1a4c1ec,407,0,...) at g_run_events+0x67/frame 0x1aa6ecac fork_exit(fc4810,0,1aa6ece8,0,0,...) at fork_exit+0x7e/frame 0x1aa6ecd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aa6ecd4 --- trap 0, eip = 0, esp = 0x1aa6ed20, ebp = 0 --- (null)() at 0 Tracing command geom pid 13 tid 100029 td 0x18d80700 sched_switch(18d80700,0,104,189,1f58300,...) at sched_switch+0x80c/frame 0x1aa73b78 mi_switch(104,0,1a5d1f5,22b,18d80700,...) at mi_switch+0x1f3/frame 0x1aa73bb4 sleepq_switch(18d80700,0,1a5d1f5,2b3,18d80700,...) at sleepq_switch+0x110/frame 0x1aa73be8 sleepq_wait(1ff3064,5c,1a3c3cb,0,0,...) at sleepq_wait+0x48/frame 0x1aa73c0c _sleep(1ff3064,1f47df0,25c,1a3c3cb,0,...) at _sleep+0x396/frame 0x1aa73c60 g_io_schedule_up(18d80700,0,1a3e478,61,1aa73cd4,...) at g_io_schedule_up+0xcf/frame 0x1aa73c94 g_up_procbody(0,1aa73ce8,1a4c1ec,407,0,...) at g_up_procbody+0x7d/frame 0x1aa73cac fork_exit(fc4890,0,1aa73ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa73cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aa73cd4 --- trap 0, eip = 0, esp = 0x1aa73d20, ebp = 0 --- (null)() at 0 Tracing command geom pid 13 tid 100030 td 0x18e60a80 sched_switch(18e60a80,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1aa78b70 mi_switch(104,0,1a5d1f5,22b,18e60a80,...) at mi_switch+0x1f3/frame 0x1aa78bb0 sleepq_switch(18e60a80,0,1a5d1f5,2b3,18e60a80,...) at sleepq_switch+0x110/frame 0x1aa78be4 sleepq_wait(1ff3068,5c,1a3c3cb,0,0,...) at sleepq_wait+0x48/frame 0x1aa78c08 _sleep(1ff3068,1f47dd0,25c,1a3c3cb,0,...) at _sleep+0x396/frame 0x1aa78c5c g_io_schedule_down(18e60a80,0,1a3e478,6d,1aa78cd4,...) at g_io_schedule_down+0xec/frame 0x1aa78c94 g_down_procbody(0,1aa78ce8,1a4c1ec,407,0,...) at g_down_procbody+0x7d/frame 0x1aa78cac fork_exit(fc4910,0,1aa78ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa78cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aa78cd4 --- trap 0, eip = 0, esp = 0x1aa78d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100007 td 0x18d11700 sched_switch(18d11700,0,109,189,8,...) at sched_switch+0x80c/frame 0x1aa05c30 mi_switch(109,0,1a4c591,5a1,1a4c1ec,...) at mi_switch+0x1f3/frame 0x1aa05c70 ithread_loop(b94a0e0,1aa05ce8,1a4c1ec,407,0,...) at ithread_loop+0x200/frame 0x1aa05cac fork_exit(10432f0,b94a0e0,1aa05ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa05cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aa05cd4 --- trap 0, eip = 0, esp = 0x1aa05d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100008 td 0x18d11380 sched_switch(18d11380,0,109,189,8,...) at sched_switch+0x80c/frame 0x1aa0ac30 mi_switch(109,0,1a4c591,5a1,1a4c1ec,...) at mi_switch+0x1f3/frame 0x1aa0ac70 ithread_loop(b94a0d0,1aa0ace8,1a4c1ec,407,0,...) at ithread_loop+0x200/frame 0x1aa0acac fork_exit(10432f0,b94a0d0,1aa0ace8,0,0,...) at fork_exit+0x7e/frame 0x1aa0acd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aa0acd4 --- trap 0, eip = 0, esp = 0x1aa0ad20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100010 td 0x18d10a80 PTDpde() at PTDpde+0x22a4 Tracing command intr pid 12 tid 100022 td 0x18dbf380 sched_switch(18dbf380,0,109,189,8,...) at sched_switch+0x80c/frame 0x1aa50c30 mi_switch(109,0,1a4c591,5a1,1a4c1ec,...) at mi_switch+0x1f3/frame 0x1aa50c70 ithread_loop(18dd8050,1aa50ce8,1a4c1ec,407,0,...) at ithread_loop+0x200/frame 0x1aa50cac fork_exit(10432f0,18dd8050,1aa50ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa50cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aa50cd4 --- trap 0, eip = 0, esp = 0x1aa50d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100023 td 0x18dbf000 PTDpde() at PTDpde+0x22a4 Tracing command intr pid 12 tid 100024 td 0x18d97a80 PTDpde() at PTDpde+0x22a4 Tracing command intr pid 12 tid 100025 td 0x18d97700 PTDpde() at PTDpde+0x22a4 Tracing command intr pid 12 tid 100026 td 0x18d97380 sched_switch(18d97380,0,109,189,8,...) at sched_switch+0x80c/frame 0x1aa64c30 mi_switch(109,0,1a4c591,5a1,1a4c1ec,...) at mi_switch+0x1f3/frame 0x1aa64c70 ithread_loop(18dd8010,1aa64ce8,1a4c1ec,407,0,...) at ithread_loop+0x200/frame 0x1aa64cac fork_exit(10432f0,18dd8010,1aa64ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa64cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aa64cd4 --- trap 0, eip = 0, esp = 0x1aa64d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100027 td 0x18d97000 PTDpde() at PTDpde+0x22a4 Tracing command intr pid 12 tid 100042 td 0x1ac48000 sched_switch(1ac48000,0,109,189,8,...) at sched_switch+0x80c/frame 0x1aae2c30 mi_switch(109,0,1a4c591,5a1,1a4c1ec,...) at mi_switch+0x1f3/frame 0x1aae2c70 ithread_loop(1ac37050,1aae2ce8,1a4c1ec,407,0,...) at ithread_loop+0x200/frame 0x1aae2cac fork_exit(10432f0,1ac37050,1aae2ce8,0,0,...) at fork_exit+0x7e/frame 0x1aae2cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aae2cd4 --- trap 0, eip = 0, esp = 0x1aae2d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100043 td 0x1ac47a80 sched_switch(1ac47a80,0,109,189,8,...) at sched_switch+0x80c/frame 0x1aae8c30 mi_switch(109,0,1a4c591,5a1,407,...) at mi_switch+0x1f3/frame 0x1aae8c70 ithread_loop(1ac37000,1aae8ce8,1a4c1ec,407,0,...) at ithread_loop+0x200/frame 0x1aae8cac fork_exit(10432f0,1ac37000,1aae8ce8,0,0,...) at fork_exit+0x7e/frame 0x1aae8cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aae8cd4 --- trap 0, eip = 0, esp = 0x1aae8d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100044 td 0x1ac47700 sched_switch(1ac47700,0,109,189,8,...) at sched_switch+0x80c/frame 0x1aaeec30 mi_switch(109,0,1a4c591,5a1,1a4c1ec,...) at mi_switch+0x1f3/frame 0x1aaeec70 ithread_loop(18dd8f90,1aaeece8,1a4c1ec,407,0,...) at ithread_loop+0x200/frame 0x1aaeecac fork_exit(10432f0,18dd8f90,1aaeece8,0,0,...) at fork_exit+0x7e/frame 0x1aaeecd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aaeecd4 --- trap 0, eip = 0, esp = 0x1aaeed20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100045 td 0x1ac47380 sched_switch(1ac47380,0,109,189,8,...) at sched_switch+0x80c/frame 0x1aaf4c30 mi_switch(109,0,1a4c591,5a1,1a4c1ec,...) at mi_switch+0x1f3/frame 0x1aaf4c70 ithread_loop(18dd8f80,1aaf4ce8,1a4c1ec,407,0,...) at ithread_loop+0x200/frame 0x1aaf4cac fork_exit(10432f0,18dd8f80,1aaf4ce8,0,0,...) at fork_exit+0x7e/frame 0x1aaf4cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aaf4cd4 --- trap 0, eip = 0, esp = 0x1aaf4d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100051 td 0x1ac3da80 sched_switch(1ac3da80,0,109,189,8,...) at sched_switch+0x80c/frame 0x1ab13c30 mi_switch(109,0,1a4c591,5a1,1a4c1ec,...) at mi_switch+0x1f3/frame 0x1ab13c70 ithread_loop(18dd8f60,1ab13ce8,1a4c1ec,407,0,...) at ithread_loop+0x200/frame 0x1ab13cac fork_exit(10432f0,18dd8f60,1ab13ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab13cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ab13cd4 --- trap 0, eip = 0, esp = 0x1ab13d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100057 td 0x1aef4a80 sched_switch(1aef4a80,0,109,189,8,...) at sched_switch+0x80c/frame 0x1ab32c30 mi_switch(109,0,1a4c591,5a1,1a4c1ec,...) at mi_switch+0x1f3/frame 0x1ab32c70 ithread_loop(18dd8f40,1ab32ce8,1a4c1ec,407,0,...) at ithread_loop+0x200/frame 0x1ab32cac fork_exit(10432f0,18dd8f40,1ab32ce8,0,0,...) at fork_exit+0x7e/frame 0x1ab32cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1ab32cd4 --- trap 0, eip = 0, esp = 0x1ab32d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100073 td 0x1af06380 PTDpde() at PTDpde+0x22a4 Tracing command intr pid 12 tid 100079 td 0x1aef5a80 sched_switch(1aef5a80,0,109,189,8,...) at sched_switch+0x80c/frame 0x1aba3c30 mi_switch(109,0,1a4c591,5a1,1a4c1ec,...) at mi_switch+0x1f3/frame 0x1aba3c70 ithread_loop(18dd8ee0,1aba3ce8,1a4c1ec,407,0,...) at ithread_loop+0x200/frame 0x1aba3cac fork_exit(10432f0,18dd8ee0,1aba3ce8,0,0,...) at fork_exit+0x7e/frame 0x1aba3cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aba3cd4 --- trap 0, eip = 0, esp = 0x1aba3d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100080 td 0x1aef5700 sched_switch(1aef5700,0,109,189,8,...) at sched_switch+0x80c/frame 0x1abacc30 mi_switch(109,0,1a4c591,5a1,1a4c1ec,...) at mi_switch+0x1f3/frame 0x1abacc70 ithread_loop(18dd8eb0,1abacce8,1a4c1ec,407,0,...) at ithread_loop+0x200/frame 0x1abaccac fork_exit(10432f0,18dd8eb0,1abacce8,0,0,...) at fork_exit+0x7e/frame 0x1abaccd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1abaccd4 --- trap 0, eip = 0, esp = 0x1abacd20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100082 td 0x1af7b700 PTDpde() at PTDpde+0x22a4 Tracing command idle pid 11 tid 100003 td 0x18d12700 (CPU 0) cpustop_handler(0,7811fd8,14d16b94,165524b,0,...) at cpustop_handler+0x25/frame 0x14d16a90 ipi_nmi_handler(0,b1f,14d16af8,165d963,2427c50,...) at ipi_nmi_handler+0x36/frame 0x14d16aa0 trap(14d16ba0,8,28,28,18fbc800,...) at trap+0xbb/frame 0x14d16b94 calltrap() at PTDpde+0x20ed/frame 0x14d16b94 --- trap 0x13, eip = 0x166e0e5, esp = 0x14d16be0, ebp = 0x14d16be0 --- acpi_cpu_c1(14d16c34,165d7d2,2427c50,0,1c5f51f,...) at acpi_cpu_c1+0x5/frame 0x14d16be0 acpi_cpu_idle(ad8a73a,0,ad8a73a,14d16c50,166e4aa,...) at acpi_cpu_idle+0x30b/frame 0x14d16c20 cpu_idle_acpi(ad8a73a,0,1f58300,4,ffffffff,...) at cpu_idle_acpi+0x3f/frame 0x14d16c34 cpu_idle(0,14d16c80,1a58828,aea,4,...) at cpu_idle+0x9a/frame 0x14d16c50 sched_idletd(0,14d16ce8,1a4c1ec,407,0,...) at sched_idletd+0x236/frame 0x14d16cac fork_exit(10b2a30,0,14d16ce8,0,0,...) at fork_exit+0x7e/frame 0x14d16cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x14d16cd4 --- trap 0, eip = 0, esp = 0x14d16d20, ebp = 0 --- (null)() at 0 Tracing command idle pid 11 tid 100004 td 0x18d12380 (CPU 1) cpustop_handler(1,7811fd8,14d1bb94,165524b,14d1baf0,...) at cpustop_handler+0x25/frame 0x14d1ba90 ipi_nmi_handler(14d1baf0,165d963,bbcec50,8,1c5f51f,...) at ipi_nmi_handler+0x36/frame 0x14d1baa0 trap(14d1bba0,8,28,28,18fbc600,...) at trap+0xbb/frame 0x14d1bb94 calltrap() at PTDpde+0x20ed/frame 0x14d1bb94 --- trap 0x13, eip = 0x166e0e5, esp = 0x14d1bbe0, ebp = 0x14d1bbe0 --- acpi_cpu_c1(14d1bc34,165d7d2,bbcec50,0,1c5f51f,...) at acpi_cpu_c1+0x5/frame 0x14d1bbe0 acpi_cpu_idle(26a4a01c,0,26a4a01c,14d1bc50,166e4aa,...) at acpi_cpu_idle+0x30b/frame 0x14d1bc20 cpu_idle_acpi(26a4a01c,0,1f589c0,1,ffffffff,...) at cpu_idle_acpi+0x3f/frame 0x14d1bc34 cpu_idle(0,14d1bc80,1a58828,42b,1,...) at cpu_idle+0x9a/frame 0x14d1bc50 sched_idletd(0,14d1bce8,1a4c1ec,407,0,...) at sched_idletd+0x236/frame 0x14d1bcac fork_exit(10b2a30,0,14d1bce8,0,0,...) at fork_exit+0x7e/frame 0x14d1bcd4 fork_trampoline() at PTDpde+0x22ae/frame 0x14d1bcd4 --- trap 0, eip = 0, esp = 0x14d1bd20, ebp = 0 --- (null)() at 0 Tracing command idle pid 11 tid 100005 td 0x18d12000 (CPU 2) cpustop_handler(2,7811fd8,14d20b94,165524b,8,...) at cpustop_handler+0x25/frame 0x14d20a90 ipi_nmi_handler(8,1a4c591,3e6,9cb,1a4c591,...) at ipi_nmi_handler+0x36/frame 0x14d20aa0 trap(14d20ba0,8,28,28,18fbc400,...) at trap+0xbb/frame 0x14d20b94 calltrap() at PTDpde+0x20ed/frame 0x14d20b94 --- trap 0x13, eip = 0x166e0e5, esp = 0x14d20be0, ebp = 0x14d20be0 --- acpi_cpu_c1(14d20c34,165d7d2,bbd3c50,0,1c5f51f,...) at acpi_cpu_c1+0x5/frame 0x14d20be0 acpi_cpu_idle(8d0a50c,0,8d0a50c,14d20c50,166e4aa,...) at acpi_cpu_idle+0x30b/frame 0x14d20c20 cpu_idle_acpi(8d0a50c,0,1f59080,3,ffffffff,...) at cpu_idle_acpi+0x3f/frame 0x14d20c34 cpu_idle(0,14d20c80,1a58828,aea,3,...) at cpu_idle+0x9a/frame 0x14d20c50 sched_idletd(0,14d20ce8,1a4c1ec,407,0,...) at sched_idletd+0x236/frame 0x14d20cac fork_exit(10b2a30,0,14d20ce8,0,0,...) at fork_exit+0x7e/frame 0x14d20cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x14d20cd4 --- trap 0, eip = 0, esp = 0x14d20d20, ebp = 0 --- (null)() at 0 Tracing command idle pid 11 tid 100006 td 0x18d11a80 (CPU 3) kdb_alt_break_internal(0,14d25acc,e7df87,2,1af52888,...) at kdb_alt_break_internal+0xf0/frame 0x14d25aa0 kdb_alt_break(2,1af52888,1a13c93,0,40000,...) at kdb_alt_break+0x16/frame 0x14d25aac uart_intr_rxready(1af52800,b1f,bbd8c40,18d11a80,14d25af0,...) at uart_intr_rxready+0x87/frame 0x14d25acc uart_intr(1af52800,0,b1f,1,18d11a80,...) at uart_intr+0x130/frame 0x14d25b0c intr_event_handle(18d6de00,14d25ba0,1f5979c,18d7f700,1,...) at intr_event_handle+0xa5/frame 0x14d25b38 intr_execute_handlers(18d69120,14d25ba0,3) at intr_execute_handlers+0xa5/frame 0x14d25b70 lapic_handle_intr(32,14d25ba0,8,28,28,...) at lapic_handle_intr+0x5e/frame 0x14d25b90 Xapic_isr1_pti() at PTDpde+0x2a78/frame 0x14d25b90 --- interrupt, eip = 0x166e0e5, esp = 0x14d25be0, ebp = 0x14d25be0 --- acpi_cpu_c1(14d25c34,165d7d2,bbd8c50,0,1c5f51f,...) at acpi_cpu_c1+0x5/frame 0x14d25be0 acpi_cpu_idle(1b1f668a,0,1b1f668a,14d25c50,166e4aa,...) at acpi_cpu_idle+0x30b/frame 0x14d25c20 cpu_idle_acpi(1b1f668a,0,1f59740,2,ffffffff,...) at cpu_idle_acpi+0x3f/frame 0x14d25c34 cpu_idle(0,14d25c80,1a58828,aea,2,...) at cpu_idle+0x9a/frame 0x14d25c50 sched_idletd(0,14d25ce8,1a4c1ec,407,0,...) at sched_idletd+0x236/frame 0x14d25cac fork_exit(10b2a30,0,14d25ce8,0,0,...) at fork_exit+0x7e/frame 0x14d25cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x14d25cd4 --- trap 0, eip = 0, esp = 0x14d25d20, ebp = 0 --- (null)() at 0 Tracing command init pid 1 tid 100002 td 0x18d12a80 sched_switch(18d12a80,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x14d10940 mi_switch(104,0,1a5d1f5,22b,18d12a80,...) at mi_switch+0x1f3/frame 0x14d10980 sleepq_switch(18d12a80,0,1a5d1f5,1ca,6c,...) at sleepq_switch+0x110/frame 0x14d109b4 sleepq_catch_signals(0,1a5d1f5,178,1f69e14,18d12a80,...) at sleepq_catch_signals+0x360/frame 0x14d109f8 sleepq_wait_sig(18d0ea08,6c,1a615a6,100,0,...) at sleepq_wait_sig+0x14/frame 0x14d10a1c _sleep(18d0ea08,18d0eab0,36c,1a615a6,0,...) at _sleep+0x386/frame 0x14d10a70 kern_wait6(18d12a80,7,0,0,14d10af4,...) at kern_wait6+0x567/frame 0x14d10ac8 sys_wait4(18d12a80,18d12d04,1a4bc2b,4,1a714aa2,...) at sys_wait4+0x87/frame 0x14d10be8 syscall(14d10ce8,3b,3b,3b,8131eb3,...) at syscall+0x6ee/frame 0x14d10cdc Xint0x80_syscall() at PTDpde+0x229b/frame 0x14d10cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x806a257, esp = 0xffbfe80c, ebp = 0xffbfe820 --- _end(0,0,0,0,0,...) at 0x806a257/frame 0xffbfe820 (null)() at 0 Tracing command audit pid 10 tid 100001 td 0x18d13000 sched_switch(18d13000,0,104,189,1f589c0,...) at sched_switch+0x80c/frame 0x14d0bb80 mi_switch(104,0,1a5d1f5,22b,18d13000,...) at mi_switch+0x1f3/frame 0x14d0bbbc sleepq_switch(18d13000,0,1a5d1f5,2b3,1d17d38,...) at sleepq_switch+0x110/frame 0x14d0bbf0 sleepq_wait(1ff7390,0,14d0bc34,1,0,...) at sleepq_wait+0x48/frame 0x14d0bc14 _cv_wait(1ff7390,1ff7318,1a9ccae,1be,8,...) at _cv_wait+0x21f/frame 0x14d0bc58 audit_worker(0,14d0bce8,1a4c1ec,407,0,...) at audit_worker+0x94/frame 0x14d0bcac fork_exit(134c3f0,0,14d0bce8,0,0,...) at fork_exit+0x7e/frame 0x14d0bcd4 fork_trampoline() at PTDpde+0x22ae/frame 0x14d0bcd4 --- trap 0, eip = 0, esp = 0x14d0bd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100000 td 0x1ff33e0 sched_switch(1ff33e0,0,104,189,1f589c0,...) at sched_switch+0x80c/frame 0x2422bf0 mi_switch(104,0,1a5d1f5,22b,1ff33e0,...) at mi_switch+0x1f3/frame 0x2422c2c sleepq_switch(1ff33e0,0,1a5d1f5,2d6,b20,...) at sleepq_switch+0x110/frame 0x2422c60 sleepq_timedwait(1ff3084,54,9,0,0,...) at sleepq_timedwait+0x53/frame 0x2422c9c _sleep(1ff3084,0,54,1aad89a,fffff470,...) at _sleep+0x332/frame 0x2422cf0 swapper() at swapper+0x2c8/frame 0x2422d38 btext() at btext+0x5f Tracing command kernel pid 0 tid 100009 td 0x18d11000 sched_switch(18d11000,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1aa0fb88 mi_switch(104,0,1a5d1f5,22b,18d11000,...) at mi_switch+0x1f3/frame 0x1aa0fbc8 sleepq_switch(18d11000,0,1a5d1f5,2b3,18d11000,...) at sleepq_switch+0x110/frame 0x1aa0fbfc sleepq_wait(18d6d200,0,1a3c3cb,0,0,...) at sleepq_wait+0x48/frame 0x1aa0fc20 _sleep(18d6d200,18d6d21c,0,1a3c3cb,0,...) at _sleep+0x396/frame 0x1aa0fc74 taskqueue_thread_loop(1ff671c,1aa0fce8,1a4c1ec,407,0,...) at taskqueue_thread_loop+0x144/frame 0x1aa0fcac fork_exit(10de6b0,1ff671c,1aa0fce8,0,0,...) at fork_exit+0x7e/frame 0x1aa0fcd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aa0fcd4 --- trap 0, eip = 0, esp = 0x1aa0fd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100011 td 0x18d10700 sched_switch(18d10700,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1aa19b88 mi_switch(104,0,1a5d1f5,22b,18d10700,...) at mi_switch+0x1f3/frame 0x1aa19bc8 sleepq_switch(18d10700,0,1a5d1f5,2b3,18d10700,...) at sleepq_switch+0x110/frame 0x1aa19bfc sleepq_wait(18d6d080,0,1a3c3cb,0,0,...) at sleepq_wait+0x48/frame 0x1aa19c20 _sleep(18d6d080,18d6d09c,0,1a3c3cb,0,...) at _sleep+0x396/frame 0x1aa19c74 taskqueue_thread_loop(1ff397c,1aa19ce8,1a4c1ec,407,0,...) at taskqueue_thread_loop+0x144/frame 0x1aa19cac fork_exit(10de6b0,1ff397c,1aa19ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa19cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aa19cd4 --- trap 0, eip = 0, esp = 0x1aa19d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100012 td 0x18d10380 sched_switch(18d10380,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1aa1eb88 mi_switch(104,0,1a5d1f5,22b,18d10380,...) at mi_switch+0x1f3/frame 0x1aa1ebc8 sleepq_switch(18d10380,0,1a5d1f5,2b3,18d10380,...) at sleepq_switch+0x110/frame 0x1aa1ebfc sleepq_wait(18d6d000,0,1a3c3cb,0,0,...) at sleepq_wait+0x48/frame 0x1aa1ec20 _sleep(18d6d000,18d6d01c,0,1a3c3cb,0,...) at _sleep+0x396/frame 0x1aa1ec74 taskqueue_thread_loop(1ff6778,1aa1ece8,1a4c1ec,407,0,...) at taskqueue_thread_loop+0x144/frame 0x1aa1ecac fork_exit(10de6b0,1ff6778,1aa1ece8,0,0,...) at fork_exit+0x7e/frame 0x1aa1ecd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aa1ecd4 --- trap 0, eip = 0, esp = 0x1aa1ed20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100013 td 0x18d10000 sched_switch(18d10000,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1aa23b98 mi_switch(104,0,1a5d1f5,22b,18d10000,...) at mi_switch+0x1f3/frame 0x1aa23bd8 sleepq_switch(18d10000,0,1a5d1f5,2b3,18d7b000,...) at sleepq_switch+0x110/frame 0x1aa23c0c sleepq_wait(18d7b000,0,1a56637,1a3c3cb,0,...) at sleepq_wait+0x48/frame 0x1aa23c30 msleep_spin_sbt(18d7b000,18d7b01c,1a3c3cb,0,0,...) at msleep_spin_sbt+0x226/frame 0x1aa23c74 gtaskqueue_thread_loop(18d71c04,1aa23ce8,1a4c1ec,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0x1aa23cac fork_exit(10c8520,18d71c04,1aa23ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa23cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aa23cd4 --- trap 0, eip = 0, esp = 0x1aa23d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100014 td 0x18d80380 sched_switch(18d80380,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1aa28b98 mi_switch(104,0,1a5d1f5,22b,18d80380,...) at mi_switch+0x1f3/frame 0x1aa28bd8 sleepq_switch(18d80380,0,1a5d1f5,2b3,18d7af00,...) at sleepq_switch+0x110/frame 0x1aa28c0c sleepq_wait(18d7af00,0,1a56637,1a3c3cb,0,...) at sleepq_wait+0x48/frame 0x1aa28c30 msleep_spin_sbt(18d7af00,18d7af1c,1a3c3cb,0,0,...) at msleep_spin_sbt+0x226/frame 0x1aa28c74 gtaskqueue_thread_loop(18d71c14,1aa28ce8,1a4c1ec,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0x1aa28cac fork_exit(10c8520,18d71c14,1aa28ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa28cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aa28cd4 --- trap 0, eip = 0, esp = 0x1aa28d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100015 td 0x18d80000 sched_switch(18d80000,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1aa2db98 mi_switch(104,0,1a5d1f5,22b,18d80000,...) at mi_switch+0x1f3/frame 0x1aa2dbd8 sleepq_switch(18d80000,0,1a5d1f5,2b3,18d7ae80,...) at sleepq_switch+0x110/frame 0x1aa2dc0c sleepq_wait(18d7ae80,0,1a56637,1a3c3cb,0,...) at sleepq_wait+0x48/frame 0x1aa2dc30 msleep_spin_sbt(18d7ae80,18d7ae9c,1a3c3cb,0,0,...) at msleep_spin_sbt+0x226/frame 0x1aa2dc74 gtaskqueue_thread_loop(18d71c24,1aa2dce8,1a4c1ec,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0x1aa2dcac fork_exit(10c8520,18d71c24,1aa2dce8,0,0,...) at fork_exit+0x7e/frame 0x1aa2dcd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aa2dcd4 --- trap 0, eip = 0, esp = 0x1aa2dd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100016 td 0x18d7fa80 sched_switch(18d7fa80,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1aa32b98 mi_switch(104,0,1a5d1f5,22b,18d7fa80,...) at mi_switch+0x1f3/frame 0x1aa32bd8 sleepq_switch(18d7fa80,0,1a5d1f5,2b3,18d7ae00,...) at sleepq_switch+0x110/frame 0x1aa32c0c sleepq_wait(18d7ae00,0,1a56637,1a3c3cb,0,...) at sleepq_wait+0x48/frame 0x1aa32c30 msleep_spin_sbt(18d7ae00,18d7ae1c,1a3c3cb,0,0,...) at msleep_spin_sbt+0x226/frame 0x1aa32c74 gtaskqueue_thread_loop(18d71c34,1aa32ce8,1a4c1ec,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0x1aa32cac fork_exit(10c8520,18d71c34,1aa32ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa32cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aa32cd4 --- trap 0, eip = 0, esp = 0x1aa32d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100017 td 0x18dc0700 sched_switch(18dc0700,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1aa37b98 mi_switch(104,0,1a5d1f5,22b,18dc0700,...) at mi_switch+0x1f3/frame 0x1aa37bd8 sleepq_switch(18dc0700,0,1a5d1f5,2b3,18d91080,...) at sleepq_switch+0x110/frame 0x1aa37c0c sleepq_wait(18d91080,0,1a56637,1a3c3cb,0,...) at sleepq_wait+0x48/frame 0x1aa37c30 msleep_spin_sbt(18d91080,18d9109c,1a3c3cb,0,0,...) at msleep_spin_sbt+0x226/frame 0x1aa37c74 gtaskqueue_thread_loop(18d71804,1aa37ce8,1a4c1ec,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0x1aa37cac fork_exit(10c8520,18d71804,1aa37ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa37cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aa37cd4 --- trap 0, eip = 0, esp = 0x1aa37d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100018 td 0x18dc0380 sched_switch(18dc0380,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1aa3cb98 mi_switch(104,0,1a5d1f5,22b,18dc0380,...) at mi_switch+0x1f3/frame 0x1aa3cbd8 sleepq_switch(18dc0380,0,1a5d1f5,2b3,18d91000,...) at sleepq_switch+0x110/frame 0x1aa3cc0c sleepq_wait(18d91000,0,1a56637,1a3c3cb,0,...) at sleepq_wait+0x48/frame 0x1aa3cc30 msleep_spin_sbt(18d91000,18d9101c,1a3c3cb,0,0,...) at msleep_spin_sbt+0x226/frame 0x1aa3cc74 gtaskqueue_thread_loop(18d72004,1aa3cce8,1a4c1ec,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0x1aa3ccac fork_exit(10c8520,18d72004,1aa3cce8,0,0,...) at fork_exit+0x7e/frame 0x1aa3ccd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aa3ccd4 --- trap 0, eip = 0, esp = 0x1aa3cd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100019 td 0x18dc0000 sched_switch(18dc0000,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1aa41b98 mi_switch(104,0,1a5d1f5,22b,18dc0000,...) at mi_switch+0x1f3/frame 0x1aa41bd8 sleepq_switch(18dc0000,0,1a5d1f5,2b3,18d90f00,...) at sleepq_switch+0x110/frame 0x1aa41c0c sleepq_wait(18d90f00,0,1a56637,1a3c3cb,0,...) at sleepq_wait+0x48/frame 0x1aa41c30 msleep_spin_sbt(18d90f00,18d90f1c,1a3c3cb,0,0,...) at msleep_spin_sbt+0x226/frame 0x1aa41c74 gtaskqueue_thread_loop(18d72014,1aa41ce8,1a4c1ec,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0x1aa41cac fork_exit(10c8520,18d72014,1aa41ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa41cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aa41cd4 --- trap 0, eip = 0, esp = 0x1aa41d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100020 td 0x18dbfa80 sched_switch(18dbfa80,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1aa46b98 mi_switch(104,0,1a5d1f5,22b,18dbfa80,...) at mi_switch+0x1f3/frame 0x1aa46bd8 sleepq_switch(18dbfa80,0,1a5d1f5,2b3,18d90e80,...) at sleepq_switch+0x110/frame 0x1aa46c0c sleepq_wait(18d90e80,0,1a56637,1a3c3cb,0,...) at sleepq_wait+0x48/frame 0x1aa46c30 msleep_spin_sbt(18d90e80,18d90e9c,1a3c3cb,0,0,...) at msleep_spin_sbt+0x226/frame 0x1aa46c74 gtaskqueue_thread_loop(18d72024,1aa46ce8,1a4c1ec,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0x1aa46cac fork_exit(10c8520,18d72024,1aa46ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa46cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aa46cd4 --- trap 0, eip = 0, esp = 0x1aa46d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100021 td 0x18dbf700 sched_switch(18dbf700,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1aa4bb98 mi_switch(104,0,1a5d1f5,22b,18dbf700,...) at mi_switch+0x1f3/frame 0x1aa4bbd8 sleepq_switch(18dbf700,0,1a5d1f5,2b3,18d90e00,...) at sleepq_switch+0x110/frame 0x1aa4bc0c sleepq_wait(18d90e00,0,1a56637,1a3c3cb,0,...) at sleepq_wait+0x48/frame 0x1aa4bc30 msleep_spin_sbt(18d90e00,18d90e1c,1a3c3cb,0,0,...) at msleep_spin_sbt+0x226/frame 0x1aa4bc74 gtaskqueue_thread_loop(18d72034,1aa4bce8,1a4c1ec,407,0,...) at gtaskqueue_thread_loop+0xf3/frame 0x1aa4bcac fork_exit(10c8520,18d72034,1aa4bce8,0,0,...) at fork_exit+0x7e/frame 0x1aa4bcd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aa4bcd4 --- trap 0, eip = 0, esp = 0x1aa4bd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100031 td 0x18e60700 sched_switch(18e60700,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1aa7db88 mi_switch(104,0,1a5d1f5,22b,18e60700,...) at mi_switch+0x1f3/frame 0x1aa7dbc8 sleepq_switch(18e60700,0,1a5d1f5,2b3,18e60700,...) at sleepq_switch+0x110/frame 0x1aa7dbfc sleepq_wait(18dcfd00,0,1a3c3cb,0,0,...) at sleepq_wait+0x48/frame 0x1aa7dc20 _sleep(18dcfd00,18dcfd1c,0,1a3c3cb,0,...) at _sleep+0x396/frame 0x1aa7dc74 taskqueue_thread_loop(1f65c28,1aa7dce8,1a4c1ec,407,0,...) at taskqueue_thread_loop+0x144/frame 0x1aa7dcac fork_exit(10de6b0,1f65c28,1aa7dce8,0,0,...) at fork_exit+0x7e/frame 0x1aa7dcd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aa7dcd4 --- trap 0, eip = 0, esp = 0x1aa7dd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100032 td 0x18e60380 sched_switch(18e60380,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1aa82b88 mi_switch(104,0,1a5d1f5,22b,18e60380,...) at mi_switch+0x1f3/frame 0x1aa82bc8 sleepq_switch(18e60380,0,1a5d1f5,2b3,18e60380,...) at sleepq_switch+0x110/frame 0x1aa82bfc sleepq_wait(18dcfc80,0,1a3c3cb,0,0,...) at sleepq_wait+0x48/frame 0x1aa82c20 _sleep(18dcfc80,18dcfc9c,0,1a3c3cb,0,...) at _sleep+0x396/frame 0x1aa82c74 taskqueue_thread_loop(1fcc658,1aa82ce8,1a4c1ec,407,0,...) at taskqueue_thread_loop+0x144/frame 0x1aa82cac fork_exit(10de6b0,1fcc658,1aa82ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa82cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aa82cd4 --- trap 0, eip = 0, esp = 0x1aa82d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100033 td 0x18e60000 sched_switch(18e60000,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1aa87b88 mi_switch(104,0,1a5d1f5,22b,18e60000,...) at mi_switch+0x1f3/frame 0x1aa87bc8 sleepq_switch(18e60000,0,1a5d1f5,2b3,18e60000,...) at sleepq_switch+0x110/frame 0x1aa87bfc sleepq_wait(18dcfc80,0,1a3c3cb,0,0,...) at sleepq_wait+0x48/frame 0x1aa87c20 _sleep(18dcfc80,18dcfc9c,0,1a3c3cb,0,...) at _sleep+0x396/frame 0x1aa87c74 taskqueue_thread_loop(1fcc658,1aa87ce8,1a4c1ec,407,0,...) at taskqueue_thread_loop+0x144/frame 0x1aa87cac fork_exit(10de6b0,1fcc658,1aa87ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa87cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aa87cd4 --- trap 0, eip = 0, esp = 0x1aa87d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100034 td 0x18e5fa80 sched_switch(18e5fa80,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1aa8cb88 mi_switch(104,0,1a5d1f5,22b,18e5fa80,...) at mi_switch+0x1f3/frame 0x1aa8cbc8 sleepq_switch(18e5fa80,0,1a5d1f5,2b3,18e5fa80,...) at sleepq_switch+0x110/frame 0x1aa8cbfc sleepq_wait(18dcfc80,0,1a3c3cb,0,0,...) at sleepq_wait+0x48/frame 0x1aa8cc20 _sleep(18dcfc80,18dcfc9c,0,1a3c3cb,0,...) at _sleep+0x396/frame 0x1aa8cc74 taskqueue_thread_loop(1fcc658,1aa8cce8,1a4c1ec,407,0,...) at taskqueue_thread_loop+0x144/frame 0x1aa8ccac fork_exit(10de6b0,1fcc658,1aa8cce8,0,0,...) at fork_exit+0x7e/frame 0x1aa8ccd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aa8ccd4 --- trap 0, eip = 0, esp = 0x1aa8cd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100035 td 0x18e5f700 sched_switch(18e5f700,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1aa91b88 mi_switch(104,0,1a5d1f5,22b,18e5f700,...) at mi_switch+0x1f3/frame 0x1aa91bc8 sleepq_switch(18e5f700,0,1a5d1f5,2b3,18e5f700,...) at sleepq_switch+0x110/frame 0x1aa91bfc sleepq_wait(18dcfc80,0,1a3c3cb,0,0,...) at sleepq_wait+0x48/frame 0x1aa91c20 _sleep(18dcfc80,18dcfc9c,0,1a3c3cb,0,...) at _sleep+0x396/frame 0x1aa91c74 taskqueue_thread_loop(1fcc658,1aa91ce8,1a4c1ec,407,0,...) at taskqueue_thread_loop+0x144/frame 0x1aa91cac fork_exit(10de6b0,1fcc658,1aa91ce8,0,0,...) at fork_exit+0x7e/frame 0x1aa91cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1aa91cd4 --- trap 0, eip = 0, esp = 0x1aa91d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100083 td 0x1af7b380 sched_switch(1af7b380,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1abbbb98 mi_switch(104,0,1a5d1f5,22b,1af7b380,...) at mi_switch+0x1f3/frame 0x1abbbbd8 sleepq_switch(1af7b380,0,1a5d1f5,2b3,18ffce00,...) at sleepq_switch+0x110/frame 0x1abbbc0c sleepq_wait(18ffce00,0,1a56637,1a3c3cb,0,...) at sleepq_wait+0x48/frame 0x1abbbc30 msleep_spin_sbt(18ffce00,18ffce1c,1a3c3cb,0,0,...) at msleep_spin_sbt+0x226/frame 0x1abbbc74 taskqueue_thread_loop(1fe755c,1abbbce8,1a4c1ec,407,0,...) at taskqueue_thread_loop+0xf3/frame 0x1abbbcac fork_exit(10de6b0,1fe755c,1abbbce8,0,0,...) at fork_exit+0x7e/frame 0x1abbbcd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1abbbcd4 --- trap 0, eip = 0, esp = 0x1abbbd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100090 td 0x1b111700 sched_switch(1b111700,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1abdfb98 mi_switch(104,0,1a5d1f5,22b,1b111700,...) at mi_switch+0x1f3/frame 0x1abdfbd8 sleepq_switch(1b111700,0,1a5d1f5,2b3,1b22ac00,...) at sleepq_switch+0x110/frame 0x1abdfc0c sleepq_wait(1b22ac00,0,1a56637,1a3c3cb,0,...) at sleepq_wait+0x48/frame 0x1abdfc30 msleep_spin_sbt(1b22ac00,1b22ac1c,1a3c3cb,0,0,...) at msleep_spin_sbt+0x226/frame 0x1abdfc74 taskqueue_thread_loop(1fe914c,1abdfce8,1a4c1ec,407,0,...) at taskqueue_thread_loop+0xf3/frame 0x1abdfcac fork_exit(10de6b0,1fe914c,1abdfce8,0,0,...) at fork_exit+0x7e/frame 0x1abdfcd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1abdfcd4 --- trap 0, eip = 0, esp = 0x1abdfd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100091 td 0x1b111380 sched_switch(1b111380,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1abe4b98 mi_switch(104,0,1a5d1f5,22b,1b111380,...) at mi_switch+0x1f3/frame 0x1abe4bd8 sleepq_switch(1b111380,0,1a5d1f5,2b3,1b22ac00,...) at sleepq_switch+0x110/frame 0x1abe4c0c sleepq_wait(1b22ac00,0,1a56637,1a3c3cb,0,...) at sleepq_wait+0x48/frame 0x1abe4c30 msleep_spin_sbt(1b22ac00,1b22ac1c,1a3c3cb,0,0,...) at msleep_spin_sbt+0x226/frame 0x1abe4c74 taskqueue_thread_loop(1fe914c,1abe4ce8,1a4c1ec,407,0,...) at taskqueue_thread_loop+0xf3/frame 0x1abe4cac fork_exit(10de6b0,1fe914c,1abe4ce8,0,0,...) at fork_exit+0x7e/frame 0x1abe4cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1abe4cd4 --- trap 0, eip = 0, esp = 0x1abe4d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100092 td 0x1b111000 sched_switch(1b111000,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1abe9b98 mi_switch(104,0,1a5d1f5,22b,1b111000,...) at mi_switch+0x1f3/frame 0x1abe9bd8 sleepq_switch(1b111000,0,1a5d1f5,2b3,1b22ac00,...) at sleepq_switch+0x110/frame 0x1abe9c0c sleepq_wait(1b22ac00,0,1a56637,1a3c3cb,0,...) at sleepq_wait+0x48/frame 0x1abe9c30 msleep_spin_sbt(1b22ac00,1b22ac1c,1a3c3cb,0,0,...) at msleep_spin_sbt+0x226/frame 0x1abe9c74 taskqueue_thread_loop(1fe914c,1abe9ce8,1a4c1ec,407,0,...) at taskqueue_thread_loop+0xf3/frame 0x1abe9cac fork_exit(10de6b0,1fe914c,1abe9ce8,0,0,...) at fork_exit+0x7e/frame 0x1abe9cd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1abe9cd4 --- trap 0, eip = 0, esp = 0x1abe9d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100093 td 0x1aff6a80 sched_switch(1aff6a80,0,104,189,1644f30,...) at sched_switch+0x80c/frame 0x1abeeb88 mi_switch(104,0,1a5d1f5,22b,1aff6a80,...) at mi_switch+0x1f3/frame 0x1abeebc8 sleepq_switch(1aff6a80,0,1a5d1f5,2b3,1aff6a80,...) at sleepq_switch+0x110/frame 0x1abeebfc sleepq_wait(18dcfc00,0,1a3c3cb,0,0,...) at sleepq_wait+0x48/frame 0x1abeec20 _sleep(18dcfc00,18dcfc1c,0,1a3c3cb,0,...) at _sleep+0x396/frame 0x1abeec74 taskqueue_thread_loop(1d70668,1abeece8,1a4c1ec,407,0,...) at taskqueue_thread_loop+0x144/frame 0x1abeecac fork_exit(10de6b0,1d70668,1abeece8,0,0,...) at fork_exit+0x7e/frame 0x1abeecd4 fork_trampoline() at PTDpde+0x22ae/frame 0x1abeecd4 --- trap 0, eip = 0, esp = 0x1abeed20, ebp = 0 --- (null)() at 0 db:0:pho> dump Physical memory: 3427 MB Dumping 186 MB: 171 155 139 123 107 91 75 59 43 27 11 Dump complete db:0:pho> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 3 -- Test scenario: misc/datamove3.sh