GENERIC HEAD from 2019-06-20 01:15:33 UTC, r349225M, vmcore.1135 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2019 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #0 r349225M: Thu Jun 20 09:33:25 CEST 2019 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 FreeBSD clang version 8.0.0 (tags/RELEASE_800/final 356365) (based on LLVM 8.0.0) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Entering uma_startup with 9 boot pages configured startup_alloc from "UMA Kegs", 8 boot pages left startup_alloc from "UMA Zones", 7 boot pages left startup_alloc from "UMA Hash", 6 boot pages left startup_alloc from "vmem btag", 5 boot pages left startup_alloc from "UMA Zones", 4 boot pages left startup_alloc from "MAP", 3 boot pages left startup_alloc from "KMAP ENTRY", 2 boot pages left startup_alloc from "vmem", 1 boot pages left Entering uma_startup2 with 0 boot pages left VT(vga): resolution 640x480 CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.01-MHz 686-class CPU) Origin="AuthenticAMD" Id=0x100f23 Family=0x10 Model=0x2 Stepping=3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff SVM: NP,NAsids=64 TSC: P-state invariant real memory = 8589934592 (8192 MB) avail memory = 3516755968 (3353 MB) : Trying to mount root from ufs:/dev/ada0s1a [rw]... WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. uhub1: 2 ports with 2 removable, self powered uhub2: 2 ports with 2 removable, self powered uhub3: 2 ports with 2 removable, self powered uhub0: 2 ports with 2 removable, self powered uhub4: 2 ports with 2 removable, self powered WARNING: / was not properly dismounted Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. warning: total configured swap (4194304 pages) exceeds maximum recommended amount (2009920 pages). warning: increase kern.maxswzone or reduce amount of swap. Starting file system checks: /dev/ada0s1a: INCORRECT BLOCK COUNT I=212782 (480 should be 0) (CORRECTED) /dev/ada0s1a: INCORRECT BLOCK COUNT I=212784 (480 should be 416) (CORRECTED) /dev/ada0s1a: INODE 212784: FILE SIZE 227016 BEYOND END OF ALLOCATED FILE, SIZE SHOULD BE 196608 (ADJUSTED) uhub5: 10 ports with 10 removable, self powered /dev/ada0s1a: UNREF FILE I=212782 OWNER=root MODE=100600 /dev/ada0s1a: SIZE=0 MTIME=Jun 20 18:52 2019 (CLEARED) /dev/ada0s1a: FREE BLK COUNT(S) WRONG IN SUPERBLK (SALVAGED) /dev/ada0s1a: SUMMARY INFORMATION BAD (SALVAGED) /dev/ada0s1a: BLK(S) MISSING IN BIT MAPS (SALVAGED) /dev/ada0s1a: 7902 files, 407657 used, 605358 free (2638 frags, 75340 blocks, 0.3% fragmentation) /dev/ada0s1f: FREE BLK COUNT(S) WRONG IN SUPERBLK (SALVAGED) /dev/ada0s1f: 20308 files, 243549 used, 769466 free (10986 frags, 94810 blocks, 1.1% fragmentation) /dev/ada0s1d: 513445 files, 8832537 used, 1321662 free (297398 frags, 128033 blocks, 2.9% fragmentation) ** SU+J Recovering /dev/ada0s1e ** Reading 33554432 byte journal from inode 6. ** Building recovery table. ** Resolving unreferenced inode list. ** Processing journal entries. ** 17 journal records in 3584 bytes for 15.18% utilization ** Freed 0 inodes (0 dirs) 0 blocks, and 4 frags. ***** FILE SYSTEM MARKED CLEAN ***** /dev/label/tmp: 760384 files, 90153916 used, 28160065 free (36585 frags, 3515435 blocks, 0.0% fragmentation) Mounting local filesystems:. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/arduino/lib /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/e2fsprogs /usr/local/lib/gcc7 /usr/local/lib/gcc8 /usr/local/lib/mysql /usr/local/lib/nss /usr/local/lib/perl5/5.28/mach/CORE /usr/local/lib/pth /usr/local/lib/qt4 /usr/local/lib/qt5 /usr/local/llvm37/lib /usr/local/llvm39/lib a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Setting hostname: x4.osted.lan. Setting up harvesting: [UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . lo0: link state changed to UP re0: link state changed to DOWN Starting Network: lo0 re0. lo0: flags=8049 metric 0 mtu 16384 options=680003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 inet 127.0.0.1 netmask 0xff000000 groups: lo nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 media: Ethernet autoselect (none) status: no carrier nd6 options=29 Starting devd. add host 127.0.0.1: gateway lo0 fib 0: route already in table add net default: gateway 192.168.1.1 add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Starting rpcbind. NFS access cache time=60 Starting watchdogd. Jun 20 19:03:26 x4 savecore[533]: reboot lock order reversal: 1st 0x96436a4 bufwait (bufwait) @ kern/vfs_bio.c:3904 2nd 0x17b3c000 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:289 stack backtrace: #0 0x1029921 at witness_debugger+0x61 #1 0x10296f9 at witness_checkorder+0x8a9 #2 0xfd34dd at _sx_xlock+0x4d #3 0x129b635 at ufsdirhash_add+0x45 #4 0x129deae at ufs_direnter+0x3fe #5 0x12a65dd at ufs_makeinode+0x51d #6 0x12a2b3b at ufs_create+0x2b #7 0x155775d at VOP_CREATE_APV+0x6d #8 0x1096734 at vn_open_cred+0x234 #9 0x10964f0 at vn_open+0x20 #10 0x108f0c2 at kern_openat+0x242 #11 0x108f2ff at sys_openat+0x2f #12 0x1528f49 at syscall+0x2d9 #13 0xffc033b7 at _end+0xfdc571bf lock order reversal: 1st 0x2218230c ufs (ufs) @ kern/vfs_lookup.c:713 2nd 0x96436a4 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:283 3rd 0x2217c034 ufs (ufs) @ kern/vfs_subr.c:2687 stack backtrace: #0 0x1029921 at witness_debugger+0x61 #1 0x10296f9 at witness_checkorder+0x8a9 #2 0xfa3978 at lockmgr_xlock_hard+0x48 #3 0xfa40e6 at __lockmgr_args+0x376 #4 0x12960ef at ffs_lock+0x6f #5 0x1559c68 at VOP_LOCK1_APV+0x58 #6 0x1096d68 at _vn_lock+0x58 #7 0x1085b5b at vget+0x7b #8 0x1078fe3 at vfs_hash_get+0xa3 #9 0x1291b17 at ffs_vgetf+0x27 #10 0x1287fb1 at softdep_sync_buf+0x8d1 #11 0x1296e11 at ffs_syncvnode+0x231 #12 0x126e17c at ffs_truncate+0x88c #13 0x129e02e at ufs_direnter+0x57e #14 0x12a65dd at ufs_makeinode+0x51d #15 0x12a2b3b at ufs_create+0x2b #16 0x155775d at VOP_CREATE_APV+0x6d #17 0x1096734 at vn_open_cred+0x234 Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Starting statd. Starting lockd. Recovering vi editor sessions:. Updating motd:. Mounting late filesystems:. Starting ntpd. Starting powerd. Starting smartd. Jun 20 19:03:49 x4 smartd[652]: Device: /dev/ada0, WARNING: A firmware update for this drive may be available, Jun 20 19:03:49 x4 smartd[652]: see the following Seagate web pages: Jun 20 19:03:49 x4 smartd[652]: http://knowledge.seagate.com/articles/en_US/FAQ/207931en Jun 20 19:03:49 x4 smartd[652]: http://knowledge.seagate.com/articles/en_US/FAQ/213891en Configuring vt: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting sendmail_submit. Starting sendmail_msp_queue. Starting cron. Local package initialization: backup. Starting nfscbd. Starting default mousedmoused: unable to open /dev/psm0: No such file or directory . Starting inetd. Thu Jun 20 19:03 FreeBSD/i386 (x4.osted.lan) (ttyu0) login: Jun 20 19:25:46 x4 su[1026]: pho to root on /dev/pts/0 lock order reversal: 1st 0x2217de6c ufs (ufs) @ kern/vfs_mount.c:1354 2nd 0x28d6f5e4 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1926 stack backtrace: #0 0x1029921 at witness_debugger+0x61 #1 0x10296f9 at witness_checkorder+0x8a9 #2 0xfa3555 at lockmgr_lock_fast_path+0x125 #3 0x1075cb4 at vop_stdlock+0x24 #4 0x1559c68 at VOP_LOCK1_APV+0x58 #5 0x1096d68 at _vn_lock+0x58 #6 0x12767fb at softdep_flushworklist+0x5b #7 0x12948d1 at ffs_sync+0x411 #8 0x107eec5 at dounmount+0x425 #9 0x107e9ab at sys_unmount+0x26b #10 0x1528f49 at syscall+0x2d9 #11 0xffc033b7 at _end+0xfdc571bf lock order reversal: 1st 0x1f8d200 cpslk (cpslk) @ i386/i386/copyout.c:121 2nd 0x189b321c bufwait (bufwait) @ vm/vm_pager.c:379 stack backtrace: #0 0x1029921 at witness_debugger+0x61 #1 0x10296f9 at witness_checkorder+0x8a9 #2 0xfa3978 at lockmgr_xlock_hard+0x48 #3 0xfa40e6 at __lockmgr_args+0x376 #4 0x12d47d9 at pbuf_ctor+0x79 #5 0x12b024b at zone_alloc_item_locked+0x3bb #6 0x12af08c at uma_zalloc_arg+0x92c #7 0x12a8692 at swap_pager_getpages+0x2a2 #8 0x12d4a04 at vm_pager_get_pages+0x44 #9 0x12b5df8 at vm_fault_hold+0x19c8 #10 0x12b43ea at vm_fault+0x4a #11 0x1528943 at trap_pfault+0xf3 #12 0x1527f60 at trap+0x3c0 #13 0xffc0316d at _end+0xfdc56f75 #14 0x1503923 at copyout_slow0+0x13 #15 0x15035e3 at cp_slow0+0x153 #16 0x15038e7 at copyout+0xa7 #17 0x10231aa at uiomove_faultflag+0x11a swap_pager: cannot allocate bio swap_pager: cannot allocate bio FreeBSD/i386 (x4.osted.lan) (ttyu0) login: root Password: Jun 20 20:04:09 x4 login[800]: ROOT LOGIN (root) ON ttyu0 Last login: Sat Jun 15 20:55:51 on ttyu0 FreeBSD 13.0-CURRENT (PHO) #0 r349225M: Thu Jun 20 09:33:25 CEST 2019 You have new mail. root@x4:~ # init 1 root@x4:~ # Stopping inetd. Waiting for PIDS: 775, 775. Stopping nfscbd. Waiting for PIDS: 740 741. Shutting down local packages:. Stopping cron. Waiting for PIDS: 704. Stopping sshd. Waiting for PIDS: 694. Stopping smartd. Waiting for PIDS: 654. Stopping powerd. Waiting for PIDS: 630. Stopping ntpd. Waiting for PIDS: 627, 627. Stopping lockd. Waiting for PIDS: 591. Stopping statd. Waiting for PIDS: 588. Stopping nfsd. Waiting for PIDS: 584 587. Stopping mountd. Waiting for PIDS: 578. Stopping nfsuserd. Waiting for PIDS: 567 568 569 570 571. Stopping watchdogd. Waiting for PIDS: 516. Stopping rpcbind. Waiting for PIDS: 431. if_delmulti_locked: detaching ifnet instance 0x183e0400 Stopping devd. Waiting for PIDS: 346. Writing entropy file:. Writing early boot entropy file:. . Terminated Jun 20 20:04:17 x4 syslogd: exiting on signal 15 Enter full pathname of shell or RETURN for /bin/sh: # mount /dev/ada0s1a on / (ufs, local) devfs on /dev (devfs, local, multilabel) /dev/ada0s1f on /home (ufs, NFS exported, local, soft-updates) /dev/label/tmp on /tmp (ufs, NFS exported, local, soft-updates, acls) /dev/ada0s1d on /usr (ufs, local, soft-updates) /dev/ada0s1e on /var (ufs, local, journaled soft-updates) procfs on /proc (procfs, local) /dev/md10 on /mnt (ufs, NFS exported, local, soft-updates) # umount /mnt umount: unmount of /mnt failed: Device busy # KDB: enter: Break to debugger [ thread pid 11 tid 100006 ] Stopped at kdb_alt_break_internal+0xeb: movl $0,kdb_why db> show mount 0x2102e000 /dev/ada0s1a on / (ufs) 0x188f2000 devfs on /dev (devfs) 0x2156c000 /dev/ada0s1f on /home (ufs) 0x2156b000 /dev/label/tmp on /tmp (ufs) 0x2156a000 /dev/ada0s1d on /usr (ufs) 0x211c0000 /dev/ada0s1e on /var (ufs) 0x211bf000 procfs on /proc (procfs) 0x2102d000 /dev/md10 on /mnt (ufs) More info: show mount db> show mount 0x2102d000 0x2102d000 /dev/md10 on /mnt (ufs) mnt_flag = SOFTDEP, EXPORTED, DEFEXPORTED, LOCAL mnt_kern_flag = SOFTDEP, EXTENDED_SHARED, NO_IOPF, USES_BCACHE, NOASYNC, LOOKUP_SHARED, 0x00002000 mnt_opt = fstype, fspath, from, errmsg mnt_stat = { version=538182936 type=53 flags=0x0000000000201300 bsize=4096 iosize=32768 blocks=507783 bfree=507779 bavail=467157 files=262654 ffree=262651 syncwrites=412 asyncwrites=242 syncreads=35 asyncreads=0 namemax=255 owner=0 fsid=[1561053131, 815451979] } mnt_cred = { uid=0 ruid=0 } mnt_ref = 2 mnt_gen = 3 mnt_nvnodelistsize = 2 mnt_activevnodelistsize = 2 mnt_writeopcount = 0 mnt_maxsymlinklen = 120 mnt_iosize_max = 131072 mnt_hashseed = 815150180 mnt_lockref = 0 mnt_secondary_writes = 0 mnt_secondary_accwrites = 648 mnt_gjprovider = NULL List of active vnodes vnode 0x21ada16c: tag syncer, type VNON usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) lock type syncer: UNLOCKED #0 0xfa35a8 at lockmgr_lock_fast_path+0x178 #1 0x1075cb4 at vop_stdlock+0x24 #2 0x1559c68 at VOP_LOCK1_APV+0x58 #3 0x1096d68 at _vn_lock+0x58 #4 0x1087f67 at vfs_allocate_syncvnode+0x47 #5 0x107ef87 at dounmount+0x4e7 #6 0x107e9ab at sys_unmount+0x26b #7 0x1528f49 at syscall+0x2d9 #8 0xffc033b7 at _end+0xfdc571bf vnode 0x491ff444: tag ufs, type VREG usecount 1, writecount 0, refcount 1 flags (VV_NOSYNC|VI_ACTIVE) v_object 0x219bf57c ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: UNLOCKED #0 0xfa3c47 at lockmgr_xlock_hard+0x317 #1 0xfa40e6 at __lockmgr_args+0x376 #2 0x12960ef at ffs_lock+0x6f #3 0x1559c68 at VOP_LOCK1_APV+0x58 #4 0x1096d68 at _vn_lock+0x58 #5 0x1086790 at vflush+0xb0 #6 0x1291a91 at ffs_flushfiles+0x161 #7 0x1276a41 at softdep_flushfiles+0x61 #8 0x1293f02 at ffs_unmount+0x72 #9 0x107eeb5 at dounmount+0x415 #10 0x107e9ab at sys_unmount+0x26b #11 0x1528f49 at syscall+0x2d9 #12 0xffc033b7 at _end+0xfdc571bf nlink=0, effnlink=0, size=7459, extsize 0 generation=a9e2142e, uid=0, gid=0, flags=0x0 ino 26, on dev md10 List of inactive vnodes db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> bt Tracing pid 11 tid 100006 td 0x99c7a80 kdb_alt_break_internal(0) at kdb_alt_break_internal+0xeb/frame 0x12530b00 kdb_alt_break(2,17e8788c) at kdb_alt_break+0x10/frame 0x12530b0c uart_intr_rxready(17e87800,1ed3c00,0,0,99c7a80,...) at uart_intr_rxready+0x82/frame 0x12530b28 uart_intr(17e87800) at uart_intr+0x10e/frame 0x12530b48 intr_event_handle(99fec00,12530bbc) at intr_event_handle+0xaf/frame 0x12530b68 intr_execute_handlers(9462938,12530bbc,3) at intr_execute_handlers+0xc7/frame 0x12530b94 lapic_handle_intr(32,12530bbc,8,28,28,...) at lapic_handle_intr+0x55/frame 0x12530bac Xapic_isr1() at 0xffc04208/frame 0x12530bac --- interrupt, eip = 0x153da95, esp = 0x12530bfc, ebp = 0x12530bfc --- acpi_cpu_c1(0,3,708,43c63653,9865dc0,...) at acpi_cpu_c1+0x5/frame 0x12530bfc acpi_cpu_idle(655eb404,0) at acpi_cpu_idle+0x230/frame 0x12530c2c cpu_idle_acpi(655eb404,0) at cpu_idle_acpi+0x35/frame 0x12530c40 cpu_idle(0) at cpu_idle+0xa3/frame 0x12530c5c sched_idletd(0,12530ce8) at sched_idletd+0x3ee/frame 0x12530cb4 fork_exit(ff5c70,0,12530ce8,0,0,...) at fork_exit+0x6c/frame 0x12530cd4 fork_trampoline() at 0xffc033ca/frame 0x12530cd4 --- trap 0, eip = 0, esp = 0x12530d20, ebp = 0 --- (null)() at 0 db:1:pho1> show allpcpu Current CPU: 3 cpuid = 0 dynamic pcpu = 0x8c4c40 curthread = 0x99c8700: pid 11 tid 100003 "idle: cpu0" curpcb = 0x12521d40 fpcurthread = none idlethread = 0x99c8700: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 trampstk = 0xffc07ff0 kesp0 = 0x12521d30 common_tssp = 0xffc01260 tlb gen = 37639678 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0x7c21c40 curthread = 0x99c8380: pid 11 tid 100004 "idle: cpu1" curpcb = 0x12526d40 fpcurthread = none idlethread = 0x99c8380: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 trampstk = 0xffc0aff0 kesp0 = 0x12526d30 common_tssp = 0xffc012c8 tlb gen = 37639678 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0x7c26c40 curthread = 0x99c8000: pid 11 tid 100005 "idle: cpu2" curpcb = 0x1252bd40 fpcurthread = none idlethread = 0x99c8000: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 trampstk = 0xffc0bff0 kesp0 = 0x1252bd30 common_tssp = 0xffc01330 tlb gen = 37639678 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0x7c2bc40 curthread = 0x99c7a80: pid 11 tid 100006 "idle: cpu3" curpcb = 0x12530d40 fpcurthread = none idlethread = 0x99c7a80: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 trampstk = 0xffc0dff0 kesp0 = 0x12530d30 common_tssp = 0xffc01398 tlb gen = 37639673 curvnet = 0 spin locks held: db:1:pho1> show alllocks db:1:pho1> show lockedvnods Locked vnodes db:1:pho1> show allchains chain 1: thread 100227 (pid 55604, sh) sleeping on 0x17e8f474 "ttyin" chain 2: thread 100340 (pid 9061, md10) sleeping on 0x21ce6000 "mdwait" chain 3: thread 100104 (pid 25, syncer) sleeping on 0x1f3fce4 "syncer" chain 4: thread 100103 (pid 24, vnlru) sleeping on 0x188f76a8 "vlruwt" chain 5: thread 100101 (pid 23, bufdaemon) sleeping on 0x1f3f67c "qsleep" chain 6: thread 100102 (pid 23, bufspacedaemon-0) sleeping on 0x1bf3e00 "-" chain 7: thread 100115 (pid 23, /home worker) sleeping on 0x21573684 "sdflush" chain 8: thread 100116 (pid 23, /tmp worker) sleeping on 0x21573484 "sdflush" chain 9: thread 100117 (pid 23, /usr worker) sleeping on 0x21573284 "sdflush" chain 10: thread 100118 (pid 23, /var worker) sleeping on 0x21573084 "sdflush" chain 11: thread 100380 (pid 23, /mnt worker) sleeping on 0x27851884 "sdflush" chain 12: thread 100100 (pid 22, vmdaemon) sleeping on 0x1f55138 "psleep" chain 13: thread 100097 (pid 21, dom0) sleeping on 0x1f896f8 "psleep" chain 14: thread 100098 (pid 21, laundry: dom0) sleeping on 0x1ec4478 "laundp" chain 15: thread 100099 (pid 21, uma) sleeping on 0x12b1340 "umarcl" chain 16: thread 100091 (pid 20, rand_harvestq) sleeping on 0x1d2ab80 "-" chain 17: thread 100090 (pid 19, sctp_iterator) sleeping on 0x1f887bc "waiting_for_work" chain 18: thread 100089 (pid 18, soaiod4) sleeping on 0x1f3f2a8 "-" chain 19: thread 100088 (pid 17, soaiod3) sleeping on 0x1f3f2a8 "-" chain 20: thread 100087 (pid 16, soaiod2) sleeping on 0x1f3f2a8 "-" chain 21: thread 100086 (pid 9, soaiod1) sleeping on 0x1f3f2a8 "-" chain 22: thread 100083 (pid 8, fdc0) sleeping on 0x17b2323c "-" chain 23: thread 100048 (pid 15, usbus0) sleeping on 0x17b5cacc "-" chain 24: thread 100049 (pid 15, usbus0) sleeping on 0x17b5cafc "-" chain 25: thread 100050 (pid 15, usbus0) sleeping on 0x17b5cb2c "-" chain 26: thread 100051 (pid 15, usbus0) sleeping on 0x17b5cb5c "-" chain 27: thread 100052 (pid 15, usbus0) sleeping on 0x17b5cb8c "-" chain 28: thread 100054 (pid 15, usbus1) sleeping on 0x17e1cacc "-" chain 29: thread 100055 (pid 15, usbus1) sleeping on 0x17e1cafc "-" chain 30: thread 100056 (pid 15, usbus1) sleeping on 0x17e1cb2c "-" chain 31: thread 100057 (pid 15, usbus1) sleeping on 0x17e1cb5c "-" chain 32: thread 100058 (pid 15, usbus1) sleeping on 0x17e1cb8c "-" chain 33: thread 100060 (pid 15, usbus2) sleeping on 0x17e27acc "-" chain 34: thread 100061 (pid 15, usbus2) sleeping on 0x17e27afc "-" chain 35: thread 100062 (pid 15, usbus2) sleeping on 0x17e27b2c "-" chain 36: thread 100063 (pid 15, usbus2) sleeping on 0x17e27b5c "-" chain 37: thread 100064 (pid 15, usbus2) sleeping on 0x17e27b8c "-" chain 38: thread 100065 (pid 15, usbus3) sleeping on 0x17e2bacc "-" chain 39: thread 100066 (pid 15, usbus3) sleeping on 0x17e2bafc "-" chain 40: thread 100067 (pid 15, usbus3) sleeping on 0x17e2bb2c "-" chain 41: thread 100068 (pid 15, usbus3) sleeping on 0x17e2bb5c "-" chain 42: thread 100069 (pid 15, usbus3) sleeping on 0x17e2bb8c "-" chain 43: thread 100070 (pid 15, usbus4) sleeping on 0x17e33acc "-" chain 44: thread 100071 (pid 15, usbus4) sleeping on 0x17e33afc "-" chain 45: thread 100072 (pid 15, usbus4) sleeping on 0x17e33b2c "-" chain 46: thread 100073 (pid 15, usbus4) sleeping on 0x17e33b5c "-" chain 47: thread 100074 (pid 15, usbus4) sleeping on 0x17e33b8c "-" chain 48: thread 100076 (pid 15, usbus5) sleeping on 0x17b56ca4 "-" chain 49: thread 100077 (pid 15, usbus5) sleeping on 0x17b56cd4 "-" chain 50: thread 100078 (pid 15, usbus5) sleeping on 0x17b56d04 "-" chain 51: thread 100079 (pid 15, usbus5) sleeping on 0x17b56d34 "-" chain 52: thread 100080 (pid 15, usbus5) sleeping on 0x17b56d64 "-" chain 53: thread 100043 (pid 7, doneq0) sleeping on 0x1c64040 "-" chain 54: thread 100096 (pid 7, scanner) sleeping on 0x1c63f6c "-" chain 55: thread 100042 (pid 6, crypto returns 3) sleeping on 0x95a64c4 "crypto_ret_wait" chain 56: thread 100041 (pid 5, crypto returns 2) sleeping on 0x95a648c "crypto_ret_wait" chain 57: thread 100040 (pid 4, crypto returns 1) sleeping on 0x95a6454 "crypto_ret_wait" chain 58: thread 100039 (pid 3, crypto returns 0) sleeping on 0x95a641c "crypto_ret_wait" chain 59: thread 100038 (pid 2, crypto) sleeping on 0x1f53ef8 "crypto_wait" chain 60: thread 100033 (pid 14, sequencer 00) sleeping on 0x957044c "seqstate" chain 61: thread 100030 (pid 13, g_event) sleeping on 0x1f78768 "-" chain 62: thread 100031 (pid 13, g_up) sleeping on 0x1f78770 "-" chain 63: thread 100032 (pid 13, g_down) sleeping on 0x1f78764 "-" chain 64: thread 100002 (pid 1, init) sleeping on 0x99c49fc "wait" chain 65: thread 100001 (pid 10, audit) sleeping on 0x1f88fa0 "audit_worker_cv" chain 66: thread 100000 (pid 0, swapper) sleeping on 0x1f78788 "swapin" chain 67: thread 100007 (pid 0, aiod_kick taskq) sleeping on 0x94c6000 "-" chain 68: thread 100010 (pid 0, thread taskq) sleeping on 0x94c5e00 "-" chain 69: thread 100012 (pid 0, config_0) sleeping on 0x99ea000 "-" chain 70: thread 100013 (pid 0, kqueue_ctx taskq) sleeping on 0x94c5d00 "-" chain 71: thread 100014 (pid 0, if_config_tqg_0) sleeping on 0x99e9f00 "-" chain 72: thread 100015 (pid 0, if_io_tqg_0) sleeping on 0x99e9e80 "-" chain 73: thread 100016 (pid 0, if_io_tqg_1) sleeping on 0x99e9e00 "-" chain 74: thread 100017 (pid 0, if_io_tqg_2) sleeping on 0x99e9d80 "-" chain 75: thread 100018 (pid 0, if_io_tqg_3) sleeping on 0x99e9d00 "-" chain 76: thread 100019 (pid 0, softirq_0) sleeping on 0x99e9c80 "-" chain 77: thread 100020 (pid 0, softirq_1) sleeping on 0x99e9c00 "-" chain 78: thread 100021 (pid 0, softirq_2) sleeping on 0x99e9b80 "-" chain 79: thread 100022 (pid 0, softirq_3) sleeping on 0x99e9b00 "-" chain 80: thread 100029 (pid 0, firmware taskq) sleeping on 0x957e080 "-" chain 81: thread 100034 (pid 0, crypto_0) sleeping on 0x957de80 "-" chain 82: thread 100035 (pid 0, crypto_1) sleeping on 0x957de80 "-" chain 83: thread 100036 (pid 0, crypto_2) sleeping on 0x957de80 "-" chain 84: thread 100037 (pid 0, crypto_3) sleeping on 0x957de80 "-" chain 85: thread 100085 (pid 0, mca taskq) sleeping on 0x17b3df00 "-" chain 86: thread 100092 (pid 0, acpi_task_0) sleeping on 0x184e3080 "-" chain 87: thread 100093 (pid 0, acpi_task_1) sleeping on 0x184e3080 "-" chain 88: thread 100094 (pid 0, acpi_task_2) sleeping on 0x184e3080 "-" chain 89: thread 100095 (pid 0, CAM taskq) sleeping on 0x957de00 "-" db:1:pho1> show mount 0x2102e000 /dev/ada0s1a on / (ufs) 0x188f2000 devfs on /dev (devfs) 0x2156c000 /dev/ada0s1f on /home (ufs) 0x2156b000 /dev/label/tmp on /tmp (ufs) 0x2156a000 /dev/ada0s1d on /usr (ufs) 0x211c0000 /dev/ada0s1e on /var (ufs) 0x211bf000 procfs on /proc (procfs) 0x2102d000 /dev/md10 on /mnt (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 1 Buf domain 0 freebufs 466 lofreebufs 311 hifreebufs 466 bufspace 70004736 maxbufspace 94683136 hibufspace 94027776 lobufspace 89326372 bufspacethresh 91677074 numdirtybuffers 38 lodirtybuffers 732 hidirtybuffers 1464 dirtybufthresh 1317 cleanq count 5201 (68392960) dirtyq count 38 (573440) wakeup 0 lim 28 CPU 20, 23, 14, 17, Locked buffers: 0 space 0 Total buffers: 5779 space 70004736 db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 55604 1 55604 0 Ss+ ttyin 0x17e8f474 sh 9061 0 0 0 DL mdwait 0x21ce6000 [md10] 25 0 0 0 DL syncer 0x1f3fce4 [syncer] 24 0 0 0 DL vlruwt 0x188f76a8 [vnlru] 23 0 0 0 DL (threaded) [bufdaemon] 100101 D qsleep 0x1f3f67c [bufdaemon] 100102 D - 0x1bf3e00 [bufspacedaemon-0] 100115 D sdflush 0x21573684 [/home worker] 100116 D sdflush 0x21573484 [/tmp worker] 100117 D sdflush 0x21573284 [/usr worker] 100118 D sdflush 0x21573084 [/var worker] 100380 D sdflush 0x27851884 [/mnt worker] 22 0 0 0 DL psleep 0x1f55138 [vmdaemon] 21 0 0 0 DL (threaded) [pagedaemon] 100097 D psleep 0x1f896f8 [dom0] 100098 D laundp 0x1ec4478 [laundry: dom0] 100099 D umarcl 0x12b1340 [uma] 20 0 0 0 DL - 0x1d2ab80 [rand_harvestq] 19 0 0 0 DL waiting 0x1f887bc [sctp_iterator] 18 0 0 0 DL - 0x1f3f2a8 [soaiod4] 17 0 0 0 DL - 0x1f3f2a8 [soaiod3] 16 0 0 0 DL - 0x1f3f2a8 [soaiod2] 9 0 0 0 DL - 0x1f3f2a8 [soaiod1] 8 0 0 0 DL - 0x17b2323c [fdc0] 15 0 0 0 DL (threaded) [usb] 100048 D - 0x17b5cacc [usbus0] 100049 D - 0x17b5cafc [usbus0] 100050 D - 0x17b5cb2c [usbus0] 100051 D - 0x17b5cb5c [usbus0] 100052 D - 0x17b5cb8c [usbus0] 100054 D - 0x17e1cacc [usbus1] 100055 D - 0x17e1cafc [usbus1] 100056 D - 0x17e1cb2c [usbus1] 100057 D - 0x17e1cb5c [usbus1] 100058 D - 0x17e1cb8c [usbus1] 100060 D - 0x17e27acc [usbus2] 100061 D - 0x17e27afc [usbus2] 100062 D - 0x17e27b2c [usbus2] 100063 D - 0x17e27b5c [usbus2] 100064 D - 0x17e27b8c [usbus2] 100065 D - 0x17e2bacc [usbus3] 100066 D - 0x17e2bafc [usbus3] 100067 D - 0x17e2bb2c [usbus3] 100068 D - 0x17e2bb5c [usbus3] 100069 D - 0x17e2bb8c [usbus3] 100070 D - 0x17e33acc [usbus4] 100071 D - 0x17e33afc [usbus4] 100072 D - 0x17e33b2c [usbus4] 100073 D - 0x17e33b5c [usbus4] 100074 D - 0x17e33b8c [usbus4] 100076 D - 0x17b56ca4 [usbus5] 100077 D - 0x17b56cd4 [usbus5] 100078 D - 0x17b56d04 [usbus5] 100079 D - 0x17b56d34 [usbus5] 100080 D - 0x17b56d64 [usbus5] 7 0 0 0 DL (threaded) [cam] 100043 D - 0x1c64040 [doneq0] 100096 D - 0x1c63f6c [scanner] 6 0 0 0 DL crypto_ 0x95a64c4 [crypto returns 3] 5 0 0 0 DL crypto_ 0x95a648c [crypto returns 2] 4 0 0 0 DL crypto_ 0x95a6454 [crypto returns 1] 3 0 0 0 DL crypto_ 0x95a641c [crypto returns 0] 2 0 0 0 DL crypto_ 0x1f53ef8 [crypto] 14 0 0 0 DL seqstat 0x957044c [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100030 D - 0x1f78768 [g_event] 100031 D - 0x1f78770 [g_up] 100032 D - 0x1f78764 [g_down] 12 0 0 0 WL (threaded) [intr] 100008 I [swi6: task queue] 100009 I [swi6: Giant taskq] 100011 I [swi5: fast taskq] 100023 I [swi3: vm] 100024 I [swi1: netisr 0] 100025 I [swi4: clock (0)] 100026 I [swi4: clock (1)] 100027 I [swi4: clock (2)] 100028 I [swi4: clock (3)] 100044 I [irq24: hdac0] 100045 I [irq25: re0] 100046 I [irq22: ahci0] 100047 I [irq16: hdac1 ohci0] 100053 I [irq17: ohci1 ohci3] 100059 I [irq18: ohci2 ohci4] 100075 I [irq19: ehci0] 100081 I [irq14: ata0] 100082 I [swi0: uart] 100084 I [irq1: atkbd0] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 1 0 1 0 SLs wait 0x99c49fc [init] 10 0 0 0 DL audit_w 0x1f88fa0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0x1f78788 [swapper] 100007 D - 0x94c6000 [aiod_kick taskq] 100010 D - 0x94c5e00 [thread taskq] 100012 D - 0x99ea000 [config_0] 100013 D - 0x94c5d00 [kqueue_ctx taskq] 100014 D - 0x99e9f00 [if_config_tqg_0] 100015 D - 0x99e9e80 [if_io_tqg_0] 100016 D - 0x99e9e00 [if_io_tqg_1] 100017 D - 0x99e9d80 [if_io_tqg_2] 100018 D - 0x99e9d00 [if_io_tqg_3] 100019 D - 0x99e9c80 [softirq_0] 100020 D - 0x99e9c00 [softirq_1] 100021 D - 0x99e9b80 [softirq_2] 100022 D - 0x99e9b00 [softirq_3] 100029 D - 0x957e080 [firmware taskq] 100034 D - 0x957de80 [crypto_0] 100035 D - 0x957de80 [crypto_1] 100036 D - 0x957de80 [crypto_2] 100037 D - 0x957de80 [crypto_3] 100085 D - 0x17b3df00 [mca taskq] 100092 D - 0x184e3080 [acpi_task_0] 100093 D - 0x184e3080 [acpi_task_1] 100094 D - 0x184e3080 [acpi_task_2] 100095 D - 0x957de00 [CAM taskq] db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 -- -- -- -- 09 (002048K) | 000000 08 (001024K) | 000000 07 (000512K) | 000000 06 (000256K) | 000000 05 (000128K) | 000000 04 (000064K) | 000000 03 (000032K) | 000000 02 (000016K) | 000000 01 (000008K) | 000000 00 (000004K) | 000000 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 -- -- -- -- 09 (002048K) | 000012 08 (001024K) | 000173 07 (000512K) | 001098 06 (000256K) | 002901 05 (000128K) | 005192 04 (000064K) | 007260 03 (000032K) | 008674 02 (000016K) | 010844 01 (000008K) | 012107 00 (000004K) | 003942 FREE LIST 2: ORDER (SIZE) | NUMBER | POOL 0 -- -- -- -- 09 (002048K) | 000000 08 (001024K) | 000000 07 (000512K) | 000000 06 (000256K) | 000000 05 (000128K) | 000002 04 (000064K) | 000002 03 (000032K) | 000003 02 (000016K) | 000003 01 (000008K) | 000005 00 (000004K) | 000001 db:0:pho> acttrace Tracing command idle pid 11 tid 100003 td 0x99c8700 (CPU 0) cpustop_handler(0,12521bbc,12521bb0,1527c62,0,...) at cpustop_handler+0x27/frame 0x12521ae8 ipi_nmi_handler(0,12521b28,99c8700,24fedc0,99c46a8,...) at ipi_nmi_handler+0x34/frame 0x12521af8 trap(12521bbc,8,28,28,17ae6800,...) at trap+0xc2/frame 0x12521bb0 calltrap() at 0xffc0316d/frame 0x12521bb0 --- trap 0x13, eip = 0x153da95, esp = 0x12521bfc, ebp = 0x12521bfc --- acpi_cpu_c1(0,0,708,58a114ec,24fedc0,...) at acpi_cpu_c1+0x5/frame 0x12521bfc acpi_cpu_idle(47434ff,0) at acpi_cpu_idle+0x230/frame 0x12521c2c cpu_idle_acpi(47434ff,0) at cpu_idle_acpi+0x35/frame 0x12521c40 cpu_idle(0) at cpu_idle+0xa3/frame 0x12521c5c sched_idletd(0,12521ce8) at sched_idletd+0x3ee/frame 0x12521cb4 fork_exit(ff5c70,0,12521ce8,0,0,...) at fork_exit+0x6c/frame 0x12521cd4 fork_trampoline() at 0xffc033ca/frame 0x12521cd4 --- trap 0, eip = 0, esp = 0x12521d20, ebp = 0 --- (null)() at 0 Tracing command idle pid 11 tid 100004 td 0x99c8380 (CPU 1) cpustop_handler(1,12526bbc,12526bb0,1527c62,99c8380,...) at cpustop_handler+0x27/frame 0x12526ae8 ipi_nmi_handler(99c8380,12526b10,99c8380,16151c6,99c46a8,...) at ipi_nmi_handler+0x34/frame 0x12526af8 trap(12526bbc,8,28,28,17ae6600,...) at trap+0xc2/frame 0x12526bb0 calltrap() at 0xffc0316d/frame 0x12526bb0 --- trap 0x13, eip = 0x153da95, esp = 0x12526bfc, ebp = 0x12526bfc --- acpi_cpu_c1(0,1,708,4f58de2a,985bdc0,...) at acpi_cpu_c1+0x5/frame 0x12526bfc acpi_cpu_idle(1c12cd17,0) at acpi_cpu_idle+0x230/frame 0x12526c2c cpu_idle_acpi(1c12cd17,0) at cpu_idle_acpi+0x35/frame 0x12526c40 cpu_idle(0) at cpu_idle+0xa3/frame 0x12526c5c sched_idletd(0,12526ce8) at sched_idletd+0x3ee/frame 0x12526cb4 fork_exit(ff5c70,0,12526ce8,0,0,...) at fork_exit+0x6c/frame 0x12526cd4 fork_trampoline() at 0xffc033ca/frame 0x12526cd4 --- trap 0, eip = 0, esp = 0x12526d20, ebp = 0 --- (null)() at 0 Tracing command idle pid 11 tid 100005 td 0x99c8000 (CPU 2) cpustop_handler(2,1252bbbc,1252bbb0,1527c62,99c8000,...) at cpustop_handler+0x27/frame 0x1252bae8 ipi_nmi_handler(99c8000,1252bb10,99c8000,9860dd0,99c46a8,...) at ipi_nmi_handler+0x34/frame 0x1252baf8 trap(1252bbbc,8,28,28,17ae6400,...) at trap+0xc2/frame 0x1252bbb0 calltrap() at 0xffc0316d/frame 0x1252bbb0 --- trap 0x13, eip = 0x153da95, esp = 0x1252bbfc, ebp = 0x1252bbfc --- acpi_cpu_c1(0,2,708,517da733,9860dc0,...) at acpi_cpu_c1+0x5/frame 0x1252bbfc acpi_cpu_idle(1b1e6571,0) at acpi_cpu_idle+0x230/frame 0x1252bc2c cpu_idle_acpi(1b1e6571,0) at cpu_idle_acpi+0x35/frame 0x1252bc40 cpu_idle(0) at cpu_idle+0xa3/frame 0x1252bc5c sched_idletd(0,1252bce8) at sched_idletd+0x3ee/frame 0x1252bcb4 fork_exit(ff5c70,0,1252bce8,0,0,...) at fork_exit+0x6c/frame 0x1252bcd4 fork_trampoline() at 0xffc033ca/frame 0x1252bcd4 --- trap 0, eip = 0, esp = 0x1252bd20, ebp = 0 --- (null)() at 0 Tracing command idle pid 11 tid 100006 td 0x99c7a80 (CPU 3) kdb_alt_break_internal(0) at kdb_alt_break_internal+0xeb/frame 0x12530b00 kdb_alt_break(2,17e8788c) at kdb_alt_break+0x10/frame 0x12530b0c uart_intr_rxready(17e87800,1ed3c00,0,0,99c7a80,...) at uart_intr_rxready+0x82/frame 0x12530b28 uart_intr(17e87800) at uart_intr+0x10e/frame 0x12530b48 intr_event_handle(99fec00,12530bbc) at intr_event_handle+0xaf/frame 0x12530b68 intr_execute_handlers(9462938,12530bbc,3) at intr_execute_handlers+0xc7/frame 0x12530b94 lapic_handle_intr(32,12530bbc,8,28,28,...) at lapic_handle_intr+0x55/frame 0x12530bac Xapic_isr1() at 0xffc04208/frame 0x12530bac --- interrupt, eip = 0x153da95, esp = 0x12530bfc, ebp = 0x12530bfc --- acpi_cpu_c1(0,3,708,43c63653,9865dc0,...) at acpi_cpu_c1+0x5/frame 0x12530bfc acpi_cpu_idle(655eb404,0) at acpi_cpu_idle+0x230/frame 0x12530c2c cpu_idle_acpi(655eb404,0) at cpu_idle_acpi+0x35/frame 0x12530c40 cpu_idle(0) at cpu_idle+0xa3/frame 0x12530c5c sched_idletd(0,12530ce8) at sched_idletd+0x3ee/frame 0x12530cb4 fork_exit(ff5c70,0,12530ce8,0,0,...) at fork_exit+0x6c/frame 0x12530cd4 fork_trampoline() at 0xffc033ca/frame 0x12530cd4 --- trap 0, eip = 0, esp = 0x12530d20, ebp = 0 --- (null)() at 0 db:0:pho> allt Tracing command sh pid 55604 tid 100227 td 0x17e39a80 sched_switch(17e39a80,0,104) at sched_switch+0x598/frame 0x228e39fc mi_switch(104,0) at mi_switch+0x1de/frame 0x228e3a2c sleepq_switch(0,17e8f404,8,17dff6a8,1ee2a94,...) at sleepq_switch+0xe1/frame 0x228e3a50 sleepq_catch_signals(17e8f474,17e39a80,17e8f404,228e3ac8,f6fdd8,...) at sleepq_catch_signals+0x3b7/frame 0x228e3a7c sleepq_wait_sig(17e8f474,0) at sleepq_wait_sig+0x11/frame 0x228e3a90 _cv_wait_sig(17e8f474,17e8f404) at _cv_wait_sig+0x138/frame 0x228e3ac8 tty_wait(17e8f400,17e8f474) at tty_wait+0x35/frame 0x228e3ae0 ttydisc_read(17e8f400,228e3bd8,0) at ttydisc_read+0x1b9/frame 0x228e3b14 ttydev_read(9571600,228e3bd8,0) at ttydev_read+0x3d/frame 0x228e3b30 devfs_read_f(2107bf18,228e3bd8,999bc00,0,17e39a80) at devfs_read_f+0xaa/frame 0x228e3b60 dofileread(2107bf18,228e3bd8,ffffffff,ffffffff,0) at dofileread+0x6d/frame 0x228e3b90 kern_readv(17e39a80,0,228e3bd8) at kern_readv+0x3b/frame 0x228e3bbc sys_read(17e39a80,17e39d08) at sys_read+0x48/frame 0x228e3c08 syscall(228e3ce8,3b,3b,3b,ffbfec50,...) at syscall+0x2d9/frame 0x228e3cdc Xint0x80_syscall() at 0xffc033b7/frame 0x228e3cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x20606efb, esp = 0xffbfeb18, ebp = 0xffbfeb2c --- __bss_end() at 0x20606efb Tracing command md10 pid 9061 tid 100340 td 0x23cb7700 sched_switch(23cb7700,0,104) at sched_switch+0x598/frame 0x29340bc4 mi_switch(104,0) at mi_switch+0x1de/frame 0x29340bf4 sleepq_switch(23cb7700,0,21ce6000,29340c6c,fd51e7,...) at sleepq_switch+0xe1/frame 0x29340c18 sleepq_wait(21ce6000,5c) at sleepq_wait+0x3a/frame 0x29340c2c _sleep(21ce6000,21ce6028,25c,1611bf6,0,0,0,0,100) at _sleep+0x307/frame 0x29340c6c md_kthread(21ce6000,29340ce8) at md_kthread+0x1c2/frame 0x29340cb4 fork_exit(bdd270,21ce6000,29340ce8,0,0,...) at fork_exit+0x6c/frame 0x29340cd4 fork_trampoline() at 0xffc033ca/frame 0x29340cd4 --- trap 0, eip = 0, esp = 0x29340d20, ebp = 0 --- (null)() at 0 Tracing command syncer pid 25 tid 100104 td 0x188fc700 sched_switch(188fc700,0,104) at sched_switch+0x598/frame 0x1c7fbb8c mi_switch(104,0) at mi_switch+0x1de/frame 0x1c7fbbbc sleepq_switch(cb,188fc700,1be64fc,188fc700,1c7fbc14,...) at sleepq_switch+0xe1/frame 0x1c7fbbe0 sleepq_timedwait(1f3fce4,0) at sleepq_timedwait+0x47/frame 0x1c7fbc10 _cv_timedwait_sbt(1f3fce4,1f3fcc4,fffffed8,0,0,0,100) at _cv_timedwait_sbt+0x157/frame 0x1c7fbc4c sched_sync(0,1c7fbce8) at sched_sync+0x5e3/frame 0x1c7fbcb4 fork_exit(108a680,0,1c7fbce8,0,0,...) at fork_exit+0x6c/frame 0x1c7fbcd4 fork_trampoline() at 0xffc033ca/frame 0x1c7fbcd4 --- trap 0, eip = 0, esp = 0x1c7fbd20, ebp = 0 --- (null)() at 0 Tracing command vnlru pid 24 tid 100103 td 0x188fca80 sched_switch(188fca80,0,104) at sched_switch+0x598/frame 0x1c7f6b74 mi_switch(104,0) at mi_switch+0x1de/frame 0x1c7f6ba4 sleepq_switch(1,188fca80,188fca80,0,188f76a8,...) at sleepq_switch+0xe1/frame 0x1c7f6bc8 sleepq_timedwait(188f76a8,60,1c7f6c28,fadcb5,15f0042,...) at sleepq_timedwait+0x47/frame 0x1c7f6bf4 _sleep(188f76a8,1f3fc90,260,1675532,fffffed8,0,0,0,100) at _sleep+0x23c/frame 0x1c7f6c34 vnlru_proc(0,1c7f6ce8) at vnlru_proc+0x8f/frame 0x1c7f6cb4 fork_exit(1089e40,0,1c7f6ce8,0,0,...) at fork_exit+0x6c/frame 0x1c7f6cd4 fork_trampoline() at 0xffc033ca/frame 0x1c7f6cd4 --- trap 0, eip = 0, esp = 0x1c7f6d20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 23 tid 100101 td 0x188fd000 sched_switch(188fd000,0,104) at sched_switch+0x598/frame 0xb3f6bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb3f6be4 sleepq_switch(0,188fd000,188fd000,0,1f3f67c,...) at sleepq_switch+0xe1/frame 0xb3f6c08 sleepq_timedwait(1f3f67c,54,188f7aa4,188f7ab4,156cc5c,...) at sleepq_timedwait+0x47/frame 0xb3f6c34 _sleep(1f3f67c,1bf2b00,54,159b340,1999997c,0,0,0,100) at _sleep+0x23c/frame 0xb3f6c74 buf_daemon(0,b3f6ce8) at buf_daemon+0xb1/frame 0xb3f6cb4 fork_exit(106bc40,0,b3f6ce8,0,0,...) at fork_exit+0x6c/frame 0xb3f6cd4 fork_trampoline() at 0xffc033ca/frame 0xb3f6cd4 --- trap 0, eip = 0, esp = 0xb3f6d20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 23 tid 100102 td 0x184b2a80 sched_switch(184b2a80,0,104) at sched_switch+0x598/frame 0xb3fbba4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb3fbbd4 sleepq_switch(3,184b2a80,177,184b2a80,0,...) at sleepq_switch+0xe1/frame 0xb3fbbf8 sleepq_timedwait(1bf3e00,5c,188f7aa4,188f7ab4,156cc5c,...) at sleepq_timedwait+0x47/frame 0xb3fbc28 _sleep(1bf3e00,1bf3d40,25c,159eaa4,fffffed8,0,0,0,100) at _sleep+0x23c/frame 0xb3fbc68 bufspace_daemon(1bf2c00,b3fbce8) at bufspace_daemon+0x2cb/frame 0xb3fbcb4 fork_exit(106bf70,1bf2c00,b3fbce8,0,0,...) at fork_exit+0x6c/frame 0xb3fbcd4 fork_trampoline() at 0xffc033ca/frame 0xb3fbcd4 --- trap 0, eip = 0, esp = 0xb3fbd20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 23 tid 100115 td 0x188fb380 sched_switch(188fb380,0,104) at sched_switch+0x598/frame 0x21257bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x21257be4 sleepq_switch(0,188fb380,177,188fb380,0,...) at sleepq_switch+0xe1/frame 0x21257c08 sleepq_timedwait(21573684,54,21257c6c,fc67e0,15d5230,...) at sleepq_timedwait+0x47/frame 0x21257c38 _sleep(21573684,21573600,54,15cbedf,7fffff6c,0,0,0,100) at _sleep+0x23c/frame 0x21257c78 softdep_flush(2156c000,21257ce8) at softdep_flush+0x15c/frame 0x21257cb4 fork_exit(1279e90,2156c000,21257ce8,0,0,...) at fork_exit+0x6c/frame 0x21257cd4 fork_trampoline() at 0xffc033ca/frame 0x21257cd4 --- trap 0, eip = 0, esp = 0x21257d20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 23 tid 100116 td 0x188fb000 sched_switch(188fb000,0,104) at sched_switch+0x598/frame 0x2125cbb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x2125cbe4 sleepq_switch(3,188fb000,177,188fb000,0,...) at sleepq_switch+0xe1/frame 0x2125cc08 sleepq_timedwait(21573484,54,2125cc6c,fc67e0,15d5230,...) at sleepq_timedwait+0x47/frame 0x2125cc38 _sleep(21573484,21573400,54,15cbedf,7fffff6c,0,0,0,100) at _sleep+0x23c/frame 0x2125cc78 softdep_flush(2156b000,2125cce8) at softdep_flush+0x15c/frame 0x2125ccb4 fork_exit(1279e90,2156b000,2125cce8,0,0,...) at fork_exit+0x6c/frame 0x2125ccd4 fork_trampoline() at 0xffc033ca/frame 0x2125ccd4 --- trap 0, eip = 0, esp = 0x2125cd20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 23 tid 100117 td 0x184bda80 sched_switch(184bda80,0,104) at sched_switch+0x598/frame 0x21261bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x21261be4 sleepq_switch(3,184bda80,177,184bda80,0,...) at sleepq_switch+0xe1/frame 0x21261c08 sleepq_timedwait(21573284,54,21261c6c,fc67e0,15d5230,...) at sleepq_timedwait+0x47/frame 0x21261c38 _sleep(21573284,21573200,54,15cbedf,7fffff6c,0,0,0,100) at _sleep+0x23c/frame 0x21261c78 softdep_flush(2156a000,21261ce8) at softdep_flush+0x15c/frame 0x21261cb4 fork_exit(1279e90,2156a000,21261ce8,0,0,...) at fork_exit+0x6c/frame 0x21261cd4 fork_trampoline() at 0xffc033ca/frame 0x21261cd4 --- trap 0, eip = 0, esp = 0x21261d20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 23 tid 100118 td 0x184bd700 sched_switch(184bd700,0,104) at sched_switch+0x598/frame 0x21266bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x21266be4 sleepq_switch(1,184bd700,177,184bd700,0,...) at sleepq_switch+0xe1/frame 0x21266c08 sleepq_timedwait(21573084,54,21266c6c,fc67e0,15d5230,...) at sleepq_timedwait+0x47/frame 0x21266c38 _sleep(21573084,21573000,54,15cbedf,7fffff6c,0,0,0,100) at _sleep+0x23c/frame 0x21266c78 softdep_flush(211c0000,21266ce8) at softdep_flush+0x15c/frame 0x21266cb4 fork_exit(1279e90,211c0000,21266ce8,0,0,...) at fork_exit+0x6c/frame 0x21266cd4 fork_trampoline() at 0xffc033ca/frame 0x21266cd4 --- trap 0, eip = 0, esp = 0x21266d20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 23 tid 100380 td 0x23bac700 sched_switch(23bac700,0,104) at sched_switch+0x598/frame 0x2925fbb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x2925fbe4 sleepq_switch(1,23bac700,177,23bac700,0,...) at sleepq_switch+0xe1/frame 0x2925fc08 sleepq_timedwait(27851884,54,2925fc6c,fc67e0,15d5230,...) at sleepq_timedwait+0x47/frame 0x2925fc38 _sleep(27851884,27851800,54,15cbedf,7fffff6c,0,0,0,100) at _sleep+0x23c/frame 0x2925fc78 softdep_flush(2102d000,2925fce8) at softdep_flush+0x15c/frame 0x2925fcb4 fork_exit(1279e90,2102d000,2925fce8,0,0,...) at fork_exit+0x6c/frame 0x2925fcd4 fork_trampoline() at 0xffc033ca/frame 0x2925fcd4 --- trap 0, eip = 0, esp = 0x2925fd20, ebp = 0 --- (null)() at 0 Tracing command vmdaemon pid 22 tid 100100 td 0x188fd380 sched_switch(188fd380,0,104) at sched_switch+0x598/frame 0xb3f1b94 mi_switch(104,0) at mi_switch+0x1de/frame 0xb3f1bc4 sleepq_switch(188fd380,0,1f55138,b3f1c3c,fd51e7,...) at sleepq_switch+0xe1/frame 0xb3f1be8 sleepq_wait(1f55138,74) at sleepq_wait+0x3a/frame 0xb3f1bfc _sleep(1f55138,1f55124,74,159b339,0,0,0,0,100) at _sleep+0x307/frame 0xb3f1c3c vm_daemon(0,b3f1ce8) at vm_daemon+0xa88/frame 0xb3f1cb4 fork_exit(12dbf90,0,b3f1ce8,0,0,...) at fork_exit+0x6c/frame 0xb3f1cd4 fork_trampoline() at 0xffc033ca/frame 0xb3f1cd4 --- trap 0, eip = 0, esp = 0xb3f1d20, ebp = 0 --- (null)() at 0 Tracing command pagedaemon pid 21 tid 100097 td 0x9504a80 sched_switch(9504a80,0,104) at sched_switch+0x598/frame 0xb3e29d4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb3e2a04 sleepq_switch(2,9504a80,9504a80,0,1f896f8,...) at sleepq_switch+0xe1/frame 0xb3e2a28 sleepq_timedwait(1f896f8,54,10000,10000,15b9168,...) at sleepq_timedwait+0x47/frame 0xb3e2a54 _sleep(1f896f8,1f89400,254,159b339,1999997c,0,0,0,100) at _sleep+0x23c/frame 0xb3e2a94 vm_pageout_worker(0,9504a80,99c5354,9504a80,99c5354,...) at vm_pageout_worker+0x266/frame 0xb3e2c94 vm_pageout(0,b3e2ce8) at vm_pageout+0x10a/frame 0xb3e2cb4 fork_exit(12d1930,0,b3e2ce8,0,0,...) at fork_exit+0x6c/frame 0xb3e2cd4 fork_trampoline() at 0xffc033ca/frame 0xb3e2cd4 --- trap 0, eip = 0, esp = 0xb3e2d20, ebp = 0 --- (null)() at 0 Tracing command pagedaemon pid 21 tid 100098 td 0x184bb380 sched_switch(184bb380,0,104) at sched_switch+0x598/frame 0xb3e7a24 mi_switch(104,0) at mi_switch+0x1de/frame 0xb3e7a54 sleepq_switch(0,184bb380,184bb380,0,1ec4478,...) at sleepq_switch+0xe1/frame 0xb3e7a78 sleepq_timedwait(1ec4478,0,0,2db9380,2db9588,...) at sleepq_timedwait+0x47/frame 0xb3e7aa4 _sleep(1ec4478,0,0,15d5881,1999997c,0,0,0,100) at _sleep+0x23c/frame 0xb3e7ae4 pause_sbt(15d5881,1999997c,0,0,0,100) at pause_sbt+0x9b/frame 0xb3e7b20 vm_pageout_laundry_worker(0,b3e7ce8) at vm_pageout_laundry_worker+0xba9/frame 0xb3e7cb4 fork_exit(12d2ff0,0,b3e7ce8,0,0,...) at fork_exit+0x6c/frame 0xb3e7cd4 fork_trampoline() at 0xffc033ca/frame 0xb3e7cd4 --- trap 0, eip = 0, esp = 0xb3e7d20, ebp = 0 --- (null)() at 0 Tracing command pagedaemon pid 21 tid 100099 td 0x184bb000 sched_switch(184bb000,0,104) at sched_switch+0x598/frame 0xb3ecbbc mi_switch(104,0) at mi_switch+0x1de/frame 0xb3ecbec sleepq_switch(1ee1f44,184bb000,0,1f54d4c,b3ecc40,...) at sleepq_switch+0xe1/frame 0xb3ecc10 sleepq_timedwait(12b1340,54,0,b3eccb4,15e84dd,...) at sleepq_timedwait+0x47/frame 0xb3ecc3c _sleep(12b1340,1f54d4c,54,15fb010,fffffed8,0,0,0,100) at _sleep+0x23c/frame 0xb3ecc7c uma_reclaim_worker(0,b3ecce8) at uma_reclaim_worker+0x104/frame 0xb3eccb4 fork_exit(12b1a10,0,b3ecce8,0,0,...) at fork_exit+0x6c/frame 0xb3eccd4 fork_trampoline() at 0xffc033ca/frame 0xb3eccd4 --- trap 0, eip = 0, esp = 0xb3ecd20, ebp = 0 --- (null)() at 0 Tracing command rand_harvestq pid 20 tid 100091 td 0x184bca80 sched_switch(184bca80,0,104) at sched_switch+0x598/frame 0xb3c4b94 mi_switch(104,0) at mi_switch+0x1de/frame 0xb3c4bc4 sleepq_switch(1,184bca80,184bca80,0,1d2ab80,...) at sleepq_switch+0xe1/frame 0xb3c4be8 sleepq_timedwait(1d2ab80,0,1d2fc74,0,b3c4c50,...) at sleepq_timedwait+0x47/frame 0xb3c4c14 _sleep(1d2ab80,0,0,159eaa4,19999999,0,0,0,4) at _sleep+0x23c/frame 0xb3c4c54 random_kthread(0,b3c4ce8) at random_kthread+0x23e/frame 0xb3c4cb4 fork_exit(d41210,0,b3c4ce8,0,0,...) at fork_exit+0x6c/frame 0xb3c4cd4 fork_trampoline() at 0xffc033ca/frame 0xb3c4cd4 --- trap 0, eip = 0, esp = 0xb3c4d20, ebp = 0 --- (null)() at 0 Tracing command sctp_iterator pid 19 tid 100090 td 0x184bd000 sched_switch(184bd000,0,104) at sched_switch+0x598/frame 0xb3bbbdc mi_switch(104,0) at mi_switch+0x1de/frame 0xb3bbc10 sleepq_switch(184bd000,0,1f887bc,b3bbc88,fd51e7,...) at sleepq_switch+0xe1/frame 0xb3bbc34 sleepq_wait(1f887bc,0) at sleepq_wait+0x3a/frame 0xb3bbc48 _sleep(1f887bc,1f88784,0,1593704,0,0,0,0,100) at _sleep+0x307/frame 0xb3bbc88 sctp_iterator_thread(0,b3bbce8) at sctp_iterator_thread+0x43/frame 0xb3bbcb4 fork_exit(1143e60,0,b3bbce8,0,0,...) at fork_exit+0x6c/frame 0xb3bbcd4 fork_trampoline() at 0xffc033ca/frame 0xb3bbcd4 --- trap 0, eip = 0, esp = 0xb3bbd20, ebp = 0 --- (null)() at 0 Tracing command soaiod4 pid 18 tid 100089 td 0x17a01000 sched_switch(17a01000,0,104) at sched_switch+0x598/frame 0xb3b1bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb3b1be4 sleepq_switch(1,17a01000,177,17a01000,0,...) at sleepq_switch+0xe1/frame 0xb3b1c08 sleepq_timedwait(1f3f2a8,0,0,15a4f2b,1615cc3,...) at sleepq_timedwait+0x47/frame 0xb3b1c38 _sleep(1f3f2a8,1f3f288,0,159eaa4,ffffdd50,1d,0,0,100) at _sleep+0x23c/frame 0xb3b1c78 soaio_kproc_loop(4,b3b1ce8) at soaio_kproc_loop+0x14b/frame 0xb3b1cb4 fork_exit(1035fd0,4,b3b1ce8,0,0,...) at fork_exit+0x6c/frame 0xb3b1cd4 fork_trampoline() at 0xffc033ca/frame 0xb3b1cd4 --- trap 0, eip = 0, esp = 0xb3b1d20, ebp = 0 --- (null)() at 0 Tracing command soaiod3 pid 17 tid 100088 td 0x17a01380 sched_switch(17a01380,0,104) at sched_switch+0x598/frame 0xb3acbb4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb3acbe4 sleepq_switch(1,17a01380,177,17a01380,0,...) at sleepq_switch+0xe1/frame 0xb3acc08 sleepq_timedwait(1f3f2a8,0,0,15a4f2b,1615cc3,...) at sleepq_timedwait+0x47/frame 0xb3acc38 _sleep(1f3f2a8,1f3f288,0,159eaa4,ffffdd50,1d,0,0,100) at _sleep+0x23c/frame 0xb3acc78 soaio_kproc_loop(3,b3acce8) at soaio_kproc_loop+0x14b/frame 0xb3accb4 fork_exit(1035fd0,3,b3acce8,0,0,...) at fork_exit+0x6c/frame 0xb3accd4 fork_trampoline() at 0xffc033ca/frame 0xb3accd4 --- trap 0, eip = 0, esp = 0xb3acd20, ebp = 0 --- (null)() at 0 Tracing command soaiod2 pid 16 tid 100087 td 0x17a01700 sched_switch(17a01700,0,104) at sched_switch+0x598/frame 0xb3a7bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb3a7be4 sleepq_switch(3,17a01700,177,17a01700,0,...) at sleepq_switch+0xe1/frame 0xb3a7c08 sleepq_timedwait(1f3f2a8,0,0,15a4f2b,1615cc3,...) at sleepq_timedwait+0x47/frame 0xb3a7c38 _sleep(1f3f2a8,1f3f288,0,159eaa4,ffffdd50,1d,0,0,100) at _sleep+0x23c/frame 0xb3a7c78 soaio_kproc_loop(2,b3a7ce8) at soaio_kproc_loop+0x14b/frame 0xb3a7cb4 fork_exit(1035fd0,2,b3a7ce8,0,0,...) at fork_exit+0x6c/frame 0xb3a7cd4 fork_trampoline() at 0xffc033ca/frame 0xb3a7cd4 --- trap 0, eip = 0, esp = 0xb3a7d20, ebp = 0 --- (null)() at 0 Tracing command soaiod1 pid 9 tid 100086 td 0x17a01a80 sched_switch(17a01a80,0,104) at sched_switch+0x598/frame 0xb3a2bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb3a2be4 sleepq_switch(3,17a01a80,177,17a01a80,0,...) at sleepq_switch+0xe1/frame 0xb3a2c08 sleepq_timedwait(1f3f2a8,0,0,15a4f2b,1615cc3,...) at sleepq_timedwait+0x47/frame 0xb3a2c38 _sleep(1f3f2a8,1f3f288,0,159eaa4,ffffdd50,1d,0,0,100) at _sleep+0x23c/frame 0xb3a2c78 soaio_kproc_loop(1,b3a2ce8) at soaio_kproc_loop+0x14b/frame 0xb3a2cb4 fork_exit(1035fd0,1,b3a2ce8,0,0,...) at fork_exit+0x6c/frame 0xb3a2cd4 fork_trampoline() at 0xffc033ca/frame 0xb3a2cd4 --- trap 0, eip = 0, esp = 0xb3a2d20, ebp = 0 --- (null)() at 0 Tracing command fdc0 pid 8 tid 100083 td 0x17eb0a80 sched_switch(17eb0a80,0,104) at sched_switch+0x598/frame 0xb393b94 mi_switch(104,0) at mi_switch+0x1de/frame 0xb393bc4 sleepq_switch(17eb0a80,0,17b2323c,b393c3c,fd51e7,...) at sleepq_switch+0xe1/frame 0xb393be8 sleepq_wait(17b2323c,5c) at sleepq_wait+0x3a/frame 0xb393bfc _sleep(17b2323c,17b232f8,5c,159eaa4,0,0,0,0,100) at _sleep+0x307/frame 0xb393c3c fdc_thread(17b23200,b393ce8) at fdc_thread+0x10f1/frame 0xb393cb4 fork_exit(14a0210,17b23200,b393ce8,0,0,...) at fork_exit+0x6c/frame 0xb393cd4 fork_trampoline() at 0xffc033ca/frame 0xb393cd4 --- trap 0, eip = 0, esp = 0xb393d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100048 td 0x17b7d000 sched_switch(17b7d000,0,104) at sched_switch+0x598/frame 0xb2dbbf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb2dbc24 sleepq_switch(17b7d000,17b5ccf8,17b5cacc,b2dbc94,f6f8e5,...) at sleepq_switch+0xe1/frame 0xb2dbc48 sleepq_wait(17b5cacc,0) at sleepq_wait+0x3a/frame 0xb2dbc5c _cv_wait(17b5cacc,17b5ccf8) at _cv_wait+0x135/frame 0xb2dbc94 usb_process(17b5cac4,b2dbce8) at usb_process+0x104/frame 0xb2dbcb4 fork_exit(e3af20,17b5cac4,b2dbce8,0,0,...) at fork_exit+0x6c/frame 0xb2dbcd4 fork_trampoline() at 0xffc033ca/frame 0xb2dbcd4 --- trap 0, eip = 0, esp = 0xb2dbd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100049 td 0x17b7ca80 sched_switch(17b7ca80,0,104) at sched_switch+0x598/frame 0xb2e0bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb2e0c24 sleepq_switch(17b7ca80,17b5ccf8,17b5cafc,b2e0c94,f6f8e5,...) at sleepq_switch+0xe1/frame 0xb2e0c48 sleepq_wait(17b5cafc,0) at sleepq_wait+0x3a/frame 0xb2e0c5c _cv_wait(17b5cafc,17b5ccf8) at _cv_wait+0x135/frame 0xb2e0c94 usb_process(17b5caf4,b2e0ce8) at usb_process+0x104/frame 0xb2e0cb4 fork_exit(e3af20,17b5caf4,b2e0ce8,0,0,...) at fork_exit+0x6c/frame 0xb2e0cd4 fork_trampoline() at 0xffc033ca/frame 0xb2e0cd4 --- trap 0, eip = 0, esp = 0xb2e0d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100050 td 0x17b7c700 sched_switch(17b7c700,0,104) at sched_switch+0x598/frame 0xb2e5bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb2e5c24 sleepq_switch(17b7c700,17b5ccf8,17b5cb2c,b2e5c94,f6f8e5,...) at sleepq_switch+0xe1/frame 0xb2e5c48 sleepq_wait(17b5cb2c,0) at sleepq_wait+0x3a/frame 0xb2e5c5c _cv_wait(17b5cb2c,17b5ccf8) at _cv_wait+0x135/frame 0xb2e5c94 usb_process(17b5cb24,b2e5ce8) at usb_process+0x104/frame 0xb2e5cb4 fork_exit(e3af20,17b5cb24,b2e5ce8,0,0,...) at fork_exit+0x6c/frame 0xb2e5cd4 fork_trampoline() at 0xffc033ca/frame 0xb2e5cd4 --- trap 0, eip = 0, esp = 0xb2e5d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100051 td 0x17b7c380 sched_switch(17b7c380,0,104) at sched_switch+0x598/frame 0xb2eabf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb2eac24 sleepq_switch(17b7c380,17b5ccf8,17b5cb5c,b2eac94,f6f8e5,...) at sleepq_switch+0xe1/frame 0xb2eac48 sleepq_wait(17b5cb5c,0) at sleepq_wait+0x3a/frame 0xb2eac5c _cv_wait(17b5cb5c,17b5ccf8) at _cv_wait+0x135/frame 0xb2eac94 usb_process(17b5cb54,b2eace8) at usb_process+0x104/frame 0xb2eacb4 fork_exit(e3af20,17b5cb54,b2eace8,0,0,...) at fork_exit+0x6c/frame 0xb2eacd4 fork_trampoline() at 0xffc033ca/frame 0xb2eacd4 --- trap 0, eip = 0, esp = 0xb2ead20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100052 td 0x17b7c000 sched_switch(17b7c000,0,104) at sched_switch+0x598/frame 0xb2efbf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb2efc24 sleepq_switch(17b7c000,17b5ccf8,17b5cb8c,b2efc94,f6f8e5,...) at sleepq_switch+0xe1/frame 0xb2efc48 sleepq_wait(17b5cb8c,0) at sleepq_wait+0x3a/frame 0xb2efc5c _cv_wait(17b5cb8c,17b5ccf8) at _cv_wait+0x135/frame 0xb2efc94 usb_process(17b5cb84,b2efce8) at usb_process+0x104/frame 0xb2efcb4 fork_exit(e3af20,17b5cb84,b2efce8,0,0,...) at fork_exit+0x6c/frame 0xb2efcd4 fork_trampoline() at 0xffc033ca/frame 0xb2efcd4 --- trap 0, eip = 0, esp = 0xb2efd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100054 td 0x17b72700 sched_switch(17b72700,0,104) at sched_switch+0x598/frame 0xb2fabf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb2fac24 sleepq_switch(17b72700,17e1ccf8,17e1cacc,b2fac94,f6f8e5,...) at sleepq_switch+0xe1/frame 0xb2fac48 sleepq_wait(17e1cacc,0) at sleepq_wait+0x3a/frame 0xb2fac5c _cv_wait(17e1cacc,17e1ccf8) at _cv_wait+0x135/frame 0xb2fac94 usb_process(17e1cac4,b2face8) at usb_process+0x104/frame 0xb2facb4 fork_exit(e3af20,17e1cac4,b2face8,0,0,...) at fork_exit+0x6c/frame 0xb2facd4 fork_trampoline() at 0xffc033ca/frame 0xb2facd4 --- trap 0, eip = 0, esp = 0xb2fad20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100055 td 0x17b72380 sched_switch(17b72380,0,104) at sched_switch+0x598/frame 0xb2ffbf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb2ffc24 sleepq_switch(17b72380,17e1ccf8,17e1cafc,b2ffc94,f6f8e5,...) at sleepq_switch+0xe1/frame 0xb2ffc48 sleepq_wait(17e1cafc,0) at sleepq_wait+0x3a/frame 0xb2ffc5c _cv_wait(17e1cafc,17e1ccf8) at _cv_wait+0x135/frame 0xb2ffc94 usb_process(17e1caf4,b2ffce8) at usb_process+0x104/frame 0xb2ffcb4 fork_exit(e3af20,17e1caf4,b2ffce8,0,0,...) at fork_exit+0x6c/frame 0xb2ffcd4 fork_trampoline() at 0xffc033ca/frame 0xb2ffcd4 --- trap 0, eip = 0, esp = 0xb2ffd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100056 td 0x17b72000 sched_switch(17b72000,0,104) at sched_switch+0x598/frame 0xb304bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb304c24 sleepq_switch(17b72000,17e1ccf8,17e1cb2c,b304c94,f6f8e5,...) at sleepq_switch+0xe1/frame 0xb304c48 sleepq_wait(17e1cb2c,0) at sleepq_wait+0x3a/frame 0xb304c5c _cv_wait(17e1cb2c,17e1ccf8) at _cv_wait+0x135/frame 0xb304c94 usb_process(17e1cb24,b304ce8) at usb_process+0x104/frame 0xb304cb4 fork_exit(e3af20,17e1cb24,b304ce8,0,0,...) at fork_exit+0x6c/frame 0xb304cd4 fork_trampoline() at 0xffc033ca/frame 0xb304cd4 --- trap 0, eip = 0, esp = 0xb304d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100057 td 0x17e22380 sched_switch(17e22380,0,104) at sched_switch+0x598/frame 0xb309bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb309c24 sleepq_switch(17e22380,17e1ccf8,17e1cb5c,b309c94,f6f8e5,...) at sleepq_switch+0xe1/frame 0xb309c48 sleepq_wait(17e1cb5c,0) at sleepq_wait+0x3a/frame 0xb309c5c _cv_wait(17e1cb5c,17e1ccf8) at _cv_wait+0x135/frame 0xb309c94 usb_process(17e1cb54,b309ce8) at usb_process+0x104/frame 0xb309cb4 fork_exit(e3af20,17e1cb54,b309ce8,0,0,...) at fork_exit+0x6c/frame 0xb309cd4 fork_trampoline() at 0xffc033ca/frame 0xb309cd4 --- trap 0, eip = 0, esp = 0xb309d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100058 td 0x17e22000 sched_switch(17e22000,0,104) at sched_switch+0x598/frame 0xb30ebf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb30ec24 sleepq_switch(17e22000,17e1ccf8,17e1cb8c,b30ec94,f6f8e5,...) at sleepq_switch+0xe1/frame 0xb30ec48 sleepq_wait(17e1cb8c,0) at sleepq_wait+0x3a/frame 0xb30ec5c _cv_wait(17e1cb8c,17e1ccf8) at _cv_wait+0x135/frame 0xb30ec94 usb_process(17e1cb84,b30ece8) at usb_process+0x104/frame 0xb30ecb4 fork_exit(e3af20,17e1cb84,b30ece8,0,0,...) at fork_exit+0x6c/frame 0xb30ecd4 fork_trampoline() at 0xffc033ca/frame 0xb30ecd4 --- trap 0, eip = 0, esp = 0xb30ed20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100060 td 0x17e21700 sched_switch(17e21700,0,104) at sched_switch+0x598/frame 0xb319bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb319c24 sleepq_switch(17e21700,17e27cf8,17e27acc,b319c94,f6f8e5,...) at sleepq_switch+0xe1/frame 0xb319c48 sleepq_wait(17e27acc,0) at sleepq_wait+0x3a/frame 0xb319c5c _cv_wait(17e27acc,17e27cf8) at _cv_wait+0x135/frame 0xb319c94 usb_process(17e27ac4,b319ce8) at usb_process+0x104/frame 0xb319cb4 fork_exit(e3af20,17e27ac4,b319ce8,0,0,...) at fork_exit+0x6c/frame 0xb319cd4 fork_trampoline() at 0xffc033ca/frame 0xb319cd4 --- trap 0, eip = 0, esp = 0xb319d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100061 td 0x17e21380 sched_switch(17e21380,0,104) at sched_switch+0x598/frame 0xb31ebf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb31ec24 sleepq_switch(17e21380,17e27cf8,17e27afc,b31ec94,f6f8e5,...) at sleepq_switch+0xe1/frame 0xb31ec48 sleepq_wait(17e27afc,0) at sleepq_wait+0x3a/frame 0xb31ec5c _cv_wait(17e27afc,17e27cf8) at _cv_wait+0x135/frame 0xb31ec94 usb_process(17e27af4,b31ece8) at usb_process+0x104/frame 0xb31ecb4 fork_exit(e3af20,17e27af4,b31ece8,0,0,...) at fork_exit+0x6c/frame 0xb31ecd4 fork_trampoline() at 0xffc033ca/frame 0xb31ecd4 --- trap 0, eip = 0, esp = 0xb31ed20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100062 td 0x17e21000 sched_switch(17e21000,0,104) at sched_switch+0x598/frame 0xb323bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb323c24 sleepq_switch(17e21000,17e27cf8,17e27b2c,b323c94,f6f8e5,...) at sleepq_switch+0xe1/frame 0xb323c48 sleepq_wait(17e27b2c,0) at sleepq_wait+0x3a/frame 0xb323c5c _cv_wait(17e27b2c,17e27cf8) at _cv_wait+0x135/frame 0xb323c94 usb_process(17e27b24,b323ce8) at usb_process+0x104/frame 0xb323cb4 fork_exit(e3af20,17e27b24,b323ce8,0,0,...) at fork_exit+0x6c/frame 0xb323cd4 fork_trampoline() at 0xffc033ca/frame 0xb323cd4 --- trap 0, eip = 0, esp = 0xb323d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100063 td 0x17e20a80 sched_switch(17e20a80,0,104) at sched_switch+0x598/frame 0xb328bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb328c24 sleepq_switch(17e20a80,17e27cf8,17e27b5c,b328c94,f6f8e5,...) at sleepq_switch+0xe1/frame 0xb328c48 sleepq_wait(17e27b5c,0) at sleepq_wait+0x3a/frame 0xb328c5c _cv_wait(17e27b5c,17e27cf8) at _cv_wait+0x135/frame 0xb328c94 usb_process(17e27b54,b328ce8) at usb_process+0x104/frame 0xb328cb4 fork_exit(e3af20,17e27b54,b328ce8,0,0,...) at fork_exit+0x6c/frame 0xb328cd4 fork_trampoline() at 0xffc033ca/frame 0xb328cd4 --- trap 0, eip = 0, esp = 0xb328d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100064 td 0x17e20700 sched_switch(17e20700,0,104) at sched_switch+0x598/frame 0xb32dbf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb32dc24 sleepq_switch(17e20700,17e27cf8,17e27b8c,b32dc94,f6f8e5,...) at sleepq_switch+0xe1/frame 0xb32dc48 sleepq_wait(17e27b8c,0) at sleepq_wait+0x3a/frame 0xb32dc5c _cv_wait(17e27b8c,17e27cf8) at _cv_wait+0x135/frame 0xb32dc94 usb_process(17e27b84,b32dce8) at usb_process+0x104/frame 0xb32dcb4 fork_exit(e3af20,17e27b84,b32dce8,0,0,...) at fork_exit+0x6c/frame 0xb32dcd4 fork_trampoline() at 0xffc033ca/frame 0xb32dcd4 --- trap 0, eip = 0, esp = 0xb32dd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100065 td 0x17e20380 sched_switch(17e20380,0,104) at sched_switch+0x598/frame 0xb333bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb333c24 sleepq_switch(17e20380,17e2bcf8,17e2bacc,b333c94,f6f8e5,...) at sleepq_switch+0xe1/frame 0xb333c48 sleepq_wait(17e2bacc,0) at sleepq_wait+0x3a/frame 0xb333c5c _cv_wait(17e2bacc,17e2bcf8) at _cv_wait+0x135/frame 0xb333c94 usb_process(17e2bac4,b333ce8) at usb_process+0x104/frame 0xb333cb4 fork_exit(e3af20,17e2bac4,b333ce8,0,0,...) at fork_exit+0x6c/frame 0xb333cd4 fork_trampoline() at 0xffc033ca/frame 0xb333cd4 --- trap 0, eip = 0, esp = 0xb333d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100066 td 0x17e20000 sched_switch(17e20000,0,104) at sched_switch+0x598/frame 0xb338bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb338c24 sleepq_switch(17e20000,17e2bcf8,17e2bafc,b338c94,f6f8e5,...) at sleepq_switch+0xe1/frame 0xb338c48 sleepq_wait(17e2bafc,0) at sleepq_wait+0x3a/frame 0xb338c5c _cv_wait(17e2bafc,17e2bcf8) at _cv_wait+0x135/frame 0xb338c94 usb_process(17e2baf4,b338ce8) at usb_process+0x104/frame 0xb338cb4 fork_exit(e3af20,17e2baf4,b338ce8,0,0,...) at fork_exit+0x6c/frame 0xb338cd4 fork_trampoline() at 0xffc033ca/frame 0xb338cd4 --- trap 0, eip = 0, esp = 0xb338d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100067 td 0x17b7ea80 sched_switch(17b7ea80,0,104) at sched_switch+0x598/frame 0xb33dbf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb33dc24 sleepq_switch(17b7ea80,17e2bcf8,17e2bb2c,b33dc94,f6f8e5,...) at sleepq_switch+0xe1/frame 0xb33dc48 sleepq_wait(17e2bb2c,0) at sleepq_wait+0x3a/frame 0xb33dc5c _cv_wait(17e2bb2c,17e2bcf8) at _cv_wait+0x135/frame 0xb33dc94 usb_process(17e2bb24,b33dce8) at usb_process+0x104/frame 0xb33dcb4 fork_exit(e3af20,17e2bb24,b33dce8,0,0,...) at fork_exit+0x6c/frame 0xb33dcd4 fork_trampoline() at 0xffc033ca/frame 0xb33dcd4 --- trap 0, eip = 0, esp = 0xb33dd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100068 td 0x17b7e700 sched_switch(17b7e700,0,104) at sched_switch+0x598/frame 0xb342bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb342c24 sleepq_switch(17b7e700,17e2bcf8,17e2bb5c,b342c94,f6f8e5,...) at sleepq_switch+0xe1/frame 0xb342c48 sleepq_wait(17e2bb5c,0) at sleepq_wait+0x3a/frame 0xb342c5c _cv_wait(17e2bb5c,17e2bcf8) at _cv_wait+0x135/frame 0xb342c94 usb_process(17e2bb54,b342ce8) at usb_process+0x104/frame 0xb342cb4 fork_exit(e3af20,17e2bb54,b342ce8,0,0,...) at fork_exit+0x6c/frame 0xb342cd4 fork_trampoline() at 0xffc033ca/frame 0xb342cd4 --- trap 0, eip = 0, esp = 0xb342d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100069 td 0x17b7e380 sched_switch(17b7e380,0,104) at sched_switch+0x598/frame 0xb347bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb347c24 sleepq_switch(17b7e380,17e2bcf8,17e2bb8c,b347c94,f6f8e5,...) at sleepq_switch+0xe1/frame 0xb347c48 sleepq_wait(17e2bb8c,0) at sleepq_wait+0x3a/frame 0xb347c5c _cv_wait(17e2bb8c,17e2bcf8) at _cv_wait+0x135/frame 0xb347c94 usb_process(17e2bb84,b347ce8) at usb_process+0x104/frame 0xb347cb4 fork_exit(e3af20,17e2bb84,b347ce8,0,0,...) at fork_exit+0x6c/frame 0xb347cd4 fork_trampoline() at 0xffc033ca/frame 0xb347cd4 --- trap 0, eip = 0, esp = 0xb347d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100070 td 0x17e39700 sched_switch(17e39700,0,104) at sched_switch+0x598/frame 0xb34dbf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb34dc24 sleepq_switch(17e39700,17e33cf8,17e33acc,b34dc94,f6f8e5,...) at sleepq_switch+0xe1/frame 0xb34dc48 sleepq_wait(17e33acc,0) at sleepq_wait+0x3a/frame 0xb34dc5c _cv_wait(17e33acc,17e33cf8) at _cv_wait+0x135/frame 0xb34dc94 usb_process(17e33ac4,b34dce8) at usb_process+0x104/frame 0xb34dcb4 fork_exit(e3af20,17e33ac4,b34dce8,0,0,...) at fork_exit+0x6c/frame 0xb34dcd4 fork_trampoline() at 0xffc033ca/frame 0xb34dcd4 --- trap 0, eip = 0, esp = 0xb34dd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100071 td 0x17e39380 sched_switch(17e39380,0,104) at sched_switch+0x598/frame 0xb352bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb352c24 sleepq_switch(17e39380,17e33cf8,17e33afc,b352c94,f6f8e5,...) at sleepq_switch+0xe1/frame 0xb352c48 sleepq_wait(17e33afc,0) at sleepq_wait+0x3a/frame 0xb352c5c _cv_wait(17e33afc,17e33cf8) at _cv_wait+0x135/frame 0xb352c94 usb_process(17e33af4,b352ce8) at usb_process+0x104/frame 0xb352cb4 fork_exit(e3af20,17e33af4,b352ce8,0,0,...) at fork_exit+0x6c/frame 0xb352cd4 fork_trampoline() at 0xffc033ca/frame 0xb352cd4 --- trap 0, eip = 0, esp = 0xb352d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100072 td 0x17e39000 sched_switch(17e39000,0,104) at sched_switch+0x598/frame 0xb357bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb357c24 sleepq_switch(17e39000,17e33cf8,17e33b2c,b357c94,f6f8e5,...) at sleepq_switch+0xe1/frame 0xb357c48 sleepq_wait(17e33b2c,0) at sleepq_wait+0x3a/frame 0xb357c5c _cv_wait(17e33b2c,17e33cf8) at _cv_wait+0x135/frame 0xb357c94 usb_process(17e33b24,b357ce8) at usb_process+0x104/frame 0xb357cb4 fork_exit(e3af20,17e33b24,b357ce8,0,0,...) at fork_exit+0x6c/frame 0xb357cd4 fork_trampoline() at 0xffc033ca/frame 0xb357cd4 --- trap 0, eip = 0, esp = 0xb357d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100073 td 0x17e38a80 sched_switch(17e38a80,0,104) at sched_switch+0x598/frame 0xb35cbf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb35cc24 sleepq_switch(17e38a80,17e33cf8,17e33b5c,b35cc94,f6f8e5,...) at sleepq_switch+0xe1/frame 0xb35cc48 sleepq_wait(17e33b5c,0) at sleepq_wait+0x3a/frame 0xb35cc5c _cv_wait(17e33b5c,17e33cf8) at _cv_wait+0x135/frame 0xb35cc94 usb_process(17e33b54,b35cce8) at usb_process+0x104/frame 0xb35ccb4 fork_exit(e3af20,17e33b54,b35cce8,0,0,...) at fork_exit+0x6c/frame 0xb35ccd4 fork_trampoline() at 0xffc033ca/frame 0xb35ccd4 --- trap 0, eip = 0, esp = 0xb35cd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100074 td 0x17e38700 sched_switch(17e38700,0,104) at sched_switch+0x598/frame 0xb361bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb361c24 sleepq_switch(17e38700,17e33cf8,17e33b8c,b361c94,f6f8e5,...) at sleepq_switch+0xe1/frame 0xb361c48 sleepq_wait(17e33b8c,0) at sleepq_wait+0x3a/frame 0xb361c5c _cv_wait(17e33b8c,17e33cf8) at _cv_wait+0x135/frame 0xb361c94 usb_process(17e33b84,b361ce8) at usb_process+0x104/frame 0xb361cb4 fork_exit(e3af20,17e33b84,b361ce8,0,0,...) at fork_exit+0x6c/frame 0xb361cd4 fork_trampoline() at 0xffc033ca/frame 0xb361cd4 --- trap 0, eip = 0, esp = 0xb361d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100076 td 0x17e38000 sched_switch(17e38000,0,104) at sched_switch+0x598/frame 0xb36cbf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb36cc24 sleepq_switch(17e38000,17b56ed0,17b56ca4,b36cc94,f6f8e5,...) at sleepq_switch+0xe1/frame 0xb36cc48 sleepq_wait(17b56ca4,0) at sleepq_wait+0x3a/frame 0xb36cc5c _cv_wait(17b56ca4,17b56ed0) at _cv_wait+0x135/frame 0xb36cc94 usb_process(17b56c9c,b36cce8) at usb_process+0x104/frame 0xb36ccb4 fork_exit(e3af20,17b56c9c,b36cce8,0,0,...) at fork_exit+0x6c/frame 0xb36ccd4 fork_trampoline() at 0xffc033ca/frame 0xb36ccd4 --- trap 0, eip = 0, esp = 0xb36cd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100077 td 0x17e37a80 sched_switch(17e37a80,0,104) at sched_switch+0x598/frame 0xb371bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb371c24 sleepq_switch(17e37a80,17b56ed0,17b56cd4,b371c94,f6f8e5,...) at sleepq_switch+0xe1/frame 0xb371c48 sleepq_wait(17b56cd4,0) at sleepq_wait+0x3a/frame 0xb371c5c _cv_wait(17b56cd4,17b56ed0) at _cv_wait+0x135/frame 0xb371c94 usb_process(17b56ccc,b371ce8) at usb_process+0x104/frame 0xb371cb4 fork_exit(e3af20,17b56ccc,b371ce8,0,0,...) at fork_exit+0x6c/frame 0xb371cd4 fork_trampoline() at 0xffc033ca/frame 0xb371cd4 --- trap 0, eip = 0, esp = 0xb371d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100078 td 0x17e37700 sched_switch(17e37700,0,104) at sched_switch+0x598/frame 0xb376bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb376c24 sleepq_switch(17e37700,17b56ed0,17b56d04,b376c94,f6f8e5,...) at sleepq_switch+0xe1/frame 0xb376c48 sleepq_wait(17b56d04,0) at sleepq_wait+0x3a/frame 0xb376c5c _cv_wait(17b56d04,17b56ed0) at _cv_wait+0x135/frame 0xb376c94 usb_process(17b56cfc,b376ce8) at usb_process+0x104/frame 0xb376cb4 fork_exit(e3af20,17b56cfc,b376ce8,0,0,...) at fork_exit+0x6c/frame 0xb376cd4 fork_trampoline() at 0xffc033ca/frame 0xb376cd4 --- trap 0, eip = 0, esp = 0xb376d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100079 td 0x17e37380 sched_switch(17e37380,0,104) at sched_switch+0x598/frame 0xb37bbf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb37bc24 sleepq_switch(17e37380,17b56ed0,17b56d34,b37bc94,f6f8e5,...) at sleepq_switch+0xe1/frame 0xb37bc48 sleepq_wait(17b56d34,0) at sleepq_wait+0x3a/frame 0xb37bc5c _cv_wait(17b56d34,17b56ed0) at _cv_wait+0x135/frame 0xb37bc94 usb_process(17b56d2c,b37bce8) at usb_process+0x104/frame 0xb37bcb4 fork_exit(e3af20,17b56d2c,b37bce8,0,0,...) at fork_exit+0x6c/frame 0xb37bcd4 fork_trampoline() at 0xffc033ca/frame 0xb37bcd4 --- trap 0, eip = 0, esp = 0xb37bd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100080 td 0x17e37000 sched_switch(17e37000,0,104) at sched_switch+0x598/frame 0xb380bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb380c24 sleepq_switch(17e37000,17b56ed0,17b56d64,b380c94,f6f8e5,...) at sleepq_switch+0xe1/frame 0xb380c48 sleepq_wait(17b56d64,0) at sleepq_wait+0x3a/frame 0xb380c5c _cv_wait(17b56d64,17b56ed0) at _cv_wait+0x135/frame 0xb380c94 usb_process(17b56d5c,b380ce8) at usb_process+0x104/frame 0xb380cb4 fork_exit(e3af20,17b56d5c,b380ce8,0,0,...) at fork_exit+0x6c/frame 0xb380cd4 fork_trampoline() at 0xffc033ca/frame 0xb380cd4 --- trap 0, eip = 0, esp = 0xb380d20, ebp = 0 --- (null)() at 0 Tracing command cam pid 7 tid 100043 td 0x17a02000 sched_switch(17a02000,0,104) at sched_switch+0x598/frame 0xb294bc4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb294bf4 sleepq_switch(17a02000,0,1c64040,b294c6c,fd51e7,...) at sleepq_switch+0xe1/frame 0xb294c18 sleepq_wait(1c64040,5c) at sleepq_wait+0x3a/frame 0xb294c2c _sleep(1c64040,1c64000,5c,159eaa4,0,0,0,0,100) at _sleep+0x307/frame 0xb294c6c xpt_done_td(1c64000,b294ce8) at xpt_done_td+0x72/frame 0xb294cb4 fork_exit(90a1d0,1c64000,b294ce8,0,0,...) at fork_exit+0x6c/frame 0xb294cd4 fork_trampoline() at 0xffc033ca/frame 0xb294cd4 --- trap 0, eip = 0, esp = 0xb294d20, ebp = 0 --- (null)() at 0 Tracing command cam pid 7 tid 100096 td 0x184bb700 sched_switch(184bb700,0,104) at sched_switch+0x598/frame 0xb3ddbbc mi_switch(104,0) at mi_switch+0x1de/frame 0xb3ddbec sleepq_switch(184bb700,0,1c63f6c,b3ddc64,fd51e7,...) at sleepq_switch+0xe1/frame 0xb3ddc10 sleepq_wait(1c63f6c,5c) at sleepq_wait+0x3a/frame 0xb3ddc24 _sleep(1c63f6c,1c63fcc,5c,159eaa4,0,0,0,0,100) at _sleep+0x307/frame 0xb3ddc64 xpt_scanner_thread(0,b3ddce8) at xpt_scanner_thread+0x63/frame 0xb3ddcb4 fork_exit(90a470,0,b3ddce8,0,0,...) at fork_exit+0x6c/frame 0xb3ddcd4 fork_trampoline() at 0xffc033ca/frame 0xb3ddcd4 --- trap 0, eip = 0, esp = 0xb3ddd20, ebp = 0 --- (null)() at 0 Tracing command crypto returns 3 pid 6 tid 100042 td 0x17a02380 sched_switch(17a02380,0,104) at sched_switch+0x598/frame 0xb28fbbc mi_switch(104,0) at mi_switch+0x1de/frame 0xb28fbec sleepq_switch(17a02380,0,95a64c4,b28fc64,fd51e7,...) at sleepq_switch+0xe1/frame 0xb28fc10 sleepq_wait(95a64c4,6c) at sleepq_wait+0x3a/frame 0xb28fc24 _sleep(95a64c4,95a64a8,6c,167fcb3,0,0,0,0,100) at _sleep+0x307/frame 0xb28fc64 crypto_ret_proc(95a64a8,b28fce8) at crypto_ret_proc+0x1e9/frame 0xb28fcb4 fork_exit(122ba40,95a64a8,b28fce8,0,0,...) at fork_exit+0x6c/frame 0xb28fcd4 fork_trampoline() at 0xffc033ca/frame 0xb28fcd4 --- trap 0, eip = 0, esp = 0xb28fd20, ebp = 0 --- (null)() at 0 Tracing command crypto returns 2 pid 5 tid 100041 td 0x17a02700 sched_switch(17a02700,0,104) at sched_switch+0x598/frame 0xb28abbc mi_switch(104,0) at mi_switch+0x1de/frame 0xb28abec sleepq_switch(17a02700,0,95a648c,b28ac64,fd51e7,...) at sleepq_switch+0xe1/frame 0xb28ac10 sleepq_wait(95a648c,6c) at sleepq_wait+0x3a/frame 0xb28ac24 _sleep(95a648c,95a6470,6c,167fcb3,0,0,0,0,100) at _sleep+0x307/frame 0xb28ac64 crypto_ret_proc(95a6470,b28ace8) at crypto_ret_proc+0x1e9/frame 0xb28acb4 fork_exit(122ba40,95a6470,b28ace8,0,0,...) at fork_exit+0x6c/frame 0xb28acd4 fork_trampoline() at 0xffc033ca/frame 0xb28acd4 --- trap 0, eip = 0, esp = 0xb28ad20, ebp = 0 --- (null)() at 0 Tracing command crypto returns 1 pid 4 tid 100040 td 0x17a02a80 sched_switch(17a02a80,0,104) at sched_switch+0x598/frame 0xb285bbc mi_switch(104,0) at mi_switch+0x1de/frame 0xb285bec sleepq_switch(17a02a80,0,95a6454,b285c64,fd51e7,...) at sleepq_switch+0xe1/frame 0xb285c10 sleepq_wait(95a6454,6c) at sleepq_wait+0x3a/frame 0xb285c24 _sleep(95a6454,95a6438,6c,167fcb3,0,0,0,0,100) at _sleep+0x307/frame 0xb285c64 crypto_ret_proc(95a6438,b285ce8) at crypto_ret_proc+0x1e9/frame 0xb285cb4 fork_exit(122ba40,95a6438,b285ce8,0,0,...) at fork_exit+0x6c/frame 0xb285cd4 fork_trampoline() at 0xffc033ca/frame 0xb285cd4 --- trap 0, eip = 0, esp = 0xb285d20, ebp = 0 --- (null)() at 0 Tracing command crypto returns 0 pid 3 tid 100039 td 0x17a03000 sched_switch(17a03000,0,104) at sched_switch+0x598/frame 0xb280bbc mi_switch(104,0) at mi_switch+0x1de/frame 0xb280bec sleepq_switch(17a03000,0,95a641c,b280c64,fd51e7,...) at sleepq_switch+0xe1/frame 0xb280c10 sleepq_wait(95a641c,6c) at sleepq_wait+0x3a/frame 0xb280c24 _sleep(95a641c,95a6400,6c,167fcb3,0,0,0,0,100) at _sleep+0x307/frame 0xb280c64 crypto_ret_proc(95a6400,b280ce8) at crypto_ret_proc+0x1e9/frame 0xb280cb4 fork_exit(122ba40,95a6400,b280ce8,0,0,...) at fork_exit+0x6c/frame 0xb280cd4 fork_trampoline() at 0xffc033ca/frame 0xb280cd4 --- trap 0, eip = 0, esp = 0xb280d20, ebp = 0 --- (null)() at 0 Tracing command crypto pid 2 tid 100038 td 0x17a03380 sched_switch(17a03380,0,104) at sched_switch+0x598/frame 0xb27bbcc mi_switch(104,0) at mi_switch+0x1de/frame 0xb27bbfc sleepq_switch(17a03380,0,1f53ef8,b27bc74,fd51e7,...) at sleepq_switch+0xe1/frame 0xb27bc20 sleepq_wait(1f53ef8,6c) at sleepq_wait+0x3a/frame 0xb27bc34 _sleep(1f53ef8,1f53ee0,6c,163426d,0,0,0,0,100) at _sleep+0x307/frame 0xb27bc74 crypto_proc(0,b27bce8) at crypto_proc+0x250/frame 0xb27bcb4 fork_exit(122b6c0,0,b27bce8,0,0,...) at fork_exit+0x6c/frame 0xb27bcd4 fork_trampoline() at 0xffc033ca/frame 0xb27bcd4 --- trap 0, eip = 0, esp = 0xb27bd20, ebp = 0 --- (null)() at 0 Tracing command sequencer 00 pid 14 tid 100033 td 0x94d2000 sched_switch(94d2000,0,104) at sched_switch+0x598/frame 0x125e8bcc mi_switch(104,0) at mi_switch+0x1de/frame 0x125e8bfc sleepq_switch(94d2000,9570404,957044c,125e8c6c,f6f8e5,...) at sleepq_switch+0xe1/frame 0x125e8c20 sleepq_wait(957044c,0) at sleepq_wait+0x3a/frame 0x125e8c34 _cv_wait(957044c,9570404) at _cv_wait+0x135/frame 0x125e8c6c seq_eventthread(9570400,125e8ce8) at seq_eventthread+0xcb/frame 0x125e8cb4 fork_exit(dc2e00,9570400,125e8ce8,0,0,...) at fork_exit+0x6c/frame 0x125e8cd4 fork_trampoline() at 0xffc033ca/frame 0x125e8cd4 --- trap 0, eip = 0, esp = 0x125e8d20, ebp = 0 --- (null)() at 0 Tracing command geom pid 13 tid 100030 td 0x94d2a80 sched_switch(94d2a80,0,104) at sched_switch+0x598/frame 0x125d5bd4 mi_switch(104,0) at mi_switch+0x1de/frame 0x125d5c04 sleepq_switch(94d2a80,0,1f78768,125d5c7c,fd51e7,...) at sleepq_switch+0xe1/frame 0x125d5c28 sleepq_wait(1f78768,5c) at sleepq_wait+0x3a/frame 0x125d5c3c _sleep(1f78768,1ebfef4,25c,159eaa4,0,0,0,0,100) at _sleep+0x307/frame 0x125d5c7c g_run_events(0,125d5ce8) at g_run_events+0x47/frame 0x125d5cb4 fork_exit(f25ad0,0,125d5ce8,0,0,...) at fork_exit+0x6c/frame 0x125d5cd4 fork_trampoline() at 0xffc033ca/frame 0x125d5cd4 --- trap 0, eip = 0, esp = 0x125d5d20, ebp = 0 --- (null)() at 0 Tracing command geom pid 13 tid 100031 td 0x94d2700 sched_switch(94d2700,0,104) at sched_switch+0x598/frame 0x125dabcc mi_switch(104,0) at mi_switch+0x1de/frame 0x125dabfc sleepq_switch(94d2700,0,1f78770,125dac74,fd51e7,...) at sleepq_switch+0xe1/frame 0x125dac20 sleepq_wait(1f78770,5c) at sleepq_wait+0x3a/frame 0x125dac34 _sleep(1f78770,1ebff3c,25c,159eaa4,0,0,0,0,100) at _sleep+0x307/frame 0x125dac74 g_io_schedule_up(94d2700) at g_io_schedule_up+0x8e/frame 0x125daca8 g_up_procbody(0,125dace8) at g_up_procbody+0x5b/frame 0x125dacb4 fork_exit(f25b20,0,125dace8,0,0,...) at fork_exit+0x6c/frame 0x125dacd4 fork_trampoline() at 0xffc033ca/frame 0x125dacd4 --- trap 0, eip = 0, esp = 0x125dad20, ebp = 0 --- (null)() at 0 Tracing command geom pid 13 tid 100032 td 0x94d2380 sched_switch(94d2380,0,104) at sched_switch+0x598/frame 0x125dfbc4 mi_switch(104,0) at mi_switch+0x1de/frame 0x125dfbf8 sleepq_switch(94d2380,0,1f78764,125dfc70,fd51e7,...) at sleepq_switch+0xe1/frame 0x125dfc1c sleepq_wait(1f78764,5c) at sleepq_wait+0x3a/frame 0x125dfc30 _sleep(1f78764,1ebff1c,25c,159eaa4,0,0,0,0,100) at _sleep+0x307/frame 0x125dfc70 g_io_schedule_down(94d2380) at g_io_schedule_down+0xa6/frame 0x125dfca8 g_down_procbody(0,125dfce8) at g_down_procbody+0x5b/frame 0x125dfcb4 fork_exit(f25b80,0,125dfce8,0,0,...) at fork_exit+0x6c/frame 0x125dfcd4 fork_trampoline() at 0xffc033ca/frame 0x125dfcd4 --- trap 0, eip = 0, esp = 0x125dfd20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100008 td 0x99c7380 sched_switch(99c7380,0,109) at sched_switch+0x598/frame 0x1253fc4c mi_switch(109,0) at mi_switch+0x1de/frame 0x1253fc80 ithread_loop(946cf90,1253fce8) at ithread_loop+0x2f5/frame 0x1253fcb4 fork_exit(f94070,946cf90,1253fce8,0,0,...) at fork_exit+0x6c/frame 0x1253fcd4 fork_trampoline() at 0xffc033ca/frame 0x1253fcd4 --- trap 0, eip = 0, esp = 0x1253fd20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100009 td 0x99c7000 sched_switch(99c7000,0,109) at sched_switch+0x598/frame 0x12544c4c mi_switch(109,0) at mi_switch+0x1de/frame 0x12544c80 ithread_loop(946cf80,12544ce8) at ithread_loop+0x2f5/frame 0x12544cb4 fork_exit(f94070,946cf80,12544ce8,0,0,...) at fork_exit+0x6c/frame 0x12544cd4 fork_trampoline() at 0xffc033ca/frame 0x12544cd4 --- trap 0, eip = 0, esp = 0x12544d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100011 td 0x99c6700 __bss_end() at 0xffc033c0 Tracing command intr pid 12 tid 100023 td 0x9504700 __bss_end() at 0xffc033c0 Tracing command intr pid 12 tid 100024 td 0x9504380 sched_switch(9504380,0,109) at sched_switch+0x598/frame 0x1259bc4c mi_switch(109,0) at mi_switch+0x1de/frame 0x1259bc80 ithread_loop(94cd040,1259bce8) at ithread_loop+0x2f5/frame 0x1259bcb4 fork_exit(f94070,94cd040,1259bce8,0,0,...) at fork_exit+0x6c/frame 0x1259bcd4 fork_trampoline() at 0xffc033ca/frame 0x1259bcd4 --- trap 0, eip = 0, esp = 0x1259bd20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100025 td 0x9504000 sched_switch(9504000,0,109) at sched_switch+0x598/frame 0x125a0c4c mi_switch(109,0) at mi_switch+0x1de/frame 0x125a0c80 ithread_loop(94cd030,125a0ce8) at ithread_loop+0x2f5/frame 0x125a0cb4 fork_exit(f94070,94cd030,125a0ce8,0,0,...) at fork_exit+0x6c/frame 0x125a0cd4 fork_trampoline() at 0xffc033ca/frame 0x125a0cd4 --- trap 0, eip = 0, esp = 0x125a0d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100026 td 0x9503a80 __bss_end() at 0xffc033c0 Tracing command intr pid 12 tid 100027 td 0x9503700 __bss_end() at 0xffc033c0 Tracing command intr pid 12 tid 100028 td 0x9503380 __bss_end() at 0xffc033c0 Tracing command intr pid 12 tid 100044 td 0x17b7e000 sched_switch(17b7e000,0,109) at sched_switch+0x598/frame 0xb2c4c4c mi_switch(109,0) at mi_switch+0x1de/frame 0xb2c4c80 ithread_loop(17b63050,b2c4ce8) at ithread_loop+0x2f5/frame 0xb2c4cb4 fork_exit(f94070,17b63050,b2c4ce8,0,0,...) at fork_exit+0x6c/frame 0xb2c4cd4 fork_trampoline() at 0xffc033ca/frame 0xb2c4cd4 --- trap 0, eip = 0, esp = 0xb2c4d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100045 td 0x17b7da80 sched_switch(17b7da80,0,109) at sched_switch+0x598/frame 0xb2cac4c mi_switch(109,0) at mi_switch+0x1de/frame 0xb2cac80 ithread_loop(17b63000,b2cace8) at ithread_loop+0x2f5/frame 0xb2cacb4 fork_exit(f94070,17b63000,b2cace8,0,0,...) at fork_exit+0x6c/frame 0xb2cacd4 fork_trampoline() at 0xffc033ca/frame 0xb2cacd4 --- trap 0, eip = 0, esp = 0xb2cad20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100046 td 0x17b7d700 sched_switch(17b7d700,0,109) at sched_switch+0x598/frame 0xb2d0c4c mi_switch(109,0) at mi_switch+0x1de/frame 0xb2d0c80 ithread_loop(94cdf90,b2d0ce8) at ithread_loop+0x2f5/frame 0xb2d0cb4 fork_exit(f94070,94cdf90,b2d0ce8,0,0,...) at fork_exit+0x6c/frame 0xb2d0cd4 fork_trampoline() at 0xffc033ca/frame 0xb2d0cd4 --- trap 0, eip = 0, esp = 0xb2d0d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100047 td 0x17b7d380 sched_switch(17b7d380,0,109) at sched_switch+0x598/frame 0xb2d6c4c mi_switch(109,0) at mi_switch+0x1de/frame 0xb2d6c80 ithread_loop(94cdf80,b2d6ce8) at ithread_loop+0x2f5/frame 0xb2d6cb4 fork_exit(f94070,94cdf80,b2d6ce8,0,0,...) at fork_exit+0x6c/frame 0xb2d6cd4 fork_trampoline() at 0xffc033ca/frame 0xb2d6cd4 --- trap 0, eip = 0, esp = 0xb2d6d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100053 td 0x17b72a80 sched_switch(17b72a80,0,109) at sched_switch+0x598/frame 0xb2f5c4c mi_switch(109,0) at mi_switch+0x1de/frame 0xb2f5c80 ithread_loop(94cdf60,b2f5ce8) at ithread_loop+0x2f5/frame 0xb2f5cb4 fork_exit(f94070,94cdf60,b2f5ce8,0,0,...) at fork_exit+0x6c/frame 0xb2f5cd4 fork_trampoline() at 0xffc033ca/frame 0xb2f5cd4 --- trap 0, eip = 0, esp = 0xb2f5d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100059 td 0x17e21a80 sched_switch(17e21a80,0,109) at sched_switch+0x598/frame 0xb314c4c mi_switch(109,0) at mi_switch+0x1de/frame 0xb314c80 ithread_loop(94cdf40,b314ce8) at ithread_loop+0x2f5/frame 0xb314cb4 fork_exit(f94070,94cdf40,b314ce8,0,0,...) at fork_exit+0x6c/frame 0xb314cd4 fork_trampoline() at 0xffc033ca/frame 0xb314cd4 --- trap 0, eip = 0, esp = 0xb314d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100075 td 0x17e38380 __bss_end() at 0xffc033c0 Tracing command intr pid 12 tid 100081 td 0x17e22a80 sched_switch(17e22a80,0,109) at sched_switch+0x598/frame 0xb385c4c mi_switch(109,0) at mi_switch+0x1de/frame 0xb385c80 ithread_loop(94cdee0,b385ce8) at ithread_loop+0x2f5/frame 0xb385cb4 fork_exit(f94070,94cdee0,b385ce8,0,0,...) at fork_exit+0x6c/frame 0xb385cd4 fork_trampoline() at 0xffc033ca/frame 0xb385cd4 --- trap 0, eip = 0, esp = 0xb385d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100082 td 0x17e22700 sched_switch(17e22700,0,109) at sched_switch+0x598/frame 0xb38ec4c mi_switch(109,0) at mi_switch+0x1de/frame 0xb38ec80 ithread_loop(94cdeb0,b38ece8) at ithread_loop+0x2f5/frame 0xb38ecb4 fork_exit(f94070,94cdeb0,b38ece8,0,0,...) at fork_exit+0x6c/frame 0xb38ecd4 fork_trampoline() at 0xffc033ca/frame 0xb38ecd4 --- trap 0, eip = 0, esp = 0xb38ed20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100084 td 0x17eb0700 __bss_end() at 0xffc033c0 Tracing command idle pid 11 tid 100003 td 0x99c8700 (CPU 0) cpustop_handler(0,12521bbc,12521bb0,1527c62,0,...) at cpustop_handler+0x27/frame 0x12521ae8 ipi_nmi_handler(0,12521b28,99c8700,24fedc0,99c46a8,...) at ipi_nmi_handler+0x34/frame 0x12521af8 trap(12521bbc,8,28,28,17ae6800,...) at trap+0xc2/frame 0x12521bb0 calltrap() at 0xffc0316d/frame 0x12521bb0 --- trap 0x13, eip = 0x153da95, esp = 0x12521bfc, ebp = 0x12521bfc --- acpi_cpu_c1(0,0,708,58a114ec,24fedc0,...) at acpi_cpu_c1+0x5/frame 0x12521bfc acpi_cpu_idle(47434ff,0) at acpi_cpu_idle+0x230/frame 0x12521c2c cpu_idle_acpi(47434ff,0) at cpu_idle_acpi+0x35/frame 0x12521c40 cpu_idle(0) at cpu_idle+0xa3/frame 0x12521c5c sched_idletd(0,12521ce8) at sched_idletd+0x3ee/frame 0x12521cb4 fork_exit(ff5c70,0,12521ce8,0,0,...) at fork_exit+0x6c/frame 0x12521cd4 fork_trampoline() at 0xffc033ca/frame 0x12521cd4 --- trap 0, eip = 0, esp = 0x12521d20, ebp = 0 --- (null)() at 0 Tracing command idle pid 11 tid 100004 td 0x99c8380 (CPU 1) cpustop_handler(1,12526bbc,12526bb0,1527c62,99c8380,...) at cpustop_handler+0x27/frame 0x12526ae8 ipi_nmi_handler(99c8380,12526b10,99c8380,16151c6,99c46a8,...) at ipi_nmi_handler+0x34/frame 0x12526af8 trap(12526bbc,8,28,28,17ae6600,...) at trap+0xc2/frame 0x12526bb0 calltrap() at 0xffc0316d/frame 0x12526bb0 --- trap 0x13, eip = 0x153da95, esp = 0x12526bfc, ebp = 0x12526bfc --- acpi_cpu_c1(0,1,708,4f58de2a,985bdc0,...) at acpi_cpu_c1+0x5/frame 0x12526bfc acpi_cpu_idle(1c12cd17,0) at acpi_cpu_idle+0x230/frame 0x12526c2c cpu_idle_acpi(1c12cd17,0) at cpu_idle_acpi+0x35/frame 0x12526c40 cpu_idle(0) at cpu_idle+0xa3/frame 0x12526c5c sched_idletd(0,12526ce8) at sched_idletd+0x3ee/frame 0x12526cb4 fork_exit(ff5c70,0,12526ce8,0,0,...) at fork_exit+0x6c/frame 0x12526cd4 fork_trampoline() at 0xffc033ca/frame 0x12526cd4 --- trap 0, eip = 0, esp = 0x12526d20, ebp = 0 --- (null)() at 0 Tracing command idle pid 11 tid 100005 td 0x99c8000 (CPU 2) cpustop_handler(2,1252bbbc,1252bbb0,1527c62,99c8000,...) at cpustop_handler+0x27/frame 0x1252bae8 ipi_nmi_handler(99c8000,1252bb10,99c8000,9860dd0,99c46a8,...) at ipi_nmi_handler+0x34/frame 0x1252baf8 trap(1252bbbc,8,28,28,17ae6400,...) at trap+0xc2/frame 0x1252bbb0 calltrap() at 0xffc0316d/frame 0x1252bbb0 --- trap 0x13, eip = 0x153da95, esp = 0x1252bbfc, ebp = 0x1252bbfc --- acpi_cpu_c1(0,2,708,517da733,9860dc0,...) at acpi_cpu_c1+0x5/frame 0x1252bbfc acpi_cpu_idle(1b1e6571,0) at acpi_cpu_idle+0x230/frame 0x1252bc2c cpu_idle_acpi(1b1e6571,0) at cpu_idle_acpi+0x35/frame 0x1252bc40 cpu_idle(0) at cpu_idle+0xa3/frame 0x1252bc5c sched_idletd(0,1252bce8) at sched_idletd+0x3ee/frame 0x1252bcb4 fork_exit(ff5c70,0,1252bce8,0,0,...) at fork_exit+0x6c/frame 0x1252bcd4 fork_trampoline() at 0xffc033ca/frame 0x1252bcd4 --- trap 0, eip = 0, esp = 0x1252bd20, ebp = 0 --- (null)() at 0 Tracing command idle pid 11 tid 100006 td 0x99c7a80 (CPU 3) kdb_alt_break_internal(0) at kdb_alt_break_internal+0xeb/frame 0x12530b00 kdb_alt_break(2,17e8788c) at kdb_alt_break+0x10/frame 0x12530b0c uart_intr_rxready(17e87800,1ed3c00,0,0,99c7a80,...) at uart_intr_rxready+0x82/frame 0x12530b28 uart_intr(17e87800) at uart_intr+0x10e/frame 0x12530b48 intr_event_handle(99fec00,12530bbc) at intr_event_handle+0xaf/frame 0x12530b68 intr_execute_handlers(9462938,12530bbc,3) at intr_execute_handlers+0xc7/frame 0x12530b94 lapic_handle_intr(32,12530bbc,8,28,28,...) at lapic_handle_intr+0x55/frame 0x12530bac Xapic_isr1() at 0xffc04208/frame 0x12530bac --- interrupt, eip = 0x153da95, esp = 0x12530bfc, ebp = 0x12530bfc --- acpi_cpu_c1(0,3,708,43c63653,9865dc0,...) at acpi_cpu_c1+0x5/frame 0x12530bfc acpi_cpu_idle(655eb404,0) at acpi_cpu_idle+0x230/frame 0x12530c2c cpu_idle_acpi(655eb404,0) at cpu_idle_acpi+0x35/frame 0x12530c40 cpu_idle(0) at cpu_idle+0xa3/frame 0x12530c5c sched_idletd(0,12530ce8) at sched_idletd+0x3ee/frame 0x12530cb4 fork_exit(ff5c70,0,12530ce8,0,0,...) at fork_exit+0x6c/frame 0x12530cd4 fork_trampoline() at 0xffc033ca/frame 0x12530cd4 --- trap 0, eip = 0, esp = 0x12530d20, ebp = 0 --- (null)() at 0 Tracing command init pid 1 tid 100002 td 0x99c8a80 sched_switch(99c8a80,0,104) at sched_switch+0x598/frame 0x125189b4 mi_switch(104,0) at mi_switch+0x1de/frame 0x125189e8 sleepq_switch(6c,12518a40,1019877,99c49fc,1ee37d4,...) at sleepq_switch+0xe1/frame 0x12518a0c sleepq_catch_signals(99c8a80,0,99c49fc,12518a8c,fd516e,...) at sleepq_catch_signals+0x3b7/frame 0x12518a38 sleepq_wait_sig(99c49fc,6c) at sleepq_wait_sig+0x11/frame 0x12518a4c _sleep(99c49fc,99c4aa4,36c,166aa1c,0,0,0,0,100) at _sleep+0x28e/frame 0x12518a8c kern_wait6(99c8a80,7,0,0,12518b14,32,0,0) at kern_wait6+0x3bd/frame 0x12518ae8 sys_wait4(99c8a80,99c8d08) at sys_wait4+0x78/frame 0x12518c08 syscall(12518ce8,3b,3b,3b,ffffffff,...) at syscall+0x2d9/frame 0x12518cdc Xint0x80_syscall() at 0xffc033b7/frame 0x12518cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x47f56f, esp = 0xffbfe868, ebp = 0xffbfe87c --- (null)() at 0x47f56f Tracing command audit pid 10 tid 100001 td 0x99c9000 sched_switch(99c9000,0,104) at sched_switch+0x598/frame 0x12513bcc mi_switch(104,0) at mi_switch+0x1de/frame 0x12513c00 sleepq_switch(99c9000,1f88f4c,1f88fa0,12513c70,f6f8e5,...) at sleepq_switch+0xe1/frame 0x12513c24 sleepq_wait(1f88fa0,0) at sleepq_wait+0x3a/frame 0x12513c38 _cv_wait(1f88fa0,1f88f4c) at _cv_wait+0x135/frame 0x12513c70 audit_worker(0,12513ce8) at audit_worker+0x7f/frame 0x12513cb4 fork_exit(124a590,0,12513ce8,0,0,...) at fork_exit+0x6c/frame 0x12513cd4 fork_trampoline() at 0xffc033ca/frame 0x12513cd4 --- trap 0, eip = 0, esp = 0x12513d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100000 td 0x1f78b00 sched_switch(1f78b00,0,104) at sched_switch+0x598/frame 0x24f9c04 mi_switch(104,0) at mi_switch+0x1de/frame 0x24f9c34 sleepq_switch(3,1f78b00,177,1f78b00,0,...) at sleepq_switch+0xe1/frame 0x24f9c58 sleepq_timedwait(1f78788,54,246,0,0,...) at sleepq_timedwait+0x47/frame 0x24f9c88 _sleep(1f78788,0,54,166d63a,fffff470,9,0,0,100) at _sleep+0x23c/frame 0x24f9cc8 swapper(0,0,0,1c387b4) at swapper+0x6d/frame 0x24f9d14 mi_startup() at mi_startup+0x2b5/frame 0x24f9d38 btext() at btext+0x5f Tracing command kernel pid 0 tid 100007 td 0x99c7700 sched_switch(99c7700,0,104) at sched_switch+0x598/frame 0x1253abd4 mi_switch(104,0) at mi_switch+0x1de/frame 0x1253ac04 sleepq_switch(99c7700,0,94c6000,1253ac7c,fd51e7,...) at sleepq_switch+0xe1/frame 0x1253ac28 sleepq_wait(94c6000,0) at sleepq_wait+0x3a/frame 0x1253ac3c _sleep(94c6000,94c601c,0,159eaa4,0,0,0,0,100) at _sleep+0x307/frame 0x1253ac7c taskqueue_thread_loop(1f88330,1253ace8) at taskqueue_thread_loop+0xcb/frame 0x1253acb4 fork_exit(101e800,1f88330,1253ace8,0,0,...) at fork_exit+0x6c/frame 0x1253acd4 fork_trampoline() at 0xffc033ca/frame 0x1253acd4 --- trap 0, eip = 0, esp = 0x1253ad20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100010 td 0x99c6a80 sched_switch(99c6a80,0,104) at sched_switch+0x598/frame 0x12549bd4 mi_switch(104,0) at mi_switch+0x1de/frame 0x12549c04 sleepq_switch(99c6a80,0,94c5e00,12549c7c,fd51e7,...) at sleepq_switch+0xe1/frame 0x12549c28 sleepq_wait(94c5e00,0) at sleepq_wait+0x3a/frame 0x12549c3c _sleep(94c5e00,94c5e1c,0,159eaa4,0,0,0,0,100) at _sleep+0x307/frame 0x12549c7c taskqueue_thread_loop(1f882e0,12549ce8) at taskqueue_thread_loop+0xcb/frame 0x12549cb4 fork_exit(101e800,1f882e0,12549ce8,0,0,...) at fork_exit+0x6c/frame 0x12549cd4 fork_trampoline() at 0xffc033ca/frame 0x12549cd4 --- trap 0, eip = 0, esp = 0x12549d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100012 td 0x99c6380 sched_switch(99c6380,0,104) at sched_switch+0x598/frame 0x12553bdc mi_switch(104,0) at mi_switch+0x1de/frame 0x12553c10 sleepq_switch(0,99ea000,99c6380,12553c80,fd5432,...) at sleepq_switch+0xe1/frame 0x12553c34 sleepq_wait(99ea000,0) at sleepq_wait+0x3a/frame 0x12553c48 msleep_spin_sbt(99ea000,99ea01c,159eaa4,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x12553c80 gtaskqueue_thread_loop(94c0804,12553ce8) at gtaskqueue_thread_loop+0x9c/frame 0x12553cb4 fork_exit(100b130,94c0804,12553ce8,0,0,...) at fork_exit+0x6c/frame 0x12553cd4 fork_trampoline() at 0xffc033ca/frame 0x12553cd4 --- trap 0, eip = 0, esp = 0x12553d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100013 td 0x99c6000 sched_switch(99c6000,0,104) at sched_switch+0x598/frame 0x12558bd4 mi_switch(104,0) at mi_switch+0x1de/frame 0x12558c04 sleepq_switch(99c6000,0,94c5d00,12558c7c,fd51e7,...) at sleepq_switch+0xe1/frame 0x12558c28 sleepq_wait(94c5d00,0) at sleepq_wait+0x3a/frame 0x12558c3c _sleep(94c5d00,94c5d1c,0,159eaa4,0,0,0,0,100) at _sleep+0x307/frame 0x12558c7c taskqueue_thread_loop(1f79158,12558ce8) at taskqueue_thread_loop+0xcb/frame 0x12558cb4 fork_exit(101e800,1f79158,12558ce8,0,0,...) at fork_exit+0x6c/frame 0x12558cd4 fork_trampoline() at 0xffc033ca/frame 0x12558cd4 --- trap 0, eip = 0, esp = 0x12558d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100014 td 0x94cb380 sched_switch(94cb380,0,104) at sched_switch+0x598/frame 0x12569bdc mi_switch(104,0) at mi_switch+0x1de/frame 0x12569c10 sleepq_switch(0,99e9f00,94cb380,12569c80,fd5432,...) at sleepq_switch+0xe1/frame 0x12569c34 sleepq_wait(99e9f00,0) at sleepq_wait+0x3a/frame 0x12569c48 msleep_spin_sbt(99e9f00,99e9f1c,159eaa4,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x12569c80 gtaskqueue_thread_loop(94c0c04,12569ce8) at gtaskqueue_thread_loop+0x9c/frame 0x12569cb4 fork_exit(100b130,94c0c04,12569ce8,0,0,...) at fork_exit+0x6c/frame 0x12569cd4 fork_trampoline() at 0xffc033ca/frame 0x12569cd4 --- trap 0, eip = 0, esp = 0x12569d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100015 td 0x94cb000 sched_switch(94cb000,0,104) at sched_switch+0x598/frame 0x1256ebdc mi_switch(104,0) at mi_switch+0x1de/frame 0x1256ec10 sleepq_switch(0,99e9e80,94cb000,1256ec80,fd5432,...) at sleepq_switch+0xe1/frame 0x1256ec34 sleepq_wait(99e9e80,0) at sleepq_wait+0x3a/frame 0x1256ec48 msleep_spin_sbt(99e9e80,99e9e9c,159eaa4,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x1256ec80 gtaskqueue_thread_loop(94c1004,1256ece8) at gtaskqueue_thread_loop+0x9c/frame 0x1256ecb4 fork_exit(100b130,94c1004,1256ece8,0,0,...) at fork_exit+0x6c/frame 0x1256ecd4 fork_trampoline() at 0xffc033ca/frame 0x1256ecd4 --- trap 0, eip = 0, esp = 0x1256ed20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100016 td 0x94caa80 sched_switch(94caa80,0,104) at sched_switch+0x598/frame 0x12573bdc mi_switch(104,0) at mi_switch+0x1de/frame 0x12573c10 sleepq_switch(0,99e9e00,94caa80,12573c80,fd5432,...) at sleepq_switch+0xe1/frame 0x12573c34 sleepq_wait(99e9e00,0) at sleepq_wait+0x3a/frame 0x12573c48 msleep_spin_sbt(99e9e00,99e9e1c,159eaa4,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x12573c80 gtaskqueue_thread_loop(94c1014,12573ce8) at gtaskqueue_thread_loop+0x9c/frame 0x12573cb4 fork_exit(100b130,94c1014,12573ce8,0,0,...) at fork_exit+0x6c/frame 0x12573cd4 fork_trampoline() at 0xffc033ca/frame 0x12573cd4 --- trap 0, eip = 0, esp = 0x12573d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100017 td 0x94ca700 sched_switch(94ca700,0,104) at sched_switch+0x598/frame 0x12578bdc mi_switch(104,0) at mi_switch+0x1de/frame 0x12578c10 sleepq_switch(0,99e9d80,94ca700,12578c80,fd5432,...) at sleepq_switch+0xe1/frame 0x12578c34 sleepq_wait(99e9d80,0) at sleepq_wait+0x3a/frame 0x12578c48 msleep_spin_sbt(99e9d80,99e9d9c,159eaa4,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x12578c80 gtaskqueue_thread_loop(94c1024,12578ce8) at gtaskqueue_thread_loop+0x9c/frame 0x12578cb4 fork_exit(100b130,94c1024,12578ce8,0,0,...) at fork_exit+0x6c/frame 0x12578cd4 fork_trampoline() at 0xffc033ca/frame 0x12578cd4 --- trap 0, eip = 0, esp = 0x12578d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100018 td 0x94ca380 sched_switch(94ca380,0,104) at sched_switch+0x598/frame 0x1257dbdc mi_switch(104,0) at mi_switch+0x1de/frame 0x1257dc10 sleepq_switch(0,99e9d00,94ca380,1257dc80,fd5432,...) at sleepq_switch+0xe1/frame 0x1257dc34 sleepq_wait(99e9d00,0) at sleepq_wait+0x3a/frame 0x1257dc48 msleep_spin_sbt(99e9d00,99e9d1c,159eaa4,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x1257dc80 gtaskqueue_thread_loop(94c1034,1257dce8) at gtaskqueue_thread_loop+0x9c/frame 0x1257dcb4 fork_exit(100b130,94c1034,1257dce8,0,0,...) at fork_exit+0x6c/frame 0x1257dcd4 fork_trampoline() at 0xffc033ca/frame 0x1257dcd4 --- trap 0, eip = 0, esp = 0x1257dd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100019 td 0x94ca000 sched_switch(94ca000,0,104) at sched_switch+0x598/frame 0x12582bdc mi_switch(104,0) at mi_switch+0x1de/frame 0x12582c10 sleepq_switch(0,99e9c80,94ca000,12582c80,fd5432,...) at sleepq_switch+0xe1/frame 0x12582c34 sleepq_wait(99e9c80,0) at sleepq_wait+0x3a/frame 0x12582c48 msleep_spin_sbt(99e9c80,99e9c9c,159eaa4,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x12582c80 gtaskqueue_thread_loop(94c0404,12582ce8) at gtaskqueue_thread_loop+0x9c/frame 0x12582cb4 fork_exit(100b130,94c0404,12582ce8,0,0,...) at fork_exit+0x6c/frame 0x12582cd4 fork_trampoline() at 0xffc033ca/frame 0x12582cd4 --- trap 0, eip = 0, esp = 0x12582d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100020 td 0x94c9a80 sched_switch(94c9a80,0,104) at sched_switch+0x598/frame 0x12587bdc mi_switch(104,0) at mi_switch+0x1de/frame 0x12587c10 sleepq_switch(0,99e9c00,94c9a80,12587c80,fd5432,...) at sleepq_switch+0xe1/frame 0x12587c34 sleepq_wait(99e9c00,0) at sleepq_wait+0x3a/frame 0x12587c48 msleep_spin_sbt(99e9c00,99e9c1c,159eaa4,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x12587c80 gtaskqueue_thread_loop(94c0414,12587ce8) at gtaskqueue_thread_loop+0x9c/frame 0x12587cb4 fork_exit(100b130,94c0414,12587ce8,0,0,...) at fork_exit+0x6c/frame 0x12587cd4 fork_trampoline() at 0xffc033ca/frame 0x12587cd4 --- trap 0, eip = 0, esp = 0x12587d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100021 td 0x94c9700 sched_switch(94c9700,0,104) at sched_switch+0x598/frame 0x1258cbdc mi_switch(104,0) at mi_switch+0x1de/frame 0x1258cc10 sleepq_switch(0,99e9b80,94c9700,1258cc80,fd5432,...) at sleepq_switch+0xe1/frame 0x1258cc34 sleepq_wait(99e9b80,0) at sleepq_wait+0x3a/frame 0x1258cc48 msleep_spin_sbt(99e9b80,99e9b9c,159eaa4,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x1258cc80 gtaskqueue_thread_loop(94c0424,1258cce8) at gtaskqueue_thread_loop+0x9c/frame 0x1258ccb4 fork_exit(100b130,94c0424,1258cce8,0,0,...) at fork_exit+0x6c/frame 0x1258ccd4 fork_trampoline() at 0xffc033ca/frame 0x1258ccd4 --- trap 0, eip = 0, esp = 0x1258cd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100022 td 0x94c9380 sched_switch(94c9380,0,104) at sched_switch+0x598/frame 0x12591bdc mi_switch(104,0) at mi_switch+0x1de/frame 0x12591c10 sleepq_switch(0,99e9b00,94c9380,12591c80,fd5432,...) at sleepq_switch+0xe1/frame 0x12591c34 sleepq_wait(99e9b00,0) at sleepq_wait+0x3a/frame 0x12591c48 msleep_spin_sbt(99e9b00,99e9b1c,159eaa4,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x12591c80 gtaskqueue_thread_loop(94c0434,12591ce8) at gtaskqueue_thread_loop+0x9c/frame 0x12591cb4 fork_exit(100b130,94c0434,12591ce8,0,0,...) at fork_exit+0x6c/frame 0x12591cd4 fork_trampoline() at 0xffc033ca/frame 0x12591cd4 --- trap 0, eip = 0, esp = 0x12591d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100029 td 0x9503000 sched_switch(9503000,0,104) at sched_switch+0x598/frame 0x125d0bd4 mi_switch(104,0) at mi_switch+0x1de/frame 0x125d0c04 sleepq_switch(9503000,0,957e080,125d0c7c,fd51e7,...) at sleepq_switch+0xe1/frame 0x125d0c28 sleepq_wait(957e080,0) at sleepq_wait+0x3a/frame 0x125d0c3c _sleep(957e080,957e09c,0,159eaa4,0,0,0,0,100) at _sleep+0x307/frame 0x125d0c7c taskqueue_thread_loop(1ee010c,125d0ce8) at taskqueue_thread_loop+0xcb/frame 0x125d0cb4 fork_exit(101e800,1ee010c,125d0ce8,0,0,...) at fork_exit+0x6c/frame 0x125d0cd4 fork_trampoline() at 0xffc033ca/frame 0x125d0cd4 --- trap 0, eip = 0, esp = 0x125d0d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100034 td 0x94cba80 sched_switch(94cba80,0,104) at sched_switch+0x598/frame 0x125edbd4 mi_switch(104,0) at mi_switch+0x1de/frame 0x125edc04 sleepq_switch(94cba80,0,957de80,125edc7c,fd51e7,...) at sleepq_switch+0xe1/frame 0x125edc28 sleepq_wait(957de80,0) at sleepq_wait+0x3a/frame 0x125edc3c _sleep(957de80,957de9c,0,159eaa4,0,0,0,0,100) at _sleep+0x307/frame 0x125edc7c taskqueue_thread_loop(1f53f9c,125edce8) at taskqueue_thread_loop+0xcb/frame 0x125edcb4 fork_exit(101e800,1f53f9c,125edce8,0,0,...) at fork_exit+0x6c/frame 0x125edcd4 fork_trampoline() at 0xffc033ca/frame 0x125edcd4 --- trap 0, eip = 0, esp = 0x125edd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100035 td 0x94cb700 sched_switch(94cb700,0,104) at sched_switch+0x598/frame 0x125f2bd4 mi_switch(104,0) at mi_switch+0x1de/frame 0x125f2c04 sleepq_switch(94cb700,0,957de80,125f2c7c,fd51e7,...) at sleepq_switch+0xe1/frame 0x125f2c28 sleepq_wait(957de80,0) at sleepq_wait+0x3a/frame 0x125f2c3c _sleep(957de80,957de9c,0,159eaa4,0,0,0,0,100) at _sleep+0x307/frame 0x125f2c7c taskqueue_thread_loop(1f53f9c,125f2ce8) at taskqueue_thread_loop+0xcb/frame 0x125f2cb4 fork_exit(101e800,1f53f9c,125f2ce8,0,0,...) at fork_exit+0x6c/frame 0x125f2cd4 fork_trampoline() at 0xffc033ca/frame 0x125f2cd4 --- trap 0, eip = 0, esp = 0x125f2d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100036 td 0x17a03a80 sched_switch(17a03a80,0,104) at sched_switch+0x598/frame 0x125f7bd4 mi_switch(104,0) at mi_switch+0x1de/frame 0x125f7c04 sleepq_switch(17a03a80,0,957de80,125f7c7c,fd51e7,...) at sleepq_switch+0xe1/frame 0x125f7c28 sleepq_wait(957de80,0) at sleepq_wait+0x3a/frame 0x125f7c3c _sleep(957de80,957de9c,0,159eaa4,0,0,0,0,100) at _sleep+0x307/frame 0x125f7c7c taskqueue_thread_loop(1f53f9c,125f7ce8) at taskqueue_thread_loop+0xcb/frame 0x125f7cb4 fork_exit(101e800,1f53f9c,125f7ce8,0,0,...) at fork_exit+0x6c/frame 0x125f7cd4 fork_trampoline() at 0xffc033ca/frame 0x125f7cd4 --- trap 0, eip = 0, esp = 0x125f7d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100037 td 0x17a03700 sched_switch(17a03700,0,104) at sched_switch+0x598/frame 0x125fcbd4 mi_switch(104,0) at mi_switch+0x1de/frame 0x125fcc04 sleepq_switch(17a03700,0,957de80,125fcc7c,fd51e7,...) at sleepq_switch+0xe1/frame 0x125fcc28 sleepq_wait(957de80,0) at sleepq_wait+0x3a/frame 0x125fcc3c _sleep(957de80,957de9c,0,159eaa4,0,0,0,0,100) at _sleep+0x307/frame 0x125fcc7c taskqueue_thread_loop(1f53f9c,125fcce8) at taskqueue_thread_loop+0xcb/frame 0x125fccb4 fork_exit(101e800,1f53f9c,125fcce8,0,0,...) at fork_exit+0x6c/frame 0x125fccd4 fork_trampoline() at 0xffc033ca/frame 0x125fccd4 --- trap 0, eip = 0, esp = 0x125fcd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100085 td 0x17eb0380 sched_switch(17eb0380,0,104) at sched_switch+0x598/frame 0xb39dbdc mi_switch(104,0) at mi_switch+0x1de/frame 0xb39dc10 sleepq_switch(0,17b3df00,17eb0380,b39dc80,fd5432,...) at sleepq_switch+0xe1/frame 0xb39dc34 sleepq_wait(17b3df00,0) at sleepq_wait+0x3a/frame 0xb39dc48 msleep_spin_sbt(17b3df00,17b3df1c,159eaa4,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0xb39dc80 taskqueue_thread_loop(1f6cc08,b39dce8) at taskqueue_thread_loop+0x9c/frame 0xb39dcb4 fork_exit(101e800,1f6cc08,b39dce8,0,0,...) at fork_exit+0x6c/frame 0xb39dcd4 fork_trampoline() at 0xffc033ca/frame 0xb39dcd4 --- trap 0, eip = 0, esp = 0xb39dd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100092 td 0x184bc700 sched_switch(184bc700,0,104) at sched_switch+0x598/frame 0xb3c9bdc mi_switch(104,0) at mi_switch+0x1de/frame 0xb3c9c10 sleepq_switch(0,184e3080,184bc700,b3c9c80,fd5432,...) at sleepq_switch+0xe1/frame 0xb3c9c34 sleepq_wait(184e3080,0) at sleepq_wait+0x3a/frame 0xb3c9c48 msleep_spin_sbt(184e3080,184e309c,159eaa4,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0xb3c9c80 taskqueue_thread_loop(1f6e844,b3c9ce8) at taskqueue_thread_loop+0x9c/frame 0xb3c9cb4 fork_exit(101e800,1f6e844,b3c9ce8,0,0,...) at fork_exit+0x6c/frame 0xb3c9cd4 fork_trampoline() at 0xffc033ca/frame 0xb3c9cd4 --- trap 0, eip = 0, esp = 0xb3c9d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100093 td 0x184bc380 sched_switch(184bc380,0,104) at sched_switch+0x598/frame 0xb3cebdc mi_switch(104,0) at mi_switch+0x1de/frame 0xb3cec10 sleepq_switch(0,184e3080,184bc380,b3cec80,fd5432,...) at sleepq_switch+0xe1/frame 0xb3cec34 sleepq_wait(184e3080,0) at sleepq_wait+0x3a/frame 0xb3cec48 msleep_spin_sbt(184e3080,184e309c,159eaa4,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0xb3cec80 taskqueue_thread_loop(1f6e844,b3cece8) at taskqueue_thread_loop+0x9c/frame 0xb3cecb4 fork_exit(101e800,1f6e844,b3cece8,0,0,...) at fork_exit+0x6c/frame 0xb3cecd4 fork_trampoline() at 0xffc033ca/frame 0xb3cecd4 --- trap 0, eip = 0, esp = 0xb3ced20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100094 td 0x184bc000 sched_switch(184bc000,0,104) at sched_switch+0x598/frame 0xb3d3bdc mi_switch(104,0) at mi_switch+0x1de/frame 0xb3d3c10 sleepq_switch(0,184e3080,184bc000,b3d3c80,fd5432,...) at sleepq_switch+0xe1/frame 0xb3d3c34 sleepq_wait(184e3080,0) at sleepq_wait+0x3a/frame 0xb3d3c48 msleep_spin_sbt(184e3080,184e309c,159eaa4,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0xb3d3c80 taskqueue_thread_loop(1f6e844,b3d3ce8) at taskqueue_thread_loop+0x9c/frame 0xb3d3cb4 fork_exit(101e800,1f6e844,b3d3ce8,0,0,...) at fork_exit+0x6c/frame 0xb3d3cd4 fork_trampoline() at 0xffc033ca/frame 0xb3d3cd4 --- trap 0, eip = 0, esp = 0xb3d3d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100095 td 0x184bba80 sched_switch(184bba80,0,104) at sched_switch+0x598/frame 0xb3d8bd4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb3d8c04 sleepq_switch(184bba80,0,957de00,b3d8c7c,fd51e7,...) at sleepq_switch+0xe1/frame 0xb3d8c28 sleepq_wait(957de00,0) at sleepq_wait+0x3a/frame 0xb3d8c3c _sleep(957de00,957de1c,0,159eaa4,0,0,0,0,100) at _sleep+0x307/frame 0xb3d8c7c taskqueue_thread_loop(1c63ff4,b3d8ce8) at taskqueue_thread_loop+0xcb/frame 0xb3d8cb4 fork_exit(101e800,1c63ff4,b3d8ce8,0,0,...) at fork_exit+0x6c/frame 0xb3d8cd4 fork_trampoline() at 0xffc033ca/frame 0xb3d8cd4 --- trap 0, eip = 0, esp = 0xb3d8d20, ebp = 0 --- (null)() at 0 db:0:pho> dump Physical memory: 3426 MB Dumping 270 MB: 255 239 223 207 191 175 159 143 127 111 95 79 63 47 31 15 Dump complete db> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 3 $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/vm/vm_map.c =================================================================== --- /usr/src/sys/vm/vm_map.c (revision 349225) +++ /usr/src/sys/vm/vm_map.c (working copy) @@ -2186,8 +2186,19 @@ _vm_map_clip_start(vm_map_t map, vm_map_entry_t en VM_MAP_ASSERT_LOCKED(map); KASSERT(entry->end > start && entry->start < start, ("_vm_map_clip_start: invalid clip of entry %p", entry)); - vm_map_simplify_entry(map, entry); + if ((entry->eflags & MAP_ENTRY_NOMERGE_MASK) == 0 && + (vm_map_mergeable_neighbors(entry->prev, entry) || + vm_map_mergeable_neighbors(entry, entry->next))) { + printf("%s: simplifying entry start %jx end %jx next_read %jx " + "max_free %jx eflags %jx object-type %d\n", __func__, + (uintmax_t)entry->start, (uintmax_t)entry->end, + (uintmax_t)entry->next_read, (uintmax_t)entry->max_free, + (uintmax_t)entry->eflags, + entry->object.vm_object ? entry->object.vm_object->type : -1); + vm_map_simplify_entry(map, entry); + } + /* * Create a backing object now, if none exists, so that more individual * objects won't be created after the map entry is split. @@ -2472,9 +2483,7 @@ again: VM_MAP_RANGE_CHECK(map, start, end); - if (vm_map_lookup_entry(map, start, &entry)) { - vm_map_clip_start(map, entry, start); - } else { + if (!vm_map_lookup_entry(map, start, &entry)) { entry = entry->next; } @@ -2515,6 +2524,8 @@ again: * now will do cow due to allowed write (e.g. debugger sets * breakpoint on text segment) */ + if (entry->start < start) + vm_map_clip_start(map, entry, start); for (current = entry; current->start < end; current = current->next) { vm_map_clip_end(map, current, end); -- Test scenario: misc/fcntl2.sh