GENERIC HEAD from 2014-01-18 15:57:43 UTC, r260852, vmcore.737 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb 4718592K of memory above 4GB ignored Copyright (c) 1992-2014 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.0-CURRENT #1 r260852: Thu Jan 30 11:27:43 CET 2014 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 FreeBSD clang version 3.3 (tags/RELEASE_33/final 183502) 20130610 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.01-MHz 686-class CPU) Origin="AuthenticAMD" Id=0x100f23 Family=0x10 Model=0x2 Stepping=3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 8589934592 (8192 MB) avail memory = 2080583680 (1984 MB) : Trying to mount root from ufs:/dev/ad4s1a [rw]... Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. warning: total configured swap (4194304 pages) exceeds maximum recommended amount (4073440 pages). warning: increase kern.maxswzone or reduce amount of swap. Starting file system checks: /dev/ad4s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1a: clean, 475142 free (2398 frags, 59093 blocks, 0.2% fragmentation) /dev/ad4s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1f: clean, 601819 free (8907 frags, 74114 blocks, 0.9% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 98745820 free (17756 frags, 12341008 blocks, 0.0% fragmentation) /dev/ad4s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1d: clean, 3285133 free (202637 frags, 385312 blocks, 2.0% fragmentation) /dev/ad4s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1e: clean, 14065728 free (134496 frags, 1741404 blocks, 0.5% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN Starting Network: lo0 re0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 scopeid 0x1 nd6 options=29 media: Ethernet autoselect (none) status: no carrier Starting devd. add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 re0: link state changed to UP ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/kde4/lib /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/gcc46 /usr/local/lib/mysql /usr/local/lib/nss /usr/local/lib/pth /usr/local/lib/qt4 /usr/local/lib/virtualbox a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. savecore: couldn't find media and/or sector size of /var/crash: Inappropriate ioctl for device Jan 30 11:32:19 x4 savecore: couldn't find media and/or sector size of /var/crash: Inappropriate ioctl for device No core dumps found. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Recovering vi editor sessions:. Updating motd:. Starting ntpd. Starting powerd. Removing stale Samba tdb files: ....... done Starting nmbd. Starting smbd. Starting winbindd. Starting smartd. /etc/rc: WARNING: failed to start smartd Starting default moused. Expensive timeout(9) function: 0xc08ef3a0(0xc15b0cf8) 0.014196838 s Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Local package initialization: backup** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 165139 files, 19568161 used, 98745820 free (17756 frags, 12341008 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmp watchdogd. Starting inetd. Thu Jan 30 11:34:18 CET 2014 FreeBSD/i386 (x4.osted.lan) (console) login: Jan 30 11:39:13 x4 su: pho to root on /dev/pts/0 20140130 11:39:23 all (1/1): stealer.sh vm_thread_new: kstack allocation failed swap_pager_getswapspace(16): failed warning: total configured swap (4194304 pages) exceeds maximum recommended amount (4073440 pages). warning: increase kern.maxswzone or reduce amount of swap. 20140130 11:43:57 all (1/1): stealer.sh swap_pager_getswapspace(16): failed warning: total configured swap (4194304 pages) exceeds maximum recommended amount (4073440 pages). warning: increase kern.maxswzone or reduce amount of swap. 20140130 11:48:23 all (1/1): stealer.sh Stopping inetd. Waiting for PIDS: 826. Shutting down local packages:. Stopping cron. Waiting for PIDS: 738. Stopping sshd. Waiting for PIDS: 727. Stopping moused. Waiting for PIDS: 695. Stopping winbindd. Waiting for PIDS: 674. Stopping smbd. Waiting for PIDS: 672. Stopping nmbd. Waiting for PIDS: 670. Stopping powerd. Waiting for PIDS: 647. Stopping ntpd. Waiting for PIDS: 644. Stopping nfsd. Waiting for PIDS: 583 588. Stopping mountd. Waiting for PIDS: 577. Stopping nfsuserd. Waiting for PIDS: 566 567 568 569 570. Stopping rpcbind. Waiting for PIDS: 538. Stopping watchdogd. Waiting for PIDS: 801. Stopping devd. Waiting for PIDS: 412. Writing entropy file:. . Terminated Jan 30 11:59:15 x4 syslogd: exiting on signal 15 Jan 30 11:59:35 init: some processes would not die; ps axl advised Enter full pathname of shell or RETURN for /bin/sh: # ps auxwwl USER PID %CPU %MEM VSZ RSS TT STAT STARTED TIME COMMAND UID PPID CPU PRI NI MWCHAN root 11 400.0 0.0 0 32 - RL 11:32AM 58:39.09 [idle] 0 0 0 155 0 - root 0 0.0 0.0 0 88 - DLs 11:32AM 0:00.14 [kernel] 0 0 0 -8 0 - root 1 0.0 0.0 9204 776 - SLs 11:32AM 0:00.05 /sbin/init -- 0 0 0 20 0 wait root 2 0.0 0.0 0 16 - DL 11:32AM 0:16.15 [cam] 0 0 0 -16 0 ccb_scan root 3 0.0 0.0 0 8 - DL 11:32AM 0:00.01 [fdc0] 0 0 0 -16 0 - root 4 0.0 0.0 0 8 - DL 11:32AM 0:00.00 [sctp_iterator] 0 0 0 -16 0 waiting_ root 5 0.0 0.0 0 8 - DL 11:32AM 0:25.17 [pagedaemon] 0 0 0 -16 0 psleep root 6 0.0 0.0 0 8 - DL 11:32AM 0:00.22 [vmdaemon] 0 0 0 -16 0 psleep root 7 0.0 0.0 0 8 - DL 11:32AM 0:00.00 [pagezero] 0 0 0 155 0 pgzero root 8 0.0 0.0 0 8 - DL 11:32AM 0:00.01 [bufdaemon] 0 0 0 -16 0 psleep root 9 0.0 0.0 0 8 - DL 11:32AM 0:00.17 [syncer] 0 0 0 16 0 syncer root 10 0.0 0.0 0 8 - DL 11:32AM 0:00.00 [audit] 0 0 0 -16 0 audit_wo root 12 0.0 0.0 0 160 - WL 11:32AM 0:08.48 [intr] 0 0 0 -84 0 - root 13 0.0 0.0 0 24 - DL 11:32AM 0:04.01 [geom] 0 0 0 -8 0 - root 14 0.0 0.0 0 8 - DL 11:32AM 0:01.29 [rand_harvestq] 0 0 0 -16 0 - root 15 0.0 0.0 0 192 - DL 11:32AM 0:00.08 [usb] 0 0 0 -68 0 - root 16 0.0 0.0 0 8 - DL 11:32AM 0:00.01 [vnlru] 0 0 0 -16 0 vlruwt root 17 0.0 0.0 0 8 - DL 11:32AM 0:00.59 [softdepflush] 0 0 0 20 0 sdflush root 2030 0.0 0.0 0 8 - DL 11:48AM 0:11.06 [md5] 0 0 0 -8 0 mdwait root 2714 0.0 0.1 10348 2600 u0 Ss 11:59AM 0:00.01 -sh (sh) 0 1 0 20 0 wait root 2715 0.0 0.1 10060 1840 u0 R+ 11:59AM 0:00.00 ps auxwwl 0 2714 0 20 0 - stress 2159 0.0 0.0 0 8 0- DE 11:48AM 0:05.68 /tmp/stealer 479 1004 1 0 20 0 objtrm # kill -9 2159 # kill -9 2159 # kill -9 2159 # ~KDB: enter: Break to debugger [ thread pid 11 tid 100005 ] Stopped at kdb_break+0x4e: movl $0,kdb_why db> run pho db:0:pho> bt Tracing pid 11 tid 100005 td 0xc6efc930 kdb_break(c7179800,c0ab5a8b,eb0f3c80,8,c12ff9e7,...) at kdb_break+0x4e/frame 0xeb106ae4 uart_intr(c7179800,eb106b58,c0ab5a8b,c6efc000,0,...) at uart_intr+0x9e/frame 0xeb106b20 intr_event_handle(c6d6a600,eb106b9c,7f067fa3,eb106b9c,2,...) at intr_event_handle+0x7a/frame 0xeb106b4c intr_execute_handlers(c6f450d4,eb106b9c,2) at intr_execute_handlers+0x42/frame 0xeb106b6c lapic_handle_intr(30,eb106b9c) at lapic_handle_intr+0x6f/frame 0xeb106b8c Xapic_isr1() at Xapic_isr1+0x35/frame 0xeb106b8c --- interrupt, eip = 0xc0fb0895, esp = 0xeb106bdc, ebp = 0xeb106bdc --- acpi_cpu_c1(c0fd413b,eb0f3c90,0,c12ff9e7,303,...) at acpi_cpu_c1+0x5/frame 0xeb106bdc acpi_cpu_idle(7f067fa3,0,7f067fa3,eb106c50,c0fbac0a,...) at acpi_cpu_idle+0x149/frame 0xeb106c20 cpu_idle_acpi(7f067fa3,0,4,c142c788,c142c796,...) at cpu_idle_acpi+0x3f/frame 0xeb106c34 cpu_idle(0,2,c113b4fb,a35,c142c788,...) at cpu_idle+0x9a/frame 0xeb106c50 sched_idletd(0,eb106d08,c113267c,3c9,0,...) at sched_idletd+0x1d6/frame 0xeb106ccc fork_exit(c0af2d50,0,eb106d08) at fork_exit+0x7f/frame 0xeb106cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb106cf4 --- trap 0, eip = 0, esp = 0xeb106d40, ebp = 0 --- db:0:bt> show allpcpu Current CPU: 2 cpuid = 0 dynamic pcpu = 0x843400 curthread = 0xc6efd000: pid 11 "idle: cpu0" curpcb = 0xeb100d60 fpcurthread = none idlethread = 0xc6efd000: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x29d0e400 curthread = 0xc6efcc40: pid 11 "idle: cpu1" curpcb = 0xeb103d60 fpcurthread = none idlethread = 0xc6efcc40: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x29d11400 curthread = 0xc6efc930: pid 11 "idle: cpu2" curpcb = 0xeb106d60 fpcurthread = none idlethread = 0xc6efc930: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x29d14400 curthread = 0xc6efc620: pid 11 "idle: cpu3" curpcb = 0xeb109d60 fpcurthread = none idlethread = 0xc6efc620: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks db:0:alllocks> show lockedvnods Locked vnodes db:0:lockedvnods> show mount 0xc75522ec /dev/ad4s1a on / (ufs) 0xc75525d8 devfs on /dev (devfs) 0xc78e3000 /dev/ad4s1f on /home (ufs) 0xc7a9d8c4 /dev/ad4s1d on /usr (ufs) 0xc7a9d5d8 /dev/ad4s1e on /var (ufs) 0xc7552000 procfs on /proc (procfs) 0xc8a172ec /dev/label/tmp on /tmp (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 2714 1 2714 0 Ss+ ttyin 0xc7038470 sh 2159 1 2041 1004 DE+ objtrm 0xc95d0750 stealer 2030 0 0 0 DL mdwait 0xc9146800 [md5] 17 0 0 0 DL sdflush 0xc159c710 [softdepflush] 16 0 0 0 DL vlruwt 0xc74598c4 [vnlru] 9 0 0 0 DL syncer 0xc1598460 [syncer] 8 0 0 0 DL psleep 0xc1597f84 [bufdaemon] 7 0 0 0 DL pgzero 0xc159d320 [pagezero] 6 0 0 0 DL psleep 0xc159d044 [vmdaemon] 5 0 0 0 DL psleep 0xc15fc284 [pagedaemon] 4 0 0 0 DL waiting_ 0xc15f8cb0 [sctp_iterator] 3 0 0 0 DL - 0xc7044e3c [fdc0] 15 0 0 0 DL (threaded) [usb] 100058 D - 0xc7154d34 [usbus5] 100057 D - 0xc7154d04 [usbus5] 100056 D - 0xc7154cd4 [usbus5] 100055 D - 0xc7154ca4 [usbus5] 100053 D - 0xc7145b5c [usbus4] 100052 D - 0xc7145b2c [usbus4] 100051 D - 0xc7145afc [usbus4] 100050 D - 0xc7145acc [usbus4] 100049 D - 0xc7143b5c [usbus3] 100048 D - 0xc7143b2c [usbus3] 100047 D - 0xc7143afc [usbus3] 100046 D - 0xc7143acc [usbus3] 100045 D - 0xc713db5c [usbus2] 100044 D - 0xc713db2c [usbus2] 100043 D - 0xc713dafc [usbus2] 100042 D - 0xc713dacc [usbus2] 100040 D - 0xc7138b5c [usbus1] 100039 D - 0xc7138b2c [usbus1] 100038 D - 0xc7138afc [usbus1] 100037 D - 0xc7138acc [usbus1] 100035 D - 0xc7131b5c [usbus0] 100034 D - 0xc7131b2c [usbus0] 100033 D - 0xc7131afc [usbus0] 100032 D - 0xc7131acc [usbus0] 2 0 0 0 DL (threaded) [cam] 100068 D ccb_scan 0xc13e2aa8 [scanner] 100019 D - 0xc13e2c00 [doneq0] 14 0 0 0 DL - 0xc13fc828 [rand_harvestq] 13 0 0 0 DL (threaded) [geom] 100016 D - 0xc15f4e48 [g_down] 100015 D - 0xc15f4e44 [g_up] 100014 D - 0xc15f4e40 [g_event] 12 0 0 0 WL (threaded) [intr] 100063 I [irq12: psm0] 100062 I [irq1: atkbd0] 100060 I [swi0: uart] 100059 I [irq14: ata0] 100054 I [irq19: ehci0] 100041 I [irq18: ohci2 ohci4] 100036 I [irq17: ohci1 ohci3] 100031 I [irq16: hdac1 ohci0] 100030 I [irq22: ahci0] 100029 I [irq257: re0] 100028 I [irq256: hdac0] 100026 I [swi5: fast taskq] 100024 I [swi6: Giant taskq] 100023 I [swi6: task queue] 100012 I [swi3: vm] 100011 I [swi4: clock] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 I [swi4: clock] 100007 I [swi1: netisr 0] 11 0 0 0 RL (threaded) [idle] 100006 Run CPU 3 [idle: cpu3] 100005 Run CPU 2 [idle: cpu2] 100004 Run CPU 1 [idle: cpu1] 100003 Run CPU 0 [idle: cpu0] 1 0 1 0 SLs wait 0xc6efa2ec [init] 10 0 0 0 DL audit_wo 0xc15fab8c [audit] 0 0 0 0 DLs (threaded) [kernel] 100067 D - 0xc6d68780 [CAM taskq] 100065 D - 0xc141e5cc [deadlkres] 100064 D - 0xc714a500 [mca taskq] 100027 D - 0xc6d68280 [ffs_trim taskq] 100025 D - 0xc6d68400 [thread taskq] 100022 D - 0xc6d68680 [acpi_task_2] 100021 D - 0xc6d68680 [acpi_task_1] 100020 D - 0xc6d68680 [acpi_task_0] 100018 D - 0xc6d68800 [kqueue taskq] 100013 D - 0xc6d69880 [firmware taskq] 100000 D swapin 0xc15f4ec4 [swapper] db:0:ps> allt Tracing command sh pid 2714 tid 100240 td 0xc9600000 sched_switch(c9600000,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xc6a129a0 mi_switch(104,0,c113f10d,1f4,8,...) at mi_switch+0x1c9/frame 0xc6a129d4 sleepq_switch(c9600000,0,c113f10d,1aa,c7038414,...) at sleepq_switch+0x1c5/frame 0xc6a12a08 sleepq_catch_signals(c6a12a74,c0ab4ca9,c7038414,0,0,...) at sleepq_catch_signals+0x36c/frame 0xc6a12a50 sleepq_wait_sig(c7038470,0,c6a12aa4,101,0,...) at sleepq_wait_sig+0x14/frame 0xc6a12a74 _cv_wait_sig(c7038470,c7038404,c114473d,558,c6a12c10,...) at _cv_wait_sig+0x200/frame 0xc6a12ab8 tty_wait(c7038400,c7038470,c6a12c10,1,0,...) at tty_wait+0x4b/frame 0xc6a12adc ttydisc_read(c7038400,c6a12c10,0,a1,0,...) at ttydisc_read+0x377/frame 0xc6a12b20 ttydev_read(c6faae00,c6a12c10,0,1,0,...) at ttydev_read+0x81/frame 0xc6a12b40 devfs_read_f(c75d2038,c6a12c10,c6ecbf00,0,c9600000,...) at devfs_read_f+0x84/frame 0xc6a12b74 dofileread(c75d2038,c6a12c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xc6a12ba8 kern_readv(c9600000,0,c6a12c10,0,bfbfddab,...) at kern_readv+0x96/frame 0xc6a12bf0 sys_read(c9600000,c6a12cc8,c0fd3084,eb0f6c90,0,...) at sys_read+0x5c/frame 0xc6a12c40 syscall(c6a12d08) at syscall+0x2ed/frame 0xc6a12cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xc6a12cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281ffee7, esp = 0xbfbfdd58, ebp = 0xbfbfdd78 --- Tracing command stealer pid 2159 tid 100235 td 0xc9601000 sched_switch(c9601000,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xc69fe868 mi_switch(104,0,c113f10d,1f4,161,...) at mi_switch+0x1c9/frame 0xc69fe89c sleepq_switch(c9601000,0,c113f10d,26a,c95d0750,...) at sleepq_switch+0x1c5/frame 0xc69fe8d0 sleepq_wait(c95d0750,54,c1177e73,0,0,...) at sleepq_wait+0x48/frame 0xc69fe8f4 _sleep(c95d0750,c95d0750,54,c1177e73,0,...) at _sleep+0x385/frame 0xc69fe950 vm_object_pip_wait(c95d0750,c1177e73,c1177d55,2c1,843400,...) at vm_object_pip_wait+0xb5/frame 0xc69fe9a0 vm_object_terminate(c95d0750,c1177d55,201,c0d67fc8,c1fe2210,...) at vm_object_terminate+0x78/frame 0xc69fea18 vm_object_deallocate(c95d0750,c963150c,c1fe0000,0,c801b558,...) at vm_object_deallocate+0x8e9/frame 0xc69feadc vm_map_entry_deallocate(c801b558,0,c9601000,0,c9601000,...) at vm_map_entry_deallocate+0x36/frame 0xc69feaf8 vm_map_process_deferred(c75e640c,c1176de7,b80,bfc00000,1000,b80,c1176de7,c75e63c0) at vm_map_process_deferred+0x105/frame 0xc69feb20 _vm_map_unlock(c75e63c0,c1176de7,b80,b80,bfc00000,...) at _vm_map_unlock+0x86/frame 0xc69feb4c vm_map_remove(c75e63c0,1000,bfc00000,c95fa95c,c75e63c0,...) at vm_map_remove+0xe6/frame 0xc69feb88 vmspace_dofree(c75e63c0,1,0,1,c95fa8c4,...) at vmspace_dofree+0x36/frame 0xc69feba4 vmspace_exit(c9601000,0,c11323f8,13d,2000,...) at vmspace_exit+0x161/frame 0xc69febd0 exit1(c9601000,0,c69fecfc,c0fcc65d,c9601000,...) at exit1+0x644/frame 0xc69fec30 sys_sys_exit(c9601000,c69fecc8,0,0,c9601000,...) at sys_sys_exit+0x1d/frame 0xc69fec40 syscall(c69fed08) at syscall+0x2ed/frame 0xc69fecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xc69fecfc --- syscall (1, FreeBSD ELF32, sys_sys_exit), eip = 0x281213b3, esp = 0xbfbfd4c8, ebp = 0xbfbfd4d8 --- Tracing command md5 pid 2030 tid 100158 td 0xc89f5310 sched_switch(c89f5310,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xc68f0ba0 mi_switch(104,0,c113f10d,1f4,161,...) at mi_switch+0x1c9/frame 0xc68f0bd4 sleepq_switch(c89f5310,0,c113f10d,26a,c9146800,...) at sleepq_switch+0x1c5/frame 0xc68f0c08 sleepq_wait(c9146800,5c,c10cb21a,0,0,...) at sleepq_wait+0x48/frame 0xc68f0c2c _sleep(c9146800,c9146820,25c,c10cb21a,0,...) at _sleep+0x385/frame 0xc68f0c88 md_kthread(c9146800,c68f0d08,c113267c,3c9,0,...) at md_kthread+0x118/frame 0xc68f0ccc fork_exit(c078a4e0,c9146800,c68f0d08) at fork_exit+0x7f/frame 0xc68f0cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc68f0cf4 --- trap 0, eip = 0, esp = 0xc68f0d40, ebp = 0 --- Tracing command softdepflush pid 17 tid 100075 td 0xc7377930 sched_switch(c7377930,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xc681cba4 mi_switch(104,0,c113f10d,1f4,101,...) at mi_switch+0x1c9/frame 0xc681cbd8 sleepq_switch(c7377930,0,c113f10d,28d,c159c710,...) at sleepq_switch+0x1c5/frame 0xc681cc0c sleepq_timedwait(c159c710,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xc681cc30 _sleep(c159c710,c159c6d4,54,c117313f,fffffed8,...) at _sleep+0x350/frame 0xc681cc8c softdep_flush(0,c681cd08,c113267c,3c9,0,...) at softdep_flush+0x1e4/frame 0xc681cccc fork_exit(c0d40d90,0,c681cd08) at fork_exit+0x7f/frame 0xc681ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc681ccf4 --- trap 0, eip = 0, esp = 0xc681cd40, ebp = 0 --- Tracing command vnlru pid 16 tid 100074 td 0xc7377c40 sched_switch(c7377c40,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xc6819b78 mi_switch(104,0,c113f10d,1f4,101,...) at mi_switch+0x1c9/frame 0xc6819bac sleepq_switch(c7377c40,0,c113f10d,28d,c74598c4,...) at sleepq_switch+0x1c5/frame 0xc6819be0 sleepq_timedwait(c74598c4,60,0,0,0,...) at sleepq_timedwait+0x48/frame 0xc6819c04 _sleep(c74598c4,c1598418,260,c114bc99,fffffed8,...) at _sleep+0x350/frame 0xc6819c60 vnlru_proc(0,c6819d08,c113267c,3c9,0,...) at vnlru_proc+0xcf/frame 0xc6819ccc fork_exit(c0b7f4a0,0,c6819d08) at fork_exit+0x7f/frame 0xc6819cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc6819cf4 --- trap 0, eip = 0, esp = 0xc6819d40, ebp = 0 --- Tracing command syncer pid 9 tid 100073 td 0xc737a000 sched_switch(c737a000,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xc6816b78 mi_switch(104,0,c113f10d,1f4,8,...) at mi_switch+0x1c9/frame 0xc6816bac sleepq_switch(c737a000,0,c113f10d,28d,0,...) at sleepq_switch+0x1c5/frame 0xc6816be0 sleepq_timedwait(c1598460,0,c6816c3c,0,0,...) at sleepq_timedwait+0x48/frame 0xc6816c04 _cv_timedwait_sbt(c1598460,c1598440,fffffed8,0,0,...) at _cv_timedwait_sbt+0x228/frame 0xc6816c50 sched_sync(0,c6816d08,c113267c,3c9,0,...) at sched_sync+0x682/frame 0xc6816ccc fork_exit(c0b7ec00,0,c6816d08) at fork_exit+0x7f/frame 0xc6816cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc6816cf4 --- trap 0, eip = 0, esp = 0xc6816d40, ebp = 0 --- Tracing command bufdaemon pid 8 tid 100072 td 0xc737a310 sched_switch(c737a310,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb3fdbb0 mi_switch(104,0,c113f10d,1f4,101,...) at mi_switch+0x1c9/frame 0xeb3fdbe4 sleepq_switch(c737a310,0,c113f10d,28d,c1597f84,...) at sleepq_switch+0x1c5/frame 0xeb3fdc18 sleepq_timedwait(c1597f84,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xeb3fdc3c _sleep(c1597f84,c1597f00,54,c11485de,fffffed8,...) at _sleep+0x350/frame 0xeb3fdc98 buf_daemon(0,eb3fdd08,c113267c,3c9,0,...) at buf_daemon+0x8c/frame 0xeb3fdccc fork_exit(c0b61dd0,0,eb3fdd08) at fork_exit+0x7f/frame 0xeb3fdcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb3fdcf4 --- trap 0, eip = 0, esp = 0xeb3fdd40, ebp = 0 --- Tracing command pagezero pid 7 tid 100071 td 0xc737a620 sched_switch(c737a620,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb3fabac mi_switch(104,0,c113f10d,1f4,101,...) at mi_switch+0x1c9/frame 0xeb3fabe0 sleepq_switch(c737a620,0,c113f10d,28d,c159d320,...) at sleepq_switch+0x1c5/frame 0xeb3fac14 sleepq_timedwait(c159d320,0,12b,0,0,...) at sleepq_timedwait+0x48/frame 0xeb3fac38 _sleep(c159d320,c15fc200,0,c117a8f0,fffea520,...) at _sleep+0x350/frame 0xeb3fac94 vm_pagezero(0,eb3fad08,c113267c,3c9,0,...) at vm_pagezero+0xc2/frame 0xeb3faccc fork_exit(c0d91410,0,eb3fad08) at fork_exit+0x7f/frame 0xeb3facf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb3facf4 --- trap 0, eip = 0, esp = 0xeb3fad40, ebp = 0 --- Tracing command vmdaemon pid 6 tid 100070 td 0xc737a930 sched_switch(c737a930,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb3f7b78 mi_switch(104,0,c113f10d,1f4,161,...) at mi_switch+0x1c9/frame 0xeb3f7bac sleepq_switch(c737a930,0,c113f10d,26a,c159d044,...) at sleepq_switch+0x1c5/frame 0xeb3f7be0 sleepq_wait(c159d044,74,c11485de,0,0,...) at sleepq_wait+0x48/frame 0xeb3f7c04 _sleep(c159d044,c159d02c,74,c11485de,0,...) at _sleep+0x385/frame 0xeb3f7c60 vm_daemon(0,eb3f7d08,c113267c,3c9,0,...) at vm_daemon+0xac/frame 0xeb3f7ccc fork_exit(c0d89710,0,eb3f7d08) at fork_exit+0x7f/frame 0xeb3f7cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb3f7cf4 --- trap 0, eip = 0, esp = 0xeb3f7d40, ebp = 0 --- Tracing command pagedaemon pid 5 tid 100069 td 0xc737ac40 sched_switch(c737ac40,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb3f4b7c mi_switch(104,0,c113f10d,1f4,101,...) at mi_switch+0x1c9/frame 0xeb3f4bb0 sleepq_switch(c737ac40,0,c113f10d,28d,c15fc284,...) at sleepq_switch+0x1c5/frame 0xeb3f4be4 sleepq_timedwait(c15fc284,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xeb3f4c08 _sleep(c15fc284,c15fc200,54,c11485de,fffffed8,...) at _sleep+0x350/frame 0xeb3f4c64 vm_pageout(0,eb3f4d08,c113267c,3c9,0,...) at vm_pageout+0x242/frame 0xeb3f4ccc fork_exit(c0d89f30,0,eb3f4d08) at fork_exit+0x7f/frame 0xeb3f4cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb3f4cf4 --- trap 0, eip = 0, esp = 0xeb3f4d40, ebp = 0 --- Tracing command sctp_iterator pid 4 tid 100066 td 0xc737b620 sched_switch(c737b620,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb26bbb8 mi_switch(104,0,c113f10d,1f4,161,...) at mi_switch+0x1c9/frame 0xeb26bbec sleepq_switch(c737b620,0,c113f10d,26a,c15f8cb0,...) at sleepq_switch+0x1c5/frame 0xeb26bc20 sleepq_wait(c15f8cb0,0,c115f3e1,0,0,...) at sleepq_wait+0x48/frame 0xeb26bc44 _sleep(c15f8cb0,c15f8c78,0,c115f3e1,0,...) at _sleep+0x385/frame 0xeb26bca0 sctp_iterator_thread(0,eb26bd08,c113267c,3c9,0,...) at sctp_iterator_thread+0x7c/frame 0xeb26bccc fork_exit(c0c1e7b0,0,eb26bd08) at fork_exit+0x7f/frame 0xeb26bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb26bcf4 --- trap 0, eip = 0, esp = 0xeb26bd40, ebp = 0 --- Tracing command fdc0 pid 3 tid 100061 td 0xc714c310 sched_switch(c714c310,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb25bb48 mi_switch(104,0,c113f10d,1f4,101,...) at mi_switch+0x1c9/frame 0xeb25bb7c sleepq_switch(c714c310,0,c113f10d,28d,c7044e3c,...) at sleepq_switch+0x1c5/frame 0xeb25bbb0 sleepq_timedwait(c7044e3c,5c,0,0,0,...) at sleepq_timedwait+0x48/frame 0xeb25bbd4 _sleep(c7044e3c,c7044ef0,5c,c11247da,fffffed8,...) at _sleep+0x350/frame 0xeb25bc30 fdc_thread(c7044e00,eb25bd08,c113267c,3c9,0,...) at fdc_thread+0x8a7/frame 0xeb25bccc fork_exit(c0f45540,c7044e00,eb25bd08) at fork_exit+0x7f/frame 0xeb25bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb25bcf4 --- trap 0, eip = 0, esp = 0xeb25bd40, ebp = 0 --- Tracing command usb pid 15 tid 100058 td 0xc714cc40 sched_switch(c714cc40,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb237bd4 mi_switch(104,0,c113f10d,1f4,8,...) at mi_switch+0x1c9/frame 0xeb237c08 sleepq_switch(c714cc40,0,c113f10d,26a,c714cc40,...) at sleepq_switch+0x1c5/frame 0xeb237c3c sleepq_wait(c7154d34,0,eb237c90,1,0,...) at sleepq_wait+0x48/frame 0xeb237c60 _cv_wait(c7154d34,c7154e74,c110f527,77,c7154d3c,...) at _cv_wait+0x1f9/frame 0xeb237ca4 usb_process(c7154d2c,eb237d08,c113267c,3c9,0,...) at usb_process+0xe6/frame 0xeb237ccc fork_exit(c095c190,c7154d2c,eb237d08) at fork_exit+0x7f/frame 0xeb237cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb237cf4 --- trap 0, eip = 0, esp = 0xeb237d40, ebp = 0 --- Tracing command usb pid 15 tid 100057 td 0xc714d000 sched_switch(c714d000,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb234bd4 mi_switch(104,0,c113f10d,1f4,8,...) at mi_switch+0x1c9/frame 0xeb234c08 sleepq_switch(c714d000,0,c113f10d,26a,c714d000,...) at sleepq_switch+0x1c5/frame 0xeb234c3c sleepq_wait(c7154d04,0,eb234c90,1,0,...) at sleepq_wait+0x48/frame 0xeb234c60 _cv_wait(c7154d04,c7154e74,c110f527,77,c7154d0c,...) at _cv_wait+0x1f9/frame 0xeb234ca4 usb_process(c7154cfc,eb234d08,c113267c,3c9,0,...) at usb_process+0xe6/frame 0xeb234ccc fork_exit(c095c190,c7154cfc,eb234d08) at fork_exit+0x7f/frame 0xeb234cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb234cf4 --- trap 0, eip = 0, esp = 0xeb234d40, ebp = 0 --- Tracing command usb pid 15 tid 100056 td 0xc714d310 sched_switch(c714d310,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb231bd4 mi_switch(104,0,c113f10d,1f4,8,...) at mi_switch+0x1c9/frame 0xeb231c08 sleepq_switch(c714d310,0,c113f10d,26a,c714d310,...) at sleepq_switch+0x1c5/frame 0xeb231c3c sleepq_wait(c7154cd4,0,eb231c90,1,0,...) at sleepq_wait+0x48/frame 0xeb231c60 _cv_wait(c7154cd4,c7154e74,c110f527,77,c7154cdc,...) at _cv_wait+0x1f9/frame 0xeb231ca4 usb_process(c7154ccc,eb231d08,c113267c,3c9,0,...) at usb_process+0xe6/frame 0xeb231ccc fork_exit(c095c190,c7154ccc,eb231d08) at fork_exit+0x7f/frame 0xeb231cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb231cf4 --- trap 0, eip = 0, esp = 0xeb231d40, ebp = 0 --- Tracing command usb pid 15 tid 100055 td 0xc714d620 sched_switch(c714d620,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb22ebd4 mi_switch(104,0,c113f10d,1f4,8,...) at mi_switch+0x1c9/frame 0xeb22ec08 sleepq_switch(c714d620,0,c113f10d,26a,c714d620,...) at sleepq_switch+0x1c5/frame 0xeb22ec3c sleepq_wait(c7154ca4,0,eb22ec90,1,0,...) at sleepq_wait+0x48/frame 0xeb22ec60 _cv_wait(c7154ca4,c7154e74,c110f527,77,c7154cac,...) at _cv_wait+0x1f9/frame 0xeb22eca4 usb_process(c7154c9c,eb22ed08,c113267c,3c9,0,...) at usb_process+0xe6/frame 0xeb22eccc fork_exit(c095c190,c7154c9c,eb22ed08) at fork_exit+0x7f/frame 0xeb22ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb22ecf4 --- trap 0, eip = 0, esp = 0xeb22ed40, ebp = 0 --- Tracing command usb pid 15 tid 100053 td 0xc714dc40 sched_switch(c714dc40,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb225bd4 mi_switch(104,0,c113f10d,1f4,8,...) at mi_switch+0x1c9/frame 0xeb225c08 sleepq_switch(c714dc40,0,c113f10d,26a,c714dc40,...) at sleepq_switch+0x1c5/frame 0xeb225c3c sleepq_wait(c7145b5c,0,eb225c90,1,0,...) at sleepq_wait+0x48/frame 0xeb225c60 _cv_wait(c7145b5c,c7145c9c,c110f527,77,c7145b64,...) at _cv_wait+0x1f9/frame 0xeb225ca4 usb_process(c7145b54,eb225d08,c113267c,3c9,0,...) at usb_process+0xe6/frame 0xeb225ccc fork_exit(c095c190,c7145b54,eb225d08) at fork_exit+0x7f/frame 0xeb225cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb225cf4 --- trap 0, eip = 0, esp = 0xeb225d40, ebp = 0 --- Tracing command usb pid 15 tid 100052 td 0xc70a7c40 sched_switch(c70a7c40,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb222bd4 mi_switch(104,0,c113f10d,1f4,8,...) at mi_switch+0x1c9/frame 0xeb222c08 sleepq_switch(c70a7c40,0,c113f10d,26a,c70a7c40,...) at sleepq_switch+0x1c5/frame 0xeb222c3c sleepq_wait(c7145b2c,0,eb222c90,1,0,...) at sleepq_wait+0x48/frame 0xeb222c60 _cv_wait(c7145b2c,c7145c9c,c110f527,77,c7145b34,...) at _cv_wait+0x1f9/frame 0xeb222ca4 usb_process(c7145b24,eb222d08,c113267c,3c9,0,...) at usb_process+0xe6/frame 0xeb222ccc fork_exit(c095c190,c7145b24,eb222d08) at fork_exit+0x7f/frame 0xeb222cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb222cf4 --- trap 0, eip = 0, esp = 0xeb222d40, ebp = 0 --- Tracing command usb pid 15 tid 100051 td 0xc713a000 sched_switch(c713a000,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb21fbd4 mi_switch(104,0,c113f10d,1f4,8,...) at mi_switch+0x1c9/frame 0xeb21fc08 sleepq_switch(c713a000,0,c113f10d,26a,c713a000,...) at sleepq_switch+0x1c5/frame 0xeb21fc3c sleepq_wait(c7145afc,0,eb21fc90,1,0,...) at sleepq_wait+0x48/frame 0xeb21fc60 _cv_wait(c7145afc,c7145c9c,c110f527,77,c7145b04,...) at _cv_wait+0x1f9/frame 0xeb21fca4 usb_process(c7145af4,eb21fd08,c113267c,3c9,0,...) at usb_process+0xe6/frame 0xeb21fccc fork_exit(c095c190,c7145af4,eb21fd08) at fork_exit+0x7f/frame 0xeb21fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb21fcf4 --- trap 0, eip = 0, esp = 0xeb21fd40, ebp = 0 --- Tracing command usb pid 15 tid 100050 td 0xc713a310 sched_switch(c713a310,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb21cbd4 mi_switch(104,0,c113f10d,1f4,8,...) at mi_switch+0x1c9/frame 0xeb21cc08 sleepq_switch(c713a310,0,c113f10d,26a,c713a310,...) at sleepq_switch+0x1c5/frame 0xeb21cc3c sleepq_wait(c7145acc,0,eb21cc90,1,0,...) at sleepq_wait+0x48/frame 0xeb21cc60 _cv_wait(c7145acc,c7145c9c,c110f527,77,c7145ad4,...) at _cv_wait+0x1f9/frame 0xeb21cca4 usb_process(c7145ac4,eb21cd08,c113267c,3c9,0,...) at usb_process+0xe6/frame 0xeb21cccc fork_exit(c095c190,c7145ac4,eb21cd08) at fork_exit+0x7f/frame 0xeb21ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb21ccf4 --- trap 0, eip = 0, esp = 0xeb21cd40, ebp = 0 --- Tracing command usb pid 15 tid 100049 td 0xc713a620 sched_switch(c713a620,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb218bd4 mi_switch(104,0,c113f10d,1f4,8,...) at mi_switch+0x1c9/frame 0xeb218c08 sleepq_switch(c713a620,0,c113f10d,26a,c713a620,...) at sleepq_switch+0x1c5/frame 0xeb218c3c sleepq_wait(c7143b5c,0,eb218c90,1,0,...) at sleepq_wait+0x48/frame 0xeb218c60 _cv_wait(c7143b5c,c7143c9c,c110f527,77,c7143b64,...) at _cv_wait+0x1f9/frame 0xeb218ca4 usb_process(c7143b54,eb218d08,c113267c,3c9,0,...) at usb_process+0xe6/frame 0xeb218ccc fork_exit(c095c190,c7143b54,eb218d08) at fork_exit+0x7f/frame 0xeb218cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb218cf4 --- trap 0, eip = 0, esp = 0xeb218d40, ebp = 0 --- Tracing command usb pid 15 tid 100048 td 0xc713a930 sched_switch(c713a930,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb215bd4 mi_switch(104,0,c113f10d,1f4,8,...) at mi_switch+0x1c9/frame 0xeb215c08 sleepq_switch(c713a930,0,c113f10d,26a,c713a930,...) at sleepq_switch+0x1c5/frame 0xeb215c3c sleepq_wait(c7143b2c,0,eb215c90,1,0,...) at sleepq_wait+0x48/frame 0xeb215c60 _cv_wait(c7143b2c,c7143c9c,c110f527,77,c7143b34,...) at _cv_wait+0x1f9/frame 0xeb215ca4 usb_process(c7143b24,eb215d08,c113267c,3c9,0,...) at usb_process+0xe6/frame 0xeb215ccc fork_exit(c095c190,c7143b24,eb215d08) at fork_exit+0x7f/frame 0xeb215cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb215cf4 --- trap 0, eip = 0, esp = 0xeb215d40, ebp = 0 --- Tracing command usb pid 15 tid 100047 td 0xc713ac40 sched_switch(c713ac40,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb212bd4 mi_switch(104,0,c113f10d,1f4,8,...) at mi_switch+0x1c9/frame 0xeb212c08 sleepq_switch(c713ac40,0,c113f10d,26a,c713ac40,...) at sleepq_switch+0x1c5/frame 0xeb212c3c sleepq_wait(c7143afc,0,eb212c90,1,0,...) at sleepq_wait+0x48/frame 0xeb212c60 _cv_wait(c7143afc,c7143c9c,c110f527,77,c7143b04,...) at _cv_wait+0x1f9/frame 0xeb212ca4 usb_process(c7143af4,eb212d08,c113267c,3c9,0,...) at usb_process+0xe6/frame 0xeb212ccc fork_exit(c095c190,c7143af4,eb212d08) at fork_exit+0x7f/frame 0xeb212cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb212cf4 --- trap 0, eip = 0, esp = 0xeb212d40, ebp = 0 --- Tracing command usb pid 15 tid 100046 td 0xc713b000 sched_switch(c713b000,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb20fbd4 mi_switch(104,0,c113f10d,1f4,8,...) at mi_switch+0x1c9/frame 0xeb20fc08 sleepq_switch(c713b000,0,c113f10d,26a,c713b000,...) at sleepq_switch+0x1c5/frame 0xeb20fc3c sleepq_wait(c7143acc,0,eb20fc90,1,0,...) at sleepq_wait+0x48/frame 0xeb20fc60 _cv_wait(c7143acc,c7143c9c,c110f527,77,c7143ad4,...) at _cv_wait+0x1f9/frame 0xeb20fca4 usb_process(c7143ac4,eb20fd08,c113267c,3c9,0,...) at usb_process+0xe6/frame 0xeb20fccc fork_exit(c095c190,c7143ac4,eb20fd08) at fork_exit+0x7f/frame 0xeb20fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb20fcf4 --- trap 0, eip = 0, esp = 0xeb20fd40, ebp = 0 --- Tracing command usb pid 15 tid 100045 td 0xc713b310 sched_switch(c713b310,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb20bbd4 mi_switch(104,0,c113f10d,1f4,8,...) at mi_switch+0x1c9/frame 0xeb20bc08 sleepq_switch(c713b310,0,c113f10d,26a,c713b310,...) at sleepq_switch+0x1c5/frame 0xeb20bc3c sleepq_wait(c713db5c,0,eb20bc90,1,0,...) at sleepq_wait+0x48/frame 0xeb20bc60 _cv_wait(c713db5c,c713dc9c,c110f527,77,c713db64,...) at _cv_wait+0x1f9/frame 0xeb20bca4 usb_process(c713db54,eb20bd08,c113267c,3c9,0,...) at usb_process+0xe6/frame 0xeb20bccc fork_exit(c095c190,c713db54,eb20bd08) at fork_exit+0x7f/frame 0xeb20bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb20bcf4 --- trap 0, eip = 0, esp = 0xeb20bd40, ebp = 0 --- Tracing command usb pid 15 tid 100044 td 0xc713b620 sched_switch(c713b620,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb208bd4 mi_switch(104,0,c113f10d,1f4,8,...) at mi_switch+0x1c9/frame 0xeb208c08 sleepq_switch(c713b620,0,c113f10d,26a,c713b620,...) at sleepq_switch+0x1c5/frame 0xeb208c3c sleepq_wait(c713db2c,0,eb208c90,1,0,...) at sleepq_wait+0x48/frame 0xeb208c60 _cv_wait(c713db2c,c713dc9c,c110f527,77,c713db34,...) at _cv_wait+0x1f9/frame 0xeb208ca4 usb_process(c713db24,eb208d08,c113267c,3c9,0,...) at usb_process+0xe6/frame 0xeb208ccc fork_exit(c095c190,c713db24,eb208d08) at fork_exit+0x7f/frame 0xeb208cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb208cf4 --- trap 0, eip = 0, esp = 0xeb208d40, ebp = 0 --- Tracing command usb pid 15 tid 100043 td 0xc713b930 sched_switch(c713b930,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb205bd4 mi_switch(104,0,c113f10d,1f4,8,...) at mi_switch+0x1c9/frame 0xeb205c08 sleepq_switch(c713b930,0,c113f10d,26a,c713b930,...) at sleepq_switch+0x1c5/frame 0xeb205c3c sleepq_wait(c713dafc,0,eb205c90,1,0,...) at sleepq_wait+0x48/frame 0xeb205c60 _cv_wait(c713dafc,c713dc9c,c110f527,77,c713db04,...) at _cv_wait+0x1f9/frame 0xeb205ca4 usb_process(c713daf4,eb205d08,c113267c,3c9,0,...) at usb_process+0xe6/frame 0xeb205ccc fork_exit(c095c190,c713daf4,eb205d08) at fork_exit+0x7f/frame 0xeb205cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb205cf4 --- trap 0, eip = 0, esp = 0xeb205d40, ebp = 0 --- Tracing command usb pid 15 tid 100042 td 0xc713bc40 sched_switch(c713bc40,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb202bd4 mi_switch(104,0,c113f10d,1f4,8,...) at mi_switch+0x1c9/frame 0xeb202c08 sleepq_switch(c713bc40,0,c113f10d,26a,c713bc40,...) at sleepq_switch+0x1c5/frame 0xeb202c3c sleepq_wait(c713dacc,0,eb202c90,1,0,...) at sleepq_wait+0x48/frame 0xeb202c60 _cv_wait(c713dacc,c713dc9c,c110f527,77,c713dad4,...) at _cv_wait+0x1f9/frame 0xeb202ca4 usb_process(c713dac4,eb202d08,c113267c,3c9,0,...) at usb_process+0xe6/frame 0xeb202ccc fork_exit(c095c190,c713dac4,eb202d08) at fork_exit+0x7f/frame 0xeb202cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb202cf4 --- trap 0, eip = 0, esp = 0xeb202d40, ebp = 0 --- Tracing command usb pid 15 tid 100040 td 0xc713c310 sched_switch(c713c310,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb1fbbd4 mi_switch(104,0,c113f10d,1f4,8,...) at mi_switch+0x1c9/frame 0xeb1fbc08 sleepq_switch(c713c310,0,c113f10d,26a,c713c310,...) at sleepq_switch+0x1c5/frame 0xeb1fbc3c sleepq_wait(c7138b5c,0,eb1fbc90,1,0,...) at sleepq_wait+0x48/frame 0xeb1fbc60 _cv_wait(c7138b5c,c7138c9c,c110f527,77,c7138b64,...) at _cv_wait+0x1f9/frame 0xeb1fbca4 usb_process(c7138b54,eb1fbd08,c113267c,3c9,0,...) at usb_process+0xe6/frame 0xeb1fbccc fork_exit(c095c190,c7138b54,eb1fbd08) at fork_exit+0x7f/frame 0xeb1fbcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb1fbcf4 --- trap 0, eip = 0, esp = 0xeb1fbd40, ebp = 0 --- Tracing command usb pid 15 tid 100039 td 0xc6faf310 sched_switch(c6faf310,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb1f8bd4 mi_switch(104,0,c113f10d,1f4,8,...) at mi_switch+0x1c9/frame 0xeb1f8c08 sleepq_switch(c6faf310,0,c113f10d,26a,c6faf310,...) at sleepq_switch+0x1c5/frame 0xeb1f8c3c sleepq_wait(c7138b2c,0,eb1f8c90,1,0,...) at sleepq_wait+0x48/frame 0xeb1f8c60 _cv_wait(c7138b2c,c7138c9c,c110f527,77,c7138b34,...) at _cv_wait+0x1f9/frame 0xeb1f8ca4 usb_process(c7138b24,eb1f8d08,c113267c,3c9,0,...) at usb_process+0xe6/frame 0xeb1f8ccc fork_exit(c095c190,c7138b24,eb1f8d08) at fork_exit+0x7f/frame 0xeb1f8cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb1f8cf4 --- trap 0, eip = 0, esp = 0xeb1f8d40, ebp = 0 --- Tracing command usb pid 15 tid 100038 td 0xc6faf620 sched_switch(c6faf620,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb1f5bd4 mi_switch(104,0,c113f10d,1f4,8,...) at mi_switch+0x1c9/frame 0xeb1f5c08 sleepq_switch(c6faf620,0,c113f10d,26a,c6faf620,...) at sleepq_switch+0x1c5/frame 0xeb1f5c3c sleepq_wait(c7138afc,0,eb1f5c90,1,0,...) at sleepq_wait+0x48/frame 0xeb1f5c60 _cv_wait(c7138afc,c7138c9c,c110f527,77,c7138b04,...) at _cv_wait+0x1f9/frame 0xeb1f5ca4 usb_process(c7138af4,eb1f5d08,c113267c,3c9,0,...) at usb_process+0xe6/frame 0xeb1f5ccc fork_exit(c095c190,c7138af4,eb1f5d08) at fork_exit+0x7f/frame 0xeb1f5cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb1f5cf4 --- trap 0, eip = 0, esp = 0xeb1f5d40, ebp = 0 --- Tracing command usb pid 15 tid 100037 td 0xc6faf930 sched_switch(c6faf930,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb1f2bd4 mi_switch(104,0,c113f10d,1f4,8,...) at mi_switch+0x1c9/frame 0xeb1f2c08 sleepq_switch(c6faf930,0,c113f10d,26a,c6faf930,...) at sleepq_switch+0x1c5/frame 0xeb1f2c3c sleepq_wait(c7138acc,0,eb1f2c90,1,0,...) at sleepq_wait+0x48/frame 0xeb1f2c60 _cv_wait(c7138acc,c7138c9c,c110f527,77,c7138ad4,...) at _cv_wait+0x1f9/frame 0xeb1f2ca4 usb_process(c7138ac4,eb1f2d08,c113267c,3c9,0,...) at usb_process+0xe6/frame 0xeb1f2ccc fork_exit(c095c190,c7138ac4,eb1f2d08) at fork_exit+0x7f/frame 0xeb1f2cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb1f2cf4 --- trap 0, eip = 0, esp = 0xeb1f2d40, ebp = 0 --- Tracing command usb pid 15 tid 100035 td 0xc70a6000 sched_switch(c70a6000,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb1ebbd4 mi_switch(104,0,c113f10d,1f4,8,...) at mi_switch+0x1c9/frame 0xeb1ebc08 sleepq_switch(c70a6000,0,c113f10d,26a,c70a6000,...) at sleepq_switch+0x1c5/frame 0xeb1ebc3c sleepq_wait(c7131b5c,0,eb1ebc90,1,0,...) at sleepq_wait+0x48/frame 0xeb1ebc60 _cv_wait(c7131b5c,c7131c9c,c110f527,77,c7131b64,...) at _cv_wait+0x1f9/frame 0xeb1ebca4 usb_process(c7131b54,eb1ebd08,c113267c,3c9,0,...) at usb_process+0xe6/frame 0xeb1ebccc fork_exit(c095c190,c7131b54,eb1ebd08) at fork_exit+0x7f/frame 0xeb1ebcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb1ebcf4 --- trap 0, eip = 0, esp = 0xeb1ebd40, ebp = 0 --- Tracing command usb pid 15 tid 100034 td 0xc70a6310 sched_switch(c70a6310,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb1e8bd4 mi_switch(104,0,c113f10d,1f4,8,...) at mi_switch+0x1c9/frame 0xeb1e8c08 sleepq_switch(c70a6310,0,c113f10d,26a,c70a6310,...) at sleepq_switch+0x1c5/frame 0xeb1e8c3c sleepq_wait(c7131b2c,0,eb1e8c90,1,0,...) at sleepq_wait+0x48/frame 0xeb1e8c60 _cv_wait(c7131b2c,c7131c9c,c110f527,77,c7131b34,...) at _cv_wait+0x1f9/frame 0xeb1e8ca4 usb_process(c7131b24,eb1e8d08,c113267c,3c9,0,...) at usb_process+0xe6/frame 0xeb1e8ccc fork_exit(c095c190,c7131b24,eb1e8d08) at fork_exit+0x7f/frame 0xeb1e8cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb1e8cf4 --- trap 0, eip = 0, esp = 0xeb1e8d40, ebp = 0 --- Tracing command usb pid 15 tid 100033 td 0xc70a6620 sched_switch(c70a6620,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb1e5bd4 mi_switch(104,0,c113f10d,1f4,8,...) at mi_switch+0x1c9/frame 0xeb1e5c08 sleepq_switch(c70a6620,0,c113f10d,26a,c70a6620,...) at sleepq_switch+0x1c5/frame 0xeb1e5c3c sleepq_wait(c7131afc,0,eb1e5c90,1,0,...) at sleepq_wait+0x48/frame 0xeb1e5c60 _cv_wait(c7131afc,c7131c9c,c110f527,77,c7131b04,...) at _cv_wait+0x1f9/frame 0xeb1e5ca4 usb_process(c7131af4,eb1e5d08,c113267c,3c9,0,...) at usb_process+0xe6/frame 0xeb1e5ccc fork_exit(c095c190,c7131af4,eb1e5d08) at fork_exit+0x7f/frame 0xeb1e5cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb1e5cf4 --- trap 0, eip = 0, esp = 0xeb1e5d40, ebp = 0 --- Tracing command usb pid 15 tid 100032 td 0xc70a6930 sched_switch(c70a6930,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb1e2bd4 mi_switch(104,0,c113f10d,1f4,8,...) at mi_switch+0x1c9/frame 0xeb1e2c08 sleepq_switch(c70a6930,0,c113f10d,26a,c70a6930,...) at sleepq_switch+0x1c5/frame 0xeb1e2c3c sleepq_wait(c7131acc,0,eb1e2c90,1,0,...) at sleepq_wait+0x48/frame 0xeb1e2c60 _cv_wait(c7131acc,c7131c9c,c110f527,77,c7131ad4,...) at _cv_wait+0x1f9/frame 0xeb1e2ca4 usb_process(c7131ac4,eb1e2d08,c113267c,3c9,0,...) at usb_process+0xe6/frame 0xeb1e2ccc fork_exit(c095c190,c7131ac4,eb1e2d08) at fork_exit+0x7f/frame 0xeb1e2cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb1e2cf4 --- trap 0, eip = 0, esp = 0xeb1e2d40, ebp = 0 --- Tracing command cam pid 2 tid 100068 td 0xc737b000 sched_switch(c737b000,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb271b90 mi_switch(104,0,c113f10d,1f4,161,...) at mi_switch+0x1c9/frame 0xeb271bc4 sleepq_switch(c737b000,0,c113f10d,26a,c13e2aa8,...) at sleepq_switch+0x1c5/frame 0xeb271bf8 sleepq_wait(c13e2aa8,5c,c0ffabda,0,0,...) at sleepq_wait+0x48/frame 0xeb271c1c _sleep(c13e2aa8,c13e2af8,5c,c0ffabda,0,...) at _sleep+0x385/frame 0xeb271c78 xpt_scanner_thread(0,eb271d08,c113267c,3c9,0,...) at xpt_scanner_thread+0xac/frame 0xeb271ccc fork_exit(c04bf5d0,0,eb271d08) at fork_exit+0x7f/frame 0xeb271cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb271cf4 --- trap 0, eip = 0, esp = 0xeb271d40, ebp = 0 --- Tracing command cam pid 2 tid 100019 td 0xc6fae000 sched_switch(c6fae000,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xee628b98 mi_switch(104,0,c113f10d,1f4,161,...) at mi_switch+0x1c9/frame 0xee628bcc sleepq_switch(c6fae000,0,c113f10d,26a,c13e2c00,...) at sleepq_switch+0x1c5/frame 0xee628c00 sleepq_wait(c13e2c00,5c,c11247da,0,0,...) at sleepq_wait+0x48/frame 0xee628c24 _sleep(c13e2c00,c13e2b80,5c,c11247da,0,...) at _sleep+0x385/frame 0xee628c80 xpt_done_td(c13e2b80,ee628d08,c113267c,3c9,0,...) at xpt_done_td+0xd2/frame 0xee628ccc fork_exit(c04bf1f0,c13e2b80,ee628d08) at fork_exit+0x7f/frame 0xee628cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee628cf4 --- trap 0, eip = 0, esp = 0xee628d40, ebp = 0 --- Tracing command rand_harvestq pid 14 tid 100017 td 0xc6fae620 sched_switch(c6fae620,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xee621bb4 mi_switch(104,0,c113f10d,1f4,c143ba78,...) at mi_switch+0x1c9/frame 0xee621be8 sleepq_switch(c6fae620,0,c113f10d,28d,c13fc828,...) at sleepq_switch+0x1c5/frame 0xee621c1c sleepq_timedwait(c13fc828,0,c1139b2a,c11247da,0,...) at sleepq_timedwait+0x48/frame 0xee621c40 msleep_spin_sbt(c13fc828,c15e9efc,c11247da,19999999,0,...) at msleep_spin_sbt+0x225/frame 0xee621c88 random_kthread(c084a3f0,ee621d08,c113267c,3c9,0,...) at random_kthread+0x213/frame 0xee621ccc fork_exit(c08494d0,c084a3f0,ee621d08) at fork_exit+0x7f/frame 0xee621cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee621cf4 --- trap 0, eip = 0, esp = 0xee621d40, ebp = 0 --- Tracing command geom pid 13 tid 100016 td 0xc6fae930 sched_switch(c6fae930,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xee61eb94 mi_switch(104,0,c113f10d,1f4,161,...) at mi_switch+0x1c9/frame 0xee61ebc8 sleepq_switch(c6fae930,0,c113f10d,26a,c15f4e48,...) at sleepq_switch+0x1c5/frame 0xee61ebfc sleepq_wait(c15f4e48,5c,c11247da,0,0,...) at sleepq_wait+0x48/frame 0xee61ec20 _sleep(c15f4e48,c141c920,25c,c11247da,0,...) at _sleep+0x385/frame 0xee61ec7c g_io_schedule_down(c6fae930,0,c112651e,6d,ee61ecf4,...) at g_io_schedule_down+0x5c/frame 0xee61ecb4 g_down_procbody(0,ee61ed08,c113267c,3c9,0,...) at g_down_procbody+0x9d/frame 0xee61eccc fork_exit(c0a27550,0,ee61ed08) at fork_exit+0x7f/frame 0xee61ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee61ecf4 --- trap 0, eip = 0, esp = 0xee61ed40, ebp = 0 --- Tracing command geom pid 13 tid 100015 td 0xc6faec40 sched_switch(c6faec40,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xee61bb98 mi_switch(104,0,c113f10d,1f4,161,...) at mi_switch+0x1c9/frame 0xee61bbcc sleepq_switch(c6faec40,0,c113f10d,26a,c15f4e44,...) at sleepq_switch+0x1c5/frame 0xee61bc00 sleepq_wait(c15f4e44,5c,c11247da,0,0,...) at sleepq_wait+0x48/frame 0xee61bc24 _sleep(c15f4e44,c141c940,25c,c11247da,0,...) at _sleep+0x385/frame 0xee61bc80 g_io_schedule_up(c6faec40,0,c112651e,60,ee61bcf4,...) at g_io_schedule_up+0xe6/frame 0xee61bcb4 g_up_procbody(0,ee61bd08,c113267c,3c9,0,...) at g_up_procbody+0x9d/frame 0xee61bccc fork_exit(c0a274b0,0,ee61bd08) at fork_exit+0x7f/frame 0xee61bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee61bcf4 --- trap 0, eip = 0, esp = 0xee61bd40, ebp = 0 --- Tracing command geom pid 13 tid 100014 td 0xc6faf000 sched_switch(c6faf000,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xee618ba8 mi_switch(104,0,c113f10d,1f4,161,...) at mi_switch+0x1c9/frame 0xee618bdc sleepq_switch(c6faf000,0,c113f10d,26a,c15f4e40,...) at sleepq_switch+0x1c5/frame 0xee618c10 sleepq_wait(c15f4e40,5c,c11247da,0,0,...) at sleepq_wait+0x48/frame 0xee618c34 _sleep(c15f4e40,c141c8f8,25c,c11247da,0,...) at _sleep+0x385/frame 0xee618c90 g_run_events(0,ee618d08,c113267c,3c9,0,...) at g_run_events+0x586/frame 0xee618ccc fork_exit(c0a27410,0,ee618d08) at fork_exit+0x7f/frame 0xee618cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee618cf4 --- trap 0, eip = 0, esp = 0xee618d40, ebp = 0 --- Tracing command intr pid 12 tid 100063 td 0xc713cc40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100062 td 0xc714c000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100060 td 0xc714c620 sched_switch(c714c620,0,109,1bb,0,...) at sched_switch+0x4b9/frame 0xeb24ec60 mi_switch(109,0,c11328ed,55a,8,...) at mi_switch+0x1c9/frame 0xeb24ec94 ithread_loop(c70fbbb0,eb24ed08,c113267c,3c9,0,...) at ithread_loop+0x201/frame 0xeb24eccc fork_exit(c0a9a840,c70fbbb0,eb24ed08) at fork_exit+0x7f/frame 0xeb24ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb24ecf4 --- trap 0, eip = 0, esp = 0xeb24ed40, ebp = 0 --- Tracing command intr pid 12 tid 100059 td 0xc714c930 sched_switch(c714c930,0,109,1bb,c1605bb4,...) at sched_switch+0x4b9/frame 0xeb23dc60 mi_switch(109,0,c11328ed,55a,8,...) at mi_switch+0x1c9/frame 0xeb23dc94 ithread_loop(c70fbf40,eb23dd08,c113267c,3c9,0,...) at ithread_loop+0x201/frame 0xeb23dccc fork_exit(c0a9a840,c70fbf40,eb23dd08) at fork_exit+0x7f/frame 0xeb23dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb23dcf4 --- trap 0, eip = 0, esp = 0xeb23dd40, ebp = 0 --- Tracing command intr pid 12 tid 100054 td 0xc714d930 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xc713c000 sched_switch(c713c000,0,109,1bb,c1605bb4,...) at sched_switch+0x4b9/frame 0xeb1ffc60 mi_switch(109,0,c11328ed,55a,8,...) at mi_switch+0x1c9/frame 0xeb1ffc94 ithread_loop(c70fb1c0,eb1ffd08,c113267c,3c9,0,...) at ithread_loop+0x201/frame 0xeb1ffccc fork_exit(c0a9a840,c70fb1c0,eb1ffd08) at fork_exit+0x7f/frame 0xeb1ffcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb1ffcf4 --- trap 0, eip = 0, esp = 0xeb1ffd40, ebp = 0 --- Tracing command intr pid 12 tid 100036 td 0xc6fafc40 sched_switch(c6fafc40,0,109,1bb,c1605bb4,...) at sched_switch+0x4b9/frame 0xeb1efc60 mi_switch(109,0,c11328ed,55a,8,...) at mi_switch+0x1c9/frame 0xeb1efc94 ithread_loop(c70fb240,eb1efd08,c113267c,3c9,0,...) at ithread_loop+0x201/frame 0xeb1efccc fork_exit(c0a9a840,c70fb240,eb1efd08) at fork_exit+0x7f/frame 0xeb1efcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb1efcf4 --- trap 0, eip = 0, esp = 0xeb1efd40, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xc70a6c40 sched_switch(c70a6c40,0,109,1bb,c1605bb4,...) at sched_switch+0x4b9/frame 0xeb1dfc60 mi_switch(109,0,c11328ed,55a,8,...) at mi_switch+0x1c9/frame 0xeb1dfc94 ithread_loop(c70fb2c0,eb1dfd08,c113267c,3c9,0,...) at ithread_loop+0x201/frame 0xeb1dfccc fork_exit(c0a9a840,c70fb2c0,eb1dfd08) at fork_exit+0x7f/frame 0xeb1dfcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb1dfcf4 --- trap 0, eip = 0, esp = 0xeb1dfd40, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc70a7000 sched_switch(c70a7000,0,109,1bb,c1605bb4,...) at sched_switch+0x4b9/frame 0xee77fc60 mi_switch(109,0,c11328ed,55a,8,...) at mi_switch+0x1c9/frame 0xee77fc94 ithread_loop(c70fb480,ee77fd08,c113267c,3c9,0,...) at ithread_loop+0x201/frame 0xee77fccc fork_exit(c0a9a840,c70fb480,ee77fd08) at fork_exit+0x7f/frame 0xee77fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee77fcf4 --- trap 0, eip = 0, esp = 0xee77fd40, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc70a7310 sched_switch(c70a7310,0,109,1bb,c11328ed,...) at sched_switch+0x4b9/frame 0xee77bc60 mi_switch(109,0,c11328ed,55a,8,...) at mi_switch+0x1c9/frame 0xee77bc94 ithread_loop(c70fb4d0,ee77bd08,c113267c,3c9,0,...) at ithread_loop+0x201/frame 0xee77bccc fork_exit(c0a9a840,c70fb4d0,ee77bd08) at fork_exit+0x7f/frame 0xee77bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee77bcf4 --- trap 0, eip = 0, esp = 0xee77bd40, ebp = 0 --- Tracing command intr pid 12 tid 100028 td 0xc70a7620 sched_switch(c70a7620,0,109,1bb,c11328ed,...) at sched_switch+0x4b9/frame 0xee672c60 mi_switch(109,0,c11328ed,55a,8,...) at mi_switch+0x1c9/frame 0xee672c94 ithread_loop(c6d62850,ee672d08,c113267c,3c9,0,...) at ithread_loop+0x201/frame 0xee672ccc fork_exit(c0a9a840,c6d62850,ee672d08) at fork_exit+0x7f/frame 0xee672cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee672cf4 --- trap 0, eip = 0, esp = 0xee672d40, ebp = 0 --- Tracing command intr pid 12 tid 100026 td 0xc6efd930 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100024 td 0xc6fad000 sched_switch(c6fad000,0,109,1bb,0,...) at sched_switch+0x4b9/frame 0xee637c60 mi_switch(109,0,c11328ed,55a,8,...) at mi_switch+0x1c9/frame 0xee637c94 ithread_loop(c6d625b0,ee637d08,c113267c,3c9,0,...) at ithread_loop+0x201/frame 0xee637ccc fork_exit(c0a9a840,c6d625b0,ee637d08) at fork_exit+0x7f/frame 0xee637cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee637cf4 --- trap 0, eip = 0, esp = 0xee637d40, ebp = 0 --- Tracing command intr pid 12 tid 100023 td 0xc6fad310 sched_switch(c6fad310,0,109,1bb,c11328ed,...) at sched_switch+0x4b9/frame 0xee634c60 mi_switch(109,0,c11328ed,55a,8,...) at mi_switch+0x1c9/frame 0xee634c94 ithread_loop(c6d625c0,ee634d08,c113267c,3c9,0,...) at ithread_loop+0x201/frame 0xee634ccc fork_exit(c0a9a840,c6d625c0,ee634d08) at fork_exit+0x7f/frame 0xee634cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee634cf4 --- trap 0, eip = 0, esp = 0xee634d40, ebp = 0 --- Tracing command intr pid 12 tid 100012 td 0xc6efb310 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100011 td 0xc6efb620 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100010 td 0xc6efb930 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100009 td 0xc6efbc40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100008 td 0xc6efc000 sched_switch(c6efc000,0,109,1bb,c11328ed,...) at sched_switch+0x4b9/frame 0xee606c60 mi_switch(109,0,c11328ed,55a,8,...) at mi_switch+0x1c9/frame 0xee606c94 ithread_loop(c6d62730,ee606d08,c113267c,3c9,0,...) at ithread_loop+0x201/frame 0xee606ccc fork_exit(c0a9a840,c6d62730,ee606d08) at fork_exit+0x7f/frame 0xee606cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee606cf4 --- trap 0, eip = 0, esp = 0xee606d40, ebp = 0 --- Tracing command intr pid 12 tid 100007 td 0xc6efc310 sched_switch(c6efc310,0,109,1bb,c11328ed,...) at sched_switch+0x4b9/frame 0xee603c60 mi_switch(109,0,c11328ed,55a,8,...) at mi_switch+0x1c9/frame 0xee603c94 ithread_loop(c6d62740,ee603d08,c113267c,3c9,0,...) at ithread_loop+0x201/frame 0xee603ccc fork_exit(c0a9a840,c6d62740,ee603d08) at fork_exit+0x7f/frame 0xee603cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee603cf4 --- trap 0, eip = 0, esp = 0xee603d40, ebp = 0 --- Tracing command idle pid 11 tid 100006 td 0xc6efc620 cpustop_handler(3,13,eb109b90,c0fcb20e,c6fae620,...) at cpustop_handler+0x2f/frame 0xeb109a38 ipi_nmi_handler(c6fae620,4,c1139b82,c142c010,c142c000,...) at ipi_nmi_handler+0x37/frame 0xeb109a48 trap(eb109b9c) at trap+0x3e/frame 0xeb109b90 calltrap() at calltrap+0x6/frame 0xeb109b90 --- trap 0x13, eip = 0xc0fb0895, esp = 0xeb109bdc, ebp = 0xeb109bdc --- acpi_cpu_c1(c0fd413b,eb0f6c90,0,c12ff9e7,303,...) at acpi_cpu_c1+0x5/frame 0xeb109bdc acpi_cpu_idle(7f0a062d,0,7f0a062d,eb109c50,c0fbac0a,...) at acpi_cpu_idle+0x149/frame 0xeb109c20 cpu_idle_acpi(7f0a062d,0,3,c142ce88,c142ce96,...) at cpu_idle_acpi+0x3f/frame 0xeb109c34 cpu_idle(0,2,c113b4fb,a35,c142ce88,...) at cpu_idle+0x9a/frame 0xeb109c50 sched_idletd(0,eb109d08,c113267c,3c9,0,...) at sched_idletd+0x1d6/frame 0xeb109ccc fork_exit(c0af2d50,0,eb109d08) at fork_exit+0x7f/frame 0xeb109cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb109cf4 --- trap 0, eip = 0, esp = 0xeb109d40, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc6efc930 kdb_break(c7179800,c0ab5a8b,eb0f3c80,8,c12ff9e7,...) at kdb_break+0x4e/frame 0xeb106ae4 uart_intr(c7179800,eb106b58,c0ab5a8b,c6efc000,0,...) at uart_intr+0x9e/frame 0xeb106b20 intr_event_handle(c6d6a600,eb106b9c,7f067fa3,eb106b9c,2,...) at intr_event_handle+0x7a/frame 0xeb106b4c intr_execute_handlers(c6f450d4,eb106b9c,2) at intr_execute_handlers+0x42/frame 0xeb106b6c lapic_handle_intr(30,eb106b9c) at lapic_handle_intr+0x6f/frame 0xeb106b8c Xapic_isr1() at Xapic_isr1+0x35/frame 0xeb106b8c --- interrupt, eip = 0xc0fb0895, esp = 0xeb106bdc, ebp = 0xeb106bdc --- acpi_cpu_c1(c0fd413b,eb0f3c90,0,c12ff9e7,303,...) at acpi_cpu_c1+0x5/frame 0xeb106bdc acpi_cpu_idle(7f067fa3,0,7f067fa3,eb106c50,c0fbac0a,...) at acpi_cpu_idle+0x149/frame 0xeb106c20 cpu_idle_acpi(7f067fa3,0,4,c142c788,c142c796,...) at cpu_idle_acpi+0x3f/frame 0xeb106c34 cpu_idle(0,2,c113b4fb,a35,c142c788,...) at cpu_idle+0x9a/frame 0xeb106c50 sched_idletd(0,eb106d08,c113267c,3c9,0,...) at sched_idletd+0x1d6/frame 0xeb106ccc fork_exit(c0af2d50,0,eb106d08) at fork_exit+0x7f/frame 0xeb106cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb106cf4 --- trap 0, eip = 0, esp = 0xeb106d40, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc6efcc40 cpustop_handler(1,13,eb103b90,c0fcb20e,a,...) at cpustop_handler+0x2f/frame 0xeb103a38 ipi_nmi_handler(a,1,1ffefa,0,0,...) at ipi_nmi_handler+0x37/frame 0xeb103a48 trap(eb103b9c) at trap+0x3e/frame 0xeb103b90 calltrap() at calltrap+0x6/frame 0xeb103b90 --- trap 0x13, eip = 0xc0fb0895, esp = 0xeb103bdc, ebp = 0xeb103bdc --- acpi_cpu_c1(c0fd413b,eb0f0c90,0,c12ff9e7,303,...) at acpi_cpu_c1+0x5/frame 0xeb103bdc acpi_cpu_idle(7f09ea0e,0,7f09ea0e,eb103c50,c0fbac0a,...) at acpi_cpu_idle+0x149/frame 0xeb103c20 cpu_idle_acpi(7f09ea0e,0,2,c142c088,c142c096,...) at cpu_idle_acpi+0x3f/frame 0xeb103c34 cpu_idle(0,2,c113b4fb,3f8,c142c088,...) at cpu_idle+0x9a/frame 0xeb103c50 sched_idletd(0,eb103d08,c113267c,3c9,0,...) at sched_idletd+0x1d6/frame 0xeb103ccc fork_exit(c0af2d50,0,eb103d08) at fork_exit+0x7f/frame 0xeb103cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb103cf4 --- trap 0, eip = 0, esp = 0xeb103d40, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xc6efd000 cpustop_handler(0,13,eb100b90,c0fcb20e,c6efd000,...) at cpustop_handler+0x2f/frame 0xeb100a38 ipi_nmi_handler(c6efd000,0,416382,0,0,...) at ipi_nmi_handler+0x37/frame 0xeb100a48 trap(eb100b9c) at trap+0x3e/frame 0xeb100b90 calltrap() at calltrap+0x6/frame 0xeb100b90 --- trap 0x13, eip = 0xc0fb0895, esp = 0xeb100bdc, ebp = 0xeb100bdc --- acpi_cpu_c1(c0fd413b,c1c25c90,0,c12ff9e7,303,...) at acpi_cpu_c1+0x5/frame 0xeb100bdc acpi_cpu_idle(6f7d2a8,0,6f7d2a8,eb100c50,c0fbac0a,...) at acpi_cpu_idle+0x149/frame 0xeb100c20 cpu_idle_acpi(6f7d2a8,0,2,c142b988,c142b996,...) at cpu_idle_acpi+0x3f/frame 0xeb100c34 cpu_idle(0,2,c113b4fb,a35,c142b988,...) at cpu_idle+0x9a/frame 0xeb100c50 sched_idletd(0,eb100d08,c113267c,3c9,0,...) at sched_idletd+0x1d6/frame 0xeb100ccc fork_exit(c0af2d50,0,eb100d08) at fork_exit+0x7f/frame 0xeb100cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb100cf4 --- trap 0, eip = 0, esp = 0xeb100d40, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc6efd310 sched_switch(c6efd310,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb0fc98c mi_switch(104,0,c113f10d,1f4,c113f10d,...) at mi_switch+0x1c9/frame 0xeb0fc9c0 sleepq_switch(c6efd310,0,c113f10d,1aa,eb0fca38,...) at sleepq_switch+0x1c5/frame 0xeb0fc9f4 sleepq_catch_signals(0,c113f10d,161,750,c6efa2ec,...) at sleepq_catch_signals+0x36c/frame 0xeb0fca3c sleepq_wait_sig(c6efa2ec,6c,c1142e31,100,0,...) at sleepq_wait_sig+0x14/frame 0xeb0fca60 _sleep(c6efa2ec,c6efa384,16c,c1142e31,0,...) at _sleep+0x364/frame 0xeb0fcabc kern_wait6(c6efd310,7,0,0,eb0fcb4c,...) at kern_wait6+0x45c/frame 0xeb0fcb20 sys_wait4(c6efd310,eb0fccc8,c0fd3084,eb0f6c90,0,...) at sys_wait4+0x94/frame 0xeb0fcc40 syscall(eb0fcd08) at syscall+0x2ed/frame 0xeb0fccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xeb0fccfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x805eae7, esp = 0xbfbfd874, ebp = 0xbfbfd888 --- Tracing command audit pid 10 tid 100001 td 0xc6efd620 sched_switch(c6efd620,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb0f9ba8 mi_switch(104,0,c113f10d,1f4,8,...) at mi_switch+0x1c9/frame 0xeb0f9bdc sleepq_switch(c6efd620,0,c113f10d,26a,c6efd620,...) at sleepq_switch+0x1c5/frame 0xeb0f9c10 sleepq_wait(c15fab8c,0,eb0f9c64,1,0,...) at sleepq_wait+0x48/frame 0xeb0f9c34 _cv_wait(c15fab8c,c15fab18,c116bc52,18d,0,...) at _cv_wait+0x1f9/frame 0xeb0f9c78 audit_worker(0,eb0f9d08,c113267c,3c9,0,...) at audit_worker+0x94/frame 0xeb0f9ccc fork_exit(c0cf5010,0,eb0f9d08) at fork_exit+0x7f/frame 0xeb0f9cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb0f9cf4 --- trap 0, eip = 0, esp = 0xeb0f9d40, ebp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xc737b310 sched_switch(c737b310,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb26ebac mi_switch(104,0,c113f10d,1f4,161,...) at mi_switch+0x1c9/frame 0xeb26ebe0 sleepq_switch(c737b310,0,c113f10d,26a,c6d68780,...) at sleepq_switch+0x1c5/frame 0xeb26ec14 sleepq_wait(c6d68780,0,c11247da,0,0,...) at sleepq_wait+0x48/frame 0xeb26ec38 _sleep(c6d68780,c6d68798,0,c11247da,0,...) at _sleep+0x385/frame 0xeb26ec94 taskqueue_thread_loop(c13e2b20,eb26ed08,c113267c,3c9,0,...) at taskqueue_thread_loop+0x129/frame 0xeb26eccc fork_exit(c0b14cd0,c13e2b20,eb26ed08) at fork_exit+0x7f/frame 0xeb26ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb26ecf4 --- trap 0, eip = 0, esp = 0xeb26ed40, ebp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xc713c620 sched_switch(c713c620,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb267b68 mi_switch(104,0,c113f10d,1f4,101,...) at mi_switch+0x1c9/frame 0xeb267b9c sleepq_switch(c713c620,0,c113f10d,28d,c141e5cc,...) at sleepq_switch+0x1c5/frame 0xeb267bd0 sleepq_timedwait(c141e5cc,0,2,0,0,...) at sleepq_timedwait+0x48/frame 0xeb267bf4 _sleep(c141e5cc,0,0,c11247da,fffffc88,...) at _sleep+0x350/frame 0xeb267c50 pause_sbt(c11247da,fffffc88,2,0,0,...) at pause_sbt+0xe9/frame 0xeb267c8c deadlkres(0,eb267d08,c113267c,3c9,0,...) at deadlkres+0x82/frame 0xeb267ccc fork_exit(c0a77f00,0,eb267d08) at fork_exit+0x7f/frame 0xeb267cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb267cf4 --- trap 0, eip = 0, esp = 0xeb267d40, ebp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xc713c930 sched_switch(c713c930,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xeb264bc0 mi_switch(104,0,c113f10d,1f4,c143b4f0,...) at mi_switch+0x1c9/frame 0xeb264bf4 sleepq_switch(c713c930,0,c113f10d,26a,c714a500,...) at sleepq_switch+0x1c5/frame 0xeb264c28 sleepq_wait(c714a500,0,c1139b2a,c11247da,0,...) at sleepq_wait+0x48/frame 0xeb264c4c msleep_spin_sbt(c714a500,c714a518,c11247da,0,0,...) at msleep_spin_sbt+0x239/frame 0xeb264c94 taskqueue_thread_loop(c15e6a10,eb264d08,c113267c,3c9,0,...) at taskqueue_thread_loop+0xcc/frame 0xeb264ccc fork_exit(c0b14cd0,c15e6a10,eb264d08) at fork_exit+0x7f/frame 0xeb264cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeb264cf4 --- trap 0, eip = 0, esp = 0xeb264d40, ebp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xc70a7930 sched_switch(c70a7930,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xee640bac mi_switch(104,0,c113f10d,1f4,161,...) at mi_switch+0x1c9/frame 0xee640be0 sleepq_switch(c70a7930,0,c113f10d,26a,c6d68280,...) at sleepq_switch+0x1c5/frame 0xee640c14 sleepq_wait(c6d68280,0,c11247da,0,0,...) at sleepq_wait+0x48/frame 0xee640c38 _sleep(c6d68280,c6d68298,0,c11247da,0,...) at _sleep+0x385/frame 0xee640c94 taskqueue_thread_loop(c15fabc8,ee640d08,c113267c,3c9,0,...) at taskqueue_thread_loop+0x129/frame 0xee640ccc fork_exit(c0b14cd0,c15fabc8,ee640d08) at fork_exit+0x7f/frame 0xee640cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee640cf4 --- trap 0, eip = 0, esp = 0xee640d40, ebp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xc6efdc40 sched_switch(c6efdc40,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xee63abac mi_switch(104,0,c113f10d,1f4,161,...) at mi_switch+0x1c9/frame 0xee63abe0 sleepq_switch(c6efdc40,0,c113f10d,26a,c6d68400,...) at sleepq_switch+0x1c5/frame 0xee63ac14 sleepq_wait(c6d68400,0,c11247da,0,0,...) at sleepq_wait+0x48/frame 0xee63ac38 _sleep(c6d68400,c6d68418,0,c11247da,0,...) at _sleep+0x385/frame 0xee63ac94 taskqueue_thread_loop(c15f8520,ee63ad08,c113267c,3c9,0,...) at taskqueue_thread_loop+0x129/frame 0xee63accc fork_exit(c0b14cd0,c15f8520,ee63ad08) at fork_exit+0x7f/frame 0xee63acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee63acf4 --- trap 0, eip = 0, esp = 0xee63ad40, ebp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xc6fad620 sched_switch(c6fad620,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xee631bc0 mi_switch(104,0,c113f10d,1f4,c143a608,...) at mi_switch+0x1c9/frame 0xee631bf4 sleepq_switch(c6fad620,0,c113f10d,26a,c6d68680,...) at sleepq_switch+0x1c5/frame 0xee631c28 sleepq_wait(c6d68680,0,c1139b2a,c11247da,0,...) at sleepq_wait+0x48/frame 0xee631c4c msleep_spin_sbt(c6d68680,c6d68698,c11247da,0,0,...) at msleep_spin_sbt+0x239/frame 0xee631c94 taskqueue_thread_loop(c15e8554,ee631d08,c113267c,3c9,0,...) at taskqueue_thread_loop+0xcc/frame 0xee631ccc fork_exit(c0b14cd0,c15e8554,ee631d08) at fork_exit+0x7f/frame 0xee631cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee631cf4 --- trap 0, eip = 0, esp = 0xee631d40, ebp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xc6fad930 sched_switch(c6fad930,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xee62ebc0 mi_switch(104,0,c113f10d,1f4,c143a608,...) at mi_switch+0x1c9/frame 0xee62ebf4 sleepq_switch(c6fad930,0,c113f10d,26a,c6d68680,...) at sleepq_switch+0x1c5/frame 0xee62ec28 sleepq_wait(c6d68680,0,c1139b2a,c11247da,0,...) at sleepq_wait+0x48/frame 0xee62ec4c msleep_spin_sbt(c6d68680,c6d68698,c11247da,0,0,...) at msleep_spin_sbt+0x239/frame 0xee62ec94 taskqueue_thread_loop(c15e8554,ee62ed08,c113267c,3c9,0,...) at taskqueue_thread_loop+0xcc/frame 0xee62eccc fork_exit(c0b14cd0,c15e8554,ee62ed08) at fork_exit+0x7f/frame 0xee62ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee62ecf4 --- trap 0, eip = 0, esp = 0xee62ed40, ebp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xc6fadc40 sched_switch(c6fadc40,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xee62bbc0 mi_switch(104,0,c113f10d,1f4,c143a608,...) at mi_switch+0x1c9/frame 0xee62bbf4 sleepq_switch(c6fadc40,0,c113f10d,26a,c6d68680,...) at sleepq_switch+0x1c5/frame 0xee62bc28 sleepq_wait(c6d68680,0,c1139b2a,c11247da,0,...) at sleepq_wait+0x48/frame 0xee62bc4c msleep_spin_sbt(c6d68680,c6d68698,c11247da,0,0,...) at msleep_spin_sbt+0x239/frame 0xee62bc94 taskqueue_thread_loop(c15e8554,ee62bd08,c113267c,3c9,0,...) at taskqueue_thread_loop+0xcc/frame 0xee62bccc fork_exit(c0b14cd0,c15e8554,ee62bd08) at fork_exit+0x7f/frame 0xee62bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee62bcf4 --- trap 0, eip = 0, esp = 0xee62bd40, ebp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xc6fae310 sched_switch(c6fae310,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xee625bac mi_switch(104,0,c113f10d,1f4,161,...) at mi_switch+0x1c9/frame 0xee625be0 sleepq_switch(c6fae310,0,c113f10d,26a,c6d68800,...) at sleepq_switch+0x1c5/frame 0xee625c14 sleepq_wait(c6d68800,0,c11247da,0,0,...) at sleepq_wait+0x48/frame 0xee625c38 _sleep(c6d68800,c6d68818,0,c11247da,0,...) at _sleep+0x385/frame 0xee625c94 taskqueue_thread_loop(c15f5658,ee625d08,c113267c,3c9,0,...) at taskqueue_thread_loop+0x129/frame 0xee625ccc fork_exit(c0b14cd0,c15f5658,ee625d08) at fork_exit+0x7f/frame 0xee625cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee625cf4 --- trap 0, eip = 0, esp = 0xee625d40, ebp = 0 --- Tracing command kernel pid 0 tid 100013 td 0xc6efb000 sched_switch(c6efb000,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xee615bac mi_switch(104,0,c113f10d,1f4,161,...) at mi_switch+0x1c9/frame 0xee615be0 sleepq_switch(c6efb000,0,c113f10d,26a,c6d69880,...) at sleepq_switch+0x1c5/frame 0xee615c14 sleepq_wait(c6d69880,0,c11247da,0,0,...) at sleepq_wait+0x48/frame 0xee615c38 _sleep(c6d69880,c6d69898,0,c11247da,0,...) at _sleep+0x385/frame 0xee615c94 taskqueue_thread_loop(c1439a44,ee615d08,c113267c,3c9,0,...) at taskqueue_thread_loop+0x129/frame 0xee615ccc fork_exit(c0b14cd0,c1439a44,ee615d08) at fork_exit+0x7f/frame 0xee615cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xee615cf4 --- trap 0, eip = 0, esp = 0xee615d40, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc15f51c0 sched_switch(c15f51c0,0,104,1bb,c0ab62fe,...) at sched_switch+0x4b9/frame 0xc1c20c2c mi_switch(104,0,c113f10d,1f4,101,...) at mi_switch+0x1c9/frame 0xc1c20c60 sleepq_switch(c15f51c0,0,c113f10d,28d,c15f4ec4,...) at sleepq_switch+0x1c5/frame 0xc1c20c94 sleepq_timedwait(c15f4ec4,54,9,0,0,...) at sleepq_timedwait+0x48/frame 0xc1c20cb8 _sleep(c15f4ec4,0,54,c11779be,fffff470,...) at _sleep+0x350/frame 0xc1c20d14 swapper() at swapper+0x24f/frame 0xc1c20d58 begin() at begin+0x2c db:0:allt> call doadump Physical memory: 2023 MB Dumping 138 MB: 123 107 91 75 59 43 27 11 Dump complete = 0 db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 2 (kgdb) proc 2159 [Switching to thread 78 (Thread 100235)]#0 sched_switch (td=0xc9601000, newtd=, flags=0x104) at ../../../kern/sched_ule.c:1937 1937 cpuid = PCPU_GET(cpuid); (kgdb) bt #0 sched_switch (td=0xc9601000, newtd=, flags=0x104) at ../../../kern/sched_ule.c:1937 #1 0xc0ad47c9 in mi_switch (flags=) at ../../../kern/kern_synch.c:493 #2 0xc0b10ba5 in sleepq_switch (wchan=, pri=0x54) at ../../../kern/subr_sleepqueue.c:540 #3 0xc0b10988 in sleepq_wait (wchan=0xc95d0750, pri=0x54) at ../../../kern/subr_sleepqueue.c:619 #4 0xc0ad3fd5 in _sleep (ident=0xc95d0750, lock=0x9c, priority=, wmesg=, sbt=0x0, pr=0x0) at ../../../kern/kern_synch.c:255 #5 0xc0d7c295 in vm_object_pip_wait (object=0xc95d0750, waitid=0xc1177e73 "objtrm") at ../../../vm/vm_object.c:396 #6 0xc0d7da68 in vm_object_terminate (object=0xc95d0750) at ../../../vm/vm_object.c:715 #7 0xc0d7cd69 in vm_object_deallocate (object=0xc95d0750) at ../../../vm/vm_object.c:651 #8 0xc0d791c6 in vm_map_entry_deallocate (entry=0xc801b558, system_map=0x0) at ../../../vm/vm_map.c:2763 #9 0xc0d6ec55 in vm_map_process_deferred () at ../../../vm/vm_map.c:475 #10 0xc0d6eb46 in _vm_map_unlock (map=0xc75e63c0, file=0xc1176de7 "../../../vm/vm_map.c", line=0xb80) at ../../../vm/vm_map.c:488 #11 0xc0d75b46 in vm_map_remove (map=0xc75e63c0, start=0x1000, end=0xbfc00000) at ../../../vm/vm_map.c:2944 #12 0xc0d6e646 in vmspace_dofree (vm=0xc75e63c0) at ../../../vm/vm_map.c:327 #13 0xc0d6e871 in vmspace_exit (td=0xc9601000) at ../../../vm/vm_map.c:405 #14 0xc0a92fd4 in exit1 (td=0xc9601000, rv=) at ../../../kern/kern_exit.c:319 #15 0xc0a9298d in sys_sys_exit (td=0xc9601000, uap=0xc69fecc8) at ../../../kern/kern_exit.c:119 #16 0xc0fcc65d in syscall (frame=) at subr_syscall.c:133 #17 0xc0fb4a51 in Xint0x80_syscall () at ../../../i386/i386/exception.s:269 #18 0x00000033 in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb) f 5 #5 0xc0d7c295 in vm_object_pip_wait (object=0xc95d0750, waitid=0xc1177e73 "objtrm") at ../../../vm/vm_object.c:396 396 VM_OBJECT_SLEEP(object, object, PVM, waitid, 0); (kgdb) l 391 { 392 393 VM_OBJECT_ASSERT_WLOCKED(object); 394 while (object->paging_in_progress) { 395 object->flags |= OBJ_PIPWNT; 396 VM_OBJECT_SLEEP(object, object, PVM, waitid, 0); 397 } 398 } 399 400 /* (kgdb) info loc No locals. (kgdb) p *object $1 = {lock = {lock_object = {lo_name = 0xc1177d32 "vm object", lo_flags = 0x5630000, lo_data = 0x0, lo_witness = 0x0}, rw_lock = 0x1}, object_list = {tqe_next = 0xc965f000, tqe_prev = 0xc95d09d4}, shadow_head = {lh_first = 0x0}, shadow_list = {le_next = 0xc965f138, le_prev = 0xc966e1f4}, memq = {tqh_first = 0xc29ed994, tqh_last = 0xc45ae704}, rtree = { rt_root = 0xe0a6a764, rt_flags = 0x0}, size = 0xc00, generation = 0x1, ref_count = 0x0, shadow_count = 0x0, memattr = 0x6, type = 0x1, flags = 0x3048, pg_color = 0x8800, paging_in_progress = 0x0, resident_page_count = 0xc00, backing_object = 0x0, backing_object_offset = 0x0, pager_object_list = {tqe_next = 0x0, tqe_prev = 0x0}, rvq = {lh_first = 0x0}, cache = {rt_root = 0x0, rt_flags = 0x0}, handle = 0x0, un_pager = {vnp = {vnp_size = 0x0, writemappings = 0x0}, devp = {devp_pglist = {tqh_first = 0x0, tqh_last = 0x0}, ops = 0x0, dev = 0x0}, sgp = {sgp_pglist = {tqh_first = 0x0, tqh_last = 0x0}}, swp = {swp_tmpfs = 0x0, swp_bcount = 0x0}}, cred = 0xc7506180, charge = 0xc00000} (kgdb) p object->flags $4 = 0x3048 #define OBJ_DEAD 0x0008 /* dead objects (during rundown) */ #define OBJ_PIPWNT 0x0040 /* paging in progress wanted */ #define OBJ_COLORED 0x1000 /* pg_color is defined */ #define OBJ_ONEMAPPING 0x2000 /* One USE (a single, non-forked) mapping flag */ (kgdb) f 8 #8 0xc0d791c6 in vm_map_entry_deallocate (entry=0xc801b558, system_map=0x0) at ../../../vm/vm_map.c:2763 2763 vm_object_deallocate(entry->object.vm_object); (kgdb) l 2758 static void 2759 vm_map_entry_deallocate(vm_map_entry_t entry, boolean_t system_map) 2760 { 2761 2762 if ((entry->eflags & MAP_ENTRY_IS_SUB_MAP) == 0) 2763 vm_object_deallocate(entry->object.vm_object); 2764 uma_zfree(system_map ? kmapentzone : mapentzone, entry); 2765 } 2766 2767 /* (kgdb) p *entry $2 = {prev = 0xc75e63c0, next = 0xc9631558, left = 0x0, right = 0xc963150c, start = 0x28800000, end = 0x29400000, avail_ssize = 0x0, adj_free = 0x967df000, max_free = 0x967df000, object = { vm_object = 0xc95d0750, sub_map = 0xc95d0750}, offset = 0x0, eflags = 0x0, protection = 0x3, max_protection = 0x7, inheritance = 0x1, read_ahead = 0x7, wired_count = 0x0, next_read = 0x2f0, cred = 0x0, wiring_thread = 0x0} (kgdb) f 11 #11 0xc0d75b46 in vm_map_remove (map=0xc75e63c0, start=0x1000, end=0xbfc00000) at ../../../vm/vm_map.c:2944 2944 vm_map_unlock(map); (kgdb) l 2939 int result; 2940 2941 vm_map_lock(map); 2942 VM_MAP_RANGE_CHECK(map, start, end); 2943 result = vm_map_delete(map, start, end); 2944 vm_map_unlock(map); 2945 return (result); 2946 } 2947 2948 /* (kgdb) p *map $3 = {header = {prev = 0xc75e63c0, next = 0xc75e63c0, left = 0x0, right = 0x0, start = 0x1000, end = 0xbfc00000, avail_ssize = 0x0, adj_free = 0x0, max_free = 0x0, object = { vm_object = 0x0, sub_map = 0x0}, offset = 0x0, eflags = 0x0, protection = 0x0, max_protection = 0x0, inheritance = 0x0, read_ahead = 0x0, wired_count = 0x0, next_read = 0x0, cred = 0x0, wiring_thread = 0x0}, lock = {lock_object = {lo_name = 0xc1141df3 "vm map (user)", lo_flags = 0x2330000, lo_data = 0x0, lo_witness = 0x0}, sx_lock = 0x1}, system_mtx = { lock_object = {lo_name = 0xc1141dc5 "vm map (system)", lo_flags = 0x1430000, lo_data = 0x0, lo_witness = 0x0}, mtx_lock = 0x4}, nentries = 0x0, size = 0x0, timestamp = 0x58, needs_wakeup = 0x0, system_map = 0x0, flags = 0x0, root = 0x0, pmap = 0xc75e6474, busy = 0x0} (kgdb) $ svn diff -x -p /usr/src/sys -- Test scenario: stealer.sh