GENERIC HEAD from 2012-05-03 10:26:33 UTC, r234951M, vmcore.14 KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2012 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #1 r244441+295ef26-dirty: Thu Dec 20 19:51:11 CET 2012 pho@x4.osted.lan:/var/tmp/deviant2/sys/amd64/compile/PHO amd64 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz K8-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 0x10 Model = 0x2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 4294967296 (4096 MB) avail memory = 3949314048 (3766 MB) : Trying to mount root from ufs:/dev/ada0s3a [rw]... Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/ada0s3a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s3a: clean, 638185 free (881 frags, 79663 blocks, 0.1% fragmentation) /dev/ada0s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1f: clean, 139121 free (5401 frags, 16715 blocks, 0.5% fragmentation) /dev/ada0s1g: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1g: clean, 64161764 free (8460 frags, 8019163 blocks, 0.0% fragmentation) /dev/ada0s3d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s3d: clean, 4402549 free (166213 frags, 529542 blocks, 1.6% fragmentation) /dev/ada0s3e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s3e: clean, 11360833 free (83713 frags, 1409640 blocks, 0.3% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN Starting Network: lo0 re0 fwe0 fwip0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet 127.0.0.1 netmask 0xff000000 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x4 nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 tentative scopeid 0x1 nd6 options=29 media: Ethernet autoselect (none) status: no carrier fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 Starting devd. Starting Network: fwe0. fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 Starting Network: fwip0. fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 re0: link state changed to UP add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/kde4/lib /usr/local/lib/compat/pkg /usr/local/lib/qt4 32-bit compatibility ldconfig path: /usr/lib32 Creating and/or trimming log files. Starting syslogd. No core dumps found. Additional ABI support: linux Fatal trap 12: page fault while in kernel mode cpuid = 2; apic id = 02 fault virtual address = 0xffffff80044702a9 fault code = supervisor read data, page not present instruction pointer = 0x20:0xffffffff809a72f7 stack pointer = 0x28:0xffffff811e59a4d0 frame pointer = 0x28:0xffffff811e59a4e0 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 1047 (kldload) [ thread pid 1047 tid 100084 ] Stopped at strncmp+0x17: movzbl (%rdi),%ecx db> run pho db:0:pho> bt Tracing pid 1047 tid 100084 td 0xfffffe0008c99480 strncmp() at strncmp+0x17/frame 0xffffff811e59a4e0 link_elf_reloc_local() at link_elf_reloc_local+0x93/frame 0xffffff811e59a550 link_elf_load_file() at link_elf_load_file+0xa0c/frame 0xffffff811e59a6f0 linker_load_module() at linker_load_module+0x728/frame 0xffffff811e59aa30 kern_kldload() at kern_kldload+0xac/frame 0xffffff811e59aa90 sys_kldload() at sys_kldload+0x84/frame 0xffffff811e59aad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff811e59abf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff811e59abf0 --- syscall (304, FreeBSD ELF64, sys_kldload), rip = 0x80088136a, rsp = 0x7fffffffd7e8, rbp = 0x7fffffffdd80 --- db:0:bt> show allpcpu Current CPU: 2 cpuid = 0 dynamic pcpu = 0x5da500 curthread = 0xfffffe000291d480: pid 11 "idle: cpu0" curpcb = 0xffffff8000252cc0 fpcurthread = none idlethread = 0xfffffe000291d480: tid 100003 "idle: cpu0" curpmap = 0xffffffff81361850 tssp = 0xffffffff81571380 commontssp = 0xffffffff81571380 rsp0 = 0xffffff8000252cc0 gs32p = 0xffffffff8156f4b8 ldt = 0xffffffff8156f4f8 tss = 0xffffffff8156f4e8 spin locks held: cpuid = 1 dynamic pcpu = 0xffffff807ef13500 curthread = 0xfffffe000291d000: pid 11 "idle: cpu1" curpcb = 0xffffff8000257cc0 fpcurthread = none idlethread = 0xfffffe000291d000: tid 100004 "idle: cpu1" curpmap = 0xffffffff81361850 tssp = 0xffffffff815713e8 commontssp = 0xffffffff815713e8 rsp0 = 0xffffff8000257cc0 gs32p = 0xffffffff8156f520 ldt = 0xffffffff8156f560 tss = 0xffffffff8156f550 spin locks held: cpuid = 2 dynamic pcpu = 0xffffff807ef1a500 curthread = 0xfffffe0008c99480: pid 1047 "kldload" curpcb = 0xffffff811e59acc0 fpcurthread = none idlethread = 0xfffffe0002928900: tid 100005 "idle: cpu2" curpmap = 0xfffffe0008d4dbe8 tssp = 0xffffffff81571450 commontssp = 0xffffffff81571450 rsp0 = 0xffffff811e59acc0 gs32p = 0xffffffff8156f588 ldt = 0xffffffff8156f5c8 tss = 0xffffffff8156f5b8 spin locks held: cpuid = 3 dynamic pcpu = 0xffffff807ef21500 curthread = 0xfffffe0002928480: pid 11 "idle: cpu3" curpcb = 0xffffff8000261cc0 fpcurthread = none idlethread = 0xfffffe0002928480: tid 100006 "idle: cpu3" curpmap = 0xffffffff81361850 tssp = 0xffffffff815714b8 commontssp = 0xffffffff815714b8 rsp0 = 0xffffff8000261cc0 gs32p = 0xffffffff8156f5f0 ldt = 0xffffffff8156f630 tss = 0xffffffff8156f620 spin locks held: db:0:allpcpu> show alllocks Process 1047 (kldload) thread 0xfffffe0008c99480 (100084) shared lockmgr ufs (ufs) r = 0 (0xfffffe0008e2ad40) locked @ kern/vfs_subr.c:2162 exclusive sx kernel linker (kernel linker) r = 0 (0xffffffff813621c0) locked @ kern/kern_linker.c:1040 db:0:alllocks> show lockedvnods Locked vnodes 0xfffffe0008e2aca8: tag ufs, type VREG usecount 1, writecount 0, refcount 77 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffffe0008e29bc8 ref 0 pages 300 lock type ufs: SHARED (count 1) #0 0xffffffff808d28b9 at __lockmgr_args+0x909 #1 0xffffffff80b45a2b at ffs_lock+0x9b #2 0xffffffff80d22818 at VOP_LOCK1_APV+0x88 #3 0xffffffff809a1bdd at _vn_lock+0x8d #4 0xffffffff80996573 at vget+0x63 #5 0xffffffff8097f21a at cache_lookup+0x55a #6 0xffffffff8097f6b8 at vfs_cache_lookup+0xc8 #7 0xffffffff80d21627 at VOP_LOOKUP_APV+0xa7 #8 0xffffffff80986b52 at lookup+0x332 #9 0xffffffff80987870 at namei+0x400 #10 0xffffffff809a36a1 at vn_open_cred+0x1c1 #11 0xffffffff80cfabd3 at link_elf_load_file+0xb3 #12 0xffffffff808d07d8 at linker_load_module+0x728 #13 0xffffffff808d0eec at kern_kldload+0xac #14 0xffffffff808d1064 at sys_kldload+0x84 #15 0xffffffff80c900e3 at amd64_syscall+0x2d3 #16 0xffffffff80c7a367 at Xfast_syscall+0xf7 ino 212609, on dev ada0s3a db:0:lockedvnods> show mount 0xfffffe0008c0fb58 /dev/ada0s3a on / (ufs) 0xfffffe0008c10000 devfs on /dev (devfs) 0xfffffe0008d23790 /dev/ada0s1f on /home (ufs) 0xfffffe0008d233c8 /dev/ada0s1g on /tmp (ufs) 0xfffffe0008d23000 /dev/ada0s3d on /usr (ufs) 0xfffffe0008c10b58 /dev/ada0s3e on /var (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 1047 1044 20 0 R+ CPU 2 kldload 1044 20 20 0 S+ wait 0xfffffe0008d6d4a8 sh 1039 1 1039 0 Ss select 0xfffffe000895f940 syslogd 838 1 838 0 Ss select 0xfffffe0008aea340 devd 20 1 20 0 Ss+ wait 0xfffffe0008a22950 sh 19 0 0 0 DL sdflush 0xffffffff81564338 [softdepflush] 18 0 0 0 DL vlruwt 0xfffffe0008a234a8 [vnlru] 17 0 0 0 DL syncer 0xffffffff815589a0 [syncer] 16 0 0 0 DL psleep 0xffffffff81558400 [bufdaemon] 9 0 0 0 DL pgzero 0xffffffff8156e33c [pagezero] 8 0 0 0 DL psleep 0xffffffff8156d508 [vmdaemon] 7 0 0 0 DL psleep 0xffffffff8156d4cc [pagedaemon] 6 0 0 0 DL ccb_scan 0xffffffff813229e0 [xpt_thrd] 5 0 0 0 DL waiting_ 0xffffffff8155e680 [sctp_iterator] 4 0 0 0 DL - 0xfffffe0002d18848 [fdc0] 3 0 0 0 SL - 0xffffff8002658000 [fw0_probe] 15 0 0 0 DL (threaded) [usb] 100059 D - 0xffffff8002655e18 [usbus5] 100058 D - 0xffffff8002655dc0 [usbus5] 100057 D - 0xffffff8002655d68 [usbus5] 100056 D - 0xffffff8002655d10 [usbus5] 100054 D - 0xffffff800264d460 [usbus4] 100053 D - 0xffffff800264d408 [usbus4] 100052 D - 0xffffff800264d3b0 [usbus4] 100051 D - 0xffffff800264d358 [usbus4] 100050 D - 0xffffff800264a460 [usbus3] 100049 D - 0xffffff800264a408 [usbus3] 100048 D - 0xffffff800264a3b0 [usbus3] 100047 D - 0xffffff800264a358 [usbus3] 100046 D - 0xffffff8002647460 [usbus2] 100045 D - 0xffffff8002647408 [usbus2] 100044 D - 0xffffff80026473b0 [usbus2] 100043 D - 0xffffff8002647358 [usbus2] 100041 D - 0xffffff8002644460 [usbus1] 100040 D - 0xffffff8002644408 [usbus1] 100039 D - 0xffffff80026443b0 [usbus1] 100038 D - 0xffffff8002644358 [usbus1] 100036 D - 0xffffff8002641460 [usbus0] 100035 D - 0xffffff8002641408 [usbus0] 100034 D - 0xffffff80026413b0 [usbus0] 100033 D - 0xffffff8002641358 [usbus0] 2 0 0 0 DL ctl_work 0xffffff8001310000 [ctl_thrd] 14 0 0 0 DL - 0xffffffff81367a64 [yarrow] 13 0 0 0 DL (threaded) [geom] 100015 D - 0xffffffff81360af0 [g_down] 100014 D - 0xffffffff81360ae8 [g_up] 100013 D - 0xffffffff81360ad8 [g_event] 12 0 0 0 WL (threaded) [intr] 100067 I [irq12: psm0] 100066 I [irq1: atkbd0] 100064 I [swi0: uart] 100061 I [irq20: fwohci0] 100060 I [irq14: ata0] 100055 I [irq19: ehci0] 100042 I [irq18: ohci2 ohci4] 100037 I [irq17: ohci1 ohci3] 100032 I [irq16: hdac1 ohci0] 100031 I [irq22: ahci0] 100030 I [irq257: re0] 100029 I [irq256: hdac0] 100027 I [swi6: task queue] 100026 I [swi6: Giant taskq] 100023 I [swi5: fast taskq] 100022 I [swi2: cambio] 100012 I [swi3: vm] 100011 I [swi4: clock] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 I [swi4: clock] 100007 I [swi1: netisr 0] 11 0 0 0 RL (threaded) [idle] 100006 Run CPU 3 [idle: cpu3] 100005 CanRun [idle: cpu2] 100004 Run CPU 1 [idle: cpu1] 100003 Run CPU 0 [idle: cpu0] 1 0 1 0 SLs wait 0xfffffe000291b950 [init] 10 0 0 0 DL audit_wo 0xffffffff815632b0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100069 D - 0xffffffff81367a64 [deadlkres] 100068 D - 0xfffffe00060db000 [mca taskq] 100062 D - 0xfffffe00060db880 [fw0_taskq] 100025 D - 0xfffffe000294c280 [thread taskq] 100024 D - 0xfffffe000294c300 [ffs_trim taskq] 100021 D - 0xfffffe000294ca00 [acpi_task_2] 100020 D - 0xfffffe000294ca00 [acpi_task_1] 100019 D - 0xfffffe000294ca00 [acpi_task_0] 100018 D - 0xfffffe000294ca80 [kqueue taskq] 100016 D - 0xfffffe0002929500 [firmware taskq] 100000 D sched 0xffffffff81360e00 [swapper] db:0:ps> allt Tracing command kldload pid 1047 tid 100084 td 0xfffffe0008c99480 strncmp() at strncmp+0x17/frame 0xffffff811e59a4e0 link_elf_reloc_local() at link_elf_reloc_local+0x93/frame 0xffffff811e59a550 link_elf_load_file() at link_elf_load_file+0xa0c/frame 0xffffff811e59a6f0 linker_load_module() at linker_load_module+0x728/frame 0xffffff811e59aa30 kern_kldload() at kern_kldload+0xac/frame 0xffffff811e59aa90 sys_kldload() at sys_kldload+0x84/frame 0xffffff811e59aad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff811e59abf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff811e59abf0 --- syscall (304, FreeBSD ELF64, sys_kldload), rip = 0x80088136a, rsp = 0x7fffffffd7e8, rbp = 0x7fffffffdd80 --- Tracing command sh pid 1044 tid 100110 td 0xfffffe0008d93000 sched_switch() at sched_switch+0x1b4/frame 0xffffff811e61c650 mi_switch() at mi_switch+0x238/frame 0xffffff811e61c6a0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811e61c6e0 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff811e61c740 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff811e61c760 _sleep() at _sleep+0x37d/frame 0xffffff811e61c7f0 kern_wait6() at kern_wait6+0x5b3/frame 0xffffff811e61c890 kern_wait() at kern_wait+0x12d/frame 0xffffff811e61ca10 sys_wait4() at sys_wait4+0x35/frame 0xffffff811e61cad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff811e61cbf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff811e61cbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800d2f14a, rsp = 0x7fffffffbdd8, rbp = 0x1 --- Tracing command syslogd pid 1039 tid 100116 td 0xfffffe0008d35000 sched_switch() at sched_switch+0x1b4/frame 0xffffff811e63a690 mi_switch() at mi_switch+0x238/frame 0xffffff811e63a6e0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811e63a720 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff811e63a780 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff811e63a7a0 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff811e63a800 seltdwait() at seltdwait+0xad/frame 0xffffff811e63a830 kern_select() at kern_select+0x79f/frame 0xffffff811e63aa80 sys_select() at sys_select+0x5d/frame 0xffffff811e63aad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff811e63abf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff811e63abf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800b4a2aa, rsp = 0x7fffffffd118, rbp = 0x80142c108 --- Tracing command devd pid 838 tid 100108 td 0xfffffe0008d93480 sched_switch() at sched_switch+0x1b4/frame 0xffffff811e612690 mi_switch() at mi_switch+0x238/frame 0xffffff811e6126e0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811e612720 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff811e612780 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff811e6127a0 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff811e612800 seltdwait() at seltdwait+0xad/frame 0xffffff811e612830 kern_select() at kern_select+0x79f/frame 0xffffff811e612a80 sys_select() at sys_select+0x5d/frame 0xffffff811e612ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff811e612bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff811e612bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x4417da, rsp = 0x7fffffffd828, rbp = 0x7fffffffd840 --- Tracing command sh pid 20 tid 100079 td 0xfffffe0008a1d000 sched_switch() at sched_switch+0x1b4/frame 0xffffff811e581650 mi_switch() at mi_switch+0x238/frame 0xffffff811e5816a0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811e5816e0 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff811e581740 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff811e581760 _sleep() at _sleep+0x37d/frame 0xffffff811e5817f0 kern_wait6() at kern_wait6+0x5b3/frame 0xffffff811e581890 kern_wait() at kern_wait+0x12d/frame 0xffffff811e581a10 sys_wait4() at sys_wait4+0x35/frame 0xffffff811e581ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff811e581bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff811e581bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800d2f14a, rsp = 0x7fffffffd808, rbp = 0x1 --- Tracing command softdepflush pid 19 tid 100078 td 0xfffffe0008a1d480 sched_switch() at sched_switch+0x1b4/frame 0xffffff81152ffa10 mi_switch() at mi_switch+0x238/frame 0xffffff81152ffa60 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81152ffaa0 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff81152ffad0 _sleep() at _sleep+0x29a/frame 0xffffff81152ffb60 softdep_flush() at softdep_flush+0x20d/frame 0xffffff81152ffba0 fork_exit() at fork_exit+0x139/frame 0xffffff81152ffbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff81152ffbf0 --- trap 0, rip = 0, rsp = 0xffffff81152ffcb0, rbp = 0 --- Tracing command vnlru pid 18 tid 100077 td 0xfffffe0008a1d900 sched_switch() at sched_switch+0x1b4/frame 0xffffff81152fa9d0 mi_switch() at mi_switch+0x238/frame 0xffffff81152faa20 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81152faa60 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff81152faa90 _sleep() at _sleep+0x29a/frame 0xffffff81152fab20 vnlru_proc() at vnlru_proc+0x537/frame 0xffffff81152faba0 fork_exit() at fork_exit+0x139/frame 0xffffff81152fabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff81152fabf0 --- trap 0, rip = 0, rsp = 0xffffff81152facb0, rbp = 0 --- Tracing command syncer pid 17 tid 100076 td 0xfffffe0008a1e000 sched_switch() at sched_switch+0x1b4/frame 0xffffff81152f59f0 mi_switch() at mi_switch+0x238/frame 0xffffff81152f5a40 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81152f5a80 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff81152f5ab0 _cv_timedwait() at _cv_timedwait+0x18f/frame 0xffffff81152f5b10 sched_sync() at sched_sync+0x568/frame 0xffffff81152f5ba0 fork_exit() at fork_exit+0x139/frame 0xffffff81152f5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff81152f5bf0 --- trap 0, rip = 0, rsp = 0xffffff81152f5cb0, rbp = 0 --- Tracing command bufdaemon pid 16 tid 100075 td 0xfffffe0008a1e480 sched_switch() at sched_switch+0x1b4/frame 0xffffff81152f0a30 mi_switch() at mi_switch+0x238/frame 0xffffff81152f0a80 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81152f0ac0 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff81152f0af0 _sleep() at _sleep+0x29a/frame 0xffffff81152f0b80 buf_daemon() at buf_daemon+0x192/frame 0xffffff81152f0ba0 fork_exit() at fork_exit+0x139/frame 0xffffff81152f0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff81152f0bf0 --- trap 0, rip = 0, rsp = 0xffffff81152f0cb0, rbp = 0 --- Tracing command pagezero pid 9 tid 100074 td 0xfffffe0008a1e900 sched_switch() at sched_switch+0x1b4/frame 0xffffff81152eba30 mi_switch() at mi_switch+0x238/frame 0xffffff81152eba80 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81152ebac0 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff81152ebaf0 _sleep() at _sleep+0x29a/frame 0xffffff81152ebb80 vm_pagezero() at vm_pagezero+0x73/frame 0xffffff81152ebba0 fork_exit() at fork_exit+0x139/frame 0xffffff81152ebbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff81152ebbf0 --- trap 0, rip = 0, rsp = 0xffffff81152ebcb0, rbp = 0 --- Tracing command vmdaemon pid 8 tid 100073 td 0xfffffe0008a20000 sched_switch() at sched_switch+0x1b4/frame 0xffffff81152e69e0 mi_switch() at mi_switch+0x238/frame 0xffffff81152e6a30 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81152e6a70 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff81152e6aa0 _sleep() at _sleep+0x3e9/frame 0xffffff81152e6b30 vm_daemon() at vm_daemon+0x4d/frame 0xffffff81152e6ba0 fork_exit() at fork_exit+0x139/frame 0xffffff81152e6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff81152e6bf0 --- trap 0, rip = 0, rsp = 0xffffff81152e6cb0, rbp = 0 --- Tracing command pagedaemon pid 7 tid 100072 td 0xfffffe00060d9000 sched_switch() at sched_switch+0x1b4/frame 0xffffff81152e1940 mi_switch() at mi_switch+0x238/frame 0xffffff81152e1990 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff81152e19d0 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff81152e1a00 _sleep() at _sleep+0x29a/frame 0xffffff81152e1a90 vm_pageout() at vm_pageout+0xb8e/frame 0xffffff81152e1ba0 fork_exit() at fork_exit+0x139/frame 0xffffff81152e1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff81152e1bf0 --- trap 0, rip = 0, rsp = 0xffffff81152e1cb0, rbp = 0 --- Tracing command xpt_thrd pid 6 tid 100071 td 0xfffffe00060d9480 sched_switch() at sched_switch+0x1b4/frame 0xffffff811515ca30 mi_switch() at mi_switch+0x238/frame 0xffffff811515ca80 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811515cac0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811515caf0 _sleep() at _sleep+0x3e9/frame 0xffffff811515cb80 xpt_scanner_thread() at xpt_scanner_thread+0xdd/frame 0xffffff811515cba0 fork_exit() at fork_exit+0x139/frame 0xffffff811515cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811515cbf0 --- trap 0, rip = 0, rsp = 0xffffff811515ccb0, rbp = 0 --- Tracing command sctp_iterator pid 5 tid 100070 td 0xfffffe00060d9900 sched_switch() at sched_switch+0x1b4/frame 0xffffff8115157a40 mi_switch() at mi_switch+0x238/frame 0xffffff8115157a90 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8115157ad0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8115157b00 _sleep() at _sleep+0x3e9/frame 0xffffff8115157b90 sctp_iterator_thread() at sctp_iterator_thread+0x3f/frame 0xffffff8115157ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8115157bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8115157bf0 --- trap 0, rip = 0, rsp = 0xffffff8115157cb0, rbp = 0 --- Tracing command fdc0 pid 4 tid 100065 td 0xfffffe00060df480 sched_switch() at sched_switch+0x1b4/frame 0xffffff8115139990 mi_switch() at mi_switch+0x238/frame 0xffffff81151399e0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8115139a20 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff8115139a50 _sleep() at _sleep+0x29a/frame 0xffffff8115139ae0 fdc_thread() at fdc_thread+0x7f4/frame 0xffffff8115139ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8115139bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8115139bf0 --- trap 0, rip = 0, rsp = 0xffffff8115139cb0, rbp = 0 --- Tracing command fw0_probe pid 3 tid 100063 td 0xfffffe00060e0000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8115121480 mi_switch() at mi_switch+0x238/frame 0xffffff81151214d0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8115121510 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff8115121570 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff8115121590 _sleep() at _sleep+0x37d/frame 0xffffff8115121620 fw_bus_probe_thread() at fw_bus_probe_thread+0xca/frame 0xffffff8115121ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8115121bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8115121bf0 --- trap 0, rip = 0, rsp = 0xffffff8115121cb0, rbp = 0 --- Tracing command usb pid 15 tid 100059 td 0xfffffe00060b8900 sched_switch() at sched_switch+0x1b4/frame 0xffffff8114db6a50 mi_switch() at mi_switch+0x238/frame 0xffffff8114db6aa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8114db6ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8114db6b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8114db6b70 usb_process() at usb_process+0x172/frame 0xffffff8114db6ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8114db6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8114db6bf0 --- trap 0, rip = 0, rsp = 0xffffff8114db6cb0, rbp = 0 --- Tracing command usb pid 15 tid 100058 td 0xfffffe00060bf000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8114db1a50 mi_switch() at mi_switch+0x238/frame 0xffffff8114db1aa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8114db1ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8114db1b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8114db1b70 usb_process() at usb_process+0x172/frame 0xffffff8114db1ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8114db1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8114db1bf0 --- trap 0, rip = 0, rsp = 0xffffff8114db1cb0, rbp = 0 --- Tracing command usb pid 15 tid 100057 td 0xfffffe00060bf480 sched_switch() at sched_switch+0x1b4/frame 0xffffff8114daca50 mi_switch() at mi_switch+0x238/frame 0xffffff8114dacaa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8114dacae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8114dacb10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8114dacb70 usb_process() at usb_process+0x172/frame 0xffffff8114dacba0 fork_exit() at fork_exit+0x139/frame 0xffffff8114dacbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8114dacbf0 --- trap 0, rip = 0, rsp = 0xffffff8114daccb0, rbp = 0 --- Tracing command usb pid 15 tid 100056 td 0xfffffe00060bf900 sched_switch() at sched_switch+0x1b4/frame 0xffffff8114da7a50 mi_switch() at mi_switch+0x238/frame 0xffffff8114da7aa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8114da7ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8114da7b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8114da7b70 usb_process() at usb_process+0x172/frame 0xffffff8114da7ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8114da7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8114da7bf0 --- trap 0, rip = 0, rsp = 0xffffff8114da7cb0, rbp = 0 --- Tracing command usb pid 15 tid 100054 td 0xfffffe00060c0480 sched_switch() at sched_switch+0x1b4/frame 0xffffff8114c1aa50 mi_switch() at mi_switch+0x238/frame 0xffffff8114c1aaa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8114c1aae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8114c1ab10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8114c1ab70 usb_process() at usb_process+0x172/frame 0xffffff8114c1aba0 fork_exit() at fork_exit+0x139/frame 0xffffff8114c1abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8114c1abf0 --- trap 0, rip = 0, rsp = 0xffffff8114c1acb0, rbp = 0 --- Tracing command usb pid 15 tid 100053 td 0xfffffe00060c0900 sched_switch() at sched_switch+0x1b4/frame 0xffffff8114c15a50 mi_switch() at mi_switch+0x238/frame 0xffffff8114c15aa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8114c15ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8114c15b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8114c15b70 usb_process() at usb_process+0x172/frame 0xffffff8114c15ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8114c15bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8114c15bf0 --- trap 0, rip = 0, rsp = 0xffffff8114c15cb0, rbp = 0 --- Tracing command usb pid 15 tid 100052 td 0xfffffe00060c1000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8114c10a50 mi_switch() at mi_switch+0x238/frame 0xffffff8114c10aa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8114c10ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8114c10b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8114c10b70 usb_process() at usb_process+0x172/frame 0xffffff8114c10ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8114c10bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8114c10bf0 --- trap 0, rip = 0, rsp = 0xffffff8114c10cb0, rbp = 0 --- Tracing command usb pid 15 tid 100051 td 0xfffffe00060c1480 sched_switch() at sched_switch+0x1b4/frame 0xffffff8114c0ba50 mi_switch() at mi_switch+0x238/frame 0xffffff8114c0baa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8114c0bae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8114c0bb10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8114c0bb70 usb_process() at usb_process+0x172/frame 0xffffff8114c0bba0 fork_exit() at fork_exit+0x139/frame 0xffffff8114c0bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8114c0bbf0 --- trap 0, rip = 0, rsp = 0xffffff8114c0bcb0, rbp = 0 --- Tracing command usb pid 15 tid 100050 td 0xfffffe00060c1900 sched_switch() at sched_switch+0x1b4/frame 0xffffff8114bc2a50 mi_switch() at mi_switch+0x238/frame 0xffffff8114bc2aa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8114bc2ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8114bc2b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8114bc2b70 usb_process() at usb_process+0x172/frame 0xffffff8114bc2ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8114bc2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8114bc2bf0 --- trap 0, rip = 0, rsp = 0xffffff8114bc2cb0, rbp = 0 --- Tracing command usb pid 15 tid 100049 td 0xfffffe00060b2000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8114bbda50 mi_switch() at mi_switch+0x238/frame 0xffffff8114bbdaa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8114bbdae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8114bbdb10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8114bbdb70 usb_process() at usb_process+0x172/frame 0xffffff8114bbdba0 fork_exit() at fork_exit+0x139/frame 0xffffff8114bbdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8114bbdbf0 --- trap 0, rip = 0, rsp = 0xffffff8114bbdcb0, rbp = 0 --- Tracing command usb pid 15 tid 100048 td 0xfffffe00060b2480 sched_switch() at sched_switch+0x1b4/frame 0xffffff8114bb8a50 mi_switch() at mi_switch+0x238/frame 0xffffff8114bb8aa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8114bb8ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8114bb8b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8114bb8b70 usb_process() at usb_process+0x172/frame 0xffffff8114bb8ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8114bb8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8114bb8bf0 --- trap 0, rip = 0, rsp = 0xffffff8114bb8cb0, rbp = 0 --- Tracing command usb pid 15 tid 100047 td 0xfffffe00060b2900 sched_switch() at sched_switch+0x1b4/frame 0xffffff8114bb3a50 mi_switch() at mi_switch+0x238/frame 0xffffff8114bb3aa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8114bb3ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8114bb3b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8114bb3b70 usb_process() at usb_process+0x172/frame 0xffffff8114bb3ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8114bb3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8114bb3bf0 --- trap 0, rip = 0, rsp = 0xffffff8114bb3cb0, rbp = 0 --- Tracing command usb pid 15 tid 100046 td 0xfffffe00060b5000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8114b6aa50 mi_switch() at mi_switch+0x238/frame 0xffffff8114b6aaa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8114b6aae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8114b6ab10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8114b6ab70 usb_process() at usb_process+0x172/frame 0xffffff8114b6aba0 fork_exit() at fork_exit+0x139/frame 0xffffff8114b6abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8114b6abf0 --- trap 0, rip = 0, rsp = 0xffffff8114b6acb0, rbp = 0 --- Tracing command usb pid 15 tid 100045 td 0xfffffe00060b5480 sched_switch() at sched_switch+0x1b4/frame 0xffffff8114b65a50 mi_switch() at mi_switch+0x238/frame 0xffffff8114b65aa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8114b65ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8114b65b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8114b65b70 usb_process() at usb_process+0x172/frame 0xffffff8114b65ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8114b65bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8114b65bf0 --- trap 0, rip = 0, rsp = 0xffffff8114b65cb0, rbp = 0 --- Tracing command usb pid 15 tid 100044 td 0xfffffe00060b5900 sched_switch() at sched_switch+0x1b4/frame 0xffffff8114b60a50 mi_switch() at mi_switch+0x238/frame 0xffffff8114b60aa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8114b60ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8114b60b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8114b60b70 usb_process() at usb_process+0x172/frame 0xffffff8114b60ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8114b60bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8114b60bf0 --- trap 0, rip = 0, rsp = 0xffffff8114b60cb0, rbp = 0 --- Tracing command usb pid 15 tid 100043 td 0xfffffe00060b7000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8114b5ba50 mi_switch() at mi_switch+0x238/frame 0xffffff8114b5baa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8114b5bae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8114b5bb10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8114b5bb70 usb_process() at usb_process+0x172/frame 0xffffff8114b5bba0 fork_exit() at fork_exit+0x139/frame 0xffffff8114b5bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8114b5bbf0 --- trap 0, rip = 0, rsp = 0xffffff8114b5bcb0, rbp = 0 --- Tracing command usb pid 15 tid 100041 td 0xfffffe00060b7900 sched_switch() at sched_switch+0x1b4/frame 0xffffff8114b0da50 mi_switch() at mi_switch+0x238/frame 0xffffff8114b0daa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8114b0dae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8114b0db10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8114b0db70 usb_process() at usb_process+0x172/frame 0xffffff8114b0dba0 fork_exit() at fork_exit+0x139/frame 0xffffff8114b0dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8114b0dbf0 --- trap 0, rip = 0, rsp = 0xffffff8114b0dcb0, rbp = 0 --- Tracing command usb pid 15 tid 100040 td 0xfffffe00060b8000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8114b08a50 mi_switch() at mi_switch+0x238/frame 0xffffff8114b08aa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8114b08ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8114b08b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8114b08b70 usb_process() at usb_process+0x172/frame 0xffffff8114b08ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8114b08bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8114b08bf0 --- trap 0, rip = 0, rsp = 0xffffff8114b08cb0, rbp = 0 --- Tracing command usb pid 15 tid 100039 td 0xfffffe0002de5000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8114b03a50 mi_switch() at mi_switch+0x238/frame 0xffffff8114b03aa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8114b03ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8114b03b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8114b03b70 usb_process() at usb_process+0x172/frame 0xffffff8114b03ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8114b03bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8114b03bf0 --- trap 0, rip = 0, rsp = 0xffffff8114b03cb0, rbp = 0 --- Tracing command usb pid 15 tid 100038 td 0xfffffe0002de5480 sched_switch() at sched_switch+0x1b4/frame 0xffffff8114afea50 mi_switch() at mi_switch+0x238/frame 0xffffff8114afeaa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8114afeae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8114afeb10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8114afeb70 usb_process() at usb_process+0x172/frame 0xffffff8114afeba0 fork_exit() at fork_exit+0x139/frame 0xffffff8114afebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8114afebf0 --- trap 0, rip = 0, rsp = 0xffffff8114afecb0, rbp = 0 --- Tracing command usb pid 15 tid 100036 td 0xfffffe0002de6000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8114ab0a50 mi_switch() at mi_switch+0x238/frame 0xffffff8114ab0aa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8114ab0ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8114ab0b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8114ab0b70 usb_process() at usb_process+0x172/frame 0xffffff8114ab0ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8114ab0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8114ab0bf0 --- trap 0, rip = 0, rsp = 0xffffff8114ab0cb0, rbp = 0 --- Tracing command usb pid 15 tid 100035 td 0xfffffe0002de6480 sched_switch() at sched_switch+0x1b4/frame 0xffffff8114aaba50 mi_switch() at mi_switch+0x238/frame 0xffffff8114aabaa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8114aabae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8114aabb10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8114aabb70 usb_process() at usb_process+0x172/frame 0xffffff8114aabba0 fork_exit() at fork_exit+0x139/frame 0xffffff8114aabbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8114aabbf0 --- trap 0, rip = 0, rsp = 0xffffff8114aabcb0, rbp = 0 --- Tracing command usb pid 15 tid 100034 td 0xfffffe0002de6900 sched_switch() at sched_switch+0x1b4/frame 0xffffff8114aa6a50 mi_switch() at mi_switch+0x238/frame 0xffffff8114aa6aa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8114aa6ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8114aa6b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8114aa6b70 usb_process() at usb_process+0x172/frame 0xffffff8114aa6ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8114aa6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8114aa6bf0 --- trap 0, rip = 0, rsp = 0xffffff8114aa6cb0, rbp = 0 --- Tracing command usb pid 15 tid 100033 td 0xfffffe0002de7000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8114aa1a50 mi_switch() at mi_switch+0x238/frame 0xffffff8114aa1aa0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8114aa1ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8114aa1b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8114aa1b70 usb_process() at usb_process+0x172/frame 0xffffff8114aa1ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8114aa1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8114aa1bf0 --- trap 0, rip = 0, rsp = 0xffffff8114aa1cb0, rbp = 0 --- Tracing command ctl_thrd pid 2 tid 100028 td 0xfffffe0002ae1000 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002d03f0 mi_switch() at mi_switch+0x238/frame 0xffffff80002d0440 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff80002d0480 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff80002d04b0 _sleep() at _sleep+0x3e9/frame 0xffffff80002d0540 ctl_work_thread() at ctl_work_thread+0x1ce8/frame 0xffffff80002d0ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002d0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002d0bf0 --- trap 0, rip = 0, rsp = 0xffffff80002d0cb0, rbp = 0 --- Tracing command yarrow pid 14 tid 100017 td 0xfffffe0002949900 sched_switch() at sched_switch+0x1b4/frame 0xffffff8000298a10 mi_switch() at mi_switch+0x238/frame 0xffffff8000298a60 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8000298aa0 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff8000298ad0 _sleep() at _sleep+0x29a/frame 0xffffff8000298b60 random_kthread() at random_kthread+0x1ad/frame 0xffffff8000298ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000298bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000298bf0 --- trap 0, rip = 0, rsp = 0xffffff8000298cb0, rbp = 0 --- Tracing command geom pid 13 tid 100015 td 0xfffffe0002936000 sched_switch() at sched_switch+0x1b4/frame 0xffffff800028e9f0 mi_switch() at mi_switch+0x238/frame 0xffffff800028ea40 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff800028ea80 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff800028eab0 _sleep() at _sleep+0x3e9/frame 0xffffff800028eb40 g_io_schedule_down() at g_io_schedule_down+0x28c/frame 0xffffff800028eb90 g_down_procbody() at g_down_procbody+0x7c/frame 0xffffff800028eba0 fork_exit() at fork_exit+0x139/frame 0xffffff800028ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800028ebf0 --- trap 0, rip = 0, rsp = 0xffffff800028ecb0, rbp = 0 --- Tracing command geom pid 13 tid 100014 td 0xfffffe0002936480 sched_switch() at sched_switch+0x1b4/frame 0xffffff8000289a20 mi_switch() at mi_switch+0x238/frame 0xffffff8000289a70 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8000289ab0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8000289ae0 _sleep() at _sleep+0x3e9/frame 0xffffff8000289b70 g_io_schedule_up() at g_io_schedule_up+0x138/frame 0xffffff8000289b90 g_up_procbody() at g_up_procbody+0x7c/frame 0xffffff8000289ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000289bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000289bf0 --- trap 0, rip = 0, rsp = 0xffffff8000289cb0, rbp = 0 --- Tracing command geom pid 13 tid 100013 td 0xfffffe0002936900 sched_switch() at sched_switch+0x1b4/frame 0xffffff8000284a20 mi_switch() at mi_switch+0x238/frame 0xffffff8000284a70 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8000284ab0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8000284ae0 _sleep() at _sleep+0x3e9/frame 0xffffff8000284b70 g_run_events() at g_run_events+0x449/frame 0xffffff8000284ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000284bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000284bf0 --- trap 0, rip = 0, rsp = 0xffffff8000284cb0, rbp = 0 --- Tracing command intr pid 12 tid 100067 td 0xfffffe00060dd900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100066 td 0xfffffe00060df000 sched_switch() at sched_switch+0x1b4/frame 0xffffff811513eb00 mi_switch() at mi_switch+0x238/frame 0xffffff811513eb50 ithread_loop() at ithread_loop+0x273/frame 0xffffff811513eba0 fork_exit() at fork_exit+0x139/frame 0xffffff811513ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811513ebf0 --- trap 0, rip = 0, rsp = 0xffffff811513ecb0, rbp = 0 --- Tracing command intr pid 12 tid 100064 td 0xfffffe00060df900 sched_switch() at sched_switch+0x1b4/frame 0xffffff811512ab00 mi_switch() at mi_switch+0x238/frame 0xffffff811512ab50 ithread_loop() at ithread_loop+0x273/frame 0xffffff811512aba0 fork_exit() at fork_exit+0x139/frame 0xffffff811512abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811512abf0 --- trap 0, rip = 0, rsp = 0xffffff811512acb0, rbp = 0 --- Tracing command intr pid 12 tid 100061 td 0xfffffe00060e0900 sched_switch() at sched_switch+0x1b4/frame 0xffffff8114dedb00 mi_switch() at mi_switch+0x238/frame 0xffffff8114dedb50 ithread_loop() at ithread_loop+0x273/frame 0xffffff8114dedba0 fork_exit() at fork_exit+0x139/frame 0xffffff8114dedbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8114dedbf0 --- trap 0, rip = 0, rsp = 0xffffff8114dedcb0, rbp = 0 --- Tracing command intr pid 12 tid 100060 td 0xfffffe00060b8480 sched_switch() at sched_switch+0x1b4/frame 0xffffff8114ddeb00 mi_switch() at mi_switch+0x238/frame 0xffffff8114ddeb50 ithread_loop() at ithread_loop+0x273/frame 0xffffff8114ddeba0 fork_exit() at fork_exit+0x139/frame 0xffffff8114ddebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8114ddebf0 --- trap 0, rip = 0, rsp = 0xffffff8114ddecb0, rbp = 0 --- Tracing command intr pid 12 tid 100055 td 0xfffffe00060c0000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100042 td 0xfffffe00060b7480 sched_switch() at sched_switch+0x1b4/frame 0xffffff8114b56b00 mi_switch() at mi_switch+0x238/frame 0xffffff8114b56b50 ithread_loop() at ithread_loop+0x273/frame 0xffffff8114b56ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8114b56bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8114b56bf0 --- trap 0, rip = 0, rsp = 0xffffff8114b56cb0, rbp = 0 --- Tracing command intr pid 12 tid 100037 td 0xfffffe0002de5900 sched_switch() at sched_switch+0x1b4/frame 0xffffff8114af9b00 mi_switch() at mi_switch+0x238/frame 0xffffff8114af9b50 ithread_loop() at ithread_loop+0x273/frame 0xffffff8114af9ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8114af9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8114af9bf0 --- trap 0, rip = 0, rsp = 0xffffff8114af9cb0, rbp = 0 --- Tracing command intr pid 12 tid 100032 td 0xfffffe0002de7480 sched_switch() at sched_switch+0x1b4/frame 0xffffff8114a9cb00 mi_switch() at mi_switch+0x238/frame 0xffffff8114a9cb50 ithread_loop() at ithread_loop+0x273/frame 0xffffff8114a9cba0 fork_exit() at fork_exit+0x139/frame 0xffffff8114a9cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8114a9cbf0 --- trap 0, rip = 0, rsp = 0xffffff8114a9ccb0, rbp = 0 --- Tracing command intr pid 12 tid 100031 td 0xfffffe0002de7900 sched_switch() at sched_switch+0x1b4/frame 0xffffff80003e6b00 mi_switch() at mi_switch+0x238/frame 0xffffff80003e6b50 ithread_loop() at ithread_loop+0x273/frame 0xffffff80003e6ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80003e6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80003e6bf0 --- trap 0, rip = 0, rsp = 0xffffff80003e6cb0, rbp = 0 --- Tracing command intr pid 12 tid 100030 td 0xfffffe000294b480 sched_switch() at sched_switch+0x1b4/frame 0xffffff80003e1b00 mi_switch() at mi_switch+0x238/frame 0xffffff80003e1b50 ithread_loop() at ithread_loop+0x273/frame 0xffffff80003e1ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80003e1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80003e1bf0 --- trap 0, rip = 0, rsp = 0xffffff80003e1cb0, rbp = 0 --- Tracing command intr pid 12 tid 100029 td 0xfffffe000294b900 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002d5b00 mi_switch() at mi_switch+0x238/frame 0xffffff80002d5b50 ithread_loop() at ithread_loop+0x273/frame 0xffffff80002d5ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002d5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002d5bf0 --- trap 0, rip = 0, rsp = 0xffffff80002d5cb0, rbp = 0 --- Tracing command intr pid 12 tid 100027 td 0xfffffe0002ae1480 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002cbb00 mi_switch() at mi_switch+0x238/frame 0xffffff80002cbb50 ithread_loop() at ithread_loop+0x273/frame 0xffffff80002cbba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002cbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002cbbf0 --- trap 0, rip = 0, rsp = 0xffffff80002cbcb0, rbp = 0 --- Tracing command intr pid 12 tid 100026 td 0xfffffe0002ae1900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100023 td 0xfffffe0002ae2900 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100022 td 0xfffffe0002948000 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002b2b00 mi_switch() at mi_switch+0x238/frame 0xffffff80002b2b50 ithread_loop() at ithread_loop+0x273/frame 0xffffff80002b2ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002b2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002b2bf0 --- trap 0, rip = 0, rsp = 0xffffff80002b2cb0, rbp = 0 --- Tracing command intr pid 12 tid 100012 td 0xfffffe0002937000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100011 td 0xfffffe0002937480 sched_switch() at sched_switch+0x1b4/frame 0xffffff800027ab00 mi_switch() at mi_switch+0x238/frame 0xffffff800027ab50 ithread_loop() at ithread_loop+0x273/frame 0xffffff800027aba0 fork_exit() at fork_exit+0x139/frame 0xffffff800027abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800027abf0 --- trap 0, rip = 0, rsp = 0xffffff800027acb0, rbp = 0 --- Tracing command intr pid 12 tid 100010 td 0xfffffe0002937900 sched_switch() at sched_switch+0x1b4/frame 0xffffff8000275b00 mi_switch() at mi_switch+0x238/frame 0xffffff8000275b50 ithread_loop() at ithread_loop+0x273/frame 0xffffff8000275ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000275bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000275bf0 --- trap 0, rip = 0, rsp = 0xffffff8000275cb0, rbp = 0 --- Tracing command intr pid 12 tid 100009 td 0xfffffe000291e480 sched_switch() at sched_switch+0x1b4/frame 0xffffff8000270b00 mi_switch() at mi_switch+0x238/frame 0xffffff8000270b50 ithread_loop() at ithread_loop+0x273/frame 0xffffff8000270ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000270bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000270bf0 --- trap 0, rip = 0, rsp = 0xffffff8000270cb0, rbp = 0 --- Tracing command intr pid 12 tid 100008 td 0xfffffe000291e900 sched_switch() at sched_switch+0x1b4/frame 0xffffff800026bb00 mi_switch() at mi_switch+0x238/frame 0xffffff800026bb50 ithread_loop() at ithread_loop+0x273/frame 0xffffff800026bba0 fork_exit() at fork_exit+0x139/frame 0xffffff800026bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800026bbf0 --- trap 0, rip = 0, rsp = 0xffffff800026bcb0, rbp = 0 --- Tracing command intr pid 12 tid 100007 td 0xfffffe0002928000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8000266b00 mi_switch() at mi_switch+0x238/frame 0xffffff8000266b50 ithread_loop() at ithread_loop+0x273/frame 0xffffff8000266ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000266bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000266bf0 --- trap 0, rip = 0, rsp = 0xffffff8000266cb0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe0002928480 cpustop_handler() at cpustop_handler+0x2c/frame 0xffffff8000241d00 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xffffff8000241d20 trap() at trap+0x325/frame 0xffffff8000241f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff8000241f20 --- trap 0x13, rip = 0xffffffff80c75486, rsp = 0xffffff8000241fe0, rbp = 0xffffff8000261a90 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000261a90 acpi_cpu_idle() at acpi_cpu_idle+0x2ac/frame 0xffffff8000261ad0 cpu_idle_acpi() at cpu_idle_acpi+0x45/frame 0xffffff8000261af0 cpu_idle() at cpu_idle+0x78/frame 0xffffff8000261b10 sched_idletd() at sched_idletd+0x186/frame 0xffffff8000261ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000261bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000261bf0 --- trap 0, rip = 0, rsp = 0xffffff8000261cb0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe0002928900 sched_switch() at sched_switch+0x1b4/frame 0xffffff800025caa0 mi_switch() at mi_switch+0x238/frame 0xffffff800025caf0 critical_exit() at critical_exit+0xb0/frame 0xffffff800025cb10 sched_idletd() at sched_idletd+0x186/frame 0xffffff800025cba0 fork_exit() at fork_exit+0x139/frame 0xffffff800025cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800025cbf0 --- trap 0, rip = 0, rsp = 0xffffff800025ccb0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe000291d000 cpustop_handler() at cpustop_handler+0x2c/frame 0xffffff8000233d00 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xffffff8000233d20 trap() at trap+0x325/frame 0xffffff8000233f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff8000233f20 --- trap 0x13, rip = 0xffffffff80c75486, rsp = 0xffffff8000233fe0, rbp = 0xffffff8000257a90 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000257a90 acpi_cpu_idle() at acpi_cpu_idle+0x2ac/frame 0xffffff8000257ad0 cpu_idle_acpi() at cpu_idle_acpi+0x45/frame 0xffffff8000257af0 cpu_idle() at cpu_idle+0x78/frame 0xffffff8000257b10 sched_idletd() at sched_idletd+0x186/frame 0xffffff8000257ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000257bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000257bf0 --- trap 0, rip = 0, rsp = 0xffffff8000257cb0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffffe000291d480 cpustop_handler() at cpustop_handler+0x2c/frame 0xffffffff8157eb60 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xffffffff8157eb80 trap() at trap+0x325/frame 0xffffffff8157ed80 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff8157ed80 --- trap 0x13, rip = 0xffffffff80c75486, rsp = 0xffffffff8157ee40, rbp = 0xffffff8000252a90 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000252a90 acpi_cpu_idle() at acpi_cpu_idle+0x2ac/frame 0xffffff8000252ad0 cpu_idle_acpi() at cpu_idle_acpi+0x45/frame 0xffffff8000252af0 cpu_idle() at cpu_idle+0x78/frame 0xffffff8000252b10 sched_idletd() at sched_idletd+0x186/frame 0xffffff8000252ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000252bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000252bf0 --- trap 0, rip = 0, rsp = 0xffffff8000252cb0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffffe000291d900 sched_switch() at sched_switch+0x1b4/frame 0xffffff800024d650 mi_switch() at mi_switch+0x238/frame 0xffffff800024d6a0 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff800024d6e0 sleepq_catch_signals() at sleepq_catch_signals+0x2c6/frame 0xffffff800024d740 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff800024d760 _sleep() at _sleep+0x37d/frame 0xffffff800024d7f0 kern_wait6() at kern_wait6+0x5b3/frame 0xffffff800024d890 kern_wait() at kern_wait+0x12d/frame 0xffffff800024da10 sys_wait4() at sys_wait4+0x35/frame 0xffffff800024dad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff800024dbf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff800024dbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x41241a, rsp = 0x7fffffffd6e8, rbp = 0x7fffffffd74c --- Tracing command audit pid 10 tid 100001 td 0xfffffe000291e000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8000248a00 mi_switch() at mi_switch+0x238/frame 0xffffff8000248a50 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8000248a90 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8000248ac0 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8000248b20 audit_worker() at audit_worker+0x77/frame 0xffffff8000248ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000248bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000248bf0 --- trap 0, rip = 0, rsp = 0xffffff8000248cb0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffffe00060dd000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8115151a10 mi_switch() at mi_switch+0x238/frame 0xffffff8115151a60 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8115151aa0 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff8115151ad0 _sleep() at _sleep+0x29a/frame 0xffffff8115151b60 deadlkres() at deadlkres+0x2b7/frame 0xffffff8115151ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8115151bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8115151bf0 --- trap 0, rip = 0, rsp = 0xffffff8115151cb0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffffe00060dd480 sched_switch() at sched_switch+0x1b4/frame 0xffffff811514ca40 mi_switch() at mi_switch+0x238/frame 0xffffff811514ca90 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811514cad0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811514cb00 msleep_spin() at msleep_spin+0x22d/frame 0xffffff811514cb70 taskqueue_thread_loop() at taskqueue_thread_loop+0x6f/frame 0xffffff811514cba0 fork_exit() at fork_exit+0x139/frame 0xffffff811514cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811514cbf0 --- trap 0, rip = 0, rsp = 0xffffff811514ccb0, rbp = 0 --- Tracing command kernel pid 0 tid 100062 td 0xfffffe00060e0480 sched_switch() at sched_switch+0x1b4/frame 0xffffff811505ca40 mi_switch() at mi_switch+0x238/frame 0xffffff811505ca90 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff811505cad0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff811505cb00 msleep_spin() at msleep_spin+0x22d/frame 0xffffff811505cb70 taskqueue_thread_loop() at taskqueue_thread_loop+0x6f/frame 0xffffff811505cba0 fork_exit() at fork_exit+0x139/frame 0xffffff811505cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff811505cbf0 --- trap 0, rip = 0, rsp = 0xffffff811505ccb0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffffe0002ae2000 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002c1a20 mi_switch() at mi_switch+0x238/frame 0xffffff80002c1a70 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff80002c1ab0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff80002c1ae0 _sleep() at _sleep+0x3e9/frame 0xffffff80002c1b70 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xffffff80002c1ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002c1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002c1bf0 --- trap 0, rip = 0, rsp = 0xffffff80002c1cb0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffffe0002ae2480 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002bca20 mi_switch() at mi_switch+0x238/frame 0xffffff80002bca70 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff80002bcab0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff80002bcae0 _sleep() at _sleep+0x3e9/frame 0xffffff80002bcb70 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xffffff80002bcba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002bcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002bcbf0 --- trap 0, rip = 0, rsp = 0xffffff80002bccb0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffffe0002948480 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002ada40 mi_switch() at mi_switch+0x238/frame 0xffffff80002ada90 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff80002adad0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff80002adb00 msleep_spin() at msleep_spin+0x22d/frame 0xffffff80002adb70 taskqueue_thread_loop() at taskqueue_thread_loop+0x6f/frame 0xffffff80002adba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002adbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002adbf0 --- trap 0, rip = 0, rsp = 0xffffff80002adcb0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffffe0002948900 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002a8a40 mi_switch() at mi_switch+0x238/frame 0xffffff80002a8a90 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff80002a8ad0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff80002a8b00 msleep_spin() at msleep_spin+0x22d/frame 0xffffff80002a8b70 taskqueue_thread_loop() at taskqueue_thread_loop+0x6f/frame 0xffffff80002a8ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002a8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002a8bf0 --- trap 0, rip = 0, rsp = 0xffffff80002a8cb0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffffe0002949000 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002a3a40 mi_switch() at mi_switch+0x238/frame 0xffffff80002a3a90 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff80002a3ad0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff80002a3b00 msleep_spin() at msleep_spin+0x22d/frame 0xffffff80002a3b70 taskqueue_thread_loop() at taskqueue_thread_loop+0x6f/frame 0xffffff80002a3ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002a3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002a3bf0 --- trap 0, rip = 0, rsp = 0xffffff80002a3cb0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffffe0002949480 sched_switch() at sched_switch+0x1b4/frame 0xffffff800029ea20 mi_switch() at mi_switch+0x238/frame 0xffffff800029ea70 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff800029eab0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff800029eae0 _sleep() at _sleep+0x3e9/frame 0xffffff800029eb70 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xffffff800029eba0 fork_exit() at fork_exit+0x139/frame 0xffffff800029ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800029ebf0 --- trap 0, rip = 0, rsp = 0xffffff800029ecb0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffffe000294b000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8000293a20 mi_switch() at mi_switch+0x238/frame 0xffffff8000293a70 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffff8000293ab0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8000293ae0 _sleep() at _sleep+0x3e9/frame 0xffffff8000293b70 taskqueue_thread_loop() at taskqueue_thread_loop+0xc7/frame 0xffffff8000293ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000293bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000293bf0 --- trap 0, rip = 0, rsp = 0xffffff8000293cb0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff813612b0 sched_switch() at sched_switch+0x1b4/frame 0xffffffff818fab00 mi_switch() at mi_switch+0x238/frame 0xffffffff818fab50 sleepq_switch() at sleepq_switch+0xfe/frame 0xffffffff818fab90 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffffff818fabc0 _sleep() at _sleep+0x29a/frame 0xffffffff818fac50 scheduler() at scheduler+0x2b0/frame 0xffffffff818fac90 mi_startup() at mi_startup+0x77/frame 0xffffffff818facb0 btext() at btext+0x2c db:0:allt> call doadump Dumping 318 out of 3944 MB:..6%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete = 0 db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 2 (kgdb) bt #0 doadump (textdump=0x291c000) at ../../../kern/kern_shutdown.c:263 #1 0xffffffff803424ac in db_fncall (dummy1=Variable "dummy1" is not available. ) at ../../../ddb/db_command.c:578 #2 0xffffffff8034275d in db_command (last_cmdp=0xffffffff813245e0, cmd_table=Variable "cmd_table" is not available. ) at ../../../ddb/db_command.c:449 #3 0xffffffff803472f3 in db_script_exec (scriptname=0xffffffff81324e80 "doadump", warnifnotfound=0x1) at ../../../ddb/db_script.c:302 #4 0xffffffff803427e1 in db_command (last_cmdp=0xffffffff813245e0, cmd_table=Variable "cmd_table" is not available. ) at ../../../ddb/db_command.c:449 #5 0xffffffff80342a30 in db_command_loop () at ../../../ddb/db_command.c:502 #6 0xffffffff80344ba9 in db_trap (type=Variable "type" is not available. ) at ../../../ddb/db_main.c:231 #7 0xffffffff80928a48 in kdb_trap (type=0xc, code=0x0, tf=0xffffff811e59a420) at ../../../kern/subr_kdb.c:654 #8 0xffffffff80c90abd in trap_fatal (frame=0xffffff811e59a420, eva=Variable "eva" is not available. ) at ../../../amd64/amd64/trap.c:867 #9 0xffffffff80c90c7a in trap_pfault (frame=0xffffff811e59a420, usermode=0x0) at ../../../amd64/amd64/trap.c:789 #10 0xffffffff80c913ba in trap (frame=0xffffff811e59a420) at ../../../amd64/amd64/trap.c:463 #11 0xffffffff80c7a083 in calltrap () at ../../../amd64/amd64/exception.S:228 #12 0xffffffff809a72f7 in strncmp (s1=0xffffff80044702a9
, s2=0xffffffff80f5ea59 "__start_", n=0x8) at ../../../libkern/strncmp.c:44 #13 0xffffffff80cf9323 in link_elf_reloc_local (lf=Variable "lf" is not available. ) at ../../../kern/link_elf_obj.c:1265 #14 0xffffffff80cfb52c in link_elf_load_file (cls=Variable "cls" is not available. ) at ../../../kern/link_elf_obj.c:843 #15 0xffffffff808d07d8 in linker_load_module (kldname=Variable "kldname" is not available. ) at linker_if.h:161 #16 0xffffffff808d0eec in kern_kldload (td=0xfffffe0008c99480, file=0xfffffe0008b93000 "linux", fileid=0xffffff811e59aab4) at ../../../kern/kern_linker.c:1041 #17 0xffffffff808d1064 in sys_kldload (td=0xfffffe0008c99480, uap=Variable "uap" is not available. ) at ../../../kern/kern_linker.c:1075 #18 0xffffffff80c900e3 in amd64_syscall (td=0xfffffe0008c99480, traced=0x0) at subr_syscall.c:135 #19 0xffffffff80c7a367 in Xfast_syscall () at ../../../amd64/amd64/exception.S:387 #20 0x000000080088136a in ?? () (kgdb) f 12 #12 0xffffffff809a72f7 in strncmp (s1=0xffffff80044702a9
, s2=0xffffffff80f5ea59 "__start_", n=0x8) at ../../../libkern/strncmp.c:44 44 if (*s1 != *s2++) (kgdb) p s2 $3 = 0xffffffff80f5ea59 "__start_" (kgdb) p s1 $4 = 0xffffff80044702a9
(kgdb) f 13 #13 0xffffffff80cf9323 in link_elf_reloc_local (lf=Variable "lf" is not available. ) at ../../../kern/link_elf_obj.c:1265 1265 if (strncmp(sym_name, startn, sizeof(startn) - 1) == 0) { (kgdb) l 1260 sym = ef->ddbsymtab + symidx; 1261 if (sym->st_shndx != SHN_UNDEF) 1262 continue; 1263 1264 sym_name = ef->ddbstrtab + sym->st_name; 1265 if (strncmp(sym_name, startn, sizeof(startn) - 1) == 0) { 1266 start = 1; 1267 linkset_name = sym_name + sizeof(startn) - 1; 1268 } 1269 else if (strncmp(sym_name, stopn, sizeof(stopn) - 1) == 0) { (kgdb) info loc ef = 0xfffffe0008dd4200 rellim = Variable "rellim" is not available. (kgdb) $ svn diff -x -p /var/tmp/r234951/sys Index: /var/tmp/r234951/sys/kern/kern_timeout.c =================================================================== --- /var/tmp/r234951/sys/kern/kern_timeout.c (revision 234951) +++ /var/tmp/r234951/sys/kern/kern_timeout.c (working copy) @@ -741,6 +741,8 @@ callout_handle_init(struct callout_handle *handle) handle->callout = NULL; } +int pho; + /* * New interface; clients allocate their own callout structures. * @@ -764,6 +766,7 @@ callout_reset_on(struct callout *c, int to_ticks, struct callout_cpu *cc; int cancelled = 0; + pho++; /* * Don't allow migration of pre-allocated callouts lest they * become unbalanced.