KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2018 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 12.0-CURRENT #0 r328113: Thu Jan 18 09:37:16 CET 2018 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 5.0.1 (tags/RELEASE_501/final 320880) (based on LLVM 5.0.1) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.07-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33180536832 (31643 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads arc4random: no preloaded entropy cache ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-47 on motherboard SMP: AP CPU #1 Launched! SMP: AP CPU #11 Launched! SMP: AP CPU #5 Launched! SMP: AP CPU #10 Launched! SMP: AP CPU #7 Launched! SMP: AP CPU #2 Launched! SMP: AP CPU #6 Launched! SMP: AP CPU #3 Launched! SMP: AP CPU #8 Launched! SMP: AP CPU #9 Launched! SMP: AP CPU #4 Launched! Timecounter "TSC-low" frequency 1750037326 Hz quality 1000 random: entropy device external interface [ath_hal] loaded module_register_init: MOD_LOAD (vesa, 0xffffffff80fca330, 0) error 19 random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" kbd1 at kbdmux0 netmap: loaded module nexus0 vtvga0: on motherboard cryptosoft0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) cpu0: on acpi0 cpu1: on acpi0 cpu2: on acpi0 cpu3: on acpi0 cpu4: on acpi0 cpu5: on acpi0 cpu6: on acpi0 cpu7: on acpi0 cpu8: on acpi0 cpu9: on acpi0 cpu10: on acpi0 cpu11: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: attach_pre capping queues at 8 igb0: using 1024 tx descriptors and 1024 rx descriptors igb0: msix_init qsets capped at 8 igb0: pxm cpus: 6 queue msgs: 9 admincnt: 1 igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: using 6 rx queues 6 tx queues igb0: Using MSIX interrupts with 7 vectors igb0: allocated for 6 tx_queues igb0: allocated for 6 rx_queues igb0: Ethernet address: 0c:c4:7a:a8:cd:da igb0: netmap queues/slots: TX 6/1024, RX 6/1024 igb1: port 0xd000-0xd01f mem 0xfb300000-0xfb31ffff,0xfb340000-0xfb343fff irq 17 at device 0.1 on pci8 igb1: attach_pre capping queues at 8 igb1: using 1024 tx descriptors and 1024 rx descriptors igb1: msix_init qsets capped at 8 igb1: pxm cpus: 6 queue msgs: 9 admincnt: 1 igb1: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb1: using 6 rx queues 6 tx queues igb1: Using MSIX interrupts with 7 vectors igb1: allocated for 6 tx_queues igb1: allocated for 6 rx_queues igb1: Ethernet address: 0c:c4:7a:a8:cd:db igb1: netmap queues/slots: TX 6/1024, RX 6/1024 ehci1: mem 0xfb433000-0xfb4333ff irq 18 at device 29.0 on pci1 usbus2: EHCI version 1.0 usbus2 on ehci1 usbus2: 480Mbps High Speed USB v2.0 isab0: at device 31.0 on pci1 isa0: on isab0 ahci1: port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf000-0xf01f mem 0xfb432000-0xfb4327ff irq 16 at device 31.2 on pci1 ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich4: at channel 0 on ahci1 ahcich5: at channel 1 on ahci1 ahcich6: at channel 2 on ahci1 ahcich7: at channel 3 on ahci1 ahcich8: at channel 4 on ahci1 ahcich9: at channel 5 on ahci1 ahciem1: on ahci1 acpi_button0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 uart1: console (115200,n,8,1) orm0: at iomem 0xc0000-0xc7fff,0xcb000-0xcbfff pnpid ORM0000 on isa0 est0: on cpu0 p4tcc0: on cpu0 est1: on cpu1 p4tcc1: on cpu1 est2: on cpu2 p4tcc2: on cpu2 est3: on cpu3 p4tcc3: on cpu3 est4: on cpu4 p4tcc4: on cpu4 est5: on cpu5 p4tcc5: on cpu5 est6: on cpu6 p4tcc6: on cpu6 est7: on cpu7 p4tcc7: on cpu7 est8: on cpu8 p4tcc8: on cpu8 est9: on cpu9 p4tcc9: on cpu9 est10: on cpu10 p4tcc10: on cpu10 est11: on cpu11 p4tcc11: on cpu11 NULL mp in getnewvnode(9), tag crossmp Timecounters tick every 1.000 msec arc4random: no preloaded entropy cache ugen0.1: <0x8086 XHCI root HUB> at usbus0 ugen1.1: at usbus1 uhub0: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0 ugen2.1: at usbus2 uhub1: on usbus1 uhub2: on usbus2 Expensive timeout(9) function: 0xffffffff8041f5f0(0xfffffe009c5f9000) 0.002989256 s ses0 at ahciem0 bus 0 scbus4 target 0 lun 0 ses0: SEMB ounted tem checks: 000, class 9/0, rev 2.00/0.00, addr 1> on usbus0 uhub4: 6 ports with 6 removable, self powered uhub5: 4 ports with 3 removable, self powered uhub3: 8 ports with 8 removable, self powered Writing entropy lock order reversal: 1st 0xfffffe0000e3fef0 bufwait (bufwait) @ kern/vfs_bio.c:3564 2nd 0xfffff80013895c00 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:289 stack backtrace: file:#0 0xffffffff80afafd3 at witness_debugger+0x73 #1 0xffffffff80afae52 at witness_checkorder+0xe02 #2 0xffffffff80a9e998 at _sx_xlock+0x68 #3 0xffffffff80d984e7 at ufsdirhash_remove+0x47 #4 0xffffffff80d9d2d9 at ufs_dirremove+0x129 #5 0xffffffff80da30a5 at ufs_remove+0x75 #6 0xffffffff810c831d at VOP_REMOVE_APV+0x11d #7 0xffffffff80b70978 at kern_unlinkat+0x1e8 #8 0xffffffff80f4b34b at amd64_syscall+0x7ab #9 0xffffffff80f278cc at fast_syscall_common+0x100 . Setting hostname: mercat1.netperf.freebsd.org. ugen0.3: at usbus0 ukbd0 on uhub5 ukbd0: on usbus0 kbd2 at ukbd0 Starting casperd. Clearing /tmp (X related). Starting statd. Starting lockd. Updating motd:. Mounting late file systems:. Configuring syscons: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Thu Jan 18 19:50 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root Jan 18 19:51:21 mercat1 login: ROOT LOGIN (root) ON ttyu1 Last login: Thu Jan 18 10:46:01 on ttyu1 FreeBSD 12.0-CURRENT (PHO) #0 r328113: Thu Jan 18 09:37:16 CET 2018 Welcome to FreeBSD! Before seeking technical support, please use the following resources: o Security advisories and updated errata information for all releases are at http://www.FreeBSD.org/releases/ - always consult the ERRATA section for your release first as it's updated frequently. o The Handbook and FAQ documents are at http://www.FreeBSD.org/ and, along with the mailing lists, can be searched by going to http://www.FreeBSD.org/search/. If the doc package has been installed (or fetched via pkg install lang-freebsd-doc, where lang is the 2-letter language code, e.g. en), they are also available formatted in /usr/local/share/doc/freebsd. If you still have a question or problem, please take the output of `uname -a', along with any relevant error messages, and email it as a question to the questions@FreeBSD.org mailing list. If you are unfamiliar with FreeBSD's directory layout, please refer to the hier(7) manual page. If you are not familiar with manual pages, type `man man'. Edit /etc/motd to change this login announcement. root@mercat1:~ # lock order reversal: 1st 0xfffff80013acd548 ufs (ufs) @ kern/vfs_mount.c:1280 2nd 0xfffff80013bf1548 devfs (devfs) @ ufs/ffs/ffs_vfsops.c:1628 stack backtrace: #0 0xffffffff80afafd3 at witness_debugger+0x73 #1 0xffffffff80afae52 at witness_checkorder+0xe02 #2 0xffffffff80a6b16f at lockmgr_lock_fast_path+0x1bf #3 0xffffffff810c95c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80b77336 at _vn_lock+0x66 #5 0xffffffff80d915ed at ffs_sync+0x1cd #6 0xffffffff80b5d594 at dounmount+0x554 #7 0xffffffff80b5cfbf at sys_unmount+0x30f #8 0xffffffff80f4b34b at amd64_syscall+0x7ab #9 0xffffffff80f278cc at fast_syscall_common+0x100 cd /stress2/misc root@mercat1:/stress2/misc # cat pmc2.sh #!/bin/sh # # Copyright (c) 2017 Dell EMC Isilon # All rights reserved. # # Redistribution and use in source and binary forms, with or without # modification, are permitted provided that the following conditions # are met: # 1. Redistributions of source code must retain the above copyright # notice, this list of conditions and the following disclaimer. # 2. Redistributions in binary form must reproduce the above copyright # notice, this list of conditions and the following disclaimer in the # documentation and/or other materials provided with the distribution. # # THIS SOFTWARE IS PROVIDED BY THE AUTHOR AND CONTRIBUTORS ``AS IS'' AND # ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE # IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE # ARE DISCLAIMED. IN NO EVENT SHALL THE AUTHOR OR CONTRIBUTORS BE LIABLE # FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL # DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS # OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) # HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT # LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY # OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF # SUCH DAMAGE. # # $FreeBSD$ # [ `id -u ` -ne 0 ] && echo "Must be root!" && exit 1 . ../default.cfg kldstat -v | grep -q hwpmc || { kldload hwpmc; loaded=1; } ../misc/churn.sh & pid=$! while ! pgrep -q churn; do sleep .5; done pmcstat -P instructions -t churn -O /tmp/pmc2.log wait $pid rm /tmp/pmc2.log [ $loaded ] && kldunload hwpmc exit 0 root@mercat1:/stress2/misc # ./pmc2.sh kernel trap 12 with interrupts disabled Fatal trap 12: page fault while in kernel mode kernel trap 12 with interrupts disabled cpuid = 11; apic id = 0b kernel trap 12 with interrupts disabled fault virtual address = 0xdc90 Fatal trap 12: page fault while in kernel mode Fatal trap 12: page fault while in kernel mode cpuid = 3; apic id = 03 fault virtual address = 0x14f80 fault code = supervisor write data, page not present fault code = supervisor write data, page not present instruction pointer = 0x20:0xffffffff80f27a92 stack pointer = 0x0:0xfffffe00071bbf30 frame pointer = 0x0:0x7fffffffe7d0 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = cpuid = 1; apic id = 01 fault virtual address = 0x14590 resume, fault code = supervisor write data, page not present instruction pointer = 0x20:0xffffffff80f27a92 stack pointer = 0x0:0xfffffe00071fbf30 frame pointer = 0x0:0x7fffffffe7d0 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = resume, IOPL = 0 current process = 852 (churn) [ thread pid 852 tid 100207 ] Stopped at nmi_fromuserspace+0x46: movq %rax,offset+0x8(%rdi) db> bt Tracing pid 852 tid 100207 td 0xfffff801500fe560 nmi_fromuserspace() at nmi_fromuserspace+0x46/frame 0x7fffffffe7d0 db> run pho db:0:pho> bt Tracing pid 852 tid 100207 td 0xfffff801500fe560 nmi_fromuserspace() at nmi_fromuserspace+0x46/frame 0x7fffffffe7d0 db:0:bt> show allpcpu Current CPU: 11 cpuid = 0 dynamic pcpu = 0xa04740 curthread = 0xfffff8000391d000: pid 11 tid 100003 "idle: cpu0" curpcb = 0xfffffe007895ab80 fpcurthread = none idlethread = 0xfffff8000391d000: tid 100003 "idle: cpu0" curpmap = 0xffffffff81ede238 tssp = 0xffffffff81f04510 commontssp = 0xffffffff81f04510 rsp0 = 0xfffffe007895ab80 gs32p = 0xffffffff81f0ad58 ldt = 0xffffffff81f0ad98 tss = 0xffffffff81f0ad88 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe007e977740 curthread = 0xfffff80013d40560: pid 846 tid 100202 "churn" curpcb = 0xfffffe009ed3ab80 fpcurthread = none idlethread = 0xfffff8000391c560: tid 100004 "idle: cpu1" curpmap = 0xfffff80013ab6130 tssp = 0xffffffff81f04578 commontssp = 0xffffffff81f04578 rsp0 = 0xfffffe009ed3ab80 gs32p = 0xffffffff81f0adc0 ldt = 0xffffffff81f0ae00 tss = 0xffffffff81f0adf0 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe008572d740 curthread = 0xfffff8000391c000: pid 11 tid 100005 "idle: cpu2" curpcb = 0xfffffe0078964b80 fpcurthread = none idlethread = 0xfffff8000391c000: tid 100005 "idle: cpu2" curpmap = 0xffffffff81ede238 tssp = 0xffffffff81f045e0 commontssp = 0xffffffff81f045e0 rsp0 = 0xfffffe0078964b80 gs32p = 0xffffffff81f0ae28 ldt = 0xffffffff81f0ae68 tss = 0xffffffff81f0ae58 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe0085735740 curthread = 0xfffff80013cd6560: pid 850 tid 100206 "churn" curpcb = 0xfffffe009ed4eb80 fpcurthread = none idlethread = 0xfffff8000391b560: tid 100006 "idle: cpu3" curpmap = 0xfffff80013949130 tssp = 0xffffffff81f04648 commontssp = 0xffffffff81f04648 rsp0 = 0xfffffe009ed4eb80 gs32p = 0xffffffff81f0ae90 ldt = 0xffffffff81f0aed0 tss = 0xffffffff81f0aec0 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe008573d740 curthread = 0xfffff80003c5e000: pid 19 tid 100090 "doneq1" curpcb = 0xfffffe000050eb80 fpcurthread = none idlethread = 0xfffff8000391b000: tid 100007 "idle: cpu4" curpmap = 0xffffffff81ede238 tssp = 0xffffffff81f046b0 commontssp = 0xffffffff81f046b0 rsp0 = 0xfffffe000050eb80 gs32p = 0xffffffff81f0aef8 ldt = 0xffffffff81f0af38 tss = 0xffffffff81f0af28 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe0085745740 curthread = 0xfffff80003915560: pid 11 tid 100008 "idle: cpu5" curpcb = 0xfffffe0078973b80 fpcurthread = none idlethread = 0xfffff80003915560: tid 100008 "idle: cpu5" curpmap = 0xffffffff81ede238 tssp = 0xffffffff81f04718 commontssp = 0xffffffff81f04718 rsp0 = 0xfffffe0078973b80 gs32p = 0xffffffff81f0af60 ldt = 0xffffffff81f0afa0 tss = 0xffffffff81f0af90 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe008574d740 curthread = 0xfffff80003915000: pid 11 tid 100009 "idle: cpu6" curpcb = 0xfffffe0078978b80 fpcurthread = none idlethread = 0xfffff80003915000: tid 100009 "idle: cpu6" curpmap = 0xffffffff81ede238 tssp = 0xffffffff81f04780 commontssp = 0xffffffff81f04780 rsp0 = 0xfffffe0078978b80 gs32p = 0xffffffff81f0afc8 ldt = 0xffffffff81f0b008 tss = 0xffffffff81f0aff8 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe0085755740 curthread = 0xfffff80003932560: pid 11 tid 100010 "idle: cpu7" curpcb = 0xfffffe007897db80 fpcurthread = none idlethread = 0xfffff80003932560: tid 100010 "idle: cpu7" curpmap = 0xffffffff81ede238 tssp = 0xffffffff81f047e8 commontssp = 0xffffffff81f047e8 rsp0 = 0xfffffe007897db80 gs32p = 0xffffffff81f0b030 ldt = 0xffffffff81f0b070 tss = 0xffffffff81f0b060 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe008575d740 curthread = 0xfffff80003932000: pid 11 tid 100011 "idle: cpu8" curpcb = 0xfffffe0078982b80 fpcurthread = none idlethread = 0xfffff80003932000: tid 100011 "idle: cpu8" curpmap = 0xffffffff81ede238 tssp = 0xffffffff81f04850 commontssp = 0xffffffff81f04850 rsp0 = 0xfffffe0078982b80 gs32p = 0xffffffff81f0b098 ldt = 0xffffffff81f0b0d8 tss = 0xffffffff81f0b0c8 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe0085765740 curthread = 0xfffff80003931560: pid 11 tid 100012 "idle: cpu9" curpcb = 0xfffffe0078987b80 fpcurthread = none idlethread = 0xfffff80003931560: tid 100012 "idle: cpu9" curpmap = 0xffffffff81ede238 tssp = 0xffffffff81f048b8 commontssp = 0xffffffff81f048b8 rsp0 = 0xfffffe0078987b80 gs32p = 0xffffffff81f0b100 ldt = 0xffffffff81f0b140 tss = 0xffffffff81f0b130 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe008576d740 curthread = 0xfffff80003931000: pid 11 tid 100013 "idle: cpu10" curpcb = 0xfffffe007898cb80 fpcurthread = none idlethread = 0xfffff80003931000: tid 100013 "idle: cpu10" curpmap = 0xffffffff81ede238 tssp = 0xffffffff81f04920 commontssp = 0xffffffff81f04920 rsp0 = 0xfffffe007898cb80 gs32p = 0xffffffff81f0b168 ldt = 0xffffffff81f0b1a8 tss = 0xffffffff81f0b198 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe0085775740 curthread = 0xfffff801500fe560: pid 852 tid 100207 "churn" curpcb = 0xfffffe009ed53b80 fpcurthread = none idlethread = 0xfffff80003930560: tid 100014 "idle: cpu11" curpmap = 0xfffff8015017f130 tssp = 0xffffffff81f04988 commontssp = 0xffffffff81f04988 rsp0 = 0xfffffe009ed53b80 gs32p = 0xffffffff81f0b1d0 ldt = 0xffffffff81f0b210 tss = 0xffffffff81f0b200 curvnet = 0 spin locks held: db:0:allpcpu> show alllocks Process 853 (churn) thread 0xfffff80013b5d560 (100217) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe000105f958) locked @ ufs/ffs/ffs_vnops.c:282 exclusive lockmgr ufs (ufs) r = 0 (0xfffff801501402d8) locked @ kern/vfs_vnops.c:568 Process 851 (churn) thread 0xfffff8004b0fb000 (100229) exclusive lockmgr ufs (ufs) r = 0 (0xfffff8004b4827b8) locked @ kern/vfs_lookup.c:671 Process 19 (cam) thread 0xfffff80003c5e000 (100090) exclusive sleep mutex vm page free queue (vm page free queue) r = 0 (0xffffffff8193ff40) locked @ vm/vm_page.c:3049 exclusive sleep mutex vm page (vm page) r = 0 (0xffffffff8193c100) locked @ kern/vfs_bio.c:2623 exclusive rw vm object (vm object) r = 0 (0xfffff80013a0f300) locked @ kern/vfs_bio.c:2684 db:0:alllocks> show lockedvnods Locked vnodes vnode 0xfffff8004b482750: tag ufs, type VDIR usecount 22, writecount 0, refcount 25 mountedhere 0 flags (VV_ROOT|VI_ACTIVE) v_object 0xfffff8001386dc00 ref 0 pages 1 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8004b0fb000 (pid 851, churn, tid 100229) with shared waiters pending #0 0xffffffff80a6b990 at __lockmgr_args+0x760 #1 0xffffffff80d92e5f at ffs_lock+0xaf #2 0xffffffff810c95c1 at VOP_LOCK1_APV+0xe1 #3 0xffffffff80b77336 at _vn_lock+0x66 #4 0xffffffff80b58c26 at lookup+0x116 #5 0xffffffff80b586ea at namei+0x53a #6 0xffffffff80b76a28 at vn_open_cred+0xd8 #7 0xffffffff80a99f0d at sigexit+0x55d #8 0xffffffff80a9a9f0 at postsig+0x1c0 #9 0xffffffff80af0518 at ast+0x4f8 #10 0xffffffff80f29769 at doreti_ast+0x1f ino 2, on dev gpt/tmp vnode 0xfffff80150140270: tag ufs, type VREG usecount 1, writecount 1, refcount 4 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8004b9a9c00 ref 0 pages 8 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80013b5d560 (pid 853, churn, tid 100217) with exclusive waiters pending #0 0xffffffff80a6bde1 at __lockmgr_args+0xbb1 #1 0xffffffff80d92e5f at ffs_lock+0xaf #2 0xffffffff810c95c1 at VOP_LOCK1_APV+0xe1 #3 0xffffffff80b77336 at _vn_lock+0x66 #4 0xffffffff80b776b8 at vn_rdwr+0x128 #5 0xffffffff80b77cf2 at vn_rdwr_inchunks+0x92 #6 0xffffffff80a24b6e at elf64_coredump+0xd6e #7 0xffffffff80a9a180 at sigexit+0x7d0 #8 0xffffffff80a9a9f0 at postsig+0x1c0 #9 0xffffffff80af0518 at ast+0x4f8 #10 0xffffffff80f29769 at doreti_ast+0x1f ino 76, on dev gpt/tmp db:0:lockedvnods> show allchains chain 1: thread 100235 (pid 858, hwpmc: proc(857)) sleeping on 0xfffff80013405800 "pmcloop" chain 2: thread 100168 (pid 857, pmcstat) sleeping on 0xfffff800041d8000 "kqread" chain 3: thread 100215 (pid 855, test2) blocked on lockmgr ufsEXCL thread 100229 (pid 851, test2) blocked on lockmgr ufsEXCL thread 100217 (pid 853, test2) sleeping on 0xfffffe000105f8d8 "biowr" chain 4: thread 100220 (pid 854, test2) blocked on lockmgr ufsEXCL thread 100229 (pid 851, test2) blocked on lockmgr ufsEXCL thread 100217 (pid 853, test2) sleeping on 0xfffffe000105f8d8 "biowr" chain 5: thread 100217 (pid 853, test2) sleeping on 0xfffffe000105f8d8 "biowr" chain 6: thread 100229 (pid 851, test2) blocked on lockmgr ufsEXCL thread 100217 (pid 853, test2) sleeping on 0xfffffe000105f8d8 "biowr" chain 7: thread 100219 (pid 849, test2) blocked on lockmgr ufsEXCL thread 100229 (pid 851, test2) blocked on lockmgr ufsEXCL thread 100217 (pid 853, test2) sleeping on 0xfffffe000105f8d8 "biowr" chain 8: thread 100211 (pid 848, test2) blocked on lockmgr ufsEXCL thread 100229 (pid 851, test2) blocked on lockmgr ufsEXCL thread 100217 (pid 853, test2) sleeping on 0xfffffe000105f8d8 "biowr" chain 9: thread 100230 (pid 847, test2) blocked on lockmgr ufsEXCL thread 100229 (pid 851, test2) blocked on lockmgr ufsEXCL thread 100217 (pid 853, test2) sleeping on 0xfffffe000105f8d8 "biowr" chain 10: thread 100214 (pid 846, test2) sleeping on 0xffffffff81ce3166 "nanslp" chain 11: thread 100231 (pid 846, test2) sleeping on 0xffffffff81ce3166 "nanslp" chain 12: thread 100227 (pid 845, test2) blocked on lockmgr ufsEXCL thread 100229 (pid 851, test2) blocked on lockmgr ufsEXCL thread 100217 (pid 853, test2) sleeping on 0xfffffe000105f8d8 "biowr" chain 13: thread 100225 (pid 844, test2) blocked on lockmgr ufsEXCL thread 100229 (pid 851, test2) blocked on lockmgr ufsEXCL thread 100217 (pid 853, test2) sleeping on 0xfffffe000105f8d8 "biowr" chain 14: thread 100162 (pid 843, churn) sleeping on 0xfffff80013d7e538 "wait" chain 15: thread 100200 (pid 822, sh) sleeping on 0xfffff80013d4a538 "wait" chain 16: thread 100136 (pid 814, sh) sleeping on 0xfffff800139caa70 "wait" chain 17: thread 100152 (pid 803, csh) sleeping on 0xfffff8004bd594b0 "ttyin" chain 18: thread 100196 (pid 802, su) sleeping on 0xfffff8004ba65538 "wait" chain 19: thread 100184 (pid 801, bash) sleeping on 0xfffff80013931000 "wait" chain 20: thread 100174 (pid 800, sshd) sleeping on 0xfffff800131cf740 "select" chain 21: thread 100160 (pid 797, sshd) sleeping on 0xfffff8000413e940 "select" chain 22: thread 100197 (pid 794, csh) sleeping on 0xfffff8004b12cb18 "pause" chain 23: thread 100135 (pid 793, dhclient) sleeping on 0xfffff8000413e9c0 "select" chain 24: thread 100195 (pid 748, login) sleeping on 0xfffff8004ba65a70 "wait" chain 25: thread 100194 (pid 747, getty) sleeping on 0xfffff800080710b0 "ttyin" chain 26: thread 100193 (pid 746, getty) sleeping on 0xfffff800132c3cb0 "ttyin" chain 27: thread 100192 (pid 745, getty) sleeping on 0xfffff800132c50b0 "ttyin" chain 28: thread 100191 (pid 744, getty) sleeping on 0xfffff800132c54b0 "ttyin" chain 29: thread 100190 (pid 743, getty) sleeping on 0xfffff800132c58b0 "ttyin" chain 30: thread 100189 (pid 742, getty) sleeping on 0xfffff800132c5cb0 "ttyin" chain 31: thread 100188 (pid 741, getty) sleeping on 0xfffff800132c60b0 "ttyin" chain 32: thread 100169 (pid 740, getty) sleeping on 0xfffff800132c64b0 "ttyin" chain 33: thread 100134 (pid 739, getty) sleeping on 0xfffff800132c68b0 "ttyin" chain 34: thread 100183 (pid 705, cron) sleeping on 0xffffffff81ce3161 "nanslp" chain 35: thread 100150 (pid 701, sshd) sleeping on 0xfffff800033b0440 "select" chain 36: thread 100179 (pid 636, NLM: master) sleeping on 0xfffff80003f45260 "rpcsvc" chain 37: thread 100177 (pid 633, rpc.statd) sleeping on 0xfffff80013398840 "select" chain 38: thread 100156 (pid 598, casperd) sleeping on 0xfffff80003f25140 "select" chain 39: thread 100172 (pid 595, casperd) sleeping on 0xfffff800133d47c0 "select" chain 40: thread 100165 (pid 583, dhclient) sleeping on 0xfffff800133d4840 "select" chain 41: thread 100173 (pid 577, dhclient) sleeping on 0xfffff800132c01c0 "select" chain 42: thread 100157 (pid 538, rpcbind) sleeping on 0xfffff800133988c0 "select" chain 43: thread 100159 (pid 533, syslogd) sleeping on 0xfffff80003f251c0 "select" chain 44: thread 100166 (pid 458, devd) sleeping on 0xfffff80003a84c40 "select" chain 45: thread 100132 (pid 34, vnlru) sleeping on 0xfffff80013111538 "vlruwt" chain 46: thread 100131 (pid 33, syncer) sleeping on 0xffffffff81e886c0 "syncer" chain 47: thread 100130 (pid 32, bufspacedaemon) sleeping on 0xffffffff81e87c1c "-" chain 48: thread 100128 (pid 31, bufdaemon) sleeping on 0xffffffff81e879f8 "psleep" chain 49: thread 100145 (pid 31, / worker) sleeping on 0xfffff800080752e8 "sdflush" chain 50: thread 100198 (pid 31, /tmp worker) sleeping on 0xfffff8015000dae8 "sdflush" chain 51: thread 100127 (pid 30, vmdaemon) sleeping on 0xffffffff81e94178 "psleep" chain 52: thread 100126 (pid 29, pagedaemon) sleeping on 0xffffffff81e9057c "psleep" chain 53: thread 100129 (pid 29, laundry: dom0) sleeping on 0xffffffff81e90588 "launds" chain 54: thread 100133 (pid 29, uma) sleeping on 0xffffffff80db0a60 "umarcl" chain 55: thread 100125 (pid 28, enc_daemon1) sleeping on 0xfffff80013039000 "idle" chain 56: thread 100124 (pid 27, enc_daemon0) sleeping on 0xfffff80013039538 "idle" chain 57: thread 100118 (pid 26, rand_harvestq) sleeping on 0xffffffff81bb6138 "-" chain 58: thread 100117 (pid 25, sctp_iterator) sleeping on 0xffffffff81f00bc0 "waiting_for_work" chain 59: thread 100116 (pid 24, soaiod4) sleeping on 0xffffffff81e873f4 "-" chain 60: thread 100115 (pid 23, soaiod3) sleeping on 0xffffffff81e873f4 "-" chain 61: thread 100114 (pid 22, soaiod2) sleeping on 0xffffffff81e873f4 "-" chain 62: thread 100113 (pid 21, soaiod1) sleeping on 0xffffffff81e873f4 "-" chain 63: thread 100094 (pid 20, usbus0) sleeping on 0xfffffe009c7c1460 "-" chain 64: thread 100095 (pid 20, usbus0) sleeping on 0xfffffe009c7c14b8 "-" chain 65: thread 100096 (pid 20, usbus0) sleeping on 0xfffffe009c7c1510 "-" chain 66: thread 100097 (pid 20, usbus0) sleeping on 0xfffffe009c7c1568 "-" chain 67: thread 100098 (pid 20, usbus0) sleeping on 0xfffffe009c7c15c0 "-" chain 68: thread 100100 (pid 20, usbus1) sleeping on 0xfffffe009a5bfd10 "-" chain 69: thread 100101 (pid 20, usbus1) sleeping on 0xfffffe009a5bfd68 "-" chain 70: thread 100102 (pid 20, usbus1) sleeping on 0xfffffe009a5bfdc0 "-" chain 71: thread 100103 (pid 20, usbus1) sleeping on 0xfffffe009a5bfe18 "-" chain 72: thread 100104 (pid 20, usbus1) sleeping on 0xfffffe009a5bfe70 "-" chain 73: thread 100105 (pid 20, usbus2) sleeping on 0xfffffe009ca42d10 "-" chain 74: thread 100106 (pid 20, usbus2) sleeping on 0xfffffe009ca42d68 "-" chain 75: thread 100107 (pid 20, usbus2) sleeping on 0xfffffe009ca42dc0 "-" chain 76: thread 100108 (pid 20, usbus2) sleeping on 0xfffffe009ca42e18 "-" chain 77: thread 100109 (pid 20, usbus2) sleeping on 0xfffffe009ca42e70 "-" chain 78: thread 100089 (pid 19, doneq0) sleeping on 0xffffffff81a91440 "-" chain 79: thread 100091 (pid 19, doneq2) sleeping on 0xffffffff81a91540 "-" chain 80: thread 100123 (pid 19, scanner) sleeping on 0xffffffff81a91308 "-" chain 81: thread 100088 (pid 18, crypto returns 11) sleeping on 0xfffff80003ab6450 "crypto_ret_wait" chain 82: thread 100087 (pid 17, crypto returns 10) sleeping on 0xfffff80003ab63f0 "crypto_ret_wait" chain 83: thread 100086 (pid 16, crypto returns 9) sleeping on 0xfffff80003ab6390 "crypto_ret_wait" chain 84: thread 100085 (pid 15, crypto returns 8) sleeping on 0xfffff80003ab6330 "crypto_ret_wait" chain 85: thread 100084 (pid 14, crypto returns 7) sleeping on 0xfffff80003ab62d0 "crypto_ret_wait" chain 86: thread 100083 (pid 9, crypto returns 6) sleeping on 0xfffff80003ab6270 "crypto_ret_wait" chain 87: thread 100082 (pid 8, crypto returns 5) sleeping on 0xfffff80003ab6210 "crypto_ret_wait" chain 88: thread 100081 (pid 7, crypto returns 4) sleeping on 0xfffff80003ab61b0 "crypto_ret_wait" chain 89: thread 100080 (pid 6, crypto returns 3) sleeping on 0xfffff80003ab6150 "crypto_ret_wait" chain 90: thread 100079 (pid 5, crypto returns 2) sleeping on 0xfffff80003ab60f0 "crypto_ret_wait" chain 91: thread 100078 (pid 4, crypto returns 1) sleeping on 0xfffff80003ab6090 "crypto_ret_wait" chain 92: thread 100077 (pid 3, crypto returns 0) sleeping on 0xfffff80003ab6030 "crypto_ret_wait" chain 93: thread 100076 (pid 2, crypto) sleeping on 0xffffffff81e8e998 "crypto_wait" chain 94: thread 100060 (pid 13, g_event) sleeping on 0xffffffff81edd600 "-" chain 95: thread 100061 (pid 13, g_up) sleeping on 0xffffffff81edd608 "-" chain 96: thread 100062 (pid 13, g_down) sleeping on 0xffffffff81edd610 "-" chain 97: thread 100002 (pid 1, init) sleeping on 0xfffff80003914538 "wait" chain 98: thread 100001 (pid 10, audit) sleeping on 0xffffffff81f018a8 "audit_worker_cv" chain 99: thread 100000 (pid 0, swapper) sleeping on 0xffffffff81edd648 "swapin" chain 100: thread 100016 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff80003957b00 "-" chain 101: thread 100017 (pid 0, aiod_kick taskq) sleeping on 0xfffff80003957a00 "-" chain 102: thread 100020 (pid 0, thread taskq) sleeping on 0xfffff80003957500 "-" chain 103: thread 100021 (pid 0, if_io_tqg_0) sleeping on 0xfffff80003957400 "-" chain 104: thread 100022 (pid 0, if_io_tqg_1) sleeping on 0xfffff80003957300 "-" chain 105: thread 100023 (pid 0, if_io_tqg_2) sleeping on 0xfffff80003957200 "-" chain 106: thread 100024 (pid 0, if_io_tqg_3) sleeping on 0xfffff80003957100 "-" chain 107: thread 100025 (pid 0, if_io_tqg_4) sleeping on 0xfffff80003957000 "-" chain 108: thread 100026 (pid 0, if_io_tqg_5) sleeping on 0xfffff8000396f100 "-" chain 109: thread 100027 (pid 0, if_io_tqg_6) sleeping on 0xfffff8000396f000 "-" chain 110: thread 100028 (pid 0, if_io_tqg_7) sleeping on 0xfffff8000396ee00 "-" chain 111: thread 100029 (pid 0, if_io_tqg_8) sleeping on 0xfffff8000396ed00 "-" chain 112: thread 100030 (pid 0, if_io_tqg_9) sleeping on 0xfffff8000396ec00 "-" chain 113: thread 100031 (pid 0, if_io_tqg_10) sleeping on 0xfffff8000396eb00 "-" chain 114: thread 100032 (pid 0, if_io_tqg_11) sleeping on 0xfffff8000396ea00 "-" chain 115: thread 100033 (pid 0, softirq_0) sleeping on 0xfffff8000396e900 "-" chain 116: thread 100034 (pid 0, softirq_1) sleeping on 0xfffff8000396e800 "-" chain 117: thread 100035 (pid 0, softirq_2) sleeping on 0xfffff8000396e700 "-" chain 118: thread 100036 (pid 0, softirq_3) sleeping on 0xfffff8000396e600 "-" chain 119: thread 100037 (pid 0, softirq_4) sleeping on 0xfffff8000396e500 "-" chain 120: thread 100038 (pid 0, softirq_5) sleeping on 0xfffff8000396e400 "-" chain 121: thread 100039 (pid 0, softirq_6) sleeping on 0xfffff8000396e300 "-" chain 122: thread 100040 (pid 0, softirq_7) sleeping on 0xfffff8000396e200 "-" chain 123: thread 100041 (pid 0, softirq_8) sleeping on 0xfffff8000396e100 "-" chain 124: thread 100042 (pid 0, softirq_9) sleeping on 0xfffff8000396e000 "-" chain 125: thread 100043 (pid 0, softirq_10) sleeping on 0xfffff8000396de00 "-" chain 126: thread 100044 (pid 0, softirq_11) sleeping on 0xfffff8000396dd00 "-" chain 127: thread 100045 (pid 0, if_config_tqg_0) sleeping on 0xfffff800039f6200 "-" chain 128: thread 100063 (pid 0, firmware taskq) sleeping on 0xfffff800039f5200 "-" chain 129: thread 100064 (pid 0, crypto_0) sleeping on 0xfffff800039f5100 "-" chain 130: thread 100065 (pid 0, crypto_1) sleeping on 0xfffff800039f5100 "-" chain 131: thread 100066 (pid 0, crypto_2) sleeping on 0xfffff800039f5100 "-" chain 132: thread 100067 (pid 0, crypto_3) sleeping on 0xfffff800039f5100 "-" chain 133: thread 100068 (pid 0, crypto_4) sleeping on 0xfffff800039f5100 "-" chain 134: thread 100069 (pid 0, crypto_5) sleeping on 0xfffff800039f5100 "-" chain 135: thread 100070 (pid 0, crypto_6) sleeping on 0xfffff800039f5100 "-" chain 136: thread 100071 (pid 0, crypto_7) sleeping on 0xfffff800039f5100 "-" chain 137: thread 100072 (pid 0, crypto_8) sleeping on 0xfffff800039f5100 "-" chain 138: thread 100073 (pid 0, crypto_9) sleeping on 0xfffff800039f5100 "-" chain 139: thread 100074 (pid 0, crypto_10) sleeping on 0xfffff800039f5100 "-" chain 140: thread 100075 (pid 0, crypto_11) sleeping on 0xfffff800039f5100 "-" chain 141: thread 100112 (pid 0, mca taskq) sleeping on 0xfffff800041d8a00 "-" chain 142: thread 100119 (pid 0, acpi_task_0) sleeping on 0xfffff80013169500 "-" chain 143: thread 100120 (pid 0, acpi_task_1) sleeping on 0xfffff80013169500 "-" chain 144: thread 100121 (pid 0, acpi_task_2) sleeping on 0xfffff80013169500 "-" chain 145: thread 100122 (pid 0, CAM taskq) sleeping on 0xfffff800039f5000 "-" db:0:allchains> show mount 0xfffff80013874000 /dev/gpt/work on / (ufs) 0xfffff80013875000 devfs on /dev (devfs) 0xfffff8015003c000 /dev/gpt/tmp on /tmp (ufs) More info: show mount db:0:mount> show page vm_cnt.v_free_count: 7465198 vm_cnt.v_inactive_count: 737 vm_cnt.v_active_count: 574466 vm_cnt.v_laundry_count: 0 vm_cnt.v_wire_count: 90306 vm_cnt.v_free_reserved: 10652 vm_cnt.v_free_min: 51304 vm_cnt.v_free_target: 173260 vm_cnt.v_inactive_target: 259890 db:0:page> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 001781 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000008 | 000000 09 (002048K) | 000101 | 000001 08 (001024K) | 000000 | 000000 07 (000512K) | 000001 | 000001 06 (000256K) | 000000 | 000001 05 (000128K) | 000000 | 000000 04 (000064K) | 000001 | 000000 03 (000032K) | 000001 | 000000 02 (000016K) | 000002 | 000004 01 (000008K) | 000046 | 000013 00 (000004K) | 000306 | 000095 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000001 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000001 | 000000 05 (000128K) | 000001 | 000000 04 (000064K) | 000002 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000000 | 000000 01 (000008K) | 000001 | 000000 00 (000004K) | 000000 | 000000 db:0:freepages> ps pid ppid pgrp uid state wmesg wchan cmd 858 0 0 0 DL pmcloop 0xfffff80013405800 [hwpmc: proc(857)] 857 814 814 0 S+ kqread 0xfffff800041d8000 pmcstat 855 843 814 0 T+ (threaded) churn 100210 s churn 100215 D ufs 0xfffff8004b4827b8 test2 100224 s test2 854 843 814 0 T+ (threaded) churn 100209 s churn 100220 D ufs 0xfffff8004b4827b8 test2 100228 s test2 853 843 814 0 T+ (threaded) churn 100208 s churn 100217 D biowr 0xfffffe000105f8d8 test2 100234 s test2 852 843 814 0 T+ (threaded) churn 100207 Run CPU 11 churn 100226 s test2 100233 s test2 851 843 814 0 T+ (threaded) churn 100147 s churn 100222 s test2 100229 D ufs 0xfffff801501402d8 test2 850 843 814 0 T+ (threaded) churn 100206 Run CPU 3 churn 100213 s test2 100221 s test2 849 843 814 0 T+ (threaded) churn 100205 s churn 100212 s test2 100219 D ufs 0xfffff8004b4827b8 test2 848 843 814 0 T+ (threaded) churn 100204 s churn 100211 D ufs 0xfffff8004b4827b8 test2 100223 s test2 847 843 814 0 T+ (threaded) churn 100203 s churn 100218 s test2 100230 D ufs 0xfffff8004b4827b8 test2 846 843 814 0 R+ (threaded) churn 100202 Run CPU 1 churn 100214 S nanslp 0xffffffff81ce3166 test2 100231 S nanslp 0xffffffff81ce3166 test2 845 843 814 0 T+ (threaded) churn 100201 s churn 100216 s test2 100227 D ufs 0xfffff8004b4827b8 test2 844 843 814 0 T+ (threaded) churn 100199 s churn 100225 D ufs 0xfffff8004b4827b8 test2 100232 s test2 843 822 814 0 S+ wait 0xfffff80013d7e538 churn 822 814 814 0 S+ wait 0xfffff80013d4a538 sh 814 794 814 0 S+ wait 0xfffff800139caa70 sh 803 802 803 0 S+ ttyin 0xfffff8004bd594b0 csh 802 801 802 2006 S+ wait 0xfffff8004ba65538 su 801 800 801 2006 Ss+ wait 0xfffff80013931000 bash 800 797 797 2006 S select 0xfffff800131cf740 sshd 797 701 797 0 Ss select 0xfffff8000413e940 sshd 794 748 794 0 S+ pause 0xfffff8004b12cb18 csh 793 1 793 65 Ss select 0xfffff8000413e9c0 dhclient 748 1 748 0 Ss+ wait 0xfffff8004ba65a70 login 747 1 747 0 Ss+ ttyin 0xfffff800080710b0 getty 746 1 746 0 Ss+ ttyin 0xfffff800132c3cb0 getty 745 1 745 0 Ss+ ttyin 0xfffff800132c50b0 getty 744 1 744 0 Ss+ ttyin 0xfffff800132c54b0 getty 743 1 743 0 Ss+ ttyin 0xfffff800132c58b0 getty 742 1 742 0 Ss+ ttyin 0xfffff800132c5cb0 getty 741 1 741 0 Ss+ ttyin 0xfffff800132c60b0 getty 740 1 740 0 Ss+ ttyin 0xfffff800132c64b0 getty 739 1 739 0 Ss+ ttyin 0xfffff800132c68b0 getty 705 1 705 0 Ss nanslp 0xffffffff81ce3161 cron 701 1 701 0 Ss select 0xfffff800033b0440 sshd 636 1 636 0 Ss rpcsvc 0xfffff80003f45260 NLM: master 633 1 633 0 Ss select 0xfffff80013398840 rpc.statd 598 1 598 0 Ss select 0xfffff80003f25140 casperd 595 1 595 0 Ss select 0xfffff800133d47c0 casperd 583 1 583 0 Ss select 0xfffff800133d4840 dhclient 577 1 577 0 Ss select 0xfffff800132c01c0 dhclient 538 1 538 0 Ss select 0xfffff800133988c0 rpcbind 533 1 533 0 Ss select 0xfffff80003f251c0 syslogd 458 1 458 0 Ss select 0xfffff80003a84c40 devd 34 0 0 0 DL vlruwt 0xfffff80013111538 [vnlru] 33 0 0 0 DL syncer 0xffffffff81e886c0 [syncer] 32 0 0 0 DL - 0xffffffff81e87c1c [bufspacedaemon] 31 0 0 0 DL (threaded) [bufdaemon] 100128 D psleep 0xffffffff81e879f8 [bufdaemon] 100145 D sdflush 0xfffff800080752e8 [/ worker] 100198 D sdflush 0xfffff8015000dae8 [/tmp worker] 30 0 0 0 DL psleep 0xffffffff81e94178 [vmdaemon] 29 0 0 0 DL (threaded) [pagedaemon] 100126 D psleep 0xffffffff81e9057c [pagedaemon] 100129 D launds 0xffffffff81e90588 [laundry: dom0] 100133 D umarcl 0xffffffff80db0a60 [uma] 28 0 0 0 DL idle 0xfffff80013039000 [enc_daemon1] 27 0 0 0 DL idle 0xfffff80013039538 [enc_daemon0] 26 0 0 0 DL - 0xffffffff81bb6138 [rand_harvestq] 25 0 0 0 DL waiting 0xffffffff81f00bc0 [sctp_iterator] 24 0 0 0 DL - 0xffffffff81e873f4 [soaiod4] 23 0 0 0 DL - 0xffffffff81e873f4 [soaiod3] 22 0 0 0 DL - 0xffffffff81e873f4 [soaiod2] 21 0 0 0 DL - 0xffffffff81e873f4 [soaiod1] 20 0 0 0 DL (threaded) [usb] 100094 D - 0xfffffe009c7c1460 [usbus0] 100095 D - 0xfffffe009c7c14b8 [usbus0] 100096 D - 0xfffffe009c7c1510 [usbus0] 100097 D - 0xfffffe009c7c1568 [usbus0] 100098 D - 0xfffffe009c7c15c0 [usbus0] 100100 D - 0xfffffe009a5bfd10 [usbus1] 100101 D - 0xfffffe009a5bfd68 [usbus1] 100102 D - 0xfffffe009a5bfdc0 [usbus1] 100103 D - 0xfffffe009a5bfe18 [usbus1] 100104 D - 0xfffffe009a5bfe70 [usbus1] 100105 D - 0xfffffe009ca42d10 [usbus2] 100106 D - 0xfffffe009ca42d68 [usbus2] 100107 D - 0xfffffe009ca42dc0 [usbus2] 100108 D - 0xfffffe009ca42e18 [usbus2] 100109 D - 0xfffffe009ca42e70 [usbus2] 19 0 0 0 RL (threaded) [cam] 100089 D - 0xffffffff81a91440 [doneq0] 100090 Run CPU 4 [doneq1] 100091 D - 0xffffffff81a91540 [doneq2] 100123 D - 0xffffffff81a91308 [scanner] 18 0 0 0 DL crypto_ 0xfffff80003ab6450 [crypto returns 11] 17 0 0 0 DL crypto_ 0xfffff80003ab63f0 [crypto returns 10] 16 0 0 0 DL crypto_ 0xfffff80003ab6390 [crypto returns 9] 15 0 0 0 DL crypto_ 0xfffff80003ab6330 [crypto returns 8] 14 0 0 0 DL crypto_ 0xfffff80003ab62d0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff80003ab6270 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff80003ab6210 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff80003ab61b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff80003ab6150 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff80003ab60f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff80003ab6090 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff80003ab6030 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff81e8e998 [crypto] 13 0 0 0 DL (threaded) [geom] 100060 D - 0xffffffff81edd600 [g_event] 100061 D - 0xffffffff81edd608 [g_up] 100062 D - 0xffffffff81edd610 [g_down] 12 0 0 0 WL (threaded) [intr] 100015 I [swi5: fast taskq] 100018 I [swi6: task queue] 100019 I [swi6: Giant taskq] 100046 I [swi1: netisr 0] 100047 I [swi4: clock (0)] 100048 I [swi4: clock (1)] 100049 I [swi4: clock (2)] 100050 I [swi4: clock (3)] 100051 I [swi4: clock (4)] 100052 I [swi4: clock (5)] 100053 I [swi4: clock (6)] 100054 I [swi4: clock (7)] 100055 I [swi4: clock (8)] 100056 I [swi4: clock (9)] 100057 I [swi4: clock (10)] 100058 I [swi4: clock (11)] 100059 I [swi3: vm] 100092 I [irq264: ahci0] 100093 I [irq19: xhci0] 100099 I [irq18: ehci0 ehci1] 100110 I [irq279: ahci1] 100111 I [swi0: uart uart] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 CanRun [idle: cpu3] 100007 CanRun [idle: cpu4] 100008 Run CPU 5 [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 Run CPU 7 [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 Run CPU 9 [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 CanRun [idle: cpu11] 1 0 1 0 SLs wait 0xfffff80003914538 [init] 10 0 0 0 DL audit_w 0xffffffff81f018a8 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81edd648 [swapper] 100016 D - 0xfffff80003957b00 [kqueue_ctx taskq] 100017 D - 0xfffff80003957a00 [aiod_kick taskq] 100020 D - 0xfffff80003957500 [thread taskq] 100021 D - 0xfffff80003957400 [if_io_tqg_0] 100022 D - 0xfffff80003957300 [if_io_tqg_1] 100023 D - 0xfffff80003957200 [if_io_tqg_2] 100024 D - 0xfffff80003957100 [if_io_tqg_3] 100025 D - 0xfffff80003957000 [if_io_tqg_4] 100026 D - 0xfffff8000396f100 [if_io_tqg_5] 100027 D - 0xfffff8000396f000 [if_io_tqg_6] 100028 D - 0xfffff8000396ee00 [if_io_tqg_7] 100029 D - 0xfffff8000396ed00 [if_io_tqg_8] 100030 D - 0xfffff8000396ec00 [if_io_tqg_9] 100031 D - 0xfffff8000396eb00 [if_io_tqg_10] 100032 D - 0xfffff8000396ea00 [if_io_tqg_11] 100033 D - 0xfffff8000396e900 [softirq_0] 100034 D - 0xfffff8000396e800 [softirq_1] 100035 D - 0xfffff8000396e700 [softirq_2] 100036 D - 0xfffff8000396e600 [softirq_3] 100037 D - 0xfffff8000396e500 [softirq_4] 100038 D - 0xfffff8000396e400 [softirq_5] 100039 D - 0xfffff8000396e300 [softirq_6] 100040 D - 0xfffff8000396e200 [softirq_7] 100041 D - 0xfffff8000396e100 [softirq_8] 100042 D - 0xfffff8000396e000 [softirq_9] 100043 D - 0xfffff8000396de00 [softirq_10] 100044 D - 0xfffff8000396dd00 [softirq_11] 100045 D - 0xfffff800039f6200 [if_config_tqg_0] 100063 D - 0xfffff800039f5200 [firmware taskq] 100064 D - 0xfffff800039f5100 [crypto_0] 100065 D - 0xfffff800039f5100 [crypto_1] 100066 D - 0xfffff800039f5100 [crypto_2] 100067 D - 0xfffff800039f5100 [crypto_3] 100068 D - 0xfffff800039f5100 [crypto_4] 100069 D - 0xfffff800039f5100 [crypto_5] 100070 D - 0xfffff800039f5100 [crypto_6] 100071 D - 0xfffff800039f5100 [crypto_7] 100072 D - 0xfffff800039f5100 [crypto_8] 100073 D - 0xfffff800039f5100 [crypto_9] 100074 D - 0xfffff800039f5100 [crypto_10] 100075 D - 0xfffff800039f5100 [crypto_11] 100112 D - 0xfffff800041d8a00 [mca taskq] 100119 D - 0xfffff80013169500 [acpi_task_0] 100120 D - 0xfffff80013169500 [acpi_task_1] 100121 D - 0xfffff80013169500 [acpi_task_2] 100122 D - 0xfffff800039f5000 [CAM taskq] db:0:ps> allt Tracing command hwpmc: proc(857) pid 858 tid 100235 td 0xfffff801500fb560 sched_switch() at sched_switch+0x525/frame 0xfffffe009eddf870 mi_switch() at mi_switch+0x188/frame 0xfffffe009eddf8a0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009eddf8e0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe009eddf910 _sleep() at _sleep+0x358/frame 0xfffffe009eddf9b0 pmclog_loop() at pmclog_loop+0x3e4/frame 0xfffffe009eddfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe009eddfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009eddfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pmcstat pid 857 tid 100168 td 0xfffff80013850560 sched_switch() at sched_switch+0x525/frame 0xfffffe009ec953a0 mi_switch() at mi_switch+0x188/frame 0xfffffe009ec953d0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ec95410 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe009ec95470 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009ec954a0 _sleep() at _sleep+0x34a/frame 0xfffffe009ec95540 kqueue_kevent() at kqueue_kevent+0x2ea/frame 0xfffffe009ec95810 kern_kevent_fp() at kern_kevent_fp+0x96/frame 0xfffffe009ec95860 kern_kevent() at kern_kevent+0x9f/frame 0xfffffe009ec958c0 kern_kevent_generic() at kern_kevent_generic+0x96/frame 0xfffffe009ec95920 sys_kevent() at sys_kevent+0x61/frame 0xfffffe009ec95980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe009ec95ab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffe800 Tracing command churn pid 855 tid 100210 td 0xfffff801500fd000 sched_switch() at sched_switch+0x525/frame 0xfffffe009ed629f0 mi_switch() at mi_switch+0x188/frame 0xfffffe009ed62a20 thread_suspend_check() at thread_suspend_check+0x93/frame 0xfffffe009ed62a70 ast() at ast+0x57f/frame 0xfffffe009ed62ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe7d0 Tracing command churn pid 855 tid 100215 td 0xfffff801500fc560 sched_switch() at sched_switch+0x525/frame 0xfffffe009ed7b290 mi_switch() at mi_switch+0x188/frame 0xfffffe009ed7b2c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ed7b300 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe009ed7b330 sleeplk() at sleeplk+0x148/frame 0xfffffe009ed7b390 __lockmgr_args() at __lockmgr_args+0x705/frame 0xfffffe009ed7b430 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe009ed7b480 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe009ed7b4b0 _vn_lock() at _vn_lock+0x66/frame 0xfffffe009ed7b520 lookup() at lookup+0x116/frame 0xfffffe009ed7b5c0 namei() at namei+0x53a/frame 0xfffffe009ed7b680 vn_open_cred() at vn_open_cred+0xd8/frame 0xfffffe009ed7b7c0 sigexit() at sigexit+0x55d/frame 0xfffffe009ed7b9a0 postsig() at postsig+0x1c0/frame 0xfffffe009ed7ba70 ast() at ast+0x4f8/frame 0xfffffe009ed7bab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffdfffdfb0 Tracing command churn pid 855 tid 100224 td 0xfffff801500fc000 sched_switch() at sched_switch+0x525/frame 0xfffffe009eda89f0 mi_switch() at mi_switch+0x188/frame 0xfffffe009eda8a20 thread_suspend_check() at thread_suspend_check+0x93/frame 0xfffffe009eda8a70 ast() at ast+0x57f/frame 0xfffffe009eda8ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffdfdfcfb0 Tracing command churn pid 854 tid 100209 td 0xfffff801500fd560 sched_switch() at sched_switch+0x525/frame 0xfffffe009ed5d9f0 mi_switch() at mi_switch+0x188/frame 0xfffffe009ed5da20 thread_suspend_check() at thread_suspend_check+0x93/frame 0xfffffe009ed5da70 ast() at ast+0x57f/frame 0xfffffe009ed5dab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe7d0 Tracing command churn pid 854 tid 100220 td 0xfffff80013cd5000 sched_switch() at sched_switch+0x525/frame 0xfffffe009ed94290 mi_switch() at mi_switch+0x188/frame 0xfffffe009ed942c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ed94300 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe009ed94330 sleeplk() at sleeplk+0x148/frame 0xfffffe009ed94390 __lockmgr_args() at __lockmgr_args+0x705/frame 0xfffffe009ed94430 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe009ed94480 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe009ed944b0 _vn_lock() at _vn_lock+0x66/frame 0xfffffe009ed94520 lookup() at lookup+0x116/frame 0xfffffe009ed945c0 namei() at namei+0x53a/frame 0xfffffe009ed94680 vn_open_cred() at vn_open_cred+0xd8/frame 0xfffffe009ed947c0 sigexit() at sigexit+0x55d/frame 0xfffffe009ed949a0 postsig() at postsig+0x1c0/frame 0xfffffe009ed94a70 ast() at ast+0x4f8/frame 0xfffffe009ed94ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffdfffdfb0 Tracing command churn pid 854 tid 100228 td 0xfffff80013cd4560 sched_switch() at sched_switch+0x525/frame 0xfffffe009edbc9f0 mi_switch() at mi_switch+0x188/frame 0xfffffe009edbca20 thread_suspend_check() at thread_suspend_check+0x93/frame 0xfffffe009edbca70 ast() at ast+0x57f/frame 0xfffffe009edbcab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffdfdfcf40 Tracing command churn pid 853 tid 100208 td 0xfffff801500fe000 sched_switch() at sched_switch+0x525/frame 0xfffffe009ed589f0 mi_switch() at mi_switch+0x188/frame 0xfffffe009ed58a20 thread_suspend_check() at thread_suspend_check+0x93/frame 0xfffffe009ed58a70 ast() at ast+0x57f/frame 0xfffffe009ed58ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe7d0 Tracing command churn pid 853 tid 100217 td 0xfffff80013b5d560 sched_switch() at sched_switch+0x525/frame 0xfffffe009ed84e00 mi_switch() at mi_switch+0x188/frame 0xfffffe009ed84e30 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ed84e70 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe009ed84ea0 _sleep() at _sleep+0x358/frame 0xfffffe009ed84f40 bufwait() at bufwait+0xc4/frame 0xfffffe009ed84f80 bufwrite() at bufwrite+0x214/frame 0xfffffe009ed84fd0 ffs_syncvnode() at ffs_syncvnode+0x3af/frame 0xfffffe009ed85040 ffs_truncate() at ffs_truncate+0x6ed/frame 0xfffffe009ed85230 ffs_write() at ffs_write+0x55c/frame 0xfffffe009ed852d0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe009ed853e0 vn_io_fault_doio() at vn_io_fault_doio+0xa7/frame 0xfffffe009ed85420 vn_io_fault1() at vn_io_fault1+0x17e/frame 0xfffffe009ed85560 vn_rdwr() at vn_rdwr+0x1c4/frame 0xfffffe009ed85630 vn_rdwr_inchunks() at vn_rdwr_inchunks+0x92/frame 0xfffffe009ed856b0 elf64_coredump() at elf64_coredump+0xd6e/frame 0xfffffe009ed857c0 sigexit() at sigexit+0x7d0/frame 0xfffffe009ed859a0 postsig() at postsig+0x1c0/frame 0xfffffe009ed85a70 ast() at ast+0x4f8/frame 0xfffffe009ed85ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffdfffdfb0 Tracing command churn pid 853 tid 100234 td 0xfffff80013b5d000 sched_switch() at sched_switch+0x525/frame 0xfffffe009edda9f0 mi_switch() at mi_switch+0x188/frame 0xfffffe009eddaa20 thread_suspend_check() at thread_suspend_check+0x93/frame 0xfffffe009eddaa70 ast() at ast+0x57f/frame 0xfffffe009eddaab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffdfdfcf40 Tracing command churn pid 852 tid 100207 td 0xfffff801500fe560 (CPU 11) nmi_fromuserspace() at nmi_fromuserspace+0x46/frame 0x7fffffffe7d0 Tracing command churn pid 852 tid 100226 td 0xfffff80013855560 sched_switch() at sched_switch+0x525/frame 0xfffffe009edad9f0 mi_switch() at mi_switch+0x188/frame 0xfffffe009edada20 thread_suspend_check() at thread_suspend_check+0x93/frame 0xfffffe009edada70 ast() at ast+0x57f/frame 0xfffffe009edadab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffdfffdf40 Tracing command churn pid 852 tid 100233 td 0xfffff8004ba69000 sched_switch() at sched_switch+0x525/frame 0xfffffe009edd56d0 mi_switch() at mi_switch+0x188/frame 0xfffffe009edd5700 thread_suspend_switch() at thread_suspend_switch+0x174/frame 0xfffffe009edd5750 thread_single() at thread_single+0x205/frame 0xfffffe009edd57c0 sigexit() at sigexit+0x75/frame 0xfffffe009edd59a0 postsig() at postsig+0x1c0/frame 0xfffffe009edd5a70 ast() at ast+0x4f8/frame 0xfffffe009edd5ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffdfdfcfb0 Tracing command churn pid 851 tid 100147 td 0xfffff80013c1b560 sched_switch() at sched_switch+0x525/frame 0xfffffe009ec2c9f0 mi_switch() at mi_switch+0x188/frame 0xfffffe009ec2ca20 thread_suspend_check() at thread_suspend_check+0x93/frame 0xfffffe009ec2ca70 ast() at ast+0x57f/frame 0xfffffe009ec2cab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe7d0 Tracing command churn pid 851 tid 100222 td 0xfffff8004b0fb560 sched_switch() at sched_switch+0x525/frame 0xfffffe009ed999f0 mi_switch() at mi_switch+0x188/frame 0xfffffe009ed99a20 thread_suspend_check() at thread_suspend_check+0x93/frame 0xfffffe009ed99a70 ast() at ast+0x57f/frame 0xfffffe009ed99ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffdfffdf40 Tracing command churn pid 851 tid 100229 td 0xfffff8004b0fb000 sched_switch() at sched_switch+0x525/frame 0xfffffe009edc0fa0 mi_switch() at mi_switch+0x188/frame 0xfffffe009edc0fd0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009edc1010 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe009edc1040 sleeplk() at sleeplk+0x148/frame 0xfffffe009edc10a0 __lockmgr_args() at __lockmgr_args+0xaef/frame 0xfffffe009edc1140 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe009edc1190 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe009edc11c0 _vn_lock() at _vn_lock+0x66/frame 0xfffffe009edc1230 vget() at vget+0x9b/frame 0xfffffe009edc1270 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe009edc12c0 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe009edc1350 ufs_lookup_ino() at ufs_lookup_ino+0xc81/frame 0xfffffe009edc1460 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe009edc1490 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe009edc14f0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe009edc1520 lookup() at lookup+0x692/frame 0xfffffe009edc15c0 namei() at namei+0x53a/frame 0xfffffe009edc1680 vn_open_cred() at vn_open_cred+0xd8/frame 0xfffffe009edc17c0 sigexit() at sigexit+0x55d/frame 0xfffffe009edc19a0 postsig() at postsig+0x1c0/frame 0xfffffe009edc1a70 ast() at ast+0x4f8/frame 0xfffffe009edc1ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffdfdfcfb0 Tracing command churn pid 850 tid 100206 td 0xfffff80013cd6560 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071bbdf0 ipi_nmi_handler() at ipi_nmi_handler+0x45/frame 0xfffffe00071bbe10 trap() at trap+0x49/frame 0xfffffe00071bbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071bbf20 --- trap 0x13, rip = 0xffffffff808a8990, rsp = 0xfffffe00071bb930, rbp = 0xfffffe00071bb950 --- ns8250_putc() at ns8250_putc+0xb0/frame 0xfffffe00071bb950 uart_cnputc() at uart_cnputc+0x47/frame 0xfffffe00071bb970 cnputc() at cnputc+0x181/frame 0xfffffe00071bb9a0 cnputs() at cnputs+0x68/frame 0xfffffe00071bb9c0 putchar() at putchar+0x154/frame 0xfffffe00071bba60 kvprintf() at kvprintf+0x1189/frame 0xfffffe00071bbb70 vprintf() at vprintf+0x84/frame 0xfffffe00071bbc40 printf() at printf+0x43/frame 0xfffffe00071bbca0 trap_fatal() at trap_fatal+0x262/frame 0xfffffe00071bbcf0 trap_pfault() at trap_pfault+0x62/frame 0xfffffe00071bbd50 trap() at trap+0x2ff/frame 0xfffffe00071bbe60 calltrap() at calltrap+0x8/frame 0xfffffe00071bbe60 --- trap 0xc, rip = 0x15016b067, rsp = 0xfffffe00071bb950, rbp = 0x7fffffffe7d0 --- Tracing command churn pid 850 tid 100213 td 0xfffff80013937000 sched_switch() at sched_switch+0x525/frame 0xfffffe009ed716d0 mi_switch() at mi_switch+0x188/frame 0xfffffe009ed71700 thread_suspend_switch() at thread_suspend_switch+0x174/frame 0xfffffe009ed71750 thread_single() at thread_single+0x205/frame 0xfffffe009ed717c0 sigexit() at sigexit+0x75/frame 0xfffffe009ed719a0 postsig() at postsig+0x1c0/frame 0xfffffe009ed71a70 ast() at ast+0x4f8/frame 0xfffffe009ed71ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffdfffdfb0 Tracing command churn pid 850 tid 100221 td 0xfffff80013864560 sched_switch() at sched_switch+0x525/frame 0xfffffe009ed8f9f0 mi_switch() at mi_switch+0x188/frame 0xfffffe009ed8fa20 thread_suspend_check() at thread_suspend_check+0x93/frame 0xfffffe009ed8fa70 ast() at ast+0x57f/frame 0xfffffe009ed8fab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffdfdfcf40 Tracing command churn pid 849 tid 100205 td 0xfffff80013d7f000 sched_switch() at sched_switch+0x525/frame 0xfffffe009ed499f0 mi_switch() at mi_switch+0x188/frame 0xfffffe009ed49a20 thread_suspend_check() at thread_suspend_check+0x93/frame 0xfffffe009ed49a70 ast() at ast+0x57f/frame 0xfffffe009ed49ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe7d0 Tracing command churn pid 849 tid 100212 td 0xfffff8004b484560 sched_switch() at sched_switch+0x525/frame 0xfffffe009ed6c9f0 mi_switch() at mi_switch+0x188/frame 0xfffffe009ed6ca20 thread_suspend_check() at thread_suspend_check+0x93/frame 0xfffffe009ed6ca70 ast() at ast+0x57f/frame 0xfffffe009ed6cab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffdfffdf40 Tracing command churn pid 849 tid 100219 td 0xfffff8004b484000 sched_switch() at sched_switch+0x525/frame 0xfffffe009ed8a290 mi_switch() at mi_switch+0x188/frame 0xfffffe009ed8a2c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ed8a300 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe009ed8a330 sleeplk() at sleeplk+0x148/frame 0xfffffe009ed8a390 __lockmgr_args() at __lockmgr_args+0x705/frame 0xfffffe009ed8a430 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe009ed8a480 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe009ed8a4b0 _vn_lock() at _vn_lock+0x66/frame 0xfffffe009ed8a520 lookup() at lookup+0x116/frame 0xfffffe009ed8a5c0 namei() at namei+0x53a/frame 0xfffffe009ed8a680 vn_open_cred() at vn_open_cred+0xd8/frame 0xfffffe009ed8a7c0 sigexit() at sigexit+0x55d/frame 0xfffffe009ed8a9a0 postsig() at postsig+0x1c0/frame 0xfffffe009ed8aa70 ast() at ast+0x4f8/frame 0xfffffe009ed8aab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffdfdfcfb0 Tracing command churn pid 848 tid 100204 td 0xfffff80013d7f560 sched_switch() at sched_switch+0x525/frame 0xfffffe009ed449f0 mi_switch() at mi_switch+0x188/frame 0xfffffe009ed44a20 thread_suspend_check() at thread_suspend_check+0x93/frame 0xfffffe009ed44a70 ast() at ast+0x57f/frame 0xfffffe009ed44ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe7d0 Tracing command churn pid 848 tid 100211 td 0xfffff800139dc560 sched_switch() at sched_switch+0x525/frame 0xfffffe009ed67290 mi_switch() at mi_switch+0x188/frame 0xfffffe009ed672c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ed67300 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe009ed67330 sleeplk() at sleeplk+0x148/frame 0xfffffe009ed67390 __lockmgr_args() at __lockmgr_args+0x705/frame 0xfffffe009ed67430 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe009ed67480 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe009ed674b0 _vn_lock() at _vn_lock+0x66/frame 0xfffffe009ed67520 lookup() at lookup+0x116/frame 0xfffffe009ed675c0 namei() at namei+0x53a/frame 0xfffffe009ed67680 vn_open_cred() at vn_open_cred+0xd8/frame 0xfffffe009ed677c0 sigexit() at sigexit+0x55d/frame 0xfffffe009ed679a0 postsig() at postsig+0x1c0/frame 0xfffffe009ed67a70 ast() at ast+0x4f8/frame 0xfffffe009ed67ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffdfffdfb0 Tracing command churn pid 848 tid 100223 td 0xfffff800139dc000 sched_switch() at sched_switch+0x525/frame 0xfffffe009eda39f0 mi_switch() at mi_switch+0x188/frame 0xfffffe009eda3a20 thread_suspend_check() at thread_suspend_check+0x93/frame 0xfffffe009eda3a70 ast() at ast+0x57f/frame 0xfffffe009eda3ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffdfdfcfb0 Tracing command churn pid 847 tid 100203 td 0xfffff80013d40000 sched_switch() at sched_switch+0x525/frame 0xfffffe009ed3f9f0 mi_switch() at mi_switch+0x188/frame 0xfffffe009ed3fa20 thread_suspend_check() at thread_suspend_check+0x93/frame 0xfffffe009ed3fa70 ast() at ast+0x57f/frame 0xfffffe009ed3fab0 fast_syscall_common() at fast_syscall_common+0x17f/frame 0x7fffffffe7d0 Tracing command churn pid 847 tid 100218 td 0xfffff80013ee4560 sched_switch() at sched_switch+0x525/frame 0xfffffe009ed9e9f0 mi_switch() at mi_switch+0x188/frame 0xfffffe009ed9ea20 thread_suspend_check() at thread_suspend_check+0x93/frame 0xfffffe009ed9ea70 ast() at ast+0x57f/frame 0xfffffe009ed9eab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffdfffdf40 Tracing command churn pid 847 tid 100230 td 0xfffff80013ee4000 sched_switch() at sched_switch+0x525/frame 0xfffffe009edc6290 mi_switch() at mi_switch+0x188/frame 0xfffffe009edc62c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009edc6300 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe009edc6330 sleeplk() at sleeplk+0x148/frame 0xfffffe009edc6390 __lockmgr_args() at __lockmgr_args+0x705/frame 0xfffffe009edc6430 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe009edc6480 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe009edc64b0 _vn_lock() at _vn_lock+0x66/frame 0xfffffe009edc6520 lookup() at lookup+0x116/frame 0xfffffe009edc65c0 namei() at namei+0x53a/frame 0xfffffe009edc6680 vn_open_cred() at vn_open_cred+0xd8/frame 0xfffffe009edc67c0 sigexit() at sigexit+0x55d/frame 0xfffffe009edc69a0 postsig() at postsig+0x1c0/frame 0xfffffe009edc6a70 ast() at ast+0x4f8/frame 0xfffffe009edc6ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffdfdfcfb0 Tracing command churn pid 846 tid 100202 td 0xfffff80013d40560 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00007ffdf0 ipi_nmi_handler() at ipi_nmi_handler+0x45/frame 0xfffffe00007ffe10 trap() at trap+0x49/frame 0xfffffe00007fff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00007fff20 --- trap 0x13, rip = 0xffffffff80adbb52, rsp = 0xffffffff81e97fa0, rbp = 0xffffffff81e97fb0 --- lock_delay() at lock_delay+0x42/frame 0xffffffff81e97fb0 _mtx_lock_spin_cookie() at _mtx_lock_spin_cookie+0xc1/frame 0xffffffff81e98020 __mtx_lock_spin_flags() at __mtx_lock_spin_flags+0xd8/frame 0xffffffff81e98060 cnputs() at cnputs+0x4b/frame 0xffffffff81e98080 putchar() at putchar+0x154/frame 0xffffffff81e98120 kvprintf() at kvprintf+0x1189/frame 0xffffffff81e98230 vprintf() at vprintf+0x84/frame 0xffffffff81e98300 printf() at printf+0x43/frame 0xffffffff81e98360 trap_fatal() at trap_fatal+0x16d/frame 0xffffffff81e983b0 trap_pfault() at trap_pfault+0x62/frame 0xffffffff81e98410 trap() at trap+0x2ff/frame 0xffffffff81e98520 calltrap() at calltrap+0x8/frame 0xffffffff81e98520 --- trap 0xc, rip = 0x248e001, rsp = 0xfffffe007895a910, rbp = 0x7fffffffe7d0 --- Tracing command churn pid 846 tid 100214 td 0xfffff80013c2d000 sched_switch() at sched_switch+0x525/frame 0xfffffe009ed76700 mi_switch() at mi_switch+0x188/frame 0xfffffe009ed76730 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ed76770 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe009ed767d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe009ed76810 _sleep() at _sleep+0x2e7/frame 0xfffffe009ed768b0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1b7/frame 0xfffffe009ed76940 sys_nanosleep() at sys_nanosleep+0x97/frame 0xfffffe009ed76980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe009ed76ab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffdfffdf40 Tracing command churn pid 846 tid 100231 td 0xfffff80013c2c560 sched_switch() at sched_switch+0x525/frame 0xfffffe009edcb700 mi_switch() at mi_switch+0x188/frame 0xfffffe009edcb730 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009edcb770 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe009edcb7d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe009edcb810 _sleep() at _sleep+0x2e7/frame 0xfffffe009edcb8b0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1b7/frame 0xfffffe009edcb940 sys_nanosleep() at sys_nanosleep+0x97/frame 0xfffffe009edcb980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe009edcbab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffdfdfcf40 Tracing command churn pid 845 tid 100201 td 0xfffff80013d41000 sched_switch() at sched_switch+0x525/frame 0xfffffe009ed359f0 mi_switch() at mi_switch+0x188/frame 0xfffffe009ed35a20 thread_suspend_check() at thread_suspend_check+0x93/frame 0xfffffe009ed35a70 ast() at ast+0x57f/frame 0xfffffe009ed35ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe7d0 Tracing command churn pid 845 tid 100216 td 0xfffff80013850000 sched_switch() at sched_switch+0x525/frame 0xfffffe009ed809f0 mi_switch() at mi_switch+0x188/frame 0xfffffe009ed80a20 thread_suspend_check() at thread_suspend_check+0x93/frame 0xfffffe009ed80a70 ast() at ast+0x57f/frame 0xfffffe009ed80ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffdfffdf40 Tracing command churn pid 845 tid 100227 td 0xfffff8001312c560 sched_switch() at sched_switch+0x525/frame 0xfffffe009edb7290 mi_switch() at mi_switch+0x188/frame 0xfffffe009edb72c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009edb7300 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe009edb7330 sleeplk() at sleeplk+0x148/frame 0xfffffe009edb7390 __lockmgr_args() at __lockmgr_args+0x705/frame 0xfffffe009edb7430 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe009edb7480 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe009edb74b0 _vn_lock() at _vn_lock+0x66/frame 0xfffffe009edb7520 lookup() at lookup+0x116/frame 0xfffffe009edb75c0 namei() at namei+0x53a/frame 0xfffffe009edb7680 vn_open_cred() at vn_open_cred+0xd8/frame 0xfffffe009edb77c0 sigexit() at sigexit+0x55d/frame 0xfffffe009edb79a0 postsig() at postsig+0x1c0/frame 0xfffffe009edb7a70 ast() at ast+0x4f8/frame 0xfffffe009edb7ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffdfdfcfb0 Tracing command churn pid 844 tid 100199 td 0xfffff80013d41560 sched_switch() at sched_switch+0x525/frame 0xfffffe009ed2b9f0 mi_switch() at mi_switch+0x188/frame 0xfffffe009ed2ba20 thread_suspend_check() at thread_suspend_check+0x93/frame 0xfffffe009ed2ba70 ast() at ast+0x57f/frame 0xfffffe009ed2bab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe7d0 Tracing command churn pid 844 tid 100225 td 0xfffff80013c1a000 sched_switch() at sched_switch+0x525/frame 0xfffffe009edb2290 mi_switch() at mi_switch+0x188/frame 0xfffffe009edb22c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009edb2300 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe009edb2330 sleeplk() at sleeplk+0x148/frame 0xfffffe009edb2390 __lockmgr_args() at __lockmgr_args+0x705/frame 0xfffffe009edb2430 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe009edb2480 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe009edb24b0 _vn_lock() at _vn_lock+0x66/frame 0xfffffe009edb2520 lookup() at lookup+0x116/frame 0xfffffe009edb25c0 namei() at namei+0x53a/frame 0xfffffe009edb2680 vn_open_cred() at vn_open_cred+0xd8/frame 0xfffffe009edb27c0 sigexit() at sigexit+0x55d/frame 0xfffffe009edb29a0 postsig() at postsig+0x1c0/frame 0xfffffe009edb2a70 ast() at ast+0x4f8/frame 0xfffffe009edb2ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffdfffdfb0 Tracing command churn pid 844 tid 100232 td 0xfffff80013c19560 sched_switch() at sched_switch+0x525/frame 0xfffffe009edd09f0 mi_switch() at mi_switch+0x188/frame 0xfffffe009edd0a20 thread_suspend_check() at thread_suspend_check+0x93/frame 0xfffffe009edd0a70 ast() at ast+0x57f/frame 0xfffffe009edd0ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffdfdfcf40 Tracing command churn pid 843 tid 100162 td 0xfffff80013d42000 sched_switch() at sched_switch+0x525/frame 0xfffffe009ec77560 mi_switch() at mi_switch+0x188/frame 0xfffffe009ec77590 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ec775d0 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe009ec77630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009ec77660 _sleep() at _sleep+0x34a/frame 0xfffffe009ec77700 kern_wait6() at kern_wait6+0x1cb/frame 0xfffffe009ec77790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe009ec77980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe009ec77ab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffe7d0 Tracing command sh pid 822 tid 100200 td 0xfffff8004b485000 sched_switch() at sched_switch+0x525/frame 0xfffffe009ed30560 mi_switch() at mi_switch+0x188/frame 0xfffffe009ed30590 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ed305d0 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe009ed30630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009ed30660 _sleep() at _sleep+0x34a/frame 0xfffffe009ed30700 kern_wait6() at kern_wait6+0x1cb/frame 0xfffffe009ed30790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe009ed30980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe009ed30ab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffe560 Tracing command sh pid 814 tid 100136 td 0xfffff800139de000 sched_switch() at sched_switch+0x525/frame 0xfffffe00005f5560 mi_switch() at mi_switch+0x188/frame 0xfffffe00005f5590 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005f55d0 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe00005f5630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00005f5660 _sleep() at _sleep+0x34a/frame 0xfffffe00005f5700 kern_wait6() at kern_wait6+0x1cb/frame 0xfffffe00005f5790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00005f5980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00005f5ab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffe880 Tracing command csh pid 803 tid 100152 td 0xfffff80013d42560 sched_switch() at sched_switch+0x525/frame 0xfffffe009ec45610 mi_switch() at mi_switch+0x188/frame 0xfffffe009ec45640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ec45680 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe009ec456e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009ec45710 _cv_wait_sig() at _cv_wait_sig+0x1fd/frame 0xfffffe009ec45770 tty_wait() at tty_wait+0x42/frame 0xfffffe009ec457a0 ttydisc_read() at ttydisc_read+0x24e/frame 0xfffffe009ec45810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe009ec45840 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe009ec458a0 dofileread() at dofileread+0xba/frame 0xfffffe009ec458e0 kern_readv() at kern_readv+0x68/frame 0xfffffe009ec45930 sys_read() at sys_read+0x86/frame 0xfffffe009ec45980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe009ec45ab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffe130 Tracing command su pid 802 tid 100196 td 0xfffff8004ba69560 sched_switch() at sched_switch+0x525/frame 0xfffffe009ed21560 mi_switch() at mi_switch+0x188/frame 0xfffffe009ed21590 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ed215d0 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe009ed21630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009ed21660 _sleep() at _sleep+0x34a/frame 0xfffffe009ed21700 kern_wait6() at kern_wait6+0x1cb/frame 0xfffffe009ed21790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe009ed21980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe009ed21ab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffeb70 Tracing command bash pid 801 tid 100184 td 0xfffff8001393f000 sched_switch() at sched_switch+0x525/frame 0xfffffe009ece5560 mi_switch() at mi_switch+0x188/frame 0xfffffe009ece5590 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ece55d0 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe009ece5630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009ece5660 _sleep() at _sleep+0x34a/frame 0xfffffe009ece5700 kern_wait6() at kern_wait6+0x1cb/frame 0xfffffe009ece5790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe009ece5980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe009ece5ab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffe800 Tracing command sshd pid 800 tid 100174 td 0xfffff8004b0fd560 sched_switch() at sched_switch+0x525/frame 0xfffffe009ecb35b0 mi_switch() at mi_switch+0x188/frame 0xfffffe009ecb35e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ecb3620 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe009ecb3680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009ecb36b0 _cv_wait_sig() at _cv_wait_sig+0x1fd/frame 0xfffffe009ecb3710 seltdwait() at seltdwait+0x8d/frame 0xfffffe009ecb3750 kern_select() at kern_select+0x81c/frame 0xfffffe009ecb3940 sys_select() at sys_select+0x56/frame 0xfffffe009ecb3980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe009ecb3ab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffa620 Tracing command sshd pid 797 tid 100160 td 0xfffff80013c2d560 sched_switch() at sched_switch+0x525/frame 0xfffffe009ec6d620 mi_switch() at mi_switch+0x188/frame 0xfffffe009ec6d650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ec6d690 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe009ec6d6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009ec6d720 _cv_wait_sig() at _cv_wait_sig+0x1fd/frame 0xfffffe009ec6d780 seltdwait() at seltdwait+0x8d/frame 0xfffffe009ec6d7c0 kern_poll() at kern_poll+0x3f8/frame 0xfffffe009ec6d960 sys_poll() at sys_poll+0x50/frame 0xfffffe009ec6d980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe009ec6dab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffe600 Tracing command csh pid 794 tid 100197 td 0xfffff8004b0fc000 sched_switch() at sched_switch+0x525/frame 0xfffffe009ed26750 mi_switch() at mi_switch+0x188/frame 0xfffffe009ed26780 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ed267c0 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe009ed26820 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009ed26850 _sleep() at _sleep+0x34a/frame 0xfffffe009ed268f0 kern_sigsuspend() at kern_sigsuspend+0xb4/frame 0xfffffe009ed26950 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe009ed26980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe009ed26ab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffe190 Tracing command dhclient pid 793 tid 100135 td 0xfffff80013941560 sched_switch() at sched_switch+0x525/frame 0xfffffe00005f0600 mi_switch() at mi_switch+0x188/frame 0xfffffe00005f0630 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005f0670 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe00005f06d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00005f0710 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x220/frame 0xfffffe00005f0780 seltdwait() at seltdwait+0x6b/frame 0xfffffe00005f07c0 kern_poll() at kern_poll+0x3f8/frame 0xfffffe00005f0960 sys_poll() at sys_poll+0x50/frame 0xfffffe00005f0980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00005f0ab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffec80 Tracing command login pid 748 tid 100195 td 0xfffff8004ba6a000 sched_switch() at sched_switch+0x525/frame 0xfffffe009ed1c560 mi_switch() at mi_switch+0x188/frame 0xfffffe009ed1c590 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ed1c5d0 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe009ed1c630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009ed1c660 _sleep() at _sleep+0x34a/frame 0xfffffe009ed1c700 kern_wait6() at kern_wait6+0x1cb/frame 0xfffffe009ed1c790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe009ed1c980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe009ed1cab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffed20 Tracing command getty pid 747 tid 100194 td 0xfffff8004b487560 sched_switch() at sched_switch+0x525/frame 0xfffffe009ed17610 mi_switch() at mi_switch+0x188/frame 0xfffffe009ed17640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ed17680 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe009ed176e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009ed17710 _cv_wait_sig() at _cv_wait_sig+0x1fd/frame 0xfffffe009ed17770 tty_wait() at tty_wait+0x42/frame 0xfffffe009ed177a0 ttydisc_read() at ttydisc_read+0x24e/frame 0xfffffe009ed17810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe009ed17840 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe009ed178a0 dofileread() at dofileread+0xba/frame 0xfffffe009ed178e0 kern_readv() at kern_readv+0x68/frame 0xfffffe009ed17930 sys_read() at sys_read+0x86/frame 0xfffffe009ed17980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe009ed17ab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffecb0 Tracing command getty pid 746 tid 100193 td 0xfffff8004ba52000 sched_switch() at sched_switch+0x525/frame 0xfffffe009ed12610 mi_switch() at mi_switch+0x188/frame 0xfffffe009ed12640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ed12680 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe009ed126e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009ed12710 _cv_wait_sig() at _cv_wait_sig+0x1fd/frame 0xfffffe009ed12770 tty_wait() at tty_wait+0x42/frame 0xfffffe009ed127a0 ttydisc_read() at ttydisc_read+0x24e/frame 0xfffffe009ed12810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe009ed12840 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe009ed128a0 dofileread() at dofileread+0xba/frame 0xfffffe009ed128e0 kern_readv() at kern_readv+0x68/frame 0xfffffe009ed12930 sys_read() at sys_read+0x86/frame 0xfffffe009ed12980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe009ed12ab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffecb0 Tracing command getty pid 745 tid 100192 td 0xfffff8004ba52560 sched_switch() at sched_switch+0x525/frame 0xfffffe009ed0d610 mi_switch() at mi_switch+0x188/frame 0xfffffe009ed0d640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ed0d680 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe009ed0d6e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009ed0d710 _cv_wait_sig() at _cv_wait_sig+0x1fd/frame 0xfffffe009ed0d770 tty_wait() at tty_wait+0x42/frame 0xfffffe009ed0d7a0 ttydisc_read() at ttydisc_read+0x24e/frame 0xfffffe009ed0d810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe009ed0d840 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe009ed0d8a0 dofileread() at dofileread+0xba/frame 0xfffffe009ed0d8e0 kern_readv() at kern_readv+0x68/frame 0xfffffe009ed0d930 sys_read() at sys_read+0x86/frame 0xfffffe009ed0d980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe009ed0dab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffecb0 Tracing command getty pid 744 tid 100191 td 0xfffff8004ba53000 sched_switch() at sched_switch+0x525/frame 0xfffffe009ed08610 mi_switch() at mi_switch+0x188/frame 0xfffffe009ed08640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ed08680 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe009ed086e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009ed08710 _cv_wait_sig() at _cv_wait_sig+0x1fd/frame 0xfffffe009ed08770 tty_wait() at tty_wait+0x42/frame 0xfffffe009ed087a0 ttydisc_read() at ttydisc_read+0x24e/frame 0xfffffe009ed08810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe009ed08840 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe009ed088a0 dofileread() at dofileread+0xba/frame 0xfffffe009ed088e0 kern_readv() at kern_readv+0x68/frame 0xfffffe009ed08930 sys_read() at sys_read+0x86/frame 0xfffffe009ed08980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe009ed08ab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffecb0 Tracing command getty pid 743 tid 100190 td 0xfffff8004ba53560 sched_switch() at sched_switch+0x525/frame 0xfffffe009ed03610 mi_switch() at mi_switch+0x188/frame 0xfffffe009ed03640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ed03680 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe009ed036e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009ed03710 _cv_wait_sig() at _cv_wait_sig+0x1fd/frame 0xfffffe009ed03770 tty_wait() at tty_wait+0x42/frame 0xfffffe009ed037a0 ttydisc_read() at ttydisc_read+0x24e/frame 0xfffffe009ed03810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe009ed03840 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe009ed038a0 dofileread() at dofileread+0xba/frame 0xfffffe009ed038e0 kern_readv() at kern_readv+0x68/frame 0xfffffe009ed03930 sys_read() at sys_read+0x86/frame 0xfffffe009ed03980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe009ed03ab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffecb0 Tracing command getty pid 742 tid 100189 td 0xfffff8004ba21000 sched_switch() at sched_switch+0x525/frame 0xfffffe009ecfe610 mi_switch() at mi_switch+0x188/frame 0xfffffe009ecfe640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ecfe680 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe009ecfe6e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009ecfe710 _cv_wait_sig() at _cv_wait_sig+0x1fd/frame 0xfffffe009ecfe770 tty_wait() at tty_wait+0x42/frame 0xfffffe009ecfe7a0 ttydisc_read() at ttydisc_read+0x24e/frame 0xfffffe009ecfe810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe009ecfe840 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe009ecfe8a0 dofileread() at dofileread+0xba/frame 0xfffffe009ecfe8e0 kern_readv() at kern_readv+0x68/frame 0xfffffe009ecfe930 sys_read() at sys_read+0x86/frame 0xfffffe009ecfe980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe009ecfeab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffecb0 Tracing command getty pid 741 tid 100188 td 0xfffff8004ba21560 sched_switch() at sched_switch+0x525/frame 0xfffffe009ecf9610 mi_switch() at mi_switch+0x188/frame 0xfffffe009ecf9640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ecf9680 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe009ecf96e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009ecf9710 _cv_wait_sig() at _cv_wait_sig+0x1fd/frame 0xfffffe009ecf9770 tty_wait() at tty_wait+0x42/frame 0xfffffe009ecf97a0 ttydisc_read() at ttydisc_read+0x24e/frame 0xfffffe009ecf9810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe009ecf9840 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe009ecf98a0 dofileread() at dofileread+0xba/frame 0xfffffe009ecf98e0 kern_readv() at kern_readv+0x68/frame 0xfffffe009ecf9930 sys_read() at sys_read+0x86/frame 0xfffffe009ecf9980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe009ecf9ab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffecb0 Tracing command getty pid 740 tid 100169 td 0xfffff8004b0fe000 sched_switch() at sched_switch+0x525/frame 0xfffffe009ec9a610 mi_switch() at mi_switch+0x188/frame 0xfffffe009ec9a640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ec9a680 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe009ec9a6e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009ec9a710 _cv_wait_sig() at _cv_wait_sig+0x1fd/frame 0xfffffe009ec9a770 tty_wait() at tty_wait+0x42/frame 0xfffffe009ec9a7a0 ttydisc_read() at ttydisc_read+0x24e/frame 0xfffffe009ec9a810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe009ec9a840 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe009ec9a8a0 dofileread() at dofileread+0xba/frame 0xfffffe009ec9a8e0 kern_readv() at kern_readv+0x68/frame 0xfffffe009ec9a930 sys_read() at sys_read+0x86/frame 0xfffffe009ec9a980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe009ec9aab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffecb0 Tracing command getty pid 739 tid 100134 td 0xfffff800039c5000 sched_switch() at sched_switch+0x525/frame 0xfffffe00005eb610 mi_switch() at mi_switch+0x188/frame 0xfffffe00005eb640 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005eb680 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe00005eb6e0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00005eb710 _cv_wait_sig() at _cv_wait_sig+0x1fd/frame 0xfffffe00005eb770 tty_wait() at tty_wait+0x42/frame 0xfffffe00005eb7a0 ttydisc_read() at ttydisc_read+0x24e/frame 0xfffffe00005eb810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00005eb840 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe00005eb8a0 dofileread() at dofileread+0xba/frame 0xfffffe00005eb8e0 kern_readv() at kern_readv+0x68/frame 0xfffffe00005eb930 sys_read() at sys_read+0x86/frame 0xfffffe00005eb980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00005ebab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffecb0 Tracing command cron pid 705 tid 100183 td 0xfffff8001393f560 sched_switch() at sched_switch+0x525/frame 0xfffffe009ece0700 mi_switch() at mi_switch+0x188/frame 0xfffffe009ece0730 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ece0770 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe009ece07d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe009ece0810 _sleep() at _sleep+0x2e7/frame 0xfffffe009ece08b0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1b7/frame 0xfffffe009ece0940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe009ece0980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe009ece0ab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffece0 Tracing command sshd pid 701 tid 100150 td 0xfffff80013cd6000 sched_switch() at sched_switch+0x525/frame 0xfffffe009ec3b5b0 mi_switch() at mi_switch+0x188/frame 0xfffffe009ec3b5e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ec3b620 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe009ec3b680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009ec3b6b0 _cv_wait_sig() at _cv_wait_sig+0x1fd/frame 0xfffffe009ec3b710 seltdwait() at seltdwait+0x8d/frame 0xfffffe009ec3b750 kern_select() at kern_select+0x81c/frame 0xfffffe009ec3b940 sys_select() at sys_select+0x56/frame 0xfffffe009ec3b980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe009ec3bab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffe6d0 Tracing command rpc.lockd pid 636 tid 100179 td 0xfffff8004b486000 sched_switch() at sched_switch+0x525/frame 0xfffffe009eccc4c0 mi_switch() at mi_switch+0x188/frame 0xfffffe009eccc4f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009eccc530 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe009eccc590 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe009eccc5d0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x220/frame 0xfffffe009eccc640 svc_run_internal() at svc_run_internal+0x392/frame 0xfffffe009eccc780 svc_run() at svc_run+0x1e5/frame 0xfffffe009eccc7e0 sys_nlm_syscall() at sys_nlm_syscall+0x747/frame 0xfffffe009eccc980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe009ecccab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffece0 Tracing command rpc.statd pid 633 tid 100177 td 0xfffff8004b486560 sched_switch() at sched_switch+0x525/frame 0xfffffe009ecc2590 mi_switch() at mi_switch+0x188/frame 0xfffffe009ecc25c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ecc2600 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe009ecc2660 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe009ecc26a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x220/frame 0xfffffe009ecc2710 seltdwait() at seltdwait+0x6b/frame 0xfffffe009ecc2750 kern_select() at kern_select+0x81c/frame 0xfffffe009ecc2940 sys_select() at sys_select+0x56/frame 0xfffffe009ecc2980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe009ecc2ab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffec00 Tracing command casperd pid 598 tid 100156 td 0xfffff80013852560 sched_switch() at sched_switch+0x525/frame 0xfffffe009ec595b0 mi_switch() at mi_switch+0x188/frame 0xfffffe009ec595e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ec59620 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe009ec59680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009ec596b0 _cv_wait_sig() at _cv_wait_sig+0x1fd/frame 0xfffffe009ec59710 seltdwait() at seltdwait+0x8d/frame 0xfffffe009ec59750 kern_select() at kern_select+0x81c/frame 0xfffffe009ec59940 sys_select() at sys_select+0x56/frame 0xfffffe009ec59980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe009ec59ab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffece0 Tracing command casperd pid 595 tid 100172 td 0xfffff8004b487000 sched_switch() at sched_switch+0x525/frame 0xfffffe009eca95b0 mi_switch() at mi_switch+0x188/frame 0xfffffe009eca95e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009eca9620 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe009eca9680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009eca96b0 _cv_wait_sig() at _cv_wait_sig+0x1fd/frame 0xfffffe009eca9710 seltdwait() at seltdwait+0x8d/frame 0xfffffe009eca9750 kern_select() at kern_select+0x81c/frame 0xfffffe009eca9940 sys_select() at sys_select+0x56/frame 0xfffffe009eca9980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe009eca9ab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffe720 Tracing command dhclient pid 583 tid 100165 td 0xfffff80003c5e560 sched_switch() at sched_switch+0x525/frame 0xfffffe009ec86620 mi_switch() at mi_switch+0x188/frame 0xfffffe009ec86650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ec86690 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe009ec866f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009ec86720 _cv_wait_sig() at _cv_wait_sig+0x1fd/frame 0xfffffe009ec86780 seltdwait() at seltdwait+0x8d/frame 0xfffffe009ec867c0 kern_poll() at kern_poll+0x3f8/frame 0xfffffe009ec86960 sys_poll() at sys_poll+0x50/frame 0xfffffe009ec86980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe009ec86ab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffec80 Tracing command dhclient pid 577 tid 100173 td 0xfffff80013940000 sched_switch() at sched_switch+0x525/frame 0xfffffe009ecae5b0 mi_switch() at mi_switch+0x188/frame 0xfffffe009ecae5e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ecae620 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe009ecae680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009ecae6b0 _cv_wait_sig() at _cv_wait_sig+0x1fd/frame 0xfffffe009ecae710 seltdwait() at seltdwait+0x8d/frame 0xfffffe009ecae750 kern_select() at kern_select+0x81c/frame 0xfffffe009ecae940 sys_select() at sys_select+0x56/frame 0xfffffe009ecae980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe009ecaeab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffeac0 Tracing command rpcbind pid 538 tid 100157 td 0xfffff80013852000 sched_switch() at sched_switch+0x525/frame 0xfffffe009ec5e600 mi_switch() at mi_switch+0x188/frame 0xfffffe009ec5e630 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ec5e670 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe009ec5e6d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe009ec5e710 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x220/frame 0xfffffe009ec5e780 seltdwait() at seltdwait+0x6b/frame 0xfffffe009ec5e7c0 kern_poll() at kern_poll+0x3f8/frame 0xfffffe009ec5e960 sys_poll() at sys_poll+0x50/frame 0xfffffe009ec5e980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe009ec5eab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffec70 Tracing command syslogd pid 533 tid 100159 td 0xfffff80013c2e000 sched_switch() at sched_switch+0x525/frame 0xfffffe009ec685b0 mi_switch() at mi_switch+0x188/frame 0xfffffe009ec685e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ec68620 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe009ec68680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009ec686b0 _cv_wait_sig() at _cv_wait_sig+0x1fd/frame 0xfffffe009ec68710 seltdwait() at seltdwait+0x8d/frame 0xfffffe009ec68750 kern_select() at kern_select+0x81c/frame 0xfffffe009ec68940 sys_select() at sys_select+0x56/frame 0xfffffe009ec68980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe009ec68ab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffece0 Tracing command devd pid 458 tid 100166 td 0xfffff8004b0fe560 sched_switch() at sched_switch+0x525/frame 0xfffffe009ec8b590 mi_switch() at mi_switch+0x188/frame 0xfffffe009ec8b5c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ec8b600 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe009ec8b660 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe009ec8b6a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x220/frame 0xfffffe009ec8b710 seltdwait() at seltdwait+0x6b/frame 0xfffffe009ec8b750 kern_select() at kern_select+0x81c/frame 0xfffffe009ec8b940 sys_select() at sys_select+0x56/frame 0xfffffe009ec8b980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe009ec8bab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffed00 Tracing command vnlru pid 34 tid 100132 td 0xfffff80013857560 sched_switch() at sched_switch+0x525/frame 0xfffffe00005e1890 mi_switch() at mi_switch+0x188/frame 0xfffffe00005e18c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005e1900 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00005e1940 _sleep() at _sleep+0x2fa/frame 0xfffffe00005e19e0 vnlru_proc() at vnlru_proc+0x1e4/frame 0xfffffe00005e1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 33 tid 100131 td 0xfffff80013859000 sched_switch() at sched_switch+0x525/frame 0xfffffe00005d78c0 mi_switch() at mi_switch+0x188/frame 0xfffffe00005d78f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005d7930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00005d7970 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x220/frame 0xfffffe00005d79e0 sched_sync() at sched_sync+0x1b2/frame 0xfffffe00005d7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufspacedaemon pid 32 tid 100130 td 0xfffff80013859560 sched_switch() at sched_switch+0x525/frame 0xfffffe00005d2900 mi_switch() at mi_switch+0x188/frame 0xfffffe00005d2930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005d2970 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00005d29b0 _sleep() at _sleep+0x2fa/frame 0xfffffe00005d2a50 bufspace_daemon() at bufspace_daemon+0x1b7/frame 0xfffffe00005d2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100128 td 0xfffff8001385b000 sched_switch() at sched_switch+0x525/frame 0xfffffe00005cd8f0 mi_switch() at mi_switch+0x188/frame 0xfffffe00005cd920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005cd960 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00005cd9a0 _sleep() at _sleep+0x2fa/frame 0xfffffe00005cda40 buf_daemon() at buf_daemon+0x68/frame 0xfffffe00005cda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005cdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005cdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100145 td 0xfffff80008003000 sched_switch() at sched_switch+0x525/frame 0xfffffe009ec228f0 mi_switch() at mi_switch+0x188/frame 0xfffffe009ec22920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ec22960 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe009ec229a0 _sleep() at _sleep+0x2fa/frame 0xfffffe009ec22a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe009ec22a70 fork_exit() at fork_exit+0x84/frame 0xfffffe009ec22ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009ec22ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100198 td 0xfffff80013937560 sched_switch() at sched_switch+0x525/frame 0xfffffe009ec368f0 mi_switch() at mi_switch+0x188/frame 0xfffffe009ec36920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009ec36960 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe009ec369a0 _sleep() at _sleep+0x2fa/frame 0xfffffe009ec36a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe009ec36a70 fork_exit() at fork_exit+0x84/frame 0xfffffe009ec36ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009ec36ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 30 tid 100127 td 0xfffff8001311d000 sched_switch() at sched_switch+0x525/frame 0xfffffe00005c88b0 mi_switch() at mi_switch+0x188/frame 0xfffffe00005c88e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005c8920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c8950 _sleep() at _sleep+0x358/frame 0xfffffe00005c89f0 vm_daemon() at vm_daemon+0x85/frame 0xfffffe00005c8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 29 tid 100126 td 0xfffff8001311d560 sched_switch() at sched_switch+0x525/frame 0xfffffe00005c3850 mi_switch() at mi_switch+0x188/frame 0xfffffe00005c3880 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005c38c0 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00005c3900 _sleep() at _sleep+0x2fa/frame 0xfffffe00005c39a0 vm_pageout_worker() at vm_pageout_worker+0x34a/frame 0xfffffe00005c3a40 vm_pageout() at vm_pageout+0xcb/frame 0xfffffe00005c3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 29 tid 100129 td 0xfffff80013864000 sched_switch() at sched_switch+0x525/frame 0xfffffe00005dc850 mi_switch() at mi_switch+0x188/frame 0xfffffe00005dc880 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005dc8c0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005dc8f0 _sleep() at _sleep+0x358/frame 0xfffffe00005dc990 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x1ff/frame 0xfffffe00005dca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005dcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005dcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 29 tid 100133 td 0xfffff80013863560 sched_switch() at sched_switch+0x525/frame 0xfffffe00005e68f0 mi_switch() at mi_switch+0x188/frame 0xfffffe00005e6920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005e6960 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00005e69a0 _sleep() at _sleep+0x2fa/frame 0xfffffe00005e6a40 uma_reclaim_worker() at uma_reclaim_worker+0xda/frame 0xfffffe00005e6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 28 tid 100125 td 0xfffff80013051000 sched_switch() at sched_switch+0x525/frame 0xfffffe00005be8b0 mi_switch() at mi_switch+0x188/frame 0xfffffe00005be8e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005be920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005be950 _sleep() at _sleep+0x358/frame 0xfffffe00005be9f0 enc_daemon() at enc_daemon+0x1ca/frame 0xfffffe00005bea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005beab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005beab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 27 tid 100124 td 0xfffff80013051560 sched_switch() at sched_switch+0x525/frame 0xfffffe00005b98b0 mi_switch() at mi_switch+0x188/frame 0xfffffe00005b98e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005b9920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005b9950 _sleep() at _sleep+0x358/frame 0xfffffe00005b99f0 enc_daemon() at enc_daemon+0x1ca/frame 0xfffffe00005b9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005b9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005b9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 26 tid 100118 td 0xfffff8001312b560 sched_switch() at sched_switch+0x525/frame 0xfffffe000059b8c0 mi_switch() at mi_switch+0x188/frame 0xfffffe000059b8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000059b930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe000059b970 _sleep() at _sleep+0x2fa/frame 0xfffffe000059ba10 random_kthread() at random_kthread+0x57/frame 0xfffffe000059ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000059bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000059bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 25 tid 100117 td 0xfffff8001312c000 sched_switch() at sched_switch+0x525/frame 0xfffffe0000596910 mi_switch() at mi_switch+0x188/frame 0xfffffe0000596940 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000596980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005969b0 _sleep() at _sleep+0x358/frame 0xfffffe0000596a50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe0000596a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000596ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000596ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 24 tid 100116 td 0xfffff80013052000 sched_switch() at sched_switch+0x525/frame 0xfffffe00005908e0 mi_switch() at mi_switch+0x188/frame 0xfffffe0000590910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000590950 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0000590990 _sleep() at _sleep+0x2fa/frame 0xfffffe0000590a30 soaio_kproc_loop() at soaio_kproc_loop+0x194/frame 0xfffffe0000590a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000590ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000590ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 23 tid 100115 td 0xfffff80013052560 sched_switch() at sched_switch+0x525/frame 0xfffffe000058b8e0 mi_switch() at mi_switch+0x188/frame 0xfffffe000058b910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000058b950 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe000058b990 _sleep() at _sleep+0x2fa/frame 0xfffffe000058ba30 soaio_kproc_loop() at soaio_kproc_loop+0x194/frame 0xfffffe000058ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000058bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000058bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 22 tid 100114 td 0xfffff80013053000 sched_switch() at sched_switch+0x525/frame 0xfffffe00005868e0 mi_switch() at mi_switch+0x188/frame 0xfffffe0000586910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000586950 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0000586990 _sleep() at _sleep+0x2fa/frame 0xfffffe0000586a30 soaio_kproc_loop() at soaio_kproc_loop+0x194/frame 0xfffffe0000586a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000586ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000586ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 21 tid 100113 td 0xfffff80013053560 sched_switch() at sched_switch+0x525/frame 0xfffffe00005818e0 mi_switch() at mi_switch+0x188/frame 0xfffffe0000581910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000581950 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0000581990 _sleep() at _sleep+0x2fa/frame 0xfffffe0000581a30 soaio_kproc_loop() at soaio_kproc_loop+0x194/frame 0xfffffe0000581a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000581ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000581ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100094 td 0xfffff80003c5c000 sched_switch() at sched_switch+0x525/frame 0xfffffe0000522930 mi_switch() at mi_switch+0x188/frame 0xfffffe0000522960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005229a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005229d0 _cv_wait() at _cv_wait+0x202/frame 0xfffffe0000522a30 usb_process() at usb_process+0x12b/frame 0xfffffe0000522a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000522ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000522ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100095 td 0xfffff80003c5b560 sched_switch() at sched_switch+0x525/frame 0xfffffe0000527930 mi_switch() at mi_switch+0x188/frame 0xfffffe0000527960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005279a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005279d0 _cv_wait() at _cv_wait+0x202/frame 0xfffffe0000527a30 usb_process() at usb_process+0x12b/frame 0xfffffe0000527a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000527ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000527ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100096 td 0xfffff80003c5b000 sched_switch() at sched_switch+0x525/frame 0xfffffe000052c930 mi_switch() at mi_switch+0x188/frame 0xfffffe000052c960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000052c9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000052c9d0 _cv_wait() at _cv_wait+0x202/frame 0xfffffe000052ca30 usb_process() at usb_process+0x12b/frame 0xfffffe000052ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe000052cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000052cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100097 td 0xfffff80003c5a560 sched_switch() at sched_switch+0x525/frame 0xfffffe0000531930 mi_switch() at mi_switch+0x188/frame 0xfffffe0000531960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005319a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005319d0 _cv_wait() at _cv_wait+0x202/frame 0xfffffe0000531a30 usb_process() at usb_process+0x12b/frame 0xfffffe0000531a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000531ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000531ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100098 td 0xfffff80003c5a000 sched_switch() at sched_switch+0x525/frame 0xfffffe0000536930 mi_switch() at mi_switch+0x188/frame 0xfffffe0000536960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005369a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005369d0 _cv_wait() at _cv_wait+0x202/frame 0xfffffe0000536a30 usb_process() at usb_process+0x12b/frame 0xfffffe0000536a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000536ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000536ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100100 td 0xfffff80004130000 sched_switch() at sched_switch+0x525/frame 0xfffffe0000540930 mi_switch() at mi_switch+0x188/frame 0xfffffe0000540960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005409a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005409d0 _cv_wait() at _cv_wait+0x202/frame 0xfffffe0000540a30 usb_process() at usb_process+0x12b/frame 0xfffffe0000540a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000540ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000540ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100101 td 0xfffff8000412f560 sched_switch() at sched_switch+0x525/frame 0xfffffe0000545930 mi_switch() at mi_switch+0x188/frame 0xfffffe0000545960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005459a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005459d0 _cv_wait() at _cv_wait+0x202/frame 0xfffffe0000545a30 usb_process() at usb_process+0x12b/frame 0xfffffe0000545a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000545ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000545ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100102 td 0xfffff8000412f000 sched_switch() at sched_switch+0x525/frame 0xfffffe000054a930 mi_switch() at mi_switch+0x188/frame 0xfffffe000054a960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000054a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000054a9d0 _cv_wait() at _cv_wait+0x202/frame 0xfffffe000054aa30 usb_process() at usb_process+0x12b/frame 0xfffffe000054aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000054aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000054aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100103 td 0xfffff8000412e560 sched_switch() at sched_switch+0x525/frame 0xfffffe000054f930 mi_switch() at mi_switch+0x188/frame 0xfffffe000054f960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000054f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000054f9d0 _cv_wait() at _cv_wait+0x202/frame 0xfffffe000054fa30 usb_process() at usb_process+0x12b/frame 0xfffffe000054fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000054fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000054fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100104 td 0xfffff8000412e000 sched_switch() at sched_switch+0x525/frame 0xfffffe0000554930 mi_switch() at mi_switch+0x188/frame 0xfffffe0000554960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005549a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005549d0 _cv_wait() at _cv_wait+0x202/frame 0xfffffe0000554a30 usb_process() at usb_process+0x12b/frame 0xfffffe0000554a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000554ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000554ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100105 td 0xfffff8000800e000 sched_switch() at sched_switch+0x525/frame 0xfffffe0000559930 mi_switch() at mi_switch+0x188/frame 0xfffffe0000559960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005599a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005599d0 _cv_wait() at _cv_wait+0x202/frame 0xfffffe0000559a30 usb_process() at usb_process+0x12b/frame 0xfffffe0000559a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000559ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000559ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100106 td 0xfffff8000800d560 sched_switch() at sched_switch+0x525/frame 0xfffffe000055e930 mi_switch() at mi_switch+0x188/frame 0xfffffe000055e960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000055e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000055e9d0 _cv_wait() at _cv_wait+0x202/frame 0xfffffe000055ea30 usb_process() at usb_process+0x12b/frame 0xfffffe000055ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000055eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000055eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100107 td 0xfffff8000800d000 sched_switch() at sched_switch+0x525/frame 0xfffffe0000563930 mi_switch() at mi_switch+0x188/frame 0xfffffe0000563960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005639a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005639d0 _cv_wait() at _cv_wait+0x202/frame 0xfffffe0000563a30 usb_process() at usb_process+0x12b/frame 0xfffffe0000563a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000563ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000563ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100108 td 0xfffff8000800c560 sched_switch() at sched_switch+0x525/frame 0xfffffe0000568930 mi_switch() at mi_switch+0x188/frame 0xfffffe0000568960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005689a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005689d0 _cv_wait() at _cv_wait+0x202/frame 0xfffffe0000568a30 usb_process() at usb_process+0x12b/frame 0xfffffe0000568a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000568ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000568ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100109 td 0xfffff8000800c000 sched_switch() at sched_switch+0x525/frame 0xfffffe000056d930 mi_switch() at mi_switch+0x188/frame 0xfffffe000056d960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000056d9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000056d9d0 _cv_wait() at _cv_wait+0x202/frame 0xfffffe000056da30 usb_process() at usb_process+0x12b/frame 0xfffffe000056da70 fork_exit() at fork_exit+0x84/frame 0xfffffe000056dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000056dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 19 tid 100089 td 0xfffff80003aae560 sched_switch() at sched_switch+0x525/frame 0xfffffe00005098e0 mi_switch() at mi_switch+0x188/frame 0xfffffe0000509910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000509950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000509980 _sleep() at _sleep+0x358/frame 0xfffffe0000509a20 xpt_done_td() at xpt_done_td+0xab/frame 0xfffffe0000509a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000509ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000509ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 19 tid 100090 td 0xfffff80003c5e000 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071c3df0 ipi_nmi_handler() at ipi_nmi_handler+0x45/frame 0xfffffe00071c3e10 trap() at trap+0x49/frame 0xfffffe00071c3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071c3f20 --- trap 0x13, rip = 0xffffffff80afb91e, rsp = 0xfffffe000050e680, rbp = 0xfffffe000050e700 --- witness_unlock() at witness_unlock+0xae/frame 0xfffffe000050e700 __mtx_unlock_flags() at __mtx_unlock_flags+0x5d/frame 0xfffffe000050e740 vfs_vmio_unwire() at vfs_vmio_unwire+0x83/frame 0xfffffe000050e760 brelse() at brelse+0x420/frame 0xfffffe000050e7b0 softdep_disk_write_complete() at softdep_disk_write_complete+0x547/frame 0xfffffe000050e810 bufdone_finish() at bufdone_finish+0x34/frame 0xfffffe000050e880 bufdone() at bufdone+0x101/frame 0xfffffe000050e8b0 g_io_deliver() at g_io_deliver+0x26b/frame 0xfffffe000050e900 g_io_deliver() at g_io_deliver+0x26b/frame 0xfffffe000050e950 g_io_deliver() at g_io_deliver+0x26b/frame 0xfffffe000050e9a0 g_disk_done() at g_disk_done+0x106/frame 0xfffffe000050e9e0 xpt_done_process() at xpt_done_process+0x35f/frame 0xfffffe000050ea20 xpt_done_td() at xpt_done_td+0x136/frame 0xfffffe000050ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000050eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000050eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 19 tid 100091 td 0xfffff80003c5d560 sched_switch() at sched_switch+0x525/frame 0xfffffe00005138e0 mi_switch() at mi_switch+0x188/frame 0xfffffe0000513910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000513950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000513980 _sleep() at _sleep+0x358/frame 0xfffffe0000513a20 xpt_done_td() at xpt_done_td+0xab/frame 0xfffffe0000513a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000513ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000513ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 19 tid 100123 td 0xfffff80013129000 sched_switch() at sched_switch+0x525/frame 0xfffffe00005b48d0 mi_switch() at mi_switch+0x188/frame 0xfffffe00005b4900 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005b4940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005b4970 _sleep() at _sleep+0x358/frame 0xfffffe00005b4a10 xpt_scanner_thread() at xpt_scanner_thread+0x93/frame 0xfffffe00005b4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005b4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005b4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 18 tid 100088 td 0xfffff80003abc000 sched_switch() at sched_switch+0x525/frame 0xfffffe00005048c0 mi_switch() at mi_switch+0x188/frame 0xfffffe00005048f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000504930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000504960 _sleep() at _sleep+0x358/frame 0xfffffe0000504a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0000504a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000504ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000504ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 17 tid 100087 td 0xfffff80003abc560 sched_switch() at sched_switch+0x525/frame 0xfffffe00004ff8c0 mi_switch() at mi_switch+0x188/frame 0xfffffe00004ff8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004ff930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004ff960 _sleep() at _sleep+0x358/frame 0xfffffe00004ffa00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00004ffa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004ffab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004ffab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 16 tid 100086 td 0xfffff80003abd000 sched_switch() at sched_switch+0x525/frame 0xfffffe00004fa8c0 mi_switch() at mi_switch+0x188/frame 0xfffffe00004fa8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004fa930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004fa960 _sleep() at _sleep+0x358/frame 0xfffffe00004faa00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00004faa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004faab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004faab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 15 tid 100085 td 0xfffff80003abd560 sched_switch() at sched_switch+0x525/frame 0xfffffe00004f58c0 mi_switch() at mi_switch+0x188/frame 0xfffffe00004f58f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004f5930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004f5960 _sleep() at _sleep+0x358/frame 0xfffffe00004f5a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00004f5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004f5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004f5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 14 tid 100084 td 0xfffff80003abe000 sched_switch() at sched_switch+0x525/frame 0xfffffe00004f08c0 mi_switch() at mi_switch+0x188/frame 0xfffffe00004f08f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004f0930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004f0960 _sleep() at _sleep+0x358/frame 0xfffffe00004f0a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00004f0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004f0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004f0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100083 td 0xfffff80003abe560 sched_switch() at sched_switch+0x525/frame 0xfffffe00004eb8c0 mi_switch() at mi_switch+0x188/frame 0xfffffe00004eb8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004eb930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004eb960 _sleep() at _sleep+0x358/frame 0xfffffe00004eba00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00004eba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004ebab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004ebab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100082 td 0xfffff80003abf000 sched_switch() at sched_switch+0x525/frame 0xfffffe00004e68c0 mi_switch() at mi_switch+0x188/frame 0xfffffe00004e68f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004e6930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004e6960 _sleep() at _sleep+0x358/frame 0xfffffe00004e6a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00004e6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004e6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004e6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100081 td 0xfffff80003abf560 sched_switch() at sched_switch+0x525/frame 0xfffffe00004e18c0 mi_switch() at mi_switch+0x188/frame 0xfffffe00004e18f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004e1930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004e1960 _sleep() at _sleep+0x358/frame 0xfffffe00004e1a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00004e1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004e1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004e1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100080 td 0xfffff80003aaa000 sched_switch() at sched_switch+0x525/frame 0xfffffe00004dc8c0 mi_switch() at mi_switch+0x188/frame 0xfffffe00004dc8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004dc930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004dc960 _sleep() at _sleep+0x358/frame 0xfffffe00004dca00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00004dca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004dcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004dcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100079 td 0xfffff80003aaa560 sched_switch() at sched_switch+0x525/frame 0xfffffe00004d78c0 mi_switch() at mi_switch+0x188/frame 0xfffffe00004d78f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004d7930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004d7960 _sleep() at _sleep+0x358/frame 0xfffffe00004d7a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00004d7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100078 td 0xfffff80003aab000 sched_switch() at sched_switch+0x525/frame 0xfffffe00004d28c0 mi_switch() at mi_switch+0x188/frame 0xfffffe00004d28f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004d2930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004d2960 _sleep() at _sleep+0x358/frame 0xfffffe00004d2a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00004d2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100077 td 0xfffff80003aab560 sched_switch() at sched_switch+0x525/frame 0xfffffe00004cd8c0 mi_switch() at mi_switch+0x188/frame 0xfffffe00004cd8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004cd930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004cd960 _sleep() at _sleep+0x358/frame 0xfffffe00004cda00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00004cda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004cdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004cdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100076 td 0xfffff80003aac000 sched_switch() at sched_switch+0x525/frame 0xfffffe00004c88f0 mi_switch() at mi_switch+0x188/frame 0xfffffe00004c8920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004c8960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c8990 _sleep() at _sleep+0x358/frame 0xfffffe00004c8a30 crypto_proc() at crypto_proc+0x7d/frame 0xfffffe00004c8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100060 td 0xfffff80003a1d000 sched_switch() at sched_switch+0x525/frame 0xfffffe00004788f0 mi_switch() at mi_switch+0x188/frame 0xfffffe0000478920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000478960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000478990 _sleep() at _sleep+0x358/frame 0xfffffe0000478a30 g_run_events() at g_run_events+0x11a/frame 0xfffffe0000478a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000478ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000478ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100061 td 0xfffff80003a1c560 sched_switch() at sched_switch+0x525/frame 0xfffffe000047d8f0 mi_switch() at mi_switch+0x188/frame 0xfffffe000047d920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000047d960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000047d990 _sleep() at _sleep+0x358/frame 0xfffffe000047da30 g_io_schedule_up() at g_io_schedule_up+0xa3/frame 0xfffffe000047da60 g_up_procbody() at g_up_procbody+0x6d/frame 0xfffffe000047da70 fork_exit() at fork_exit+0x84/frame 0xfffffe000047dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000047dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffff80003a1c000 sched_switch() at sched_switch+0x525/frame 0xfffffe00004828e0 mi_switch() at mi_switch+0x188/frame 0xfffffe0000482910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000482950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000482980 _sleep() at _sleep+0x358/frame 0xfffffe0000482a20 g_io_schedule_down() at g_io_schedule_down+0x14c/frame 0xfffffe0000482a60 g_down_procbody() at g_down_procbody+0x6d/frame 0xfffffe0000482a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000482ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000482ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100015 td 0xfffff80003930000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100018 td 0xfffff8000391e560 sched_switch() at sched_switch+0x525/frame 0xfffffe00789a59f0 mi_switch() at mi_switch+0x188/frame 0xfffffe00789a5a20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe00789a5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789a5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789a5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100019 td 0xfffff80003969000 sched_switch() at sched_switch+0x525/frame 0xfffffe00789aa9f0 mi_switch() at mi_switch+0x188/frame 0xfffffe00789aaa20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe00789aaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789aaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789aaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100046 td 0xfffff80003a09000 sched_switch() at sched_switch+0x525/frame 0xfffffe00004329f0 mi_switch() at mi_switch+0x188/frame 0xfffffe0000432a20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe0000432a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000432ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000432ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100047 td 0xfffff80003a08560 sched_switch() at sched_switch+0x525/frame 0xfffffe00004379f0 mi_switch() at mi_switch+0x188/frame 0xfffffe0000437a20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe0000437a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000437ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000437ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100048 td 0xfffff80003a08000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100049 td 0xfffff80003a07560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100050 td 0xfffff80003a07000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffff800039fb560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffff800039fb000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100053 td 0xfffff800039db560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100054 td 0xfffff80003a20000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100055 td 0xfffff80003a1f560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100056 td 0xfffff80003a1f000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100057 td 0xfffff80003a1e560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100058 td 0xfffff80003a1e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xfffff80003a1d560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100092 td 0xfffff80003c5d000 sched_switch() at sched_switch+0x525/frame 0xfffffe00005189f0 mi_switch() at mi_switch+0x188/frame 0xfffffe0000518a20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe0000518a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000518ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000518ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100093 td 0xfffff80003c5c560 sched_switch() at sched_switch+0x525/frame 0xfffffe000051d9f0 mi_switch() at mi_switch+0x188/frame 0xfffffe000051da20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe000051da70 fork_exit() at fork_exit+0x84/frame 0xfffffe000051dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000051dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100099 td 0xfffff80004130560 sched_switch() at sched_switch+0x525/frame 0xfffffe000053b9f0 mi_switch() at mi_switch+0x188/frame 0xfffffe000053ba20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe000053ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000053bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000053bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100110 td 0xfffff8000800b560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100111 td 0xfffff8000800b000 sched_switch() at sched_switch+0x525/frame 0xfffffe00005779f0 mi_switch() at mi_switch+0x188/frame 0xfffffe0000577a20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe0000577a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000577ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000577ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffff8000391d000 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81e984b0 ipi_nmi_handler() at ipi_nmi_handler+0x45/frame 0xffffffff81e984d0 trap() at trap+0x49/frame 0xffffffff81e985e0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81e985e0 --- trap 0x13, rip = 0xffffffff810add76, rsp = 0xfffffe007895a910, rbp = 0xfffffe007895a910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007895a910 acpi_cpu_idle() at acpi_cpu_idle+0x2e6/frame 0xfffffe007895a960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007895a980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007895a9a0 sched_idletd() at sched_idletd+0xc2/frame 0xfffffe007895aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007895aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007895aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff8000391c560 sched_switch() at sched_switch+0x525/frame 0xfffffe007895f970 mi_switch() at mi_switch+0x188/frame 0xfffffe007895f9a0 sched_idletd() at sched_idletd+0x387/frame 0xfffffe007895fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007895fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007895fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff8000391c000 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071b3df0 ipi_nmi_handler() at ipi_nmi_handler+0x45/frame 0xfffffe00071b3e10 trap() at trap+0x49/frame 0xfffffe00071b3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071b3f20 --- trap 0x13, rip = 0xffffffff810add76, rsp = 0xfffffe0078964910, rbp = 0xfffffe0078964910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078964910 acpi_cpu_idle() at acpi_cpu_idle+0x2e6/frame 0xfffffe0078964960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078964980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789649a0 sched_idletd() at sched_idletd+0xc2/frame 0xfffffe0078964a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078964ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078964ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff8000391b560 sched_switch() at sched_switch+0x525/frame 0xfffffe0078969970 mi_switch() at mi_switch+0x188/frame 0xfffffe00789699a0 sched_idletd() at sched_idletd+0x387/frame 0xfffffe0078969a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078969ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078969ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff8000391b000 sched_switch() at sched_switch+0x525/frame 0xfffffe007896e950 mi_switch() at mi_switch+0x188/frame 0xfffffe007896e980 critical_exit() at critical_exit+0x8b/frame 0xfffffe007896e9a0 sched_idletd() at sched_idletd+0xc2/frame 0xfffffe007896ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe007896eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007896eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff80003915560 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071cbdf0 ipi_nmi_handler() at ipi_nmi_handler+0x45/frame 0xfffffe00071cbe10 trap() at trap+0x49/frame 0xfffffe00071cbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071cbf20 --- trap 0x13, rip = 0xffffffff810add76, rsp = 0xfffffe0078973910, rbp = 0xfffffe0078973910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078973910 acpi_cpu_idle() at acpi_cpu_idle+0x2e6/frame 0xfffffe0078973960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078973980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789739a0 sched_idletd() at sched_idletd+0xc2/frame 0xfffffe0078973a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078973ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078973ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff80003915000 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071d3df0 ipi_nmi_handler() at ipi_nmi_handler+0x45/frame 0xfffffe00071d3e10 trap() at trap+0x49/frame 0xfffffe00071d3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071d3f20 --- trap 0x13, rip = 0xffffffff810add76, rsp = 0xfffffe0078978910, rbp = 0xfffffe0078978910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078978910 acpi_cpu_idle() at acpi_cpu_idle+0x2e6/frame 0xfffffe0078978960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078978980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789789a0 sched_idletd() at sched_idletd+0xc2/frame 0xfffffe0078978a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078978ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078978ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff80003932560 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071dbdf0 ipi_nmi_handler() at ipi_nmi_handler+0x45/frame 0xfffffe00071dbe10 trap() at trap+0x49/frame 0xfffffe00071dbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071dbf20 --- trap 0x13, rip = 0xffffffff810add76, rsp = 0xfffffe007897d910, rbp = 0xfffffe007897d910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007897d910 acpi_cpu_idle() at acpi_cpu_idle+0x2e6/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0xc2/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff80003932000 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071e3df0 ipi_nmi_handler() at ipi_nmi_handler+0x45/frame 0xfffffe00071e3e10 trap() at trap+0x49/frame 0xfffffe00071e3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071e3f20 --- trap 0x13, rip = 0xffffffff810add76, rsp = 0xfffffe0078982910, rbp = 0xfffffe0078982910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078982910 acpi_cpu_idle() at acpi_cpu_idle+0x2e6/frame 0xfffffe0078982960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078982980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789829a0 sched_idletd() at sched_idletd+0xc2/frame 0xfffffe0078982a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078982ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078982ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff80003931560 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071ebdf0 ipi_nmi_handler() at ipi_nmi_handler+0x45/frame 0xfffffe00071ebe10 trap() at trap+0x49/frame 0xfffffe00071ebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071ebf20 --- trap 0x13, rip = 0xffffffff810add76, rsp = 0xfffffe0078987910, rbp = 0xfffffe0078987910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078987910 acpi_cpu_idle() at acpi_cpu_idle+0x2e6/frame 0xfffffe0078987960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078987980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789879a0 sched_idletd() at sched_idletd+0xc2/frame 0xfffffe0078987a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078987ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078987ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff80003931000 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071f3df0 ipi_nmi_handler() at ipi_nmi_handler+0x45/frame 0xfffffe00071f3e10 trap() at trap+0x49/frame 0xfffffe00071f3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071f3f20 --- trap 0x13, rip = 0xffffffff810add76, rsp = 0xfffffe007898c910, rbp = 0xfffffe007898c910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007898c910 acpi_cpu_idle() at acpi_cpu_idle+0x2e6/frame 0xfffffe007898c960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007898c980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007898c9a0 sched_idletd() at sched_idletd+0xc2/frame 0xfffffe007898ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe007898cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007898cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff80003930560 sched_switch() at sched_switch+0x525/frame 0xfffffe0078991970 mi_switch() at mi_switch+0x188/frame 0xfffffe00789919a0 sched_idletd() at sched_idletd+0x387/frame 0xfffffe0078991a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078991ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078991ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff8000391d560 sched_switch() at sched_switch+0x525/frame 0xfffffe0078955560 mi_switch() at mi_switch+0x188/frame 0xfffffe0078955590 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789555d0 sleepq_catch_signals() at sleepq_catch_signals+0x301/frame 0xfffffe0078955630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0078955660 _sleep() at _sleep+0x34a/frame 0xfffffe0078955700 kern_wait6() at kern_wait6+0x1cb/frame 0xfffffe0078955790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe0078955980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe0078955ab0 fast_syscall_common() at fast_syscall_common+0x100/frame 0x7fffffffe7f0 Tracing command audit pid 10 tid 100001 td 0xfffff8000391e000 sched_switch() at sched_switch+0x525/frame 0xfffffe0078950910 mi_switch() at mi_switch+0x188/frame 0xfffffe0078950940 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0078950980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789509b0 _cv_wait() at _cv_wait+0x202/frame 0xfffffe0078950a10 audit_worker() at audit_worker+0x363/frame 0xfffffe0078950a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078950ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078950ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81eddb80 sched_switch() at sched_switch+0x525/frame 0xffffffff8248a9d0 mi_switch() at mi_switch+0x188/frame 0xffffffff8248aa00 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffffff8248aa40 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xffffffff8248aa80 _sleep() at _sleep+0x2fa/frame 0xffffffff8248ab20 swapper() at swapper+0xcb/frame 0xffffffff8248ab70 btext() at btext+0x2c Tracing command kernel pid 0 tid 100016 td 0xfffff8000392f560 sched_switch() at sched_switch+0x525/frame 0xfffffe007899b900 mi_switch() at mi_switch+0x188/frame 0xfffffe007899b930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe007899b970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe007899b9a0 _sleep() at _sleep+0x358/frame 0xfffffe007899ba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe007899ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe007899bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007899bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffff8000392f000 sched_switch() at sched_switch+0x525/frame 0xfffffe00789a0900 mi_switch() at mi_switch+0x188/frame 0xfffffe00789a0930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789a0970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789a09a0 _sleep() at _sleep+0x358/frame 0xfffffe00789a0a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00789a0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789a0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789a0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffff80003968560 sched_switch() at sched_switch+0x525/frame 0xfffffe00789af900 mi_switch() at mi_switch+0x188/frame 0xfffffe00789af930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789af970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789af9a0 _sleep() at _sleep+0x358/frame 0xfffffe00789afa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00789afa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789afab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789afab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffff80003968000 sched_switch() at sched_switch+0x525/frame 0xfffffe00789b4920 mi_switch() at mi_switch+0x188/frame 0xfffffe00789b4950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789b4990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789b49c0 msleep_spin_sbt() at msleep_spin_sbt+0x1ea/frame 0xfffffe00789b4a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789b4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789b4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789b4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffff80003967560 sched_switch() at sched_switch+0x525/frame 0xfffffe00789b9920 mi_switch() at mi_switch+0x188/frame 0xfffffe00789b9950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789b9990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789b99c0 msleep_spin_sbt() at msleep_spin_sbt+0x1ea/frame 0xfffffe00789b9a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789b9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789b9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789b9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffff80003967000 sched_switch() at sched_switch+0x525/frame 0xfffffe00789be920 mi_switch() at mi_switch+0x188/frame 0xfffffe00789be950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789be990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789be9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1ea/frame 0xfffffe00789bea40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789bea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789beab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789beab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffff80003966560 sched_switch() at sched_switch+0x525/frame 0xfffffe00789c3920 mi_switch() at mi_switch+0x188/frame 0xfffffe00789c3950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789c3990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789c39c0 msleep_spin_sbt() at msleep_spin_sbt+0x1ea/frame 0xfffffe00789c3a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789c3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789c3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789c3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffff80003966000 sched_switch() at sched_switch+0x525/frame 0xfffffe00789c8920 mi_switch() at mi_switch+0x188/frame 0xfffffe00789c8950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789c8990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789c89c0 msleep_spin_sbt() at msleep_spin_sbt+0x1ea/frame 0xfffffe00789c8a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789c8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789c8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789c8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffff80003965560 sched_switch() at sched_switch+0x525/frame 0xfffffe00789cd920 mi_switch() at mi_switch+0x188/frame 0xfffffe00789cd950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789cd990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789cd9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1ea/frame 0xfffffe00789cda40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789cda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789cdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789cdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffff80003965000 sched_switch() at sched_switch+0x525/frame 0xfffffe00789d2920 mi_switch() at mi_switch+0x188/frame 0xfffffe00789d2950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789d2990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789d29c0 msleep_spin_sbt() at msleep_spin_sbt+0x1ea/frame 0xfffffe00789d2a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789d2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789d2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789d2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffff80003973560 sched_switch() at sched_switch+0x525/frame 0xfffffe00789d7920 mi_switch() at mi_switch+0x188/frame 0xfffffe00789d7950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789d7990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789d79c0 msleep_spin_sbt() at msleep_spin_sbt+0x1ea/frame 0xfffffe00789d7a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789d7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789d7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789d7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffff80003973000 sched_switch() at sched_switch+0x525/frame 0xfffffe00789dc920 mi_switch() at mi_switch+0x188/frame 0xfffffe00789dc950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789dc990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789dc9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1ea/frame 0xfffffe00789dca40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789dca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789dcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789dcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffff80003972560 sched_switch() at sched_switch+0x525/frame 0xfffffe00789e1920 mi_switch() at mi_switch+0x188/frame 0xfffffe00789e1950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789e1990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789e19c0 msleep_spin_sbt() at msleep_spin_sbt+0x1ea/frame 0xfffffe00789e1a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789e1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789e1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789e1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffff80003972000 sched_switch() at sched_switch+0x525/frame 0xfffffe00789e6920 mi_switch() at mi_switch+0x188/frame 0xfffffe00789e6950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789e6990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789e69c0 msleep_spin_sbt() at msleep_spin_sbt+0x1ea/frame 0xfffffe00789e6a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789e6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789e6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789e6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffff80003971560 sched_switch() at sched_switch+0x525/frame 0xfffffe00789eb920 mi_switch() at mi_switch+0x188/frame 0xfffffe00789eb950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789eb990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789eb9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1ea/frame 0xfffffe00789eba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789eba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789ebab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789ebab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff80003971000 sched_switch() at sched_switch+0x525/frame 0xfffffe00789f0920 mi_switch() at mi_switch+0x188/frame 0xfffffe00789f0950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789f0990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789f09c0 msleep_spin_sbt() at msleep_spin_sbt+0x1ea/frame 0xfffffe00789f0a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789f0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789f0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789f0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffff80003970560 sched_switch() at sched_switch+0x525/frame 0xfffffe00789f5920 mi_switch() at mi_switch+0x188/frame 0xfffffe00789f5950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789f5990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789f59c0 msleep_spin_sbt() at msleep_spin_sbt+0x1ea/frame 0xfffffe00789f5a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789f5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789f5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789f5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffff80003970000 sched_switch() at sched_switch+0x525/frame 0xfffffe00789fa920 mi_switch() at mi_switch+0x188/frame 0xfffffe00789fa950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789fa990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789fa9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1ea/frame 0xfffffe00789faa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789faa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789faab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789faab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffff80003969560 sched_switch() at sched_switch+0x525/frame 0xfffffe00789ff920 mi_switch() at mi_switch+0x188/frame 0xfffffe00789ff950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789ff990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789ff9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1ea/frame 0xfffffe00789ffa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789ffa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789ffab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789ffab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffff800039db000 sched_switch() at sched_switch+0x525/frame 0xfffffe0000405920 mi_switch() at mi_switch+0x188/frame 0xfffffe0000405950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000405990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004059c0 msleep_spin_sbt() at msleep_spin_sbt+0x1ea/frame 0xfffffe0000405a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000405a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000405ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000405ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffff800039d3560 sched_switch() at sched_switch+0x525/frame 0xfffffe000040a920 mi_switch() at mi_switch+0x188/frame 0xfffffe000040a950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000040a990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000040a9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1ea/frame 0xfffffe000040aa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000040aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000040aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000040aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffff800039d3000 sched_switch() at sched_switch+0x525/frame 0xfffffe000040f920 mi_switch() at mi_switch+0x188/frame 0xfffffe000040f950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000040f990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000040f9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1ea/frame 0xfffffe000040fa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000040fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000040fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000040fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffff800039ce560 sched_switch() at sched_switch+0x525/frame 0xfffffe0000414920 mi_switch() at mi_switch+0x188/frame 0xfffffe0000414950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000414990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004149c0 msleep_spin_sbt() at msleep_spin_sbt+0x1ea/frame 0xfffffe0000414a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000414a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000414ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000414ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffff800039ce000 sched_switch() at sched_switch+0x525/frame 0xfffffe0000419920 mi_switch() at mi_switch+0x188/frame 0xfffffe0000419950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000419990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004199c0 msleep_spin_sbt() at msleep_spin_sbt+0x1ea/frame 0xfffffe0000419a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000419a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000419ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000419ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffff800039c8560 sched_switch() at sched_switch+0x525/frame 0xfffffe000041e920 mi_switch() at mi_switch+0x188/frame 0xfffffe000041e950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000041e990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000041e9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1ea/frame 0xfffffe000041ea40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000041ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000041eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000041eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffff800039c8000 sched_switch() at sched_switch+0x525/frame 0xfffffe0000423920 mi_switch() at mi_switch+0x188/frame 0xfffffe0000423950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000423990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004239c0 msleep_spin_sbt() at msleep_spin_sbt+0x1ea/frame 0xfffffe0000423a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000423a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000423ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000423ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffff800039c5560 sched_switch() at sched_switch+0x525/frame 0xfffffe0000428920 mi_switch() at mi_switch+0x188/frame 0xfffffe0000428950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000428990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004289c0 msleep_spin_sbt() at msleep_spin_sbt+0x1ea/frame 0xfffffe0000428a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000428a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000428ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000428ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffff80003a09560 sched_switch() at sched_switch+0x525/frame 0xfffffe000042d920 mi_switch() at mi_switch+0x188/frame 0xfffffe000042d950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000042d990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000042d9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1ea/frame 0xfffffe000042da40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000042da70 fork_exit() at fork_exit+0x84/frame 0xfffffe000042dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000042dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100063 td 0xfffff80003a69560 sched_switch() at sched_switch+0x525/frame 0xfffffe0000487900 mi_switch() at mi_switch+0x188/frame 0xfffffe0000487930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000487970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004879a0 _sleep() at _sleep+0x358/frame 0xfffffe0000487a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000487a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000487ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000487ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffff80003a69000 sched_switch() at sched_switch+0x525/frame 0xfffffe000048c900 mi_switch() at mi_switch+0x188/frame 0xfffffe000048c930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000048c970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000048c9a0 _sleep() at _sleep+0x358/frame 0xfffffe000048ca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe000048ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe000048cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000048cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xfffff80003a68560 sched_switch() at sched_switch+0x525/frame 0xfffffe0000491900 mi_switch() at mi_switch+0x188/frame 0xfffffe0000491930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000491970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004919a0 _sleep() at _sleep+0x358/frame 0xfffffe0000491a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000491a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000491ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000491ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff80003a68000 sched_switch() at sched_switch+0x525/frame 0xfffffe0000496900 mi_switch() at mi_switch+0x188/frame 0xfffffe0000496930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000496970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004969a0 _sleep() at _sleep+0x358/frame 0xfffffe0000496a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000496a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000496ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000496ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff80003a67560 sched_switch() at sched_switch+0x525/frame 0xfffffe000049b900 mi_switch() at mi_switch+0x188/frame 0xfffffe000049b930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000049b970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000049b9a0 _sleep() at _sleep+0x358/frame 0xfffffe000049ba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe000049ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000049bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000049bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff80003a67000 sched_switch() at sched_switch+0x525/frame 0xfffffe00004a0900 mi_switch() at mi_switch+0x188/frame 0xfffffe00004a0930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004a0970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a09a0 _sleep() at _sleep+0x358/frame 0xfffffe00004a0a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00004a0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffff80003a66560 sched_switch() at sched_switch+0x525/frame 0xfffffe00004a5900 mi_switch() at mi_switch+0x188/frame 0xfffffe00004a5930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004a5970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a59a0 _sleep() at _sleep+0x358/frame 0xfffffe00004a5a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00004a5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff80003a66000 sched_switch() at sched_switch+0x525/frame 0xfffffe00004aa900 mi_switch() at mi_switch+0x188/frame 0xfffffe00004aa930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004aa970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004aa9a0 _sleep() at _sleep+0x358/frame 0xfffffe00004aaa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00004aaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004aaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004aaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff80003a20560 sched_switch() at sched_switch+0x525/frame 0xfffffe00004af900 mi_switch() at mi_switch+0x188/frame 0xfffffe00004af930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004af970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004af9a0 _sleep() at _sleep+0x358/frame 0xfffffe00004afa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00004afa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004afab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004afab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffff80003aae000 sched_switch() at sched_switch+0x525/frame 0xfffffe00004b4900 mi_switch() at mi_switch+0x188/frame 0xfffffe00004b4930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004b4970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b49a0 _sleep() at _sleep+0x358/frame 0xfffffe00004b4a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00004b4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffff80003aad560 sched_switch() at sched_switch+0x525/frame 0xfffffe00004b9900 mi_switch() at mi_switch+0x188/frame 0xfffffe00004b9930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004b9970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b99a0 _sleep() at _sleep+0x358/frame 0xfffffe00004b9a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00004b9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffff80003aad000 sched_switch() at sched_switch+0x525/frame 0xfffffe00004be900 mi_switch() at mi_switch+0x188/frame 0xfffffe00004be930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004be970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004be9a0 _sleep() at _sleep+0x358/frame 0xfffffe00004bea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00004bea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004beab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004beab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffff80003aac560 sched_switch() at sched_switch+0x525/frame 0xfffffe00004c3900 mi_switch() at mi_switch+0x188/frame 0xfffffe00004c3930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004c3970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c39a0 _sleep() at _sleep+0x358/frame 0xfffffe00004c3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00004c3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100112 td 0xfffff80008003560 sched_switch() at sched_switch+0x525/frame 0xfffffe000057c920 mi_switch() at mi_switch+0x188/frame 0xfffffe000057c950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000057c990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000057c9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1ea/frame 0xfffffe000057ca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe000057ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe000057cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000057cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100119 td 0xfffff8001312b000 sched_switch() at sched_switch+0x525/frame 0xfffffe00005a0920 mi_switch() at mi_switch+0x188/frame 0xfffffe00005a0950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005a0990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005a09c0 msleep_spin_sbt() at msleep_spin_sbt+0x1ea/frame 0xfffffe00005a0a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00005a0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005a0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005a0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100120 td 0xfffff8001312a560 sched_switch() at sched_switch+0x525/frame 0xfffffe00005a5920 mi_switch() at mi_switch+0x188/frame 0xfffffe00005a5950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005a5990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005a59c0 msleep_spin_sbt() at msleep_spin_sbt+0x1ea/frame 0xfffffe00005a5a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00005a5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005a5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005a5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffff8001312a000 sched_switch() at sched_switch+0x525/frame 0xfffffe00005aa920 mi_switch() at mi_switch+0x188/frame 0xfffffe00005aa950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005aa990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005aa9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1ea/frame 0xfffffe00005aaa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00005aaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005aaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005aaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffff80013129560 sched_switch() at sched_switch+0x525/frame 0xfffffe00005af900 mi_switch() at mi_switch+0x188/frame 0xfffffe00005af930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005af970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005af9a0 _sleep() at _sleep+0x358/frame 0xfffffe00005afa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005afa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005afab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005afab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:allt> dump Dumping 1205 out of 32626 MB:..2%..11%..22%..31%..42%..51%..62%..71%..81%..91% Dump complete db:0:dump> reset cpu_reset: Restarting BSP -- Test scenario: misc/pmc2.sh