vmcore.102 KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2018 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 12.0-CURRENT #1 r337396: Tue Aug 7 13:59:58 CEST 2018 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 6.0.1 (tags/RELEASE_601/final 335540) (based on LLVM 6.0.1) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Entering uma_startup with 10 boot pages configured startup_alloc from "UMA Kegs", 8 boot pages left startup_alloc from "UMA Zones", 7 boot pages left startup_alloc from "UMA Zones", 6 boot pages left startup_alloc from "UMA Zones", 5 boot pages left startup_alloc from "UMA Zones", 4 boot pages left startup_alloc from "UMA Zones", 3 boot pages left startup_alloc from "UMA Hash", 2 boot pages left startup_alloc from "UMA Zones", 1 boot pages left Entering uma_startup1 with 0 boot pages left Entering uma_startup2 with 0 boot pages left VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.07-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33175134208 (31638 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: unblocking device. ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-47 on motherboard Launching APs: 1 2 3 6 8 10 9 4 5 11 7 Timecounter "TSC-low" frequency 1750036260 Hz quality 1000 random: entropy device external interface module_register_init: MOD_LOAD (vesa, 0xffffffff811270f0, 0) error 19 random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" kbd1 at kbdmux0 netmap: loaded module [ath_hal] loaded nexus0 vtvga0: on motherboard cryptosoft0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: attach_pre capping queues at 8 igb0: using 1024 tx descriptors and 1024 rx descriptors igb0: msix_init qsets capped at 8 igb0: pxm cpus: 6 queue msgs: 9 admincnt: 1 igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: using 6 rx queues 6 tx queues i** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 72 files, 22182 used, 1243225 free (145 frags, 155385 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** ELF ldconfig path: /lib /usr/libocal/lib ugen0.3: at usbus0 ukbd0 on uhub5 ukbd0: on usbus0 32-bit compatibikbd2 at ukbd0 lity ldconfig path:b32 Setting hostname: mercat1.netperf.freebsd.org. Setting up harvesting: PURE_RDRAND,[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,NET_ETHER,NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . lo0: link state changed to UP Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8802 metric 0 mtu 1500 options=e505bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: ums.ko Autoloading moduums0 on uhub5 ums0: on usbus0 le: uhid.ko ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff8012a199000 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 7 Aug 14:05:17 ntpdate[1537]: step time server 192.168.5.1 offset 0.330916 sec Starting rpcbind. Starting watchdogd. No core dumps found. NFS access cache time=60 lock order reversal: 1st 0xfffffe0000ea0070 bufwait (bufwait) @ kern/vfs_bio.c:3916 2nd 0xfffff80003622c00 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:289 stack backtrace: #0 0xffffffff80c06513 at witness_debugger+0x73 #1 0xffffffff80c06394 at witness_checkorder+0xe34 #2 0xffffffff80ba32e8 at _sx_xlock+0x68 #3 0xffffffff80ee860d at ufsdirhash_add+0x4d #4 0xffffffff80eed12f at ufs_direnter+0x49f #5 0xffffffff80ef5759 at ufs_mkdir+0x8b9 #6 0xffffffff812275ad at VOP_MKDIR_APV+0xfd #7 0xffffffff80c8220e at kern_mkdirat+0x1be #8 0xffffffff810a493c at amd64_syscall+0x29c #9 0xffffffff8107e13d at fast_syscall_common+0x101 Clearing /tmp (X related). Starting statd. Starting lockd. Updating motd:. Mounting late filesystems:. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Tue Aug 7 14:05 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root Aug 7 14:05:22 mercat1 login[1791]: ROOT LOGIN (root) ON ttyu1 Last login: Tue Aug 7 12:07:17 on ttyu1 FreeBSD 12.0-CURRENT (PHO) #1 r337396: Tue Aug 7 13:59:58 CEST 2018 Welcome to FreeBSD! Release Notes, Errata: https://www.FreeBSD.org/releases/ Security Advisories: https://www.FreeBSD.org/security/ FreeBSD Handbook: https://www.FreeBSD.org/handbook/ FreeBSD FAQ: https://www.FreeBSD.org/faq/ Questions List: https://lists.FreeBSD.org/mailman/listinfo/freebsd-questions/ FreeBSD Forums: https://forums.FreeBSD.org/ Documents installed with the system are in the /usr/local/share/doc/freebsd/ directory, or can be installed later with: pkg install en-freebsd-doc For other languages, replace "en" with a language code like de or fr. Show the version of FreeBSD installed: freebsd-version ; uname -a Please include that output and any error messages when posting questions. Introduction to manual pages: man man FreeBSD directory layout: man hier Edit /etc/motd to change this login announcement. [?1l>root@mercat1:~ # Aug 7 14:05:29 mercat1 su[1802]: pho to root on /dev/pts/0 20180807 14:05:57 all (1/1): pfl2.sh lock order reversal: 1st 0xfffff80148b98068 ufs (ufs) @ kern/vfs_subr.c:2572 2nd 0xfffffe0000f50998 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:282 3rd 0xfffff80148e512e0 ufs (ufs) @ kern/vfs_subr.c:2572 stack backtrace: #0 0xffffffff80c06513 at witness_debugger+0x73 #1 0xffffffff80c06394 at witness_checkorder+0xe34 #2 0xffffffff80b6d5fb at lockmgr_xlock_hard+0x6b #3 0xffffffff80b6e005 at __lockmgr_args+0x545 #4 0xffffffff80ee326f at ffs_lock+0xaf #5 0xffffffff812282c1 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c85076 at _vn_lock+0x66 #7 0xffffffff80c73348 at vget+0x98 #8 0xffffffff80c651f1 at vfs_hash_get+0xd1 #9 0xffffffff80edc8d9 at ffs_vgetf+0x69 #10 0xffffffff80ec6d65 at flush_pagedep_deps+0x395 #11 0xffffffff80ec68aa at softdep_sync_buf+0x43a #12 0xffffffff80ee4064 at ffs_syncvnode+0x294 #13 0xffffffff80ea136b at ffs_truncate+0xddb #14 0xffffffff80eed2d1 at ufs_direnter+0x641 #15 0xffffffff80ef5759 at ufs_mkdir+0x8b9 #16 0xffffffff812275ad at VOP_MKDIR_APV+0xfd #17 0xffffffff80c8220e at kern_mkdirat+0x1be Aug 7 14:14:36 mercat1 kernel: pid 19864 (rw), uid 2007 inumber 129565 on /mnt10: filesystem full softdep_waitidle: Failed to flush worklist for 0xfffff8023c19b000 softdep_waitidle: Failed to flush worklist for 0xfffff8023c19b000 softdep_waitidle: Failed to flush worklist for 0xfffff8023c19b000 softdep_waitidle: Failed to flush worklist for 0xfffff8023c19b000 softdep_waitidle: Failed to flush worklist for 0xfffff8023c19b000 softdep_waitidle: Failed to flush worklist for 0xfffff8023c19b000 softdep_waitidle: Failed to flush worklist for 0xfffff8023c19b000 softdep_waitidle: Failed to flush worklist for 0xfffff8023c19b000 softdep_waitidle: Failed to flush worklist for 0xfffff8023c19b000 softdep_waitidle: Failed to flush worklist for 0xfffff8023c19b000 softdep_waitidle: Failed to flush worklist for 0xfffff8023c19b000 softdep_waitidle: Failed to flush worklist for 0xfffff8023c19b000 softdep_waitidle: Failed to flush worklist for 0xfffff8023c19b000 softdep_waitidle: Failed to flush worklist for 0xfffff8023c19b000 Aug 7 15:04:49 mercat1 su[94535]: pho to root on /dev/pts/1 ps -lp 89592 UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 0 89592 3446 0 20 0 10904 2420 softdeps D+ 0 0:00.00 umount /mnt11 root@mercat1:~ # procstat -k 89592 PID TID COMM TDNAME KSTACK 89592 100442 umount - mi_switch sleepq_switch sleepq_timedwait _sleep softdep_waitidle softdep_flushfiles ffs_unmount dounmount sys_unmount amd64_syscall fast_syscall_common root@mercat1:~ # ~. [terminated ipmitool] KDB: enter: Break to debugger [ thread pid 11 tid 100003 ] Stopped at kdb_alt_break_internal+0x106: movq $0,kdb_why db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> bt Tracing pid 11 tid 100003 td 0xfffff8000365f000 kdb_alt_break_internal() at kdb_alt_break_internal+0x106/frame 0xfffffe007895a6f0 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe007895a700 uart_intr_rxready() at uart_intr_rxready+0x9a/frame 0xfffffe007895a730 uart_intr() at uart_intr+0x138/frame 0xfffffe007895a770 intr_event_handle() at intr_event_handle+0xfd/frame 0xfffffe007895a7d0 intr_execute_handlers() at intr_execute_handlers+0x58/frame 0xfffffe007895a800 lapic_handle_intr() at lapic_handle_intr+0x6d/frame 0xfffffe007895a840 Xapic_isr1() at Xapic_isr1+0xd9/frame 0xfffffe007895a840 --- interrupt, rip = 0xffffffff8120b1d6, rsp = 0xfffffe007895a910, rbp = 0xfffffe007895a910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007895a910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe007895a960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007895a980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007895a9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007895aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007895aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007895aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:1:pho1> show allpcpu Current CPU: 0 cpuid = 0 dynamic pcpu = 0xd09680 curthread = 0xfffff8000365f000: pid 11 tid 100003 "idle: cpu0" curpcb = 0xfffffe007895ab80 fpcurthread = none idlethread = 0xfffff8000365f000: tid 100003 "idle: cpu0" curpmap = 0xffffffff820011b8 tssp = 0xffffffff8212bd20 commontssp = 0xffffffff8212bd20 rsp0 = 0xfffffe007895ab80 gs32p = 0xffffffff82132958 ldt = 0xffffffff82132998 tss = 0xffffffff82132988 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe0085619680 curthread = 0xfffff8000365e580: pid 11 tid 100004 "idle: cpu1" curpcb = 0xfffffe007895fb80 fpcurthread = none idlethread = 0xfffff8000365e580: tid 100004 "idle: cpu1" curpmap = 0xffffffff820011b8 tssp = 0xffffffff8212bd88 commontssp = 0xffffffff8212bd88 rsp0 = 0xfffffe007895fb80 gs32p = 0xffffffff821329c0 ldt = 0xffffffff82132a00 tss = 0xffffffff821329f0 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe0085625680 curthread = 0xfffff8000365e000: pid 11 tid 100005 "idle: cpu2" curpcb = 0xfffffe0078964b80 fpcurthread = none idlethread = 0xfffff8000365e000: tid 100005 "idle: cpu2" curpmap = 0xffffffff820011b8 tssp = 0xffffffff8212bdf0 commontssp = 0xffffffff8212bdf0 rsp0 = 0xfffffe0078964b80 gs32p = 0xffffffff82132a28 ldt = 0xffffffff82132a68 tss = 0xffffffff82132a58 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe0085631680 curthread = 0xfffff8000365d580: pid 11 tid 100006 "idle: cpu3" curpcb = 0xfffffe0078969b80 fpcurthread = none idlethread = 0xfffff8000365d580: tid 100006 "idle: cpu3" curpmap = 0xffffffff820011b8 tssp = 0xffffffff8212be58 commontssp = 0xffffffff8212be58 rsp0 = 0xfffffe0078969b80 gs32p = 0xffffffff82132a90 ldt = 0xffffffff82132ad0 tss = 0xffffffff82132ac0 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe008563d680 curthread = 0xfffff8000365d000: pid 11 tid 100007 "idle: cpu4" curpcb = 0xfffffe007896eb80 fpcurthread = none idlethread = 0xfffff8000365d000: tid 100007 "idle: cpu4" curpmap = 0xffffffff820011b8 tssp = 0xffffffff8212bec0 commontssp = 0xffffffff8212bec0 rsp0 = 0xfffffe007896eb80 gs32p = 0xffffffff82132af8 ldt = 0xffffffff82132b38 tss = 0xffffffff82132b28 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe0085649680 curthread = 0xfffff8000365c580: pid 11 tid 100008 "idle: cpu5" curpcb = 0xfffffe0078973b80 fpcurthread = none idlethread = 0xfffff8000365c580: tid 100008 "idle: cpu5" curpmap = 0xffffffff820011b8 tssp = 0xffffffff8212bf28 commontssp = 0xffffffff8212bf28 rsp0 = 0xfffffe0078973b80 gs32p = 0xffffffff82132b60 ldt = 0xffffffff82132ba0 tss = 0xffffffff82132b90 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe0085655680 curthread = 0xfffff8000365c000: pid 11 tid 100009 "idle: cpu6" curpcb = 0xfffffe0078978b80 fpcurthread = none idlethread = 0xfffff8000365c000: tid 100009 "idle: cpu6" curpmap = 0xffffffff820011b8 tssp = 0xffffffff8212bf90 commontssp = 0xffffffff8212bf90 rsp0 = 0xfffffe0078978b80 gs32p = 0xffffffff82132bc8 ldt = 0xffffffff82132c08 tss = 0xffffffff82132bf8 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe0085661680 curthread = 0xfffff80003670580: pid 11 tid 100010 "idle: cpu7" curpcb = 0xfffffe007897db80 fpcurthread = none idlethread = 0xfffff80003670580: tid 100010 "idle: cpu7" curpmap = 0xffffffff820011b8 tssp = 0xffffffff8212bff8 commontssp = 0xffffffff8212bff8 rsp0 = 0xfffffe007897db80 gs32p = 0xffffffff82132c30 ldt = 0xffffffff82132c70 tss = 0xffffffff82132c60 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe007f129680 curthread = 0xfffff80003670000: pid 11 tid 100011 "idle: cpu8" curpcb = 0xfffffe0078982b80 fpcurthread = none idlethread = 0xfffff80003670000: tid 100011 "idle: cpu8" curpmap = 0xffffffff820011b8 tssp = 0xffffffff8212c060 commontssp = 0xffffffff8212c060 rsp0 = 0xfffffe0078982b80 gs32p = 0xffffffff82132c98 ldt = 0xffffffff82132cd8 tss = 0xffffffff82132cc8 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe007f135680 curthread = 0xfffff8000366f580: pid 11 tid 100012 "idle: cpu9" curpcb = 0xfffffe0078987b80 fpcurthread = none idlethread = 0xfffff8000366f580: tid 100012 "idle: cpu9" curpmap = 0xffffffff820011b8 tssp = 0xffffffff8212c0c8 commontssp = 0xffffffff8212c0c8 rsp0 = 0xfffffe0078987b80 gs32p = 0xffffffff82132d00 ldt = 0xffffffff82132d40 tss = 0xffffffff82132d30 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe007f141680 curthread = 0xfffff8000366f000: pid 11 tid 100013 "idle: cpu10" curpcb = 0xfffffe007898cb80 fpcurthread = none idlethread = 0xfffff8000366f000: tid 100013 "idle: cpu10" curpmap = 0xffffffff820011b8 tssp = 0xffffffff8212c130 commontssp = 0xffffffff8212c130 rsp0 = 0xfffffe007898cb80 gs32p = 0xffffffff82132d68 ldt = 0xffffffff82132da8 tss = 0xffffffff82132d98 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe007f14d680 curthread = 0xfffff8000366e580: pid 11 tid 100014 "idle: cpu11" curpcb = 0xfffffe0078991b80 fpcurthread = none idlethread = 0xfffff8000366e580: tid 100014 "idle: cpu11" curpmap = 0xffffffff820011b8 tssp = 0xffffffff8212c198 commontssp = 0xffffffff8212c198 rsp0 = 0xfffffe0078991b80 gs32p = 0xffffffff82132dd0 ldt = 0xffffffff82132e10 tss = 0xffffffff82132e00 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 96848 (ls) thread 0xfffff802723cb580 (100450) shared lockmgr ufs (ufs) r = 0 (0xfffff8012d513068) locked @ kern/vfs_lookup.c:671 Process 89592 (umount) thread 0xfffff8023c4c5000 (100442) exclusive lockmgr ufs (ufs) r = 0 (0xfffff8023c188a48) locked @ kern/vfs_mount.c:1343 db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffff8012d513000: tag ufs, type VDIR usecount 82, writecount 0, refcount 85 mountedhere 0 flags (VV_ROOT|VI_ACTIVE) v_object 0xfffff8000362cd00 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: SHARED (count 1) #0 0xffffffff80b6d542 at lockmgr_slock_hard+0x332 #1 0xffffffff80b6e031 at __lockmgr_args+0x571 #2 0xffffffff80ee326f at ffs_lock+0xaf #3 0xffffffff812282c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c85076 at _vn_lock+0x66 #5 0xffffffff80c66c24 at lookup+0x114 #6 0xffffffff80c666cd at namei+0x4fd #7 0xffffffff80c7ff84 at kern_readlinkat+0x74 #8 0xffffffff80c7ff06 at sys_readlink+0x26 #9 0xffffffff810a493c at amd64_syscall+0x29c #10 0xffffffff8107e13d at fast_syscall_common+0x101 ino 2, on dev gpt/work vnode 0xfffff8023c1889e0: tag ufs, type VDIR usecount 1, writecount 0, refcount 2 mountedhere 0xfffff8023c19b000 flags (VI_ACTIVE) lock type ufs: EXCL by thread 0xfffff8023c4c5000 (pid 89592, umount, tid 100442) with shared waiters pending #0 0xffffffff80b6d94a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b6e005 at __lockmgr_args+0x545 #2 0xffffffff80ee326f at ffs_lock+0xaf #3 0xffffffff812282c1 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c85076 at _vn_lock+0x66 #5 0xffffffff80c6b13c at dounmount+0x6c #6 0xffffffff80c6b040 at sys_unmount+0x310 #7 0xffffffff810a493c at amd64_syscall+0x29c #8 0xffffffff8107e13d at fast_syscall_common+0x101 ino 70866048, on dev gpt/work db:1:pho1> show allchains chain 1: thread 100393 (pid 7160, sleep) sleeping on 0xffffffff81df65a6 "nanslp" chain 2: thread 100450 (pid 96848, ls) blocked on lockmgr ufsEXCL thread 100442 (pid 89592, umount) sleeping on 0xfffff8012d6fccd0 "softdeps" chain 3: thread 100438 (pid 96847, sh) sleeping on 0xfffff8027208d000 "wait" chain 4: thread 100222 (pid 95392, bash) sleeping on 0xfffff8012d247bc0 "select" chain 5: thread 100489 (pid 94535, csh) sleeping on 0xfffff802722845d0 "pause" chain 6: thread 100425 (pid 94508, su) sleeping on 0xfffff8023cba4000 "wait" chain 7: thread 100442 (pid 89592, umount) sleeping on 0xfffff8012d6fccd0 "softdeps" chain 8: thread 100199 (pid 3477, md11) sleeping on 0xfffff8023c1bf000 "mdwait" chain 9: thread 100255 (pid 3466, md10) sleeping on 0xfffff80148f04000 "mdwait" chain 10: thread 100258 (pid 3447, tee) sleeping on 0xfffff8012d8bd5f0 "piperd" chain 11: thread 100238 (pid 3446, sh) sleeping on 0xfffff80148e6b528 "wait" chain 12: thread 100223 (pid 3445, sh) sleeping on 0xfffff8012d6a6528 "wait" chain 13: thread 100187 (pid 3443, bash) sleeping on 0xfffff800038b6000 "wait" chain 14: thread 100227 (pid 3442, sshd) sleeping on 0xfffff80003d0e340 "select" chain 15: thread 100243 (pid 2943, sshd) sleeping on 0xfffff8012d240ac0 "select" chain 16: thread 100230 (pid 1970, sh) sleeping on 0xfffff8012d8bd000 "piperd" chain 17: thread 100229 (pid 1968, awk) sleeping on 0xfffff8012dd6a5f0 "piperd" chain 18: thread 100213 (pid 1967, sh) sleeping on 0xfffff80148d1ea50 "wait" chain 19: thread 100183 (pid 1877, sh) sleeping on 0xfffff8012d6a6a50 "wait" chain 20: thread 100192 (pid 1806, sh) sleeping on 0xfffff801482d5000 "wait" chain 21: thread 100180 (pid 1804, bash) sleeping on 0xfffff8012d6a7000 "wait" chain 22: thread 100198 (pid 1802, csh) sleeping on 0xfffff8012d17b0a8 "pause" chain 23: thread 100195 (pid 1801, su) sleeping on 0xfffff8012a154a50 "wait" chain 24: thread 100151 (pid 1800, bash) sleeping on 0xfffff800038b6a50 "wait" chain 25: thread 100185 (pid 1799, sshd) sleeping on 0xfffff8012d247cc0 "select" chain 26: thread 100194 (pid 1796, sshd) sleeping on 0xfffff8012d2faf40 "select" chain 27: thread 100141 (pid 1792, csh) sleeping on 0xfffff8012c0c70b0 "ttyin" chain 28: thread 100165 (pid 1791, login) sleeping on 0xfffff8012d589000 "wait" chain 29: thread 100142 (pid 1790, getty) sleeping on 0xfffff8012c0c74b0 "ttyin" chain 30: thread 100208 (pid 1789, getty) sleeping on 0xfffff8012d323cb0 "ttyin" chain 31: thread 100207 (pid 1788, getty) sleeping on 0xfffff8012d3240b0 "ttyin" chain 32: thread 100206 (pid 1787, getty) sleeping on 0xfffff8012d3244b0 "ttyin" chain 33: thread 100205 (pid 1786, getty) sleeping on 0xfffff8012d3248b0 "ttyin" chain 34: thread 100204 (pid 1785, getty) sleeping on 0xfffff8012d324cb0 "ttyin" chain 35: thread 100153 (pid 1784, getty) sleeping on 0xfffff8012d3250b0 "ttyin" chain 36: thread 100145 (pid 1783, getty) sleeping on 0xfffff8012d3254b0 "ttyin" chain 37: thread 100163 (pid 1782, getty) sleeping on 0xfffff8012d3258b0 "ttyin" chain 38: thread 100157 (pid 1738, cron) sleeping on 0xffffffff81df65a3 "nanslp" chain 39: thread 100167 (pid 1734, sshd) sleeping on 0xfffff80003676ac0 "select" chain 40: thread 100166 (pid 1669, NLM: master) sleeping on 0xfffff8012d2d8260 "rpcsvc" chain 41: thread 100196 (pid 1666, rpc.statd) sleeping on 0xfffff8012d0e97c0 "select" chain 42: thread 100169 (pid 1616, watchdogd) sleeping on 0xfffff8012d588a50 "wait" chain 43: thread 100191 (pid 1540, rpcbind) sleeping on 0xfffff80003d48bc0 "select" chain 44: thread 100186 (pid 1530, syslogd) sleeping on 0xfffff80003676bc0 "select" chain 45: thread 100161 (pid 1459, devd) sleeping on 0xfffff8012c009640 "select" chain 46: thread 100184 (pid 1454, dhclient) sleeping on 0xfffff80003cc3440 "select" chain 47: thread 100150 (pid 1410, dhclient) sleeping on 0xfffff80003cc3540 "select" chain 48: thread 100170 (pid 1407, dhclient) sleeping on 0xfffff8012d0e9c40 "select" chain 49: thread 100132 (pid 33, vnlru) sleeping on 0xfffff8012d17ba50 "vlruwt" chain 50: thread 100131 (pid 32, syncer) sleeping on 0xffffffff81f98a40 "syncer" chain 51: thread 100129 (pid 31, bufdaemon) sleeping on 0xffffffff81f97ee0 "qsleep" chain 52: thread 100134 (pid 31, bufspacedaemon-0) sleeping on 0xffffffff81a0a600 "-" chain 53: thread 100135 (pid 31, bufspacedaemon-1) sleeping on 0xffffffff81a128c0 "-" chain 54: thread 100136 (pid 31, bufspacedaemon-2) sleeping on 0xffffffff81a1ab80 "-" chain 55: thread 100137 (pid 31, bufspacedaemon-3) sleeping on 0xffffffff81a22e40 "-" chain 56: thread 100138 (pid 31, bufspacedaemon-4) sleeping on 0xffffffff81a2b100 "-" chain 57: thread 100139 (pid 31, bufspacedaemon-5) sleeping on 0xffffffff81a333c0 "-" chain 58: thread 100140 (pid 31, bufspacedaemon-6) sleeping on 0xffffffff81a3b680 "-" chain 59: thread 100154 (pid 31, / worker) sleeping on 0xfffff8012d6de2e8 "sdflush" chain 60: thread 100160 (pid 31, /tmp worker) sleeping on 0xfffff8012d67dae8 "sdflush" chain 61: thread 100261 (pid 31, /mnt10 worker) sleeping on 0xfffff8012d67d6e8 "sdflush" chain 62: thread 100262 (pid 31, /mnt11 worker) sleeping on 0xfffff8012d6fcce8 "sdflush" chain 63: thread 100128 (pid 30, vmdaemon) sleeping on 0xffffffff81fb4dc0 "psleep" chain 64: thread 100127 (pid 29, dom0) sleeping on 0xffffffff82025518 "psleep" chain 65: thread 100130 (pid 29, laundry: dom0) sleeping on 0xffffffff82025524 "launds" chain 66: thread 100133 (pid 29, uma) sleeping on 0xffffffff80f01740 "umarcl" chain 67: thread 100126 (pid 28, enc_daemon1) sleeping on 0xfffff8012d08d000 "idle" chain 68: thread 100125 (pid 27, enc_daemon0) sleeping on 0xfffff8012d08d528 "idle" chain 69: thread 100119 (pid 26, rand_harvestq) sleeping on 0xffffffff81cc6480 "-" chain 70: thread 100118 (pid 25, sctp_iterator) sleeping on 0xffffffff82023d00 "waiting_for_work" chain 71: thread 100117 (pid 24, soaiod4) sleeping on 0xffffffff81f978dc "-" chain 72: thread 100116 (pid 23, soaiod3) sleeping on 0xffffffff81f978dc "-" chain 73: thread 100115 (pid 22, soaiod2) sleeping on 0xffffffff81f978dc "-" chain 74: thread 100114 (pid 21, soaiod1) sleeping on 0xffffffff81f978dc "-" chain 75: thread 100095 (pid 20, usbus0) sleeping on 0xfffffe009c7bd460 "-" chain 76: thread 100096 (pid 20, usbus0) sleeping on 0xfffffe009c7bd4b8 "-" chain 77: thread 100097 (pid 20, usbus0) sleeping on 0xfffffe009c7bd510 "-" chain 78: thread 100098 (pid 20, usbus0) sleeping on 0xfffffe009c7bd568 "-" chain 79: thread 100099 (pid 20, usbus0) sleeping on 0xfffffe009c7bd5c0 "-" chain 80: thread 100101 (pid 20, usbus1) sleeping on 0xfffffe009a5c6d10 "-" chain 81: thread 100102 (pid 20, usbus1) sleeping on 0xfffffe009a5c6d68 "-" chain 82: thread 100103 (pid 20, usbus1) sleeping on 0xfffffe009a5c6dc0 "-" chain 83: thread 100104 (pid 20, usbus1) sleeping on 0xfffffe009a5c6e18 "-" chain 84: thread 100105 (pid 20, usbus1) sleeping on 0xfffffe009a5c6e70 "-" chain 85: thread 100106 (pid 20, usbus2) sleeping on 0xfffffe009ca21d10 "-" chain 86: thread 100107 (pid 20, usbus2) sleeping on 0xfffffe009ca21d68 "-" chain 87: thread 100108 (pid 20, usbus2) sleeping on 0xfffffe009ca21dc0 "-" chain 88: thread 100109 (pid 20, usbus2) sleeping on 0xfffffe009ca21e18 "-" chain 89: thread 100110 (pid 20, usbus2) sleeping on 0xfffffe009ca21e70 "-" chain 90: thread 100090 (pid 19, doneq0) sleeping on 0xffffffff81ba1740 "-" chain 91: thread 100091 (pid 19, doneq1) sleeping on 0xffffffff81ba17c0 "-" chain 92: thread 100092 (pid 19, doneq2) sleeping on 0xffffffff81ba1840 "-" chain 93: thread 100124 (pid 19, scanner) sleeping on 0xffffffff81ba1608 "-" chain 94: thread 100089 (pid 18, crypto returns 11) sleeping on 0xfffff800038aa450 "crypto_ret_wait" chain 95: thread 100088 (pid 17, crypto returns 10) sleeping on 0xfffff800038aa3f0 "crypto_ret_wait" chain 96: thread 100087 (pid 16, crypto returns 9) sleeping on 0xfffff800038aa390 "crypto_ret_wait" chain 97: thread 100086 (pid 15, crypto returns 8) sleeping on 0xfffff800038aa330 "crypto_ret_wait" chain 98: thread 100085 (pid 14, crypto returns 7) sleeping on 0xfffff800038aa2d0 "crypto_ret_wait" chain 99: thread 100084 (pid 9, crypto returns 6) sleeping on 0xfffff800038aa270 "crypto_ret_wait" chain 100: thread 100083 (pid 8, crypto returns 5) sleeping on 0xfffff800038aa210 "crypto_ret_wait" chain 101: thread 100082 (pid 7, crypto returns 4) sleeping on 0xfffff800038aa1b0 "crypto_ret_wait" chain 102: thread 100081 (pid 6, crypto returns 3) sleeping on 0xfffff800038aa150 "crypto_ret_wait" chain 103: thread 100080 (pid 5, crypto returns 2) sleeping on 0xfffff800038aa0f0 "crypto_ret_wait" chain 104: thread 100079 (pid 4, crypto returns 1) sleeping on 0xfffff800038aa090 "crypto_ret_wait" chain 105: thread 100078 (pid 3, crypto returns 0) sleeping on 0xfffff800038aa030 "crypto_ret_wait" chain 106: thread 100077 (pid 2, crypto) sleeping on 0xffffffff81faf3d0 "crypto_wait" chain 107: thread 100062 (pid 13, g_event) sleeping on 0xffffffff82000570 "-" chain 108: thread 100063 (pid 13, g_up) sleeping on 0xffffffff82000580 "-" chain 109: thread 100064 (pid 13, g_down) sleeping on 0xffffffff82000568 "-" chain 110: thread 100002 (pid 1, init) sleeping on 0xfffff8000365b528 "wait" chain 111: thread 100001 (pid 10, audit) sleeping on 0xffffffff82024a10 "audit_worker_cv" chain 112: thread 100000 (pid 0, swapper) sleeping on 0xffffffff820005b0 "swapin" chain 113: thread 100016 (pid 0, thread taskq) sleeping on 0xfffff800030d3b00 "-" chain 114: thread 100018 (pid 0, aiod_kick taskq) sleeping on 0xfffff800030d3900 "-" chain 115: thread 100019 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff800030d3800 "-" chain 116: thread 100021 (pid 0, config_0) sleeping on 0xfffff800030d3600 "-" chain 117: thread 100022 (pid 0, if_io_tqg_0) sleeping on 0xfffff800030d3500 "-" chain 118: thread 100023 (pid 0, if_io_tqg_1) sleeping on 0xfffff800030d3400 "-" chain 119: thread 100024 (pid 0, if_io_tqg_2) sleeping on 0xfffff800030d3300 "-" chain 120: thread 100025 (pid 0, if_io_tqg_3) sleeping on 0xfffff800030d3200 "-" chain 121: thread 100026 (pid 0, if_io_tqg_4) sleeping on 0xfffff800030d3100 "-" chain 122: thread 100027 (pid 0, if_io_tqg_5) sleeping on 0xfffff800030d3000 "-" chain 123: thread 100028 (pid 0, if_io_tqg_6) sleeping on 0xfffff800030d2e00 "-" chain 124: thread 100029 (pid 0, if_io_tqg_7) sleeping on 0xfffff800030d2d00 "-" chain 125: thread 100030 (pid 0, if_io_tqg_8) sleeping on 0xfffff800030d2c00 "-" chain 126: thread 100031 (pid 0, if_io_tqg_9) sleeping on 0xfffff800030d2b00 "-" chain 127: thread 100032 (pid 0, if_io_tqg_10) sleeping on 0xfffff800030d2a00 "-" chain 128: thread 100033 (pid 0, if_io_tqg_11) sleeping on 0xfffff800030d2900 "-" chain 129: thread 100034 (pid 0, softirq_0) sleeping on 0xfffff800030d2800 "-" chain 130: thread 100035 (pid 0, softirq_1) sleeping on 0xfffff800030d2700 "-" chain 131: thread 100036 (pid 0, softirq_2) sleeping on 0xfffff800030d2600 "-" chain 132: thread 100037 (pid 0, softirq_3) sleeping on 0xfffff800030d2500 "-" chain 133: thread 100038 (pid 0, softirq_4) sleeping on 0xfffff800030d2400 "-" chain 134: thread 100039 (pid 0, softirq_5) sleeping on 0xfffff800030d2300 "-" chain 135: thread 100040 (pid 0, softirq_6) sleeping on 0xfffff800030d2200 "-" chain 136: thread 100041 (pid 0, softirq_7) sleeping on 0xfffff800030d2100 "-" chain 137: thread 100042 (pid 0, softirq_8) sleeping on 0xfffff800030d2000 "-" chain 138: thread 100043 (pid 0, softirq_9) sleeping on 0xfffff800030d1e00 "-" chain 139: thread 100044 (pid 0, softirq_10) sleeping on 0xfffff800030d1d00 "-" chain 140: thread 100045 (pid 0, softirq_11) sleeping on 0xfffff800030d1c00 "-" chain 141: thread 100046 (pid 0, if_config_tqg_0) sleeping on 0xfffff80003773100 "-" chain 142: thread 100061 (pid 0, firmware taskq) sleeping on 0xfffff80003773000 "-" chain 143: thread 100065 (pid 0, crypto_0) sleeping on 0xfffff80003772d00 "-" chain 144: thread 100066 (pid 0, crypto_1) sleeping on 0xfffff80003772d00 "-" chain 145: thread 100067 (pid 0, crypto_2) sleeping on 0xfffff80003772d00 "-" chain 146: thread 100068 (pid 0, crypto_3) sleeping on 0xfffff80003772d00 "-" chain 147: thread 100069 (pid 0, crypto_4) sleeping on 0xfffff80003772d00 "-" chain 148: thread 100070 (pid 0, crypto_5) sleeping on 0xfffff80003772d00 "-" chain 149: thread 100071 (pid 0, crypto_6) sleeping on 0xfffff80003772d00 "-" chain 150: thread 100072 (pid 0, crypto_7) sleeping on 0xfffff80003772d00 "-" chain 151: thread 100073 (pid 0, crypto_8) sleeping on 0xfffff80003772d00 "-" chain 152: thread 100074 (pid 0, crypto_9) sleeping on 0xfffff80003772d00 "-" chain 153: thread 100075 (pid 0, crypto_10) sleeping on 0xfffff80003772d00 "-" chain 154: thread 100076 (pid 0, crypto_11) sleeping on 0xfffff80003772d00 "-" chain 155: thread 100113 (pid 0, mca taskq) sleeping on 0xfffff8012c0f1200 "-" chain 156: thread 100120 (pid 0, acpi_task_0) sleeping on 0xfffff8012d1d9600 "-" chain 157: thread 100121 (pid 0, acpi_task_1) sleeping on 0xfffff8012d1d9600 "-" chain 158: thread 100122 (pid 0, acpi_task_2) sleeping on 0xfffff8012d1d9600 "-" chain 159: thread 100123 (pid 0, CAM taskq) sleeping on 0xfffff80003772b00 "-" db:1:pho1> show mount 0xfffff8012d522000 /dev/gpt/work on / (ufs) 0xfffff8012d4bc000 devfs on /dev (devfs) 0xfffff8012d9fa000 /dev/gpt/tmp on /tmp (ufs) 0xfffff8023c1a4000 /dev/md10a on /mnt10 (ufs) 0xfffff8023c19b000 /dev/md11a on /mnt11 (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 68368 Buf domain 0 freebufs 15095 lofreebufs 219 hifreebufs 329 bufspace 860160 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 15 (323584) dirtyq count 0 (0) wakeup 0 lim 25 CPU 3, 1, 2, 1, 1, 10, 1, 1, 0, 1, 1, 1, Locked buffers: 0 space 0 Total buffers: 28173 space 860160 Buf domain 1 freebufs 15098 lofreebufs 219 hifreebufs 329 bufspace 651264 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 18 (319488) dirtyq count 0 (0) wakeup 0 lim 25 CPU 1, 0, 2, 2, 0, 1, 1, 1, 1, 8, 0, 0, Locked buffers: 0 space 0 Total buffers: 17011 space 651264 Buf domain 2 freebufs 15067 lofreebufs 219 hifreebufs 329 bufspace 1830912 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 20 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 23 (618496) dirtyq count 20 (626688) wakeup 0 lim 25 CPU 2, 0, 0, 5, 1, 0, 3, 2, 0, 6, 1, 3, Locked buffers: 0 space 0 Total buffers: 10187 space 1830912 Buf domain 3 freebufs 15091 lofreebufs 219 hifreebufs 329 bufspace 876544 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 23 (487424) dirtyq count 1 (4096) wakeup 0 lim 25 CPU 1, 0, 3, 3, 0, 1, 1, 1, 1, 2, 1, 4, Locked buffers: 0 space 0 Total buffers: 7941 space 876544 Buf domain 4 freebufs 14384 lofreebufs 219 hifreebufs 329 bufspace 23785472 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 668 (21622784) dirtyq count 1 (8192) wakeup 0 lim 25 CPU 2, 5, 7, 3, 4, 2, 21, 16, 1, 15, 0, 4, Locked buffers: 0 space 0 Total buffers: 12144 space 23785472 Buf domain 5 freebufs 13722 lofreebufs 219 hifreebufs 329 bufspace 45645824 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1339 (43532288) dirtyq count 0 (0) wakeup 0 lim 25 CPU 3, 7, 3, 8, 8, 8, 5, 6, 7, 4, 7, 6, Locked buffers: 0 space 0 Total buffers: 16438 space 45645824 Buf domain 6 freebufs 15084 lofreebufs 219 hifreebufs 329 bufspace 929792 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 19 (323584) dirtyq count 0 (0) wakeup 0 lim 25 CPU 1, 1, 7, 3, 0, 1, 4, 3, 0, 9, 0, 1, Locked buffers: 0 space 0 Total buffers: 14037 space 929792 db:1:pho1> show page vm_cnt.v_free_count: 7338657 vm_cnt.v_inactive_count: 101203 vm_cnt.v_active_count: 386808 vm_cnt.v_laundry_count: 43361 vm_cnt.v_wire_count: 254664 vm_cnt.v_free_reserved: 10650 vm_cnt.v_free_min: 51292 vm_cnt.v_free_target: 173218 vm_cnt.v_inactive_target: 259827 db:1:pho1> show pageq pq_free 7338657 dom 0 page_cnt 8128679 free 7338657 pq_act 386808 pq_inact 101203 pq_laund 43361 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000383 | 000000 11 (008192K) | 000213 | 000000 10 (004096K) | 000352 | 000002 09 (002048K) | 000740 | 000011 08 (001024K) | 003952 | 000008 07 (000512K) | 005613 | 000012 06 (000256K) | 008725 | 000018 05 (000128K) | 016361 | 000041 04 (000064K) | 031690 | 000114 03 (000032K) | 056671 | 000297 02 (000016K) | 095889 | 000946 01 (000008K) | 121899 | 003435 00 (000004K) | 136164 | 005158 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000001 | 000000 06 (000256K) | 000002 | 000000 05 (000128K) | 000002 | 000000 04 (000064K) | 000003 | 000000 03 (000032K) | 000001 | 000000 02 (000016K) | 000002 | 000000 01 (000008K) | 000001 | 000000 00 (000004K) | 000002 | 000000 db:0:pho> acttrace Tracing command idle pid 11 tid 100003 td 0xfffff8000365f000 (CPU 0) kdb_alt_break_internal() at kdb_alt_break_internal+0x106/frame 0xfffffe007895a6f0 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe007895a700 uart_intr_rxready() at uart_intr_rxready+0x9a/frame 0xfffffe007895a730 uart_intr() at uart_intr+0x138/frame 0xfffffe007895a770 intr_event_handle() at intr_event_handle+0xfd/frame 0xfffffe007895a7d0 intr_execute_handlers() at intr_execute_handlers+0x58/frame 0xfffffe007895a800 lapic_handle_intr() at lapic_handle_intr+0x6d/frame 0xfffffe007895a840 Xapic_isr1() at Xapic_isr1+0xd9/frame 0xfffffe007895a840 --- interrupt, rip = 0xffffffff8120b1d6, rsp = 0xfffffe007895a910, rbp = 0xfffffe007895a910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007895a910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe007895a960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007895a980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007895a9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007895aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007895aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007895aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff8000365e580 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00003fedf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00003fee10 trap() at trap+0x49/frame 0xfffffe00003fef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00003fef20 --- trap 0x13, rip = 0xffffffff8120b1d6, rsp = 0xfffffe007895f910, rbp = 0xfffffe007895f910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007895f910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe007895f960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007895f980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007895f9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007895fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007895fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007895fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff8000365e000 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071b8df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071b8e10 trap() at trap+0x49/frame 0xfffffe00071b8f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071b8f20 --- trap 0x13, rip = 0xffffffff8120b1d6, rsp = 0xfffffe0078964910, rbp = 0xfffffe0078964910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078964910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe0078964960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078964980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00789649a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078964a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078964ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078964ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff8000365d580 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071c4df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071c4e10 trap() at trap+0x49/frame 0xfffffe00071c4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071c4f20 --- trap 0x13, rip = 0xffffffff8120b1d6, rsp = 0xfffffe0078969910, rbp = 0xfffffe0078969910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078969910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe0078969960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078969980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00789699a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078969a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078969ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078969ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff8000365d000 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071d0df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071d0e10 trap() at trap+0x49/frame 0xfffffe00071d0f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071d0f20 --- trap 0x13, rip = 0xffffffff8120b1d6, rsp = 0xfffffe007896e910, rbp = 0xfffffe007896e910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007896e910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe007896e960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007896e980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007896e9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007896ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe007896eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007896eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff8000365c580 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071dcdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071dce10 trap() at trap+0x49/frame 0xfffffe00071dcf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071dcf20 --- trap 0x13, rip = 0xffffffff8120b1d6, rsp = 0xfffffe0078973910, rbp = 0xfffffe0078973910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078973910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe0078973960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078973980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00789739a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078973a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078973ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078973ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff8000365c000 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071e8df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071e8e10 trap() at trap+0x49/frame 0xfffffe00071e8f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071e8f20 --- trap 0x13, rip = 0xffffffff8120b1d6, rsp = 0xfffffe0078978910, rbp = 0xfffffe0078978910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078978910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe0078978960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078978980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00789789a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078978a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078978ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078978ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff80003670580 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071f4df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071f4e10 trap() at trap+0x49/frame 0xfffffe00071f4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071f4f20 --- trap 0x13, rip = 0xffffffff8120b1d6, rsp = 0xfffffe007897d910, rbp = 0xfffffe007897d910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007897d910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff80003670000 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000cbcdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000cbce10 trap() at trap+0x49/frame 0xfffffe0000cbcf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000cbcf20 --- trap 0x13, rip = 0xffffffff8120b1d6, rsp = 0xfffffe0078982910, rbp = 0xfffffe0078982910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078982910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe0078982960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078982980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00789829a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078982a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078982ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078982ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff8000366f580 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000cc8df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000cc8e10 trap() at trap+0x49/frame 0xfffffe0000cc8f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000cc8f20 --- trap 0x13, rip = 0xffffffff8120b1d6, rsp = 0xfffffe0078987910, rbp = 0xfffffe0078987910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078987910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe0078987960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078987980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00789879a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078987a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078987ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078987ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff8000366f000 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000cd4df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000cd4e10 trap() at trap+0x49/frame 0xfffffe0000cd4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000cd4f20 --- trap 0x13, rip = 0xffffffff8120b1d6, rsp = 0xfffffe007898c910, rbp = 0xfffffe007898c910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007898c910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe007898c960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007898c980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007898c9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007898ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe007898cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007898cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff8000366e580 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000ce0df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000ce0e10 trap() at trap+0x49/frame 0xfffffe0000ce0f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000ce0f20 --- trap 0x13, rip = 0xffffffff8120b1d6, rsp = 0xfffffe0078991910, rbp = 0xfffffe0078991910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078991910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe0078991960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078991980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00789919a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078991a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078991ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078991ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 7160 1967 1877 0 S nanslp 0xffffffff81df65a6 sleep 96848 96847 1616 0 D ufs 0xfffff8023c188a48 ls 96847 1616 1616 0 S wait 0xfffff8027208d000 sh 95392 94535 95392 0 S+ select 0xfffff8012d247bc0 bash 94535 94508 94535 0 S+ pause 0xfffff802722845d0 csh 94508 3443 94508 2006 S+ wait 0xfffff8023cba4000 su 89592 3446 1806 0 D+ softdep 0xfffff8012d6fccd0 umount 3477 0 0 0 DL mdwait 0xfffff8023c1bf000 [md11] 3466 0 0 0 DL mdwait 0xfffff80148f04000 [md10] 3447 1806 1806 0 S+ piperd 0xfffff8012d8bd5f0 tee 3446 3445 1806 0 S+ wait 0xfffff80148e6b528 sh 3445 1806 1806 0 SW+ wait 0xfffff8012d6a6528 sh 3443 3442 3443 2006 Ss+ wait 0xfffff800038b6000 bash 3442 2943 2943 2006 S select 0xfffff80003d0e340 sshd 2943 1734 2943 0 Ss select 0xfffff8012d240ac0 sshd 1970 1877 1877 0 S piperd 0xfffff8012d8bd000 sh 1968 1877 1877 0 S piperd 0xfffff8012dd6a5f0 awk 1967 1877 1877 0 S wait 0xfffff80148d1ea50 sh 1877 1 1877 0 SWs wait 0xfffff8012d6a6a50 sh 1806 1804 1806 0 SW+ wait 0xfffff801482d5000 sh 1804 1802 1804 0 SW+ wait 0xfffff8012d6a7000 bash 1802 1801 1802 0 SW+ pause 0xfffff8012d17b0a8 csh 1801 1800 1801 2006 SW+ wait 0xfffff8012a154a50 su 1800 1799 1800 2006 SWs+ wait 0xfffff800038b6a50 bash 1799 1796 1796 2006 S select 0xfffff8012d247cc0 sshd 1796 1734 1796 0 Ss select 0xfffff8012d2faf40 sshd 1792 1791 1792 0 S+ ttyin 0xfffff8012c0c70b0 csh 1791 1 1791 0 SWs+ wait 0xfffff8012d589000 login 1790 1 1790 0 Ss+ ttyin 0xfffff8012c0c74b0 getty 1789 1 1789 0 Ss+ ttyin 0xfffff8012d323cb0 getty 1788 1 1788 0 Ss+ ttyin 0xfffff8012d3240b0 getty 1787 1 1787 0 Ss+ ttyin 0xfffff8012d3244b0 getty 1786 1 1786 0 Ss+ ttyin 0xfffff8012d3248b0 getty 1785 1 1785 0 Ss+ ttyin 0xfffff8012d324cb0 getty 1784 1 1784 0 Ss+ ttyin 0xfffff8012d3250b0 getty 1783 1 1783 0 Ss+ ttyin 0xfffff8012d3254b0 getty 1782 1 1782 0 Ss+ ttyin 0xfffff8012d3258b0 getty 1738 1 1738 0 Ss nanslp 0xffffffff81df65a3 cron 1734 1 1734 0 Ss select 0xfffff80003676ac0 sshd 1669 1 1669 0 Ss rpcsvc 0xfffff8012d2d8260 NLM: master 1666 1 1666 0 Ss select 0xfffff8012d0e97c0 rpc.statd 1616 1 1616 0 Ss wait 0xfffff8012d588a50 watchdogd 1540 1 1540 0 Ss select 0xfffff80003d48bc0 rpcbind 1530 1 1530 0 Ss select 0xfffff80003676bc0 syslogd 1459 1 1459 0 Ss select 0xfffff8012c009640 devd 1454 1 1454 65 Ss select 0xfffff80003cc3440 dhclient 1410 1 1410 0 Ss select 0xfffff80003cc3540 dhclient 1407 1 1407 0 Ss select 0xfffff8012d0e9c40 dhclient 33 0 0 0 DL vlruwt 0xfffff8012d17ba50 [vnlru] 32 0 0 0 DL syncer 0xffffffff81f98a40 [syncer] 31 0 0 0 DL (threaded) [bufdaemon] 100129 D qsleep 0xffffffff81f97ee0 [bufdaemon] 100134 D - 0xffffffff81a0a600 [bufspacedaemon-0] 100135 D - 0xffffffff81a128c0 [bufspacedaemon-1] 100136 D - 0xffffffff81a1ab80 [bufspacedaemon-2] 100137 D - 0xffffffff81a22e40 [bufspacedaemon-3] 100138 D - 0xffffffff81a2b100 [bufspacedaemon-4] 100139 D - 0xffffffff81a333c0 [bufspacedaemon-5] 100140 D - 0xffffffff81a3b680 [bufspacedaemon-6] 100154 D sdflush 0xfffff8012d6de2e8 [/ worker] 100160 D sdflush 0xfffff8012d67dae8 [/tmp worker] 100261 D sdflush 0xfffff8012d67d6e8 [/mnt10 worker] 100262 D sdflush 0xfffff8012d6fcce8 [/mnt11 worker] 30 0 0 0 DL psleep 0xffffffff81fb4dc0 [vmdaemon] 29 0 0 0 DL (threaded) [pagedaemon] 100127 D psleep 0xffffffff82025518 [dom0] 100130 D launds 0xffffffff82025524 [laundry: dom0] 100133 D umarcl 0xffffffff80f01740 [uma] 28 0 0 0 DL idle 0xfffff8012d08d000 [enc_daemon1] 27 0 0 0 DL idle 0xfffff8012d08d528 [enc_daemon0] 26 0 0 0 DL - 0xffffffff81cc6480 [rand_harvestq] 25 0 0 0 DL waiting 0xffffffff82023d00 [sctp_iterator] 24 0 0 0 DL - 0xffffffff81f978dc [soaiod4] 23 0 0 0 DL - 0xffffffff81f978dc [soaiod3] 22 0 0 0 DL - 0xffffffff81f978dc [soaiod2] 21 0 0 0 DL - 0xffffffff81f978dc [soaiod1] 20 0 0 0 DL (threaded) [usb] 100095 D - 0xfffffe009c7bd460 [usbus0] 100096 D - 0xfffffe009c7bd4b8 [usbus0] 100097 D - 0xfffffe009c7bd510 [usbus0] 100098 D - 0xfffffe009c7bd568 [usbus0] 100099 D - 0xfffffe009c7bd5c0 [usbus0] 100101 D - 0xfffffe009a5c6d10 [usbus1] 100102 D - 0xfffffe009a5c6d68 [usbus1] 100103 D - 0xfffffe009a5c6dc0 [usbus1] 100104 D - 0xfffffe009a5c6e18 [usbus1] 100105 D - 0xfffffe009a5c6e70 [usbus1] 100106 D - 0xfffffe009ca21d10 [usbus2] 100107 D - 0xfffffe009ca21d68 [usbus2] 100108 D - 0xfffffe009ca21dc0 [usbus2] 100109 D - 0xfffffe009ca21e18 [usbus2] 100110 D - 0xfffffe009ca21e70 [usbus2] 19 0 0 0 DL (threaded) [cam] 100090 D - 0xffffffff81ba1740 [doneq0] 100091 D - 0xffffffff81ba17c0 [doneq1] 100092 D - 0xffffffff81ba1840 [doneq2] 100124 D - 0xffffffff81ba1608 [scanner] 18 0 0 0 DL crypto_ 0xfffff800038aa450 [crypto returns 11] 17 0 0 0 DL crypto_ 0xfffff800038aa3f0 [crypto returns 10] 16 0 0 0 DL crypto_ 0xfffff800038aa390 [crypto returns 9] 15 0 0 0 DL crypto_ 0xfffff800038aa330 [crypto returns 8] 14 0 0 0 DL crypto_ 0xfffff800038aa2d0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff800038aa270 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff800038aa210 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff800038aa1b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff800038aa150 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff800038aa0f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff800038aa090 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff800038aa030 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff81faf3d0 [crypto] 13 0 0 0 DL (threaded) [geom] 100062 D - 0xffffffff82000570 [g_event] 100063 D - 0xffffffff82000580 [g_up] 100064 D - 0xffffffff82000568 [g_down] 12 0 0 0 WL (threaded) [intr] 100015 I [swi6: Giant taskq] 100017 I [swi5: fast taskq] 100020 I [swi6: task queue] 100047 I [swi4: clock (0)] 100048 I [swi4: clock (1)] 100049 I [swi4: clock (2)] 100050 I [swi4: clock (3)] 100051 I [swi4: clock (4)] 100052 I [swi4: clock (5)] 100053 I [swi4: clock (6)] 100054 I [swi4: clock (7)] 100055 I [swi4: clock (8)] 100056 I [swi4: clock (9)] 100057 I [swi4: clock (10)] 100058 I [swi4: clock (11)] 100059 I [swi1: netisr 0] 100060 I [swi3: vm] 100093 I [irq264: ahci0] 100094 I [irq19: xhci0] 100100 I [irq18: ehci0 ehci1] 100111 I [irq279: ahci1] 100112 I [swi0: uart uart] 100172 I [irq280: ioat0] 100173 I [irq281: ioat1] 100174 I [irq282: ioat2] 100175 I [irq283: ioat3] 100176 I [irq284: ioat4] 100177 I [irq285: ioat5] 100178 I [irq286: ioat6] 100179 I [irq287: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 100007 Run CPU 4 [idle: cpu4] 100008 Run CPU 5 [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 Run CPU 7 [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 Run CPU 9 [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 1 0 1 0 SLs wait 0xfffff8000365b528 [init] 10 0 0 0 DL audit_w 0xffffffff82024a10 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff820005b0 [swapper] 100016 D - 0xfffff800030d3b00 [thread taskq] 100018 D - 0xfffff800030d3900 [aiod_kick taskq] 100019 D - 0xfffff800030d3800 [kqueue_ctx taskq] 100021 D - 0xfffff800030d3600 [config_0] 100022 D - 0xfffff800030d3500 [if_io_tqg_0] 100023 D - 0xfffff800030d3400 [if_io_tqg_1] 100024 D - 0xfffff800030d3300 [if_io_tqg_2] 100025 D - 0xfffff800030d3200 [if_io_tqg_3] 100026 D - 0xfffff800030d3100 [if_io_tqg_4] 100027 D - 0xfffff800030d3000 [if_io_tqg_5] 100028 D - 0xfffff800030d2e00 [if_io_tqg_6] 100029 D - 0xfffff800030d2d00 [if_io_tqg_7] 100030 D - 0xfffff800030d2c00 [if_io_tqg_8] 100031 D - 0xfffff800030d2b00 [if_io_tqg_9] 100032 D - 0xfffff800030d2a00 [if_io_tqg_10] 100033 D - 0xfffff800030d2900 [if_io_tqg_11] 100034 D - 0xfffff800030d2800 [softirq_0] 100035 D - 0xfffff800030d2700 [softirq_1] 100036 D - 0xfffff800030d2600 [softirq_2] 100037 D - 0xfffff800030d2500 [softirq_3] 100038 D - 0xfffff800030d2400 [softirq_4] 100039 D - 0xfffff800030d2300 [softirq_5] 100040 D - 0xfffff800030d2200 [softirq_6] 100041 D - 0xfffff800030d2100 [softirq_7] 100042 D - 0xfffff800030d2000 [softirq_8] 100043 D - 0xfffff800030d1e00 [softirq_9] 100044 D - 0xfffff800030d1d00 [softirq_10] 100045 D - 0xfffff800030d1c00 [softirq_11] 100046 D - 0xfffff80003773100 [if_config_tqg_0] 100061 D - 0xfffff80003773000 [firmware taskq] 100065 D - 0xfffff80003772d00 [crypto_0] 100066 D - 0xfffff80003772d00 [crypto_1] 100067 D - 0xfffff80003772d00 [crypto_2] 100068 D - 0xfffff80003772d00 [crypto_3] 100069 D - 0xfffff80003772d00 [crypto_4] 100070 D - 0xfffff80003772d00 [crypto_5] 100071 D - 0xfffff80003772d00 [crypto_6] 100072 D - 0xfffff80003772d00 [crypto_7] 100073 D - 0xfffff80003772d00 [crypto_8] 100074 D - 0xfffff80003772d00 [crypto_9] 100075 D - 0xfffff80003772d00 [crypto_10] 100076 D - 0xfffff80003772d00 [crypto_11] 100113 D - 0xfffff8012c0f1200 [mca taskq] 100120 D - 0xfffff8012d1d9600 [acpi_task_0] 100121 D - 0xfffff8012d1d9600 [acpi_task_1] 100122 D - 0xfffff8012d1d9600 [acpi_task_2] 100123 D - 0xfffff80003772b00 [CAM taskq] db:0:pho> allt Tracing command sleep pid 7160 tid 100393 td 0xfffff8023cd7e000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a9a04700 mi_switch() at mi_switch+0x178/frame 0xfffffe00a9a04730 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a9a04770 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a9a047d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a9a04810 _sleep() at _sleep+0x33b/frame 0xfffffe00a9a048b0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1b7/frame 0xfffffe00a9a04940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00a9a04980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a9a04ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a9a04ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003a22ea, rsp = 0x7fffffffe6d8, rbp = 0x7fffffffe720 --- Tracing command ls pid 96848 tid 100450 td 0xfffff802723cb580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a9b21070 mi_switch() at mi_switch+0x178/frame 0xfffffe00a9b210a0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a9b210e0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a9b21110 sleeplk() at sleeplk+0x149/frame 0xfffffe00a9b21170 lockmgr_slock_hard() at lockmgr_slock_hard+0x2db/frame 0xfffffe00a9b21200 __lockmgr_args() at __lockmgr_args+0x571/frame 0xfffffe00a9b212a0 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00a9b212f0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00a9b21320 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00a9b21390 vget() at vget+0x98/frame 0xfffffe00a9b213d0 cache_lookup() at cache_lookup+0x772/frame 0xfffffe00a9b214a0 vfs_cache_lookup() at vfs_cache_lookup+0xac/frame 0xfffffe00a9b21500 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00a9b21530 lookup() at lookup+0x692/frame 0xfffffe00a9b215d0 namei() at namei+0x4fd/frame 0xfffffe00a9b21690 kern_statat() at kern_statat+0x77/frame 0xfffffe00a9b21880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00a9b21980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a9b21ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a9b21ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048f0aa, rsp = 0x7fffffffe338, rbp = 0x7fffffffe3f0 --- Tracing command sh pid 96847 tid 100438 td 0xfffff80272537000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a9ae5560 mi_switch() at mi_switch+0x178/frame 0xfffffe00a9ae5590 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a9ae55d0 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a9ae5630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a9ae5660 _sleep() at _sleep+0x39c/frame 0xfffffe00a9ae5700 kern_wait6() at kern_wait6+0x4c4/frame 0xfffffe00a9ae5790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00a9ae5980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a9ae5ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a9ae5ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040316a, rsp = 0x7fffffffe878, rbp = 0x7fffffffe930 --- Tracing command bash pid 95392 tid 100222 td 0xfffff801482d7000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a7eab580 mi_switch() at mi_switch+0x178/frame 0xfffffe00a7eab5b0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a7eab5f0 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a7eab650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a7eab680 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a7eab6e0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a7eab720 kern_select() at kern_select+0x8c0/frame 0xfffffe00a7eab900 sys_pselect() at sys_pselect+0x127/frame 0xfffffe00a7eab980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a7eabab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7eabab0 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x800aff28a, rsp = 0x7fffffffd638, rbp = 0x7fffffffd700 --- Tracing command csh pid 94535 tid 100489 td 0xfffff80272290580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a9be4750 mi_switch() at mi_switch+0x178/frame 0xfffffe00a9be4780 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a9be47c0 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a9be4820 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a9be4850 _sleep() at _sleep+0x39c/frame 0xfffffe00a9be48f0 kern_sigsuspend() at kern_sigsuspend+0xb4/frame 0xfffffe00a9be4950 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe00a9be4980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a9be4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a9be4ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x8004871ea, rsp = 0x7fffffffe028, rbp = 0x7fffffffe0b0 --- Tracing command su pid 94508 tid 100425 td 0xfffff8023ccb5000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a9aa4560 mi_switch() at mi_switch+0x178/frame 0xfffffe00a9aa4590 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a9aa45d0 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a9aa4630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a9aa4660 _sleep() at _sleep+0x39c/frame 0xfffffe00a9aa4700 kern_wait6() at kern_wait6+0x4c4/frame 0xfffffe00a9aa4790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00a9aa4980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a9aa4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a9aa4ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003e716a, rsp = 0x7fffffffe628, rbp = 0x7fffffffeb70 --- Tracing command umount pid 89592 tid 100442 td 0xfffff8023c4c5000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a9af9500 mi_switch() at mi_switch+0x178/frame 0xfffffe00a9af9530 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a9af9570 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00a9af95b0 _sleep() at _sleep+0x34d/frame 0xfffffe00a9af9650 softdep_waitidle() at softdep_waitidle+0x179/frame 0xfffffe00a9af96d0 softdep_flushfiles() at softdep_flushfiles+0x16e/frame 0xfffffe00a9af9750 ffs_unmount() at ffs_unmount+0x14b/frame 0xfffffe00a9af97f0 dounmount() at dounmount+0x519/frame 0xfffffe00a9af9860 sys_unmount() at sys_unmount+0x310/frame 0xfffffe00a9af9980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a9af9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a9af9ab0 --- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8002d695a, rsp = 0x7fffffffd298, rbp = 0x7fffffffd7d0 --- Tracing command md11 pid 3477 tid 100199 td 0xfffff801482d7580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a7e388d0 mi_switch() at mi_switch+0x178/frame 0xfffffe00a7e38900 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a7e38940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a7e38970 _sleep() at _sleep+0x3a9/frame 0xfffffe00a7e38a10 md_kthread() at md_kthread+0x1e5/frame 0xfffffe00a7e38a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a7e38ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a7e38ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md10 pid 3466 tid 100255 td 0xfffff80148f55000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a7f508d0 mi_switch() at mi_switch+0x178/frame 0xfffffe00a7f50900 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a7f50940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00a7f50970 _sleep() at _sleep+0x3a9/frame 0xfffffe00a7f50a10 md_kthread() at md_kthread+0x1e5/frame 0xfffffe00a7f50a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a7f50ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a7f50ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command tee pid 3447 tid 100258 td 0xfffff8012d4d1580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a7f5f6b0 mi_switch() at mi_switch+0x178/frame 0xfffffe00a7f5f6e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a7f5f720 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a7f5f780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a7f5f7b0 _sleep() at _sleep+0x39c/frame 0xfffffe00a7f5f850 pipe_read() at pipe_read+0x345/frame 0xfffffe00a7f5f8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a7f5f8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a7f5f930 sys_read() at sys_read+0x86/frame 0xfffffe00a7f5f980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a7f5fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7f5fab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800413b0a, rsp = 0x7fffffffe6e8, rbp = 0x7fffffffe730 --- Tracing command sh pid 3446 tid 100238 td 0xfffff8012db7f000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a7efb560 mi_switch() at mi_switch+0x178/frame 0xfffffe00a7efb590 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a7efb5d0 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a7efb630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a7efb660 _sleep() at _sleep+0x39c/frame 0xfffffe00a7efb700 kern_wait6() at kern_wait6+0x4c4/frame 0xfffffe00a7efb790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00a7efb980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a7efbab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7efbab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040316a, rsp = 0x7fffffffe278, rbp = 0x7fffffffe330 --- Tracing command sh pid 3445 tid 100223 td 0xfffff8012d6b4580 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0078959f00 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe0078959f10 trap() at trap+0x5c/frame 0xfffffe007895a020 calltrap() at calltrap+0x8/frame 0xfffffe007895a020 --- trap 0xc, rip = 0xffffffff8107bb26, rsp = 0xfffffe007895a0f0, rbp = 0xfffffe007895a100 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007895a100 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007895a1a0 db_command() at db_command+0x279/frame 0xfffffe007895a270 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007895a310 db_command() at db_command+0x279/frame 0xfffffe007895a3e0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007895a3f0 db_trap() at db_trap+0xef/frame 0xfffffe007895a480 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007895a4f0 trap() at trap+0x815/frame 0xfffffe007895a600 calltrap() at calltrap+0x8/frame 0xfffffe007895a600 --- trap 0x3, rip = 0xffffffff80be3f06, rsp = 0xfffffe007895a6d0, rbp = 0xfffffe007895a6f0 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x106/frame 0xfffffe007895a6f0 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe007895a700 uart_intr_rxready() at uart_intr_rxready+0x9a/frame 0xfffffe007895a730 uart_intr() at uart_intr+0x138/frame 0xfffffe007895a770 intr_event_handle() at intr_event_handle+0xfd/frame 0xfffffe007895a7d0 intr_execute_handlers() at intr_execute_handlers+0x58/frame 0xfffffe007895a800 lapic_handle_intr() at lapic_handle_intr+0x6d/frame 0xfffffe007895a840 Xapic_isr1() at Xapic_isr1+0xd9/frame 0xfffffe007895a840 --- interrupt, rip = 0xffffffff8120b1d6, rsp = 0xfffffe007895a910, rbp = 0xfffffe007895a910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007895a910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe007895a960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007895a980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007895a9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007895aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007895aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007895aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bash pid 3443 tid 100187 td 0xfffff80003a3e000 sched_switch() at sched_switch+0x942/frame 0xfffffe009d1ef560 mi_switch() at mi_switch+0x178/frame 0xfffffe009d1ef590 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d1ef5d0 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009d1ef630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009d1ef660 _sleep() at _sleep+0x39c/frame 0xfffffe009d1ef700 kern_wait6() at kern_wait6+0x4c4/frame 0xfffffe009d1ef790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe009d1ef980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe009d1efab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009d1efab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800aff16a, rsp = 0x7fffffffe7b8, rbp = 0x7fffffffe800 --- Tracing command sshd pid 3442 tid 100227 td 0xfffff8012d4d4580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a7ec45c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00a7ec45f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a7ec4630 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a7ec4690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a7ec46c0 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a7ec4720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a7ec4760 kern_select() at kern_select+0x8c0/frame 0xfffffe00a7ec4940 sys_select() at sys_select+0x56/frame 0xfffffe00a7ec4980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a7ec4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7ec4ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800876aea, rsp = 0x7fffffffa5a8, rbp = 0x7fffffffa5e0 --- Tracing command sshd pid 2943 tid 100243 td 0xfffff8012d68e580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a7f14640 mi_switch() at mi_switch+0x178/frame 0xfffffe00a7f14670 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a7f146b0 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a7f14710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a7f14740 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a7f147a0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a7f147e0 kern_poll() at kern_poll+0x43a/frame 0xfffffe00a7f14960 sys_poll() at sys_poll+0x50/frame 0xfffffe00a7f14980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a7f14ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7f14ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x800817c8a, rsp = 0x7fffffffe5c8, rbp = 0x7fffffffe600 --- Tracing command sh pid 1970 tid 100230 td 0xfffff8012d8c8580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a7ed36b0 mi_switch() at mi_switch+0x178/frame 0xfffffe00a7ed36e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a7ed3720 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a7ed3780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a7ed37b0 _sleep() at _sleep+0x39c/frame 0xfffffe00a7ed3850 pipe_read() at pipe_read+0x345/frame 0xfffffe00a7ed38b0 dofileread() at dofileread+0x95/frame 0xfffffe00a7ed38f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a7ed3930 sys_read() at sys_read+0x86/frame 0xfffffe00a7ed3980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a7ed3ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7ed3ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800474b0a, rsp = 0x7fffffffe258, rbp = 0x7fffffffe360 --- Tracing command awk pid 1968 tid 100229 td 0xfffff8012d8c9000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a7ece6b0 mi_switch() at mi_switch+0x178/frame 0xfffffe00a7ece6e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a7ece720 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a7ece780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a7ece7b0 _sleep() at _sleep+0x39c/frame 0xfffffe00a7ece850 pipe_read() at pipe_read+0x345/frame 0xfffffe00a7ece8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a7ece8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a7ece930 sys_read() at sys_read+0x86/frame 0xfffffe00a7ece980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a7eceab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7eceab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800476b0a, rsp = 0x7fffffffe358, rbp = 0x7fffffffe370 --- Tracing command sh pid 1967 tid 100213 td 0xfffff8012d4ca580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a7e7e560 mi_switch() at mi_switch+0x178/frame 0xfffffe00a7e7e590 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a7e7e5d0 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a7e7e630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a7e7e660 _sleep() at _sleep+0x39c/frame 0xfffffe00a7e7e700 kern_wait6() at kern_wait6+0x4c4/frame 0xfffffe00a7e7e790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00a7e7e980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a7e7eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7e7eab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040316a, rsp = 0x7fffffffe268, rbp = 0x7fffffffe320 --- Tracing command sh pid 1877 tid 100183 td 0xfffff8012d6b5000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0078959f00 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe0078959f10 trap() at trap+0x5c/frame 0xfffffe007895a020 calltrap() at calltrap+0x8/frame 0xfffffe007895a020 --- trap 0xc, rip = 0xffffffff8107bb26, rsp = 0xfffffe007895a0f0, rbp = 0xfffffe007895a100 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007895a100 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007895a1a0 db_command() at db_command+0x279/frame 0xfffffe007895a270 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007895a310 db_command() at db_command+0x279/frame 0xfffffe007895a3e0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007895a3f0 db_trap() at db_trap+0xef/frame 0xfffffe007895a480 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007895a4f0 trap() at trap+0x815/frame 0xfffffe007895a600 calltrap() at calltrap+0x8/frame 0xfffffe007895a600 --- trap 0x3, rip = 0xffffffff80be3f06, rsp = 0xfffffe007895a6d0, rbp = 0xfffffe007895a6f0 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x106/frame 0xfffffe007895a6f0 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe007895a700 uart_intr_rxready() at uart_intr_rxready+0x9a/frame 0xfffffe007895a730 uart_intr() at uart_intr+0x138/frame 0xfffffe007895a770 intr_event_handle() at intr_event_handle+0xfd/frame 0xfffffe007895a7d0 intr_execute_handlers() at intr_execute_handlers+0x58/frame 0xfffffe007895a800 lapic_handle_intr() at lapic_handle_intr+0x6d/frame 0xfffffe007895a840 Xapic_isr1() at Xapic_isr1+0xd9/frame 0xfffffe007895a840 --- interrupt, rip = 0xffffffff8120b1d6, rsp = 0xfffffe007895a910, rbp = 0xfffffe007895a910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007895a910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe007895a960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007895a980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007895a9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007895aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007895aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007895aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 1806 tid 100192 td 0xfffff801482d8580 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0078959f00 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe0078959f10 trap() at trap+0x5c/frame 0xfffffe007895a020 calltrap() at calltrap+0x8/frame 0xfffffe007895a020 --- trap 0xc, rip = 0xffffffff8107bb26, rsp = 0xfffffe007895a0f0, rbp = 0xfffffe007895a100 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007895a100 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007895a1a0 db_command() at db_command+0x279/frame 0xfffffe007895a270 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007895a310 db_command() at db_command+0x279/frame 0xfffffe007895a3e0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007895a3f0 db_trap() at db_trap+0xef/frame 0xfffffe007895a480 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007895a4f0 trap() at trap+0x815/frame 0xfffffe007895a600 calltrap() at calltrap+0x8/frame 0xfffffe007895a600 --- trap 0x3, rip = 0xffffffff80be3f06, rsp = 0xfffffe007895a6d0, rbp = 0xfffffe007895a6f0 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x106/frame 0xfffffe007895a6f0 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe007895a700 uart_intr_rxready() at uart_intr_rxready+0x9a/frame 0xfffffe007895a730 uart_intr() at uart_intr+0x138/frame 0xfffffe007895a770 intr_event_handle() at intr_event_handle+0xfd/frame 0xfffffe007895a7d0 intr_execute_handlers() at intr_execute_handlers+0x58/frame 0xfffffe007895a800 lapic_handle_intr() at lapic_handle_intr+0x6d/frame 0xfffffe007895a840 Xapic_isr1() at Xapic_isr1+0xd9/frame 0xfffffe007895a840 --- interrupt, rip = 0xffffffff8120b1d6, rsp = 0xfffffe007895a910, rbp = 0xfffffe007895a910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007895a910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe007895a960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007895a980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007895a9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007895aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007895aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007895aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bash pid 1804 tid 100180 td 0xfffff8012d6b5580 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0078959f00 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe0078959f10 trap() at trap+0x5c/frame 0xfffffe007895a020 calltrap() at calltrap+0x8/frame 0xfffffe007895a020 --- trap 0xc, rip = 0xffffffff8107bb26, rsp = 0xfffffe007895a0f0, rbp = 0xfffffe007895a100 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007895a100 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007895a1a0 db_command() at db_command+0x279/frame 0xfffffe007895a270 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007895a310 db_command() at db_command+0x279/frame 0xfffffe007895a3e0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007895a3f0 db_trap() at db_trap+0xef/frame 0xfffffe007895a480 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007895a4f0 trap() at trap+0x815/frame 0xfffffe007895a600 calltrap() at calltrap+0x8/frame 0xfffffe007895a600 --- trap 0x3, rip = 0xffffffff80be3f06, rsp = 0xfffffe007895a6d0, rbp = 0xfffffe007895a6f0 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x106/frame 0xfffffe007895a6f0 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe007895a700 uart_intr_rxready() at uart_intr_rxready+0x9a/frame 0xfffffe007895a730 uart_intr() at uart_intr+0x138/frame 0xfffffe007895a770 intr_event_handle() at intr_event_handle+0xfd/frame 0xfffffe007895a7d0 intr_execute_handlers() at intr_execute_handlers+0x58/frame 0xfffffe007895a800 lapic_handle_intr() at lapic_handle_intr+0x6d/frame 0xfffffe007895a840 Xapic_isr1() at Xapic_isr1+0xd9/frame 0xfffffe007895a840 --- interrupt, rip = 0xffffffff8120b1d6, rsp = 0xfffffe007895a910, rbp = 0xfffffe007895a910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007895a910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe007895a960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007895a980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007895a9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007895aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007895aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007895aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command csh pid 1802 tid 100198 td 0xfffff8012d4ce000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0078959f00 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe0078959f10 trap() at trap+0x5c/frame 0xfffffe007895a020 calltrap() at calltrap+0x8/frame 0xfffffe007895a020 --- trap 0xc, rip = 0xffffffff8107bb26, rsp = 0xfffffe007895a0f0, rbp = 0xfffffe007895a100 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007895a100 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007895a1a0 db_command() at db_command+0x279/frame 0xfffffe007895a270 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007895a310 db_command() at db_command+0x279/frame 0xfffffe007895a3e0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007895a3f0 db_trap() at db_trap+0xef/frame 0xfffffe007895a480 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007895a4f0 trap() at trap+0x815/frame 0xfffffe007895a600 calltrap() at calltrap+0x8/frame 0xfffffe007895a600 --- trap 0x3, rip = 0xffffffff80be3f06, rsp = 0xfffffe007895a6d0, rbp = 0xfffffe007895a6f0 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x106/frame 0xfffffe007895a6f0 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe007895a700 uart_intr_rxready() at uart_intr_rxready+0x9a/frame 0xfffffe007895a730 uart_intr() at uart_intr+0x138/frame 0xfffffe007895a770 intr_event_handle() at intr_event_handle+0xfd/frame 0xfffffe007895a7d0 intr_execute_handlers() at intr_execute_handlers+0x58/frame 0xfffffe007895a800 lapic_handle_intr() at lapic_handle_intr+0x6d/frame 0xfffffe007895a840 Xapic_isr1() at Xapic_isr1+0xd9/frame 0xfffffe007895a840 --- interrupt, rip = 0xffffffff8120b1d6, rsp = 0xfffffe007895a910, rbp = 0xfffffe007895a910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007895a910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe007895a960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007895a980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007895a9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007895aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007895aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007895aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command su pid 1801 tid 100195 td 0xfffff8012a178580 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0078959f00 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe0078959f10 trap() at trap+0x5c/frame 0xfffffe007895a020 calltrap() at calltrap+0x8/frame 0xfffffe007895a020 --- trap 0xc, rip = 0xffffffff8107bb26, rsp = 0xfffffe007895a0f0, rbp = 0xfffffe007895a100 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007895a100 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007895a1a0 db_command() at db_command+0x279/frame 0xfffffe007895a270 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007895a310 db_command() at db_command+0x279/frame 0xfffffe007895a3e0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007895a3f0 db_trap() at db_trap+0xef/frame 0xfffffe007895a480 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007895a4f0 trap() at trap+0x815/frame 0xfffffe007895a600 calltrap() at calltrap+0x8/frame 0xfffffe007895a600 --- trap 0x3, rip = 0xffffffff80be3f06, rsp = 0xfffffe007895a6d0, rbp = 0xfffffe007895a6f0 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x106/frame 0xfffffe007895a6f0 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe007895a700 uart_intr_rxready() at uart_intr_rxready+0x9a/frame 0xfffffe007895a730 uart_intr() at uart_intr+0x138/frame 0xfffffe007895a770 intr_event_handle() at intr_event_handle+0xfd/frame 0xfffffe007895a7d0 intr_execute_handlers() at intr_execute_handlers+0x58/frame 0xfffffe007895a800 lapic_handle_intr() at lapic_handle_intr+0x6d/frame 0xfffffe007895a840 Xapic_isr1() at Xapic_isr1+0xd9/frame 0xfffffe007895a840 --- interrupt, rip = 0xffffffff8120b1d6, rsp = 0xfffffe007895a910, rbp = 0xfffffe007895a910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007895a910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe007895a960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007895a980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007895a9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007895aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007895aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007895aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bash pid 1800 tid 100151 td 0xfffff80003a3f000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0078959f00 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe0078959f10 trap() at trap+0x5c/frame 0xfffffe007895a020 calltrap() at calltrap+0x8/frame 0xfffffe007895a020 --- trap 0xc, rip = 0xffffffff8107bb26, rsp = 0xfffffe007895a0f0, rbp = 0xfffffe007895a100 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007895a100 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007895a1a0 db_command() at db_command+0x279/frame 0xfffffe007895a270 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007895a310 db_command() at db_command+0x279/frame 0xfffffe007895a3e0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007895a3f0 db_trap() at db_trap+0xef/frame 0xfffffe007895a480 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007895a4f0 trap() at trap+0x815/frame 0xfffffe007895a600 calltrap() at calltrap+0x8/frame 0xfffffe007895a600 --- trap 0x3, rip = 0xffffffff80be3f06, rsp = 0xfffffe007895a6d0, rbp = 0xfffffe007895a6f0 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x106/frame 0xfffffe007895a6f0 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe007895a700 uart_intr_rxready() at uart_intr_rxready+0x9a/frame 0xfffffe007895a730 uart_intr() at uart_intr+0x138/frame 0xfffffe007895a770 intr_event_handle() at intr_event_handle+0xfd/frame 0xfffffe007895a7d0 intr_execute_handlers() at intr_execute_handlers+0x58/frame 0xfffffe007895a800 lapic_handle_intr() at lapic_handle_intr+0x6d/frame 0xfffffe007895a840 Xapic_isr1() at Xapic_isr1+0xd9/frame 0xfffffe007895a840 --- interrupt, rip = 0xffffffff8120b1d6, rsp = 0xfffffe007895a910, rbp = 0xfffffe007895a910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007895a910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe007895a960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007895a980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007895a9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007895aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007895aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007895aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sshd pid 1799 tid 100185 td 0xfffff801482d9580 sched_switch() at sched_switch+0x942/frame 0xfffffe009d1e55c0 mi_switch() at mi_switch+0x178/frame 0xfffffe009d1e55f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d1e5630 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009d1e5690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009d1e56c0 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe009d1e5720 seltdwait() at seltdwait+0x8d/frame 0xfffffe009d1e5760 kern_select() at kern_select+0x8c0/frame 0xfffffe009d1e5940 sys_select() at sys_select+0x56/frame 0xfffffe009d1e5980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe009d1e5ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009d1e5ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800876aea, rsp = 0x7fffffffa5a8, rbp = 0x7fffffffa5e0 --- Tracing command sshd pid 1796 tid 100194 td 0xfffff8012d68f580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a7e1f640 mi_switch() at mi_switch+0x178/frame 0xfffffe00a7e1f670 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a7e1f6b0 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a7e1f710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a7e1f740 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a7e1f7a0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a7e1f7e0 kern_poll() at kern_poll+0x43a/frame 0xfffffe00a7e1f960 sys_poll() at sys_poll+0x50/frame 0xfffffe00a7e1f980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a7e1fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7e1fab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x800817c8a, rsp = 0x7fffffffe5c8, rbp = 0x7fffffffe600 --- Tracing command csh pid 1792 tid 100141 td 0xfffff8012d4dd580 sched_switch() at sched_switch+0x942/frame 0xfffffe009d0ea620 mi_switch() at mi_switch+0x178/frame 0xfffffe009d0ea650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d0ea690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009d0ea6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009d0ea720 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe009d0ea780 tty_wait() at tty_wait+0x42/frame 0xfffffe009d0ea7b0 ttydisc_read() at ttydisc_read+0x22c/frame 0xfffffe009d0ea820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe009d0ea850 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe009d0ea8b0 dofileread() at dofileread+0x95/frame 0xfffffe009d0ea8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe009d0ea930 sys_read() at sys_read+0x86/frame 0xfffffe009d0ea980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe009d0eaab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009d0eaab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004f8b0a, rsp = 0x7fffffffe208, rbp = 0x7fffffffe230 --- Tracing command login pid 1791 tid 100165 td 0xfffff8012db83000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0078959f00 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe0078959f10 trap() at trap+0x5c/frame 0xfffffe007895a020 calltrap() at calltrap+0x8/frame 0xfffffe007895a020 --- trap 0xc, rip = 0xffffffff8107bb26, rsp = 0xfffffe007895a0f0, rbp = 0xfffffe007895a100 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007895a100 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007895a1a0 db_command() at db_command+0x279/frame 0xfffffe007895a270 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007895a310 db_command() at db_command+0x279/frame 0xfffffe007895a3e0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007895a3f0 db_trap() at db_trap+0xef/frame 0xfffffe007895a480 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007895a4f0 trap() at trap+0x815/frame 0xfffffe007895a600 calltrap() at calltrap+0x8/frame 0xfffffe007895a600 --- trap 0x3, rip = 0xffffffff80be3f06, rsp = 0xfffffe007895a6d0, rbp = 0xfffffe007895a6f0 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x106/frame 0xfffffe007895a6f0 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe007895a700 uart_intr_rxready() at uart_intr_rxready+0x9a/frame 0xfffffe007895a730 uart_intr() at uart_intr+0x138/frame 0xfffffe007895a770 intr_event_handle() at intr_event_handle+0xfd/frame 0xfffffe007895a7d0 intr_execute_handlers() at intr_execute_handlers+0x58/frame 0xfffffe007895a800 lapic_handle_intr() at lapic_handle_intr+0x6d/frame 0xfffffe007895a840 Xapic_isr1() at Xapic_isr1+0xd9/frame 0xfffffe007895a840 --- interrupt, rip = 0xffffffff8120b1d6, rsp = 0xfffffe007895a910, rbp = 0xfffffe007895a910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007895a910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe007895a960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007895a980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007895a9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007895aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007895aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007895aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command getty pid 1790 tid 100142 td 0xfffff8012d615580 sched_switch() at sched_switch+0x942/frame 0xfffffe009d0ef620 mi_switch() at mi_switch+0x178/frame 0xfffffe009d0ef650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d0ef690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009d0ef6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009d0ef720 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe009d0ef780 tty_wait() at tty_wait+0x42/frame 0xfffffe009d0ef7b0 ttydisc_read() at ttydisc_read+0x22c/frame 0xfffffe009d0ef820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe009d0ef850 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe009d0ef8b0 dofileread() at dofileread+0x95/frame 0xfffffe009d0ef8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe009d0ef930 sys_read() at sys_read+0x86/frame 0xfffffe009d0ef980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe009d0efab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009d0efab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042fb0a, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 1789 tid 100208 td 0xfffff8012db80000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a7e65620 mi_switch() at mi_switch+0x178/frame 0xfffffe00a7e65650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a7e65690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a7e656f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a7e65720 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a7e65780 tty_wait() at tty_wait+0x42/frame 0xfffffe00a7e657b0 ttydisc_read() at ttydisc_read+0x22c/frame 0xfffffe00a7e65820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a7e65850 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe00a7e658b0 dofileread() at dofileread+0x95/frame 0xfffffe00a7e658f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a7e65930 sys_read() at sys_read+0x86/frame 0xfffffe00a7e65980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a7e65ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7e65ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042fb0a, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 1788 tid 100207 td 0xfffff8012db80580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a7e60620 mi_switch() at mi_switch+0x178/frame 0xfffffe00a7e60650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a7e60690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a7e606f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a7e60720 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a7e60780 tty_wait() at tty_wait+0x42/frame 0xfffffe00a7e607b0 ttydisc_read() at ttydisc_read+0x22c/frame 0xfffffe00a7e60820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a7e60850 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe00a7e608b0 dofileread() at dofileread+0x95/frame 0xfffffe00a7e608f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a7e60930 sys_read() at sys_read+0x86/frame 0xfffffe00a7e60980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a7e60ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7e60ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042fb0a, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 1787 tid 100206 td 0xfffff8012db81000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a7e5b620 mi_switch() at mi_switch+0x178/frame 0xfffffe00a7e5b650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a7e5b690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a7e5b6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a7e5b720 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a7e5b780 tty_wait() at tty_wait+0x42/frame 0xfffffe00a7e5b7b0 ttydisc_read() at ttydisc_read+0x22c/frame 0xfffffe00a7e5b820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a7e5b850 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe00a7e5b8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a7e5b8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a7e5b930 sys_read() at sys_read+0x86/frame 0xfffffe00a7e5b980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a7e5bab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7e5bab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042fb0a, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 1786 tid 100205 td 0xfffff8012db81580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a7e56620 mi_switch() at mi_switch+0x178/frame 0xfffffe00a7e56650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a7e56690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a7e566f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a7e56720 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a7e56780 tty_wait() at tty_wait+0x42/frame 0xfffffe00a7e567b0 ttydisc_read() at ttydisc_read+0x22c/frame 0xfffffe00a7e56820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a7e56850 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe00a7e568b0 dofileread() at dofileread+0x95/frame 0xfffffe00a7e568f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a7e56930 sys_read() at sys_read+0x86/frame 0xfffffe00a7e56980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a7e56ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7e56ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042fb0a, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 1785 tid 100204 td 0xfffff8012db82000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a7e51620 mi_switch() at mi_switch+0x178/frame 0xfffffe00a7e51650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a7e51690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a7e516f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a7e51720 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a7e51780 tty_wait() at tty_wait+0x42/frame 0xfffffe00a7e517b0 ttydisc_read() at ttydisc_read+0x22c/frame 0xfffffe00a7e51820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a7e51850 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe00a7e518b0 dofileread() at dofileread+0x95/frame 0xfffffe00a7e518f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a7e51930 sys_read() at sys_read+0x86/frame 0xfffffe00a7e51980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a7e51ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7e51ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042fb0a, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 1784 tid 100153 td 0xfffff8012d4dd000 sched_switch() at sched_switch+0x942/frame 0xfffffe009d126620 mi_switch() at mi_switch+0x178/frame 0xfffffe009d126650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d126690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009d1266f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009d126720 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe009d126780 tty_wait() at tty_wait+0x42/frame 0xfffffe009d1267b0 ttydisc_read() at ttydisc_read+0x22c/frame 0xfffffe009d126820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe009d126850 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe009d1268b0 dofileread() at dofileread+0x95/frame 0xfffffe009d1268f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe009d126930 sys_read() at sys_read+0x86/frame 0xfffffe009d126980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe009d126ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009d126ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042fb0a, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 1783 tid 100145 td 0xfffff8012a17a000 sched_switch() at sched_switch+0x942/frame 0xfffffe009d0fe620 mi_switch() at mi_switch+0x178/frame 0xfffffe009d0fe650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d0fe690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009d0fe6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009d0fe720 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe009d0fe780 tty_wait() at tty_wait+0x42/frame 0xfffffe009d0fe7b0 ttydisc_read() at ttydisc_read+0x22c/frame 0xfffffe009d0fe820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe009d0fe850 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe009d0fe8b0 dofileread() at dofileread+0x95/frame 0xfffffe009d0fe8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe009d0fe930 sys_read() at sys_read+0x86/frame 0xfffffe009d0fe980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe009d0feab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009d0feab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042fb0a, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 1782 tid 100163 td 0xfffff8012d6b6000 sched_switch() at sched_switch+0x942/frame 0xfffffe009d153620 mi_switch() at mi_switch+0x178/frame 0xfffffe009d153650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d153690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009d1536f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009d153720 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe009d153780 tty_wait() at tty_wait+0x42/frame 0xfffffe009d1537b0 ttydisc_read() at ttydisc_read+0x22c/frame 0xfffffe009d153820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe009d153850 devfs_read_f() at devfs_read_f+0xe0/frame 0xfffffe009d1538b0 dofileread() at dofileread+0x95/frame 0xfffffe009d1538f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe009d153930 sys_read() at sys_read+0x86/frame 0xfffffe009d153980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe009d153ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009d153ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042fb0a, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command cron pid 1738 tid 100157 td 0xfffff80003a3e580 sched_switch() at sched_switch+0x942/frame 0xfffffe009d13a700 mi_switch() at mi_switch+0x178/frame 0xfffffe009d13a730 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d13a770 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009d13a7d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe009d13a810 _sleep() at _sleep+0x33b/frame 0xfffffe009d13a8b0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1b7/frame 0xfffffe009d13a940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe009d13a980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe009d13aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009d13aab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003d12ea, rsp = 0x7fffffffeaf8, rbp = 0x7fffffffece0 --- Tracing command sshd pid 1734 tid 100167 td 0xfffff8012d8c9580 sched_switch() at sched_switch+0x942/frame 0xfffffe009d17f5c0 mi_switch() at mi_switch+0x178/frame 0xfffffe009d17f5f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d17f630 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009d17f690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009d17f6c0 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe009d17f720 seltdwait() at seltdwait+0x8d/frame 0xfffffe009d17f760 kern_select() at kern_select+0x8c0/frame 0xfffffe009d17f940 sys_select() at sys_select+0x56/frame 0xfffffe009d17f980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe009d17fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009d17fab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800876aea, rsp = 0x7fffffffe698, rbp = 0x7fffffffe6d0 --- Tracing command rpc.lockd pid 1669 tid 100166 td 0xfffff8012d8ca000 sched_switch() at sched_switch+0x942/frame 0xfffffe009d17a4d0 mi_switch() at mi_switch+0x178/frame 0xfffffe009d17a500 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d17a540 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009d17a5a0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe009d17a5e0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1f1/frame 0xfffffe009d17a650 svc_run_internal() at svc_run_internal+0x3a4/frame 0xfffffe009d17a790 svc_run() at svc_run+0x1fe/frame 0xfffffe009d17a7f0 sys_nlm_syscall() at sys_nlm_syscall+0x7af/frame 0xfffffe009d17a980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe009d17aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009d17aab0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8002ed5fa, rsp = 0x7fffffffec28, rbp = 0x7fffffffece0 --- Tracing command rpc.statd pid 1666 tid 100196 td 0xfffff8012a178000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a7e295a0 mi_switch() at mi_switch+0x178/frame 0xfffffe00a7e295d0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a7e29610 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a7e29670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a7e296b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1f1/frame 0xfffffe00a7e29720 seltdwait() at seltdwait+0x6b/frame 0xfffffe00a7e29760 kern_select() at kern_select+0x8c0/frame 0xfffffe00a7e29940 sys_select() at sys_select+0x56/frame 0xfffffe00a7e29980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a7e29ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7e29ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800423aea, rsp = 0x7fffffffeab8, rbp = 0x7fffffffec00 --- Tracing command watchdogd pid 1616 tid 100169 td 0xfffff8012db82580 sched_switch() at sched_switch+0x942/frame 0xfffffe009d189560 mi_switch() at mi_switch+0x178/frame 0xfffffe009d189590 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d1895d0 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009d189630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009d189660 _sleep() at _sleep+0x39c/frame 0xfffffe009d189700 kern_wait6() at kern_wait6+0x4c4/frame 0xfffffe009d189790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe009d189980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe009d189ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009d189ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003bb16a, rsp = 0x7fffffffea48, rbp = 0x7fffffffeb00 --- Tracing command rpcbind pid 1540 tid 100191 td 0xfffff8012d828000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a7e10620 mi_switch() at mi_switch+0x178/frame 0xfffffe00a7e10650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a7e10690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00a7e106f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a7e10730 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1f1/frame 0xfffffe00a7e107a0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00a7e107e0 kern_poll() at kern_poll+0x43a/frame 0xfffffe00a7e10960 sys_poll() at sys_poll+0x50/frame 0xfffffe00a7e10980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe00a7e10ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7e10ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003c9c8a, rsp = 0x7fffffffca58, rbp = 0x7fffffffec70 --- Tracing command syslogd pid 1530 tid 100186 td 0xfffff801482d9000 sched_switch() at sched_switch+0x942/frame 0xfffffe009d1ea5c0 mi_switch() at mi_switch+0x178/frame 0xfffffe009d1ea5f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d1ea630 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009d1ea690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009d1ea6c0 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe009d1ea720 seltdwait() at seltdwait+0x8d/frame 0xfffffe009d1ea760 kern_select() at kern_select+0x8c0/frame 0xfffffe009d1ea940 sys_select() at sys_select+0x56/frame 0xfffffe009d1ea980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe009d1eaab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009d1eaab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800435aea, rsp = 0x7fffffffe6c8, rbp = 0x7fffffffece0 --- Tracing command devd pid 1459 tid 100161 td 0xfffff8012d898580 sched_switch() at sched_switch+0x942/frame 0xfffffe009d1495a0 mi_switch() at mi_switch+0x178/frame 0xfffffe009d1495d0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d149610 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009d149670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe009d1496b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1f1/frame 0xfffffe009d149720 seltdwait() at seltdwait+0x6b/frame 0xfffffe009d149760 kern_select() at kern_select+0x8c0/frame 0xfffffe009d149940 sys_select() at sys_select+0x56/frame 0xfffffe009d149980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe009d149ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009d149ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2fc14a, rsp = 0x7fffffffcb78, rbp = 0x7fffffffed00 --- Tracing command dhclient pid 1454 tid 100184 td 0xfffff8012d093000 sched_switch() at sched_switch+0x942/frame 0xfffffe009d1e0620 mi_switch() at mi_switch+0x178/frame 0xfffffe009d1e0650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d1e0690 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009d1e06f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe009d1e0730 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1f1/frame 0xfffffe009d1e07a0 seltdwait() at seltdwait+0x6b/frame 0xfffffe009d1e07e0 kern_poll() at kern_poll+0x43a/frame 0xfffffe009d1e0960 sys_poll() at sys_poll+0x50/frame 0xfffffe009d1e0980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe009d1e0ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009d1e0ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003ecc8a, rsp = 0x7fffffffec48, rbp = 0x7fffffffec80 --- Tracing command dhclient pid 1410 tid 100150 td 0xfffff8012d0a3000 sched_switch() at sched_switch+0x942/frame 0xfffffe009d117640 mi_switch() at mi_switch+0x178/frame 0xfffffe009d117670 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d1176b0 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009d117710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009d117740 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe009d1177a0 seltdwait() at seltdwait+0x8d/frame 0xfffffe009d1177e0 kern_poll() at kern_poll+0x43a/frame 0xfffffe009d117960 sys_poll() at sys_poll+0x50/frame 0xfffffe009d117980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe009d117ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009d117ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003ecc8a, rsp = 0x7fffffffec58, rbp = 0x7fffffffec80 --- Tracing command dhclient pid 1407 tid 100170 td 0xfffff8012d093580 sched_switch() at sched_switch+0x942/frame 0xfffffe009d18e5c0 mi_switch() at mi_switch+0x178/frame 0xfffffe009d18e5f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d18e630 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe009d18e690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe009d18e6c0 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe009d18e720 seltdwait() at seltdwait+0x8d/frame 0xfffffe009d18e760 kern_select() at kern_select+0x8c0/frame 0xfffffe009d18e940 sys_select() at sys_select+0x56/frame 0xfffffe009d18e980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe009d18eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe009d18eab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80044baea, rsp = 0x7fffffffea08, rbp = 0x7fffffffeac0 --- Tracing command vnlru pid 33 tid 100132 td 0xfffff8012d4cf000 sched_switch() at sched_switch+0x942/frame 0xfffffe009d0b8880 mi_switch() at mi_switch+0x178/frame 0xfffffe009d0b88b0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d0b88f0 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe009d0b8930 _sleep() at _sleep+0x34d/frame 0xfffffe009d0b89d0 vnlru_proc() at vnlru_proc+0xa4/frame 0xfffffe009d0b8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d0b8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d0b8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 32 tid 100131 td 0xfffff8012d4cf580 sched_switch() at sched_switch+0x942/frame 0xfffffe009d0b38c0 mi_switch() at mi_switch+0x178/frame 0xfffffe009d0b38f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d0b3930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe009d0b3970 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x1f1/frame 0xfffffe009d0b39e0 sched_sync() at sched_sync+0x609/frame 0xfffffe009d0b3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d0b3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d0b3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100129 td 0xfffff8012d4d1000 sched_switch() at sched_switch+0x942/frame 0xfffffe009d0ae8d0 mi_switch() at mi_switch+0x178/frame 0xfffffe009d0ae900 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d0ae940 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe009d0ae980 _sleep() at _sleep+0x34d/frame 0xfffffe009d0aea20 buf_daemon() at buf_daemon+0xd8/frame 0xfffffe009d0aea70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d0aeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d0aeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100134 td 0xfffff8012d4f4000 sched_switch() at sched_switch+0x942/frame 0xfffffe009d0c78c0 mi_switch() at mi_switch+0x178/frame 0xfffffe009d0c78f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d0c7930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe009d0c7970 _sleep() at _sleep+0x34d/frame 0xfffffe009d0c7a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe009d0c7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d0c7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d0c7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100135 td 0xfffff8012d4f2580 sched_switch() at sched_switch+0x942/frame 0xfffffe009d0cc8c0 mi_switch() at mi_switch+0x178/frame 0xfffffe009d0cc8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d0cc930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe009d0cc970 _sleep() at _sleep+0x34d/frame 0xfffffe009d0cca10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe009d0cca70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d0ccab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d0ccab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100136 td 0xfffff8012d4f2000 sched_switch() at sched_switch+0x942/frame 0xfffffe009d0d18c0 mi_switch() at mi_switch+0x178/frame 0xfffffe009d0d18f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d0d1930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe009d0d1970 _sleep() at _sleep+0x34d/frame 0xfffffe009d0d1a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe009d0d1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d0d1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d0d1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100137 td 0xfffff8012d4ef580 sched_switch() at sched_switch+0x942/frame 0xfffffe009d0d68c0 mi_switch() at mi_switch+0x178/frame 0xfffffe009d0d68f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d0d6930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe009d0d6970 _sleep() at _sleep+0x34d/frame 0xfffffe009d0d6a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe009d0d6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d0d6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d0d6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100138 td 0xfffff8012d4ef000 sched_switch() at sched_switch+0x942/frame 0xfffffe009d0db8c0 mi_switch() at mi_switch+0x178/frame 0xfffffe009d0db8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d0db930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe009d0db970 _sleep() at _sleep+0x34d/frame 0xfffffe009d0dba10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe009d0dba70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d0dbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d0dbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100139 td 0xfffff8012d4ee580 sched_switch() at sched_switch+0x942/frame 0xfffffe009d0e08c0 mi_switch() at mi_switch+0x178/frame 0xfffffe009d0e08f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d0e0930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe009d0e0970 _sleep() at _sleep+0x34d/frame 0xfffffe009d0e0a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe009d0e0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d0e0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d0e0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100140 td 0xfffff8012d4ee000 sched_switch() at sched_switch+0x942/frame 0xfffffe009d0e58c0 mi_switch() at mi_switch+0x178/frame 0xfffffe009d0e58f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d0e5930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe009d0e5970 _sleep() at _sleep+0x34d/frame 0xfffffe009d0e5a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe009d0e5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d0e5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d0e5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100154 td 0xfffff8012d829000 sched_switch() at sched_switch+0x942/frame 0xfffffe009d12b8b0 mi_switch() at mi_switch+0x178/frame 0xfffffe009d12b8e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d12b920 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe009d12b960 _sleep() at _sleep+0x34d/frame 0xfffffe009d12ba00 softdep_flush() at softdep_flush+0x28a/frame 0xfffffe009d12ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d12bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d12bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100160 td 0xfffff8012d6b6580 sched_switch() at sched_switch+0x942/frame 0xfffffe009d1448b0 mi_switch() at mi_switch+0x178/frame 0xfffffe009d1448e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d144920 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe009d144960 _sleep() at _sleep+0x34d/frame 0xfffffe009d144a00 softdep_flush() at softdep_flush+0x28a/frame 0xfffffe009d144a70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d144ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d144ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100261 td 0xfffff80148ea3580 sched_switch() at sched_switch+0x942/frame 0xfffffe00a7f6e8b0 mi_switch() at mi_switch+0x178/frame 0xfffffe00a7f6e8e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a7f6e920 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00a7f6e960 _sleep() at _sleep+0x34d/frame 0xfffffe00a7f6ea00 softdep_flush() at softdep_flush+0x28a/frame 0xfffffe00a7f6ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a7f6eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a7f6eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 31 tid 100262 td 0xfffff8012d877000 sched_switch() at sched_switch+0x942/frame 0xfffffe00a7f738b0 mi_switch() at mi_switch+0x178/frame 0xfffffe00a7f738e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a7f73920 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00a7f73960 _sleep() at _sleep+0x34d/frame 0xfffffe00a7f73a00 softdep_flush() at softdep_flush+0x28a/frame 0xfffffe00a7f73a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a7f73ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a7f73ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 30 tid 100128 td 0xfffff8012d0a6580 sched_switch() at sched_switch+0x942/frame 0xfffffe009d0a98b0 mi_switch() at mi_switch+0x178/frame 0xfffffe009d0a98e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d0a9920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe009d0a9950 _sleep() at _sleep+0x3a9/frame 0xfffffe009d0a99f0 vm_daemon() at vm_daemon+0x85/frame 0xfffffe009d0a9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d0a9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d0a9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 29 tid 100127 td 0xfffff8012d18f000 sched_switch() at sched_switch+0x942/frame 0xfffffe009d0a4520 mi_switch() at mi_switch+0x178/frame 0xfffffe009d0a4550 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d0a4590 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe009d0a45d0 _sleep() at _sleep+0x34d/frame 0xfffffe009d0a4670 vm_pageout_worker() at vm_pageout_worker+0x26e/frame 0xfffffe009d0a4a50 vm_pageout() at vm_pageout+0x133/frame 0xfffffe009d0a4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d0a4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d0a4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 29 tid 100130 td 0xfffff8012d4d7580 sched_switch() at sched_switch+0x942/frame 0xfffffe009d0bd6b0 mi_switch() at mi_switch+0x178/frame 0xfffffe009d0bd6e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d0bd720 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe009d0bd750 _sleep() at _sleep+0x3a9/frame 0xfffffe009d0bd7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xe79/frame 0xfffffe009d0bda70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d0bdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d0bdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 29 tid 100133 td 0xfffff8012d4d7000 sched_switch() at sched_switch+0x942/frame 0xfffffe009d0c28f0 mi_switch() at mi_switch+0x178/frame 0xfffffe009d0c2920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d0c2960 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe009d0c29a0 _sleep() at _sleep+0x34d/frame 0xfffffe009d0c2a40 uma_reclaim_worker() at uma_reclaim_worker+0xda/frame 0xfffffe009d0c2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d0c2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d0c2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 28 tid 100126 td 0xfffff8012d0a3580 sched_switch() at sched_switch+0x942/frame 0xfffffe009d0938b0 mi_switch() at mi_switch+0x178/frame 0xfffffe009d0938e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d093920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe009d093950 _sleep() at _sleep+0x3a9/frame 0xfffffe009d0939f0 enc_daemon() at enc_daemon+0x1df/frame 0xfffffe009d093a70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d093ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d093ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 27 tid 100125 td 0xfffff8012d0a4000 sched_switch() at sched_switch+0x942/frame 0xfffffe009d08e8b0 mi_switch() at mi_switch+0x178/frame 0xfffffe009d08e8e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d08e920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe009d08e950 _sleep() at _sleep+0x3a9/frame 0xfffffe009d08e9f0 enc_daemon() at enc_daemon+0x1df/frame 0xfffffe009d08ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d08eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d08eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 26 tid 100119 td 0xfffff8012d19d000 sched_switch() at sched_switch+0x942/frame 0xfffffe009d0708c0 mi_switch() at mi_switch+0x178/frame 0xfffffe009d0708f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d070930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe009d070970 _sleep() at _sleep+0x34d/frame 0xfffffe009d070a10 random_kthread() at random_kthread+0x57/frame 0xfffffe009d070a70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d070ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d070ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 25 tid 100118 td 0xfffff8012d19d580 sched_switch() at sched_switch+0x942/frame 0xfffffe009d05f910 mi_switch() at mi_switch+0x178/frame 0xfffffe009d05f940 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d05f980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe009d05f9b0 _sleep() at _sleep+0x3a9/frame 0xfffffe009d05fa50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe009d05fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d05fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d05fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 24 tid 100117 td 0xfffff8012d0a4580 sched_switch() at sched_switch+0x942/frame 0xfffffe009d04e8e0 mi_switch() at mi_switch+0x178/frame 0xfffffe009d04e910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d04e950 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe009d04e990 _sleep() at _sleep+0x34d/frame 0xfffffe009d04ea30 soaio_kproc_loop() at soaio_kproc_loop+0x196/frame 0xfffffe009d04ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d04eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d04eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 23 tid 100116 td 0xfffff8012d0a5000 sched_switch() at sched_switch+0x942/frame 0xfffffe009d0498e0 mi_switch() at mi_switch+0x178/frame 0xfffffe009d049910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d049950 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe009d049990 _sleep() at _sleep+0x34d/frame 0xfffffe009d049a30 soaio_kproc_loop() at soaio_kproc_loop+0x196/frame 0xfffffe009d049a70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d049ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d049ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 22 tid 100115 td 0xfffff8012d0a5580 sched_switch() at sched_switch+0x942/frame 0xfffffe009d0448e0 mi_switch() at mi_switch+0x178/frame 0xfffffe009d044910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d044950 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe009d044990 _sleep() at _sleep+0x34d/frame 0xfffffe009d044a30 soaio_kproc_loop() at soaio_kproc_loop+0x196/frame 0xfffffe009d044a70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d044ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d044ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 21 tid 100114 td 0xfffff8012d0a6000 sched_switch() at sched_switch+0x942/frame 0xfffffe009d03f8e0 mi_switch() at mi_switch+0x178/frame 0xfffffe009d03f910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d03f950 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe009d03f990 _sleep() at _sleep+0x34d/frame 0xfffffe009d03fa30 soaio_kproc_loop() at soaio_kproc_loop+0x196/frame 0xfffffe009d03fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d03fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d03fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100095 td 0xfffff80003dec580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005c5920 mi_switch() at mi_switch+0x178/frame 0xfffffe00005c5950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005c5990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c59c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe00005c5a30 usb_process() at usb_process+0x12b/frame 0xfffffe00005c5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100096 td 0xfffff80003dec000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005ca920 mi_switch() at mi_switch+0x178/frame 0xfffffe00005ca950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005ca990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ca9c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe00005caa30 usb_process() at usb_process+0x12b/frame 0xfffffe00005caa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005caab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005caab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100097 td 0xfffff80003deb580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005cf920 mi_switch() at mi_switch+0x178/frame 0xfffffe00005cf950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005cf990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005cf9c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe00005cfa30 usb_process() at usb_process+0x12b/frame 0xfffffe00005cfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005cfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005cfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100098 td 0xfffff80003deb000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005d4920 mi_switch() at mi_switch+0x178/frame 0xfffffe00005d4950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005d4990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005d49c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe00005d4a30 usb_process() at usb_process+0x12b/frame 0xfffffe00005d4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100099 td 0xfffff80003de3580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005d9920 mi_switch() at mi_switch+0x178/frame 0xfffffe00005d9950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005d9990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005d99c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe00005d9a30 usb_process() at usb_process+0x12b/frame 0xfffffe00005d9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100101 td 0xfffff80003a40580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005e3920 mi_switch() at mi_switch+0x178/frame 0xfffffe00005e3950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005e3990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005e39c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe00005e3a30 usb_process() at usb_process+0x12b/frame 0xfffffe00005e3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100102 td 0xfffff8012a17c000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005e8920 mi_switch() at mi_switch+0x178/frame 0xfffffe00005e8950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005e8990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005e89c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe00005e8a30 usb_process() at usb_process+0x12b/frame 0xfffffe00005e8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100103 td 0xfffff8012a17b580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005ed920 mi_switch() at mi_switch+0x178/frame 0xfffffe00005ed950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005ed990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ed9c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe00005eda30 usb_process() at usb_process+0x12b/frame 0xfffffe00005eda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005edab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005edab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100104 td 0xfffff8012a17b000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005f2920 mi_switch() at mi_switch+0x178/frame 0xfffffe00005f2950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005f2990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005f29c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe00005f2a30 usb_process() at usb_process+0x12b/frame 0xfffffe00005f2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100105 td 0xfffff8012a17a580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005f7920 mi_switch() at mi_switch+0x178/frame 0xfffffe00005f7950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005f7990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005f79c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe00005f7a30 usb_process() at usb_process+0x12b/frame 0xfffffe00005f7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100106 td 0xfffff8012c07d580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005fc920 mi_switch() at mi_switch+0x178/frame 0xfffffe00005fc950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005fc990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005fc9c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe00005fca30 usb_process() at usb_process+0x12b/frame 0xfffffe00005fca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005fcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005fcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100107 td 0xfffff8012c07d000 sched_switch() at sched_switch+0x942/frame 0xfffffe009d01c920 mi_switch() at mi_switch+0x178/frame 0xfffffe009d01c950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d01c990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe009d01c9c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe009d01ca30 usb_process() at usb_process+0x12b/frame 0xfffffe009d01ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d01cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d01cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100108 td 0xfffff8012c07c580 sched_switch() at sched_switch+0x942/frame 0xfffffe009d021920 mi_switch() at mi_switch+0x178/frame 0xfffffe009d021950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d021990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe009d0219c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe009d021a30 usb_process() at usb_process+0x12b/frame 0xfffffe009d021a70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d021ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d021ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100109 td 0xfffff8012c07c000 sched_switch() at sched_switch+0x942/frame 0xfffffe009d026920 mi_switch() at mi_switch+0x178/frame 0xfffffe009d026950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d026990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe009d0269c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe009d026a30 usb_process() at usb_process+0x12b/frame 0xfffffe009d026a70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d026ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d026ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 20 tid 100110 td 0xfffff8012c07b580 sched_switch() at sched_switch+0x942/frame 0xfffffe009d02b920 mi_switch() at mi_switch+0x178/frame 0xfffffe009d02b950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d02b990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe009d02b9c0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe009d02ba30 usb_process() at usb_process+0x12b/frame 0xfffffe009d02ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d02bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d02bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 19 tid 100090 td 0xfffff800038a2580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005ac8e0 mi_switch() at mi_switch+0x178/frame 0xfffffe00005ac910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005ac950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ac980 _sleep() at _sleep+0x3a9/frame 0xfffffe00005aca20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00005aca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005acab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005acab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 19 tid 100091 td 0xfffff80003a40000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005b18e0 mi_switch() at mi_switch+0x178/frame 0xfffffe00005b1910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005b1950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005b1980 _sleep() at _sleep+0x3a9/frame 0xfffffe00005b1a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00005b1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005b1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005b1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 19 tid 100092 td 0xfffff80003a3f580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005b68e0 mi_switch() at mi_switch+0x178/frame 0xfffffe00005b6910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005b6950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005b6980 _sleep() at _sleep+0x3a9/frame 0xfffffe00005b6a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00005b6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005b6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005b6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 19 tid 100124 td 0xfffff8012d18f580 sched_switch() at sched_switch+0x942/frame 0xfffffe009d0898d0 mi_switch() at mi_switch+0x178/frame 0xfffffe009d089900 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d089940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe009d089970 _sleep() at _sleep+0x3a9/frame 0xfffffe009d089a10 xpt_scanner_thread() at xpt_scanner_thread+0x93/frame 0xfffffe009d089a70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d089ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d089ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 18 tid 100089 td 0xfffff800038af000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005a78c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00005a78f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005a7930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005a7960 _sleep() at _sleep+0x3a9/frame 0xfffffe00005a7a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005a7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005a7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005a7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 17 tid 100088 td 0xfffff800038af580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005a28c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00005a28f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005a2930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005a2960 _sleep() at _sleep+0x3a9/frame 0xfffffe00005a2a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005a2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005a2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005a2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 16 tid 100087 td 0xfffff800038b0000 sched_switch() at sched_switch+0x942/frame 0xfffffe000059d8c0 mi_switch() at mi_switch+0x178/frame 0xfffffe000059d8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000059d930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000059d960 _sleep() at _sleep+0x3a9/frame 0xfffffe000059da00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe000059da70 fork_exit() at fork_exit+0x84/frame 0xfffffe000059dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000059dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 15 tid 100086 td 0xfffff800038b0580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005988c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00005988f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000598930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000598960 _sleep() at _sleep+0x3a9/frame 0xfffffe0000598a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0000598a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000598ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000598ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 14 tid 100085 td 0xfffff800038b1000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005938c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00005938f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000593930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000593960 _sleep() at _sleep+0x3a9/frame 0xfffffe0000593a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0000593a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000593ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000593ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100084 td 0xfffff800038b1580 sched_switch() at sched_switch+0x942/frame 0xfffffe000058e8c0 mi_switch() at mi_switch+0x178/frame 0xfffffe000058e8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000058e930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000058e960 _sleep() at _sleep+0x3a9/frame 0xfffffe000058ea00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe000058ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000058eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000058eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100083 td 0xfffff800038b2000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005898c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00005898f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000589930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000589960 _sleep() at _sleep+0x3a9/frame 0xfffffe0000589a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0000589a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000589ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000589ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100082 td 0xfffff800038b2580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005848c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00005848f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000584930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000584960 _sleep() at _sleep+0x3a9/frame 0xfffffe0000584a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0000584a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000584ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000584ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100081 td 0xfffff8000389e000 sched_switch() at sched_switch+0x942/frame 0xfffffe000057f8c0 mi_switch() at mi_switch+0x178/frame 0xfffffe000057f8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000057f930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000057f960 _sleep() at _sleep+0x3a9/frame 0xfffffe000057fa00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe000057fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000057fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000057fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100080 td 0xfffff8000389e580 sched_switch() at sched_switch+0x942/frame 0xfffffe000057a8c0 mi_switch() at mi_switch+0x178/frame 0xfffffe000057a8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000057a930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000057a960 _sleep() at _sleep+0x3a9/frame 0xfffffe000057aa00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe000057aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000057aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000057aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100079 td 0xfffff8000389f000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005758c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00005758f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000575930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000575960 _sleep() at _sleep+0x3a9/frame 0xfffffe0000575a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0000575a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000575ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000575ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100078 td 0xfffff8000389f580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005708c0 mi_switch() at mi_switch+0x178/frame 0xfffffe00005708f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000570930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000570960 _sleep() at _sleep+0x3a9/frame 0xfffffe0000570a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0000570a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000570ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000570ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100077 td 0xfffff800038a0000 sched_switch() at sched_switch+0x942/frame 0xfffffe000056b8f0 mi_switch() at mi_switch+0x178/frame 0xfffffe000056b920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000056b960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000056b990 _sleep() at _sleep+0x3a9/frame 0xfffffe000056ba30 crypto_proc() at crypto_proc+0x2d5/frame 0xfffffe000056ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000056bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000056bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffff80003796580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005208f0 mi_switch() at mi_switch+0x178/frame 0xfffffe0000520920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000520960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000520990 _sleep() at _sleep+0x3a9/frame 0xfffffe0000520a30 g_run_events() at g_run_events+0x4f/frame 0xfffffe0000520a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000520ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000520ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffff80003796000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005258f0 mi_switch() at mi_switch+0x178/frame 0xfffffe0000525920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000525960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000525990 _sleep() at _sleep+0x3a9/frame 0xfffffe0000525a30 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0000525a60 g_up_procbody() at g_up_procbody+0x6d/frame 0xfffffe0000525a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000525ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000525ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100064 td 0xfffff80003836580 sched_switch() at sched_switch+0x942/frame 0xfffffe000052a8e0 mi_switch() at mi_switch+0x178/frame 0xfffffe000052a910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000052a950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000052a980 _sleep() at _sleep+0x3a9/frame 0xfffffe000052aa20 g_io_schedule_down() at g_io_schedule_down+0x14c/frame 0xfffffe000052aa60 g_down_procbody() at g_down_procbody+0x6d/frame 0xfffffe000052aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000052aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000052aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100015 td 0xfffff8000366e000 sched_switch() at sched_switch+0x942/frame 0xfffffe00789969e0 mi_switch() at mi_switch+0x178/frame 0xfffffe0078996a10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe0078996a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078996ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078996ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100017 td 0xfffff8000366d000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100020 td 0xfffff80003697580 sched_switch() at sched_switch+0x942/frame 0xfffffe00789af9e0 mi_switch() at mi_switch+0x178/frame 0xfffffe00789afa10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe00789afa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789afab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789afab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100047 td 0xfffff80003786000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004759e0 mi_switch() at mi_switch+0x178/frame 0xfffffe0000475a10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe0000475a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000475ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000475ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100048 td 0xfffff80003785580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100049 td 0xfffff80003785000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100050 td 0xfffff80003784580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffff80003784000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffff80003778580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100053 td 0xfffff80003778000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100054 td 0xfffff80003726580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100055 td 0xfffff8000379a000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100056 td 0xfffff80003799580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100057 td 0xfffff80003799000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100058 td 0xfffff80003798580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xfffff80003798000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004b19e0 mi_switch() at mi_switch+0x178/frame 0xfffffe00004b1a10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe00004b1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100060 td 0xfffff80003797580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100093 td 0xfffff80003ded580 sched_switch() at sched_switch+0x942/frame 0xfffffe00005bb9e0 mi_switch() at mi_switch+0x178/frame 0xfffffe00005bba10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe00005bba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005bbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005bbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100094 td 0xfffff80003ded000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005c09e0 mi_switch() at mi_switch+0x178/frame 0xfffffe00005c0a10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe00005c0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100100 td 0xfffff80003de3000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005de9e0 mi_switch() at mi_switch+0x178/frame 0xfffffe00005dea10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe00005dea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005deab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005deab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100111 td 0xfffff8012c07b000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100112 td 0xfffff8012c073580 sched_switch() at sched_switch+0x942/frame 0xfffffe009d0359e0 mi_switch() at mi_switch+0x178/frame 0xfffffe009d035a10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe009d035a70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d035ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d035ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100172 td 0xfffff8012dd51000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100173 td 0xfffff8012dd50580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100174 td 0xfffff8012dd50000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100175 td 0xfffff8012dd4f580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100176 td 0xfffff8012dd4f000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100177 td 0xfffff8012dd4e580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100178 td 0xfffff8012dd4e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100179 td 0xfffff8012db83580 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffff8000365f000 (CPU 0) kdb_alt_break_internal() at kdb_alt_break_internal+0x106/frame 0xfffffe007895a6f0 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe007895a700 uart_intr_rxready() at uart_intr_rxready+0x9a/frame 0xfffffe007895a730 uart_intr() at uart_intr+0x138/frame 0xfffffe007895a770 intr_event_handle() at intr_event_handle+0xfd/frame 0xfffffe007895a7d0 intr_execute_handlers() at intr_execute_handlers+0x58/frame 0xfffffe007895a800 lapic_handle_intr() at lapic_handle_intr+0x6d/frame 0xfffffe007895a840 Xapic_isr1() at Xapic_isr1+0xd9/frame 0xfffffe007895a840 --- interrupt, rip = 0xffffffff8120b1d6, rsp = 0xfffffe007895a910, rbp = 0xfffffe007895a910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007895a910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe007895a960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007895a980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007895a9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007895aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007895aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007895aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff8000365e580 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00003fedf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00003fee10 trap() at trap+0x49/frame 0xfffffe00003fef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00003fef20 --- trap 0x13, rip = 0xffffffff8120b1d6, rsp = 0xfffffe007895f910, rbp = 0xfffffe007895f910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007895f910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe007895f960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007895f980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007895f9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007895fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007895fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007895fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff8000365e000 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071b8df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071b8e10 trap() at trap+0x49/frame 0xfffffe00071b8f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071b8f20 --- trap 0x13, rip = 0xffffffff8120b1d6, rsp = 0xfffffe0078964910, rbp = 0xfffffe0078964910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078964910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe0078964960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078964980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00789649a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078964a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078964ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078964ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff8000365d580 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071c4df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071c4e10 trap() at trap+0x49/frame 0xfffffe00071c4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071c4f20 --- trap 0x13, rip = 0xffffffff8120b1d6, rsp = 0xfffffe0078969910, rbp = 0xfffffe0078969910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078969910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe0078969960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078969980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00789699a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078969a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078969ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078969ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff8000365d000 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071d0df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071d0e10 trap() at trap+0x49/frame 0xfffffe00071d0f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071d0f20 --- trap 0x13, rip = 0xffffffff8120b1d6, rsp = 0xfffffe007896e910, rbp = 0xfffffe007896e910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007896e910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe007896e960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007896e980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007896e9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007896ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe007896eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007896eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff8000365c580 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071dcdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071dce10 trap() at trap+0x49/frame 0xfffffe00071dcf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071dcf20 --- trap 0x13, rip = 0xffffffff8120b1d6, rsp = 0xfffffe0078973910, rbp = 0xfffffe0078973910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078973910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe0078973960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078973980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00789739a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078973a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078973ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078973ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff8000365c000 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071e8df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071e8e10 trap() at trap+0x49/frame 0xfffffe00071e8f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071e8f20 --- trap 0x13, rip = 0xffffffff8120b1d6, rsp = 0xfffffe0078978910, rbp = 0xfffffe0078978910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078978910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe0078978960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078978980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00789789a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078978a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078978ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078978ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff80003670580 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071f4df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071f4e10 trap() at trap+0x49/frame 0xfffffe00071f4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071f4f20 --- trap 0x13, rip = 0xffffffff8120b1d6, rsp = 0xfffffe007897d910, rbp = 0xfffffe007897d910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007897d910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff80003670000 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000cbcdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000cbce10 trap() at trap+0x49/frame 0xfffffe0000cbcf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000cbcf20 --- trap 0x13, rip = 0xffffffff8120b1d6, rsp = 0xfffffe0078982910, rbp = 0xfffffe0078982910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078982910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe0078982960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078982980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00789829a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078982a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078982ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078982ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff8000366f580 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000cc8df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000cc8e10 trap() at trap+0x49/frame 0xfffffe0000cc8f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000cc8f20 --- trap 0x13, rip = 0xffffffff8120b1d6, rsp = 0xfffffe0078987910, rbp = 0xfffffe0078987910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078987910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe0078987960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078987980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00789879a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078987a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078987ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078987ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff8000366f000 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000cd4df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000cd4e10 trap() at trap+0x49/frame 0xfffffe0000cd4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000cd4f20 --- trap 0x13, rip = 0xffffffff8120b1d6, rsp = 0xfffffe007898c910, rbp = 0xfffffe007898c910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007898c910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe007898c960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007898c980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007898c9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007898ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe007898cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007898cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff8000366e580 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000ce0df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000ce0e10 trap() at trap+0x49/frame 0xfffffe0000ce0f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000ce0f20 --- trap 0x13, rip = 0xffffffff8120b1d6, rsp = 0xfffffe0078991910, rbp = 0xfffffe0078991910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078991910 acpi_cpu_idle() at acpi_cpu_idle+0x2ee/frame 0xfffffe0078991960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078991980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00789919a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078991a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078991ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078991ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff8000365f580 sched_switch() at sched_switch+0x942/frame 0xfffffe0078955560 mi_switch() at mi_switch+0x178/frame 0xfffffe0078955590 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789555d0 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe0078955630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0078955660 _sleep() at _sleep+0x39c/frame 0xfffffe0078955700 kern_wait6() at kern_wait6+0x4c4/frame 0xfffffe0078955790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe0078955980 amd64_syscall() at amd64_syscall+0x29c/frame 0xfffffe0078955ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0078955ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2ae77a, rsp = 0x7fffffffe788, rbp = 0x7fffffffe7f0 --- Tracing command audit pid 10 tid 100001 td 0xfffff80003660000 sched_switch() at sched_switch+0x942/frame 0xfffffe0078950900 mi_switch() at mi_switch+0x178/frame 0xfffffe0078950930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0078950970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789509a0 _cv_wait() at _cv_wait+0x1e7/frame 0xfffffe0078950a10 audit_worker() at audit_worker+0x93/frame 0xfffffe0078950a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078950ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078950ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff82000b00 sched_switch() at sched_switch+0x942/frame 0xffffffff8289d9d0 mi_switch() at mi_switch+0x178/frame 0xffffffff8289da00 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffffff8289da40 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xffffffff8289da80 _sleep() at _sleep+0x34d/frame 0xffffffff8289db20 swapper() at swapper+0x77/frame 0xffffffff8289db70 btext() at btext+0x2c Tracing command kernel pid 0 tid 100016 td 0xfffff8000366d580 sched_switch() at sched_switch+0x942/frame 0xfffffe007899b900 mi_switch() at mi_switch+0x178/frame 0xfffffe007899b930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe007899b970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe007899b9a0 _sleep() at _sleep+0x3a9/frame 0xfffffe007899ba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe007899ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe007899bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007899bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffff80003660580 sched_switch() at sched_switch+0x942/frame 0xfffffe00789a5900 mi_switch() at mi_switch+0x178/frame 0xfffffe00789a5930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789a5970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789a59a0 _sleep() at _sleep+0x3a9/frame 0xfffffe00789a5a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00789a5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789a5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789a5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffff80003698000 sched_switch() at sched_switch+0x942/frame 0xfffffe00789aa900 mi_switch() at mi_switch+0x178/frame 0xfffffe00789aa930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789aa970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789aa9a0 _sleep() at _sleep+0x3a9/frame 0xfffffe00789aaa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00789aaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789aaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789aaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffff80003697000 sched_switch() at sched_switch+0x942/frame 0xfffffe00789e4920 mi_switch() at mi_switch+0x178/frame 0xfffffe00789e4950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789e4990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789e49c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789e4a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789e4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789e4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789e4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffff80003696580 sched_switch() at sched_switch+0x942/frame 0xfffffe00789e9920 mi_switch() at mi_switch+0x178/frame 0xfffffe00789e9950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789e9990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789e99c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789e9a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffff80003696000 sched_switch() at sched_switch+0x942/frame 0xfffffe00789ee920 mi_switch() at mi_switch+0x178/frame 0xfffffe00789ee950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789ee990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789ee9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789eea40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffff80003695580 sched_switch() at sched_switch+0x942/frame 0xfffffe00789f3920 mi_switch() at mi_switch+0x178/frame 0xfffffe00789f3950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789f3990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789f39c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789f3a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffff80003695000 sched_switch() at sched_switch+0x942/frame 0xfffffe00789f8920 mi_switch() at mi_switch+0x178/frame 0xfffffe00789f8950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789f8990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789f89c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789f8a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789f8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789f8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789f8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffff80003694580 sched_switch() at sched_switch+0x942/frame 0xfffffe00789fd920 mi_switch() at mi_switch+0x178/frame 0xfffffe00789fd950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789fd990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789fd9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe00789fda40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789fda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789fdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789fdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffff80003694000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000411920 mi_switch() at mi_switch+0x178/frame 0xfffffe0000411950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000411990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004119c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe0000411a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000411a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000411ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000411ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffff800036d1580 sched_switch() at sched_switch+0x942/frame 0xfffffe0000416920 mi_switch() at mi_switch+0x178/frame 0xfffffe0000416950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000416990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004169c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe0000416a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000416a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000416ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000416ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffff800036d1000 sched_switch() at sched_switch+0x942/frame 0xfffffe000041b920 mi_switch() at mi_switch+0x178/frame 0xfffffe000041b950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000041b990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000041b9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe000041ba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000041ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000041bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000041bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffff800036d0580 sched_switch() at sched_switch+0x942/frame 0xfffffe0000420920 mi_switch() at mi_switch+0x178/frame 0xfffffe0000420950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000420990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004209c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe0000420a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000420a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000420ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000420ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffff800036d0000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000425920 mi_switch() at mi_switch+0x178/frame 0xfffffe0000425950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000425990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004259c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe0000425a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000425a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000425ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000425ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffff800036cf580 sched_switch() at sched_switch+0x942/frame 0xfffffe000042a920 mi_switch() at mi_switch+0x178/frame 0xfffffe000042a950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000042a990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000042a9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe000042aa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000042aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000042aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000042aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff800036cf000 sched_switch() at sched_switch+0x942/frame 0xfffffe000042f920 mi_switch() at mi_switch+0x178/frame 0xfffffe000042f950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000042f990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000042f9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe000042fa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000042fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000042fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000042fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffff800036ce580 sched_switch() at sched_switch+0x942/frame 0xfffffe0000434920 mi_switch() at mi_switch+0x178/frame 0xfffffe0000434950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000434990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004349c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe0000434a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000434a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000434ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000434ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffff800036ce000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000439920 mi_switch() at mi_switch+0x178/frame 0xfffffe0000439950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000439990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004399c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe0000439a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000439a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000439ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000439ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffff80003698580 sched_switch() at sched_switch+0x942/frame 0xfffffe000043e920 mi_switch() at mi_switch+0x178/frame 0xfffffe000043e950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000043e990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000043e9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe000043ea40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000043ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000043eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000043eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffff80003726000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000443920 mi_switch() at mi_switch+0x178/frame 0xfffffe0000443950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000443990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004439c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe0000443a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000443a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000443ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000443ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffff80003722580 sched_switch() at sched_switch+0x942/frame 0xfffffe0000448920 mi_switch() at mi_switch+0x178/frame 0xfffffe0000448950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000448990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004489c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe0000448a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000448a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000448ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000448ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffff80003722000 sched_switch() at sched_switch+0x942/frame 0xfffffe000044d920 mi_switch() at mi_switch+0x178/frame 0xfffffe000044d950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000044d990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000044d9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe000044da40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000044da70 fork_exit() at fork_exit+0x84/frame 0xfffffe000044dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000044dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffff8000371f580 sched_switch() at sched_switch+0x942/frame 0xfffffe0000452920 mi_switch() at mi_switch+0x178/frame 0xfffffe0000452950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000452990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004529c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe0000452a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000452a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000452ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000452ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffff8000371f000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000457920 mi_switch() at mi_switch+0x178/frame 0xfffffe0000457950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000457990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004579c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe0000457a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000457a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000457ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000457ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffff8000371c580 sched_switch() at sched_switch+0x942/frame 0xfffffe000045c920 mi_switch() at mi_switch+0x178/frame 0xfffffe000045c950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000045c990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000045c9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe000045ca40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000045ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe000045cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000045cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffff8000371c000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000461920 mi_switch() at mi_switch+0x178/frame 0xfffffe0000461950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000461990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004619c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe0000461a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000461a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000461ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000461ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffff80003718580 sched_switch() at sched_switch+0x942/frame 0xfffffe0000466920 mi_switch() at mi_switch+0x178/frame 0xfffffe0000466950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000466990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004669c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe0000466a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000466a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000466ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000466ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffff80003718000 sched_switch() at sched_switch+0x942/frame 0xfffffe000046b920 mi_switch() at mi_switch+0x178/frame 0xfffffe000046b950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000046b990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000046b9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe000046ba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000046ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000046bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000046bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffff80003786580 sched_switch() at sched_switch+0x942/frame 0xfffffe0000470920 mi_switch() at mi_switch+0x178/frame 0xfffffe0000470950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000470990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004709c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe0000470a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000470a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000470ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000470ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffff80003797000 sched_switch() at sched_switch+0x942/frame 0xfffffe000051b900 mi_switch() at mi_switch+0x178/frame 0xfffffe000051b930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000051b970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000051b9a0 _sleep() at _sleep+0x3a9/frame 0xfffffe000051ba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe000051ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000051bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000051bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xfffff80003836000 sched_switch() at sched_switch+0x942/frame 0xfffffe000052f900 mi_switch() at mi_switch+0x178/frame 0xfffffe000052f930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000052f970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000052f9a0 _sleep() at _sleep+0x3a9/frame 0xfffffe000052fa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe000052fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000052fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000052fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff80003835580 sched_switch() at sched_switch+0x942/frame 0xfffffe0000534900 mi_switch() at mi_switch+0x178/frame 0xfffffe0000534930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000534970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005349a0 _sleep() at _sleep+0x3a9/frame 0xfffffe0000534a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000534a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000534ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000534ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff80003835000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000539900 mi_switch() at mi_switch+0x178/frame 0xfffffe0000539930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000539970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005399a0 _sleep() at _sleep+0x3a9/frame 0xfffffe0000539a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000539a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000539ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000539ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff80003834580 sched_switch() at sched_switch+0x942/frame 0xfffffe000053e900 mi_switch() at mi_switch+0x178/frame 0xfffffe000053e930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000053e970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000053e9a0 _sleep() at _sleep+0x3a9/frame 0xfffffe000053ea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe000053ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000053eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000053eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffff80003834000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000543900 mi_switch() at mi_switch+0x178/frame 0xfffffe0000543930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000543970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005439a0 _sleep() at _sleep+0x3a9/frame 0xfffffe0000543a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000543a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000543ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000543ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff80003833580 sched_switch() at sched_switch+0x942/frame 0xfffffe0000548900 mi_switch() at mi_switch+0x178/frame 0xfffffe0000548930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000548970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005489a0 _sleep() at _sleep+0x3a9/frame 0xfffffe0000548a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000548a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000548ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000548ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff80003833000 sched_switch() at sched_switch+0x942/frame 0xfffffe000054d900 mi_switch() at mi_switch+0x178/frame 0xfffffe000054d930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000054d970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000054d9a0 _sleep() at _sleep+0x3a9/frame 0xfffffe000054da40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe000054da70 fork_exit() at fork_exit+0x84/frame 0xfffffe000054dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000054dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffff8000379a580 sched_switch() at sched_switch+0x942/frame 0xfffffe0000552900 mi_switch() at mi_switch+0x178/frame 0xfffffe0000552930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000552970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005529a0 _sleep() at _sleep+0x3a9/frame 0xfffffe0000552a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000552a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000552ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000552ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffff800038a2000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000557900 mi_switch() at mi_switch+0x178/frame 0xfffffe0000557930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000557970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005579a0 _sleep() at _sleep+0x3a9/frame 0xfffffe0000557a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000557a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000557ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000557ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffff800038a1580 sched_switch() at sched_switch+0x942/frame 0xfffffe000055c900 mi_switch() at mi_switch+0x178/frame 0xfffffe000055c930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000055c970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000055c9a0 _sleep() at _sleep+0x3a9/frame 0xfffffe000055ca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe000055ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe000055cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000055cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffff800038a1000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000561900 mi_switch() at mi_switch+0x178/frame 0xfffffe0000561930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000561970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005619a0 _sleep() at _sleep+0x3a9/frame 0xfffffe0000561a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000561a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000561ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000561ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffff800038a0580 sched_switch() at sched_switch+0x942/frame 0xfffffe0000566900 mi_switch() at mi_switch+0x178/frame 0xfffffe0000566930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000566970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005669a0 _sleep() at _sleep+0x3a9/frame 0xfffffe0000566a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000566a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000566ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000566ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100113 td 0xfffff8012c073000 sched_switch() at sched_switch+0x942/frame 0xfffffe009d03a920 mi_switch() at mi_switch+0x178/frame 0xfffffe009d03a950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d03a990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe009d03a9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe009d03aa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe009d03aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d03aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d03aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100120 td 0xfffff8012d19c580 sched_switch() at sched_switch+0x942/frame 0xfffffe009d075920 mi_switch() at mi_switch+0x178/frame 0xfffffe009d075950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d075990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe009d0759c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe009d075a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe009d075a70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d075ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d075ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffff8012d19c000 sched_switch() at sched_switch+0x942/frame 0xfffffe009d07a920 mi_switch() at mi_switch+0x178/frame 0xfffffe009d07a950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d07a990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe009d07a9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe009d07aa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe009d07aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d07aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d07aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffff8012d19b580 sched_switch() at sched_switch+0x942/frame 0xfffffe009d07f920 mi_switch() at mi_switch+0x178/frame 0xfffffe009d07f950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d07f990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe009d07f9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1c2/frame 0xfffffe009d07fa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe009d07fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d07fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d07fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100123 td 0xfffff8012d19b000 sched_switch() at sched_switch+0x942/frame 0xfffffe009d084900 mi_switch() at mi_switch+0x178/frame 0xfffffe009d084930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe009d084970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe009d0849a0 _sleep() at _sleep+0x3a9/frame 0xfffffe009d084a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe009d084a70 fork_exit() at fork_exit+0x84/frame 0xfffffe009d084ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d084ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> dump Dumping 1894 out of 32621 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db> reset (kgdb) proc 89592 [Switching to thread 195 (Thread 100442)]#0 sched_switch (td=0xfffff8023c4c5000, newtd=0xfffff8000365e000, flags=) at ../../../kern/sched_ule.c:2112 2112 cpuid = PCPU_GET(cpuid); Current language: auto; currently minimal (kgdb) bt #0 sched_switch (td=0xfffff8023c4c5000, newtd=0xfffff8000365e000, flags=) at ../../../kern/sched_ule.c:2112 #1 0xffffffff80ba5c58 in mi_switch (flags=0x104, newtd=0x0) at ../../../kern/kern_synch.c:439 #2 0xffffffff80bf331d in sleepq_switch (wchan=0xfffff8012d6fccd0, pri=0x54) at ../../../kern/subr_sleepqueue.c:613 #3 0xffffffff80bf3a70 in sleepq_timedwait (wchan=0xfffff8012d6fccd0, pri=0x54) at ../../../kern/subr_sleepqueue.c:727 #4 0xffffffff80ba549d in _sleep (ident=0x0, lock=, priority=, wmesg=0xffffffff8125e9d1 "softdeps", sbt=, pr=0x0, flags=0x100) at ../../../kern/kern_synch.c:213 #5 0xffffffff80eaec99 in softdep_waitidle (mp=0xfffff8023c19b000, flags=0x0) at ../../../ufs/ffs/ffs_softdep.c:1942 #6 0xffffffff80eae93e in softdep_flushfiles (oldmnt=0xfffff8023c19b000, flags=0x0, td=0xfffff8023c4c5000) at ../../../ufs/ffs/ffs_softdep.c:2014 #7 0xffffffff80edf10b in ffs_unmount (mp=0xfffff8023c19b000, mntflags=0x8000000) at ../../../ufs/ffs/ffs_vfsops.c:1229 #8 0xffffffff80c6b5e9 in dounmount (mp=, flags=0x8000000, td=0xfffff8023c4c5000) at ../../../kern/vfs_mount.c:1438 #9 0xffffffff80c6b040 in sys_unmount (td=0xfffff8023c4c5000, uap=0xfffff8023c4c53c0) at ../../../kern/vfs_mount.c:1281 #10 0xffffffff810a493c in amd64_syscall (td=0xfffff8023c4c5000, traced=0x0) at subr_syscall.c:135 #11 0xffffffff8107e13d in fast_syscall_common () at ../../../amd64/amd64/exception.S:504 #12 0x00000008002d695a in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb) f 5 #5 0xffffffff80eaec99 in softdep_waitidle (mp=0xfffff8023c19b000, flags=0x0) at ../../../ufs/ffs/ffs_softdep.c:1942 1942 msleep(&ump->softdep_deps, LOCK_PTR(ump), PVM | PDROP, (kgdb) l 1937 for (i = 0; i < SU_WAITIDLE_RETRIES && ump->softdep_deps != 0; i++) { 1938 ump->softdep_req = 1; 1939 KASSERT((flags & FORCECLOSE) == 0 || 1940 ump->softdep_on_worklist == 0, 1941 ("softdep_waitidle: work added after flush")); 1942 msleep(&ump->softdep_deps, LOCK_PTR(ump), PVM | PDROP, 1943 "softdeps", 10 * hz); 1944 vn_lock(devvp, LK_EXCLUSIVE | LK_RETRY); 1945 error = VOP_FSYNC(devvp, MNT_WAIT, td); 1946 VOP_UNLOCK(devvp, 0); (kgdb) info loc ump = (struct ufsmount *) 0xfffff8023c1f3800 devvp = (struct vnode *) 0xfffff80148b97768 td = (struct thread *) 0xfffff8023c4c5000 error = 0x0 i = 0xd (kgdb) p *ump $1 = {um_mountp = 0xfffff8023c19b000, um_dev = 0xfffff8012d24cc00, um_cp = 0xfffff8012d51a700, um_bo = 0xfffff80148b978d0, um_devvp = 0xfffff80148b97768, um_fstype = 0x2, um_fs = 0xfffffe00a79dc000, um_extattr = { uepm_lock = {lock_object = {lo_name = 0xffffffff8123f60c "ufs_extattr_sx", lo_flags = 0x2330000, lo_data = 0x0, lo_witness = 0xfffff8087fd78400}, sx_lock = 0x1}, uepm_list = {lh_first = 0x0}, uepm_ucred = 0x0, uepm_flags = 0x1}, um_nindir = 0x1000, um_bptrtodb = 0x3, um_seqinc = 0x8, um_lock = {lock_object = {lo_name = 0xffffffff8125453a "FFS", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd78380}, mtx_lock = 0x0}, um_fsckpid = 0x0, um_softdep = 0xfffff8012d6fcc00, um_quotas = 0xfffff8023c1f38b8, um_cred = 0xfffff8023c1f38c8, um_btime = 0xfffff8023c1f38d8, um_itime = 0xfffff8023c1f38e8, um_qflags = 0xfffff8023c1f38f8 "", um_savedmaxfilesize = 0x0, um_flags = 0x0, um_trim_inflight = 0x0, um_trim_tq = 0x0, um_trimhash = 0x0, um_trimlisthashsize = 0x0, um_balloc = 0xffffffff80e9d0c0 , um_blkatoff = 0xffffffff80eda7c0 , um_truncate = 0xffffffff80ea0590 , um_update = 0xffffffff80e9fcf0 , um_valloc = 0xffffffff80e93b60 , um_vfree = 0xffffffff80e95190 , um_ifree = 0xffffffff80ee15d0 , um_rdonly = 0xffffffff80ea3460 , um_snapgone = 0xffffffff80ea9760 } (kgdb) p *devvp $2 = {v_tag = 0xffffffff8123c562 "devfs", v_op = 0xffffffff81af74a0, v_data = 0xfffff8012ddac500, v_mount = 0xfffff8012d4bc000, v_nmntvnodes = {tqe_next = 0x0, tqe_prev = 0xfffff801488eba00}, { v_mountedhere = 0xfffff8012d24cc00, v_unpcb = 0xfffff8012d24cc00, v_rdev = 0xfffff8012d24cc00, v_fifoinfo = 0xfffff8012d24cc00}, v_hashlist = {le_next = 0x0, le_prev = 0xfffffe009dba18f0}, v_cache_src = { lh_first = 0x0}, v_cache_dst = {tqh_first = 0x0, tqh_last = 0xfffff80148b977b8}, v_cache_dd = 0x0, v_lock = {lock_object = {lo_name = 0xffffffff8123c562 "devfs", lo_flags = 0x6fb0000, lo_data = 0x0, lo_witness = 0xfffff8087fd78280}, lk_lock = 0x1, lk_exslpfail = 0x0, lk_timo = 0x33, lk_pri = 0x60, lk_stack = {depth = 0xa, pcs = 0xfffff80148b97808}}, v_interlock = {lock_object = { lo_name = 0xffffffff813773f8 "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd6b680}, mtx_lock = 0x0}, v_vnlock = 0xfffff80148b977d0, v_actfreelist = {tqe_next = 0xfffff80148d3a278, tqe_prev = 0xfffff8012d4bca38}, v_bufobj = {bo_lock = {lock_object = {lo_name = 0xffffffff813384f3 "bufobj interlock", lo_flags = 0x5230000, lo_data = 0x0, lo_witness = 0xfffff8087fd75500}, rw_lock = 0x1}, bo_ops = 0xffffffff81b62658, bo_object = 0xfffff8023c0b3200, bo_synclist = {le_next = 0x0, le_prev = 0xfffff8012c0f1190}, bo_private = 0xfffff8012d51a700, bo_clean = {bv_hd = {tqh_first = 0xfffffe0001e15608, tqh_last = 0xfffffe0005d91040}, bv_root = {pt_root = 0xfffff8012d038d80}, bv_cnt = 0x2b9}, bo_dirty = {bv_hd = {tqh_first = 0x0, tqh_last = 0xfffff80148b97938}, bv_root = {pt_root = 0x0}, bv_cnt = 0x0}, bo_numoutput = 0x0, bo_flag = 0x0, bo_domain = 0x4, bo_bsize = 0x200}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0, v_rl = {rl_waiters = {tqh_first = 0x0, tqh_last = 0xfffff80148b97988}, rl_currdep = 0x0}, v_cstart = 0x0, v_lasta = 0x0, v_lastw = 0x0, v_clen = 0x0, v_holdcnt = 0x2bb, v_usecount = 0x1, v_iflag = 0x200, v_vflag = 0x0, v_mflag = 0x0, v_writecount = 0x0, v_hash = 0xa45cbb, v_type = VCHR} (kgdb) p *mp $3 = {mnt_mtx = {lock_object = {lo_name = 0xffffffff81232f84 "struct mount mtx", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd6bc00}, mtx_lock = 0x0}, mnt_gen = 0x1, mnt_list = {tqe_next = 0x0, tqe_prev = 0xfffff8023c1a4028}, mnt_op = 0xffffffff81b62440, mnt_vfc = 0xffffffff81b62558, mnt_vnodecovered = 0xfffff8023c1889e0, mnt_syncer = 0x0, mnt_ref = 0x1, mnt_nvnodelist = {tqh_first = 0x0, tqh_last = 0xfffff8023c19b060}, mnt_nvnodelistsize = 0x0, mnt_writeopcount = 0x1, mnt_kern_flag = 0x4180614c, mnt_flag = 0x100001000, mnt_opt = 0xfffff8023c209270, mnt_optnew = 0x0, mnt_maxsymlinklen = 0x78, mnt_stat = {f_version = 0x20140518, f_type = 0x35, f_flags = 0x100001000, f_bsize = 0x1000, f_iosize = 0x8000, f_blocks = 0x7bfa5, f_bfree = 0x7af58, f_bavail = 0x710a7, f_files = 0x3fffe, f_ffree = 0x3fbe3, f_syncwrites = 0x2cc819, f_asyncwrites = 0x37ede8, f_syncreads = 0x7b0, f_asyncreads = 0x3864, f_spare = 0xfffff8023c19b108, f_namemax = 0xff, f_owner = 0x0, f_fsid = {val = 0xfffff8023c19b160}, f_charspare = 0xfffff8023c19b168 "", f_fstypename = 0xfffff8023c19b1b8 "ufs", f_mntfromname = 0xfffff8023c19b1c8 "/dev/md11a", f_mntonname = 0xfffff8023c19b5c8 "/mnt11"}, mnt_cred = 0xfffff8012dae0700, mnt_data = 0xfffff8023c1f3800, mnt_time = 0x0, mnt_iosize_max = 0x20000, mnt_export = 0x0, mnt_label = 0x0, mnt_hashseed = 0xe6443e8c, mnt_lockref = 0x0, mnt_secondary_writes = 0x0, mnt_secondary_accwrites = 0x2ccfde9, mnt_susp_owner = 0x0, mnt_gjprovider = 0x0, mnt_listmtx = {lock_object = {lo_name = 0xffffffff812ba645 "struct mount vlist mtx", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd78180}, mtx_lock = 0x0}, mnt_activevnodelist = {tqh_first = 0x0, tqh_last = 0xfffff8023c19ba38}, mnt_activevnodelistsize = 0x0, mnt_tmpfreevnodelist = {tqh_first = 0x0, tqh_last = 0xfffff8023c19ba50}, mnt_tmpfreevnodelistsize = 0x0, mnt_explock = {lock_object = {lo_name = 0xffffffff812ec9e5 "explock", lo_flags = 0x6730000, lo_data = 0x0, lo_witness = 0xfffff8087fd76200}, lk_lock = 0x1, lk_exslpfail = 0x0, lk_timo = 0x0, lk_pri = 0x60, lk_stack = { depth = 0x0, pcs = 0xfffff8023c19baa0}}, mnt_upper_link = {tqe_next = 0x0, tqe_prev = 0x0}, mnt_uppers = {tqh_first = 0x0, tqh_last = 0xfffff8023c19bb40}} (kgdb) p *ump->um_softdep $4 = {sd_fslock = {lock_object = {lo_name = 0xffffffff812e56d7 "Per-Filesystem Softdep Lock", lo_flags = 0x5230000, lo_data = 0x0, lo_witness = 0xfffff8087fd78700}, rw_lock = 0x1}, sd_workitem_pending = {lh_first = 0x0}, sd_worklist_tail = 0xfffff8012d6fcc20, sd_journal_pending = {lh_first = 0x0}, sd_journal_tail = 0xfffff8012d6fcc30, sd_jblocks = 0xfffff8012d30fd80, sd_unlinked = {tqh_first = 0x0, tqh_last = 0xfffff8012d6fcc48}, sd_dirtycg = {lh_first = 0x0}, sd_mkdirlisthd = {lh_first = 0x0}, sd_pdhash = 0xfffffe00a7a80000, sd_pdhashsize = 0xffff, sd_pdnextclean = 0x0, sd_idhash = 0xfffffe00a8c00000, sd_idhashsize = 0x7ffff, sd_idnextclean = 0x2bca7, sd_newblkhash = 0xfffffe00a9000000, sd_newblkhashsize = 0xfffff, sd_bmhash = 0xfffffe00a79e0000, sd_bmhashsize = 0x3ff, sd_indirhash = 0xfffff8023c2091e0, sd_indirhashsize = 0x0, sd_on_journal = 0x0, sd_on_worklist = 0x0, sd_deps = 0x2, sd_accdeps = 0x38d3ecd, sd_req = 0x1, sd_flags = 0x0, sd_cleanups = 0x0, sd_flushtd = 0xfffff8012d877000, sd_next = {tqe_next = 0x0, tqe_prev = 0xfffff8012d67d6f0}, sd_ump = 0xfffff8023c1f3800, sd_curdeps = 0xfffff8012d6fcd08} (kgdb) -- Test scenario: misc/pfl2.sh