swappoff(8) is looping, vmcore.56 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2019 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #1 r349536M: Sat Jun 29 11:54:13 CEST 2019 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 8.0.1 (branches/release_80 363030) (based on LLVM 8.0.1) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Entering uma_startup with 10 boot pages configured startup_alloc from "UMA Kegs", 8 boot pages left startup_alloc from "UMA Zones", 7 boot pages left startup_alloc from "UMA Zones", 6 boot pages left startup_alloc from "UMA Zones", 5 boot pages left startup_alloc from "UMA Zones", 4 boot pages left startup_alloc from "UMA Zones", 3 boot pages left startup_alloc from "UMA Hash", 2 boot pages left startup_alloc from "UMA Zones", 1 boot pages left Entering uma_startup1 with 0 boot pages left Entering uma_startup2 with 0 boot pages left VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.06-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33182707712 (31645 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: unblocking device. ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-47 on motherboard Launching APs: 1 6 2 4 11 7 8 3 10 5 9 Timecounter "TSC-low" frequency 1750032336 Hz quality 1000 random: entropy device external interface kbd1 at kbdmux0 module_register_init: MOD_LOAD (vesa, 0xffffffff81127290, 0) error 19 random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" 000.000055 [4254] netmap_init netmap: loaded module [ath_hal] loaded nexus0 vtvga0: on motherboard cryptosoft0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: Using 6 RX queues 6 TX queues igb0: UAutoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8802 metric 0 mtu 1500 options=e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko ums0 on uhub4 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff800039ae000 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 29 Jun 11:59:34 ntpdate[2051]: step time server 192.168.5.1 offset 112.995420 sec Starting rpcbind. NFS access cache time=60 Starting watchdogd. No core dumps found. lock order reversal: 1st 0xfffffe000088e028 bufwait (bufwait) @ kern/vfs_bio.c:3904 2nd 0xfffff8000aee9400 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:289 stack backtrace: #0 0xffffffff80c37a33 at witness_debugger+0x73 #1 0xffffffff80c3777d at witness_checkorder+0xa7d #2 0xffffffff80bd6338 at _sx_xlock+0x68 #3 0xffffffff80ee1ded at ufsdirhash_add+0x4d #4 0xffffffff80ee6786 at ufs_direnter+0x446 #5 0xffffffff80eee999 at ufs_mkdir+0x8c9 #6 0xffffffff812279dc at VOP_MKDIR_APV+0x8c #7 0xffffffff80cb0c93 at kern_mkdirat+0x1b3 #8 0xffffffff810a1b51 at amd64_syscall+0x291 #9 0xffffffff8107982d at fast_syscall_common+0x101 Clearing /tmp (X related). Starting statd. Starting lockd. fscklock order reversal: 1st 0xfffff8000aadf068 ufs (ufs) @ kern/vfs_subr.c:2687 2nd 0xfffffe000088dc50 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:283 3rd 0xfffff801340e4cc0 ufs (ufs) @ kern/vfs_subr.c:2687 stack backtrace: #0 0xffffffff80c37a33 at witness_debugger+0x73 #1 0xffffffff80c3777d at witness_checkorder+0xa7d #2 0xffffffff80ba02fb at lockmgr_xlock_hard+0x6b #3 0xffffffff80ba0d6e at __lockmgr_args+0x5fe #4 0xffffffff80edc78c at ffs_lock+0x7c #5 0xffffffff81228530 at VOP_LOCK1_APV+0x70 #6 0xffffffff80cb4195 at _vn_lock+0x65 #7 0xffffffff80ca2056 at vget+0xa6 #8 0xffffffff80c93e0c at vfs_hash_get+0xcc #9 0xffffffff80ed800f at ffs_vgetf+0x3f #10 0xffffffff80ecd33f at softdep_sync_buf+0x56f #11 0xffffffff80edd5a4 at ffs_syncvnode+0x234 #12 0xffffffff80edad4d at ffs_sync+0x20d #13 0xffffffff80c9a75f at dounmount+0x4bf #14 0xffffffff80c9a200 at sys_unmount+0x300 #15 0xffffffff810a1b51 at amd64_syscall+0x291 #16 0xffffffff8107982d at fast_syscall_common+0x101 lock order reversal: 1st 0xfffff8000ae27a48 ufs (ufs) @ kern/vfs_mount.c:1354 2nd 0xfffff8000aadf2e0 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1926 stack backtrace: #0 0xffffffff80c37a33 at witness_debugger+0x73 #1 0xffffffff80c3777d at witness_checkorder+0xa7d #2 0xffffffff80b9fdfb at lockmgr_lock_fast_path+0x16b #3 0xffffffff81228530 at VOP_LOCK1_APV+0x70 #4 0xffffffff80cb4195 at _vn_lock+0x65 #5 0xffffffff80eba10d at softdep_flushworklist+0x5d #6 0xffffffff80edaf46 at ffs_sync+0x406 #7 0xffffffff80c9a75f at dounmount+0x4bf #8 0xffffffff80c9a200 at sys_unmount+0x300 #9 0xffffffff810a1b51 at amd64_syscall+0x291 #10 0xffffffff8107982d at fast_syscall_common+0x101 ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 202 files, 9015 used, 1256392 free (96 frags, 157037 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** Updating motd:. Mounting late filesystems:. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Sat Jun 29 11:59 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root Jun 29 11:59:41 mercat1 login[2331]: ROOT LOGIN (root) ON ttyu1 Last login: Thu Jun 27 07:24:30 on ttyu1 FreeBSD 13.0-CURRENT (PHO) #1 r349536M: Sat Jun 29 11:54:13 CEST 2019 root@mercat1:~ # Jun 29 11:59:50 mercat1 su[2345]: pho to root on /dev/pts/0 20190629 12:00:43 all (1/10): callout_reset_on.sh Expensive timeout(9) function: 0xffffffff80be4220(0xfffff80134cbb530) 0.011737292 s 20190629 12:03:33 all (2/10): callout_reset_on2.sh Expensive timeout(9) function: 0xffffffff80df9690(0xfffff80163659b70) 4.951231842 s Expensive timeout(9) function: 0xffffffff80df9690(0xfffff80163bce3d0) 63.572755735 s 20190629 12:13:35 all (3/10): swap.sh 20190629 12:19:52 all (4/10): swap2.sh 20190629 12:26:20 all (5/10): swap5.sh procstat -k 61295 PID TID COMM TDNAME KSTACK 61295 100434 swapoff - swap_pager_swapoff swapoff_one sys_swapoff amd64_syscall fast_syscall_common root@mercat1:~ # ps -lp61295 UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 0 61295 61285 0 72 0 10936 2560 - R+ 0 83:15.55 swapoff -a root@mercat1:~ # procstat -k 61295 PID TID COMM TDNAME KSTACK 61295 100434 swapoff - swap_pager_swapoff_object swap_pager_swapoff swapoff_one sys_swapoff amd64_syscall fast_syscall_common root@mercat1:~ # procstat -k 61295 PID TID COMM TDNAME KSTACK 61295 100434 swapoff - swap_pager_swapoff_object swap_pager_swapoff swapoff_one sys_swapoff amd64_syscall fast_syscall_common root@mercat1:~ # procstat -k 61295 PID TID COMM TDNAME KSTACK 61295 100434 swapoff - SWAP_PCTRIE_LOOKUP_GE swap_pager_swapoff_object swap_pager_swapoff swapoff_one sys_swapoff amd64_syscall fast_syscall_common root@mercat1:~ # procstat -k 61295 PID TID COMM TDNAME KSTACK 61295 100434 swapoff - swap_pager_swapoff_object swap_pager_swapoff swapoff_one sys_swapoff amd64_syscall fast_syscall_common root@mercat1:~ # root@mercat1:~ # KDB: enter: Break to debugger [ thread pid 11 tid 100003 ] Stopped at kdb_alt_break_internal+0x106: movq $0,kdb_why db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> bt Tracing pid 11 tid 100003 td 0xfffff800036c4000 kdb_alt_break_internal() at kdb_alt_break_internal+0x106/frame 0xfffffe0076766710 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe0076766720 uart_intr_rxready() at uart_intr_rxready+0x9a/frame 0xfffffe0076766750 uart_intr() at uart_intr+0x138/frame 0xfffffe0076766790 intr_event_handle() at intr_event_handle+0xb5/frame 0xfffffe00767667e0 intr_execute_handlers() at intr_execute_handlers+0x57/frame 0xfffffe0076766810 lapic_handle_intr() at lapic_handle_intr+0x5f/frame 0xfffffe0076766830 Xapic_isr1() at Xapic_isr1+0xd9/frame 0xfffffe0076766830 --- interrupt, rip = 0xffffffff8120a926, rsp = 0xfffffe0076766900, rbp = 0xfffffe0076766900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076766900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076766950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076766970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076766990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076766a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076766ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076766ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:1:pho1> show allpcpu Current CPU: 0 cpuid = 0 dynamic pcpu = 0xd60800 curthread = 0xfffff800036c4000: pid 11 tid 100003 "idle: cpu0" curpcb = 0xfffffe0076766b80 fpcurthread = none idlethread = 0xfffff800036c4000: tid 100003 "idle: cpu0" curpmap = 0xffffffff82086db0 tssp = 0xffffffff821be4a0 commontssp = 0xffffffff821be4a0 rsp0 = 0xfffffe0076766b80 gs32p = 0xffffffff821c50d8 ldt = 0xffffffff821c5118 tss = 0xffffffff821c5108 tlb gen = 410660 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe0084fea800 curthread = 0xfffff800036c35a0: pid 11 tid 100004 "idle: cpu1" curpcb = 0xfffffe007676bb80 fpcurthread = none idlethread = 0xfffff800036c35a0: tid 100004 "idle: cpu1" curpmap = 0xffffffff82086db0 tssp = 0xffffffff821be508 commontssp = 0xffffffff821be508 rsp0 = 0xfffffe007676bb80 gs32p = 0xffffffff821c5140 ldt = 0xffffffff821c5180 tss = 0xffffffff821c5170 tlb gen = 410660 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe0084ff6800 curthread = 0xfffff800036c3000: pid 11 tid 100005 "idle: cpu2" curpcb = 0xfffffe0076770b80 fpcurthread = none idlethread = 0xfffff800036c3000: tid 100005 "idle: cpu2" curpmap = 0xffffffff82086db0 tssp = 0xffffffff821be570 commontssp = 0xffffffff821be570 rsp0 = 0xfffffe0076770b80 gs32p = 0xffffffff821c51a8 ldt = 0xffffffff821c51e8 tss = 0xffffffff821c51d8 tlb gen = 410657 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe0085002800 curthread = 0xfffff800036c25a0: pid 11 tid 100006 "idle: cpu3" curpcb = 0xfffffe0076775b80 fpcurthread = none idlethread = 0xfffff800036c25a0: tid 100006 "idle: cpu3" curpmap = 0xffffffff82086db0 tssp = 0xffffffff821be5d8 commontssp = 0xffffffff821be5d8 rsp0 = 0xfffffe0076775b80 gs32p = 0xffffffff821c5210 ldt = 0xffffffff821c5250 tss = 0xffffffff821c5240 tlb gen = 410660 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe008500e800 curthread = 0xfffff800036c2000: pid 11 tid 100007 "idle: cpu4" curpcb = 0xfffffe007677ab80 fpcurthread = none idlethread = 0xfffff800036c2000: tid 100007 "idle: cpu4" curpmap = 0xffffffff82086db0 tssp = 0xffffffff821be640 commontssp = 0xffffffff821be640 rsp0 = 0xfffffe007677ab80 gs32p = 0xffffffff821c5278 ldt = 0xffffffff821c52b8 tss = 0xffffffff821c52a8 tlb gen = 410660 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe008501a800 curthread = 0xfffff800036c15a0: pid 11 tid 100008 "idle: cpu5" curpcb = 0xfffffe007677fb80 fpcurthread = none idlethread = 0xfffff800036c15a0: tid 100008 "idle: cpu5" curpmap = 0xffffffff82086db0 tssp = 0xffffffff821be6a8 commontssp = 0xffffffff821be6a8 rsp0 = 0xfffffe007677fb80 gs32p = 0xffffffff821c52e0 ldt = 0xffffffff821c5320 tss = 0xffffffff821c5310 tlb gen = 410660 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe0085026800 curthread = 0xfffff800036c1000: pid 11 tid 100009 "idle: cpu6" curpcb = 0xfffffe0076784b80 fpcurthread = none idlethread = 0xfffff800036c1000: tid 100009 "idle: cpu6" curpmap = 0xffffffff82086db0 tssp = 0xffffffff821be710 commontssp = 0xffffffff821be710 rsp0 = 0xfffffe0076784b80 gs32p = 0xffffffff821c5348 ldt = 0xffffffff821c5388 tss = 0xffffffff821c5378 tlb gen = 410660 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe0085032800 curthread = 0xfffff800036d55a0: pid 11 tid 100010 "idle: cpu7" curpcb = 0xfffffe0076789b80 fpcurthread = none idlethread = 0xfffff800036d55a0: tid 100010 "idle: cpu7" curpmap = 0xffffffff82086db0 tssp = 0xffffffff821be778 commontssp = 0xffffffff821be778 rsp0 = 0xfffffe0076789b80 gs32p = 0xffffffff821c53b0 ldt = 0xffffffff821c53f0 tss = 0xffffffff821c53e0 tlb gen = 410660 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe008503e800 curthread = 0xfffff800036d5000: pid 11 tid 100011 "idle: cpu8" curpcb = 0xfffffe007678eb80 fpcurthread = none idlethread = 0xfffff800036d5000: tid 100011 "idle: cpu8" curpmap = 0xffffffff82086db0 tssp = 0xffffffff821be7e0 commontssp = 0xffffffff821be7e0 rsp0 = 0xfffffe007678eb80 gs32p = 0xffffffff821c5418 ldt = 0xffffffff821c5458 tss = 0xffffffff821c5448 tlb gen = 410660 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe008504a800 curthread = 0xfffff800036d45a0: pid 11 tid 100012 "idle: cpu9" curpcb = 0xfffffe0076793b80 fpcurthread = none idlethread = 0xfffff800036d45a0: tid 100012 "idle: cpu9" curpmap = 0xffffffff82086db0 tssp = 0xffffffff821be848 commontssp = 0xffffffff821be848 rsp0 = 0xfffffe0076793b80 gs32p = 0xffffffff821c5480 ldt = 0xffffffff821c54c0 tss = 0xffffffff821c54b0 tlb gen = 410660 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe0085056800 curthread = 0xfffff800036d4000: pid 11 tid 100013 "idle: cpu10" curpcb = 0xfffffe0076798b80 fpcurthread = none idlethread = 0xfffff800036d4000: tid 100013 "idle: cpu10" curpmap = 0xffffffff82086db0 tssp = 0xffffffff821be8b0 commontssp = 0xffffffff821be8b0 rsp0 = 0xfffffe0076798b80 gs32p = 0xffffffff821c54e8 ldt = 0xffffffff821c5528 tss = 0xffffffff821c5518 tlb gen = 410660 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe0085062800 curthread = 0xfffff801d3538000: pid 61295 tid 100434 "swapoff" curpcb = 0xfffffe00ac92eb80 fpcurthread = 0xfffff801d3538000: pid 61295 "swapoff" idlethread = 0xfffff800036d35a0: tid 100014 "idle: cpu11" curpmap = 0xfffff80276ba6130 tssp = 0xffffffff821be918 commontssp = 0xffffffff821be918 rsp0 = 0xfffffe00ac92eb80 gs32p = 0xffffffff821c5550 ldt = 0xffffffff821c5590 tss = 0xffffffff821c5580 tlb gen = 410660 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 61295 (swapoff) thread 0xfffff801d3538000 (100434) exclusive rw vm object (vm object) r = 0 (0xfffff80003677a00) locked @ vm/swap_pager.c:1787 exclusive sx swsysc (swsysc) r = 0 (0xffffffff820497f8) locked @ vm/swap_pager.c:2348 db:1:pho1> show lockedvnods Locked vnodes db:1:pho1> show allchains chain 1: thread 100366 (pid 55272, sleep) sleeping on 0xffffffff81e8f0b8 "nanslp" chain 2: thread 100450 (pid 46747, bash) sleeping on 0xfffff806e10af940 "select" chain 3: thread 100398 (pid 46746, sshd) sleeping on 0xfffff80578644940 "select" chain 4: thread 100233 (pid 46743, sshd) sleeping on 0xfffff8006a2586c0 "select" chain 5: thread 100147 (pid 61285, sh) sleeping on 0xfffff8000a28da60 "wait" chain 6: thread 100616 (pid 61284, tee) sleeping on 0xfffff80250fdfbe0 "piperd" chain 7: thread 100478 (pid 61283, sh) sleeping on 0xfffff801d38b1000 "wait" chain 8: thread 100237 (pid 2525, sh) sleeping on 0xfffff80019744000 "piperd" chain 9: thread 100236 (pid 2523, awk) sleeping on 0xfffff800191245f0 "piperd" chain 10: thread 100235 (pid 2522, sh) sleeping on 0xfffff80019127530 "wait" chain 11: thread 100199 (pid 2464, sh) sleeping on 0xfffff80019128000 "wait" chain 12: thread 100156 (pid 2360, sh) sleeping on 0xfffff8000a392530 "wait" chain 13: thread 100173 (pid 2347, bash) sleeping on 0xfffff8000a9e9a60 "wait" chain 14: thread 100164 (pid 2345, csh) sleeping on 0xfffff80019129b08 "pause" chain 15: thread 100215 (pid 2344, su) sleeping on 0xfffff80134cbca60 "wait" chain 16: thread 100170 (pid 2340, bash) sleeping on 0xfffff8000acfd530 "wait" chain 17: thread 100154 (pid 2339, sshd) sleeping on 0xfffff8000ad88c40 "select" chain 18: thread 100159 (pid 2336, sshd) sleeping on 0xfffff80003db3240 "select" chain 19: thread 100152 (pid 2332, csh) sleeping on 0xfffff800060cf0b0 "ttyin" chain 20: thread 100148 (pid 2331, login) sleeping on 0xfffff8000a28d530 "wait" chain 21: thread 100161 (pid 2330, getty) sleeping on 0xfffff800060cf4b0 "ttyin" chain 22: thread 100166 (pid 2329, getty) sleeping on 0xfffff8000a5950b0 "ttyin" chain 23: thread 100213 (pid 2328, getty) sleeping on 0xfffff8000a5954b0 "ttyin" chain 24: thread 100212 (pid 2327, getty) sleeping on 0xfffff8000a5958b0 "ttyin" chain 25: thread 100211 (pid 2326, getty) sleeping on 0xfffff8000a595cb0 "ttyin" chain 26: thread 100189 (pid 2325, getty) sleeping on 0xfffff8000a5960b0 "ttyin" chain 27: thread 100192 (pid 2324, getty) sleeping on 0xfffff8000a5964b0 "ttyin" chain 28: thread 100165 (pid 2323, getty) sleeping on 0xfffff8000a5968b0 "ttyin" chain 29: thread 100142 (pid 2322, getty) sleeping on 0xfffff8000a596cb0 "ttyin" chain 30: thread 100174 (pid 2276, cron) sleeping on 0xffffffff81e8f0b7 "nanslp" chain 31: thread 100204 (pid 2272, sshd) sleeping on 0xfffff80003db32c0 "select" chain 32: thread 100151 (pid 2243, ntpd) sleeping on 0xfffff80003db3340 "select" chain 33: thread 101001 (pid 2243, ntpd) sleeping on 0xfffff80003fd2580 "usem" chain 34: thread 100198 (pid 2182, NLM: master) sleeping on 0xfffff80003f95660 "rpcsvc" chain 35: thread 100196 (pid 2179, rpc.statd) sleeping on 0xfffff8000ae34ec0 "select" chain 36: thread 100194 (pid 2133, watchdogd) sleeping on 0xffffffff81e8f0b0 "nanslp" chain 37: thread 100150 (pid 2054, rpcbind) sleeping on 0xfffff80003fdf840 "select" chain 38: thread 100195 (pid 2044, syslogd) sleeping on 0xfffff800031319c0 "select" chain 39: thread 100177 (pid 1973, devd) sleeping on 0xfffff80003fc5d40 "select" chain 40: thread 100155 (pid 1968, dhclient) sleeping on 0xfffff8000a2adbc0 "select" chain 41: thread 100188 (pid 1924, dhclient) sleeping on 0xfffff80003131a40 "select" chain 42: thread 100169 (pid 1921, dhclient) sleeping on 0xfffff80003f3ea40 "select" chain 43: thread 100141 (pid 34, syncer) sleeping on 0xffffffff820315c0 "syncer" chain 44: thread 100140 (pid 33, vnlru) sleeping on 0xfffff8000a39b000 "vlruwt" chain 45: thread 100130 (pid 32, bufdaemon) sleeping on 0xffffffff82030a58 "qsleep" chain 46: thread 100131 (pid 32, bufspacedaemon-0) sleeping on 0xffffffff81a0a8c0 "-" chain 47: thread 100132 (pid 32, bufspacedaemon-1) sleeping on 0xffffffff81a12b80 "-" chain 48: thread 100134 (pid 32, bufspacedaemon-2) sleeping on 0xffffffff81a1ae40 "-" chain 49: thread 100135 (pid 32, bufspacedaemon-3) sleeping on 0xffffffff81a23100 "-" chain 50: thread 100136 (pid 32, bufspacedaemon-4) sleeping on 0xffffffff81a2b3c0 "-" chain 51: thread 100137 (pid 32, bufspacedaemon-5) sleeping on 0xffffffff81a33680 "-" chain 52: thread 100139 (pid 32, bufspacedaemon-6) sleeping on 0xffffffff81a3b940 "-" chain 53: thread 100153 (pid 32, / worker) sleeping on 0xfffff8000a67bae8 "sdflush" chain 54: thread 100200 (pid 32, /tmp worker) sleeping on 0xfffff8000aea32e8 "sdflush" chain 55: thread 100129 (pid 31, vmdaemon) sleeping on 0xffffffff8204d808 "psleep" chain 56: thread 100128 (pid 30, dom0) sleeping on 0xffffffff820b75d8 "psleep" chain 57: thread 100133 (pid 30, laundry: dom0) sleeping on 0xffffffff820b75e4 "launds" chain 58: thread 100138 (pid 30, uma) sleeping on 0xffffffff80efcac0 "umarcl" chain 59: thread 100127 (pid 29, enc_daemon1) sleeping on 0xfffff8000a297000 "idle" chain 60: thread 100126 (pid 28, enc_daemon0) sleeping on 0xfffff8000a297530 "idle" chain 61: thread 100120 (pid 27, rand_harvestq) sleeping on 0xffffffff81cee7a0 "-" chain 62: thread 100119 (pid 26, sctp_iterator) sleeping on 0xffffffff820b5cb0 "waiting_for_work" chain 63: thread 100118 (pid 25, soaiod4) sleeping on 0xffffffff8203045c "-" chain 64: thread 100117 (pid 24, soaiod3) sleeping on 0xffffffff8203045c "-" chain 65: thread 100116 (pid 23, soaiod2) sleeping on 0xffffffff8203045c "-" chain 66: thread 100115 (pid 22, soaiod1) sleeping on 0xffffffff8203045c "-" chain 67: thread 100096 (pid 21, usbus0) sleeping on 0xfffffe009a197460 "-" chain 68: thread 100097 (pid 21, usbus0) sleeping on 0xfffffe009a1974b8 "-" chain 69: thread 100098 (pid 21, usbus0) sleeping on 0xfffffe009a197510 "-" chain 70: thread 100099 (pid 21, usbus0) sleeping on 0xfffffe009a197568 "-" chain 71: thread 100100 (pid 21, usbus0) sleeping on 0xfffffe009a1975c0 "-" chain 72: thread 100102 (pid 21, usbus1) sleeping on 0xfffffe00007f3d10 "-" chain 73: thread 100103 (pid 21, usbus1) sleeping on 0xfffffe00007f3d68 "-" chain 74: thread 100104 (pid 21, usbus1) sleeping on 0xfffffe00007f3dc0 "-" chain 75: thread 100105 (pid 21, usbus1) sleeping on 0xfffffe00007f3e18 "-" chain 76: thread 100106 (pid 21, usbus1) sleeping on 0xfffffe00007f3e70 "-" chain 77: thread 100107 (pid 21, usbus2) sleeping on 0xfffffe009a62dd10 "-" chain 78: thread 100108 (pid 21, usbus2) sleeping on 0xfffffe009a62dd68 "-" chain 79: thread 100109 (pid 21, usbus2) sleeping on 0xfffffe009a62ddc0 "-" chain 80: thread 100110 (pid 21, usbus2) sleeping on 0xfffffe009a62de18 "-" chain 81: thread 100111 (pid 21, usbus2) sleeping on 0xfffffe009a62de70 "-" chain 82: thread 100091 (pid 20, doneq0) sleeping on 0xffffffff81bc9b40 "-" chain 83: thread 100092 (pid 20, doneq1) sleeping on 0xffffffff81bc9bc0 "-" chain 84: thread 100093 (pid 20, doneq2) sleeping on 0xffffffff81bc9c40 "-" chain 85: thread 100125 (pid 20, scanner) sleeping on 0xffffffff81bc9a08 "-" chain 86: thread 100090 (pid 19, crypto returns 11) sleeping on 0xfffff80003935450 "crypto_ret_wait" chain 87: thread 100089 (pid 18, crypto returns 10) sleeping on 0xfffff800039353f0 "crypto_ret_wait" chain 88: thread 100088 (pid 17, crypto returns 9) sleeping on 0xfffff80003935390 "crypto_ret_wait" chain 89: thread 100087 (pid 16, crypto returns 8) sleeping on 0xfffff80003935330 "crypto_ret_wait" chain 90: thread 100086 (pid 15, crypto returns 7) sleeping on 0xfffff800039352d0 "crypto_ret_wait" chain 91: thread 100085 (pid 9, crypto returns 6) sleeping on 0xfffff80003935270 "crypto_ret_wait" chain 92: thread 100084 (pid 8, crypto returns 5) sleeping on 0xfffff80003935210 "crypto_ret_wait" chain 93: thread 100083 (pid 7, crypto returns 4) sleeping on 0xfffff800039351b0 "crypto_ret_wait" chain 94: thread 100082 (pid 6, crypto returns 3) sleeping on 0xfffff80003935150 "crypto_ret_wait" chain 95: thread 100081 (pid 5, crypto returns 2) sleeping on 0xfffff800039350f0 "crypto_ret_wait" chain 96: thread 100080 (pid 4, crypto returns 1) sleeping on 0xfffff80003935090 "crypto_ret_wait" chain 97: thread 100079 (pid 3, crypto returns 0) sleeping on 0xfffff80003935030 "crypto_ret_wait" chain 98: thread 100078 (pid 2, crypto) sleeping on 0xffffffff82047df8 "crypto_wait" chain 99: thread 100065 (pid 14, sequencer 00) sleeping on 0xfffff8000383c888 "seqstate" chain 100: thread 100062 (pid 13, g_event) sleeping on 0xffffffff82086140 "-" chain 101: thread 100063 (pid 13, g_up) sleeping on 0xffffffff82086150 "-" chain 102: thread 100064 (pid 13, g_down) sleeping on 0xffffffff82086138 "-" chain 103: thread 100002 (pid 1, init) sleeping on 0xfffff800036c0530 "wait" chain 104: thread 100001 (pid 10, audit) sleeping on 0xffffffff820b69d0 "audit_worker_cv" chain 105: thread 100000 (pid 0, swapper) sleeping on 0xffffffff82086180 "swapin" chain 106: thread 100015 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff80003711000 "-" chain 107: thread 100016 (pid 0, aiod_kick taskq) sleeping on 0xfffff80003710e00 "-" chain 108: thread 100019 (pid 0, thread taskq) sleeping on 0xfffff80003710b00 "-" chain 109: thread 100021 (pid 0, config_0) sleeping on 0xfffff80003710900 "-" chain 110: thread 100022 (pid 0, if_io_tqg_0) sleeping on 0xfffff80003710800 "-" chain 111: thread 100023 (pid 0, if_io_tqg_1) sleeping on 0xfffff80003710700 "-" chain 112: thread 100024 (pid 0, if_io_tqg_2) sleeping on 0xfffff80003710600 "-" chain 113: thread 100025 (pid 0, if_io_tqg_3) sleeping on 0xfffff80003710500 "-" chain 114: thread 100026 (pid 0, if_io_tqg_4) sleeping on 0xfffff80003710400 "-" chain 115: thread 100027 (pid 0, if_io_tqg_5) sleeping on 0xfffff80003710300 "-" chain 116: thread 100028 (pid 0, if_io_tqg_6) sleeping on 0xfffff80003710200 "-" chain 117: thread 100029 (pid 0, if_io_tqg_7) sleeping on 0xfffff80003710100 "-" chain 118: thread 100030 (pid 0, if_io_tqg_8) sleeping on 0xfffff80003710000 "-" chain 119: thread 100031 (pid 0, if_io_tqg_9) sleeping on 0xfffff8000370fe00 "-" chain 120: thread 100032 (pid 0, if_io_tqg_10) sleeping on 0xfffff8000370fd00 "-" chain 121: thread 100033 (pid 0, if_io_tqg_11) sleeping on 0xfffff8000370fc00 "-" chain 122: thread 100034 (pid 0, softirq_0) sleeping on 0xfffff8000370fb00 "-" chain 123: thread 100035 (pid 0, softirq_1) sleeping on 0xfffff8000370fa00 "-" chain 124: thread 100036 (pid 0, softirq_2) sleeping on 0xfffff8000370f900 "-" chain 125: thread 100037 (pid 0, softirq_3) sleeping on 0xfffff8000370f800 "-" chain 126: thread 100038 (pid 0, softirq_4) sleeping on 0xfffff800037d6100 "-" chain 127: thread 100039 (pid 0, softirq_5) sleeping on 0xfffff800037d6000 "-" chain 128: thread 100040 (pid 0, softirq_6) sleeping on 0xfffff800037d5e00 "-" chain 129: thread 100041 (pid 0, softirq_7) sleeping on 0xfffff800037d5d00 "-" chain 130: thread 100042 (pid 0, softirq_8) sleeping on 0xfffff800037d5c00 "-" chain 131: thread 100043 (pid 0, softirq_9) sleeping on 0xfffff800037d5b00 "-" chain 132: thread 100044 (pid 0, softirq_10) sleeping on 0xfffff800037d5a00 "-" chain 133: thread 100045 (pid 0, softirq_11) sleeping on 0xfffff800037d5900 "-" chain 134: thread 100046 (pid 0, if_config_tqg_0) sleeping on 0xfffff8000380b200 "-" chain 135: thread 100061 (pid 0, firmware taskq) sleeping on 0xfffff8000380b100 "-" chain 136: thread 100066 (pid 0, crypto_0) sleeping on 0xfffff8000380ae00 "-" chain 137: thread 100067 (pid 0, crypto_1) sleeping on 0xfffff8000380ae00 "-" chain 138: thread 100068 (pid 0, crypto_2) sleeping on 0xfffff8000380ae00 "-" chain 139: thread 100069 (pid 0, crypto_3) sleeping on 0xfffff8000380ae00 "-" chain 140: thread 100070 (pid 0, crypto_4) sleeping on 0xfffff8000380ae00 "-" chain 141: thread 100071 (pid 0, crypto_5) sleeping on 0xfffff8000380ae00 "-" chain 142: thread 100072 (pid 0, crypto_6) sleeping on 0xfffff8000380ae00 "-" chain 143: thread 100073 (pid 0, crypto_7) sleeping on 0xfffff8000380ae00 "-" chain 144: thread 100074 (pid 0, crypto_8) sleeping on 0xfffff8000380ae00 "-" chain 145: thread 100075 (pid 0, crypto_9) sleeping on 0xfffff8000380ae00 "-" chain 146: thread 100076 (pid 0, crypto_10) sleeping on 0xfffff8000380ae00 "-" chain 147: thread 100077 (pid 0, crypto_11) sleeping on 0xfffff8000380ae00 "-" chain 148: thread 100114 (pid 0, mca taskq) blocked on lockmgr (null)EXCL thread 0 (pid 1970434661, ) is inactive chain 149: thread 100121 (pid 0, acpi_task_0) sleeping on 0xfffff8000a368d00 "-" chain 150: thread 100122 (pid 0, acpi_task_1) sleeping on 0xfffff8000a368d00 "-" chain 151: thread 100123 (pid 0, acpi_task_2) sleeping on 0xfffff8000a368d00 "-" chain 152: thread 100124 (pid 0, CAM taskq) sleeping on 0xfffff8000380ac00 "-" db:1:pho1> show mount 0xfffff8000a7c2000 /dev/gpt/work on / (ufs) 0xfffff8000a7c3000 devfs on /dev (devfs) 0xfffff80134906000 /dev/gpt/tmp on /tmp (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 67292 Buf domain 0 freebufs 14995 lofreebufs 219 hifreebufs 329 bufspace 2244608 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 131 (2097152) dirtyq count 1 (32768) wakeup 0 lim 25 CPU 1, 0, 0, 0, 0, 0, 0, 0, 3, 2, 0, 0, Locked buffers: 0 space 0 Total buffers: 10381 space 2244608 Buf domain 1 freebufs 14980 lofreebufs 219 hifreebufs 329 bufspace 3911680 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 23 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 88 (2375680) dirtyq count 23 (753664) wakeup 0 lim 25 CPU 0, 3, 6, 1, 5, 3, 6, 6, 5, 1, 2, 4, Locked buffers: 0 space 0 Total buffers: 37722 space 3911680 Buf domain 2 freebufs 13806 lofreebufs 219 hifreebufs 329 bufspace 42848256 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1240 (40292352) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 8, 9, 1, 12, 4, 2, 13, 13, 3, 1, 21, Locked buffers: 0 space 0 Total buffers: 15676 space 42848256 Buf domain 3 freebufs 15047 lofreebufs 219 hifreebufs 329 bufspace 1036288 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 61 (483328) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 6, 2, 0, 5, 1, 0, 1, 4, 4, 1, 1, Locked buffers: 0 space 0 Total buffers: 8549 space 1036288 Buf domain 4 freebufs 14417 lofreebufs 219 hifreebufs 329 bufspace 21123072 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 685 (20221952) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 24, 0, 0, 0, 0, 0, 0, 2, 5, 0, 0, Locked buffers: 0 space 0 Total buffers: 13454 space 21123072 Buf domain 5 freebufs 14959 lofreebufs 219 hifreebufs 329 bufspace 3084288 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 163 (2961408) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 2, 1, 0, 0, 1, 3, 0, 2, 2, 0, 0, Locked buffers: 0 space 0 Total buffers: 5389 space 3084288 Buf domain 6 freebufs 15080 lofreebufs 219 hifreebufs 329 bufspace 749568 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 4 (81920) dirtyq count 0 (0) wakeup 0 lim 25 CPU 2, 2, 6, 2, 11, 2, 0, 5, 4, 8, 0, 7, Locked buffers: 0 space 0 Total buffers: 14760 space 749568 db:1:pho1> show page vm_cnt.v_free_count: 7957303 vm_cnt.v_inactive_count: 743 vm_cnt.v_active_count: 2552 vm_cnt.v_laundry_count: 140 vm_cnt.v_wire_count: 163803 vm_cnt.v_free_reserved: 10649 vm_cnt.v_free_min: 51289 vm_cnt.v_free_target: 173209 vm_cnt.v_inactive_target: 259813 db:1:pho1> show pageq pq_free 7957303 dom 0 page_cnt 8128423 free 7957303 pq_act 2552 pq_inact 743 pq_laund 140 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000568 | 000012 11 (008192K) | 000633 | 000004 10 (004096K) | 001286 | 000005 09 (002048K) | 002202 | 000014 08 (001024K) | 003273 | 000001 07 (000512K) | 003366 | 000005 06 (000256K) | 003541 | 000027 05 (000128K) | 003719 | 000071 04 (000064K) | 004110 | 000156 03 (000032K) | 004674 | 000370 02 (000016K) | 005873 | 000679 01 (000008K) | 009678 | 001160 00 (000004K) | 008387 | 000004 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000001 | 000000 05 (000128K) | 000001 | 000000 04 (000064K) | 000002 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000001 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000001 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket FFS2 dinode 256 1112 778 10674 0 61 FFS1 dinode 128 0 0 0 0 125 FFS inode 160 1112 784 10674 0 61 swblk 136 1218 305776 579216 0 62 swpctrie 144 176 24637 48927 0 61 selfd 64 107 3055 73600 0 253 rtentry 208 12 140 15 0 61 IPsec SA lft_c 16 0 0 0 0 253 ripcb 488 1 7 3 0 29 udplite_inpcb 488 0 0 0 0 29 sctp_asconf_ack 48 0 0 0 0 253 sctp_asconf 40 0 0 0 0 253 sctp_stream_msg_out 112 0 0 0 0 125 sctp_readq 152 0 0 0 0 61 sctp_chunk 152 0 0 0 0 61 sctp_raddr 736 0 0 0 0 13 sctp_laddr 48 0 0 4 0 253 sctp_asoc 2408 0 0 0 0 3 sctp_ep 1280 0 0 0 0 9 tcp_log_node 120 0 0 0 0 125 tcp_log_bucket 144 0 0 0 0 61 tcp_log 408 0 0 0 0 29 tcpreass 48 0 0 0 0 253 tfo_ccache_entries 80 0 0 0 0 125 tfo 4 0 0 0 0 253 sackhole 32 0 0 0 0 253 hostcache 96 0 41 1 0 125 syncache 168 0 69 8043 0 61 tcptw 88 0 0 170 0 125 tcpcb 976 10 14 28799 0 13 tcp_inpcb 488 10 30 28799 0 29 udpcb 32 20 2584 644 0 253 udp_inpcb 488 20 292 644 0 29 ipq 56 0 0 0 0 253 unpcb 256 22 668 5046 0 61 socket 872 55 2981 34523 0 13 KNOTE 160 0 0 1 0 61 itimer 352 0 0 0 0 29 ksiginfo 112 747 2158 6610493 0 125 pipe 760 8 262 375087 0 13 AIOLIO 280 0 0 0 0 29 AIOCB 752 0 0 0 0 13 AIOP 32 0 0 0 0 253 AIO 208 0 0 0 0 61 Mountpoints 2896 3 6 5 0 3 procdesc 136 1 28 12 0 61 NCLNODE 744 0 0 0 0 13 DIRHASH 1024 68 64 276 0 13 LTS VFS Cache 368 0 0 0 0 29 L VFS Cache 328 0 0 0 0 29 STS VFS Cache 148 0 0 0 0 61 S VFS Cache 108 1186 1544 20763 0 125 rentr 24 0 0 3 0 253 NAMEI 1024 0 196 4776301 0 13 BUF TRIE 144 353 105595 862847 0 61 VNODEPOLL 120 0 0 0 0 125 VNODE 632 1222 242 10790 0 13 vtnet_tx_hdr 24 0 0 0 0 253 crypto_session 24 0 0 0 0 253 cryptodesc 120 0 0 0 0 125 cryptop 128 0 0 0 0 125 nvme_request 128 0 0 0 0 125 g_bio 408 0 846 7208098 0 29 FPU_save_area 832 0 0 0 0 13 DMAR_MAP_ENTRY 120 0 0 0 0 125 ttyoutq 256 181 104 290 0 61 ttyinq 160 345 135 555 0 61 epoch_record pcpu 256 4 12 4 0 61 mbuf_extpgs 256 0 0 0 0 61 mbuf_jumbo_16k 16384 0 0 0 0 1 mbuf_jumbo_9k 9216 0 0 0 0 1 mbuf_jumbo_page 4096 0 2 4 0 1 mbuf_cluster 2048 8173 47 12735 0 5 mbuf 256 6223 4314 480014574 0 253 mbuf_packet 256 28 2005 559 0 253 audit_record 1280 0 0 0 0 9 domainset 40 0 0 0 0 253 cpuset 104 27 469 27 0 125 THREAD 1440 890 82 1001 0 9 PROC 1328 76 698 654446 0 9 MAC labels 40 0 0 0 0 253 pbuf 984 0 694 0 0 1 clpbuf 984 0 54 369539 3819 5 vnpbuf 984 0 0 0 0 13 mdpbuf 984 0 0 0 0 1 nfspbuf 984 0 0 0 0 5 swwbuf 984 0 20 321322 0 1 swrbuf 984 0 114 170162 0 5 umtx_shm 88 0 0 0 0 125 umtx pi 96 0 0 0 0 125 rl_entry 40 753 2019 753 0 253 TURNSTILE 136 973 507 973 0 61 rangeset pctrie nodes 144 0 0 0 0 61 filedesc0 1104 77 217 654447 0 9 Files 80 130 2663 4202376 0 125 SLEEPQUEUE 88 973 453 973 0 125 65536 65536 2 0 2 0 1 65536 65536 1 0 1 0 1 65536 65536 2 7 100 0 1 65536 65536 2 0 2 0 1 65536 65536 4 11 2269 0 1 65536 65536 0 0 0 0 1 65536 65536 0 1 32 0 1 65536 65536 2 0 2 0 1 32768 32768 12 0 20 0 1 32768 32768 1 0 1 0 1 32768 32768 1 13 94 0 1 32768 32768 0 0 0 0 1 32768 32768 12 41 3167 0 2 32768 32768 12 0 12 0 1 32768 32768 0 0 0 0 1 32768 32768 0 0 0 0 1 16384 16384 1 0 13 0 1 16384 16384 0 0 0 0 1 16384 16384 2 1 230 0 1 16384 16384 7 2 10 0 1 16384 16384 49 0 2878 0 1 16384 16384 4 0 4 0 1 16384 16384 1 0 1 0 1 16384 16384 0 0 0 0 1 8192 8192 13 4 98 0 1 8192 8192 6 0 6 0 1 8192 8192 3 0 3 0 1 8192 8192 1 0 1 0 1 8192 8192 21 3 1687 0 1 8192 8192 88 0 88 0 1 8192 8192 0 0 0 0 1 8192 8192 1 0 1 0 1 4096 4096 2 1 11 0 1 4096 4096 59 7 96 0 1 4096 4096 85 54 654517 0 1 4096 4096 2 1 3 0 1 4096 4096 6 0 92008 0 1 4096 4096 365 3 660 0 1 4096 4096 1 12 1284 0 1 4096 4096 0 0 12 0 1 2048 2048 3 11 32 0 5 2048 2048 96 6 97 0 5 2048 2048 3 15 57 0 5 2048 2048 5 3 5 0 5 2048 2048 5 5 503 0 5 2048 2048 4 2 4 0 5 2048 2048 18 102 505460 0 5 2048 2048 2 2 2 0 5 1024 1024 2 14 62 0 13 1024 1024 201 39 232 0 13 1024 1024 1 159 990132 0 13 1024 1024 1 3 1 0 13 1024 1024 33 143 3782 0 13 1024 1024 25 107 935 0 13 1024 1024 18 14 30 0 13 1024 1024 5 11 5714 0 13 512 512 2 432 10028 0 29 512 512 137 38 138 0 29 512 512 796 352 277495 0 29 512 512 4 24 4 0 29 512 512 94 179 6574 0 29 512 512 10 25 10 0 29 512 512 21 28 33 0 29 512 512 36 48 52 0 29 256 256 30 7635 2703769 0 61 256 256 439 611 60802 0 61 256 256 50 1165 18438 0 61 256 256 308 832 655926 0 61 256 256 457 743 14858 0 61 256 256 17 73 17 0 61 256 256 44 601 1297 0 61 256 256 25 65 8970 0 61 128 128 18 1284 978 0 125 128 128 440 1389 29658 0 125 128 128 105 1941 1426123 0 125 128 128 2599 1245 2602 0 125 128 128 2602 374 3512 0 125 128 128 160 1638 19226 0 125 128 128 416 1010 841 0 125 128 128 14385 278 884429 0 125 64 64 26 3384 170067 0 253 64 64 8635 3331 28970753 0 253 64 64 177 2861 654618 0 253 64 64 88 3136 655956 0 253 64 64 1358 811 3060 0 253 64 64 66 2538 20888 0 253 64 64 65 3593 462252 0 253 64 64 9288 2306 17403 0 253 32 32 119 3601 145769 0 253 32 32 245 2359 405 0 253 32 32 38 2566 678 0 253 32 32 43 2561 2472 0 253 32 32 3600 1608 14649 0 253 32 32 11 2097 40 0 253 32 32 120 2856 29654 0 253 32 32 1510 1838 23992 0 253 16 16 17 2224 119 0 253 16 16 192 2796 32936 0 253 16 16 89 1654 577 0 253 16 16 42 1701 129 0 253 16 16 3141 2337 24026 0 253 16 16 29 1714 29 0 253 16 16 9 1485 10 0 253 16 16 490 1253 850674 0 253 mt_zone 24 428 402 428 0 253 mt_stats_zone 64 428 84 428 0 253 64 pcpu 8 3024 1584 3366 0 253 fakepg 104 0 266 24 0 125 VMSPACE 2552 43 626 654413 0 3 MAP ENTRY 112 2029 6021 31442680 0 132 KMAP ENTRY 112 7 201 7 0 125 MAP 232 2 65 2 0 61 RADIX NODE 144 9035 546046 14496211 0 219 VM OBJECT 256 2535 7440 9546914 0 63 vmem btag 56 12702 2473 12750 0 253 vmem 1856 0 1 0 0 5 256 Bucket 2048 765 778 1108100 0 57 128 Bucket 1024 431 349 31677 0 14 64 Bucket 512 1462 316 164685 0 29 32 Bucket 256 1402 997 897552 0 61 16 Bucket 128 154 1891 500717 0 125 12 Bucket 96 69 1571 108426 0 125 8 Bucket 64 111 3670 65730 0 253 6 Bucket 48 53 3267 122600 0 253 4 Bucket 32 453 3267 135532 0 253 UMA Hash 256 1 10 7 0 0 UMA Slabs 112 6884 0 13980 0 0 UMA Zones 1960 81 1 81 0 0 UMA Kegs 216 75 4 75 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket vm pgcache 104 -18692877 4053 46830093 253 buf free cache 984 -5613 35992 2281582 21 buffer arena-65 65536 0 0 1514051 1 buffer arena-61 61440 0 0 1514051 1 buffer arena-57 57344 0 0 1514051 1 buffer arena-53 53248 0 0 1514051 1 buffer arena-49 49152 0 0 1514051 1 buffer arena-45 45056 0 0 1514051 1 buffer arena-40 40960 0 0 1514051 1 buffer arena-36 36864 0 0 1514051 1 buffer arena-32 32768 167 257 1515901 1 buffer arena-28 28672 0 0 1514051 1 buffer arena-24 24576 0 0 1514051 1 buffer arena-20 20480 0 0 1514051 1 buffer arena-16 16384 3 6 1514069 1 buffer arena-12 12288 0 0 1514051 1 buffer arena-81 8192 0 0 1514051 1 buffer arena-40 4096 0 0 1514051 1 db:0:pho> acttrace Tracing command swapoff pid 61295 tid 100434 td 0xfffff801d3538000 (CPU 11) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bebdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bebe10 trap() at trap+0x48/frame 0xfffffe0006bebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bebf20 --- trap 0x13, rip = 0xffffffff80c19cb0, rsp = 0xfffffe00ac92e640, rbp = 0xfffffe00ac92e6d0 --- pctrie_lookup_ge() at pctrie_lookup_ge+0x160/frame 0xfffffe00ac92e6d0 SWAP_PCTRIE_LOOKUP_GE() at SWAP_PCTRIE_LOOKUP_GE+0x1d/frame 0xfffffe00ac92e6f0 swap_pager_swapoff_object() at swap_pager_swapoff_object+0x50/frame 0xfffffe00ac92e750 swap_pager_swapoff() at swap_pager_swapoff+0xf9/frame 0xfffffe00ac92e7d0 swapoff_one() at swapoff_one+0x15e/frame 0xfffffe00ac92e820 sys_swapoff() at sys_swapoff+0x1d6/frame 0xfffffe00ac92e990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00ac92eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac92eab0 --- syscall (424, FreeBSD ELF64, sys_swapoff), rip = 0x8002f88ca, rsp = 0x7fffffffe4c8, rbp = 0x7fffffffe5f0 --- Tracing command idle pid 11 tid 100003 td 0xfffff800036c4000 (CPU 0) kdb_alt_break_internal() at kdb_alt_break_internal+0x106/frame 0xfffffe0076766710 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe0076766720 uart_intr_rxready() at uart_intr_rxready+0x9a/frame 0xfffffe0076766750 uart_intr() at uart_intr+0x138/frame 0xfffffe0076766790 intr_event_handle() at intr_event_handle+0xb5/frame 0xfffffe00767667e0 intr_execute_handlers() at intr_execute_handlers+0x57/frame 0xfffffe0076766810 lapic_handle_intr() at lapic_handle_intr+0x5f/frame 0xfffffe0076766830 Xapic_isr1() at Xapic_isr1+0xd9/frame 0xfffffe0076766830 --- interrupt, rip = 0xffffffff8120a926, rsp = 0xfffffe0076766900, rbp = 0xfffffe0076766900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076766900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076766950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076766970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076766990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076766a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076766ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076766ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff800036c35a0 (CPU 1) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b73df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b73e10 trap() at trap+0x48/frame 0xfffffe0006b73f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b73f20 --- trap 0x13, rip = 0xffffffff8120a926, rsp = 0xfffffe007676b900, rbp = 0xfffffe007676b900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007676b900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007676b950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007676b970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007676b990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007676ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe007676bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007676bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff800036c3000 (CPU 2) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b7fdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b7fe10 trap() at trap+0x48/frame 0xfffffe0006b7ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b7ff20 --- trap 0x13, rip = 0xffffffff8120a926, rsp = 0xfffffe0076770900, rbp = 0xfffffe0076770900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076770900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076770950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076770970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076770990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076770a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076770ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076770ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff800036c25a0 (CPU 3) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b8bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b8be10 trap() at trap+0x48/frame 0xfffffe0006b8bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b8bf20 --- trap 0x13, rip = 0xffffffff8120a926, rsp = 0xfffffe0076775900, rbp = 0xfffffe0076775900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076775900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076775950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076775970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076775990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076775a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076775ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076775ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff800036c2000 (CPU 4) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b97df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b97e10 trap() at trap+0x48/frame 0xfffffe0006b97f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b97f20 --- trap 0x13, rip = 0xffffffff8120a926, rsp = 0xfffffe007677a900, rbp = 0xfffffe007677a900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007677a900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007677a950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007677a970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007677a990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007677aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007677aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007677aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff800036c15a0 (CPU 5) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006ba3df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006ba3e10 trap() at trap+0x48/frame 0xfffffe0006ba3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006ba3f20 --- trap 0x13, rip = 0xffffffff8120a926, rsp = 0xfffffe007677f900, rbp = 0xfffffe007677f900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007677f900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007677f950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007677f970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007677f990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007677fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007677fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007677fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff800036c1000 (CPU 6) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bafdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bafe10 trap() at trap+0x48/frame 0xfffffe0006baff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006baff20 --- trap 0x13, rip = 0xffffffff8120a926, rsp = 0xfffffe0076784900, rbp = 0xfffffe0076784900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076784900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076784950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076784970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076784990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076784a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076784ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076784ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff800036d55a0 (CPU 7) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bbbdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bbbe10 trap() at trap+0x48/frame 0xfffffe0006bbbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bbbf20 --- trap 0x13, rip = 0xffffffff8120a926, rsp = 0xfffffe0076789900, rbp = 0xfffffe0076789900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076789900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076789950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076789970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076789990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076789a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076789ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076789ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff800036d5000 (CPU 8) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bc7df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bc7e10 trap() at trap+0x48/frame 0xfffffe0006bc7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc7f20 --- trap 0x13, rip = 0xffffffff8120a926, rsp = 0xfffffe007678e900, rbp = 0xfffffe007678e900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007678e900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007678e950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007678e970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007678e990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007678ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe007678eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007678eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff800036d45a0 (CPU 9) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bd3df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bd3e10 trap() at trap+0x48/frame 0xfffffe0006bd3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bd3f20 --- trap 0x13, rip = 0xffffffff8120a926, rsp = 0xfffffe0076793900, rbp = 0xfffffe0076793900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076793900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076793950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076793970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076793990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076793a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076793ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076793ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff800036d4000 (CPU 10) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bdfdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bdfe10 trap() at trap+0x48/frame 0xfffffe0006bdff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bdff20 --- trap 0x13, rip = 0xffffffff8120a926, rsp = 0xfffffe0076798900, rbp = 0xfffffe0076798900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076798900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076798950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076798970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076798990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076798a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076798ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076798ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 55272 2522 2464 0 S nanslp 0xffffffff81e8f0b8 sleep 46747 46746 46747 2006 Ss+ select 0xfffff806e10af940 bash 46746 46743 46743 2006 S select 0xfffff80578644940 sshd 46743 2272 46743 0 Ss select 0xfffff8006a2586c0 sshd 61295 61285 2360 0 R+ CPU 11 swapoff 61285 61283 2360 0 S+ wait 0xfffff8000a28da60 sh 61284 2360 2360 0 S+ piperd 0xfffff80250fdfbe0 tee 61283 2360 2360 0 S+ wait 0xfffff801d38b1000 sh 2525 2464 2464 0 S piperd 0xfffff80019744000 sh 2523 2464 2464 0 S piperd 0xfffff800191245f0 awk 2522 2464 2464 0 S wait 0xfffff80019127530 sh 2464 1 2464 0 SWs wait 0xfffff80019128000 sh 2360 2347 2360 0 S+ wait 0xfffff8000a392530 sh 2347 2345 2347 0 SW+ wait 0xfffff8000a9e9a60 bash 2345 2344 2345 0 SW+ pause 0xfffff80019129b08 csh 2344 2340 2344 2006 SW+ wait 0xfffff80134cbca60 su 2340 2339 2340 2006 SWs+ wait 0xfffff8000acfd530 bash 2339 2336 2336 2006 S select 0xfffff8000ad88c40 sshd 2336 2272 2336 0 Ss select 0xfffff80003db3240 sshd 2332 2331 2332 0 S+ ttyin 0xfffff800060cf0b0 csh 2331 1 2331 0 SWs+ wait 0xfffff8000a28d530 login 2330 1 2330 0 Ss+ ttyin 0xfffff800060cf4b0 getty 2329 1 2329 0 Ss+ ttyin 0xfffff8000a5950b0 getty 2328 1 2328 0 Ss+ ttyin 0xfffff8000a5954b0 getty 2327 1 2327 0 Ss+ ttyin 0xfffff8000a5958b0 getty 2326 1 2326 0 Ss+ ttyin 0xfffff8000a595cb0 getty 2325 1 2325 0 Ss+ ttyin 0xfffff8000a5960b0 getty 2324 1 2324 0 Ss+ ttyin 0xfffff8000a5964b0 getty 2323 1 2323 0 Ss+ ttyin 0xfffff8000a5968b0 getty 2322 1 2322 0 Ss+ ttyin 0xfffff8000a596cb0 getty 2276 1 2276 0 Ss nanslp 0xffffffff81e8f0b7 cron 2272 1 2272 0 Ss select 0xfffff80003db32c0 sshd 2243 1 2243 123 Ss (threaded) ntpd 100151 S select 0xfffff80003db3340 ntpd 101001 S usem 0xfffff80003fd2580 ntpd 2182 1 2182 0 Ss rpcsvc 0xfffff80003f95660 NLM: master 2179 1 2179 0 Ss select 0xfffff8000ae34ec0 rpc.statd 2133 1 2133 0 Ss nanslp 0xffffffff81e8f0b0 watchdogd 2054 1 2054 0 Ss select 0xfffff80003fdf840 rpcbind 2044 1 2044 0 Ss select 0xfffff800031319c0 syslogd 1973 1 1973 0 Ss select 0xfffff80003fc5d40 devd 1968 1 1968 65 Ss select 0xfffff8000a2adbc0 dhclient 1924 1 1924 0 Ss select 0xfffff80003131a40 dhclient 1921 1 1921 0 Ss select 0xfffff80003f3ea40 dhclient 34 0 0 0 DL syncer 0xffffffff820315c0 [syncer] 33 0 0 0 DL vlruwt 0xfffff8000a39b000 [vnlru] 32 0 0 0 DL (threaded) [bufdaemon] 100130 D qsleep 0xffffffff82030a58 [bufdaemon] 100131 D - 0xffffffff81a0a8c0 [bufspacedaemon-0] 100132 D - 0xffffffff81a12b80 [bufspacedaemon-1] 100134 D - 0xffffffff81a1ae40 [bufspacedaemon-2] 100135 D - 0xffffffff81a23100 [bufspacedaemon-3] 100136 D - 0xffffffff81a2b3c0 [bufspacedaemon-4] 100137 D - 0xffffffff81a33680 [bufspacedaemon-5] 100139 D - 0xffffffff81a3b940 [bufspacedaemon-6] 100153 D sdflush 0xfffff8000a67bae8 [/ worker] 100200 D sdflush 0xfffff8000aea32e8 [/tmp worker] 31 0 0 0 DL psleep 0xffffffff8204d808 [vmdaemon] 30 0 0 0 DL (threaded) [pagedaemon] 100128 D psleep 0xffffffff820b75d8 [dom0] 100133 D launds 0xffffffff820b75e4 [laundry: dom0] 100138 D umarcl 0xffffffff80efcac0 [uma] 29 0 0 0 DL idle 0xfffff8000a297000 [enc_daemon1] 28 0 0 0 DL idle 0xfffff8000a297530 [enc_daemon0] 27 0 0 0 DL - 0xffffffff81cee7a0 [rand_harvestq] 26 0 0 0 DL waiting 0xffffffff820b5cb0 [sctp_iterator] 25 0 0 0 DL - 0xffffffff8203045c [soaiod4] 24 0 0 0 DL - 0xffffffff8203045c [soaiod3] 23 0 0 0 DL - 0xffffffff8203045c [soaiod2] 22 0 0 0 DL - 0xffffffff8203045c [soaiod1] 21 0 0 0 DL (threaded) [usb] 100096 D - 0xfffffe009a197460 [usbus0] 100097 D - 0xfffffe009a1974b8 [usbus0] 100098 D - 0xfffffe009a197510 [usbus0] 100099 D - 0xfffffe009a197568 [usbus0] 100100 D - 0xfffffe009a1975c0 [usbus0] 100102 D - 0xfffffe00007f3d10 [usbus1] 100103 D - 0xfffffe00007f3d68 [usbus1] 100104 D - 0xfffffe00007f3dc0 [usbus1] 100105 D - 0xfffffe00007f3e18 [usbus1] 100106 D - 0xfffffe00007f3e70 [usbus1] 100107 D - 0xfffffe009a62dd10 [usbus2] 100108 D - 0xfffffe009a62dd68 [usbus2] 100109 D - 0xfffffe009a62ddc0 [usbus2] 100110 D - 0xfffffe009a62de18 [usbus2] 100111 D - 0xfffffe009a62de70 [usbus2] 20 0 0 0 DL (threaded) [cam] 100091 D - 0xffffffff81bc9b40 [doneq0] 100092 D - 0xffffffff81bc9bc0 [doneq1] 100093 D - 0xffffffff81bc9c40 [doneq2] 100125 D - 0xffffffff81bc9a08 [scanner] 19 0 0 0 DL crypto_ 0xfffff80003935450 [crypto returns 11] 18 0 0 0 DL crypto_ 0xfffff800039353f0 [crypto returns 10] 17 0 0 0 DL crypto_ 0xfffff80003935390 [crypto returns 9] 16 0 0 0 DL crypto_ 0xfffff80003935330 [crypto returns 8] 15 0 0 0 DL crypto_ 0xfffff800039352d0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff80003935270 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff80003935210 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff800039351b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff80003935150 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff800039350f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff80003935090 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff80003935030 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff82047df8 [crypto] 14 0 0 0 DL seqstat 0xfffff8000383c888 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100062 D - 0xffffffff82086140 [g_event] 100063 D - 0xffffffff82086150 [g_up] 100064 D - 0xffffffff82086138 [g_down] 12 0 0 0 WL (threaded) [intr] 100017 I [swi6: task queue] 100018 I [swi6: Giant taskq] 100020 I [swi5: fast taskq] 100047 I [swi1: netisr 0] 100048 I [swi4: clock (0)] 100049 I [swi4: clock (1)] 100050 I [swi4: clock (2)] 100051 I [swi4: clock (3)] 100052 I [swi4: clock (4)] 100053 I [swi4: clock (5)] 100054 I [swi4: clock (6)] 100055 I [swi4: clock (7)] 100056 I [swi4: clock (8)] 100057 I [swi4: clock (9)] 100058 I [swi4: clock (10)] 100059 I [swi4: clock (11)] 100060 I [swi3: vm] 100094 I [irq56: ahci0] 100095 I [irq19: xhci0] 100101 I [irq18: ehci0 ehci1] 100112 I [irq71: ahci1] 100113 I [swi0: uart uart] 100178 I [irq72: ioat0] 100179 I [irq73: ioat1] 100180 I [irq74: ioat2] 100181 I [irq75: ioat3] 100182 I [irq76: ioat4] 100183 I [irq77: ioat5] 100184 I [irq78: ioat6] 100185 I [irq79: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 100007 Run CPU 4 [idle: cpu4] 100008 Run CPU 5 [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 Run CPU 7 [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 Run CPU 9 [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 CanRun [idle: cpu11] 1 0 1 0 SLs wait 0xfffff800036c0530 [init] 10 0 0 0 DL audit_w 0xffffffff820b69d0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff82086180 [swapper] 100015 D - 0xfffff80003711000 [kqueue_ctx taskq] 100016 D - 0xfffff80003710e00 [aiod_kick taskq] 100019 D - 0xfffff80003710b00 [thread taskq] 100021 D - 0xfffff80003710900 [config_0] 100022 D - 0xfffff80003710800 [if_io_tqg_0] 100023 D - 0xfffff80003710700 [if_io_tqg_1] 100024 D - 0xfffff80003710600 [if_io_tqg_2] 100025 D - 0xfffff80003710500 [if_io_tqg_3] 100026 D - 0xfffff80003710400 [if_io_tqg_4] 100027 D - 0xfffff80003710300 [if_io_tqg_5] 100028 D - 0xfffff80003710200 [if_io_tqg_6] 100029 D - 0xfffff80003710100 [if_io_tqg_7] 100030 D - 0xfffff80003710000 [if_io_tqg_8] 100031 D - 0xfffff8000370fe00 [if_io_tqg_9] 100032 D - 0xfffff8000370fd00 [if_io_tqg_10] 100033 D - 0xfffff8000370fc00 [if_io_tqg_11] 100034 D - 0xfffff8000370fb00 [softirq_0] 100035 D - 0xfffff8000370fa00 [softirq_1] 100036 D - 0xfffff8000370f900 [softirq_2] 100037 D - 0xfffff8000370f800 [softirq_3] 100038 D - 0xfffff800037d6100 [softirq_4] 100039 D - 0xfffff800037d6000 [softirq_5] 100040 D - 0xfffff800037d5e00 [softirq_6] 100041 D - 0xfffff800037d5d00 [softirq_7] 100042 D - 0xfffff800037d5c00 [softirq_8] 100043 D - 0xfffff800037d5b00 [softirq_9] 100044 D - 0xfffff800037d5a00 [softirq_10] 100045 D - 0xfffff800037d5900 [softirq_11] 100046 D - 0xfffff8000380b200 [if_config_tqg_0] 100061 D - 0xfffff8000380b100 [firmware taskq] 100066 D - 0xfffff8000380ae00 [crypto_0] 100067 D - 0xfffff8000380ae00 [crypto_1] 100068 D - 0xfffff8000380ae00 [crypto_2] 100069 D - 0xfffff8000380ae00 [crypto_3] 100070 D - 0xfffff8000380ae00 [crypto_4] 100071 D - 0xfffff8000380ae00 [crypto_5] 100072 D - 0xfffff8000380ae00 [crypto_6] 100073 D - 0xfffff8000380ae00 [crypto_7] 100074 D - 0xfffff8000380ae00 [crypto_8] 100075 D - 0xfffff8000380ae00 [crypto_9] 100076 D - 0xfffff8000380ae00 [crypto_10] 100077 D - 0xfffff8000380ae00 [crypto_11] 100114 D - 0xfffff800060f1a00 [mca taskq] 100121 D - 0xfffff8000a368d00 [acpi_task_0] 100122 D - 0xfffff8000a368d00 [acpi_task_1] 100123 D - 0xfffff8000a368d00 [acpi_task_2] 100124 D - 0xfffff8000380ac00 [CAM taskq] db:0:pho> allt Tracing command sleep pid 55272 tid 100366 td 0xfffff80134b2d000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ac7da720 mi_switch() at mi_switch+0x174/frame 0xfffffe00ac7da750 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac7da790 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac7da7f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00ac7da830 _sleep() at _sleep+0x265/frame 0xfffffe00ac7da8d0 kern_clock_nanosleep() at kern_clock_nanosleep+0x206/frame 0xfffffe00ac7da950 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00ac7da990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00ac7daab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac7daab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003acb6a, rsp = 0x7fffffffe6a8, rbp = 0x7fffffffe6f0 --- Tracing command bash pid 46747 tid 100450 td 0xfffff801d31c5000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ac97e590 mi_switch() at mi_switch+0x174/frame 0xfffffe00ac97e5c0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac97e600 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac97e660 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac97e690 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac97e6f0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ac97e730 kern_select() at kern_select+0x953/frame 0xfffffe00ac97e910 sys_pselect() at sys_pselect+0x127/frame 0xfffffe00ac97e990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00ac97eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac97eab0 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x80051db0a, rsp = 0x7fffffffd788, rbp = 0x7fffffffd850 --- Tracing command sshd pid 46746 tid 100398 td 0xfffff801d364b000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ac87a5d0 mi_switch() at mi_switch+0x174/frame 0xfffffe00ac87a600 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac87a640 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac87a6a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac87a6d0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac87a730 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ac87a770 kern_select() at kern_select+0x953/frame 0xfffffe00ac87a950 sys_select() at sys_select+0x56/frame 0xfffffe00ac87a990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00ac87aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac87aab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80090a20a, rsp = 0x7fffffffa578, rbp = 0x7fffffffa5b0 --- Tracing command sshd pid 46743 tid 100233 td 0xfffff80134b2e000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ab7b6650 mi_switch() at mi_switch+0x174/frame 0xfffffe00ab7b6680 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ab7b66c0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ab7b6720 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ab7b6750 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ab7b67b0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ab7b67f0 kern_poll() at kern_poll+0x448/frame 0xfffffe00ab7b6970 sys_poll() at sys_poll+0x50/frame 0xfffffe00ab7b6990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00ab7b6ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ab7b6ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8008ac35a, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe610 --- Tracing command swapoff pid 61295 tid 100434 td 0xfffff801d3538000 (CPU 11) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bebdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bebe10 trap() at trap+0x48/frame 0xfffffe0006bebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bebf20 --- trap 0x13, rip = 0xffffffff80c19cb0, rsp = 0xfffffe00ac92e640, rbp = 0xfffffe00ac92e6d0 --- pctrie_lookup_ge() at pctrie_lookup_ge+0x160/frame 0xfffffe00ac92e6d0 SWAP_PCTRIE_LOOKUP_GE() at SWAP_PCTRIE_LOOKUP_GE+0x1d/frame 0xfffffe00ac92e6f0 swap_pager_swapoff_object() at swap_pager_swapoff_object+0x50/frame 0xfffffe00ac92e750 swap_pager_swapoff() at swap_pager_swapoff+0xf9/frame 0xfffffe00ac92e7d0 swapoff_one() at swapoff_one+0x15e/frame 0xfffffe00ac92e820 sys_swapoff() at sys_swapoff+0x1d6/frame 0xfffffe00ac92e990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00ac92eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac92eab0 --- syscall (424, FreeBSD ELF64, sys_swapoff), rip = 0x8002f88ca, rsp = 0x7fffffffe4c8, rbp = 0x7fffffffe5f0 --- Tracing command sh pid 61285 tid 100147 td 0xfffff8000a2b1000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a97b8570 mi_switch() at mi_switch+0x174/frame 0xfffffe00a97b85a0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a97b85e0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a97b8640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a97b8670 _sleep() at _sleep+0x2d0/frame 0xfffffe00a97b8710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00a97b87a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00a97b8990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a97b8ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a97b8ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040d9ea, rsp = 0x7fffffffe368, rbp = 0x7fffffffe420 --- Tracing command tee pid 61284 tid 100616 td 0xfffff801637385a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00accc26b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00accc26e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00accc2720 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00accc2780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00accc27b0 _sleep() at _sleep+0x2d0/frame 0xfffffe00accc2850 pipe_read() at pipe_read+0x359/frame 0xfffffe00accc28b0 dofileread() at dofileread+0x81/frame 0xfffffe00accc2900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00accc2940 sys_read() at sys_read+0x84/frame 0xfffffe00accc2990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00accc2ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00accc2ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80041d22a, rsp = 0x7fffffffe6b8, rbp = 0x7fffffffe700 --- Tracing command sh pid 61283 tid 100478 td 0xfffff801d38e1000 sched_switch() at sched_switch+0x713/frame 0xfffffe00aca0e570 mi_switch() at mi_switch+0x174/frame 0xfffffe00aca0e5a0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aca0e5e0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aca0e640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aca0e670 _sleep() at _sleep+0x2d0/frame 0xfffffe00aca0e710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00aca0e7a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00aca0e990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00aca0eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aca0eab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040d9ea, rsp = 0x7fffffffe188, rbp = 0x7fffffffe240 --- Tracing command sh pid 2525 tid 100237 td 0xfffff8016336b5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00ab7ca6b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00ab7ca6e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ab7ca720 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ab7ca780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ab7ca7b0 _sleep() at _sleep+0x2d0/frame 0xfffffe00ab7ca850 pipe_read() at pipe_read+0x359/frame 0xfffffe00ab7ca8b0 dofileread() at dofileread+0x81/frame 0xfffffe00ab7ca900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00ab7ca940 sys_read() at sys_read+0x84/frame 0xfffffe00ab7ca990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00ab7caab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ab7caab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047e22a, rsp = 0x7fffffffe228, rbp = 0x7fffffffe330 --- Tracing command awk pid 2523 tid 100236 td 0xfffff8000af925a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00ab7c56b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00ab7c56e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ab7c5720 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ab7c5780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ab7c57b0 _sleep() at _sleep+0x2d0/frame 0xfffffe00ab7c5850 pipe_read() at pipe_read+0x359/frame 0xfffffe00ab7c58b0 dofileread() at dofileread+0x81/frame 0xfffffe00ab7c5900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00ab7c5940 sys_read() at sys_read+0x84/frame 0xfffffe00ab7c5990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00ab7c5ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ab7c5ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80048122a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe340 --- Tracing command sh pid 2522 tid 100235 td 0xfffff8001912a000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ab7c0570 mi_switch() at mi_switch+0x174/frame 0xfffffe00ab7c05a0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ab7c05e0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ab7c0640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ab7c0670 _sleep() at _sleep+0x2d0/frame 0xfffffe00ab7c0710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00ab7c07a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00ab7c0990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00ab7c0ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ab7c0ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040d9ea, rsp = 0x7fffffffe238, rbp = 0x7fffffffe2f0 --- Tracing command sh pid 2464 tid 100199 td 0xfffff8001912b000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0076765f10 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe0076765f20 trap() at trap+0x5b/frame 0xfffffe0076766030 calltrap() at calltrap+0x8/frame 0xfffffe0076766030 --- trap 0xc, rip = 0xffffffff810770f6, rsp = 0xfffffe0076766100, rbp = 0xfffffe0076766110 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe0076766110 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00767661b0 db_command() at db_command+0x279/frame 0xfffffe0076766280 db_script_exec() at db_script_exec+0x188/frame 0xfffffe0076766320 db_command() at db_command+0x279/frame 0xfffffe00767663f0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe0076766400 db_trap() at db_trap+0xef/frame 0xfffffe0076766490 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe0076766510 trap() at trap+0x811/frame 0xfffffe0076766620 calltrap() at calltrap+0x8/frame 0xfffffe0076766620 --- trap 0x3, rip = 0xffffffff80c15d16, rsp = 0xfffffe00767666f0, rbp = 0xfffffe0076766710 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x106/frame 0xfffffe0076766710 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe0076766720 uart_intr_rxready() at uart_intr_rxready+0x9a/frame 0xfffffe0076766750 uart_intr() at uart_intr+0x138/frame 0xfffffe0076766790 intr_event_handle() at intr_event_handle+0xb5/frame 0xfffffe00767667e0 intr_execute_handlers() at intr_execute_handlers+0x57/frame 0xfffffe0076766810 lapic_handle_intr() at lapic_handle_intr+0x5f/frame 0xfffffe0076766830 Xapic_isr1() at Xapic_isr1+0xd9/frame 0xfffffe0076766830 --- interrupt, rip = 0xffffffff8120a926, rsp = 0xfffffe0076766900, rbp = 0xfffffe0076766900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076766900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076766950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076766970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076766990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076766a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076766ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076766ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 2360 tid 100156 td 0xfffff8000a7d35a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a97e5570 mi_switch() at mi_switch+0x174/frame 0xfffffe00a97e55a0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a97e55e0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a97e5640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a97e5670 _sleep() at _sleep+0x2d0/frame 0xfffffe00a97e5710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00a97e57a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00a97e5990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a97e5ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a97e5ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040d9ea, rsp = 0x7fffffffe4a8, rbp = 0x7fffffffe560 --- Tracing command bash pid 2347 tid 100173 td 0xfffff8000aa02000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0076765f10 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe0076765f20 trap() at trap+0x5b/frame 0xfffffe0076766030 calltrap() at calltrap+0x8/frame 0xfffffe0076766030 --- trap 0xc, rip = 0xffffffff810770f6, rsp = 0xfffffe0076766100, rbp = 0xfffffe0076766110 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe0076766110 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00767661b0 db_command() at db_command+0x279/frame 0xfffffe0076766280 db_script_exec() at db_script_exec+0x188/frame 0xfffffe0076766320 db_command() at db_command+0x279/frame 0xfffffe00767663f0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe0076766400 db_trap() at db_trap+0xef/frame 0xfffffe0076766490 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe0076766510 trap() at trap+0x811/frame 0xfffffe0076766620 calltrap() at calltrap+0x8/frame 0xfffffe0076766620 --- trap 0x3, rip = 0xffffffff80c15d16, rsp = 0xfffffe00767666f0, rbp = 0xfffffe0076766710 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x106/frame 0xfffffe0076766710 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe0076766720 uart_intr_rxready() at uart_intr_rxready+0x9a/frame 0xfffffe0076766750 uart_intr() at uart_intr+0x138/frame 0xfffffe0076766790 intr_event_handle() at intr_event_handle+0xb5/frame 0xfffffe00767667e0 intr_execute_handlers() at intr_execute_handlers+0x57/frame 0xfffffe0076766810 lapic_handle_intr() at lapic_handle_intr+0x5f/frame 0xfffffe0076766830 Xapic_isr1() at Xapic_isr1+0xd9/frame 0xfffffe0076766830 --- interrupt, rip = 0xffffffff8120a926, rsp = 0xfffffe0076766900, rbp = 0xfffffe0076766900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076766900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076766950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076766970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076766990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076766a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076766ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076766ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command csh pid 2345 tid 100164 td 0xfffff8001912d5a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0076765f10 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe0076765f20 trap() at trap+0x5b/frame 0xfffffe0076766030 calltrap() at calltrap+0x8/frame 0xfffffe0076766030 --- trap 0xc, rip = 0xffffffff810770f6, rsp = 0xfffffe0076766100, rbp = 0xfffffe0076766110 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe0076766110 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00767661b0 db_command() at db_command+0x279/frame 0xfffffe0076766280 db_script_exec() at db_script_exec+0x188/frame 0xfffffe0076766320 db_command() at db_command+0x279/frame 0xfffffe00767663f0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe0076766400 db_trap() at db_trap+0xef/frame 0xfffffe0076766490 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe0076766510 trap() at trap+0x811/frame 0xfffffe0076766620 calltrap() at calltrap+0x8/frame 0xfffffe0076766620 --- trap 0x3, rip = 0xffffffff80c15d16, rsp = 0xfffffe00767666f0, rbp = 0xfffffe0076766710 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x106/frame 0xfffffe0076766710 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe0076766720 uart_intr_rxready() at uart_intr_rxready+0x9a/frame 0xfffffe0076766750 uart_intr() at uart_intr+0x138/frame 0xfffffe0076766790 intr_event_handle() at intr_event_handle+0xb5/frame 0xfffffe00767667e0 intr_execute_handlers() at intr_execute_handlers+0x57/frame 0xfffffe0076766810 lapic_handle_intr() at lapic_handle_intr+0x5f/frame 0xfffffe0076766830 Xapic_isr1() at Xapic_isr1+0xd9/frame 0xfffffe0076766830 --- interrupt, rip = 0xffffffff8120a926, rsp = 0xfffffe0076766900, rbp = 0xfffffe0076766900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076766900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076766950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076766970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076766990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076766a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076766ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076766ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command su pid 2344 tid 100215 td 0xfffff80134b2f000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0076765f10 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe0076765f20 trap() at trap+0x5b/frame 0xfffffe0076766030 calltrap() at calltrap+0x8/frame 0xfffffe0076766030 --- trap 0xc, rip = 0xffffffff810770f6, rsp = 0xfffffe0076766100, rbp = 0xfffffe0076766110 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe0076766110 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00767661b0 db_command() at db_command+0x279/frame 0xfffffe0076766280 db_script_exec() at db_script_exec+0x188/frame 0xfffffe0076766320 db_command() at db_command+0x279/frame 0xfffffe00767663f0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe0076766400 db_trap() at db_trap+0xef/frame 0xfffffe0076766490 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe0076766510 trap() at trap+0x811/frame 0xfffffe0076766620 calltrap() at calltrap+0x8/frame 0xfffffe0076766620 --- trap 0x3, rip = 0xffffffff80c15d16, rsp = 0xfffffe00767666f0, rbp = 0xfffffe0076766710 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x106/frame 0xfffffe0076766710 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe0076766720 uart_intr_rxready() at uart_intr_rxready+0x9a/frame 0xfffffe0076766750 uart_intr() at uart_intr+0x138/frame 0xfffffe0076766790 intr_event_handle() at intr_event_handle+0xb5/frame 0xfffffe00767667e0 intr_execute_handlers() at intr_execute_handlers+0x57/frame 0xfffffe0076766810 lapic_handle_intr() at lapic_handle_intr+0x5f/frame 0xfffffe0076766830 Xapic_isr1() at Xapic_isr1+0xd9/frame 0xfffffe0076766830 --- interrupt, rip = 0xffffffff8120a926, rsp = 0xfffffe0076766900, rbp = 0xfffffe0076766900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076766900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076766950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076766970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076766990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076766a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076766ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076766ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bash pid 2340 tid 100170 td 0xfffff8001920f5a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0076765f10 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe0076765f20 trap() at trap+0x5b/frame 0xfffffe0076766030 calltrap() at calltrap+0x8/frame 0xfffffe0076766030 --- trap 0xc, rip = 0xffffffff810770f6, rsp = 0xfffffe0076766100, rbp = 0xfffffe0076766110 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe0076766110 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00767661b0 db_command() at db_command+0x279/frame 0xfffffe0076766280 db_script_exec() at db_script_exec+0x188/frame 0xfffffe0076766320 db_command() at db_command+0x279/frame 0xfffffe00767663f0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe0076766400 db_trap() at db_trap+0xef/frame 0xfffffe0076766490 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe0076766510 trap() at trap+0x811/frame 0xfffffe0076766620 calltrap() at calltrap+0x8/frame 0xfffffe0076766620 --- trap 0x3, rip = 0xffffffff80c15d16, rsp = 0xfffffe00767666f0, rbp = 0xfffffe0076766710 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x106/frame 0xfffffe0076766710 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe0076766720 uart_intr_rxready() at uart_intr_rxready+0x9a/frame 0xfffffe0076766750 uart_intr() at uart_intr+0x138/frame 0xfffffe0076766790 intr_event_handle() at intr_event_handle+0xb5/frame 0xfffffe00767667e0 intr_execute_handlers() at intr_execute_handlers+0x57/frame 0xfffffe0076766810 lapic_handle_intr() at lapic_handle_intr+0x5f/frame 0xfffffe0076766830 Xapic_isr1() at Xapic_isr1+0xd9/frame 0xfffffe0076766830 --- interrupt, rip = 0xffffffff8120a926, rsp = 0xfffffe0076766900, rbp = 0xfffffe0076766900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076766900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076766950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076766970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076766990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076766a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076766ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076766ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sshd pid 2339 tid 100154 td 0xfffff8000ae60000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a97db5d0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a97db600 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a97db640 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a97db6a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a97db6d0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a97db730 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a97db770 kern_select() at kern_select+0x953/frame 0xfffffe00a97db950 sys_select() at sys_select+0x56/frame 0xfffffe00a97db990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a97dbab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a97dbab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80090a20a, rsp = 0x7fffffffa578, rbp = 0x7fffffffa5b0 --- Tracing command sshd pid 2336 tid 100159 td 0xfffff8000af92000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a97f4650 mi_switch() at mi_switch+0x174/frame 0xfffffe00a97f4680 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a97f46c0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a97f4720 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a97f4750 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a97f47b0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a97f47f0 kern_poll() at kern_poll+0x448/frame 0xfffffe00a97f4970 sys_poll() at sys_poll+0x50/frame 0xfffffe00a97f4990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a97f4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a97f4ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8008ac35a, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe610 --- Tracing command csh pid 2332 tid 100152 td 0xfffff8000ae605a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a97d1630 mi_switch() at mi_switch+0x174/frame 0xfffffe00a97d1660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a97d16a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a97d1700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a97d1730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a97d1790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a97d17c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00a97d1820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a97d1850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a97d18b0 dofileread() at dofileread+0x81/frame 0xfffffe00a97d1900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a97d1940 sys_read() at sys_read+0x84/frame 0xfffffe00a97d1990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a97d1ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a97d1ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80050222a, rsp = 0x7fffffffe1f8, rbp = 0x7fffffffe220 --- Tracing command login pid 2331 tid 100148 td 0xfffff8000a29e5a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0076765f10 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe0076765f20 trap() at trap+0x5b/frame 0xfffffe0076766030 calltrap() at calltrap+0x8/frame 0xfffffe0076766030 --- trap 0xc, rip = 0xffffffff810770f6, rsp = 0xfffffe0076766100, rbp = 0xfffffe0076766110 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe0076766110 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe00767661b0 db_command() at db_command+0x279/frame 0xfffffe0076766280 db_script_exec() at db_script_exec+0x188/frame 0xfffffe0076766320 db_command() at db_command+0x279/frame 0xfffffe00767663f0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe0076766400 db_trap() at db_trap+0xef/frame 0xfffffe0076766490 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe0076766510 trap() at trap+0x811/frame 0xfffffe0076766620 calltrap() at calltrap+0x8/frame 0xfffffe0076766620 --- trap 0x3, rip = 0xffffffff80c15d16, rsp = 0xfffffe00767666f0, rbp = 0xfffffe0076766710 --- kdb_alt_break_internal() at kdb_alt_break_internal+0x106/frame 0xfffffe0076766710 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe0076766720 uart_intr_rxready() at uart_intr_rxready+0x9a/frame 0xfffffe0076766750 uart_intr() at uart_intr+0x138/frame 0xfffffe0076766790 intr_event_handle() at intr_event_handle+0xb5/frame 0xfffffe00767667e0 intr_execute_handlers() at intr_execute_handlers+0x57/frame 0xfffffe0076766810 lapic_handle_intr() at lapic_handle_intr+0x5f/frame 0xfffffe0076766830 Xapic_isr1() at Xapic_isr1+0xd9/frame 0xfffffe0076766830 --- interrupt, rip = 0xffffffff8120a926, rsp = 0xfffffe0076766900, rbp = 0xfffffe0076766900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076766900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076766950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076766970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076766990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076766a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076766ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076766ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command getty pid 2330 tid 100161 td 0xfffff8000ad8e5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a97fe630 mi_switch() at mi_switch+0x174/frame 0xfffffe00a97fe660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a97fe6a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a97fe700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a97fe730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a97fe790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a97fe7c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00a97fe820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a97fe850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a97fe8b0 dofileread() at dofileread+0x81/frame 0xfffffe00a97fe900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a97fe940 sys_read() at sys_read+0x84/frame 0xfffffe00a97fe990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a97feab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a97feab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043922a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2329 tid 100166 td 0xfffff8001912d000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ab618630 mi_switch() at mi_switch+0x174/frame 0xfffffe00ab618660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ab6186a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ab618700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ab618730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ab618790 tty_wait() at tty_wait+0x42/frame 0xfffffe00ab6187c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ab618820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ab618850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ab6188b0 dofileread() at dofileread+0x81/frame 0xfffffe00ab618900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00ab618940 sys_read() at sys_read+0x84/frame 0xfffffe00ab618990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00ab618ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ab618ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043922a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2328 tid 100213 td 0xfffff80134b2f5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00ab752630 mi_switch() at mi_switch+0x174/frame 0xfffffe00ab752660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ab7526a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ab752700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ab752730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ab752790 tty_wait() at tty_wait+0x42/frame 0xfffffe00ab7527c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ab752820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ab752850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ab7528b0 dofileread() at dofileread+0x81/frame 0xfffffe00ab752900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00ab752940 sys_read() at sys_read+0x84/frame 0xfffffe00ab752990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00ab752ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ab752ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043922a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2327 tid 100212 td 0xfffff80134b44000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ab74d630 mi_switch() at mi_switch+0x174/frame 0xfffffe00ab74d660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ab74d6a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ab74d700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ab74d730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ab74d790 tty_wait() at tty_wait+0x42/frame 0xfffffe00ab74d7c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ab74d820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ab74d850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ab74d8b0 dofileread() at dofileread+0x81/frame 0xfffffe00ab74d900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00ab74d940 sys_read() at sys_read+0x84/frame 0xfffffe00ab74d990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00ab74dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ab74dab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043922a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2326 tid 100211 td 0xfffff8000a7d65a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00ab748630 mi_switch() at mi_switch+0x174/frame 0xfffffe00ab748660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ab7486a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ab748700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ab748730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ab748790 tty_wait() at tty_wait+0x42/frame 0xfffffe00ab7487c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ab748820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ab748850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ab7488b0 dofileread() at dofileread+0x81/frame 0xfffffe00ab748900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00ab748940 sys_read() at sys_read+0x84/frame 0xfffffe00ab748990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00ab748ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ab748ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043922a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2325 tid 100189 td 0xfffff8000a80e000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ab6bb630 mi_switch() at mi_switch+0x174/frame 0xfffffe00ab6bb660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ab6bb6a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ab6bb700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ab6bb730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ab6bb790 tty_wait() at tty_wait+0x42/frame 0xfffffe00ab6bb7c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ab6bb820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ab6bb850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ab6bb8b0 dofileread() at dofileread+0x81/frame 0xfffffe00ab6bb900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00ab6bb940 sys_read() at sys_read+0x84/frame 0xfffffe00ab6bb990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00ab6bbab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ab6bbab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043922a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2324 tid 100192 td 0xfffff8001920e5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00ab6ca630 mi_switch() at mi_switch+0x174/frame 0xfffffe00ab6ca660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ab6ca6a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ab6ca700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ab6ca730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ab6ca790 tty_wait() at tty_wait+0x42/frame 0xfffffe00ab6ca7c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ab6ca820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ab6ca850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ab6ca8b0 dofileread() at dofileread+0x81/frame 0xfffffe00ab6ca900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00ab6ca940 sys_read() at sys_read+0x84/frame 0xfffffe00ab6ca990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00ab6caab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ab6caab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043922a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2323 tid 100165 td 0xfffff8000ae37000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ab613630 mi_switch() at mi_switch+0x174/frame 0xfffffe00ab613660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ab6136a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ab613700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ab613730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ab613790 tty_wait() at tty_wait+0x42/frame 0xfffffe00ab6137c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ab613820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ab613850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ab6138b0 dofileread() at dofileread+0x81/frame 0xfffffe00ab613900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00ab613940 sys_read() at sys_read+0x84/frame 0xfffffe00ab613990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00ab613ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ab613ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043922a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2322 tid 100142 td 0xfffff8000aa035a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a35fd630 mi_switch() at mi_switch+0x174/frame 0xfffffe00a35fd660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a35fd6a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a35fd700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a35fd730 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a35fd790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a35fd7c0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00a35fd820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a35fd850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a35fd8b0 dofileread() at dofileread+0x81/frame 0xfffffe00a35fd900 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a35fd940 sys_read() at sys_read+0x84/frame 0xfffffe00a35fd990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a35fdab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a35fdab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80043922a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command cron pid 2276 tid 100174 td 0xfffff8000af915a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00ab640720 mi_switch() at mi_switch+0x174/frame 0xfffffe00ab640750 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ab640790 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ab6407f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00ab640830 _sleep() at _sleep+0x265/frame 0xfffffe00ab6408d0 kern_clock_nanosleep() at kern_clock_nanosleep+0x206/frame 0xfffffe00ab640950 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00ab640990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00ab640ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ab640ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003dcb6a, rsp = 0x7fffffffead8, rbp = 0x7fffffffecc0 --- Tracing command sshd pid 2272 tid 100204 td 0xfffff8001912a5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00ab7255d0 mi_switch() at mi_switch+0x174/frame 0xfffffe00ab725600 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ab725640 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ab7256a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ab7256d0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ab725730 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ab725770 kern_select() at kern_select+0x953/frame 0xfffffe00ab725950 sys_select() at sys_select+0x56/frame 0xfffffe00ab725990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00ab725ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ab725ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80090a20a, rsp = 0x7fffffffe668, rbp = 0x7fffffffe6a0 --- Tracing command ntpd pid 2243 tid 100151 td 0xfffff8000aa025a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a97cc5d0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a97cc600 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a97cc640 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a97cc6a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a97cc6d0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a97cc730 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a97cc770 kern_select() at kern_select+0x953/frame 0xfffffe00a97cc950 sys_select() at sys_select+0x56/frame 0xfffffe00a97cc990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a97ccab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a97ccab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80083620a, rsp = 0x7fffffffdf18, rbp = 0x7fffffffdf50 --- Tracing command ntpd pid 2243 tid 101001 td 0xfffff808260e15a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004416d0 mi_switch() at mi_switch+0x174/frame 0xfffffe0000441700 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000441740 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00004417a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00004417d0 _sleep() at _sleep+0x2d0/frame 0xfffffe0000441870 umtxq_sleep() at umtxq_sleep+0x153/frame 0xfffffe00004418d0 do_sem2_wait() at do_sem2_wait+0x26d/frame 0xfffffe0000441940 __umtx_op_sem2_wait() at __umtx_op_sem2_wait+0x76/frame 0xfffffe0000441990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe0000441ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0000441ab0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x80072a58a, rsp = 0x7fffdfffded8, rbp = 0x7fffdfffdf50 --- Tracing command rpc.lockd pid 2182 tid 100198 td 0xfffff8001912b5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00ab70c4f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00ab70c520 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ab70c560 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ab70c5c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00ab70c600 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00ab70c670 svc_run_internal() at svc_run_internal+0xa77/frame 0xfffffe00ab70c7b0 svc_run() at svc_run+0x24e/frame 0xfffffe00ab70c810 sys_nlm_syscall() at sys_nlm_syscall+0x77b/frame 0xfffffe00ab70c990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00ab70cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ab70cab0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8002f862a, rsp = 0x7fffffffec08, rbp = 0x7fffffffecc0 --- Tracing command rpc.statd pid 2179 tid 100196 td 0xfffff8000378f000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ab7025b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00ab7025e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ab702620 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ab702680 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00ab7026c0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00ab702730 seltdwait() at seltdwait+0x6b/frame 0xfffffe00ab702770 kern_select() at kern_select+0x953/frame 0xfffffe00ab702950 sys_select() at sys_select+0x56/frame 0xfffffe00ab702990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00ab702ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ab702ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80042d20a, rsp = 0x7fffffffea98, rbp = 0x7fffffffebe0 --- Tracing command watchdogd pid 2133 tid 100194 td 0xfffff8000a7f15a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00ab6ec720 mi_switch() at mi_switch+0x174/frame 0xfffffe00ab6ec750 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ab6ec790 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ab6ec7f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00ab6ec830 _sleep() at _sleep+0x265/frame 0xfffffe00ab6ec8d0 kern_clock_nanosleep() at kern_clock_nanosleep+0x206/frame 0xfffffe00ab6ec950 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00ab6ec990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00ab6ecab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ab6ecab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003c5b6a, rsp = 0x7fffffffea98, rbp = 0x7fffffffeae0 --- Tracing command rpcbind pid 2054 tid 100150 td 0xfffff8000379c000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a97c7630 mi_switch() at mi_switch+0x174/frame 0xfffffe00a97c7660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a97c76a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a97c7700 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a97c7740 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00a97c77b0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00a97c77f0 kern_poll() at kern_poll+0x448/frame 0xfffffe00a97c7970 sys_poll() at sys_poll+0x50/frame 0xfffffe00a97c7990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a97c7ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a97c7ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003d435a, rsp = 0x7fffffffca38, rbp = 0x7fffffffec50 --- Tracing command syslogd pid 2044 tid 100195 td 0xfffff8000a7f1000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ab6f15d0 mi_switch() at mi_switch+0x174/frame 0xfffffe00ab6f1600 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ab6f1640 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ab6f16a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ab6f16d0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ab6f1730 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ab6f1770 kern_select() at kern_select+0x953/frame 0xfffffe00ab6f1950 sys_select() at sys_select+0x56/frame 0xfffffe00ab6f1990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00ab6f1ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ab6f1ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80043e20a, rsp = 0x7fffffffe748, rbp = 0x7fffffffecc0 --- Tracing command devd pid 1973 tid 100177 td 0xfffff8001920f000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ab64f5b0 mi_switch() at mi_switch+0x174/frame 0xfffffe00ab64f5e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ab64f620 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ab64f680 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00ab64f6c0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00ab64f730 seltdwait() at seltdwait+0x6b/frame 0xfffffe00ab64f770 kern_select() at kern_select+0x953/frame 0xfffffe00ab64f950 sys_select() at sys_select+0x56/frame 0xfffffe00ab64f990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00ab64fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ab64fab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2f530a, rsp = 0x7fffffffcb48, rbp = 0x7fffffffece0 --- Tracing command dhclient pid 1968 tid 100155 td 0xfffff8000a811000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a97e0630 mi_switch() at mi_switch+0x174/frame 0xfffffe00a97e0660 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a97e06a0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a97e0700 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a97e0740 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00a97e07b0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00a97e07f0 kern_poll() at kern_poll+0x448/frame 0xfffffe00a97e0970 sys_poll() at sys_poll+0x50/frame 0xfffffe00a97e0990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00a97e0ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a97e0ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f735a, rsp = 0x7fffffffec28, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1924 tid 100188 td 0xfffff8001912c000 sched_switch() at sched_switch+0x713/frame 0xfffffe00ab6b6650 mi_switch() at mi_switch+0x174/frame 0xfffffe00ab6b6680 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ab6b66c0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ab6b6720 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ab6b6750 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ab6b67b0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ab6b67f0 kern_poll() at kern_poll+0x448/frame 0xfffffe00ab6b6970 sys_poll() at sys_poll+0x50/frame 0xfffffe00ab6b6990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00ab6b6ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ab6b6ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f735a, rsp = 0x7fffffffec38, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1921 tid 100169 td 0xfffff800037945a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00ab6275d0 mi_switch() at mi_switch+0x174/frame 0xfffffe00ab627600 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ab627640 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ab6276a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ab6276d0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ab627730 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ab627770 kern_select() at kern_select+0x953/frame 0xfffffe00ab627950 sys_select() at sys_select+0x56/frame 0xfffffe00ab627990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe00ab627ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ab627ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80045520a, rsp = 0x7fffffffe9e8, rbp = 0x7fffffffeaa0 --- Tracing command syncer pid 34 tid 100141 td 0xfffff8000a7d4000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a35f88c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a35f88f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a35f8930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a35f8970 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x185/frame 0xfffffe00a35f89e0 sched_sync() at sched_sync+0x609/frame 0xfffffe00a35f8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a35f8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a35f8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vnlru pid 33 tid 100140 td 0xfffff8000a7d45a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a35f3890 mi_switch() at mi_switch+0x174/frame 0xfffffe00a35f38c0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a35f3900 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a35f3940 _sleep() at _sleep+0x279/frame 0xfffffe00a35f39e0 vnlru_proc() at vnlru_proc+0xa4/frame 0xfffffe00a35f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a35f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a35f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100130 td 0xfffff8000a7d6000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006f158d0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f15900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f15940 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f15980 _sleep() at _sleep+0x279/frame 0xfffffe0006f15a20 buf_daemon() at buf_daemon+0xc8/frame 0xfffffe0006f15a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f15ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f15ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100131 td 0xfffff800037a05a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006fe68c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006fe68f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006fe6930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006fe6970 _sleep() at _sleep+0x279/frame 0xfffffe0006fe6a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006fe6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006fe6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006fe6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100132 td 0xfffff8000a809000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006feb8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006feb8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006feb930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006feb970 _sleep() at _sleep+0x279/frame 0xfffffe0006feba10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006feba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006febab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006febab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100134 td 0xfffff8000a8045a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006ff08c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ff08f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ff0930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ff0970 _sleep() at _sleep+0x279/frame 0xfffffe0006ff0a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006ff0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ff0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ff0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100135 td 0xfffff8000a804000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006ff58c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ff58f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ff5930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ff5970 _sleep() at _sleep+0x279/frame 0xfffffe0006ff5a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006ff5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ff5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ff5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100136 td 0xfffff8000a8015a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006ffa8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ffa8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ffa930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ffa970 _sleep() at _sleep+0x279/frame 0xfffffe0006ffaa10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006ffaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ffaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ffaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100137 td 0xfffff8000a801000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a34848c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a34848f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a3484930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a3484970 _sleep() at _sleep+0x279/frame 0xfffffe00a3484a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00a3484a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a3484ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a3484ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100139 td 0xfffff8000a7ff5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a35ee8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a35ee8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a35ee930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a35ee970 _sleep() at _sleep+0x279/frame 0xfffffe00a35eea10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00a35eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a35eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a35eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100153 td 0xfffff80003f5f5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a97d68f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a97d6920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a97d6960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a97d69a0 _sleep() at _sleep+0x279/frame 0xfffffe00a97d6a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00a97d6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a97d6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a97d6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100200 td 0xfffff8000a29e000 sched_switch() at sched_switch+0x713/frame 0xfffffe00a97ea8f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a97ea920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a97ea960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a97ea9a0 _sleep() at _sleep+0x279/frame 0xfffffe00a97eaa40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00a97eaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a97eaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a97eaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 31 tid 100129 td 0xfffff8000a2b45a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006f108c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f108f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f10930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f10960 _sleep() at _sleep+0x2da/frame 0xfffffe0006f10a00 vm_daemon() at vm_daemon+0xabf/frame 0xfffffe0006f10a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f10ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f10ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffff8000a39d000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006f0b560 mi_switch() at mi_switch+0x174/frame 0xfffffe0006f0b590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f0b5d0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f0b610 _sleep() at _sleep+0x279/frame 0xfffffe0006f0b6b0 vm_pageout_worker() at vm_pageout_worker+0x25e/frame 0xfffffe0006f0ba30 vm_pageout() at vm_pageout+0x156/frame 0xfffffe0006f0ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f0bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f0bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100133 td 0xfffff8000a813000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006fff6b0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006fff6e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006fff720 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006fff750 _sleep() at _sleep+0x2da/frame 0xfffffe0006fff7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xbcb/frame 0xfffffe0006fffa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006fffab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006fffab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100138 td 0xfffff8000a8115a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00a35898f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00a3589920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a3589960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a35899a0 _sleep() at _sleep+0x279/frame 0xfffffe00a3589a40 uma_reclaim_worker() at uma_reclaim_worker+0xda/frame 0xfffffe00a3589a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a3589ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a3589ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 29 tid 100127 td 0xfffff8000a2b15a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006efa8b0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006efa8e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006efa920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006efa950 _sleep() at _sleep+0x2da/frame 0xfffffe0006efa9f0 enc_daemon() at enc_daemon+0x1cf/frame 0xfffffe0006efaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006efaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006efaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 28 tid 100126 td 0xfffff8000a2b2000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006ef58b0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ef58e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ef5920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ef5950 _sleep() at _sleep+0x2da/frame 0xfffffe0006ef59f0 enc_daemon() at enc_daemon+0x1cf/frame 0xfffffe0006ef5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ef5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ef5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 27 tid 100120 td 0xfffff8000a3ac000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006ed78c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ed78f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ed7930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ed7970 _sleep() at _sleep+0x279/frame 0xfffffe0006ed7a10 random_kthread() at random_kthread+0x26a/frame 0xfffffe0006ed7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ed7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ed7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 26 tid 100119 td 0xfffff8000a3ac5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006ec6910 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ec6940 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ec6980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ec69b0 _sleep() at _sleep+0x2da/frame 0xfffffe0006ec6a50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe0006ec6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ec6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ec6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 25 tid 100118 td 0xfffff8000a2b25a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006eb58e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006eb5910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006eb5950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006eb5990 _sleep() at _sleep+0x279/frame 0xfffffe0006eb5a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006eb5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eb5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eb5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 24 tid 100117 td 0xfffff8000a2b3000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006eb08e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006eb0910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006eb0950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006eb0990 _sleep() at _sleep+0x279/frame 0xfffffe0006eb0a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006eb0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eb0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eb0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 23 tid 100116 td 0xfffff8000a2b35a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006eab8e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006eab910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006eab950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006eab990 _sleep() at _sleep+0x279/frame 0xfffffe0006eaba30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006eaba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eabab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eabab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 22 tid 100115 td 0xfffff8000a2b4000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006ea68e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ea6910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ea6950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ea6990 _sleep() at _sleep+0x279/frame 0xfffffe0006ea6a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ea6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ea6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ea6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100096 td 0xfffff80003aa4000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e3b930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e3b960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e3b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e3b9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e3ba30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e3ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e3bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e3bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100097 td 0xfffff80003aa35a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e40930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e40960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e409a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e409d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e40a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e40a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e40ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e40ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100098 td 0xfffff80003aa3000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e45930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e45960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e459a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e459d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e45a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e45a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e45ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e45ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100099 td 0xfffff8000393d5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e4a930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e4a960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e4a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e4a9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e4aa30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e4aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e4aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e4aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100100 td 0xfffff80003f66000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e4f930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e4f960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e4f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e4f9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e4fa30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e4fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e4fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e4fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100102 td 0xfffff80003f62000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e59930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e59960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e599a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e599d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e59a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e59a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e59ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e59ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100103 td 0xfffff80003f615a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e5e930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e5e960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e5e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e5e9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e5ea30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e5ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e5eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e5eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100104 td 0xfffff80003f61000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e63930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e63960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e639a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e639d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e63a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e63a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e63ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e63ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100105 td 0xfffff80003f605a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e68930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e68960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e689a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e689d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e68a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e68a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e68ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e68ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100106 td 0xfffff80003f60000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e6d930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e6d960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e6d9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e6d9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e6da30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e6da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e6dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e6dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100107 td 0xfffff8000607d5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e7e930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e7e960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e7e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e7e9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e7ea30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e7ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e7eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e7eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100108 td 0xfffff8000607d000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e83930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e83960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e839a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e839d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e83a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e83a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e83ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e83ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100109 td 0xfffff8000607c5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e88930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e88960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e889a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e889d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e88a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e88a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e88ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e88ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100110 td 0xfffff8000607c000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e8d930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e8d960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e8d9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e8d9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e8da30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e8da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e8dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e8dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100111 td 0xfffff8000607b5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e92930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e92960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e929a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e929d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e92a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e92a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e92ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e92ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100091 td 0xfffff80003aa65a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e228e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e22910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e22950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e22980 _sleep() at _sleep+0x2da/frame 0xfffffe0006e22a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e22a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e22ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e22ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100092 td 0xfffff80003aa6000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e278e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e27910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e27950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e27980 _sleep() at _sleep+0x2da/frame 0xfffffe0006e27a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e27a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e27ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e27ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100093 td 0xfffff80003aa55a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e2c8e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e2c910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e2c950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e2c980 _sleep() at _sleep+0x2da/frame 0xfffffe0006e2ca20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e2ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e2cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e2cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100125 td 0xfffff8000a39d5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006ef08d0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ef0900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ef0940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ef0970 _sleep() at _sleep+0x2da/frame 0xfffffe0006ef0a10 xpt_scanner_thread() at xpt_scanner_thread+0x93/frame 0xfffffe0006ef0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ef0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ef0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 19 tid 100090 td 0xfffff80003939000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e1d8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e1d8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e1d930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e1d960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e1da00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e1da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e1dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e1dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 18 tid 100089 td 0xfffff800039395a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e188c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e188f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e18930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e18960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e18a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e18a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e18ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e18ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 17 tid 100088 td 0xfffff8000393a000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e138c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e138f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e13930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e13960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e13a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e13a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e13ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e13ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 16 tid 100087 td 0xfffff8000393a5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e0e8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e0e8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e0e930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e0e960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e0ea00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e0ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e0eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e0eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 15 tid 100086 td 0xfffff8000393b000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e098c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e098f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e09930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e09960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e09a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e09a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e09ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e09ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100085 td 0xfffff8000393b5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e048c0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e048f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e04930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e04960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e04a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e04a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e04ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e04ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100084 td 0xfffff8000393c000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005fb8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005fb8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005fb930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005fb960 _sleep() at _sleep+0x2da/frame 0xfffffe00005fba00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005fba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005fbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005fbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100083 td 0xfffff8000393c5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005f68c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005f68f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005f6930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005f6960 _sleep() at _sleep+0x2da/frame 0xfffffe00005f6a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005f6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100082 td 0xfffff8000393d000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005f18c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005f18f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005f1930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005f1960 _sleep() at _sleep+0x2da/frame 0xfffffe00005f1a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005f1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100081 td 0xfffff800038d55a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005ec8c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005ec8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005ec930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ec960 _sleep() at _sleep+0x2da/frame 0xfffffe00005eca00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005eca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005ecab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005ecab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100080 td 0xfffff8000392a000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005e78c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005e78f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005e7930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005e7960 _sleep() at _sleep+0x2da/frame 0xfffffe00005e7a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005e7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100079 td 0xfffff8000392a5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005e28c0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005e28f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005e2930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005e2960 _sleep() at _sleep+0x2da/frame 0xfffffe00005e2a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005e2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100078 td 0xfffff8000392b000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005dd8f0 mi_switch() at mi_switch+0x174/frame 0xfffffe00005dd920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005dd960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005dd990 _sleep() at _sleep+0x2da/frame 0xfffffe00005dda30 crypto_proc() at crypto_proc+0x2c4/frame 0xfffffe00005dda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005ddab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005ddab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100065 td 0xfffff800038d45a0 sched_switch() at sched_switch+0x713/frame 0xfffffe000059c8f0 mi_switch() at mi_switch+0x174/frame 0xfffffe000059c920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000059c960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000059c990 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe000059c9f0 seq_eventthread() at seq_eventthread+0xdc/frame 0xfffffe000059ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe000059cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000059cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffff8000382e000 sched_switch() at sched_switch+0x713/frame 0xfffffe000058d8f0 mi_switch() at mi_switch+0x174/frame 0xfffffe000058d920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000058d960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000058d990 _sleep() at _sleep+0x2da/frame 0xfffffe000058da30 g_run_events() at g_run_events+0x4f/frame 0xfffffe000058da70 fork_exit() at fork_exit+0x84/frame 0xfffffe000058dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000058dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffff800038205a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005928f0 mi_switch() at mi_switch+0x174/frame 0xfffffe0000592920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000592960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000592990 _sleep() at _sleep+0x2da/frame 0xfffffe0000592a30 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0000592a60 g_up_procbody() at g_up_procbody+0x6d/frame 0xfffffe0000592a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000592ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000592ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100064 td 0xfffff800038d5000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005978f0 mi_switch() at mi_switch+0x174/frame 0xfffffe0000597920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000597960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000597990 _sleep() at _sleep+0x2da/frame 0xfffffe0000597a30 g_io_schedule_down() at g_io_schedule_down+0x14c/frame 0xfffffe0000597a60 g_down_procbody() at g_down_procbody+0x6d/frame 0xfffffe0000597a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000597ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000597ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100017 td 0xfffff800036d2000 sched_switch() at sched_switch+0x713/frame 0xfffffe00767b89e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00767b8a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00767b8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767b8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767b8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100018 td 0xfffff800036c55a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00767bd9e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00767bda10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00767bda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767bdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767bdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100020 td 0xfffff8000371b5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffff8000381f5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004ee9e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00004eea10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00004eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100048 td 0xfffff8000381f000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004f39e0 mi_switch() at mi_switch+0x174/frame 0xfffffe00004f3a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00004f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100049 td 0xfffff8000381e5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100050 td 0xfffff8000381e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffff8000381d5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffff8000381d000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100053 td 0xfffff8000380f5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100054 td 0xfffff8000380f000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100055 td 0xfffff800038315a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100056 td 0xfffff80003831000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100057 td 0xfffff800038305a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100058 td 0xfffff80003830000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xfffff8000382f5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100060 td 0xfffff8000382f000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100094 td 0xfffff80003aa5000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e319e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e31a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006e31a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e31ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e31ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffff80003aa45a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e369e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e36a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006e36a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e36ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e36ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100101 td 0xfffff80003f625a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e549e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e54a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006e54a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e54ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e54ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100112 td 0xfffff8000607b000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffff8000606e5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006e9c9e0 mi_switch() at mi_switch+0x174/frame 0xfffffe0006e9ca10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006e9ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e9cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e9cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100178 td 0xfffff8000aa015a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100179 td 0xfffff8000aa01000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100180 td 0xfffff8000a9f25a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100181 td 0xfffff8000a9f2000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100182 td 0xfffff8000a8135a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100183 td 0xfffff8001989a000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100184 td 0xfffff800198995a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100185 td 0xfffff80019899000 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffff800036c4000 (CPU 0) kdb_alt_break_internal() at kdb_alt_break_internal+0x106/frame 0xfffffe0076766710 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe0076766720 uart_intr_rxready() at uart_intr_rxready+0x9a/frame 0xfffffe0076766750 uart_intr() at uart_intr+0x138/frame 0xfffffe0076766790 intr_event_handle() at intr_event_handle+0xb5/frame 0xfffffe00767667e0 intr_execute_handlers() at intr_execute_handlers+0x57/frame 0xfffffe0076766810 lapic_handle_intr() at lapic_handle_intr+0x5f/frame 0xfffffe0076766830 Xapic_isr1() at Xapic_isr1+0xd9/frame 0xfffffe0076766830 --- interrupt, rip = 0xffffffff8120a926, rsp = 0xfffffe0076766900, rbp = 0xfffffe0076766900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076766900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076766950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076766970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076766990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076766a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076766ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076766ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff800036c35a0 (CPU 1) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b73df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b73e10 trap() at trap+0x48/frame 0xfffffe0006b73f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b73f20 --- trap 0x13, rip = 0xffffffff8120a926, rsp = 0xfffffe007676b900, rbp = 0xfffffe007676b900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007676b900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007676b950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007676b970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007676b990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007676ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe007676bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007676bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff800036c3000 (CPU 2) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b7fdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b7fe10 trap() at trap+0x48/frame 0xfffffe0006b7ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b7ff20 --- trap 0x13, rip = 0xffffffff8120a926, rsp = 0xfffffe0076770900, rbp = 0xfffffe0076770900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076770900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076770950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076770970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076770990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076770a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076770ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076770ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff800036c25a0 (CPU 3) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b8bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b8be10 trap() at trap+0x48/frame 0xfffffe0006b8bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b8bf20 --- trap 0x13, rip = 0xffffffff8120a926, rsp = 0xfffffe0076775900, rbp = 0xfffffe0076775900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076775900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076775950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076775970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076775990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076775a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076775ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076775ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff800036c2000 (CPU 4) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b97df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b97e10 trap() at trap+0x48/frame 0xfffffe0006b97f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b97f20 --- trap 0x13, rip = 0xffffffff8120a926, rsp = 0xfffffe007677a900, rbp = 0xfffffe007677a900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007677a900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007677a950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007677a970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007677a990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007677aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007677aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007677aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff800036c15a0 (CPU 5) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006ba3df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006ba3e10 trap() at trap+0x48/frame 0xfffffe0006ba3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006ba3f20 --- trap 0x13, rip = 0xffffffff8120a926, rsp = 0xfffffe007677f900, rbp = 0xfffffe007677f900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007677f900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007677f950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007677f970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007677f990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007677fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007677fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007677fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff800036c1000 (CPU 6) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bafdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bafe10 trap() at trap+0x48/frame 0xfffffe0006baff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006baff20 --- trap 0x13, rip = 0xffffffff8120a926, rsp = 0xfffffe0076784900, rbp = 0xfffffe0076784900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076784900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076784950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076784970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076784990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076784a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076784ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076784ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff800036d55a0 (CPU 7) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bbbdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bbbe10 trap() at trap+0x48/frame 0xfffffe0006bbbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bbbf20 --- trap 0x13, rip = 0xffffffff8120a926, rsp = 0xfffffe0076789900, rbp = 0xfffffe0076789900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076789900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076789950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076789970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076789990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076789a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076789ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076789ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff800036d5000 (CPU 8) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bc7df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bc7e10 trap() at trap+0x48/frame 0xfffffe0006bc7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc7f20 --- trap 0x13, rip = 0xffffffff8120a926, rsp = 0xfffffe007678e900, rbp = 0xfffffe007678e900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007678e900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007678e950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007678e970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007678e990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe007678ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe007678eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007678eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff800036d45a0 (CPU 9) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bd3df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bd3e10 trap() at trap+0x48/frame 0xfffffe0006bd3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bd3f20 --- trap 0x13, rip = 0xffffffff8120a926, rsp = 0xfffffe0076793900, rbp = 0xfffffe0076793900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076793900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076793950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076793970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076793990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076793a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076793ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076793ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff800036d4000 (CPU 10) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bdfdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bdfe10 trap() at trap+0x48/frame 0xfffffe0006bdff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bdff20 --- trap 0x13, rip = 0xffffffff8120a926, rsp = 0xfffffe0076798900, rbp = 0xfffffe0076798900 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076798900 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076798950 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076798970 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0076798990 sched_idletd() at sched_idletd+0x472/frame 0xfffffe0076798a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076798ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076798ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff800036d35a0 sched_switch() at sched_switch+0x713/frame 0xfffffe007679d960 mi_switch() at mi_switch+0x174/frame 0xfffffe007679d990 sched_idletd() at sched_idletd+0x4c4/frame 0xfffffe007679da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007679dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007679dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff800036c45a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0076761570 mi_switch() at mi_switch+0x174/frame 0xfffffe00767615a0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767615e0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe0076761640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0076761670 _sleep() at _sleep+0x2d0/frame 0xfffffe0076761710 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00767617a0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe0076761990 amd64_syscall() at amd64_syscall+0x291/frame 0xfffffe0076761ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0076761ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2b10ca, rsp = 0x7fffffffe778, rbp = 0x7fffffffe7e0 --- Tracing command audit pid 10 tid 100001 td 0xfffff800036c5000 sched_switch() at sched_switch+0x713/frame 0xfffffe007675c910 mi_switch() at mi_switch+0x174/frame 0xfffffe007675c940 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe007675c980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe007675c9b0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe007675ca10 audit_worker() at audit_worker+0x93/frame 0xfffffe007675ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe007675cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007675cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff820866c0 sched_switch() at sched_switch+0x713/frame 0xffffffff828ea980 mi_switch() at mi_switch+0x174/frame 0xffffffff828ea9b0 sleepq_switch() at sleepq_switch+0x110/frame 0xffffffff828ea9f0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xffffffff828eaa30 _sleep() at _sleep+0x279/frame 0xffffffff828eaad0 swapper() at swapper+0x77/frame 0xffffffff828eab20 mi_startup() at mi_startup+0x2ee/frame 0xffffffff828eab70 btext() at btext+0x2c Tracing command kernel pid 0 tid 100015 td 0xfffff800036d3000 sched_switch() at sched_switch+0x713/frame 0xfffffe00767ae900 mi_switch() at mi_switch+0x174/frame 0xfffffe00767ae930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767ae970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00767ae9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00767aea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00767aea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767aeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767aeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffff800036d25a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00767b3900 mi_switch() at mi_switch+0x174/frame 0xfffffe00767b3930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767b3970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00767b39a0 _sleep() at _sleep+0x2da/frame 0xfffffe00767b3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00767b3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767b3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767b3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffff8000371c000 sched_switch() at sched_switch+0x713/frame 0xfffffe00767c2900 mi_switch() at mi_switch+0x174/frame 0xfffffe00767c2930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767c2970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00767c29a0 _sleep() at _sleep+0x2da/frame 0xfffffe00767c2a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00767c2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767c2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767c2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffff8000371b000 sched_switch() at sched_switch+0x713/frame 0xfffffe00767cc930 mi_switch() at mi_switch+0x174/frame 0xfffffe00767cc960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767cc9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00767cc9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00767cca40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00767cca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767ccab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767ccab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffff8000371a5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0000471930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000471960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004719a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004719d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000471a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000471a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000471ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000471ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffff8000371a000 sched_switch() at sched_switch+0x713/frame 0xfffffe0000476930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000476960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004769a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004769d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000476a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000476a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000476ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000476ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffff800037195a0 sched_switch() at sched_switch+0x713/frame 0xfffffe000047b930 mi_switch() at mi_switch+0x174/frame 0xfffffe000047b960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000047b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000047b9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe000047ba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000047ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000047bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000047bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffff80003719000 sched_switch() at sched_switch+0x713/frame 0xfffffe0000480930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000480960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004809a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004809d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000480a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000480a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000480ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000480ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffff800037185a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0000485930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000485960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004859a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004859d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000485a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000485a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000485ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000485ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffff80003718000 sched_switch() at sched_switch+0x713/frame 0xfffffe000048a930 mi_switch() at mi_switch+0x174/frame 0xfffffe000048a960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000048a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000048a9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe000048aa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000048aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000048aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000048aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffff800037515a0 sched_switch() at sched_switch+0x713/frame 0xfffffe000048f930 mi_switch() at mi_switch+0x174/frame 0xfffffe000048f960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000048f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000048f9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe000048fa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000048fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000048fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000048fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffff80003751000 sched_switch() at sched_switch+0x713/frame 0xfffffe0000494930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000494960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004949a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004949d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000494a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000494a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000494ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000494ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffff800037505a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0000499930 mi_switch() at mi_switch+0x174/frame 0xfffffe0000499960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004999a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004999d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000499a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000499a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000499ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000499ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffff80003750000 sched_switch() at sched_switch+0x713/frame 0xfffffe000049e930 mi_switch() at mi_switch+0x174/frame 0xfffffe000049e960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000049e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000049e9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe000049ea40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000049ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000049eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000049eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffff8000374f5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004a3930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004a3960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004a39a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a39d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004a3a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004a3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff8000374f000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004a8930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004a8960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004a89a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a89d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004a8a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004a8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffff8000374e5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004ad930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004ad960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004ad9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004ad9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004ada40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004ada70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004adab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004adab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffff8000374e000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004b2930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004b2960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004b29a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b29d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004b2a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004b2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffff8000371c5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004b7930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004b7960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004b79a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b79d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004b7a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004b7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffff800037a0000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004bc930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004bc960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004bc9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004bc9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004bca40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004bca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004bcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004bcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffff800037ec5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004c1930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004c1960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004c19a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c19d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004c1a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004c1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffff800037ec000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004c6930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004c6960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004c69a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c69d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004c6a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004c6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffff800037eb5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004cb930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004cb960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004cb9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004cb9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004cba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004cba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004cbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004cbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffff800037eb000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004d0930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004d0960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004d09a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004d09d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004d0a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004d0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffff800037ea5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004d5930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004d5960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004d59a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004d59d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004d5a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004d5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffff800037ea000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004da930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004da960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004da9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004da9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004daa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004daa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004daab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004daab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffff800037dc5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00004df930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004df960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004df9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004df9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004dfa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004dfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004dfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004dfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffff800037dc000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004e4930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004e4960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004e49a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004e49d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004e4a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004e4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004e4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004e4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffff80003820000 sched_switch() at sched_switch+0x713/frame 0xfffffe00004e9930 mi_switch() at mi_switch+0x174/frame 0xfffffe00004e9960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004e99a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004e99d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004e9a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffff8000382e5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0000588900 mi_switch() at mi_switch+0x174/frame 0xfffffe0000588930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000588970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005889a0 _sleep() at _sleep+0x2da/frame 0xfffffe0000588a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000588a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000588ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000588ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff800038d4000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005a1900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005a1930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005a1970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005a19a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005a1a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005a1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005a1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005a1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff800038d35a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005a6900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005a6930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005a6970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005a69a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005a6a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005a6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005a6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005a6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff800038d3000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005ab900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005ab930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005ab970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ab9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005aba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005aba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005abab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005abab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffff800038d25a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005b0900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005b0930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005b0970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005b09a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005b0a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005b0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005b0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005b0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff800038d2000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005b5900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005b5930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005b5970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005b59a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005b5a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005b5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005b5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005b5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff800038d15a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005ba900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005ba930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005ba970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ba9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005baa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005baa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005baab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005baab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffff800038d1000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005bf900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005bf930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005bf970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005bf9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005bfa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005bfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005bfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005bfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffff8000392d5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005c4900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005c4930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005c4970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c49a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005c4a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005c4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffff8000392d000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005c9900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005c9930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005c9970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c99a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005c9a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005c9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffff8000392c5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005ce900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005ce930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005ce970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ce9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005cea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005cea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005ceab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005ceab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffff8000392c000 sched_switch() at sched_switch+0x713/frame 0xfffffe00005d3900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005d3930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005d3970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005d39a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005d3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005d3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffff8000392b5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00005d8900 mi_switch() at mi_switch+0x174/frame 0xfffffe00005d8930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005d8970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005d89a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005d8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005d8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffff8000606e000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006ea1930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ea1960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ea19a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ea19d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0006ea1a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006ea1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ea1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ea1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffff8000a3ab5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006edc930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006edc960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006edc9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006edc9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0006edca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006edca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006edcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006edcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffff8000a3ab000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006ee1930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ee1960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ee19a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ee19d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0006ee1a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006ee1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ee1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ee1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100123 td 0xfffff8000a3aa5a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0006ee6930 mi_switch() at mi_switch+0x174/frame 0xfffffe0006ee6960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ee69a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ee69d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0006ee6a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006ee6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ee6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ee6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffff8000a3aa000 sched_switch() at sched_switch+0x713/frame 0xfffffe0006eeb900 mi_switch() at mi_switch+0x174/frame 0xfffffe0006eeb930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006eeb970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006eeb9a0 _sleep() at _sleep+0x2da/frame 0xfffffe0006eeba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0006eeba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eebab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eebab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> dump Dumping 1463 out of 32621 MB:..2%..11%..21%..31%..41%..51%..61%..72%..81%..91% Dump complete db> (kgdb) proc 61295 [Switching to thread 191 (Thread 100434)]#0 cpustop_handler () at ../../../x86/x86/mp_x86.c:1413 1413 use_mwait = (stop_mwait && (cpu_feature2 & CPUID2_MON) != 0 && Current language: auto; currently minimal (kgdb) bt #0 cpustop_handler () at ../../../x86/x86/mp_x86.c:1413 #1 0xffffffff8121b680 in ipi_nmi_handler () at ../../../x86/x86/mp_x86.c:1370 #2 0xffffffff810a0428 in trap (frame=0xfffffe0006bebf30) at ../../../amd64/amd64/trap.c:210 #3 0xffffffff81079c5d in nmi_calltrap () at ../../../amd64/amd64/exception.S:779 #4 0xffffffff80c19cb0 in pctrie_lookup_ge (ptree=, index=0x0) #5 0xffffffff80ef458d in SWAP_PCTRIE_LOOKUP_GE (ptree=0xfffff80003677ad0, key=0x0) at ../../../vm/swap_pager.c:457 #6 0xffffffff80ef6bb0 in swap_pager_swapoff_object (sp=0xfffff8000ae1e380, object=0xfffff80003677a00) at ../../../vm/swap_pager.c:1737 #7 0xffffffff80ef6879 in swap_pager_swapoff (sp=0xfffff8000ae1e380) at ../../../vm/swap_pager.c:1805 #8 0xffffffff80ef4e1e in swapoff_one (sp=0xfffff8000ae1e380, cred=0xfffff8000a45b100) at ../../../vm/swap_pager.c:2413 #9 0xffffffff80ef4c86 in sys_swapoff (td=0xfffff801d3538000, uap=0xfffff801d35383c8) at ../../../vm/swap_pager.c:2368 #10 0xffffffff810a1b51 in amd64_syscall (td=0xfffff801d3538000, traced=0x0) at subr_syscall.c:135 #11 0xffffffff8107982d in fast_syscall_common () at ../../../amd64/amd64/exception.S:504 #12 0x00000008002f88ca in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb) f 5 #5 0xffffffff80ef458d in SWAP_PCTRIE_LOOKUP_GE (ptree=0xfffff80003677ad0, key=0x0) at ../../../vm/swap_pager.c:457 457 PCTRIE_DEFINE(SWAP, swblk, p, swblk_trie_alloc, swblk_trie_free); (kgdb) l 452 { 453 454 uma_zfree(swpctrie_zone, node); 455 } 456 457 PCTRIE_DEFINE(SWAP, swblk, p, swblk_trie_alloc, swblk_trie_free); 458 459 /* 460 * SWP_SIZECHECK() - update swap_pager_full indication 461 * (kgdb) info loc No locals. (kgdb) p *ptree $1 = {pt_root = 0xfffff80226b67360} (kgdb) p *ptree.pt_root $2 = 0x0 (kgdb) f 6 #6 0xffffffff80ef6bb0 in swap_pager_swapoff_object (sp=0xfffff8000ae1e380, object=0xfffff80003677a00) at ../../../vm/swap_pager.c:1737 1737 for (pi = 0; (sb = SWAP_PCTRIE_LOOKUP_GE( (kgdb) l 1732 bool ondev; 1733 1734 s_blk = SWAPBLK_NONE; 1735 s_pindex = 0; 1736 n_blks = 0; 1737 for (pi = 0; (sb = SWAP_PCTRIE_LOOKUP_GE( 1738 &object->un_pager.swp.swp_blks, pi)) != NULL; ) { 1739 for (i = 0; i < SWAP_META_PAGES; i++) { 1740 blk = sb->d[i]; 1741 ondev = swp_pager_isondev(blk, sp); (kgdb) info loc sb = (struct swblk *) 0xfffff803567b8088 pi = 0x0 s_pindex = 0x0 blk = 0x8000000000000000 n_blks = 0x0 s_blk = 0x8000000000000000 i = 0x0 ondev = 0x0 (kgdb) p *sp $3 = {sw_flags = 0x5, sw_nblks = 0x1000000, sw_used = 0x1e02, sw_dev = 0x7e, sw_vp = 0xfffff8000ace09e0, sw_id = 0xfffff8000ae1e400, sw_first = 0x0, sw_end = 0x1000000, sw_blist = 0xfffffe00a9800000, sw_list = {tqe_next = 0x0, tqe_prev = 0xffffffff81b58d78}, sw_strategy = 0xffffffff80ef7940 , sw_close = 0xffffffff80ef7bc0 } (kgdb) p *object $4 = {lock = {lock_object = {lo_name = 0xffffffff81291d9b "vm object", lo_flags = 0x25630000, lo_data = 0x0, lo_witness = 0xfffff8087fd6b780}, rw_lock = 0xfffff801d3538000}, object_list = {tqe_next = 0xfffff80003677b00, tqe_prev = 0xfffff80003677920}, shadow_head = {lh_first = 0x0}, shadow_list = {le_next = 0xfffff8000a9ae800, le_prev = 0xfffff800195b7830}, memq = {tqh_first = 0xfffff8084b53f330, tqh_last = 0xfffff80851c624e0}, rtree = {rt_root = 0xfffff8000aebd5a0}, size = 0x22b, domain = {dr_policy = 0x0, dr_iter = 0x0}, generation = 0x1, ref_count = 0x1, shadow_count = 0x0, memattr = 0x6, type = 0x1, flags = 0x3000, pg_color = 0x46a, paging_in_progress = 0x0, resident_page_count = 0x8, backing_object = 0xfffff800195b7800, backing_object_offset = 0x0, pager_object_list = {tqe_next = 0x0, tqe_prev = 0x0}, rvq = {lh_first = 0x0}, handle = 0x0, un_pager = {vnp = {vnp_size = 0x0, writemappings = 0xfffff80226b67360}, devp = {devp_pglist = {tqh_first = 0x0, tqh_last = 0xfffff80226b67360}, ops = 0x0, dev = 0x0}, sgp = {sgp_pglist = {tqh_first = 0x0, tqh_last = 0xfffff80226b67360}}, swp = {swp_tmpfs = 0x0, swp_blks = { pt_root = 0xfffff80226b67360}}}, cred = 0xfffff8000aa4d800, charge = 0x22b000, umtx_data = 0x0} (kgdb) -- Test scenario: misc/swap5.sh