KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2018 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 12.0-ALPHA8 #0 r339079M: Tue Oct 2 08:12:39 CEST 2018 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 6.0.1 (tags/RELEASE_601/final 335540) (based on LLVM 6.0.1) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Entering uma_startup with 10 boot pages configured startup_alloc from "UMA Kegs", 8 boot pages left startup_alloc from "UMA Zones", 7 boot pages left startup_alloc from "UMA Zones", 6 boot pages left startup_alloc from "UMA Zones", 5 boot pages left startup_alloc from "UMA Zones", 4 boot pages left startup_alloc from "UMA Zones", 3 boot pages left startup_alloc from "UMA Hash", 2 boot pages left startup_alloc from "UMA Zones", 1 boot pages left Entering uma_startup1 with 0 boot pages left Entering uma_startup2 with 0 boot pages left VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.06-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33182433280 (31645 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: unblocking device. ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-47 on motherboard Launching APs: 1 2 6 4 9 8 7 10 3 11 5 Timecounter "TSC-low" frequency 1750031508 Hz quality 1000 random: entropy device external interface module_register_init: MOD_LOAD (vesa, 0xffffffff810eada0, 0) error 19 kbd1 at kbdmux0 random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" netmap: loaded module [ath_hal] loaded nexus0 vtvga0: on motherboard cryptosoft0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: attach_pre capping queues at 8 igb0: using 1024 tx descriptors and 1024 rx descriptors igb0: msix_init qsets capped at 8 igb0: pxm cpus: 6 queue msgs: 9 admincnt: 1 igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: using 6 rx queues 6 tx queues igb0: Using MSIX interrupts with 7 vectors igb0: allocated for 6 tx_queues igb0: allocated for 6 rx_queues igb0: Ethernet address: 0c:c4:7a:a8:cd:da igb0: netmap queues/slots: TX 6/1024, RX 6/1024 igb1: port 0xd000-0xd01f mem 0xfb300000-0xfb31ffff,0xfb340000-0xfb343fff irq 17 at device 0.1 on pci8 igb1: attach_pre capping queues at 8 igb1: using 1024 tx descriptors and 1024 rx descriptors igb1: msix_init qsets capped at 8 igb1: pxm cpus: 6 queue msgs: 9 admincnt: 1 igb1: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb1: using 6 rx queues 6 tx queues igb1: Using MSIX interrupts with 7 vectors igb1: allocated for 6 tx_queues igb1: allocated for 6 rx_queues igb1: Ethernet address: 0c:c4:7a:a8:cd:db igb1: netmap queues/slots: TX 6/1024, RX 6/1024 ehci1: mem 0xfb433000-0xfb4333ff irq 18 at device 29.0 on pci1 usbus2: EHCI version 1.0 usbus2 on ehci1 usbus2: 480Mbps High Speed USB v2.0 isab0: at device 31.0 on pci1 isa0: on isab0 ahci1: port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf000-0xf01f mem 0xfb432000-0xfb4327ff irq 16 at device 31.2 on pci1 ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich4: at channel 0 on ahci1 ahcich5: at channel 1 on ahci1 ahcich6: at channel 2 on ahci1 ahcich7: at channel 3 on ahci1 ahcich8: at channel 4 on ahci1 ahcich9: on ahci1 acpi_button0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 uart1: console (115200,n,8,1) orm0: at iomem 0xc0000-0xc7fff,0xcb000-0xcbfff pnpid ORM0000 on isa0 est0: on cpu0 p4tcc0: on cpu0 NULL mp in getnewvnode(9), tag crossmp Timecounters tick every 1.000 msec ugen0.1: <0x8086 XHCI root HUB> at usbus0 ugen2.1: at usbus2 uhub0: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0 ugen1.1: at usbus1 uhub1: on usbus2 uhub2: on usbus1 Expensive timeout(9) function: 0xffffffff80487dc0(0xfffffe009c030000) 0.004614818 s ada0 at ahcich1 bus 0 scbus1 target 0 lun 0 ada0: ACS-2 ATA SATA 3.x device ada0: Serial Number WD-WCC3F3KDDP98 ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 953869MB (1953525168 512 byte sectors) ada0: quirks=0x1<4K> ses0 at ahciem0 bus 0 scbus4 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device ses1 at ahciem1 bus 0 scbus11 target 0 lun 0 ses1: SEMB S-E-S 2.00 device ses1: SEMB SES Device hwpmc: SOFT/16/64/0x67 TSC/1/64/0x20 IAP/4/48/0x3ff IAF/3/48/0x67 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Expensive timeout(9) function: 0xffffffff80a00050(0xffffffff81af3bd0) 0.007403142 s Trying to mount root from ufs:/dev/gpt/work [rw]... WARNING: / was not properly dismounted uhub1: 2 ports with 2 removable, self powered Interface IP-Address Broadcast ase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 87 files, 248137 used, 1017270 free (118 frags, 127144 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib 32-bit compatibility ldconfig path: /usr/lib32 Setting hostname: mercat1.netperf.freebsd.org. Setting up harvesting: PURE_RDRAND,[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,NET_ETHER,NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . lo0: link state changed to UP Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8802 metric 0 mtu 1500 options=e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko ums0 on uhub4 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff80006047800 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 2 Oct 08:21:21 ntpdate[2051]: step time server 192.168.5.1 offset -1.282361 sec Starting rpcbind. Starting watchdogd. No core dumps found. NFS access cache time=60 lock order reversal: 1st 0xfffffe00008be898 bufwait (bufwait) @ kern/vfs_bio.c:3916 2nd 0xfffff80007c8ec00 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:289 stack backtrace: #0 0xffffffff80bf8cf3 at witness_debugger+0x73 #1 0xffffffff80bf8a43 at witness_checkorder+0xab3 #2 0xffffffff80b99568 at _sx_xlock+0x68 #3 0xffffffff80eb008d at ufsdirhash_add+0x4d #4 0xffffffff80eb4bc2 at ufs_direnter+0x472 #5 0xffffffff80ebd0e0 at ufs_mkdir+0x8f0 #6 0xffffffff811e7c42 at VOP_MKDIR_APV+0xc2 #7 0xffffffff80c7172e at kern_mkdirat+0x1be #8 0xffffffff81068867 at amd64_syscall+0x2a7 #9 0xffffffff81044c4d at fast_syscall_common+0x101 Clearing /tmp (X related). Starting statd. Starting lockd. Updating motd:. Mounting late filesystems:. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Tue Oct 2 08:21 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root Oct 2 08:22:27 mercat1 login[2307]: ROOT LOGIN (root) ON ttyu1 Last login: Mon Oct 1 06:51:36 on ttyu1 FreeBSD 12.0-ALPHA8 (PHO) #0 r339079M: Tue Oct 2 08:12:39 CEST 2018 Welcome to FreeBSD! Release Notes, Errata: https://www.FreeBSD.org/releases/ Security Advisories: https://www.FreeBSD.org/security/ FreeBSD Handbook: https://www.FreeBSD.org/handbook/ FreeBSD FAQ: https://www.FreeBSD.org/faq/ Questions List: https://lists.FreeBSD.org/mailman/listinfo/freebsd-questions/ FreeBSD Forums: https://forums.FreeBSD.org/ Documents installed with the system are in the /usr/local/share/doc/freebsd/ directory, or can be installed later with: pkg install en-freebsd-doc For other languages, replace "en" with a language code like de or fr. Show the version of FreeBSD installed: freebsd-version ; uname -a Please include that output and any error messages when posting questions. Introduction to manual pages: man man FreeBSD directory layout: man hier Edit /etc/motd to change this login announcement. [?1l>root@mercat1:~ # Oct 2 08:22:34 mercat1 su[2324]: pho to root on /dev/pts/0 20181002 08:23:38 all (1/6): pmc.sh 20181002 08:23:41 all (2/6): pmc2.sh Oct 2 08:24:19 mercat1 su[4865]: pho to root on /dev/pts/1 Expensive timeout(9) function: 0xffffffff80ec9eb0(0) 0.608773225 s 20181002 10:52:52 all (1/6): pmc.sh 20181002 10:52:55 all (2/6): pmc2.sh 20181002 11:02:57 all (3/6): pmc3.sh 20181002 11:09:23 all (4/6): pmc4.sh 20181002 11:09:25 all (5/6): pmc5.sh 20181002 11:09:27 all (6/6): pmc6.sh 20181002 11:09:29 all: done Oct 2 11:17:23 mercat1 kernel: pid 4368 (swap), uid 2007, was killed: out of swap space lock order reversal: 1st 0xfffff802d5771068 ufs (ufs) @ kern/vfs_vnops.c:864 2nd 0xffffffff81a02140 proctree (proctree) @ kern/subr_prf.c:180 stack backtrace: #0 0xffffffff80bf8cf3 at witness_debugger+0x73 #1 0xffffffff80bf8a43 at witness_checkorder+0xab3 #2 0xffffffff80b9a798 at _sx_slock_int+0x68 #3 0xffffffff80bdd3ce at uprintf+0x5e #4 0xffffffff80e80e70 at ffs_balloc_ufs2+0x1860 #5 0xffffffff80eaa9de at ffs_write+0x21e #6 0xffffffff811e6b2f at VOP_WRITE_APV+0x13f #7 0xffffffff80c771b3 at vn_write+0x273 #8 0xffffffff80c76b73 at vn_io_fault_doio+0x43 #9 0xffffffff80c74c11 at vn_io_fault1+0x171 #10 0xffffffff80c72ff5 at vn_io_fault+0x195 #11 0xffffffff80bfd517 at dofilewrite+0x97 #12 0xffffffff80bfd13a at kern_writev+0x4a #13 0xffffffff80bfd0e6 at sys_write+0x86 #14 0xffffffff81068867 at amd64_syscall+0x2a7 #15 0xffffffff81044c4d at fast_syscall_common+0x101 Oct 2 11:20:38 mercat1 kernel: pid 11398 (rw), uid 2007 inumber 57860 on /mnt: filesystem full Oct 2 11:20:38 mercat1 kernel: pid 11499 (rw), uid 2007 inumber 56552 on /mnt: filesystem full Oct 2 11:20:56 mercat1 kernel: pid 11434 (rw), uid 2007 inumber 2094 on /mnt: filesystem full Oct 2 11:20:56 mercat1 kernel: pid 11465 (rw), uid 2007 inumber 3598 on /mnt: filesystem full Oct 2 11:21:06 mercat1 kernel: pid 11397 (symlink), uid 2007 inumber 32769 on /mnt: out of inodes Oct 2 11:21:21 mercat1 kernel: pid 11446 (mkdir), uid 2007 inumber 32752 on /mnt: out of inodes Oct 2 11:21:24 mercat1 kernel: pid 11480 (creat), uid 2007 inumber 32836 on /mnt: out of inodes Oct 2 11:21:28 mercat1 kernel: pid 11423 (creat), uid 2007 inumber 32775 on /mnt: out of inodes Oct 2 11:21:37 mercat1 kernel: pid 11501 (creat), uid 2007 inumber 32872 on /mnt: out of inodes Oct 2 11:21:48 mercat1 kernel: pid 11497 (creat), uid 2007 inumber 32840 on /mnt: out of inodes Oct 2 11:21:54 mercat1 kernel: pid 11507 (creat), uid 2007 inumber 32811 on /mnt: out of inodes Oct 2 11:21:58 mercat1 kernel: pid 11433 (creat), uid 2007 inumber 32848 on /mnt: out of inodes Oct 2 11:22:04 mercat1 kernel: pid 11505 (creat), uid 2007 inumber 32822 on /mnt: out of inodes Oct 2 11:22:16 mercat1 kernel: pid 11440 (creat), uid 2007 inumber 32878 on /mnt: out of inodes Oct 2 11:22:20 mercat1 kernel: pid 11431 (mkdir), uid 2007 inumber 130673 on /mnt: out of inodes Oct 2 11:22:28 mercat1 kernel: pid 11497 (creat), uid 2007 inumber 32840 on /mnt: out of inodes Oct 2 11:22:33 mercat1 kernel: pid 11505 (creat), uid 2007 inumber 32822 on /mnt: out of inodes Oct 2 11:23:23 mercat1 kernel: pid 15287 (swap), uid 2007, was killed: out of swap space Oct 2 11:27:05 mercat1 kernel: pid 20416 (rw), uid 2007 inumber 113861 on /mnt: filesystem full Oct 2 11:27:05 mercat1 kernel: pid 20407 (creat), uid 2007 inumber 65561 on /mnt: filesystem full Oct 2 11:27:06 mercat1 kernel: pid 20403 (rw), uid 2007 inumber 117124 on /mnt: filesystem full Oct 2 11:29:12 mercat1 kernel: pid 22057 (rw), uid 2007 inumber 125520 on /mnt: filesystem full Oct 2 11:29:12 mercat1 kernel: pid 22159 (mkdir), uid 2007 inumber 12928 on /mnt: filesystem full Oct 2 11:29:16 mercat1 kernel: pid 22036 (rw), uid 2007 inumber 115607 on /mnt: filesystem full Oct 2 11:29:16 mercat1 kernel: pid 22056 (link), uid 2007 inumber 98323 on /mnt: filesystem full Oct 2 11:29:16 mercat1 kernel: pid 22042 (rw), uid 2007 inumber 116298 on /mnt: filesystem full Oct 2 11:30:15 mercat1 kernel: pid 22084 (creat), uid 2007 inumber 98312 on /mnt: out of inodes Oct 2 11:31:10 mercat1 kernel: pmc_capture_user_callchain took 9573 ticks Oct 2 11:33:31 mercat1 kernel: pid 25733 (rw), uid 2007 inumber 125094 on /mnt: filesystem full Oct 2 11:33:31 mercat1 kernel: pid 25754 (link), uid 2007 inumber 98320 on /mnt: filesystem full Oct 2 11:33:31 mercat1 kernel: pid 25745 (mkdir), uid 2007 inumber 16602 on /mnt: filesystem full Oct 2 11:37:55 mercat1 kernel: pid 32424 (rw), uid 2007 inumber 130369 on /mnt: filesystem full Oct 2 11:37:55 mercat1 kernel: pid 32454 (mkdir), uid 2007 inumber 67956 on /mnt: filesystem full Oct 2 11:38:00 mercat1 kernel: pid 32418 (rw), uid 2007 inumber 115797 on /mnt: filesystem full Oct 2 11:38:00 mercat1 kernel: pid 32303 (link), uid 2007 inumber 33009 on /mnt: filesystem full Oct 2 11:40:09 mercat1 kernel: pid 34671 (rw), uid 2007 inumber 32962 on /mnt: out of inodes Oct 2 11:40:15 mercat1 kernel: pid 34643 (openat), uid 2007 inumber 33181 on /mnt: out of inodes Oct 2 11:41:48 mercat1 kernel: pid 34633 (creat), uid 2007 inumber 33130 on /mnt: out of inodes Oct 2 11:41:56 mercat1 kernel: pid 34605 (creat), uid 2007 inumber 33100 on /mnt: out of inodes Oct 2 11:42:00 mercat1 kernel: pid 34659 (creat), uid 2007 inumber 33198 on /mnt: out of inodes Oct 2 13:39:14 mercat1 kernel: pmc_capture_user_callchain took 2433 ticks Oct 2 13:39:26 mercat1 kernel: pmc_capture_user_callchain took 1339 ticks Oct 2 13:39:27 mercat1 kernel: pmc_capture_user_callchain took 6011 ticks panic: [pmc,4695] pm=0xfffff802d5c32a00 runcount 0 cpuid = 3 time = 1538480788 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0006bc4ca0 vpanic() at vpanic+0x1a3/frame 0xfffffe0006bc4d00 panic() at panic+0x43/frame 0xfffffe0006bc4d60 pmc_add_sample() at pmc_add_sample+0xcb/frame 0xfffffe0006bc4db0 core2_intr() at core2_intr+0x1d2/frame 0xfffffe0006bc4e10 trap() at trap+0x96/frame 0xfffffe0006bc4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc4f20 --- trap 0x13, rip = 0xffffffff8105348a, rsp = 0xfffffe00a95676d0, rbp = 0xfffffe00a9567710 --- pmap_invalidate_page() at pmap_invalidate_page+0x5a/frame 0xfffffe00a9567710 pmap_enter() at pmap_enter+0x89f/frame 0xfffffe00a95677d0 vm_fault_hold() at vm_fault_hold+0x19e6/frame 0xfffffe00a9567910 vm_fault() at vm_fault+0x60/frame 0xfffffe00a9567950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00a95679a0 trap() at trap+0x45a/frame 0xfffffe00a9567ab0 calltrap() at calltrap+0x8/frame 0xfffffe00a9567ab0 --- trap 0xc, rip = 0x217cf9, rsp = 0x7fffffffe1d0, rbp = 0x7fffffffe200 --- KDB: enter: panic [ thread pid 14701 tid 102173 ] Stopped at kdb_enter+0x3b: movq $0,kdb_why db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> bt Tracing pid 14701 tid 102173 td 0xfffff8073c02e000 kdb_enter() at kdb_enter+0x3b/frame 0xfffffe0006bc4ca0 vpanic() at vpanic+0x1c0/frame 0xfffffe0006bc4d00 panic() at panic+0x43/frame 0xfffffe0006bc4d60 pmc_add_sample() at pmc_add_sample+0xcb/frame 0xfffffe0006bc4db0 core2_intr() at core2_intr+0x1d2/frame 0xfffffe0006bc4e10 trap() at trap+0x96/frame 0xfffffe0006bc4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc4f20 --- trap 0x13, rip = 0xffffffff8105348a, rsp = 0xfffffe00a95676d0, rbp = 0xfffffe00a9567710 --- pmap_invalidate_page() at pmap_invalidate_page+0x5a/frame 0xfffffe00a9567710 pmap_enter() at pmap_enter+0x89f/frame 0xfffffe00a95677d0 vm_fault_hold() at vm_fault_hold+0x19e6/frame 0xfffffe00a9567910 vm_fault() at vm_fault+0x60/frame 0xfffffe00a9567950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00a95679a0 trap() at trap+0x45a/frame 0xfffffe00a9567ab0 calltrap() at calltrap+0x8/frame 0xfffffe00a9567ab0 --- trap 0xc, rip = 0x217cf9, rsp = 0x7fffffffe1d0, rbp = 0x7fffffffe200 --- db:1:pho1> show allpcpu Current CPU: 3 cpuid = 0 dynamic pcpu = 0xd42480 curthread = 0xfffff800036af000: pid 11 tid 100003 "idle: cpu0" curpcb = 0xfffffe007875ab80 fpcurthread = none idlethread = 0xfffff800036af000: tid 100003 "idle: cpu0" curpmap = 0xffffffff8208df68 tssp = 0xffffffff821b92a0 commontssp = 0xffffffff821b92a0 rsp0 = 0xfffffe007875ab80 gs32p = 0xffffffff821bfed8 ldt = 0xffffffff821bff18 tss = 0xffffffff821bff08 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe0085017480 curthread = 0xfffff805737ee000: pid 14700 tid 101763 "sh" curpcb = 0xfffffe00a915bb80 fpcurthread = 0xfffff805737ee000: pid 14700 "sh" idlethread = 0xfffff800036ae580: tid 100004 "idle: cpu1" curpmap = 0xfffff804b22a7130 tssp = 0xffffffff821b9308 commontssp = 0xffffffff821b9308 rsp0 = 0xfffffe00a915bb80 gs32p = 0xffffffff821bff40 ldt = 0xffffffff821bff80 tss = 0xffffffff821bff70 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe0085023480 curthread = 0xfffff800036ae000: pid 11 tid 100005 "idle: cpu2" curpcb = 0xfffffe0078764b80 fpcurthread = none idlethread = 0xfffff800036ae000: tid 100005 "idle: cpu2" curpmap = 0xffffffff8208df68 tssp = 0xffffffff821b9370 commontssp = 0xffffffff821b9370 rsp0 = 0xfffffe0078764b80 gs32p = 0xffffffff821bffa8 ldt = 0xffffffff821bffe8 tss = 0xffffffff821bffd8 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe008502f480 curthread = 0xfffff8073c02e000: pid 14701 tid 102173 "sh" curpcb = 0xfffffe00a9567b80 fpcurthread = 0xfffff8073c02e000: pid 14701 "sh" idlethread = 0xfffff800036ad580: tid 100006 "idle: cpu3" curpmap = 0xfffff80150f9d130 tssp = 0xffffffff821b93d8 commontssp = 0xffffffff821b93d8 rsp0 = 0xfffffe00a9567b80 gs32p = 0xffffffff821c0010 ldt = 0xffffffff821c0050 tss = 0xffffffff821c0040 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe008503b480 curthread = 0xfffff8019865e000: pid 14617 tid 101868 "sh" curpcb = 0xfffffe00a836cb80 fpcurthread = none idlethread = 0xfffff800036ad000: tid 100007 "idle: cpu4" curpmap = 0xfffff805737c7130 tssp = 0xffffffff821b9440 commontssp = 0xffffffff821b9440 rsp0 = 0xfffffe00a836cb80 gs32p = 0xffffffff821c0078 ldt = 0xffffffff821c00b8 tss = 0xffffffff821c00a8 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe0085047480 curthread = 0xfffff800036ac580: pid 11 tid 100008 "idle: cpu5" curpcb = 0xfffffe0078773b80 fpcurthread = none idlethread = 0xfffff800036ac580: tid 100008 "idle: cpu5" curpmap = 0xffffffff8208df68 tssp = 0xffffffff821b94a8 commontssp = 0xffffffff821b94a8 rsp0 = 0xfffffe0078773b80 gs32p = 0xffffffff821c00e0 ldt = 0xffffffff821c0120 tss = 0xffffffff821c0110 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe0085053480 curthread = 0xfffff800036ac000: pid 11 tid 100009 "idle: cpu6" curpcb = 0xfffffe0078778b80 fpcurthread = none idlethread = 0xfffff800036ac000: tid 100009 "idle: cpu6" curpmap = 0xffffffff8208df68 tssp = 0xffffffff821b9510 commontssp = 0xffffffff821b9510 rsp0 = 0xfffffe0078778b80 gs32p = 0xffffffff821c0148 ldt = 0xffffffff821c0188 tss = 0xffffffff821c0178 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe008505f480 curthread = 0xfffff800036c0580: pid 11 tid 100010 "idle: cpu7" curpcb = 0xfffffe007877db80 fpcurthread = none idlethread = 0xfffff800036c0580: tid 100010 "idle: cpu7" curpmap = 0xffffffff8208df68 tssp = 0xffffffff821b9578 commontssp = 0xffffffff821b9578 rsp0 = 0xfffffe007877db80 gs32p = 0xffffffff821c01b0 ldt = 0xffffffff821c01f0 tss = 0xffffffff821c01e0 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe007e6db480 curthread = 0xfffff800036c0000: pid 11 tid 100011 "idle: cpu8" curpcb = 0xfffffe0078782b80 fpcurthread = none idlethread = 0xfffff800036c0000: tid 100011 "idle: cpu8" curpmap = 0xffffffff8208df68 tssp = 0xffffffff821b95e0 commontssp = 0xffffffff821b95e0 rsp0 = 0xfffffe0078782b80 gs32p = 0xffffffff821c0218 ldt = 0xffffffff821c0258 tss = 0xffffffff821c0248 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe007e6e7480 curthread = 0xfffff800036bf580: pid 11 tid 100012 "idle: cpu9" curpcb = 0xfffffe0078787b80 fpcurthread = none idlethread = 0xfffff800036bf580: tid 100012 "idle: cpu9" curpmap = 0xffffffff8208df68 tssp = 0xffffffff821b9648 commontssp = 0xffffffff821b9648 rsp0 = 0xfffffe0078787b80 gs32p = 0xffffffff821c0280 ldt = 0xffffffff821c02c0 tss = 0xffffffff821c02b0 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe007e6f3480 curthread = 0xfffff800036bf000: pid 11 tid 100013 "idle: cpu10" curpcb = 0xfffffe007878cb80 fpcurthread = none idlethread = 0xfffff800036bf000: tid 100013 "idle: cpu10" curpmap = 0xffffffff8208df68 tssp = 0xffffffff821b96b0 commontssp = 0xffffffff821b96b0 rsp0 = 0xfffffe007878cb80 gs32p = 0xffffffff821c02e8 ldt = 0xffffffff821c0328 tss = 0xffffffff821c0318 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe007e6ff480 curthread = 0xfffff801930d3580: pid 96968 tid 100246 "pmcstat" curpcb = 0xfffffe00a71d5b80 fpcurthread = 0xfffff801930d3580: pid 96968 "pmcstat" idlethread = 0xfffff800036be580: tid 100014 "idle: cpu11" curpmap = 0xfffff801930e5130 tssp = 0xffffffff821b9718 commontssp = 0xffffffff821b9718 rsp0 = 0xfffffe00a71d5b80 gs32p = 0xffffffff821c0350 ldt = 0xffffffff821c0390 tss = 0xffffffff821c0380 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 14701 (sh) thread 0xfffff8073c02e000 (102173) exclusive rw pmap pv list (pmap pv list) r = 0 (0xffffffff81a48080) locked @ amd64/amd64/pmap.c:5059 exclusive sleep mutex pmap (pmap) r = 0 (0xfffff80150f9d130) locked @ amd64/amd64/pmap.c:4951 shared sx vm map (user) (vm map (user)) r = 0 (0xfffff80150f9d078) locked @ vm/vm_map.c:4075 Process 14700 (sh) thread 0xfffff805737ee000 (101763) exclusive rw pmap pv list (pmap pv list) r = 0 (0xffffffff81a48cc0) locked @ amd64/amd64/pmap.c:6196 exclusive sleep mutex pmap (pmap) r = 0 (0xfffff804b22a7130) locked @ amd64/amd64/pmap.c:6116 Process 14617 (sh) thread 0xfffff8019865e000 (101868) exclusive sleep mutex pmap (pmap) r = 0 (0xfffff805737c7130) locked @ amd64/amd64/pmap.c:4951 shared sx vm map (user) (vm map (user)) r = 0 (0xfffff805737c7078) locked @ vm/vm_map.c:4075 db:1:pho1> show lockedvnods Locked vnodes db:1:pho1> show allchains chain 1: thread 102281 (pid 12588, hwpmc: proc(12583)) sleeping on 0xfffff8014e36c000 "pmcloop" chain 2: thread 102189 (pid 12583, pmcstat) sleeping on 0xfffff8050b50c500 "kqread" chain 3: thread 100364 (pid 96969, hwpmc: proc(96968)) sleeping on 0xfffff80007e94000 "pipewr" chain 4: thread 100147 (pid 4903, bash) sleeping on 0xfffff80007bef528 "wait" chain 5: thread 100316 (pid 4865, csh) sleeping on 0xfffff80193138af8 "pause" chain 6: thread 100165 (pid 4864, su) sleeping on 0xfffff80007e92a50 "wait" chain 7: thread 100249 (pid 4827, bash) sleeping on 0xfffff80150ffca50 "wait" chain 8: thread 100360 (pid 4822, sshd) sleeping on 0xfffff80007651240 "select" chain 9: thread 100366 (pid 4793, sshd) sleeping on 0xfffff800075b8040 "select" chain 10: thread 100235 (pid 2482, sh) sleeping on 0xfffff800182375f0 "piperd" chain 11: thread 100226 (pid 2481, awk) sleeping on 0xfffff80007cf0be0 "piperd" chain 12: thread 100225 (pid 2480, sh) sleeping on 0xfffff80150fd6a50 "wait" chain 13: thread 100175 (pid 2414, sh) sleeping on 0xfffff80007e92528 "wait" chain 14: thread 100179 (pid 2326, bash) sleeping on 0xfffff80007e92000 "wait" chain 15: thread 100192 (pid 2324, csh) sleeping on 0xfffff800060175d0 "pause" chain 16: thread 100218 (pid 2323, su) blocked on lockmgr Pj@EXCL thread 0 (pid -512, ) can run chain 17: thread 100149 (pid 2322, bash) sleeping on 0xfffff800036aa000 "wait" chain 18: thread 100207 (pid 2321, sshd) sleeping on 0xfffff800075b7f40 "select" chain 19: thread 100217 (pid 2318, sshd) sleeping on 0xfffff8000760a2c0 "select" chain 20: thread 100162 (pid 2314, csh) sleeping on 0xfffff800060a94b0 "ttyin" chain 21: thread 100142 (pid 2307, login) sleeping on 0xfffff800036aa528 "wait" chain 22: thread 100216 (pid 2306, getty) sleeping on 0xfffff800060a98b0 "ttyin" chain 23: thread 100215 (pid 2305, getty) sleeping on 0xfffff800076a04b0 "ttyin" chain 24: thread 100214 (pid 2304, getty) sleeping on 0xfffff800076a08b0 "ttyin" chain 25: thread 100213 (pid 2303, getty) sleeping on 0xfffff800076a0cb0 "ttyin" chain 26: thread 100212 (pid 2302, getty) sleeping on 0xfffff800076a10b0 "ttyin" chain 27: thread 100211 (pid 2301, getty) sleeping on 0xfffff800076a14b0 "ttyin" chain 28: thread 100174 (pid 2300, getty) sleeping on 0xfffff800076a18b0 "ttyin" chain 29: thread 100160 (pid 2299, getty) sleeping on 0xfffff800076a1cb0 "ttyin" chain 30: thread 100195 (pid 2298, getty) sleeping on 0xfffff800076a20b0 "ttyin" chain 31: thread 100205 (pid 2252, cron) sleeping on 0xffffffff81e962ba "nanslp" chain 32: thread 100171 (pid 2248, sshd) sleeping on 0xfffff800076f50c0 "select" chain 33: thread 100202 (pid 2183, NLM: master) sleeping on 0xfffff800075e8160 "rpcsvc" chain 34: thread 100199 (pid 2180, rpc.statd) sleeping on 0xfffff80007524f40 "select" chain 35: thread 100154 (pid 2130, watchdogd) sleeping on 0xffffffff81e962ba "nanslp" chain 36: thread 100201 (pid 2054, rpcbind) sleeping on 0xfffff80003e4bec0 "select" chain 37: thread 100200 (pid 2044, syslogd) sleeping on 0xfffff8000774a340 "select" chain 38: thread 100144 (pid 1973, devd) sleeping on 0xfffff80003e4bf40 "select" chain 39: thread 100157 (pid 1968, dhclient) sleeping on 0xfffff8000774a3c0 "select" chain 40: thread 100173 (pid 1924, dhclient) sleeping on 0xfffff80007dd65c0 "select" chain 41: thread 100167 (pid 1921, dhclient) sleeping on 0xfffff800075b9240 "select" chain 42: thread 100133 (pid 34, vnlru) sleeping on 0xfffff800074cea50 "vlruwt" chain 43: thread 100132 (pid 33, syncer) sleeping on 0xffffffff82038700 "syncer" chain 44: thread 100130 (pid 32, bufdaemon) sleeping on 0xffffffff82037ba0 "qsleep" chain 45: thread 100135 (pid 32, bufspacedaemon-0) sleeping on 0xffffffff81a0a580 "-" chain 46: thread 100136 (pid 32, bufspacedaemon-1) sleeping on 0xffffffff81a12840 "-" chain 47: thread 100137 (pid 32, bufspacedaemon-2) sleeping on 0xffffffff81a1ab00 "-" chain 48: thread 100138 (pid 32, bufspacedaemon-3) sleeping on 0xffffffff81a22dc0 "-" chain 49: thread 100139 (pid 32, bufspacedaemon-4) sleeping on 0xffffffff81a2b080 "-" chain 50: thread 100140 (pid 32, bufspacedaemon-5) sleeping on 0xffffffff81a33340 "-" chain 51: thread 100141 (pid 32, bufspacedaemon-6) sleeping on 0xffffffff81a3b600 "-" chain 52: thread 100152 (pid 32, / worker) sleeping on 0xfffff80003e8c8e8 "sdflush" chain 53: thread 100161 (pid 32, /tmp worker) sleeping on 0xfffff80007a204e8 "sdflush" chain 54: thread 100129 (pid 31, vmdaemon) sleeping on 0xffffffff82054a08 "psleep" chain 55: thread 100128 (pid 30, dom0) sleeping on 0xffffffff820b23d8 "psleep" chain 56: thread 100131 (pid 30, laundry: dom0) sleeping on 0xffffffff820b23e4 "launds" chain 57: thread 100134 (pid 30, uma) sleeping on 0xffffffff80ec8dc0 "umarcl" chain 58: thread 100127 (pid 29, enc_daemon1) sleeping on 0xfffff80007407a50 "idle" chain 59: thread 100126 (pid 28, enc_daemon0) sleeping on 0xfffff80007408000 "idle" chain 60: thread 100123 (pid 27, rand_harvestq) sleeping on 0xffffffff81cf5a88 "-" chain 61: thread 100119 (pid 26, sctp_iterator) sleeping on 0xffffffff820b0ac0 "waiting_for_work" chain 62: thread 100118 (pid 25, soaiod4) sleeping on 0xffffffff8203759c "-" chain 63: thread 100117 (pid 24, soaiod3) sleeping on 0xffffffff8203759c "-" chain 64: thread 100116 (pid 23, soaiod2) sleeping on 0xffffffff8203759c "-" chain 65: thread 100115 (pid 22, soaiod1) sleeping on 0xffffffff8203759c "-" chain 66: thread 100096 (pid 21, usbus0) sleeping on 0xfffffe009c1f8460 "-" chain 67: thread 100097 (pid 21, usbus0) sleeping on 0xfffffe009c1f84b8 "-" chain 68: thread 100098 (pid 21, usbus0) sleeping on 0xfffffe009c1f8510 "-" chain 69: thread 100099 (pid 21, usbus0) sleeping on 0xfffffe009c1f8568 "-" chain 70: thread 100100 (pid 21, usbus0) sleeping on 0xfffffe009c1f85c0 "-" chain 71: thread 100102 (pid 21, usbus1) sleeping on 0xfffffe009a006d10 "-" chain 72: thread 100103 (pid 21, usbus1) sleeping on 0xfffffe009a006d68 "-" chain 73: thread 100104 (pid 21, usbus1) sleeping on 0xfffffe009a006dc0 "-" chain 74: thread 100105 (pid 21, usbus1) sleeping on 0xfffffe009a006e18 "-" chain 75: thread 100106 (pid 21, usbus1) sleeping on 0xfffffe009a006e70 "-" chain 76: thread 100107 (pid 21, usbus2) sleeping on 0xfffffe009c651d10 "-" chain 77: thread 100108 (pid 21, usbus2) sleeping on 0xfffffe009c651d68 "-" chain 78: thread 100109 (pid 21, usbus2) sleeping on 0xfffffe009c651dc0 "-" chain 79: thread 100110 (pid 21, usbus2) sleeping on 0xfffffe009c651e18 "-" chain 80: thread 100111 (pid 21, usbus2) sleeping on 0xfffffe009c651e70 "-" chain 81: thread 100091 (pid 20, doneq0) sleeping on 0xffffffff81bd0d40 "-" chain 82: thread 100092 (pid 20, doneq1) sleeping on 0xffffffff81bd0dc0 "-" chain 83: thread 100093 (pid 20, doneq2) sleeping on 0xffffffff81bd0e40 "-" chain 84: thread 100125 (pid 20, scanner) sleeping on 0xffffffff81bd0c08 "-" chain 85: thread 100090 (pid 19, sequencer 00) sleeping on 0xfffff80003895c88 "seqstate" chain 86: thread 100089 (pid 18, crypto returns 11) sleeping on 0xfffff80003922450 "crypto_ret_wait" chain 87: thread 100088 (pid 17, crypto returns 10) sleeping on 0xfffff800039223f0 "crypto_ret_wait" chain 88: thread 100087 (pid 16, crypto returns 9) sleeping on 0xfffff80003922390 "crypto_ret_wait" chain 89: thread 100086 (pid 15, crypto returns 8) sleeping on 0xfffff80003922330 "crypto_ret_wait" chain 90: thread 100085 (pid 14, crypto returns 7) sleeping on 0xfffff800039222d0 "crypto_ret_wait" chain 91: thread 100084 (pid 9, crypto returns 6) sleeping on 0xfffff80003922270 "crypto_ret_wait" chain 92: thread 100083 (pid 8, crypto returns 5) sleeping on 0xfffff80003922210 "crypto_ret_wait" chain 93: thread 100082 (pid 7, crypto returns 4) sleeping on 0xfffff800039221b0 "crypto_ret_wait" chain 94: thread 100081 (pid 6, crypto returns 3) sleeping on 0xfffff80003922150 "crypto_ret_wait" chain 95: thread 100080 (pid 5, crypto returns 2) sleeping on 0xfffff800039220f0 "crypto_ret_wait" chain 96: thread 100079 (pid 4, crypto returns 1) sleeping on 0xfffff80003922090 "crypto_ret_wait" chain 97: thread 100078 (pid 3, crypto returns 0) sleeping on 0xfffff80003922030 "crypto_ret_wait" chain 98: thread 100077 (pid 2, crypto) sleeping on 0xffffffff8204f020 "crypto_wait" chain 99: thread 100061 (pid 13, g_event) sleeping on 0xffffffff8208d310 "-" chain 100: thread 100062 (pid 13, g_up) sleeping on 0xffffffff8208d320 "-" chain 101: thread 100063 (pid 13, g_down) sleeping on 0xffffffff8208d308 "-" chain 102: thread 100002 (pid 1, init) sleeping on 0xfffff800036ab528 "wait" chain 103: thread 100001 (pid 10, audit) sleeping on 0xffffffff820b17e0 "audit_worker_cv" chain 104: thread 100000 (pid 0, swapper) sleeping on 0xffffffff8208d350 "swapin" chain 105: thread 100015 (pid 0, config_0) sleeping on 0xfffff8000368ad00 "-" chain 106: thread 100016 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff800036e5d00 "-" chain 107: thread 100017 (pid 0, aiod_kick taskq) sleeping on 0xfffff800036e5c00 "-" chain 108: thread 100020 (pid 0, thread taskq) sleeping on 0xfffff800036e5700 "-" chain 109: thread 100022 (pid 0, if_config_tqg_0) sleeping on 0xfffff8000368ac00 "-" chain 110: thread 100023 (pid 0, softirq_0) sleeping on 0xfffff8000368ab00 "-" chain 111: thread 100024 (pid 0, softirq_1) sleeping on 0xfffff8000368aa00 "-" chain 112: thread 100025 (pid 0, softirq_2) sleeping on 0xfffff8000368a900 "-" chain 113: thread 100026 (pid 0, softirq_3) sleeping on 0xfffff8000368a800 "-" chain 114: thread 100027 (pid 0, softirq_4) sleeping on 0xfffff8000368a700 "-" chain 115: thread 100028 (pid 0, softirq_5) sleeping on 0xfffff8000368a600 "-" chain 116: thread 100029 (pid 0, softirq_6) sleeping on 0xfffff8000368a500 "-" chain 117: thread 100030 (pid 0, softirq_7) sleeping on 0xfffff8000368a400 "-" chain 118: thread 100031 (pid 0, softirq_8) sleeping on 0xfffff8000368a300 "-" chain 119: thread 100032 (pid 0, softirq_9) sleeping on 0xfffff8000368a200 "-" chain 120: thread 100033 (pid 0, softirq_10) sleeping on 0xfffff8000368a100 "-" chain 121: thread 100034 (pid 0, softirq_11) sleeping on 0xfffff8000368a000 "-" chain 122: thread 100035 (pid 0, if_io_tqg_0) sleeping on 0xfffff80003689e00 "-" chain 123: thread 100036 (pid 0, if_io_tqg_1) sleeping on 0xfffff80003689d00 "-" chain 124: thread 100037 (pid 0, if_io_tqg_2) sleeping on 0xfffff80003689c00 "-" chain 125: thread 100038 (pid 0, if_io_tqg_3) sleeping on 0xfffff800037cd100 "-" chain 126: thread 100039 (pid 0, if_io_tqg_4) sleeping on 0xfffff800037cd000 "-" chain 127: thread 100040 (pid 0, if_io_tqg_5) sleeping on 0xfffff800037cce00 "-" chain 128: thread 100041 (pid 0, if_io_tqg_6) sleeping on 0xfffff800037ccd00 "-" chain 129: thread 100042 (pid 0, if_io_tqg_7) sleeping on 0xfffff800037ccc00 "-" chain 130: thread 100043 (pid 0, if_io_tqg_8) sleeping on 0xfffff800037ccb00 "-" chain 131: thread 100044 (pid 0, if_io_tqg_9) sleeping on 0xfffff800037cca00 "-" chain 132: thread 100045 (pid 0, if_io_tqg_10) sleeping on 0xfffff800037cc900 "-" chain 133: thread 100046 (pid 0, if_io_tqg_11) sleeping on 0xfffff800037cc800 "-" chain 134: thread 100064 (pid 0, firmware taskq) sleeping on 0xfffff800037f0200 "-" chain 135: thread 100065 (pid 0, crypto_0) sleeping on 0xfffff800037f0100 "-" chain 136: thread 100066 (pid 0, crypto_1) sleeping on 0xfffff800037f0100 "-" chain 137: thread 100067 (pid 0, crypto_2) sleeping on 0xfffff800037f0100 "-" chain 138: thread 100068 (pid 0, crypto_3) sleeping on 0xfffff800037f0100 "-" chain 139: thread 100069 (pid 0, crypto_4) sleeping on 0xfffff800037f0100 "-" chain 140: thread 100070 (pid 0, crypto_5) sleeping on 0xfffff800037f0100 "-" chain 141: thread 100071 (pid 0, crypto_6) sleeping on 0xfffff800037f0100 "-" chain 142: thread 100072 (pid 0, crypto_7) sleeping on 0xfffff800037f0100 "-" chain 143: thread 100073 (pid 0, crypto_8) sleeping on 0xfffff800037f0100 "-" chain 144: thread 100074 (pid 0, crypto_9) sleeping on 0xfffff800037f0100 "-" chain 145: thread 100075 (pid 0, crypto_10) sleeping on 0xfffff800037f0100 "-" chain 146: thread 100076 (pid 0, crypto_11) sleeping on 0xfffff800037f0100 "-" chain 147: thread 100114 (pid 0, mca taskq) blocked on lockmgr (null)EXCL KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0006bc43b0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe0006bc43c0 trap() at trap+0x5c/frame 0xfffffe0006bc44d0 calltrap() at calltrap+0x8/frame 0xfffffe0006bc44d0 --- trap 0xc, rip = 0xffffffff80bf0ada, rsp = 0xfffffe0006bc45a0, rbp = 0xfffffe0006bc45c0 --- print_lockchain() at print_lockchain+0x3a/frame 0xfffffe0006bc45c0 db_show_allchains() at db_show_allchains+0x80/frame 0xfffffe0006bc45f0 db_command() at db_command+0x279/frame 0xfffffe0006bc46c0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe0006bc4760 db_command() at db_command+0x279/frame 0xfffffe0006bc4830 db_script_exec() at db_script_exec+0x188/frame 0xfffffe0006bc48d0 db_command() at db_command+0x279/frame 0xfffffe0006bc49a0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe0006bc49b0 db_trap() at db_trap+0xef/frame 0xfffffe0006bc4a40 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe0006bc4ab0 trap() at trap+0x806/frame 0xfffffe0006bc4bc0 calltrap() at calltrap+0x8/frame 0xfffffe0006bc4bc0 --- trap 0x3, rip = 0xffffffff80bd828b, rsp = 0xfffffe0006bc4c90, rbp = 0xfffffe0006bc4ca0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe0006bc4ca0 vpanic() at vpanic+0x1c0/frame 0xfffffe0006bc4d00 panic() at panic+0x43/frame 0xfffffe0006bc4d60 pmc_add_sample() at pmc_add_sample+0xcb/frame 0xfffffe0006bc4db0 core2_intr() at core2_intr+0x1d2/frame 0xfffffe0006bc4e10 trap() at trap+0x96/frame 0xfffffe0006bc4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc4f20 --- trap 0x13, rip = 0xffffffff8105348a, rsp = 0xfffffe00a95676d0, rbp = 0xfffffe00a9567710 --- pmap_invalidate_page() at pmap_invalidate_page+0x5a/frame 0xfffffe00a9567710 pmap_enter() at pmap_enter+0x89f/frame 0xfffffe00a95677d0 vm_fault_hold() at vm_fault_hold+0x19e6/frame 0xfffffe00a9567910 vm_fault() at vm_fault+0x60/frame 0xfffffe00a9567950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00a95679a0 trap() at trap+0x45a/frame 0xfffffe00a9567ab0 calltrap() at calltrap+0x8/frame 0xfffffe00a9567ab0 --- trap 0xc, rip = 0x217cf9, rsp = 0x7fffffffe1d0, rbp = 0x7fffffffe200 --- Script command 'show allchains' returned error db:1:pho1> show mount 0xfffff800078e1000 /dev/gpt/work on / (ufs) 0xfffff800078e2000 devfs on /dev (devfs) 0xfffff80007d82000 /dev/gpt/tmp on /tmp (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 22838 Buf domain 0 freebufs 9548 lofreebufs 219 hifreebufs 329 bufspace 34336768 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 5561 (33882112) dirtyq count 0 (0) wakeup 0 lim 25 CPU 1, 4, 1, 1, 2, 0, 2, 3, 6, 1, 3, 0, Locked buffers: 0 space 0 Total buffers: 17082 space 34336768 Buf domain 1 freebufs 9185 lofreebufs 219 hifreebufs 329 bufspace 48377856 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 26 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 5864 (45764608) dirtyq count 26 (851968) wakeup 0 lim 25 CPU 8, 1, 6, 3, 1, 3, 0, 1, 20, 5, 4, 6, Locked buffers: 0 space 0 Total buffers: 15317 space 48377856 Buf domain 2 freebufs 13533 lofreebufs 219 hifreebufs 329 bufspace 12009472 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 2 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1522 (9981952) dirtyq count 2 (8192) wakeup 0 lim 25 CPU 4, 5, 15, 5, 1, 6, 1, 1, 11, 20, 2, 5, Locked buffers: 0 space 0 Total buffers: 7329 space 12009472 Buf domain 3 freebufs 9393 lofreebufs 219 hifreebufs 329 bufspace 39821312 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 5720 (39522304) dirtyq count 0 (0) wakeup 0 lim 25 CPU 5, 0, 3, 1, 1, 1, 2, 1, 2, 1, 2, 1, Locked buffers: 0 space 0 Total buffers: 16378 space 39821312 Buf domain 4 freebufs 9585 lofreebufs 219 hifreebufs 329 bufspace 32497664 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 5531 (32153600) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 4, 1, 2, 0, 2, 0, 0, 5, 1, 1, 1, Locked buffers: 0 space 0 Total buffers: 20061 space 32497664 Buf domain 5 freebufs 9290 lofreebufs 219 hifreebufs 329 bufspace 42528768 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 5735 (39305216) dirtyq count 1 (4096) wakeup 0 lim 25 CPU 2, 1, 4, 14, 8, 3, 9, 3, 23, 10, 6, 24, Locked buffers: 0 space 0 Total buffers: 13975 space 42528768 Buf domain 6 freebufs 12331 lofreebufs 219 hifreebufs 329 bufspace 13422592 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 2754 (12156928) dirtyq count 0 (0) wakeup 0 lim 25 CPU 6, 2, 2, 8, 2, 0, 11, 3, 3, 8, 1, 2, Locked buffers: 0 space 0 Total buffers: 15789 space 13422592 db:1:pho1> show page vm_cnt.v_free_count: 7765008 vm_cnt.v_inactive_count: 697 vm_cnt.v_active_count: 7497 vm_cnt.v_laundry_count: 46 vm_cnt.v_wire_count: 351463 vm_cnt.v_free_reserved: 10649 vm_cnt.v_free_min: 51289 vm_cnt.v_free_target: 173209 vm_cnt.v_inactive_target: 259813 db:1:pho1> show pageq pq_free 7765008 dom 0 page_cnt 8128423 free 7765008 pq_act 7497 pq_inact 697 pq_laund 46 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000869 | 000000 11 (008192K) | 000490 | 000003 10 (004096K) | 000899 | 000002 09 (002048K) | 001168 | 000008 08 (001024K) | 001555 | 000006 07 (000512K) | 002332 | 000018 06 (000256K) | 003331 | 000071 05 (000128K) | 005001 | 000224 04 (000064K) | 008485 | 000821 03 (000032K) | 013790 | 003144 02 (000016K) | 021529 | 008156 01 (000008K) | 033098 | 016192 00 (000004K) | 035930 | 030063 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000001 | 000000 05 (000128K) | 000001 | 000000 04 (000064K) | 000002 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000001 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000001 | 000000 db:0:pho> acttrace Tracing command sh pid 14701 tid 102173 td 0xfffff8073c02e000 (CPU 3) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe0006bc4ca0 vpanic() at vpanic+0x1c0/frame 0xfffffe0006bc4d00 panic() at panic+0x43/frame 0xfffffe0006bc4d60 pmc_add_sample() at pmc_add_sample+0xcb/frame 0xfffffe0006bc4db0 core2_intr() at core2_intr+0x1d2/frame 0xfffffe0006bc4e10 trap() at trap+0x96/frame 0xfffffe0006bc4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc4f20 --- trap 0x13, rip = 0xffffffff8105348a, rsp = 0xfffffe00a95676d0, rbp = 0xfffffe00a9567710 --- pmap_invalidate_page() at pmap_invalidate_page+0x5a/frame 0xfffffe00a9567710 pmap_enter() at pmap_enter+0x89f/frame 0xfffffe00a95677d0 vm_fault_hold() at vm_fault_hold+0x19e6/frame 0xfffffe00a9567910 vm_fault() at vm_fault+0x60/frame 0xfffffe00a9567950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00a95679a0 trap() at trap+0x45a/frame 0xfffffe00a9567ab0 calltrap() at calltrap+0x8/frame 0xfffffe00a9567ab0 --- trap 0xc, rip = 0x217cf9, rsp = 0x7fffffffe1d0, rbp = 0x7fffffffe200 --- Tracing command sh pid 14700 tid 101763 td 0xfffff805737ee000 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bacdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bace10 trap() at trap+0x49/frame 0xfffffe0006bacf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bacf20 --- trap 0x13, rip = 0xffffffff8105ca10, rsp = 0xfffffe00a915b7e0, rbp = 0xfffffe00a915b8c0 --- pmap_remove_pages() at pmap_remove_pages+0x710/frame 0xfffffe00a915b8c0 vmspace_exit() at vmspace_exit+0x9c/frame 0xfffffe00a915b900 exit1() at exit1+0x5ad/frame 0xfffffe00a915b970 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe00a915b980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a915bab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a915bab0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x800402f2a, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe6c0 --- Tracing command sh pid 14617 tid 101868 td 0xfffff8019865e000 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bd0df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bd0e10 trap() at trap+0x49/frame 0xfffffe0006bd0f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bd0f20 --- trap 0x13, rip = 0xffffffff80bd98a0, rsp = 0xfffffe00a836c610, rbp = 0xfffffe00a836c620 --- lock_delay() at lock_delay+0x40/frame 0xfffffe00a836c620 __rw_wlock_hard() at __rw_wlock_hard+0x1e8/frame 0xfffffe00a836c6d0 _rw_wlock_cookie() at _rw_wlock_cookie+0xc0/frame 0xfffffe00a836c710 pmap_enter() at pmap_enter+0x7c3/frame 0xfffffe00a836c7d0 vm_fault_hold() at vm_fault_hold+0x19e6/frame 0xfffffe00a836c910 vm_fault() at vm_fault+0x60/frame 0xfffffe00a836c950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00a836c9a0 trap() at trap+0x45a/frame 0xfffffe00a836cab0 calltrap() at calltrap+0x8/frame 0xfffffe00a836cab0 --- trap 0xc, rip = 0x20d90f, rsp = 0x7fffffffe210, rbp = 0x7fffffffe290 --- Tracing command pmcstat pid 96968 tid 100246 td 0xfffff801930d3580 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000294df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000294e10 trap() at trap+0x49/frame 0xfffffe0000294f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000294f20 --- trap 0x13, rip = 0x210f50, rsp = 0x7fffffffc200, rbp = 0x7fffffffc230 --- Tracing command idle pid 11 tid 100003 td 0xfffff800036af000 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff82058d70 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xffffffff82058d90 trap() at trap+0x49/frame 0xffffffff82058ea0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff82058ea0 --- trap 0x13, rip = 0xffffffff811cb606, rsp = 0xfffffe007875a910, rbp = 0xfffffe007875a910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007875a910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe007875a960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007875a980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007875a9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007875aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007875aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007875aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff800036ae000 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bb8df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bb8e10 trap() at trap+0x49/frame 0xfffffe0006bb8f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bb8f20 --- trap 0x13, rip = 0xffffffff811cb606, rsp = 0xfffffe0078764910, rbp = 0xfffffe0078764910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078764910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe0078764960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078764980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00787649a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078764a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078764ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078764ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff800036ac580 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bdcdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bdce10 trap() at trap+0x49/frame 0xfffffe0006bdcf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bdcf20 --- trap 0x13, rip = 0xffffffff811cb606, rsp = 0xfffffe0078773910, rbp = 0xfffffe0078773910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078773910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe0078773960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078773980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00787739a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078773a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078773ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078773ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff800036ac000 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006be8df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006be8e10 trap() at trap+0x49/frame 0xfffffe0006be8f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006be8f20 --- trap 0x13, rip = 0xffffffff811cb606, rsp = 0xfffffe0078778910, rbp = 0xfffffe0078778910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078778910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe0078778960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078778980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00787789a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078778a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078778ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078778ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff800036c0580 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bf4df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bf4e10 trap() at trap+0x49/frame 0xfffffe0006bf4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bf4f20 --- trap 0x13, rip = 0xffffffff811cb606, rsp = 0xfffffe007877d910, rbp = 0xfffffe007877d910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007877d910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe007877d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007877d980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007877d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007877da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007877dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007877dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff800036c0000 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000270df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000270e10 trap() at trap+0x49/frame 0xfffffe0000270f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000270f20 --- trap 0x13, rip = 0xffffffff811cb606, rsp = 0xfffffe0078782910, rbp = 0xfffffe0078782910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078782910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe0078782960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078782980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00787829a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078782a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078782ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078782ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff800036bf580 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe000027cdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe000027ce10 trap() at trap+0x49/frame 0xfffffe000027cf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe000027cf20 --- trap 0x13, rip = 0xffffffff811cb606, rsp = 0xfffffe0078787910, rbp = 0xfffffe0078787910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078787910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe0078787960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078787980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00787879a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078787a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078787ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078787ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff800036bf000 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000288df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000288e10 trap() at trap+0x49/frame 0xfffffe0000288f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000288f20 --- trap 0x13, rip = 0xffffffff811cb606, rsp = 0xfffffe007878c910, rbp = 0xfffffe007878c910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007878c910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe007878c960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007878c980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007878c9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007878ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe007878cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007878cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 14701 14617 2414 0 R CPU 3 sh 14700 14617 2414 0 RE CPU 1 sh 14617 2480 2414 0 R CPU 4 sh 12588 0 0 0 DL pmcloop 0xfffff8014e36c000 [hwpmc: proc(12583)] 12583 4903 12583 0 S+ kqread 0xfffff8050b50c500 pmcstat 96969 0 0 0 SL pipewr 0xfffff80007e94000 [hwpmc: proc(96968)] 96968 2326 96968 0 R+ CPU 11 pmcstat 4903 4865 4903 0 S+ wait 0xfffff80007bef528 bash 4865 4864 4865 0 SW+ pause 0xfffff80193138af8 csh 4864 4827 4864 2006 SW+ wait 0xfffff80007e92a50 su 4827 4822 4827 2006 SWs+ wait 0xfffff80150ffca50 bash 4822 4793 4793 2006 S select 0xfffff80007651240 sshd 4793 2248 4793 0 Ss select 0xfffff800075b8040 sshd 2482 2414 2414 0 S piperd 0xfffff800182375f0 sh 2481 2414 2414 0 S piperd 0xfffff80007cf0be0 awk 2480 2414 2414 0 S wait 0xfffff80150fd6a50 sh 2414 1 2414 0 SWs wait 0xfffff80007e92528 sh 2326 2324 2326 0 SW+ wait 0xfffff80007e92000 bash 2324 2323 2324 0 SW+ pause 0xfffff800060175d0 csh 2323 2322 2323 2006 SW+ wait 0xfffff80007a63a50 su 2322 2321 2322 2006 SWs+ wait 0xfffff800036aa000 bash 2321 2318 2318 2006 S select 0xfffff800075b7f40 sshd 2318 2248 2318 0 Ss select 0xfffff8000760a2c0 sshd 2314 2307 2314 0 S+ ttyin 0xfffff800060a94b0 csh 2307 1 2307 0 SWs+ wait 0xfffff800036aa528 login 2306 1 2306 0 Ss+ ttyin 0xfffff800060a98b0 getty 2305 1 2305 0 Ss+ ttyin 0xfffff800076a04b0 getty 2304 1 2304 0 Ss+ ttyin 0xfffff800076a08b0 getty 2303 1 2303 0 Ss+ ttyin 0xfffff800076a0cb0 getty 2302 1 2302 0 Ss+ ttyin 0xfffff800076a10b0 getty 2301 1 2301 0 Ss+ ttyin 0xfffff800076a14b0 getty 2300 1 2300 0 Ss+ ttyin 0xfffff800076a18b0 getty 2299 1 2299 0 Ss+ ttyin 0xfffff800076a1cb0 getty 2298 1 2298 0 Ss+ ttyin 0xfffff800076a20b0 getty 2252 1 2252 0 Ss nanslp 0xffffffff81e962ba cron 2248 1 2248 0 Ss select 0xfffff800076f50c0 sshd 2183 1 2183 0 Ss rpcsvc 0xfffff800075e8160 NLM: master 2180 1 2180 0 Ss select 0xfffff80007524f40 rpc.statd 2130 1 2130 0 Ss nanslp 0xffffffff81e962ba watchdogd 2054 1 2054 0 Ss select 0xfffff80003e4bec0 rpcbind 2044 1 2044 0 Ss select 0xfffff8000774a340 syslogd 1973 1 1973 0 Ss select 0xfffff80003e4bf40 devd 1968 1 1968 65 Ss select 0xfffff8000774a3c0 dhclient 1924 1 1924 0 Ss select 0xfffff80007dd65c0 dhclient 1921 1 1921 0 Ss select 0xfffff800075b9240 dhclient 34 0 0 0 DL vlruwt 0xfffff800074cea50 [vnlru] 33 0 0 0 DL syncer 0xffffffff82038700 [syncer] 32 0 0 0 DL (threaded) [bufdaemon] 100130 D qsleep 0xffffffff82037ba0 [bufdaemon] 100135 D - 0xffffffff81a0a580 [bufspacedaemon-0] 100136 D - 0xffffffff81a12840 [bufspacedaemon-1] 100137 D - 0xffffffff81a1ab00 [bufspacedaemon-2] 100138 D - 0xffffffff81a22dc0 [bufspacedaemon-3] 100139 D - 0xffffffff81a2b080 [bufspacedaemon-4] 100140 D - 0xffffffff81a33340 [bufspacedaemon-5] 100141 D - 0xffffffff81a3b600 [bufspacedaemon-6] 100152 D sdflush 0xfffff80003e8c8e8 [/ worker] 100161 D sdflush 0xfffff80007a204e8 [/tmp worker] 31 0 0 0 DL psleep 0xffffffff82054a08 [vmdaemon] 30 0 0 0 DL (threaded) [pagedaemon] 100128 D psleep 0xffffffff820b23d8 [dom0] 100131 D launds 0xffffffff820b23e4 [laundry: dom0] 100134 D umarcl 0xffffffff80ec8dc0 [uma] 29 0 0 0 DL idle 0xfffff80007407a50 [enc_daemon1] 28 0 0 0 DL idle 0xfffff80007408000 [enc_daemon0] 27 0 0 0 DL - 0xffffffff81cf5a88 [rand_harvestq] 26 0 0 0 DL waiting 0xffffffff820b0ac0 [sctp_iterator] 25 0 0 0 DL - 0xffffffff8203759c [soaiod4] 24 0 0 0 DL - 0xffffffff8203759c [soaiod3] 23 0 0 0 DL - 0xffffffff8203759c [soaiod2] 22 0 0 0 DL - 0xffffffff8203759c [soaiod1] 21 0 0 0 DL (threaded) [usb] 100096 D - 0xfffffe009c1f8460 [usbus0] 100097 D - 0xfffffe009c1f84b8 [usbus0] 100098 D - 0xfffffe009c1f8510 [usbus0] 100099 D - 0xfffffe009c1f8568 [usbus0] 100100 D - 0xfffffe009c1f85c0 [usbus0] 100102 D - 0xfffffe009a006d10 [usbus1] 100103 D - 0xfffffe009a006d68 [usbus1] 100104 D - 0xfffffe009a006dc0 [usbus1] 100105 D - 0xfffffe009a006e18 [usbus1] 100106 D - 0xfffffe009a006e70 [usbus1] 100107 D - 0xfffffe009c651d10 [usbus2] 100108 D - 0xfffffe009c651d68 [usbus2] 100109 D - 0xfffffe009c651dc0 [usbus2] 100110 D - 0xfffffe009c651e18 [usbus2] 100111 D - 0xfffffe009c651e70 [usbus2] 20 0 0 0 DL (threaded) [cam] 100091 D - 0xffffffff81bd0d40 [doneq0] 100092 D - 0xffffffff81bd0dc0 [doneq1] 100093 D - 0xffffffff81bd0e40 [doneq2] 100125 D - 0xffffffff81bd0c08 [scanner] 19 0 0 0 DL seqstat 0xfffff80003895c88 [sequencer 00] 18 0 0 0 DL crypto_ 0xfffff80003922450 [crypto returns 11] 17 0 0 0 DL crypto_ 0xfffff800039223f0 [crypto returns 10] 16 0 0 0 DL crypto_ 0xfffff80003922390 [crypto returns 9] 15 0 0 0 DL crypto_ 0xfffff80003922330 [crypto returns 8] 14 0 0 0 DL crypto_ 0xfffff800039222d0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff80003922270 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff80003922210 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff800039221b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff80003922150 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff800039220f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff80003922090 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff80003922030 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff8204f020 [crypto] 13 0 0 0 DL (threaded) [geom] 100061 D - 0xffffffff8208d310 [g_event] 100062 D - 0xffffffff8208d320 [g_up] 100063 D - 0xffffffff8208d308 [g_down] 12 0 0 0 WL (threaded) [intr] 100018 I [swi6: task queue] 100019 I [swi6: Giant taskq] 100021 I [swi5: fast taskq] 100047 I [swi3: vm] 100048 I [swi1: netisr 0] 100049 I [swi4: clock (0)] 100050 I [swi4: clock (1)] 100051 I [swi4: clock (2)] 100052 I [swi4: clock (3)] 100053 I [swi4: clock (4)] 100054 I [swi4: clock (5)] 100055 I [swi4: clock (6)] 100056 I [swi4: clock (7)] 100057 I [swi4: clock (8)] 100058 I [swi4: clock (9)] 100059 I [swi4: clock (10)] 100060 I [swi4: clock (11)] 100094 I [irq264: ahci0] 100095 I [irq19: xhci0] 100101 I [irq18: ehci0 ehci1] 100112 I [irq279: ahci1] 100113 I [swi0: uart uart] 100184 I [irq280: ioat0] 100185 I [irq281: ioat1] 100186 I [irq282: ioat2] 100187 I [irq283: ioat3] 100188 I [irq284: ioat4] 100189 I [irq285: ioat5] 100190 I [irq286: ioat6] 100191 I [irq287: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 CanRun [idle: cpu3] 100007 CanRun [idle: cpu4] 100008 Run CPU 5 [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 Run CPU 7 [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 Run CPU 9 [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 CanRun [idle: cpu11] 1 0 1 0 SLs wait 0xfffff800036ab528 [init] 10 0 0 0 DL audit_w 0xffffffff820b17e0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff8208d350 [swapper] 100015 D - 0xfffff8000368ad00 [config_0] 100016 D - 0xfffff800036e5d00 [kqueue_ctx taskq] 100017 D - 0xfffff800036e5c00 [aiod_kick taskq] 100020 D - 0xfffff800036e5700 [thread taskq] 100022 D - 0xfffff8000368ac00 [if_config_tqg_0] 100023 D - 0xfffff8000368ab00 [softirq_0] 100024 D - 0xfffff8000368aa00 [softirq_1] 100025 D - 0xfffff8000368a900 [softirq_2] 100026 D - 0xfffff8000368a800 [softirq_3] 100027 D - 0xfffff8000368a700 [softirq_4] 100028 D - 0xfffff8000368a600 [softirq_5] 100029 D - 0xfffff8000368a500 [softirq_6] 100030 D - 0xfffff8000368a400 [softirq_7] 100031 D - 0xfffff8000368a300 [softirq_8] 100032 D - 0xfffff8000368a200 [softirq_9] 100033 D - 0xfffff8000368a100 [softirq_10] 100034 D - 0xfffff8000368a000 [softirq_11] 100035 D - 0xfffff80003689e00 [if_io_tqg_0] 100036 D - 0xfffff80003689d00 [if_io_tqg_1] 100037 D - 0xfffff80003689c00 [if_io_tqg_2] 100038 D - 0xfffff800037cd100 [if_io_tqg_3] 100039 D - 0xfffff800037cd000 [if_io_tqg_4] 100040 D - 0xfffff800037cce00 [if_io_tqg_5] 100041 D - 0xfffff800037ccd00 [if_io_tqg_6] 100042 D - 0xfffff800037ccc00 [if_io_tqg_7] 100043 D - 0xfffff800037ccb00 [if_io_tqg_8] 100044 D - 0xfffff800037cca00 [if_io_tqg_9] 100045 D - 0xfffff800037cc900 [if_io_tqg_10] 100046 D - 0xfffff800037cc800 [if_io_tqg_11] 100064 D - 0xfffff800037f0200 [firmware taskq] 100065 D - 0xfffff800037f0100 [crypto_0] 100066 D - 0xfffff800037f0100 [crypto_1] 100067 D - 0xfffff800037f0100 [crypto_2] 100068 D - 0xfffff800037f0100 [crypto_3] 100069 D - 0xfffff800037f0100 [crypto_4] 100070 D - 0xfffff800037f0100 [crypto_5] 100071 D - 0xfffff800037f0100 [crypto_6] 100072 D - 0xfffff800037f0100 [crypto_7] 100073 D - 0xfffff800037f0100 [crypto_8] 100074 D - 0xfffff800037f0100 [crypto_9] 100075 D - 0xfffff800037f0100 [crypto_10] 100076 D - 0xfffff800037f0100 [crypto_11] 100114 D - 0xfffff800060dda00 [mca taskq] 100120 D - 0xfffff8000751c500 [acpi_task_0] 100121 D - 0xfffff8000751c500 [acpi_task_1] 100122 D - 0xfffff8000751c500 [acpi_task_2] 100124 D - 0xfffff800037f0000 [CAM taskq] db:0:pho> allt Tracing command sh pid 14701 tid 102173 td 0xfffff8073c02e000 (CPU 3) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe0006bc4ca0 vpanic() at vpanic+0x1c0/frame 0xfffffe0006bc4d00 panic() at panic+0x43/frame 0xfffffe0006bc4d60 pmc_add_sample() at pmc_add_sample+0xcb/frame 0xfffffe0006bc4db0 core2_intr() at core2_intr+0x1d2/frame 0xfffffe0006bc4e10 trap() at trap+0x96/frame 0xfffffe0006bc4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc4f20 --- trap 0x13, rip = 0xffffffff8105348a, rsp = 0xfffffe00a95676d0, rbp = 0xfffffe00a9567710 --- pmap_invalidate_page() at pmap_invalidate_page+0x5a/frame 0xfffffe00a9567710 pmap_enter() at pmap_enter+0x89f/frame 0xfffffe00a95677d0 vm_fault_hold() at vm_fault_hold+0x19e6/frame 0xfffffe00a9567910 vm_fault() at vm_fault+0x60/frame 0xfffffe00a9567950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00a95679a0 trap() at trap+0x45a/frame 0xfffffe00a9567ab0 calltrap() at calltrap+0x8/frame 0xfffffe00a9567ab0 --- trap 0xc, rip = 0x217cf9, rsp = 0x7fffffffe1d0, rbp = 0x7fffffffe200 --- Tracing command sh pid 14700 tid 101763 td 0xfffff805737ee000 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bacdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bace10 trap() at trap+0x49/frame 0xfffffe0006bacf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bacf20 --- trap 0x13, rip = 0xffffffff8105ca10, rsp = 0xfffffe00a915b7e0, rbp = 0xfffffe00a915b8c0 --- pmap_remove_pages() at pmap_remove_pages+0x710/frame 0xfffffe00a915b8c0 vmspace_exit() at vmspace_exit+0x9c/frame 0xfffffe00a915b900 exit1() at exit1+0x5ad/frame 0xfffffe00a915b970 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe00a915b980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a915bab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a915bab0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x800402f2a, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe6c0 --- Tracing command sh pid 14617 tid 101868 td 0xfffff8019865e000 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bd0df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bd0e10 trap() at trap+0x49/frame 0xfffffe0006bd0f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bd0f20 --- trap 0x13, rip = 0xffffffff80bd98a0, rsp = 0xfffffe00a836c610, rbp = 0xfffffe00a836c620 --- lock_delay() at lock_delay+0x40/frame 0xfffffe00a836c620 __rw_wlock_hard() at __rw_wlock_hard+0x1e8/frame 0xfffffe00a836c6d0 _rw_wlock_cookie() at _rw_wlock_cookie+0xc0/frame 0xfffffe00a836c710 pmap_enter() at pmap_enter+0x7c3/frame 0xfffffe00a836c7d0 vm_fault_hold() at vm_fault_hold+0x19e6/frame 0xfffffe00a836c910 vm_fault() at vm_fault+0x60/frame 0xfffffe00a836c950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00a836c9a0 trap() at trap+0x45a/frame 0xfffffe00a836cab0 calltrap() at calltrap+0x8/frame 0xfffffe00a836cab0 --- trap 0xc, rip = 0x20d90f, rsp = 0x7fffffffe210, rbp = 0x7fffffffe290 --- Tracing command hwpmc: proc(12583) pid 12588 tid 102281 td 0xfffff8073c481000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a9785860 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a9785890 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a97858d0 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00a9785910 _sleep() at _sleep+0x2fc/frame 0xfffffe00a97859b0 pmclog_loop() at pmclog_loop+0x3a3/frame 0xfffffe00a9785a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a9785ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a9785ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pmcstat pid 12583 tid 102189 td 0xfffff8073c183000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a95b73a0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a95b73d0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a95b7410 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a95b7470 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a95b74a0 _sleep() at _sleep+0x34e/frame 0xfffffe00a95b7540 kqueue_kevent() at kqueue_kevent+0xa81/frame 0xfffffe00a95b7810 kern_kevent_fp() at kern_kevent_fp+0x97/frame 0xfffffe00a95b7860 kern_kevent() at kern_kevent+0x9f/frame 0xfffffe00a95b78c0 kern_kevent_generic() at kern_kevent_generic+0x71/frame 0xfffffe00a95b7920 sys_kevent() at sys_kevent+0x61/frame 0xfffffe00a95b7980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a95b7ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a95b7ab0 --- syscall (560, FreeBSD ELF64, sys_kevent), rip = 0x8008efb1a, rsp = 0x7fffffffe3a8, rbp = 0x7fffffffea10 --- Tracing command hwpmc: proc(96968) pid 96969 tid 100364 td 0xfffff802b9923000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a79e9760 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a79e9790 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a79e97d0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a79e9830 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a79e9860 _sleep() at _sleep+0x34e/frame 0xfffffe00a79e9900 pipe_write() at pipe_write+0x9ac/frame 0xfffffe00a79e99b0 pmclog_loop() at pmclog_loop+0x2ab/frame 0xfffffe00a79e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a79e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a79e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pmcstat pid 96968 tid 100246 td 0xfffff801930d3580 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000294df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000294e10 trap() at trap+0x49/frame 0xfffffe0000294f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000294f20 --- trap 0x13, rip = 0x210f50, rsp = 0x7fffffffc200, rbp = 0x7fffffffc230 --- Tracing command bash pid 4903 tid 100147 td 0xfffff80007bf2000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f67560 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f67590 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f675d0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006f67630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0006f67660 _sleep() at _sleep+0x34e/frame 0xfffffe0006f67700 kern_wait6() at kern_wait6+0x4af/frame 0xfffffe0006f67790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe0006f67980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe0006f67ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006f67ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800aff03a, rsp = 0x7fffffffe678, rbp = 0x7fffffffe6c0 --- Tracing command csh pid 4865 tid 100316 td 0xfffff80193152000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0006bc44c0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe0006bc44d0 trap() at trap+0x5c/frame 0xfffffe0006bc45e0 calltrap() at calltrap+0x8/frame 0xfffffe0006bc45e0 --- trap 0xc, rip = 0xffffffff81042546, rsp = 0xfffffe0006bc46b0, rbp = 0xfffffe0006bc46c0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe0006bc46c0 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe0006bc4760 db_command() at db_command+0x279/frame 0xfffffe0006bc4830 db_script_exec() at db_script_exec+0x188/frame 0xfffffe0006bc48d0 db_command() at db_command+0x279/frame 0xfffffe0006bc49a0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe0006bc49b0 db_trap() at db_trap+0xef/frame 0xfffffe0006bc4a40 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe0006bc4ab0 trap() at trap+0x806/frame 0xfffffe0006bc4bc0 calltrap() at calltrap+0x8/frame 0xfffffe0006bc4bc0 --- trap 0x3, rip = 0xffffffff80bd828b, rsp = 0xfffffe0006bc4c90, rbp = 0xfffffe0006bc4ca0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe0006bc4ca0 vpanic() at vpanic+0x1c0/frame 0xfffffe0006bc4d00 panic() at panic+0x43/frame 0xfffffe0006bc4d60 pmc_add_sample() at pmc_add_sample+0xcb/frame 0xfffffe0006bc4db0 core2_intr() at core2_intr+0x1d2/frame 0xfffffe0006bc4e10 trap() at trap+0x96/frame 0xfffffe0006bc4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc4f20 --- trap 0x13, rip = 0xffffffff8105348a, rsp = 0xfffffe00a95676d0, rbp = 0xfffffe00a9567710 --- pmap_invalidate_page() at pmap_invalidate_page+0x5a/frame 0xfffffe00a9567710 pmap_enter() at pmap_enter+0x89f/frame 0xfffffe00a95677d0 vm_fault_hold() at vm_fault_hold+0x19e6/frame 0xfffffe00a9567910 vm_fault() at vm_fault+0x60/frame 0xfffffe00a9567950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00a95679a0 trap() at trap+0x45a/frame 0xfffffe00a9567ab0 calltrap() at calltrap+0x8/frame 0xfffffe00a9567ab0 --- trap 0xc, rip = 0x217cf9, rsp = 0x7fffffffe1d0, rbp = 0x7fffffffe200 --- Tracing command su pid 4864 tid 100165 td 0xfffff800078f4580 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0006bc44c0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe0006bc44d0 trap() at trap+0x5c/frame 0xfffffe0006bc45e0 calltrap() at calltrap+0x8/frame 0xfffffe0006bc45e0 --- trap 0xc, rip = 0xffffffff81042546, rsp = 0xfffffe0006bc46b0, rbp = 0xfffffe0006bc46c0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe0006bc46c0 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe0006bc4760 db_command() at db_command+0x279/frame 0xfffffe0006bc4830 db_script_exec() at db_script_exec+0x188/frame 0xfffffe0006bc48d0 db_command() at db_command+0x279/frame 0xfffffe0006bc49a0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe0006bc49b0 db_trap() at db_trap+0xef/frame 0xfffffe0006bc4a40 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe0006bc4ab0 trap() at trap+0x806/frame 0xfffffe0006bc4bc0 calltrap() at calltrap+0x8/frame 0xfffffe0006bc4bc0 --- trap 0x3, rip = 0xffffffff80bd828b, rsp = 0xfffffe0006bc4c90, rbp = 0xfffffe0006bc4ca0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe0006bc4ca0 vpanic() at vpanic+0x1c0/frame 0xfffffe0006bc4d00 panic() at panic+0x43/frame 0xfffffe0006bc4d60 pmc_add_sample() at pmc_add_sample+0xcb/frame 0xfffffe0006bc4db0 core2_intr() at core2_intr+0x1d2/frame 0xfffffe0006bc4e10 trap() at trap+0x96/frame 0xfffffe0006bc4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc4f20 --- trap 0x13, rip = 0xffffffff8105348a, rsp = 0xfffffe00a95676d0, rbp = 0xfffffe00a9567710 --- pmap_invalidate_page() at pmap_invalidate_page+0x5a/frame 0xfffffe00a9567710 pmap_enter() at pmap_enter+0x89f/frame 0xfffffe00a95677d0 vm_fault_hold() at vm_fault_hold+0x19e6/frame 0xfffffe00a9567910 vm_fault() at vm_fault+0x60/frame 0xfffffe00a9567950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00a95679a0 trap() at trap+0x45a/frame 0xfffffe00a9567ab0 calltrap() at calltrap+0x8/frame 0xfffffe00a9567ab0 --- trap 0xc, rip = 0x217cf9, rsp = 0x7fffffffe1d0, rbp = 0x7fffffffe200 --- Tracing command bash pid 4827 tid 100249 td 0xfffff80150880580 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0006bc44c0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe0006bc44d0 trap() at trap+0x5c/frame 0xfffffe0006bc45e0 calltrap() at calltrap+0x8/frame 0xfffffe0006bc45e0 --- trap 0xc, rip = 0xffffffff81042546, rsp = 0xfffffe0006bc46b0, rbp = 0xfffffe0006bc46c0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe0006bc46c0 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe0006bc4760 db_command() at db_command+0x279/frame 0xfffffe0006bc4830 db_script_exec() at db_script_exec+0x188/frame 0xfffffe0006bc48d0 db_command() at db_command+0x279/frame 0xfffffe0006bc49a0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe0006bc49b0 db_trap() at db_trap+0xef/frame 0xfffffe0006bc4a40 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe0006bc4ab0 trap() at trap+0x806/frame 0xfffffe0006bc4bc0 calltrap() at calltrap+0x8/frame 0xfffffe0006bc4bc0 --- trap 0x3, rip = 0xffffffff80bd828b, rsp = 0xfffffe0006bc4c90, rbp = 0xfffffe0006bc4ca0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe0006bc4ca0 vpanic() at vpanic+0x1c0/frame 0xfffffe0006bc4d00 panic() at panic+0x43/frame 0xfffffe0006bc4d60 pmc_add_sample() at pmc_add_sample+0xcb/frame 0xfffffe0006bc4db0 core2_intr() at core2_intr+0x1d2/frame 0xfffffe0006bc4e10 trap() at trap+0x96/frame 0xfffffe0006bc4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc4f20 --- trap 0x13, rip = 0xffffffff8105348a, rsp = 0xfffffe00a95676d0, rbp = 0xfffffe00a9567710 --- pmap_invalidate_page() at pmap_invalidate_page+0x5a/frame 0xfffffe00a9567710 pmap_enter() at pmap_enter+0x89f/frame 0xfffffe00a95677d0 vm_fault_hold() at vm_fault_hold+0x19e6/frame 0xfffffe00a9567910 vm_fault() at vm_fault+0x60/frame 0xfffffe00a9567950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00a95679a0 trap() at trap+0x45a/frame 0xfffffe00a9567ab0 calltrap() at calltrap+0x8/frame 0xfffffe00a9567ab0 --- trap 0xc, rip = 0x217cf9, rsp = 0x7fffffffe1d0, rbp = 0x7fffffffe200 --- Tracing command sshd pid 4822 tid 100360 td 0xfffff802b935f580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a79d55c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a79d55f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a79d5630 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a79d5690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a79d56c0 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a79d5720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a79d5760 kern_select() at kern_select+0x8bf/frame 0xfffffe00a79d5940 sys_select() at sys_select+0x56/frame 0xfffffe00a79d5980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a79d5ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a79d5ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80087762a, rsp = 0x7fffffffa598, rbp = 0x7fffffffa5d0 --- Tracing command sshd pid 4793 tid 100366 td 0xfffff80193301580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a79f3640 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a79f3670 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a79f36b0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a79f3710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a79f3740 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a79f37a0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a79f37e0 kern_poll() at kern_poll+0x43a/frame 0xfffffe00a79f3960 sys_poll() at sys_poll+0x50/frame 0xfffffe00a79f3980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a79f3ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a79f3ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x800818b5a, rsp = 0x7fffffffe5f8, rbp = 0x7fffffffe630 --- Tracing command sh pid 2482 tid 100235 td 0xfffff8001818f580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a719e6b0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a719e6e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a719e720 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a719e780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a719e7b0 _sleep() at _sleep+0x34e/frame 0xfffffe00a719e850 pipe_read() at pipe_read+0x345/frame 0xfffffe00a719e8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a719e8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a719e930 sys_read() at sys_read+0x86/frame 0xfffffe00a719e980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a719eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a719eab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047464a, rsp = 0x7fffffffe258, rbp = 0x7fffffffe360 --- Tracing command awk pid 2481 tid 100226 td 0xfffff80018190580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a71716b0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a71716e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a7171720 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a7171780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a71717b0 _sleep() at _sleep+0x34e/frame 0xfffffe00a7171850 pipe_read() at pipe_read+0x345/frame 0xfffffe00a71718b0 dofileread() at dofileread+0x95/frame 0xfffffe00a71718f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a7171930 sys_read() at sys_read+0x86/frame 0xfffffe00a7171980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a7171ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7171ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047664a, rsp = 0x7fffffffe358, rbp = 0x7fffffffe370 --- Tracing command sh pid 2480 tid 100225 td 0xfffff80018191000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a716c560 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a716c590 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a716c5d0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a716c630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a716c660 _sleep() at _sleep+0x34e/frame 0xfffffe00a716c700 kern_wait6() at kern_wait6+0x4af/frame 0xfffffe00a716c790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00a716c980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a716cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a716cab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040303a, rsp = 0x7fffffffe348, rbp = 0x7fffffffe400 --- Tracing command sh pid 2414 tid 100175 td 0xfffff800078f4000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0006bc44c0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe0006bc44d0 trap() at trap+0x5c/frame 0xfffffe0006bc45e0 calltrap() at calltrap+0x8/frame 0xfffffe0006bc45e0 --- trap 0xc, rip = 0xffffffff81042546, rsp = 0xfffffe0006bc46b0, rbp = 0xfffffe0006bc46c0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe0006bc46c0 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe0006bc4760 db_command() at db_command+0x279/frame 0xfffffe0006bc4830 db_script_exec() at db_script_exec+0x188/frame 0xfffffe0006bc48d0 db_command() at db_command+0x279/frame 0xfffffe0006bc49a0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe0006bc49b0 db_trap() at db_trap+0xef/frame 0xfffffe0006bc4a40 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe0006bc4ab0 trap() at trap+0x806/frame 0xfffffe0006bc4bc0 calltrap() at calltrap+0x8/frame 0xfffffe0006bc4bc0 --- trap 0x3, rip = 0xffffffff80bd828b, rsp = 0xfffffe0006bc4c90, rbp = 0xfffffe0006bc4ca0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe0006bc4ca0 vpanic() at vpanic+0x1c0/frame 0xfffffe0006bc4d00 panic() at panic+0x43/frame 0xfffffe0006bc4d60 pmc_add_sample() at pmc_add_sample+0xcb/frame 0xfffffe0006bc4db0 core2_intr() at core2_intr+0x1d2/frame 0xfffffe0006bc4e10 trap() at trap+0x96/frame 0xfffffe0006bc4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc4f20 --- trap 0x13, rip = 0xffffffff8105348a, rsp = 0xfffffe00a95676d0, rbp = 0xfffffe00a9567710 --- pmap_invalidate_page() at pmap_invalidate_page+0x5a/frame 0xfffffe00a9567710 pmap_enter() at pmap_enter+0x89f/frame 0xfffffe00a95677d0 vm_fault_hold() at vm_fault_hold+0x19e6/frame 0xfffffe00a9567910 vm_fault() at vm_fault+0x60/frame 0xfffffe00a9567950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00a95679a0 trap() at trap+0x45a/frame 0xfffffe00a9567ab0 calltrap() at calltrap+0x8/frame 0xfffffe00a9567ab0 --- trap 0xc, rip = 0x217cf9, rsp = 0x7fffffffe1d0, rbp = 0x7fffffffe200 --- Tracing command bash pid 2326 tid 100179 td 0xfffff800078f0580 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0006bc44c0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe0006bc44d0 trap() at trap+0x5c/frame 0xfffffe0006bc45e0 calltrap() at calltrap+0x8/frame 0xfffffe0006bc45e0 --- trap 0xc, rip = 0xffffffff81042546, rsp = 0xfffffe0006bc46b0, rbp = 0xfffffe0006bc46c0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe0006bc46c0 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe0006bc4760 db_command() at db_command+0x279/frame 0xfffffe0006bc4830 db_script_exec() at db_script_exec+0x188/frame 0xfffffe0006bc48d0 db_command() at db_command+0x279/frame 0xfffffe0006bc49a0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe0006bc49b0 db_trap() at db_trap+0xef/frame 0xfffffe0006bc4a40 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe0006bc4ab0 trap() at trap+0x806/frame 0xfffffe0006bc4bc0 calltrap() at calltrap+0x8/frame 0xfffffe0006bc4bc0 --- trap 0x3, rip = 0xffffffff80bd828b, rsp = 0xfffffe0006bc4c90, rbp = 0xfffffe0006bc4ca0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe0006bc4ca0 vpanic() at vpanic+0x1c0/frame 0xfffffe0006bc4d00 panic() at panic+0x43/frame 0xfffffe0006bc4d60 pmc_add_sample() at pmc_add_sample+0xcb/frame 0xfffffe0006bc4db0 core2_intr() at core2_intr+0x1d2/frame 0xfffffe0006bc4e10 trap() at trap+0x96/frame 0xfffffe0006bc4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc4f20 --- trap 0x13, rip = 0xffffffff8105348a, rsp = 0xfffffe00a95676d0, rbp = 0xfffffe00a9567710 --- pmap_invalidate_page() at pmap_invalidate_page+0x5a/frame 0xfffffe00a9567710 pmap_enter() at pmap_enter+0x89f/frame 0xfffffe00a95677d0 vm_fault_hold() at vm_fault_hold+0x19e6/frame 0xfffffe00a9567910 vm_fault() at vm_fault+0x60/frame 0xfffffe00a9567950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00a95679a0 trap() at trap+0x45a/frame 0xfffffe00a9567ab0 calltrap() at calltrap+0x8/frame 0xfffffe00a9567ab0 --- trap 0xc, rip = 0x217cf9, rsp = 0x7fffffffe1d0, rbp = 0x7fffffffe200 --- Tracing command csh pid 2324 tid 100192 td 0xfffff8001833e580 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0006bc44c0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe0006bc44d0 trap() at trap+0x5c/frame 0xfffffe0006bc45e0 calltrap() at calltrap+0x8/frame 0xfffffe0006bc45e0 --- trap 0xc, rip = 0xffffffff81042546, rsp = 0xfffffe0006bc46b0, rbp = 0xfffffe0006bc46c0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe0006bc46c0 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe0006bc4760 db_command() at db_command+0x279/frame 0xfffffe0006bc4830 db_script_exec() at db_script_exec+0x188/frame 0xfffffe0006bc48d0 db_command() at db_command+0x279/frame 0xfffffe0006bc49a0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe0006bc49b0 db_trap() at db_trap+0xef/frame 0xfffffe0006bc4a40 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe0006bc4ab0 trap() at trap+0x806/frame 0xfffffe0006bc4bc0 calltrap() at calltrap+0x8/frame 0xfffffe0006bc4bc0 --- trap 0x3, rip = 0xffffffff80bd828b, rsp = 0xfffffe0006bc4c90, rbp = 0xfffffe0006bc4ca0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe0006bc4ca0 vpanic() at vpanic+0x1c0/frame 0xfffffe0006bc4d00 panic() at panic+0x43/frame 0xfffffe0006bc4d60 pmc_add_sample() at pmc_add_sample+0xcb/frame 0xfffffe0006bc4db0 core2_intr() at core2_intr+0x1d2/frame 0xfffffe0006bc4e10 trap() at trap+0x96/frame 0xfffffe0006bc4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc4f20 --- trap 0x13, rip = 0xffffffff8105348a, rsp = 0xfffffe00a95676d0, rbp = 0xfffffe00a9567710 --- pmap_invalidate_page() at pmap_invalidate_page+0x5a/frame 0xfffffe00a9567710 pmap_enter() at pmap_enter+0x89f/frame 0xfffffe00a95677d0 vm_fault_hold() at vm_fault_hold+0x19e6/frame 0xfffffe00a9567910 vm_fault() at vm_fault+0x60/frame 0xfffffe00a9567950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00a95679a0 trap() at trap+0x45a/frame 0xfffffe00a9567ab0 calltrap() at calltrap+0x8/frame 0xfffffe00a9567ab0 --- trap 0xc, rip = 0x217cf9, rsp = 0x7fffffffe1d0, rbp = 0x7fffffffe200 --- Tracing command su pid 2323 tid 100218 td 0xfffff80007df6000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0006bc44c0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe0006bc44d0 trap() at trap+0x5c/frame 0xfffffe0006bc45e0 calltrap() at calltrap+0x8/frame 0xfffffe0006bc45e0 --- trap 0xc, rip = 0xffffffff81042546, rsp = 0xfffffe0006bc46b0, rbp = 0xfffffe0006bc46c0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe0006bc46c0 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe0006bc4760 db_command() at db_command+0x279/frame 0xfffffe0006bc4830 db_script_exec() at db_script_exec+0x188/frame 0xfffffe0006bc48d0 db_command() at db_command+0x279/frame 0xfffffe0006bc49a0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe0006bc49b0 db_trap() at db_trap+0xef/frame 0xfffffe0006bc4a40 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe0006bc4ab0 trap() at trap+0x806/frame 0xfffffe0006bc4bc0 calltrap() at calltrap+0x8/frame 0xfffffe0006bc4bc0 --- trap 0x3, rip = 0xffffffff80bd828b, rsp = 0xfffffe0006bc4c90, rbp = 0xfffffe0006bc4ca0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe0006bc4ca0 vpanic() at vpanic+0x1c0/frame 0xfffffe0006bc4d00 panic() at panic+0x43/frame 0xfffffe0006bc4d60 pmc_add_sample() at pmc_add_sample+0xcb/frame 0xfffffe0006bc4db0 core2_intr() at core2_intr+0x1d2/frame 0xfffffe0006bc4e10 trap() at trap+0x96/frame 0xfffffe0006bc4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc4f20 --- trap 0x13, rip = 0xffffffff8105348a, rsp = 0xfffffe00a95676d0, rbp = 0xfffffe00a9567710 --- pmap_invalidate_page() at pmap_invalidate_page+0x5a/frame 0xfffffe00a9567710 pmap_enter() at pmap_enter+0x89f/frame 0xfffffe00a95677d0 vm_fault_hold() at vm_fault_hold+0x19e6/frame 0xfffffe00a9567910 vm_fault() at vm_fault+0x60/frame 0xfffffe00a9567950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00a95679a0 trap() at trap+0x45a/frame 0xfffffe00a9567ab0 calltrap() at calltrap+0x8/frame 0xfffffe00a9567ab0 --- trap 0xc, rip = 0x217cf9, rsp = 0x7fffffffe1d0, rbp = 0x7fffffffe200 --- Tracing command bash pid 2322 tid 100149 td 0xfffff8000795e000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0006bc44c0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe0006bc44d0 trap() at trap+0x5c/frame 0xfffffe0006bc45e0 calltrap() at calltrap+0x8/frame 0xfffffe0006bc45e0 --- trap 0xc, rip = 0xffffffff81042546, rsp = 0xfffffe0006bc46b0, rbp = 0xfffffe0006bc46c0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe0006bc46c0 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe0006bc4760 db_command() at db_command+0x279/frame 0xfffffe0006bc4830 db_script_exec() at db_script_exec+0x188/frame 0xfffffe0006bc48d0 db_command() at db_command+0x279/frame 0xfffffe0006bc49a0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe0006bc49b0 db_trap() at db_trap+0xef/frame 0xfffffe0006bc4a40 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe0006bc4ab0 trap() at trap+0x806/frame 0xfffffe0006bc4bc0 calltrap() at calltrap+0x8/frame 0xfffffe0006bc4bc0 --- trap 0x3, rip = 0xffffffff80bd828b, rsp = 0xfffffe0006bc4c90, rbp = 0xfffffe0006bc4ca0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe0006bc4ca0 vpanic() at vpanic+0x1c0/frame 0xfffffe0006bc4d00 panic() at panic+0x43/frame 0xfffffe0006bc4d60 pmc_add_sample() at pmc_add_sample+0xcb/frame 0xfffffe0006bc4db0 core2_intr() at core2_intr+0x1d2/frame 0xfffffe0006bc4e10 trap() at trap+0x96/frame 0xfffffe0006bc4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc4f20 --- trap 0x13, rip = 0xffffffff8105348a, rsp = 0xfffffe00a95676d0, rbp = 0xfffffe00a9567710 --- pmap_invalidate_page() at pmap_invalidate_page+0x5a/frame 0xfffffe00a9567710 pmap_enter() at pmap_enter+0x89f/frame 0xfffffe00a95677d0 vm_fault_hold() at vm_fault_hold+0x19e6/frame 0xfffffe00a9567910 vm_fault() at vm_fault+0x60/frame 0xfffffe00a9567950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00a95679a0 trap() at trap+0x45a/frame 0xfffffe00a9567ab0 calltrap() at calltrap+0x8/frame 0xfffffe00a9567ab0 --- trap 0xc, rip = 0x217cf9, rsp = 0x7fffffffe1d0, rbp = 0x7fffffffe200 --- Tracing command sshd pid 2321 tid 100207 td 0xfffff80018192580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a70ee5c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a70ee5f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a70ee630 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a70ee690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a70ee6c0 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a70ee720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a70ee760 kern_select() at kern_select+0x8bf/frame 0xfffffe00a70ee940 sys_select() at sys_select+0x56/frame 0xfffffe00a70ee980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a70eeab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a70eeab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80087762a, rsp = 0x7fffffffa598, rbp = 0x7fffffffa5d0 --- Tracing command sshd pid 2318 tid 100217 td 0xfffff80150a5c000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a7120640 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a7120670 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a71206b0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a7120710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a7120740 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a71207a0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a71207e0 kern_poll() at kern_poll+0x43a/frame 0xfffffe00a7120960 sys_poll() at sys_poll+0x50/frame 0xfffffe00a7120980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a7120ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7120ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x800818b5a, rsp = 0x7fffffffe5f8, rbp = 0x7fffffffe630 --- Tracing command csh pid 2314 tid 100162 td 0xfffff80007df7000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006fad630 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006fad660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006fad6a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006fad700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0006fad730 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe0006fad790 tty_wait() at tty_wait+0x42/frame 0xfffffe0006fad7c0 ttydisc_read() at ttydisc_read+0x212/frame 0xfffffe0006fad820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0006fad850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe0006fad8b0 dofileread() at dofileread+0x95/frame 0xfffffe0006fad8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe0006fad930 sys_read() at sys_read+0x86/frame 0xfffffe0006fad980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe0006fadab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006fadab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004f864a, rsp = 0x7fffffffe208, rbp = 0x7fffffffe230 --- Tracing command login pid 2307 tid 100142 td 0xfffff8000795e580 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0006bc44c0 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe0006bc44d0 trap() at trap+0x5c/frame 0xfffffe0006bc45e0 calltrap() at calltrap+0x8/frame 0xfffffe0006bc45e0 --- trap 0xc, rip = 0xffffffff81042546, rsp = 0xfffffe0006bc46b0, rbp = 0xfffffe0006bc46c0 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe0006bc46c0 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe0006bc4760 db_command() at db_command+0x279/frame 0xfffffe0006bc4830 db_script_exec() at db_script_exec+0x188/frame 0xfffffe0006bc48d0 db_command() at db_command+0x279/frame 0xfffffe0006bc49a0 db_command_loop() at db_command_loop+0x64/frame 0xfffffe0006bc49b0 db_trap() at db_trap+0xef/frame 0xfffffe0006bc4a40 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe0006bc4ab0 trap() at trap+0x806/frame 0xfffffe0006bc4bc0 calltrap() at calltrap+0x8/frame 0xfffffe0006bc4bc0 --- trap 0x3, rip = 0xffffffff80bd828b, rsp = 0xfffffe0006bc4c90, rbp = 0xfffffe0006bc4ca0 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe0006bc4ca0 vpanic() at vpanic+0x1c0/frame 0xfffffe0006bc4d00 panic() at panic+0x43/frame 0xfffffe0006bc4d60 pmc_add_sample() at pmc_add_sample+0xcb/frame 0xfffffe0006bc4db0 core2_intr() at core2_intr+0x1d2/frame 0xfffffe0006bc4e10 trap() at trap+0x96/frame 0xfffffe0006bc4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc4f20 --- trap 0x13, rip = 0xffffffff8105348a, rsp = 0xfffffe00a95676d0, rbp = 0xfffffe00a9567710 --- pmap_invalidate_page() at pmap_invalidate_page+0x5a/frame 0xfffffe00a9567710 pmap_enter() at pmap_enter+0x89f/frame 0xfffffe00a95677d0 vm_fault_hold() at vm_fault_hold+0x19e6/frame 0xfffffe00a9567910 vm_fault() at vm_fault+0x60/frame 0xfffffe00a9567950 trap_pfault() at trap_pfault+0x188/frame 0xfffffe00a95679a0 trap() at trap+0x45a/frame 0xfffffe00a9567ab0 calltrap() at calltrap+0x8/frame 0xfffffe00a9567ab0 --- trap 0xc, rip = 0x217cf9, rsp = 0x7fffffffe1d0, rbp = 0x7fffffffe200 --- Tracing command getty pid 2306 tid 100216 td 0xfffff80150882580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a711b630 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a711b660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a711b6a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a711b700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a711b730 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a711b790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a711b7c0 ttydisc_read() at ttydisc_read+0x212/frame 0xfffffe00a711b820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a711b850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a711b8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a711b8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a711b930 sys_read() at sys_read+0x86/frame 0xfffffe00a711b980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a711bab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a711bab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042f64a, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 2305 tid 100215 td 0xfffff80007c9a580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a7116630 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a7116660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a71166a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a7116700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a7116730 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a7116790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a71167c0 ttydisc_read() at ttydisc_read+0x212/frame 0xfffffe00a7116820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a7116850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a71168b0 dofileread() at dofileread+0x95/frame 0xfffffe00a71168f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a7116930 sys_read() at sys_read+0x86/frame 0xfffffe00a7116980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a7116ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7116ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042f64a, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 2304 tid 100214 td 0xfffff80007d97000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a7111630 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a7111660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a71116a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a7111700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a7111730 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a7111790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a71117c0 ttydisc_read() at ttydisc_read+0x212/frame 0xfffffe00a7111820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a7111850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a71118b0 dofileread() at dofileread+0x95/frame 0xfffffe00a71118f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a7111930 sys_read() at sys_read+0x86/frame 0xfffffe00a7111980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a7111ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7111ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042f64a, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 2303 tid 100213 td 0xfffff80007d97580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a710c630 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a710c660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a710c6a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a710c700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a710c730 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a710c790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a710c7c0 ttydisc_read() at ttydisc_read+0x212/frame 0xfffffe00a710c820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a710c850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a710c8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a710c8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a710c930 sys_read() at sys_read+0x86/frame 0xfffffe00a710c980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a710cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a710cab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042f64a, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 2302 tid 100212 td 0xfffff80007da3000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a7107630 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a7107660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a71076a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a7107700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a7107730 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a7107790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a71077c0 ttydisc_read() at ttydisc_read+0x212/frame 0xfffffe00a7107820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a7107850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a71078b0 dofileread() at dofileread+0x95/frame 0xfffffe00a71078f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a7107930 sys_read() at sys_read+0x86/frame 0xfffffe00a7107980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a7107ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7107ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042f64a, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 2301 tid 100211 td 0xfffff80007da3580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a7102630 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a7102660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a71026a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a7102700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a7102730 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a7102790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a71027c0 ttydisc_read() at ttydisc_read+0x212/frame 0xfffffe00a7102820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a7102850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a71028b0 dofileread() at dofileread+0x95/frame 0xfffffe00a71028f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a7102930 sys_read() at sys_read+0x86/frame 0xfffffe00a7102980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a7102ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a7102ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042f64a, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 2300 tid 100174 td 0xfffff80007da4580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006ff5630 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006ff5660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ff56a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006ff5700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0006ff5730 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe0006ff5790 tty_wait() at tty_wait+0x42/frame 0xfffffe0006ff57c0 ttydisc_read() at ttydisc_read+0x212/frame 0xfffffe0006ff5820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0006ff5850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe0006ff58b0 dofileread() at dofileread+0x95/frame 0xfffffe0006ff58f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe0006ff5930 sys_read() at sys_read+0x86/frame 0xfffffe0006ff5980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe0006ff5ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006ff5ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042f64a, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 2299 tid 100160 td 0xfffff80007da5580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f9e630 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f9e660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f9e6a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006f9e700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0006f9e730 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe0006f9e790 tty_wait() at tty_wait+0x42/frame 0xfffffe0006f9e7c0 ttydisc_read() at ttydisc_read+0x212/frame 0xfffffe0006f9e820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe0006f9e850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe0006f9e8b0 dofileread() at dofileread+0x95/frame 0xfffffe0006f9e8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe0006f9e930 sys_read() at sys_read+0x86/frame 0xfffffe0006f9e980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe0006f9eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006f9eab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042f64a, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command getty pid 2298 tid 100195 td 0xfffff80007da4000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a709a630 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a709a660 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a709a6a0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a709a700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a709a730 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a709a790 tty_wait() at tty_wait+0x42/frame 0xfffffe00a709a7c0 ttydisc_read() at ttydisc_read+0x212/frame 0xfffffe00a709a820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a709a850 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a709a8b0 dofileread() at dofileread+0x95/frame 0xfffffe00a709a8f0 kern_readv() at kern_readv+0x4a/frame 0xfffffe00a709a930 sys_read() at sys_read+0x86/frame 0xfffffe00a709a980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a709aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a709aab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80042f64a, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec30 --- Tracing command cron pid 2252 tid 100205 td 0xfffff80003787000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a70e4700 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a70e4730 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a70e4770 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a70e47d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a70e4810 _sleep() at _sleep+0x2e9/frame 0xfffffe00a70e48b0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1b7/frame 0xfffffe00a70e4940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00a70e4980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a70e4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a70e4ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003d11ba, rsp = 0x7fffffffeaf8, rbp = 0x7fffffffece0 --- Tracing command sshd pid 2248 tid 100171 td 0xfffff80007df6580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006fda5c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006fda5f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006fda630 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006fda690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0006fda6c0 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe0006fda720 seltdwait() at seltdwait+0x8d/frame 0xfffffe0006fda760 kern_select() at kern_select+0x8bf/frame 0xfffffe0006fda940 sys_select() at sys_select+0x56/frame 0xfffffe0006fda980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe0006fdaab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006fdaab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80087762a, rsp = 0x7fffffffe688, rbp = 0x7fffffffe6c0 --- Tracing command rpc.lockd pid 2183 tid 100202 td 0xfffff800037ae580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a70d54e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a70d5510 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a70d5550 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a70d55b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a70d55f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1f1/frame 0xfffffe00a70d5660 svc_run_internal() at svc_run_internal+0xa92/frame 0xfffffe00a70d57a0 svc_run() at svc_run+0x1fe/frame 0xfffffe00a70d5800 sys_nlm_syscall() at sys_nlm_syscall+0x76b/frame 0xfffffe00a70d5980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a70d5ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a70d5ab0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8002ed5da, rsp = 0x7fffffffec28, rbp = 0x7fffffffece0 --- Tracing command rpc.statd pid 2180 tid 100199 td 0xfffff8000795d000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a70ba5a0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a70ba5d0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a70ba610 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a70ba670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a70ba6b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1f1/frame 0xfffffe00a70ba720 seltdwait() at seltdwait+0x6b/frame 0xfffffe00a70ba760 kern_select() at kern_select+0x8bf/frame 0xfffffe00a70ba940 sys_select() at sys_select+0x56/frame 0xfffffe00a70ba980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a70baab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a70baab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80042362a, rsp = 0x7fffffffeab8, rbp = 0x7fffffffec00 --- Tracing command watchdogd pid 2130 tid 100154 td 0xfffff800078fd580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f8a700 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f8a730 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f8a770 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006f8a7d0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe0006f8a810 _sleep() at _sleep+0x2e9/frame 0xfffffe0006f8a8b0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1b7/frame 0xfffffe0006f8a940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe0006f8a980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe0006f8aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006f8aab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003bb1ba, rsp = 0x7fffffffeab8, rbp = 0x7fffffffeb00 --- Tracing command rpcbind pid 2054 tid 100201 td 0xfffff800037af000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a70d0620 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a70d0650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a70d0690 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a70d06f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00a70d0730 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1f1/frame 0xfffffe00a70d07a0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00a70d07e0 kern_poll() at kern_poll+0x43a/frame 0xfffffe00a70d0960 sys_poll() at sys_poll+0x50/frame 0xfffffe00a70d0980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a70d0ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a70d0ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003c9b5a, rsp = 0x7fffffffca58, rbp = 0x7fffffffec70 --- Tracing command syslogd pid 2044 tid 100200 td 0xfffff800037af580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00a70cb5c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00a70cb5f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00a70cb630 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe00a70cb690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a70cb6c0 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe00a70cb720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00a70cb760 kern_select() at kern_select+0x8bf/frame 0xfffffe00a70cb940 sys_select() at sys_select+0x56/frame 0xfffffe00a70cb980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe00a70cbab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a70cbab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80043562a, rsp = 0x7fffffffe6c8, rbp = 0x7fffffffece0 --- Tracing command devd pid 1973 tid 100144 td 0xfffff80006406000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f585a0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f585d0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f58610 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006f58670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe0006f586b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1f1/frame 0xfffffe0006f58720 seltdwait() at seltdwait+0x6b/frame 0xfffffe0006f58760 kern_select() at kern_select+0x8bf/frame 0xfffffe0006f58940 sys_select() at sys_select+0x56/frame 0xfffffe0006f58980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe0006f58ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006f58ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2fc10a, rsp = 0x7fffffffcb78, rbp = 0x7fffffffed00 --- Tracing command dhclient pid 1968 tid 100157 td 0xfffff800037b1000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f99620 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f99650 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f99690 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006f996f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe0006f99730 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1f1/frame 0xfffffe0006f997a0 seltdwait() at seltdwait+0x6b/frame 0xfffffe0006f997e0 kern_poll() at kern_poll+0x43a/frame 0xfffffe0006f99960 sys_poll() at sys_poll+0x50/frame 0xfffffe0006f99980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe0006f99ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006f99ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003ecb5a, rsp = 0x7fffffffec48, rbp = 0x7fffffffec80 --- Tracing command dhclient pid 1924 tid 100173 td 0xfffff80006035000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006ff0640 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006ff0670 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ff06b0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006ff0710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0006ff0740 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe0006ff07a0 seltdwait() at seltdwait+0x8d/frame 0xfffffe0006ff07e0 kern_poll() at kern_poll+0x43a/frame 0xfffffe0006ff0960 sys_poll() at sys_poll+0x50/frame 0xfffffe0006ff0980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe0006ff0ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006ff0ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003ecb5a, rsp = 0x7fffffffec58, rbp = 0x7fffffffec80 --- Tracing command dhclient pid 1921 tid 100167 td 0xfffff8000795d580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006fc65c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006fc65f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006fc6630 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0006fc6690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0006fc66c0 _cv_wait_sig() at _cv_wait_sig+0x1ce/frame 0xfffffe0006fc6720 seltdwait() at seltdwait+0x8d/frame 0xfffffe0006fc6760 kern_select() at kern_select+0x8bf/frame 0xfffffe0006fc6940 sys_select() at sys_select+0x56/frame 0xfffffe0006fc6980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe0006fc6ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0006fc6ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80044b62a, rsp = 0x7fffffffea08, rbp = 0x7fffffffeac0 --- Tracing command vnlru pid 34 tid 100133 td 0xfffff800078f8000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f21880 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f218b0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f218f0 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006f21930 _sleep() at _sleep+0x2fc/frame 0xfffffe0006f219d0 vnlru_proc() at vnlru_proc+0xa4/frame 0xfffffe0006f21a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f21ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f21ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 33 tid 100132 td 0xfffff800078f8580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f178c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f178f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f17930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006f17970 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x1f1/frame 0xfffffe0006f179e0 sched_sync() at sched_sync+0x609/frame 0xfffffe0006f17a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f17ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f17ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100130 td 0xfffff800078fa000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f128d0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f12900 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f12940 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006f12980 _sleep() at _sleep+0x2fc/frame 0xfffffe0006f12a20 buf_daemon() at buf_daemon+0xd8/frame 0xfffffe0006f12a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f12ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f12ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100135 td 0xfffff8000791b000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f2b8c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f2b8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f2b930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006f2b970 _sleep() at _sleep+0x2fc/frame 0xfffffe0006f2ba10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006f2ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f2bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f2bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100136 td 0xfffff8000791a580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f308c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f308f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f30930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006f30970 _sleep() at _sleep+0x2fc/frame 0xfffffe0006f30a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006f30a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f30ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f30ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100137 td 0xfffff8000791a000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f358c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f358f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f35930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006f35970 _sleep() at _sleep+0x2fc/frame 0xfffffe0006f35a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006f35a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f35ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f35ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100138 td 0xfffff80007919580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f3a8c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f3a8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f3a930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006f3a970 _sleep() at _sleep+0x2fc/frame 0xfffffe0006f3aa10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006f3aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f3aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f3aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100139 td 0xfffff80007919000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f3f8c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f3f8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f3f930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006f3f970 _sleep() at _sleep+0x2fc/frame 0xfffffe0006f3fa10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006f3fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f3fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f3fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100140 td 0xfffff80007918580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f448c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f448f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f44930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006f44970 _sleep() at _sleep+0x2fc/frame 0xfffffe0006f44a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006f44a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f44ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f44ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100141 td 0xfffff80007918000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f498c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f498f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f49930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006f49970 _sleep() at _sleep+0x2fc/frame 0xfffffe0006f49a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006f49a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f49ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f49ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100152 td 0xfffff80006036580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f808f0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f80920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f80960 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006f809a0 _sleep() at _sleep+0x2fc/frame 0xfffffe0006f80a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe0006f80a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f80ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f80ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100161 td 0xfffff80007da5000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006fa88f0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006fa8920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006fa8960 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006fa89a0 _sleep() at _sleep+0x2fc/frame 0xfffffe0006fa8a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe0006fa8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006fa8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006fa8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 31 tid 100129 td 0xfffff8000640a580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f0d8b0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f0d8e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f0d920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f0d950 _sleep() at _sleep+0x358/frame 0xfffffe0006f0d9f0 vm_daemon() at vm_daemon+0xaa6/frame 0xfffffe0006f0da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f0dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f0dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffff800074dc000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f08560 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f08590 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f085d0 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006f08610 _sleep() at _sleep+0x2fc/frame 0xfffffe0006f086b0 vm_pageout_worker() at vm_pageout_worker+0x24e/frame 0xfffffe0006f08a40 vm_pageout() at vm_pageout+0x16c/frame 0xfffffe0006f08a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f08ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f08ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100131 td 0xfffff800078fe580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f1c6b0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f1c6e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f1c720 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f1c750 _sleep() at _sleep+0x358/frame 0xfffffe0006f1c7f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xc70/frame 0xfffffe0006f1ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f1cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f1cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100134 td 0xfffff800078fe000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006f268f0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006f26920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006f26960 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006f269a0 _sleep() at _sleep+0x2fc/frame 0xfffffe0006f26a40 uma_reclaim_worker() at uma_reclaim_worker+0xda/frame 0xfffffe0006f26a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f26ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f26ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 29 tid 100127 td 0xfffff80003abd000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006ef78b0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006ef78e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ef7920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ef7950 _sleep() at _sleep+0x358/frame 0xfffffe0006ef79f0 enc_daemon() at enc_daemon+0x1df/frame 0xfffffe0006ef7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ef7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ef7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 28 tid 100126 td 0xfffff80003abd580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006ef28b0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006ef28e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ef2920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ef2950 _sleep() at _sleep+0x358/frame 0xfffffe0006ef29f0 enc_daemon() at enc_daemon+0x1df/frame 0xfffffe0006ef2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ef2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ef2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 27 tid 100123 td 0xfffff800074e4580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006ee38c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006ee38f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ee3930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006ee3970 _sleep() at _sleep+0x2fc/frame 0xfffffe0006ee3a10 random_kthread() at random_kthread+0x296/frame 0xfffffe0006ee3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ee3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ee3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 26 tid 100119 td 0xfffff800074e6580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006ec3910 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006ec3940 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ec3980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ec39b0 _sleep() at _sleep+0x358/frame 0xfffffe0006ec3a50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe0006ec3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ec3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ec3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 25 tid 100118 td 0xfffff80003abe000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006eb28e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006eb2910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006eb2950 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006eb2990 _sleep() at _sleep+0x2fc/frame 0xfffffe0006eb2a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006eb2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eb2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eb2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 24 tid 100117 td 0xfffff80003abe580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006ead8e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006ead910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ead950 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006ead990 _sleep() at _sleep+0x2fc/frame 0xfffffe0006eada30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006eada70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eadab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eadab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 23 tid 100116 td 0xfffff80003abf000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006ea88e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006ea8910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ea8950 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006ea8990 _sleep() at _sleep+0x2fc/frame 0xfffffe0006ea8a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ea8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ea8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ea8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 22 tid 100115 td 0xfffff80003abf580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006ea38e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006ea3910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ea3950 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe0006ea3990 _sleep() at _sleep+0x2fc/frame 0xfffffe0006ea3a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ea3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ea3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ea3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100096 td 0xfffff80003ea6000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e2c930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e2c960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e2c9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e2c9d0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e2ca30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e2ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e2cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e2cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100097 td 0xfffff80003ea5580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e31930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e31960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e319a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e319d0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e31a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e31a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e31ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e31ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100098 td 0xfffff80003ea5000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e36930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e36960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e369a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e369d0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e36a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e36a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e36ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e36ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100099 td 0xfffff80003ea4580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e3b930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e3b960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e3b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e3b9d0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e3ba30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e3ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e3bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e3bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100100 td 0xfffff80003ea4000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e40930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e40960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e409a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e409d0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e40a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e40a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e40ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e40ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100102 td 0xfffff80003e9c000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e4a930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e4a960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e4a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e4a9d0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e4aa30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e4aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e4aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e4aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100103 td 0xfffff80006038580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e4f930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e4f960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e4f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e4f9d0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e4fa30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e4fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e4fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e4fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100104 td 0xfffff80006038000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e54930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e54960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e549a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e549d0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e54a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e54a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e54ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e54ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100105 td 0xfffff80006037580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e59930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e59960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e599a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e599d0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e59a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e59a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e59ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e59ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100106 td 0xfffff80006037000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e5e930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e5e960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e5e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e5e9d0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e5ea30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e5ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e5eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e5eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100107 td 0xfffff8000640a000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e7b930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e7b960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e7b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e7b9d0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e7ba30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e7ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e7bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e7bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100108 td 0xfffff80006409580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e80930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e80960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e809a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e809d0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e80a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e80a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e80ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e80ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100109 td 0xfffff80006409000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e85930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e85960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e859a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e859d0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e85a30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e85a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e85ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e85ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100110 td 0xfffff80006408580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e8a930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e8a960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e8a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e8a9d0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e8aa30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e8aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e8aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e8aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100111 td 0xfffff80006408000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e8f930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e8f960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e8f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e8f9d0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e8fa30 usb_process() at usb_process+0x12b/frame 0xfffffe0006e8fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e8fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e8fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100091 td 0xfffff80003928000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e138e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e13910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e13950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e13980 _sleep() at _sleep+0x358/frame 0xfffffe0006e13a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e13a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e13ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e13ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100092 td 0xfffff80003ac4580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e188e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e18910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e18950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e18980 _sleep() at _sleep+0x358/frame 0xfffffe0006e18a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e18a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e18ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e18ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100093 td 0xfffff80003ac4000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e1d8e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e1d910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e1d950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e1d980 _sleep() at _sleep+0x358/frame 0xfffffe0006e1da20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e1da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e1dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e1dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100125 td 0xfffff800074dc580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006eed8d0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006eed900 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006eed940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006eed970 _sleep() at _sleep+0x358/frame 0xfffffe0006eeda10 xpt_scanner_thread() at xpt_scanner_thread+0x93/frame 0xfffffe0006eeda70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eedab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eedab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 19 tid 100090 td 0xfffff80003928580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e0e8f0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e0e920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e0e960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e0e990 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0006e0e9f0 seq_eventthread() at seq_eventthread+0xcc/frame 0xfffffe0006e0ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e0eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e0eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 18 tid 100089 td 0xfffff80003929000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e098c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e098f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e09930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e09960 _sleep() at _sleep+0x358/frame 0xfffffe0006e09a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e09a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e09ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e09ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 17 tid 100088 td 0xfffff80003929580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e048c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e048f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e04930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e04960 _sleep() at _sleep+0x358/frame 0xfffffe0006e04a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e04a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e04ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e04ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 16 tid 100087 td 0xfffff8000392a000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005fd8c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005fd8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005fd930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005fd960 _sleep() at _sleep+0x358/frame 0xfffffe00005fda00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005fda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005fdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005fdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 15 tid 100086 td 0xfffff8000392a580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005f88c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005f88f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005f8930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005f8960 _sleep() at _sleep+0x358/frame 0xfffffe00005f8a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005f8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 14 tid 100085 td 0xfffff8000392b000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005f38c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005f38f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005f3930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005f3960 _sleep() at _sleep+0x358/frame 0xfffffe00005f3a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100084 td 0xfffff8000392b580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005ee8c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005ee8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005ee930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ee960 _sleep() at _sleep+0x358/frame 0xfffffe00005eea00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100083 td 0xfffff8000392c000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005e98c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005e98f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005e9930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005e9960 _sleep() at _sleep+0x358/frame 0xfffffe00005e9a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100082 td 0xfffff80003919580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005e48c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005e48f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005e4930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005e4960 _sleep() at _sleep+0x358/frame 0xfffffe00005e4a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005e4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100081 td 0xfffff8000391a000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005df8c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005df8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005df930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005df960 _sleep() at _sleep+0x358/frame 0xfffffe00005dfa00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005dfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005dfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005dfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100080 td 0xfffff8000391a580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005da8c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005da8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005da930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005da960 _sleep() at _sleep+0x358/frame 0xfffffe00005daa00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005daa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005daab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005daab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100079 td 0xfffff8000391b000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005d58c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005d58f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005d5930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005d5960 _sleep() at _sleep+0x358/frame 0xfffffe00005d5a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005d5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100078 td 0xfffff8000391b580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005d08c0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005d08f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005d0930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005d0960 _sleep() at _sleep+0x358/frame 0xfffffe00005d0a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005d0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100077 td 0xfffff8000391c000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005cb8f0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005cb920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005cb960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005cb990 _sleep() at _sleep+0x358/frame 0xfffffe00005cba30 crypto_proc() at crypto_proc+0x2c5/frame 0xfffffe00005cba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005cbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005cbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100061 td 0xfffff80003817000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe000057b8f0 mi_switch() at mi_switch+0x16f/frame 0xfffffe000057b920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000057b960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000057b990 _sleep() at _sleep+0x358/frame 0xfffffe000057ba30 g_run_events() at g_run_events+0x4f/frame 0xfffffe000057ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000057bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000057bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffff80003816580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005808f0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0000580920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000580960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000580990 _sleep() at _sleep+0x358/frame 0xfffffe0000580a30 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0000580a60 g_up_procbody() at g_up_procbody+0x6d/frame 0xfffffe0000580a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000580ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000580ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffff80003816000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005858e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0000585910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000585950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000585980 _sleep() at _sleep+0x358/frame 0xfffffe0000585a20 g_io_schedule_down() at g_io_schedule_down+0x14c/frame 0xfffffe0000585a60 g_down_procbody() at g_down_procbody+0x6d/frame 0xfffffe0000585a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000585ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000585ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100018 td 0xfffff800036b0580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00787a59e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00787a5a10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe00787a5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00787a5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00787a5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100019 td 0xfffff800036f4000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00787aa9e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00787aaa10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe00787aaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00787aaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00787aaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100021 td 0xfffff800036f3000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffff80003806000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100048 td 0xfffff80003805580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00004da9e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00004daa10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe00004daa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004daab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004daab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100049 td 0xfffff80003805000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00004df9e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00004dfa10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe00004dfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004dfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004dfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100050 td 0xfffff80003804580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00004e49e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00004e4a10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe00004e4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004e4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004e4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100051 td 0xfffff80003804000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00004e99e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00004e9a10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe00004e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100052 td 0xfffff80003803580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00004ee9e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00004eea10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe00004eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100053 td 0xfffff80003803000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00004f39e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00004f3a10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe00004f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100054 td 0xfffff800037fb580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00004f89e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00004f8a10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe00004f8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004f8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004f8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100055 td 0xfffff800037fb000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00004fd9e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe00004fda10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe00004fda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004fdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004fdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100056 td 0xfffff80003819580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005029e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0000502a10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe0000502a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000502ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000502ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100057 td 0xfffff80003819000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005079e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0000507a10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe0000507a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000507ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000507ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100058 td 0xfffff80003818580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe000050c9e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe000050ca10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe000050ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe000050cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000050cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100059 td 0xfffff80003818000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005119e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0000511a10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe0000511a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000511ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000511ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100060 td 0xfffff80003817580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005169e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0000516a10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe0000516a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000516ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000516ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100094 td 0xfffff80003ea7000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e229e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e22a10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe0006e22a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e22ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e22ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffff80003ea6580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e279e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e27a10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe0006e27a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e27ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e27ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100101 td 0xfffff80003e9c580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e459e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e45a10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe0006e45a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e45ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e45ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100112 td 0xfffff80006407580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffff80006407000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e999e0 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e99a10 ithread_loop() at ithread_loop+0x313/frame 0xfffffe0006e99a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e99ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e99ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100184 td 0xfffff80003ea7580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100185 td 0xfffff80018342000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100186 td 0xfffff80018341580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100187 td 0xfffff80018341000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100188 td 0xfffff80018340580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100189 td 0xfffff80018340000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100190 td 0xfffff8001833f580 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100191 td 0xfffff8001833f000 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffff800036af000 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff82058d70 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xffffffff82058d90 trap() at trap+0x49/frame 0xffffffff82058ea0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff82058ea0 --- trap 0x13, rip = 0xffffffff811cb606, rsp = 0xfffffe007875a910, rbp = 0xfffffe007875a910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007875a910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe007875a960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007875a980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007875a9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007875aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007875aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007875aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff800036ae580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe007875f950 mi_switch() at mi_switch+0x16f/frame 0xfffffe007875f980 critical_exit_preempt() at critical_exit_preempt+0x66/frame 0xfffffe007875f9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007875fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007875fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007875fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff800036ae000 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bb8df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bb8e10 trap() at trap+0x49/frame 0xfffffe0006bb8f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bb8f20 --- trap 0x13, rip = 0xffffffff811cb606, rsp = 0xfffffe0078764910, rbp = 0xfffffe0078764910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078764910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe0078764960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078764980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00787649a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078764a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078764ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078764ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff800036ad580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0078769950 mi_switch() at mi_switch+0x16f/frame 0xfffffe0078769980 critical_exit_preempt() at critical_exit_preempt+0x66/frame 0xfffffe00787699a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078769a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078769ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078769ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff800036ad000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe007876e950 mi_switch() at mi_switch+0x16f/frame 0xfffffe007876e980 critical_exit_preempt() at critical_exit_preempt+0x66/frame 0xfffffe007876e9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007876ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe007876eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007876eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff800036ac580 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bdcdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bdce10 trap() at trap+0x49/frame 0xfffffe0006bdcf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bdcf20 --- trap 0x13, rip = 0xffffffff811cb606, rsp = 0xfffffe0078773910, rbp = 0xfffffe0078773910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078773910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe0078773960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078773980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00787739a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078773a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078773ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078773ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff800036ac000 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006be8df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006be8e10 trap() at trap+0x49/frame 0xfffffe0006be8f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006be8f20 --- trap 0x13, rip = 0xffffffff811cb606, rsp = 0xfffffe0078778910, rbp = 0xfffffe0078778910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078778910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe0078778960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078778980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00787789a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078778a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078778ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078778ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff800036c0580 (CPU 7) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0006bf4df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0006bf4e10 trap() at trap+0x49/frame 0xfffffe0006bf4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bf4f20 --- trap 0x13, rip = 0xffffffff811cb606, rsp = 0xfffffe007877d910, rbp = 0xfffffe007877d910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007877d910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe007877d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007877d980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007877d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007877da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007877dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007877dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff800036c0000 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000270df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000270e10 trap() at trap+0x49/frame 0xfffffe0000270f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000270f20 --- trap 0x13, rip = 0xffffffff811cb606, rsp = 0xfffffe0078782910, rbp = 0xfffffe0078782910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078782910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe0078782960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078782980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00787829a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078782a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078782ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078782ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff800036bf580 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe000027cdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe000027ce10 trap() at trap+0x49/frame 0xfffffe000027cf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe000027cf20 --- trap 0x13, rip = 0xffffffff811cb606, rsp = 0xfffffe0078787910, rbp = 0xfffffe0078787910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0078787910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe0078787960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078787980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe00787879a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078787a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078787ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078787ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff800036bf000 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000288df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000288e10 trap() at trap+0x49/frame 0xfffffe0000288f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000288f20 --- trap 0x13, rip = 0xffffffff811cb606, rsp = 0xfffffe007878c910, rbp = 0xfffffe007878c910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007878c910 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe007878c960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007878c980 cpu_idle() at cpu_idle+0xa7/frame 0xfffffe007878c9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007878ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe007878cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007878cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff800036be580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0078791950 mi_switch() at mi_switch+0x16f/frame 0xfffffe0078791980 critical_exit_preempt() at critical_exit_preempt+0x66/frame 0xfffffe00787919a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078791a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078791ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078791ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff800036af580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0078755560 mi_switch() at mi_switch+0x16f/frame 0xfffffe0078755590 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00787555d0 sleepq_catch_signals() at sleepq_catch_signals+0x3e7/frame 0xfffffe0078755630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0078755660 _sleep() at _sleep+0x34e/frame 0xfffffe0078755700 kern_wait6() at kern_wait6+0x4af/frame 0xfffffe0078755790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe0078755980 amd64_syscall() at amd64_syscall+0x2a7/frame 0xfffffe0078755ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0078755ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2ae76a, rsp = 0x7fffffffe788, rbp = 0x7fffffffe7f0 --- Tracing command audit pid 10 tid 100001 td 0xfffff800036b0000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0078750910 mi_switch() at mi_switch+0x16f/frame 0xfffffe0078750940 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0078750980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00787509b0 _cv_wait() at _cv_wait+0x1d3/frame 0xfffffe0078750a10 audit_worker() at audit_worker+0x93/frame 0xfffffe0078750a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078750ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078750ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff8208d8a0 sched_switch() at sched_switch+0x7ca/frame 0xffffffff828d89d0 mi_switch() at mi_switch+0x16f/frame 0xffffffff828d8a00 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffffff828d8a40 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xffffffff828d8a80 _sleep() at _sleep+0x2fc/frame 0xffffffff828d8b20 swapper() at swapper+0x77/frame 0xffffffff828d8b70 btext() at btext+0x2c Tracing command kernel pid 0 tid 100015 td 0xfffff800036be000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0078796930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0078796960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00787969a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00787969d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe0078796a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0078796a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078796ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078796ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffff800036bd580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe007879b900 mi_switch() at mi_switch+0x16f/frame 0xfffffe007879b930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe007879b970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe007879b9a0 _sleep() at _sleep+0x358/frame 0xfffffe007879ba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe007879ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe007879bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007879bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffff800036bd000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00787a0900 mi_switch() at mi_switch+0x16f/frame 0xfffffe00787a0930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00787a0970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00787a09a0 _sleep() at _sleep+0x358/frame 0xfffffe00787a0a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00787a0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00787a0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00787a0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffff800036f3580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00787af900 mi_switch() at mi_switch+0x16f/frame 0xfffffe00787af930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00787af970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00787af9a0 _sleep() at _sleep+0x358/frame 0xfffffe00787afa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00787afa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00787afab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00787afab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffff800036f2580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00787e9930 mi_switch() at mi_switch+0x16f/frame 0xfffffe00787e9960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00787e99a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00787e99d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe00787e9a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00787e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00787e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00787e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffff800036f2000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00787ee930 mi_switch() at mi_switch+0x16f/frame 0xfffffe00787ee960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00787ee9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00787ee9d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe00787eea40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00787eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00787eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00787eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffff800036f1580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00787f3930 mi_switch() at mi_switch+0x16f/frame 0xfffffe00787f3960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00787f39a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00787f39d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe00787f3a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00787f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00787f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00787f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffff800036f1000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00787f8930 mi_switch() at mi_switch+0x16f/frame 0xfffffe00787f8960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00787f89a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00787f89d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe00787f8a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00787f8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00787f8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00787f8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffff800036f0580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00787fd930 mi_switch() at mi_switch+0x16f/frame 0xfffffe00787fd960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00787fd9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00787fd9d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe00787fda40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00787fda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00787fdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00787fdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffff800036f0000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0000471930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0000471960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004719a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004719d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe0000471a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000471a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000471ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000471ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffff80003733580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0000476930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0000476960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004769a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004769d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe0000476a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000476a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000476ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000476ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffff80003733000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe000047b930 mi_switch() at mi_switch+0x16f/frame 0xfffffe000047b960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000047b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000047b9d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe000047ba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000047ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000047bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000047bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffff80003732580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0000480930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0000480960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004809a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004809d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe0000480a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000480a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000480ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000480ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffff80003732000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0000485930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0000485960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004859a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004859d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe0000485a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000485a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000485ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000485ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffff80003731580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe000048a930 mi_switch() at mi_switch+0x16f/frame 0xfffffe000048a960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000048a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000048a9d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe000048aa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000048aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000048aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000048aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff80003731000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe000048f930 mi_switch() at mi_switch+0x16f/frame 0xfffffe000048f960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000048f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000048f9d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe000048fa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000048fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000048fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000048fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffff8000372c580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0000494930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0000494960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004949a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004949d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe0000494a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000494a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000494ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000494ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffff8000372c000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0000499930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0000499960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004999a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004999d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe0000499a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000499a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000499ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000499ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffff800036f4580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe000049e930 mi_switch() at mi_switch+0x16f/frame 0xfffffe000049e960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000049e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000049e9d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe000049ea40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000049ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000049eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000049eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffff800037b3000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00004a3930 mi_switch() at mi_switch+0x16f/frame 0xfffffe00004a3960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004a39a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a39d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe00004a3a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004a3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffff800037e0580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00004a8930 mi_switch() at mi_switch+0x16f/frame 0xfffffe00004a8960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004a89a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a89d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe00004a8a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004a8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffff800037e0000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00004ad930 mi_switch() at mi_switch+0x16f/frame 0xfffffe00004ad960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004ad9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004ad9d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe00004ada40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004ada70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004adab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004adab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffff800037df580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00004b2930 mi_switch() at mi_switch+0x16f/frame 0xfffffe00004b2960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004b29a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b29d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe00004b2a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004b2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffff800037df000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00004b7930 mi_switch() at mi_switch+0x16f/frame 0xfffffe00004b7960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004b79a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b79d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe00004b7a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004b7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffff800037de580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00004bc930 mi_switch() at mi_switch+0x16f/frame 0xfffffe00004bc960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004bc9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004bc9d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe00004bca40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004bca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004bcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004bcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffff800037de000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00004c1930 mi_switch() at mi_switch+0x16f/frame 0xfffffe00004c1960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004c19a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c19d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe00004c1a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004c1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffff800037d2580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00004c6930 mi_switch() at mi_switch+0x16f/frame 0xfffffe00004c6960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004c69a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c69d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe00004c6a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004c6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffff800037d2000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00004cb930 mi_switch() at mi_switch+0x16f/frame 0xfffffe00004cb960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004cb9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004cb9d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe00004cba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004cba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004cbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004cbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffff800037b3580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00004d0930 mi_switch() at mi_switch+0x16f/frame 0xfffffe00004d0960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004d09a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004d09d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe00004d0a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004d0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffff80003806580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe000058a900 mi_switch() at mi_switch+0x16f/frame 0xfffffe000058a930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000058a970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000058a9a0 _sleep() at _sleep+0x358/frame 0xfffffe000058aa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe000058aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000058aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000058aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xfffff80003919000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe000058f900 mi_switch() at mi_switch+0x16f/frame 0xfffffe000058f930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000058f970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000058f9a0 _sleep() at _sleep+0x358/frame 0xfffffe000058fa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe000058fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000058fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000058fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff80003918580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0000594900 mi_switch() at mi_switch+0x16f/frame 0xfffffe0000594930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000594970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005949a0 _sleep() at _sleep+0x358/frame 0xfffffe0000594a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000594a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000594ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000594ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff80003918000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0000599900 mi_switch() at mi_switch+0x16f/frame 0xfffffe0000599930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000599970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005999a0 _sleep() at _sleep+0x358/frame 0xfffffe0000599a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000599a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000599ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000599ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff80003917580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe000059e900 mi_switch() at mi_switch+0x16f/frame 0xfffffe000059e930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000059e970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000059e9a0 _sleep() at _sleep+0x358/frame 0xfffffe000059ea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe000059ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000059eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000059eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffff80003917000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005a3900 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005a3930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005a3970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005a39a0 _sleep() at _sleep+0x358/frame 0xfffffe00005a3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005a3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005a3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005a3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff80003916580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005a8900 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005a8930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005a8970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005a89a0 _sleep() at _sleep+0x358/frame 0xfffffe00005a8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005a8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005a8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005a8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff80003916000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005ad900 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005ad930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005ad970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ad9a0 _sleep() at _sleep+0x358/frame 0xfffffe00005ada40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005ada70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005adab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005adab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffff80003915580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005b2900 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005b2930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005b2970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005b29a0 _sleep() at _sleep+0x358/frame 0xfffffe00005b2a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005b2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005b2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005b2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffff80003915000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005b7900 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005b7930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005b7970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005b79a0 _sleep() at _sleep+0x358/frame 0xfffffe00005b7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005b7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005b7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005b7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffff8000391d580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005bc900 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005bc930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005bc970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005bc9a0 _sleep() at _sleep+0x358/frame 0xfffffe00005bca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005bca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005bcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005bcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffff8000391d000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005c1900 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005c1930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005c1970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c19a0 _sleep() at _sleep+0x358/frame 0xfffffe00005c1a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005c1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffff8000391c580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe00005c6900 mi_switch() at mi_switch+0x16f/frame 0xfffffe00005c6930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005c6970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c69a0 _sleep() at _sleep+0x358/frame 0xfffffe00005c6a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005c6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffff80006406580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006e9e930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006e9e960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006e9e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e9e9d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe0006e9ea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006e9ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e9eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e9eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100120 td 0xfffff800074e6000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006ed4930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006ed4960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ed49a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ed49d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe0006ed4a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006ed4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ed4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ed4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffff800074e5580 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006ed9930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006ed9960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ed99a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ed99d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe0006ed9a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006ed9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ed9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ed9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffff800074e5000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006ede930 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006ede960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ede9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ede9d0 msleep_spin_sbt() at msleep_spin_sbt+0x1b3/frame 0xfffffe0006edea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006edea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006edeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006edeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffff800074e4000 sched_switch() at sched_switch+0x7ca/frame 0xfffffe0006ee8900 mi_switch() at mi_switch+0x16f/frame 0xfffffe0006ee8930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0006ee8970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ee89a0 _sleep() at _sleep+0x358/frame 0xfffffe0006ee8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0006ee8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ee8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ee8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> dump Dumping 2212 out of 32621 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db> reset (kgdb) bt #0 doadump (textdump=0x0) at pcpu.h:230 #1 0xffffffff8043daab in db_dump (dummy=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:574 #2 0xffffffff8043d879 in db_command (cmd_table=) at ../../../ddb/db_command.c:481 #3 0xffffffff804427d8 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #4 0xffffffff8043d879 in db_command (cmd_table=) at ../../../ddb/db_command.c:481 #5 0xffffffff8043d5f4 in db_command_loop () at ../../../ddb/db_command.c:534 #6 0xffffffff8044080f in db_trap (type=, code=) at ../../../ddb/db_main.c:252 #7 0xffffffff80bd8bc3 in kdb_trap (type=0x3, code=0x0, tf=) at ../../../kern/subr_kdb.c:693 #8 0xffffffff81067aa6 in trap (frame=0xfffffe0006bc4bd0) at ../../../amd64/amd64/trap.c:619 #9 0xffffffff81044365 in calltrap () at ../../../amd64/amd64/exception.S:232 #10 0xffffffff80bd828b in kdb_enter (why=0xffffffff812f3d00 "panic", msg=) at cpufunc.h:65 #11 0xffffffff80b906b0 in vpanic (fmt=, ap=0xfffffe0006bc4d40) at ../../../kern/kern_shutdown.c:861 #12 0xffffffff80b90453 in panic (fmt=) at ../../../kern/kern_shutdown.c:799 #13 0xffffffff827de15b in pmc_add_sample (ring=2177961488, pm=0xfffff802d5c32a00, tf=0x278) at /usr/src/sys/dev/hwpmc/hwpmc_mod.c:4694 #14 0xffffffff827eb912 in core2_intr (tf=0xfffffe0006bc4f30) at /usr/src/sys/dev/hwpmc/hwpmc_core.c:1204 #15 0xffffffff81067336 in trap (frame=0xfffffe0006bc4f30) at ../../../amd64/amd64/trap.c:231 #16 0xffffffff8104506d in nmi_calltrap () at ../../../amd64/amd64/exception.S:776 #17 0xffffffff8105348a in pmap_invalidate_page (pmap=0xfffff80150f9d130, va=0x7fffffffe000) at cpufunc.h:550 #18 0xffffffff8105885f in pmap_enter (pmap=, va=0x1fe, m=0xfffff8085c6daaa8, prot=, flags=, psind=) at ../../../amd64/amd64/pmap.c:5070 #19 0xffffffff80ece206 in vm_fault_hold (map=0xfffff80150f9d000, vaddr=, fault_type=0x2, fault_flags=, m_hold=0x0) at ../../../vm/vm_fault.c:1286 #20 0xffffffff80ecc7d0 in vm_fault (map=0xfffff80150f9d000, vaddr=, fault_type=0x2, fault_flags=0x0) at ../../../vm/vm_fault.c:536 #21 0xffffffff81068058 in trap_pfault (frame=0xfffffe00a9567ac0, usermode=) at ../../../amd64/amd64/trap.c:830 #22 0xffffffff810676fa in trap (frame=0xfffffe00a9567ac0) at ../../../amd64/amd64/trap.c:351 #23 0xffffffff81044365 in calltrap () at ../../../amd64/amd64/exception.S:232 #24 0x0000000000217cf9 in ?? () Previous frame inner to this frame (corrupt stack?) Current language: auto; currently minimal (kgdb) f 13 #13 0xffffffff827de15b in pmc_add_sample (ring=2177961488, pm=0xfffff802d5c32a00, tf=0x278) at /usr/src/sys/dev/hwpmc/hwpmc_mod.c:4694 4694 KASSERT(counter_u64_fetch(pm->pm_runcount) > 0, (kgdb) l 4689 PMCDBG6(SAM,INT,1,"(spc) cpu=%d pm=%p tf=%p um=%d wr=%d rd=%d", 4690 cpu, pm, (void *) tf, inuserspace, 4691 (int) (psb->ps_prodidx & pmc_sample_mask), 4692 (int) (psb->ps_considx & pmc_sample_mask)); 4693 callchaindepth = 1; 4694 KASSERT(counter_u64_fetch(pm->pm_runcount) > 0, 4695 ("[pmc,%d] pm=%p runcount %ld", __LINE__, (void *) pm, 4696 (unsigned long)counter_u64_fetch(pm->pm_runcount))); 4697 4698 error = ENOMEM; (kgdb) info loc psb = (struct pmc_samplebuffer *) 0xfffffe009e29c000 ps = (struct pmc_sample *) 0xfffffe009e29e3c0 callchaindepth = Cannot access memory at address 0x1 (kgdb) p *pm $1 = {pm_targets = {lh_first = 0x0}, pm_next = {le_next = 0xfffff803e708b700, le_prev = 0xfffff80150e84108}, pm_gv = {pm_savedvalue = 0x0}, pm_sc = {pm_reloadcount = 0x186a3, pm_initial = 0x186a3}, pm_pcpu_state = 0xfffff80548935800, pm_cpustate = {__bits = 0xfffff802d5c32a30}, pm_caps = 0x161, pm_event = 462, pm_flags = 0x20080, pm_owner = 0xfffff8014e36c000, pm_runcount = 0xfffffe0006ef8fa0, pm_state = PMC_STATE_RUNNING, pm_overflowcnt = 0x0, pm_id = 0x300711, pm_class = PMC_CLASS_IAP, pm_md = { pm_amd = {pm_amd_evsel = 0x1320bd}, pm_iaf = {pm_iaf_ctrl = 0x1320bd}, pm_iap = {pm_iap_evsel = 0x1320bd, pm_iap_rsp = 0x0}, pm_ucf = {pm_ucf_ctrl = 0x1320bd}, pm_ucp = { pm_ucp_evsel = 0x1320bd}}} (kgdb) -- Test scenario: pmcstat -S inst_retired.any_p -T on screen1 pmcstat -S tlb_flush.stlb_any -T on screen2