KDB: enter: watchdog timeout, vmcore.836 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2024 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 15.0-CURRENT #0 main-n271080-96d8f35f2a2b-dirty: Mon Jul 8 14:33:45 CEST 2024 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 18.1.6 (https://github.com/llvm/llvm-project.git llvmorg-18.1.6-0-g1118c2e05e67) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.21-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33171128320 (31634 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 6 7 11 9 8 10 2 4 5 3 random: entropy device external interface kbd1 at kbdmux0 vtvga0: smbios0: at iomem 0xf05e0-0xf05fe smbios0: Version: 3.0, BCD Revision: 3.0 aesni0: acpi0: <> acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb416000-0xfb4167ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb412000-0xfb4123ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: EEPROM V1.63-0 eTrack 0x800009fa igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: Usinugen0.3: at usbus0 ukbd0 on uhub3 ukbd0: on usbus0 kbd2 at ukbd0 Setting hostuuid: 00000000-0000-0000-0000-002590c99976. Setting hostid: 0x90b83241. Starting file system checks: WARNING: / was not properly dismounted Mounting local filesystems:. Autoloading module: acpi_wmi Autoloading module: ichsmb Autoloading module: ioat ioat0: mem 0x383ffff1c000-0x383ffff1ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0x383ffff18000-0x383ffff1bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0x383ffff14000-0x383ffff17fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0x383ffff10000-0x383ffff13fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0x383ffff0c000-0x383ffff0ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0x383ffff08000-0x383ffff0bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0x383ffff04000-0x383ffff07fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0x383ffff00000-0x383ffff03fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 ichsmb0: port 0x580-0x59f mem 0x383ffff21000-0x383ffff210ff irq 18 at device 31.3 on pci1 smbus0: on ichsmb0 acpi_wmi0: on acpi0 acpi_wmi0: cannot find EC device fsck2+ fsck -fy /tmp ** /dev/gpt/tmpzes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 1164 files, 65131 used, 1200276 free (100 frags, 150022 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** + set +x Updating CPU Microcode... CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.00-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics Done. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/e2fsprogs /usr/local/lib/perl5/5.36/mach/CORE 32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32/compat Setting hostname: mercat1.netperf.freebsd.org. Setting up harvesting: PURE_RDRAND,[CALLOUT],[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . igb0: link state changed to UP debugnet_any_ifnet_update: Bad dn_init result from igb0 (ifp 0xfffff800058ba800), ignoring. lo0: link state changed to UP igb0: link state changed to DOWN Starting Network: lo0 igb0 igb1 mce0 mce1. lo0: flags=1008049 metric 0 mtu 16384 options=680003 inet 127.0.0.1 netmask 0xff000000 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 groups: lo nd6 options=21 igb0: flags=8843 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:da inet6 fe80::ec4:7aff:fea8:cdda%igb0 prefixlen 64 scopeid 0x1 media: Ethernet autoselect status: no carrier nd6 options=21 igb1: flags=8802 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 mce0: flags=8802 metric 0 mtu 1500 options=7eef07bb ether 7c:fe:90:30:ee:38 media: Ethernet autoselect status: no carrier nd6 options=29 mce1: flags=8802 metric 0 mtu 1500 options=7eef07bb ether 7c:fe:90:30:ee:39 media: Ethernet autoselect status: no carrier nd6 options=29 Starting devd. igb0: link state changed to UP Autoloading module: mlx5 Autoloading module: mlx5 Starting Network: igb1. igb1: flags=8802 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Starting Network: mce0. mce0: flags=8802 metric 0 mtu 1500 options=7eef07bb ether 7c:fe:90:30:ee:38 media: Ethernet autoselect status: no carrier nd6 options=29 Starting Network: mce1. mce1: flags=8802 metric 0 mtu 1500 options=7eef07bb ether 7c:fe:90:30:ee:39 media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid Autoloading module: ums Autoloading module: usbhid ums0 on uhub3 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192.168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. route: message indicates error: File exists add host 127.0.0.1: gateway lo0 fib 0: route already in table route: message indicates error: File exists add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. No core dumps found. Starting watchdogd. Setting date via ntp. 8 Jul 14:37:14 ntpdate[3461]: step time server 192.168.5.1 offset +0.250857 sec Clearing /tmp (X related). Recovering vi editor sessions:. Updating motd:. Updating /var/run/os-release done. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Mounting late filesystems:. Starting powerd. Starting inetd. Starting cron. Performing sanity check on sshd configuration. Starting sshd. Mon Jul 8 14:37 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: Jul 8 14:37:23 mercat1 su[3647]: pho to root on /dev/pts/0 20240708 14:37:49 all (1/1): swapoff.sh swp_pager_getswapspace(32): failed stress2: pts leak: 1/2 20240708 14:40:26 all (1/1): swapoff.sh Jul 8 14:41:21 mercat1 kernel: pid 25252 (rw), uid 2007 inumber 93772 on /mnt: filesystem full Jul 8 14:42:25 mercat1 kernel: pid 25262 (mkdir), uid 2007 inumber 21303 on /mnt: filesystem full Jul 8 14:42:39 mercat1 kernel: pid 50783 (mkdir), uid 2007 inumber 98799 on /mnt: out of inodes 20240708 14:43:05 all (1/1): swapoff.sh Jul 8 14:45:17 mercat1 kernel: pid 69176 (rw), uid 2007 inumber 68837 on /mnt: filesystem full 20240708 14:45:44 all (1/1): swapoff.sh Jul 8 14:46:41 mercat1 kernel: pid 74779 (mkdir), uid 2007 inumber 30720 on /mnt: filesystem full Jul 8 14:48:02 mercat1 kernel: pid 80630 (rw), uid 2007 inumber 119287 on /mnt: filesystem full root Jul 8 15:34:41 mercat1 login[3619]: ROOT LOGIN (root) ON ttyu1 Last login: Mon Jul 8 13:33:47 on ttyu1 FreeBSD 15.0-CURRENT #0 main-n271080-96d8f35f2a2b-dirty: Mon Jul 8 14:33:45 CEST 2024 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO Welcome to FreeBSD! Release Notes, Errata: https://www.FreeBSD.org/releases/ Security Advisories: https://www.FreeBSD.org/security/ FreeBSD Handbook: https://www.FreeBSD.org/handbook/ FreeBSD FAQ: https://www.FreeBSD.org/faq/ Questions List: https://www.FreeBSD.org/lists/questions/ FreeBSD Forums: https://forums.FreeBSD.org/ Documents installed with the system are in the /usr/local/share/doc/freebsd/ directory, or can be installed later with: pkg install en-freebsd-doc For other languages, replace "en" with a language code like de or fr. Show the version of FreeBSD installed: freebsd-version ; uname -a Please include that output and any error messages when posting questions. Introduction to manual pages: man man FreeBSD directory layout: man hier To change this login announcement, see motd(5). You have new mail. root@mercat1:~ # ps -l UID PID PPID C PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 0 3619 1 8 20 0 13552 3576 wait Ss u1 0:00.01 login [pam] (login) 0 87525 3619 8 20 0 13700 3864 wait S u1 0:00.01 -sh (sh) 0 87527 87525 7 20 0 13768 3620 - R+ u1 0:00.00 ps -l 0 3611 1 6 68 0 13156 2272 ttyin Is+ v0 0:00.00 /usr/libexec/getty Pc ttyv0 0 3612 1 2 68 0 13156 2272 ttyin Is+ v1 0:00.00 /usr/libexec/getty Pc ttyv1 0 3613 1 7 68 0 13156 2272 ttyin Is+ v2 0:00.00 /usr/libexec/getty Pc ttyv2 0 3614 1 8 68 0 13156 2264 ttyin Is+ v3 0:00.00 /usr/libexec/getty Pc ttyv3 0 3615 1 9 68 0 13156 2276 ttyin Is+ v4 0:00.00 /usr/libexec/getty Pc ttyv4 0 3616 1 0 68 0 13156 2272 ttyin Is+ v5 0:00.00 /usr/libexec/getty Pc ttyv5 0 3617 1 5 68 0 13156 2272 ttyin Is+ v6 0:00.00 /usr/libexec/getty Pc ttyv6 0 3618 1 11 68 0 13156 2268 ttyin Is+ v7 0:00.00 /usr/libexec/getty Pc ttyv7 0 3646 3624 9 68 0 13528 8 wait IW 0 0:00.00 su 0 3647 3646 8 68 0 13700 8 wait IW 0 0:00.00 su (sh) 0 3648 3647 11 20 0 17472 2492 select I+ 0 0:00.07 bash 0 3706 3648 10 135 0 13700 1116 - R 0 46:22.21 /bin/sh ./all.sh -m 720 swapoff.sh root@mercat1:~ # procstat -k 3706 PID TID COMM TDNAME KSTACK 3706 100229 sh - root@mercat1:~ # root@mercat1:~ # KDB: enter: Break to debugger [ thread pid 11 tid 100003 ] Stopped at kdb_alt_break_internal+0x14d: movq $0,0x105bde8(%rip) db> ps pid ppid pgrp uid state wmesg wchan cmd 2463 3824 3792 0 S nanslp 0xffffffff81bdb1a3 sleep 87525 3619 87525 0 S+ ttyin 0xfffff8000647f8b0 sh 82556 9054 9054 2006 S+ nanslp 0xffffffff81bdb1a2 sleep 57564 57563 57564 2006 Ss+ ttyin 0xfffff8075b0fc0b0 sh 57563 57560 57560 2006 S select 0xfffff80003ebd8c0 sshd 57560 3597 57560 0 Ss select 0xfffff801c1e412c0 sshd 9054 6820 9054 2006 S+ wait 0xfffffe016f154020 sh 6820 6662 6820 2006 SWs+ wait 0xfffffe016e444020 sh 6662 5418 5418 2006 S select 0xfffff80003e97dc0 sshd 5418 3597 5418 0 Ss select 0xfffff800050c19c0 sshd 3827 3792 3792 0 S piperd 0xfffffe016d3b9888 sh 3825 3792 3792 0 S piperd 0xfffffe0163f075b0 awk 3824 3792 3792 0 S wait 0xfffffe0163fe4040 sh 3792 1 3792 0 SWs wait 0xfffffe016d2fc060 sh 3706 3648 3706 0 R+ CPU 10 sh 3648 3647 3648 0 S+ select 0xfffff80009567a40 bash 3647 3646 3647 0 SW+ wait 0xfffffe010ebe2040 sh 3646 3624 3646 2006 SW+ wait 0xfffffe0163f0e5c0 su 3624 3623 3624 2006 SWs+ wait 0xfffffe003ce745a0 sh --More-- db> proc 3706 No such command; use "help" to list available commands db> bt 3706 Tracing pid 3706 tid 100229 td 0xfffff80053300740 cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003cec3df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003cec3e00 trap() at trap+0x56/frame 0xfffffe003cec3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cec3f20 --- trap 0x13, rip = 0x2882cbc92549, rsp = 0x288aec6c35c8, rbp = 0x288aec6c35e0 --- db> bt 3706 Tracing pid 3706 tid 100229 td 0xfffff80053300740 cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003cec3df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003cec3e00 trap() at trap+0x56/frame 0xfffffe003cec3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cec3f20 --- trap 0x13, rip = 0x2882cbc92549, rsp = 0x288aec6c35c8, rbp = 0x288aec6c35e0 --- db> ps pid ppid pgrp uid state wmesg wchan cmd 2463 3824 3792 0 S nanslp 0xffffffff81bdb1a3 sleep 87525 3619 87525 0 S+ ttyin 0xfffff8000647f8b0 sh 82556 9054 9054 2006 S+ nanslp 0xffffffff81bdb1a2 sleep 57564 57563 57564 2006 Ss+ ttyin 0xfffff8075b0fc0b0 sh 57563 57560 57560 2006 S select 0xfffff80003ebd8c0 sshd 57560 3597 57560 0 Ss select 0xfffff801c1e412c0 sshd 9054 6820 9054 2006 S+ wait 0xfffffe016f154020 sh 6820 6662 6820 2006 SWs+ wait 0xfffffe016e444020 sh 6662 5418 5418 2006 S select 0xfffff80003e97dc0 sshd 5418 3597 5418 0 Ss select 0xfffff800050c19c0 sshd 3827 3792 3792 0 S piperd 0xfffffe016d3b9888 sh 3825 3792 3792 0 S piperd 0xfffffe0163f075b0 awk 3824 3792 3792 0 S wait 0xfffffe0163fe4040 sh 3792 1 3792 0 SWs wait 0xfffffe016d2fc060 sh 3706 3648 3706 0 R+ CPU 10 sh 3648 3647 3648 0 S+ select 0xfffff80009567a40 bash 3647 3646 3647 0 SW+ wait 0xfffffe010ebe2040 sh 3646 3624 3646 2006 SW+ wait 0xfffffe0163f0e5c0 su 3624 3623 3624 2006 SWs+ wait 0xfffffe003ce745a0 sh --More-- 3623 3620 3620 2006 S select 0xfffff800053951c0 sshd 3620 3597 3620 0 Ss select 0xfffff8005e3810c0 sshd 3619 1 3619 0 Ss+ wait 0xfffffe016ad57040 login 3618 1 3618 0 Ss+ ttyin 0xfffff800094838b0 getty 3617 1 3617 0 Ss+ ttyin 0xfffff80009483cb0 getty 3616 1 3616 0 Ss+ ttyin 0xfffff800094820b0 getty 3615 1 3615 0 Ss+ ttyin 0xfffff800094824b0 getty 3614 1 3614 0 Ss+ ttyin 0xfffff800094828b0 getty 3613 1 3613 0 Ss+ ttyin 0xfffff80009482cb0 getty 3612 1 3612 0 Ss+ ttyin 0xfffff800094810b0 getty 3611 1 3611 0 Ss+ ttyin 0xfffff800094814b0 getty 3597 1 3597 0 Ss select 0xfffff800050c1bc0 sshd 3580 1 3580 0 Ss nanslp 0xffffffff81bdb1a5 cron 3575 1 3575 0 Ss select 0xfffff800050c1b40 inetd 3554 1 3554 0 Ss select 0xfffff80003f6adc0 powerd 3537 1 3537 123 Ss (threaded) ntpd 100292 S select 0xfffff800538ad840 ntpd 100639 S usem 0xfffff803117e0b00 ntpd 3439 1 3439 0 Ss nanslp 0xffffffff81bdb1a4 watchdogd 3422 1 3422 0 Ss kqread 0xfffff80230e78800 syslogd --More-- db> show alllocks db> c -sh: /root: Permission denied root@mercat1:~ # kill 3706 root@mercat1:~ # 20240708 15:36:09 all (1/1): swapoff.sh 20240708 15:40:25 all (1/1): swapoff.sh Jul 8 15:40:34 mercat1 kernel: pid 49856 (rw), uid 2007 inumber 72425 on /mnt: filesystem full Jul 8 15:41:00 mercat1 kernel: pid 49776 (rw), uid 2007 inumber 75063 on /mnt: filesystem full Jul 8 15:41:07 mercat1 kernel: pid 49909 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page root@mercat1:~ # Jul 8 15:42:41 mercat1 kernel: pid 55784 (rw), uid 2007 inumber 45 on /mnt: filesystem full Jul 8 15:42:48 mercat1 kernel: pid 55794 (link), uid 2007 inumber 65814 on /mnt: filesystem full Jul 8 15:42:51 mercat1 kernel: pid 55732 (link), uid 2007 inumber 65821 on /mnt: filesystem full Jul 8 15:42:56 mercat1 kernel: pid 55774 (creat), uid 2007 inumber 32912 on /mnt: out of inodes 20240708 15:43:08 all (1/1): swapoff.sh Jul 8 15:43:56 mercat1 kernel: pid 61499 (rw), uid 2007 inumber 670 on /mnt: filesystem full 20240708 15:45:49 all (1/1): swapoff.sh 20240708 15:48:34 all (1/1): swapoff.sh Jul 8 15:48:45 mercat1 kernel: pid 87376 (rw), uid 2007 inumber 12133 on /mnt: filesystem full Jul 8 15:49:40 mercat1 kernel: pid 87416 (rw), uid 2007 inumber 67935 on /mnt: filesystem full Jul 8 15:50:50 mercat1 kernel: pid 95129 (rw), uid 2007 inumber 56477 on /mnt: filesystem full Jul 8 15:50:51 mercat1 kernel: pid 95186 (rw), uid 2007 inumber 47630 on /mnt: filesystem full Jul 8 15:50:52 mercat1 kernel: pid 95142 (rw), uid 2007 inumber 72521 on /mnt: filesystem full Jul 8 15:51:05 mercat1 kernel: pid 95164 (rw), uid 2007 inumber 39835 on /mnt: filesystem full 20240708 15:51:11 all (1/1): swapoff.sh Jul 8 15:52:12 mercat1 kernel: pid 779 (mkdir), uid 2007 inumber 107101 on /mnt: out of inodes Jul 8 15:52:51 mercat1 kernel: pid 823 (mkdir), uid 2007 inumber 16475 on /mnt: out of inodes Jul 8 15:52:52 mercat1 kernel: pid 834 (rw), uid 2007 inumber 94578 on /mnt: filesystem full 20240708 15:54:03 all (1/1): swapoff.sh 20240708 15:56:48 all (1/1): swapoff.sh Jul 8 15:57:37 mercat1 kernel: pid 29560 (rw), uid 2007 inumber 104937 on /mnt: filesystem full swp_pager_getswapspace(7): failed 20240708 15:59:28 all (1/1): swapoff.sh Jul 8 15:59:35 mercat1 kernel: pid 41779 (creat), uid 2007 inumber 9 on /mnt: filesystem full Jul 8 16:00:20 mercat1 kernel: pid 41705 (mkdir), uid 2007 inumber 32476 on /mnt: out of inodes Jul 8 16:00:27 mercat1 kernel: pid 41788 (mkdir), uid 2007 inumber 65790 on /mnt: out of inodes Jul 8 16:00:42 mercat1 kernel: pid 41700 (creat), uid 2007 inumber 65794 on /mnt: out of inodes Jul 8 16:00:45 mercat1 kernel: pid 41757 (creat), uid 2007 inumber 98701 on /mnt: out of inodes 20240708 16:02:08 all (1/1): swapoff.sh Jul 8 16:03:33 mercat1 kernel: pid 53216 (openat), uid 2007 inumber 98693 on /mnt: out of inodes 20240708 16:04:49 all (1/1): swapoff.sh Jul 8 16:05:59 mercat1 kernel: pid 64491 (openat), uid 2007 inumber 98698 on /mnt: out of inodes Jul 8 16:06:04 mercat1 kernel: pid 64539 (creat), uid 2007 inumber 65801 on /mnt: out of inodes Jul 8 16:06:08 mercat1 kernel: pid 64576 (link), uid 2007 inumber 14 on /mnt: out of inodes Jul 8 16:06:22 mercat1 kernel: pid 64573 (creat), uid 2007 inumber 98712 on /mnt: out of inodes Jul 8 16:07:05 mercat1 kernel: pid 70343 (rw), uid 2007 inumber 61570 on /mnt: filesystem full Jul 8 16:07:07 mercat1 kernel: pid 70352 (rw), uid 2007 inumber 59634 on /mnt: filesystem full 20240708 16:07:30 all (1/1): swapoff.sh Jul 8 16:07:45 mercat1 kernel: pid 75840 (symlink), uid 2007 inumber 65792 on /mnt: filesystem full Jul 8 16:09:45 mercat1 kernel: pid 81755 (mkdir), uid 2007 inumber 99 on /mnt: out of inodes Jul 8 16:10:02 mercat1 kernel: pid 81734 (creat), uid 2007 inumber 10 on /mnt: out of inodes 20240708 16:10:17 all (1/1): swapoff.sh Jul 8 16:10:51 mercat1 kernel: pid 95406 (rw), uid 2007 inumber 36993 on /mnt: filesystem full Jul 8 16:12:32 mercat1 kernel: pid 3955 (rw), uid 2007 inumber 76663 on /mnt: filesystem full Jul 8 16:12:35 mercat1 kernel: pid 3970 (creat), uid 2007 inumber 721 on /mnt: filesystem full 20240708 16:12:57 all (1/1): swapoff.sh Jul 8 16:15:16 mercat1 kernel: pid 14263 (rw), uid 2007 inumber 15988 on /mnt: filesystem full 20240708 16:15:42 all (1/1): swapoff.sh Jul 8 16:15:56 mercat1 kernel: pid 23965 (rw), uid 2007 inumber 14862 on /mnt: filesystem full Jul 8 16:16:55 mercat1 kernel: pid 24039 (creat), uid 2007 inumber 65805 on /mnt: filesystem full Jul 8 16:17:41 mercat1 kernel: pid 23962 (openat), uid 2007 inumber 6 on /mnt: out of inodes swp_pager_getswapspace(32): failed 20240708 16:18:16 all (1/1): swapoff.sh Jul 8 16:19:02 mercat1 kernel: pid 39573 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page Jul 8 16:19:42 mercat1 kernel: pid 39497 (creat), uid 2007 inumber 65795 on /mnt: out of inodes Jul 8 16:19:49 mercat1 kernel: pid 39527 (mkdir), uid 2007 inumber 107 on /mnt: out of inodes Jul 8 16:20:10 mercat1 kernel: pid 39539 (openat), uid 2007 inumber 98833 on /mnt: out of inodes 20240708 16:21:21 all (1/1): swapoff.sh 20240708 16:23:57 all (1/1): swapoff.sh Jul 8 16:24:09 mercat1 kernel: pid 63547 (mkdir), uid 2007 inumber 110851 on /mnt: filesystem full Jul 8 16:24:20 mercat1 kernel: pid 63568 (mkdir), uid 2007 inumber 31551 on /mnt: out of inodes Jul 8 16:25:10 mercat1 kernel: pid 63586 (creat), uid 2007 inumber 98711 on /mnt: out of inodes Jul 8 16:25:15 mercat1 kernel: pid 63601 (creat), uid 2007 inumber 14 on /mnt: out of inodes Jul 8 16:25:45 mercat1 kernel: pid 63619 (creat), uid 2007 inumber 65806 on /mnt: out of inodes 20240708 16:26:55 all (1/1): swapoff.sh Jul 8 16:27:07 mercat1 kernel: pid 76643 (rw), uid 2007 inumber 45195 on /mnt: filesystem full Jul 8 16:27:12 mercat1 kernel: pid 76618 (rw), uid 2007 inumber 7 on /mnt: out of inodes Jul 8 16:27:23 mercat1 kernel: pid 76638 (rw), uid 2007 inumber 88672 on /mnt: filesystem full Jul 8 16:27:33 mercat1 kernel: pid 76631 (openat), uid 2007 inumber 65798 on /mnt: out of inodes Jul 8 16:27:36 mercat1 kernel: pid 76611 (symlink), uid 2007 inumber 98690 on /mnt: out of inodes Jul 8 16:27:43 mercat1 kernel: pid 76661 (mkdir), uid 2007 inumber 90113 on /mnt: filesystem full Jul 8 16:27:50 mercat1 kernel: pid 76617 (symlink), uid 2007 inumber 4 on /mnt: out of inodes Jul 8 16:28:03 mercat1 kernel: pid 76653 (mkdir), uid 2007 inumber 97269 on /mnt: out of inodes Jul 8 16:28:10 mercat1 kernel: pid 76616 (openat), uid 2007 inumber 98692 on /mnt: out of inodes Jul 8 16:28:27 mercat1 kernel: pid 76657 (mkfifo), uid 2007 inumber 98688 on /mnt: out of inodes 20240708 16:29:35 all (1/1): swapoff.sh Jul 8 16:30:21 mercat1 kernel: pid 97006 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page Jul 8 16:31:14 mercat1 kernel: pid 97023 (rw), uid 2007 inumber 122327 on /mnt: filesystem full Jul 8 16:31:34 mercat1 kernel: pid 97049 (mkdir), uid 2007 inumber 32987 on /mnt: filesystem full 20240708 16:32:22 all (1/1): swapoff.sh swp_pager_getswapspace(8): failed Jul 8 16:34:46 mercat1 kernel: pid 18846 (rw), uid 2007 inumber 73274 on /mnt: filesystem full Jul 8 16:34:50 mercat1 kernel: pid 18864 (rw), uid 2007 inumber 89698 on /mnt: filesystem full 20240708 16:35:10 all (1/1): swapoff.sh Jul 8 16:37:27 mercat1 kernel: pid 36048 (rw), uid 2007 inumber 24450 on /mnt: filesystem full 20240708 16:37:43 all (1/1): swapoff.sh Jul 8 16:39:33 mercat1 kernel: pid 41490 (rw), uid 2007 inumber 61603 on /mnt: filesystem full Jul 8 16:40:00 mercat1 kernel: pid 43915 (rw), uid 2007 inumber 13738 on /mnt: filesystem full 20240708 16:40:41 all (1/1): swapoff.sh 20240708 16:43:20 all (1/1): swapoff.sh Jul 8 16:46:07 mercat1 kernel: pid 65946 (creat), uid 2007 inumber 30 on /mnt: out of inodes 20240708 16:46:14 all (1/1): swapoff.sh 20240708 16:48:53 all (1/1): swapoff.sh 20240708 16:51:34 all (1/1): swapoff.sh Jul 8 16:51:43 mercat1 kernel: pid 25202 (creat), uid 2007 inumber 98712 on /mnt: filesystem full Jul 8 16:51:53 mercat1 kernel: pid 25175 (rw), uid 2007 inumber 40958 on /mnt: filesystem full Jul 8 16:53:31 mercat1 kernel: pid 25107 (rw), uid 2007 inumber 11428 on /mnt: filesystem full Jul 8 16:53:48 mercat1 kernel: pid 31120 (rw), uid 2007 inumber 69243 on /mnt: filesystem full Jul 8 16:53:54 mercat1 kernel: pid 31123 (rw), uid 2007 inumber 86879 on /mnt: filesystem full Jul 8 16:53:56 mercat1 kernel: pid 31089 (rw), uid 2007 inumber 74198 on /mnt: filesystem full Jul 8 16:54:05 mercat1 kernel: pid 31077 (creat), uid 2007 inumber 98727 on /mnt: out of inodes 20240708 16:54:21 all (1/1): swapoff.sh Jul 8 16:54:33 mercat1 kernel: pid 37662 (mkdir), uid 2007 inumber 19108 on /mnt: filesystem full Jul 8 16:55:49 mercat1 kernel: pid 37667 (mkdir), uid 2007 inumber 105588 on /mnt: filesystem full Jul 8 16:56:04 mercat1 kernel: pid 37562 (rw), uid 2007 inumber 1446 on /mnt: filesystem full 20240708 16:57:00 all (1/1): swapoff.sh swp_pager_getswapspace(32): failed 20240708 16:59:44 all (1/1): swapoff.sh Jul 8 17:00:08 mercat1 kernel: pid 70595 (mkdir), uid 2007 inumber 115735 on /mnt: filesystem full Jul 8 17:00:13 mercat1 kernel: pid 70581 (rw), uid 2007 inumber 101508 on /mnt: filesystem full Jul 8 17:00:20 mercat1 kernel: pid 70548 (symlink), uid 2007 inumber 65792 on /mnt: filesystem full Jul 8 17:00:24 mercat1 kernel: pid 70633 (mkdir), uid 2007 inumber 102288 on /mnt: filesystem full Jul 8 17:00:50 mercat1 kernel: pid 70576 (rw), uid 2007 inumber 65869 on /mnt: filesystem full Jul 8 17:01:54 mercat1 kernel: pid 77217 (mkdir), uid 2007 inumber 17819 on /mnt: filesystem full Jul 8 17:02:03 mercat1 kernel: pid 77263 (rw), uid 2007 inumber 110528 on /mnt: filesystem full Jul 8 17:02:11 mercat1 kernel: pid 77252 (mkdir), uid 2007 inumber 32894 on /mnt: out of inodes Jul 8 17:02:16 mercat1 kernel: pid 77232 (mkdir), uid 2007 inumber 98483 on /mnt: out of inodes 20240708 17:02:23 all (1/1): swapoff.sh Jul 8 17:03:11 mercat1 kernel: pid 82584 (mkdir), uid 2007 inumber 98019 on /mnt: out of inodes Jul 8 17:03:39 mercat1 kernel: pid 82598 (link), uid 2007 inumber 5 on /mnt: out of inodes 20240708 17:05:04 all (1/1): swapoff.sh Jul 8 17:07:00 mercat1 kernel: pid 98856 (rw), uid 2007 inumber 81708 on /mnt: filesystem full 20240708 17:07:57 all (1/1): swapoff.sh Jul 8 17:08:09 mercat1 kernel: pid 10741 (rw), uid 2007 inumber 122573 on /mnt: filesystem full 20240708 17:10:45 all (1/1): swapoff.sh Jul 8 17:11:51 mercat1 kernel: pid 36282 (creat), uid 2007 inumber 9 on /mnt: out of inodes Jul 8 17:12:10 mercat1 kernel: pid 36185 (symlink), uid 2007 inumber 98689 on /mnt: out of inodes Jul 8 17:13:01 mercat1 kernel: pid 48206 (rw), uid 2007 inumber 49935 on /mnt: filesystem full 20240708 17:13:33 all (1/1): swapoff.sh swp_pager_getswapspace(1): failed 20240708 17:16:17 all (1/1): swapoff.sh Jul 8 17:17:17 mercat1 kernel: pid 69851 (mkfifo), uid 2007 inumber 98688 on /mnt: out of inodes Jul 8 17:17:30 mercat1 kernel: pid 69893 (mkdir), uid 2007 inumber 23152 on /mnt: out of inodes Jul 8 17:17:47 mercat1 kernel: pid 69858 (symlink), uid 2007 inumber 8 on /mnt: out of inodes 20240708 17:18:51 all (1/1): swapoff.sh Jul 8 17:20:46 mercat1 kernel: pid 82628 (creat), uid 2007 inumber 12 on /mnt: out of inodes 20240708 17:21:43 all (1/1): swapoff.sh Jul 8 17:23:26 mercat1 kernel: pid 94092 (rw), uid 2007 inumber 65801 on /mnt: filesystem full Jul 8 17:23:42 mercat1 kernel: pid 94077 (symlink), uid 2007 inumber 98691 on /mnt: filesystem full 20240708 17:24:27 all (1/1): swapoff.sh 20240708 17:27:26 all (1/1): swapoff.sh Jul 8 17:28:19 mercat1 kernel: pid 17280 (mkdir), uid 2007 inumber 98595 on /mnt: out of inodes Jul 8 17:28:59 mercat1 kernel: pid 17325 (openat), uid 2007 inumber 15 on /mnt: out of inodes Jul 8 17:29:40 mercat1 kernel: pid 22453 (rw), uid 2007 inumber 20563 on /mnt: filesystem full 20240708 17:30:33 all (1/1): swapoff.sh 20240708 17:33:13 all (1/1): swapoff.sh Jul 8 17:33:49 mercat1 kernel: pid 42349 (rw), uid 2007 inumber 52887 on /mnt: filesystem full Jul 8 17:34:00 mercat1 kernel: pid 42384 (link), uid 2007 inumber 98702 on /mnt: filesystem full Jul 8 17:34:25 mercat1 kernel: pid 42464 (mkdir), uid 2007 inumber 87861 on /mnt: out of inodes Jul 8 17:34:42 mercat1 kernel: pid 42484 (swap), jid 0, uid 2007, was killed: failed to reclaim memory Jul 8 17:35:34 mercat1 kernel: pid 48548 (creat), uid 2007 inumber 65908 on /mnt: out of inodes 20240708 17:36:05 all (1/1): swapoff.sh Jul 8 17:37:05 mercat1 kernel: pid 59327 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page Jul 8 17:37:06 mercat1 kernel: pid 59261 (rw), uid 2007 inumber 69405 on /mnt: filesystem full Jul 8 17:39:08 mercat1 kernel: pid 64759 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page 20240708 17:40:28 all (1/1): swapoff.sh Jul 8 17:41:19 mercat1 kernel: pid 70301 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page Jul 8 17:42:43 mercat1 kernel: pid 75642 (rw), uid 2007 inumber 81905 on /mnt: filesystem full Jul 8 17:42:46 mercat1 kernel: pid 75731 (rw), uid 2007 inumber 86773 on /mnt: filesystem full Jul 8 17:42:50 mercat1 kernel: pid 75693 (rw), uid 2007 inumber 25908 on /mnt: filesystem full 20240708 17:43:10 all (1/1): swapoff.sh Jul 8 17:45:22 mercat1 kernel: pid 91229 (rw), uid 2007 inumber 14 on /mnt: filesystem full Jul 8 17:45:27 mercat1 kernel: pid 91302 (mkdir), uid 2007 inumber 124992 on /mnt: filesystem full 20240708 17:45:50 all (1/1): swapoff.sh 20240708 17:48:24 all (1/1): swapoff.sh Jul 8 17:48:49 mercat1 kernel: pid 29628 (creat), uid 2007 inumber 65795 on /mnt: out of inodes Jul 8 17:49:11 mercat1 kernel: pid 29651 (mkdir), uid 2007 inumber 65675 on /mnt: out of inodes Jul 8 17:49:15 mercat1 kernel: pid 29655 (mkdir), uid 2007 inumber 123370 on /mnt: out of inodes Jul 8 17:49:42 mercat1 kernel: pid 29628 (creat), uid 2007 inumber 65795 on /mnt: out of inodes Jul 8 17:50:04 mercat1 kernel: pid 29642 (mkdir), uid 2007 inumber 65786 on /mnt: out of inodes 20240708 17:51:20 all (1/1): swapoff.sh Jul 8 17:51:33 mercat1 kernel: pid 43496 (openat), uid 2007 inumber 65795 on /mnt: out of inodes Jul 8 17:52:02 mercat1 kernel: pid 43548 (creat), uid 2007 inumber 32899 on /mnt: out of inodes Jul 8 17:53:50 mercat1 kernel: pid 69850 (symlink), uid 2007 inumber 98947 on /mnt: filesystem full 20240708 17:54:00 all (1/1): swapoff.sh Jul 8 17:56:19 mercat1 kernel: pid 81817 (rw), uid 2007 inumber 123170 on /mnt: filesystem full Jul 8 17:56:23 mercat1 kernel: pid 81823 (creat), uid 2007 inumber 65828 on /mnt: out of inodes Jul 8 17:56:31 mercat1 kernel: pid 81885 (creat), uid 2007 inumber 20 on /mnt: out of inodes 20240708 17:56:47 all (1/1): swapoff.sh Jul 8 17:56:59 mercat1 kernel: pid 89916 (rw), uid 2007 inumber 102970 on /mnt: filesystem full 20240708 17:59:33 all (1/1): swapoff.sh Jul 8 18:01:51 mercat1 kernel: pid 14513 (creat), uid 2007 inumber 35 on /mnt: out of inodes 20240708 18:02:13 all (1/1): swapoff.sh 20240708 18:04:52 all (1/1): swapoff.sh Jul 8 18:05:00 mercat1 kernel: pid 26754 (rw), uid 2007 inumber 35049 on /mnt: filesystem full Jul 8 18:05:46 mercat1 kernel: pid 26723 (rw), uid 2007 inumber 84203 on /mnt: filesystem full Jul 8 18:06:05 mercat1 kernel: pid 26693 (link), uid 2007 inumber 98714 on /mnt: out of inodes Jul 8 18:06:06 mercat1 kernel: pid 26711 (openat), uid 2007 inumber 12 on /mnt: out of inodes Jul 8 18:06:21 mercat1 kernel: pid 26763 (link), uid 2007 inumber 32908 on /mnt: out of inodes Jul 8 18:06:46 mercat1 kernel: pid 26726 (creat), uid 2007 inumber 32904 on /mnt: out of inodes 20240708 18:07:32 all (1/1): swapoff.sh Jul 8 18:08:52 mercat1 kernel: pid 33728 (rw), uid 2007 inumber 65803 on /mnt: filesystem full 20240708 18:10:10 all (1/1): swapoff.sh Jul 8 18:12:34 mercat1 kernel: pid 54128 (rw), uid 2007 inumber 65854 on /mnt: filesystem full Jul 8 18:12:38 mercat1 kernel: pid 54119 (rw), uid 2007 inumber 119146 on /mnt: filesystem full Jul 8 18:12:41 mercat1 kernel: pid 54107 (mkdir), uid 2007 inumber 59138 on /mnt: filesystem full 20240708 18:13:02 all (1/1): swapoff.sh Jul 8 18:14:00 mercat1 kernel: pid 64504 (mkdir), uid 2007 inumber 124 on /mnt: out of inodes Jul 8 18:14:22 mercat1 kernel: pid 64498 (mkdir), uid 2007 inumber 65656 on /mnt: out of inodes 20240708 18:15:44 all (1/1): swapoff.sh Jul 8 18:17:16 mercat1 kernel: pid 76325 (symlink), uid 2007 inumber 98704 on /mnt: out of inodes Jul 8 18:17:31 mercat1 kernel: pid 76368 (mkdir), uid 2007 inumber 131581 on /mnt: out of inodes 20240708 18:18:23 all (1/1): swapoff.sh Jul 8 18:18:32 mercat1 kernel: pid 88126 (rw), uid 2007 inumber 82353 on /mnt: filesystem full Jul 8 18:18:38 mercat1 kernel: pid 88087 (rw), uid 2007 inumber 121316 on /mnt: filesystem full Jul 8 18:18:41 mercat1 kernel: pid 88075 (rw), uid 2007 inumber 98350 on /mnt: filesystem full Jul 8 18:18:52 mercat1 kernel: pid 88081 (link), uid 2007 inumber 65793 on /mnt: out of inodes Jul 8 18:20:40 mercat1 kernel: pid 93909 (rw), uid 2007 inumber 90268 on /mnt: filesystem full Jul 8 18:20:44 mercat1 kernel: pid 93886 (rw), uid 2007 inumber 87741 on /mnt: filesystem full 20240708 18:20:59 all (1/1): swapoff.sh 20240708 18:24:07 all (1/1): swapoff.sh Jul 8 18:26:33 mercat1 kernel: pid 48780 (symlink), uid 2007 inumber 89 on /mnt: out of inodes 20240708 18:26:47 all (1/1): swapoff.sh Jul 8 18:26:57 mercat1 kernel: pid 55430 (link), uid 2007 inumber 98697 on /mnt: filesystem full Jul 8 18:27:00 mercat1 kernel: pid 55410 (rw), uid 2007 inumber 92030 on /mnt: filesystem full Jul 8 18:29:13 mercat1 kernel: pid 68746 (rw), uid 2007 inumber 78414 on /mnt: filesystem full Jul 8 18:29:18 mercat1 kernel: pid 68789 (mkdir), uid 2007 inumber 101738 on /mnt: filesystem full Jul 8 18:29:20 mercat1 kernel: pid 68793 (rw), uid 2007 inumber 65964 on /mnt: filesystem full 20240708 18:29:31 all (1/1): swapoff.sh Jul 8 18:30:00 mercat1 kernel: pid 77129 (rw), uid 2007 inumber 32906 on /mnt: filesystem full 20240708 18:32:42 all (1/1): swapoff.sh Jul 8 18:33:00 mercat1 kernel: pid 91449 (rw), uid 2007 inumber 32915 on /mnt: filesystem full Jul 8 18:34:13 mercat1 kernel: pid 91415 (link), uid 2007 inumber 10 on /mnt: filesystem full Jul 8 18:34:40 mercat1 kernel: pid 91417 (rw), uid 2007 inumber 105609 on /mnt: filesystem full 20240708 18:35:23 all (1/1): swapoff.sh Jul 8 18:37:53 mercat1 kernel: pid 11769 (openat), uid 2007 inumber 85 on /mnt: out of inodes 20240708 18:38:02 all (1/1): swapoff.sh Jul 8 18:39:16 mercat1 kernel: pid 17133 (mkdir), uid 2007 inumber 98677 on /mnt: out of inodes 20240708 18:40:41 all (1/1): swapoff.sh Jul 8 18:43:03 mercat1 kernel: pid 35063 (rw), uid 2007 inumber 40515 on /mnt: filesystem full Jul 8 18:43:05 mercat1 kernel: pid 35120 (rw), uid 2007 inumber 21147 on /mnt: filesystem full 20240708 18:43:22 all (1/1): swapoff.sh Jul 8 18:43:36 mercat1 kernel: pid 40590 (creat), uid 2007 inumber 65802 on /mnt: out of inodes Jul 8 18:43:39 mercat1 kernel: pid 40533 (mkdir), uid 2007 inumber 729 on /mnt: filesystem full Jul 8 18:43:42 mercat1 kernel: pid 40491 (openat), uid 2007 inumber 6 on /mnt: out of inodes Jul 8 18:45:50 mercat1 kernel: pid 46713 (mkdir), uid 2007 inumber 1638 on /mnt: filesystem full Jul 8 18:45:54 mercat1 kernel: pid 46641 (rw), uid 2007 inumber 124130 on /mnt: filesystem full 20240708 18:47:58 all (1/1): swapoff.sh Jul 8 18:50:10 mercat1 kernel: pid 59281 (rw), uid 2007 inumber 7261 on /mnt: filesystem full Jul 8 18:50:17 mercat1 kernel: pid 59261 (rw), uid 2007 inumber 121578 on /mnt: filesystem full Jul 8 18:50:21 mercat1 kernel: pid 59269 (rw), uid 2007 inumber 45625 on /mnt: filesystem full stress2: pts leak: 1/3 20240708 18:50:37 all (1/1): swapoff.sh Jul 8 18:52:55 mercat1 kernel: pid 73122 (openat), uid 2007 inumber 12 on /mnt: out of inodes 20240708 18:53:16 all (1/1): swapoff.sh Jul 8 18:55:47 mercat1 kernel: pid 87645 (rw), uid 2007 inumber 63074 on /mnt: filesystem full 20240708 18:55:55 all (1/1): swapoff.sh Jul 8 18:56:05 mercat1 kernel: pid 93051 (rw), uid 2007 inumber 17045 on /mnt: filesystem full 20240708 18:58:43 all (1/1): swapoff.sh Jul 8 18:59:00 mercat1 kernel: pid 4403 (link), uid 2007 inumber 65807 on /mnt: filesystem full Jul 8 18:59:10 mercat1 kernel: pid 4354 (rw), uid 2007 inumber 101689 on /mnt: filesystem full Jul 8 19:01:04 mercat1 kernel: pid 10498 (mkdir), uid 2007 inumber 77812 on /mnt: filesystem full 20240708 19:01:24 all (1/1): swapoff.sh swp_pager_getswapspace(32): failed 20240708 19:04:07 all (1/1): swapoff.sh Jul 8 19:04:17 mercat1 kernel: pid 26712 (rw), uid 2007 inumber 70086 on /mnt: filesystem full Jul 8 19:04:21 mercat1 kernel: pid 26797 (creat), uid 2007 inumber 98714 on /mnt: filesystem full 20240708 19:06:43 all (1/1): swapoff.sh swp_pager_getswapspace(3): failed 20240708 19:09:21 all (1/1): swapoff.sh Jul 8 19:12:00 mercat1 kernel: pid 50611 (rw), uid 2007 inumber 68094 on /mnt: filesystem full 20240708 19:12:20 all (1/1): swapoff.sh 20240708 19:15:05 all (1/1): swapoff.sh 20240708 19:17:46 all (1/1): swapoff.sh 20240708 19:20:30 all (1/1): swapoff.sh swp_pager_getswapspace(2): failed 20240708 19:23:17 all (1/1): swapoff.sh 20240708 19:26:00 all (1/1): swapoff.sh 20240708 19:28:40 all (1/1): swapoff.sh 20240708 19:31:23 all (1/1): swapoff.sh 20240708 19:34:02 all (1/1): swapoff.sh 20240708 19:36:48 all (1/1): swapoff.sh Jul 8 19:38:34 mercat1 kernel: pid 15285 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page swp_pager_getswapspace(25): failed 20240708 19:39:35 all (1/1): swapoff.sh 20240708 19:42:14 all (1/1): swapoff.sh swp_pager_getswapspace(2): failed 20240708 19:44:56 all (1/1): swapoff.sh 20240708 19:47:35 all (1/1): swapoff.sh 20240708 19:50:33 all (1/1): swapoff.sh 20240708 19:53:24 all (1/1): swapoff.sh 20240708 19:56:03 all (1/1): swapoff.sh 20240708 19:58:44 all (1/1): swapoff.sh 20240708 20:01:23 all (1/1): swapoff.sh 20240708 20:04:12 all (1/1): swapoff.sh 20240708 20:06:51 all (1/1): swapoff.sh 20240708 20:09:53 all (1/1): swapoff.sh 20240708 20:12:34 all (1/1): swapoff.sh 20240708 20:15:21 all (1/1): swapoff.sh 20240708 20:18:06 all (1/1): swapoff.sh 20240708 20:20:58 all (1/1): swapoff.sh 20240708 20:23:41 all (1/1): swapoff.sh Jul 8 20:27:10 mercat1 kernel: pid 95151 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page 20240708 20:27:18 all (1/1): swapoff.sh 20240708 20:29:58 all (1/1): swapoff.sh swp_pager_getswapspace(32): failed 20240708 20:32:53 all (1/1): swapoff.sh 20240708 20:35:33 all (1/1): swapoff.sh swp_pager_getswapspace(1): failed 20240708 20:38:20 all (1/1): swapoff.sh 20240708 20:40:58 all (1/1): swapoff.sh 20240708 20:44:05 all (1/1): swapoff.sh 20240708 20:46:59 all (1/1): swapoff.sh 20240708 20:49:37 all (1/1): swapoff.sh 20240708 20:52:18 all (1/1): swapoff.sh Jul 8 20:53:58 mercat1 kernel: pid 79901 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page 20240708 20:55:10 all (1/1): swapoff.sh 20240708 20:57:49 all (1/1): swapoff.sh 20240708 21:00:28 all (1/1): swapoff.sh 20240708 21:03:55 all (1/1): swapoff.sh 20240708 21:06:36 all (1/1): swapoff.sh 20240708 21:09:16 all (1/1): swapoff.sh 20240708 21:11:54 all (1/1): swapoff.sh 20240708 21:14:33 all (1/1): swapoff.sh swp_pager_getswapspace(1): failed 20240708 21:17:21 all (1/1): swapoff.sh Jul 8 21:19:23 mercat1 kernel: pid 880 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page 20240708 21:20:01 all (1/1): swapoff.sh 20240708 21:22:41 all (1/1): swapoff.sh 20240708 21:25:24 all (1/1): swapoff.sh 20240708 21:28:11 all (1/1): swapoff.sh 20240708 21:30:49 all (1/1): swapoff.sh 20240708 21:34:17 all (1/1): swapoff.sh 20240708 21:36:58 all (1/1): swapoff.sh 20240708 21:39:37 all (1/1): swapoff.sh 20240708 21:42:16 all (1/1): swapoff.sh Jul 8 21:45:13 mercat1 kernel: pid 28971 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page 20240708 21:46:19 all (1/1): swapoff.sh Jul 8 21:50:37 mercat1 kernel: pid 40872 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page 20240708 21:51:12 all (1/1): swapoff.sh swp_pager_getswapspace(1): failed 20240708 21:53:54 all (1/1): swapoff.sh 20240708 21:56:38 all (1/1): swapoff.sh 20240708 21:59:18 all (1/1): swapoff.sh Jul 8 22:00:28 mercat1 ntpd[3537]: /usr/src/contrib/ntp/libntp/work_thread.c:209: INSIST(((void *)0) == c->workitems[c->head_workitem % c->workitems_alloc]) failed Jul 8 22:01:10 mercat1 kernel: pid 7564 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page Jul 8 22:00:28 mercat1 ntpd[3537]: exiting (due to assertion failure) 20240708 22:02:26 all (1/1): swapoff.sh 20240708 22:05:06 all (1/1): swapoff.sh Jul 8 22:06:28 mercat1 kernel: pid 25060 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page swp_pager_getswapspace(32): failed 20240708 22:07:50 all (1/1): swapoff.sh Jul 8 22:09:34 mercat1 kernel: pid 30698 (symlink), uid 2007 inumber 5 on /mnt: out of inodes swp_pager_getswapspace(32): failed 20240708 22:10:33 all (1/1): swapoff.sh 20240708 22:13:12 all (1/1): swapoff.sh Jul 8 22:14:55 mercat1 kernel: pid 88772 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page 20240708 22:16:10 all (1/1): swapoff.sh 20240708 22:18:52 all (1/1): swapoff.sh 20240708 22:21:31 all (1/1): swapoff.sh swp_pager_getswapspace(10): failed 20240708 22:24:12 all (1/1): swapoff.sh 20240708 22:28:38 all (1/1): swapoff.sh 20240708 22:31:17 all (1/1): swapoff.sh 20240708 22:33:54 all (1/1): swapoff.sh 20240708 22:36:32 all (1/1): swapoff.sh 20240708 22:39:14 all (1/1): swapoff.sh 20240708 22:41:53 all (1/1): swapoff.sh 20240708 22:44:33 all (1/1): swapoff.sh 20240708 22:46:58 all (1/39): oovm2.sh 20240708 22:47:00 all (2/39): swapoff4.sh stress2: GEOM leak: 16/90 20240708 22:47:07 all.sh done, elapsed 0 day(s), 07:10.58 20240708 22:49:37 all.sh done, elapsed 0 day(s), 00:02.40 20240708 22:50:45 all (1/39): mmap40.sh 20240708 22:57:01 all (2/39): swap5.sh 20240708 23:06:22 all (3/39): vmio.sh 20240708 23:06:25 all (4/39): crossmp5.sh 20240708 23:11:29 all (5/39): holdcnt03.sh 20240708 23:11:32 all (6/39): swapoff4.sh 20240708 23:15:40 all (7/39): swappedout.sh 20240708 23:17:49 all (8/39): swapoff6.sh swp_pager_getswapspace(1): failed swp_pager_getswapspace(11): failed swp_pager_getswapspace(31): failed Jul 8 23:20:48 mercat1 kernel: pid 63780 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 8 23:20:50 mercat1 kernel: pid 63784 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 8 23:20:51 mercat1 kernel: pid 63789 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 8 23:20:52 mercat1 kernel: pid 63793 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 8 23:20:54 mercat1 kernel: pid 3274 (devd), jid 0, uid 0, was killed: failed to reclaim memory Jul 8 23:20:55 mercat1 kernel: pid 3648 (bash), jid 0, uid 0, was killed: failed to reclaim memory Jul 8 23:20:56 mercat1 kernel: pid 6820 (sh), jid 0, uid 2006, was killed: failed to reclaim memory swp_pager_getswapspace(3): failed swp_pager_getswapspace(1): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed Jul 8 23:21:21 mercat1 kernel: pid 70607 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 8 23:21:22 mercat1 kernel: pid 71524 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 8 23:21:23 mercat1 kernel: pid 71925 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 8 23:21:25 mercat1 kernel: pid 71928 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 8 23:21:26 mercat1 kernel: pid 3624 (sh), jid 0, uid 2006, was killed: failed to reclaim memory Jul 8 23:21:27 mercat1 kernel: pid 87525 (sh), jid 0, uid 0, was killed: failed to reclaim memory Jul 8 23:21:28 mercat1 kernel: pid 3619 (login), jid 0, uid 0, was killed: failed to reclaim memory FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: swp_pager_getswapspace(32): failed Jul 8 23:21:57 mercat1 kernel: pid 77617 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 8 23:21:57 mercat1 kernel: pid 78841 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 8 23:21:57 mercat1 kernel: pid 79912 (sort), jid 0, uid 0, was killed: failed to reclaim memory swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed Jul 8 23:22:29 mercat1 kernel: pid 79916 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 8 23:22:29 mercat1 kernel: pid 85300 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 8 23:22:29 mercat1 kernel: pid 86659 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 8 23:22:29 mercat1 kernel: pid 87794 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 8 23:22:29 mercat1 kernel: pid 90423 (vmstat), jid 0, uid 0, was killed: failed to reclaim memory Jul 8 23:22:29 mercat1 kernel: pid 25409 (awk), jid 0, uid 0, was killed: failed to reclaim memory Jul 8 23:22:29 mercat1 kernel: pid 90424 (sed), jid 0, uid 0, was killed: failed to reclaim memory swp_pager_getswapspace(1): failed swp_pager_getswapspace(1): failed swp_pager_getswapspace(1): failed swp_pager_getswapspace(10): failed swp_pager_getswapspace(1): failed swp_pager_getswapspace(4): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed Jul 8 23:22:52 mercat1 kernel: pid 90495 (sort), jid 0, uid 0, was killed: failed to reclaim memory swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed Jul 8 23:23:05 mercat1 kernel: pid 90503 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 8 23:23:05 mercat1 kernel: pid 90499 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 8 23:23:05 mercat1 kernel: pid 90507 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 8 23:23:05 mercat1 kernel: pid 94317 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 8 23:23:05 mercat1 kernel: pid 51611 (sh), jid 0, uid 0, was killed: failed to reclaim memory Jul 8 23:23:05 mercat1 kernel: pid 94535 (swapoff), jid 0, uid 0, was killed: failed to reclaim memory 20240708 23:23:09 all (9/39): buildworld2.sh 20240708 23:23:12 all (10/39): vmp.sh 20240708 23:25:19 all (11/39): swap3.sh Jul 8 23:30:34 mercat1 kernel: pid 95774 (swap2), jid 0, uid 0, was killed: failed to reclaim memory 20240708 23:30:37 all (12/39): holdcnt05.sh 20240708 23:30:40 all (13/39): tmpfs19.sh KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0108032bc0 hardclock() at hardclock+0x103/frame 0xfffffe0108032c00 handleevents() at handleevents+0xaf/frame 0xfffffe0108032c40 timercb() at timercb+0x18e/frame 0xfffffe0108032c90 lapic_handle_timer() at lapic_handle_timer+0xab/frame 0xfffffe0108032cb0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe0108032cb0 --- interrupt, rip = 0xffffffff804c649e, rsp = 0xfffffe0108032d80, rbp = 0xfffffe0108032db0 --- acpi_cpu_idle() at acpi_cpu_idle+0x27e/frame 0xfffffe0108032db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108032dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108032df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108032ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108032f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108032f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- KDB: enter: watchdog timeout [ thread pid 11 tid 100009 ] Stopped at kdb_enter+0x33: movq $0,0x105bf52(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> dump Dumping 1588 out of 32620 MB:..2%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:1:pho1> bt Tracing pid 11 tid 100009 td 0xfffff80003bdf740 kdb_enter() at kdb_enter+0x33/frame 0xfffffe0108032c00 handleevents() at handleevents+0xaf/frame 0xfffffe0108032c40 timercb() at timercb+0x18e/frame 0xfffffe0108032c90 lapic_handle_timer() at lapic_handle_timer+0xab/frame 0xfffffe0108032cb0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe0108032cb0 --- interrupt, rip = 0xffffffff804c649e, rsp = 0xfffffe0108032d80, rbp = 0xfffffe0108032db0 --- acpi_cpu_idle() at acpi_cpu_idle+0x27e/frame 0xfffffe0108032db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108032dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108032df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108032ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108032f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108032f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:1:pho1> show allpcpu Current CPU: 6 cpuid = 0 dynamic pcpu = 0x9f5e80 curthread = 0xfffff80003bf4740: pid 11 tid 100003 critnest 1 "idle: cpu0" curpcb = 0xfffff80003bf4c60 fpcurthread = none idlethread = 0xfffff80003bf4740: tid 100003 "idle: cpu0" self = 0xffffffff82410000 curpmap = 0xffffffff81b97ef0 tssp = 0xffffffff82410384 rsp0 = 0xfffffe0108015000 kcr3 = 0x8000000002387002 ucr3 = 0xffffffffffffffff scr3 = 0x7a65f49bf gs32p = 0xffffffff82410404 ldt = 0xffffffff82410444 tss = 0xffffffff82410434 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bb4b5e80 curthread = 0xfffff80003bf4000: pid 11 tid 100004 critnest 1 "idle: cpu1" curpcb = 0xfffff80003bf4520 fpcurthread = none idlethread = 0xfffff80003bf4000: tid 100004 "idle: cpu1" self = 0xffffffff82411000 curpmap = 0xffffffff81b97ef0 tssp = 0xffffffff82411384 rsp0 = 0xfffffe0108010000 kcr3 = 0x8000000002387075 ucr3 = 0xffffffffffffffff scr3 = 0x1bab4db88 gs32p = 0xffffffff82411404 ldt = 0xffffffff82411444 tss = 0xffffffff82411434 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bb4c4e80 curthread = 0xfffff80003bf5740: pid 11 tid 100005 critnest 1 "idle: cpu2" curpcb = 0xfffff80003bf5c60 fpcurthread = none idlethread = 0xfffff80003bf5740: tid 100005 "idle: cpu2" self = 0xffffffff82412000 curpmap = 0xffffffff81b97ef0 tssp = 0xffffffff82412384 rsp0 = 0xfffffe010801f000 kcr3 = 0x800000000238702a ucr3 = 0xffffffffffffffff scr3 = 0x311ca1f96 gs32p = 0xffffffff82412404 ldt = 0xffffffff82412444 tss = 0xffffffff82412434 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bb4d3e80 curthread = 0xfffff80003bf5000: pid 11 tid 100006 critnest 1 "idle: cpu3" curpcb = 0xfffff80003bf5520 fpcurthread = none idlethread = 0xfffff80003bf5000: tid 100006 "idle: cpu3" self = 0xffffffff82413000 curpmap = 0xffffffff81b97ef0 tssp = 0xffffffff82413384 rsp0 = 0xfffffe010801a000 kcr3 = 0x8000000002387022 ucr3 = 0xffffffffffffffff scr3 = 0x532d1d05 gs32p = 0xffffffff82413404 ldt = 0xffffffff82413444 tss = 0xffffffff82413434 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bb4e2e80 curthread = 0xfffff80003bf6740: pid 11 tid 100007 critnest 1 "idle: cpu4" curpcb = 0xfffff80003bf6c60 fpcurthread = none idlethread = 0xfffff80003bf6740: tid 100007 "idle: cpu4" self = 0xffffffff82414000 curpmap = 0xffffffff81b97ef0 tssp = 0xffffffff82414384 rsp0 = 0xfffffe0108029000 kcr3 = 0x800000000238702a ucr3 = 0xffffffffffffffff scr3 = 0x279713bfd gs32p = 0xffffffff82414404 ldt = 0xffffffff82414444 tss = 0xffffffff82414434 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bb4f1e80 curthread = 0xfffff80003bf6000: pid 11 tid 100008 critnest 1 "idle: cpu5" curpcb = 0xfffff80003bf6520 fpcurthread = none idlethread = 0xfffff80003bf6000: tid 100008 "idle: cpu5" self = 0xffffffff82415000 curpmap = 0xffffffff81b97ef0 tssp = 0xffffffff82415384 rsp0 = 0xfffffe0108024000 kcr3 = 0x800000000238701c ucr3 = 0xffffffffffffffff scr3 = 0x2869cdc7b gs32p = 0xffffffff82415404 ldt = 0xffffffff82415444 tss = 0xffffffff82415434 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bb500e80 curthread = 0xfffff80003bdf740: pid 11 tid 100009 critnest 2 "idle: cpu6" curpcb = 0xfffff80003bdfc60 fpcurthread = none idlethread = 0xfffff80003bdf740: tid 100009 "idle: cpu6" self = 0xffffffff82416000 curpmap = 0xffffffff81b97ef0 tssp = 0xffffffff82416384 rsp0 = 0xfffffe0108033000 kcr3 = 0x800000000238704d ucr3 = 0xffffffffffffffff scr3 = 0x631b0ad98 gs32p = 0xffffffff82416404 ldt = 0xffffffff82416444 tss = 0xffffffff82416434 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bb50fe80 curthread = 0xfffff80003bdf000: pid 11 tid 100010 critnest 1 "idle: cpu7" curpcb = 0xfffff80003bdf520 fpcurthread = none idlethread = 0xfffff80003bdf000: tid 100010 "idle: cpu7" self = 0xffffffff82417000 curpmap = 0xffffffff81b97ef0 tssp = 0xffffffff82417384 rsp0 = 0xfffffe010802e000 kcr3 = 0x8000000002387005 ucr3 = 0xffffffffffffffff scr3 = 0x7c743a839 gs32p = 0xffffffff82417404 ldt = 0xffffffff82417444 tss = 0xffffffff82417434 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bb51ee80 curthread = 0xfffff80003be0740: pid 11 tid 100011 critnest 1 "idle: cpu8" curpcb = 0xfffff80003be0c60 fpcurthread = none idlethread = 0xfffff80003be0740: tid 100011 "idle: cpu8" self = 0xffffffff82418000 curpmap = 0xffffffff81b97ef0 tssp = 0xffffffff82418384 rsp0 = 0xfffffe010803d000 kcr3 = 0x80000000023870e2 ucr3 = 0xffffffffffffffff scr3 = 0x5d7e59bc2 gs32p = 0xffffffff82418404 ldt = 0xffffffff82418444 tss = 0xffffffff82418434 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bb52de80 curthread = 0xfffff80003be0000: pid 11 tid 100012 critnest 1 "idle: cpu9" curpcb = 0xfffff80003be0520 fpcurthread = none idlethread = 0xfffff80003be0000: tid 100012 "idle: cpu9" self = 0xffffffff82419000 curpmap = 0xffffffff81b97ef0 tssp = 0xffffffff82419384 rsp0 = 0xfffffe0108038000 kcr3 = 0x8000000002387107 ucr3 = 0xffffffffffffffff scr3 = 0x408b08e53 gs32p = 0xffffffff82419404 ldt = 0xffffffff82419444 tss = 0xffffffff82419434 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bb53ce80 curthread = 0xfffff80003be1740: pid 11 tid 100013 critnest 1 "idle: cpu10" curpcb = 0xfffff80003be1c60 fpcurthread = none idlethread = 0xfffff80003be1740: tid 100013 "idle: cpu10" self = 0xffffffff8241a000 curpmap = 0xffffffff81b97ef0 tssp = 0xffffffff8241a384 rsp0 = 0xfffffe0108047000 kcr3 = 0x8000000002387021 ucr3 = 0xffffffffffffffff scr3 = 0x279713ce7 gs32p = 0xffffffff8241a404 ldt = 0xffffffff8241a444 tss = 0xffffffff8241a434 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bb54be80 curthread = 0xfffff80003be1000: pid 11 tid 100014 critnest 1 "idle: cpu11" curpcb = 0xfffff80003be1520 fpcurthread = none idlethread = 0xfffff80003be1000: tid 100014 "idle: cpu11" self = 0xffffffff8241b000 curpmap = 0xffffffff81b97ef0 tssp = 0xffffffff8241b384 rsp0 = 0xfffffe0108042000 kcr3 = 0x800000000238704a ucr3 = 0xffffffffffffffff scr3 = 0x55953df9d gs32p = 0xffffffff8241b404 ldt = 0xffffffff8241b444 tss = 0xffffffff8241b434 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 96132 (dd) thread 0xfffff800058ce740 (100334) exclusive lockmgr tmpfs (tmpfs) r = 0 (0xfffffe0170d3b070) locked @ kern/vfs_vnops.c:1176 Process 3439 (watchdogd) thread 0xfffff8005e163000 (100257) shared sx killpg racer (killpg racer) r = 0 (0xfffff801ba58fdf0) locked @ kern/kern_fork.c:975 Process 9 (pagedaemon) thread 0xfffff80005006000 (100201) shared rw UMA lock (UMA lock) r = 0 (0xffffffff81803600) locked @ vm/uma_core.c:3108 shared sx umareclaim (umareclaim) r = 0 (0xffffffff81cdbd60) locked @ vm/uma_core.c:5327 db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffffe0170d3b000: type VREG state VSTATE_CONSTRUCTED op 0xffffffff818b6100 usecount 1, writecount 1, refcount 1 seqc users 0 hold count flags () flags (VIRF_TEXT_REF) v_object 0xfffff803d362d318 ref 1 pages 7931181 cleanbuf 0 dirtybuf 0 lock type tmpfs: EXCL by thread 0xfffff800058ce740 (pid 96132, dd, tid 100334) #0 0xffffffff80b176fc at lockmgr_xlock+0x9c #1 0xffffffff8113518a at VOP_LOCK1_APV+0x3a #2 0xffffffff80c5c0e3 at _vn_lock+0x53 #3 0xffffffff80c61b28 at vn_write+0x1d8 #4 0xffffffff80c5a3a5 at vn_io_fault+0x1e5 #5 0xffffffff80bc414f at dofilewrite+0x7f #6 0xffffffff80bc3cd7 at sys_write+0xb7 #7 0xffffffff8106b8c8 at amd64_syscall+0x158 #8 0xffffffff8103cfcb at fast_syscall_common+0xf8 tag VT_TMPFS, tmpfs_node 0xfffff806fa0fc0e8, flags 0x0, links 1 mode 0644, owner 0, group 0, size 32486981632, status 0x3 db:1:pho1> show mount 0xfffffe010ebe5700 /dev/gpt/work on / (ufs) 0xfffffe010ebe6280 devfs on /dev (devfs) 0xfffffe016cacb280 /dev/gpt/tmp on /tmp (ufs) 0xfffffe010ebe4000 tmpfs on /mnt (tmpfs) More info: show mount db:1:pho1> show bufqueues bqempty: 105396 Buf domain 0 freebufs 14842 lofreebufs 219 hifreebufs 329 bufspace 8781824 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 262 (8134656) dirtyq count 0 (0) wakeup 0 lim 25 CPU 1, 3, 3, 4, 0, 2, 1, 0, 2, 10, 3, 0, Locked buffers: 0 space 0 Total buffers: 23878 space 8781824 Buf domain 1 freebufs 15060 lofreebufs 219 hifreebufs 329 bufspace 1372160 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 69 (1323008) dirtyq count 0 (0) wakeup 0 lim 25 CPU 1, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 0, Locked buffers: 0 space 0 Total buffers: 11840 space 1372160 Buf domain 2 freebufs 15119 lofreebufs 219 hifreebufs 329 bufspace 237568 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 10 (131072) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 0, 0, 1, 2, 0, 0, 1, 0, 0, 0, 0, Locked buffers: 0 space 0 Total buffers: 22300 space 237568 Buf domain 3 freebufs 15107 lofreebufs 219 hifreebufs 329 bufspace 667648 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 11 (323584) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 4, 1, 1, 0, 2, 4, 0, 1, 1, 1, 0, Locked buffers: 0 space 0 Total buffers: 13281 space 667648 Buf domain 4 freebufs 15089 lofreebufs 219 hifreebufs 329 bufspace 1028096 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 7 (147456) dirtyq count 0 (0) wakeup 0 lim 25 CPU 1, 7, 3, 4, 6, 8, 4, 1, 1, 1, 1, 0, Locked buffers: 0 space 0 Total buffers: 10889 space 1028096 Buf domain 5 freebufs 15101 lofreebufs 219 hifreebufs 329 bufspace 450560 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 15 (143360) dirtyq count 0 (0) wakeup 0 lim 25 CPU 1, 2, 2, 2, 2, 0, 1, 0, 0, 1, 6, 0, Locked buffers: 0 space 0 Total buffers: 12594 space 450560 Buf domain 6 freebufs 15078 lofreebufs 219 hifreebufs 329 bufspace 1622016 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 2 (61440) dirtyq count 0 (0) wakeup 0 lim 25 CPU 3, 2, 3, 13, 19, 0, 2, 0, 2, 6, 1, 2, Locked buffers: 0 space 0 Total buffers: 11149 space 1622016 db:1:pho1> show page vm_cnt.v_free_count: 16273 vm_cnt.v_inactive_count: 1 vm_cnt.v_active_count: 0 vm_cnt.v_laundry_count: 0 vm_cnt.v_wire_count: 173343 vm_cnt.v_free_reserved: 10642 vm_cnt.v_free_min: 51257 vm_cnt.v_free_target: 173102 vm_cnt.v_inactive_target: 259653 db:1:pho1> show pageq pq_free 16273 dom 0 page_cnt 8123039 free 16273 pq_act 0 pq_inact 1 pq_laund 0 pq_unsw 7933253 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 | POOL 2 -- -- -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 | 000000 11 (008192K) | 000000 | 000000 | 000000 10 (004096K) | 000000 | 000000 | 000000 09 (002048K) | 000000 | 000015 | 000000 08 (001024K) | 000000 | 000000 | 000000 07 (000512K) | 000000 | 000001 | 000000 06 (000256K) | 000000 | 000004 | 000000 05 (000128K) | 000000 | 000013 | 000000 04 (000064K) | 000000 | 000020 | 000000 03 (000032K) | 000000 | 000036 | 000018 02 (000016K) | 000000 | 000075 | 000085 01 (000008K) | 000000 | 000136 | 000257 00 (000004K) | 000000 | 000772 | 001870 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 | POOL 2 -- -- -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 | 000000 11 (008192K) | 000000 | 000000 | 000000 10 (004096K) | 000000 | 000000 | 000000 09 (002048K) | 000000 | 000000 | 000000 08 (001024K) | 000000 | 000000 | 000000 07 (000512K) | 000000 | 000000 | 000000 06 (000256K) | 000000 | 000000 | 000000 05 (000128K) | 000000 | 000000 | 000000 04 (000064K) | 000000 | 000000 | 000000 03 (000032K) | 000000 | 000000 | 000000 02 (000016K) | 000000 | 000000 | 000000 01 (000008K) | 000000 | 000000 | 000000 00 (000004K) | 000000 | 000000 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree malloc-4096 4096 34122 0 176473 0 2 139763712 0 RADIX NODE 144 534801 1172 291857480 0 62 77180112 0 swblk 136 0 310996 8842543 0 62 42295456 0 VM OBJECT 264 2193 129732 329242718 0 30 34828200 0 mbuf_cluster 2048 12307 441 244901 0 8 26107904 0 BUF TRIE 144 127 105825 254203497 0 62 15257088 0 FFS inode 1168 9614 1068 413165357 0 8 12476576 0 VNODE 600 9746 2253 413187362 0 16 7199400 0 UMA Slabs 0 112 43345 11765 2111539 0 126 6172320 0 malloc-128 128 44540 286 1640242 0 126 5737728 0 mbuf 256 16470 3817 530847 0 254 5193472 0 pbuf 2776 0 1456 0 0 0 4041856 0 swpctrie 144 0 23324 728314 0 62 3358656 0 S VFS Cache 104 10592 19165 164012664 0 126 3094728 0 FFS2 dinode 256 9614 2176 413162332 0 62 3018240 0 vmem btag 56 16065 30075 1118958 0 254 2583840 0 THREAD 1824 953 133 12061 0 8 1980864 0 malloc-128 128 12634 324 697347543 0 126 1658624 0 malloc-4096 4096 332 0 277198 0 2 1359872 0 DEVCTL 1024 1000 100 101183 0 0 1126400 0 PROC 1376 40 719 4593360 0 8 1044384 0 FPU_save_area 832 955 89 1319303 0 16 868608 0 malloc-8192 8192 99 0 110 0 1 811008 0 malloc-64 64 11697 714 21425 0 254 794304 0 malloc-32768 32768 24 0 24 0 1 786432 0 malloc-64 64 9000 891 39476 0 254 633024 0 lkpicurr 168 13 3083 13 0 62 520128 0 UMA Zones 2048 228 7 229 0 8 481280 0 malloc-32768 32768 14 0 1427170 0 1 458752 0 malloc-128 128 2232 1178 7869156 0 126 436480 0 VMSPACE 616 7 701 4593165 0 16 436128 0 malloc-64 64 4637 781 4605192 0 254 346752 0 malloc-256 256 1071 264 12179 0 62 341760 0 malloc-384 384 760 30 761 0 30 303360 0 malloc-32 32 8143 1307 28895 0 254 302400 0 malloc-1024 1024 254 38 39593181 0 16 299008 0 malloc-16 16 15766 1984 15999 0 254 284000 0 malloc-256 256 839 211 1617757712 0 62 268800 0 MAP ENTRY 96 295 2225 227695536 0 126 241920 0 malloc-2048 2048 107 5 1405 0 8 229376 0 Mountpoints 2944 4 72 10834 0 4 223744 0 ksiginfo 112 741 1239 1409874 0 126 221760 0 TURNSTILE 136 1087 530 1087 0 62 219912 0 malloc-16384 16384 13 0 4843 0 1 212992 0 malloc-65536 65536 3 0 3274 0 1 196608 0 malloc-65536 65536 3 0 3 0 1 196608 0 PWD 40 9 4738 67263960 0 254 189880 0 malloc-8192 8192 23 0 51356 0 1 188416 0 malloc-2048 2048 89 3 32032 0 8 188416 0 malloc-4096 4096 44 0 4596049 0 2 180224 0 malloc-128 128 997 367 459571187 0 126 174592 0 lkpimm 56 3 3093 3 0 254 173376 0 Files 80 46 2104 269069055 0 126 172000 0 PGRP 120 19 1301 681 0 126 158400 0 SLEEPQUEUE 88 1087 705 1087 0 126 157696 0 fakepg 104 0 1404 1433 0 126 146016 0 udp_inpcb 416 4 329 1115 0 30 138528 0 malloc-65536 65536 2 0 2 0 1 131072 0 malloc-32768 32768 4 0 3606 0 1 131072 0 malloc-1024 1024 121 7 218 0 16 131072 0 rl_entry 40 720 2512 724 0 254 129280 0 malloc-512 512 59 149 1935895 0 30 106496 0 malloc-128 128 516 290 52672 0 126 103168 0 malloc-4096 4096 25 0 16459 0 2 102400 0 256 Bucket 2048 26 24 39726685 0 8 102400 0 malloc-32768 32768 3 0 12 0 1 98304 0 malloc-128 128 388 325 9161624480 0 126 91264 0 malloc-8192 8192 11 0 10844 0 1 90112 0 malloc-32 32 1152 1494 552990 0 254 84672 0 filedesc0 1072 27 50 4593361 0 8 82544 0 malloc-16384 16384 5 0 5 0 1 81920 0 malloc-384 384 164 46 8814 0 30 80640 0 UMA Kegs 384 198 5 199 0 30 77952 0 malloc-64 64 59 1138 6052046 0 254 76608 0 malloc-4096 4096 18 0 20 0 2 73728 0 malloc-256 256 176 109 1670 0 62 72960 0 malloc-64 64 185 949 4713429000 0 254 72576 0 malloc-32 32 531 1737 207409 0 254 72576 0 32 Bucket 256 19 251 36685416 0 62 69120 0 malloc-64 64 78 993 4845737 0 254 68544 0 malloc-65536 65536 1 0 1 0 1 65536 0 malloc-65536 65536 1 0 1 0 1 65536 0 malloc-65536 65536 1 0 1422 0 1 65536 0 malloc-32768 32768 2 0 142 0 1 65536 0 malloc-16384 16384 4 0 9 0 1 65536 0 malloc-8192 8192 8 0 50 0 1 65536 0 malloc-128 128 107 389 65571271 0 126 63488 0 malloc-2048 2048 27 3 38 0 8 61440 0 malloc-2048 2048 16 14 4861 0 8 61440 0 malloc-4096 4096 14 0 11206 0 2 57344 0 128 Bucket 1024 23 32 26264219 0 16 56320 0 malloc-256 256 57 153 342355 0 62 53760 0 malloc-16 16 860 2390 1686326 0 254 52000 0 malloc-16384 16384 3 0 7 0 1 49152 0 pcpu-8 8 4217 1927 4237 0 254 49152 0 malloc-32 32 373 1139 173035 0 254 48384 0 malloc-32 32 73 1439 1392 0 254 48384 0 malloc-16 16 772 2228 186462 0 254 48000 0 malloc-256 256 43 137 1099281570 0 62 46080 0 udp_inpcb ports 32 2 1384 209 0 254 44352 0 pcpu-64 64 450 190 450 0 254 40960 0 pcpu-16 16 76 2484 76 0 254 40960 0 malloc-128 128 31 279 35766788 0 126 39680 0 malloc-1024 1024 23 13 45532 0 16 36864 0 malloc-32768 32768 1 0 1 0 1 32768 0 malloc-16384 16384 2 0 108457 0 1 32768 0 malloc-8192 8192 4 0 22069 0 1 32768 0 malloc-32 32 38 970 23367 0 254 32256 0 8 Bucket 80 17 383 82020595 0 126 32000 0 tcp_inpcb 1304 4 20 13 0 8 31296 0 malloc-384 384 25 55 633 0 30 30720 0 malloc-256 256 14 106 3343198 0 62 30720 0 malloc-2048 2048 11 3 74197 0 8 28672 0 malloc-1024 1024 17 11 619 0 16 28672 0 malloc-512 512 28 28 316670 0 30 28672 0 malloc-64 64 20 421 7879987015 0 254 28224 0 malloc-384 384 11 59 154617 0 30 26880 0 malloc-384 384 27 43 490 0 30 26880 0 cpuset 200 27 101 27 0 62 25600 0 malloc-8192 8192 3 0 3 0 1 24576 0 malloc-32 32 101 655 1220145 0 254 24192 0 malloc-32 32 38 718 1129192 0 254 24192 0 malloc-16 16 26 1474 139163 0 254 24000 0 malloc-16 16 79 1421 546 0 254 24000 0 routing nhops 256 9 81 14 0 62 23040 0 socket 960 11 13 14018 0 16 23040 0 malloc-256 256 10 80 684 0 62 23040 0 64 Bucket 512 12 28 43726735 0 30 20480 0 rtentry 168 12 108 14 0 62 20160 0 malloc-64 64 14 301 61 0 254 20160 0 ripcb 384 0 50 9 0 30 19200 0 16 Bucket 144 11 101 79492607 0 62 16128 0 malloc-16 16 9 991 6649020 0 254 16000 0 malloc-16 16 31 969 1474274 0 254 16000 0 malloc-16 16 4 996 4 0 254 16000 0 malloc-2048 2048 3 3 3 0 8 12288 0 malloc-1024 1024 5 7 6 0 16 12288 0 malloc-1024 1024 4 8 114111847 0 16 12288 0 malloc-512 512 12 12 12 0 30 12288 0 malloc-512 512 3 21 3 0 30 12288 0 unpcb 256 3 42 12716 0 62 11520 0 malloc-384 384 13 17 13 0 30 11520 0 malloc-8192 8192 1 0 1 0 1 8192 0 malloc-8192 8192 1 0 1 0 1 8192 0 malloc-4096 4096 2 0 13893 0 2 8192 0 malloc-512 512 2 14 10833 0 30 8192 0 hostcache 64 0 126 3 0 254 8064 0 tcp_inpcb ports 32 2 250 2 0 254 8064 0 ertt 72 4 108 13 0 126 8064 0 pipe 728 2 9 2655519 0 16 8008 0 kenv 258 18 12 27409 0 30 7740 0 malloc-384 384 12 8 634380998 0 30 7680 0 mbuf_packet 256 23 0 402496 0 254 5888 0 epoch_record pcpu 256 4 12 4 0 62 4096 0 mbuf_jumbo_page 4096 1 0 12 0 2 4096 0 malloc-2048 2048 1 1 405 0 8 4096 0 malloc-1024 1024 2 2 2 0 16 4096 0 malloc-512 512 1 7 57 0 30 4096 0 SMR CPU 32 7 120 7 0 254 4064 0 vtnet_tx_hdr 24 0 167 0 0 254 4008 0 KNOTE 160 11 14 400718 0 62 4000 0 TMPFS node 232 2 15 2 0 62 3944 0 UMA Slabs 1 176 11 11 11 0 62 3872 0 L VFS Cache 320 0 12 1 0 30 3840 0 KMAP ENTRY 96 33 6 33 0 0 3744 0 vmem 1856 2 0 2 0 8 3712 0 SMR SHARED 24 7 120 7 0 254 3048 0 FFS1 dinode 128 0 0 0 0 126 0 0 da_ccb 544 0 0 0 0 16 0 0 ada_ccb 272 0 0 7927969 0 30 0 0 tfo_ccache_entries 80 0 0 0 0 126 0 0 tfo 4 0 0 0 0 254 0 0 sackhole 32 0 0 0 0 254 0 0 syncache 168 0 0 4 0 62 0 0 ipq 56 0 0 0 0 254 0 0 tcp_log_id_node 120 0 0 0 0 126 0 0 tcp_log_id_bucket 176 0 0 0 0 62 0 0 tcp_log 416 0 0 0 0 30 0 0 tcpreass 48 0 0 0 0 254 0 0 udplite_inpcb ports 32 0 0 0 0 254 0 0 udplite_inpcb 416 0 0 0 0 30 0 0 ripcb ports 32 0 0 0 0 254 0 0 IPsec SA lft_c 16 0 0 0 0 254 0 0 itimer 352 0 0 0 0 30 0 0 AIOLIO 272 0 0 0 0 30 0 0 AIOCB 552 0 0 0 0 16 0 0 AIO 208 0 0 0 0 62 0 0 DIRHASH 1024 0 0 12907741 0 16 0 0 NCLNODE 760 0 0 0 0 16 0 0 NAMEI 1024 0 0 2345029111 0 16 0 0 LTS VFS Cache 360 0 0 0 0 30 0 0 STS VFS Cache 144 0 0 0 0 62 0 0 cryptop 280 0 0 0 0 30 0 0 linux_dma_object 32 0 0 0 0 254 0 0 linux_dma_pctrie 144 0 0 0 0 62 0 0 g_bio 408 0 0 871866661 0 30 0 0 IOMMU_MAP_ENTRY 104 0 0 0 0 126 0 0 ttyoutq 256 0 0 734 0 62 0 0 ttyinq 160 0 0 1410 0 62 0 0 mbuf_jumbo_16k 16384 0 0 0 0 1 0 0 mbuf_jumbo_9k 9216 0 0 0 0 1 0 0 audit_record 1280 0 0 0 0 8 0 0 domainset 40 0 0 0 0 254 0 0 MAC labels 40 0 0 0 0 254 0 0 clpbuf 2776 0 0 8272586 0 4 0 0 vnpbuf 2776 0 0 0 0 4 0 0 nfspbuf 2776 0 0 0 0 4 0 0 swwbuf 2776 0 0 4802830 0 2 0 0 swrbuf 2776 0 0 1712643 0 4 0 0 ertt_txseginfo 40 0 0 21666 0 254 0 0 umtx_shm 88 0 0 0 0 126 0 0 umtx pi 96 0 0 0 0 126 0 0 rangeset pctrie nodes 144 0 0 0 0 62 0 0 malloc-65536 65536 0 0 0 0 1 0 0 malloc-65536 65536 0 0 601 0 1 0 0 malloc-32768 32768 0 0 0 0 1 0 0 malloc-32768 32768 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-16384 16384 0 0 343 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-4096 4096 0 0 0 0 2 0 0 malloc-2048 2048 0 0 0 0 8 0 0 malloc-1024 1024 0 0 0 0 16 0 0 malloc-512 512 0 0 0 0 30 0 0 malloc-512 512 0 0 109 0 30 0 0 malloc-384 384 0 0 1 0 30 0 0 malloc-256 256 0 0 15266 0 62 0 0 pcpu-32 32 0 0 0 0 254 0 0 pcpu-4 4 0 0 0 0 254 0 0 4 Bucket 48 0 0 4853133 0 254 0 0 2 Bucket 32 0 0 3577079 0 254 0 0 UMA Hash 256 0 0 0 0 62 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket debugnet_mbuf_packet 2048 0 0 0 0 debugnet_mbuf_cluster 2048 -6144 0 0 0 debugnet_mbuf 256 -10240 0 0 0 vm pgcache 4096 85298 0 302953016 2 vm pgcache 4096 7920501 0 2318800786 2 vm pgcache 4096 0 0 0 2 buf free cache 848 535 0 173661992 16 buffer arena-65 65536 0 0 0 1 buffer arena-61 61440 0 0 0 1 buffer arena-57 57344 0 0 0 1 buffer arena-53 53248 0 0 0 1 buffer arena-49 49152 0 0 0 1 buffer arena-45 45056 0 0 0 1 buffer arena-40 40960 0 0 0 1 buffer arena-36 36864 0 0 0 1 buffer arena-32 32768 98 0 35059187 1 buffer arena-28 28672 0 0 0 1 buffer arena-24 24576 0 0 0 1 buffer arena-20 20480 0 0 0 1 buffer arena-16 16384 3 0 21430001 1 buffer arena-12 12288 0 0 0 1 buffer arena-81 8192 0 0 0 1 buffer arena-40 4096 0 0 0 2 kstack_cache 16384 953 0 12061 1 db:0:pho> acttrace Tracing command idle pid 11 tid 100003 td 0xfffff80003bf4740 (CPU 0) cpustop_handler() at cpustop_handler+0x27/frame 0xffffffff81d09f80 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xffffffff81d09f90 trap() at trap+0x56/frame 0xffffffff81d0a0b0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81d0a0b0 --- trap 0x13, rip = 0xffffffff81026d4e, rsp = 0xfffffe0108014d78, rbp = 0xfffffe0108014db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108014db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108014dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108014df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108014ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108014f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108014f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff80003bf4000 (CPU 1) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce3cdf0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce3ce00 trap() at trap+0x56/frame 0xfffffe003ce3cf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce3cf20 --- trap 0x13, rip = 0xffffffff81026d4e, rsp = 0xfffffe010800fd78, rbp = 0xfffffe010800fdb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe010800fdb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe010800fdd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe010800fdf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe010800fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010800ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010800ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff80003bf5740 (CPU 2) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce4bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce4be00 trap() at trap+0x56/frame 0xfffffe003ce4bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce4bf20 --- trap 0x13, rip = 0xffffffff81026d4e, rsp = 0xfffffe010801ed78, rbp = 0xfffffe010801edb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe010801edb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe010801edd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe010801edf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe010801eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010801ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010801ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff80003bf5000 (CPU 3) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce5adf0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce5ae00 trap() at trap+0x56/frame 0xfffffe003ce5af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce5af20 --- trap 0x13, rip = 0xffffffff81026d4e, rsp = 0xfffffe0108019d78, rbp = 0xfffffe0108019db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108019db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108019dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108019df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108019ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108019f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108019f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff80003bf6740 (CPU 4) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce69df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce69e00 trap() at trap+0x56/frame 0xfffffe003ce69f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce69f20 --- trap 0x13, rip = 0xffffffff81026d4e, rsp = 0xfffffe0108028d78, rbp = 0xfffffe0108028db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108028db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108028dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108028df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108028ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108028f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108028f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff80003bf6000 (CPU 5) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce78df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce78e00 trap() at trap+0x56/frame 0xfffffe003ce78f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce78f20 --- trap 0x13, rip = 0xffffffff81026d4e, rsp = 0xfffffe0108023d78, rbp = 0xfffffe0108023db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108023db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108023dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108023df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108023ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108023f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108023f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff80003bdf740 (CPU 6) kdb_enter() at kdb_enter+0x33/frame 0xfffffe0108032c00 handleevents() at handleevents+0xaf/frame 0xfffffe0108032c40 timercb() at timercb+0x18e/frame 0xfffffe0108032c90 lapic_handle_timer() at lapic_handle_timer+0xab/frame 0xfffffe0108032cb0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe0108032cb0 --- interrupt, rip = 0xffffffff804c649e, rsp = 0xfffffe0108032d80, rbp = 0xfffffe0108032db0 --- acpi_cpu_idle() at acpi_cpu_idle+0x27e/frame 0xfffffe0108032db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108032dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108032df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108032ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108032f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108032f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff80003bdf000 (CPU 7) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce96df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce96e00 trap() at trap+0x56/frame 0xfffffe003ce96f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce96f20 --- trap 0x13, rip = 0xffffffff81026d4e, rsp = 0xfffffe010802dd78, rbp = 0xfffffe010802ddb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe010802ddb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe010802ddd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe010802ddf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe010802def0 fork_exit() at fork_exit+0x82/frame 0xfffffe010802df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010802df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff80003be0740 (CPU 8) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003cea5df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003cea5e00 trap() at trap+0x56/frame 0xfffffe003cea5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cea5f20 --- trap 0x13, rip = 0xffffffff81026d4e, rsp = 0xfffffe010803cd78, rbp = 0xfffffe010803cdb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe010803cdb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe010803cdd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe010803cdf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe010803cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010803cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010803cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff80003be0000 (CPU 9) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ceb4df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ceb4e00 trap() at trap+0x56/frame 0xfffffe003ceb4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ceb4f20 --- trap 0x13, rip = 0xffffffff81026d4e, rsp = 0xfffffe0108037d78, rbp = 0xfffffe0108037db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108037db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108037dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108037df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108037ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108037f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108037f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff80003be1740 (CPU 10) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003cec3df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003cec3e00 trap() at trap+0x56/frame 0xfffffe003cec3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cec3f20 --- trap 0x13, rip = 0xffffffff81026d4e, rsp = 0xfffffe0108046d78, rbp = 0xfffffe0108046db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108046db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108046dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108046df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108046ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108046f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108046f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff80003be1000 (CPU 11) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ced2df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ced2e00 trap() at trap+0x56/frame 0xfffffe003ced2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ced2f20 --- trap 0x13, rip = 0xffffffff81026d4e, rsp = 0xfffffe0108041d78, rbp = 0xfffffe0108041db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108041db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108041dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108041df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108041ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108041f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108041f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 96144 3439 3439 0 NV watchdogd 96132 1 88906 0 D vmwait 0xffffffff818076c0 dd 3597 1 3597 0 Ss select 0xfffff800050c1bc0 sshd 3580 1 3580 0 ?Ws cron 3575 1 3575 0 Ss select 0xfffff800050c1b40 inetd 3439 1 3439 0 DLs vmwait 0xffffffff818076c0 watchdogd 3422 1 3422 0 ?Ws syslogd 19 0 0 0 DL syncer 0xffffffff81cc19a8 [syncer] 18 0 0 0 DL vlruwt 0xfffffe010ebe0000 [vnlru] 17 0 0 0 DL (threaded) [bufdaemon] 100202 D psleep 0xffffffff81cc09c0 [bufdaemon] 100203 D - 0xffffffff81802100 [bufspacedaemon-0] 100204 D - 0xffffffff81802380 [bufspacedaemon-1] 100205 D - 0xffffffff81802600 [bufspacedaemon-2] 100206 D - 0xffffffff81802880 [bufspacedaemon-3] 100207 D - 0xffffffff81802b00 [bufspacedaemon-4] 100208 D - 0xffffffff81802d80 [bufspacedaemon-5] 100209 D - 0xffffffff81803000 [bufspacedaemon-6] 100234 D sdflush 0xfffff8005e2b8ce8 [/ worker] 100250 D sdflush 0xfffff8005e2f3ce8 [/tmp worker] 16 0 0 0 RL [vmdaemon] 9 0 0 0 RL (threaded) [pagedaemon] 100198 D pwait 0xffffffff813c596a [dom0] 100199 D launds 0xffffffff81cdc984 [laundry: dom0] 100201 RunQ [uma] 8 0 0 0 DL idle 0xfffffe010e662ae0 [enc_daemon1] 7 0 0 0 DL idle 0xfffffe010e663040 [enc_daemon0] 6 0 0 0 DL - 0xffffffff819dc9b0 [rand_harvestq] 15 0 0 0 DL (threaded) [usb] 100128 D - 0xfffffe010a9cf440 [usbus0] 100129 D - 0xfffffe010a9cf498 [usbus0] 100130 D - 0xfffffe010a9cf4f0 [usbus0] 100131 D - 0xfffffe010a9cf548 [usbus0] 100132 D - 0xfffffe010a9cf5a0 [usbus0] 100134 D - 0xfffffe00e4d9ccf0 [usbus1] 100135 D - 0xfffffe00e4d9cd48 [usbus1] 100136 D - 0xfffffe00e4d9cda0 [usbus1] 100137 D - 0xfffffe00e4d9cdf8 [usbus1] 100138 D - 0xfffffe00e4d9ce50 [usbus1] 100139 D - 0xfffffe010ad7ccf0 [usbus2] 100140 D - 0xfffffe010ad7cd48 [usbus2] 100141 D - 0xfffffe010ad7cda0 [usbus2] 100142 D - 0xfffffe010ad7cdf8 [usbus2] 100143 D - 0xfffffe010ad7ce50 [usbus2] 5 0 0 0 DL - 0xffffffff81d009e8 [busdma] 4 0 0 0 DL (threaded) [cam] 100121 D - 0xffffffff819ae240 [doneq0] 100122 D - 0xffffffff819ae2c0 [doneq1] 100123 D - 0xffffffff819ae340 [doneq2] 100124 D - 0xffffffff819ae1c0 [async] 100153 D - 0xffffffff819ae090 [scanner] 3 0 0 0 DL (threaded) [crypto] 100108 D crypto_ 0xffffffff81cd9db0 [crypto] 100109 D crypto_ 0xfffff800051f1830 [crypto returns 0] 100110 D crypto_ 0xfffff800051f1880 [crypto returns 1] 100111 D crypto_ 0xfffff800051f18d0 [crypto returns 2] 100112 D crypto_ 0xfffff800051f1920 [crypto returns 3] 100113 D crypto_ 0xfffff800051f1970 [crypto returns 4] 100114 D crypto_ 0xfffff800051f19c0 [crypto returns 5] 100115 D crypto_ 0xfffff800051f1a10 [crypto returns 6] 100116 D crypto_ 0xfffff800051f1a60 [crypto returns 7] 100117 D crypto_ 0xfffff800051f1ab0 [crypto returns 8] 100118 D crypto_ 0xfffff800051f1b00 [crypto returns 9] 100119 D crypto_ 0xfffff800051f1b50 [crypto returns 10] 100120 D crypto_ 0xfffff800051f1ba0 [crypto returns 11] 14 0 0 0 DL seqstat 0xfffff800052fb488 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100092 D - 0xffffffff81b96bb0 [g_event] 100093 D - 0xffffffff81b96bb8 [g_up] 100094 D - 0xffffffff81b96bc0 [g_down] 2 0 0 0 WL (threaded) [clock] 100078 I [clock (0)] 100079 I [clock (1)] 100080 I [clock (2)] 100081 I [clock (3)] 100082 I [clock (4)] 100083 I [clock (5)] 100084 I [clock (6)] 100085 I [clock (7)] 100086 I [clock (8)] 100087 I [clock (9)] 100088 I [clock (10)] 100089 I [clock (11)] 12 0 0 0 WL (threaded) [intr] 100042 I [swi6: task queue] 100043 I [swi6: Giant taskq] 100045 I [swi5: fast taskq] 100090 I [swi1: netisr 0] 100125 I [irq56: ahci0] 100127 I [irq19: xhci0] 100133 I [irq18: ehci0 ehci1+] 100144 I [irq71: ahci1] 100145 I [swi4: apei] 100146 I [swi0: uart uart] 100160 I [irq73: mlx5_core0] 100161 I [irq74: mlx5_core0] 100162 I [irq72: mlx5_core0] 100163 I [irq75: mlx5_core0] 100164 I [irq76: mlx5_core0] 100165 I [irq77: mlx5_core0] 100166 I [irq78: mlx5_core0] 100167 I [irq79: mlx5_core0] 100168 I [irq80: mlx5_core0] 100169 I [irq81: mlx5_core0] 100170 I [irq82: mlx5_core0] 100171 I [irq83: mlx5_core0] 100172 I [irq84: mlx5_core0] 100173 I [irq85: mlx5_core0] 100174 I [irq86: mlx5_core0] 100181 I [irq88: mlx5_core1] 100182 I [irq89: mlx5_core1] 100183 I [irq87: mlx5_core1] 100184 I [irq90: mlx5_core1] 100185 I [irq91: mlx5_core1] 100186 I [irq92: mlx5_core1] 100187 I [irq93: mlx5_core1] 100188 I [irq94: mlx5_core1] 100189 I [irq95: mlx5_core1] 100190 I [irq96: mlx5_core1] 100191 I [irq97: mlx5_core1] 100192 I [irq98: mlx5_core1] 100193 I [irq99: mlx5_core1] 100194 I [irq100: mlx5_core1] 100195 I [irq101: mlx5_core1] 100242 I [irq102: ioat0] 100243 I [irq103: ioat1] 100244 I [irq104: ioat2] 100245 I [irq105: ioat3] 100246 I [irq106: ioat4] 100247 I [irq107: ioat5] 100248 I [irq108: ioat6] 100249 I [irq109: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 100007 Run CPU 4 [idle: cpu4] 100008 Run CPU 5 [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 Run CPU 7 [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 Run CPU 9 [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 1 0 1 0 DLs pfault 0xffffffff818076c0 [init] 10 0 0 0 DL audit_w 0xffffffff81cda2b0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81b97120 [swapper] 100015 D - 0xfffff800039edd00 [softirq_0] 100016 D - 0xfffff800039edc00 [softirq_1] 100017 D - 0xfffff800039edb00 [softirq_2] 100018 D - 0xfffff800039eda00 [softirq_3] 100019 D - 0xfffff800039ed900 [softirq_4] 100020 D - 0xfffff800039ed800 [softirq_5] 100021 D - 0xfffff800039ed700 [softirq_6] 100022 D - 0xfffff800039ed600 [softirq_7] 100023 D - 0xfffff800039ed500 [softirq_8] 100024 D - 0xfffff800039ed400 [softirq_9] 100025 D - 0xfffff800039ed300 [softirq_10] 100026 D - 0xfffff800039ed200 [softirq_11] 100027 D - 0xfffff800039ed100 [if_io_tqg_0] 100028 D - 0xfffff800039ed000 [if_io_tqg_1] 100029 D - 0xfffff800039ece00 [if_io_tqg_2] 100030 D - 0xfffff800039ecd00 [if_io_tqg_3] 100031 D - 0xfffff800039ecc00 [if_io_tqg_4] 100032 D - 0xfffff800039ecb00 [if_io_tqg_5] 100033 D - 0xfffff800039eca00 [if_io_tqg_6] 100034 D - 0xfffff800039ec900 [if_io_tqg_7] 100035 D - 0xfffff800039ec800 [if_io_tqg_8] 100036 D - 0xfffff800039ec700 [if_io_tqg_9] 100037 D - 0xfffff800039ec600 [if_io_tqg_10] 100038 D - 0xfffff800039ec500 [if_io_tqg_11] 100039 D - 0xfffff800039ec400 [if_config_tqg_0] 100040 D - 0xfffff800039ec300 [pci_hp taskq] 100041 D - 0xfffff800039ec200 [kqueue_ctx taskq] 100044 D - 0xfffff80003b9c300 [thread taskq] 100046 D - 0xfffff80003b9c100 [aiod_kick taskq] 100047 D - 0xfffff80003b9c000 [deferred_unmount ta] 100048 D - 0xfffff80003b9de00 [inm_free taskq] 100049 D - 0xfffff80003b9dd00 [in6m_free taskq] 100050 D - 0xfffff80003b9dc00 [linuxkpi_irq_wq] 100051 D - 0xfffff80003b9db00 [linuxkpi_short_wq_0] 100052 D - 0xfffff80003b9db00 [linuxkpi_short_wq_1] 100053 D - 0xfffff80003b9db00 [linuxkpi_short_wq_2] 100054 D - 0xfffff80003b9db00 [linuxkpi_short_wq_3] 100055 D - 0xfffff80003b9db00 [linuxkpi_short_wq_4] 100056 D - 0xfffff80003b9db00 [linuxkpi_short_wq_5] 100057 D - 0xfffff80003b9db00 [linuxkpi_short_wq_6] 100058 D - 0xfffff80003b9db00 [linuxkpi_short_wq_7] 100059 D - 0xfffff80003b9db00 [linuxkpi_short_wq_8] 100060 D - 0xfffff80003b9db00 [linuxkpi_short_wq_9] 100061 D - 0xfffff80003b9db00 [linuxkpi_short_wq_1] 100062 D - 0xfffff80003b9db00 [linuxkpi_short_wq_1] 100063 D - 0xfffff80003b9db00 [linuxkpi_short_wq_1] 100064 D - 0xfffff80003b9da00 [linuxkpi_long_wq_0] 100065 D - 0xfffff80003b9da00 [linuxkpi_long_wq_1] 100066 D - 0xfffff80003b9da00 [linuxkpi_long_wq_2] 100067 D - 0xfffff80003b9da00 [linuxkpi_long_wq_3] 100068 D - 0xfffff80003b9da00 [linuxkpi_long_wq_4] 100069 D - 0xfffff80003b9da00 [linuxkpi_long_wq_5] 100070 D - 0xfffff80003b9da00 [linuxkpi_long_wq_6] 100071 D - 0xfffff80003b9da00 [linuxkpi_long_wq_7] 100072 D - 0xfffff80003b9da00 [linuxkpi_long_wq_8] 100073 D - 0xfffff80003b9da00 [linuxkpi_long_wq_9] 100074 D - 0xfffff80003b9da00 [linuxkpi_long_wq_10] 100075 D - 0xfffff80003b9da00 [linuxkpi_long_wq_11] 100076 D - 0xfffff80003b9da00 [linuxkpi_long_wq_12] 100091 D - 0xfffff80003b9d800 [firmware taskq] 100096 D - 0xfffff80003b9ec00 [crypto_0] 100097 D - 0xfffff80003b9ec00 [crypto_1] 100098 D - 0xfffff80003b9ec00 [crypto_2] 100099 D - 0xfffff80003b9ec00 [crypto_3] 100100 D - 0xfffff80003b9ec00 [crypto_4] 100101 D - 0xfffff80003b9ec00 [crypto_5] 100102 D - 0xfffff80003b9ec00 [crypto_6] 100103 D - 0xfffff80003b9ec00 [crypto_7] 100104 D - 0xfffff80003b9ec00 [crypto_8] 100105 D - 0xfffff80003b9ec00 [crypto_9] 100106 D - 0xfffff80003b9ec00 [crypto_10] 100107 D - 0xfffff80003b9ec00 [crypto_11] 100147 D - 0xfffff80005922100 [acpi_task_0] 100148 D - 0xfffff80005922100 [acpi_task_1] 100149 D - 0xfffff80005922100 [acpi_task_2] 100151 D - 0xfffff800039ede00 [mca taskq] 100152 D - 0xfffff80003b9e500 [CAM taskq] 100156 D - 0xfffff80005923400 [mlx5_core0-rec] 100157 D - 0xfffff80005923300 [mlx5_core0-wdg] 100158 D - 0xfffff80005923200 [mlx5_core0-cmd] 100159 D - 0xfffff80005923100 [mlx5_page_allocator] 100175 D - 0xfffff80005924e00 [mlx5_fc] 100176 D - 0xfffff80005924d00 [mlx5_esw_wq] 100177 D - 0xfffff80005924c00 [mlx5_core1-rec] 100178 D - 0xfffff80005924b00 [mlx5_core1-wdg] 100179 D - 0xfffff80005924a00 [mlx5_core1-cmd] 100180 D - 0xfffff80005924900 [mlx5_page_allocator] 100196 D - 0xfffff80003f8c600 [mlx5_fc] 100197 D - 0xfffff80003f8c500 [mlx5_esw_wq] 75919 1 75919 0 Z+ getty 3197 1 3197 0 Z dhclient 3200 1 3200 0 Z dhclient 3259 1 3259 65 Z dhclient 3554 1 3554 0 Z powerd 3611 1 3611 0 Z+ getty 3612 1 3612 0 Z+ getty 3613 1 3613 0 Z+ getty 3614 1 3614 0 Z+ getty 3615 1 3615 0 Z+ getty 3616 1 3616 0 Z+ getty 3618 1 3618 0 Z+ getty 96121 1 88906 0 Z sh 88906 1 88906 0 Z+ sh db:0:pho> allt Tracing command kernel pid 0 tid 100000 td 0xffffffff81b97680 sched_switch() at sched_switch+0x5c6/frame 0xffffffff8237de10 mi_switch() at mi_switch+0x170/frame 0xffffffff8237de30 sleepq_switch() at sleepq_switch+0x101/frame 0xffffffff8237de70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xffffffff8237deb0 _sleep() at _sleep+0x27e/frame 0xffffffff8237df50 swapper() at swapper+0x75/frame 0xffffffff8237dfa0 mi_startup() at mi_startup+0x226/frame 0xffffffff8237dff0 Tracing command kernel pid 0 tid 100015 td 0xfffff80003be2740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108050df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108050e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108050e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe0108050ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe0108050ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108050f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108050f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffff80003be2000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010804bdf0 mi_switch() at mi_switch+0x170/frame 0xfffffe010804be10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010804be50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010804bec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe010804bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010804bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010804bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffff80003bb5740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010805adf0 mi_switch() at mi_switch+0x170/frame 0xfffffe010805ae10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010805ae50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010805aec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe010805aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010805af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010805af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffff80003bb5000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108055df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108055e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108055e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe0108055ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe0108055ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108055f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108055f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffff80003bb6740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108064df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108064e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108064e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe0108064ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe0108064ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108064f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108064f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffff80003bb6000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010805fdf0 mi_switch() at mi_switch+0x170/frame 0xfffffe010805fe10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010805fe50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010805fec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe010805fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010805ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010805ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffff80003bb7740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010806edf0 mi_switch() at mi_switch+0x170/frame 0xfffffe010806ee10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010806ee50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010806eec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe010806eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010806ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010806ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffff80003bb7000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108069df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108069e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108069e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe0108069ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe0108069ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108069f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108069f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffff80003bb8740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108078df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108078e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108078e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe0108078ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe0108078ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108078f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108078f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffff80003bb8000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108073df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108073e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108073e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe0108073ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe0108073ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108073f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108073f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffff80003bb1740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108082df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108082e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108082e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe0108082ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe0108082ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108082f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108082f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffff80003bb1000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010807ddf0 mi_switch() at mi_switch+0x170/frame 0xfffffe010807de10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010807de50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010807dec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe010807def0 fork_exit() at fork_exit+0x82/frame 0xfffffe010807df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010807df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffff80003bb2740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010808cdf0 mi_switch() at mi_switch+0x170/frame 0xfffffe010808ce10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010808ce50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010808cec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe010808cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010808cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010808cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffff80003bb2000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108087df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108087e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108087e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe0108087ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe0108087ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108087f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108087f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffff80003bb3740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108096df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108096e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108096e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe0108096ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe0108096ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108096f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108096f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffff80003bb3000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108091df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108091e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108091e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe0108091ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe0108091ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108091f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108091f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffff80003bb4740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080a0df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080a0e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080a0e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01080a0ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe01080a0ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080a0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080a0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffff80003bb4000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010809bdf0 mi_switch() at mi_switch+0x170/frame 0xfffffe010809be10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010809be50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010809bec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe010809bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010809bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010809bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff80003bab740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080aadf0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080aae10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080aae50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01080aaec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe01080aaef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080aaf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080aaf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffff80003bab000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080a5df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080a5e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080a5e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01080a5ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe01080a5ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080a5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080a5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffff80003bac740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080b4df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080b4e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080b4e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01080b4ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe01080b4ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080b4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080b4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffff80003bac000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080afdf0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080afe10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080afe50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01080afec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe01080afef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080aff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080aff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffff80003bad740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080bedf0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080bee10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080bee50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01080beec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe01080beef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080bef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080bef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffff80003bad000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080b9df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080b9e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080b9e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01080b9ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe01080b9ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080b9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080b9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffff80003bae740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080c8df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080c8e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080c8e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01080c8ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe01080c8ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080c8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080c8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffff80003bae000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080c3dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080c3de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080c3e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01080c3ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01080c3ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080c3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080c3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffff80003ba7740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080d2dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080d2de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080d2e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01080d2ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01080d2ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080d2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080d2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffff80003ba8000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080d7dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080d7de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080d7e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01080d7ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01080d7ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080d7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080d7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffff80003ba9000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080e1dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080e1de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080e1e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01080e1ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01080e1ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080e1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080e1f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100047 td 0xfffff80003baa740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080f0dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080f0de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080f0e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01080f0ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01080f0ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080f0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080f0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100048 td 0xfffff80003baa000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080ebdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080ebde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080ebe20 _sleep() at _sleep+0x2d8/frame 0xfffffe01080ebec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01080ebef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080ebf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080ebf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100049 td 0xfffff80003b98740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080fadc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080fade0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080fae20 _sleep() at _sleep+0x2d8/frame 0xfffffe01080faec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01080faef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080faf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080faf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100050 td 0xfffff80003b98000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080f5df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080f5e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080f5e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01080f5ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe01080f5ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080f5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080f5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100051 td 0xfffff80003b99740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108104dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108104de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108104e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108104ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108104ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108104f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108104f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100052 td 0xfffff80003b99000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080ffdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080ffde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080ffe20 _sleep() at _sleep+0x2d8/frame 0xfffffe01080ffec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01080ffef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080fff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080fff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100053 td 0xfffff80003b9a740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010810edc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010810ede0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010810ee20 _sleep() at _sleep+0x2d8/frame 0xfffffe010810eec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010810eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010810ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010810ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100054 td 0xfffff80003b9a000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108109dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108109de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108109e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108109ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108109ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108109f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108109f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100055 td 0xfffff80003b9b740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108118dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108118de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108118e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108118ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108118ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108118f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108118f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100056 td 0xfffff80003b9b000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108113dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108113de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108113e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108113ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108113ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108113f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108113f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100057 td 0xfffff80003b91740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108122dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108122de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108122e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108122ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108122ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108122f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108122f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100058 td 0xfffff80003b91000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010811ddc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010811dde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010811de20 _sleep() at _sleep+0x2d8/frame 0xfffffe010811dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010811def0 fork_exit() at fork_exit+0x82/frame 0xfffffe010811df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010811df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100059 td 0xfffff80003b95740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010812cdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010812cde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010812ce20 _sleep() at _sleep+0x2d8/frame 0xfffffe010812cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010812cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010812cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010812cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100060 td 0xfffff80003b95000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108127dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108127de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108127e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108127ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108127ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108127f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108127f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffff80003b96740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108136dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108136de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108136e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108136ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108136ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108136f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108136f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100062 td 0xfffff80003b96000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108131dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108131de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108131e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108131ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108131ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108131f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108131f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100063 td 0xfffff80003b97740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108140dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108140de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108140e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108140ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108140ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108140f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108140f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffff80003b97000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010813bdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010813bde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010813be20 _sleep() at _sleep+0x2d8/frame 0xfffffe010813bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010813bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010813bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010813bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xfffff80003b89740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010814adc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010814ade0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010814ae20 _sleep() at _sleep+0x2d8/frame 0xfffffe010814aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010814aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010814af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010814af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff80003b89000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108145dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108145de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108145e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108145ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108145ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108145f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108145f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff80003b8a740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108154dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108154de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108154e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108154ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108154ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108154f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108154f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff80003b8a000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010814fdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010814fde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010814fe20 _sleep() at _sleep+0x2d8/frame 0xfffffe010814fec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010814fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010814ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010814ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffff80003b8b740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010815edc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010815ede0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010815ee20 _sleep() at _sleep+0x2d8/frame 0xfffffe010815eec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010815eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010815ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010815ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff80003b8b000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108159dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108159de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108159e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108159ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108159ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108159f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108159f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff80003b8c740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108168dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108168de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108168e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108168ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108168ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108168f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108168f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffff80003b8c000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108163dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108163de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108163e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108163ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108163ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108163f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108163f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffff80003b85740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108172dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108172de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108172e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108172ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108172ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108172f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108172f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffff80003b85000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010816ddc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010816dde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010816de20 _sleep() at _sleep+0x2d8/frame 0xfffffe010816dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010816def0 fork_exit() at fork_exit+0x82/frame 0xfffffe010816df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010816df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffff80003b86740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010817cdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010817cde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010817ce20 _sleep() at _sleep+0x2d8/frame 0xfffffe010817cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010817cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010817cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010817cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffff80003b86000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108177dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108177de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108177e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108177ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108177ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108177f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108177f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100091 td 0xfffff80003c93740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081ccdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081ccde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081cce20 _sleep() at _sleep+0x2d8/frame 0xfffffe01081ccec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01081ccef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081ccf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081ccf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100096 td 0xfffff80003c95000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081dbdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081dbde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081dbe20 _sleep() at _sleep+0x2d8/frame 0xfffffe01081dbec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01081dbef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081dbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081dbf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100097 td 0xfffff80005277740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081eadc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081eade0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081eae20 _sleep() at _sleep+0x2d8/frame 0xfffffe01081eaec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01081eaef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081eaf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081eaf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100098 td 0xfffff80005277000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081e5dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081e5de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081e5e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01081e5ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01081e5ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081e5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081e5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100099 td 0xfffff80005278740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081f4dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081f4de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081f4e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01081f4ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01081f4ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081f4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081f4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100100 td 0xfffff80005278000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081efdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081efde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081efe20 _sleep() at _sleep+0x2d8/frame 0xfffffe01081efec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01081efef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081eff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081eff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100101 td 0xfffff80005279740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081fedc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081fede0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081fee20 _sleep() at _sleep+0x2d8/frame 0xfffffe01081feec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01081feef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081fef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081fef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100102 td 0xfffff80005279000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081f9dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081f9de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081f9e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01081f9ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01081f9ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081f9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081f9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100103 td 0xfffff8000527a740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108208dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108208de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108208e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108208ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108208ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108208f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108208f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100104 td 0xfffff8000527a000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108203dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108203de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108203e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108203ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108203ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108203f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108203f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100105 td 0xfffff80005273740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108212dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108212de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108212e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108212ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108212ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108212f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108212f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100106 td 0xfffff80005273000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010820ddc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010820dde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010820de20 _sleep() at _sleep+0x2d8/frame 0xfffffe010820dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010820def0 fork_exit() at fork_exit+0x82/frame 0xfffffe010820df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010820df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100107 td 0xfffff80005274740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010821cdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010821cde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010821ce20 _sleep() at _sleep+0x2d8/frame 0xfffffe010821cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010821cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010821cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010821cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100147 td 0xfffff80009599740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082e4df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082e4e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082e4e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01082e4ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe01082e4ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082e4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082e4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100148 td 0xfffff80009599000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082dfdf0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082dfe10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082dfe50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01082dfec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe01082dfef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082dff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082dff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100149 td 0xfffff8000959a740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082eedf0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082eee10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082eee50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01082eeec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe01082eeef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082eef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082eef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100151 td 0xfffff8000959b740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082f8df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082f8e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082f8e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01082f8ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe01082f8ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082f8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082f8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100152 td 0xfffff8000959b000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082f3dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082f3de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082f3e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01082f3ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01082f3ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082f3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082f3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100156 td 0xfffff800095a3000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082fddc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082fdde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082fde20 _sleep() at _sleep+0x2d8/frame 0xfffffe01082fdec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01082fdef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082fdf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082fdf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100157 td 0xfffff8000954e740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108316dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108316de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108316e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108316ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108316ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108316f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108316f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100158 td 0xfffff8000954e000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108311dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108311de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108311e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108311ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108311ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108311f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108311f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100159 td 0xfffff8000954f740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108320dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108320de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108320e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108320ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108320ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108320f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108320f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100175 td 0xfffff8004cbd3740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108370dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108370de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108370e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108370ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108370ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108370f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108370f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100176 td 0xfffff8004cbd3000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010836bdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010836bde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010836be20 _sleep() at _sleep+0x2d8/frame 0xfffffe010836bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010836bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010836bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010836bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100177 td 0xfffff8004cbd4740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010837adc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010837ade0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010837ae20 _sleep() at _sleep+0x2d8/frame 0xfffffe010837aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010837aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010837af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010837af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100178 td 0xfffff8004cbd4000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108375dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108375de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108375e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108375ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108375ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108375f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108375f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100179 td 0xfffff8004cbd5740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108384dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108384de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108384e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108384ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108384ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108384f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108384f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100180 td 0xfffff8004cbd5000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010837fdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010837fde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010837fe20 _sleep() at _sleep+0x2d8/frame 0xfffffe010837fec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010837fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010837ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010837ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100196 td 0xfffff80003f23740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01083dedc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01083dede0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01083dee20 _sleep() at _sleep+0x2d8/frame 0xfffffe01083deec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01083deef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01083def30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01083def30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100197 td 0xfffff80003f23000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01083d9dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01083d9de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01083d9e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01083d9ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01083d9ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01083d9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01083d9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff80003bf3000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108005a50 mi_switch() at mi_switch+0x170/frame 0xfffffe0108005a70 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108005ab0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0108005af0 _sleep() at _sleep+0x27e/frame 0xfffffe0108005b90 vm_waitpfault() at vm_waitpfault+0x74/frame 0xfffffe0108005bc0 vm_fault_allocate() at vm_fault_allocate+0x41e/frame 0xfffffe0108005c30 vm_fault() at vm_fault+0x43d/frame 0xfffffe0108005d60 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe0108005da0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe0108005e10 trap() at trap+0x51d/frame 0xfffffe0108005f30 calltrap() at calltrap+0x8/frame 0xfffffe0108005f30 --- trap 0xc, rip = 0x26a970, rsp = 0x820478028, rbp = 0x8204780b0 --- Tracing command clock pid 2 tid 100078 td 0xfffff80003b87000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108181ea0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108181ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe0108181ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108181f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108181f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100079 td 0xfffff80003b88740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108190ea0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108190ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe0108190ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108190f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108190f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100080 td 0xfffff80003b88000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010818bea0 mi_switch() at mi_switch+0x170/frame 0xfffffe010818bec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe010818bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010818bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010818bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100081 td 0xfffff80003c96740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010819aea0 mi_switch() at mi_switch+0x170/frame 0xfffffe010819aec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe010819aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010819af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010819af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100082 td 0xfffff80003c96000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108195ea0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108195ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe0108195ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108195f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108195f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100083 td 0xfffff80003c97740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081a4ea0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081a4ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe01081a4ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081a4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081a4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100084 td 0xfffff80003c97000 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100085 td 0xfffff80003c98740 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100086 td 0xfffff80003c98000 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100087 td 0xfffff80003c99740 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100088 td 0xfffff80003c99000 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100089 td 0xfffff80003c92740 fork_trampoline() at fork_trampoline Tracing command crypto pid 3 tid 100108 td 0xfffff80005274000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108217dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108217de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108217e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108217ec0 crypto_dispatch_thread() at crypto_dispatch_thread+0x193/frame 0xfffffe0108217ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108217f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108217f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100109 td 0xfffff80005275740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108226db0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108226dd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108226e10 _sleep() at _sleep+0x2d8/frame 0xfffffe0108226eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe0108226ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108226f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108226f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100110 td 0xfffff80005275000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108221db0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108221dd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108221e10 _sleep() at _sleep+0x2d8/frame 0xfffffe0108221eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe0108221ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108221f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108221f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100111 td 0xfffff80005276740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108230db0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108230dd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108230e10 _sleep() at _sleep+0x2d8/frame 0xfffffe0108230eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe0108230ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108230f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108230f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100112 td 0xfffff80005276000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010822bdb0 mi_switch() at mi_switch+0x170/frame 0xfffffe010822bdd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010822be10 _sleep() at _sleep+0x2d8/frame 0xfffffe010822beb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe010822bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010822bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010822bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100113 td 0xfffff8000526d740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010823adb0 mi_switch() at mi_switch+0x170/frame 0xfffffe010823add0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010823ae10 _sleep() at _sleep+0x2d8/frame 0xfffffe010823aeb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe010823aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010823af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010823af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100114 td 0xfffff8000526d000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108235db0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108235dd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108235e10 _sleep() at _sleep+0x2d8/frame 0xfffffe0108235eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe0108235ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108235f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108235f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100115 td 0xfffff8000526e740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108244db0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108244dd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108244e10 _sleep() at _sleep+0x2d8/frame 0xfffffe0108244eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe0108244ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108244f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108244f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100116 td 0xfffff8000526e000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010823fdb0 mi_switch() at mi_switch+0x170/frame 0xfffffe010823fdd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010823fe10 _sleep() at _sleep+0x2d8/frame 0xfffffe010823feb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe010823fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010823ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010823ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100117 td 0xfffff8000526f740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010824edb0 mi_switch() at mi_switch+0x170/frame 0xfffffe010824edd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010824ee10 _sleep() at _sleep+0x2d8/frame 0xfffffe010824eeb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe010824eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010824ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010824ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100118 td 0xfffff8000526f000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108249db0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108249dd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108249e10 _sleep() at _sleep+0x2d8/frame 0xfffffe0108249eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe0108249ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108249f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108249f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100119 td 0xfffff80005270740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108258db0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108258dd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108258e10 _sleep() at _sleep+0x2d8/frame 0xfffffe0108258eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe0108258ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108258f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108258f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100120 td 0xfffff80005270000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108253db0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108253dd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108253e10 _sleep() at _sleep+0x2d8/frame 0xfffffe0108253eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe0108253ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108253f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108253f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100121 td 0xfffff8000534d740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108262da0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108262dc0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108262e00 _sleep() at _sleep+0x2d8/frame 0xfffffe0108262ea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0108262ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108262f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108262f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100122 td 0xfffff8000534d000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010825dda0 mi_switch() at mi_switch+0x170/frame 0xfffffe010825ddc0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010825de00 _sleep() at _sleep+0x2d8/frame 0xfffffe010825dea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe010825def0 fork_exit() at fork_exit+0x82/frame 0xfffffe010825df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010825df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100123 td 0xfffff80005352740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010826cda0 mi_switch() at mi_switch+0x170/frame 0xfffffe010826cdc0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010826ce00 _sleep() at _sleep+0x2d8/frame 0xfffffe010826cea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe010826cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010826cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010826cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100124 td 0xfffff80005352000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108267da0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108267dc0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108267e00 _sleep() at _sleep+0x2d8/frame 0xfffffe0108267ea0 xpt_async_td() at xpt_async_td+0x74/frame 0xfffffe0108267ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108267f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108267f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100153 td 0xfffff800095a3740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108302dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108302de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108302e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108302ec0 xpt_scanner_thread() at xpt_scanner_thread+0x138/frame 0xfffffe0108302ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108302f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108302f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command busdma pid 5 tid 100126 td 0xfffff8000577c740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108276da0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108276dc0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108276e00 _sleep() at _sleep+0x2d8/frame 0xfffffe0108276ea0 busdma_thread() at busdma_thread+0xc5/frame 0xfffffe0108276ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108276f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108276f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 6 tid 100150 td 0xfffff8000959a000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082e9d20 mi_switch() at mi_switch+0x170/frame 0xfffffe01082e9d40 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082e9d80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01082e9dc0 _sleep() at _sleep+0x27e/frame 0xfffffe01082e9e60 random_kthread() at random_kthread+0xb7/frame 0xfffffe01082e9ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082e9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082e9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 7 tid 100154 td 0xfffff800061ca740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010830cd80 mi_switch() at mi_switch+0x170/frame 0xfffffe010830cda0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010830cde0 _sleep() at _sleep+0x2d8/frame 0xfffffe010830ce80 enc_daemon() at enc_daemon+0xdd/frame 0xfffffe010830cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010830cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010830cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 8 tid 100155 td 0xfffff800061ca000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108307d80 mi_switch() at mi_switch+0x170/frame 0xfffffe0108307da0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108307de0 _sleep() at _sleep+0x2d8/frame 0xfffffe0108307e80 enc_daemon() at enc_daemon+0xdd/frame 0xfffffe0108307ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108307f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108307f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 9 tid 100198 td 0xfffff8000603a740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01083e8980 mi_switch() at mi_switch+0x170/frame 0xfffffe01083e89a0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01083e89e0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01083e8a20 _sleep() at _sleep+0x27e/frame 0xfffffe01083e8ac0 pause_sbt() at pause_sbt+0x7d/frame 0xfffffe01083e8af0 vm_pageout_worker() at vm_pageout_worker+0x230/frame 0xfffffe01083e8eb0 vm_pageout() at vm_pageout+0x1d7/frame 0xfffffe01083e8ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01083e8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01083e8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 9 tid 100199 td 0xfffff80005006740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01083f2a70 mi_switch() at mi_switch+0x170/frame 0xfffffe01083f2a90 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01083f2ad0 _sleep() at _sleep+0x2d8/frame 0xfffffe01083f2b70 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xb52/frame 0xfffffe01083f2ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01083f2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01083f2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 9 tid 100201 td 0xfffff80005006000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01083ede20 mi_switch() at mi_switch+0x170/frame 0xfffffe01083ede40 sched_bind() at sched_bind+0xc6/frame 0xfffffe01083ede60 pcpu_cache_drain_safe() at pcpu_cache_drain_safe+0x26a/frame 0xfffffe01083ede90 uma_reclaim_domain() at uma_reclaim_domain+0x1aa/frame 0xfffffe01083edec0 uma_reclaim_worker() at uma_reclaim_worker+0x35/frame 0xfffffe01083edef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01083edf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01083edf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command audit pid 10 tid 100001 td 0xfffff80003bf3740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010800adc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010800ade0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010800ae20 _cv_wait() at _cv_wait+0x160/frame 0xfffffe010800ae90 audit_worker() at audit_worker+0x8f/frame 0xfffffe010800aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010800af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010800af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffff80003bf4740 (CPU 0) cpustop_handler() at cpustop_handler+0x27/frame 0xffffffff81d09f80 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xffffffff81d09f90 trap() at trap+0x56/frame 0xffffffff81d0a0b0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81d0a0b0 --- trap 0x13, rip = 0xffffffff81026d4e, rsp = 0xfffffe0108014d78, rbp = 0xfffffe0108014db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108014db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108014dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108014df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108014ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108014f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108014f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff80003bf4000 (CPU 1) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce3cdf0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce3ce00 trap() at trap+0x56/frame 0xfffffe003ce3cf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce3cf20 --- trap 0x13, rip = 0xffffffff81026d4e, rsp = 0xfffffe010800fd78, rbp = 0xfffffe010800fdb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe010800fdb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe010800fdd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe010800fdf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe010800fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010800ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010800ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff80003bf5740 (CPU 2) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce4bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce4be00 trap() at trap+0x56/frame 0xfffffe003ce4bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce4bf20 --- trap 0x13, rip = 0xffffffff81026d4e, rsp = 0xfffffe010801ed78, rbp = 0xfffffe010801edb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe010801edb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe010801edd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe010801edf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe010801eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010801ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010801ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff80003bf5000 (CPU 3) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce5adf0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce5ae00 trap() at trap+0x56/frame 0xfffffe003ce5af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce5af20 --- trap 0x13, rip = 0xffffffff81026d4e, rsp = 0xfffffe0108019d78, rbp = 0xfffffe0108019db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108019db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108019dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108019df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108019ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108019f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108019f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff80003bf6740 (CPU 4) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce69df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce69e00 trap() at trap+0x56/frame 0xfffffe003ce69f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce69f20 --- trap 0x13, rip = 0xffffffff81026d4e, rsp = 0xfffffe0108028d78, rbp = 0xfffffe0108028db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108028db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108028dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108028df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108028ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108028f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108028f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff80003bf6000 (CPU 5) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce78df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce78e00 trap() at trap+0x56/frame 0xfffffe003ce78f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce78f20 --- trap 0x13, rip = 0xffffffff81026d4e, rsp = 0xfffffe0108023d78, rbp = 0xfffffe0108023db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108023db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108023dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108023df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108023ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108023f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108023f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff80003bdf740 (CPU 6) kdb_enter() at kdb_enter+0x33/frame 0xfffffe0108032c00 handleevents() at handleevents+0xaf/frame 0xfffffe0108032c40 timercb() at timercb+0x18e/frame 0xfffffe0108032c90 lapic_handle_timer() at lapic_handle_timer+0xab/frame 0xfffffe0108032cb0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe0108032cb0 --- interrupt, rip = 0xffffffff804c649e, rsp = 0xfffffe0108032d80, rbp = 0xfffffe0108032db0 --- acpi_cpu_idle() at acpi_cpu_idle+0x27e/frame 0xfffffe0108032db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108032dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108032df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108032ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108032f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108032f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff80003bdf000 (CPU 7) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce96df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce96e00 trap() at trap+0x56/frame 0xfffffe003ce96f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce96f20 --- trap 0x13, rip = 0xffffffff81026d4e, rsp = 0xfffffe010802dd78, rbp = 0xfffffe010802ddb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe010802ddb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe010802ddd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe010802ddf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe010802def0 fork_exit() at fork_exit+0x82/frame 0xfffffe010802df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010802df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff80003be0740 (CPU 8) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003cea5df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003cea5e00 trap() at trap+0x56/frame 0xfffffe003cea5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cea5f20 --- trap 0x13, rip = 0xffffffff81026d4e, rsp = 0xfffffe010803cd78, rbp = 0xfffffe010803cdb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe010803cdb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe010803cdd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe010803cdf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe010803cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010803cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010803cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff80003be0000 (CPU 9) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ceb4df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ceb4e00 trap() at trap+0x56/frame 0xfffffe003ceb4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ceb4f20 --- trap 0x13, rip = 0xffffffff81026d4e, rsp = 0xfffffe0108037d78, rbp = 0xfffffe0108037db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108037db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108037dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108037df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108037ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108037f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108037f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff80003be1740 (CPU 10) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003cec3df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003cec3e00 trap() at trap+0x56/frame 0xfffffe003cec3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cec3f20 --- trap 0x13, rip = 0xffffffff81026d4e, rsp = 0xfffffe0108046d78, rbp = 0xfffffe0108046db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108046db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108046dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108046df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108046ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108046f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108046f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff80003be1000 (CPU 11) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ced2df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ced2e00 trap() at trap+0x56/frame 0xfffffe003ced2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ced2f20 --- trap 0x13, rip = 0xffffffff81026d4e, rsp = 0xfffffe0108041d78, rbp = 0xfffffe0108041db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108041db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108041dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108041df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108041ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108041f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108041f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100042 td 0xfffff80003ba7000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080cde40 mi_switch() at mi_switch+0x170/frame 0xfffffe01080cde60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe01080cdef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080cdf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080cdf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100043 td 0xfffff80003ba8740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100045 td 0xfffff80003ba9740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100090 td 0xfffff80003c92000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081bde40 mi_switch() at mi_switch+0x170/frame 0xfffffe01081bde60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe01081bdef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081bdf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081bdf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100125 td 0xfffff80003b87740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108186e40 mi_switch() at mi_switch+0x170/frame 0xfffffe0108186e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0108186ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108186f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108186f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100127 td 0xfffff8000577c000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108271e40 mi_switch() at mi_switch+0x170/frame 0xfffffe0108271e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0108271ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108271f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108271f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100133 td 0xfffff8000578a000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010828fe40 mi_switch() at mi_switch+0x170/frame 0xfffffe010828fe60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010828fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010828ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010828ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100144 td 0xfffff800060d9000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100145 td 0xfffff800060e1740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100146 td 0xfffff800060e1000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082d5e40 mi_switch() at mi_switch+0x170/frame 0xfffffe01082d5e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe01082d5ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082d5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082d5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100160 td 0xfffff8000954f000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010831be40 mi_switch() at mi_switch+0x170/frame 0xfffffe010831be60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010831bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010831bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010831bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100161 td 0xfffff80009550740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010832ae40 mi_switch() at mi_switch+0x170/frame 0xfffffe010832ae60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010832aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010832af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010832af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100162 td 0xfffff80009550000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100163 td 0xfffff80009551740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100164 td 0xfffff80009551000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100165 td 0xfffff8004cbd6740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100166 td 0xfffff8004cbd6000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100167 td 0xfffff8004cbd7740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100168 td 0xfffff8004cbd7000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100169 td 0xfffff8004cbd8740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100170 td 0xfffff8004cbd8000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100171 td 0xfffff8004cbd9740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100172 td 0xfffff8004cbd9000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100173 td 0xfffff8004cbd2740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100174 td 0xfffff8004cbd2000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100181 td 0xfffff800532ff740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010838ee40 mi_switch() at mi_switch+0x170/frame 0xfffffe010838ee60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010838eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010838ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010838ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100182 td 0xfffff80003f32740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108398e40 mi_switch() at mi_switch+0x170/frame 0xfffffe0108398e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0108398ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108398f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108398f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100183 td 0xfffff80003f32000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100184 td 0xfffff80003f33740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100185 td 0xfffff80003f33000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100186 td 0xfffff80003f34740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100187 td 0xfffff80003f34000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100188 td 0xfffff80003f40740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100189 td 0xfffff80003f40000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100190 td 0xfffff80003f20740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100191 td 0xfffff80003f20000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100192 td 0xfffff80003f21740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100193 td 0xfffff80003f21000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100194 td 0xfffff80003f22740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100195 td 0xfffff80003f22000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100242 td 0xfffff80009453740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100243 td 0xfffff80009453000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100244 td 0xfffff80009454740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100245 td 0xfffff80009454000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100246 td 0xfffff800061b6740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100247 td 0xfffff800061b6000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100248 td 0xfffff800093e3740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100249 td 0xfffff800093e3000 fork_trampoline() at fork_trampoline Tracing command geom pid 13 tid 100092 td 0xfffff80003c93000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081c7dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081c7de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081c7e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01081c7ec0 g_run_events() at g_run_events+0x434/frame 0xfffffe01081c7ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081c7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081c7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100093 td 0xfffff80003c94740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081d6db0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081d6dd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081d6e10 _sleep() at _sleep+0x2d8/frame 0xfffffe01081d6eb0 g_io_schedule_up() at g_io_schedule_up+0x3c/frame 0xfffffe01081d6ee0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe01081d6ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081d6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081d6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100094 td 0xfffff80003c94000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081d1db0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081d1dd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081d1e10 _sleep() at _sleep+0x2d8/frame 0xfffffe01081d1eb0 g_io_schedule_down() at g_io_schedule_down+0x3c/frame 0xfffffe01081d1ee0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe01081d1ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081d1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081d1f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100095 td 0xfffff80003c95740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081e0da0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081e0dc0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081e0e00 _cv_wait() at _cv_wait+0x160/frame 0xfffffe01081e0e70 seq_eventthread() at seq_eventthread+0x8c/frame 0xfffffe01081e0ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081e0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081e0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100128 td 0xfffff8000577d740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108280df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108280e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108280e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe0108280ec0 usb_process() at usb_process+0xb0/frame 0xfffffe0108280ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108280f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108280f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100129 td 0xfffff8000577d000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010827bdf0 mi_switch() at mi_switch+0x170/frame 0xfffffe010827be10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010827be50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe010827bec0 usb_process() at usb_process+0xb0/frame 0xfffffe010827bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010827bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010827bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100130 td 0xfffff8000577e740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010828adf0 mi_switch() at mi_switch+0x170/frame 0xfffffe010828ae10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010828ae50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe010828aec0 usb_process() at usb_process+0xb0/frame 0xfffffe010828aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010828af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010828af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100131 td 0xfffff8000577e000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108285df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108285e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108285e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe0108285ec0 usb_process() at usb_process+0xb0/frame 0xfffffe0108285ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108285f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108285f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100132 td 0xfffff8000578a740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108294df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108294e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108294e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe0108294ec0 usb_process() at usb_process+0xb0/frame 0xfffffe0108294ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108294f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108294f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100134 td 0xfffff800058cb740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010829edf0 mi_switch() at mi_switch+0x170/frame 0xfffffe010829ee10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010829ee50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe010829eec0 usb_process() at usb_process+0xb0/frame 0xfffffe010829eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010829ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010829ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100135 td 0xfffff800058cb000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108299df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108299e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108299e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe0108299ec0 usb_process() at usb_process+0xb0/frame 0xfffffe0108299ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108299f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108299f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100136 td 0xfffff800058cc740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082a8df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082a8e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082a8e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe01082a8ec0 usb_process() at usb_process+0xb0/frame 0xfffffe01082a8ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082a8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082a8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100137 td 0xfffff800058cc000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082a3df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082a3e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082a3e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe01082a3ec0 usb_process() at usb_process+0xb0/frame 0xfffffe01082a3ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082a3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082a3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100138 td 0xfffff800058cd740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082b2df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082b2e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082b2e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe01082b2ec0 usb_process() at usb_process+0xb0/frame 0xfffffe01082b2ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082b2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082b2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100139 td 0xfffff800060d7740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082bcdf0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082bce10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082bce50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe01082bcec0 usb_process() at usb_process+0xb0/frame 0xfffffe01082bcef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082bcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082bcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100140 td 0xfffff800060d7000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082b7df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082b7e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082b7e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe01082b7ec0 usb_process() at usb_process+0xb0/frame 0xfffffe01082b7ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082b7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082b7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100141 td 0xfffff800060d8740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082c6df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082c6e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082c6e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe01082c6ec0 usb_process() at usb_process+0xb0/frame 0xfffffe01082c6ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082c6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082c6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100142 td 0xfffff800060d8000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082c1df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082c1e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082c1e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe01082c1ec0 usb_process() at usb_process+0xb0/frame 0xfffffe01082c1ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082c1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082c1f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100143 td 0xfffff800060d9740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082d0df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082d0e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082d0e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe01082d0ec0 usb_process() at usb_process+0xb0/frame 0xfffffe01082d0ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082d0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082d0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 16 tid 100200 td 0xfffff8000603a000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01083e3dd0 mi_switch() at mi_switch+0x170/frame 0xfffffe01083e3df0 sched_bind() at sched_bind+0xc6/frame 0xfffffe01083e3e10 vm_page_pqbatch_drain() at vm_page_pqbatch_drain+0x7f/frame 0xfffffe01083e3e80 vm_daemon() at vm_daemon+0xc1/frame 0xfffffe01083e3ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01083e3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01083e3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100202 td 0xfffff8000603b740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01083fcd60 mi_switch() at mi_switch+0x170/frame 0xfffffe01083fcd80 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01083fcdc0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01083fce00 _sleep() at _sleep+0x27e/frame 0xfffffe01083fcea0 buf_daemon() at buf_daemon+0x121/frame 0xfffffe01083fcef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01083fcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01083fcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100203 td 0xfffff80005090740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108406d40 mi_switch() at mi_switch+0x170/frame 0xfffffe0108406d60 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108406da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0108406de0 _sleep() at _sleep+0x27e/frame 0xfffffe0108406e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe0108406ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108406f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108406f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100204 td 0xfffff80005090000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108401d40 mi_switch() at mi_switch+0x170/frame 0xfffffe0108401d60 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108401da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0108401de0 _sleep() at _sleep+0x27e/frame 0xfffffe0108401e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe0108401ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108401f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108401f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100205 td 0xfffff80005091740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108410d40 mi_switch() at mi_switch+0x170/frame 0xfffffe0108410d60 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108410da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0108410de0 _sleep() at _sleep+0x27e/frame 0xfffffe0108410e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe0108410ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108410f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108410f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100206 td 0xfffff80005091000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010840bd40 mi_switch() at mi_switch+0x170/frame 0xfffffe010840bd60 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010840bda0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010840bde0 _sleep() at _sleep+0x27e/frame 0xfffffe010840be80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010840bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010840bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010840bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100207 td 0xfffff80005092740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010841ad40 mi_switch() at mi_switch+0x170/frame 0xfffffe010841ad60 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010841ada0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010841ade0 _sleep() at _sleep+0x27e/frame 0xfffffe010841ae80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe010841aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010841af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010841af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100208 td 0xfffff80005092000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108415d40 mi_switch() at mi_switch+0x170/frame 0xfffffe0108415d60 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108415da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0108415de0 _sleep() at _sleep+0x27e/frame 0xfffffe0108415e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe0108415ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108415f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108415f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100209 td 0xfffff8000509e740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108424d40 mi_switch() at mi_switch+0x170/frame 0xfffffe0108424d60 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108424da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0108424de0 _sleep() at _sleep+0x27e/frame 0xfffffe0108424e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe0108424ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108424f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108424f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100234 td 0xfffff80005007000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108479d70 mi_switch() at mi_switch+0x170/frame 0xfffffe0108479d90 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108479dd0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0108479e10 _sleep() at _sleep+0x27e/frame 0xfffffe0108479eb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe0108479ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108479f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108479f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100250 td 0xfffff80006048000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010846fd70 mi_switch() at mi_switch+0x170/frame 0xfffffe010846fd90 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010846fdd0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010846fe10 _sleep() at _sleep+0x27e/frame 0xfffffe010846feb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe010846fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010846ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010846ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vnlru pid 18 tid 100210 td 0xfffff8000603b000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01083f7d10 mi_switch() at mi_switch+0x170/frame 0xfffffe01083f7d30 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01083f7d70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01083f7db0 _sleep() at _sleep+0x27e/frame 0xfffffe01083f7e50 vnlru_proc() at vnlru_proc+0x18b/frame 0xfffffe01083f7ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01083f7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01083f7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 19 tid 100211 td 0xfffff80006040740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010842ed30 mi_switch() at mi_switch+0x170/frame 0xfffffe010842ed50 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010842ed90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010842edd0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x187/frame 0xfffffe010842ee60 sched_sync() at sched_sync+0x6ae/frame 0xfffffe010842eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010842ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010842ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command getty pid 75919 tid 100541 td 0xfffff801ba586000 thread_exit() at thread_exit+0x1ea/frame 0xfffffe0108947860 exit1() at exit1+0xe0f/frame 0xfffffe01089478d0 sigexit() at sigexit+0x171/frame 0xfffffe0108947d50 postsig() at postsig+0x1a5/frame 0xfffffe0108947e20 ast_sig() at ast_sig+0x33b/frame 0xfffffe0108947ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe0108947f10 ast() at ast+0x20/frame 0xfffffe0108947f30 doreti_ast() at doreti_ast+0x1c/frame 0xca96d176f30 Tracing command dhclient pid 3197 tid 100318 td 0xfffff801bab4a000 thread_exit() at thread_exit+0x1ea/frame 0xfffffe0108578860 exit1() at exit1+0xe0f/frame 0xfffffe01085788d0 sigexit() at sigexit+0x171/frame 0xfffffe0108578d50 postsig() at postsig+0x1a5/frame 0xfffffe0108578e20 ast_sig() at ast_sig+0x33b/frame 0xfffffe0108578ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe0108578f10 ast() at ast+0x20/frame 0xfffffe0108578f30 doreti_ast() at doreti_ast+0x1c/frame 0x3e57dbb28a30 Tracing command dhclient pid 3200 tid 100215 td 0xfffff8000509e000 thread_exit() at thread_exit+0x1ea/frame 0xfffffe010841f860 exit1() at exit1+0xe0f/frame 0xfffffe010841f8d0 sigexit() at sigexit+0x171/frame 0xfffffe010841fd50 postsig() at postsig+0x1a5/frame 0xfffffe010841fe20 ast_sig() at ast_sig+0x33b/frame 0xfffffe010841fed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe010841ff10 ast() at ast+0x20/frame 0xfffffe010841ff30 doreti_ast() at doreti_ast+0x1c/frame 0x3e57dbb27910 Tracing command dhclient pid 3259 tid 100323 td 0xfffff801ba046000 thread_exit() at thread_exit+0x1ea/frame 0xfffffe0108569860 exit1() at exit1+0xe0f/frame 0xfffffe01085698d0 sigexit() at sigexit+0x171/frame 0xfffffe0108569d50 postsig() at postsig+0x1a5/frame 0xfffffe0108569e20 ast_sig() at ast_sig+0x33b/frame 0xfffffe0108569ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe0108569f10 ast() at ast+0x20/frame 0xfffffe0108569f30 doreti_ast() at doreti_ast+0x1c/frame 0x3e57dbb28bf0 Tracing command syslogd pid 3422 tid 100213 td 0xfffff8000535a740 --- swapped out Tracing command watchdogd pid 3439 tid 100257 td 0xfffff8005e163000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108497b10 mi_switch() at mi_switch+0x170/frame 0xfffffe0108497b30 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108497b70 _sleep() at _sleep+0x2d8/frame 0xfffffe0108497c10 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe0108497c40 vm_forkproc() at vm_forkproc+0xaa/frame 0xfffffe0108497c90 do_fork() at do_fork+0xcf8/frame 0xfffffe0108497d30 fork1() at fork1+0x70a/frame 0xfffffe0108497da0 sys_vfork() at sys_vfork+0x54/frame 0xfffffe0108497e00 amd64_syscall() at amd64_syscall+0x158/frame 0xfffffe0108497f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0108497f30 --- syscall (66, FreeBSD ELF64, vfork), rip = 0x16c827b574ab, rsp = 0x16c82720d140, rbp = 0x16c82720d200 --- Tracing command powerd pid 3554 tid 100335 td 0xfffff801ba3b7000 thread_exit() at thread_exit+0x1ea/frame 0xfffffe01085c3860 exit1() at exit1+0xe0f/frame 0xfffffe01085c38d0 sigexit() at sigexit+0x171/frame 0xfffffe01085c3d50 postsig() at postsig+0x1a5/frame 0xfffffe01085c3e20 ast_sig() at ast_sig+0x33b/frame 0xfffffe01085c3ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01085c3f10 ast() at ast+0x20/frame 0xfffffe01085c3f30 doreti_ast() at doreti_ast+0x1c/frame 0x5accc53de10 Tracing command inetd pid 3575 tid 100294 td 0xfffff80005008000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010854ba90 mi_switch() at mi_switch+0x170/frame 0xfffffe010854bab0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010854baf0 sleepq_catch_signals() at sleepq_catch_signals+0x282/frame 0xfffffe010854bb50 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010854bb60 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010854bbd0 kern_select() at kern_select+0xa29/frame 0xfffffe010854bdc0 sys_select() at sys_select+0x57/frame 0xfffffe010854be00 amd64_syscall() at amd64_syscall+0x158/frame 0xfffffe010854bf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010854bf30 --- syscall (93, FreeBSD ELF64, select), rip = 0x14b36667a83a, rsp = 0x14b3637e8438, rbp = 0x14b3637e92c0 --- Tracing command cron pid 3580 tid 100269 td 0xfffff8005335b000 --- swapped out Tracing command sshd pid 3597 tid 100260 td 0xfffff800093e4740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108500a90 mi_switch() at mi_switch+0x170/frame 0xfffffe0108500ab0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108500af0 sleepq_catch_signals() at sleepq_catch_signals+0x282/frame 0xfffffe0108500b50 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0108500b60 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0108500bd0 kern_poll_kfds() at kern_poll_kfds+0x4cc/frame 0xfffffe0108500c60 kern_poll() at kern_poll+0x9d/frame 0xfffffe0108500db0 sys_ppoll() at sys_ppoll+0x70/frame 0xfffffe0108500e00 amd64_syscall() at amd64_syscall+0x158/frame 0xfffffe0108500f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0108500f30 --- syscall (545, FreeBSD ELF64, ppoll), rip = 0x37494d20575a, rsp = 0x37493f2e4ca8, rbp = 0x37493f2e4ce0 --- Tracing command getty pid 3611 tid 100212 td 0xfffff800532ff000 thread_exit() at thread_exit+0x1ea/frame 0xfffffe0108389860 exit1() at exit1+0xe0f/frame 0xfffffe01083898d0 sigexit() at sigexit+0x171/frame 0xfffffe0108389d50 postsig() at postsig+0x1a5/frame 0xfffffe0108389e20 ast_sig() at ast_sig+0x33b/frame 0xfffffe0108389ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe0108389f10 ast() at ast+0x20/frame 0xfffffe0108389f30 doreti_ast() at doreti_ast+0x1c/frame 0x173f15302dc0 Tracing command getty pid 3612 tid 100231 td 0xfffff80006048740 thread_exit() at thread_exit+0x1ea/frame 0xfffffe0108474860 exit1() at exit1+0xe0f/frame 0xfffffe01084748d0 sigexit() at sigexit+0x171/frame 0xfffffe0108474d50 postsig() at postsig+0x1a5/frame 0xfffffe0108474e20 ast_sig() at ast_sig+0x33b/frame 0xfffffe0108474ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe0108474f10 ast() at ast+0x20/frame 0xfffffe0108474f30 doreti_ast() at doreti_ast+0x1c/frame 0x1c01afd1a1e0 Tracing command getty pid 3613 tid 100337 td 0xfffff80230f9a000 thread_exit() at thread_exit+0x1ea/frame 0xfffffe010855a860 exit1() at exit1+0xe0f/frame 0xfffffe010855a8d0 sigexit() at sigexit+0x171/frame 0xfffffe010855ad50 postsig() at postsig+0x1a5/frame 0xfffffe010855ae20 ast_sig() at ast_sig+0x33b/frame 0xfffffe010855aed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe010855af10 ast() at ast+0x20/frame 0xfffffe010855af30 doreti_ast() at doreti_ast+0x1c/frame 0x345b6958db10 Tracing command getty pid 3614 tid 100338 td 0xfffff8005e0ce000 thread_exit() at thread_exit+0x1ea/frame 0xfffffe0108587860 exit1() at exit1+0xe0f/frame 0xfffffe01085878d0 sigexit() at sigexit+0x171/frame 0xfffffe0108587d50 postsig() at postsig+0x1a5/frame 0xfffffe0108587e20 ast_sig() at ast_sig+0x33b/frame 0xfffffe0108587ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe0108587f10 ast() at ast+0x20/frame 0xfffffe0108587f30 doreti_ast() at doreti_ast+0x1c/frame 0x7e57b7a19f0 Tracing command getty pid 3615 tid 100339 td 0xfffff80053c0d000 thread_exit() at thread_exit+0x1ea/frame 0xfffffe010855f860 exit1() at exit1+0xe0f/frame 0xfffffe010855f8d0 sigexit() at sigexit+0x171/frame 0xfffffe010855fd50 postsig() at postsig+0x1a5/frame 0xfffffe010855fe20 ast_sig() at ast_sig+0x33b/frame 0xfffffe010855fed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe010855ff10 ast() at ast+0x20/frame 0xfffffe010855ff30 doreti_ast() at doreti_ast+0x1c/frame 0x3230b42c5500 Tracing command getty pid 3616 tid 100261 td 0xfffff80053e39000 thread_exit() at thread_exit+0x1ea/frame 0xfffffe01084dd860 exit1() at exit1+0xe0f/frame 0xfffffe01084dd8d0 sigexit() at sigexit+0x171/frame 0xfffffe01084ddd50 postsig() at postsig+0x1a5/frame 0xfffffe01084dde20 ast_sig() at ast_sig+0x33b/frame 0xfffffe01084dded0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01084ddf10 ast() at ast+0x20/frame 0xfffffe01084ddf30 doreti_ast() at doreti_ast+0x1c/frame 0xad047711f50 Tracing command getty pid 3618 tid 100235 td 0xfffff80053e38740 thread_exit() at thread_exit+0x1ea/frame 0xfffffe010844c860 exit1() at exit1+0xe0f/frame 0xfffffe010844c8d0 sigexit() at sigexit+0x171/frame 0xfffffe010844cd50 postsig() at postsig+0x1a5/frame 0xfffffe010844ce20 ast_sig() at ast_sig+0x33b/frame 0xfffffe010844ced0 ast_handler() at ast_handler+0xe8/frame 0xfffffe010844cf10 ast() at ast+0x20/frame 0xfffffe010844cf30 doreti_ast() at doreti_ast+0x1c/frame 0xf1279c63610 Tracing command sh pid 96121 tid 100487 td 0xfffff805295f8740 thread_exit() at thread_exit+0x1ea/frame 0xfffffe010887a860 exit1() at exit1+0xe0f/frame 0xfffffe010887a8d0 sigexit() at sigexit+0x171/frame 0xfffffe010887ad50 postsig() at postsig+0x1a5/frame 0xfffffe010887ae20 ast_sig() at ast_sig+0x33b/frame 0xfffffe010887aed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe010887af10 ast() at ast+0x20/frame 0xfffffe010887af30 doreti_ast() at doreti_ast+0x1c/frame 0x1a59d700900 Tracing command dd pid 96132 tid 100334 td 0xfffff800058ce740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01085aa7d0 mi_switch() at mi_switch+0x170/frame 0xfffffe01085aa7f0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01085aa830 _sleep() at _sleep+0x2d8/frame 0xfffffe01085aa8d0 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe01085aa900 vm_domainset_iter_page() at vm_domainset_iter_page+0xad/frame 0xfffffe01085aa930 vm_page_grab_valid() at vm_page_grab_valid+0x182/frame 0xfffffe01085aaa60 uiomove_object() at uiomove_object+0x110/frame 0xfffffe01085aaac0 tmpfs_write() at tmpfs_write+0xd7/frame 0xfffffe01085aab10 VOP_WRITE_APV() at VOP_WRITE_APV+0xc9/frame 0xfffffe01085aac20 vn_write() at vn_write+0x2e7/frame 0xfffffe01085aacb0 vn_io_fault() at vn_io_fault+0x1e5/frame 0xfffffe01085aad40 dofilewrite() at dofilewrite+0x7f/frame 0xfffffe01085aad90 sys_write() at sys_write+0xb7/frame 0xfffffe01085aae00 amd64_syscall() at amd64_syscall+0x158/frame 0xfffffe01085aaf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01085aaf30 --- syscall (4, FreeBSD ELF64, write), rip = 0xef391dd49da, rsp = 0xef39075c228, rbp = 0xef39075c260 --- Tracing command watchdogd pid 96144 tid 100333 td 0xfffff8005e0ce740 thread_exit() at thread_exit+0x1ea/frame 0xfffffe01085bed80 exit1() at exit1+0xe0f/frame 0xfffffe01085bedf0 sys_exit() at sys_exit+0xd/frame 0xfffffe01085bee00 amd64_syscall() at amd64_syscall+0x158/frame 0xfffffe01085bef30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01085bef30 --- syscall (1, FreeBSD ELF64, exit), rip = 0x3539192ae4ba, rsp = 0x3539165a0308, rbp = 0x3539165a0320 --- Tracing command sh pid 88906 tid 100251 td 0xfffff8005e46b740 thread_exit() at thread_exit+0x1ea/frame 0xfffffe01084ce860 exit1() at exit1+0xe0f/frame 0xfffffe01084ce8d0 sigexit() at sigexit+0x171/frame 0xfffffe01084ced50 postsig() at postsig+0x1a5/frame 0xfffffe01084cee20 ast_sig() at ast_sig+0x33b/frame 0xfffffe01084ceed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01084cef10 ast() at ast+0x20/frame 0xfffffe01084cef30 doreti_ast() at doreti_ast+0x1c/frame 0x1a59d700c50 db> reset (kgdb) proc 96132 (kgdb) bt #0 sched_switch (td=td@entry=0xfffff800058ce740, flags=flags@entry=0x103) at ../../../kern/sched_ule.c:2290 #1 0xffffffff80b56560 in mi_switch (flags=flags@entry=0x103) at ../../../kern/kern_synch.c:546 #2 0xffffffff80baa6f1 in sleepq_switch (wchan=0xffffffff818076c0 , pri=0x34) at ../../../kern/subr_sleepqueue.c:607 #3 0xffffffff80baa5cc in sleepq_wait (wchan=, pri=) at ../../../kern/subr_sleepqueue.c:658 #4 0xffffffff80b55aa8 in _sleep (ident=0xffffffff818076c0 , lock=0xffffffff81803680 , priority=0x234, wmesg=0xffffffff81144a78 "vmwait", sbt=0x0, pr=pr@entry=0x0, flags=0x100) at ../../../kern/kern_synch.c:221 #5 0xffffffff80f0d7b3 in vm_wait_doms (wdoms=wdoms@entry=0xfffffe01085aa950, mflags=mflags@entry=0x0) at ../../../vm/vm_page.c:3399 #6 0xffffffff80eed72d in vm_domainset_iter_page (di=di@entry=0xfffffe01085aa940, obj=obj@entry=0xfffff803d362d318, domain=domain@entry=0xfffffe01085aaa2c) at ../../../vm/vm_domainset.c:250 #7 0xffffffff80f0fc12 in vm_page_alloc_after (object=0xfffff803d362d318, pindex=0x79052d, req=0x8000, mpred=0xfffffe0015e1dab0) at ../../../vm/vm_page.c:2016 #8 vm_page_alloc (object=0xfffff803d362d318, pindex=0x79052d, req=0x10) at ../../../vm/vm_page.c:1983 #9 vm_page_grab_valid (mp=mp@entry=0xfffffe01085aaa90, object=object@entry=0xfffff803d362d318, pindex=pindex@entry=0x79052d, allocflags=allocflags@entry=0x5000) at ../../../vm/vm_page.c:4852 #10 0xffffffff80bf4f70 in uiomove_object_page (obj=0xfffff803d362d318, len=, uio=0xfffffe01085aada8) at ../../../kern/uipc_shm.c:232 #11 uiomove_object (obj=0xfffff803d362d318, obj_size=0x790600000, uio=uio@entry=0xfffffe01085aada8) at ../../../kern/uipc_shm.c:268 #12 0xffffffff80a69d57 in tmpfs_write (v=0xfffffe01085aac48) at ../../../fs/tmpfs/tmpfs_vnops.c:697 #13 0xffffffff81133599 in VOP_WRITE_APV (vop=0xffffffff818b6100 , a=a@entry=0xfffffe01085aac48) at vnode_if.c:1167 #14 0xffffffff80c61c37 in VOP_WRITE (vp=0xfffffe0170d3b000, uio=0xfffffe01085aada8, ioflag=0x7f0001, cred=) at ./vnode_if.h:595 #15 vn_write (fp=fp@entry=0xfffff80005850230, uio=uio@entry=0xfffffe01085aada8, active_cred=active_cred@entry=0xfffff8005e26e400, flags=, td=td@entry=0xfffff800058ce740) at ../../../kern/vfs_vnops.c:1193 #16 0xffffffff80c5a3a5 in vn_io_fault (fp=0xfffff80005850230, fp@entry=, uio=0xfffffe01085aada8, uio@entry=, active_cred=0xfffff8005e26e400, active_cred@entry=, flags=0x0, flags@entry=, td=, td@entry=) at ../../../kern/vfs_vnops.c:1507 #17 0xffffffff80bc414f in fo_write (fp=0xfffff80005850230, uio=0xfffffe01085aada8, active_cred=, flags=0x0, td=0xfffff800058ce740) at ../../../sys/file.h:352 #18 dofilewrite (td=td@entry=0xfffff800058ce740, fd=fd@entry=0x4, fp=0xfffff80005850230, auio=auio@entry=0xfffffe01085aada8, offset=offset@entry=0xffffffffffffffff, flags=flags@entry=0x0) at ../../../kern/sys_generic.c:562 #19 0xffffffff80bc3cd7 in kern_writev (td=0xfffff800058ce740, fd=0x4, auio=0xfffffe01085aada8) at ../../../kern/sys_generic.c:489 #20 sys_write (td=0xfffff800058ce740, uap=) at ../../../kern/sys_generic.c:404 #21 0xffffffff8106b8c8 in syscallenter (td=0xfffff800058ce740) at ../../../amd64/amd64/../../kern/subr_syscall.c:189 #22 amd64_syscall (td=0xfffff800058ce740, traced=0x0) at ../../../amd64/amd64/trap.c:1192 #23 #24 0x00000ef391dd49da in ?? () Backtrace stopped: Cannot access memory at address 0xef39075c228 (kgdb) f 5 #5 0xffffffff80f0d7b3 in vm_wait_doms (wdoms=wdoms@entry=0xfffffe01085aa950, mflags=mflags@entry=0x0) at ../../../vm/vm_page.c:3399 3399 error = msleep(&vm_pageproc_waiters, &vm_domainset_lock, (kgdb) l 3394 * race-free vm_wait_domain(). 3395 */ 3396 if (curproc == pageproc) { 3397 mtx_lock(&vm_domainset_lock); 3398 vm_pageproc_waiters++; 3399 error = msleep(&vm_pageproc_waiters, &vm_domainset_lock, 3400 PVM | PDROP | mflags, "pageprocwait", 1); 3401 } else { 3402 /* 3403 * XXX Ideally we would wait only until the allocation could (kgdb) diff --git a/sys/kern/subr_pctrie.c b/sys/kern/subr_pctrie.c index 6949e3de99bf..13014a3c18cd 100644 --- a/sys/kern/subr_pctrie.c +++ b/sys/kern/subr_pctrie.c @@ -738,42 +738,25 @@ pctrie_subtree_lookup_lt_assert(struct pctrie_node *node, uint64_t index, } #endif -/* - * Remove the specified index from the tree, and return the value stored at - * that index. If the index is not present, return NULL. - */ -uint64_t * -pctrie_remove_lookup(struct pctrie *ptree, uint64_t index, - struct pctrie_node **freenode) +static void +pctrie_remove(struct pctrie *ptree, uint64_t index, struct pctrie_node *parent, + struct pctrie_node *node, struct pctrie_node **freenode) { - struct pctrie_node *child, *node, *parent; - uint64_t *m; + struct pctrie_node *child; int slot; - *freenode = node = NULL; - child = pctrie_root_load(ptree, NULL, PCTRIE_LOCKED); - for (;;) { - if (pctrie_isleaf(child)) - break; - parent = node; - node = child; - slot = pctrie_slot(node, index); - child = pctrie_node_load(&node->pn_child[slot], NULL, - PCTRIE_LOCKED); - } - if ((m = pctrie_toval(child)) == NULL || *m != index) - return (NULL); if (node == NULL) { pctrie_root_store(ptree, PCTRIE_NULL, PCTRIE_LOCKED); - return (m); + return; } + slot = pctrie_slot(node, index); KASSERT((node->pn_popmap & (1 << slot)) != 0, ("%s: bad popmap slot %d in node %p", __func__, slot, node)); node->pn_popmap ^= 1 << slot; pctrie_node_store(&node->pn_child[slot], PCTRIE_NULL, PCTRIE_LOCKED); if (!powerof2(node->pn_popmap)) - return (m); + return; KASSERT(node->pn_popmap != 0, ("%s: bad popmap all zeroes", __func__)); slot = ffs(node->pn_popmap) - 1; child = pctrie_node_load(&node->pn_child[slot], NULL, PCTRIE_LOCKED); @@ -795,6 +778,34 @@ pctrie_remove_lookup(struct pctrie *ptree, uint64_t index, */ pctrie_node_put(node); *freenode = node; +} + +/* + * Remove the specified index from the tree, and return the value stored at + * that index. If the index is not present, return NULL. + */ +uint64_t * +pctrie_remove_lookup(struct pctrie *ptree, uint64_t index, + struct pctrie_node **freenode) +{ + struct pctrie_node *child, *node, *parent; + uint64_t *m; + int slot; + + *freenode = node = NULL; + child = pctrie_root_load(ptree, NULL, PCTRIE_LOCKED); + for (;;) { + if (pctrie_isleaf(child)) + break; + parent = node; + node = child; + slot = pctrie_slot(node, index); + child = pctrie_node_load(&node->pn_child[slot], NULL, + PCTRIE_LOCKED); + } + if ((m = pctrie_toval(child)) == NULL || *m != index) + return (NULL); + pctrie_remove(ptree, index, parent, node, freenode); return (m); } @@ -901,6 +912,138 @@ pctrie_reclaim_begin_cb(struct pctrie_node **pnode, struct pctrie *ptree, callback, keyoff, arg)); } +/* + * Find first leaf >= index, and fill iter with the path to the parent of that + * leaf. + */ +static uint64_t * +pctrie_iter_index(struct pctrie_iter *iter, struct pctrie_node *node, + uint64_t index) +{ + uint64_t *m; + int slot; + + /* Seek a node that matches index. */ + while (!pctrie_isleaf(node) && + !pctrie_keybarr(node, index, &slot)) { + iter->path[iter->top++] = node; + node = pctrie_node_load(&node->pn_child[slot], NULL, + PCTRIE_LOCKED); + } + + /* + * If no such node was found, and instead this path leads only to nodes + * < index, back up to find a subtrie with the least value > index. + */ + if (pctrie_isleaf(node) ? + (m = pctrie_toval(node)) == NULL || *m < index : + node->pn_owner < index) { + /* Climb the path to find a node with a descendant > index. */ + do { + if (iter->top == 0) + return (NULL); + node = iter->path[--iter->top]; + slot = pctrie_slot(node, index) + 1; + } while ((node->pn_popmap >> slot) == 0); + + /* Step to the least child with a descendant > index. */ + slot += ffs(node->pn_popmap >> slot) - 1; + iter->top++; + node = pctrie_node_load(&node->pn_child[slot], NULL, + PCTRIE_LOCKED); + } + /* Descend to the least leaf of the subtrie. */ + while (!pctrie_isleaf(node)) { + slot = ffs(node->pn_popmap) - 1; + iter->path[iter->top++] = node; + node = pctrie_node_load(&node->pn_child[slot], NULL, + PCTRIE_LOCKED); + } + m = pctrie_toval(node); + iter->index = *m; + return (m); +} + +/* + * Find the first leaf with value at least 'step' greater than the previous + * leaf. + */ +uint64_t * +pctrie_iter_step(struct pctrie_iter *iter, uint64_t step) +{ + struct pctrie_node *node; + uint64_t index = iter->index + step; + int slot; + + if (iter->top == 0) { + uint64_t *m; + node = pctrie_root_load(iter->ptree, NULL, PCTRIE_UNSERIALIZED); + if (!pctrie_isleaf(node)) + /* + * If there have been insertions since the last + * iteration, the root may not be a leaf; in that case, + * put the root on the path. + */ + iter->path[iter->top++] = node; + else if ((m = pctrie_toval(node)) != NULL && *m >= index) { + /* If the root is the only value in the trie and it is + * larger than the current index value, it was promoted + * to root via the removal of another, and should be + * considered as the last iteration. + */ + iter->index = *m; + return (m); + } else + return (NULL); + } + + /* Climb the path to find a node that matches a prefix of index. */ + do { + if (iter->top == 0) + return (NULL); + node = iter->path[--iter->top]; + } while (pctrie_keybarr(node, index, &slot)); + + /* Complete the search for index from node. */ + iter->top++; + node = pctrie_node_load(&node->pn_child[slot], NULL, PCTRIE_LOCKED); + return (pctrie_iter_index(iter, node, index)); +} + +/* + * Find first leaf >= index, and initialize iter with the path to the parent of + * that leaf. + */ +uint64_t * +pctrie_iter_start(struct pctrie_iter *iter, + struct pctrie *ptree, uint64_t index) +{ + struct pctrie_node *node = pctrie_root_load(ptree, NULL, PCTRIE_LOCKED); + + iter->ptree = ptree; + iter->top = 0; + return (pctrie_iter_index(iter, node, index)); +} + +/* + * Remove from the trie the leaf last chosen by the iterator, and + * adjust the path if it's last member is to be freed. + */ +void +pctrie_iter_remove(struct pctrie_iter *iter, struct pctrie_node **freenode) +{ + struct pctrie_node *node = NULL, *parent = NULL; + + if (iter->top >= 1) + node = iter->path[iter->top - 1]; + if (iter->top >= 2) + parent = iter->path[iter->top - 2]; + *freenode = NULL; + pctrie_remove(iter->ptree, iter->index, parent, node, freenode); + if (*freenode != NULL) + --iter->top; +} + /* * Replace an existing value in the trie with another one. * Panics if there is not an old value in the trie at the new value's index. diff --git a/sys/kern/subr_rangeset.c b/sys/kern/subr_rangeset.c index ddb1839531ea..7faeef45a5ff 100644 --- a/sys/kern/subr_rangeset.c +++ b/sys/kern/subr_rangeset.c @@ -272,8 +272,8 @@ rangeset_next(struct rangeset *rs, uint64_t place) int rangeset_copy(struct rangeset *dst_rs, struct rangeset *src_rs) { + struct pctrie_iter iter; struct rs_el *src_r, *dst_r; - uint64_t cursor; int error; MPASS(pctrie_is_empty(&dst_rs->rs_trie)); @@ -281,10 +281,8 @@ rangeset_copy(struct rangeset *dst_rs, struct rangeset *src_rs) MPASS(dst_rs->rs_dup_data == src_rs->rs_dup_data); error = 0; - for (cursor = 0;; cursor = src_r->re_start + 1) { - src_r = RANGESET_PCTRIE_LOOKUP_GE(&src_rs->rs_trie, cursor); - if (src_r == NULL) - break; + for (src_r = RANGESET_PCTRIE_ITER_START(&iter, &src_rs->rs_trie, 0); + src_r != NULL; src_r = RANGESET_PCTRIE_ITER_STEP(&iter, 1)) { dst_r = dst_rs->rs_dup_data(dst_rs->rs_data_ctx, src_r); if (dst_r == NULL) { error = ENOMEM; @@ -303,13 +301,11 @@ rangeset_copy(struct rangeset *dst_rs, struct rangeset *src_rs) static void rangeset_check(struct rangeset *rs) { + struct pctrie_iter iter; struct rs_el *r, *rp; - uint64_t cursor; - for (cursor = 0, rp = NULL;; cursor = r->re_start + 1, rp = r) { - r = RANGESET_PCTRIE_LOOKUP_GE(&rs->rs_trie, cursor); - if (r == NULL) - break; + for (rp = NULL, r = RANGESET_PCTRIE_ITER_START(&iter, &rs->rs_trie, 0); + r != NULL; rp = r, r = RANGESET_PCTRIE_ITER_STEP(&iter, 1)) { KASSERT(r->re_start < r->re_end, ("invalid interval rs %p elem %p (%#jx, %#jx)", rs, r, (uintmax_t)r->re_start, (uintmax_t)r->re_end)); @@ -332,9 +328,9 @@ rangeset_check(struct rangeset *rs) DB_SHOW_COMMAND(rangeset, rangeset_show_fn) { + struct pctrie_iter iter; struct rangeset *rs; struct rs_el *r; - uint64_t cursor; if (!have_addr) { db_printf("show rangeset addr\n"); @@ -343,10 +339,8 @@ DB_SHOW_COMMAND(rangeset, rangeset_show_fn) rs = (struct rangeset *)addr; db_printf("rangeset %p\n", rs); - for (cursor = 0;; cursor = r->re_start + 1) { - r = RANGESET_PCTRIE_LOOKUP_GE(&rs->rs_trie, cursor); - if (r == NULL) - break; + for (r = RANGESET_PCTRIE_ITER_START(&iter, &rs->rs_trie, 0); + r != NULL; r = RANGESET_PCTRIE_ITER_STEP(&iter, 1)) { db_printf(" el %p start %#jx end %#jx\n", r, r->re_start, r->re_end); } diff --git a/sys/sys/pctrie.h b/sys/sys/pctrie.h index d06b533a54b7..e7bf3f93586f 100644 --- a/sys/sys/pctrie.h +++ b/sys/sys/pctrie.h @@ -240,6 +240,31 @@ name##_PCTRIE_RECLAIM_CALLBACK(struct pctrie *ptree, \ } \ \ static __inline __unused struct type * \ +name##_PCTRIE_ITER_STEP(struct pctrie_iter *iter, int64_t step) \ +{ \ + return name##_PCTRIE_VAL2PTR( \ + pctrie_iter_step(iter, step)); \ +} \ + \ +static __inline __unused struct type * \ +name##_PCTRIE_ITER_START(struct pctrie_iter *iter, \ + struct pctrie *ptree, int64_t index) \ +{ \ + return name##_PCTRIE_VAL2PTR( \ + pctrie_iter_start(iter, ptree, index)); \ +} \ + \ +static __inline __unused void \ +name##_PCTRIE_ITER_REMOVE(struct pctrie_iter *iter) \ +{ \ + struct pctrie_node *freenode; \ + \ + pctrie_iter_remove(iter, &freenode); \ + if (freenode != NULL) \ + freefn(iter->ptree, freenode); \ +} \ + \ +static __inline __unused struct type * \ name##_PCTRIE_REPLACE(struct pctrie *ptree, struct type *ptr) \ { \ \ @@ -295,6 +320,12 @@ struct pctrie_node *pctrie_reclaim_begin_cb(struct pctrie_node **pnode, pctrie_cb_t callback, int keyoff, void *arg); struct pctrie_node *pctrie_reclaim_resume_cb(struct pctrie_node **pnode, pctrie_cb_t callback, int keyoff, void *arg); +struct pctrie_iter; +uint64_t *pctrie_iter_step(struct pctrie_iter *iter, uint64_t step); +uint64_t *pctrie_iter_start(struct pctrie_iter *iter, + struct pctrie *ptree, uint64_t index); +void pctrie_iter_remove(struct pctrie_iter *iter, + struct pctrie_node **freenode); uint64_t *pctrie_remove_lookup(struct pctrie *ptree, uint64_t index, struct pctrie_node **killnode); uint64_t *pctrie_replace(struct pctrie *ptree, uint64_t *newval); @@ -343,5 +374,12 @@ pctrie_is_empty(struct pctrie *ptree) #define PCTRIE_COUNT (1 << PCTRIE_WIDTH) +struct pctrie_iter { + struct pctrie_node *path[sizeof(uint64_t) * NBBY / PCTRIE_WIDTH]; + struct pctrie *ptree; + uint64_t index; + int top; +}; + #endif /* _KERNEL */ #endif /* !_SYS_PCTRIE_H_ */ diff --git a/sys/vm/swap_pager.c b/sys/vm/swap_pager.c index 9df1521858c1..68e21ff6a365 100644 --- a/sys/vm/swap_pager.c +++ b/sys/vm/swap_pager.c @@ -1776,8 +1776,8 @@ swp_pager_force_dirty(struct page_range *range, vm_page_t m, daddr_t *blk) u_long swap_pager_swapped_pages(vm_object_t object) { + struct pctrie_iter iter; struct swblk *sb; - vm_pindex_t pi; u_long res; int i; @@ -1786,9 +1786,10 @@ swap_pager_swapped_pages(vm_object_t object) if (pctrie_is_empty(&object->un_pager.swp.swp_blks)) return (0); - for (res = 0, pi = 0; (sb = SWAP_PCTRIE_LOOKUP_GE( - &object->un_pager.swp.swp_blks, pi)) != NULL; - pi = sb->p + SWAP_META_PAGES) { + res = 0; + for (sb = SWAP_PCTRIE_ITER_START(&iter, + &object->un_pager.swp.swp_blks, 0); sb != NULL; + sb = SWAP_PCTRIE_ITER_STEP(&iter, SWAP_META_PAGES)) { for (i = 0; i < SWAP_META_PAGES; i++) { if (sb->d[i] != SWAPBLK_NONE) res++; @@ -1806,6 +1807,7 @@ swap_pager_swapped_pages(vm_object_t object) static void swap_pager_swapoff_object(struct swdevt *sp, vm_object_t object) { + struct pctrie_iter iter; struct page_range range; struct swblk *sb; vm_page_t m; @@ -1822,29 +1824,28 @@ swap_pager_swapoff_object(struct swdevt *sp, vm_object_t object) i = 0; swp_pager_init_freerange(&range); for (;;) { - if (i == 0 && (object->flags & OBJ_DEAD) != 0) { - /* - * Make sure that pending writes finish before - * returning. - */ - vm_object_pip_wait(object, "swpoff"); - swp_pager_meta_free_all(object); - break; - } - - if (i == SWAP_META_PAGES) { + if (i == 0) { + if ((object->flags & OBJ_DEAD) != 0) { + /* + * Make sure that pending writes finish before + * returning. + */ + vm_object_pip_wait(object, "swpoff"); + swp_pager_meta_free_all(object); + break; + } + sb = SWAP_PCTRIE_ITER_START(&iter, + &object->un_pager.swp.swp_blks, pi); + } else if (i == SWAP_META_PAGES) { pi = sb->p + SWAP_META_PAGES; if (sb_empty) { - SWAP_PCTRIE_REMOVE( - &object->un_pager.swp.swp_blks, sb->p); + SWAP_PCTRIE_ITER_REMOVE(&iter); uma_zfree(swblk_zone, sb); } + sb = SWAP_PCTRIE_ITER_STEP(&iter, SWAP_META_PAGES); i = 0; } - if (i == 0) { - sb = SWAP_PCTRIE_LOOKUP_GE( - &object->un_pager.swp.swp_blks, pi); if (sb == NULL) break; sb_empty = true; @@ -2152,6 +2153,7 @@ static void swp_pager_meta_transfer(vm_object_t srcobject, vm_object_t dstobject, vm_pindex_t pindex, vm_pindex_t count, vm_size_t *moved) { + struct pctrie_iter iter; struct page_range range; struct swblk *sb; daddr_t blk; @@ -2159,6 +2161,7 @@ swp_pager_meta_transfer(vm_object_t srcobject, vm_object_t dstobject, vm_pindex_t offset, last; vm_size_t mc; int i, limit, start; + bool lock_held; VM_OBJECT_ASSERT_WLOCKED(srcobject); MPASS(moved == NULL || dstobject == NULL); @@ -2171,14 +2174,13 @@ swp_pager_meta_transfer(vm_object_t srcobject, vm_object_t dstobject, swp_pager_init_freerange(&range); offset = pindex; last = pindex + count; - for (;;) { - sb = SWAP_PCTRIE_LOOKUP_GE(&srcobject->un_pager.swp.swp_blks, - rounddown(pindex, SWAP_META_PAGES)); - if (sb == NULL || sb->p >= last) - break; + sb = SWAP_PCTRIE_ITER_START(&iter, &srcobject->un_pager.swp.swp_blks, + rounddown(pindex, SWAP_META_PAGES)); + while (sb != NULL && sb->p < last) { start = pindex > sb->p ? pindex - sb->p : 0; limit = last - sb->p < SWAP_META_PAGES ? last - sb->p : SWAP_META_PAGES; + lock_held = true; for (i = start; i < limit; i++) { blk = sb->d[i]; if (blk == SWAPBLK_NONE) @@ -2199,6 +2201,7 @@ swp_pager_meta_transfer(vm_object_t srcobject, vm_object_t dstobject, swp_pager_meta_build(dstobject, sb->p + i - offset, blk, false); VM_OBJECT_WLOCK(srcobject); + lock_held = false; } if (moved != NULL) { if (m != NULL && m->pindex != pindex + i - 1) @@ -2210,13 +2213,17 @@ swp_pager_meta_transfer(vm_object_t srcobject, vm_object_t dstobject, } sb->d[i] = SWAPBLK_NONE; } + if (!lock_held) { + sb = SWAP_PCTRIE_ITER_START(&iter, + &srcobject->un_pager.swp.swp_blks, sb->p); + } pindex = sb->p + SWAP_META_PAGES; if (swp_pager_swblk_empty(sb, 0, start) && swp_pager_swblk_empty(sb, limit, SWAP_META_PAGES)) { - SWAP_PCTRIE_REMOVE(&srcobject->un_pager.swp.swp_blks, - sb->p); + SWAP_PCTRIE_ITER_REMOVE(&iter); uma_zfree(swblk_zone, sb); } + sb = SWAP_PCTRIE_ITER_STEP(&iter, SWAP_META_PAGES); } swp_pager_freeswapspace(&range); out: @@ -2314,6 +2321,7 @@ swp_pager_meta_lookup(vm_object_t object, vm_pindex_t pindex) vm_pindex_t swap_pager_find_least(vm_object_t object, vm_pindex_t pindex) { + struct pctrie_iter iter; struct swblk *sb; int i; @@ -2322,7 +2330,7 @@ swap_pager_find_least(vm_object_t object, vm_pindex_t pindex) if (pctrie_is_empty(&object->un_pager.swp.swp_blks)) return (object->size); - sb = SWAP_PCTRIE_LOOKUP_GE(&object->un_pager.swp.swp_blks, + sb = SWAP_PCTRIE_ITER_START(&iter, &object->un_pager.swp.swp_blks, rounddown(pindex, SWAP_META_PAGES)); if (sb == NULL) return (object->size); @@ -2331,8 +2339,7 @@ swap_pager_find_least(vm_object_t object, vm_pindex_t pindex) if (sb->d[i] != SWAPBLK_NONE) return (sb->p + i); } - sb = SWAP_PCTRIE_LOOKUP_GE(&object->un_pager.swp.swp_blks, - roundup(pindex, SWAP_META_PAGES)); + sb = SWAP_PCTRIE_ITER_STEP(&iter, SWAP_META_PAGES); if (sb == NULL) return (object->size); } @@ -2776,6 +2783,8 @@ SYSCTL_NODE(_vm, OID_AUTO, swap_info, CTLFLAG_RD | CTLFLAG_MPSAFE, long vmspace_swap_count(struct vmspace *vmspace) { + struct pctrie_iter iter; + struct pctrie *ptree; vm_map_t map; vm_map_entry_t cur; vm_object_t object; @@ -2796,13 +2805,12 @@ vmspace_swap_count(struct vmspace *vmspace) VM_OBJECT_RLOCK(object); if ((object->flags & OBJ_SWAP) == 0) goto unlock; + ptree = &object->un_pager.swp.swp_blks; pi = OFF_TO_IDX(cur->offset); e = pi + OFF_TO_IDX(cur->end - cur->start); - for (;; pi = sb->p + SWAP_META_PAGES) { - sb = SWAP_PCTRIE_LOOKUP_GE( - &object->un_pager.swp.swp_blks, pi); - if (sb == NULL || sb->p >= e) - break; + for (sb = SWAP_PCTRIE_ITER_START(&iter, ptree, pi); + sb != NULL && sb->p < e; + sb = SWAP_PCTRIE_ITER_STEP(&iter, SWAP_META_PAGES)) { for (i = 0; i < SWAP_META_PAGES; i++) { if (sb->p + i < e && sb->d[i] != SWAPBLK_NONE) -- Test scenario: src/tools/test/stress2/misc/tmpfs19.sh