KDB: enter: watchdog timeout (after one hour), vmcore.837 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2024 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 15.0-CURRENT #2 main-n271204-7773023b72de1-dirty: Mon Jul 15 10:26:04 CEST 2024 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 18.1.6 (https://github.com/llvm/llvm-project.git llvmorg-18.1.6-0-g1118c2e05e67) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.08-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33171079168 (31634 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 7 9 3 10 2 8 5 4 11 6 random: entropy device external interface kbd1 at kbdmux0 vtvga0: smbios0: at iomem 0xf05e0-0xf05fe smbios0: Version: 3.0, BCD Revision: 3.0 aesni0: acpi0: <> acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb416000-0xfb4167ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb412000-0xfb4123ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: EEPROM V1.63-0 eTrack 0x800009fa igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: Using 6 RX queues 6 TX queues igb0: Using MSI-X interrupts with 7 vectors igb0: Ethernet address: 0c:c4:7a:a8:cd:da igb0: netmap queues/slots: TX 6/1024, RX 6/1024 igb1: port 0xd000-0xd01f mem 0xfb300000-0xfb31ffff,0xfb340000-0xfb343fff irq 17 at device 0.1 on pci8 igb1: EEPROM V1.63-0 eTrack 0x800009fa igb1: Using 1024 TX descriptors and 1024 RX descriptors igb1: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb1: Using 6 RX queues 6 TX queues igb1: Using MSI-X interrupts with 7 vectors igb1: Ethernet address: 0c:c4:7a:a8:cd:db igb1: netmap queues/slots: TX 6/1024, RX 6/1024 ehci1: mem 0xfb411000-0xfb4113ff irq 18 at device 29.0 on pci1 usbus2: EHCI version 1.0 usbus2 on ehci1 usbus2: 480Mbps High Speed USB v2.0 isab0: at device 31.0 on pci1 isa0: on isab0 ahci1: port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf000-0xf01f mem 0xfb410000-0xfb4107ff irq 16 at device 31.2 on pci1 ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich4: at channel 0 on ahci1 ahcich5: at channel 1 on ahci1 ahcich6: at channel 2 on ahci1 ahcich7: at channel 3 on ahci1 ahcich8: at channel 4 on ahci1 ahcich9: at channel 5 on ahci1 ahciem1: on ahci1 acpi_button0: on acpi0 apei0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 uart1: console (115200,n,8,1) orm0: at iomem 0xc0000-0xc7fff,0xcb000-0xcbfff pnpid ORM0000 on isa0 est0: on cpu0 NULL mp in getnewvnode(9), tag crossmp Timecounter "TSC-low" frequency 1749998348 Hz quality 1000 Timecounters tick every 1.000 msec Expensive callout(9) function: 0xffffffff804e07a0(0xfffffe010a7d1000) 0.012294522 s ada0 at ahcich1 bus 0 scbus1 target 0 lun 0 ada0: ACS-2 ATA SATA 3.x device ada0: Serial Number WD-WCC3F3KDDP98 ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 953869MB (1953525168 512 byte sectors) ada0: quirks=0x1<4K> ses0 at ahciem0 bus 0 scbus4 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device ses1 at ahciem1 bus 0 scbus11 target 0 lun 0 ses1: SEMB S-E-S 2.00 device ses1: SEMB SES Device ses0: ada0,pass0 in 'Slot 01', SATA Slot: scbus1 target 0 mlx5_core0: mem 0xf8000000-0xf9ffffff irq 32 at device 0.0 on pci3 mlx5: Mellanox Core driver 3.7.1 (November 2021)ugen1.1: at usbus1 ugen0.1: at usbus0 uhub0 on usbus1 uhub0: on usbus1 uhub1 on usbus0 uhub1: on usbus0 ugen2.1: at usbus2 uhub2 on usbus2 uhub2: on usbus2 mlx5_core0: WARN: mlx5_vsc_set_space:125:(pid 0): Space 0x7 is not supported. mlx5_core0: WARN: mlx5_fwdump_prep:99:(pid 0): VSC scan space is not supported mlx5_core0: INFO: init_one:1713:(pid 0): cannot find SR-IOV PCIe cap mlx5_core: INFO: (mlx5_core0): E-Switch: Total vports 1, l2 table size(65536), per vport: max uc(1024) max mc(16384) mlx5_core0: Failed to initialize SR-IOV support, erroSetting hostuuid: 00000000-0000-0000-0000-002590c99976. Setting hostid: 0x90b83241. Starting file system checks: WARNING: / was not properly dismounted Mounting local filesystems:. Autoloading module: acpi_wmi Autoloading module: ichsmb Autoloading module: ioat ioat0: mem 0x383ffff1c000-0x383ffff1ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0x383ffff18000-0x383ffff1bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0x383ffff14000-0x383ffff17fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0x383ffff10000-0x383ffff13fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0x383ffff0c000-0x383ffff0ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0x383ffff08000-0x383ffff0bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0x383ffff04000-0x383ffff07fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0x383ffff00000-0x383ffff03fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 ichsmb0: port 0x580-0x59f mem 0x383ffff21000-0x383ffff210ff irq 18 at device 31.3 on pci1 smbus0: on ichsmb0 acpi_wmi0: on acpi0 acpi_wmi0: cannot find EC device fsck2+ fsck -fy /tmp ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 1169 files, 64989 used, 1200418 free (122 frags, 150037 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** + set +x Updating CPU Microcode... CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.00-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics Done. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/e2fsprogs /usr/local/lib/perl5/5.36/mach/CORE 32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32/compat Setting hostname: mercat1.netperf.freebsd.org. Setting up harvesting: PURE_RDRAND,[CALLOUT],[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . igb0: link state changed to UP debugnet_any_ifnet_update: Bad dn_init result from igb0 (ifp 0xfffff80172964000), ignoring. lo0: link state changed to UP Autoloading module: mlx5 Autoloading module: mlx5 Starting Network: igb1. igb1: flags=8802 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Starting Network: mce0. mce0: flags=8802 metric 0 mtu 1500 options=7eef07bb ether 7c:fe:90:30:ee:38 media: Ethernet autoselect status: no carrier nd6 options=29 Starting Network: mce1. mce1: flags=8802 metric 0 mtu 1500 options=7eef07bb ether 7c:fe:90:30:ee:39 media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid Autoloading module: ums Autoloading module: usbhid ums0 on uhub3 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192.168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. route: message indicates error: File exists add host 127.0.0.1: gateway lo0 fib 0: route already in table route: message indicates error: File exists add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. No core dumps found. Starting watchdogd. Setting date via ntp. 15 Jul 10:31:11 ntpdate[3464]: step time server 192.168.5.1 offset -0.997054 sec Clearing /tmp (X related). Recovering vi editor sessions:. Updating motd:. Updating /var/run/os-release done. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Mounting late filesystems:. Starting powerd. Starting inetd. Starting cron. Performing sanity check on sshd configuration. Starting sshd. Mon Jul 15 10:31 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: Jul 15 10:32:24 mercat1 su[3651]: pho to root on /dev/pts/0 20240715 10:33:17 all (1/39): buildworld2.sh 20240715 10:33:20 all (2/39): crossmp4.sh stress2: pts leak: 1/2 20240715 10:41:27 all (3/39): crossmp5.sh stress2: newblk leak: 982/986. 20240715 10:46:30 all (4/39): crossmp8.sh 20240715 10:47:40 all (5/39): holdcnt0.sh 20240715 10:47:43 all (6/39): holdcnt02.sh 20240715 10:47:46 all (7/39): holdcnt03.sh 20240715 10:47:49 all (8/39): holdcnt05.sh 20240715 10:47:52 all (9/39): mapwrite.sh 20240715 10:48:53 all (10/39): marcus5.sh witness_lock_list_get: witness exhausted 20240715 11:07:21 all (11/39): marcus6.sh 20240715 11:12:30 all (12/39): marcus7.sh 20240715 11:24:53 all (13/39): md7.sh Jul 15 11:28:27 mercat1 kernel: pid 53896 (rw), uid 0 inumber 39486 on /mnt: filesystem full Jul 15 11:31:36 mercat1 kernel: pid 66683 (rw), uid 0 inumber 127131 on /mnt: filesystem full Jul 15 11:31:46 mercat1 kernel: pid 66717 (rw), uid 0 inumber 89963 on /mnt: filesystem full Jul 15 11:32:51 mercat1 kernel: pid 66713 (rw), uid 0 inumber 111489 on /mnt: filesystem full Jul 15 11:33:27 mercat1 kernel: pid 90486 (rw), uid 0 inumber 163454 on /mnt: filesystem full Jul 15 11:33:57 mercat1 kernel: pid 90498 (rw), uid 0 inumber 146973 on /mnt: filesystem full Jul 15 11:34:23 mercat1 kernel: pid 90541 (mkfifo), uid 0 inumber 134784 on /mnt: out of inodes Jul 15 11:34:39 mercat1 kernel: pid 90503 (rw), uid 0 inumber 167050 on /mnt: filesystem full 20240715 11:35:13 all (14/39): mincore.sh 20240715 11:40:54 all (15/39): mmap40.sh 20240715 11:47:08 all (16/39): oom.sh 20240715 11:47:11 all (17/39): oovm.sh stress2: pts leak: 1/3 20240715 11:58:07 all (18/39): oovm2.sh 20240715 12:08:43 all (19/39): pfl.sh 20240715 12:11:19 all (20/39): pfl2.sh Jul 15 12:16:13 mercat1 kernel: pid 81419 (mkdir), uid 2007 inumber 161517 on /mnt10: filesystem full Jul 15 12:16:33 mercat1 kernel: pid 82442 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page Jul 15 12:16:43 mercat1 kernel: pid 81309 (rw), uid 2007 inumber 140449 on /mnt10: filesystem full Jul 15 12:16:59 mercat1 kernel: pid 81323 (rw), uid 2007 inumber 16120 on /mnt10: filesystem full Jul 15 12:17:02 mercat1 kernel: pid 81339 (link), uid 2007 inumber 131538 on /mnt10: filesystem full Jul 15 12:17:31 mercat1 kernel: pid 82476 (creat), uid 2007 inumber 15 on /mnt11: filesystem full Jul 15 12:17:51 mercat1 kernel: pid 84953 (rw), uid 2007 inumber 73761 on /mnt10: filesystem full Jul 15 12:20:01 mercat1 kernel: pid 91455 (rw), uid 2007 inumber 108751 on /mnt10: filesystem full 20240715 12:21:59 all (21/39): pthread5.sh 20240715 12:22:37 all (22/39): sort.sh 20240715 12:25:50 all (23/39): sort2.sh Jul 15 12:27:18 mercat1 kernel: pid 65155 (sort), jid 0, uid 0, was killed: a thread waited too long to allocate a page 20240715 12:30:59 all (24/39): stealer.sh swp_pager_getswapspace(8): failed Jul 15 12:31:51 mercat1 kernel: pid 35802 (stealer), jid 0, uid 2007, was killed: a thread waited too long to allocate a page swap_pager: out of swap space swp_pager_getswapspace(6): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(13): failed swp_pager_getswapspace(27): failed swp_pager_getswapspace(16): failed swp_pager_getswapspace(12): failed swp_pager_getswapspace(17): failed Jul 15 12:33:03 mercat1 kernel: pid 35804 (stealer), jid 0, uid 2007, was killed: a thread waited too long to allocate a page Jul 15 12:33:03 mercat1 kernel: pid 35839 (stealer), jid 0, uid 2007, was killed: failed to reclaim memory Jul 15 12:33:03 mercat1 kernel: pid 35833 (stealer), jid 0, uid 2007, was killed: failed to reclaim memory swap_pager: out of swap space swp_pager_getswapspace(15): failed Jul 15 12:33:07 mercat1 kernel: pid 35921 (stealer), jid 0, uid 2007, was killed: failed to reclaim memory swp_pager_getswapspace(27): failed 20240715 12:36:08 all (25/39): swap3.sh 20240715 12:41:17 all (26/39): swap4.sh Jul 15 12:41:36 mercat1 kernel: pid 51462 (swap4), jid 0, uid 0, was killed: failed to reclaim memory Jul 15 12:41:37 mercat1 kernel: pid 51454 (swap4), jid 0, uid 0, was killed: failed to reclaim memory Jul 15 12:41:38 mercat1 kernel: pid 51458 (swap4), jid 0, uid 0, was killed: failed to reclaim memory Jul 15 12:41:47 mercat1 kernel: pid 51459 (swap4), jid 0, uid 0, was killed: failed to reclaim memory Jul 15 12:41:47 mercat1 kernel: pid 51461 (swap4), jid 0, uid 0, was killed: failed to reclaim memory Jul 15 12:41:47 mercat1 kernel: pid 3276 (devd), jid 0, uid 0, was killed: failed to reclaim memory 20240715 12:41:48 all (27/39): swap5.sh 20240715 12:51:10 all (28/39): swap6.sh 20240715 12:52:16 all (29/39): swap7.sh 20240715 13:04:53 all (30/39): swapoff.sh Jul 15 13:06:10 mercat1 kernel: pid 65228 (swap), jid 0, uid 2007, was killed: a thread waited too long to allocate a page Jul 15 13:07:59 mercat1 kernel: pid 71647 (rw), uid 2007 inumber 130321 on /mnt: filesystem full 20240715 13:08:05 all (31/39): swapoff4.sh Jul 15 13:08:52 mercat1 kernel: pid 77218 (swap), jid 0, uid 0, was killed: failed to reclaim memory 20240715 13:12:14 all (32/39): swapoff6.sh swp_pager_getswapspace(1): failed swp_pager_getswapspace(1): failed swp_pager_getswapspace(14): failed Jul 15 13:14:59 mercat1 kernel: pid 98701 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 15 13:14:59 mercat1 kernel: pid 98697 (sort), jid 0, uid 0, was killed: failed to reclaim memory swp_pager_getswapspace(14): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(3): failed swp_pager_getswapspace(1): failed swp_pager_getswapspace(7): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(9): failed swp_pager_getswapspace(1): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(1): failed swp_pager_getswapspace(17): failed swp_pager_getswapspace(23): failed swp_pager_getswapspace(10): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed Jul 15 13:15:07 mercat1 kernel: pid 98709 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 15 13:15:08 mercat1 kernel: pid 98705 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 15 13:15:09 mercat1 kernel: pid 5592 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 15 13:15:11 mercat1 kernel: pid 7030 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 15 13:15:12 mercat1 kernel: pid 3652 (bash), jid 0, uid 0, was killed: failed to reclaim memory Jul 15 13:15:14 mercat1 kernel: pid 3539 (ntpd), jid 0, uid 123, was killed: failed to reclaim memory swp_pager_getswapspace(4): failed swp_pager_getswapspace(1): failed swp_pager_getswapspace(1): failed swp_pager_getswapspace(1): failed swp_pager_getswapspace(11): failed Jul 15 13:15:40 mercat1 kernel: pid 12109 (sort), jid 0, uid 0, was killed: failed to reclaim memory swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed swp_pager_getswapspace(32): failed Jul 15 13:15:45 mercat1 kernel: pid 13489 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 15 13:15:46 mercat1 kernel: pid 14724 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 15 13:15:47 mercat1 kernel: pid 15784 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 15 13:15:49 mercat1 kernel: pid 18869 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 15 13:15:50 mercat1 kernel: pid 10623 (sh), jid 0, uid 2006, was killed: failed to reclaim memory Jul 15 13:15:51 mercat1 kernel: pid 80215 (sh), jid 0, uid 2006, was killed: failed to reclaim memory Jul 15 13:15:53 mercat1 kernel: pid 3628 (sh), jid 0, uid 2006, was killed: failed to reclaim memory swp_pager_getswapspace(9): failed swp_pager_getswapspace(32): failed Jul 15 13:16:23 mercat1 kernel: pid 23047 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 15 13:16:23 mercat1 kernel: pid 23051 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 15 13:16:23 mercat1 kernel: pid 23057 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 15 13:16:23 mercat1 kernel: pid 23061 (sort), jid 0, uid 0, was killed: failed to reclaim memory Jul 15 13:16:23 mercat1 kernel: pid 4558 (awk), jid 0, uid 0, was killed: failed to reclaim memory Jul 15 13:16:23 mercat1 kernel: pid 92169 (sh), jid 0, uid 0, was killed: failed to reclaim memory Jul 15 13:16:23 mercat1 kernel: pid 29763 (swapoff), jid 0, uid 0, was killed: failed to reclaim memory 20240715 13:16:24 all (33/39): swappedout.sh 20240715 13:18:32 all (34/39): tmpfs.sh stress2: pts leak: 1/2 20240715 13:28:56 all (35/39): tmpfs13.sh 20240715 13:31:03 all (36/39): tmpfs19.sh KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe010802dbc0 hardclock() at hardclock+0x103/frame 0xfffffe010802dc00 handleevents() at handleevents+0xaf/frame 0xfffffe010802dc40 timercb() at timercb+0x18e/frame 0xfffffe010802dc90 lapic_handle_timer() at lapic_handle_timer+0xab/frame 0xfffffe010802dcb0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe010802dcb0 --- interrupt, rip = 0xffffffff804c63de, rsp = 0xfffffe010802dd80, rbp = 0xfffffe010802ddb0 --- acpi_cpu_idle() at acpi_cpu_idle+0x27e/frame 0xfffffe010802ddb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe010802ddd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe010802ddf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe010802def0 fork_exit() at fork_exit+0x82/frame 0xfffffe010802df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010802df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- KDB: enter: watchdog timeout [ thread pid 11 tid 100010 ] Stopped at kdb_enter+0x33: movq $0,0x10551f2(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> dump Dumping 1999 out of 32620 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:1:pho1> bt Tracing pid 11 tid 100010 td 0xfffff80003bd9000 kdb_enter() at kdb_enter+0x33/frame 0xfffffe010802dc00 handleevents() at handleevents+0xaf/frame 0xfffffe010802dc40 timercb() at timercb+0x18e/frame 0xfffffe010802dc90 lapic_handle_timer() at lapic_handle_timer+0xab/frame 0xfffffe010802dcb0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe010802dcb0 --- interrupt, rip = 0xffffffff804c63de, rsp = 0xfffffe010802dd80, rbp = 0xfffffe010802ddb0 --- acpi_cpu_idle() at acpi_cpu_idle+0x27e/frame 0xfffffe010802ddb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe010802ddd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe010802ddf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe010802def0 fork_exit() at fork_exit+0x82/frame 0xfffffe010802df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010802df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:1:pho1> show allpcpu Current CPU: 7 cpuid = 0 dynamic pcpu = 0x9f9e40 curthread = 0xfffff80003bee740: pid 11 tid 100003 critnest 1 "idle: cpu0" curpcb = 0xfffff80003beec60 fpcurthread = none idlethread = 0xfffff80003bee740: tid 100003 "idle: cpu0" self = 0xffffffff82410000 curpmap = 0xffffffff81b97df0 tssp = 0xffffffff82410384 rsp0 = 0xfffffe0108015000 kcr3 = 0x800000000238b003 ucr3 = 0xffffffffffffffff scr3 = 0x3f4cb0981 gs32p = 0xffffffff82410404 ldt = 0xffffffff82410444 tss = 0xffffffff82410434 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bb4b5e40 curthread = 0xfffff80003bee000: pid 11 tid 100004 critnest 1 "idle: cpu1" curpcb = 0xfffff80003bee520 fpcurthread = none idlethread = 0xfffff80003bee000: tid 100004 "idle: cpu1" self = 0xffffffff82411000 curpmap = 0xffffffff81b97df0 tssp = 0xffffffff82411384 rsp0 = 0xfffffe0108010000 kcr3 = 0x800000000238b002 ucr3 = 0xffffffffffffffff scr3 = 0x256a6488a gs32p = 0xffffffff82411404 ldt = 0xffffffff82411444 tss = 0xffffffff82411434 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bb4c4e40 curthread = 0xfffff80003bef740: pid 11 tid 100005 critnest 1 "idle: cpu2" curpcb = 0xfffff80003befc60 fpcurthread = none idlethread = 0xfffff80003bef740: tid 100005 "idle: cpu2" self = 0xffffffff82412000 curpmap = 0xffffffff81b97df0 tssp = 0xffffffff82412384 rsp0 = 0xfffffe010801f000 kcr3 = 0x800000000238b003 ucr3 = 0xffffffffffffffff scr3 = 0x5315f29cf gs32p = 0xffffffff82412404 ldt = 0xffffffff82412444 tss = 0xffffffff82412434 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bb4d3e40 curthread = 0xfffff80003bef000: pid 11 tid 100006 critnest 1 "idle: cpu3" curpcb = 0xfffff80003bef520 fpcurthread = none idlethread = 0xfffff80003bef000: tid 100006 "idle: cpu3" self = 0xffffffff82413000 curpmap = 0xffffffff81b97df0 tssp = 0xffffffff82413384 rsp0 = 0xfffffe010801a000 kcr3 = 0x800000000238b089 ucr3 = 0xffffffffffffffff scr3 = 0x1fd44cd6e gs32p = 0xffffffff82413404 ldt = 0xffffffff82413444 tss = 0xffffffff82413434 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bb4e2e40 curthread = 0xfffff80003bf0740: pid 11 tid 100007 critnest 1 "idle: cpu4" curpcb = 0xfffff80003bf0c60 fpcurthread = none idlethread = 0xfffff80003bf0740: tid 100007 "idle: cpu4" self = 0xffffffff82414000 curpmap = 0xffffffff81b97df0 tssp = 0xffffffff82414384 rsp0 = 0xfffffe0108029000 kcr3 = 0x800000000238b005 ucr3 = 0xffffffffffffffff scr3 = 0x45602ca35 gs32p = 0xffffffff82414404 ldt = 0xffffffff82414444 tss = 0xffffffff82414434 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bb4f1e40 curthread = 0xfffff80003bf0000: pid 11 tid 100008 critnest 1 "idle: cpu5" curpcb = 0xfffff80003bf0520 fpcurthread = none idlethread = 0xfffff80003bf0000: tid 100008 "idle: cpu5" self = 0xffffffff82415000 curpmap = 0xffffffff81b97df0 tssp = 0xffffffff82415384 rsp0 = 0xfffffe0108024000 kcr3 = 0x800000000238b072 ucr3 = 0xffffffffffffffff scr3 = 0x3f4c90b2c gs32p = 0xffffffff82415404 ldt = 0xffffffff82415444 tss = 0xffffffff82415434 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bb500e40 curthread = 0xfffff80003bd9740: pid 11 tid 100009 critnest 1 "idle: cpu6" curpcb = 0xfffff80003bd9c60 fpcurthread = none idlethread = 0xfffff80003bd9740: tid 100009 "idle: cpu6" self = 0xffffffff82416000 curpmap = 0xffffffff81b97df0 tssp = 0xffffffff82416384 rsp0 = 0xfffffe0108033000 kcr3 = 0x800000000238b130 ucr3 = 0xffffffffffffffff scr3 = 0x531679d4f gs32p = 0xffffffff82416404 ldt = 0xffffffff82416444 tss = 0xffffffff82416434 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bb50fe40 curthread = 0xfffff80003bd9000: pid 11 tid 100010 critnest 2 "idle: cpu7" curpcb = 0xfffff80003bd9520 fpcurthread = none idlethread = 0xfffff80003bd9000: tid 100010 "idle: cpu7" self = 0xffffffff82417000 curpmap = 0xffffffff81b97df0 tssp = 0xffffffff82417384 rsp0 = 0xfffffe010802e000 kcr3 = 0x800000000238b063 ucr3 = 0xffffffffffffffff scr3 = 0x12c26b50 gs32p = 0xffffffff82417404 ldt = 0xffffffff82417444 tss = 0xffffffff82417434 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bb51ee40 curthread = 0xfffff80003bda740: pid 11 tid 100011 critnest 1 "idle: cpu8" curpcb = 0xfffff80003bdac60 fpcurthread = none idlethread = 0xfffff80003bda740: tid 100011 "idle: cpu8" self = 0xffffffff82418000 curpmap = 0xffffffff81b97df0 tssp = 0xffffffff82418384 rsp0 = 0xfffffe010803d000 kcr3 = 0x800000000238b004 ucr3 = 0xffffffffffffffff scr3 = 0x790bfa96c gs32p = 0xffffffff82418404 ldt = 0xffffffff82418444 tss = 0xffffffff82418434 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bb52de40 curthread = 0xfffff80003bda000: pid 11 tid 100012 critnest 1 "idle: cpu9" curpcb = 0xfffff80003bda520 fpcurthread = none idlethread = 0xfffff80003bda000: tid 100012 "idle: cpu9" self = 0xffffffff82419000 curpmap = 0xffffffff81b97df0 tssp = 0xffffffff82419384 rsp0 = 0xfffffe0108038000 kcr3 = 0x800000000238b002 ucr3 = 0xffffffffffffffff scr3 = 0x1c9eb2a0c gs32p = 0xffffffff82419404 ldt = 0xffffffff82419444 tss = 0xffffffff82419434 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bb53ce40 curthread = 0xfffff80003bdb740: pid 11 tid 100013 critnest 1 "idle: cpu10" curpcb = 0xfffff80003bdbc60 fpcurthread = none idlethread = 0xfffff80003bdb740: tid 100013 "idle: cpu10" self = 0xffffffff8241a000 curpmap = 0xffffffff81b97df0 tssp = 0xffffffff8241a384 rsp0 = 0xfffffe0108047000 kcr3 = 0x800000000238b006 ucr3 = 0xffffffffffffffff scr3 = 0x12cf71937 gs32p = 0xffffffff8241a404 ldt = 0xffffffff8241a444 tss = 0xffffffff8241a434 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bb54be40 curthread = 0xfffff80003bdb000: pid 11 tid 100014 critnest 1 "idle: cpu11" curpcb = 0xfffff80003bdb520 fpcurthread = none idlethread = 0xfffff80003bdb000: tid 100014 "idle: cpu11" self = 0xffffffff8241b000 curpmap = 0xffffffff81b97df0 tssp = 0xffffffff8241b384 rsp0 = 0xfffffe0108042000 kcr3 = 0x800000000238b002 ucr3 = 0xffffffffffffffff scr3 = 0x8348ac81b gs32p = 0xffffffff8241b404 ldt = 0xffffffff8241b444 tss = 0xffffffff8241b434 curvnet = 0 spin locks held: db:1:pho1> show alllocks db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffffe0174d28e10: type VREG state VSTATE_CONSTRUCTED op 0xffffffff818b6a60 usecount 1, writecount 1, refcount 1 seqc users 0 hold count flags () flags (VIRF_TEXT_REF) v_object 0xfffff805f338a000 ref 1 pages 7699046 cleanbuf 0 dirtybuf 0 lock type tmpfs: EXCL by thread 0xfffff8033275b000 (pid 55577, dd, tid 120853) #0 0xffffffff80b1e33c at lockmgr_xlock+0x9c #1 0xffffffff8114118a at VOP_LOCK1_APV+0x3a #2 0xffffffff80c656d3 at _vn_lock+0x53 #3 0xffffffff80c6b118 at vn_write+0x1d8 #4 0xffffffff80c63995 at vn_io_fault+0x1e5 #5 0xffffffff80bcd5ff at dofilewrite+0x7f #6 0xffffffff80bcd187 at sys_write+0xb7 #7 0xffffffff81077918 at amd64_syscall+0x158 #8 0xffffffff81049bab at fast_syscall_common+0xf8 tag VT_TMPFS, tmpfs_node 0xfffff806368aaae0, flags 0x0, links 1 mode 0644, owner 0, group 0, size 31535923200, status 0x3 db:1:pho1> show mount 0xfffffe010ec0f700 /dev/gpt/work on / (ufs) 0xfffffe010ec10280 devfs on /dev (devfs) 0xfffffe015afb3280 /dev/gpt/tmp on /tmp (ufs) 0xfffffe016915c000 tmpfs on /mnt (tmpfs) More info: show mount db:1:pho1> show bufqueues bqempty: 88629 Buf domain 0 freebufs 14042 lofreebufs 219 hifreebufs 329 bufspace 31399936 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 971 (28381184) dirtyq count 0 (0) wakeup 0 lim 25 CPU 16, 22, 0, 3, 9, 14, 3, 10, 9, 4, 10, 20, Locked buffers: 0 space 0 Total buffers: 5253 space 31399936 Buf domain 1 freebufs 7944 lofreebufs 219 hifreebufs 329 bufspace 235425792 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 7103 (232751104) dirtyq count 0 (0) wakeup 0 lim 25 CPU 1, 1, 9, 2, 5, 11, 19, 12, 8, 0, 14, 4, Locked buffers: 0 space 0 Total buffers: 51107 space 235425792 Buf domain 2 freebufs 14930 lofreebufs 219 hifreebufs 329 bufspace 1982464 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 150 (1134592) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 1, 3, 3, 13, 7, 0, 2, 9, 3, 6, 6, Locked buffers: 0 space 0 Total buffers: 26680 space 1982464 Buf domain 3 freebufs 14921 lofreebufs 219 hifreebufs 329 bufspace 2174976 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 180 (1609728) dirtyq count 0 (0) wakeup 0 lim 25 CPU 1, 1, 2, 0, 4, 2, 1, 3, 6, 2, 4, 6, Locked buffers: 0 space 0 Total buffers: 3006 space 2174976 Buf domain 4 freebufs 13943 lofreebufs 219 hifreebufs 329 bufspace 33886208 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1078 (30846976) dirtyq count 0 (0) wakeup 0 lim 25 CPU 14, 20, 1, 5, 14, 18, 4, 2, 9, 4, 11, 10, Locked buffers: 0 space 0 Total buffers: 3294 space 33886208 Buf domain 5 freebufs 14909 lofreebufs 219 hifreebufs 329 bufspace 2662400 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 135 (1241088) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 0, 11, 5, 9, 6, 4, 4, 9, 11, 11, 19, Locked buffers: 0 space 0 Total buffers: 3931 space 2662400 Buf domain 6 freebufs 7940 lofreebufs 219 hifreebufs 329 bufspace 235438080 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 7121 (233144320) dirtyq count 0 (0) wakeup 0 lim 25 CPU 8, 8, 1, 17, 0, 2, 3, 5, 6, 7, 14, 1, Locked buffers: 0 space 0 Total buffers: 12660 space 235438080 db:1:pho1> show page vm_cnt.v_free_count: 15562 vm_cnt.v_inactive_count: 1 vm_cnt.v_active_count: 0 vm_cnt.v_laundry_count: 0 vm_cnt.v_wire_count: 406181 vm_cnt.v_free_reserved: 10642 vm_cnt.v_free_min: 51257 vm_cnt.v_free_target: 173102 vm_cnt.v_inactive_target: 259653 db:1:pho1> show pageq pq_free 15562 dom 0 page_cnt 8123039 free 15562 pq_act 0 pq_inact 1 pq_laund 0 pq_unsw 7700946 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 | POOL 2 -- -- -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 | 000000 11 (008192K) | 000000 | 000000 | 000000 10 (004096K) | 000000 | 000000 | 000000 09 (002048K) | 000000 | 000015 | 000000 08 (001024K) | 000000 | 000000 | 000000 07 (000512K) | 000000 | 000000 | 000000 06 (000256K) | 000000 | 000000 | 000000 05 (000128K) | 000000 | 000007 | 000000 04 (000064K) | 000000 | 000024 | 000000 03 (000032K) | 000000 | 000077 | 000001 02 (000016K) | 000000 | 000152 | 000010 01 (000008K) | 000000 | 000360 | 000068 00 (000004K) | 000000 | 001323 | 000796 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 | POOL 2 -- -- -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 | 000000 11 (008192K) | 000000 | 000000 | 000000 10 (004096K) | 000000 | 000000 | 000000 09 (002048K) | 000000 | 000000 | 000000 08 (001024K) | 000000 | 000000 | 000000 07 (000512K) | 000000 | 000000 | 000000 06 (000256K) | 000000 | 000000 | 000000 05 (000128K) | 000000 | 000000 | 000000 04 (000064K) | 000000 | 000000 | 000000 03 (000032K) | 000000 | 000000 | 000000 02 (000016K) | 000000 | 000000 | 000000 01 (000008K) | 000000 | 000000 | 000008 00 (000004K) | 000000 | 000000 | 000034 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree malloc-4096 4096 34146 0 34312 0 2 139862016 0 VM OBJECT 264 1476 464484 198823540 0 30 123013440 0 RADIX NODE 144 534443 1474 123814948 0 62 77172048 0 THREAD 1824 11827 14205 230145 0 8 47482368 0 swblk 136 0 338343 2509198 0 62 46014648 0 mbuf_cluster 2048 12302 242 44173 0 8 25690112 0 VNODE 600 2483 36608 286680944 0 16 23454600 0 PROC 1376 42 11596 2953300 0 8 16013888 0 BUF TRIE 144 1288 104664 19878216 0 62 15257088 0 malloc-128 128 78091 339 25955294 0 126 10039040 0 FPU_save_area 832 11829 87 307432 0 16 9914112 0 S VFS Cache 104 2851 84938 223404770 0 126 9130056 0 UMA Slabs 0 112 42607 22223 1612545 0 126 7260960 0 VMSPACE 616 7 11699 2953238 0 16 7210896 0 vmem btag 56 35288 92284 731932 0 254 7144032 0 FFS inode 1168 2447 3580 84239182 0 8 7039536 0 TMPFS node 232 2 20432 194866351 0 62 4740688 0 mbuf 256 16482 1831 606285 0 254 4688128 0 malloc-384 384 11649 101 11649 0 30 4512000 0 swpctrie 144 0 26208 189886 0 62 3773952 0 TURNSTILE 136 26033 364 26033 0 62 3589992 0 pbuf 2776 0 1168 0 0 0 3242368 0 malloc-256 256 11880 210 420758 0 62 3095040 0 malloc-128 128 18519 174 1611315 0 126 2392704 0 SLEEPQUEUE 88 26033 367 26033 0 126 2323200 0 ksiginfo 112 11615 5053 143398 0 126 1866816 0 malloc-128 128 13205 466 1930164521 0 126 1749888 0 FFS2 dinode 256 2447 4108 84233553 0 62 1678080 0 malloc-4096 4096 339 0 523670 0 2 1388544 0 Files 80 49 14601 818679674 0 126 1172000 0 DEVCTL 1024 1000 100 141608 0 0 1126400 0 malloc-64 64 11693 340 25130 0 254 770112 0 malloc-8192 8192 88 0 108 0 1 720896 0 malloc-64 64 9029 1051 8620410 0 254 645120 0 lkpicurr 168 13 3083 13 0 62 520128 0 malloc-32768 32768 15 0 15 0 1 491520 0 UMA Zones 2048 228 7 229 0 8 481280 0 rl_entry 40 9567 2351 9584 0 254 476720 0 malloc-32768 32768 12 0 12 0 1 393216 0 malloc-64 64 4488 678 978995744 0 254 330624 0 malloc-32 32 8382 1698 36060844 0 254 322560 0 MAP ENTRY 96 304 2930 129135195 0 126 310464 0 malloc-16 16 15877 2373 296480318 0 254 292000 0 malloc-32768 32768 8 0 1500 0 1 262144 0 malloc-1024 1024 216 40 17772 0 16 262144 0 256 Bucket 2048 64 58 63788362 0 8 249856 0 malloc-4096 4096 58 0 2953321 0 2 237568 0 Mountpoints 2944 4 76 17502 0 4 235520 0 malloc-2048 2048 107 1 107 0 8 221184 0 malloc-2048 2048 99 5 113 0 8 212992 0 malloc-256 256 540 255 635619 0 62 203520 0 PWD 40 9 5041 139963043 0 254 202000 0 L VFS Cache 320 0 624 900 0 30 199680 0 malloc-65536 65536 3 0 10 0 1 196608 0 malloc-65536 65536 3 0 4 0 1 196608 0 malloc-65536 65536 3 0 548 0 1 196608 0 malloc-32768 32768 6 0 11 0 1 196608 0 malloc-16384 16384 12 0 4829 0 1 196608 0 lkpimm 56 3 3093 3 0 254 173376 0 PGRP 120 21 1365 316 0 126 166320 0 udp_inpcb 416 4 374 501 0 30 157248 0 malloc-8192 8192 19 0 25 0 1 155648 0 malloc-1024 1024 135 13 470563 0 16 151552 0 fakepg 104 0 1404 470 0 126 146016 0 pcpu-8 8 15185 2223 15205 0 254 139264 0 malloc-128 128 662 392 89831310 0 126 134912 0 malloc-65536 65536 2 0 3269 0 1 131072 0 malloc-256 256 261 204 61240 0 62 119040 0 malloc-256 256 300 165 17955 0 62 119040 0 malloc-128 128 382 517 14374451 0 126 115072 0 malloc-8192 8192 13 0 90917 0 1 106496 0 malloc-64 64 125 1513 5976721 0 254 104832 0 malloc-32768 32768 3 0 3589 0 1 98304 0 malloc-16384 16384 6 0 13 0 1 98304 0 malloc-8192 8192 12 0 2982 0 1 98304 0 32 Bucket 256 26 319 19522538 0 62 88320 0 filedesc0 1072 27 50 2953301 0 8 82544 0 malloc-16384 16384 5 0 13 0 1 81920 0 malloc-64 64 103 1157 3031474 0 254 80640 0 malloc-128 128 307 313 148710083 0 126 79360 0 UMA Kegs 384 198 5 199 0 30 77952 0 malloc-512 512 48 104 412206 0 30 77824 0 malloc-384 384 150 50 160 0 30 76800 0 malloc-32 32 1138 1130 553762 0 254 72576 0 malloc-128 128 140 418 84247 0 126 71424 0 malloc-65536 65536 1 0 6 0 1 65536 0 malloc-32768 32768 2 0 2 0 1 65536 0 malloc-16384 16384 4 0 135802 0 1 65536 0 udp_inpcb ports 32 2 2014 90 0 254 64512 0 malloc-32 32 115 1775 44243 0 254 60480 0 malloc-32 32 306 1584 917288 0 254 60480 0 64 Bucket 512 20 92 9685339 0 30 57344 0 pipe 728 11 66 1163103 0 16 56056 0 malloc-16 16 291 3209 4161235 0 254 56000 0 malloc-2048 2048 18 8 356 0 8 53248 0 malloc-32 32 149 1489 358 0 254 52416 0 malloc-32 32 278 1360 401253 0 254 52416 0 malloc-8192 8192 6 0 48 0 1 49152 0 malloc-8192 8192 6 0 34878 0 1 49152 0 malloc-16 16 182 2818 563203 0 254 48000 0 tcp_inpcb 1304 6 30 24 0 8 46944 0 pcpu-64 64 453 251 453 0 254 45056 0 16 Bucket 144 12 296 10980443 0 62 44352 0 malloc-256 256 53 112 66481710 0 62 42240 0 malloc-4096 4096 10 0 18022 0 2 40960 0 malloc-1024 1024 30 10 4760 0 16 40960 0 pcpu-16 16 80 2480 80 0 254 40960 0 malloc-64 64 223 407 1056862371 0 254 40320 0 malloc-64 64 18 612 277922064 0 254 40320 0 malloc-32 32 50 1210 116440 0 254 40320 0 malloc-128 128 40 270 234230 0 126 39680 0 malloc-384 384 57 43 88 0 30 38400 0 malloc-32 32 43 1091 45 0 254 36288 0 socket 960 13 23 7176 0 16 34560 0 malloc-32768 32768 1 0 353 0 1 32768 0 malloc-1024 1024 19 13 4926 0 16 32768 0 malloc-16 16 42 1958 129925 0 254 32000 0 malloc-16 16 265 1735 140437 0 254 32000 0 malloc-16 16 24 1976 24 0 254 32000 0 malloc-256 256 25 95 162523532 0 62 30720 0 malloc-64 64 17 424 717592 0 254 28224 0 malloc-16 16 250 1500 420039 0 254 28000 0 malloc-16 16 620 1130 1685916 0 254 28000 0 malloc-384 384 22 48 5235 0 30 26880 0 malloc-256 256 27 78 78502595 0 62 26880 0 malloc-8192 8192 3 0 17439 0 1 24576 0 malloc-512 512 26 22 29 0 30 24576 0 8 Bucket 80 7 293 13010266 0 126 24000 0 128 Bucket 1024 5 18 13639815 0 16 23552 0 malloc-2048 2048 8 2 43930 0 8 20480 0 tcp_inpcb ports 32 2 628 9 0 254 20160 0 routing nhops 256 9 66 14 0 62 19200 0 malloc-16384 16384 1 0 13 0 1 16384 0 malloc-2048 2048 5 3 10 0 8 16384 0 malloc-2048 2048 8 0 372 0 8 16384 0 malloc-1024 1024 13 3 13 0 16 16384 0 malloc-1024 1024 8 8 8083 0 16 16384 0 rtentry 168 12 84 14 0 62 16128 0 cpuset 200 27 53 27 0 62 16000 0 malloc-4096 4096 3 0 16421 0 2 12288 0 malloc-2048 2048 3 3 2795 0 8 12288 0 malloc-2048 2048 4 2 74193 0 8 12288 0 malloc-1024 1024 3 9 2058579 0 16 12288 0 malloc-512 512 3 21 65 0 30 12288 0 malloc-512 512 3 21 1518 0 30 12288 0 malloc-384 384 10 20 271 0 30 11520 0 malloc-4096 4096 2 0 14 0 2 8192 0 malloc-1024 1024 2 6 149300 0 16 8192 0 malloc-512 512 2 14 17581 0 30 8192 0 hostcache 64 1 125 3 0 254 8064 0 ertt 72 6 106 24 0 126 8064 0 UMA Slabs 1 176 33 12 33 0 62 7920 0 kenv 258 18 12 27409 0 30 7740 0 ripcb 384 0 20 3 0 30 7680 0 unpcb 256 3 27 6553 0 62 7680 0 malloc-256 256 2 28 108169464 0 62 7680 0 mbuf_packet 256 17 0 560593 0 254 4352 0 epoch_record pcpu 256 4 12 4 0 62 4096 0 malloc-4096 4096 1 0 24497 0 2 4096 0 malloc-4096 4096 1 0 3230 0 2 4096 0 malloc-512 512 1 7 1 0 30 4096 0 SMR CPU 32 7 120 7 0 254 4064 0 STS VFS Cache 144 0 28 2 0 62 4032 0 vtnet_tx_hdr 24 0 167 0 0 254 4008 0 KNOTE 160 11 14 561052 0 62 4000 0 malloc-384 384 1 9 99865014 0 30 3840 0 KMAP ENTRY 96 30 9 30 0 0 3744 0 vmem 1856 2 0 2 0 8 3712 0 SMR SHARED 24 7 120 7 0 254 3048 0 FFS1 dinode 128 0 0 0 0 126 0 0 da_ccb 544 0 0 0 0 16 0 0 ada_ccb 272 0 0 4087991 0 30 0 0 tfo_ccache_entries 80 0 0 0 0 126 0 0 tfo 4 0 0 0 0 254 0 0 sackhole 32 0 0 0 0 254 0 0 syncache 168 0 0 7 0 62 0 0 ipq 56 0 0 0 0 254 0 0 tcp_log_id_node 120 0 0 0 0 126 0 0 tcp_log_id_bucket 176 0 0 0 0 62 0 0 tcp_log 416 0 0 0 0 30 0 0 tcpreass 48 0 0 0 0 254 0 0 udplite_inpcb ports 32 0 0 0 0 254 0 0 udplite_inpcb 416 0 0 0 0 30 0 0 ripcb ports 32 0 0 0 0 254 0 0 IPsec SA lft_c 16 0 0 0 0 254 0 0 itimer 352 0 0 1 0 30 0 0 AIOLIO 272 0 0 0 0 30 0 0 AIOCB 552 0 0 0 0 16 0 0 AIO 208 0 0 0 0 62 0 0 DIRHASH 1024 0 0 2082422 0 16 0 0 NCLNODE 760 0 0 3 0 16 0 0 NAMEI 1024 0 0 2417385831 0 16 0 0 LTS VFS Cache 360 0 0 0 0 30 0 0 cryptop 280 0 0 0 0 30 0 0 linux_dma_object 32 0 0 0 0 254 0 0 linux_dma_pctrie 144 0 0 0 0 62 0 0 g_bio 408 0 0 57979130 0 30 0 0 IOMMU_MAP_ENTRY 104 0 0 0 0 126 0 0 ttyoutq 256 0 0 455 0 62 0 0 ttyinq 160 0 0 870 0 62 0 0 mbuf_jumbo_16k 16384 0 0 0 0 1 0 0 mbuf_jumbo_9k 9216 0 0 0 0 1 0 0 mbuf_jumbo_page 4096 0 0 10 0 2 0 0 audit_record 1280 0 0 0 0 8 0 0 domainset 40 0 0 0 0 254 0 0 MAC labels 40 0 0 0 0 254 0 0 clpbuf 2776 0 0 925765 0 4 0 0 vnpbuf 2776 0 0 0 0 4 0 0 nfspbuf 2776 0 0 0 0 4 0 0 swwbuf 2776 0 0 1321494 0 2 0 0 swrbuf 2776 0 0 1277342 0 4 0 0 ertt_txseginfo 40 0 0 5891 0 254 0 0 umtx_shm 88 0 0 0 0 126 0 0 umtx pi 96 0 0 0 0 126 0 0 rangeset pctrie nodes 144 0 0 0 0 62 0 0 malloc-65536 65536 0 0 0 0 1 0 0 malloc-65536 65536 0 0 18 0 1 0 0 malloc-65536 65536 0 0 0 0 1 0 0 malloc-32768 32768 0 0 29273 0 1 0 0 malloc-16384 16384 0 0 52 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-16384 16384 0 0 1 0 1 0 0 malloc-8192 8192 0 0 10 0 1 0 0 malloc-512 512 0 0 478719 0 30 0 0 malloc-512 512 0 0 16 0 30 0 0 malloc-384 384 0 0 0 0 30 0 0 malloc-384 384 0 0 27062 0 30 0 0 pcpu-32 32 0 0 0 0 254 0 0 pcpu-4 4 0 0 0 0 254 0 0 4 Bucket 48 0 0 1860802 0 254 0 0 2 Bucket 32 0 0 1787341 0 254 0 0 UMA Hash 256 0 0 0 0 62 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket debugnet_mbuf_packet 2048 0 0 0 0 debugnet_mbuf_cluster 2048 -6144 0 0 0 debugnet_mbuf 256 -10240 0 0 0 vm pgcache 4096 135768 0 117485436 2 vm pgcache 4096 7797289 0 809890827 2 vm pgcache 4096 0 0 0 2 buf free cache 848 17302 0 47072197 16 buffer arena-65 65536 0 0 4 1 buffer arena-61 61440 0 0 0 1 buffer arena-57 57344 0 0 0 1 buffer arena-53 53248 0 0 0 1 buffer arena-49 49152 0 0 0 1 buffer arena-45 45056 0 0 0 1 buffer arena-40 40960 0 0 0 1 buffer arena-36 36864 0 0 0 1 buffer arena-32 32768 885 0 13778502 1 buffer arena-28 28672 0 0 0 1 buffer arena-24 24576 0 0 0 1 buffer arena-20 20480 0 0 0 1 buffer arena-16 16384 3 0 70175 1 buffer arena-12 12288 0 0 0 1 buffer arena-81 8192 0 0 0 1 buffer arena-40 4096 0 0 0 2 kstack_cache 16384 11827 0 230145 1 db:0:pho> acttrace Tracing command idle pid 11 tid 100003 td 0xfffff80003bee740 (CPU 0) cpustop_handler() at cpustop_handler+0x27/frame 0xffffffff81d09f80 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xffffffff81d09f90 trap() at trap+0x56/frame 0xffffffff81d0a0b0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81d0a0b0 --- trap 0x13, rip = 0xffffffff8103392e, rsp = 0xfffffe0108014d78, rbp = 0xfffffe0108014db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108014db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108014dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108014df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108014ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108014f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108014f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff80003bee000 (CPU 1) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce3cdf0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce3ce00 trap() at trap+0x56/frame 0xfffffe003ce3cf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce3cf20 --- trap 0x13, rip = 0xffffffff8103392e, rsp = 0xfffffe010800fd78, rbp = 0xfffffe010800fdb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe010800fdb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe010800fdd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe010800fdf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe010800fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010800ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010800ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff80003bef740 (CPU 2) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce4bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce4be00 trap() at trap+0x56/frame 0xfffffe003ce4bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce4bf20 --- trap 0x13, rip = 0xffffffff8103392e, rsp = 0xfffffe010801ed78, rbp = 0xfffffe010801edb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe010801edb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe010801edd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe010801edf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe010801eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010801ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010801ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff80003bef000 (CPU 3) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce5adf0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce5ae00 trap() at trap+0x56/frame 0xfffffe003ce5af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce5af20 --- trap 0x13, rip = 0xffffffff8103392e, rsp = 0xfffffe0108019d78, rbp = 0xfffffe0108019db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108019db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108019dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108019df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108019ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108019f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108019f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff80003bf0740 (CPU 4) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce69df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce69e00 trap() at trap+0x56/frame 0xfffffe003ce69f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce69f20 --- trap 0x13, rip = 0xffffffff8103392e, rsp = 0xfffffe0108028d78, rbp = 0xfffffe0108028db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108028db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108028dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108028df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108028ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108028f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108028f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff80003bf0000 (CPU 5) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce78df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce78e00 trap() at trap+0x56/frame 0xfffffe003ce78f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce78f20 --- trap 0x13, rip = 0xffffffff8103392e, rsp = 0xfffffe0108023d78, rbp = 0xfffffe0108023db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108023db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108023dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108023df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108023ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108023f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108023f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff80003bd9740 (CPU 6) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce87df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce87e00 trap() at trap+0x56/frame 0xfffffe003ce87f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce87f20 --- trap 0x13, rip = 0xffffffff8103392e, rsp = 0xfffffe0108032d78, rbp = 0xfffffe0108032db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108032db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108032dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108032df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108032ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108032f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108032f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff80003bd9000 (CPU 7) kdb_enter() at kdb_enter+0x33/frame 0xfffffe010802dc00 handleevents() at handleevents+0xaf/frame 0xfffffe010802dc40 timercb() at timercb+0x18e/frame 0xfffffe010802dc90 lapic_handle_timer() at lapic_handle_timer+0xab/frame 0xfffffe010802dcb0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe010802dcb0 --- interrupt, rip = 0xffffffff804c63de, rsp = 0xfffffe010802dd80, rbp = 0xfffffe010802ddb0 --- acpi_cpu_idle() at acpi_cpu_idle+0x27e/frame 0xfffffe010802ddb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe010802ddd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe010802ddf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe010802def0 fork_exit() at fork_exit+0x82/frame 0xfffffe010802df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010802df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff80003bda740 (CPU 8) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003cea5df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003cea5e00 trap() at trap+0x56/frame 0xfffffe003cea5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cea5f20 --- trap 0x13, rip = 0xffffffff8103392e, rsp = 0xfffffe010803cd78, rbp = 0xfffffe010803cdb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe010803cdb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe010803cdd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe010803cdf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe010803cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010803cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010803cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff80003bda000 (CPU 9) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ceb4df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ceb4e00 trap() at trap+0x56/frame 0xfffffe003ceb4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ceb4f20 --- trap 0x13, rip = 0xffffffff8103392e, rsp = 0xfffffe0108037d78, rbp = 0xfffffe0108037db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108037db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108037dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108037df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108037ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108037f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108037f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff80003bdb740 (CPU 10) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003cec3df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003cec3e00 trap() at trap+0x56/frame 0xfffffe003cec3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cec3f20 --- trap 0x13, rip = 0xffffffff8103392e, rsp = 0xfffffe0108046d78, rbp = 0xfffffe0108046db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108046db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108046dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108046df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108046ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108046f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108046f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff80003bdb000 (CPU 11) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ced2df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ced2e00 trap() at trap+0x56/frame 0xfffffe003ced2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ced2f20 --- trap 0x13, rip = 0xffffffff8103392e, rsp = 0xfffffe0108041d78, rbp = 0xfffffe0108041db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108041db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108041dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108041df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108041ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108041f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108041f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 55578 3441 3441 0 NV watchdogd 55577 1 4266 0 D vmwait 0xffffffff818076c0 dd 3599 1 3599 0 ?Ws sshd 3582 1 3582 0 ?Ws cron 3577 1 3577 0 Ss select 0xfffff800078ea940 inetd 3441 1 3441 0 DLs vmwait 0xffffffff818076c0 watchdogd 3424 1 3424 0 ?Ws syslogd 19 0 0 0 DL syncer 0xffffffff81cc18e8 [syncer] 18 0 0 0 DL vlruwt 0xfffffe010ec0a000 [vnlru] 17 0 0 0 DL (threaded) [bufdaemon] 100200 D psleep 0xffffffff81cc0900 [bufdaemon] 100201 D - 0xffffffff81802100 [bufspacedaemon-0] 100202 D - 0xffffffff81802380 [bufspacedaemon-1] 100203 D - 0xffffffff81802600 [bufspacedaemon-2] 100204 D - 0xffffffff81802880 [bufspacedaemon-3] 100205 D - 0xffffffff81802b00 [bufspacedaemon-4] 100206 D - 0xffffffff81802d80 [bufspacedaemon-5] 100207 D - 0xffffffff81803000 [bufspacedaemon-6] 100233 D sdflush 0xfffff800200f4ce8 [/ worker] 100250 D sdflush 0xfffff80020293ce8 [/tmp worker] 16 0 0 0 RL [vmdaemon] 9 0 0 0 RL (threaded) [pagedaemon] 100198 D pwait 0xffffffff813d72b9 [dom0] 100208 D launds 0xffffffff81cdc904 [laundry: dom0] 100209 RunQ [uma] 8 0 0 0 DL idle 0xfffffe010e482ae0 [enc_daemon1] 7 0 0 0 DL idle 0xfffffe010e483040 [enc_daemon0] 6 0 0 0 DL - 0xffffffff819dc8a0 [rand_harvestq] 15 0 0 0 DL (threaded) [usb] 100128 D - 0xfffffe010a9cf440 [usbus0] 100129 D - 0xfffffe010a9cf498 [usbus0] 100130 D - 0xfffffe010a9cf4f0 [usbus0] 100131 D - 0xfffffe010a9cf548 [usbus0] 100132 D - 0xfffffe010a9cf5a0 [usbus0] 100134 D - 0xfffffe00e4d9ccf0 [usbus1] 100135 D - 0xfffffe00e4d9cd48 [usbus1] 100136 D - 0xfffffe00e4d9cda0 [usbus1] 100137 D - 0xfffffe00e4d9cdf8 [usbus1] 100138 D - 0xfffffe00e4d9ce50 [usbus1] 100139 D - 0xfffffe010ad7ccf0 [usbus2] 100140 D - 0xfffffe010ad7cd48 [usbus2] 100141 D - 0xfffffe010ad7cda0 [usbus2] 100142 D - 0xfffffe010ad7cdf8 [usbus2] 100143 D - 0xfffffe010ad7ce50 [usbus2] 5 0 0 0 DL - 0xffffffff81d00968 [busdma] 4 0 0 0 DL (threaded) [cam] 100121 D - 0xffffffff819ae240 [doneq0] 100122 D - 0xffffffff819ae2c0 [doneq1] 100123 D - 0xffffffff819ae340 [doneq2] 100124 D - 0xffffffff819ae1c0 [async] 100153 D - 0xffffffff819ae090 [scanner] 3 0 0 0 DL (threaded) [crypto] 100108 D crypto_ 0xffffffff81cd9d30 [crypto] 100109 D crypto_ 0xfffff80003fc3c30 [crypto returns 0] 100110 D crypto_ 0xfffff80003fc3c80 [crypto returns 1] 100111 D crypto_ 0xfffff80003fc3cd0 [crypto returns 2] 100112 D crypto_ 0xfffff80003fc3d20 [crypto returns 3] 100113 D crypto_ 0xfffff80003fc3d70 [crypto returns 4] 100114 D crypto_ 0xfffff80003fc3dc0 [crypto returns 5] 100115 D crypto_ 0xfffff80003fc3e10 [crypto returns 6] 100116 D crypto_ 0xfffff80003fc3e60 [crypto returns 7] 100117 D crypto_ 0xfffff80003fc3eb0 [crypto returns 8] 100118 D crypto_ 0xfffff80003fc3f00 [crypto returns 9] 100119 D crypto_ 0xfffff80003fc3f50 [crypto returns 10] 100120 D crypto_ 0xfffff80003fc3fa0 [crypto returns 11] 14 0 0 0 DL seqstat 0xfffff80003f33088 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100092 D - 0xffffffff81b96ab0 [g_event] 100093 D - 0xffffffff81b96ab8 [g_up] 100094 D - 0xffffffff81b96ac0 [g_down] 2 0 0 0 WL (threaded) [clock] 100078 I [clock (0)] 100079 I [clock (1)] 100080 I [clock (2)] 100081 I [clock (3)] 100082 I [clock (4)] 100083 I [clock (5)] 100084 I [clock (6)] 100085 I [clock (7)] 100086 I [clock (8)] 100087 I [clock (9)] 100088 I [clock (10)] 100089 I [clock (11)] 12 0 0 0 WL (threaded) [intr] 100042 I [swi6: task queue] 100043 I [swi6: Giant taskq] 100045 I [swi5: fast taskq] 100090 I [swi1: netisr 0] 100125 I [irq56: ahci0] 100127 I [irq19: xhci0] 100133 I [irq18: ehci0 ehci1+] 100144 I [irq71: ahci1] 100145 I [swi4: apei] 100146 I [swi0: uart uart] 100160 I [irq73: mlx5_core0] 100161 I [irq74: mlx5_core0] 100162 I [irq72: mlx5_core0] 100163 I [irq75: mlx5_core0] 100164 I [irq76: mlx5_core0] 100165 I [irq77: mlx5_core0] 100166 I [irq78: mlx5_core0] 100167 I [irq79: mlx5_core0] 100168 I [irq80: mlx5_core0] 100169 I [irq81: mlx5_core0] 100170 I [irq82: mlx5_core0] 100171 I [irq83: mlx5_core0] 100172 I [irq84: mlx5_core0] 100173 I [irq85: mlx5_core0] 100174 I [irq86: mlx5_core0] 100181 I [irq88: mlx5_core1] 100182 I [irq89: mlx5_core1] 100183 I [irq87: mlx5_core1] 100184 I [irq90: mlx5_core1] 100185 I [irq91: mlx5_core1] 100186 I [irq92: mlx5_core1] 100187 I [irq93: mlx5_core1] 100188 I [irq94: mlx5_core1] 100189 I [irq95: mlx5_core1] 100190 I [irq96: mlx5_core1] 100191 I [irq97: mlx5_core1] 100192 I [irq98: mlx5_core1] 100193 I [irq99: mlx5_core1] 100194 I [irq100: mlx5_core1] 100195 I [irq101: mlx5_core1] 100241 I [irq102: ioat0] 100242 I [irq103: ioat1] 100243 I [irq104: ioat2] 100244 I [irq105: ioat3] 100245 I [irq106: ioat4] 100246 I [irq107: ioat5] 100247 I [irq108: ioat6] 100248 I [irq109: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 100007 Run CPU 4 [idle: cpu4] 100008 Run CPU 5 [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 Run CPU 7 [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 Run CPU 9 [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 1 0 1 0 DLs pfault 0xffffffff818076c0 [init] 10 0 0 0 DL audit_w 0xffffffff81cda230 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81b97020 [swapper] 100015 D - 0xfffff80003ba5100 [softirq_0] 100016 D - 0xfffff80003ba5000 [softirq_1] 100017 D - 0xfffff80003ba6e00 [softirq_2] 100018 D - 0xfffff80003ba6d00 [softirq_3] 100019 D - 0xfffff80003ba6c00 [softirq_4] 100020 D - 0xfffff80003ba6b00 [softirq_5] 100021 D - 0xfffff80003ba6a00 [softirq_6] 100022 D - 0xfffff80003ba6900 [softirq_7] 100023 D - 0xfffff80003ba6800 [softirq_8] 100024 D - 0xfffff80003ba6700 [softirq_9] 100025 D - 0xfffff80003ba6600 [softirq_10] 100026 D - 0xfffff80003ba6500 [softirq_11] 100027 D - 0xfffff80003ba6400 [if_io_tqg_0] 100028 D - 0xfffff80003ba6300 [if_io_tqg_1] 100029 D - 0xfffff80003ba6200 [if_io_tqg_2] 100030 D - 0xfffff80003ba6100 [if_io_tqg_3] 100031 D - 0xfffff80003ba6000 [if_io_tqg_4] 100032 D - 0xfffff80003ba7e00 [if_io_tqg_5] 100033 D - 0xfffff80003ba7d00 [if_io_tqg_6] 100034 D - 0xfffff80003ba7c00 [if_io_tqg_7] 100035 D - 0xfffff80003ba7b00 [if_io_tqg_8] 100036 D - 0xfffff80003ba7a00 [if_io_tqg_9] 100037 D - 0xfffff80003ba7900 [if_io_tqg_10] 100038 D - 0xfffff80003ba7800 [if_io_tqg_11] 100039 D - 0xfffff80003ba7700 [if_config_tqg_0] 100040 D - 0xfffff80003a0fd00 [pci_hp taskq] 100041 D - 0xfffff80003a0fc00 [kqueue_ctx taskq] 100044 D - 0xfffff80003a0f700 [thread taskq] 100046 D - 0xfffff80003a0f400 [aiod_kick taskq] 100047 D - 0xfffff80003a0f300 [deferred_unmount ta] 100048 D - 0xfffff80003a0f200 [inm_free taskq] 100049 D - 0xfffff80003a0f100 [in6m_free taskq] 100050 D - 0xfffff80003a0f000 [linuxkpi_irq_wq] 100051 D - 0xfffff80003b86300 [linuxkpi_short_wq_0] 100052 D - 0xfffff80003b86300 [linuxkpi_short_wq_1] 100053 D - 0xfffff80003b86300 [linuxkpi_short_wq_2] 100054 D - 0xfffff80003b86300 [linuxkpi_short_wq_3] 100055 D - 0xfffff80003b86300 [linuxkpi_short_wq_4] 100056 D - 0xfffff80003b86300 [linuxkpi_short_wq_5] 100057 D - 0xfffff80003b86300 [linuxkpi_short_wq_6] 100058 D - 0xfffff80003b86300 [linuxkpi_short_wq_7] 100059 D - 0xfffff80003b86300 [linuxkpi_short_wq_8] 100060 D - 0xfffff80003b86300 [linuxkpi_short_wq_9] 100061 D - 0xfffff80003b86300 [linuxkpi_short_wq_1] 100062 D - 0xfffff80003b86300 [linuxkpi_short_wq_1] 100063 D - 0xfffff80003b86300 [linuxkpi_short_wq_1] 100064 D - 0xfffff80003b86200 [linuxkpi_long_wq_0] 100065 D - 0xfffff80003b86200 [linuxkpi_long_wq_1] 100066 D - 0xfffff80003b86200 [linuxkpi_long_wq_2] 100067 D - 0xfffff80003b86200 [linuxkpi_long_wq_3] 100068 D - 0xfffff80003b86200 [linuxkpi_long_wq_4] 100069 D - 0xfffff80003b86200 [linuxkpi_long_wq_5] 100070 D - 0xfffff80003b86200 [linuxkpi_long_wq_6] 100071 D - 0xfffff80003b86200 [linuxkpi_long_wq_7] 100072 D - 0xfffff80003b86200 [linuxkpi_long_wq_8] 100073 D - 0xfffff80003b86200 [linuxkpi_long_wq_9] 100074 D - 0xfffff80003b86200 [linuxkpi_long_wq_10] 100075 D - 0xfffff80003b86200 [linuxkpi_long_wq_11] 100076 D - 0xfffff80003b86200 [linuxkpi_long_wq_12] 100091 D - 0xfffff80003b87e00 [firmware taskq] 100096 D - 0xfffff80003b87d00 [crypto_0] 100097 D - 0xfffff80003b87d00 [crypto_1] 100098 D - 0xfffff80003b87d00 [crypto_2] 100099 D - 0xfffff80003b87d00 [crypto_3] 100100 D - 0xfffff80003b87d00 [crypto_4] 100101 D - 0xfffff80003b87d00 [crypto_5] 100102 D - 0xfffff80003b87d00 [crypto_6] 100103 D - 0xfffff80003b87d00 [crypto_7] 100104 D - 0xfffff80003b87d00 [crypto_8] 100105 D - 0xfffff80003b87d00 [crypto_9] 100106 D - 0xfffff80003b87d00 [crypto_10] 100107 D - 0xfffff80003b87d00 [crypto_11] 100147 D - 0xfffff8000790c800 [acpi_task_0] 100148 D - 0xfffff8000790c800 [acpi_task_1] 100149 D - 0xfffff8000790c800 [acpi_task_2] 100151 D - 0xfffff80003a13100 [mca taskq] 100152 D - 0xfffff80003b87c00 [CAM taskq] 100156 D - 0xfffff8000790c700 [mlx5_core0-rec] 100157 D - 0xfffff8000790c600 [mlx5_core0-wdg] 100158 D - 0xfffff8000790c500 [mlx5_core0-cmd] 100159 D - 0xfffff80003df2d00 [mlx5_page_allocator] 100175 D - 0xfffff800079cb400 [mlx5_fc] 100176 D - 0xfffff800079cb300 [mlx5_esw_wq] 100177 D - 0xfffff800079cb200 [mlx5_core1-rec] 100178 D - 0xfffff800079cb100 [mlx5_core1-wdg] 100179 D - 0xfffff800079cb000 [mlx5_core1-cmd] 100180 D - 0xfffff800079cce00 [mlx5_page_allocator] 100196 D - 0xfffff8001276f600 [mlx5_fc] 100197 D - 0xfffff8001276f500 [mlx5_esw_wq] 35892 1 35761 2006 Z sshd 35900 1 35900 2006 Z+ sh 3199 1 3199 0 Z dhclient 3202 1 3202 0 Z dhclient 3261 1 3261 65 Z dhclient 3556 1 3556 0 Z powerd 3613 1 3613 0 Z+ getty 3614 1 3614 0 Z+ getty 3615 1 3615 0 Z+ getty 3616 1 3616 0 Z+ getty 3617 1 3617 0 Z+ getty 3618 1 3618 0 Z+ getty 3619 1 3619 0 Z+ getty 3621 1 3621 0 Z+ getty 4266 1 4266 0 Z+ sh 55566 1 4266 0 Z sh db:0:pho> allt Tracing command kernel pid 0 tid 100000 td 0xffffffff81b97580 sched_switch() at sched_switch+0x5c6/frame 0xffffffff82381e10 mi_switch() at mi_switch+0x170/frame 0xffffffff82381e30 sleepq_switch() at sleepq_switch+0x101/frame 0xffffffff82381e70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xffffffff82381eb0 _sleep() at _sleep+0x27e/frame 0xffffffff82381f50 swapper() at swapper+0x75/frame 0xffffffff82381fa0 mi_startup() at mi_startup+0x226/frame 0xffffffff82381ff0 Tracing command kernel pid 0 tid 100015 td 0xfffff80003bdc740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108050df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108050e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108050e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe0108050ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe0108050ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108050f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108050f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffff80003bdc000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010804bdf0 mi_switch() at mi_switch+0x170/frame 0xfffffe010804be10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010804be50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010804bec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe010804bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010804bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010804bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100017 td 0xfffff80003b9f740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010805adf0 mi_switch() at mi_switch+0x170/frame 0xfffffe010805ae10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010805ae50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010805aec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe010805aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010805af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010805af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffff80003b9f000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108055df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108055e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108055e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe0108055ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe0108055ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108055f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108055f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffff80003ba0740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108064df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108064e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108064e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe0108064ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe0108064ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108064f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108064f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffff80003ba0000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010805fdf0 mi_switch() at mi_switch+0x170/frame 0xfffffe010805fe10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010805fe50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010805fec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe010805fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010805ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010805ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffff80003ba1740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010806edf0 mi_switch() at mi_switch+0x170/frame 0xfffffe010806ee10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010806ee50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010806eec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe010806eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010806ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010806ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffff80003ba1000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108069df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108069e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108069e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe0108069ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe0108069ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108069f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108069f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffff80003ba2740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108078df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108078e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108078e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe0108078ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe0108078ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108078f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108078f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffff80003ba2000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108073df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108073e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108073e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe0108073ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe0108073ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108073f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108073f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffff80003b9b740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108082df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108082e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108082e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe0108082ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe0108082ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108082f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108082f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffff80003b9b000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010807ddf0 mi_switch() at mi_switch+0x170/frame 0xfffffe010807de10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010807de50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010807dec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe010807def0 fork_exit() at fork_exit+0x82/frame 0xfffffe010807df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010807df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffff80003b9c740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010808cdf0 mi_switch() at mi_switch+0x170/frame 0xfffffe010808ce10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010808ce50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010808cec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe010808cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010808cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010808cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffff80003b9c000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108087df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108087e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108087e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe0108087ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe0108087ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108087f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108087f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffff80003b9d740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108096df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108096e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108096e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe0108096ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe0108096ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108096f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108096f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffff80003b9d000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108091df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108091e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108091e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe0108091ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe0108091ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108091f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108091f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffff80003b9e740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080a0df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080a0e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080a0e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01080a0ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe01080a0ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080a0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080a0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffff80003b9e000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010809bdf0 mi_switch() at mi_switch+0x170/frame 0xfffffe010809be10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010809be50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe010809bec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe010809bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010809bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010809bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff80003b97740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080aadf0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080aae10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080aae50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01080aaec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe01080aaef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080aaf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080aaf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffff80003b97000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080a5df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080a5e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080a5e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01080a5ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe01080a5ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080a5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080a5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffff80003b98740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080b4df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080b4e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080b4e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01080b4ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe01080b4ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080b4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080b4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffff80003b98000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080afdf0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080afe10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080afe50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01080afec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe01080afef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080aff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080aff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffff80003b99740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080bedf0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080bee10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080bee50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01080beec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe01080beef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080bef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080bef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffff80003b99000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080b9df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080b9e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080b9e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01080b9ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe01080b9ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080b9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080b9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffff80003b9a740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080c8df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080c8e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080c8e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01080c8ec0 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0x104/frame 0xfffffe01080c8ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080c8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080c8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffff80003b9a000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080c3dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080c3de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080c3e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01080c3ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01080c3ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080c3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080c3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffff80003b90740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080d2dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080d2de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080d2e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01080d2ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01080d2ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080d2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080d2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffff80003b91000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080d7dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080d7de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080d7e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01080d7ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01080d7ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080d7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080d7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffff80003b92000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080e1dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080e1de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080e1e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01080e1ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01080e1ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080e1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080e1f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100047 td 0xfffff80003b93740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080f0dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080f0de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080f0e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01080f0ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01080f0ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080f0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080f0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100048 td 0xfffff80003b93000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080ebdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080ebde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080ebe20 _sleep() at _sleep+0x2d8/frame 0xfffffe01080ebec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01080ebef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080ebf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080ebf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100049 td 0xfffff80003b8a740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080fadc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080fade0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080fae20 _sleep() at _sleep+0x2d8/frame 0xfffffe01080faec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01080faef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080faf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080faf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100050 td 0xfffff80003b8a000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080f5df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080f5e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080f5e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01080f5ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe01080f5ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080f5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080f5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100051 td 0xfffff80003b8b740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108104dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108104de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108104e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108104ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108104ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108104f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108104f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100052 td 0xfffff80003b8b000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080ffdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01080ffde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01080ffe20 _sleep() at _sleep+0x2d8/frame 0xfffffe01080ffec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01080ffef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080fff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080fff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100053 td 0xfffff80003b8c740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010810edc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010810ede0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010810ee20 _sleep() at _sleep+0x2d8/frame 0xfffffe010810eec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010810eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010810ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010810ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100054 td 0xfffff80003b8c000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108109dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108109de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108109e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108109ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108109ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108109f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108109f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100055 td 0xfffff80003b8d740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108118dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108118de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108118e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108118ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108118ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108118f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108118f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100056 td 0xfffff80003b8d000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108113dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108113de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108113e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108113ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108113ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108113f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108113f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100057 td 0xfffff80003ccd740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108122dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108122de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108122e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108122ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108122ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108122f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108122f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100058 td 0xfffff80003ccd000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010811ddc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010811dde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010811de20 _sleep() at _sleep+0x2d8/frame 0xfffffe010811dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010811def0 fork_exit() at fork_exit+0x82/frame 0xfffffe010811df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010811df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100059 td 0xfffff80003cd5740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010812cdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010812cde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010812ce20 _sleep() at _sleep+0x2d8/frame 0xfffffe010812cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010812cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010812cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010812cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100060 td 0xfffff80003cd5000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108127dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108127de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108127e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108127ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108127ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108127f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108127f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffff80003b84740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108136dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108136de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108136e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108136ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108136ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108136f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108136f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100062 td 0xfffff80003b84000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108131dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108131de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108131e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108131ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108131ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108131f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108131f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100063 td 0xfffff80003b85740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108140dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108140de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108140e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108140ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108140ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108140f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108140f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffff80003b85000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010813bdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010813bde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010813be20 _sleep() at _sleep+0x2d8/frame 0xfffffe010813bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010813bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010813bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010813bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xfffff80003cc5740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010814adc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010814ade0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010814ae20 _sleep() at _sleep+0x2d8/frame 0xfffffe010814aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010814aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010814af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010814af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff80003cc5000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108145dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108145de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108145e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108145ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108145ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108145f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108145f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff80003cc6740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108154dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108154de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108154e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108154ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108154ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108154f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108154f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff80003cc6000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010814fdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010814fde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010814fe20 _sleep() at _sleep+0x2d8/frame 0xfffffe010814fec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010814fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010814ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010814ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffff80003cc7740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010815edc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010815ede0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010815ee20 _sleep() at _sleep+0x2d8/frame 0xfffffe010815eec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010815eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010815ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010815ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff80003cc7000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108159dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108159de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108159e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108159ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108159ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108159f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108159f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff80003cc8740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108168dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108168de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108168e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108168ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108168ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108168f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108168f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffff80003cc8000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108163dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108163de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108163e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108163ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108163ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108163f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108163f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffff80003cc1740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108172dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108172de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108172e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108172ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108172ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108172f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108172f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffff80003cc1000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010816ddc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010816dde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010816de20 _sleep() at _sleep+0x2d8/frame 0xfffffe010816dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010816def0 fork_exit() at fork_exit+0x82/frame 0xfffffe010816df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010816df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffff80003cc2740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010817cdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010817cde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010817ce20 _sleep() at _sleep+0x2d8/frame 0xfffffe010817cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010817cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010817cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010817cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffff80003cc2000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108177dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108177de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108177e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108177ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108177ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108177f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108177f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100091 td 0xfffff80003c85740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081ccdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081ccde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081cce20 _sleep() at _sleep+0x2d8/frame 0xfffffe01081ccec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01081ccef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081ccf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081ccf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100096 td 0xfffff80003c87000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081dbdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081dbde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081dbe20 _sleep() at _sleep+0x2d8/frame 0xfffffe01081dbec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01081dbef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081dbf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081dbf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100097 td 0xfffff80003fcd740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081eadc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081eade0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081eae20 _sleep() at _sleep+0x2d8/frame 0xfffffe01081eaec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01081eaef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081eaf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081eaf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100098 td 0xfffff80003fcd000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081e5dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081e5de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081e5e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01081e5ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01081e5ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081e5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081e5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100099 td 0xfffff80003fce740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081f4dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081f4de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081f4e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01081f4ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01081f4ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081f4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081f4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100100 td 0xfffff80003fce000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081efdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081efde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081efe20 _sleep() at _sleep+0x2d8/frame 0xfffffe01081efec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01081efef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081eff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081eff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100101 td 0xfffff80003fcf740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081fedc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081fede0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081fee20 _sleep() at _sleep+0x2d8/frame 0xfffffe01081feec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01081feef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081fef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081fef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100102 td 0xfffff80003fcf000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081f9dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081f9de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081f9e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01081f9ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01081f9ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081f9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081f9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100103 td 0xfffff80003fd0740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108208dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108208de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108208e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108208ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108208ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108208f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108208f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100104 td 0xfffff80003fd0000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108203dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108203de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108203e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108203ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108203ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108203f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108203f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100105 td 0xfffff80003fc9740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108212dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108212de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108212e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108212ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108212ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108212f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108212f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100106 td 0xfffff80003fc9000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010820ddc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010820dde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010820de20 _sleep() at _sleep+0x2d8/frame 0xfffffe010820dec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010820def0 fork_exit() at fork_exit+0x82/frame 0xfffffe010820df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010820df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100107 td 0xfffff80003fca740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010821cdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010821cde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010821ce20 _sleep() at _sleep+0x2d8/frame 0xfffffe010821cec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010821cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010821cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010821cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100147 td 0xfffff800078cc740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082e4df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082e4e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082e4e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01082e4ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe01082e4ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082e4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082e4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100148 td 0xfffff800078cc000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082dfdf0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082dfe10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082dfe50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01082dfec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe01082dfef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082dff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082dff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100149 td 0xfffff800078cd740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082eedf0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082eee10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082eee50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01082eeec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe01082eeef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082eef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082eef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100151 td 0xfffff800078ce740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082f8df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082f8e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082f8e50 msleep_spin_sbt() at msleep_spin_sbt+0x154/frame 0xfffffe01082f8ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0x104/frame 0xfffffe01082f8ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082f8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082f8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100152 td 0xfffff800078ce000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082f3dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082f3de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082f3e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01082f3ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01082f3ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082f3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082f3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100156 td 0xfffff800078d6000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082fddc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082fdde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082fde20 _sleep() at _sleep+0x2d8/frame 0xfffffe01082fdec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01082fdef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082fdf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082fdf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100157 td 0xfffff80007885740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108316dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108316de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108316e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108316ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108316ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108316f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108316f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100158 td 0xfffff80007885000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108311dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108311de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108311e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108311ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108311ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108311f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108311f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100159 td 0xfffff80003dde740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108320dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108320de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108320e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108320ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108320ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108320f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108320f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100175 td 0xfffff800079c3740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108370dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108370de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108370e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108370ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108370ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108370f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108370f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100176 td 0xfffff800079c3000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010836bdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010836bde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010836be20 _sleep() at _sleep+0x2d8/frame 0xfffffe010836bec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010836bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010836bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010836bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100177 td 0xfffff8000e189740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010837adc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010837ade0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010837ae20 _sleep() at _sleep+0x2d8/frame 0xfffffe010837aec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010837aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010837af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010837af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100178 td 0xfffff8000e189000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108375dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108375de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108375e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108375ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108375ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108375f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108375f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100179 td 0xfffff8000e18a740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108384dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108384de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108384e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108384ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe0108384ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108384f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108384f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100180 td 0xfffff8000e18a000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010837fdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010837fde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010837fe20 _sleep() at _sleep+0x2d8/frame 0xfffffe010837fec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe010837fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010837ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010837ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100196 td 0xfffff80012765000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01083cfdc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01083cfde0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01083cfe20 _sleep() at _sleep+0x2d8/frame 0xfffffe01083cfec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01083cfef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01083cff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01083cff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100197 td 0xfffff80012766740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01083dedc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01083dede0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01083dee20 _sleep() at _sleep+0x2d8/frame 0xfffffe01083deec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc1/frame 0xfffffe01083deef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01083def30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01083def30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff80003bed000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108005a50 mi_switch() at mi_switch+0x170/frame 0xfffffe0108005a70 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108005ab0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0108005af0 _sleep() at _sleep+0x27e/frame 0xfffffe0108005b90 vm_waitpfault() at vm_waitpfault+0x74/frame 0xfffffe0108005bc0 vm_fault_allocate() at vm_fault_allocate+0x41e/frame 0xfffffe0108005c30 vm_fault() at vm_fault+0x43d/frame 0xfffffe0108005d60 vm_fault_trap() at vm_fault_trap+0x5d/frame 0xfffffe0108005da0 trap_pfault() at trap_pfault+0x21d/frame 0xfffffe0108005e10 trap() at trap+0x51d/frame 0xfffffe0108005f30 calltrap() at calltrap+0x8/frame 0xfffffe0108005f30 --- trap 0xc, rip = 0x26a970, rsp = 0x820c89e78, rbp = 0x820c89f00 --- Tracing command clock pid 2 tid 100078 td 0xfffff80003cc3000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108181ea0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108181ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe0108181ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108181f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108181f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100079 td 0xfffff80003cc4740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108190ea0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108190ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe0108190ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108190f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108190f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100080 td 0xfffff80003cc4000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010818bea0 mi_switch() at mi_switch+0x170/frame 0xfffffe010818bec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe010818bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010818bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010818bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100081 td 0xfffff80003c88740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010819aea0 mi_switch() at mi_switch+0x170/frame 0xfffffe010819aec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe010819aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010819af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010819af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100082 td 0xfffff80003c88000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108195ea0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108195ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe0108195ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108195f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108195f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100083 td 0xfffff80003c89740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081a4ea0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081a4ec0 softclock_thread() at softclock_thread+0x6e/frame 0xfffffe01081a4ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081a4f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081a4f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command clock pid 2 tid 100084 td 0xfffff80003c89000 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100085 td 0xfffff80003c8a740 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100086 td 0xfffff80003c8a000 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100087 td 0xfffff80003c8b740 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100088 td 0xfffff80003c8b000 fork_trampoline() at fork_trampoline Tracing command clock pid 2 tid 100089 td 0xfffff80003c84740 fork_trampoline() at fork_trampoline Tracing command crypto pid 3 tid 100108 td 0xfffff80003fca000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108217dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108217de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108217e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108217ec0 crypto_dispatch_thread() at crypto_dispatch_thread+0x193/frame 0xfffffe0108217ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108217f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108217f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100109 td 0xfffff80003fcb740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108226db0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108226dd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108226e10 _sleep() at _sleep+0x2d8/frame 0xfffffe0108226eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe0108226ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108226f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108226f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100110 td 0xfffff80003fcb000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108221db0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108221dd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108221e10 _sleep() at _sleep+0x2d8/frame 0xfffffe0108221eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe0108221ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108221f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108221f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100111 td 0xfffff80003fcc740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108230db0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108230dd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108230e10 _sleep() at _sleep+0x2d8/frame 0xfffffe0108230eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe0108230ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108230f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108230f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100112 td 0xfffff80003fcc000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010822bdb0 mi_switch() at mi_switch+0x170/frame 0xfffffe010822bdd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010822be10 _sleep() at _sleep+0x2d8/frame 0xfffffe010822beb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe010822bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010822bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010822bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100113 td 0xfffff80003fbf740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010823adb0 mi_switch() at mi_switch+0x170/frame 0xfffffe010823add0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010823ae10 _sleep() at _sleep+0x2d8/frame 0xfffffe010823aeb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe010823aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010823af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010823af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100114 td 0xfffff80003fbf000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108235db0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108235dd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108235e10 _sleep() at _sleep+0x2d8/frame 0xfffffe0108235eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe0108235ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108235f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108235f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100115 td 0xfffff80003fc0740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108244db0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108244dd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108244e10 _sleep() at _sleep+0x2d8/frame 0xfffffe0108244eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe0108244ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108244f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108244f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100116 td 0xfffff80003fc0000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010823fdb0 mi_switch() at mi_switch+0x170/frame 0xfffffe010823fdd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010823fe10 _sleep() at _sleep+0x2d8/frame 0xfffffe010823feb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe010823fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010823ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010823ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100117 td 0xfffff80003fc1740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010824edb0 mi_switch() at mi_switch+0x170/frame 0xfffffe010824edd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010824ee10 _sleep() at _sleep+0x2d8/frame 0xfffffe010824eeb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe010824eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010824ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010824ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100118 td 0xfffff80003fc1000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108249db0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108249dd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108249e10 _sleep() at _sleep+0x2d8/frame 0xfffffe0108249eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe0108249ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108249f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108249f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100119 td 0xfffff80003fc2740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108258db0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108258dd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108258e10 _sleep() at _sleep+0x2d8/frame 0xfffffe0108258eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe0108258ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108258f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108258f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100120 td 0xfffff80003fc2000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108253db0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108253dd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108253e10 _sleep() at _sleep+0x2d8/frame 0xfffffe0108253eb0 crypto_ret_thread() at crypto_ret_thread+0x144/frame 0xfffffe0108253ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108253f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108253f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100121 td 0xfffff801720b2740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108262da0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108262dc0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108262e00 _sleep() at _sleep+0x2d8/frame 0xfffffe0108262ea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0108262ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108262f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108262f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100122 td 0xfffff801720b2000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010825dda0 mi_switch() at mi_switch+0x170/frame 0xfffffe010825ddc0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010825de00 _sleep() at _sleep+0x2d8/frame 0xfffffe010825dea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe010825def0 fork_exit() at fork_exit+0x82/frame 0xfffffe010825df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010825df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100123 td 0xfffff801720b7740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010826cda0 mi_switch() at mi_switch+0x170/frame 0xfffffe010826cdc0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010826ce00 _sleep() at _sleep+0x2d8/frame 0xfffffe010826cea0 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe010826cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010826cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010826cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100124 td 0xfffff801720b7000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108267da0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108267dc0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108267e00 _sleep() at _sleep+0x2d8/frame 0xfffffe0108267ea0 xpt_async_td() at xpt_async_td+0x74/frame 0xfffffe0108267ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108267f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108267f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100153 td 0xfffff800078d6740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108302dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108302de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108302e20 _sleep() at _sleep+0x2d8/frame 0xfffffe0108302ec0 xpt_scanner_thread() at xpt_scanner_thread+0x138/frame 0xfffffe0108302ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108302f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108302f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command busdma pid 5 tid 100126 td 0xfffff8017257c740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108276da0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108276dc0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108276e00 _sleep() at _sleep+0x2d8/frame 0xfffffe0108276ea0 busdma_thread() at busdma_thread+0xc5/frame 0xfffffe0108276ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108276f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108276f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 6 tid 100150 td 0xfffff800078cd000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082e9d20 mi_switch() at mi_switch+0x170/frame 0xfffffe01082e9d40 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082e9d80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01082e9dc0 _sleep() at _sleep+0x27e/frame 0xfffffe01082e9e60 random_kthread() at random_kthread+0xb7/frame 0xfffffe01082e9ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082e9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082e9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 7 tid 100154 td 0xfffff80005227740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010830cd80 mi_switch() at mi_switch+0x170/frame 0xfffffe010830cda0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010830cde0 _sleep() at _sleep+0x2d8/frame 0xfffffe010830ce80 enc_daemon() at enc_daemon+0xdd/frame 0xfffffe010830cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010830cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010830cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 8 tid 100155 td 0xfffff80005227000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108307d80 mi_switch() at mi_switch+0x170/frame 0xfffffe0108307da0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108307de0 _sleep() at _sleep+0x2d8/frame 0xfffffe0108307e80 enc_daemon() at enc_daemon+0xdd/frame 0xfffffe0108307ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108307f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108307f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 9 tid 100198 td 0xfffff80012766000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01083d9980 mi_switch() at mi_switch+0x170/frame 0xfffffe01083d99a0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01083d99e0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01083d9a20 _sleep() at _sleep+0x27e/frame 0xfffffe01083d9ac0 pause_sbt() at pause_sbt+0x7d/frame 0xfffffe01083d9af0 vm_pageout_worker() at vm_pageout_worker+0x230/frame 0xfffffe01083d9eb0 vm_pageout() at vm_pageout+0x1d7/frame 0xfffffe01083d9ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01083d9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01083d9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 9 tid 100208 td 0xfffff800050d5740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010841aa70 mi_switch() at mi_switch+0x170/frame 0xfffffe010841aa90 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010841aad0 _sleep() at _sleep+0x2d8/frame 0xfffffe010841ab70 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xb52/frame 0xfffffe010841aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010841af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010841af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 9 tid 100209 td 0xfffff800050d5000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108415e20 mi_switch() at mi_switch+0x170/frame 0xfffffe0108415e40 sched_bind() at sched_bind+0xc6/frame 0xfffffe0108415e60 pcpu_cache_drain_safe() at pcpu_cache_drain_safe+0x26a/frame 0xfffffe0108415e90 uma_reclaim_domain() at uma_reclaim_domain+0x1aa/frame 0xfffffe0108415ec0 uma_reclaim_worker() at uma_reclaim_worker+0x35/frame 0xfffffe0108415ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108415f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108415f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command audit pid 10 tid 100001 td 0xfffff80003bed740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010800adc0 mi_switch() at mi_switch+0x170/frame 0xfffffe010800ade0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010800ae20 _cv_wait() at _cv_wait+0x160/frame 0xfffffe010800ae90 audit_worker() at audit_worker+0x8f/frame 0xfffffe010800aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010800af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010800af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffff80003bee740 (CPU 0) cpustop_handler() at cpustop_handler+0x27/frame 0xffffffff81d09f80 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xffffffff81d09f90 trap() at trap+0x56/frame 0xffffffff81d0a0b0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81d0a0b0 --- trap 0x13, rip = 0xffffffff8103392e, rsp = 0xfffffe0108014d78, rbp = 0xfffffe0108014db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108014db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108014dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108014df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108014ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108014f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108014f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff80003bee000 (CPU 1) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce3cdf0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce3ce00 trap() at trap+0x56/frame 0xfffffe003ce3cf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce3cf20 --- trap 0x13, rip = 0xffffffff8103392e, rsp = 0xfffffe010800fd78, rbp = 0xfffffe010800fdb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe010800fdb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe010800fdd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe010800fdf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe010800fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010800ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010800ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff80003bef740 (CPU 2) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce4bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce4be00 trap() at trap+0x56/frame 0xfffffe003ce4bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce4bf20 --- trap 0x13, rip = 0xffffffff8103392e, rsp = 0xfffffe010801ed78, rbp = 0xfffffe010801edb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe010801edb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe010801edd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe010801edf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe010801eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010801ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010801ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff80003bef000 (CPU 3) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce5adf0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce5ae00 trap() at trap+0x56/frame 0xfffffe003ce5af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce5af20 --- trap 0x13, rip = 0xffffffff8103392e, rsp = 0xfffffe0108019d78, rbp = 0xfffffe0108019db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108019db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108019dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108019df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108019ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108019f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108019f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff80003bf0740 (CPU 4) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce69df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce69e00 trap() at trap+0x56/frame 0xfffffe003ce69f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce69f20 --- trap 0x13, rip = 0xffffffff8103392e, rsp = 0xfffffe0108028d78, rbp = 0xfffffe0108028db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108028db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108028dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108028df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108028ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108028f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108028f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff80003bf0000 (CPU 5) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce78df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce78e00 trap() at trap+0x56/frame 0xfffffe003ce78f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce78f20 --- trap 0x13, rip = 0xffffffff8103392e, rsp = 0xfffffe0108023d78, rbp = 0xfffffe0108023db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108023db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108023dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108023df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108023ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108023f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108023f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff80003bd9740 (CPU 6) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ce87df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ce87e00 trap() at trap+0x56/frame 0xfffffe003ce87f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ce87f20 --- trap 0x13, rip = 0xffffffff8103392e, rsp = 0xfffffe0108032d78, rbp = 0xfffffe0108032db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108032db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108032dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108032df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108032ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108032f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108032f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff80003bd9000 (CPU 7) kdb_enter() at kdb_enter+0x33/frame 0xfffffe010802dc00 handleevents() at handleevents+0xaf/frame 0xfffffe010802dc40 timercb() at timercb+0x18e/frame 0xfffffe010802dc90 lapic_handle_timer() at lapic_handle_timer+0xab/frame 0xfffffe010802dcb0 Xtimerint() at Xtimerint+0xb1/frame 0xfffffe010802dcb0 --- interrupt, rip = 0xffffffff804c63de, rsp = 0xfffffe010802dd80, rbp = 0xfffffe010802ddb0 --- acpi_cpu_idle() at acpi_cpu_idle+0x27e/frame 0xfffffe010802ddb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe010802ddd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe010802ddf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe010802def0 fork_exit() at fork_exit+0x82/frame 0xfffffe010802df30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010802df30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff80003bda740 (CPU 8) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003cea5df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003cea5e00 trap() at trap+0x56/frame 0xfffffe003cea5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cea5f20 --- trap 0x13, rip = 0xffffffff8103392e, rsp = 0xfffffe010803cd78, rbp = 0xfffffe010803cdb0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe010803cdb0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe010803cdd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe010803cdf0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe010803cef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010803cf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010803cf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff80003bda000 (CPU 9) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ceb4df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ceb4e00 trap() at trap+0x56/frame 0xfffffe003ceb4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ceb4f20 --- trap 0x13, rip = 0xffffffff8103392e, rsp = 0xfffffe0108037d78, rbp = 0xfffffe0108037db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108037db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108037dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108037df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108037ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108037f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108037f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff80003bdb740 (CPU 10) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003cec3df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003cec3e00 trap() at trap+0x56/frame 0xfffffe003cec3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003cec3f20 --- trap 0x13, rip = 0xffffffff8103392e, rsp = 0xfffffe0108046d78, rbp = 0xfffffe0108046db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108046db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108046dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108046df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108046ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108046f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108046f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff80003bdb000 (CPU 11) cpustop_handler() at cpustop_handler+0x27/frame 0xfffffe003ced2df0 ipi_nmi_handler() at ipi_nmi_handler+0x38/frame 0xfffffe003ced2e00 trap() at trap+0x56/frame 0xfffffe003ced2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003ced2f20 --- trap 0x13, rip = 0xffffffff8103392e, rsp = 0xfffffe0108041d78, rbp = 0xfffffe0108041db0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x6e/frame 0xfffffe0108041db0 cpu_idle_acpi() at cpu_idle_acpi+0x50/frame 0xfffffe0108041dd0 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe0108041df0 sched_idletd() at sched_idletd+0x534/frame 0xfffffe0108041ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108041f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108041f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100042 td 0xfffff80003b90000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01080cde40 mi_switch() at mi_switch+0x170/frame 0xfffffe01080cde60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe01080cdef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01080cdf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01080cdf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100043 td 0xfffff80003b91740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100045 td 0xfffff80003b92740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100090 td 0xfffff80003c84000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081bde40 mi_switch() at mi_switch+0x170/frame 0xfffffe01081bde60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe01081bdef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081bdf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081bdf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100125 td 0xfffff80003cc3740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108186e40 mi_switch() at mi_switch+0x170/frame 0xfffffe0108186e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0108186ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108186f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108186f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100127 td 0xfffff8017257c000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108271e40 mi_switch() at mi_switch+0x170/frame 0xfffffe0108271e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0108271ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108271f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108271f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100133 td 0xfffff80172586000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010828fe40 mi_switch() at mi_switch+0x170/frame 0xfffffe010828fe60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010828fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010828ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010828ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100144 td 0xfffff8017286f000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100145 td 0xfffff80172877740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100146 td 0xfffff80172877000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082d5e40 mi_switch() at mi_switch+0x170/frame 0xfffffe01082d5e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe01082d5ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082d5f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082d5f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100160 td 0xfffff80003dde000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010831be40 mi_switch() at mi_switch+0x170/frame 0xfffffe010831be60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010831bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010831bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010831bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100161 td 0xfffff800079cd740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010832ae40 mi_switch() at mi_switch+0x170/frame 0xfffffe010832ae60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010832aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010832af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010832af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100162 td 0xfffff800079cd000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100163 td 0xfffff800079ce740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100164 td 0xfffff800079ce000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100165 td 0xfffff800079cf740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100166 td 0xfffff800079cf000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100167 td 0xfffff800079d7740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100168 td 0xfffff800079d7000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100169 td 0xfffff800079c0740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100170 td 0xfffff800079c0000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100171 td 0xfffff800079c1740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100172 td 0xfffff800079c1000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100173 td 0xfffff800079c2740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100174 td 0xfffff800079c2000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100181 td 0xfffff8000e18b740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010838ee40 mi_switch() at mi_switch+0x170/frame 0xfffffe010838ee60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe010838eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010838ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010838ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100182 td 0xfffff8000e18b000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108389e40 mi_switch() at mi_switch+0x170/frame 0xfffffe0108389e60 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0108389ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108389f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108389f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100183 td 0xfffff8000e18c740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100184 td 0xfffff8000e18c000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100185 td 0xfffff80012768740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100186 td 0xfffff80012768000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100187 td 0xfffff80012769740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100188 td 0xfffff80012769000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100189 td 0xfffff8001276a740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100190 td 0xfffff8001276a000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100191 td 0xfffff8001276b740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100192 td 0xfffff8001276b000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100193 td 0xfffff80012764740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100194 td 0xfffff80012764000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100195 td 0xfffff80012765740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100241 td 0xfffff8001295a740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100242 td 0xfffff8001295a000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100243 td 0xfffff80012ee9740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100244 td 0xfffff80012ee9000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100245 td 0xfffff80012976740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100246 td 0xfffff80012976000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100247 td 0xfffff8001295f740 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100248 td 0xfffff8001295f000 fork_trampoline() at fork_trampoline Tracing command geom pid 13 tid 100092 td 0xfffff80003c85000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081c7dc0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081c7de0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081c7e20 _sleep() at _sleep+0x2d8/frame 0xfffffe01081c7ec0 g_run_events() at g_run_events+0x434/frame 0xfffffe01081c7ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081c7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081c7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100093 td 0xfffff80003c86740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081d6db0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081d6dd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081d6e10 _sleep() at _sleep+0x2d8/frame 0xfffffe01081d6eb0 g_io_schedule_up() at g_io_schedule_up+0x3c/frame 0xfffffe01081d6ee0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe01081d6ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081d6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081d6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100094 td 0xfffff80003c86000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081d1db0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081d1dd0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081d1e10 _sleep() at _sleep+0x2d8/frame 0xfffffe01081d1eb0 g_io_schedule_down() at g_io_schedule_down+0x3c/frame 0xfffffe01081d1ee0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe01081d1ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081d1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081d1f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100095 td 0xfffff80003c87740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01081e0da0 mi_switch() at mi_switch+0x170/frame 0xfffffe01081e0dc0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01081e0e00 _cv_wait() at _cv_wait+0x160/frame 0xfffffe01081e0e70 seq_eventthread() at seq_eventthread+0x8c/frame 0xfffffe01081e0ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081e0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081e0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100128 td 0xfffff8017257d740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108280df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108280e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108280e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe0108280ec0 usb_process() at usb_process+0xb0/frame 0xfffffe0108280ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108280f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108280f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100129 td 0xfffff8017257d000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010827bdf0 mi_switch() at mi_switch+0x170/frame 0xfffffe010827be10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010827be50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe010827bec0 usb_process() at usb_process+0xb0/frame 0xfffffe010827bef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010827bf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010827bf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100130 td 0xfffff8017257e740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010828adf0 mi_switch() at mi_switch+0x170/frame 0xfffffe010828ae10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010828ae50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe010828aec0 usb_process() at usb_process+0xb0/frame 0xfffffe010828aef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010828af30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010828af30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100131 td 0xfffff8017257e000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108285df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108285e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108285e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe0108285ec0 usb_process() at usb_process+0xb0/frame 0xfffffe0108285ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108285f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108285f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100132 td 0xfffff80172586740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108294df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108294e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108294e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe0108294ec0 usb_process() at usb_process+0xb0/frame 0xfffffe0108294ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108294f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108294f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100134 td 0xfffff80172974740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010829edf0 mi_switch() at mi_switch+0x170/frame 0xfffffe010829ee10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010829ee50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe010829eec0 usb_process() at usb_process+0xb0/frame 0xfffffe010829eef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010829ef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010829ef30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100135 td 0xfffff80172974000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108299df0 mi_switch() at mi_switch+0x170/frame 0xfffffe0108299e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108299e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe0108299ec0 usb_process() at usb_process+0xb0/frame 0xfffffe0108299ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108299f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108299f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100136 td 0xfffff80172975740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082a8df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082a8e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082a8e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe01082a8ec0 usb_process() at usb_process+0xb0/frame 0xfffffe01082a8ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082a8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082a8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100137 td 0xfffff80172975000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082a3df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082a3e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082a3e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe01082a3ec0 usb_process() at usb_process+0xb0/frame 0xfffffe01082a3ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082a3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082a3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100138 td 0xfffff80172976740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082b2df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082b2e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082b2e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe01082b2ec0 usb_process() at usb_process+0xb0/frame 0xfffffe01082b2ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082b2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082b2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100139 td 0xfffff8017286d740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082bcdf0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082bce10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082bce50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe01082bcec0 usb_process() at usb_process+0xb0/frame 0xfffffe01082bcef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082bcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082bcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100140 td 0xfffff8017286d000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082b7df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082b7e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082b7e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe01082b7ec0 usb_process() at usb_process+0xb0/frame 0xfffffe01082b7ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082b7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082b7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100141 td 0xfffff8017286e740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082c6df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082c6e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082c6e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe01082c6ec0 usb_process() at usb_process+0xb0/frame 0xfffffe01082c6ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082c6f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082c6f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100142 td 0xfffff8017286e000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082c1df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082c1e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082c1e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe01082c1ec0 usb_process() at usb_process+0xb0/frame 0xfffffe01082c1ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082c1f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082c1f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 15 tid 100143 td 0xfffff8017286f740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082d0df0 mi_switch() at mi_switch+0x170/frame 0xfffffe01082d0e10 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082d0e50 _cv_wait() at _cv_wait+0x160/frame 0xfffffe01082d0ec0 usb_process() at usb_process+0xb0/frame 0xfffffe01082d0ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082d0f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082d0f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 16 tid 100199 td 0xfffff80012767740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01083e8dd0 mi_switch() at mi_switch+0x170/frame 0xfffffe01083e8df0 sched_bind() at sched_bind+0xc6/frame 0xfffffe01083e8e10 vm_page_pqbatch_drain() at vm_page_pqbatch_drain+0x7f/frame 0xfffffe01083e8e80 vm_daemon() at vm_daemon+0xc1/frame 0xfffffe01083e8ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01083e8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01083e8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100200 td 0xfffff80012767000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01083e3d60 mi_switch() at mi_switch+0x170/frame 0xfffffe01083e3d80 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01083e3dc0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01083e3e00 _sleep() at _sleep+0x27e/frame 0xfffffe01083e3ea0 buf_daemon() at buf_daemon+0x121/frame 0xfffffe01083e3ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01083e3f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01083e3f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100201 td 0xfffff8000774b740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01083f2d40 mi_switch() at mi_switch+0x170/frame 0xfffffe01083f2d60 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01083f2da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01083f2de0 _sleep() at _sleep+0x27e/frame 0xfffffe01083f2e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe01083f2ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01083f2f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01083f2f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100202 td 0xfffff8000774b000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01083edd40 mi_switch() at mi_switch+0x170/frame 0xfffffe01083edd60 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01083edda0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01083edde0 _sleep() at _sleep+0x27e/frame 0xfffffe01083ede80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe01083edef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01083edf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01083edf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100203 td 0xfffff8000774c740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01083fcd40 mi_switch() at mi_switch+0x170/frame 0xfffffe01083fcd60 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01083fcda0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01083fcde0 _sleep() at _sleep+0x27e/frame 0xfffffe01083fce80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe01083fcef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01083fcf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01083fcf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100204 td 0xfffff8000774c000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01083f7d40 mi_switch() at mi_switch+0x170/frame 0xfffffe01083f7d60 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01083f7da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01083f7de0 _sleep() at _sleep+0x27e/frame 0xfffffe01083f7e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe01083f7ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01083f7f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01083f7f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100205 td 0xfffff8000774d740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108406d40 mi_switch() at mi_switch+0x170/frame 0xfffffe0108406d60 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108406da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0108406de0 _sleep() at _sleep+0x27e/frame 0xfffffe0108406e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe0108406ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108406f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108406f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100206 td 0xfffff8000774d000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108401d40 mi_switch() at mi_switch+0x170/frame 0xfffffe0108401d60 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108401da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0108401de0 _sleep() at _sleep+0x27e/frame 0xfffffe0108401e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe0108401ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108401f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108401f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100207 td 0xfffff8000774e740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108410d40 mi_switch() at mi_switch+0x170/frame 0xfffffe0108410d60 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108410da0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0108410de0 _sleep() at _sleep+0x27e/frame 0xfffffe0108410e80 bufspace_daemon() at bufspace_daemon+0x322/frame 0xfffffe0108410ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108410f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108410f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100233 td 0xfffff80172976000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01082add70 mi_switch() at mi_switch+0x170/frame 0xfffffe01082add90 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01082addd0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01082ade10 _sleep() at _sleep+0x27e/frame 0xfffffe01082adeb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe01082adef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01082adf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01082adf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 17 tid 100250 td 0xfffff8002023f740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe01084d8d70 mi_switch() at mi_switch+0x170/frame 0xfffffe01084d8d90 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe01084d8dd0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe01084d8e10 _sleep() at _sleep+0x27e/frame 0xfffffe01084d8eb0 softdep_flush() at softdep_flush+0x188/frame 0xfffffe01084d8ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01084d8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01084d8f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vnlru pid 18 tid 100210 td 0xfffff80012b26740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108424d10 mi_switch() at mi_switch+0x170/frame 0xfffffe0108424d30 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108424d70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0108424db0 _sleep() at _sleep+0x27e/frame 0xfffffe0108424e50 vnlru_proc() at vnlru_proc+0x18b/frame 0xfffffe0108424ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe0108424f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0108424f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 19 tid 100211 td 0xfffff80012b26000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010841fd30 mi_switch() at mi_switch+0x170/frame 0xfffffe010841fd50 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010841fd90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe010841fdd0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x187/frame 0xfffffe010841fe60 sched_sync() at sched_sync+0x6ae/frame 0xfffffe010841fef0 fork_exit() at fork_exit+0x82/frame 0xfffffe010841ff30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe010841ff30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sshd pid 35892 tid 126405 td 0xfffff804fa038000 thread_exit() at thread_exit+0x1ea/frame 0xfffffe01a2cc7860 exit1() at exit1+0xe0f/frame 0xfffffe01a2cc78d0 sigexit() at sigexit+0x171/frame 0xfffffe01a2cc7d50 postsig() at postsig+0x1a5/frame 0xfffffe01a2cc7e20 ast_sig() at ast_sig+0x33b/frame 0xfffffe01a2cc7ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01a2cc7f10 ast() at ast+0x20/frame 0xfffffe01a2cc7f30 doreti_ast() at doreti_ast+0x1c/frame 0x97908d3cca0 Tracing command sh pid 35900 tid 128646 td 0xfffff804b6d18000 thread_exit() at thread_exit+0x1ea/frame 0xfffffe01a5ca1860 exit1() at exit1+0xe0f/frame 0xfffffe01a5ca18d0 sigexit() at sigexit+0x171/frame 0xfffffe01a5ca1d50 postsig() at postsig+0x1a5/frame 0xfffffe01a5ca1e20 ast_sig() at ast_sig+0x33b/frame 0xfffffe01a5ca1ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01a5ca1f10 ast() at ast+0x20/frame 0xfffffe01a5ca1f30 doreti_ast() at doreti_ast+0x1c/frame 0xae507ad2ae0 Tracing command dhclient pid 3199 tid 100259 td 0xfffff80005231000 thread_exit() at thread_exit+0x1ea/frame 0xfffffe01084e7860 exit1() at exit1+0xe0f/frame 0xfffffe01084e78d0 sigexit() at sigexit+0x171/frame 0xfffffe01084e7d50 postsig() at postsig+0x1a5/frame 0xfffffe01084e7e20 ast_sig() at ast_sig+0x33b/frame 0xfffffe01084e7ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01084e7f10 ast() at ast+0x20/frame 0xfffffe01084e7f30 doreti_ast() at doreti_ast+0x1c/frame 0x268b3e8b09a0 Tracing command dhclient pid 3202 tid 100294 td 0xfffff8004590c740 thread_exit() at thread_exit+0x1ea/frame 0xfffffe01084c9860 exit1() at exit1+0xe0f/frame 0xfffffe01084c98d0 sigexit() at sigexit+0x171/frame 0xfffffe01084c9d50 postsig() at postsig+0x1a5/frame 0xfffffe01084c9e20 ast_sig() at ast_sig+0x33b/frame 0xfffffe01084c9ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01084c9f10 ast() at ast+0x20/frame 0xfffffe01084c9f30 doreti_ast() at doreti_ast+0x1c/frame 0x268b3e8af880 Tracing command dhclient pid 3261 tid 100272 td 0xfffff80012b2d000 thread_exit() at thread_exit+0x1ea/frame 0xfffffe0108479860 exit1() at exit1+0xe0f/frame 0xfffffe01084798d0 sigexit() at sigexit+0x171/frame 0xfffffe0108479d50 postsig() at postsig+0x1a5/frame 0xfffffe0108479e20 ast_sig() at ast_sig+0x33b/frame 0xfffffe0108479ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe0108479f10 ast() at ast+0x20/frame 0xfffffe0108479f30 doreti_ast() at doreti_ast+0x1c/frame 0x268b3e8b0b60 Tracing command syslogd pid 3424 tid 100328 td 0xfffff80007959000 --- swapped out Tracing command watchdogd pid 3441 tid 100256 td 0xfffff800127db000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe0108456b10 mi_switch() at mi_switch+0x170/frame 0xfffffe0108456b30 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe0108456b70 _sleep() at _sleep+0x2d8/frame 0xfffffe0108456c10 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe0108456c40 vm_forkproc() at vm_forkproc+0xaa/frame 0xfffffe0108456c90 do_fork() at do_fork+0xcf8/frame 0xfffffe0108456d30 fork1() at fork1+0x70a/frame 0xfffffe0108456da0 sys_vfork() at sys_vfork+0x54/frame 0xfffffe0108456e00 amd64_syscall() at amd64_syscall+0x158/frame 0xfffffe0108456f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0108456f30 --- syscall (66, FreeBSD ELF64, vfork), rip = 0x17ce7ad124ab, rsp = 0x17ce7725a940, rbp = 0x17ce7725aa00 --- Tracing command powerd pid 3556 tid 100336 td 0xfffff800458c3000 thread_exit() at thread_exit+0x1ea/frame 0xfffffe010845b860 exit1() at exit1+0xe0f/frame 0xfffffe010845b8d0 sigexit() at sigexit+0x171/frame 0xfffffe010845bd50 postsig() at postsig+0x1a5/frame 0xfffffe010845be20 ast_sig() at ast_sig+0x33b/frame 0xfffffe010845bed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe010845bf10 ast() at ast+0x20/frame 0xfffffe010845bf30 doreti_ast() at doreti_ast+0x1c/frame 0x3105970ab660 Tracing command inetd pid 3577 tid 100341 td 0xfffff8000aaef740 sched_switch() at sched_switch+0x5c6/frame 0xfffffe010858ca90 mi_switch() at mi_switch+0x170/frame 0xfffffe010858cab0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe010858caf0 sleepq_catch_signals() at sleepq_catch_signals+0x282/frame 0xfffffe010858cb50 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe010858cb60 _cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe010858cbd0 kern_select() at kern_select+0xa29/frame 0xfffffe010858cdc0 sys_select() at sys_select+0x57/frame 0xfffffe010858ce00 amd64_syscall() at amd64_syscall+0x158/frame 0xfffffe010858cf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe010858cf30 --- syscall (93, FreeBSD ELF64, select), rip = 0x15b64b93a83a, rsp = 0x15b646e28498, rbp = 0x15b646e29320 --- Tracing command cron pid 3582 tid 100249 td 0xfffff80012bfc740 --- swapped out Tracing command sshd pid 3599 tid 100228 td 0xfffff80012bfb000 --- swapped out Tracing command getty pid 3613 tid 100212 td 0xfffff80012bfa740 thread_exit() at thread_exit+0x1ea/frame 0xfffffe010842e860 exit1() at exit1+0xe0f/frame 0xfffffe010842e8d0 sigexit() at sigexit+0x171/frame 0xfffffe010842ed50 postsig() at postsig+0x1a5/frame 0xfffffe010842ee20 ast_sig() at ast_sig+0x33b/frame 0xfffffe010842eed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe010842ef10 ast() at ast+0x20/frame 0xfffffe010842ef30 doreti_ast() at doreti_ast+0x1c/frame 0x1246a9367860 Tracing command getty pid 3614 tid 100234 td 0xfffff80012b2c000 thread_exit() at thread_exit+0x1ea/frame 0xfffffe0108460860 exit1() at exit1+0xe0f/frame 0xfffffe01084608d0 sigexit() at sigexit+0x171/frame 0xfffffe0108460d50 postsig() at postsig+0x1a5/frame 0xfffffe0108460e20 ast_sig() at ast_sig+0x33b/frame 0xfffffe0108460ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe0108460f10 ast() at ast+0x20/frame 0xfffffe0108460f30 doreti_ast() at doreti_ast+0x1c/frame 0x158705158330 Tracing command getty pid 3615 tid 100231 td 0xfffff80007958000 thread_exit() at thread_exit+0x1ea/frame 0xfffffe010843d860 exit1() at exit1+0xe0f/frame 0xfffffe010843d8d0 sigexit() at sigexit+0x171/frame 0xfffffe010843dd50 postsig() at postsig+0x1a5/frame 0xfffffe010843de20 ast_sig() at ast_sig+0x33b/frame 0xfffffe010843ded0 ast_handler() at ast_handler+0xe8/frame 0xfffffe010843df10 ast() at ast+0x20/frame 0xfffffe010843df30 doreti_ast() at doreti_ast+0x1c/frame 0x1dd43aace70 Tracing command getty pid 3616 tid 100236 td 0xfffff8000774e000 thread_exit() at thread_exit+0x1ea/frame 0xfffffe010840b860 exit1() at exit1+0xe0f/frame 0xfffffe010840b8d0 sigexit() at sigexit+0x171/frame 0xfffffe010840bd50 postsig() at postsig+0x1a5/frame 0xfffffe010840be20 ast_sig() at ast_sig+0x33b/frame 0xfffffe010840bed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe010840bf10 ast() at ast+0x20/frame 0xfffffe010840bf30 doreti_ast() at doreti_ast+0x1c/frame 0x2908f7d69300 Tracing command getty pid 3617 tid 100253 td 0xfffff80172977740 thread_exit() at thread_exit+0x1ea/frame 0xfffffe01084e2860 exit1() at exit1+0xe0f/frame 0xfffffe01084e28d0 sigexit() at sigexit+0x171/frame 0xfffffe01084e2d50 postsig() at postsig+0x1a5/frame 0xfffffe01084e2e20 ast_sig() at ast_sig+0x33b/frame 0xfffffe01084e2ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01084e2f10 ast() at ast+0x20/frame 0xfffffe01084e2f30 doreti_ast() at doreti_ast+0x1c/frame 0x3728dc2daa0 Tracing command getty pid 3618 tid 100229 td 0xfffff80005229000 thread_exit() at thread_exit+0x1ea/frame 0xfffffe0108429860 exit1() at exit1+0xe0f/frame 0xfffffe01084298d0 sigexit() at sigexit+0x171/frame 0xfffffe0108429d50 postsig() at postsig+0x1a5/frame 0xfffffe0108429e20 ast_sig() at ast_sig+0x33b/frame 0xfffffe0108429ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe0108429f10 ast() at ast+0x20/frame 0xfffffe0108429f30 doreti_ast() at doreti_ast+0x1c/frame 0xdaa00bcace0 Tracing command getty pid 3619 tid 100215 td 0xfffff800050d6740 thread_exit() at thread_exit+0x1ea/frame 0xfffffe010844c860 exit1() at exit1+0xe0f/frame 0xfffffe010844c8d0 sigexit() at sigexit+0x171/frame 0xfffffe010844cd50 postsig() at postsig+0x1a5/frame 0xfffffe010844ce20 ast_sig() at ast_sig+0x33b/frame 0xfffffe010844ced0 ast_handler() at ast_handler+0xe8/frame 0xfffffe010844cf10 ast() at ast+0x20/frame 0xfffffe010844cf30 doreti_ast() at doreti_ast+0x1c/frame 0x2ffbb1c7f620 Tracing command getty pid 3621 tid 100346 td 0xfffff80003ddf000 thread_exit() at thread_exit+0x1ea/frame 0xfffffe0108573860 exit1() at exit1+0xe0f/frame 0xfffffe01085738d0 sigexit() at sigexit+0x171/frame 0xfffffe0108573d50 postsig() at postsig+0x1a5/frame 0xfffffe0108573e20 ast_sig() at ast_sig+0x33b/frame 0xfffffe0108573ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe0108573f10 ast() at ast+0x20/frame 0xfffffe0108573f30 doreti_ast() at doreti_ast+0x1c/frame 0x339586730810 Tracing command sh pid 4266 tid 100269 td 0xfffff80045887740 thread_exit() at thread_exit+0x1ea/frame 0xfffffe0108528860 exit1() at exit1+0xe0f/frame 0xfffffe01085288d0 sigexit() at sigexit+0x171/frame 0xfffffe0108528d50 postsig() at postsig+0x1a5/frame 0xfffffe0108528e20 ast_sig() at ast_sig+0x33b/frame 0xfffffe0108528ed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe0108528f10 ast() at ast+0x20/frame 0xfffffe0108528f30 doreti_ast() at doreti_ast+0x1c/frame 0x21570e701e30 Tracing command sh pid 55566 tid 101140 td 0xfffff803e1f67740 thread_exit() at thread_exit+0x1ea/frame 0xfffffe01087ee860 exit1() at exit1+0xe0f/frame 0xfffffe01087ee8d0 sigexit() at sigexit+0x171/frame 0xfffffe01087eed50 postsig() at postsig+0x1a5/frame 0xfffffe01087eee20 ast_sig() at ast_sig+0x33b/frame 0xfffffe01087eeed0 ast_handler() at ast_handler+0xe8/frame 0xfffffe01087eef10 ast() at ast+0x20/frame 0xfffffe01087eef30 doreti_ast() at doreti_ast+0x1c/frame 0x21570e701ae0 Tracing command dd pid 55577 tid 120853 td 0xfffff8033275b000 sched_switch() at sched_switch+0x5c6/frame 0xfffffe017f24f7d0 mi_switch() at mi_switch+0x170/frame 0xfffffe017f24f7f0 sleepq_switch() at sleepq_switch+0x101/frame 0xfffffe017f24f830 _sleep() at _sleep+0x2d8/frame 0xfffffe017f24f8d0 vm_wait_doms() at vm_wait_doms+0xe3/frame 0xfffffe017f24f900 vm_domainset_iter_page() at vm_domainset_iter_page+0xad/frame 0xfffffe017f24f930 vm_page_grab_valid() at vm_page_grab_valid+0x182/frame 0xfffffe017f24fa60 uiomove_object() at uiomove_object+0x110/frame 0xfffffe017f24fac0 tmpfs_write() at tmpfs_write+0xd7/frame 0xfffffe017f24fb10 VOP_WRITE_APV() at VOP_WRITE_APV+0xc9/frame 0xfffffe017f24fc20 vn_write() at vn_write+0x2e7/frame 0xfffffe017f24fcb0 vn_io_fault() at vn_io_fault+0x1e5/frame 0xfffffe017f24fd40 dofilewrite() at dofilewrite+0x7f/frame 0xfffffe017f24fd90 sys_write() at sys_write+0xb7/frame 0xfffffe017f24fe00 amd64_syscall() at amd64_syscall+0x158/frame 0xfffffe017f24ff30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe017f24ff30 --- syscall (4, FreeBSD ELF64, write), rip = 0x24cf5adf29da, rsp = 0x24cf56e5e818, rbp = 0x24cf56e5e850 --- Tracing command watchdogd pid 55578 tid 100354 td 0xfffff80007725000 thread_exit() at thread_exit+0x1ea/frame 0xfffffe0108555d80 exit1() at exit1+0xe0f/frame 0xfffffe0108555df0 sys_exit() at sys_exit+0xd/frame 0xfffffe0108555e00 amd64_syscall() at amd64_syscall+0x158/frame 0xfffffe0108555f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0108555f30 --- syscall (1, FreeBSD ELF64, exit), rip = 0x32bf008eb4ba, rsp = 0x32befe8c88a8, rbp = 0x32befe8c88c0 --- db> reset U (kgdb) proc 55577 (kgdb) bt #0 sched_switch (td=td@entry=0xfffff8033275b000, flags=flags@entry=0x103) at ../../../kern/sched_ule.c:2290 #1 0xffffffff80b5d1c0 in mi_switch (flags=flags@entry=0x103) at ../../../kern/kern_synch.c:546 #2 0xffffffff80bb3ba1 in sleepq_switch (wchan=0xffffffff818076c0 , pri=0x34) at ../../../kern/subr_sleepqueue.c:607 #3 0xffffffff80bb3a7c in sleepq_wait (wchan=, pri=) at ../../../kern/subr_sleepqueue.c:658 #4 0xffffffff80b5c708 in _sleep (ident=0xffffffff818076c0 , lock=0xffffffff81803680 , priority=0x234, wmesg=0xffffffff81150ade "vmwait", sbt=0x0, pr=pr@entry=0x0, flags=0x100) at ../../../kern/kern_synch.c:221 #5 0xffffffff80f1a2e3 in vm_wait_doms (wdoms=wdoms@entry=0xfffffe017f24f950, mflags=mflags@entry=0x0) at ../../../vm/vm_page.c:3399 #6 0xffffffff80efa10d in vm_domainset_iter_page (di=di@entry=0xfffffe017f24f940, obj=obj@entry=0xfffff805f338a000, domain=domain@entry=0xfffffe017f24fa2c) at ../../../vm/vm_domainset.c:253 #7 0xffffffff80f1c742 in vm_page_alloc_after (object=0xfffff805f338a000, pindex=0x757a66, req=0x8000, mpred=0xfffffe0021888910) at ../../../vm/vm_page.c:2016 #8 vm_page_alloc (object=0xfffff805f338a000, pindex=0x757a66, req=0x10) at ../../../vm/vm_page.c:1983 #9 vm_page_grab_valid (mp=mp@entry=0xfffffe017f24fa90, object=object@entry=0xfffff805f338a000, pindex=pindex@entry=0x757a66, allocflags=allocflags@entry=0x5000) at ../../../vm/vm_page.c:4852 #10 0xffffffff80bfe480 in uiomove_object_page (obj=0xfffff805f338a000, len=, uio=0xfffffe017f24fda8) at ../../../kern/uipc_shm.c:232 #11 uiomove_object (obj=0xfffff805f338a000, obj_size=0x757b00000, uio=uio@entry=0xfffffe017f24fda8) at ../../../kern/uipc_shm.c:268 #12 0xffffffff80a70997 in tmpfs_write (v=0xfffffe017f24fc48) at ../../../fs/tmpfs/tmpfs_vnops.c:697 #13 0xffffffff8113f599 in VOP_WRITE_APV (vop=0xffffffff818b6a60 , a=a@entry=0xfffffe017f24fc48) at vnode_if.c:1167 #14 0xffffffff80c6b227 in VOP_WRITE (vp=0xfffffe0174d28e10, uio=0xfffffe017f24fda8, ioflag=0x7f0001, cred=) at ./vnode_if.h:595 #15 vn_write (fp=fp@entry=0xfffff803e1ec50f0, uio=uio@entry=0xfffffe017f24fda8, active_cred=active_cred@entry=0xfffff80012806000, flags=, td=td@entry=0xfffff8033275b000) at ../../../kern/vfs_vnops.c:1193 #16 0xffffffff80c63995 in vn_io_fault (fp=0xfffff803e1ec50f0, fp@entry=, uio=0xfffffe017f24fda8, uio@entry=, active_cred=0xfffff80012806000, active_cred@entry=, flags=0x0, flags@entry=, td=, td@entry=) at ../../../kern/vfs_vnops.c:1507 #17 0xffffffff80bcd5ff in fo_write (fp=0xfffff803e1ec50f0, uio=0xfffffe017f24fda8, active_cred=, flags=0x0, td=0xfffff8033275b000) at ../../../sys/file.h:352 #18 dofilewrite (td=td@entry=0xfffff8033275b000, fd=fd@entry=0x4, fp=0xfffff803e1ec50f0, auio=auio@entry=0xfffffe017f24fda8, offset=offset@entry=0xffffffffffffffff, flags=flags@entry=0x0) at ../../../kern/sys_generic.c:562 #19 0xffffffff80bcd187 in kern_writev (td=0xfffff8033275b000, fd=0x4, auio=0xfffffe017f24fda8) at ../../../kern/sys_generic.c:489 #20 sys_write (td=0xfffff8033275b000, uap=) at ../../../kern/sys_generic.c:404 #21 0xffffffff81077918 in syscallenter (td=0xfffff8033275b000) at ../../../amd64/amd64/../../kern/subr_syscall.c:189 #22 amd64_syscall (td=0xfffff8033275b000, traced=0x0) at ../../../amd64/amd64/trap.c:1192 #23 #24 0x000024cf5adf29da in ?? () Backtrace stopped: Cannot access memory at address 0x24cf56e5e818 (kgdb) f 5 #5 0xffffffff80f1a2e3 in vm_wait_doms (wdoms=wdoms@entry=0xfffffe017f24f950, mflags=mflags@entry=0x0) at ../../../vm/vm_page.c:3399 3399 error = msleep(&vm_pageproc_waiters, &vm_domainset_lock, (kgdb) l 3394 * race-free vm_wait_domain(). 3395 */ 3396 if (curproc == pageproc) { 3397 mtx_lock(&vm_domainset_lock); 3398 vm_pageproc_waiters++; 3399 error = msleep(&vm_pageproc_waiters, &vm_domainset_lock, 3400 PVM | PDROP | mflags, "pageprocwait", 1); 3401 } else { 3402 /* 3403 * XXX Ideally we would wait only until the allocation could (kgdb) info loc error = 0x0 (kgdb) p/d vm_pageproc_waiters $1 = 0 (kgdb) p vm_domainset_lock $2 = {lock_object = {lo_name = 0xffffffff812cbd96 "vm domainset lock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffff8087fd76180}, mtx_lock = 0x0} (kgdb) diff --git a/sys/kern/subr_pctrie.c b/sys/kern/subr_pctrie.c index 6949e3de99bfb..3e45ea631b1a0 100644 --- a/sys/kern/subr_pctrie.c +++ b/sys/kern/subr_pctrie.c @@ -63,7 +63,6 @@ #endif #define PCTRIE_MASK (PCTRIE_COUNT - 1) -#define PCTRIE_LIMIT (howmany(sizeof(uint64_t) * NBBY, PCTRIE_WIDTH) - 1) #if PCTRIE_WIDTH == 3 typedef uint8_t pn_popmap_t; @@ -738,42 +737,25 @@ pctrie_subtree_lookup_lt_assert(struct pctrie_node *node, uint64_t index, } #endif -/* - * Remove the specified index from the tree, and return the value stored at - * that index. If the index is not present, return NULL. - */ -uint64_t * -pctrie_remove_lookup(struct pctrie *ptree, uint64_t index, - struct pctrie_node **freenode) +static void +pctrie_remove(struct pctrie *ptree, uint64_t index, struct pctrie_node *parent, + struct pctrie_node *node, struct pctrie_node **freenode) { - struct pctrie_node *child, *node, *parent; - uint64_t *m; + struct pctrie_node *child; int slot; - *freenode = node = NULL; - child = pctrie_root_load(ptree, NULL, PCTRIE_LOCKED); - for (;;) { - if (pctrie_isleaf(child)) - break; - parent = node; - node = child; - slot = pctrie_slot(node, index); - child = pctrie_node_load(&node->pn_child[slot], NULL, - PCTRIE_LOCKED); - } - if ((m = pctrie_toval(child)) == NULL || *m != index) - return (NULL); if (node == NULL) { pctrie_root_store(ptree, PCTRIE_NULL, PCTRIE_LOCKED); - return (m); + return; } + slot = pctrie_slot(node, index); KASSERT((node->pn_popmap & (1 << slot)) != 0, ("%s: bad popmap slot %d in node %p", __func__, slot, node)); node->pn_popmap ^= 1 << slot; pctrie_node_store(&node->pn_child[slot], PCTRIE_NULL, PCTRIE_LOCKED); if (!powerof2(node->pn_popmap)) - return (m); + return; KASSERT(node->pn_popmap != 0, ("%s: bad popmap all zeroes", __func__)); slot = ffs(node->pn_popmap) - 1; child = pctrie_node_load(&node->pn_child[slot], NULL, PCTRIE_LOCKED); @@ -795,6 +777,33 @@ pctrie_remove_lookup(struct pctrie *ptree, uint64_t index, */ pctrie_node_put(node); *freenode = node; +} + +/* + * Remove the specified index from the tree, and return the value stored at + * that index. If the index is not present, return NULL. + */ +uint64_t * +pctrie_remove_lookup(struct pctrie *ptree, uint64_t index, + struct pctrie_node **freenode) +{ + struct pctrie_node *child, *node, *parent; + uint64_t *m; + int slot; + + parent = (struct pctrie_node *)0xdeadbeef; + *freenode = node = NULL; + child = pctrie_root_load(ptree, NULL, PCTRIE_LOCKED); + while (!pctrie_isleaf(child)) { + parent = node; + node = child; + slot = pctrie_slot(node, index); + child = pctrie_node_load(&node->pn_child[slot], NULL, + PCTRIE_LOCKED); + } + if ((m = pctrie_toval(child)) == NULL || *m != index) + return (NULL); + pctrie_remove(ptree, index, parent, node, freenode); return (m); } @@ -901,6 +910,161 @@ pctrie_reclaim_begin_cb(struct pctrie_node **pnode, struct pctrie *ptree, callback, keyoff, arg)); } +/* + * Find first leaf >= index, and fill iter with the path to the parent of that + * leaf. + */ +static uint64_t * +pctrie_iter_index(struct pctrie_iter *iter, struct pctrie_node *node, + uint64_t index) +{ + uint64_t *m; + int slot; + + /* Seek a node that matches index. */ + while (!pctrie_isleaf(node) && + !pctrie_keybarr(node, index, &slot)) { + iter->path[iter->top++] = node; + KASSERT(iter->top <= nitems(iter->path), + ("%s: path overflow in trie %p", __func__, iter->ptree)); + node = pctrie_node_load(&node->pn_child[slot], NULL, + PCTRIE_LOCKED); + } + + /* + * If no such node was found, and instead this path leads only to nodes + * < index, back up to find a subtrie with the least value > index. + */ + if (pctrie_isleaf(node) ? + (m = pctrie_toval(node)) == NULL || *m < index : + node->pn_owner < index) { + /* Climb the path to find a node with a descendant > index. */ + do { + if (iter->top == 0) { + MPASS(pctrie_lookup_ge(iter->ptree, index) == + NULL); + return (NULL); + } + node = iter->path[--iter->top]; + slot = pctrie_slot(node, index) + 1; + } while ((node->pn_popmap >> slot) == 0); + + /* Step to the least child with a descendant > index. */ + slot += ffs(node->pn_popmap >> slot) - 1; + iter->top++; + node = pctrie_node_load(&node->pn_child[slot], NULL, + PCTRIE_LOCKED); + } + /* Descend to the least leaf of the subtrie. */ + while (!pctrie_isleaf(node)) { + slot = ffs(node->pn_popmap) - 1; + iter->path[iter->top++] = node; + KASSERT(iter->top <= nitems(iter->path), + ("%s: path overflow in trie %p", __func__, iter->ptree)); + node = pctrie_node_load(&node->pn_child[slot], NULL, + PCTRIE_LOCKED); + } + m = pctrie_toval(node); + iter->index = *m; + MPASS(pctrie_lookup_ge(iter->ptree, index) == m); + return (m); +} + +/* + * Find the first leaf with value at least 'step' greater than the previous + * leaf. + */ +uint64_t * +pctrie_iter_step(struct pctrie_iter *iter, uint64_t step) +{ + struct pctrie_node *node; + uint64_t index = iter->index + step; + int slot; + + /* Detect step overflow. */ + if (index < iter->index) + return (NULL); + + if (iter->top == 0) { + uint64_t *m; + node = pctrie_root_load(iter->ptree, NULL, PCTRIE_UNSERIALIZED); + if (!pctrie_isleaf(node)) + /* + * If there have been insertions since the last + * iteration, the root may not be a leaf; in that case, + * put the root on the path. + */ + iter->path[iter->top++] = node; + else if ((m = pctrie_toval(node)) != NULL && *m >= index) { + /* If the root is the only value in the trie and it is + * larger than the current index value, it was promoted + * to root via the removal of another, and should be + * considered as the last iteration. + */ + iter->index = *m; + MPASS(pctrie_lookup_ge(iter->ptree, index) == m); + return (m); + } + } + + /* Climb the path to find a node that matches a prefix of index. */ + do { + if (iter->top == 0) + return (NULL); + node = iter->path[--iter->top]; + } while (pctrie_keybarr(node, index, &slot)); + + /* Complete the search for index from node. */ + iter->top++; + node = pctrie_node_load(&node->pn_child[slot], NULL, PCTRIE_LOCKED); + return (pctrie_iter_index(iter, node, index)); +} + +/* + * Find first leaf >= index, and initialize iter with the path to the parent of + * that leaf. + */ +uint64_t * +pctrie_iter_start(struct pctrie_iter *iter, + struct pctrie *ptree, uint64_t index) +{ + struct pctrie_node *node = pctrie_root_load(ptree, NULL, PCTRIE_LOCKED); + + iter->ptree = ptree; + iter->top = 0; + return (pctrie_iter_index(iter, node, index)); +} + +/* + * Remove from the trie the leaf last chosen by the iterator, and + * adjust the path if it's last member is to be freed. + */ +uint64_t * +pctrie_iter_remove(struct pctrie_iter *iter, struct pctrie_node **freenode) +{ + struct pctrie_node *child, *node, *parent; + uint64_t *m; + int slot; + + *freenode = NULL; + parent = (iter->top >= 2) ? iter->path[iter->top - 2] : NULL; + if (iter->top >= 1) { + node = iter->path[iter->top - 1]; + slot = pctrie_slot(node, iter->index); + child = pctrie_node_load(&node->pn_child[slot], NULL, + PCTRIE_LOCKED); + } else { + node = NULL; + child = pctrie_root_load(iter->ptree, NULL, PCTRIE_LOCKED); + } + if ((m = pctrie_toval(child)) == NULL || *m != iter->index) + return (NULL); + pctrie_remove(iter->ptree, iter->index, parent, node, freenode); + if (*freenode != NULL) + --iter->top; + return (m); +} + /* * Replace an existing value in the trie with another one. * Panics if there is not an old value in the trie at the new value's index. diff --git a/sys/kern/subr_rangeset.c b/sys/kern/subr_rangeset.c index ddb1839531ea5..7faeef45a5ff9 100644 --- a/sys/kern/subr_rangeset.c +++ b/sys/kern/subr_rangeset.c @@ -272,8 +272,8 @@ rangeset_next(struct rangeset *rs, uint64_t place) int rangeset_copy(struct rangeset *dst_rs, struct rangeset *src_rs) { + struct pctrie_iter iter; struct rs_el *src_r, *dst_r; - uint64_t cursor; int error; MPASS(pctrie_is_empty(&dst_rs->rs_trie)); @@ -281,10 +281,8 @@ rangeset_copy(struct rangeset *dst_rs, struct rangeset *src_rs) MPASS(dst_rs->rs_dup_data == src_rs->rs_dup_data); error = 0; - for (cursor = 0;; cursor = src_r->re_start + 1) { - src_r = RANGESET_PCTRIE_LOOKUP_GE(&src_rs->rs_trie, cursor); - if (src_r == NULL) - break; + for (src_r = RANGESET_PCTRIE_ITER_START(&iter, &src_rs->rs_trie, 0); + src_r != NULL; src_r = RANGESET_PCTRIE_ITER_STEP(&iter, 1)) { dst_r = dst_rs->rs_dup_data(dst_rs->rs_data_ctx, src_r); if (dst_r == NULL) { error = ENOMEM; @@ -303,13 +301,11 @@ rangeset_copy(struct rangeset *dst_rs, struct rangeset *src_rs) static void rangeset_check(struct rangeset *rs) { + struct pctrie_iter iter; struct rs_el *r, *rp; - uint64_t cursor; - for (cursor = 0, rp = NULL;; cursor = r->re_start + 1, rp = r) { - r = RANGESET_PCTRIE_LOOKUP_GE(&rs->rs_trie, cursor); - if (r == NULL) - break; + for (rp = NULL, r = RANGESET_PCTRIE_ITER_START(&iter, &rs->rs_trie, 0); + r != NULL; rp = r, r = RANGESET_PCTRIE_ITER_STEP(&iter, 1)) { KASSERT(r->re_start < r->re_end, ("invalid interval rs %p elem %p (%#jx, %#jx)", rs, r, (uintmax_t)r->re_start, (uintmax_t)r->re_end)); @@ -332,9 +328,9 @@ rangeset_check(struct rangeset *rs) DB_SHOW_COMMAND(rangeset, rangeset_show_fn) { + struct pctrie_iter iter; struct rangeset *rs; struct rs_el *r; - uint64_t cursor; if (!have_addr) { db_printf("show rangeset addr\n"); @@ -343,10 +339,8 @@ DB_SHOW_COMMAND(rangeset, rangeset_show_fn) rs = (struct rangeset *)addr; db_printf("rangeset %p\n", rs); - for (cursor = 0;; cursor = r->re_start + 1) { - r = RANGESET_PCTRIE_LOOKUP_GE(&rs->rs_trie, cursor); - if (r == NULL) - break; + for (r = RANGESET_PCTRIE_ITER_START(&iter, &rs->rs_trie, 0); + r != NULL; r = RANGESET_PCTRIE_ITER_STEP(&iter, 1)) { db_printf(" el %p start %#jx end %#jx\n", r, r->re_start, r->re_end); } diff --git a/sys/net/if.c b/sys/net/if.c index 604a93aa7cbaa..342c2fdb44114 100644 --- a/sys/net/if.c +++ b/sys/net/if.c @@ -3798,7 +3798,7 @@ if_delmulti_locked(struct ifnet *ifp, struct ifmultiaddr *ifma, int detaching) */ if (detaching) { #ifdef DIAGNOSTIC - printf("%s: detaching ifnet instance %p\n", __func__, ifp); +// printf("%s: detaching ifnet instance %p\n", __func__, ifp); #endif /* * ifp may already be nulled out if we are being reentered diff --git a/sys/sys/pctrie.h b/sys/sys/pctrie.h index d06b533a54b72..90fb324e61bc2 100644 --- a/sys/sys/pctrie.h +++ b/sys/sys/pctrie.h @@ -240,6 +240,34 @@ name##_PCTRIE_RECLAIM_CALLBACK(struct pctrie *ptree, \ } \ \ static __inline __unused struct type * \ +name##_PCTRIE_ITER_STEP(struct pctrie_iter *iter, uint64_t step) \ +{ \ + return name##_PCTRIE_VAL2PTR( \ + pctrie_iter_step(iter, step)); \ +} \ + \ +static __inline __unused struct type * \ +name##_PCTRIE_ITER_START(struct pctrie_iter *iter, \ + struct pctrie *ptree, uint64_t index) \ +{ \ + return name##_PCTRIE_VAL2PTR( \ + pctrie_iter_start(iter, ptree, index)); \ +} \ + \ +static __inline __unused void \ +name##_PCTRIE_ITER_REMOVE(struct pctrie_iter *iter) \ +{ \ + uint64_t *val; \ + struct pctrie_node *freenode; \ + \ + val = pctrie_iter_remove(iter, &freenode); \ + if (val == NULL) \ + panic("%s: key not found", __func__); \ + if (freenode != NULL) \ + freefn(iter->ptree, freenode); \ +} \ + \ +static __inline __unused struct type * \ name##_PCTRIE_REPLACE(struct pctrie *ptree, struct type *ptr) \ { \ \ @@ -295,6 +323,12 @@ struct pctrie_node *pctrie_reclaim_begin_cb(struct pctrie_node **pnode, pctrie_cb_t callback, int keyoff, void *arg); struct pctrie_node *pctrie_reclaim_resume_cb(struct pctrie_node **pnode, pctrie_cb_t callback, int keyoff, void *arg); +struct pctrie_iter; +uint64_t *pctrie_iter_step(struct pctrie_iter *iter, uint64_t step); +uint64_t *pctrie_iter_start(struct pctrie_iter *iter, + struct pctrie *ptree, uint64_t index); +uint64_t *pctrie_iter_remove(struct pctrie_iter *iter, + struct pctrie_node **freenode); uint64_t *pctrie_remove_lookup(struct pctrie *ptree, uint64_t index, struct pctrie_node **killnode); uint64_t *pctrie_replace(struct pctrie *ptree, uint64_t *newval); @@ -343,5 +377,12 @@ pctrie_is_empty(struct pctrie *ptree) #define PCTRIE_COUNT (1 << PCTRIE_WIDTH) +struct pctrie_iter { + struct pctrie_node *path[sizeof(uint64_t) * NBBY / PCTRIE_WIDTH]; + struct pctrie *ptree; + uint64_t index; + int top; +}; + #endif /* _KERNEL */ #endif /* !_SYS_PCTRIE_H_ */ diff --git a/sys/vm/swap_pager.c b/sys/vm/swap_pager.c index 9df1521858c17..0e310e10d8af1 100644 --- a/sys/vm/swap_pager.c +++ b/sys/vm/swap_pager.c @@ -491,7 +491,7 @@ static daddr_t swp_pager_meta_build(vm_object_t, vm_pindex_t, daddr_t, static void swp_pager_meta_free(vm_object_t, vm_pindex_t, vm_pindex_t, vm_size_t *); static void swp_pager_meta_transfer(vm_object_t src, vm_object_t dst, - vm_pindex_t pindex, vm_pindex_t count, vm_size_t *freed); + vm_pindex_t pindex, vm_pindex_t count); static void swp_pager_meta_free_all(vm_object_t); static daddr_t swp_pager_meta_lookup(vm_object_t, vm_pindex_t); @@ -1084,8 +1084,7 @@ swap_pager_copy(vm_object_t srcobject, vm_object_t dstobject, /* * Transfer source to destination. */ - swp_pager_meta_transfer(srcobject, dstobject, offset, dstobject->size, - NULL); + swp_pager_meta_transfer(srcobject, dstobject, offset, dstobject->size); /* * Free left over swap blocks in source. @@ -1776,8 +1775,8 @@ swp_pager_force_dirty(struct page_range *range, vm_page_t m, daddr_t *blk) u_long swap_pager_swapped_pages(vm_object_t object) { + struct pctrie_iter iter; struct swblk *sb; - vm_pindex_t pi; u_long res; int i; @@ -1786,9 +1785,10 @@ swap_pager_swapped_pages(vm_object_t object) if (pctrie_is_empty(&object->un_pager.swp.swp_blks)) return (0); - for (res = 0, pi = 0; (sb = SWAP_PCTRIE_LOOKUP_GE( - &object->un_pager.swp.swp_blks, pi)) != NULL; - pi = sb->p + SWAP_META_PAGES) { + res = 0; + for (sb = SWAP_PCTRIE_ITER_START(&iter, + &object->un_pager.swp.swp_blks, 0); sb != NULL; + sb = SWAP_PCTRIE_ITER_STEP(&iter, SWAP_META_PAGES)) { for (i = 0; i < SWAP_META_PAGES; i++) { if (sb->d[i] != SWAPBLK_NONE) res++; @@ -1806,6 +1806,7 @@ swap_pager_swapped_pages(vm_object_t object) static void swap_pager_swapoff_object(struct swdevt *sp, vm_object_t object) { + struct pctrie_iter iter; struct page_range range; struct swblk *sb; vm_page_t m; @@ -1822,29 +1823,28 @@ swap_pager_swapoff_object(struct swdevt *sp, vm_object_t object) i = 0; swp_pager_init_freerange(&range); for (;;) { - if (i == 0 && (object->flags & OBJ_DEAD) != 0) { - /* - * Make sure that pending writes finish before - * returning. - */ - vm_object_pip_wait(object, "swpoff"); - swp_pager_meta_free_all(object); - break; - } - - if (i == SWAP_META_PAGES) { + if (i == 0) { + if ((object->flags & OBJ_DEAD) != 0) { + /* + * Make sure that pending writes finish before + * returning. + */ + vm_object_pip_wait(object, "swpoff"); + swp_pager_meta_free_all(object); + break; + } + sb = SWAP_PCTRIE_ITER_START(&iter, + &object->un_pager.swp.swp_blks, pi); + } else if (i == SWAP_META_PAGES) { pi = sb->p + SWAP_META_PAGES; if (sb_empty) { - SWAP_PCTRIE_REMOVE( - &object->un_pager.swp.swp_blks, sb->p); + SWAP_PCTRIE_ITER_REMOVE(&iter); uma_zfree(swblk_zone, sb); } + sb = SWAP_PCTRIE_ITER_STEP(&iter, SWAP_META_PAGES); i = 0; } - if (i == 0) { - sb = SWAP_PCTRIE_LOOKUP_GE( - &object->un_pager.swp.swp_blks, pi); if (sb == NULL) break; sb_empty = true; @@ -2142,51 +2142,44 @@ swp_pager_meta_build(vm_object_t object, vm_pindex_t pindex, daddr_t swapblk, } /* - * SWP_PAGER_META_TRANSFER() - free a range of blocks in the srcobject's swap - * metadata, or transfer it into dstobject. + * SWP_PAGER_META_TRANSFER() - transfer a range of blocks in the srcobject's + * swap metadata into dstobject. * * This routine will free swap metadata structures as they are cleaned * out. */ static void swp_pager_meta_transfer(vm_object_t srcobject, vm_object_t dstobject, - vm_pindex_t pindex, vm_pindex_t count, vm_size_t *moved) + vm_pindex_t pindex, vm_pindex_t count) { + struct pctrie_iter iter; struct page_range range; struct swblk *sb; daddr_t blk; - vm_page_t m; vm_pindex_t offset, last; - vm_size_t mc; int i, limit, start; VM_OBJECT_ASSERT_WLOCKED(srcobject); - MPASS(moved == NULL || dstobject == NULL); + VM_OBJECT_ASSERT_WLOCKED(dstobject); - mc = 0; - m = NULL; if (count == 0 || pctrie_is_empty(&srcobject->un_pager.swp.swp_blks)) - goto out; + return; swp_pager_init_freerange(&range); offset = pindex; last = pindex + count; - for (;;) { - sb = SWAP_PCTRIE_LOOKUP_GE(&srcobject->un_pager.swp.swp_blks, - rounddown(pindex, SWAP_META_PAGES)); - if (sb == NULL || sb->p >= last) - break; + sb = SWAP_PCTRIE_LOOKUP_GE(&srcobject->un_pager.swp.swp_blks, + rounddown(pindex, SWAP_META_PAGES)); + while (sb != NULL && sb->p < last) { start = pindex > sb->p ? pindex - sb->p : 0; limit = last - sb->p < SWAP_META_PAGES ? last - sb->p : SWAP_META_PAGES; for (i = start; i < limit; i++) { - blk = sb->d[i]; - if (blk == SWAPBLK_NONE) + if (sb->d[i] == SWAPBLK_NONE) continue; - if (dstobject == NULL || - (blk = swp_pager_meta_build(dstobject, - sb->p + i - offset, blk, true), - blk != sb->d[i] && blk != SWAPBLK_NONE)) + blk = swp_pager_meta_build(dstobject, + sb->p + i - offset, sb->d[i], true); + if (blk != sb->d[i] && blk != SWAPBLK_NONE) swp_pager_update_freerange(&range, sb->d[i]); else if (blk == sb->d[i]) { /* @@ -2197,31 +2190,22 @@ swp_pager_meta_transfer(vm_object_t srcobject, vm_object_t dstobject, */ VM_OBJECT_WUNLOCK(srcobject); swp_pager_meta_build(dstobject, - sb->p + i - offset, blk, false); + sb->p + i - offset, sb->d[i], false); VM_OBJECT_WLOCK(srcobject); } - if (moved != NULL) { - if (m != NULL && m->pindex != pindex + i - 1) - m = NULL; - m = m != NULL ? vm_page_next(m) : - vm_page_lookup(srcobject, pindex + i); - if (m == NULL || vm_page_none_valid(m)) - mc++; - } sb->d[i] = SWAPBLK_NONE; } pindex = sb->p + SWAP_META_PAGES; + sb = SWAP_PCTRIE_ITER_START(&iter, + &srcobject->un_pager.swp.swp_blks, sb->p); if (swp_pager_swblk_empty(sb, 0, start) && swp_pager_swblk_empty(sb, limit, SWAP_META_PAGES)) { - SWAP_PCTRIE_REMOVE(&srcobject->un_pager.swp.swp_blks, - sb->p); + SWAP_PCTRIE_ITER_REMOVE(&iter); uma_zfree(swblk_zone, sb); } + sb = SWAP_PCTRIE_ITER_STEP(&iter, SWAP_META_PAGES); } swp_pager_freeswapspace(&range); -out: - if (moved != NULL) - *moved = mc; } /* @@ -2238,7 +2222,54 @@ static void swp_pager_meta_free(vm_object_t object, vm_pindex_t pindex, vm_pindex_t count, vm_size_t *freed) { - swp_pager_meta_transfer(object, NULL, pindex, count, freed); + struct pctrie_iter iter; + struct page_range range; + struct swblk *sb; + vm_page_t m; + vm_pindex_t last; + vm_size_t fc; + int i, limit, start; + + VM_OBJECT_ASSERT_WLOCKED(object); + + fc = 0; + m = NULL; + if (count == 0 || pctrie_is_empty(&object->un_pager.swp.swp_blks)) + goto out; + + swp_pager_init_freerange(&range); + last = pindex + count; + for (sb = SWAP_PCTRIE_ITER_START(&iter, &object->un_pager.swp.swp_blks, + rounddown(pindex, SWAP_META_PAGES)); sb != NULL && sb->p < last; + sb = SWAP_PCTRIE_ITER_STEP(&iter, SWAP_META_PAGES)) { + start = pindex > sb->p ? pindex - sb->p : 0; + limit = last - sb->p < SWAP_META_PAGES ? last - sb->p : + SWAP_META_PAGES; + for (i = start; i < limit; i++) { + if (sb->d[i] == SWAPBLK_NONE) + continue; + swp_pager_update_freerange(&range, sb->d[i]); + if (freed != NULL) { + if (m != NULL && m->pindex != pindex + i - 1) + m = NULL; + m = m != NULL ? vm_page_next(m) : + vm_page_lookup(object, pindex + i); + if (m == NULL || vm_page_none_valid(m)) + fc++; + } + sb->d[i] = SWAPBLK_NONE; + } + pindex = sb->p + SWAP_META_PAGES; + if (swp_pager_swblk_empty(sb, 0, start) && + swp_pager_swblk_empty(sb, limit, SWAP_META_PAGES)) { + SWAP_PCTRIE_ITER_REMOVE(&iter); + uma_zfree(swblk_zone, sb); + } + } + swp_pager_freeswapspace(&range); +out: + if (freed != NULL) + *freed = fc; } static void @@ -2314,6 +2345,7 @@ swp_pager_meta_lookup(vm_object_t object, vm_pindex_t pindex) vm_pindex_t swap_pager_find_least(vm_object_t object, vm_pindex_t pindex) { + struct pctrie_iter iter; struct swblk *sb; int i; @@ -2322,7 +2354,7 @@ swap_pager_find_least(vm_object_t object, vm_pindex_t pindex) if (pctrie_is_empty(&object->un_pager.swp.swp_blks)) return (object->size); - sb = SWAP_PCTRIE_LOOKUP_GE(&object->un_pager.swp.swp_blks, + sb = SWAP_PCTRIE_ITER_START(&iter, &object->un_pager.swp.swp_blks, rounddown(pindex, SWAP_META_PAGES)); if (sb == NULL) return (object->size); @@ -2331,8 +2363,7 @@ swap_pager_find_least(vm_object_t object, vm_pindex_t pindex) if (sb->d[i] != SWAPBLK_NONE) return (sb->p + i); } - sb = SWAP_PCTRIE_LOOKUP_GE(&object->un_pager.swp.swp_blks, - roundup(pindex, SWAP_META_PAGES)); + sb = SWAP_PCTRIE_ITER_STEP(&iter, SWAP_META_PAGES); if (sb == NULL) return (object->size); } @@ -2776,6 +2807,8 @@ SYSCTL_NODE(_vm, OID_AUTO, swap_info, CTLFLAG_RD | CTLFLAG_MPSAFE, long vmspace_swap_count(struct vmspace *vmspace) { + struct pctrie_iter iter; + struct pctrie *ptree; vm_map_t map; vm_map_entry_t cur; vm_object_t object; @@ -2796,13 +2829,12 @@ vmspace_swap_count(struct vmspace *vmspace) VM_OBJECT_RLOCK(object); if ((object->flags & OBJ_SWAP) == 0) goto unlock; + ptree = &object->un_pager.swp.swp_blks; pi = OFF_TO_IDX(cur->offset); e = pi + OFF_TO_IDX(cur->end - cur->start); - for (;; pi = sb->p + SWAP_META_PAGES) { - sb = SWAP_PCTRIE_LOOKUP_GE( - &object->un_pager.swp.swp_blks, pi); - if (sb == NULL || sb->p >= e) - break; + for (sb = SWAP_PCTRIE_ITER_START(&iter, ptree, pi); + sb != NULL && sb->p < e; + sb = SWAP_PCTRIE_ITER_STEP(&iter, SWAP_META_PAGES)) { for (i = 0; i < SWAP_META_PAGES; i++) { if (sb->p + i < e && sb->d[i] != SWAPBLK_NONE) -- Test scenario: src/tools/test/stress2/misc/tmpfs19.sh