panic: swap_pager_getpages_locked: object not swappable, vmcore.162 KDB: current backend: ddb Copyright (c) 1992-2020 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #1 r357853M: Thu Feb 13 08:19:46 CET 2020 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 9.0.1 (git@github.com:llvm/llvm-project.git c1a0a213378a458fbea1a5c77b315c7dce08fd05) (based on LLVM 9.0.1) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.07-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33164111872 (31627 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 2 6 10 8 4 9 3 5 7 11 Timecounter "TSC-low" frequency 1750033062 Hz quality 1000 random: entropy device external interface WARNING: Device "kbd" is Giant locked and may be deleted before FreeBSD 13.0. kbd1 at kbdmux0 000.000055 [4341] netmap_init netmap: loaded module [ath_hal] loaded nexus0 vtvga0: cryptosoft0: acpi0: acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: Using 6 RX queues 6 TX queues igb0: Using MSI-X interrupts with 7 vectors igb0: Ethernet address: 0c:c4:7a:a8:cd:da igb0: netmap queues/slots: TX 6/1024, RX 6/1024 igb1: port 0xd000-0xd01f mem 0xfb300000-0xfb31ffff,0xfb340000-0xfb343fff irq 17 at device 0.1 on pci8 igb1: Using 1024 TX descriptors and 1024 RX descriptors igb1: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb1: Using 6 RX queues 6 TX queues igb1: Using MSI-X interrupts with 7 vectors igb1: Ethernet address: 0c:c4:7a:a8:cd:db igb1: netmap queues/slots: TX 6/1024, RX 6/1024 ehci1: mem 0xfb433000-0xfb4333ff irq 18 at device 29.0 on pci1 usbus2: EHCI version 1.0 usbus2 on ehci1 usbus2: 480Mbps High Speed USB v2.0 isab0: at device 31.0 on pci1 isa0: on isab0 ahci1: port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf000-0xf01f mem 0xfb432000-0xfb4327ff irq 16 at device 31.2 on pci1 ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich4: at channel 0 on ahci1 ahcich5: at channel 1 on ahci1 ahcich6: at channel 2 on ahci1 ahcich7: at channel 3 on ahci1 ahcich8: at channel 4 on ahci1 ahcich9: at channel 5 on ahci1 ahciem1: on ahci1 acpi_button0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 uart1: console (115200,n,8,1) orm0: at iomem 0xc0000-0xc7fff,0xcb000-0xcbfff pnpid ORM0000 on isa0 est0: on cpu0 p4tcc0: on cpu0 NULL mp in getnewvnode(9), tag crossmp Timecounters tick every 1.000 msec Obsolete code will be removed soon: random(9) is the obsolete Park-Miller LCG from 1988 Expensive timeout(9) function: 0xffffffff804da860(0xfffffe00d2ad0000) 0.004211002 s ses0 at ahciem0 bus 0 scbus4 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device ses1 at ahciem1 bus 0 scbus11 target 0 lun 0 ses1: SEMB S-E-S 2.00 device ses1: SEMB SES Device ses0: pass0 in 'Slot 01', SATA Slot: scbus1 target 0 ada0 at ahcich1 bus 0 scbus1 target 0 lun 0 ada0: ACS-2 ATA SATA 3.x device ada0: Serial Number WD-WCC3F3KDDP98 ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 953869MB (1953525168 512 byte sectors) ada0: quirks=0x1<4K> hwpmc:Expensive timeout(9) function: 0xffffffff80a32640(0xffffffff818e6288) 0.007395061 s SOFT/16/64/0x67 TSC/1/64/0x20 IAP/4/48/0x3ff IAF/3/48/0x67 Trying to mount root from ufs:/dev/gpt/work [rw]... WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. ugen0.1: <0x8086 XHCI root HUB> at usbus0 ugen1.1: at usbus1 ugen2.1: at usbus2 uhub0 on usbus0 uhub0: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0 uhub1 on usbus2 uhub1: on usbus2 uhub2 on usbus1 uhub2: on usbus1 WARNING: / was not properly dismounted Interface IP-Address Broadcast ugen0.3: at usbus0 ukbd0 on uhub3 ukbd0: on usbus0 kbd2 at ukbd0 . lo0: link state changed to UP Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8822 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko ums0 on uhub3 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff800041c8800 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 13 Feb 08:23:02 ntpdate[2058]: step time server 192.168.5.1 offset -0.456985 sec Starting rpcbind. NFS access cache time=60 Starting watchdogd. No core dumps found. Clearing /tmp (X related). Starting statd. Starting lockd. Recovering vi editor sessions:. fscklock order reversal: 1st 0xfffff800217f0a68 ufs (ufs) @ kern/vfs_mount.c:1628 2nd 0xfffff800217f07e8 devfs (devfs) @ ufs/ffs/ffs_vfsops.c:1404 stack backtrace: #0 0xffffffff80c36c81 at witness_debugger+0x71 #1 0xffffffff80c369f6 at witness_checkorder+0xad6 #2 0xffffffff80b9ba08 at lockmgr_lock_fast_path+0x178 #3 0xffffffff810f1ec0 at VOP_LOCK1_APV+0x40 #4 0xffffffff80cb9804 at _vn_lock+0x54 #5 0xffffffff80ee72d3 at ffs_flushfiles+0xa3 #6 0xffffffff80ec911d at softdep_flushfiles+0xad #7 0xffffffff80ee9b17 at ffs_unmount+0xd7 #8 0xffffffff80c9b73a at dounmount+0x42a #9 0xffffffff80c9b2b9 at kern_unmount+0x2b9 #10 0xffffffff81074afe at amd64_syscall+0x2ee #11 0xffffffff8104a460 at fast_syscall_common+0x101 ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 296 files, 17182 used, 1248225 free (137 frags, 156011 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** Updating motd:. Mounting late filesystems:. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Starting powerd. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Thu Feb 13 08:23 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root Feb 13 08:23:08 mercat1 login[2344]: ROOT LOGIN (root) ON ttyu1 Last login: Wed Feb 12 19:47:46 on ttyu1 FreeBSD 13.0-CURRENT (PHO) #1 r357853M: Thu Feb 13 08:19:46 CET 2020 root@mercat1:~ # Feb 13 08:23:24 mercat1 su[2360]: pho to root on /dev/pts/0 20200213 08:24:07 all (1/9): md7.sh Feb 13 08:24:45 mercat1 kernel: pid 3709 (mkdir), uid 0 inumber 44926 on /mnt: out of inodes Feb 13 08:24:58 mercat1 kernel: pid 3705 (rw), uid 0 inumber 45084 on /mnt: filesystem full Feb 13 08:25:50 mercat1 kernel: pid 3720 (openat), uid 0 inumber 44830 on /mnt: out of inodes Feb 13 08:26:31 mercat1 kernel: pid 8383 (symlink), uid 0 inumber 44969 on /mnt: out of inodes Feb 13 08:30:30 mercat1 kernel: pid 19561 (rw), uid 0 inumber 82733 on /mnt: filesystem full Feb 13 08:30:37 mercat1 kernel: pid 19554 (symlink), uid 0 inumber 52323 on /mnt: out of inodes Feb 13 08:31:00 mercat1 kernel: pid 19564 (symlink), uid 0 inumber 50448 on /mnt: out of inodes Feb 13 08:31:47 mercat1 kernel: pid 19569 (symlink), uid 0 inumber 44819 on /mnt: out of inodes Feb 13 08:31:51 mercat1 kernel: pid 19581 (creat), uid 0 inumber 44828 on /mnt: out of inodes Feb 13 08:31:57 mercat1 kernel: pid 19631 (creat), uid 0 inumber 44933 on /mnt: out of inodes Feb 13 08:32:02 mercat1 kernel: pid 19581 (creat), uid 0 inumber 44828 on /mnt: out of inodes Feb 13 08:32:07 mercat1 kernel: pid 19623 (creat), uid 0 inumber 44891 on /mnt: out of inodes Feb 13 08:32:11 mercat1 syslogd: last message repeated 1 times Feb 13 08:32:16 mercat1 kernel: pid 19607 (creat), uid 0 inumber 44826 on /mnt: out of inodes Feb 13 08:32:20 mercat1 kernel: pid 19619 (creat), uid 0 inumber 44879 on /mnt: out of inodes 20200213 08:34:24 all (2/9): oom.sh 20200213 08:34:26 all (3/9): stealer.sh Feb 13 08:34:44 mercat1 kernel: pid 36903 (stealer), jid 0, uid 2007, was killed: out of swap space Feb 13 08:35:09 mercat1 kernel: pid 36812 (stealer), jid 0, uid 2007, was killed: out of swap space Feb 13 08:35:20 mercat1 kernel: pid 36720 (stealer), jid 0, uid 2007, was killed: out of swap space swp_pager_getswapspace(15): failed 20200213 08:38:24 all (4/9): swap3.sh Feb 13 08:41:45 mercat1 kernel: pid 40498 (swap2), jid 0, uid 0, was killed: out of swap space 20200213 08:43:30 all (5/9): swap5.sh 20200213 08:52:45 all (6/9): swapoff.sh Feb 13 08:53:48 mercat1 kernel: pid 4241 (swap), jid 0, uid 2007, was killed: out of swap space Feb 13 08:54:05 mercat1 kernel: pid 4229 (creat), uid 2007 inumber 32785 on /mnt: out of inodes Feb 13 08:54:37 mercat1 kernel: pid 4232 (creat), uid 2007 inumber 32787 on /mnt: out of inodes 20200213 08:55:37 all (7/9): swapoff4a.sh 20200213 08:56:37 all (8/9): swappedout.sh 20200213 08:56:39 all (9/9): vmio.sh 20200213 08:56:40 all (1/9): md7.sh Feb 13 09:04:55 mercat1 kernel: pid 52933 (rw), uid 0 inumber 103700 on /mnt: filesystem full 20200213 09:06:50 all (2/9): oom.sh 20200213 09:06:52 all (3/9): stealer.sh Feb 13 09:07:09 mercat1 kernel: pid 59563 (stealer), jid 0, uid 2007, was killed: out of swap space Feb 13 09:07:21 mercat1 kernel: pid 59482 (stealer), jid 0, uid 2007, was killed: out of swap space Feb 13 09:07:40 mercat1 kernel: pid 59499 (stealer), jid 0, uid 2007, was killed: out of swap space swp_pager_getswapspace(32): failed newblk leak: 28646/28670. 20200213 09:10:43 all (4/9): swap3.sh 20200213 09:15:52 all (5/9): swap5.sh 20200213 09:25:07 all.sh done, elapsed 0 day(s), 01:01.00 20200213 09:51:30 all (1/9): md7.sh Feb 13 09:51:48 mercat1 kernel: pid 79045 (rw), uid 0 inumber 177085 on /mnt: filesystem full Feb 13 09:51:59 mercat1 kernel: pid 79092 (mkdir), uid 0 inumber 44790 on /mnt: out of inodes Feb 13 09:52:19 mercat1 kernel: pid 79095 (openat), uid 0 inumber 89625 on /mnt: out of inodes Feb 13 09:52:20 mercat1 kernel: pid 79172 (creat), uid 0 inumber 89637 on /mnt: out of inodes Feb 13 09:55:51 mercat1 kernel: pid 85657 (rw), uid 0 inumber 163019 on /mnt: filesystem full Feb 13 09:57:02 mercat1 kernel: pid 85590 (rw), uid 0 inumber 106194 on /mnt: filesystem full Feb 13 09:58:01 mercat1 kernel: pid 92163 (rw), uid 0 inumber 101184 on /mnt: filesystem full Feb 13 10:00:04 mercat1 kernel: pid 94990 (creat), uid 0 inumber 89613 on /mnt: out of inodes Feb 13 10:00:32 mercat1 kernel: pid 94995 (creat), uid 0 inumber 89615 on /mnt: out of inodes Feb 13 10:01:03 mercat1 kernel: pid 94967 (creat), uid 0 inumber 89605 on /mnt: out of inodes Feb 13 10:01:30 mercat1 syslogd: last message repeated 2 times Feb 13 10:01:44 mercat1 kernel: pid 94995 (creat), uid 0 inumber 89615 on /mnt: out of inodes 20200213 10:01:56 all (2/9): oom.sh 20200213 10:01:58 all (3/9): stealer.sh Feb 13 10:02:09 mercat1 kernel: pid 384 (stealer), jid 0, uid 2007, was killed: out of swap space Feb 13 10:02:22 mercat1 kernel: pid 433 (stealer), jid 0, uid 2007, was killed: out of swap space Feb 13 10:02:34 mercat1 kernel: pid 420 (stealer), jid 0, uid 2007, was killed: out of swap space Feb 13 10:02:46 mercat1 kernel: pid 279 (stealer), jid 0, uid 2007, was killed: out of swap space swp_pager_getswapspace(32): failed 20200213 10:05:51 all (4/9): swap3.sh 20200213 10:10:59 all (5/9): swap5.sh 20200213 10:20:13 all (6/9): swapoff.sh Feb 13 10:20:23 mercat1 kernel: pid 62336 (rw), uid 2007 inumber 98420 on /mnt: filesystem full Feb 13 10:20:37 mercat1 kernel: pid 62444 (swap), jid 0, uid 2007, was killed: out of swap space Feb 13 10:20:58 mercat1 kernel: pid 62463 (swap), jid 0, uid 2007, was killed: out of swap space Feb 13 10:21:37 mercat1 kernel: pid 62400 (mkdir), uid 2007 inumber 63452 on /mnt: out of inodes Feb 13 10:21:56 mercat1 kernel: pid 62424 (mkdir), uid 2007 inumber 65452 on /mnt: out of inodes Feb 13 10:22:07 mercat1 kernel: pid 62383 (creat), uid 2007 inumber 98343 on /mnt: out of inodes 20200213 10:22:52 all (7/9): swapoff4a.sh 20200213 10:23:46 all (8/9): swappedout.sh 20200213 10:25:54 all (9/9): vmio.sh 20200213 10:25:56 all (1/9): md7.sh Feb 13 10:28:15 mercat1 kernel: pid 75132 (creat), uid 0 inumber 44947 on /mnt: out of inodes Feb 13 10:28:20 mercat1 syslogd: last message repeated 1 times Feb 13 10:28:36 mercat1 kernel: pid 75079 (creat), uid 0 inumber 44870 on /mnt: out of inodes Feb 13 10:28:58 mercat1 syslogd: last message repeated 2 times Feb 13 10:29:07 mercat1 kernel: pid 75083 (creat), uid 0 inumber 44919 on /mnt: out of inodes Feb 13 10:29:14 mercat1 kernel: pid 75119 (creat), uid 0 inumber 44944 on /mnt: out of inodes Feb 13 10:29:22 mercat1 syslogd: last message repeated 1 times Feb 13 10:29:29 mercat1 kernel: pid 75143 (creat), uid 0 inumber 44956 on /mnt: out of inodes Feb 13 10:29:37 mercat1 kernel: pid 75107 (creat), uid 0 inumber 44852 on /mnt: out of inodes Feb 13 10:29:44 mercat1 kernel: pid 75069 (creat), uid 0 inumber 44837 on /mnt: out of inodes Feb 13 10:29:50 mercat1 kernel: pid 75083 (creat), uid 0 inumber 44919 on /mnt: out of inodes Feb 13 10:29:58 mercat1 kernel: pid 75099 (creat), uid 0 inumber 44952 on /mnt: out of inodes Feb 13 10:30:18 mercat1 kernel: pid 77909 (rw), uid 0 inumber 82912 on /mnt: filesystem full Feb 13 10:30:25 mercat1 kernel: pid 77903 (rw), uid 0 inumber 148164 on /mnt: filesystem full Feb 13 10:34:32 mercat1 kernel: pid 81027 (mkfifo), uid 0 inumber 44800 on /mnt: out of inodes Feb 13 10:34:38 mercat1 kernel: pid 81006 (mkdir), uid 0 inumber 44609 on /mnt: out of inodes Feb 13 10:35:08 mercat1 kernel: pid 80998 (openat), uid 0 inumber 44998 on /mnt: out of inodes 20200213 10:36:22 all (2/9): oom.sh 20200213 10:36:24 all (3/9): stealer.sh Feb 13 10:36:52 mercat1 kernel: pid 86033 (stealer), jid 0, uid 2007, was killed: out of swap space Feb 13 10:37:05 mercat1 kernel: pid 85988 (stealer), jid 0, uid 2007, was killed: out of swap space swp_pager_getswapspace(32): failed newblk leak: 32743/32767. 20200213 10:40:21 all (4/9): swap3.sh 20200213 10:45:29 all (5/9): swap5.sh 20200213 10:54:43 all.sh done, elapsed 0 day(s), 01:03.13 20200213 11:42:10 all (1/1): swapoff3.sh swap_pager: I/O error - pageout failed; blkno 3424818759,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424818791,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424818823,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424818855,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424818887,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424818919,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424818951,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424818983,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424819015,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424819047,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424819079Feb 13 11:43:59 ,size 131072, error 28 mercat1 kernel: swap_pager: I/O error - pageout failed; blkno 3424819111,size 131072, error 28 pid 32536 (md10)swap_pager: I/O error - pageout failed; blkno 3424819143,size 131072, error 28 , uid 0 inumber swap_pager: I/O error - pageout failed; blkno 3424819175,size 131072, error 28 229 on /tmp: filswap_pager: I/O error - pageout failed; blkno 3424819207,size 131072, error 28 esystem full swap_pager: I/O error - pageout failed; blkno 3424819239,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424819271,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424819303,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424819335,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424819367,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424819399,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424819431,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424819463,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424819495,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424819527,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424819559,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424819591,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424819623,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424819655,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424819687,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424819719,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424819751,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424819783,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424819815,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424819847,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424819879,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424819911,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424819943,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424819975,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820007,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820039,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820071,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820103,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820135,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820167,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820199,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820231,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820263,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820295,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820327,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820359,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820391,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820423,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820455,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820487,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820519,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820551,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820583,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820615,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820647,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820679,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820711,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820743,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820775,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820807,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820839,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820871,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820903,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820935,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820967,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424820999,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424821031,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424821063,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424821095,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424821127,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424821159,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424821191,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424821223,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424821255,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424821287,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424821319,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424821351,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424821383,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424821415,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424821447,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424821479,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424821511,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424821543,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424821575,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424821607,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424821639,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424821671,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424821703,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424821735,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424821767,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424821799,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424821831,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424821863,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424821895,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424821927,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424821959,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424821991,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424822023,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424822055,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424822087,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424822119,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424822151,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424822183,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424822215,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424822247,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424822279,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424822311,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424822343,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424822375,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424822407,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424822439,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424822471,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424822503,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424822535,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424822567,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424822599,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424822631,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424822663,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424822695,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424822727,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424822759,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424822791,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424822823,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424822855,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424822887,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424822919,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424822951,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424822983,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424823015,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424823047,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424823079,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424823111,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424823143,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424823175,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424823207,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424823239,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424823271,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424823303,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424823335,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424823367,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424823399,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424823431,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424823463,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424823495,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424823527,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424823559,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424823591,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424823623,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424823655,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424823687,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424823719,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424823751,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424823783,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424823815,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424823847,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424823879,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424823911,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424823943,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424823975,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424824007,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424824039,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424824071,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424824103,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424824135,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424824167,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424824199,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424824231,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424824263,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424824295,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3424824327,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426254300,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426254332,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426254364,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426254396,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426254428,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426254460,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426254492,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426254524,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426254556,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426254588,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426254620,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426254652,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426254684,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426254716,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426254748,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426254780,size 131072, error 28 Feb 13 11:44:00 swap_pager: I/O error - pageout failed; blkno 3426254812,size 131072, error 28 mercat1 syslogd:swap_pager: I/O error - pageout failed; blkno 3426254844,size 131072, error 28 last message repeated 1 times Feb 13 11:44:05 mercat1 kernel: pid 32540 (md11), uid 0 inumberswap_pager: I/O error - pageout failed; blkno 3426254876,size 131072, error 28 224 on /tmp: fiswap_pager: I/O error - pageout failed; blkno 3426254908,size 131072, error 28 lesystem full swap_pager: I/O error - pageout failed; blkno 3426254940,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426254972,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255004,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255036,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255068,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255100,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255132,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255164,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255196,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255228,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255260,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255292,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255324,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255356,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255388,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255420,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255452,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255484,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255516,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255548,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255580,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255612,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255644,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255676,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255708,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255740,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255772,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255804,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255836,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255868,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255900,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255932,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255964,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426255996,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426256028,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426256060,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426256092,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426256124,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426256156,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426256188,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426256220,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426256252,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426256284,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426256316,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426256348,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426256380,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426256412,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426256444,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426256476,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426256508,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426256540,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426256572,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426256604,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426256636,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426256668,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426256700,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426256732,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426256764,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426256796,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426256828,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426256860,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426256892,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426256924,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426256956,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426256988,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426257020,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426257052,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426257084,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426257116,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426257148,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426257180,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426257212,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426257244,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426257276,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426257308,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426257340,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426257372,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426257404,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426257436,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426257468,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426257500,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426257532,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426257564,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426257596,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426257628,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426257660,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426257692,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426257724,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426257756,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426257788,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426257820,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426257852,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426257884,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426257916,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426257948,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426257980,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426258012,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426258044,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426258076,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426258108,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426258140,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426258172,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426258204,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426258236,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426258268,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426258300,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426258332,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426258364,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426258396,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426258428,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426258460,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426258492,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426258524,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426258556,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426258588,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426258620,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426258652,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426258684,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426258716,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426258748,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426258780,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426258812,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426258844,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426258876,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426258908,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426258940,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426258972,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259004,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259036,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259068,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259100,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259132,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259164,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259196,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259228,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259260,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259292,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259324,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259356,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259388,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259420,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259452,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259484,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259516,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259548,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259580,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259612,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259644,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259676,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259708,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259740,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259772,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259804,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259836,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259868,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259900,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259932,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259964,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426259996,size 1Feb 13 11:44:06 31072, error 28 mercat1 syslogd: last message repeated 1 times Feb 13 11:44:07swap_pager: I/O error - pageout failed; blkno 3426260028,size 131072, error 28 mercat1 kernel:swap_pager: I/O error - pageout failed; blkno 3426260060,size 131072, error 28 s pid 32542 (swapwap_pager: I/O error - pageout failed; blkno 3426260092,size 131072, error 28 off3), jid 0, uid 0, was killed: out of swap space swap_pager: I/O error - pageout failed; blkno 3426260124,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426260156,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426260188,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426260220,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426260252,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426260284,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426260316,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426260348,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426260380,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426260412,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426260444,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426260476,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426260508,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426260540,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426260572,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426260604,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426260636,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426260668,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426260700,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426260732,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426260764,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426260796,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426260828,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426260860,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426260892,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426260924,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426260956,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426260988,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426261020,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426261052,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426261084,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426261116,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426261148,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426261180,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426261212,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426261244,size 131072, error 28Feb 13 11:44:07 mercat1 kernel: swap_pager: I/O error - pageout failed; blkno 3426261276,size 131072, error 28 pid 32540 (md11), uid 0 inumber 224 on /tmp: filesystem full swap_pager: I/O error - pageout failed; blkno 3426261308,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426261340,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426261372,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426261404,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426261436,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426261468,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426261500,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426261532,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426261564,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426261596,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426261628,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426261660,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426261692,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426261724,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426261756,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426261788,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426261820,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426261852,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426261884,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426261916,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426261948,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426261980,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426262012,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426262044,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426262076,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426262108,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426262140,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426262172,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426262204,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426262236,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426262268,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426262300,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426262332,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426262364,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426262396,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426262428,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426262460,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426262492,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426262524,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426262556,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426262588,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426262620,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426262652,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426262684,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426262716,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426262748,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426262780,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426262812,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426262844,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426262876,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426262908,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426262940,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426262972,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426263004,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426263036,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426263068,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426263100,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426263132,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426263164,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426263196,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426263228,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426263260,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426263292,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426263324,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426263356,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426263388,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426263420,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426263452,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426263484,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426263516,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426263548,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426263580,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426263612,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426263644,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426263676,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426263708,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426263740,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426263772,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426263804,size 131072, error 28 Feb 13 11:44:08 swap_pager: I/O error - pageout failed; blkno 3426263836,size 131072, error 28 mercat1 kernel: swap_pager: I/O error - pageout failed; blkno 3426263868,size 131072, error 28 pid 2186 (rpc.stswap_pager: I/O error - pageout failed; blkno 3426263900,size 131072, error 28 atd), jid 0, uidswap_pager: I/O error - pageout failed; blkno 3426263932,size 131072, error 28 0, was killed: swap_pager: I/O error - pageout failed; blkno 3426263964,size 131072, error 28 out of swap space Feb 13 11:44:08 mercat1 kernel: pid 32540 (md11), uid 0 inumber 224 on /tmp:swap_pager: I/O error - pageout failed; blkno 3426263996,size 131072, error 28 filesystem full swap_pager: I/O error - pageout failed; blkno 3426264028,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426264060,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426264092,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426264124,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426264156,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426264188,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426264220,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426264252,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426264284,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426264316,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426264348,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426264380,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426264412,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426264444,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426264476,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426264508,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426264540,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426264572,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426264604,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426264636,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426264668,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426264700,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426264732,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426264764,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426264796,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426264828,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426264860,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426264892,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426264924,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426264956,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426264988,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426265020,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426265052,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426265084,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426265116,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426265148,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426265180,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426265212,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426265244,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426265276,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426265308,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426265340,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426265372,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426265404,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426265436,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426265468,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426265500,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426265532,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426265564,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426265596,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426265628,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426265660,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426265692,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426265724,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426265756,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426265788,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426265820,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426265852,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426265884,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426265916,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426265948,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426265980,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426266012,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426266044,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426266076,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426266108,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426266140,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426266172,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426266204,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426266236,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426266268,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426266300,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426266332,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426266364,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426266396,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426266428,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426266460,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426266492,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426266524,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426266556,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426266588,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426266620,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426266652,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426266684,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426266716,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426266748,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426266780,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426266812,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426266844,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426266876,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426266908,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426266940,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426266972,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426267004,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426267036,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426267068,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426267100,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426267132,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426267164,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426267196,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426267228,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426267260,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426267292,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426267324,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426267356,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426267388,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426267420,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426267452,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426267484,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426267516,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426267548,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426267580,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426267612,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426267644,size 131072, error 28 Feb 13 11:44:09 mercat1 syslogd: last message repeated 1 times Feb 13 11:44:09 mercat1 kernel: pid 2189 (rpc.lockd), jid 0, uiswap_pager: I/O error - pageout failed; blkno 3426267676,size 131072, error 28 d 0, was killed:swap_pager: I/O error - pageout failed; blkno 3426267708,size 131072, error 28 out of swap space swap_pager: I/O error - pageout failed; blkno 3426267740,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426267772,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426267804,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426267836,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426267868,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426267900,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426267932,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426267964,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426267996,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426268028,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426268060,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426268092,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426268124,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426268156,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426268188,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426268220,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426268252,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426268284,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426268316,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426268348,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426268380,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426268412,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426268444,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426268476,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426268508,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426268540,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426268572,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426268604,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426268636,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426268668,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426268700,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426268732,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426268764,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426268796,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426268828,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426268860,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426268892,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426268924,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426268956,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426268988,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426269020,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426269052,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426269084,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426269116,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426269148,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426269180,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426269212,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426269244,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426269276,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426269308,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426269340,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426269372,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426269404,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426269436,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426269468,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426269500,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426269532,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426269564,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426269596,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426269628,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426269660,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426269692,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426269724,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426269756,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426269788,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426269820,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426269852,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426269884,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426269916,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426269948,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426269980,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426270012,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426270044,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426270076,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426270108,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426270140,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426270172,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426270204,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426270236,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426270268,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426270300,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426270332,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426270364,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426270396,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426270428,size 131072, error 28 Feb 13 11:44:10 swap_pager: I/O error - pageout failed; blkno 3426270460,size 131072, error 28 mercat1 kernel: swap_pager: I/O error - pageout failed; blkno 3426270492,size 131072, error 28 pid 32540 (md11)swap_pager: I/O error - pageout failed; blkno 3426270524,size 131072, error 28 , uid 0 inumber 224 on /tmp: filesystem full swap_pager: I/O error - pageout failed; blkno 3426270556,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426270588,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426270620,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426270652,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426270684,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426270716,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426270748,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426270780,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426270812,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426270844,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426270876,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426270908,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426270940,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426270972,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426271004,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426271036,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426271068,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426271100,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426271132,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426271164,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426271196,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426271228,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426271260,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426271292,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426271324,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426271356,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426271388,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426271420,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426271452,size 131072, error 28 swap_pager: I/O error - pageout failed; blkno 3426271484,size 90112, error 28 swap_pager: I/O error - pageout failed; blkno 3426271506,size 28672, error 28 swap_pager: I/O error - pageout failed; blkno 3426271513,size 4096, error 28 swap_pager: I/O error - pageout failed; blkno 3426271514,size 4096, error 28 swap_pager: I/O error - pageout failed; blkno 3426271515,size 20480, error 28 panic: swap_pager_getpages_locked: object not swappable cpuid = 5 time = 1581590652 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e68bd620 vpanic() at vpanic+0x185/frame 0xfffffe00e68bd680 panic() at panic+0x43/frame 0xfffffe00e68bd6e0 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x83/frame 0xfffffe00e68bd790 swap_pager_swapoff_object() at swap_pager_swapoff_object+0x342/frame 0xfffffe00e68bd890 swap_pager_swapoff() at swap_pager_swapoff+0xf8/frame 0xfffffe00e68bd900 swapoff_one() at swapoff_one+0x14a/frame 0xfffffe00e68bd950 sys_swapoff() at sys_swapoff+0x1d5/frame 0xfffffe00e68bdac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e68bdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e68bdbf0 --- syscall (424, FreeBSD ELF64, sys_swapoff), rip = 0x8002f688a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe5d0 --- KDB: enter: panic [ thread pid 38801 tid 100282 ] Stopped at kdb_enter+0x37: movq $0,0x10855a6(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> dump Dumping 1540 out of 32626 MB:..2%..11%..21%..31%..41%..51%..61%..71%..82%..91% Dump complete db:1:pho1> bt Tracing pid 38801 tid 100282 td 0xfffffe00e4206700 kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e68bd620 vpanic() at vpanic+0x1a1/frame 0xfffffe00e68bd680 panic() at panic+0x43/frame 0xfffffe00e68bd6e0 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x83/frame 0xfffffe00e68bd790 swap_pager_swapoff_object() at swap_pager_swapoff_object+0x342/frame 0xfffffe00e68bd890 swap_pager_swapoff() at swap_pager_swapoff+0xf8/frame 0xfffffe00e68bd900 swapoff_one() at swapoff_one+0x14a/frame 0xfffffe00e68bd950 sys_swapoff() at sys_swapoff+0x1d5/frame 0xfffffe00e68bdac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e68bdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e68bdbf0 --- syscall (424, FreeBSD ELF64, sys_swapoff), rip = 0x8002f688a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe5d0 --- db:1:pho1> show allpcpu Current CPU: 5 cpuid = 0 dynamic pcpu = 0x975d80 curthread = 0xfffffe003e3e4300: pid 11 tid 100003 critnest 1 "idle: cpu0" curpcb = 0xfffffe003e3e4800 fpcurthread = none idlethread = 0xfffffe003e3e4300: tid 100003 "idle: cpu0" self = 0xffffffff82410000 curpmap = 0xffffffff81d9ea00 tssp = 0xffffffff82410384 rsp0 = 0xfffffe00add72cc0 kcr3 = 0x8000000002306002 ucr3 = 0xffffffffffffffff scr3 = 0x4aae2aab gs32p = 0xffffffff82410404 ldt = 0xffffffff82410444 tss = 0xffffffff82410434 tlb gen = 57166739 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bc7f6d80 curthread = 0xfffffe003e3e3c00: pid 11 tid 100004 critnest 1 "idle: cpu1" curpcb = 0xfffffe003e3e4100 fpcurthread = none idlethread = 0xfffffe003e3e3c00: tid 100004 "idle: cpu1" self = 0xffffffff82411000 curpmap = 0xffffffff81d9ea00 tssp = 0xffffffff82411384 rsp0 = 0xfffffe00add77cc0 kcr3 = 0x8000000002306002 ucr3 = 0xffffffffffffffff scr3 = 0x160386fd6 gs32p = 0xffffffff82411404 ldt = 0xffffffff82411444 tss = 0xffffffff82411434 tlb gen = 57166737 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bc802d80 curthread = 0xfffffe00d6099e00: pid 30 tid 100128 critnest 0 "dom0" curpcb = 0xfffffe00d609a300 fpcurthread = none idlethread = 0xfffffe003e3e3500: tid 100005 "idle: cpu2" self = 0xffffffff82412000 curpmap = 0xffffffff81d9ea00 tssp = 0xffffffff82412384 rsp0 = 0xfffffe0037bdccc0 kcr3 = 0x8000000002306002 ucr3 = 0xffffffffffffffff scr3 = 0x1323e08c4 gs32p = 0xffffffff82412404 ldt = 0xffffffff82412444 tss = 0xffffffff82412434 tlb gen = 57166739 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bc80ed80 curthread = 0xfffffe003e3e2e00: pid 11 tid 100006 critnest 1 "idle: cpu3" curpcb = 0xfffffe003e3e3300 fpcurthread = none idlethread = 0xfffffe003e3e2e00: tid 100006 "idle: cpu3" self = 0xffffffff82413000 curpmap = 0xffffffff81d9ea00 tssp = 0xffffffff82413384 rsp0 = 0xfffffe00add81cc0 kcr3 = 0x8000000002306002 ucr3 = 0xffffffffffffffff scr3 = 0x3adbc0b5f gs32p = 0xffffffff82413404 ldt = 0xffffffff82413444 tss = 0xffffffff82413434 tlb gen = 57166739 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bc81ad80 curthread = 0xfffffe003e3e2700: pid 11 tid 100007 critnest 1 "idle: cpu4" curpcb = 0xfffffe003e3e2c00 fpcurthread = none idlethread = 0xfffffe003e3e2700: tid 100007 "idle: cpu4" self = 0xffffffff82414000 curpmap = 0xffffffff81d9ea00 tssp = 0xffffffff82414384 rsp0 = 0xfffffe00add86cc0 kcr3 = 0x8000000002306002 ucr3 = 0xffffffffffffffff scr3 = 0x27a301847 gs32p = 0xffffffff82414404 ldt = 0xffffffff82414444 tss = 0xffffffff82414434 tlb gen = 57166739 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bc826d80 curthread = 0xfffffe00e4206700: pid 38801 tid 100282 critnest 1 "swapoff" curpcb = 0xfffffe00e4206c00 fpcurthread = 0xfffffe00e4206700: pid 38801 "swapoff" idlethread = 0xfffffe003e3e2000: tid 100008 "idle: cpu5" self = 0xffffffff82415000 curpmap = 0xfffffe00e38fd120 tssp = 0xffffffff82415384 rsp0 = 0xfffffe00e68bdcc0 kcr3 = 0x800000072e70453a ucr3 = 0x800000070711cd3a scr3 = 0x70711cd3a gs32p = 0xffffffff82415404 ldt = 0xffffffff82415444 tss = 0xffffffff82415434 tlb gen = 57166739 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bc832d80 curthread = 0xfffffe003e3eca00: pid 11 tid 100009 critnest 1 "idle: cpu6" curpcb = 0xfffffe003e3ecf00 fpcurthread = none idlethread = 0xfffffe003e3eca00: tid 100009 "idle: cpu6" self = 0xffffffff82416000 curpmap = 0xffffffff81d9ea00 tssp = 0xffffffff82416384 rsp0 = 0xfffffe00add90cc0 kcr3 = 0x8000000002306002 ucr3 = 0xffffffffffffffff scr3 = 0x72fe5c82 gs32p = 0xffffffff82416404 ldt = 0xffffffff82416444 tss = 0xffffffff82416434 tlb gen = 57166739 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bc83ed80 curthread = 0xfffffe00e62d4000: pid 32542 tid 100370 critnest 0 "swapoff3" curpcb = 0xfffffe00e62d4500 fpcurthread = 0xfffffe00e62d4000: pid 32542 "swapoff3" idlethread = 0xfffffe003e3ec300: tid 100010 "idle: cpu7" self = 0xffffffff82417000 curpmap = 0xffffffff81d9ea00 tssp = 0xffffffff82417384 rsp0 = 0xfffffe00e7277cc0 kcr3 = 0x8000000002306002 ucr3 = 0xffffffffffffffff scr3 = 0x2461b2f54 gs32p = 0xffffffff82417404 ldt = 0xffffffff82417444 tss = 0xffffffff82417434 tlb gen = 57166739 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bc84ad80 curthread = 0xfffffe003e3ebc00: pid 11 tid 100011 critnest 1 "idle: cpu8" curpcb = 0xfffffe003e3ec100 fpcurthread = none idlethread = 0xfffffe003e3ebc00: tid 100011 "idle: cpu8" self = 0xffffffff82418000 curpmap = 0xffffffff81d9ea00 tssp = 0xffffffff82418384 rsp0 = 0xfffffe00add9acc0 kcr3 = 0x8000000002306002 ucr3 = 0xffffffffffffffff scr3 = 0x72fe59c8 gs32p = 0xffffffff82418404 ldt = 0xffffffff82418444 tss = 0xffffffff82418434 tlb gen = 57166739 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bc856d80 curthread = 0xfffffe00d3df9300: pid 30 tid 100138 critnest 0 "laundry: dom0" curpcb = 0xfffffe00d3df9800 fpcurthread = none idlethread = 0xfffffe003e3eb500: tid 100012 "idle: cpu9" self = 0xffffffff82419000 curpmap = 0xffffffff81d9ea00 tssp = 0xffffffff82419384 rsp0 = 0xfffffe00de7eecc0 kcr3 = 0x8000000002306002 ucr3 = 0xffffffffffffffff scr3 = 0x2165c1ec6 gs32p = 0xffffffff82419404 ldt = 0xffffffff82419444 tss = 0xffffffff82419434 tlb gen = 57166739 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bc862d80 curthread = 0xfffffe003e3eae00: pid 11 tid 100013 critnest 1 "idle: cpu10" curpcb = 0xfffffe003e3eb300 fpcurthread = none idlethread = 0xfffffe003e3eae00: tid 100013 "idle: cpu10" self = 0xffffffff8241a000 curpmap = 0xffffffff81d9ea00 tssp = 0xffffffff8241a384 rsp0 = 0xfffffe00adda4cc0 kcr3 = 0x8000000002306002 ucr3 = 0xffffffffffffffff scr3 = 0x5227c097b gs32p = 0xffffffff8241a404 ldt = 0xffffffff8241a444 tss = 0xffffffff8241a434 tlb gen = 57166739 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bc86ed80 curthread = 0xfffffe003e3ea700: pid 11 tid 100014 critnest 1 "idle: cpu11" curpcb = 0xfffffe003e3eac00 fpcurthread = none idlethread = 0xfffffe003e3ea700: tid 100014 "idle: cpu11" self = 0xffffffff8241b000 curpmap = 0xffffffff81d9ea00 tssp = 0xffffffff8241b384 rsp0 = 0xfffffe00adda9cc0 kcr3 = 0x8000000002306002 ucr3 = 0xffffffffffffffff scr3 = 0x5227c0feb gs32p = 0xffffffff8241b404 ldt = 0xffffffff8241b444 tss = 0xffffffff8241b434 tlb gen = 57166739 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 38801 (swapoff) thread 0xfffffe00e4206700 (100282) exclusive rw vm object (vm object) r = 0 (0xfffff801dc74f630) locked @ vm/vm_domainset.c:250 exclusive sx swsysc (swsysc) r = 0 (0xffffffff81d6f548) locked @ vm/swap_pager.c:2419 Process 32542 (swapoff3) thread 0xfffffe00e62d4000 (100370) exclusive rw vm object (vm object) r = 0 (0xfffff80564615840) locked @ vm/vm_object.c:662 Process 30 (pagedaemon) thread 0xfffffe00d6099e00 (100128) exclusive rw vm object (vm object) r = 0 (0xfffff805787e7108) locked @ vm/vm_pageout.c:1490 db:1:pho1> show lockedvnods Locked vnodes db:1:pho1> show mount 0xfffffe00d3ded700 /dev/gpt/work on / (ufs) 0xfffffe00d3dee280 devfs on /dev (devfs) 0xfffffe00e42a4280 /dev/gpt/tmp on /tmp (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 103174 Buf domain 0 freebufs 14841 lofreebufs 219 hifreebufs 329 bufspace 5464064 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 8 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 258 (4370432) dirtyq count 8 (262144) wakeup 0 lim 25 CPU 0, 0, 15, 3, 0, 2, 3, 2, 0, 0, 1, 0, Locked buffers: 0 space 0 Total buffers: 329 space 5464064 Buf domain 1 freebufs 15073 lofreebufs 219 hifreebufs 329 bufspace 1093632 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 34 (774144) dirtyq count 0 (0) wakeup 0 lim 25 CPU 2, 4, 8, 2, 0, 4, 0, 1, 4, 0, 0, 1, Locked buffers: 0 space 0 Total buffers: 60 space 1093632 Buf domain 2 freebufs 14893 lofreebufs 219 hifreebufs 329 bufspace 3956736 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 237 (3915776) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 0, 2, 0, 0, 0, 0, 0, 1, 0, 0, 0, Locked buffers: 0 space 0 Total buffers: 240 space 3956736 Buf domain 3 freebufs 15086 lofreebufs 219 hifreebufs 329 bufspace 716800 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 17 (90112) dirtyq count 0 (0) wakeup 0 lim 25 CPU 2, 5, 5, 1, 0, 6, 5, 1, 3, 0, 0, 2, Locked buffers: 0 space 0 Total buffers: 4877 space 716800 Buf domain 4 freebufs 15034 lofreebufs 219 hifreebufs 329 bufspace 2375680 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 24 (172032) dirtyq count 1 (32768) wakeup 0 lim 25 CPU 2, 2, 1, 14, 0, 11, 4, 4, 22, 13, 0, 1, Locked buffers: 0 space 0 Total buffers: 98406 space 2375680 Buf domain 5 freebufs 14458 lofreebufs 219 hifreebufs 329 bufspace 18386944 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 665 (18186240) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 1, 2, 1, 0, 1, 0, 2, 2, 0, 1, 0, Locked buffers: 0 space 0 Total buffers: 675 space 18386944 Buf domain 6 freebufs 13789 lofreebufs 219 hifreebufs 329 bufspace 43253760 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1330 (42889216) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 2, 5, 0, 0, 4, 3, 0, 0, 0, 0, 0, Locked buffers: 0 space 0 Total buffers: 1344 space 43253760 db:1:pho1> show page vm_cnt.v_free_count: 7941604 vm_cnt.v_inactive_count: 49 vm_cnt.v_active_count: 784 vm_cnt.v_laundry_count: 6394 vm_cnt.v_wire_count: 174905 vm_cnt.v_free_reserved: 10644 vm_cnt.v_free_min: 51264 vm_cnt.v_free_target: 173124 vm_cnt.v_inactive_target: 259686 db:1:pho1> show pageq pq_free 7941604 dom 0 page_cnt 8124099 free 7941604 pq_act 784 pq_inact 49 pq_laund 6394 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000157 | 000000 11 (008192K) | 000763 | 000000 10 (004096K) | 001404 | 000000 09 (002048K) | 002707 | 000000 08 (001024K) | 004377 | 000000 07 (000512K) | 005503 | 000000 06 (000256K) | 006532 | 000000 05 (000128K) | 007773 | 000001 04 (000064K) | 009751 | 000000 03 (000032K) | 013711 | 000001 02 (000016K) | 018828 | 000002 01 (000008K) | 024423 | 000005 00 (000004K) | 026142 | 000022 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000000 | 000000 05 (000128K) | 000001 | 000000 04 (000064K) | 000003 | 000000 03 (000032K) | 000003 | 000000 02 (000016K) | 000003 | 000000 01 (000008K) | 000002 | 000000 00 (000004K) | 000004 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree RADIX NODE 144 9425 535277 36493676 0 62 78437088 0 VM OBJECT 264 5925 155850 41595104 0 30 42708600 0 VNODE 640 42378 444 39213954 0 16 27406080 0 mbuf_cluster 2048 11918 122 42649 0 8 24657920 0 BUF TRIE 144 327 105625 9617893 0 62 15257088 0 swblk 136 12 92179 551865 0 62 12537976 0 FFS2 dinode 256 42259 1256 39213799 0 62 11139840 0 FFS inode 160 42259 2091 39213799 0 62 7096000 0 S VFS Cache 108 42541 7787 20355814 0 126 5435424 0 mbuf 256 16108 2745 82163 0 254 4826368 0 socket 904 41 2758 6231 0 16 2530296 0 128 128 14410 191 122656922 0 126 1868928 0 128 128 10814 408 1055413944 0 126 1436416 0 4096 4096 347 0 79155 0 2 1421312 0 vmem btag 56 12626 10464 43464 0 254 1293040 0 UMA Slabs 0 112 7064 3568 4466819 0 126 1190784 0 swpctrie 144 2 7754 49468 0 62 1116864 0 THREAD 1776 520 65 755 0 8 1038960 0 8192 8192 98 0 98 0 1 802816 0 pbuf 984 0 811 0 0 0 798024 0 VMSPACE 2536 40 272 838193 0 4 791232 0 32768 32768 24 0 156011 0 1 786432 0 64 64 9010 818 1385014 0 254 628992 0 64 64 9294 471 705358481 0 254 624960 0 16384 16384 37 0 37 0 1 606208 0 4096 4096 133 4 928371 0 2 561152 0 PROC 1328 75 327 838245 0 8 533856 0 MAP ENTRY 96 1568 2926 40530358 0 126 431424 0 128 128 2176 955 365126 0 126 400768 0 16384 16384 22 0 812517 0 1 360448 0 512 512 511 73 608 0 30 299008 0 32768 32768 9 0 4322 0 1 294912 0 64 64 3430 791 541362025 0 254 270144 0 32 32 6946 1496 150978 0 254 270144 0 65536 65536 4 0 4 0 1 262144 0 256 256 631 389 137718364 0 62 261120 0 16 16 13872 1878 261694 0 254 252000 0 filedesc0 1104 75 121 838246 0 8 216384 0 Files 80 113 2437 33296346 0 126 204000 0 65536 65536 3 0 2685 0 1 196608 0 UMA Zones 2176 86 3 90 0 4 193664 0 2048 2048 88 2 88 0 8 184320 0 1024 1024 149 31 232 0 16 184320 0 8192 8192 22 0 12825 0 1 180224 0 ksiginfo 112 377 811 19612 0 126 133056 0 65536 65536 2 0 2 0 1 131072 0 256 256 232 263 4305762 0 62 126720 0 128 128 713 248 3420049 0 126 123008 0 TURNSTILE 136 586 296 586 0 62 119952 0 selfd 64 129 1635 197839 0 254 112896 0 rl_entry 40 397 2128 397 0 254 101000 0 256 256 215 175 379 0 62 99840 0 512 512 91 93 269781 0 30 94208 0 4096 4096 22 0 1992 0 2 90112 0 2048 2048 27 17 1262602 0 8 90112 0 64 64 261 1125 841983 0 254 88704 0 ttyinq 160 330 220 540 0 62 88000 0 64 64 177 1146 840977 0 254 84672 0 256 256 111 219 642 0 62 84480 0 16384 16384 5 0 5 0 1 81920 0 512 512 76 84 377387 0 30 81920 0 SLEEPQUEUE 88 586 342 586 0 126 81664 0 ttyoutq 256 173 142 282 0 62 80640 0 128 128 111 509 1101 0 126 79360 0 256 256 103 197 13540 0 62 76800 0 64 64 210 986 193588 0 254 76544 0 128 128 177 412 6831910 0 126 75392 0 1024 1024 50 22 2570 0 16 73728 0 32 32 571 1697 32122 0 254 72576 0 fakepg 104 0 663 172 0 126 68952 0 65536 65536 1 0 1 0 1 65536 0 65536 65536 1 0 1 0 1 65536 0 65536 65536 1 0 1 0 1 65536 0 32768 32768 2 0 2 0 1 65536 0 32768 32768 2 0 2 0 1 65536 0 128 128 47 449 153 0 126 63488 0 32 32 143 1747 162886 0 254 60480 0 512 512 33 79 33 0 30 57344 0 L VFS Cache 328 148 20 240 0 30 55104 0 1024 1024 34 18 1289177 0 16 53248 0 32 32 68 1570 5365 0 254 52416 0 16 16 18 3232 111 0 254 52000 0 1024 1024 35 13 35 0 16 49152 0 16 16 441 2559 6869 0 254 48000 0 Mountpoints 2944 3 13 15 0 4 47104 0 64 pcpu 8 3104 2528 3500 0 254 45056 0 32 32 233 1153 1787 0 254 44352 0 16 16 415 2335 24713 0 254 44000 0 8192 8192 5 0 5 0 1 40960 0 512 512 27 53 47077645 0 30 40960 0 32 32 181 1079 16245 0 254 40320 0 cpuset 104 27 345 27 0 126 38688 0 unpcb 256 17 118 5158 0 62 34560 0 256 256 37 98 32767593 0 62 34560 0 8192 8192 4 0 4 0 1 32768 0 mt_stats_zone 64 431 81 431 0 254 32768 0 UMA Kegs 384 75 0 79 0 30 28800 0 4096 4096 7 0 7 0 2 28672 0 KMAP ENTRY 96 15 276 15 0 126 27936 0 rtentry 208 12 121 15 0 62 27664 0 udp_inpcb 488 16 40 999 0 30 27328 0 256 256 12 93 34746 0 62 26880 0 pipe 760 8 27 486472 0 16 26600 0 8192 8192 3 0 14 0 1 24576 0 16 16 17 1483 18 0 254 24000 0 16 16 35 1465 36 0 254 24000 0 2048 2048 7 3 150 0 8 20480 0 1024 1024 11 9 14 0 16 20480 0 tcpcb 1008 5 15 19 0 16 20160 0 udpcb 32 16 614 999 0 254 20160 0 64 64 9 306 18 0 254 20160 0 32 32 8 622 65687 0 254 20160 0 mt_zone 24 431 404 431 0 254 20040 0 16 16 471 779 916320 0 254 20000 0 16384 16384 1 0 1 0 1 16384 0 4096 4096 4 0 4 0 2 16384 0 1024 1024 5 11 2308 0 16 16384 0 32 32 12 492 13 0 254 16128 0 128 128 9 115 3703269 0 126 15872 0 tcp_inpcb 488 5 27 19 0 30 15616 0 256 256 18 42 7281353 0 62 15360 0 MAP 216 2 69 2 0 62 15336 0 2048 2048 3 3 4 0 8 12288 0 1024 1024 8 4 8 0 16 12288 0 512 512 15 9 32 0 30 12288 0 8192 8192 1 0 1 0 1 8192 0 4096 4096 1 1 121 0 2 8192 0 2048 2048 2 2 5636 0 8 8192 0 2048 2048 2 2 2 0 8 8192 0 g_bio 408 0 20 30779703 0 30 8160 0 mbuf_packet 256 17 0 13512 0 254 4352 0 NAMEI 1024 0 4 375657165 0 16 4096 0 epoch_record pcpu 256 4 12 4 0 62 4096 0 4096 4096 1 0 13 0 2 4096 0 4096 4096 1 0 1 0 2 4096 0 2048 2048 2 0 2 0 8 4096 0 2048 2048 1 1 1 0 8 4096 0 int pcpu 4 66 958 66 0 254 4096 0 hostcache 96 1 41 1 0 126 4032 0 procdesc 136 1 28 24 0 62 3944 0 ripcb 488 1 7 7 0 30 3904 0 UMA Slabs 1 176 11 10 11 0 62 3696 0 vmem 1856 0 1 0 0 8 1856 0 swwbuf 984 1 0 545948 0 2 984 0 FFS1 dinode 128 0 0 0 0 126 0 0 IPsec SA lft_c 16 0 0 0 0 254 0 0 udplite_inpcb 488 0 0 0 0 30 0 0 sctp_asconf_ack 48 0 0 0 0 254 0 0 sctp_asconf 40 0 0 0 0 254 0 0 sctp_stream_msg_out 112 0 0 0 0 126 0 0 sctp_readq 152 0 0 0 0 62 0 0 sctp_chunk 152 0 0 0 0 62 0 0 sctp_raddr 736 0 0 0 0 16 0 0 sctp_laddr 48 0 0 4 0 254 0 0 sctp_asoc 2288 0 0 0 0 4 0 0 sctp_ep 1280 0 0 0 0 8 0 0 tcp_log_node 120 0 0 0 0 126 0 0 tcp_log_bucket 184 0 0 0 0 62 0 0 tcp_log 408 0 0 0 0 30 0 0 tcpreass 48 0 0 0 0 254 0 0 tfo_ccache_entries 80 0 0 0 0 126 0 0 tfo 4 0 0 0 0 254 0 0 sackhole 32 0 0 0 0 254 0 0 syncache 168 0 0 1 0 62 0 0 tcptw 88 0 0 4 0 126 0 0 ipq 56 0 0 0 0 254 0 0 KNOTE 160 0 0 6 0 62 0 0 itimer 352 0 0 0 0 30 0 0 AIOLIO 280 0 0 0 0 30 0 0 AIOCB 752 0 0 0 0 16 0 0 AIOP 32 0 0 0 0 254 0 0 AIO 208 0 0 0 0 62 0 0 DIRHASH 1024 0 0 1547721 0 16 0 0 NCLNODE 744 0 0 2 0 16 0 0 LTS VFS Cache 368 0 0 0 0 30 0 0 STS VFS Cache 148 0 0 2 0 62 0 0 rentr 24 0 0 13 0 254 0 0 VNODEPOLL 120 0 0 0 0 126 0 0 vtnet_tx_hdr 24 0 0 0 0 254 0 0 crypto_session 24 0 0 0 0 254 0 0 cryptodesc 120 0 0 0 0 126 0 0 cryptop 128 0 0 0 0 126 0 0 nvme_request 128 0 0 0 0 126 0 0 FPU_save_area 832 0 0 0 0 16 0 0 DMAR_MAP_ENTRY 128 0 0 0 0 126 0 0 mbuf_extpgs 256 0 0 0 0 62 0 0 mbuf_jumbo_16k 16384 0 0 0 0 1 0 0 mbuf_jumbo_9k 9216 0 0 0 0 1 0 0 mbuf_jumbo_page 4096 0 0 2 0 2 0 0 audit_record 1280 0 0 0 0 8 0 0 domainset 40 0 0 0 0 254 0 0 MAC labels 40 0 0 0 0 254 0 0 vnpbuf 984 0 0 0 0 16 0 0 clpbuf 984 0 0 1929145 0 4 0 0 mdpbuf 984 0 0 196781 0 0 0 0 nfspbuf 984 0 0 0 0 4 0 0 swrbuf 984 0 0 142279 166 4 0 0 umtx_shm 88 0 0 0 0 126 0 0 umtx pi 96 0 0 0 0 126 0 0 rangeset pctrie nodes 144 0 0 0 0 62 0 0 65536 65536 0 0 0 0 1 0 0 65536 65536 0 0 0 0 1 0 0 32768 32768 0 0 0 0 1 0 0 32768 32768 0 0 0 0 1 0 0 32768 32768 0 0 0 0 1 0 0 32768 32768 0 0 0 0 1 0 0 16384 16384 0 0 0 0 1 0 0 16384 16384 0 0 0 0 1 0 0 16384 16384 0 0 45 0 1 0 0 16384 16384 0 0 0 0 1 0 0 8192 8192 0 0 0 0 1 0 0 8192 8192 0 0 0 0 1 0 0 1024 1024 0 0 20 0 16 0 0 512 512 0 0 295 0 30 0 0 512 512 0 0 0 0 30 0 0 64 64 0 0 12 0 254 0 0 16 16 0 0 4 0 254 0 0 SMR CPU 24 0 0 0 0 254 0 0 SMR SHARED 16 0 0 0 0 254 0 0 256 Bucket 2048 0 0 12335255 0 8 0 0 128 Bucket 1024 0 0 2325017 0 16 0 0 64 Bucket 512 0 0 1990145 0 30 0 0 4 Bucket 48 0 0 669702 0 254 0 0 2 Bucket 32 0 0 1148904 0 254 0 0 UMA Hash 256 0 0 0 0 62 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket debugnet_mbuf_packet 2048 0 0 0 0 debugnet_mbuf_cluster 2048 -6144 0 0 0 debugnet_mbuf 256 -10240 0 0 0 kstack_cache 16384 393 0 628 1 vm pgcache 4096 59098 0 30521583 2 vm pgcache 4096 16621 0 168424455 2 buf free cache 984 2757 0 12129385 16 buffer arena-65 65536 0 0 1 1 buffer arena-61 61440 0 0 0 1 buffer arena-57 57344 0 0 0 1 buffer arena-53 53248 0 0 0 1 buffer arena-49 49152 0 0 0 1 buffer arena-45 45056 0 0 0 1 buffer arena-40 40960 0 0 0 1 buffer arena-36 36864 0 0 0 1 buffer arena-32 32768 195 0 3503333 1 buffer arena-28 28672 0 0 0 1 buffer arena-24 24576 0 0 0 1 buffer arena-20 20480 0 0 0 1 buffer arena-16 16384 3 0 1040 1 buffer arena-12 12288 0 0 0 1 buffer arena-81 8192 0 0 0 1 buffer arena-40 4096 0 0 0 2 db:0:pho> acttrace Tracing command swapoff pid 38801 tid 100282 td 0xfffffe00e4206700 (CPU 5) kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e68bd620 vpanic() at vpanic+0x1a1/frame 0xfffffe00e68bd680 panic() at panic+0x43/frame 0xfffffe00e68bd6e0 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x83/frame 0xfffffe00e68bd790 swap_pager_swapoff_object() at swap_pager_swapoff_object+0x342/frame 0xfffffe00e68bd890 swap_pager_swapoff() at swap_pager_swapoff+0xf8/frame 0xfffffe00e68bd900 swapoff_one() at swapoff_one+0x14a/frame 0xfffffe00e68bd950 sys_swapoff() at sys_swapoff+0x1d5/frame 0xfffffe00e68bdac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e68bdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e68bdbf0 --- syscall (424, FreeBSD ELF64, sys_swapoff), rip = 0x8002f688a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe5d0 --- Tracing command swapoff3 pid 32542 tid 100370 td 0xfffffe00e62d4000 (CPU 7) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1c7dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1c7df0 trap() at trap+0x56/frame 0xfffffe003e1c7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1c7f20 --- trap 0x13, rip = 0xffffffff80f3e0e1, rsp = 0xfffffe00e7277630, rbp = 0xfffffe00e7277650 --- vm_radix_reclaim_allnodes_int() at vm_radix_reclaim_allnodes_int+0x11/frame 0xfffffe00e7277650 vm_radix_reclaim_allnodes_int() at vm_radix_reclaim_allnodes_int+0x55/frame 0xfffffe00e7277680 vm_object_terminate() at vm_object_terminate+0x1c8/frame 0xfffffe00e72776c0 vm_object_deallocate() at vm_object_deallocate+0x372/frame 0xfffffe00e72776f0 vm_map_process_deferred() at vm_map_process_deferred+0xad/frame 0xfffffe00e7277710 vm_map_remove() at vm_map_remove+0xeb/frame 0xfffffe00e7277740 vmspace_exit() at vmspace_exit+0xd5/frame 0xfffffe00e7277780 exit1() at exit1+0x5a2/frame 0xfffffe00e72777f0 sigexit() at sigexit+0xd7a/frame 0xfffffe00e7277ae0 postsig() at postsig+0x336/frame 0xfffffe00e7277bb0 ast() at ast+0x4df/frame 0xfffffe00e7277bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe700 Tracing command pagedaemon pid 30 tid 100128 td 0xfffffe00d6099e00 (CPU 2) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e18bdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e18bdf0 trap() at trap+0x56/frame 0xfffffe003e18bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e18bf20 --- trap 0x13, rip = 0xffffffff80bc5895, rsp = 0xfffffe0037bdc6d0, rbp = 0xfffffe0037bdc6f0 --- __rw_rlock_int() at __rw_rlock_int+0xb5/frame 0xfffffe0037bdc6f0 pmap_page_is_mapped() at pmap_page_is_mapped+0x6f/frame 0xfffffe0037bdc720 vm_page_free_prep() at vm_page_free_prep+0x91/frame 0xfffffe0037bdc740 vm_page_free_toq() at vm_page_free_toq+0x12/frame 0xfffffe0037bdc770 vm_pageout_worker() at vm_pageout_worker+0xa20/frame 0xfffffe0037bdcb70 vm_pageout() at vm_pageout+0x193/frame 0xfffffe0037bdcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bdcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bdcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100138 td 0xfffffe00d3df9300 (CPU 9) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1dfdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1dfdf0 trap() at trap+0x56/frame 0xfffffe003e1dff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1dff20 --- trap 0x13, rip = 0xffffffff80f0a572, rsp = 0xfffffe00de7ee4f0, rbp = 0xfffffe00de7ee520 --- uma_zalloc_arg() at uma_zalloc_arg+0x12/frame 0xfffffe00de7ee520 swapgeom_strategy() at swapgeom_strategy+0xbc/frame 0xfffffe00de7ee560 swp_pager_strategy() at swp_pager_strategy+0xfd/frame 0xfffffe00de7ee590 swap_pager_putpages() at swap_pager_putpages+0x5bd/frame 0xfffffe00de7ee630 vm_pageout_flush() at vm_pageout_flush+0xf5/frame 0xfffffe00de7ee6c0 vm_pageout_cluster() at vm_pageout_cluster+0x352/frame 0xfffffe00de7ee930 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x7fc/frame 0xfffffe00de7eebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de7eebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de7eebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffffe003e3e4300 (CPU 0) cpustop_handler() at cpustop_handler+0x2a/frame 0xffffffff81d87450 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xffffffff81d87470 trap() at trap+0x56/frame 0xffffffff81d875a0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81d875a0 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00add72a30, rbp = 0xfffffe00add72a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add72a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add72a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add72ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add72ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add72bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add72bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add72bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe003e3e3c00 (CPU 1) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e17fdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e17fdf0 trap() at trap+0x56/frame 0xfffffe003e17ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e17ff20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00add77a30, rbp = 0xfffffe00add77a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add77a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add77a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add77ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add77ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add77bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add77bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add77bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe003e3e2e00 (CPU 3) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e197dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e197df0 trap() at trap+0x56/frame 0xfffffe003e197f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e197f20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00add81a30, rbp = 0xfffffe00add81a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add81a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add81a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add81ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add81ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add81bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add81bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add81bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe003e3e2700 (CPU 4) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1a3dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1a3df0 trap() at trap+0x56/frame 0xfffffe003e1a3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1a3f20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00add86a30, rbp = 0xfffffe00add86a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add86a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add86a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add86ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add86ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add86bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add86bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add86bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe003e3eca00 (CPU 6) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1bbdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1bbdf0 trap() at trap+0x56/frame 0xfffffe003e1bbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1bbf20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00add90a30, rbp = 0xfffffe00add90a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add90a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add90a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add90ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add90ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add90bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add90bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add90bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe003e3ebc00 (CPU 8) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1d3dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1d3df0 trap() at trap+0x56/frame 0xfffffe003e1d3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1d3f20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00add9aa30, rbp = 0xfffffe00add9aa30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add9aa30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add9aa90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add9aab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add9aad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add9abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add9abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add9abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe003e3eae00 (CPU 10) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1ebdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1ebdf0 trap() at trap+0x56/frame 0xfffffe003e1ebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1ebf20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00adda4a30, rbp = 0xfffffe00adda4a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adda4a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00adda4a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00adda4ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00adda4ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00adda4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe003e3ea700 (CPU 11) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1f7dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1f7df0 trap() at trap+0x56/frame 0xfffffe003e1f7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1f7f20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00adda9a30, rbp = 0xfffffe00adda9a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adda9a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00adda9a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00adda9ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00adda9ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00adda9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 38801 32521 32367 0 R+ CPU 5 swapoff 38798 2522 2477 0 ?W sh 32542 32521 32367 0 RE+ CPU 7 swapoff3 32540 0 0 0 DL mdwait 0xfffff807ce419000 [md11] 32536 0 0 0 DL mdwait 0xfffff806a292e000 [md10] 32522 32367 32367 0 S+ piperd 0xfffff802d7707000 tee 32521 32520 32367 0 SW+ wait 0xfffff80183df1a60 sh 32520 32367 32367 0 SW+ wait 0xfffff801dc5e9530 sh 32367 2362 32367 0 SW+ wait 0xfffff800215d3530 sh 2525 2477 2477 0 S piperd 0xfffff800217e6000 sh 2523 2477 2477 0 S piperd 0xfffff800219232f8 awk 2522 2477 2477 0 SW wait 0xfffff80021594000 sh 2477 1 2477 0 SWs wait 0xfffff80160009530 sh 2362 2360 2362 0 SW+ wait 0xfffff8002164b530 bash 2360 2359 2360 0 SW+ pause 0xfffff8016057d0a8 csh 2359 2353 2359 2006 SW+ wait 0xfffff8002165a000 su 2353 2352 2353 2006 SWs+ wait 0xfffff80021a41530 bash 2352 2349 2349 2006 S select 0xfffff800041851c0 sshd 2349 2285 2349 0 Ss select 0xfffff8002193c3c0 sshd 2345 2344 2345 0 S+ ttyin 0xfffff80003b174b0 csh 2344 1 2344 0 SWs+ wait 0xfffff8016057da60 login 2343 1 2343 0 Ss+ ttyin 0xfffff80003b178b0 getty 2342 1 2342 0 Ss+ ttyin 0xfffff800210dc8b0 getty 2341 1 2341 0 Ss+ ttyin 0xfffff800210dccb0 getty 2340 1 2340 0 Ss+ ttyin 0xfffff800210db0b0 getty 2339 1 2339 0 Ss+ ttyin 0xfffff800210db4b0 getty 2338 1 2338 0 Ss+ ttyin 0xfffff800210db8b0 getty 2337 1 2337 0 Ss+ ttyin 0xfffff800210dbcb0 getty 2336 1 2336 0 Ss+ ttyin 0xfffff800210da0b0 getty 2335 1 2335 0 Ss+ ttyin 0xfffff800210da4b0 getty 2289 1 2289 0 Ss nanslp 0xffffffff81c82711 cron 2285 1 2285 0 Ss select 0xfffff80004185240 sshd 2257 1 2257 0 Ss select 0xfffff800041920c0 powerd 2254 1 2254 123 Ss (threaded) ntpd 100189 S select 0xfffff800039b04c0 ntpd 100755 S usem 0xfffff800210aa880 ntpd 2140 1 2140 0 Ss nanslp 0xffffffff81c82717 watchdogd 2061 1 2061 0 Ss select 0xfffff80004185340 rpcbind 2051 1 2051 0 Ss select 0xfffff800210a9840 syslogd 1980 1 1980 0 Ss select 0xfffff80004193ec0 devd 1975 1 1975 65 Ss select 0xfffff800039b0540 dhclient 1928 1 1928 0 Ss select 0xfffff8002110b440 dhclient 1925 1 1925 0 Ss select 0xfffff80021211ec0 dhclient 34 0 0 0 DL vlruwt 0xfffff80021090000 [vnlru] 33 0 0 0 DL syncer 0xffffffff81d58b98 [syncer] 32 0 0 0 DL (threaded) [bufdaemon] 100130 D qsleep 0xffffffff81d58098 [bufdaemon] 100131 D - 0xffffffff8180a980 [bufspacedaemon-0] 100132 D - 0xffffffff81812c40 [bufspacedaemon-1] 100133 D - 0xffffffff8181af00 [bufspacedaemon-2] 100134 D - 0xffffffff818231c0 [bufspacedaemon-3] 100135 D - 0xffffffff8182b480 [bufspacedaemon-4] 100136 D - 0xffffffff81833740 [bufspacedaemon-5] 100137 D - 0xffffffff8183ba00 [bufspacedaemon-6] 100154 D sdflush 0xfffff800041890e8 [/ worker] 100200 D sdflush 0xfffff80021501ce8 [/tmp worker] 31 0 0 0 DL psleep 0xffffffff81d73b08 [vmdaemon] 30 0 0 0 RL (threaded) [pagedaemon] 100128 Run CPU 2 [dom0] 100138 Run CPU 9 [laundry: dom0] 100140 D umarcl 0xffffffff80f0dc20 [uma] 29 0 0 0 DL idle 0xfffff8002118b530 [enc_daemon1] 28 0 0 0 DL idle 0xfffff8002118ba60 [enc_daemon0] 27 0 0 0 DL - 0xffffffff81adcfb0 [rand_harvestq] 26 0 0 0 DL waiting 0xffffffff81de5060 [sctp_iterator] 25 0 0 0 DL - 0xffffffff81d57a9c [soaiod4] 24 0 0 0 DL - 0xffffffff81d57a9c [soaiod3] 23 0 0 0 DL - 0xffffffff81d57a9c [soaiod2] 22 0 0 0 DL - 0xffffffff81d57a9c [soaiod1] 21 0 0 0 DL (threaded) [usb] 100096 D - 0xfffffe00d2d84440 [usbus0] 100097 D - 0xfffffe00d2d84498 [usbus0] 100098 D - 0xfffffe00d2d844f0 [usbus0] 100099 D - 0xfffffe00d2d84548 [usbus0] 100100 D - 0xfffffe00d2d845a0 [usbus0] 100102 D - 0xfffffe003e4a1cf0 [usbus1] 100103 D - 0xfffffe003e4a1d48 [usbus1] 100104 D - 0xfffffe003e4a1da0 [usbus1] 100105 D - 0xfffffe003e4a1df8 [usbus1] 100106 D - 0xfffffe003e4a1e50 [usbus1] 100107 D - 0xfffffe00d2e2bcf0 [usbus2] 100108 D - 0xfffffe00d2e2bd48 [usbus2] 100109 D - 0xfffffe00d2e2bda0 [usbus2] 100110 D - 0xfffffe00d2e2bdf8 [usbus2] 100111 D - 0xfffffe00d2e2be50 [usbus2] 20 0 0 0 RL (threaded) [cam] 100091 D - 0xffffffff819b83c0 [doneq0] 100092 RunQ [doneq1] 100093 D - 0xffffffff819b84c0 [doneq2] 100125 D - 0xffffffff819b8288 [scanner] 19 0 0 0 DL crypto_ 0xfffff80003accc50 [crypto returns 11] 18 0 0 0 DL crypto_ 0xfffff80003accbf0 [crypto returns 10] 17 0 0 0 DL crypto_ 0xfffff80003accb90 [crypto returns 9] 16 0 0 0 DL crypto_ 0xfffff80003accb30 [crypto returns 8] 15 0 0 0 DL crypto_ 0xfffff80003accad0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff80003acca70 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff80003acca10 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff80003acc9b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff80003acc950 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff80003acc8f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff80003acc890 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff80003acc830 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff81d6db78 [crypto] 14 0 0 0 DL seqstat 0xfffff80003a35888 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100062 D - 0xffffffff81d9e0c8 [g_event] 100063 D - 0xffffffff81d9e0d8 [g_up] 100064 D - 0xffffffff81d9e0d0 [g_down] 12 0 0 0 WL (threaded) [intr] 100016 I [swi6: task queue] 100017 I [swi6: Giant taskq] 100019 I [swi5: fast taskq] 100047 I [swi1: netisr 0] 100048 I [swi4: clock (0)] 100049 I [swi4: clock (1)] 100050 I [swi4: clock (2)] 100051 I [swi4: clock (3)] 100052 I [swi4: clock (4)] 100053 I [swi4: clock (5)] 100054 I [swi4: clock (6)] 100055 I [swi4: clock (7)] 100056 I [swi4: clock (8)] 100057 I [swi4: clock (9)] 100058 I [swi4: clock (10)] 100059 I [swi4: clock (11)] 100060 I [swi3: vm] 100094 I [irq56: ahci0] 100095 I [irq19: xhci0] 100101 I [irq18: ehci0 ehci1] 100112 I [irq71: ahci1] 100113 I [swi0: uart uart] 100177 I [irq72: ioat0] 100178 I [irq73: ioat1] 100179 I [irq74: ioat2] 100180 I [irq75: ioat3] 100181 I [irq76: ioat4] 100182 I [irq77: ioat5] 100183 I [irq78: ioat6] 100184 I [irq79: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 CanRun [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 100007 Run CPU 4 [idle: cpu4] 100008 CanRun [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 CanRun [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 CanRun [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 1 0 1 0 SLs wait 0xfffff80003896000 [init] 10 0 0 0 DL audit_w 0xffffffff81de5cf0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81d8d688 [swapper] 100015 D - 0xfffff8000377f100 [aiod_kick taskq] 100018 D - 0xfffff8000377ea00 [thread taskq] 100020 D - 0xfffff80003777000 [config_0] 100021 D - 0xfffff8000377e500 [kqueue_ctx taskq] 100022 D - 0xfffff80003776e00 [if_io_tqg_0] 100023 D - 0xfffff80003776d00 [if_io_tqg_1] 100024 D - 0xfffff80003776c00 [if_io_tqg_2] 100025 D - 0xfffff80003776b00 [if_io_tqg_3] 100026 D - 0xfffff80003776a00 [if_io_tqg_4] 100027 D - 0xfffff80003776900 [if_io_tqg_5] 100028 D - 0xfffff80003776800 [if_io_tqg_6] 100029 D - 0xfffff80003776700 [if_io_tqg_7] 100030 D - 0xfffff80003776600 [if_io_tqg_8] 100031 D - 0xfffff80003776500 [if_io_tqg_9] 100032 D - 0xfffff80003776400 [if_io_tqg_10] 100033 D - 0xfffff80003776300 [if_io_tqg_11] 100034 D - 0xfffff80003776200 [if_config_tqg_0] 100035 D - 0xfffff80003776100 [softirq_0] 100036 D - 0xfffff80003776000 [softirq_1] 100037 D - 0xfffff80003775e00 [softirq_2] 100038 D - 0xfffff80003775d00 [softirq_3] 100039 D - 0xfffff80003775c00 [softirq_4] 100040 D - 0xfffff80003775b00 [softirq_5] 100041 D - 0xfffff80003775a00 [softirq_6] 100042 D - 0xfffff80003775900 [softirq_7] 100043 D - 0xfffff80003775800 [softirq_8] 100044 D - 0xfffff80003775700 [softirq_9] 100045 D - 0xfffff80003775600 [softirq_10] 100046 D - 0xfffff80003775500 [softirq_11] 100061 D - 0xfffff800039d4400 [firmware taskq] 100066 D - 0xfffff800039d3d00 [crypto_0] 100067 D - 0xfffff800039d3d00 [crypto_1] 100068 D - 0xfffff800039d3d00 [crypto_2] 100069 D - 0xfffff800039d3d00 [crypto_3] 100070 D - 0xfffff800039d3d00 [crypto_4] 100071 D - 0xfffff800039d3d00 [crypto_5] 100072 D - 0xfffff800039d3d00 [crypto_6] 100073 D - 0xfffff800039d3d00 [crypto_7] 100074 D - 0xfffff800039d3d00 [crypto_8] 100075 D - 0xfffff800039d3d00 [crypto_9] 100076 D - 0xfffff800039d3d00 [crypto_10] 100077 D - 0xfffff800039d3d00 [crypto_11] 100114 D - 0xfffff80003780300 [mca taskq] 100120 D - 0xfffff80021031700 [acpi_task_0] 100121 D - 0xfffff80021031700 [acpi_task_1] 100122 D - 0xfffff80021031700 [acpi_task_2] 100124 D - 0xfffff800039d2100 [CAM taskq] db:0:pho> allt Tracing command swapoff pid 38801 tid 100282 td 0xfffffe00e4206700 (CPU 5) kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e68bd620 vpanic() at vpanic+0x1a1/frame 0xfffffe00e68bd680 panic() at panic+0x43/frame 0xfffffe00e68bd6e0 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x83/frame 0xfffffe00e68bd790 swap_pager_swapoff_object() at swap_pager_swapoff_object+0x342/frame 0xfffffe00e68bd890 swap_pager_swapoff() at swap_pager_swapoff+0xf8/frame 0xfffffe00e68bd900 swapoff_one() at swapoff_one+0x14a/frame 0xfffffe00e68bd950 sys_swapoff() at sys_swapoff+0x1d5/frame 0xfffffe00e68bdac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e68bdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e68bdbf0 --- syscall (424, FreeBSD ELF64, sys_swapoff), rip = 0x8002f688a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe5d0 --- Tracing command sh pid 38798 tid 100277 td 0xfffffe00d39e8c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e68a4740 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e68bcc80 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e68bcc90 trap() at trap+0x6c/frame 0xfffffe00e68bcdc0 calltrap() at calltrap+0x8/frame 0xfffffe00e68bcdc0 --- trap 0xc, rip = 0xffffffff81046e40, rsp = 0xfffffe00e68bce90, rbp = 0xfffffe00e68bcf20 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00e68bcf20 db_get_value() at db_get_value+0x32/frame 0xfffffe00e68bcf60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e68bcff0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e68bd010 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e68bd0b0 db_command() at db_command+0x25c/frame 0xfffffe00e68bd180 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e68bd220 db_command() at db_command+0x25c/frame 0xfffffe00e68bd2f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e68bd300 db_trap() at db_trap+0xe8/frame 0xfffffe00e68bd390 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00e68bd410 trap() at trap+0x7ae/frame 0xfffffe00e68bd540 calltrap() at calltrap+0x8/frame 0xfffffe00e68bd540 --- trap 0x3, rip = 0xffffffff80c14557, rsp = 0xfffffe00e68bd610, rbp = 0xfffffe00e68bd620 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e68bd620 vpanic() at vpanic+0x1a1/frame 0xfffffe00e68bd680 panic() at panic+0x43/frame 0xfffffe00e68bd6e0 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x83/frame 0xfffffe00e68bd790 swap_pager_swapoff_object() at swap_pager_swapoff_object+0x342/frame 0xfffffe00e68bd890 swap_pager_swapoff() at swap_pager_swapoff+0xf8/frame 0xfffffe00e68bd900 swapoff_one() at swapoff_one+0x14a/frame 0xfffffe00e68bd950 sys_swapoff() at sys_swapoff+0x1d5/frame 0xfffffe00e68bdac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e68bdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e68bdbf0 --- syscall (424, FreeBSD ELF64, sys_swapoff), rip = 0x8002f688a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe5d0 --- *** error reading from address fffffe00e68a4748 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e68bcf10 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e68bcf20 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e68bcf60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e68bcff0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e68bd010 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e68bd0b0 db_command() at db_command+0x25c/frame 0xfffffe00e68bd180 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e68bd220 db_command() at db_command+0x25c/frame 0xfffffe00e68bd2f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e68bd300 db_trap() at db_trap+0xe8/frame 0xfffffe00e68bd390 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00e68bd410 trap() at trap+0x7ae/frame 0xfffffe00e68bd540 calltrap() at calltrap+0x8/frame 0xfffffe00e68bd540 --- trap 0x3, rip = 0xffffffff80c14557, rsp = 0xfffffe00e68bd610, rbp = 0xfffffe00e68bd620 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e68bd620 vpanic() at vpanic+0x1a1/frame 0xfffffe00e68bd680 panic() at panic+0x43/frame 0xfffffe00e68bd6e0 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x83/frame 0xfffffe00e68bd790 swap_pager_swapoff_object() at swap_pager_swapoff_object+0x342/frame 0xfffffe00e68bd890 swap_pager_swapoff() at swap_pager_swapoff+0xf8/frame 0xfffffe00e68bd900 swapoff_one() at swapoff_one+0x14a/frame 0xfffffe00e68bd950 sys_swapoff() at sys_swapoff+0x1d5/frame 0xfffffe00e68bdac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e68bdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e68bdbf0 --- syscall (424, FreeBSD ELF64, sys_swapoff), rip = 0x8002f688a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe5d0 --- Tracing command swapoff3 pid 32542 tid 100370 td 0xfffffe00e62d4000 (CPU 7) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1c7dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1c7df0 trap() at trap+0x56/frame 0xfffffe003e1c7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1c7f20 --- trap 0x13, rip = 0xffffffff80f3e0e1, rsp = 0xfffffe00e7277630, rbp = 0xfffffe00e7277650 --- vm_radix_reclaim_allnodes_int() at vm_radix_reclaim_allnodes_int+0x11/frame 0xfffffe00e7277650 vm_radix_reclaim_allnodes_int() at vm_radix_reclaim_allnodes_int+0x55/frame 0xfffffe00e7277680 vm_object_terminate() at vm_object_terminate+0x1c8/frame 0xfffffe00e72776c0 vm_object_deallocate() at vm_object_deallocate+0x372/frame 0xfffffe00e72776f0 vm_map_process_deferred() at vm_map_process_deferred+0xad/frame 0xfffffe00e7277710 vm_map_remove() at vm_map_remove+0xeb/frame 0xfffffe00e7277740 vmspace_exit() at vmspace_exit+0xd5/frame 0xfffffe00e7277780 exit1() at exit1+0x5a2/frame 0xfffffe00e72777f0 sigexit() at sigexit+0xd7a/frame 0xfffffe00e7277ae0 postsig() at postsig+0x336/frame 0xfffffe00e7277bb0 ast() at ast+0x4df/frame 0xfffffe00e7277bf0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe700 Tracing command md11 pid 32540 tid 100366 td 0xfffffe00e4320800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7263a30 mi_switch() at mi_switch+0x159/frame 0xfffffe00e7263a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7263ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e7263b50 md_kthread() at md_kthread+0xd5/frame 0xfffffe00e7263bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e7263bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e7263bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command md10 pid 32536 tid 100367 td 0xfffffe00e430e500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7268a30 mi_switch() at mi_switch+0x159/frame 0xfffffe00e7268a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7268ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e7268b50 md_kthread() at md_kthread+0xd5/frame 0xfffffe00e7268bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e7268bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e7268bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command tee pid 32522 tid 100353 td 0xfffffe00e669e100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e72227f0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e7222830 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7222870 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e72228d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e72228e0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e7222980 pipe_read() at pipe_read+0x428/frame 0xfffffe00e72229e0 dofileread() at dofileread+0x81/frame 0xfffffe00e7222a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e7222a70 sys_read() at sys_read+0x83/frame 0xfffffe00e7222ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e7222bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e7222bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80041b8ea, rsp = 0x7fffffffe6a8, rbp = 0x7fffffffe6f0 --- Tracing command sh pid 32521 tid 100249 td 0xfffffe00e6761a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e68186b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e68bcc80 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e68bcc90 trap() at trap+0x6c/frame 0xfffffe00e68bcdc0 calltrap() at calltrap+0x8/frame 0xfffffe00e68bcdc0 --- trap 0xc, rip = 0xffffffff81046e40, rsp = 0xfffffe00e68bce90, rbp = 0xfffffe00e68bcf20 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00e68bcf20 db_get_value() at db_get_value+0x32/frame 0xfffffe00e68bcf60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e68bcff0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e68bd010 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e68bd0b0 db_command() at db_command+0x25c/frame 0xfffffe00e68bd180 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e68bd220 db_command() at db_command+0x25c/frame 0xfffffe00e68bd2f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e68bd300 db_trap() at db_trap+0xe8/frame 0xfffffe00e68bd390 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00e68bd410 trap() at trap+0x7ae/frame 0xfffffe00e68bd540 calltrap() at calltrap+0x8/frame 0xfffffe00e68bd540 --- trap 0x3, rip = 0xffffffff80c14557, rsp = 0xfffffe00e68bd610, rbp = 0xfffffe00e68bd620 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e68bd620 vpanic() at vpanic+0x1a1/frame 0xfffffe00e68bd680 panic() at panic+0x43/frame 0xfffffe00e68bd6e0 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x83/frame 0xfffffe00e68bd790 swap_pager_swapoff_object() at swap_pager_swapoff_object+0x342/frame 0xfffffe00e68bd890 swap_pager_swapoff() at swap_pager_swapoff+0xf8/frame 0xfffffe00e68bd900 swapoff_one() at swapoff_one+0x14a/frame 0xfffffe00e68bd950 sys_swapoff() at sys_swapoff+0x1d5/frame 0xfffffe00e68bdac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e68bdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e68bdbf0 --- syscall (424, FreeBSD ELF64, sys_swapoff), rip = 0x8002f688a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe5d0 --- *** error reading from address fffffe00e68186b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e68bcf10 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e68bcf20 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e68bcf60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e68bcff0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e68bd010 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e68bd0b0 db_command() at db_command+0x25c/frame 0xfffffe00e68bd180 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e68bd220 db_command() at db_command+0x25c/frame 0xfffffe00e68bd2f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e68bd300 db_trap() at db_trap+0xe8/frame 0xfffffe00e68bd390 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00e68bd410 trap() at trap+0x7ae/frame 0xfffffe00e68bd540 calltrap() at calltrap+0x8/frame 0xfffffe00e68bd540 --- trap 0x3, rip = 0xffffffff80c14557, rsp = 0xfffffe00e68bd610, rbp = 0xfffffe00e68bd620 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e68bd620 vpanic() at vpanic+0x1a1/frame 0xfffffe00e68bd680 panic() at panic+0x43/frame 0xfffffe00e68bd6e0 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x83/frame 0xfffffe00e68bd790 swap_pager_swapoff_object() at swap_pager_swapoff_object+0x342/frame 0xfffffe00e68bd890 swap_pager_swapoff() at swap_pager_swapoff+0xf8/frame 0xfffffe00e68bd900 swapoff_one() at swapoff_one+0x14a/frame 0xfffffe00e68bd950 sys_swapoff() at sys_swapoff+0x1d5/frame 0xfffffe00e68bdac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e68bdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e68bdbf0 --- syscall (424, FreeBSD ELF64, sys_swapoff), rip = 0x8002f688a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe5d0 --- Tracing command sh pid 32520 tid 100322 td 0xfffffe00e67e2a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e69856b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e68bcc80 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e68bcc90 trap() at trap+0x6c/frame 0xfffffe00e68bcdc0 calltrap() at calltrap+0x8/frame 0xfffffe00e68bcdc0 --- trap 0xc, rip = 0xffffffff81046e40, rsp = 0xfffffe00e68bce90, rbp = 0xfffffe00e68bcf20 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00e68bcf20 db_get_value() at db_get_value+0x32/frame 0xfffffe00e68bcf60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e68bcff0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e68bd010 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e68bd0b0 db_command() at db_command+0x25c/frame 0xfffffe00e68bd180 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e68bd220 db_command() at db_command+0x25c/frame 0xfffffe00e68bd2f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e68bd300 db_trap() at db_trap+0xe8/frame 0xfffffe00e68bd390 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00e68bd410 trap() at trap+0x7ae/frame 0xfffffe00e68bd540 calltrap() at calltrap+0x8/frame 0xfffffe00e68bd540 --- trap 0x3, rip = 0xffffffff80c14557, rsp = 0xfffffe00e68bd610, rbp = 0xfffffe00e68bd620 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e68bd620 vpanic() at vpanic+0x1a1/frame 0xfffffe00e68bd680 panic() at panic+0x43/frame 0xfffffe00e68bd6e0 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x83/frame 0xfffffe00e68bd790 swap_pager_swapoff_object() at swap_pager_swapoff_object+0x342/frame 0xfffffe00e68bd890 swap_pager_swapoff() at swap_pager_swapoff+0xf8/frame 0xfffffe00e68bd900 swapoff_one() at swapoff_one+0x14a/frame 0xfffffe00e68bd950 sys_swapoff() at sys_swapoff+0x1d5/frame 0xfffffe00e68bdac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e68bdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e68bdbf0 --- syscall (424, FreeBSD ELF64, sys_swapoff), rip = 0x8002f688a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe5d0 --- *** error reading from address fffffe00e69856b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e68bcf10 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e68bcf20 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e68bcf60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e68bcff0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e68bd010 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e68bd0b0 db_command() at db_command+0x25c/frame 0xfffffe00e68bd180 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e68bd220 db_command() at db_command+0x25c/frame 0xfffffe00e68bd2f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e68bd300 db_trap() at db_trap+0xe8/frame 0xfffffe00e68bd390 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00e68bd410 trap() at trap+0x7ae/frame 0xfffffe00e68bd540 calltrap() at calltrap+0x8/frame 0xfffffe00e68bd540 --- trap 0x3, rip = 0xffffffff80c14557, rsp = 0xfffffe00e68bd610, rbp = 0xfffffe00e68bd620 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e68bd620 vpanic() at vpanic+0x1a1/frame 0xfffffe00e68bd680 panic() at panic+0x43/frame 0xfffffe00e68bd6e0 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x83/frame 0xfffffe00e68bd790 swap_pager_swapoff_object() at swap_pager_swapoff_object+0x342/frame 0xfffffe00e68bd890 swap_pager_swapoff() at swap_pager_swapoff+0xf8/frame 0xfffffe00e68bd900 swapoff_one() at swapoff_one+0x14a/frame 0xfffffe00e68bd950 sys_swapoff() at sys_swapoff+0x1d5/frame 0xfffffe00e68bdac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e68bdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e68bdbf0 --- syscall (424, FreeBSD ELF64, sys_swapoff), rip = 0x8002f688a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe5d0 --- Tracing command sh pid 32367 tid 100240 td 0xfffffe00e3904500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5dea6b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e68bcc80 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e68bcc90 trap() at trap+0x6c/frame 0xfffffe00e68bcdc0 calltrap() at calltrap+0x8/frame 0xfffffe00e68bcdc0 --- trap 0xc, rip = 0xffffffff81046e40, rsp = 0xfffffe00e68bce90, rbp = 0xfffffe00e68bcf20 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00e68bcf20 db_get_value() at db_get_value+0x32/frame 0xfffffe00e68bcf60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e68bcff0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e68bd010 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e68bd0b0 db_command() at db_command+0x25c/frame 0xfffffe00e68bd180 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e68bd220 db_command() at db_command+0x25c/frame 0xfffffe00e68bd2f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e68bd300 db_trap() at db_trap+0xe8/frame 0xfffffe00e68bd390 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00e68bd410 trap() at trap+0x7ae/frame 0xfffffe00e68bd540 calltrap() at calltrap+0x8/frame 0xfffffe00e68bd540 --- trap 0x3, rip = 0xffffffff80c14557, rsp = 0xfffffe00e68bd610, rbp = 0xfffffe00e68bd620 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e68bd620 vpanic() at vpanic+0x1a1/frame 0xfffffe00e68bd680 panic() at panic+0x43/frame 0xfffffe00e68bd6e0 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x83/frame 0xfffffe00e68bd790 swap_pager_swapoff_object() at swap_pager_swapoff_object+0x342/frame 0xfffffe00e68bd890 swap_pager_swapoff() at swap_pager_swapoff+0xf8/frame 0xfffffe00e68bd900 swapoff_one() at swapoff_one+0x14a/frame 0xfffffe00e68bd950 sys_swapoff() at sys_swapoff+0x1d5/frame 0xfffffe00e68bdac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e68bdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e68bdbf0 --- syscall (424, FreeBSD ELF64, sys_swapoff), rip = 0x8002f688a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe5d0 --- *** error reading from address fffffe00e5dea6b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e68bcf10 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e68bcf20 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e68bcf60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e68bcff0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e68bd010 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e68bd0b0 db_command() at db_command+0x25c/frame 0xfffffe00e68bd180 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e68bd220 db_command() at db_command+0x25c/frame 0xfffffe00e68bd2f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e68bd300 db_trap() at db_trap+0xe8/frame 0xfffffe00e68bd390 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00e68bd410 trap() at trap+0x7ae/frame 0xfffffe00e68bd540 calltrap() at calltrap+0x8/frame 0xfffffe00e68bd540 --- trap 0x3, rip = 0xffffffff80c14557, rsp = 0xfffffe00e68bd610, rbp = 0xfffffe00e68bd620 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e68bd620 vpanic() at vpanic+0x1a1/frame 0xfffffe00e68bd680 panic() at panic+0x43/frame 0xfffffe00e68bd6e0 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x83/frame 0xfffffe00e68bd790 swap_pager_swapoff_object() at swap_pager_swapoff_object+0x342/frame 0xfffffe00e68bd890 swap_pager_swapoff() at swap_pager_swapoff+0xf8/frame 0xfffffe00e68bd900 swapoff_one() at swapoff_one+0x14a/frame 0xfffffe00e68bd950 sys_swapoff() at sys_swapoff+0x1d5/frame 0xfffffe00e68bdac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e68bdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e68bdbf0 --- syscall (424, FreeBSD ELF64, sys_swapoff), rip = 0x8002f688a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe5d0 --- Tracing command sh pid 2525 tid 100237 td 0xfffffe00e6783a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5ddb7f0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e5ddb830 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5ddb870 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5ddb8d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5ddb8e0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e5ddb980 pipe_read() at pipe_read+0x428/frame 0xfffffe00e5ddb9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e5ddba30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e5ddba70 sys_read() at sys_read+0x83/frame 0xfffffe00e5ddbac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e5ddbbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5ddbbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047a8ea, rsp = 0x7fffffffe218, rbp = 0x7fffffffe320 --- Tracing command awk pid 2523 tid 100236 td 0xfffffe00e6784100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5dd67f0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e5dd6830 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5dd6870 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5dd68d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5dd68e0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e5dd6980 pipe_read() at pipe_read+0x428/frame 0xfffffe00e5dd69e0 dofileread() at dofileread+0x81/frame 0xfffffe00e5dd6a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e5dd6a70 sys_read() at sys_read+0x83/frame 0xfffffe00e5dd6ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e5dd6bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5dd6bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047f8ea, rsp = 0x7fffffffe318, rbp = 0x7fffffffe330 --- Tracing command sh pid 2522 tid 100235 td 0xfffffe00e390a100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5dd16b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e68bcc80 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e68bcc90 trap() at trap+0x6c/frame 0xfffffe00e68bcdc0 calltrap() at calltrap+0x8/frame 0xfffffe00e68bcdc0 --- trap 0xc, rip = 0xffffffff81046e40, rsp = 0xfffffe00e68bce90, rbp = 0xfffffe00e68bcf20 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00e68bcf20 db_get_value() at db_get_value+0x32/frame 0xfffffe00e68bcf60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e68bcff0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e68bd010 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e68bd0b0 db_command() at db_command+0x25c/frame 0xfffffe00e68bd180 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e68bd220 db_command() at db_command+0x25c/frame 0xfffffe00e68bd2f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e68bd300 db_trap() at db_trap+0xe8/frame 0xfffffe00e68bd390 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00e68bd410 trap() at trap+0x7ae/frame 0xfffffe00e68bd540 calltrap() at calltrap+0x8/frame 0xfffffe00e68bd540 --- trap 0x3, rip = 0xffffffff80c14557, rsp = 0xfffffe00e68bd610, rbp = 0xfffffe00e68bd620 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e68bd620 vpanic() at vpanic+0x1a1/frame 0xfffffe00e68bd680 panic() at panic+0x43/frame 0xfffffe00e68bd6e0 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x83/frame 0xfffffe00e68bd790 swap_pager_swapoff_object() at swap_pager_swapoff_object+0x342/frame 0xfffffe00e68bd890 swap_pager_swapoff() at swap_pager_swapoff+0xf8/frame 0xfffffe00e68bd900 swapoff_one() at swapoff_one+0x14a/frame 0xfffffe00e68bd950 sys_swapoff() at sys_swapoff+0x1d5/frame 0xfffffe00e68bdac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e68bdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e68bdbf0 --- syscall (424, FreeBSD ELF64, sys_swapoff), rip = 0x8002f688a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe5d0 --- *** error reading from address fffffe00e5dd16b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e68bcf10 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e68bcf20 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e68bcf60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e68bcff0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e68bd010 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e68bd0b0 db_command() at db_command+0x25c/frame 0xfffffe00e68bd180 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e68bd220 db_command() at db_command+0x25c/frame 0xfffffe00e68bd2f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e68bd300 db_trap() at db_trap+0xe8/frame 0xfffffe00e68bd390 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00e68bd410 trap() at trap+0x7ae/frame 0xfffffe00e68bd540 calltrap() at calltrap+0x8/frame 0xfffffe00e68bd540 --- trap 0x3, rip = 0xffffffff80c14557, rsp = 0xfffffe00e68bd610, rbp = 0xfffffe00e68bd620 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e68bd620 vpanic() at vpanic+0x1a1/frame 0xfffffe00e68bd680 panic() at panic+0x43/frame 0xfffffe00e68bd6e0 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x83/frame 0xfffffe00e68bd790 swap_pager_swapoff_object() at swap_pager_swapoff_object+0x342/frame 0xfffffe00e68bd890 swap_pager_swapoff() at swap_pager_swapoff+0xf8/frame 0xfffffe00e68bd900 swapoff_one() at swapoff_one+0x14a/frame 0xfffffe00e68bd950 sys_swapoff() at sys_swapoff+0x1d5/frame 0xfffffe00e68bdac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e68bdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e68bdbf0 --- syscall (424, FreeBSD ELF64, sys_swapoff), rip = 0x8002f688a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe5d0 --- Tracing command sh pid 2477 tid 100208 td 0xfffffe00e430a500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5d4f6b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e68bcc80 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e68bcc90 trap() at trap+0x6c/frame 0xfffffe00e68bcdc0 calltrap() at calltrap+0x8/frame 0xfffffe00e68bcdc0 --- trap 0xc, rip = 0xffffffff81046e40, rsp = 0xfffffe00e68bce90, rbp = 0xfffffe00e68bcf20 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00e68bcf20 db_get_value() at db_get_value+0x32/frame 0xfffffe00e68bcf60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e68bcff0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e68bd010 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e68bd0b0 db_command() at db_command+0x25c/frame 0xfffffe00e68bd180 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e68bd220 db_command() at db_command+0x25c/frame 0xfffffe00e68bd2f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e68bd300 db_trap() at db_trap+0xe8/frame 0xfffffe00e68bd390 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00e68bd410 trap() at trap+0x7ae/frame 0xfffffe00e68bd540 calltrap() at calltrap+0x8/frame 0xfffffe00e68bd540 --- trap 0x3, rip = 0xffffffff80c14557, rsp = 0xfffffe00e68bd610, rbp = 0xfffffe00e68bd620 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e68bd620 vpanic() at vpanic+0x1a1/frame 0xfffffe00e68bd680 panic() at panic+0x43/frame 0xfffffe00e68bd6e0 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x83/frame 0xfffffe00e68bd790 swap_pager_swapoff_object() at swap_pager_swapoff_object+0x342/frame 0xfffffe00e68bd890 swap_pager_swapoff() at swap_pager_swapoff+0xf8/frame 0xfffffe00e68bd900 swapoff_one() at swapoff_one+0x14a/frame 0xfffffe00e68bd950 sys_swapoff() at sys_swapoff+0x1d5/frame 0xfffffe00e68bdac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e68bdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e68bdbf0 --- syscall (424, FreeBSD ELF64, sys_swapoff), rip = 0x8002f688a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe5d0 --- *** error reading from address fffffe00e5d4f6b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e68bcf10 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e68bcf20 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e68bcf60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e68bcff0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e68bd010 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e68bd0b0 db_command() at db_command+0x25c/frame 0xfffffe00e68bd180 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e68bd220 db_command() at db_command+0x25c/frame 0xfffffe00e68bd2f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e68bd300 db_trap() at db_trap+0xe8/frame 0xfffffe00e68bd390 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00e68bd410 trap() at trap+0x7ae/frame 0xfffffe00e68bd540 calltrap() at calltrap+0x8/frame 0xfffffe00e68bd540 --- trap 0x3, rip = 0xffffffff80c14557, rsp = 0xfffffe00e68bd610, rbp = 0xfffffe00e68bd620 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e68bd620 vpanic() at vpanic+0x1a1/frame 0xfffffe00e68bd680 panic() at panic+0x43/frame 0xfffffe00e68bd6e0 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x83/frame 0xfffffe00e68bd790 swap_pager_swapoff_object() at swap_pager_swapoff_object+0x342/frame 0xfffffe00e68bd890 swap_pager_swapoff() at swap_pager_swapoff+0xf8/frame 0xfffffe00e68bd900 swapoff_one() at swapoff_one+0x14a/frame 0xfffffe00e68bd950 sys_swapoff() at sys_swapoff+0x1d5/frame 0xfffffe00e68bdac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e68bdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e68bdbf0 --- syscall (424, FreeBSD ELF64, sys_swapoff), rip = 0x8002f688a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe5d0 --- Tracing command bash pid 2362 tid 100219 td 0xfffffe00d39dfa00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5d866b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e68bcc80 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e68bcc90 trap() at trap+0x6c/frame 0xfffffe00e68bcdc0 calltrap() at calltrap+0x8/frame 0xfffffe00e68bcdc0 --- trap 0xc, rip = 0xffffffff81046e40, rsp = 0xfffffe00e68bce90, rbp = 0xfffffe00e68bcf20 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00e68bcf20 db_get_value() at db_get_value+0x32/frame 0xfffffe00e68bcf60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e68bcff0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e68bd010 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e68bd0b0 db_command() at db_command+0x25c/frame 0xfffffe00e68bd180 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e68bd220 db_command() at db_command+0x25c/frame 0xfffffe00e68bd2f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e68bd300 db_trap() at db_trap+0xe8/frame 0xfffffe00e68bd390 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00e68bd410 trap() at trap+0x7ae/frame 0xfffffe00e68bd540 calltrap() at calltrap+0x8/frame 0xfffffe00e68bd540 --- trap 0x3, rip = 0xffffffff80c14557, rsp = 0xfffffe00e68bd610, rbp = 0xfffffe00e68bd620 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e68bd620 vpanic() at vpanic+0x1a1/frame 0xfffffe00e68bd680 panic() at panic+0x43/frame 0xfffffe00e68bd6e0 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x83/frame 0xfffffe00e68bd790 swap_pager_swapoff_object() at swap_pager_swapoff_object+0x342/frame 0xfffffe00e68bd890 swap_pager_swapoff() at swap_pager_swapoff+0xf8/frame 0xfffffe00e68bd900 swapoff_one() at swapoff_one+0x14a/frame 0xfffffe00e68bd950 sys_swapoff() at sys_swapoff+0x1d5/frame 0xfffffe00e68bdac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e68bdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e68bdbf0 --- syscall (424, FreeBSD ELF64, sys_swapoff), rip = 0x8002f688a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe5d0 --- *** error reading from address fffffe00e5d866b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e68bcf10 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e68bcf20 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e68bcf60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e68bcff0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e68bd010 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e68bd0b0 db_command() at db_command+0x25c/frame 0xfffffe00e68bd180 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e68bd220 db_command() at db_command+0x25c/frame 0xfffffe00e68bd2f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e68bd300 db_trap() at db_trap+0xe8/frame 0xfffffe00e68bd390 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00e68bd410 trap() at trap+0x7ae/frame 0xfffffe00e68bd540 calltrap() at calltrap+0x8/frame 0xfffffe00e68bd540 --- trap 0x3, rip = 0xffffffff80c14557, rsp = 0xfffffe00e68bd610, rbp = 0xfffffe00e68bd620 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e68bd620 vpanic() at vpanic+0x1a1/frame 0xfffffe00e68bd680 panic() at panic+0x43/frame 0xfffffe00e68bd6e0 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x83/frame 0xfffffe00e68bd790 swap_pager_swapoff_object() at swap_pager_swapoff_object+0x342/frame 0xfffffe00e68bd890 swap_pager_swapoff() at swap_pager_swapoff+0xf8/frame 0xfffffe00e68bd900 swapoff_one() at swapoff_one+0x14a/frame 0xfffffe00e68bd950 sys_swapoff() at sys_swapoff+0x1d5/frame 0xfffffe00e68bdac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e68bdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e68bdbf0 --- syscall (424, FreeBSD ELF64, sys_swapoff), rip = 0x8002f688a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe5d0 --- Tracing command csh pid 2360 tid 100218 td 0xfffffe00e430ba00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5d818a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e68bcc80 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e68bcc90 trap() at trap+0x6c/frame 0xfffffe00e68bcdc0 calltrap() at calltrap+0x8/frame 0xfffffe00e68bcdc0 --- trap 0xc, rip = 0xffffffff81046e40, rsp = 0xfffffe00e68bce90, rbp = 0xfffffe00e68bcf20 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00e68bcf20 db_get_value() at db_get_value+0x32/frame 0xfffffe00e68bcf60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e68bcff0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e68bd010 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e68bd0b0 db_command() at db_command+0x25c/frame 0xfffffe00e68bd180 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e68bd220 db_command() at db_command+0x25c/frame 0xfffffe00e68bd2f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e68bd300 db_trap() at db_trap+0xe8/frame 0xfffffe00e68bd390 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00e68bd410 trap() at trap+0x7ae/frame 0xfffffe00e68bd540 calltrap() at calltrap+0x8/frame 0xfffffe00e68bd540 --- trap 0x3, rip = 0xffffffff80c14557, rsp = 0xfffffe00e68bd610, rbp = 0xfffffe00e68bd620 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e68bd620 vpanic() at vpanic+0x1a1/frame 0xfffffe00e68bd680 panic() at panic+0x43/frame 0xfffffe00e68bd6e0 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x83/frame 0xfffffe00e68bd790 swap_pager_swapoff_object() at swap_pager_swapoff_object+0x342/frame 0xfffffe00e68bd890 swap_pager_swapoff() at swap_pager_swapoff+0xf8/frame 0xfffffe00e68bd900 swapoff_one() at swapoff_one+0x14a/frame 0xfffffe00e68bd950 sys_swapoff() at sys_swapoff+0x1d5/frame 0xfffffe00e68bdac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e68bdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e68bdbf0 --- syscall (424, FreeBSD ELF64, sys_swapoff), rip = 0x8002f688a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe5d0 --- *** error reading from address fffffe00e5d818a8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e68bcf10 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e68bcf20 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e68bcf60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e68bcff0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e68bd010 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e68bd0b0 db_command() at db_command+0x25c/frame 0xfffffe00e68bd180 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e68bd220 db_command() at db_command+0x25c/frame 0xfffffe00e68bd2f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e68bd300 db_trap() at db_trap+0xe8/frame 0xfffffe00e68bd390 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00e68bd410 trap() at trap+0x7ae/frame 0xfffffe00e68bd540 calltrap() at calltrap+0x8/frame 0xfffffe00e68bd540 --- trap 0x3, rip = 0xffffffff80c14557, rsp = 0xfffffe00e68bd610, rbp = 0xfffffe00e68bd620 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e68bd620 vpanic() at vpanic+0x1a1/frame 0xfffffe00e68bd680 panic() at panic+0x43/frame 0xfffffe00e68bd6e0 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x83/frame 0xfffffe00e68bd790 swap_pager_swapoff_object() at swap_pager_swapoff_object+0x342/frame 0xfffffe00e68bd890 swap_pager_swapoff() at swap_pager_swapoff+0xf8/frame 0xfffffe00e68bd900 swapoff_one() at swapoff_one+0x14a/frame 0xfffffe00e68bd950 sys_swapoff() at sys_swapoff+0x1d5/frame 0xfffffe00e68bdac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e68bdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e68bdbf0 --- syscall (424, FreeBSD ELF64, sys_swapoff), rip = 0x8002f688a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe5d0 --- Tracing command su pid 2359 tid 100201 td 0xfffffe00d39e7000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5d2c6b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e68bcc80 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e68bcc90 trap() at trap+0x6c/frame 0xfffffe00e68bcdc0 calltrap() at calltrap+0x8/frame 0xfffffe00e68bcdc0 --- trap 0xc, rip = 0xffffffff81046e40, rsp = 0xfffffe00e68bce90, rbp = 0xfffffe00e68bcf20 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00e68bcf20 db_get_value() at db_get_value+0x32/frame 0xfffffe00e68bcf60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e68bcff0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e68bd010 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e68bd0b0 db_command() at db_command+0x25c/frame 0xfffffe00e68bd180 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e68bd220 db_command() at db_command+0x25c/frame 0xfffffe00e68bd2f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e68bd300 db_trap() at db_trap+0xe8/frame 0xfffffe00e68bd390 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00e68bd410 trap() at trap+0x7ae/frame 0xfffffe00e68bd540 calltrap() at calltrap+0x8/frame 0xfffffe00e68bd540 --- trap 0x3, rip = 0xffffffff80c14557, rsp = 0xfffffe00e68bd610, rbp = 0xfffffe00e68bd620 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e68bd620 vpanic() at vpanic+0x1a1/frame 0xfffffe00e68bd680 panic() at panic+0x43/frame 0xfffffe00e68bd6e0 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x83/frame 0xfffffe00e68bd790 swap_pager_swapoff_object() at swap_pager_swapoff_object+0x342/frame 0xfffffe00e68bd890 swap_pager_swapoff() at swap_pager_swapoff+0xf8/frame 0xfffffe00e68bd900 swapoff_one() at swapoff_one+0x14a/frame 0xfffffe00e68bd950 sys_swapoff() at sys_swapoff+0x1d5/frame 0xfffffe00e68bdac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e68bdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e68bdbf0 --- syscall (424, FreeBSD ELF64, sys_swapoff), rip = 0x8002f688a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe5d0 --- *** error reading from address fffffe00e5d2c6b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e68bcf10 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e68bcf20 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e68bcf60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e68bcff0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e68bd010 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e68bd0b0 db_command() at db_command+0x25c/frame 0xfffffe00e68bd180 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e68bd220 db_command() at db_command+0x25c/frame 0xfffffe00e68bd2f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e68bd300 db_trap() at db_trap+0xe8/frame 0xfffffe00e68bd390 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00e68bd410 trap() at trap+0x7ae/frame 0xfffffe00e68bd540 calltrap() at calltrap+0x8/frame 0xfffffe00e68bd540 --- trap 0x3, rip = 0xffffffff80c14557, rsp = 0xfffffe00e68bd610, rbp = 0xfffffe00e68bd620 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e68bd620 vpanic() at vpanic+0x1a1/frame 0xfffffe00e68bd680 panic() at panic+0x43/frame 0xfffffe00e68bd6e0 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x83/frame 0xfffffe00e68bd790 swap_pager_swapoff_object() at swap_pager_swapoff_object+0x342/frame 0xfffffe00e68bd890 swap_pager_swapoff() at swap_pager_swapoff+0xf8/frame 0xfffffe00e68bd900 swapoff_one() at swapoff_one+0x14a/frame 0xfffffe00e68bd950 sys_swapoff() at sys_swapoff+0x1d5/frame 0xfffffe00e68bdac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e68bdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e68bdbf0 --- syscall (424, FreeBSD ELF64, sys_swapoff), rip = 0x8002f688a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe5d0 --- Tracing command bash pid 2353 tid 100155 td 0xfffffe00d2e22c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37e56b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e68bcc80 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e68bcc90 trap() at trap+0x6c/frame 0xfffffe00e68bcdc0 calltrap() at calltrap+0x8/frame 0xfffffe00e68bcdc0 --- trap 0xc, rip = 0xffffffff81046e40, rsp = 0xfffffe00e68bce90, rbp = 0xfffffe00e68bcf20 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00e68bcf20 db_get_value() at db_get_value+0x32/frame 0xfffffe00e68bcf60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e68bcff0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e68bd010 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e68bd0b0 db_command() at db_command+0x25c/frame 0xfffffe00e68bd180 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e68bd220 db_command() at db_command+0x25c/frame 0xfffffe00e68bd2f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e68bd300 db_trap() at db_trap+0xe8/frame 0xfffffe00e68bd390 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00e68bd410 trap() at trap+0x7ae/frame 0xfffffe00e68bd540 calltrap() at calltrap+0x8/frame 0xfffffe00e68bd540 --- trap 0x3, rip = 0xffffffff80c14557, rsp = 0xfffffe00e68bd610, rbp = 0xfffffe00e68bd620 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e68bd620 vpanic() at vpanic+0x1a1/frame 0xfffffe00e68bd680 panic() at panic+0x43/frame 0xfffffe00e68bd6e0 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x83/frame 0xfffffe00e68bd790 swap_pager_swapoff_object() at swap_pager_swapoff_object+0x342/frame 0xfffffe00e68bd890 swap_pager_swapoff() at swap_pager_swapoff+0xf8/frame 0xfffffe00e68bd900 swapoff_one() at swapoff_one+0x14a/frame 0xfffffe00e68bd950 sys_swapoff() at sys_swapoff+0x1d5/frame 0xfffffe00e68bdac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e68bdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e68bdbf0 --- syscall (424, FreeBSD ELF64, sys_swapoff), rip = 0x8002f688a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe5d0 --- *** error reading from address fffffe00e37e56b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e68bcf10 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e68bcf20 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e68bcf60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e68bcff0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e68bd010 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e68bd0b0 db_command() at db_command+0x25c/frame 0xfffffe00e68bd180 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e68bd220 db_command() at db_command+0x25c/frame 0xfffffe00e68bd2f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e68bd300 db_trap() at db_trap+0xe8/frame 0xfffffe00e68bd390 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00e68bd410 trap() at trap+0x7ae/frame 0xfffffe00e68bd540 calltrap() at calltrap+0x8/frame 0xfffffe00e68bd540 --- trap 0x3, rip = 0xffffffff80c14557, rsp = 0xfffffe00e68bd610, rbp = 0xfffffe00e68bd620 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e68bd620 vpanic() at vpanic+0x1a1/frame 0xfffffe00e68bd680 panic() at panic+0x43/frame 0xfffffe00e68bd6e0 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x83/frame 0xfffffe00e68bd790 swap_pager_swapoff_object() at swap_pager_swapoff_object+0x342/frame 0xfffffe00e68bd890 swap_pager_swapoff() at swap_pager_swapoff+0xf8/frame 0xfffffe00e68bd900 swapoff_one() at swapoff_one+0x14a/frame 0xfffffe00e68bd950 sys_swapoff() at sys_swapoff+0x1d5/frame 0xfffffe00e68bdac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e68bdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e68bdbf0 --- syscall (424, FreeBSD ELF64, sys_swapoff), rip = 0x8002f688a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe5d0 --- Tracing command sshd pid 2352 tid 100206 td 0xfffffe00d5ccc500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5d45710 mi_switch() at mi_switch+0x159/frame 0xfffffe00e5d45750 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5d45790 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5d457f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5d45800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e5d45860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e5d458a0 kern_select() at kern_select+0x952/frame 0xfffffe00e5d45a80 sys_select() at sys_select+0x56/frame 0xfffffe00e5d45ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e5d45bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5d45bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008f98ca, rsp = 0x7fffffffa538, rbp = 0x7fffffffa570 --- Tracing command sshd pid 2349 tid 100217 td 0xfffffe00e430c100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5d7c790 mi_switch() at mi_switch+0x159/frame 0xfffffe00e5d7c7d0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5d7c810 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5d7c870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5d7c880 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e5d7c8e0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e5d7c920 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e5d7caa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e5d7cac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e5d7cbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5d7cbf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80089c48a, rsp = 0x7fffffffe598, rbp = 0x7fffffffe5d0 --- Tracing command csh pid 2345 tid 100204 td 0xfffffe00e4212500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5d3b770 mi_switch() at mi_switch+0x159/frame 0xfffffe00e5d3b7b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5d3b7f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5d3b850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5d3b860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e5d3b8c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e5d3b8f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e5d3b950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e5d3b980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e5d3b9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e5d3ba30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e5d3ba70 sys_read() at sys_read+0x83/frame 0xfffffe00e5d3bac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e5d3bbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5d3bbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004ff8ea, rsp = 0x7fffffffe1d8, rbp = 0x7fffffffe200 --- Tracing command login pid 2344 tid 100215 td 0xfffffe00e430c800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5d726b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e68bcc80 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e68bcc90 trap() at trap+0x6c/frame 0xfffffe00e68bcdc0 calltrap() at calltrap+0x8/frame 0xfffffe00e68bcdc0 --- trap 0xc, rip = 0xffffffff81046e40, rsp = 0xfffffe00e68bce90, rbp = 0xfffffe00e68bcf20 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe00e68bcf20 db_get_value() at db_get_value+0x32/frame 0xfffffe00e68bcf60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e68bcff0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e68bd010 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e68bd0b0 db_command() at db_command+0x25c/frame 0xfffffe00e68bd180 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e68bd220 db_command() at db_command+0x25c/frame 0xfffffe00e68bd2f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e68bd300 db_trap() at db_trap+0xe8/frame 0xfffffe00e68bd390 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00e68bd410 trap() at trap+0x7ae/frame 0xfffffe00e68bd540 calltrap() at calltrap+0x8/frame 0xfffffe00e68bd540 --- trap 0x3, rip = 0xffffffff80c14557, rsp = 0xfffffe00e68bd610, rbp = 0xfffffe00e68bd620 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e68bd620 vpanic() at vpanic+0x1a1/frame 0xfffffe00e68bd680 panic() at panic+0x43/frame 0xfffffe00e68bd6e0 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x83/frame 0xfffffe00e68bd790 swap_pager_swapoff_object() at swap_pager_swapoff_object+0x342/frame 0xfffffe00e68bd890 swap_pager_swapoff() at swap_pager_swapoff+0xf8/frame 0xfffffe00e68bd900 swapoff_one() at swapoff_one+0x14a/frame 0xfffffe00e68bd950 sys_swapoff() at sys_swapoff+0x1d5/frame 0xfffffe00e68bdac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e68bdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e68bdbf0 --- syscall (424, FreeBSD ELF64, sys_swapoff), rip = 0x8002f688a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe5d0 --- *** error reading from address fffffe00e5d726b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00e68bcf10 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe00e68bcf20 db_get_value() at db_get_value+0x4c/frame 0xfffffe00e68bcf60 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe00e68bcff0 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe00e68bd010 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe00e68bd0b0 db_command() at db_command+0x25c/frame 0xfffffe00e68bd180 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe00e68bd220 db_command() at db_command+0x25c/frame 0xfffffe00e68bd2f0 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe00e68bd300 db_trap() at db_trap+0xe8/frame 0xfffffe00e68bd390 kdb_trap() at kdb_trap+0x157/frame 0xfffffe00e68bd410 trap() at trap+0x7ae/frame 0xfffffe00e68bd540 calltrap() at calltrap+0x8/frame 0xfffffe00e68bd540 --- trap 0x3, rip = 0xffffffff80c14557, rsp = 0xfffffe00e68bd610, rbp = 0xfffffe00e68bd620 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe00e68bd620 vpanic() at vpanic+0x1a1/frame 0xfffffe00e68bd680 panic() at panic+0x43/frame 0xfffffe00e68bd6e0 swap_pager_getpages_locked() at swap_pager_getpages_locked+0x83/frame 0xfffffe00e68bd790 swap_pager_swapoff_object() at swap_pager_swapoff_object+0x342/frame 0xfffffe00e68bd890 swap_pager_swapoff() at swap_pager_swapoff+0xf8/frame 0xfffffe00e68bd900 swapoff_one() at swapoff_one+0x14a/frame 0xfffffe00e68bd950 sys_swapoff() at sys_swapoff+0x1d5/frame 0xfffffe00e68bdac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e68bdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e68bdbf0 --- syscall (424, FreeBSD ELF64, sys_swapoff), rip = 0x8002f688a, rsp = 0x7fffffffe498, rbp = 0x7fffffffe5d0 --- Tracing command getty pid 2343 tid 100214 td 0xfffffe00e430d000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5d6d770 mi_switch() at mi_switch+0x159/frame 0xfffffe00e5d6d7b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5d6d7f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5d6d850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5d6d860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e5d6d8c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e5d6d8f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e5d6d950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e5d6d980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e5d6d9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e5d6da30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e5d6da70 sys_read() at sys_read+0x83/frame 0xfffffe00e5d6dac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e5d6dbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5d6dbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004378ea, rsp = 0x7fffffffebb8, rbp = 0x7fffffffec00 --- Tracing command getty pid 2342 tid 100213 td 0xfffffe00e430d700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5d68770 mi_switch() at mi_switch+0x159/frame 0xfffffe00e5d687b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5d687f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5d68850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5d68860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e5d688c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e5d688f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e5d68950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e5d68980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e5d689e0 dofileread() at dofileread+0x81/frame 0xfffffe00e5d68a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e5d68a70 sys_read() at sys_read+0x83/frame 0xfffffe00e5d68ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e5d68bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5d68bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004378ea, rsp = 0x7fffffffebb8, rbp = 0x7fffffffec00 --- Tracing command getty pid 2341 tid 100212 td 0xfffffe00e430de00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5d63770 mi_switch() at mi_switch+0x159/frame 0xfffffe00e5d637b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5d637f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5d63850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5d63860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e5d638c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e5d638f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e5d63950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e5d63980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e5d639e0 dofileread() at dofileread+0x81/frame 0xfffffe00e5d63a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e5d63a70 sys_read() at sys_read+0x83/frame 0xfffffe00e5d63ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e5d63bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5d63bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004378ea, rsp = 0x7fffffffebb8, rbp = 0x7fffffffec00 --- Tracing command getty pid 2340 tid 100211 td 0xfffffe00d3df6100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5d5e770 mi_switch() at mi_switch+0x159/frame 0xfffffe00e5d5e7b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5d5e7f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5d5e850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5d5e860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e5d5e8c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e5d5e8f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e5d5e950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e5d5e980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e5d5e9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e5d5ea30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e5d5ea70 sys_read() at sys_read+0x83/frame 0xfffffe00e5d5eac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e5d5ebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5d5ebf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004378ea, rsp = 0x7fffffffebb8, rbp = 0x7fffffffec00 --- Tracing command getty pid 2339 tid 100210 td 0xfffffe00d3df6800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5d59770 mi_switch() at mi_switch+0x159/frame 0xfffffe00e5d597b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5d597f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5d59850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5d59860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e5d598c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e5d598f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e5d59950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e5d59980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e5d599e0 dofileread() at dofileread+0x81/frame 0xfffffe00e5d59a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e5d59a70 sys_read() at sys_read+0x83/frame 0xfffffe00e5d59ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e5d59bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5d59bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004378ea, rsp = 0x7fffffffebb8, rbp = 0x7fffffffec00 --- Tracing command getty pid 2338 tid 100209 td 0xfffffe00d3df7000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5d54770 mi_switch() at mi_switch+0x159/frame 0xfffffe00e5d547b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5d547f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5d54850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5d54860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e5d548c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e5d548f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e5d54950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e5d54980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e5d549e0 dofileread() at dofileread+0x81/frame 0xfffffe00e5d54a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e5d54a70 sys_read() at sys_read+0x83/frame 0xfffffe00e5d54ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e5d54bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5d54bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004378ea, rsp = 0x7fffffffebb8, rbp = 0x7fffffffec00 --- Tracing command getty pid 2337 tid 100176 td 0xfffffe00d3df7700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5c5b770 mi_switch() at mi_switch+0x159/frame 0xfffffe00e5c5b7b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5c5b7f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5c5b850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5c5b860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e5c5b8c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e5c5b8f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e5c5b950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e5c5b980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e5c5b9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e5c5ba30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e5c5ba70 sys_read() at sys_read+0x83/frame 0xfffffe00e5c5bac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e5c5bbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5c5bbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004378ea, rsp = 0x7fffffffebb8, rbp = 0x7fffffffec00 --- Tracing command getty pid 2336 tid 100165 td 0xfffffe00d3df7e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5c18770 mi_switch() at mi_switch+0x159/frame 0xfffffe00e5c187b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5c187f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5c18850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5c18860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e5c188c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e5c188f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e5c18950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e5c18980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e5c189e0 dofileread() at dofileread+0x81/frame 0xfffffe00e5c18a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e5c18a70 sys_read() at sys_read+0x83/frame 0xfffffe00e5c18ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e5c18bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5c18bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004378ea, rsp = 0x7fffffffebb8, rbp = 0x7fffffffec00 --- Tracing command getty pid 2335 tid 100142 td 0xfffffe003e1e7300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37a4770 mi_switch() at mi_switch+0x159/frame 0xfffffe00e37a47b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37a47f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e37a4850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e37a4860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e37a48c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e37a48f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e37a4950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e37a4980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e37a49e0 dofileread() at dofileread+0x81/frame 0xfffffe00e37a4a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e37a4a70 sys_read() at sys_read+0x83/frame 0xfffffe00e37a4ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e37a4bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e37a4bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004378ea, rsp = 0x7fffffffebb8, rbp = 0x7fffffffec00 --- Tracing command cron pid 2289 tid 100146 td 0xfffffe00d39de500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37b8830 mi_switch() at mi_switch+0x159/frame 0xfffffe00e37b8870 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37b88b0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e37b8910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e37b8950 _sleep() at _sleep+0x258/frame 0xfffffe00e37b89f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e37b8a80 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e37b8ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e37b8bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e37b8bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003dbdca, rsp = 0x7fffffffea98, rbp = 0x7fffffffec80 --- Tracing command sshd pid 2285 tid 100202 td 0xfffffe00d39e0800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5d31710 mi_switch() at mi_switch+0x159/frame 0xfffffe00e5d31750 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5d31790 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5d317f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5d31800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e5d31860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e5d318a0 kern_select() at kern_select+0x952/frame 0xfffffe00e5d31a80 sys_select() at sys_select+0x56/frame 0xfffffe00e5d31ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e5d31bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5d31bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008f98ca, rsp = 0x7fffffffe628, rbp = 0x7fffffffe660 --- Tracing command powerd pid 2257 tid 100199 td 0xfffffe00e4212c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5d166d0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e5d16710 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5d16750 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5d167b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e5d167f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e5d16860 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e5d168a0 kern_select() at kern_select+0x952/frame 0xfffffe00e5d16a80 sys_select() at sys_select+0x56/frame 0xfffffe00e5d16ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e5d16bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5d16bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8004348ca, rsp = 0x7fffffffeb48, rbp = 0x7fffffffec90 --- Tracing command ntpd pid 2254 tid 100189 td 0xfffffe00e4213300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5ccc710 mi_switch() at mi_switch+0x159/frame 0xfffffe00e5ccc750 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5ccc790 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5ccc7f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5ccc800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e5ccc860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e5ccc8a0 kern_select() at kern_select+0x952/frame 0xfffffe00e5ccca80 sys_select() at sys_select+0x56/frame 0xfffffe00e5cccac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e5cccbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5cccbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80082c8ca, rsp = 0x7fffffffded8, rbp = 0x7fffffffdf10 --- Tracing command ntpd pid 2254 tid 100755 td 0xfffffe00e62dc000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5c657f0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e5c65830 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5c65870 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5c658d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5c658e0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e5c65980 umtxq_sleep() at umtxq_sleep+0x19e/frame 0xfffffe00e5c659e0 do_sem2_wait() at do_sem2_wait+0x38f/frame 0xfffffe00e5c65a70 __umtx_op_sem2_wait() at __umtx_op_sem2_wait+0x76/frame 0xfffffe00e5c65ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e5c65bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5c65bf0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x800720a2a, rsp = 0x7fffdff3aed8, rbp = 0x7fffdff3af50 --- Tracing command watchdogd pid 2140 tid 100195 td 0xfffffe00d39e9300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5d02830 mi_switch() at mi_switch+0x159/frame 0xfffffe00e5d02870 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5d028b0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5d02910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e5d02950 _sleep() at _sleep+0x258/frame 0xfffffe00e5d029f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e5d02a80 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e5d02ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e5d02bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5d02bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003c4dca, rsp = 0x7fffffffea58, rbp = 0x7fffffffeaa0 --- Tracing command rpcbind pid 2061 tid 100164 td 0xfffffe00d39e7e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5c13750 mi_switch() at mi_switch+0x159/frame 0xfffffe00e5c13790 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5c137d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5c13830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e5c13870 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e5c138e0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e5c13920 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e5c13aa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e5c13ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e5c13bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5c13bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003d248a, rsp = 0x7fffffffc9f8, rbp = 0x7fffffffec10 --- Tracing command syslogd pid 2051 tid 100192 td 0xfffffe00d39ea800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5cdb710 mi_switch() at mi_switch+0x159/frame 0xfffffe00e5cdb750 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5cdb790 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5cdb7f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5cdb800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e5cdb860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e5cdb8a0 kern_select() at kern_select+0x952/frame 0xfffffe00e5cdba80 sys_select() at sys_select+0x56/frame 0xfffffe00e5cdbac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e5cdbbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5cdbbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80043c8ca, rsp = 0x7fffffffe708, rbp = 0x7fffffffec80 --- Tracing command devd pid 1980 tid 100144 td 0xfffffe00d39e8500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37ae6d0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e37ae710 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37ae750 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e37ae7b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e37ae7f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e37ae860 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e37ae8a0 kern_select() at kern_select+0x952/frame 0xfffffe00e37aea80 sys_select() at sys_select+0x56/frame 0xfffffe00e37aeac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e37aebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e37aebf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2f803a, rsp = 0x7fffffffcb08, rbp = 0x7fffffffeca0 --- Tracing command dhclient pid 1975 tid 100193 td 0xfffffe00d39ea100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5ce0750 mi_switch() at mi_switch+0x159/frame 0xfffffe00e5ce0790 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5ce07d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5ce0830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e5ce0870 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e5ce08e0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e5ce0920 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e5ce0aa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e5ce0ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e5ce0bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5ce0bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f548a, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec20 --- Tracing command dhclient pid 1928 tid 100150 td 0xfffffe00dd1f6e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37cc790 mi_switch() at mi_switch+0x159/frame 0xfffffe00e37cc7d0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37cc810 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e37cc870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e37cc880 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e37cc8e0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e37cc920 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e37ccaa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e37ccac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e37ccbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e37ccbf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f548a, rsp = 0x7fffffffebf8, rbp = 0x7fffffffec20 --- Tracing command dhclient pid 1925 tid 100185 td 0xfffffe00d31aea00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5cb8710 mi_switch() at mi_switch+0x159/frame 0xfffffe00e5cb8750 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5cb8790 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5cb87f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5cb8800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e5cb8860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e5cb88a0 kern_select() at kern_select+0x952/frame 0xfffffe00e5cb8a80 sys_select() at sys_select+0x56/frame 0xfffffe00e5cb8ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e5cb8bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5cb8bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8004528ca, rsp = 0x7fffffffe9a8, rbp = 0x7fffffffea60 --- Tracing command vnlru pid 34 tid 100141 td 0xfffffe00d3df0c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00de7fd9b0 mi_switch() at mi_switch+0x159/frame 0xfffffe00de7fd9f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00de7fda30 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00de7fda70 _sleep() at _sleep+0x26c/frame 0xfffffe00de7fdb10 vnlru_proc() at vnlru_proc+0xaed/frame 0xfffffe00de7fdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de7fdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de7fdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 33 tid 100139 td 0xfffffe00d3df1300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00de7f39f0 mi_switch() at mi_switch+0x159/frame 0xfffffe00de7f3a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00de7f3a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00de7f3ab0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x184/frame 0xfffffe00de7f3b20 sched_sync() at sched_sync+0x69d/frame 0xfffffe00de7f3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de7f3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de7f3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100130 td 0xfffffe00d3df1a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037be6a00 mi_switch() at mi_switch+0x159/frame 0xfffffe0037be6a40 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037be6a80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037be6ac0 _sleep() at _sleep+0x26c/frame 0xfffffe0037be6b60 buf_daemon() at buf_daemon+0x112/frame 0xfffffe0037be6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037be6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037be6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100131 td 0xfffffe00d3df5a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037beb9f0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037beba30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037beba70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bebab0 _sleep() at _sleep+0x26c/frame 0xfffffe0037bebb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe0037bebbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bebbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bebbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100132 td 0xfffffe00d3df5300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bf09f0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bf0a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bf0a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bf0ab0 _sleep() at _sleep+0x26c/frame 0xfffffe0037bf0b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe0037bf0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bf0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bf0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100133 td 0xfffffe00d3df4c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bf59f0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bf5a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bf5a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bf5ab0 _sleep() at _sleep+0x26c/frame 0xfffffe0037bf5b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe0037bf5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bf5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bf5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100134 td 0xfffffe00d3df4500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bfa9f0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bfaa30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bfaa70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bfaab0 _sleep() at _sleep+0x26c/frame 0xfffffe0037bfab50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe0037bfabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bfabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bfabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100135 td 0xfffffe00d3df3e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bff9f0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bffa30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bffa70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bffab0 _sleep() at _sleep+0x26c/frame 0xfffffe0037bffb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe0037bffbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bffbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bffbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100136 td 0xfffffe00d3df3700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00de7249f0 mi_switch() at mi_switch+0x159/frame 0xfffffe00de724a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00de724a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00de724ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00de724b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00de724bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de724bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de724bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100137 td 0xfffffe00d3df3000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00de7299f0 mi_switch() at mi_switch+0x159/frame 0xfffffe00de729a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00de729a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00de729ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00de729b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00de729bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de729bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de729bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100154 td 0xfffffe00e3800000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37e0a20 mi_switch() at mi_switch+0x159/frame 0xfffffe00e37e0a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37e0aa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e37e0ae0 _sleep() at _sleep+0x26c/frame 0xfffffe00e37e0b80 softdep_flush() at softdep_flush+0x175/frame 0xfffffe00e37e0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37e0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37e0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100200 td 0xfffffe00e3905a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5d27a20 mi_switch() at mi_switch+0x159/frame 0xfffffe00e5d27a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5d27aa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e5d27ae0 _sleep() at _sleep+0x26c/frame 0xfffffe00e5d27b80 softdep_flush() at softdep_flush+0x175/frame 0xfffffe00e5d27bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e5d27bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e5d27bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 31 tid 100129 td 0xfffffe00d3df2100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037be1a20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037be1a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037be1aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037be1b40 vm_daemon() at vm_daemon+0x82/frame 0xfffffe0037be1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037be1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037be1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffffe00d6099e00 (CPU 2) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e18bdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e18bdf0 trap() at trap+0x56/frame 0xfffffe003e18bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e18bf20 --- trap 0x13, rip = 0xffffffff80bc5895, rsp = 0xfffffe0037bdc6d0, rbp = 0xfffffe0037bdc6f0 --- __rw_rlock_int() at __rw_rlock_int+0xb5/frame 0xfffffe0037bdc6f0 pmap_page_is_mapped() at pmap_page_is_mapped+0x6f/frame 0xfffffe0037bdc720 vm_page_free_prep() at vm_page_free_prep+0x91/frame 0xfffffe0037bdc740 vm_page_free_toq() at vm_page_free_toq+0x12/frame 0xfffffe0037bdc770 vm_pageout_worker() at vm_pageout_worker+0xa20/frame 0xfffffe0037bdcb70 vm_pageout() at vm_pageout+0x193/frame 0xfffffe0037bdcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bdcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bdcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100138 td 0xfffffe00d3df9300 (CPU 9) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1dfdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1dfdf0 trap() at trap+0x56/frame 0xfffffe003e1dff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1dff20 --- trap 0x13, rip = 0xffffffff80f0a572, rsp = 0xfffffe00de7ee4f0, rbp = 0xfffffe00de7ee520 --- uma_zalloc_arg() at uma_zalloc_arg+0x12/frame 0xfffffe00de7ee520 swapgeom_strategy() at swapgeom_strategy+0xbc/frame 0xfffffe00de7ee560 swp_pager_strategy() at swp_pager_strategy+0xfd/frame 0xfffffe00de7ee590 swap_pager_putpages() at swap_pager_putpages+0x5bd/frame 0xfffffe00de7ee630 vm_pageout_flush() at vm_pageout_flush+0xf5/frame 0xfffffe00de7ee6c0 vm_pageout_cluster() at vm_pageout_cluster+0x352/frame 0xfffffe00de7ee930 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x7fc/frame 0xfffffe00de7eebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de7eebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de7eebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100140 td 0xfffffe00d3df8c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00de7f8a20 mi_switch() at mi_switch+0x159/frame 0xfffffe00de7f8a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00de7f8aa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00de7f8ae0 _sleep() at _sleep+0x26c/frame 0xfffffe00de7f8b80 uma_reclaim_worker() at uma_reclaim_worker+0xb8/frame 0xfffffe00de7f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de7f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de7f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 29 tid 100127 td 0xfffffe00d5cce100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bd7a10 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bd7a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bd7a90 _sleep() at _sleep+0x2cd/frame 0xfffffe0037bd7b30 enc_daemon() at enc_daemon+0xf6/frame 0xfffffe0037bd7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bd7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bd7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 28 tid 100126 td 0xfffffe00d5cce800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bd2a10 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bd2a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bd2a90 _sleep() at _sleep+0x2cd/frame 0xfffffe0037bd2b30 enc_daemon() at enc_daemon+0xf6/frame 0xfffffe0037bd2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bd2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bd2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 27 tid 100123 td 0xfffffe00d609b300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bc39d0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bc3a10 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bc3a50 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bc3a90 _sleep() at _sleep+0x26c/frame 0xfffffe0037bc3b30 random_kthread() at random_kthread+0x67/frame 0xfffffe0037bc3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bc3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bc3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 26 tid 100119 td 0xfffffe00d5ccb000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ba3a70 mi_switch() at mi_switch+0x159/frame 0xfffffe0037ba3ab0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ba3af0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ba3b90 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe0037ba3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ba3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ba3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 25 tid 100118 td 0xfffffe00d6099700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b9ea10 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b9ea50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b9ea90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037b9ead0 _sleep() at _sleep+0x26c/frame 0xfffffe0037b9eb70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037b9ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b9ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b9ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 24 tid 100117 td 0xfffffe003e4bb300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b99a10 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b99a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b99a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037b99ad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037b99b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037b99bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b99bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b99bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 23 tid 100116 td 0xfffffe003e4bba00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b94a10 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b94a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b94a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037b94ad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037b94b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037b94bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b94bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b94bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 22 tid 100115 td 0xfffffe003e4bc100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b8fa10 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b8fa50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b8fa90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037b8fad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037b8fb70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037b8fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b8fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b8fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100096 td 0xfffffe003e4b9e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b24a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b24ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b24b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b24b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b24bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b24bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b24bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100097 td 0xfffffe003e4b9700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b29a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b29ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b29b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b29b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b29bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b29bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b29bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100098 td 0xfffffe003e4b9000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b2ea90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b2ead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b2eb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b2eb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b2ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b2ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b2ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100099 td 0xfffffe003e474800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b33a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b33ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b33b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b33b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b33bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b33bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b33bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100100 td 0xfffffe003e474100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b38a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b38ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b38b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b38b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b38bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b38bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b38bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100102 td 0xfffffe00d2e22500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b42a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b42ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b42b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b42b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b42bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b42bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b42bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100103 td 0xfffffe00d2e21e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b47a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b47ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b47b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b47b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b47bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b47bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b47bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100104 td 0xfffffe00d2e21700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b4ca90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b4cad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b4cb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b4cb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b4cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b4cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b4cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100105 td 0xfffffe00d2e21000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b51a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b51ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b51b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b51b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b51bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b51bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b51bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100106 td 0xfffffe003e4bc800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b56a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b56ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b56b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b56b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b56bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b56bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b56bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100107 td 0xfffffe003e188100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b5ba90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b5bad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b5bb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b5bb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b5bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b5bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b5bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100108 td 0xfffffe00d31ace00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b60a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b60ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b60b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b60b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b60bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b60bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b60bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100109 td 0xfffffe00d31ac700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b65a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b65ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b65b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b65b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b65bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b65bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b65bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100110 td 0xfffffe00d31ac000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b6aa90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b6aad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b6ab10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b6ab70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b6abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b6abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b6abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100111 td 0xfffffe00d2e24800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b6fa90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b6fad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b6fb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b6fb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b6fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b6fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b6fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100091 td 0xfffffe003e471700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b0ba40 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b0ba80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b0bac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b0bb60 xpt_done_td() at xpt_done_td+0x8b/frame 0xfffffe0037b0bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b0bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b0bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100092 td 0xfffffe003e471000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b10a40 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b10a80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b10ac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b10b60 xpt_done_td() at xpt_done_td+0x8b/frame 0xfffffe0037b10bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b10bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b10bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100093 td 0xfffffe003e188800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b15a40 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b15a80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b15ac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b15b60 xpt_done_td() at xpt_done_td+0x8b/frame 0xfffffe0037b15bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b15bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b15bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100125 td 0xfffffe00d609a500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bcda30 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bcda70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bcdab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037bcdb50 xpt_scanner_thread() at xpt_scanner_thread+0x92/frame 0xfffffe0037bcdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bcdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bcdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 19 tid 100090 td 0xfffffe003e471e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b06a20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b06a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b06aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b06b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037b06bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b06bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b06bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 18 tid 100089 td 0xfffffe003e472500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b01a20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b01a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b01aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b01b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037b01bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b01bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b01bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 17 tid 100088 td 0xfffffe003e472c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037afca20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037afca60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037afcaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037afcb40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037afcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037afcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037afcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 16 tid 100087 td 0xfffffe003e473300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037af7a20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037af7a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037af7aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037af7b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037af7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037af7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037af7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 15 tid 100086 td 0xfffffe003e194800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037af2a20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037af2a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037af2aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037af2b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037af2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037af2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037af2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100085 td 0xfffffe003e185000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037aeda20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037aeda60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037aedaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037aedb40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037aedbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037aedbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037aedbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100084 td 0xfffffe003e185700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ae8a20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037ae8a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ae8aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ae8b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037ae8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ae8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ae8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100083 td 0xfffffe003e185e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ae3a20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037ae3a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ae3aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ae3b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037ae3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ae3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ae3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100082 td 0xfffffe003e186500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037adea20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037adea60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037adeaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037adeb40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037adebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037adebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037adebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100081 td 0xfffffe003e186c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ad9a20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037ad9a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ad9aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ad9b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037ad9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ad9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ad9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100080 td 0xfffffe003e187300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ad4a20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037ad4a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ad4aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ad4b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037ad4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ad4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ad4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100079 td 0xfffffe003e187a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037acfa20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037acfa60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037acfaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037acfb40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037acfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037acfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037acfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100078 td 0xfffffe003e191000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037acaa50 mi_switch() at mi_switch+0x159/frame 0xfffffe0037acaa90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037acaad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037acab70 crypto_proc() at crypto_proc+0x2bf/frame 0xfffffe0037acabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037acabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037acabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100065 td 0xfffffe003e1c3a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a89a50 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a89a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a89ad0 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037a89b30 seq_eventthread() at seq_eventthread+0x8c/frame 0xfffffe0037a89bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a89bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a89bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffffe003e1cde00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a6ea50 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a6ea90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a6ead0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a6eb70 g_run_events() at g_run_events+0x64/frame 0xfffffe0037a6ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a6ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a6ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffffe003e1c4800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a73a50 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a73a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a73ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0x4c/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100064 td 0xfffffe003e1c4100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a78a50 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a78a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a78ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a78b70 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xfffffe0037a78ba0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe0037a78bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a78bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a78bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100016 td 0xfffffe003e3e5800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addb3ae0 mi_switch() at mi_switch+0x159/frame 0xfffffe00addb3b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00addb3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addb3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addb3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100017 td 0xfffffe003e3fc300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addb8ae0 mi_switch() at mi_switch+0x159/frame 0xfffffe00addb8b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00addb8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addb8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addb8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100019 td 0xfffffe003e3fb500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffffe003e1cd700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377feae0 mi_switch() at mi_switch+0x159/frame 0xfffffe00377feb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00377febb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377febf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377febf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100048 td 0xfffffe003e1cd000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a04ae0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a04b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a04bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a04bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a04bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100049 td 0xfffffe003e1dc800 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100050 td 0xfffffe003e1dc100 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffffe003e1dba00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffffe003e1db300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100053 td 0xfffffe003e1dac00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100054 td 0xfffffe003e1da500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100055 td 0xfffffe003e1c1000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100056 td 0xfffffe003e1d0800 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100057 td 0xfffffe003e1d0100 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100058 td 0xfffffe003e1cfa00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100059 td 0xfffffe003e1cf300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100060 td 0xfffffe003e1cec00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100094 td 0xfffffe003e4bac00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b1aae0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b1ab20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037b1abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b1abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b1abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffffe003e4ba500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b1fae0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b1fb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037b1fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b1fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b1fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100101 td 0xfffffe003e473a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b3dae0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b3db20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037b3dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b3dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b3dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100112 td 0xfffffe00d2e24100 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffffe00d2e23a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b79ae0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b79b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037b79bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b79bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b79bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100177 td 0xfffffe00d39dd700 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100178 td 0xfffffe00d39dd000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100179 td 0xfffffe00d3dfa800 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100180 td 0xfffffe00d3dfa100 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100181 td 0xfffffe00d3df9a00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100182 td 0xfffffe00e5ffa300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100183 td 0xfffffe00e5ff9c00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100184 td 0xfffffe00e5ff9500 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffffe003e3e4300 (CPU 0) cpustop_handler() at cpustop_handler+0x2a/frame 0xffffffff81d87450 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xffffffff81d87470 trap() at trap+0x56/frame 0xffffffff81d875a0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81d875a0 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00add72a30, rbp = 0xfffffe00add72a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add72a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add72a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add72ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add72ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add72bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add72bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add72bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe003e3e3c00 (CPU 1) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e17fdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e17fdf0 trap() at trap+0x56/frame 0xfffffe003e17ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e17ff20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00add77a30, rbp = 0xfffffe00add77a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add77a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add77a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add77ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add77ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add77bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add77bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add77bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe003e3e3500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00add7ca90 mi_switch() at mi_switch+0x159/frame 0xfffffe00add7cad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add7cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe003e3e2e00 (CPU 3) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e197dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e197df0 trap() at trap+0x56/frame 0xfffffe003e197f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e197f20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00add81a30, rbp = 0xfffffe00add81a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add81a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add81a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add81ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add81ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add81bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add81bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add81bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe003e3e2700 (CPU 4) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1a3dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1a3df0 trap() at trap+0x56/frame 0xfffffe003e1a3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1a3f20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00add86a30, rbp = 0xfffffe00add86a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add86a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add86a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add86ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add86ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add86bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add86bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add86bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe003e3e2000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00add8ba90 mi_switch() at mi_switch+0x159/frame 0xfffffe00add8bad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add8bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add8bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add8bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe003e3eca00 (CPU 6) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1bbdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1bbdf0 trap() at trap+0x56/frame 0xfffffe003e1bbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1bbf20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00add90a30, rbp = 0xfffffe00add90a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add90a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add90a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add90ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add90ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add90bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add90bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add90bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe003e3ec300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00add95a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00add95ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add95bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add95bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add95bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe003e3ebc00 (CPU 8) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1d3dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1d3df0 trap() at trap+0x56/frame 0xfffffe003e1d3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1d3f20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00add9aa30, rbp = 0xfffffe00add9aa30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00add9aa30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00add9aa90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00add9aab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00add9aad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add9abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add9abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add9abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe003e3eb500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00add9fa90 mi_switch() at mi_switch+0x159/frame 0xfffffe00add9fad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add9fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add9fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add9fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe003e3eae00 (CPU 10) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1ebdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1ebdf0 trap() at trap+0x56/frame 0xfffffe003e1ebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1ebf20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00adda4a30, rbp = 0xfffffe00adda4a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adda4a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00adda4a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00adda4ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00adda4ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00adda4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe003e3ea700 (CPU 11) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1f7dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1f7df0 trap() at trap+0x56/frame 0xfffffe003e1f7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1f7f20 --- trap 0x13, rip = 0xffffffff81032d36, rsp = 0xfffffe00adda9a30, rbp = 0xfffffe00adda9a30 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe00adda9a30 acpi_cpu_idle() at acpi_cpu_idle+0x23d/frame 0xfffffe00adda9a90 cpu_idle_acpi() at cpu_idle_acpi+0x3e/frame 0xfffffe00adda9ab0 cpu_idle() at cpu_idle+0x9f/frame 0xfffffe00adda9ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00adda9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffffe003e3e4a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00add6d6b0 mi_switch() at mi_switch+0x159/frame 0xfffffe00add6d6f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add6d730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00add6d790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00add6d7a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00add6d840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00add6d8d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00add6dac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00add6dbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00add6dbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2b2bfa, rsp = 0x7fffffffe768, rbp = 0x7fffffffe7d0 --- Tracing command audit pid 10 tid 100001 td 0xfffffe003e3e5100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00add68a70 mi_switch() at mi_switch+0x159/frame 0xfffffe00add68ab0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add68af0 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe00add68b50 audit_worker() at audit_worker+0x9f/frame 0xfffffe00add68bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add68bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add68bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81d9e1c0 sched_switch() at sched_switch+0x5ba/frame 0xffffffff822ffbf0 mi_switch() at mi_switch+0x159/frame 0xffffffff822ffc30 sleepq_switch() at sleepq_switch+0x11a/frame 0xffffffff822ffc70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xffffffff822ffcb0 _sleep() at _sleep+0x26c/frame 0xffffffff822ffd50 swapper() at swapper+0x75/frame 0xffffffff822ffda0 mi_startup() at mi_startup+0x2ed/frame 0xffffffff822ffdf0 btext() at btext+0x2c Tracing command kernel pid 0 tid 100015 td 0xfffffe003e3ea000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addaea60 mi_switch() at mi_switch+0x159/frame 0xfffffe00addaeaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addaeae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00addaeb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00addaebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addaebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addaebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffffe003e3fbc00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addbda60 mi_switch() at mi_switch+0x159/frame 0xfffffe00addbdaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addbdae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00addbdb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00addbdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addbdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addbdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffffe003e3fae00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addc7a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00addc7ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addc7b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addc7b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00addc7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addc7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addc7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffffe003e3fa700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addcca60 mi_switch() at mi_switch+0x159/frame 0xfffffe00addccaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addccae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00addccb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00addccbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addccbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addccbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffffe003e3fa000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037781a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037781ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037781b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037781b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe0037781bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037781bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037781bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffffe003e3ed800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037786a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037786ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037786b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037786b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe0037786bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037786bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037786bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffffe003e3ed100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe003778ba90 mi_switch() at mi_switch+0x159/frame 0xfffffe003778bad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe003778bb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe003778bb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe003778bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003778bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003778bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffffe003e1f2c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037790a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037790ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037790b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037790b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe0037790bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037790bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037790bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffffe003e1f2500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037795a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037795ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037795b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037795b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe0037795bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037795bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037795bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffffe003e1f1e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe003779aa90 mi_switch() at mi_switch+0x159/frame 0xfffffe003779aad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe003779ab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe003779ab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe003779abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003779abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003779abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffffe003e1f1700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe003779fa90 mi_switch() at mi_switch+0x159/frame 0xfffffe003779fad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe003779fb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe003779fb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe003779fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003779fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003779fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffffe003e1f1000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377a4a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377a4ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377a4b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377a4b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377a4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377a4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377a4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffffe003e3fd800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377a9a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377a9ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377a9b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377a9b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377a9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377a9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377a9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffffe003e3fd100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377aea90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377aead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377aeb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377aeb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377aebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377aebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377aebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffffe003e3fca00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377b3a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377b3ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377b3b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377b3b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377b3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377b3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377b3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffffe003e1e6500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377b8a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377b8ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377b8b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377b8b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377b8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377b8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377b8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffffe003e1e5e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377bda90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377bdad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377bdb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377bdb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377bdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377bdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377bdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffffe003e1e5700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377c2a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377c2ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377c2b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377c2b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377c2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377c2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377c2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffffe003e1e5000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377c7a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377c7ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377c7b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377c7b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377c7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377c7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377c7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffffe003e1f4800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377cca90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377ccad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377ccb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377ccb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377ccbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377ccbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377ccbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffffe003e1f4100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377d1a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377d1ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377d1b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377d1b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377d1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377d1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377d1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffffe003e1f3a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377d6a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377d6ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377d6b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377d6b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377d6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377d6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377d6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffffe003e1f3300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377dba90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377dbad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377dbb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377dbb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377dbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377dbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377dbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffffe003e1d9e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377e0a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377e0ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377e0b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377e0b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377e0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377e0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffffe003e1d9700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377e5a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377e5ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377e5b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377e5b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377e5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377e5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffffe003e1d9000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377eaa90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377eaad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377eab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377eab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377eabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377eabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377eabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffffe003e1e8800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377efa90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377efad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377efb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377efb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377efbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377efbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377efbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffffe003e1e8100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377f4a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377f4ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377f4b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377f4b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377f4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffffe003e1e7a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377f9a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377f9ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377f9b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377f9b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377f9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffffe003e1ce500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a69a60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a69aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a69ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a69b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037a69bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a69bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a69bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffffe003e1c3300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a8ea60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a8eaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a8eae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a8eb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037a8ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a8ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a8ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffffe003e1c2c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a93a60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a93aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a93ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a93b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037a93bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a93bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a93bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffffe003e1c2500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a98a60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a98aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a98ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a98b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037a98bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a98bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a98bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffffe003e1c1e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a9da60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a9daa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a9dae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a9db80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037a9dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a9dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a9dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffffe003e1c1700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037aa2a60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037aa2aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037aa2ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037aa2b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037aa2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037aa2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037aa2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffffe003e194100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037aa7a60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037aa7aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037aa7ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037aa7b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037aa7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037aa7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037aa7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffffe003e193a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037aaca60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037aacaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037aacae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037aacb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037aacbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037aacbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037aacbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffffe003e193300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ab1a60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037ab1aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ab1ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ab1b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037ab1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ab1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ab1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffffe003e192c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ab6a60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037ab6aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ab6ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ab6b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037ab6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ab6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ab6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffffe003e192500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037abba60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037abbaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037abbae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037abbb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037abbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037abbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037abbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffffe003e191e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ac0a60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037ac0aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ac0ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ac0b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037ac0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ac0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ac0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffffe003e191700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ac5a60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037ac5aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ac5ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ac5b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037ac5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ac5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ac5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffffe00d2e23300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b7ea90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b7ead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b7eb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037b7eb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe0037b7ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b7ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b7ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100120 td 0xfffffe00d609c800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bb4a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bb4ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bb4b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037bb4b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe0037bb4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bb4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bb4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffffe00d609c100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bb9a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bb9ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bb9b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037bb9b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe0037bb9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bb9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bb9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffffe00d609ba00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bbea90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bbead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bbeb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037bbeb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe0037bbebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bbebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bbebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffffe00d609ac00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bc8a60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bc8aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bc8ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037bc8b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037bc8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bc8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bc8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> show allchains chain 1: thread 100366 (pid 32540, md11) sleeping on 0xfffff807ce419000 "mdwait" chain 2: thread 100367 (pid 32536, md10) sleeping on 0xfffff806a292e000 "mdwait" chain 3: thread 100353 (pid 32522, tee) sleeping on 0xfffff802d7707000 "piperd" chain 4: thread 100249 (pid 32521, sh) sleeping on 0xfffff80183df1a60 "wait" chain 5: thread 100322 (pid 32520, sh) sleeping on 0xfffff801dc5e9530 "wait" chain 6: thread 100240 (pid 32367, sh) sleeping on 0xfffff800215d3530 "wait" chain 7: thread 100237 (pid 2525, sh) sleeping on 0xfffff800217e6000 "piperd" chain 8: thread 100236 (pid 2523, awk) sleeping on 0xfffff800219232f8 "piperd" chain 9: thread 100235 (pid 2522, sh) sleeping on 0xfffff80021594000 "wait" chain 10: thread 100208 (pid 2477, sh) sleeping on 0xfffff80160009530 "wait" chain 11: thread 100219 (pid 2362, bash) sleeping on 0xfffff8002164b530 "wait" chain 12: thread 100218 (pid 2360, csh) sleeping on 0xfffff8016057d0a8 "pause" chain 13: thread 100201 (pid 2359, su) sleeping on 0xfffff8002165a000 "wait" chain 14: thread 100155 (pid 2353, bash) sleeping on 0xfffff80021a41530 "wait" chain 15: thread 100206 (pid 2352, sshd) sleeping on 0xfffff800041851c0 "select" chain 16: thread 100217 (pid 2349, sshd) sleeping on 0xfffff8002193c3c0 "select" chain 17: thread 100204 (pid 2345, csh) sleeping on 0xfffff80003b174b0 "ttyin" chain 18: thread 100215 (pid 2344, login) sleeping on 0xfffff8016057da60 "wait" chain 19: thread 100214 (pid 2343, getty) sleeping on 0xfffff80003b178b0 "ttyin" chain 20: thread 100213 (pid 2342, getty) sleeping on 0xfffff800210dc8b0 "ttyin" chain 21: thread 100212 (pid 2341, getty) sleeping on 0xfffff800210dccb0 "ttyin" chain 22: thread 100211 (pid 2340, getty) sleeping on 0xfffff800210db0b0 "ttyin" chain 23: thread 100210 (pid 2339, getty) sleeping on 0xfffff800210db4b0 "ttyin" chain 24: thread 100209 (pid 2338, getty) sleeping on 0xfffff800210db8b0 "ttyin" chain 25: thread 100176 (pid 2337, getty) sleeping on 0xfffff800210dbcb0 "ttyin" chain 26: thread 100165 (pid 2336, getty) sleeping on 0xfffff800210da0b0 "ttyin" chain 27: thread 100142 (pid 2335, getty) sleeping on 0xfffff800210da4b0 "ttyin" chain 28: thread 100146 (pid 2289, cron) sleeping on 0xffffffff81c82711 "nanslp" chain 29: thread 100202 (pid 2285, sshd) sleeping on 0xfffff80004185240 "select" chain 30: thread 100199 (pid 2257, powerd) sleeping on 0xfffff800041920c0 "select" chain 31: thread 100189 (pid 2254, ntpd) sleeping on 0xfffff800039b04c0 "select" chain 32: thread 100755 (pid 2254, ntpd) sleeping on 0xfffff800210aa880 "usem" chain 33: thread 100195 (pid 2140, watchdogd) sleeping on 0xffffffff81c82717 "nanslp" chain 34: thread 100164 (pid 2061, rpcbind) sleeping on 0xfffff80004185340 "select" chain 35: thread 100192 (pid 2051, syslogd) sleeping on 0xfffff800210a9840 "select" chain 36: thread 100144 (pid 1980, devd) sleeping on 0xfffff80004193ec0 "select" chain 37: thread 100193 (pid 1975, dhclient) sleeping on 0xfffff800039b0540 "select" chain 38: thread 100150 (pid 1928, dhclient) sleeping on 0xfffff8002110b440 "select" chain 39: thread 100185 (pid 1925, dhclient) sleeping on 0xfffff80021211ec0 "select" chain 40: thread 100141 (pid 34, vnlru) sleeping on 0xfffff80021090000 "vlruwt" chain 41: thread 100139 (pid 33, syncer) sleeping on 0xffffffff81d58b98 "syncer" chain 42: thread 100130 (pid 32, bufdaemon) sleeping on 0xffffffff81d58098 "qsleep" chain 43: thread 100131 (pid 32, bufspacedaemon-0) sleeping on 0xffffffff8180a980 "-" chain 44: thread 100132 (pid 32, bufspacedaemon-1) sleeping on 0xffffffff81812c40 "-" chain 45: thread 100133 (pid 32, bufspacedaemon-2) sleeping on 0xffffffff8181af00 "-" chain 46: thread 100134 (pid 32, bufspacedaemon-3) sleeping on 0xffffffff818231c0 "-" chain 47: thread 100135 (pid 32, bufspacedaemon-4) sleeping on 0xffffffff8182b480 "-" chain 48: thread 100136 (pid 32, bufspacedaemon-5) sleeping on 0xffffffff81833740 "-" chain 49: thread 100137 (pid 32, bufspacedaemon-6) sleeping on 0xffffffff8183ba00 "-" chain 50: thread 100154 (pid 32, / worker) sleeping on 0xfffff800041890e8 "sdflush" chain 51: thread 100200 (pid 32, /tmp worker) sleeping on 0xfffff80021501ce8 "sdflush" chain 52: thread 100129 (pid 31, vmdaemon) sleeping on 0xffffffff81d73b08 "psleep" chain 53: thread 100140 (pid 30, uma) sleeping on 0xffffffff80f0dc20 "umarcl" chain 54: thread 100127 (pid 29, enc_daemon1) sleeping on 0xfffff8002118b530 "idle" chain 55: thread 100126 (pid 28, enc_daemon0) sleeping on 0xfffff8002118ba60 "idle" chain 56: thread 100123 (pid 27, rand_harvestq) sleeping on 0xffffffff81adcfb0 "-" chain 57: thread 100119 (pid 26, sctp_iterator) sleeping on 0xffffffff81de5060 "waiting_for_work" chain 58: thread 100118 (pid 25, soaiod4) sleeping on 0xffffffff81d57a9c "-" chain 59: thread 100117 (pid 24, soaiod3) sleeping on 0xffffffff81d57a9c "-" chain 60: thread 100116 (pid 23, soaiod2) sleeping on 0xffffffff81d57a9c "-" chain 61: thread 100115 (pid 22, soaiod1) sleeping on 0xffffffff81d57a9c "-" chain 62: thread 100096 (pid 21, usbus0) sleeping on 0xfffffe00d2d84440 "-" chain 63: thread 100097 (pid 21, usbus0) sleeping on 0xfffffe00d2d84498 "-" chain 64: thread 100098 (pid 21, usbus0) sleeping on 0xfffffe00d2d844f0 "-" chain 65: thread 100099 (pid 21, usbus0) sleeping on 0xfffffe00d2d84548 "-" chain 66: thread 100100 (pid 21, usbus0) sleeping on 0xfffffe00d2d845a0 "-" chain 67: thread 100102 (pid 21, usbus1) sleeping on 0xfffffe003e4a1cf0 "-" chain 68: thread 100103 (pid 21, usbus1) sleeping on 0xfffffe003e4a1d48 "-" chain 69: thread 100104 (pid 21, usbus1) sleeping on 0xfffffe003e4a1da0 "-" chain 70: thread 100105 (pid 21, usbus1) sleeping on 0xfffffe003e4a1df8 "-" chain 71: thread 100106 (pid 21, usbus1) sleeping on 0xfffffe003e4a1e50 "-" chain 72: thread 100107 (pid 21, usbus2) sleeping on 0xfffffe00d2e2bcf0 "-" chain 73: thread 100108 (pid 21, usbus2) sleeping on 0xfffffe00d2e2bd48 "-" chain 74: thread 100109 (pid 21, usbus2) sleeping on 0xfffffe00d2e2bda0 "-" chain 75: thread 100110 (pid 21, usbus2) sleeping on 0xfffffe00d2e2bdf8 "-" chain 76: thread 100111 (pid 21, usbus2) sleeping on 0xfffffe00d2e2be50 "-" chain 77: thread 100091 (pid 20, doneq0) sleeping on 0xffffffff819b83c0 "-" chain 78: thread 100093 (pid 20, doneq2) sleeping on 0xffffffff819b84c0 "-" chain 79: thread 100125 (pid 20, scanner) sleeping on 0xffffffff819b8288 "-" chain 80: thread 100090 (pid 19, crypto returns 11) sleeping on 0xfffff80003accc50 "crypto_ret_wait" chain 81: thread 100089 (pid 18, crypto returns 10) sleeping on 0xfffff80003accbf0 "crypto_ret_wait" chain 82: thread 100088 (pid 17, crypto returns 9) sleeping on 0xfffff80003accb90 "crypto_ret_wait" chain 83: thread 100087 (pid 16, crypto returns 8) sleeping on 0xfffff80003accb30 "crypto_ret_wait" chain 84: thread 100086 (pid 15, crypto returns 7) sleeping on 0xfffff80003accad0 "crypto_ret_wait" chain 85: thread 100085 (pid 9, crypto returns 6) sleeping on 0xfffff80003acca70 "crypto_ret_wait" chain 86: thread 100084 (pid 8, crypto returns 5) sleeping on 0xfffff80003acca10 "crypto_ret_wait" chain 87: thread 100083 (pid 7, crypto returns 4) sleeping on 0xfffff80003acc9b0 "crypto_ret_wait" chain 88: thread 100082 (pid 6, crypto returns 3) sleeping on 0xfffff80003acc950 "crypto_ret_wait" chain 89: thread 100081 (pid 5, crypto returns 2) sleeping on 0xfffff80003acc8f0 "crypto_ret_wait" chain 90: thread 100080 (pid 4, crypto returns 1) sleeping on 0xfffff80003acc890 "crypto_ret_wait" chain 91: thread 100079 (pid 3, crypto returns 0) sleeping on 0xfffff80003acc830 "crypto_ret_wait" chain 92: thread 100078 (pid 2, crypto) sleeping on 0xffffffff81d6db78 "crypto_wait" chain 93: thread 100065 (pid 14, sequencer 00) sleeping on 0xfffff80003a35888 "seqstate" chain 94: thread 100062 (pid 13, g_event) sleeping on 0xffffffff81d9e0c8 "-" chain 95: thread 100063 (pid 13, g_up) sleeping on 0xffffffff81d9e0d8 "-" chain 96: thread 100064 (pid 13, g_down) sleeping on 0xffffffff81d9e0d0 "-" chain 97: thread 100002 (pid 1, init) sleeping on 0xfffff80003896000 "wait" chain 98: thread 100001 (pid 10, audit) sleeping on 0xffffffff81de5cf0 "audit_worker_cv" chain 99: thread 100000 (pid 0, swapper) sleeping on 0xffffffff81d8d688 "swapin" chain 100: thread 100015 (pid 0, aiod_kick taskq) sleeping on 0xfffff8000377f100 "-" chain 101: thread 100018 (pid 0, thread taskq) sleeping on 0xfffff8000377ea00 "-" chain 102: thread 100020 (pid 0, config_0) sleeping on 0xfffff80003777000 "-" chain 103: thread 100021 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff8000377e500 "-" chain 104: thread 100022 (pid 0, if_io_tqg_0) sleeping on 0xfffff80003776e00 "-" chain 105: thread 100023 (pid 0, if_io_tqg_1) sleeping on 0xfffff80003776d00 "-" chain 106: thread 100024 (pid 0, if_io_tqg_2) sleeping on 0xfffff80003776c00 "-" chain 107: thread 100025 (pid 0, if_io_tqg_3) sleeping on 0xfffff80003776b00 "-" chain 108: thread 100026 (pid 0, if_io_tqg_4) sleeping on 0xfffff80003776a00 "-" chain 109: thread 100027 (pid 0, if_io_tqg_5) sleeping on 0xfffff80003776900 "-" chain 110: thread 100028 (pid 0, if_io_tqg_6) sleeping on 0xfffff80003776800 "-" chain 111: thread 100029 (pid 0, if_io_tqg_7) sleeping on 0xfffff80003776700 "-" chain 112: thread 100030 (pid 0, if_io_tqg_8) sleeping on 0xfffff80003776600 "-" chain 113: thread 100031 (pid 0, if_io_tqg_9) sleeping on 0xfffff80003776500 "-" chain 114: thread 100032 (pid 0, if_io_tqg_10) sleeping on 0xfffff80003776400 "-" chain 115: thread 100033 (pid 0, if_io_tqg_11) sleeping on 0xfffff80003776300 "-" chain 116: thread 100034 (pid 0, if_config_tqg_0) sleeping on 0xfffff80003776200 "-" chain 117: thread 100035 (pid 0, softirq_0) sleeping on 0xfffff80003776100 "-" chain 118: thread 100036 (pid 0, softirq_1) sleeping on 0xfffff80003776000 "-" chain 119: thread 100037 (pid 0, softirq_2) sleeping on 0xfffff80003775e00 "-" chain 120: thread 100038 (pid 0, softirq_3) sleeping on 0xfffff80003775d00 "-" chain 121: thread 100039 (pid 0, softirq_4) sleeping on 0xfffff80003775c00 "-" chain 122: thread 100040 (pid 0, softirq_5) sleeping on 0xfffff80003775b00 "-" chain 123: thread 100041 (pid 0, softirq_6) sleeping on 0xfffff80003775a00 "-" chain 124: thread 100042 (pid 0, softirq_7) sleeping on 0xfffff80003775900 "-" chain 125: thread 100043 (pid 0, softirq_8) sleeping on 0xfffff80003775800 "-" chain 126: thread 100044 (pid 0, softirq_9) sleeping on 0xfffff80003775700 "-" chain 127: thread 100045 (pid 0, softirq_10) sleeping on 0xfffff80003775600 "-" chain 128: thread 100046 (pid 0, softirq_11) sleeping on 0xfffff80003775500 "-" chain 129: thread 100061 (pid 0, firmware taskq) sleeping on 0xfffff800039d4400 "-" chain 130: thread 100066 (pid 0, crypto_0) sleeping on 0xfffff800039d3d00 "-" chain 131: thread 100067 (pid 0, crypto_1) sleeping on 0xfffff800039d3d00 "-" chain 132: thread 100068 (pid 0, crypto_2) sleeping on 0xfffff800039d3d00 "-" chain 133: thread 100069 (pid 0, crypto_3) sleeping on 0xfffff800039d3d00 "-" chain 134: thread 100070 (pid 0, crypto_4) sleeping on 0xfffff800039d3d00 "-" chain 135: thread 100071 (pid 0, crypto_5) sleeping on 0xfffff800039d3d00 "-" chain 136: thread 100072 (pid 0, crypto_6) sleeping on 0xfffff800039d3d00 "-" chain 137: thread 100073 (pid 0, crypto_7) sleeping on 0xfffff800039d3d00 "-" chain 138: thread 100074 (pid 0, crypto_8) sleeping on 0xfffff800039d3d00 "-" chain 139: thread 100075 (pid 0, crypto_9) sleeping on 0xfffff800039d3d00 "-" chain 140: thread 100076 (pid 0, crypto_10) sleeping on 0xfffff800039d3d00 "-" chain 141: thread 100077 (pid 0, crypto_11) sleeping on 0xfffff800039d3d00 "-" chain 142: thread 100114 (pid 0, mca taskq) sleeping on 0xfffff80003780300 "-" chain 143: thread 100120 (pid 0, acpi_task_0) sleeping on 0xfffff80021031700 "-" chain 144: thread 100121 (pid 0, acpi_task_1) sleeping on 0xfffff80021031700 "-" chain 145: thread 100122 (pid 0, acpi_task_2) sleeping on 0xfffff80021031700 "-" chain 146: thread 100124 (pid 0, CAM taskq) sleeping on 0xfffff800039d2100 "-" db:0:pho> chain 1: thread 100366 (pid 32540, md11) sleeping on 0xfffff807ce419000 "mdwait" chain 2: thread 100367 (pid 32536, md10) sleeping on 0xfffff806a292e000 "mdwait" chain 3: thread 100353 (pid 32522, tee) sleeping on 0xfffff802d7707000 "piperd" chain 4: thread 100249 (pid 32521, sh) sleeping on 0xfffff80183df1a60 "wait" chain 5: thread 100322 (pid 32520, sh) sleeping on 0xfffff801dc5e9530 "wait" chain 6: thread 100240 (pid 32367, sh) sleeping on 0xfffff800215d3530 "wait" chain 7: thread 100237 (pid 2525, sh) sleeping on 0xfffff800217e6000 "piperd" chain 8: thread 100236 (pid 2523, awk) sleeping on 0xfffff800219232f8 "piperd" chain 9: thread 100235 (pid 2522, sh) sleeping on 0xfffff80021594000 "wait" chain 10: thread 100208 (pid 2477, sh) sleeping on 0xfffff80160009530 "wait" chain 11: thread 100219 (pid 2362, bash) sleeping on 0xfffff8002164b530 "wait" chain 12: thread 100218 (pid 2360, csh) sleeping on 0xfffff8016057d0a8 "pause" chain 13: thread 100201 (pid 2359, su) sleeping on 0xfffff8002165a000 "wait" chain 14: thread 100155 (pid 2353, bash) sleeping on 0xfffff80021a41530 "wait" chain 15: thread 100206 (pid 2352, sshd) sleeping on 0xfffff800041851c0 "select" chain 16: thread 100217 (pid 2349, sshd) sleeping on 0xfffff8002193c3c0 "select" chain 17: thread 100204 (pid 2345, csh) sleeping on 0xfffff80003b174b0 "ttyin" chain 18: thread 100215 (pid 2344, login) sleeping on 0xfffff8016057da60 "wait" chain 19: thread 100214 (pid 2343, getty) sleeping on 0xfffff80003b178b0 "ttyin" chain 20: thread 100213 (pid 2342, getty) sleeping on 0xfffff800210dc8b0 "ttyin" chain 21: thread 100212 (pid 2341, getty) sleeping on 0xfffff800210dccb0 "ttyin" chain 22: thread 100211 (pid 2340, getty) sleeping on 0xfffff800210db0b0 "ttyin" chain 23: thread 100210 (pid 2339, getty) sleeping on 0xfffff800210db4b0 "ttyin" chain 24: thread 100209 (pid 2338, getty) sleeping on 0xfffff800210db8b0 "ttyin" chain 25: thread 100176 (pid 2337, getty) sleeping on 0xfffff800210dbcb0 "ttyin" chain 26: thread 100165 (pid 2336, getty) sleeping on 0xfffff800210da0b0 "ttyin" chain 27: thread 100142 (pid 2335, getty) sleeping on 0xfffff800210da4b0 "ttyin" chain 28: thread 100146 (pid 2289, cron) sleeping on 0xffffffff81c82711 "nanslp" chain 29: thread 100202 (pid 2285, sshd) sleeping on 0xfffff80004185240 "select" chain 30: thread 100199 (pid 2257, powerd) sleeping on 0xfffff800041920c0 "select" chain 31: thread 100189 (pid 2254, ntpd) sleeping on 0xfffff800039b04c0 "select" chain 32: thread 100755 (pid 2254, ntpd) sleeping on 0xfffff800210aa880 "usem" chain 33: thread 100195 (pid 2140, watchdogd) sleeping on 0xffffffff81c82717 "nanslp" chain 34: thread 100164 (pid 2061, rpcbind) sleeping on 0xfffff80004185340 "select" chain 35: thread 100192 (pid 2051, syslogd) sleeping on 0xfffff800210a9840 "select" chain 36: thread 100144 (pid 1980, devd) sleeping on 0xfffff80004193ec0 "select" chain 37: thread 100193 (pid 1975, dhclient) sleeping on 0xfffff800039b0540 "select" chain 38: thread 100150 (pid 1928, dhclient) sleeping on 0xfffff8002110b440 "select" chain 39: thread 100185 (pid 1925, dhclient) sleeping on 0xfffff80021211ec0 "select" chain 40: thread 100141 (pid 34, vnlru) sleeping on 0xfffff80021090000 "vlruwt" chain 41: thread 100139 (pid 33, syncer) sleeping on 0xffffffff81d58b98 "syncer" chain 42: thread 100130 (pid 32, bufdaemon) sleeping on 0xffffffff81d58098 "qsleep" chain 43: thread 100131 (pid 32, bufspacedaemon-0) sleeping on 0xffffffff8180a980 "-" chain 44: thread 100132 (pid 32, bufspacedaemon-1) sleeping on 0xffffffff81812c40 "-" chain 45: thread 100133 (pid 32, bufspacedaemon-2) sleeping on 0xffffffff8181af00 "-" chain 46: thread 100134 (pid 32, bufspacedaemon-3) sleeping on 0xffffffff818231c0 "-" chain 47: thread 100135 (pid 32, bufspacedaemon-4) sleeping on 0xffffffff8182b480 "-" chain 48: thread 100136 (pid 32, bufspacedaemon-5) sleeping on 0xffffffff81833740 "-" chain 49: thread 100137 (pid 32, bufspacedaemon-6) sleeping on 0xffffffff8183ba00 "-" chain 50: thread 100154 (pid 32, / worker) sleeping on 0xfffff800041890e8 "sdflush" chain 51: thread 100200 (pid 32, /tmp worker) sleeping on 0xfffff80021501ce8 "sdflush" chain 52: thread 100129 (pid 31, vmdaemon) sleeping on 0xffffffff81d73b08 "psleep" chain 53: thread 100140 (pid 30, uma) sleeping on 0xffffffff80f0dc20 "umarcl" chain 54: thread 100127 (pid 29, enc_daemon1) sleeping on 0xfffff8002118b530 "idle" chain 55: thread 100126 (pid 28, enc_daemon0) sleeping on 0xfffff8002118ba60 "idle" chain 56: thread 100123 (pid 27, rand_harvestq) sleeping on 0xffffffff81adcfb0 "-" chain 57: thread 100119 (pid 26, sctp_iterator) sleeping on 0xffffffff81de5060 "waiting_for_work" chain 58: thread 100118 (pid 25, soaiod4) sleeping on 0xffffffff81d57a9c "-" chain 59: thread 100117 (pid 24, soaiod3) sleeping on 0xffffffff81d57a9c "-" chain 60: thread 100116 (pid 23, soaiod2) sleeping on 0xffffffff81d57a9c "-" chain 61: thread 100115 (pid 22, soaiod1) sleeping on 0xffffffff81d57a9c "-" chain 62: thread 100096 (pid 21, usbus0) sleeping on 0xfffffe00d2d84440 "-" chain 63: thread 100097 (pid 21, usbus0) sleeping on 0xfffffe00d2d84498 "-" chain 64: thread 100098 (pid 21, usbus0) sleeping on 0xfffffe00d2d844f0 "-" chain 65: thread 100099 (pid 21, usbus0) sleeping on 0xfffffe00d2d84548 "-" chain 66: thread 100100 (pid 21, usbus0) sleeping on 0xfffffe00d2d845a0 "-" chain 67: thread 100102 (pid 21, usbus1) sleeping on 0xfffffe003e4a1cf0 "-" chain 68: thread 100103 (pid 21, usbus1) sleeping on 0xfffffe003e4a1d48 "-" chain 69: thread 100104 (pid 21, usbus1) sleeping on 0xfffffe003e4a1da0 "-" chain 70: thread 100105 (pid 21, usbus1) sleeping on 0xfffffe003e4a1df8 "-" chain 71: thread 100106 (pid 21, usbus1) sleeping on 0xfffffe003e4a1e50 "-" chain 72: thread 100107 (pid 21, usbus2) sleeping on 0xfffffe00d2e2bcf0 "-" chain 73: thread 100108 (pid 21, usbus2) sleeping on 0xfffffe00d2e2bd48 "-" chain 74: thread 100109 (pid 21, usbus2) sleeping on 0xfffffe00d2e2bda0 "-" chain 75: thread 100110 (pid 21, usbus2) sleeping on 0xfffffe00d2e2bdf8 "-" chain 76: thread 100111 (pid 21, usbus2) sleeping on 0xfffffe00d2e2be50 "-" chain 77: thread 100091 (pid 20, doneq0) sleeping on 0xffffffff819b83c0 "-" chain 78: thread 100093 (pid 20, doneq2) sleeping on 0xffffffff819b84c0 "-" chain 79: thread 100125 (pid 20, scanner) sleeping on 0xffffffff819b8288 "-" chain 80: thread 100090 (pid 19, crypto returns 11) sleeping on 0xfffff80003accc50 "crypto_ret_wait" chain 81: thread 100089 (pid 18, crypto returns 10) sleeping on 0xfffff80003accbf0 "crypto_ret_wait" chain 82: thread 100088 (pid 17, crypto returns 9) sleeping on 0xfffff80003accb90 "crypto_ret_wait" chain 83: thread 100087 (pid 16, crypto returns 8) sleeping on 0xfffff80003accb30 "crypto_ret_wait" chain 84: thread 100086 (pid 15, crypto returns 7) sleeping on 0xfffff80003accad0 "crypto_ret_wait" chain 85: thread 100085 (pid 9, crypto returns 6) sleeping on 0xfffff80003acca70 "crypto_ret_wait" chain 86: thread 100084 (pid 8, crypto returns 5) sleeping on 0xfffff80003acca10 "crypto_ret_wait" chain 87: thread 100083 (pid 7, crypto returns 4) sleeping on 0xfffff80003acc9b0 "crypto_ret_wait" chain 88: thread 100082 (pid 6, crypto returns 3) sleeping on 0xfffff80003acc950 "crypto_ret_wait" chain 89: thread 100081 (pid 5, crypto returns 2) sleeping on 0xfffff80003acc8f0 "crypto_ret_wait" chain 90: thread 100080 (pid 4, crypto returns 1) sleeping on 0xfffff80003acc890 "crypto_ret_wait" chain 91: thread 100079 (pid 3, crypto returns 0) sleeping on 0xfffff80003acc830 "crypto_ret_wait" chain 92: thread 100078 (pid 2, crypto) sleeping on 0xffffffff81d6db78 "crypto_wait" chain 93: thread 100065 (pid 14, sequencer 00) sleeping on 0xfffff80003a35888 "seqstate" chain 94: thread 100062 (pid 13, g_event) sleeping on 0xffffffff81d9e0c8 "-" chain 95: thread 100063 (pid 13, g_up) sleeping on 0xffffffff81d9e0d8 "-" chain 96: thread 100064 (pid 13, g_down) sleeping on 0xffffffff81d9e0d0 "-" chain 97: thread 100002 (pid 1, init) sleeping on 0xfffff80003896000 "wait" chain 98: thread 100001 (pid 10, audit) sleeping on 0xffffffff81de5cf0 "audit_worker_cv" chain 99: thread 100000 (pid 0, swapper) sleeping on 0xffffffff81d8d688 "swapin" chain 100: thread 100015 (pid 0, aiod_kick taskq) sleeping on 0xfffff8000377f100 "-" chain 101: thread 100018 (pid 0, thread taskq) sleeping on 0xfffff8000377ea00 "-" chain 102: thread 100020 (pid 0, config_0) sleeping on 0xfffff80003777000 "-" chain 103: thread 100021 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff8000377e500 "-" chain 104: thread 100022 (pid 0, if_io_tqg_0) sleeping on 0xfffff80003776e00 "-" chain 105: thread 100023 (pid 0, if_io_tqg_1) sleeping on 0xfffff80003776d00 "-" chain 106: thread 100024 (pid 0, if_io_tqg_2) sleeping on 0xfffff80003776c00 "-" chain 107: thread 100025 (pid 0, if_io_tqg_3) sleeping on 0xfffff80003776b00 "-" chain 108: thread 100026 (pid 0, if_io_tqg_4) sleeping on 0xfffff80003776a00 "-" chain 109: thread 100027 (pid 0, if_io_tqg_5) sleeping on 0xfffff80003776900 "-" chain 110: thread 100028 (pid 0, if_io_tqg_6) sleeping on 0xfffff80003776800 "-" chain 111: thread 100029 (pid 0, if_io_tqg_7) sleeping on 0xfffff80003776700 "-" chain 112: thread 100030 (pid 0, if_io_tqg_8) sleeping on 0xfffff80003776600 "-" chain 113: thread 100031 (pid 0, if_io_tqg_9) sleeping on 0xfffff80003776500 "-" chain 114: thread 100032 (pid 0, if_io_tqg_10) sleeping on 0xfffff80003776400 "-" chain 115: thread 100033 (pid 0, if_io_tqg_11) sleeping on 0xfffff80003776300 "-" chain 116: thread 100034 (pid 0, if_config_tqg_0) sleeping on 0xfffff80003776200 "-" chain 117: thread 100035 (pid 0, softirq_0) sleeping on 0xfffff80003776100 "-" chain 118: thread 100036 (pid 0, softirq_1) sleeping on 0xfffff80003776000 "-" chain 119: thread 100037 (pid 0, softirq_2) sleeping on 0xfffff80003775e00 "-" chain 120: thread 100038 (pid 0, softirq_3) sleeping on 0xfffff80003775d00 "-" chain 121: thread 100039 (pid 0, softirq_4) sleeping on 0xfffff80003775c00 "-" chain 122: thread 100040 (pid 0, softirq_5) sleeping on 0xfffff80003775b00 "-" chain 123: thread 100041 (pid 0, softirq_6) sleeping on 0xfffff80003775a00 "-" chain 124: thread 100042 (pid 0, softirq_7) sleeping on 0xfffff80003775900 "-" chain 125: thread 100043 (pid 0, softirq_8) sleeping on 0xfffff80003775800 "-" chain 126: thread 100044 (pid 0, softirq_9) sleeping on 0xfffff80003775700 "-" chain 127: thread 100045 (pid 0, softirq_10) sleeping on 0xfffff80003775600 "-" chain 128: thread 100046 (pid 0, softirq_11) sleeping on 0xfffff80003775500 "-" chain 129: thread 100061 (pid 0, firmware taskq) sleeping on 0xfffff800039d4400 "-" chain 130: thread 100066 (pid 0, crypto_0) sleeping on 0xfffff800039d3d00 "-" chain 131: thread 100067 (pid 0, crypto_1) sleeping on 0xfffff800039d3d00 "-" chain 132: thread 100068 (pid 0, crypto_2) sleeping on 0xfffff800039d3d00 "-" chain 133: thread 100069 (pid 0, crypto_3) sleeping on 0xfffff800039d3d00 "-" chain 134: thread 100070 (pid 0, crypto_4) sleeping on 0xfffff800039d3d00 "-" chain 135: thread 100071 (pid 0, crypto_5) sleeping on 0xfffff800039d3d00 "-" chain 136: thread 100072 (pid 0, crypto_6) sleeping on 0xfffff800039d3d00 "-" chain 137: thread 100073 (pid 0, crypto_7) sleeping on 0xfffff800039d3d00 "-" chain 138: thread 100074 (pid 0, crypto_8) sleeping on 0xfffff800039d3d00 "-" chain 139: thread 100075 (pid 0, crypto_9) sleeping on 0xfffff800039d3d00 "-" chain 140: thread 100076 (pid 0, crypto_10) sleeping on 0xfffff800039d3d00 "-" chain 141: thread 100077 (pid 0, crypto_11) sleeping on 0xfffff800039d3d00 "-" chain 142: thread 100114 (pid 0, mca taskq) sleeping on 0xfffff80003780300 "-" chain 143: thread 100120 (pid 0, acpi_task_0) sleeping on 0xfffff80021031700 "-" chain 144: thread 100121 (pid 0, acpi_task_1) sleeping on 0xfffff80021031700 "-" chain 145: thread 100122 (pid 0, acpi_task_2) sleeping on 0xfffff80021031700 "-" chain 146: thread 100124 (pid 0, CAM taskq) sleeping on 0xfffff800039d2100 "-" db> (kgdb) bt #0 doadump (textdump=0x0) at include/pcpu_aux.h:55 #1 0xffffffff8049bb3a in db_dump (dummy=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:575 #2 0xffffffff8049b8fc in db_command (cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:482 #3 0xffffffff804a08c8 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #4 0xffffffff8049b8fc in db_command (cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:482 #5 0xffffffff804a08c8 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #6 0xffffffff8049b8fc in db_command (cmd_table=, dopager=0x1) at ../../../ddb/db_command.c:482 #7 0xffffffff8049b66d in db_command_loop () at ../../../ddb/db_command.c:535 #8 0xffffffff8049e898 in db_trap (type=, code=) at ../../../ddb/db_main.c:252 #9 0xffffffff80c14df7 in kdb_trap (type=0x3, code=0x0, tf=) at ../../../kern/subr_kdb.c:689 #10 0xffffffff81073aee in trap (frame=0xfffffe00e68bd550) at ../../../amd64/amd64/trap.c:579 #11 0xffffffff81049b2c in calltrap () at ../../../amd64/amd64/exception.S:289 #12 0xffffffff80c14557 in kdb_enter (why=0xffffffff81203cba "panic", msg=) at include/cpufunc.h:65 #13 0xffffffff80bca111 in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:899 #14 0xffffffff80bc9ea3 in panic (fmt=) at ../../../kern/kern_shutdown.c:836 #15 0xffffffff80f05193 in swap_pager_getpages_locked (object=0xfffff801dc74f630, ma=0xfffffe00e68bd870, count=0x1, rbehind=0x0, rahead=0xfffffe00e68bd7cc) at ../../../vm/swap_pager.c:1203 #16 0xffffffff80f06942 in swap_pager_swapoff_object (sp=0xfffff8002104f000, object=0xfffff801dc74f630) at ../../../vm/swap_pager.c:1796 #17 0xffffffff80f06308 in swap_pager_swapoff (sp=0xfffff8002104f000) at ../../../vm/swap_pager.c:1861 #18 0xffffffff80f03d3a in swapoff_one (sp=0xfffff8002104f000, cred=0xfffff80021b2c400) at ../../../vm/swap_pager.c:2484 #19 0xffffffff80f03bb5 in sys_swapoff (td=0xfffffe00e4206700, uap=0xfffffe00e4206ad0) at ../../../vm/swap_pager.c:2439 #20 0xffffffff81074afe in amd64_syscall (td=0xfffffe00e4206700, traced=) at subr_syscall.c:151 #21 0xffffffff8104a460 in fast_syscall_common () at ../../../amd64/amd64/exception.S:584 #22 0x00000008002f688a in ?? () Previous frame inner to this frame (corrupt stack?) Current language: auto; currently minimal (kgdb) f 15 #15 0xffffffff80f05193 in swap_pager_getpages_locked (object=0xfffff801dc74f630, ma=0xfffffe00e68bd870, count=0x1, rbehind=0x0, rahead=0xfffffe00e68bd7cc) at ../../../vm/swap_pager.c:1203 1203 KASSERT(object->type == OBJT_SWAP, (kgdb) l 1198 int i, maxahead, maxbehind, reqcount; 1199 1200 VM_OBJECT_ASSERT_WLOCKED(object); 1201 reqcount = count; 1202 1203 KASSERT(object->type == OBJT_SWAP, 1204 ("%s: object not swappable", __func__)); 1205 if (!swap_pager_haspage(object, ma[0]->pindex, &maxbehind, &maxahead)) { 1206 VM_OBJECT_WUNLOCK(object); 1207 return (VM_PAGER_FAIL); (kgdb) info loc bp = (struct buf *) 0xfffff801dc74f648 bm = 0x1000000000 mpred = 0xfffff801dc74f688 msucc = 0x102000200000010 p = 0x0 pindex = 0xfffffe00e4206770 blk = 0xffffffff81c7c0a8 i = 0x0 maxahead = 0x80000000 maxbehind = 0xffffffff reqcount = 0x1 (kgdb) p *object $1 = {lock = {lock_object = {lo_name = 0xffffffff8115e8e9 "vm object", lo_flags = 0x25630000, lo_data = 0x0, lo_witness = 0xfffff8087fd75800}, rw_lock = 0xfffffe00e4206700}, object_list = {tqe_next = 0xfffff801dc74f738, tqe_prev = 0xfffff801dc74f548}, shadow_head = { lh_first = 0x0}, shadow_list = {le_next = 0xfffff80576937630, le_prev = 0xfffff80564615870}, memq = {tqh_first = 0xfffffe0000a9f838, tqh_last = 0xfffffe0000a9f848}, rtree = {rt_root = 0xfffffe0000a9f839}, size = 0x8bf370, domain = {dr_policy = 0x0, dr_iter = 0x0}, generation = 0x1, cleangeneration = 0x1, ref_count = 0x0, shadow_count = 0x0, memattr = 0x6, type = 0x5, flags = 0x3018, pg_color = 0x800, paging_in_progress = 0x1, busy = 0x0, resident_page_count = 0x1, backing_object = 0x0, backing_object_offset = 0x0, pager_object_list = { tqe_next = 0x0, tqe_prev = 0x0}, rvq = {lh_first = 0xfffff808485602a0}, handle = 0x0, un_pager = {vnp = {vnp_size = 0x0, writemappings = 0x0}, devp = {devp_pglist = {tqh_first = 0x0, tqh_last = 0x0}, ops = 0x0, dev = 0x0}, sgp = {sgp_pglist = {tqh_first = 0x0, tqh_last = 0x0}}, swp = {swp_tmpfs = 0x0, swp_blks = {pt_root = 0x0}, writemappings = 0x0}}, cred = 0x0, charge = 0x0, umtx_data = 0x0} (kgdb) Index: src/sys/vm/swap_pager.c =================================================================== --- src/sys/vm/swap_pager.c (revision 357853) +++ src/sys/vm/swap_pager.c (working copy) @@ -1188,8 +1188,8 @@ swap_pager_unswapped(vm_page_t m) * The pages in "ma" must be busied and will remain busied upon return. */ static int -swap_pager_getpages(vm_object_t object, vm_page_t *ma, int count, int *rbehind, - int *rahead) +swap_pager_getpages_locked(vm_object_t object, vm_page_t *ma, int count, + int *rbehind, int *rahead) { struct buf *bp; vm_page_t bm, mpred, msucc, p; @@ -1197,7 +1197,7 @@ static int daddr_t blk; int i, maxahead, maxbehind, reqcount; - VM_OBJECT_WLOCK(object); + VM_OBJECT_ASSERT_WLOCKED(object); reqcount = count; KASSERT(object->type == OBJT_SWAP, @@ -1352,6 +1352,15 @@ static int */ } +static int +swap_pager_getpages(vm_object_t object, vm_page_t *ma, int count, + int *rbehind, int *rahead) +{ + + VM_OBJECT_WLOCK(object); + return (swap_pager_getpages_locked(object, ma, count, rbehind, rahead)); +} + /* * swap_pager_getpages_async(): * @@ -1444,18 +1453,6 @@ swap_pager_putpages(vm_object_t object, vm_page_t /* Maximum I/O size is limited by maximum swap block size. */ n = min(count - i, nsw_cluster_max); - /* Get a block of swap of size up to size n. */ - blk = swp_pager_getswapspace(&n, 4); - if (blk == SWAPBLK_NONE) { - for (j = 0; j < n; ++j) - rtvals[i + j] = VM_PAGER_FAIL; - continue; - } - - /* - * All I/O parameters have been satisfied. Build the I/O - * request and assign the swap space. - */ if (async) { mtx_lock(&swbuf_mtx); while (nsw_wcount_async == 0) @@ -1464,6 +1461,7 @@ swap_pager_putpages(vm_object_t object, vm_page_t nsw_wcount_async--; mtx_unlock(&swbuf_mtx); } + bp = uma_zalloc(swwbuf_zone, M_WAITOK); if (async) bp->b_flags = B_ASYNC; @@ -1470,13 +1468,19 @@ swap_pager_putpages(vm_object_t object, vm_page_t bp->b_flags |= B_PAGING; bp->b_iocmd = BIO_WRITE; - bp->b_rcred = crhold(thread0.td_ucred); - bp->b_wcred = crhold(thread0.td_ucred); - bp->b_bcount = PAGE_SIZE * n; - bp->b_bufsize = PAGE_SIZE * n; - bp->b_blkno = blk; - + /* Get a block of swap of size up to size n. */ VM_OBJECT_WLOCK(object); + blk = swp_pager_getswapspace(&n, 4); + if (blk == SWAPBLK_NONE) { + VM_OBJECT_WUNLOCK(object); + for (j = 0; j < n; ++j) + rtvals[i + j] = VM_PAGER_FAIL; + mtx_lock(&swbuf_mtx); + nsw_wcount_async++; + mtx_unlock(&swbuf_mtx); + uma_zfree(swwbuf_zone, bp); + continue; + } for (j = 0; j < n; ++j) { mreq = ma[i + j]; vm_page_aflag_clear(mreq, PGA_SWAP_FREE); @@ -1490,7 +1494,14 @@ swap_pager_putpages(vm_object_t object, vm_page_t bp->b_pages[j] = mreq; } VM_OBJECT_WUNLOCK(object); + + bp->b_rcred = crhold(thread0.td_ucred); + bp->b_wcred = crhold(thread0.td_ucred); + bp->b_bcount = PAGE_SIZE * n; + bp->b_bufsize = PAGE_SIZE * n; + bp->b_blkno = blk; bp->b_npages = n; + /* * Must set dirty range for NFS to work. */ @@ -1712,72 +1723,12 @@ swp_pager_force_dirty(vm_page_t m) { vm_page_dirty(m); -#ifdef INVARIANTS - if (!vm_page_wired(m) && m->a.queue == PQ_NONE) - panic("page %p is neither wired nor queued", m); -#endif vm_page_xunbusy(m); swap_pager_unswapped(m); -} - -static void -swp_pager_force_launder(vm_page_t m) -{ - - vm_page_dirty(m); vm_page_launder(m); - vm_page_xunbusy(m); - swap_pager_unswapped(m); } /* - * SWP_PAGER_FORCE_PAGEIN() - force swap blocks to be paged in - * - * This routine dissociates pages starting at the given index within an - * object from their backing store, paging them in if they do not reside - * in memory. Pages that are paged in are marked dirty and placed in the - * laundry queue. Pages are marked dirty because they no longer have - * backing store. They are placed in the laundry queue because they have - * not been accessed recently. Otherwise, they would already reside in - * memory. - */ -static void -swp_pager_force_pagein(vm_object_t object, vm_pindex_t pindex, int npages) -{ - vm_page_t ma[npages]; - int i, j; - - KASSERT(npages > 0, ("%s: No pages", __func__)); - KASSERT(npages <= MAXPHYS / PAGE_SIZE, - ("%s: Too many pages: %d", __func__, npages)); - KASSERT(object->type == OBJT_SWAP, - ("%s: Object not swappable", __func__)); - vm_object_pip_add(object, npages); - vm_page_grab_pages(object, pindex, VM_ALLOC_NORMAL, ma, npages); - for (i = j = 0;; i++) { - /* Count nonresident pages, to page-in all at once. */ - if (i < npages && ma[i]->valid != VM_PAGE_BITS_ALL) - continue; - if (j < i) { - VM_OBJECT_WUNLOCK(object); - /* Page-in nonresident pages. Mark for laundering. */ - if (swap_pager_getpages(object, &ma[j], i - j, NULL, - NULL) != VM_PAGER_OK) - panic("%s: read from swap failed", __func__); - VM_OBJECT_WLOCK(object); - do { - swp_pager_force_launder(ma[j]); - } while (++j < i); - } - if (i == npages) - break; - /* Mark dirty a resident page. */ - swp_pager_force_dirty(ma[j++]); - } - vm_object_pip_wakeupn(object, npages); -} - -/* * swap_pager_swapoff_object: * * Page in all of the pages that have been paged out for an object @@ -1787,62 +1738,80 @@ static void swap_pager_swapoff_object(struct swdevt *sp, vm_object_t object) { struct swblk *sb; - vm_pindex_t pi, s_pindex; - daddr_t blk, n_blks, s_blk; - int i; + vm_page_t m, ma[SWAP_META_PAGES]; + vm_pindex_t pi; + daddr_t blk; + int i, j, npages, nv, rahead, rv; KASSERT(object->type == OBJT_SWAP, ("%s: Object not swappable", __func__)); - n_blks = 0; + for (pi = 0; (sb = SWAP_PCTRIE_LOOKUP_GE( &object->un_pager.swp.swp_blks, pi)) != NULL; ) { + if ((object->flags & OBJ_DEAD) != 0) { + swp_pager_meta_free_all(object); + break; + } for (i = 0; i < SWAP_META_PAGES; i++) { - blk = sb->d[i]; - if (!swp_pager_isondev(blk, sp)) - blk = SWAPBLK_NONE; - /* - * If there are no blocks/pages accumulated, start a new - * accumulation here. + * Count the number of contiguous valid blocks. */ - if (n_blks == 0) { - if (blk != SWAPBLK_NONE) { - s_blk = blk; - s_pindex = sb->p + i; - n_blks = 1; - } + for (nv = 0; nv < SWAP_META_PAGES - i; nv++) { + blk = sb->d[i + nv]; + if (!swp_pager_isondev(blk, sp) || + blk == SWAPBLK_NONE) + break; + } + if (nv == 0) continue; - } /* - * If the accumulation can be extended without breaking - * the sequence of consecutive blocks and pages that - * swp_pager_force_pagein() depends on, do so. + * Grab the page for the first valid block. If the page + * is valid, mark it dirty and free its swap block. Try + * to batch this operation since it may cause sp to be + * freed, meaning that we must restart the scan. + * Invalid pages will be revisited in future iterations. */ - if (n_blks < MAXPHYS / PAGE_SIZE && - s_blk + n_blks == blk && - s_pindex + n_blks == sb->p + i) { - ++n_blks; - continue; + m = vm_page_grab(object, sb->p + i, VM_ALLOC_NORMAL | + VM_ALLOC_WAITFAIL); + if (m == NULL) + break; + if (vm_page_all_valid(m)) { + npages = vm_page_grab_pages(object, + m->pindex + 1, + VM_ALLOC_NOCREAT | VM_ALLOC_NOWAIT, ma, + nv - 1); + swp_pager_force_dirty(m); + for (j = 0; j < npages; j++) { + if (vm_page_all_valid(ma[j])) + swp_pager_force_dirty(ma[j]); + else + vm_page_xunbusy(ma[j]); + } + break; } + vm_object_pip_add(object, 1); + rahead = SWAP_META_PAGES; + rv = swap_pager_getpages_locked(object, &m, 1, NULL, + &rahead); + if (rv != VM_PAGER_OK) + panic("%s: read from swap failed: %d", + __func__, rv); + vm_object_pip_wakeupn(object, 1); + VM_OBJECT_WLOCK(object); + vm_page_xunbusy(m); + /* - * The sequence of consecutive blocks and pages cannot - * be extended, so page them all in here. Then, - * because doing so involves releasing and reacquiring - * a lock that protects the swap block pctrie, do not - * rely on the current swap block. Break this loop and - * re-fetch the same pindex from the pctrie again. + * The object lock was dropped so we must restart the + * scan of this swap block. Pages paged in during this + * iteration will be marked dirty in a future iteration. */ - swp_pager_force_pagein(object, s_pindex, n_blks); - n_blks = 0; break; } if (i == SWAP_META_PAGES) pi = sb->p + SWAP_META_PAGES; } - if (n_blks > 0) - swp_pager_force_pagein(object, s_pindex, n_blks); } /* @@ -2078,7 +2047,7 @@ allocated: * Free the swblk if we end up with the empty page run. */ if (swapblk == SWAPBLK_NONE) - swp_pager_free_empty_swblk(object, sb); + swp_pager_free_empty_swblk(object, sb); return (prev_swapblk); } @@ -2350,7 +2319,7 @@ swaponsomething(struct vnode *vp, void *id, u_long sw_strategy_t *strategy, sw_close_t *close, dev_t dev, int flags) { struct swdevt *sp, *tsp; - swblk_t dvbase; + daddr_t dvbase; u_long mblocks; /* Index: src/sys/vm/swap_pager.h =================================================================== --- src/sys/vm/swap_pager.h (revision 357853) +++ src/sys/vm/swap_pager.h (working copy) @@ -38,14 +38,9 @@ */ #ifndef _VM_SWAP_PAGER_H_ -#define _VM_SWAP_PAGER_H_ 1 +#define _VM_SWAP_PAGER_H_ -typedef int32_t swblk_t; /* - * swap offset. This is the type used to - * address the "virtual swap device" and - * therefore the maximum swap space is - * 2^32 pages. - */ +#include struct buf; struct swdevt; @@ -62,8 +57,8 @@ struct swdevt { dev_t sw_dev; struct vnode *sw_vp; void *sw_id; - swblk_t sw_first; - swblk_t sw_end; + __daddr_t sw_first; + __daddr_t sw_end; struct blist *sw_blist; TAILQ_ENTRY(swdevt) sw_list; sw_strategy_t *sw_strategy; -- Test scenario: misc/swapoff3.sh