KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2019 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #0 r348197M: Thu May 23 22:26:32 CEST 2019 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 FreeBSD clang version 8.0.0 (tags/RELEASE_800/final 356365) (based on LLVM 8.0.0) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Entering uma_startup with 9 boot pages configured startup_alloc from "UMA Kegs", 8 boot pages left startup_alloc from "UMA Zones", 7 boot pages left startup_alloc from "UMA Hash", 6 boot pages left startup_alloc from "vmem btag", 5 boot pages left startup_alloc from "UMA Zones", 4 boot pages left startup_alloc from "MAP", 3 boot pages left startup_alloc from "KMAP ENTRY", 2 boot pages left startup_alloc from "vmem", 1 boot pages left Entering uma_startup2 with 0 boot pages left VT(vga): resolution 640x480 CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin="AuthenticAMD" Id=0x100f23 Family=0x10 Model=0x2 Stepping=3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff SVM: NP,NAsids=64 TSC: P-state invariant real memory = 8589934592 (8192 MB) avail memory = 3516751872 (3353 MB) Event timer "LAPIC" quality 100 ACPI APIC Table: <060508 APIC1048> FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs FreeBSD/SMP: 1 package(s) x 4 core(s) random: unblocking device. ioapic0 irqs 0-23 on motherboard Launching APs: 2 3 1 Timecounter "TSC" frequency 1800019223 Hz quality 800 random: entropy device external interface [ath_hal] loaded kbd1 at kbdmux0 module_register_init: MOD_LOAD (vesa, 0x148d170, 0) error 19 nexus0 vtvga0: on motherboard cryptosoft0: on motherboard acpi0: <060508 RSDT1048> on motherboard acpi0: Power Button (fixed) cpu0: on acpi0 attimer0: port 0x40-0x43 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 atrtc0: port 0x70-0x71 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 Timecounter "ACPI-safe" frequency 3579545 Hz quality 850 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib1: at device 1.0 on pci0 pci1: on pcib1 vgapci0: port 0xc000-0xc0ff mem 0xf0000000-0xf7ffffff,0xfe9f0000-0xfe9fffff,0xfe800000-0xfe8fffff irq 18 at device 5.0 on pci1 vgapci0: Boot video device hdac0: mem 0xfe9e8000-0xfe9ebfff irq 19 at device 5.2 on pci1 pcib2: at device 7.0 on pci0 pci2: on pcib2 re0: port 0xd800-0xd8ff mem 0xfeaff000-0xfeafffff irq 19 at device 0.0 on pci2 re0: Using 1 MSI message re0: Chip rev. 0x38000000 re0: MAC rev. 0x00000000 miibus0: on re0 rgephy0: PHY 1 on miibus0 rgephy0: none, 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, 100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flow re0: Using defaults for TSO: 65518/35/2048 re0: Ethernet address: 00:21:85:15:33:7d ahci0: port 0xb000-0xb007,0xa000-0xa003,0x9000-0x9007,0x8000-0x8003,0x7000-0x700f mem 0xfe7ff800-0xfe7ffbff irq 22 at device 18.0 on pci0 ahci0: AHCI v1.10 with 4 3Gbps ports, Port Multiplier supported ahci0: quirks=0x7000 ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ohci0: mem 0xfe7fe000-0xfe7fefff irq 16 at device 19.0 on pci0 usbus0 on ohci0 usbus0: 12Mbps Full Speed USB v1.0 ohci1: mem 0xfe7fd000-0xfe7fdfff irq 17 at device 19.1 on pci0 usbus1 on ohci1 usbus1: 12Mbps Full Speed USB v1.0 ohci2: mem 0xfe7fc000-0xfe7fcfff irq 18 at device 19.2 on pci0 usbus2 on ohci2 usbus2: 12Mbps Full Speed USB v1.0 ohci3: mem 0xfe7fb000-0xfe7fbfff irq 17 at device 19.3 on pci0 usbus3 on ohci3 usbus3: 12Mbps Full Speed USB v1.0 ohci4: mem 0xfe7fa000-0xfe7fafff irq 18 at device 19.4 on pci0 usbus4 on ohci4 usbus4: 12Mbps Full Speed USB v1.0 ehci0: mem 0xfe7ff000-0xfe7ff0ff irq 19 at device 19.5 on pci0 ehci0: AMD SB600/700 quirk applied usbus5: EHCI version 1.0 usbus5 on ehci0 usbus5: 480Mbps High Speed USB v2.0 atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xff00-0xff0f at device 20.1 on pci0 ata0: at channel 0 on atapci0 hdac1: mem 0xfe7f4000-0xfe7f7fff irq 16 at device 20.2 on pci0 isab0: at device 20.3 on pci0 isa0: on isab0 pcib3: at device 20.4 on pci0 pci3: on pcib3 pci3: at device 6.0 (no driver attached) acpi_button0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart0: console (115200,n,8,1) fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 atkbdc0: at port 0x60,0x64 on isa0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] ppc0: parallel port not found. hwpstate0: on cpu0 NULL mp in getnewvnode(9), tag crossmp Timecounters tick every 1.000 msec hdacc0: at cad 0 on hdac0 hdaa0: at nid 1 on hdacc0 pcm0: at nid 3 on hdaa0 hdacc1: at cad 3 on hdac1 hdaa1: at nid 1 on hdacc1 pcm1: at nid 20,22,21,23 and 24,26 on hdaa1 pcm2: at nid 27 and 25 on hdaa1 pcm3: at nid 30 on hdaa1 ugen0.1: at usbus0 ugen5.1: at usbus5 uhub0: on usbus0 ugen4.1: at usbus4 ugen3.1: at usbus3 uhub1: on usbus5 uhub2: on usbus4 ugen1.1: at usbus1 uhub3: on usbus3 Expensive timeout(9) function: 0xa39cc0(0x17b1d000) 0.009659886 s uhub4: on usbus1 (aprobe0:ahcich0:0:15:0): NOP FLUSHQUEUE. ACB: 00 00 00 00 00 00 00 00 00 00 00 00 ugen2.1: at usbus2 (aprobe0:ahcich0:0:15:0): CAM status: Command timeout uhub5: on usbus2 (aprobe0:ahcich0:0:15:0): Error 5, Retries exhausted ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 ada0: ATA8-ACS SATA 2.x device ada0: Serial Number 9VMJ99G5 ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 476940MB (976773168 512 byte sectors) cd0 at ata0 bus 0 scbus4 target 1 lun 0 cd0: <_NEC DVD_RW ND-4550A 1.06> Removable CD-ROM SCSI device cd0: 33.300MB/s transfers (UDMA2, ATAPI 12bytes, PIO 65534bytes) cd0: Attempt to query device size failed: NOT READY, Medium not present Trying to mount root from ufs:/dev/ada0s1a [rw]... WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. uhub0: 2 ports with 2 removable, self powered uhub2: 2 ports with 2 removable, self powered uhub3: 2 ports with 2 removable, self powered uhub4: 2 ports with 2 removable, self powered uhub5: 2 ports with 2 removable, self powered Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Deprecated code (to be removed in FreeBSD 14): FreeBSD 12.x ABI compat Deprecated code (to be removed in FreeBSD 14): FreeBSD 12.x ABI compat warning: total configured swap (4194304 pages) exceeds maximum recommended amount (2009920 pages). warning: increase kern.maxswzone or reduce amount of swap. Starting file system checks: /dev/ada0s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1a: clean, 614026 free (2634 frags, 76424 blocks, 0.3% fragmentation) /dev/ada0s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1f: clean, 774652 free (11004 frags, 95456 blocks, 1.1% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 28206150 free (36894 frags, 3521157 blocks, 0.0% fragmentation) /dev/ada0s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1d: clean, 756395 free (277227 frags, 59896 blocks, 2.7% fragmentation) /dev/ada0s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1e: clean, 2973390 free (168326 frags, 350633 blocks, 0.7% fragmentation) Mounting local filesystems:. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/arduino/lib /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/e2fsprogs /usr/local/lib/gcc7 /usr/local/lib/gcc8 /usr/local/lib/mysql /usr/local/lib/nss /usr/local/lib/perl5/5.28/mach/CORE /usr/local/lib/pth /usr/local/lib/qt4 /usr/local/lib/qt5 /usr/local/llvm37/lib /usr/local/llvm39/lib a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Setting hostname: x4.osted.lan. Setting up harvesting: [UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: uhub1: 10 ports with 10 removable, self powered . lo0: link state changed to UP re0: link state changed to DOWN Starting Network: lo0 re0. lo0: flags=8049 metric 0 mtu 16384 options=680003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 inet 127.0.0.1 netmask 0xff000000 groups: lo nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 media: Ethernet autoselect (none) status: no carrier nd6 options=29 Starting devd. add host 127.0.0.1: gateway lo0 fib 0: route already in table add net default: gateway 192.168.1.1 add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Starting rpcbind. NFS access cache time=60 Starting watchdogd. No core dumps found. lock order reversal: 1st 0x9660c94 bufwait (bufwait) @ kern/vfs_bio.c:3904 2nd 0x21d07800 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:289 stack backtrace: #0 0x101e0f1 at witness_debugger+0x61 #1 0x101dec9 at witness_checkorder+0x8a9 #2 0xfc7e4d at _sx_xlock+0x4d #3 0x128f865 at ufsdirhash_add+0x45 #4 0x12920de at ufs_direnter+0x3fe #5 0x1299b8c at ufs_mkdir+0x78c #6 0x154b06d at VOP_MKDIR_APV+0x6d #7 0x1088783 at kern_mkdirat+0x173 #8 0x1088609 at sys_mkdir+0x19 #9 0x151b6a9 at syscall+0x2d9 #10 0xffc033b7 at _end+0xfdc6853f Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Starting statd. Starting lockd. Recovering vi editor sessions:. Updating motd:. Mounting late filesystems:. Starting ntpd. Starting powerd. Starting smartd. May 23 22:41:59 x4 smartd[624]: Device: /dev/ada0, WARNING: A firmware update for this drive may be available, May 23 22:41:59 x4 smartd[624]: see the following Seagate web pages: May 23 22:41:59 x4 smartd[624]: http://knowledge.seagate.com/articles/en_US/FAQ/207931en May 23 22:41:59 x4 smartd[624]: http://knowledge.seagate.com/articles/en_US/FAQ/213891en Configuring vt: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting sendmail_submit. Starting sendmail_msp_queue. Starting cron. Local package initialization: backup. Starting nfscbd. Starting default mousedmoused: unable to open /dev/psm0: No such file or directory . Starting inetd. Thu May 23 22:42 FreeBSD/i386 (x4.osted.lan) (ttyu0) login: May 23 22:49:10 x4 su[904]: pho to root on /dev/pts/0 20190523 22:49:35 all (1/2): su.sh witness_lock_list_get: witness exhausted 20190523 22:55:10 all (2/2): callout_reset_on.sh Expensive timeout(9) function: 0x10025e0(0) 0.010312444 s Expensive timeout(9) function: 0xfd4990(0x2c56d000) 0.010617781 s freework leak: 1/8. 20190523 23:00:41 all (1/2): su.sh 20190523 23:05:58 all (2/2): callout_reset_on.sh 20190523 23:11:29 all (1/2): su.sh 20190523 23:17:07 all (2/2): callout_reset_on.sh Expensive timeout(9) function: 0x11aba90(0x184279b0) 0.022761411 s Expensive timeout(9) function: 0x142e030(0x1f455e4) 0.027340902 s 20190523 23:20:43 all (1/2): su.sh Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. 20190523 23:26:04 all (2/2): callout_reset_on.sh 20190523 23:30:22 all (1/2): su.sh Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. swap_pager: indefinite wait buffer: bufobj: 0, blkno: 403483, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 456256, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 400590, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 456312, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 394889, size: 16384 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 456120, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 401494, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 390688, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 401578, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 456121, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 456308, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 388612, size: 4096 20190523 23:36:08 all (2/2): callout_reset_on.sh 20190523 23:41:06 all (1/2): su.sh 20190523 23:46:29 all (2/2): callout_reset_on.sh 20190523 23:49:54 all (1/2): su.sh 20190523 23:55:41 all (2/2): callout_reset_on.sh 20190523 23:59:41 all (1/2): su.sh Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. 20190524 00:05:02 all (2/2): callout_reset_on.sh 20190524 00:11:05 all (1/2): su.sh Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. 20190524 00:16:29 all (2/2): callout_reset_on.sh 20190524 00:19:48 all (1/2): su.sh Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. 20190524 00:25:08 all (2/2): callout_reset_on.sh 20190524 00:30:20 all (1/2): su.sh Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. 20190524 00:35:49 all (2/2): callout_reset_on.sh 20190524 00:41:03 all (1/2): su.sh Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. 20190524 00:47:30 all (2/2): callout_reset_on.sh 20190524 00:51:38 all (1/2): su.sh Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. 20190524 00:57:12 all (2/2): callout_reset_on.sh 20190524 01:01:38 all (1/2): su.sh Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. 20190524 01:07:03 all (2/2): callout_reset_on.sh 20190524 01:12:25 all (1/2): su.sh Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. swap_pager: indefinite wait buffer: bufobj: 0, blkno: 866128, size: 16384 Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. May 24 01:16:23 x4 kernel: pid 50433 (swap), jid 0, uid 0, was killed: out of swap space May 24 01:16:25 x4 kernel: pid 50432 (swap), jid 0, uid 0, was killed: out of swap space 20190524 01:17:35 all (2/2): callout_reset_on.sh 20190524 01:21:34 all (1/2): su.sh Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. 20190524 01:27:38 all (2/2): callout_reset_on.sh 20190524 01:34:14 all (1/2): su.sh 20190524 01:40:29 all (2/2): callout_reset_on.sh 20190524 01:45:51 all (1/2): su.sh Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. 20190524 01:51:41 all (2/2): callout_reset_on.sh 20190524 01:56:07 all (1/2): su.sh Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. swap_pager: indefinite wait buffer: bufobj: 0, blkno: 1443878, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 1452976, size: 4096 Expensive timeout(9) function: 0x103d4f0(0) 0.573222585 s Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. 20190524 02:02:24 all (2/2): callout_reset_on.sh 20190524 02:07:02 all (1/2): su.sh 20190524 02:12:34 all (2/2): callout_reset_on.sh 20190524 02:15:43 all (1/2): su.sh Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. 20190524 02:21:11 all (2/2): callout_reset_on.sh 20190524 02:25:56 all (1/2): su.sh Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. 20190524 02:31:24 all (2/2): callout_reset_on.sh 20190524 02:34:56 all (1/2): su.sh 20190524 02:40:47 all (2/2): callout_reset_on.sh 20190524 02:46:33 all (1/2): su.sh Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. 20190524 02:52:04 all (2/2): callout_reset_on.sh 20190524 02:57:12 all (1/2): su.sh Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. 20190524 03:03:14 all (2/2): callout_reset_on.sh 20190524 03:07:35 all (1/2): su.sh Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. 20190524 03:13:05 all (2/2): callout_reset_on.sh 20190524 03:19:29 all (1/2): su.sh 20190524 03:24:53 all (2/2): callout_reset_on.sh 20190524 03:30:32 all (1/2): su.sh 20190524 03:35:55 all (2/2): callout_reset_on.sh 20190524 03:41:31 all (1/2): su.sh Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. 20190524 03:47:31 all (2/2): callout_reset_on.sh 20190524 03:53:51 all (1/2): su.sh 20190524 03:59:08 all (2/2): callout_reset_on.sh 20190524 04:04:54 all (1/2): su.sh Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. 20190524 04:10:19 all (2/2): callout_reset_on.sh 20190524 04:15:16 all (1/2): su.sh 20190524 04:21:21 all (2/2): callout_reset_on.sh 20190524 04:28:32 all (1/2): su.sh 20190524 04:33:54 all (2/2): callout_reset_on.sh 20190524 04:39:55 all (1/2): su.sh Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. 20190524 04:45:41 all (2/2): callout_reset_on.sh 20190524 04:50:42 all (1/2): su.sh Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. 20190524 04:59:00 all (2/2): callout_reset_on.sh 20190524 05:03:48 all (1/2): su.sh Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. 20190524 05:09:05 all (2/2): callout_reset_on.sh 20190524 05:14:21 all (1/2): su.sh Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. swap_pager: indefinite wait buffer: bufobj: 0, blkno: 2765338, size: 16384 20190524 05:21:14 all (2/2): callout_reset_on.sh 20190524 05:27:22 all (1/2): su.sh 20190524 05:32:40 all (2/2): callout_reset_on.sh 20190524 05:38:28 all (1/2): su.sh 20190524 05:44:52 all (2/2): callout_reset_on.sh 20190524 05:49:56 all (1/2): su.sh 20190524 05:55:29 all (2/2): callout_reset_on.sh 20190524 06:00:00 all (1/2): su.sh Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. 20190524 06:06:02 all (2/2): callout_reset_on.sh 20190524 06:09:34 all (1/2): su.sh 20190524 06:15:04 all (2/2): callout_reset_on.sh 20190524 06:20:26 all (1/2): su.sh 20190524 06:27:25 all (2/2): callout_reset_on.sh freework leak: 1/9. 20190524 06:33:24 all (1/2): su.sh Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3941547, size: 16384 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3940038, size: 81920 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3941887, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3940038, size: 81920 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3971536, size: 8192 Approaching the limit on PV entries, consider increasing either the vm.pmap.shpgperproc or the vm.pmap.pv_entries tunable. swap_pager: indefinite wait buffer: bufobj: 0, blkno: 4109677, size: 4096 20190524 06:41:29 all (2/2): callout_reset_on.sh 20190524 06:45:41 all (1/2): su.sh 20190524 06:53:40 all: done panic: vm_fault_hold: fault on nofault entry, addr: 0x2a3f7000 cpuid = 2 time = 1558673643 KDB: stack backtrace: db_trace_self_wrapper(e5a25d,1bbfbb0,0,213bc734,bce851,...) at db_trace_self_wrapper+0x2a/frame 0x213bc708 kdb_backtrace(b,2,2,2f98ad6,2db5000,...) at kdb_backtrace+0x2e/frame 0x213bc768 vpanic(161b028,213bc7b0,213bc7b0,213bc880,12aab7f,...) at vpanic+0x121/frame 0x213bc790 panic(161b028,157308b,2a3f7000,157015e,7000060,...) at panic+0x14/frame 0x213bc7a4 vm_fault_hold(2db5000,2a3f7000,2,0,0) at vm_fault_hold+0x24ff/frame 0x213bc880 vm_fault(2db5000,2a3f7000,2,0) at vm_fault+0x4a/frame 0x213bc8a8 trap_pfault(2a3f74bc) at trap_pfault+0xf3/frame 0x213bc8f4 trap(213bc9b8,8,28,28,183df220,...) at trap+0x3c0/frame 0x213bc9ac calltrap() at 0xffc0316d/frame 0x213bc9ac --- trap 0xc, eip = 0xf71185, esp = 0x213bc9f8, ebp = 0x213bca10 --- funsetownlst(186bdd10) at funsetownlst+0xa5/frame 0x213bca10 pgdelete(186bdd2c,2222b6a8,2222b760,2103740c,213bca68,...) at pgdelete+0x60/frame 0x213bca30 leavepgrp(2222b6a8) at leavepgrp+0xd5/frame 0x213bca48 proc_reap(18889380,2222b6a8,213bcb14,36) at proc_reap+0x44f/frame 0x213bca68 proc_to_reap(7,0,0,213bcb14,36,0,0,0) at proc_to_reap+0x2b8/frame 0x213bca90 kern_wait6(18889380,7,0,0,213bcb14,36,0,0) at kern_wait6+0x182/frame 0x213bcae8 sys_wait4(18889380,18889608) at sys_wait4+0x78/frame 0x213bcc08 syscall(213bcce8,3b,3b,3b,0,...) at syscall+0x2d9/frame 0x213bccdc Xint0x80_syscall() at 0xffc033b7/frame 0x213bccdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282ca583, esp = 0xffbfe724, ebp = 0xffbfe73c --- __bss_end() at 0x282ca583 KDB: enter: panic [ thread pid 908 tid 100124 ] Stopped at kdb_enter+0x35: movl $0,kdb_why db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> bt Tracing pid 908 tid 100124 td 0x18889380 kdb_enter(163a0ed,163a0ed) at kdb_enter+0x35/frame 0x213bc760 vpanic(161b028,213bc7b0,213bc7b0,213bc880,12aab7f,...) at vpanic+0x139/frame 0x213bc790 panic(161b028,157308b,2a3f7000,157015e,7000060,...) at panic+0x14/frame 0x213bc7a4 vm_fault_hold(2db5000,2a3f7000,2,0,0) at vm_fault_hold+0x24ff/frame 0x213bc880 vm_fault(2db5000,2a3f7000,2,0) at vm_fault+0x4a/frame 0x213bc8a8 trap_pfault(2a3f74bc) at trap_pfault+0xf3/frame 0x213bc8f4 trap(213bc9b8,8,28,28,183df220,...) at trap+0x3c0/frame 0x213bc9ac calltrap() at 0xffc0316d/frame 0x213bc9ac --- trap 0xc, eip = 0xf71185, esp = 0x213bc9f8, ebp = 0x213bca10 --- funsetownlst(186bdd10) at funsetownlst+0xa5/frame 0x213bca10 pgdelete(186bdd2c,2222b6a8,2222b760,2103740c,213bca68,...) at pgdelete+0x60/frame 0x213bca30 leavepgrp(2222b6a8) at leavepgrp+0xd5/frame 0x213bca48 proc_reap(18889380,2222b6a8,213bcb14,36) at proc_reap+0x44f/frame 0x213bca68 proc_to_reap(7,0,0,213bcb14,36,0,0,0) at proc_to_reap+0x2b8/frame 0x213bca90 kern_wait6(18889380,7,0,0,213bcb14,36,0,0) at kern_wait6+0x182/frame 0x213bcae8 sys_wait4(18889380,18889608) at sys_wait4+0x78/frame 0x213bcc08 syscall(213bcce8,3b,3b,3b,0,...) at syscall+0x2d9/frame 0x213bccdc Xint0x80_syscall() at 0xffc033b7/frame 0x213bccdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282ca583, esp = 0xffbfe724, ebp = 0xffbfe73c --- __bss_end() at 0x282ca583 db:1:pho1> show allpcpu Current CPU: 2 cpuid = 0 dynamic pcpu = 0x8d5fc0 curthread = 0x99dd700: pid 11 tid 100003 "idle: cpu0" curpcb = 0x12521d40 fpcurthread = none idlethread = 0x99dd700: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 trampstk = 0xffc07ff0 kesp0 = 0x12521d30 common_tssp = 0xffc01260 tlb gen = 123396147 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0x7c37fc0 curthread = 0x99dd380: pid 11 tid 100004 "idle: cpu1" curpcb = 0x12526d40 fpcurthread = none idlethread = 0x99dd380: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 trampstk = 0xffc0aff0 kesp0 = 0x12526d30 common_tssp = 0xffc012c8 tlb gen = 123396150 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0x7c3cfc0 curthread = 0x18889380: pid 908 tid 100124 "bash" curpcb = 0x213bcd40 fpcurthread = 0x18889380: pid 908 "bash" idlethread = 0x99dd000: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 trampstk = 0xffc0bff0 kesp0 = 0x213bcd30 common_tssp = 0xffc01330 tlb gen = 123396150 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0x7c41fc0 curthread = 0x951b000: pid 12 tid 100025 "swi4: clock (0)" curpcb = 0x125a0d40 fpcurthread = none idlethread = 0x99d8a80: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 trampstk = 0xffc0dff0 kesp0 = 0x125a0d30 common_tssp = 0xffc01398 tlb gen = 123396150 curvnet = 0x9956040 spin locks held: db:1:pho1> show alllocks db:1:pho1> show lockedvnods Locked vnodes db:1:pho1> show allchains chain 1: thread 102775 (pid 78668, sleep) sleeping on 0x1eb41e4 "nanslp" chain 2: thread 100216 (pid 1051, sh) sleeping on 0x21034d40 "piperd" chain 3: thread 100214 (pid 1049, awk) sleeping on 0x210966a0 "piperd" chain 4: thread 100215 (pid 1048, sh) sleeping on 0x21ea69fc "wait" chain 5: thread 100123 (pid 1028, sh) sleeping on 0x210376a8 "wait" chain 6: thread 100187 (pid 904, csh) sleeping on 0x2222d3b8 "pause" chain 7: thread 100195 (pid 903, su) sleeping on 0x217c7000 "wait" chain 8: thread 100181 (pid 895, bash) sleeping on 0x21ea5354 "wait" chain 9: thread 100196 (pid 894, sshd) sleeping on 0x18699d64 "select" chain 10: thread 100188 (pid 892, sshd) sleeping on 0x99db9e4 "select" chain 11: thread 100170 (pid 772, getty) sleeping on 0x17c34c74 "ttyin" chain 12: thread 100203 (pid 771, getty) sleeping on 0x186cbc74 "ttyin" chain 13: thread 100202 (pid 770, getty) sleeping on 0x186cc074 "ttyin" chain 14: thread 100201 (pid 769, getty) sleeping on 0x186cc474 "ttyin" chain 15: thread 100200 (pid 768, getty) sleeping on 0x186cc874 "ttyin" chain 16: thread 100199 (pid 767, getty) sleeping on 0x186ccc74 "ttyin" chain 17: thread 100198 (pid 766, getty) sleeping on 0x186cd074 "ttyin" chain 18: thread 100190 (pid 765, getty) sleeping on 0x186cd474 "ttyin" chain 19: thread 100105 (pid 764, getty) sleeping on 0x186cd874 "ttyin" chain 20: thread 100194 (pid 747, inetd) sleeping on 0x9519ee4 "select" chain 21: thread 100107 (pid 713, nfscbd: master) sleeping on 0x18464b50 "rpcsvc" chain 22: thread 100191 (pid 713, nfscbd: service) sleeping on 0x186af7d0 "rpcsvc" chain 23: thread 100192 (pid 713, nfscbd: service) sleeping on 0x186af750 "rpcsvc" chain 24: thread 100193 (pid 713, nfscbd: service) sleeping on 0x18463c50 "rpcsvc" chain 25: thread 100178 (pid 712, nfscbd) sleeping on 0x219028e8 "accept" chain 26: thread 100173 (pid 676, cron) sleeping on 0x1eb41e4 "nanslp" chain 27: thread 100176 (pid 672, sendmail) sleeping on 0x95aca60 "pause" chain 28: thread 100179 (pid 669, sendmail) sleeping on 0x9517aa4 "select" chain 29: thread 100114 (pid 666, sshd) sleeping on 0x18699ea4 "select" chain 30: thread 100174 (pid 626, smartd) sleeping on 0x1eb41e5 "nanslp" chain 31: thread 100171 (pid 602, powerd) sleeping on 0x183c2ee4 "select" chain 32: thread 100172 (pid 599, ntpd) sleeping on 0x183c12e4 "select" chain 33: thread 100167 (pid 561, NLM: master) sleeping on 0x186aedd0 "rpcsvc" chain 34: thread 100165 (pid 558, rpc.statd) sleeping on 0x183c1324 "select" chain 35: thread 100133 (pid 557, nfsd: master) sleeping on 0x17e138d0 "rpcsvc" chain 36: thread 100134 (pid 557, nfsd: service) sleeping on 0x17e13750 "rpcsvc" chain 37: thread 100135 (pid 557, nfsd: service) sleeping on 0x18464c50 "rpcsvc" chain 38: thread 100136 (pid 557, nfsd: service) sleeping on 0x18464e50 "rpcsvc" chain 39: thread 100137 (pid 557, nfsd: service) sleeping on 0x186af550 "rpcsvc" chain 40: thread 100138 (pid 557, nfsd: service) sleeping on 0x18464ed0 "rpcsvc" chain 41: thread 100139 (pid 557, nfsd: service) sleeping on 0x186af4d0 "rpcsvc" chain 42: thread 100140 (pid 557, nfsd: service) sleeping on 0x18464f50 "rpcsvc" chain 43: thread 100141 (pid 557, nfsd: service) sleeping on 0x18465050 "rpcsvc" chain 44: thread 100142 (pid 557, nfsd: service) sleeping on 0x184650d0 "rpcsvc" chain 45: thread 100143 (pid 557, nfsd: service) sleeping on 0x186af450 "rpcsvc" chain 46: thread 100144 (pid 557, nfsd: service) sleeping on 0x18465150 "rpcsvc" chain 47: thread 100145 (pid 557, nfsd: service) sleeping on 0x186af3d0 "rpcsvc" chain 48: thread 100146 (pid 557, nfsd: service) sleeping on 0x186af350 "rpcsvc" chain 49: thread 100147 (pid 557, nfsd: service) sleeping on 0x186af2d0 "rpcsvc" chain 50: thread 100148 (pid 557, nfsd: service) sleeping on 0x184651d0 "rpcsvc" chain 51: thread 100149 (pid 557, nfsd: service) sleeping on 0x186af250 "rpcsvc" chain 52: thread 100150 (pid 557, nfsd: service) sleeping on 0x18465250 "rpcsvc" chain 53: thread 100151 (pid 557, nfsd: service) sleeping on 0x186af1d0 "rpcsvc" chain 54: thread 100152 (pid 557, nfsd: service) sleeping on 0x184652d0 "rpcsvc" chain 55: thread 100153 (pid 557, nfsd: service) sleeping on 0x186af150 "rpcsvc" chain 56: thread 100154 (pid 557, nfsd: service) sleeping on 0x18465350 "rpcsvc" chain 57: thread 100155 (pid 557, nfsd: service) sleeping on 0x186af0d0 "rpcsvc" chain 58: thread 100156 (pid 557, nfsd: service) sleeping on 0x184653d0 "rpcsvc" chain 59: thread 100157 (pid 557, nfsd: service) sleeping on 0x186af050 "rpcsvc" chain 60: thread 100158 (pid 557, nfsd: service) sleeping on 0x18465450 "rpcsvc" chain 61: thread 100159 (pid 557, nfsd: service) sleeping on 0x186aef50 "rpcsvc" chain 62: thread 100160 (pid 557, nfsd: service) sleeping on 0x184654d0 "rpcsvc" chain 63: thread 100161 (pid 557, nfsd: service) sleeping on 0x186aeed0 "rpcsvc" chain 64: thread 100162 (pid 557, nfsd: service) sleeping on 0x18465550 "rpcsvc" chain 65: thread 100163 (pid 557, nfsd: service) sleeping on 0x186aee50 "rpcsvc" chain 66: thread 100164 (pid 557, nfsd: service) sleeping on 0x184655d0 "rpcsvc" chain 67: thread 100131 (pid 554, nfsd) sleeping on 0x9517ae4 "select" chain 68: thread 100129 (pid 548, mountd) sleeping on 0x9517b64 "select" chain 69: thread 100122 (pid 541, nfsuserd) sleeping on 0x183c3864 "select" chain 70: thread 100112 (pid 540, nfsuserd) sleeping on 0x9517ba4 "select" chain 71: thread 100128 (pid 539, nfsuserd) sleeping on 0x183c2f24 "select" chain 72: thread 100127 (pid 538, nfsuserd) sleeping on 0x183c2f64 "select" chain 73: thread 100126 (pid 537, nfsuserd) sleeping on 0x99d63b8 "pause" chain 74: thread 100113 (pid 494, watchdogd) sleeping on 0x1eb41e7 "nanslp" chain 75: thread 100125 (pid 405, rpcbind) sleeping on 0x183c3024 "select" chain 76: thread 100110 (pid 396, syslogd) sleeping on 0x183c2964 "select" chain 77: thread 100108 (pid 324, devd) sleeping on 0x183c3924 "select" chain 78: thread 100104 (pid 25, syncer) sleeping on 0x1f2e964 "syncer" chain 79: thread 100103 (pid 24, vnlru) sleeping on 0x99d4354 "vlruwt" chain 80: thread 100099 (pid 23, bufdaemon) sleeping on 0x1f2e2fc "qsleep" chain 81: thread 100101 (pid 23, bufspacedaemon-0) sleeping on 0x1be2bc0 "-" chain 82: thread 100115 (pid 23, /home worker) sleeping on 0x211c3284 "sdflush" chain 83: thread 100116 (pid 23, /tmp worker) sleeping on 0x211c3084 "sdflush" chain 84: thread 100117 (pid 23, /usr worker) sleeping on 0x211c2e84 "sdflush" chain 85: thread 100118 (pid 23, /var worker) sleeping on 0x211c2c84 "sdflush" chain 86: thread 100098 (pid 22, vmdaemon) sleeping on 0x1f43db8 "psleep" chain 87: thread 100097 (pid 21, dom0) sleeping on 0x1f78378 "psleep" chain 88: thread 100100 (pid 21, laundry: dom0) sleeping on 0x1f78384 "launds" chain 89: thread 100102 (pid 21, uma) sleeping on 0x12a5590 "umarcl" chain 90: thread 100091 (pid 20, rand_harvestq) sleeping on 0x1d19800 "-" chain 91: thread 100090 (pid 19, sctp_iterator) sleeping on 0x1f7743c "waiting_for_work" chain 92: thread 100089 (pid 18, soaiod4) sleeping on 0x1f2df28 "-" chain 93: thread 100088 (pid 17, soaiod3) sleeping on 0x1f2df28 "-" chain 94: thread 100087 (pid 16, soaiod2) sleeping on 0x1f2df28 "-" chain 95: thread 100086 (pid 9, soaiod1) sleeping on 0x1f2df28 "-" chain 96: thread 100083 (pid 8, fdc0) sleeping on 0x17af303c "-" chain 97: thread 100048 (pid 15, usbus0) sleeping on 0x17b1eacc "-" chain 98: thread 100049 (pid 15, usbus0) sleeping on 0x17b1eafc "-" chain 99: thread 100050 (pid 15, usbus0) sleeping on 0x17b1eb2c "-" chain 100: thread 100051 (pid 15, usbus0) sleeping on 0x17b1eb5c "-" chain 101: thread 100052 (pid 15, usbus0) sleeping on 0x17b1eb8c "-" chain 102: thread 100054 (pid 15, usbus1) sleeping on 0x17dc1acc "-" chain 103: thread 100055 (pid 15, usbus1) sleeping on 0x17dc1afc "-" chain 104: thread 100056 (pid 15, usbus1) sleeping on 0x17dc1b2c "-" chain 105: thread 100057 (pid 15, usbus1) sleeping on 0x17dc1b5c "-" chain 106: thread 100058 (pid 15, usbus1) sleeping on 0x17dc1b8c "-" chain 107: thread 100060 (pid 15, usbus2) sleeping on 0x17dccacc "-" chain 108: thread 100061 (pid 15, usbus2) sleeping on 0x17dccafc "-" chain 109: thread 100062 (pid 15, usbus2) sleeping on 0x17dccb2c "-" chain 110: thread 100063 (pid 15, usbus2) sleeping on 0x17dccb5c "-" chain 111: thread 100064 (pid 15, usbus2) sleeping on 0x17dccb8c "-" chain 112: thread 100065 (pid 15, usbus3) sleeping on 0x17dd5acc "-" chain 113: thread 100066 (pid 15, usbus3) sleeping on 0x17dd5afc "-" chain 114: thread 100067 (pid 15, usbus3) sleeping on 0x17dd5b2c "-" chain 115: thread 100068 (pid 15, usbus3) sleeping on 0x17dd5b5c "-" chain 116: thread 100069 (pid 15, usbus3) sleeping on 0x17dd5b8c "-" chain 117: thread 100070 (pid 15, usbus4) sleeping on 0x17dd9acc "-" chain 118: thread 100071 (pid 15, usbus4) sleeping on 0x17dd9afc "-" chain 119: thread 100072 (pid 15, usbus4) sleeping on 0x17dd9b2c "-" chain 120: thread 100073 (pid 15, usbus4) sleeping on 0x17dd9b5c "-" chain 121: thread 100074 (pid 15, usbus4) sleeping on 0x17dd9b8c "-" chain 122: thread 100076 (pid 15, usbus5) sleeping on 0x17b18ca4 "-" chain 123: thread 100077 (pid 15, usbus5) sleeping on 0x17b18cd4 "-" chain 124: thread 100078 (pid 15, usbus5) sleeping on 0x17b18d04 "-" chain 125: thread 100079 (pid 15, usbus5) sleeping on 0x17b18d34 "-" chain 126: thread 100080 (pid 15, usbus5) sleeping on 0x17b18d64 "-" chain 127: thread 100043 (pid 7, doneq0) sleeping on 0x1c52cc0 "-" chain 128: thread 100096 (pid 7, scanner) sleeping on 0x1c52bec "-" chain 129: thread 100042 (pid 6, crypto returns 3) sleeping on 0x95a94c4 "crypto_ret_wait" chain 130: thread 100041 (pid 5, crypto returns 2) sleeping on 0x95a948c "crypto_ret_wait" chain 131: thread 100040 (pid 4, crypto returns 1) sleeping on 0x95a9454 "crypto_ret_wait" chain 132: thread 100039 (pid 3, crypto returns 0) sleeping on 0x95a941c "crypto_ret_wait" chain 133: thread 100038 (pid 2, crypto) sleeping on 0x1f42b70 "crypto_wait" chain 134: thread 100033 (pid 14, sequencer 00) sleeping on 0x95ef24c "seqstate" chain 135: thread 100030 (pid 13, g_event) sleeping on 0x1f673e0 "-" chain 136: thread 100031 (pid 13, g_up) sleeping on 0x1f673e8 "-" chain 137: thread 100032 (pid 13, g_down) sleeping on 0x1f673dc "-" chain 138: thread 100002 (pid 1, init) sleeping on 0x99d59fc "wait" chain 139: thread 100001 (pid 10, audit) sleeping on 0x1f77c20 "audit_worker_cv" chain 140: thread 100000 (pid 0, swapper) sleeping on 0x1f67400 "swapin" chain 141: thread 100007 (pid 0, aiod_kick taskq) sleeping on 0x9434d80 "-" chain 142: thread 100010 (pid 0, thread taskq) sleeping on 0x9434c00 "-" chain 143: thread 100012 (pid 0, config_0) sleeping on 0x9434b00 "-" chain 144: thread 100013 (pid 0, kqueue_ctx taskq) sleeping on 0x9434a80 "-" chain 145: thread 100014 (pid 0, if_config_tqg_0) sleeping on 0x9434a00 "-" chain 146: thread 100015 (pid 0, if_io_tqg_0) sleeping on 0x9434380 "-" chain 147: thread 100016 (pid 0, if_io_tqg_1) sleeping on 0x9434300 "-" chain 148: thread 100017 (pid 0, if_io_tqg_2) sleeping on 0x9434280 "-" chain 149: thread 100018 (pid 0, if_io_tqg_3) sleeping on 0x9434200 "-" chain 150: thread 100019 (pid 0, softirq_0) sleeping on 0x94ea080 "-" chain 151: thread 100020 (pid 0, softirq_1) sleeping on 0x94e9980 "-" chain 152: thread 100021 (pid 0, softirq_2) sleeping on 0x94e9900 "-" chain 153: thread 100022 (pid 0, softirq_3) sleeping on 0x94e9880 "-" chain 154: thread 100029 (pid 0, firmware taskq) sleeping on 0x94e9800 "-" chain 155: thread 100034 (pid 0, crypto_0) sleeping on 0x94e8b00 "-" chain 156: thread 100035 (pid 0, crypto_1) sleeping on 0x94e8b00 "-" chain 157: thread 100036 (pid 0, crypto_2) sleeping on 0x94e8b00 "-" chain 158: thread 100037 (pid 0, crypto_3) sleeping on 0x94e8b00 "-" chain 159: thread 100085 (pid 0, mca taskq) sleeping on 0x17c3ec00 "-" chain 160: thread 100092 (pid 0, acpi_task_0) sleeping on 0x183cbd00 "-" chain 161: thread 100093 (pid 0, acpi_task_1) sleeping on 0x183cbd00 "-" chain 162: thread 100094 (pid 0, acpi_task_2) sleeping on 0x183cbd00 "-" chain 163: thread 100095 (pid 0, CAM taskq) sleeping on 0x94e8800 "-" db:1:pho1> show mount 0x1887b000 /dev/ada0s1a on / (ufs) 0x1887c000 devfs on /dev (devfs) 0x211bf000 /dev/ada0s1f on /home (ufs) 0x211dd000 /dev/label/tmp on /tmp (ufs) 0x211dc000 /dev/ada0s1d on /usr (ufs) 0x211db000 /dev/ada0s1e on /var (ufs) 0x217b5000 procfs on /proc (procfs) More info: show mount db:1:pho1> show bufqueues bqempty: 0 Buf domain 0 freebufs 444 lofreebufs 311 hifreebufs 466 bufspace 76525568 maxbufspace 94683136 hibufspace 94027776 lobufspace 89326372 bufspacethresh 91677074 numdirtybuffers 41 lodirtybuffers 732 hidirtybuffers 1464 dirtybufthresh 1317 cleanq count 5215 (74946560) dirtyq count 41 (657408) wakeup 0 lim 28 CPU 26, 17, 15, 21, Locked buffers: 0 space 0 Total buffers: 5779 space 76525568 db:1:pho1> show page vm_cnt.v_free_count: 732600 vm_cnt.v_inactive_count: 16691 vm_cnt.v_active_count: 549 vm_cnt.v_laundry_count: 1053 Loading /boot/loader.conf.local (kgdb) l *funsetownlst+0xa5 0xf71185 is in funsetownlst (../../../kern/kern_descrip.c:1010). 1005 PROC_LOCK_ASSERT(p, MA_NOTOWNED); 1006 } 1007 1008 SIGIO_LOCK(); 1009 while ((sigio = SLIST_FIRST(sigiolst)) != NULL) { 1010 *(sigio->sio_myref) = NULL; 1011 if (pg != NULL) { 1012 KASSERT(sigio->sio_pgid < 0, 1013 ("Proc sigio in pgrp sigio list")); 1014 KASSERT(sigio->sio_pgrp == pg, (kgdb)