panic: page fault, vmcore.78 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2019 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #0 r351673M: Mon Sep 2 01:26:53 CEST 2019 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 8.0.1 (tags/RELEASE_801/final 366581) (based on LLVM 8.0.1) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Entering uma_startup with 10 boot pages configured startup_alloc from "UMA Kegs", 8 boot pages left startup_alloc from "UMA Zones", 7 boot pages left startup_alloc from "UMA Zones", 6 boot pages left startup_alloc from "UMA Zones", 5 boot pages left startup_alloc from "UMA Zones", 4 boot pages left startup_alloc from "UMA Zones", 3 boot pages left startup_alloc from "UMA Hash", 2 boot pages left startup_alloc from "UMA Zones", 1 boot pages left Entering uma_startup1 with 0 boot pages left Entering uma_startup2 with 0 boot pages left VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.08-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33160597504 (31624 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 4 2 10 8 11 3 7 9 6 5 Timecounter "TSC-low" frequency 1750037816 Hz quality 1000 random: entropy device external interface kbd1 at kbdmux0 000.000054 [4335] netmap_init netmap: loaded module module_register_init: MOD_LOAD (vesa, 0xffffffff811c1ab0, 0) error 19 [ath_hal] loaded nexus0 vtvga0: cryptosoft0: acpi0: acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb0: Using 6 RX queues 6 TX queues igb0: Using MSI-X interrupts with 7 vectors igb0: Ethernet address: 0c:c4:7a:a8:cd:da igb0: netmap queues/slots: TX 6/1024, RX 6/1024 igb1: port 0xd000-0xd01f mem 0xfb300000-0xfb31ffff,0xfb340000-0xfb343fff irq 17 at device 0.1 on pci8 igb1: Using 1024 TX descriptors and 1024 RX descriptors igb1: queue equality override not set, capping rx_queues at 6 and tx_queues at 6 igb1: Using 6 RX queues 6 TX queues igb1: Using MSI-X interrupts with 7 vectors igb1: Ethernet address: 0c:c4:7a:a8:cd:db igb1: netmap queues/slots: TX 6/1024, RX 6/1024 ehci1: mem 0xfb433000-0xfb4333ff irq 18 at device 29.0 on pci1 usbus2: EHCI version 1.0 usbus2 on ehci1 usbus2: 480Mbps High Speed USB v2.0 isab0: at device 31.0 on pci1 isa0: on isab0 ahci1: port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf000-0xf01f mem 0xfb432000-0xfb4327ff irq 16 at device 31.2 on pci1 ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich4: at channel 0 on ahci1 ahcich5: at channel 1 on ahci1 ahcich6: at channel 2 on ahci1 ahcich7: at channel 3 on ahci1 ahcich8: at channel 4 on ahci1 ahcich9: at channel 5 on ahci1 ahciem1: on ahci1 acpi_button0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 uart1: console (115200,n,8,1) orm0: at iomem 0xc0000-0xc7fff,0xcb000-0xcbfff pnpid ORM0000 on isa0 est0: on cpu0 p4tcc0: on cpu0 NULL mp in getnewvnode(9), tag crossmp Timecounters tick every 1.000 msec ugen2.1: at usbus2 ugen1.1: at usbus1 uhub0 on usbus2 ugen0.1: <0x8086 XHCI root HUB> at usbus0 uhub0: on usbus2 uhub1 on usbus0 uhub2 on usbus1 uhub2: on usbus1 uhub1: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0 Expensive timeout(9) function: 0xffffffff804e0ed0(0xfffffe0099fda000) 0.004906428 s ada0 at ahcich1 bus 0 scbus1 target 0 lun 0 ada0: ACS-2 ATA SATA 3.x device ada0: Serial Number WD-WCC3F3KDDP98 ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 953869MB (1953525168 512 byte sectors) ada0: quirks=0x1<4K> ses0 at ahciem0 bus 0 scbus4 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device ses1 at ahciem1 bus 0 scbus11 target 0 lun 0 ses1: SEMB S-E-S 2.00 device ses1: SEMB SES Device ses0: ada0,pass0 in 'Slot 01', SATA Slot: scbus1 target 0 hwpmc: SOFT/16/64/0x67 TSC/1/64/0x20 IAP/4/48/0x3ff IAF/3/48/0x67 Trying to mount root from ufs:/dev/gpt/work [rw]... WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Expensive timeout(9) function: 0xffffffff80a45880(0xffffffff81ae7430) 0.007388443 s WARNING: / was not properly dismounted Interface IP-Address Broadcast Setting hostuuid: 00000000-0000-0000-0000-002590c99976. Setting hostid: 0x90b83241. dismounted ugen0.3: at usbus0 ukbd0 on uhub3 ukbd0: on usbus0 kbd2 at ukbd0 . lo0: link state changed to UP Starting Network: lo0 igb0 igb1. lo0: flags=8049 metric 0 mtu 16384 options=680003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 groups: lo nd6 options=21 igb0: flags=8843 metric 0 mtu 1500 options=e507bb ether 0c:c4:7a:a8:cd:da inet6 fe80::ec4:7aff:fea8:cdda%igb0 prefixlen 64 scopeid 0x1 media: Ethernet autoselect status: no carrier nd6 options=21 igb1: flags=8802 metric 0 mtu 1500 options=e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Starting devd. igb0: link state changed to UP Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8802 metric 0 mtu 1500 options=e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko ums0 on uhub3 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff800044ce000 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 2 Sep 09:04:16 ntpdate[2055]: step time server 192.168.5.1 offset -0.328402 sec Starting rpcbind. NFS access cache time=60 Starting watchdogd. No core dumps found. Clearing /tmp (X related). Starting statd. Starting lockd. fscklock order reversal: 1st 0xfffff80007fcb2e0 ufs (ufs) @ kern/vfs_mount.c:1354 2nd 0xfffff8000668e068 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1926 stack backtrace: #0 0xffffffff80c427b3 at witness_debugger+0x73 #1 0xffffffff80c424fe at witness_checkorder+0xa9e #2 0xffffffff80ba85a9 at lockmgr_lock_fast_path+0x179 #3 0xffffffff81237b90 at VOP_LOCK1_APV+0x70 #4 0xffffffff80cc0365 at _vn_lock+0x65 #5 0xffffffff80eca84d at softdep_flushworklist+0x5d #6 0xffffffff80eeb986 at ffs_sync+0x406 #7 0xffffffff80ca6031 at dounmount+0x4f1 #8 0xffffffff80ca5a89 at sys_unmount+0x339 #9 0xffffffff8119a254 at amd64_syscall+0x2d4 #10 0xffffffff81171b70 at fast_syscall_common+0x101 ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 307 files, 5721 used, 1259686 free (110 frags, 157447 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** Updating motd:. Mounting late filesystems:. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Mon Sep 2 09:04 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root Sep 2 09:06:06 mercat1 login[2337]: ROOT LOGIN (root) ON ttyu1 Last login: Sun Sep 1 23:26:37 on ttyu1 FreeBSD 13.0-CURRENT (PHO) #0 r351673M: Mon Sep 2 01:26:53 CEST 2019 root@mercat1:~ # Sep 2 09:06:13 mercat1 su[2355]: pho to root on /dev/pts/0 20190902 09:06:35 all (1/1): syscall5.sh 09:06:36 syscall 569 (copy_file_range) lock order reversal: (sleepable after non-sleepable) 1st 0xfffff80003d3bc08 seqflq (seqflq) @ dev/sound/midi/sequencer.c:757 2nd 0xffffffff81cf2bc0 midistat lock (midistat lock) @ dev/sound/midi/midi.c:1491 stack backtrace: #0 0xffffffff80c427b3 at witness_debugger+0x73 #1 0xffffffff80c424fe at witness_checkorder+0xa9e #2 0xffffffff80bdeee8 at _sx_xlock+0x68 #3 0xffffffff8098dcf2 at midimapper_open+0x22 #4 0xffffffff80990c94 at mseq_open+0xf4 #5 0xffffffff80a8bb15 at devfs_open+0x135 #6 0xffffffff81235452 at VOP_OPEN_APV+0x82 #7 0xffffffff80cc0105 at vn_open_vnode+0x1b5 #8 0xffffffff80cbfd1c at vn_open_cred+0x35c #9 0xffffffff80cb7963 at kern_openat+0x1f3 #10 0xffffffff8119a254 at amd64_syscall+0x2d4 #11 0xffffffff81171b70 at fast_syscall_common+0x101 09:08:46 syscall 568 (funlinkat) 09:10:48 syscall 567 (fhreadlink) 09:12:54 syscall 566 (fhlinkat) 09:15:00 syscall 565 (fhlink) 09:17:02 syscall 564 (getfhat) Expensive timeout(9) function: 0xffffffff809fbc40(0xfffffe0006de6cd8) 0.012504925 s 09:19:04 syscall 563 (getrandom) 09:21:12 syscall 562 (cpuset_setdomain) 09:23:13 syscall 561 (cpuset_getdomain) 09:25:16 syscall 560 (kevent) 09:27:19 syscall 559 (mknodat) 09:29:23 syscall 558 (fhstatfs) 09:31:25 syscall 557 (getfsstat) 09:33:26 syscall 556 (fstatfs) 09:35:38 syscall 555 (statfs) 20190902 09:37:40 all: done 20190902 09:50:07 all (1/669): 1st.sh 20190902 09:50:09 all (2/669): 256m.sh 20190902 09:50:11 all (3/669): audit.sh 20190902 09:50:12 all (4/669): beneath3.sh 20190902 09:50:13 all (5/669): buildworld.sh 20190902 09:50:15 all (6/669): buildworld2.sh 20190902 09:50:16 all (7/669): cluster.sh 20190902 09:50:18 all (8/669): cpuset.sh 20190902 09:50:19 all (9/669): crossmp2.sh 20190902 09:50:20 all (10/669): crossmp6.sh 20190902 09:50:22 all (11/669): datagram2.sh 20190902 09:50:23 all (12/669): datagram3.sh 20190902 09:50:25 all (13/669): datamove.sh freework leak: 30/41. newblk leak: 5/15. 20190902 09:50:26 all (14/669): datamove3.sh newblk leak: 1/16. 20190902 09:50:28 all (15/669): devfs2.sh 20190902 09:50:29 all (16/669): devfs5.sh 20190902 09:50:31 all (17/669): dtrace_fault.sh 20190902 09:50:32 all (18/669): dumpfs.sh newblk leak: 296/312. 20190902 09:50:34 all (19/669): dup2.sh 20190902 09:50:35 all (20/669): execi386.sh 20190902 09:50:37 all (21/669): extattr_set_fd.sh 20190902 09:50:38 all (22/669): extattrctl.sh lock order reversal: 1st 0xfffff806047e9438 ufs_extattr_sx (ufs_extattr_sx) @ ufs/ufs/ufs_extattr.c:119 2nd 0xfffff8033811c2e0 ufs (ufs) @ ufs/ffs/ffs_vfsops.c:1717 stack backtrace: #0 0xffffffff80c427b3 at witness_debugger+0x73 #1 0xffffffff80c424fe at witness_checkorder+0xa9e #2 0xffffffff80ba8bbd at lockmgr_xlock_hard+0x6d #3 0xffffffff80ba9775 at __lockmgr_args+0x605 #4 0xffffffff80ee8a93 at ffs_vgetf+0x163 #5 0xffffffff80efb7eb at ufs_root+0x1b #6 0xffffffff80ef3c4f at ufs_extattr_autostart+0x5f #7 0xffffffff80eeae76 at ffs_mount+0x1c76 #8 0xffffffff80ca4c68 at vfs_domount+0x748 #9 0xffffffff80ca3f2e at vfs_donmount+0x7be #10 0xffffffff80ca3739 at sys_nmount+0x69 #11 0xffffffff8119a254 at amd64_syscall+0x2d4 #12 0xffffffff81171b70 at fast_syscall_common+0x101 20190902 09:50:40 all (23/669): fifo.sh 20190902 09:50:42 all (24/669): forkbomb.sh 20190902 09:50:43 all (25/669): fsck2.sh 20190902 09:50:44 all (26/669): fsck3.sh 20190902 09:50:46 all (27/669): fsck4.sh 20190902 09:50:47 all (28/669): geomleak.sh 20190902 09:50:49 all (29/669): getrandom.sh 20190902 09:50:51 all (30/669): gnop3.sh 20190902 09:50:52 all (31/669): gnop5.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. 20190902 09:50:54 all (32/669): holdcnt0.sh 20190902 09:50:55 all (33/669): holdcnt02.sh 20190902 09:50:57 all (34/669): holdcnt03.sh 20190902 09:50:58 all (35/669): holdcnt04.sh 20190902 09:50:59 all (36/669): isofs2.sh 20190902 09:51:01 all (37/669): jail.sh 20190902 09:51:02 all (38/669): jail2.sh 20190902 09:51:04 all (39/669): jail3.sh 20190902 09:51:05 all (40/669): jail4.sh 20190902 09:51:07 all (41/669): kern_umtx_inf_loop.sh 20190902 09:51:08 all (42/669): kevent10.sh 20190902 09:51:10 all (43/669): kevent3.sh 20190902 09:51:11 all (44/669): ldt.sh 20190902 09:51:13 all (45/669): ldt2.sh 20190902 09:51:14 all (46/669): libMicro.sh 20190902 09:51:16 all (47/669): linux.sh 20190902 09:51:17 all (48/669): lockd.sh 20190902 09:51:18 all (49/669): lockf.sh 20190902 09:51:20 all (50/669): lookup_shared.sh 20190902 09:51:21 all (51/669): mac.sh 20190902 09:51:23 all (52/669): mac_chkexec.sh 20190902 09:51:24 all (53/669): machipc.sh 20190902 09:51:25 all (54/669): machipc2.sh 20190902 09:51:27 all (55/669): maxmemdom.sh 20190902 09:51:28 all (56/669): maxproc.sh 20190902 09:51:30 all (57/669): md4.sh 20190902 09:51:31 all (58/669): md5.sh 20190902 09:51:33 all (59/669): md6.sh 20190902 09:51:34 all (60/669): mdconfig.sh 20190902 09:51:35 all (61/669): mdconfig3.sh 20190902 09:51:37 all (62/669): memguard4.sh 20190902 09:51:38 all (63/669): mkfifo5.sh 20190902 09:51:40 all (64/669): mkfifo7.sh mount leak: 16/47 20190902 09:51:42 all (65/669): mlockall5.sh 20190902 09:51:43 all (66/669): mmap.sh 20190902 09:51:44 all (67/669): mmap12.sh 20190902 09:51:46 all (68/669): mmap16.sh 20190902 09:51:47 all (69/669): mmap17.sh 20190902 09:51:49 all (70/669): mmap20.sh 20190902 09:51:50 all (71/669): mmap24.sh 20190902 09:51:52 all (72/669): mmap30.sh 20190902 09:51:53 all (73/669): mmap33.sh 20190902 09:51:55 all (74/669): mmap35.sh 20190902 09:51:56 all (75/669): mmap36.sh 20190902 09:51:58 all (76/669): mount.sh 20190902 09:51:59 all (77/669): mprotect.sh 20190902 09:52:01 all (78/669): msdos2.sh 20190902 09:52:02 all (79/669): msdos3.sh 20190902 09:52:03 all (80/669): msdos7.sh lock order reversal: 1st 0xfffff80007edccc0 msdosfs (msdosfs) @ kern/vfs_syscalls.c:3424 2nd 0xfffff806229a1cc0 devfs (devfs) @ fs/msdosfs/msdosfs_vnops.c:854 stack backtrace: #0 0xffffffff80c427b3 at witness_debugger+0x73 #1 0xffffffff80c424fe at witness_checkorder+0xa9e #2 0xffffffff80ba85a9 at lockmgr_lock_fast_path+0x179 #3 0xffffffff81237b90 at VOP_LOCK1_APV+0x70 #4 0xffffffff80cc0365 at _vn_lock+0x65 #5 0xffffffff80a95b59 at msdosfs_fsync+0x49 #6 0xffffffff81236878 at VOP_FSYNC_APV+0x88 #7 0xffffffff80cbc2e9 at kern_fsync+0x199 #8 0xffffffff8119a254 at amd64_syscall+0x2d4 #9 0xffffffff81171b70 at fast_syscall_common+0x101 20190902 09:52:05 all (81/669): msdos8.sh 20190902 09:52:07 all (82/669): msetdomain.sh 20190902 09:52:08 all (83/669): nanosleep.sh 20190902 09:52:09 all (84/669): nbufkv.sh 20190902 09:52:11 all (85/669): nfs.sh 20190902 09:52:12 all (86/669): nfs12.sh 20190902 09:52:14 all (87/669): nfs13.sh 20190902 09:52:15 all (88/669): nfs14.sh 20190902 09:52:17 all (89/669): nfs15.sh 20190902 09:52:18 all (90/669): nfs15lockd.sh 20190902 09:52:19 all (91/669): nfs15lockd3.sh 20190902 09:52:21 all (92/669): nfs3.sh 20190902 09:52:22 all (93/669): nfs4.sh 20190902 09:52:23 all (94/669): nfs7.sh 20190902 09:52:25 all (95/669): nfs8.sh 20190902 09:52:26 all (96/669): nfs9.sh 20190902 09:52:28 all (97/669): nfs_halfpage.sh 20190902 09:52:29 all (98/669): nfs_halfpage2.sh 20190902 09:52:31 all (99/669): nfsdelegation.sh 20190902 09:52:32 all (100/669): nfsdepth.sh 20190902 09:52:33 all (101/669): nfsrename.sh 20190902 09:52:35 all (102/669): nfssillyrename.sh 20190902 09:52:36 all (103/669): nullfs10.sh 20190902 09:52:38 all (104/669): nullfs13.sh 20190902 09:52:40 all (105/669): nullfs14.sh 20190902 09:52:41 all (106/669): nullfs15.sh 20190902 09:52:43 all (107/669): nullfs21.sh 20190902 09:52:44 all (108/669): nullfs23.sh 20190902 09:52:46 all (109/669): nullfs4.sh 20190902 09:52:47 all (110/669): nullfs6.sh 20190902 09:52:48 all (111/669): nullfs7.sh 20190902 09:52:50 all (112/669): nullfs9.sh 20190902 09:52:52 all (113/669): numa.sh 20190902 09:52:53 all (114/669): oom.sh 20190902 09:52:54 all (115/669): open.sh 20190902 09:52:56 all (116/669): pagefault.sh 20190902 09:52:57 all (117/669): parallelmount2.sh 20190902 09:52:59 all (118/669): pathconf.sh 20190902 09:53:00 all (119/669): pathconf2.sh 20190902 09:53:01 all (120/669): pcatch.sh 20190902 09:53:03 all (121/669): pcatch2.sh 20190902 09:53:04 all (122/669): pkru.sh 20190902 09:53:06 all (123/669): pkru2.sh 20190902 09:53:07 all (124/669): pmc4.sh 20190902 09:53:09 all (125/669): pmc5.sh 20190902 09:53:10 all (126/669): poll.sh 20190902 09:53:12 all (127/669): posix_fadvise.sh 20190902 09:53:13 all (128/669): posix_fadvise2.sh 20190902 09:53:15 all (129/669): procfs5.sh 20190902 09:53:16 all (130/669): procstat.sh 20190902 09:53:17 all (131/669): pthread9.sh 20190902 09:53:19 all (132/669): ptrace.sh 20190902 09:53:20 all (133/669): ptrace3.sh 20190902 09:53:22 all (134/669): pts2.sh 20190902 09:53:23 all (135/669): quota5.sh 20190902 09:53:25 all (136/669): rename13.sh 20190902 09:53:26 all (137/669): rename4.sh 20190902 09:53:28 all (138/669): revoke.sh 20190902 09:53:29 all (139/669): routetbl.sh 20190902 09:53:31 all (140/669): ruby.sh 20190902 09:53:32 all (141/669): rwlock_ronly.sh 20190902 09:53:33 all (142/669): schedfuzz.sh 20190902 09:53:35 all (143/669): scp.sh 20190902 09:53:36 all (144/669): seekdir.sh 20190902 09:53:38 all (145/669): segnp.sh 20190902 09:53:40 all (146/669): segregs.sh 20190902 09:53:41 all (147/669): select3.sh 20190902 09:53:42 all (148/669): sendfile2.sh 20190902 09:53:44 all (149/669): sendfile4.sh 20190902 09:53:46 all (150/669): setuid.sh 20190902 09:53:47 all (151/669): shm_super.sh 20190902 09:53:49 all (152/669): sigaltstack.sh 20190902 09:53:50 all (153/669): sigreturn.sh 20190902 09:53:52 all (154/669): sigstop.sh 20190902 09:53:53 all (155/669): snap.sh lock order reversal: 1st 0xfffffe00008b9f90 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:283 2nd 0xfffff8031b7b9e30 snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:2327 stack backtrace: #0 0xffffffff80c427b3 at witness_debugger+0x73 #1 0xffffffff80c424fe at witness_checkorder+0xa9e #2 0xffffffff80ba8bbd at lockmgr_xlock_hard+0x6d #3 0xffffffff80ba9775 at __lockmgr_args+0x605 #4 0xffffffff80ec98d6 at ffs_copyonwrite+0x176 #5 0xffffffff80eec24c at ffs_geom_strategy+0x8c #6 0xffffffff80eff9c3 at ufs_strategy+0x83 #7 0xffffffff81237fd0 at VOP_STRATEGY_APV+0x90 #8 0xffffffff80c89d44 at bufstrategy+0x44 #9 0xffffffff80c89bcd at bufwrite+0x24d #10 0xffffffff80eee06e at ffs_syncvnode+0x2be #11 0xffffffff80eed082 at ffs_fsync+0x22 #12 0xffffffff81236878 at VOP_FSYNC_APV+0x88 #13 0xffffffff80efd5ff at ufs_remove+0xdf #14 0xffffffff81236a1c at VOP_REMOVE_APV+0xac #15 0xffffffff80cb8f9f at kern_funlinkat+0x2bf #16 0xffffffff80cb8cd8 at sys_unlink+0x28 #17 0xffffffff8119a254 at amd64_syscall+0x2d4 lock order reversal: 1st 0xfffff8031b7b9e30 snaplk (snaplk) @ ufs/ufs/ufs_vnops.c:918 2nd 0xfffff807b5d73068 ufs (ufs) @ ufs/ffs/ffs_snapshot.c:1650 stack backtrace: #0 0xffffffff80c427b3 at witness_debugger+0x73 #1 0xffffffff80c424fe at witness_checkorder+0xa9e #2 0xffffffff80ba8bbd at lockmgr_xlock_hard+0x6d #3 0xffffffff80ba9775 at __lockmgr_args+0x605 #4 0xffffffff80ec7e2d at ffs_snapremove+0xed #5 0xffffffff80ec2430 at ffs_truncate+0x270 #6 0xffffffff80ef59ed at ufs_inactive+0x1cd #7 0xffffffff81237758 at VOP_INACTIVE_APV+0x88 #8 0xffffffff80cadf58 at vinactive+0xe8 #9 0xffffffff80cae5f1 at vputx+0x391 #10 0xffffffff80cb8ff3 at kern_funlinkat+0x313 #11 0xffffffff80cb8cd8 at sys_unlink+0x28 #12 0xffffffff8119a254 at amd64_syscall+0x2d4 #13 0xffffffff81171b70 at fast_syscall_common+0x101 20190902 09:53:55 all (156/669): snap12.sh 20190902 09:53:57 all (157/669): snap2-1.sh 20190902 09:53:58 all (158/669): snap2.sh 20190902 09:54:00 all (159/669): sndstat.sh 20190902 09:54:01 all (160/669): socketpair.sh 20190902 09:54:03 all (161/669): socketpair2.sh 20190902 09:54:04 all (162/669): suj2.sh 20190902 09:54:06 all (163/669): suj32.sh 20190902 09:54:07 all (164/669): suj35.sh lock order reversal: 1st 0xfffff807dcddd2e0 ufs (ufs) @ kern/vfs_subr.c:2738 2nd 0xffffffff81a02400 proctree (proctree) @ kern/subr_prf.c:182 stack backtrace: #0 0xffffffff80c427b3 at witness_debugger+0x73 #1 0xffffffff80c424fe at witness_checkorder+0xSep 2 09:54:09 a9e #2 0xffffffff80be0018 at _smercat1 kernel: x_slock_int+0x68 #3 0xffffffff8pid 75435 (mkdir0c2581e at uprintf+0x5e #4 0xffffffff80ebaef1 at ffs_valloc+0x), uid 0 inumber541 #5 0xffffffff80efecc7 at ufs_mkdir+0xc7 #6 0xffffffff81236 255 on /mnt: oueec at VOP_MKDIR_APV+0x8c #7 0xffffffff80cbca63 at kern_mkdirat of inodes t+0x1b3 #8 0xffffffff8119a254 at amd64_syscall+0x2d4 #9 0xffffffff81171b70 at fast_syscall_common+0x101 20190902 09:54:09 all (165/669): suj7.sh Failed to find journal. Use tunefs to create one Failed to start journal: 2 20190902 09:54:10 all (166/669): suj8.sh Sep 2 09:54:12 mercat1 kernel: pid 75692 (dd), uid 0 inumber 4 on /mnt: filesystem full Sep 2 09:54:12 mercat1 kernel: pid 76047 (dd), uid 0 inumber 5 on /mnt: filesystem full 20190902 09:54:12 all (167/669): tar.sh 20190902 09:54:14 all (168/669): temp.sh 20190902 09:54:15 all (169/669): tmpfs15.sh 20190902 09:54:17 all (170/669): tmpfs18.sh 20190902 09:54:18 all (171/669): tmpfs4.sh 20190902 09:54:20 all (172/669): tmpfs6.sh 20190902 09:54:22 all (173/669): tmpfs7.sh 20190902 09:54:23 all (174/669): trim5.sh 20190902 09:54:25 all (175/669): trim6.sh 20190902 09:54:26 all (176/669): trim7.sh 20190902 09:54:28 all (177/669): trim8.sh 20190902 09:54:29 all (178/669): truncate4.sh 20190902 09:54:31 all (179/669): truncate6.sh 20190902 09:54:32 all (180/669): tvnlru.sh 20190902 09:54:34 all (181/669): ufssuspend.sh 20190902 09:54:35 all (182/669): uma_zalloc_arg.sh 20190902 09:54:37 all (183/669): unlink.sh 20190902 09:54:38 all (184/669): unload.sh 20190902 09:54:40 all (185/669): unload2.sh 20190902 09:54:41 all (186/669): vfork.sh 20190902 09:54:43 all (187/669): vmio.sh 20190902 09:54:44 all (188/669): watchman.sh 20190902 09:54:46 all (189/669): write.sh 20190902 09:54:47 all (190/669): beneath2.sh 20190902 09:54:49 all (191/669): contigmalloc3.sh 20190902 09:54:57 all (192/669): datagram.sh 20190902 09:55:00 all (193/669): ext2fs3.sh 20190902 09:55:02 all (194/669): extattr.sh 20190902 09:55:05 all (195/669): isofs.sh 20190902 09:55:07 all (196/669): killpg.sh 20190902 09:55:10 all (197/669): md9.sh lock order reversal: 1st 0xfffff80007ad3880 bufwait (bufwait) @ vm/vm_pager.c:379 2nd 0xfffff8045af132e0 tmpfs (tmpfs) @ dev/md/md.c:990 stack backtrace: #0 0xffffffff80c427b3 at witness_debugger+0x73 #1 0xffffffff80c424fe at witness_checkorder+0xa9e #2 0xffffffff80ba85a9 at lockmgr_lock_fast_path+0x179 #3 0xffffffff81237b90 at VOP_LOCK1_APV+0x70 #4 0xffffffff80cc0365 at _vn_lock+0x65 #5 0xffffffff806f479a at mdstart_vnode+0x47a #6 0xffffffff806f248c at md_kthread+0x20c #7 0xffffffff80b93964 at fork_exit+0x84 #8 0xffffffff8117228e at fork_trampoline+0xe 20190902 09:55:12 all (198/669): mmap25.sh 20190902 09:55:14 all (199/669): mmap26.sh 20190902 09:55:17 all (200/669): mmap28.sh Sep 2 09:55:20 mercat1 kernel: Failed to fully fault in a core file segment at VA 0x800e00000 with size 0x6a9b000 to be written at offset 0x86d000 for process mmap28 20190902 09:55:20 all (201/669): mmap8.sh 20190902 09:55:23 all (202/669): mmap9.sh 20190902 09:55:25 all (203/669): mountro2.sh 20190902 09:55:27 all (204/669): mountro3.sh newblk leak: 1746/2058. 20190902 09:55:29 all (205/669): nullfs12.sh 20190902 09:55:32 all (206/669): nullfs16.sh 20190902 09:55:34 all (207/669): nullfs3.sh 20190902 09:55:36 all (208/669): openlock.sh 20190902 09:55:39 all (209/669): overcommit.sh Sep 2 10:02:25 mercat1 kernel: pid 4783 (swap), jid 0, uid 2007, was killed: out of swap space Sep 2 10:02:50 mercat1 kernel: pid 4852 (rw), uid 2007 inumber 243723 on /mnt: filesystem full 20190902 10:06:27 all (210/669): ptrace11.sh 20190902 10:06:32 all (211/669): ptrace8.sh 20190902 10:06:35 all (212/669): quota9.sh lock order reversal: 1st 0xfffff801b9fa4c88 FFS (FFS Lock) @ ufs/ufs/ufs_quota.c:759 2nd 0xfffff800231ab000 struct mount mtx (struct mount mtx) @ ufs/ufs/ufs_quota.c:765 stack backtrace: #0 0xffffffff80c427b3 at witness_debugger+0x73 #1 0xffffffff80c424fe at witness_checkorder+0xa9e #2 0xffffffff80bb4415 at __mtx_lock_flags+0x95 #3 0xffffffff80efa3ad at quotaoff_inchange+0xbd #4 0xffffffff80ee88ad at ffs_flushfiles+0x12d #5 0xffffffff80ecaac3 at softdep_flushfiles+0x73 #6 0xffffffff80eeb077 at ffs_unmount+0xd7 #7 0xffffffff80ca6020 at dounmount+0x4e0 #8 0xffffffff80ca5a89 at sys_unmount+0x339 #9 0xffffffff8119a254 at amd64_syscall+0x2d4 #10 0xffffffff81171b70 at fast_syscall_common+0x101 20190902 10:06:37 all (213/669): random.sh 20190902 10:06:39 all (214/669): rename6.sh 20190902 10:06:42 all (215/669): sendfile.sh 20190902 10:06:45 all (216/669): sendfile6.sh 20190902 10:06:47 all (217/669): snap10.sh 20190902 10:06:49 all (218/669): spin.sh 20190902 10:06:52 all (219/669): trim2.sh 20190902 10:06:54 all (220/669): truncate5.sh 20190902 10:06:57 all (221/669): umtx_suspend.sh 20190902 10:06:59 all (222/669): vm_fault_dontneed.sh 20190902 10:07:02 all (223/669): contigmalloc2.sh 20190902 10:07:10 all (224/669): datamove4.sh 20190902 10:07:14 all (225/669): fcntl.sh 20190902 10:07:17 all (226/669): fpclone2.sh 20190902 10:07:20 all (227/669): kevent2.sh 20190902 10:07:23 all (228/669): kevent8.sh 20190902 10:07:27 all (229/669): mlockall7.sh 20190902 10:07:30 all (230/669): mmap23.sh 20190902 10:07:34 all (231/669): mmap4.sh vnode_pager_putpages: I/O error 28 0xfffff803f2052278: tag ufs, type VREG usecount 0, writecount 0, refcount 3203 flags (VI_ACTIVE|VI_DOINGINACT) v_object 0xfffff805b5089200 ref 0 pages 25608 cleanbuf 3200 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff801cac22000 (pid 27456, mmap4, tid 101429) #0 0xffffffff80ba8f82 at lockmgr_xlock_hard+0x432 #1 0xffffffff80ba9775 at __lockmgr_args+0x605 #2 0xffffffff80eed1cc at ffs_lock+0x7c #3 0xffffffff81237b90 at VOP_LOCK1_APV+0x70 #4 0xffffffff80cc0365 at _vn_lock+0x65 #5 0xffffffff80cae4c1 at vputx+0x261 #6 0xffffffff80f21a9a at vm_object_deallocate+0x58a #7 0xffffffff80f158ff at vm_map_process_deferred+0x7f #8 0xffffffff80f1b506 at vm_map_remove+0xc6 #9 0xffffffff80f153d3 at vmspace_exit+0xd3 #10 0xffffffff80b8e5ed at exit1+0x59d #11 0xffffffff80b8e04d at sys_sys_exit+0xd #12 0xffffffff8119a254 at amd64_syscall+0x2d4 #13 0xffffffff81171b70 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=104857600, extsize 0 generation=ba061e42, uid=0, gid=0, flags=0x0 ino 4, on dev md10a vnode_pager_putpages: residual I/O 32768 at 9760 0xfffff803f2052278: tag ufs, type VREG usecount 0, writecount 0, refcount 3203 flags (VI_ACTIVE|VI_DOINGINACT) v_object 0xfffff805b5089200 ref 0 pages 25608 cleanbuf 3200 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff801cac22000 (pid 27456, mmap4, tid 101429) #0 0xffffffff80ba8f82 at lockmgr_xlock_hard+0x432 #1 0xffffffff80ba9775 at __lockmgr_args+0x605 #2 0xffffffff80eed1cc at ffs_lock+0x7c #3 0xffffffff81237b90 at VOP_LOCK1_APV+0x70 #4 0xffffffff80cc0365 at _vn_lock+0x65 #5 0xffffffff80cae4c1 at vputx+0x261 #6 0xffffffff80f21a9a at vm_object_deallocate+0x58a #7 0xffffffff80f158ff at vm_map_process_deferred+0x7f #8 0xffffffff80f1b506 at vm_map_remove+0xc6 Sep 2 10:07:35 #9 0xffffffff80f153d3 at vmspace_exit+0xd3 mercat1 kernel: #pid 27456 (mmap4), uid 0 inumber 4 on /mnt: filesystem full 10 0xffffffff80b8e5ed at exit1+0x59d #11 0xffffffff80b8e04d at sys_sys_exit+0xd #12 0xffffffff8119a254 at amd64_syscall+0x2d4 #13 0xffffffff81171b70 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=104857600, extsize 0 generation=ba061e42, uid=0, gid=0, flags=0x0 ino 4, on dev md10a lock order reversal: 1st 0xfffff8028675d558 syncer (syncer) @ kern/vfs_subr.c:2317 2nd 0xfffff803f20522e0 ufs (ufs) @ kern/vfs_subr.c:2738 stack backtrace: #0 0xffffffff80c427b3 at witness_debugger+0x73 #1 0xffffffff80c424fe at witness_checkorder+0xa9e #2 0xffffffff80ba8bbd at lockmgr_xlock_hard+0x6d #3 0xffffffff80ba9775 at __lockmgr_args+0x605 #4 0xffffffff80eed1cc at ffs_lock+0x7c #5 0xffffffff81237b90 at VOP_LOCK1_APV+0x70 #6 0xffffffff80cc0365 at _vn_lock+0x65 #7 0xffffffff80cadb16 at vget+0xa6 #8 0xffffffff80cafe66 at vfs_msync+0xa6 #9 0xffffffff80cb51a5 at sync_fsync+0xc5 #10 0xffffffff81236878 at VOP_FSYNC_APV+0x88 #11 0xffffffff80cb2ff4 at sched_sync+0x284 #12 0xffffffff80b93964 at fork_exit+0x84 #13 0xffffffff8117228e at fork_trampoline+0xe vnode_pager_putpages: zero-length write at 40075264 resid 131072 0xfffff803f2052278: tag ufs, type VREG usecount 1, writecount 0, refcount 3203 flags (VI_ACTIVE) v_object 0xfffff805b5089200 ref 0 pages 25608 cleanbuf 3201 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff801caa71000 (pid 27464, umount, tid 101495) #0 0xffffffff80ba8f82 at lockmgr_xlock_hard+0x432 #1 0xffffffff80ba9775 at __lockmgr_args+0x605 #2 0xffffffff80eed1cc at ffs_lock+0x7c #3 0xffffffff81237b90 at VOP_LOCK1_APV+0x70 Sep 2 10:07:37 #4 0xffffffff80cc0365 at _vn_lock+0x65 mercat1 kernel: #5 0xffffffff80cadb16 at vget+0xa6 pid 27464 (umoun#6 0xffffffff80cafe66 at vfs_msync+0xa6 t), uid 0 inumbe#7 0xffffffff80ca5fa0 at dounmount+0x460 r 4 on /mnt: fil#8 0xffffffff80ca5a89 at sys_unmount+0x339 esystem full #9 0xffffffff8119a254 at amd64_syscall+0x2d4 #10 0xffffffff81171b70 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=104857600, extsize 0 generation=ba061e42, uid=0, gid=0, flags=0x0 ino 4, on dev md10a 20190902 10:07:37 all (232/669): msdos9.sh 20190902 10:07:40 all (233/669): newfs5.sh 20190902 10:07:43 all (234/669): procfs2.sh lock order reversal: 1st 0xfffff806cb05b2e0 pseudofs (pseudofs) @ kern/vfs_syscalls.c:4052 2nd 0xffffffff81a023c0 allproc (allproc) @ fs/pseudofs/pseudofs_vnops.c:794 stack backtrace: #0 0xffffffff80c427b3 at witness_debugger+0x73 #1 0xffffffff80c424fe at witness_checkorder+0xa9e #2 0xffffffff80be0018 at _sx_slock_int+0x68 #3 0xffffffff80b0ea56 at pfs_readdir+0x116 #4 0xffffffff81237458 at VOP_READDIR_APV+0x88 #5 0xffffffff80cbd37c at kern_getdirentries+0x21c #6 0xffffffff80cbd5a9 at sys_getdirentries+0x29 #7 0xffffffff8119a254 at amd64_syscall+0x2d4 #8 0xffffffff81171b70 at fast_syscall_common+0x101 lock order reversal: (sleepable after non-sleepable) 1st 0xfffff80007622688 pfs_node (pfs_node) @ fs/pseudofs/pseudofs_internal.h:105 2nd 0xfffff800036806c0 pidhash (pidhash) @ kern/kern_proc.c:425 stack backtrace: #0 0xffffffff80c427b3 at witness_debugger+0x73 #1 0xffffffff80c424fe at witness_checkorder+0xa9e #2 0xffffffff80be0018 at _sx_slock_int+0x68 #3 0xffffffff80bb9d7e at pfind+0x6e #4 0xffffffff80b0ea89 at pfs_readdir+0x149 #5 0xffffffff81237458 at VOP_READDIR_APV+0x88 #6 0xffffffff80cbd37c at kern_getdirentries+0x21c #7 0xffffffff80cbd5a9 at sys_getdirentries+0x29 #8 0xffffffff8119a254 at amd64_syscall+0x2d4 #9 0xffffffff81171b70 at fast_syscall_common+0x101 20190902 10:07:47 all (235/669): pthread.sh 20190902 10:07:51 all (236/669): tmpfs5.sh 20190902 10:07:54 all (237/669): udp.sh 20190902 10:07:58 all (238/669): unix_socket.sh 20190902 10:08:01 all (239/669): devfd.sh 20190902 10:08:06 all (240/669): dup.sh 20190902 10:08:10 all (241/669): mkfifo6.sh 20190902 10:08:15 all (242/669): mmap13.sh 20190902 10:08:20 all (243/669): mountro4.sh 20190902 10:08:24 all (244/669): growfs.sh g_access(997): provider ufsid/5d6ccdf9fd635052 has error 6 set g_access(997): provider ufsid/5d6ccdf9fd635052 has error 6 set g_access(997): provider ufsid/5d6ccdf9fd635052 has error 6 set g_access(997): provider gptid/d6f98d45-cd58-11e9-943d-0cc47aa8cdda has error 6 set g_access(997): provider gptid/d6f98d45-cd58-11e9-943d-0cc47aa8cdda has error 6 set g_access(997): provider gptid/d6f98d45-cd58-11e9-943d-0cc47aa8cdda has error 6 set g_dev_taste: make_dev_p() failed (gp->name=gptid/d6f98d45-cd58-11e9-943d-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/d6f98d45-cd58-11e9-943d-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5d6ccdf9fd635052, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/d6f98d45-cd58-11e9-943d-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5d6ccdf9fd635052, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/d6f98d45-cd58-11e9-943d-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5d6ccdf9fd635052, error=17) GEOM leak: 14/87 20190902 10:08:30 all (245/669): procfs.sh 20190902 10:08:36 all (246/669): ptrace2.sh 20190902 10:08:41 all (247/669): rename11.sh 20190902 10:08:46 all (248/669): symlink4.sh 20190902 10:08:52 all (249/669): tmpfs10.sh 20190902 10:08:57 all (250/669): truncate3.sh 20190902 10:09:03 all (251/669): truncate7.sh 20190902 10:09:07 all (252/669): pshared.sh 20190902 10:09:13 all (253/669): datamove5.sh 20190902 10:09:20 all (254/669): fork.sh 20190902 10:09:26 all (255/669): linger3.sh 20190902 10:09:33 all (256/669): mlockall4.sh 20190902 10:09:40 all (257/669): ptrace9.sh 20190902 10:09:46 all (258/669): sparse.sh 20190902 10:09:54 all (259/669): linger2.sh Sep 2 10:09:58 mercat1 kernel: pid 77882 (linger2), uid 2007 inumber 888 on /mnt: filesystem full 20190902 10:10:01 all (260/669): linger4.sh Sep 2 10:10:06 mercat1 kernel: pid 79189 (linger4), uid 2007 inumber 39004 on /mnt: out of inodes 20190902 10:10:09 all (261/669): symlink2.sh 20190902 10:10:16 all (262/669): sysctl.sh 20190902 10:10:23 all (263/669): md8.sh 20190902 10:10:32 all (264/669): quota11.sh 20190902 10:10:41 all (265/669): shm_open.sh 20190902 10:10:49 all (266/669): compare.sh 20190902 10:10:59 all (267/669): ffs_blkfree.sh newblk leak: 26623/28681. 20190902 10:11:09 all (268/669): procfs3.sh 20190902 10:11:19 all (269/669): execve.sh 20190902 10:11:29 all (270/669): thr.sh witness_lock_list_get: witness exhausted 20190902 10:11:39 all (271/669): tmpfs8.sh 20190902 10:11:48 all (272/669): umountf4.sh freework leak: 156/197. 20190902 10:12:00 all (273/669): rename8.sh 20190902 10:12:10 all (274/669): fsck5.sh 20190902 10:12:21 all (275/669): nfs15lockd2.sh 20190902 10:12:32 all (276/669): proccontrol.sh 20190902 10:12:43 all (277/669): rdgsbase.sh 20190902 10:12:54 all (278/669): rename9.sh 20190902 10:13:06 all (279/669): mprotect2.sh 20190902 10:13:19 all (280/669): posix_fadvise3.sh 20190902 10:13:31 all (281/669): tmpfs14.sh 20190902 10:13:43 all (282/669): pipe2.sh 20190902 10:13:56 all (283/669): umountf11.sh 20190902 10:14:09 all (284/669): umountf12.sh 20190902 10:14:23 all (285/669): umountf6.sh 20190902 10:14:36 all (286/669): recursiveflushes.sh 20190902 10:14:49 all (287/669): radix.sh Sep 2 10:14:55 mercat1 kernel: pid 71631 (radix), jid 0, uid 0, was killed: out of swap space 20190902 10:15:02 all (288/669): suj10.sh 20190902 10:15:18 all (289/669): mountu.sh 20190902 10:15:36 all (290/669): rdwr.sh 20190902 10:15:53 all (291/669): sem.sh 20190902 10:16:11 all (292/669): kevent6.sh 20190902 10:16:30 all (293/669): suj14.sh Sep 2 10:16:46 mercat1 kernel: pid 9144 (cp), uid 0 inumber 41776 on /mnt: filesystem full Sep 2 10:16:46 mercat1 kernel: pid 9144 (cp), uid 0 inumber 41813 on /mnt: filesystem full Sep 2 10:16:48 mercat1 kernel: pid 9144 (cp), uid 0 inumber 41845 on /mnt: filesystem full Sep 2 10:16:49 mercat1 kernel: pid 9171 (mkdir), uid 0 inumber 238292 on /mnt: filesystem full Sep 2 10:16:49 mercat1 kernel: pid 9980 (mkdir), uid 0 inumber 238292 on /mnt: filesystem full 20190902 10:16:51 all (294/669): mountro6.sh 20190902 10:17:13 all (295/669): multicast.sh 20190902 10:17:34 all (296/669): rename7.sh 20190902 10:17:55 all (297/669): tmpfs19.sh 20190902 10:18:25 all (298/669): core4.sh Sep 2 10:18:29 mercat1 kernel: Failed to write core file for process core4 (error 5) 20190902 10:18:48 all (299/669): sendfile5.sh 20190902 10:19:12 all (300/669): f_offset.sh Sep 2 10:18:48 mercat1 syslogd: last message repeated 59 times 20190902 10:19:37 all (301/669): tmpfs2.sh 20190902 10:20:01 all (302/669): pread.sh 20190902 10:20:27 all (303/669): mmap7.sh 20190902 10:20:52 all (304/669): sendmsg2.sh 20190902 10:21:18 all (305/669): multicast2.sh Sep 2 10:21:23 mercat1 mDNSResponder[9069]: mDNSResponder (Engineering Build) (Jul 27 2019 06:17:54) starting Sep 2 10:21:23 mercat1 mDNSResponder[9069]: mDNS_AddDNSServer: Lock not held! mDNS_busy (0) mDNS_reentrancy (0) Sep 2 10:21:23 mercat1 mDNSResponder[9069]: mDNSPlatformSourceAddrForDest: connect 1.1.1.1 failed errno 51 (Network is unreachable) if_delmulti_locked: detaching ifnet instance 0xfffff800044ce000 if_delmulti_locked: detaching ifnet instance 0xfffff8080fa4d800 if_delmulti_locked: detaching ifnet instance 0xfffff8080fa4d800 if_delmulti_locked: detaching ifnet instance 0xfffff8080fa4d800 if_delmulti_locked: detaching ifnet instance 0xfffff8080fa4d800 if_delmulti_locked: detaching ifnet instance 0xfffff8080fa4d800 if_delmulti_locked: detaching ifnet instance 0xfffff8080fa4d800 if_delmulti_locked: detaching ifnet instance 0xfffff8080fa4d800 if_delmulti_locked: detaching ifnet instance 0xfffff800044ce000 Sep 2 10:21:36 mercat1 mDNSResponder[9069]: mDNSResponder (Engineering Build) (Jul 27 2019 06:17:54) stopping if_delmulti_locked: detaching ifnet instance 0xfffff800044ce000 20190902 10:21:41 all (306/669): beneath.sh 20190902 10:22:09 all (307/669): sendfile3.sh 20190902 10:22:37 all (308/669): namecache2.sh 20190902 10:23:05 all (309/669): split.sh 20190902 10:23:18 all (310/669): mkfifo3.sh 20190902 10:23:50 all (311/669): mmap37.sh 20190902 10:24:22 all (312/669): credleak.sh 20190902 10:24:56 all (313/669): pthread5.sh 20190902 10:25:59 all (314/669): tcp4.sh Expensive timeout(9) function: 0xffffffff80e09380(0xfffff8060138b000) 0.244964899 s Expensive timeout(9) function: 0xffffffff80e0a2e0(0xfffff804f2ad83d0) 0.246031641 s 20190902 10:26:31 all (315/669): msdos5.sh GEOM leak: 19/106 20190902 10:27:06 all (316/669): core2.sh 20190902 10:27:41 all (317/669): nullfs22.sh 20190902 10:28:15 all (318/669): rename3.sh 20190902 10:28:50 all (319/669): umountf5.sh Sep 2 10:28:53 mercat1 kernel: pid 12806 (mkdir), uid 0 inumber 383 on /mnt: out of inodes Sep 2 10:28:55 mercat1 kernel: pid 12807 (mkdir), uid 0 inumber 1526 on /mnt: out of inodes Sep 2 10:28:56 mercat1 kernel: pid 12802 (mkdir), uid 0 inumber 1141 on /mnt: out of inodes Sep 2 10:28:58 mercat1 kernel: pid 12800 (mkdir), uid 0 inumber 1531 on /mnt: out of inodes Sep 2 10:28:59 mercat1 kernel: pid 12811 (mkdir), uid 0 inumber 1139 on /mnt: out of inodes Sep 2 10:29:00 mercat1 kernel: pid 12801 (mkdir), uid 0 inumber 1432 on /mnt: out of inodes Sep 2 10:29:01 mercat1 kernel: pid 12804 (mkdir), uid 0 inumber 1527 on /mnt: out of inodes 20190902 10:29:23 all (320/669): umountf.sh 20190902 10:31:11 all (321/669): suj33.sh 20190902 10:32:09 all (322/669): vnodes.sh 20190902 10:32:52 all (323/669): quota8.sh newblk leak: 1/28682. 20190902 10:33:42 all (324/669): mmap5.sh 20190902 10:34:39 all (325/669): crossmp7.sh ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Warning: memory type solaris leaked memory on destroy (4 allocations, 2112 bytes leaked). 20190902 10:35:25 all (326/669): fpu.sh 20190902 10:36:20 all (327/669): ufsbench.sh 20190902 10:37:14 all (328/669): crossmp5.sh 20190902 10:38:05 all (329/669): nullfs11.sh 20190902 10:39:00 all (330/669): posix_openpt.sh 20190902 10:39:56 all (331/669): fifo3.sh 20190902 10:40:52 all (332/669): advlock.sh 20190902 10:41:54 all (333/669): bench.sh 20190902 10:43:03 all (334/669): flock.sh 20190902 10:44:04 all (335/669): fsgs.sh 20190902 10:45:05 all (336/669): fts2.sh 20190902 10:46:06 all (337/669): fullpath.sh 20190902 10:47:08 all (338/669): jumbo.sh 20190902 10:48:09 all (339/669): mdconfig2.sh 20190902 10:49:10 all (340/669): midi2.sh 20190902 10:50:11 all (341/669): mknod.sh 20190902 10:51:12 all (342/669): mmap29.sh 20190902 10:52:14 all (343/669): pts3.sh newblk leak: 1697/30379. 20190902 10:53:16 all (344/669): sem_wait.sh 20190902 10:54:17 all (345/669): sigstop2.sh 20190902 10:55:18 all (346/669): socketpair3.sh 20190902 10:56:19 all (347/669): fsck.sh Superblock check-hash failed: recorded check-hash 0x2cc855ec != computed check-hash 0x5f3fc6d5 (Ignored) Superblock check-hash failed: recorded check-hash 0x2cc855ec != computed check-hash 0x5f3fc6d5 (Ignored) Sep 2 10:56:58 mercat1 kernel: pid 77506 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:58 mercat1 kernel: pid 77529 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:58 mercat1 kernel: pid 77552 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 77575 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 77598 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 77621 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 77644 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 77667 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 77690 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 77713 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 77736 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 77759 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 77782 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 77805 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 77828 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 77851 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 77874 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 77897 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 77920 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 77943 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 77966 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 77989 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 78012 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 78035 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 78058 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 78081 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 78104 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 78127 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 78150 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 78173 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 78196 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 78219 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 78242 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 78265 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 78288 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:56:59 mercat1 kernel: pid 78311 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 78334 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 78357 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 78380 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 78403 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 78426 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 78449 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 78472 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 78495 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 78518 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 78541 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 78564 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 78587 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 78610 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 78633 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 78656 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 78679 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 78702 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 78725 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 78748 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 78771 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 78794 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 78817 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 78840 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 78863 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 78886 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 78909 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 78932 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 78955 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 78978 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 79001 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 79024 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:00 mercat1 kernel: pid 79047 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:01 mercat1 kernel: pid 79070 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:01 mercat1 kernel: pid 79093 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:01 mercat1 kernel: pid 79116 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:01 mercat1 kernel: pid 79139 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:01 mercat1 kernel: pid 79162 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:01 mercat1 kernel: pid 79185 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:01 mercat1 kernel: pid 79208 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:01 mercat1 kernel: pid 79231 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:01 mercat1 kernel: pid 79254 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:01 mercat1 kernel: pid 79277 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:01 mercat1 kernel: pid 79300 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:01 mercat1 kernel: pid 79323 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:01 mercat1 kernel: pid 79346 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:01 mercat1 kernel: pid 79397 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:01 mercat1 kernel: pid 79420 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:01 mercat1 kernel: pid 79471 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:01 mercat1 kernel: pid 79494 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:01 mercat1 kernel: pid 79517 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:01 mercat1 kernel: pid 79540 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:01 mercat1 kernel: pid 79563 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:01 mercat1 kernel: pid 79586 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:01 mercat1 kernel: pid 79609 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:01 mercat1 kernel: pid 79632 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:01 mercat1 kernel: pid 79655 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:01 mercat1 kernel: pid 79678 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:01 mercat1 kernel: pid 79701 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:01 mercat1 kernel: pid 79724 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:01 mercat1 kernel: pid 79747 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:01 mercat1 kernel: pid 79770 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:01 mercat1 kernel: pid 79793 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 79816 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 79839 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 79862 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 79885 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 79908 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 79931 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 79954 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 79977 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 80000 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 80023 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 80046 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 80069 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 80092 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 80115 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 80138 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 80161 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 80184 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 80207 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 80230 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 80253 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 80276 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 80299 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 80322 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 80345 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 80368 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 80391 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 80414 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 80437 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 80460 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 80483 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 80506 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:02 mercat1 kernel: pid 80529 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 80552 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 80575 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 80598 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 80621 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 80644 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 80667 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 80690 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 80713 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 80764 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 80787 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 80810 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 80833 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 80856 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 80879 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 80902 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 80925 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 80948 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 80971 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 80994 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 81017 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 81040 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 81063 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 81086 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 81109 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 81132 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 81155 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 81178 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 81201 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 81224 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 81247 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 81270 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:03 mercat1 kernel: pid 81293 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:04 mercat1 kernel: pid 81316 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:04 mercat1 kernel: pid 81339 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:04 mercat1 kernel: pid 81362 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:04 mercat1 kernel: pid 81385 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:04 mercat1 kernel: pid 81408 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:04 mercat1 kernel: pid 81431 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:04 mercat1 kernel: pid 81454 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:04 mercat1 kernel: pid 81477 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:04 mercat1 kernel: pid 81500 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:04 mercat1 kernel: pid 81523 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:04 mercat1 kernel: pid 81546 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:04 mercat1 kernel: pid 81569 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:04 mercat1 kernel: pid 81592 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:04 mercat1 kernel: pid 81615 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:04 mercat1 kernel: pid 81638 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:04 mercat1 kernel: pid 81661 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:04 mercat1 kernel: pid 81684 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:04 mercat1 kernel: pid 81707 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:04 mercat1 kernel: pid 81730 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:04 mercat1 kernel: pid 81781 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:04 mercat1 kernel: pid 81804 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:04 mercat1 kernel: pid 81855 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:04 mercat1 kernel: pid 81878 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:04 mercat1 kernel: pid 81901 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:04 mercat1 kernel: pid 81924 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:04 mercat1 kernel: pid 81947 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:04 mercat1 kernel: pid 81970 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:04 mercat1 kernel: pid 81993 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:04 mercat1 kernel: pid 82016 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:05 mercat1 kernel: pid 82067 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:05 mercat1 kernel: pid 82090 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:05 mercat1 kernel: pid 82113 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:05 mercat1 kernel: pid 82136 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:05 mercat1 kernel: pid 82159 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:05 mercat1 kernel: pid 82182 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:05 mercat1 kernel: pid 82205 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:05 mercat1 kernel: pid 82228 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:05 mercat1 kernel: pid 82251 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:05 mercat1 kernel: pid 82274 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:05 mercat1 kernel: pid 82297 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:05 mercat1 kernel: pid 82320 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:05 mercat1 kernel: pid 82343 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:05 mercat1 kernel: pid 82366 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:05 mercat1 kernel: pid 82389 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:05 mercat1 kernel: pid 82440 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:05 mercat1 kernel: pid 82463 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:05 mercat1 kernel: pid 82486 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:05 mercat1 kernel: pid 82509 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:05 mercat1 kernel: pid 82532 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:05 mercat1 kernel: pid 82555 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:05 mercat1 kernel: pid 82578 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:05 mercat1 kernel: pid 82601 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:05 mercat1 kernel: pid 82624 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:05 mercat1 kernel: pid 82647 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:05 mercat1 kernel: pid 82670 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:05 mercat1 kernel: pid 82693 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:05 mercat1 kernel: pid 82744 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:05 mercat1 kernel: pid 82767 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:06 mercat1 kernel: pid 82790 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:06 mercat1 kernel: pid 82813 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:06 mercat1 kernel: pid 82836 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:06 mercat1 kernel: pid 82859 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:06 mercat1 kernel: pid 82910 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:06 mercat1 kernel: pid 82933 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:06 mercat1 kernel: pid 82956 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:06 mercat1 kernel: pid 82979 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:06 mercat1 kernel: pid 83030 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:06 mercat1 kernel: pid 83053 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:06 mercat1 kernel: pid 83076 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:06 mercat1 kernel: pid 83099 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:06 mercat1 kernel: pid 83122 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:06 mercat1 kernel: pid 83145 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:06 mercat1 kernel: pid 83168 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:06 mercat1 kernel: pid 83191 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:06 mercat1 kernel: pid 83214 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:06 mercat1 kernel: pid 83237 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:06 mercat1 kernel: pid 83260 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:06 mercat1 kernel: pid 83283 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:06 mercat1 kernel: pid 83306 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:06 mercat1 kernel: pid 83329 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:06 mercat1 kernel: pid 83380 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:06 mercat1 kernel: pid 83403 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:06 mercat1 kernel: pid 83426 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:06 mercat1 kernel: pid 83449 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:06 mercat1 kernel: pid 83472 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:06 mercat1 kernel: pid 83495 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:07 mercat1 kernel: pid 83518 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:07 mercat1 kernel: pid 83541 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:07 mercat1 kernel: pid 83564 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:07 mercat1 kernel: pid 83587 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:07 mercat1 kernel: pid 83610 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:07 mercat1 kernel: pid 83633 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:07 mercat1 kernel: pid 83684 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:07 mercat1 kernel: pid 83707 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:07 mercat1 kernel: pid 83730 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:07 mercat1 kernel: pid 83753 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:07 mercat1 kernel: pid 83776 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:07 mercat1 kernel: pid 83799 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:07 mercat1 kernel: pid 83822 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:07 mercat1 kernel: pid 83845 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:07 mercat1 kernel: pid 83868 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:07 mercat1 kernel: pid 83891 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:07 mercat1 kernel: pid 83914 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:07 mercat1 kernel: pid 83937 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:07 mercat1 kernel: pid 83960 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:07 mercat1 kernel: pid 83983 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:07 mercat1 kernel: pid 84006 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:07 mercat1 kernel: pid 84029 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:07 mercat1 kernel: pid 84052 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:07 mercat1 kernel: pid 84075 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:07 mercat1 kernel: pid 84098 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:07 mercat1 kernel: pid 84121 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:07 mercat1 kernel: pid 84144 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:07 mercat1 kernel: pid 84167 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:07 mercat1 kernel: pid 84190 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:07 mercat1 kernel: pid 84213 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:07 mercat1 kernel: pid 84236 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:08 mercat1 kernel: pid 84259 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:08 mercat1 kernel: pid 84282 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:08 mercat1 kernel: pid 84305 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:08 mercat1 kernel: pid 84328 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:08 mercat1 kernel: pid 84351 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:08 mercat1 kernel: pid 84374 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:08 mercat1 kernel: pid 84397 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:08 mercat1 kernel: pid 84420 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:08 mercat1 kernel: pid 84443 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:08 mercat1 kernel: pid 84466 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:08 mercat1 kernel: pid 84489 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:08 mercat1 kernel: pid 84512 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:08 mercat1 kernel: pid 84535 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:08 mercat1 kernel: pid 84558 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:08 mercat1 kernel: pid 84581 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:08 mercat1 kernel: pid 84604 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:08 mercat1 kernel: pid 84627 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:08 mercat1 kernel: pid 84654 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:08 mercat1 kernel: pid 84686 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:08 mercat1 kernel: pid 84781 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:08 mercat1 kernel: pid 84879 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:08 mercat1 kernel: pid 84977 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:08 mercat1 kernel: pid 85072 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:08 mercat1 kernel: pid 85170 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:08 mercat1 kernel: pid 85265 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:08 mercat1 kernel: pid 85363 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:08 mercat1 kernel: pid 85458 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:08 mercat1 kernel: pid 85538 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:08 mercat1 kernel: pid 85687 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:08 mercat1 kernel: pid 85752 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:08 mercat1 kernel: pid 85819 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:09 mercat1 kernel: pid 85884 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:09 mercat1 kernel: pid 85950 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:09 mercat1 kernel: pid 86016 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:09 mercat1 kernel: pid 86081 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:09 mercat1 kernel: pid 86146 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:09 mercat1 kernel: pid 86213 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:09 mercat1 kernel: pid 86278 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:09 mercat1 kernel: pid 86301 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:09 mercat1 kernel: pid 86324 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:09 mercat1 kernel: pid 86347 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:09 mercat1 kernel: pid 86370 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:09 mercat1 kernel: pid 86393 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:09 mercat1 kernel: pid 86416 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:09 mercat1 kernel: pid 86439 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:09 mercat1 kernel: pid 86462 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:09 mercat1 kernel: pid 86485 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:09 mercat1 kernel: pid 86508 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:09 mercat1 kernel: pid 86531 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:09 mercat1 kernel: pid 86554 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:09 mercat1 kernel: pid 86577 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:09 mercat1 kernel: pid 86600 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:09 mercat1 kernel: pid 86623 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:09 mercat1 kernel: pid 86646 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:09 mercat1 kernel: pid 86697 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:09 mercat1 kernel: pid 86720 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:09 mercat1 kernel: pid 86817 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:09 mercat1 kernel: pid 86840 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:10 mercat1 kernel: pid 86863 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:10 mercat1 kernel: pid 86914 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:10 mercat1 kernel: pid 86937 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:10 mercat1 kernel: pid 86960 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:10 mercat1 kernel: pid 86983 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:10 mercat1 kernel: pid 87006 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:10 mercat1 kernel: pid 87029 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:10 mercat1 kernel: pid 87052 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:10 mercat1 kernel: pid 87075 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:10 mercat1 kernel: pid 87098 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:10 mercat1 kernel: pid 87121 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:10 mercat1 kernel: pid 87144 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:10 mercat1 kernel: pid 87167 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:10 mercat1 kernel: pid 87190 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:10 mercat1 kernel: pid 87213 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:10 mercat1 kernel: pid 87236 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:10 mercat1 kernel: pid 87259 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:10 mercat1 kernel: pid 87282 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:10 mercat1 kernel: pid 87305 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:10 mercat1 kernel: pid 87328 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:10 mercat1 kernel: pid 87351 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:10 mercat1 kernel: pid 87374 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:10 mercat1 kernel: pid 87397 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:10 mercat1 kernel: pid 87420 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:10 mercat1 kernel: pid 87443 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:10 mercat1 kernel: pid 87466 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:10 mercat1 kernel: pid 87489 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:10 mercat1 kernel: pid 87512 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:10 mercat1 kernel: pid 87535 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:10 mercat1 kernel: pid 87558 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:10 mercat1 kernel: pid 87581 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 87604 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 87627 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 87650 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 87673 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 87696 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 87719 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 87742 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 87765 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 87788 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 87811 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 87834 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 87857 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 87880 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 87903 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 87926 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 87949 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 87972 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 87995 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 88018 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 88041 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 88064 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 88087 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 88110 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 88133 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 88156 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 88179 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 88202 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 88225 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 88248 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 88271 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 88294 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:11 mercat1 kernel: pid 88317 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:12 mercat1 kernel: pid 88368 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:12 mercat1 kernel: pid 88391 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:12 mercat1 kernel: pid 88414 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:12 mercat1 kernel: pid 88437 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:12 mercat1 kernel: pid 88460 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:12 mercat1 kernel: pid 88483 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:12 mercat1 kernel: pid 88506 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:12 mercat1 kernel: pid 88529 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:12 mercat1 kernel: pid 88552 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:12 mercat1 kernel: pid 88575 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:12 mercat1 kernel: pid 88598 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:12 mercat1 kernel: pid 88621 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:12 mercat1 kernel: pid 88644 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:12 mercat1 kernel: pid 88667 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:12 mercat1 kernel: pid 88690 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:12 mercat1 kernel: pid 88713 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:12 mercat1 kernel: pid 88736 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:12 mercat1 kernel: pid 88759 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:12 mercat1 kernel: pid 88782 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:12 mercat1 kernel: pid 88805 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:12 mercat1 kernel: pid 88828 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:12 mercat1 kernel: pid 88851 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:12 mercat1 kernel: pid 88874 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:12 mercat1 kernel: pid 88897 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:12 mercat1 kernel: pid 88920 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:12 mercat1 kernel: pid 88943 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:12 mercat1 kernel: pid 88966 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:12 mercat1 kernel: pid 88989 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:12 mercat1 kernel: pid 89012 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:12 mercat1 kernel: pid 89035 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:12 mercat1 kernel: pid 89058 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:13 mercat1 kernel: pid 89081 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:13 mercat1 kernel: pid 89104 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:13 mercat1 kernel: pid 89127 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:13 mercat1 kernel: pid 89150 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:13 mercat1 kernel: pid 89173 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:13 mercat1 kernel: pid 89196 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:13 mercat1 kernel: pid 89219 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:13 mercat1 kernel: pid 89242 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:13 mercat1 kernel: pid 89265 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:13 mercat1 kernel: pid 89288 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:13 mercat1 kernel: pid 89311 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:13 mercat1 kernel: pid 89339 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:13 mercat1 kernel: pid 89362 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:13 mercat1 kernel: pid 89385 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:13 mercat1 kernel: pid 89408 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:13 mercat1 kernel: pid 89459 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:13 mercat1 kernel: pid 89482 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:13 mercat1 kernel: pid 89505 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:13 mercat1 kernel: pid 89528 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:13 mercat1 kernel: pid 89551 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:13 mercat1 kernel: pid 89574 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:13 mercat1 kernel: pid 89597 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:13 mercat1 kernel: pid 89620 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:13 mercat1 kernel: pid 89643 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:13 mercat1 kernel: pid 89666 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:13 mercat1 kernel: pid 89689 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:13 mercat1 kernel: pid 89712 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:13 mercat1 kernel: pid 89735 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:13 mercat1 kernel: pid 89758 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:13 mercat1 kernel: pid 89781 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:13 mercat1 kernel: pid 89804 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:14 mercat1 kernel: pid 89827 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:14 mercat1 kernel: pid 89850 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:14 mercat1 kernel: pid 89873 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:14 mercat1 kernel: pid 89896 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:14 mercat1 kernel: pid 89919 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:14 mercat1 kernel: pid 89942 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:14 mercat1 kernel: pid 89965 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:14 mercat1 kernel: pid 89988 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:14 mercat1 kernel: pid 90011 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:14 mercat1 kernel: pid 90034 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:14 mercat1 kernel: pid 90057 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:14 mercat1 kernel: pid 90080 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:14 mercat1 kernel: pid 90103 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:14 mercat1 kernel: pid 90126 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:14 mercat1 kernel: pid 90149 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:14 mercat1 kernel: pid 90172 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:14 mercat1 kernel: pid 90195 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:14 mercat1 kernel: pid 90218 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:14 mercat1 kernel: pid 90241 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:14 mercat1 kernel: pid 90264 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:14 mercat1 kernel: pid 90287 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:14 mercat1 kernel: pid 90310 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:14 mercat1 kernel: pid 90333 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:14 mercat1 kernel: pid 90356 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:14 mercat1 kernel: pid 90379 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:14 mercat1 kernel: pid 90402 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:14 mercat1 kernel: pid 90425 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:14 mercat1 kernel: pid 90476 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:14 mercat1 kernel: pid 90499 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:14 mercat1 kernel: pid 90522 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:14 mercat1 kernel: pid 90545 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 90568 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 90591 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 90614 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 90637 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 90660 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 90683 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 90706 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 90729 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 90752 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 90775 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 90798 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 90821 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 90844 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 90867 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 90890 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 90913 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 90936 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 90959 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 90982 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 91005 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 91028 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 91051 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 91074 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 91097 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 91120 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 91143 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 91171 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 91194 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 91217 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 91240 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 91263 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:15 mercat1 kernel: pid 91286 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:16 mercat1 kernel: pid 91309 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:16 mercat1 kernel: pid 91332 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:16 mercat1 kernel: pid 91355 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:16 mercat1 kernel: pid 91378 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:16 mercat1 kernel: pid 91401 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:16 mercat1 kernel: pid 91424 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:16 mercat1 kernel: pid 91447 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:16 mercat1 kernel: pid 91470 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:16 mercat1 kernel: pid 91521 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:16 mercat1 kernel: pid 91544 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:16 mercat1 kernel: pid 91567 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:16 mercat1 kernel: pid 91590 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:16 mercat1 kernel: pid 91613 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:16 mercat1 kernel: pid 91636 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:16 mercat1 kernel: pid 91659 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:16 mercat1 kernel: pid 91682 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:16 mercat1 kernel: pid 91705 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:16 mercat1 kernel: pid 91728 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:16 mercat1 kernel: pid 91751 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:16 mercat1 kernel: pid 91802 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:16 mercat1 kernel: pid 91825 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:16 mercat1 kernel: pid 91848 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:16 mercat1 kernel: pid 91871 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:16 mercat1 kernel: pid 91894 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:16 mercat1 kernel: pid 91917 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:16 mercat1 kernel: pid 91940 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:16 mercat1 kernel: pid 91963 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:16 mercat1 kernel: pid 91986 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:16 mercat1 kernel: pid 92009 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:16 mercat1 kernel: pid 92032 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:17 mercat1 kernel: pid 92055 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:17 mercat1 kernel: pid 92078 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:17 mercat1 kernel: pid 92101 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:17 mercat1 kernel: pid 92124 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:17 mercat1 kernel: pid 92147 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:17 mercat1 kernel: pid 92170 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:17 mercat1 kernel: pid 92193 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:17 mercat1 kernel: pid 92216 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:17 mercat1 kernel: pid 92295 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:17 mercat1 kernel: pid 92318 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:17 mercat1 kernel: pid 92341 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:17 mercat1 kernel: pid 92364 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:17 mercat1 kernel: pid 92387 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:17 mercat1 kernel: pid 92410 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:17 mercat1 kernel: pid 92433 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:17 mercat1 kernel: pid 92456 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:17 mercat1 kernel: pid 92479 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:17 mercat1 kernel: pid 92502 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:17 mercat1 kernel: pid 92525 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:17 mercat1 kernel: pid 92548 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:17 mercat1 kernel: pid 92571 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:17 mercat1 kernel: pid 92594 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:17 mercat1 kernel: pid 92617 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:17 mercat1 kernel: pid 92640 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:17 mercat1 kernel: pid 92663 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:17 mercat1 kernel: pid 92686 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:17 mercat1 kernel: pid 92709 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:17 mercat1 kernel: pid 92732 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:17 mercat1 kernel: pid 92755 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:17 mercat1 kernel: pid 92778 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:18 mercat1 kernel: pid 92801 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:18 mercat1 kernel: pid 92824 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:18 mercat1 kernel: pid 92847 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:18 mercat1 kernel: pid 92870 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:18 mercat1 kernel: pid 92893 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:18 mercat1 kernel: pid 92916 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:18 mercat1 kernel: pid 92939 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:18 mercat1 kernel: pid 92962 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:18 mercat1 kernel: pid 92985 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:18 mercat1 kernel: pid 93008 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:18 mercat1 kernel: pid 93031 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:18 mercat1 kernel: pid 93054 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:18 mercat1 kernel: pid 93077 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:18 mercat1 kernel: pid 93100 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:18 mercat1 kernel: pid 93123 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:18 mercat1 kernel: pid 93146 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:18 mercat1 kernel: pid 93169 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:18 mercat1 kernel: pid 93192 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:18 mercat1 kernel: pid 93215 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:18 mercat1 kernel: pid 93238 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:18 mercat1 kernel: pid 93289 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:18 mercat1 kernel: pid 93312 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:18 mercat1 kernel: pid 93335 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:18 mercat1 kernel: pid 93386 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:18 mercat1 kernel: pid 93409 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:18 mercat1 kernel: pid 93432 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:18 mercat1 kernel: pid 93455 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:18 mercat1 kernel: pid 93506 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:19 mercat1 kernel: pid 93529 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:19 mercat1 kernel: pid 93552 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:19 mercat1 kernel: pid 93575 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:19 mercat1 kernel: pid 93598 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:19 mercat1 kernel: pid 93621 (touch), uid 0 inumberSuperblock check-hash failed: recorded check-hash 0xc655985d != computed check-hash 0x8a1f0860 (Ignored) Superblock check-hash failed: recorded check-hash 0xc655985d != computed check-hash 0x8a1f0860 (Ignored) 2 on /mnt11: out of inodes Sep 2 10:57:19 mercat1 kernel: pid 93643 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:19 mercat1 kernel: pid 93666 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:19 mercat1 kernel: pid 93689 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:19 mercat1 kernel: pid 93712 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:19 mercat1 kernel: pid 93735 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:19 mercat1 kernel: pid 93758 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:19 mercat1 kernel: pid 93781 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:19 mercat1 kernel: pid 93804 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:19 mercat1 kernel: pid 93831 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:19 mercat1 kernel: pid 93875 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:19 mercat1 kernel: pid 93973 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:19 mercat1 kernel: pid 94068 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:19 mercat1 kernel: pid 94166 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:19 mercat1 kernel: pid 94261 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:19 mercat1 kernel: pid 94359 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:19 mercat1 kernel: pid 94454 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:19 mercat1 kernel: pid 94552 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:19 mercat1 kernel: pid 94647 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:19 mercat1 kernel: pid 94721 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:19 mercat1 kernel: pid 94788 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:19 mercat1 kernel: pid 94853 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:19 mercat1 kernel: pid 94918 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:19 mercat1 kernel: pid 95067 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:19 mercat1 kernel: pid 95134 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 95199 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 95266 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 95331 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 95396 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 95455 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 95478 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 95501 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 95524 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 95547 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 95570 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 95593 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 95616 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 95639 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 95662 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 95685 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 95708 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 95731 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 95754 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 95777 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 95800 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 95823 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 95846 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 95869 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 95892 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 95915 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 95938 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 95961 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 95984 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 96007 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 96030 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 96053 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 96076 (touch), uid 0 inumber 2 on /mnt11: out of inodes Sep 2 10:57:20 mercat1 kernel: pid 96099 (touch), uid 0 inumber 2 on /mnt11: out of inodes 20190902 10:57:21 all (348/669): sendfile8.sh 20190902 10:58:23 all (349/669): sendfile9.sh 20190902 10:59:24 all (350/669): shm.sh 20190902 11:00:26 all (351/669): sendfile_shm.sh 20190902 11:01:50 all (352/669): crossmp8.sh 20190902 11:02:53 all (353/669): tcp3.sh 20190902 11:03:56 all (354/669): exlock.sh 20190902 11:05:01 all (355/669): rename10.sh 20190902 11:06:08 all (356/669): suj5.sh 20190902 11:07:21 all (357/669): truss2.sh 20190902 11:08:52 all (358/669): suj6.sh 20190902 11:10:06 all (359/669): stack_guard_page.sh Sep 2 11:10:18 mercat1 kernel: pid 76684 (rw), uid 2007 inumber 18992 on /mnt: filesystem full Sep 2 11:10:25 mercat1 kernel: pid 76736 (openat), uid 2007 inumber 98370 on /mnt: out of inodes 20190902 11:11:19 all (360/669): vmstat.sh 20190902 11:12:30 all (361/669): quota4.sh 20190902 11:14:46 all (362/669): mountro5.sh 20190902 11:16:05 all (363/669): zfs6.sh ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Warning: memory type solaris leaked memory on destroy (4 allocations, 2112 bytes leaked). 20190902 11:17:30 all (364/669): crossmp.sh 20190902 11:18:52 all (365/669): overcommit2.sh Sep 2 11:20:04 mercat1 kernel: pid 64262 (dd), uid 0 inumber 6 on /mnt: filesystem full uid 0, pid 67990: swap reservation for 12288 bytes failed Sep 2 09:20:14 mercat1 atrun[67990]: cannot read /var/at/jobs/: Cannot allocate memory 20190902 11:20:16 all (366/669): pthread2.sh 20190902 11:21:48 all (367/669): tmpfs12.sh Sep 2 11:22:15 mercat1 kernel: pid 74829 (swap), jid 0, uid 0, was killed: out of swap space Sep 2 11:22:29 mercat1 kernel: pid 74827 (swap), jid 0, uid 0, was killed: out of swap space 20190902 11:23:21 all (368/669): alternativeFlushPath.sh Sep 2 11:24:36 mercat1 kernel: pid 76453 (alternativeFlushPat), uid 0 inumber 265 on /tmp: out of inodes 20190902 11:24:41 all (369/669): pmc6.sh 20190902 11:26:19 all (370/669): dd.sh Sep 2 11:26:56 mercat1 kernel: pid 97256 (dd), uid 0 inumber 481542 on /tmp: filesystem full 20190902 11:26:56 all (371/669): mmap18.sh 20190902 11:28:28 all (372/669): pthread7.sh 20190902 11:30:10 all (373/669): ptrace10.sh 20190902 11:31:59 all (374/669): umountf2.sh 20190902 11:33:47 all (375/669): pthread3.sh 20190902 11:35:39 all (376/669): msdos10.sh 20190902 11:37:26 all (377/669): mmap21.sh Sep 2 11:38:25 mercat1 kernel: pid 92717 (mmap21), uid 2007 inumber 273 on /tmp: filesystem full Sep 2 11:38:25 mercat1 kernel: Failed to write core file for process mmap21 (error 28) Sep 2 11:38:36 mercat1 kernel: pid 92718 (mmap21), uid 2007 inumber 273 on /tmp: filesystem full Sep 2 11:38:36 mercat1 kernel: Failed to write core file for process mmap21 (error 28) 20190902 11:38:36 all (378/669): fifo2.sh 20190902 11:40:37 all (379/669): kevent.sh 20190902 11:42:39 all (380/669): kevent14.sh 20190902 11:44:40 all (381/669): midi.sh 20190902 11:46:41 all (382/669): overflow3.sh 20190902 11:48:43 all (383/669): sendfile10.sh 20190902 11:50:45 all (384/669): gnop2.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. 20190902 11:52:42 all (385/669): setsockopt2.sh 20190902 11:54:44 all (386/669): poll2.sh 20190902 11:56:46 all (387/669): ftruncate3.sh GEOM leak: 10/116 20190902 11:58:48 all (388/669): mmap27.sh 20190902 12:00:53 all (389/669): shm2.sh Sep 2 12:01:44 mercat1 kernel: pid 79709 (swap), jid 0, uid 0, was killed: out of swap space 20190902 12:02:57 all (390/669): snap11.sh 20190902 12:05:01 all (391/669): truncate9.sh 20190902 12:07:04 all (392/669): graid1_3.sh g_access(997): provider ufsid/5d6ccdf9fd635052 has error 6 set g_access(997): provider gptid/d6f98d45-cd58-11e9-943d-0cc47aa8cdda has error 6 set 20190902 12:09:08 all (393/669): vm_map.sh 20190902 12:11:12 all (394/669): fts3.sh 20190902 12:13:19 all (395/669): graid1_10.sh g_access(997): provider ufsid/5d6ccdf9fd635052 has error 6 set g_access(997): provider gptid/d6f98d45-cd58-11e9-943d-0cc47aa8cdda has error 6 set 20190902 12:15:25 all (396/669): tmpfs13.sh 20190902 12:17:32 all (397/669): mmap31.sh 20190902 12:20:08 all (398/669): racct.sh Sep 2 12:20:56 mercat1 kernel: pid 7957 (swap), jid 0, uid 0, was killed: out of swap space 20190902 12:22:14 all (399/669): swappedout.sh 20190902 12:24:24 all (400/669): contigmalloc.sh 20190902 12:26:32 all (401/669): fpclone.sh newblk leak: 8490/38869. 20190902 12:28:33 all (402/669): kevent4.sh 20190902 12:30:41 all (403/669): arp.sh Sep 2 12:31:24 mercat1 kernel: pid 30255 (swap), jid 0, uid 0, was killed: out of swap space 20190902 12:32:57 all (404/669): fifo4.sh 20190902 12:35:01 all (405/669): nullfs18.sh 20190902 12:37:10 all (406/669): truncate2.sh 20190902 12:39:17 all (407/669): vmstat2.sh Sep 2 12:39:57 mercat1 kernel: pid 66680 (swap), jid 0, uid 0, was killed: out of swap space 20190902 12:41:34 all (408/669): pthread4.sh 20190902 12:43:48 all (409/669): nullfs19.sh 20190902 12:45:51 all (410/669): mmap32.sh 20190902 12:48:12 all (411/669): callout_reset_on.sh 20190902 12:51:20 all (412/669): suj23.sh 20190902 12:53:14 all (413/669): umountf8.sh Sep 2 12:53:15 mercat1 kernel: pid 75035 (run), uid 2007 inumber 642048 on /tmp: filesystem full 20190902 12:55:45 all (414/669): pfl.sh 20190902 12:58:19 all (415/669): swapoff.sh Sep 2 12:58:20 mercat1 kernel: pid 8962 (run), uid 2007 inumber 642048 on /tmp: filesystem full 20190902 13:00:51 all (416/669): flock_open_close.sh 20190902 13:03:30 all (417/669): fork2.sh 20190902 13:06:08 all (418/669): core.sh 20190902 13:10:02 all (419/669): fragments.sh Sep 2 13:10:05 mercat1 kernel: pid 17639 (fragments), uid 2007 inumber 9298 on /mnt: filesystem full Sep 2 13:10:06 mercat1 kernel: pid 17646 (fragments), uid 2007 inumber 9753 on /mnt: filesystem full Sep 2 13:10:07 mercat1 kernel: pid 18807 (fragments), uid 2007 inumber 9674 on /mnt: filesystem full Sep 2 13:10:08 mercat1 kernel: pid 18800 (fragments), uid 2007 inumber 9706 on /mnt: filesystem full Sep 2 13:10:09 mercat1 kernel: pid 18800 (fragments), uid 2007 inumber 9806 on /mnt: filesystem full Sep 2 13:10:10 mercat1 kernel: pid 18805 (fragments), uid 2007 inumber 9602 on /mnt: filesystem full Sep 2 13:10:11 mercat1 kernel: pid 18810 (fragments), uid 2007 inumber 9718 on /mnt: filesystem full Sep 2 13:10:12 mercat1 kernel: pid 18812 (fragments), uid 2007 inumber 9722 on /mnt: filesystem full Sep 2 13:10:13 mercat1 kernel: pid 18809 (fragments), uid 2007 inumber 9860 on /mnt: filesystem full Sep 2 13:10:14 mercat1 kernel: pid 18810 (fragments), uid 2007 inumber 9774 on /mnt: filesystem full Sep 2 13:10:15 mercat1 kernel: pid 18819 (fragments), uid 2007 inumber 9677 on /mnt: filesystem full Sep 2 13:10:16 mercat1 kernel: pid 18820 (fragments), uid 2007 inumber 9711 on /mnt: filesystem full Sep 2 13:10:17 mercat1 kernel: pid 18821 (fragments), uid 2007 inumber 9686 on /mnt: filesystem full Sep 2 13:10:18 mercat1 kernel: pid 19982 (fragments), uid 2007 inumber 9735 on /mnt: filesystem full Sep 2 13:10:19 mercat1 kernel: pid 19984 (fragments), uid 2007 inumber 9687 on /mnt: filesystem full Sep 2 13:10:20 mercat1 kernel: pid 19990 (fragments), uid 2007 inumber 9614 on /mnt: filesystem full Sep 2 13:10:21 mercat1 kernel: pid 19986 (fragments), uid 2007 inumber 9886 on /mnt: filesystem full Sep 2 13:10:22 mercat1 kernel: pid 19986 (fragments), uid 2007 inumber 10033 on /mnt: filesystem full Sep 2 13:10:23 mercat1 kernel: pid 19989 (fragments), uid 2007 inumber 9611 on /mnt: filesystem full Sep 2 13:10:24 mercat1 kernel: pid 19995 (fragments), uid 2007 inumber 9692 on /mnt: filesystem full Sep 2 13:10:25 mercat1 kernel: pid 20001 (fragments), uid 2007 inumber 9711 on /mnt: filesystem full Sep 2 13:10:26 mercat1 kernel: pid 19998 (fragments), uid 2007 inumber 10056 on /mnt: filesystem full Sep 2 13:10:27 mercat1 kernel: pid 20793 (fragments), uid 2007 inumber 9693 on /mnt: filesystem full Sep 2 13:10:28 mercat1 kernel: pid 20790 (fragments), uid 2007 inumber 9760 on /mnt: filesystem full Sep 2 13:10:29 mercat1 kernel: pid 20795 (fragments), uid 2007 inumber 10022 on /mnt: filesystem full Sep 2 13:10:30 mercat1 kernel: pid 21162 (fragments), uid 2007 inumber 9652 on /mnt: filesystem full Sep 2 13:10:31 mercat1 kernel: pid 21168 (fragments), uid 2007 inumber 9726 on /mnt: filesystem full Sep 2 13:10:32 mercat1 kernel: pid 21176 (fragments), uid 2007 inumber 9621 on /mnt: filesystem full Sep 2 13:10:33 mercat1 kernel: pid 21172 (fragments), uid 2007 inumber 9721 on /mnt: filesystem full Sep 2 13:10:34 mercat1 kernel: pid 21175 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Sep 2 13:10:35 mercat1 kernel: pid 21171 (fragments), uid 2007 inumber 9651 on /mnt: filesystem full Sep 2 13:10:36 mercat1 kernel: pid 21171 (fragments), uid 2007 inumber 9883 on /mnt: filesystem full Sep 2 13:10:37 mercat1 kernel: pid 21184 (fragments), uid 2007 inumber 9716 on /mnt: filesystem full Sep 2 13:10:38 mercat1 kernel: pid 21183 (fragments), uid 2007 inumber 9753 on /mnt: filesystem full Sep 2 13:10:39 mercat1 kernel: pid 21181 (fragments), uid 2007 inumber 9818 on /mnt: filesystem full Sep 2 13:10:40 mercat1 kernel: pid 22345 (fragments), uid 2007 inumber 9703 on /mnt: filesystem full Sep 2 13:10:41 mercat1 kernel: pid 22345 (fragments), uid 2007 inumber 9861 on /mnt: filesystem full Sep 2 13:10:42 mercat1 kernel: pid 22342 (fragments), uid 2007 inumber 9798 on /mnt: filesystem full Sep 2 13:10:43 mercat1 kernel: pid 22351 (fragments), uid 2007 inumber 9805 on /mnt: filesystem full Sep 2 13:10:44 mercat1 kernel: pid 22353 (fragments), uid 2007 inumber 9751 on /mnt: filesystem full Sep 2 13:10:45 mercat1 kernel: pid 22349 (fragments), uid 2007 inumber 9805 on /mnt: filesystem full Sep 2 13:10:46 mercat1 kernel: pid 22353 (fragments), uid 2007 inumber 9773 on /mnt: filesystem full Sep 2 13:10:47 mercat1 kernel: pid 22360 (fragments), uid 2007 inumber 9790 on /mnt: filesystem full Sep 2 13:10:48 mercat1 kernel: pid 22357 (fragments), uid 2007 inumber 9745 on /mnt: filesystem full Sep 2 13:10:49 mercat1 kernel: pid 22360 (fragments), uid 2007 inumber 9824 on /mnt: filesystem full Sep 2 13:10:50 mercat1 kernel: pid 22359 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Sep 2 13:10:51 mercat1 kernel: pid 22355 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Sep 2 13:10:52 mercat1 syslogd: last message repeated 1 times Sep 2 13:10:53 mercat1 kernel: pid 22361 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Sep 2 13:10:54 mercat1 kernel: pid 22359 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Sep 2 13:10:55 mercat1 kernel: pid 23517 (fragments), uid 2007 inumber 9724 on /mnt: filesystem full Sep 2 13:10:56 mercat1 kernel: pid 23519 (fragments), uid 2007 inumber 9734 on /mnt: filesystem full Sep 2 13:10:57 mercat1 kernel: pid 23518 (fragments), uid 2007 inumber 9916 on /mnt: filesystem full Sep 2 13:10:58 mercat1 kernel: pid 23515 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Sep 2 13:10:59 mercat1 kernel: pid 23520 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Sep 2 13:11:00 mercat1 kernel: pid 23515 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Sep 2 13:11:02 mercat1 syslogd: last message repeated 2 times Sep 2 13:11:04 mercat1 kernel: pid 23520 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Sep 2 13:11:05 mercat1 syslogd: last message repeated 1 times Sep 2 13:11:06 mercat1 kernel: pid 23516 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Sep 2 13:11:08 mercat1 syslogd: last message repeated 3 times Sep 2 13:11:09 mercat1 kernel: pid 24696 (fragments), uid 2007 inumber 9707 on /mnt: filesystem full Sep 2 13:11:10 mercat1 kernel: pid 24694 (fragments), uid 2007 inumber 9641 on /mnt: filesystem full Sep 2 13:11:11 mercat1 kernel: pid 24692 (fragments), uid 2007 inumber 9614 on /mnt: filesystem full Sep 2 13:11:13 mercat1 kernel: pid 25851 (fragments), uid 2007 inumber 9714 on /mnt: filesystem full Sep 2 13:11:14 mercat1 kernel: pid 25855 (fragments), uid 2007 inumber 9828 on /mnt: filesystem full Sep 2 13:11:15 mercat1 kernel: pid 25850 (fragments), uid 2007 inumber 9899 on /mnt: filesystem full Sep 2 13:11:16 mercat1 kernel: pid 25856 (fragments), uid 2007 inumber 9727 on /mnt: filesystem full Sep 2 13:11:16 mercat1 kernel: pid 25861 (fragments), uid 2007 inumber 9621 on /mnt: filesystem full Sep 2 13:11:18 mercat1 kernel: pid 25860 (fragments), uid 2007 inumber 9740 on /mnt: filesystem full Sep 2 13:11:19 mercat1 kernel: pid 25864 (fragments), uid 2007 inumber 9760 on /mnt: filesystem full Sep 2 13:11:20 mercat1 kernel: pid 25862 (fragments), uid 2007 inumber 9845 on /mnt: filesystem full Sep 2 13:11:21 mercat1 kernel: pid 25873 (fragments), uid 2007 inumber 9734 on /mnt: filesystem full Sep 2 13:11:22 mercat1 kernel: pid 25872 (fragments), uid 2007 inumber 9730 on /mnt: filesystem full Sep 2 13:11:23 mercat1 kernel: pid 27027 (fragments), uid 2007 inumber 9689 on /mnt: filesystem full Sep 2 13:11:24 mercat1 kernel: pid 27030 (fragments), uid 2007 inumber 9840 on /mnt: filesystem full Sep 2 13:11:25 mercat1 kernel: pid 27032 (fragments), uid 2007 inumber 9657 on /mnt: filesystem full Sep 2 13:11:26 mercat1 kernel: pid 27028 (fragments), uid 2007 inumber 9948 on /mnt: filesystem full Sep 2 13:11:27 mercat1 kernel: pid 27035 (fragments), uid 2007 inumber 9729 on /mnt: filesystem full Sep 2 13:11:28 mercat1 kernel: pid 27041 (fragments), uid 2007 inumber 9610 on /mnt: filesystem full Sep 2 13:11:29 mercat1 kernel: pid 27036 (fragments), uid 2007 inumber 9929 on /mnt: filesystem full Sep 2 13:11:30 mercat1 kernel: pid 27037 (fragments), uid 2007 inumber 9721 on /mnt: filesystem full Sep 2 13:11:31 mercat1 kernel: pid 27060 (fragments), uid 2007 inumber 9717 on /mnt: filesystem full Sep 2 13:11:32 mercat1 kernel: pid 27055 (fragments), uid 2007 inumber 9746 on /mnt: filesystem full Sep 2 13:11:33 mercat1 kernel: pid 27054 (fragments), uid 2007 inumber 9820 on /mnt: filesystem full Sep 2 13:11:34 mercat1 kernel: pid 27059 (fragments), uid 2007 inumber 9611 on /mnt: filesystem full Sep 2 13:11:35 mercat1 kernel: pid 28219 (fragments), uid 2007 inumber 9739 on /mnt: filesystem full Sep 2 13:11:36 mercat1 kernel: pid 28215 (fragments), uid 2007 inumber 9779 on /mnt: filesystem full Sep 2 13:11:37 mercat1 kernel: pid 28219 (fragments), uid 2007 inumber 9933 on /mnt: filesystem full Sep 2 13:11:38 mercat1 kernel: pid 28214 (fragments), uid 2007 inumber 9657 on /mnt: filesystem full Sep 2 13:11:39 mercat1 kernel: pid 28223 (fragments), uid 2007 inumber 9671 on /mnt: filesystem full Sep 2 13:11:40 mercat1 kernel: pid 28228 (fragments), uid 2007 inumber 9852 on /mnt: filesystem full Sep 2 13:11:41 mercat1 kernel: pid 28227 (fragments), uid 2007 inumber 9862 on /mnt: filesystem full Sep 2 13:11:42 mercat1 kernel: pid 28232 (fragments), uid 2007 inumber 9791 on /mnt: filesystem full Sep 2 13:11:43 mercat1 kernel: pid 28237 (fragments), uid 2007 inumber 9942 on /mnt: filesystem full Sep 2 13:11:44 mercat1 kernel: pid 28237 (fragments), uid 2007 inumber 9768 on /mnt: filesystem full Sep 2 13:11:45 mercat1 kernel: pid 29397 (fragments), uid 2007 inumber 9727 on /mnt: filesystem full Sep 2 13:11:46 mercat1 kernel: pid 29396 (fragments), uid 2007 inumber 9819 on /mnt: filesystem full Sep 2 13:11:47 mercat1 kernel: pid 29397 (fragments), uid 2007 inumber 9601 on /mnt: filesystem full Sep 2 13:11:48 mercat1 kernel: pid 29394 (fragments), uid 2007 inumber 9950 on /mnt: filesystem full Sep 2 13:11:49 mercat1 kernel: pid 29404 (fragments), uid 2007 inumber 9633 on /mnt: filesystem full Sep 2 13:11:50 mercat1 kernel: pid 29399 (fragments), uid 2007 inumber 9682 on /mnt: filesystem full Sep 2 13:11:51 mercat1 kernel: pid 29399 (fragments), uid 2007 inumber 9673 on /mnt: filesystem full Sep 2 13:11:52 mercat1 kernel: pid 29406 (fragments), uid 2007 inumber 9702 on /mnt: filesystem full Sep 2 13:11:53 mercat1 kernel: pid 29411 (fragments), uid 2007 inumber 9842 on /mnt: filesystem full Sep 2 13:11:54 mercat1 kernel: pid 29406 (fragments), uid 2007 inumber 10118 on /mnt: filesystem full Sep 2 13:11:55 mercat1 kernel: pid 29410 (fragments), uid 2007 inumber 9789 on /mnt: filesystem full Sep 2 13:11:56 mercat1 kernel: pid 30567 (fragments), uid 2007 inumber 9694 on /mnt: filesystem full Sep 2 13:11:57 mercat1 kernel: pid 30569 (fragments), uid 2007 inumber 9702 on /mnt: filesystem full Sep 2 13:11:58 mercat1 kernel: pid 30567 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Sep 2 13:11:59 mercat1 kernel: pid 30573 (fragments), uid 2007 inumber 10000 on /mnt: filesystem full Sep 2 13:12:00 mercat1 kernel: pid 30567 (fragments), uid 2007 inumber 9848 on /mnt: filesystem full Sep 2 13:12:01 mercat1 kernel: pid 30575 (fragments), uid 2007 inumber 9694 on /mnt: filesystem full Sep 2 13:12:02 mercat1 kernel: pid 30579 (fragments), uid 2007 inumber 9642 on /mnt: filesystem full Sep 2 13:12:03 mercat1 kernel: pid 30584 (fragments), uid 2007 inumber 9705 on /mnt: filesystem full Sep 2 13:12:04 mercat1 kernel: pid 30586 (fragments), uid 2007 inumber 9816 on /mnt: filesystem full Sep 2 13:12:05 mercat1 kernel: pid 30586 (fragments), uid 2007 inumber 9618 on /mnt: filesystem full Sep 2 13:12:06 mercat1 kernel: pid 30586 (fragments), uid 2007 inumber 9732 on /mnt: filesystem full Sep 2 13:12:07 mercat1 kernel: pid 31745 (fragments), uid 2007 inumber 9708 on /mnt: filesystem full Sep 2 13:12:08 mercat1 kernel: pid 31746 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Sep 2 13:12:09 mercat1 kernel: pid 31742 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Sep 2 13:12:10 mercat1 syslogd: last message repeated 1 times Sep 2 13:12:11 mercat1 kernel: pid 31748 (fragments), uid 2007 inumber 9843 on /mnt: filesystem full Sep 2 13:12:12 mercat1 kernel: pid 31742 (fragments), uid 2007 inumber 9776 on /mnt: filesystem full Sep 2 13:12:13 mercat1 kernel: pid 31749 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Sep 2 13:12:14 mercat1 kernel: pid 31869 (fragments), uid 2007 inumber 9598 on /mnt: filesystem full Sep 2 13:12:15 mercat1 kernel: pid 31874 (fragments), uid 2007 inumber 9795 on /mnt: filesystem full Sep 2 13:12:16 mercat1 kernel: pid 31874 (fragments), uid 2007 inumber 9726 on /mnt: filesystem full Sep 2 13:12:17 mercat1 kernel: pid 31874 (fragments), uid 2007 inumber 9948 on /mnt: filesystem full Sep 2 13:12:18 mercat1 kernel: pid 31875 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Sep 2 13:12:19 mercat1 kernel: pid 31872 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Sep 2 13:12:20 mercat1 kernel: pid 31875 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Sep 2 13:12:21 mercat1 kernel: pid 31870 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Sep 2 13:12:22 mercat1 kernel: pid 31873 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Sep 2 13:12:23 mercat1 kernel: pid 31872 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Sep 2 13:12:24 mercat1 kernel: pid 31870 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Sep 2 13:12:25 mercat1 kernel: pid 31873 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Sep 2 13:12:26 mercat1 kernel: pid 31872 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Sep 2 13:12:27 mercat1 kernel: pid 31870 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Sep 2 13:12:28 mercat1 kernel: pid 31875 (fragments), uid 2007 inumber 2 on /mnt: filesystem full Sep 2 13:12:29 mercat1 syslogd: last message repeated 1 times Sep 2 13:12:30 mercat1 kernel: pid 34066 (fragments), uid 2007 inumber 9692 on /mnt: filesystem full Sep 2 13:12:31 mercat1 kernel: pid 34065 (fragments), uid 2007 inumber 9916 on /mnt: filesystem full Sep 2 13:12:32 mercat1 kernel: pid 34076 (fragments), uid 2007 inumber 9823 on /mnt: filesystem full Sep 2 13:12:33 mercat1 kernel: pid 34073 (fragments), uid 2007 inumber 9732 on /mnt: filesystem full Sep 2 13:12:34 mercat1 kernel: pid 34073 (fragments), uid 2007 inumber 9618 on /mnt: filesystem full Sep 2 13:12:35 mercat1 kernel: pid 34076 (fragments), uid 2007 inumber 10124 on /mnt: filesystem full Sep 2 13:12:36 mercat1 kernel: pid 34349 (fragments), uid 2007 inumber 9702 on /mnt: filesystem full Sep 2 13:12:37 mercat1 kernel: pid 34349 (fragments), uid 2007 inumber 9775 on /mnt: filesystem full Sep 2 13:12:38 mercat1 kernel: pid 34345 (fragments), uid 2007 inumber 9800 on /mnt: filesystem full Sep 2 13:12:39 mercat1 kernel: pid 35241 (fragments), uid 2007 inumber 9664 on /mnt: filesystem full Sep 2 13:12:40 mercat1 kernel: pid 35242 (fragments), uid 2007 inumber 9858 on /mnt: filesystem full Sep 2 13:12:41 mercat1 kernel: pid 35252 (fragments), uid 2007 inumber 9664 on /mnt: filesystem full Sep 2 13:12:42 mercat1 kernel: pid 35249 (fragments), uid 2007 inumber 9882 on /mnt: filesystem full Sep 2 13:12:43 mercat1 kernel: pid 35253 (fragments), uid 2007 inumber 9767 on /mnt: filesystem full Sep 2 13:12:44 mercat1 kernel: pid 35259 (fragments), uid 2007 inumber 9611 on /mnt: filesystem full Sep 2 13:12:45 mercat1 kernel: pid 35262 (fragments), uid 2007 inumber 9680 on /mnt: filesystem full Sep 2 13:12:46 mercat1 kernel: pid 35260 (fragments), uid 2007 inumber 9743 on /mnt: filesystem full Sep 2 13:12:47 mercat1 kernel: pid 35256 (fragments), uid 2007 inumber 9707 on /mnt: filesystem full Sep 2 13:12:48 mercat1 kernel: pid 36421 (fragments), uid 2007 inumber 9705 on /mnt: filesystem full Sep 2 13:12:49 mercat1 kernel: pid 36421 (fragments), uid 2007 inumber 9644 on /mnt: filesystem full Sep 2 13:12:50 mercat1 kernel: pid 36418 (fragments), uid 2007 inumber 9836 on /mnt: filesystem full Sep 2 13:12:51 mercat1 kernel: pid 36427 (fragments), uid 2007 inumber 9771 on /mnt: filesystem full Sep 2 13:12:52 mercat1 kernel: pid 36431 (fragments), uid 2007 inumber 9835 on /mnt: filesystem full Sep 2 13:12:53 mercat1 kernel: pid 36427 (fragments), uid 2007 inumber 9776 on /mnt: filesystem full Sep 2 13:12:54 mercat1 kernel: pid 36433 (fragments), uid 2007 inumber 9577 on /mnt: filesystem full Sep 2 13:12:55 mercat1 kernel: pid 36438 (fragments), uid 2007 inumber 9768 on /mnt: filesystem full Sep 2 13:12:56 mercat1 kernel: pid 36435 (fragments), uid 2007 inumber 9857 on /mnt: filesystem full Sep 2 13:12:57 mercat1 kernel: pid 36432 (fragments), uid 2007 inumber 9825 on /mnt: filesystem full Sep 2 13:12:58 mercat1 kernel: pid 37592 (fragments), uid 2007 inumber 9792 on /mnt: filesystem full Sep 2 13:12:59 mercat1 kernel: pid 37599 (fragments), uid 2007 inumber 9703 on /mnt: filesystem full Sep 2 13:13:00 mercat1 kernel: pid 37597 (fragments), uid 2007 inumber 9680 on /mnt: filesystem full Sep 2 13:13:02 mercat1 kernel: pid 37595 (fragments), uid 2007 inumber 9595 on /mnt: filesystem full Sep 2 13:13:03 mercat1 kernel: pid 37601 (fragments), uid 2007 inumber 9635 on /mnt: filesystem full Sep 2 13:13:03 mercat1 kernel: pid 37607 (fragments), uid 2007 inumber 9789 on /mnt: filesystem full Sep 2 13:13:04 mercat1 kernel: pid 37601 (fragments), uid 2007 inumber 9865 on /mnt: filesystem full Sep 2 13:13:05 mercat1 kernel: pid 37604 (fragments), uid 2007 inumber 9881 on /mnt: filesystem full Sep 2 13:13:07 mercat1 kernel: pid 37613 (fragments), uid 2007 inumber 9818 on /mnt: filesystem full Sep 2 13:13:08 mercat1 kernel: pid 37613 (fragments), uid 2007 inumber 9643 on /mnt: filesystem full Sep 2 13:13:09 mercat1 kernel: pid 37614 (fragments), uid 2007 inumber 9909 on /mnt: filesystem full Sep 2 13:13:09 mercat1 kernel: pid 38773 (fragments), uid 2007 inumber 9667 on /mnt: filesystem full Sep 2 13:13:10 mercat1 kernel: pid 38769 (fragments), uid 2007 inumber 9765 on /mnt: filesystem full Sep 2 13:13:12 mercat1 kernel: pid 38772 (fragments), uid 2007 inumber 9938 on /mnt: filesystem full Sep 2 13:13:13 mercat1 kernel: pid 38776 (fragments), uid 2007 inumber 9704 on /mnt: filesystem full Sep 2 13:13:14 mercat1 kernel: pid 38782 (fragments), uid 2007 inumber 9635 on /mnt: filesystem full Sep 2 13:13:15 mercat1 kernel: pid 38783 (fragments), uid 2007 inumber 9788 on /mnt: filesystem full Sep 2 13:13:16 mercat1 kernel: pid 38786 (fragments), uid 2007 inumber 9713 on /mnt: filesystem full Sep 2 13:13:17 mercat1 kernel: pid 38788 (fragments), uid 2007 inumber 9880 on /mnt: filesystem full Sep 2 13:13:18 mercat1 kernel: pid 38790 (fragments), uid 2007 inumber 9927 on /mnt: filesystem full Sep 2 13:13:19 mercat1 kernel: pid 39949 (fragments), uid 2007 inumber 9695 on /mnt: filesystem full Sep 2 13:13:20 mercat1 kernel: pid 39950 (fragments), uid 2007 inumber 9643 on /mnt: filesystem full Sep 2 13:13:21 mercat1 kernel: pid 39946 (fragments), uid 2007 inumber 9577 on /mnt: filesystem full Sep 2 13:13:22 mercat1 kernel: pid 39956 (fragments), uid 2007 inumber 9712 on /mnt: filesystem full Sep 2 13:13:23 mercat1 kernel: pid 39959 (fragments), uid 2007 inumber 9795 on /mnt: filesystem full Sep 2 13:13:24 mercat1 kernel: pid 39960 (fragments), uid 2007 inumber 9808 on /mnt: filesystem full 20190902 13:13:25 all (420/669): mmap19.sh 20190902 13:15:33 all (421/669): db.sh 20190902 13:18:34 all (422/669): ftruncate.sh Sep 2 13:18:35 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481548 on /tmp: filesystem full Sep 2 13:18:36 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481803 on /tmp: filesystem full Sep 2 13:18:37 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481712 on /tmp: filesystem full Sep 2 13:18:38 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 482020 on /tmp: filesystem full Sep 2 13:18:39 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481740 on /tmp: filesystem full Sep 2 13:18:40 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481789 on /tmp: filesystem full Sep 2 13:18:41 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481868 on /tmp: filesystem full Sep 2 13:18:42 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481593 on /tmp: filesystem full Sep 2 13:18:43 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481812 on /tmp: filesystem full Sep 2 13:18:44 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481783 on /tmp: filesystem full Sep 2 13:18:45 mercat1 syslogd: last message repeated 1 times Sep 2 13:18:46 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481603 on /tmp: filesystem full Sep 2 13:18:47 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481991 on /tmp: filesystem full Sep 2 13:18:48 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481924 on /tmp: filesystem full Sep 2 13:18:49 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481707 on /tmp: filesystem full Sep 2 13:18:50 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481588 on /tmp: filesystem full Sep 2 13:18:51 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481881 on /tmp: filesystem full Sep 2 13:18:52 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481814 on /tmp: filesystem full Sep 2 13:18:53 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481842 on /tmp: filesystem full Sep 2 13:18:54 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481583 on /tmp: filesystem full Sep 2 13:18:55 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481737 on /tmp: filesystem full Sep 2 13:18:56 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481782 on /tmp: filesystem full Sep 2 13:18:57 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481890 on /tmp: filesystem full Sep 2 13:18:58 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481957 on /tmp: filesystem full Sep 2 13:18:59 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481605 on /tmp: filesystem full Sep 2 13:19:00 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481590 on /tmp: filesystem full Sep 2 13:19:01 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481645 on /tmp: filesystem full Sep 2 13:19:02 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481617 on /tmp: filesystem full Sep 2 13:19:03 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481784 on /tmp: filesystem full Sep 2 13:19:04 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481725 on /tmp: filesystem full Sep 2 13:19:05 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481720 on /tmp: filesystem full Sep 2 13:19:06 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481580 on /tmp: filesystem full Sep 2 13:19:07 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481972 on /tmp: filesystem full Sep 2 13:19:08 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481747 on /tmp: filesystem full Sep 2 13:19:09 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481669 on /tmp: filesystem full Sep 2 13:19:10 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481574 on /tmp: filesystem full Sep 2 13:19:11 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481696 on /tmp: filesystem full Sep 2 13:19:12 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481852 on /tmp: filesystem full Sep 2 13:19:13 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481667 on /tmp: filesystem full Sep 2 13:19:14 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481832 on /tmp: filesystem full Sep 2 13:19:15 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481821 on /tmp: filesystem full Sep 2 13:19:16 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481776 on /tmp: filesystem full Sep 2 13:19:17 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481734 on /tmp: filesystem full Sep 2 13:19:18 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 482033 on /tmp: filesystem full Sep 2 13:19:19 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481991 on /tmp: filesystem full Sep 2 13:19:20 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481774 on /tmp: filesystem full Sep 2 13:19:21 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481941 on /tmp: filesystem full Sep 2 13:19:22 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481866 on /tmp: filesystem full Sep 2 13:19:23 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481919 on /tmp: filesystem full Sep 2 13:19:24 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481851 on /tmp: filesystem full Sep 2 13:19:25 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481938 on /tmp: filesystem full Sep 2 13:19:26 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481926 on /tmp: filesystem full Sep 2 13:19:27 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481896 on /tmp: filesystem full Sep 2 13:19:28 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481933 on /tmp: filesystem full Sep 2 13:19:29 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481829 on /tmp: filesystem full Sep 2 13:19:30 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481587 on /tmp: filesystem full Sep 2 13:19:31 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481885 on /tmp: filesystem full Sep 2 13:19:32 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481807 on /tmp: filesystem full Sep 2 13:19:33 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 482004 on /tmp: filesystem full Sep 2 13:19:34 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481762 on /tmp: filesystem full Sep 2 13:19:35 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481988 on /tmp: filesystem full Sep 2 13:19:36 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481830 on /tmp: filesystem full Sep 2 13:19:37 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481763 on /tmp: filesystem full Sep 2 13:19:38 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481543 on /tmp: filesystem full Sep 2 13:19:39 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481589 on /tmp: filesystem full Sep 2 13:19:40 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481683 on /tmp: filesystem full Sep 2 13:19:41 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481969 on /tmp: filesystem full Sep 2 13:19:42 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481973 on /tmp: filesystem full Sep 2 13:19:43 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481960 on /tmp: filesystem full Sep 2 13:19:44 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481623 on /tmp: filesystem full Sep 2 13:19:45 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481879 on /tmp: filesystem full Sep 2 13:19:46 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481821 on /tmp: filesystem full Sep 2 13:19:47 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481867 on /tmp: filesystem full Sep 2 13:19:48 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481744 on /tmp: filesystem full Sep 2 13:19:49 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481934 on /tmp: filesystem full Sep 2 13:19:50 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481688 on /tmp: filesystem full Sep 2 13:19:51 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481673 on /tmp: filesystem full Sep 2 13:19:52 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481728 on /tmp: filesystem full Sep 2 13:19:53 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481720 on /tmp: filesystem full Sep 2 13:19:54 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481762 on /tmp: filesystem full Sep 2 13:19:55 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481597 on /tmp: filesystem full Sep 2 13:19:56 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 482020 on /tmp: filesystem full Sep 2 13:19:57 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481608 on /tmp: filesystem full Sep 2 13:19:58 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481990 on /tmp: filesystem full Sep 2 13:19:59 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481832 on /tmp: filesystem full Sep 2 13:20:00 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481997 on /tmp: filesystem full Sep 2 13:20:01 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481657 on /tmp: filesystem full Sep 2 13:20:02 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481918 on /tmp: filesystem full Sep 2 13:20:03 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481862 on /tmp: filesystem full Sep 2 13:20:04 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481849 on /tmp: filesystem full Sep 2 13:20:05 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481889 on /tmp: filesystem full Sep 2 13:20:06 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481789 on /tmp: filesystem full Sep 2 13:20:07 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481562 on /tmp: filesystem full Sep 2 13:20:08 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481688 on /tmp: filesystem full Sep 2 13:20:09 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481598 on /tmp: filesystem full Sep 2 13:20:10 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481938 on /tmp: filesystem full Sep 2 13:20:11 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481710 on /tmp: filesystem full Sep 2 13:20:12 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481915 on /tmp: filesystem full Sep 2 13:20:13 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481634 on /tmp: filesystem full Sep 2 13:20:14 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481841 on /tmp: filesystem full Sep 2 13:20:15 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481965 on /tmp: filesystem full Sep 2 13:20:16 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481888 on /tmp: filesystem full Sep 2 13:20:17 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481806 on /tmp: filesystem full Sep 2 13:20:18 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481920 on /tmp: filesystem full Sep 2 13:20:19 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481883 on /tmp: filesystem full Sep 2 13:20:20 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 482028 on /tmp: filesystem full Sep 2 13:20:21 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481998 on /tmp: filesystem full Sep 2 13:20:22 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481587 on /tmp: filesystem full Sep 2 13:20:23 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481939 on /tmp: filesystem full Sep 2 13:20:24 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481889 on /tmp: filesystem full Sep 2 13:20:25 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481923 on /tmp: filesystem full Sep 2 13:20:26 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481629 on /tmp: filesystem full Sep 2 13:20:27 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481966 on /tmp: filesystem full Sep 2 13:20:28 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481617 on /tmp: filesystem full Sep 2 13:20:29 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481970 on /tmp: filesystem full Sep 2 13:20:30 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481704 on /tmp: filesystem full Sep 2 13:20:31 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481945 on /tmp: filesystem full Sep 2 13:20:32 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481650 on /tmp: filesystem full Sep 2 13:20:33 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481943 on /tmp: filesystem full Sep 2 13:20:34 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481623 on /tmp: filesystem full Sep 2 13:20:35 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481587 on /tmp: filesystem full Sep 2 13:20:36 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481705 on /tmp: filesystem full Sep 2 13:20:37 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481775 on /tmp: filesystem full Sep 2 13:20:38 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481633 on /tmp: filesystem full Sep 2 13:20:39 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481570 on /tmp: filesystem full Sep 2 13:20:40 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481592 on /tmp: filesystem full Sep 2 13:20:41 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481948 on /tmp: filesystem full Sep 2 13:20:42 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481854 on /tmp: filesystem full Sep 2 13:20:43 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481734 on /tmp: filesystem full Sep 2 13:20:44 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481991 on /tmp: filesystem full Sep 2 13:20:45 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481685 on /tmp: filesystem full Sep 2 13:20:46 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481936 on /tmp: filesystem full Sep 2 13:20:47 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481710 on /tmp: filesystem full Sep 2 13:20:48 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481784 on /tmp: filesystem full Sep 2 13:20:49 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481667 on /tmp: filesystem full Sep 2 13:20:50 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481826 on /tmp: filesystem full Sep 2 13:20:51 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481552 on /tmp: filesystem full Sep 2 13:20:52 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481936 on /tmp: filesystem full Sep 2 13:20:53 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481966 on /tmp: filesystem full Sep 2 13:20:54 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 482024 on /tmp: filesystem full Sep 2 13:20:55 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481651 on /tmp: filesystem full Sep 2 13:20:56 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481968 on /tmp: filesystem full Sep 2 13:20:57 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481997 on /tmp: filesystem full Sep 2 13:20:58 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481558 on /tmp: filesystem full Sep 2 13:20:59 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481701 on /tmp: filesystem full Sep 2 13:21:00 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481679 on /tmp: filesystem full Sep 2 13:21:01 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481722 on /tmp: filesystem full Sep 2 13:21:02 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481867 on /tmp: filesystem full Sep 2 13:21:03 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481562 on /tmp: filesystem full Sep 2 13:21:04 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481546 on /tmp: filesystem full Sep 2 13:21:05 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481707 on /tmp: filesystem full Sep 2 13:21:06 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481941 on /tmp: filesystem full Sep 2 13:21:07 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481563 on /tmp: filesystem full Sep 2 13:21:08 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481564 on /tmp: filesystem full Sep 2 13:21:09 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481969 on /tmp: filesystem full Sep 2 13:21:10 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481853 on /tmp: filesystem full Sep 2 13:21:11 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481708 on /tmp: filesystem full Sep 2 13:21:12 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481794 on /tmp: filesystem full Sep 2 13:21:13 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481641 on /tmp: filesystem full Sep 2 13:21:14 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481758 on /tmp: filesystem full Sep 2 13:21:15 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481870 on /tmp: filesystem full Sep 2 13:21:16 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481966 on /tmp: filesystem full Sep 2 13:21:17 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481975 on /tmp: filesystem full Sep 2 13:21:18 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481902 on /tmp: filesystem full Sep 2 13:21:19 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481993 on /tmp: filesystem full Sep 2 13:21:20 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481557 on /tmp: filesystem full Sep 2 13:21:21 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481849 on /tmp: filesystem full Sep 2 13:21:22 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481989 on /tmp: filesystem full Sep 2 13:21:23 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481983 on /tmp: filesystem full Sep 2 13:21:24 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481989 on /tmp: filesystem full Sep 2 13:21:25 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481679 on /tmp: filesystem full Sep 2 13:21:26 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481595 on /tmp: filesystem full Sep 2 13:21:27 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481779 on /tmp: filesystem full Sep 2 13:21:28 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481716 on /tmp: filesystem full Sep 2 13:21:29 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481987 on /tmp: filesystem full Sep 2 13:21:30 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481846 on /tmp: filesystem full Sep 2 13:21:31 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481724 on /tmp: filesystem full Sep 2 13:21:32 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481867 on /tmp: filesystem full Sep 2 13:21:33 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481979 on /tmp: filesystem full Sep 2 13:21:34 mercat1 kernel: pid 26396 (ftruncate), uid 65534 inumber 481933 on /tmp: filesystem full 20190902 13:21:35 all (423/669): mlockall3.sh 20190902 13:24:36 all (424/669): msync.sh 20190902 13:27:38 all (425/669): pthread8.sh 20190902 13:30:39 all (426/669): pty2.sh Sep 2 13:31:01 mercat1 kernel: pid 1977 (devd), uid 0 inumber 270 on /tmp: filesystem full Fatal trap 12: page fault while in kernel mode cpuid = 5; apic id = 05 fault virtual address = 0x18 fault code = supervisor read data, page not present instruction pointer = 0x20:0xffffffff80bb43ca stack pointer = 0x28:0xfffffe036713a6c0 frame pointer = 0x28:0xfffffe036713a700 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 14499 (pty2) trap number = 12 panic: page fault cpuid = 5 time = 1567423908 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe036713a380 vpanic() at vpanic+0x19d/frame 0xfffffe036713a3d0 panic() at panic+0x43/frame 0xfffffe036713a430 trap_fatal() at trap_fatal+0x39c/frame 0xfffffe036713a490 trap_pfault() at trap_pfault+0x62/frame 0xfffffe036713a4e0 trap() at trap+0x2b2/frame 0xfffffe036713a5f0 calltrap() at calltrap+0x8/frame 0xfffffe036713a5f0 --- trap 0xc, rip = 0xffffffff80bb43ca, rsp = 0xfffffe036713a6c0, rbp = 0xfffffe036713a700 --- __mtx_lock_flags() at __mtx_lock_flags+0x4a/frame 0xfffffe036713a700 vop_stdgetwritemount() at vop_stdgetwritemount+0x31/frame 0xfffffe036713a730 VOP_GETWRITEMOUNT_APV() at VOP_GETWRITEMOUNT_APV+0x78/frame 0xfffffe036713a750 vn_start_write() at vn_start_write+0x42/frame 0xfffffe036713a7a0 vn_close1() at vn_close1+0x5c/frame 0xfffffe036713a810 vn_closefile() at vn_closefile+0x4c/frame 0xfffffe036713a890 _fdrop() at _fdrop+0x1a/frame 0xfffffe036713a8b0 closef() at closef+0x202/frame 0xfffffe036713a940 closefp() at closefp+0x9c/frame 0xfffffe036713a980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe036713aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe036713aab0 --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x80041521a, rsp = 0x7fffffffe6f8, rbp = 0x7fffffffe710 --- KDB: enter: panic [ thread pid 14499 tid 104286 ] Stopped at kdb_enter+0x3b: movq $0,kdb_why db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> bt Tracing pid 14499 tid 104286 td 0xfffff805738a8000 kdb_enter() at kdb_enter+0x3b/frame 0xfffffe036713a380 vpanic() at vpanic+0x1ba/frame 0xfffffe036713a3d0 panic() at panic+0x43/frame 0xfffffe036713a430 trap_fatal() at trap_fatal+0x39c/frame 0xfffffe036713a490 trap_pfault() at trap_pfault+0x62/frame 0xfffffe036713a4e0 trap() at trap+0x2b2/frame 0xfffffe036713a5f0 calltrap() at calltrap+0x8/frame 0xfffffe036713a5f0 --- trap 0xc, rip = 0xffffffff80bb43ca, rsp = 0xfffffe036713a6c0, rbp = 0xfffffe036713a700 --- __mtx_lock_flags() at __mtx_lock_flags+0x4a/frame 0xfffffe036713a700 vop_stdgetwritemount() at vop_stdgetwritemount+0x31/frame 0xfffffe036713a730 VOP_GETWRITEMOUNT_APV() at VOP_GETWRITEMOUNT_APV+0x78/frame 0xfffffe036713a750 vn_start_write() at vn_start_write+0x42/frame 0xfffffe036713a7a0 vn_close1() at vn_close1+0x5c/frame 0xfffffe036713a810 vn_closefile() at vn_closefile+0x4c/frame 0xfffffe036713a890 _fdrop() at _fdrop+0x1a/frame 0xfffffe036713a8b0 closef() at closef+0x202/frame 0xfffffe036713a940 closefp() at closefp+0x9c/frame 0xfffffe036713a980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe036713aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe036713aab0 --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x80041521a, rsp = 0x7fffffffe6f8, rbp = 0x7fffffffe710 --- db:1:pho1> show allpcpu Current CPU: 5 cpuid = 0 dynamic pcpu = 0xb98400 curthread = 0xfffff800037ae000: pid 11 tid 100003 "idle: cpu0" curpcb = 0xfffffe0076766b80 fpcurthread = none idlethread = 0xfffff800037ae000: tid 100003 "idle: cpu0" curpmap = 0xffffffff81fb9d30 tssp = 0xffffffff82007160 commontssp = 0xffffffff82007160 rsp0 = 0xfffffe0076766b80 gs32p = 0xffffffff8200d9a8 ldt = 0xffffffff8200d9e8 tss = 0xffffffff8200d9d8 tlb gen = 181519191 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe0084fec400 curthread = 0xfffff800037af5a0: pid 11 tid 100004 "idle: cpu1" curpcb = 0xfffffe007676bb80 fpcurthread = none idlethread = 0xfffff800037af5a0: tid 100004 "idle: cpu1" curpmap = 0xffffffff81fb9d30 tssp = 0xffffffff820071c8 commontssp = 0xffffffff820071c8 rsp0 = 0xfffffe007676bb80 gs32p = 0xffffffff8200da10 ldt = 0xffffffff8200da50 tss = 0xffffffff8200da40 tlb gen = 181519191 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe0084ff8400 curthread = 0xfffff806429fa5a0: pid 14500 tid 103861 "pty2" curpcb = 0xfffffe0320872b80 fpcurthread = 0xfffff806429fa5a0: pid 14500 "pty2" idlethread = 0xfffff800037af000: tid 100005 "idle: cpu2" curpmap = 0xfffff803627b7130 tssp = 0xffffffff82007230 commontssp = 0xffffffff82007230 rsp0 = 0xfffffe0320872b80 gs32p = 0xffffffff8200da78 ldt = 0xffffffff8200dab8 tss = 0xffffffff8200daa8 tlb gen = 181519191 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe0085004400 curthread = 0xfffff800037b05a0: pid 11 tid 100006 "idle: cpu3" curpcb = 0xfffffe0076775b80 fpcurthread = none idlethread = 0xfffff800037b05a0: tid 100006 "idle: cpu3" curpmap = 0xffffffff81fb9d30 tssp = 0xffffffff82007298 commontssp = 0xffffffff82007298 rsp0 = 0xfffffe0076775b80 gs32p = 0xffffffff8200dae0 ldt = 0xffffffff8200db20 tss = 0xffffffff8200db10 tlb gen = 181519191 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe0085010400 curthread = 0xfffff800037b0000: pid 11 tid 100007 "idle: cpu4" curpcb = 0xfffffe007677ab80 fpcurthread = none idlethread = 0xfffff800037b0000: tid 100007 "idle: cpu4" curpmap = 0xffffffff81fb9d30 tssp = 0xffffffff82007300 commontssp = 0xffffffff82007300 rsp0 = 0xfffffe007677ab80 gs32p = 0xffffffff8200db48 ldt = 0xffffffff8200db88 tss = 0xffffffff8200db78 tlb gen = 181519191 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe008501c400 curthread = 0xfffff805738a8000: pid 14499 tid 104286 "pty2" curpcb = 0xfffffe036713ab80 fpcurthread = 0xfffff805738a8000: pid 14499 "pty2" idlethread = 0xfffff800037b15a0: tid 100008 "idle: cpu5" curpmap = 0xfffff80049afd130 tssp = 0xffffffff82007368 commontssp = 0xffffffff82007368 rsp0 = 0xfffffe036713ab80 gs32p = 0xffffffff8200dbb0 ldt = 0xffffffff8200dbf0 tss = 0xffffffff8200dbe0 tlb gen = 181519191 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe0085028400 curthread = 0xfffff800037b1000: pid 11 tid 100009 "idle: cpu6" curpcb = 0xfffffe0076784b80 fpcurthread = none idlethread = 0xfffff800037b1000: tid 100009 "idle: cpu6" curpmap = 0xffffffff81fb9d30 tssp = 0xffffffff820073d0 commontssp = 0xffffffff820073d0 rsp0 = 0xfffffe0076784b80 gs32p = 0xffffffff8200dc18 ldt = 0xffffffff8200dc58 tss = 0xffffffff8200dc48 tlb gen = 181519191 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe0085034400 curthread = 0xfffff806c3f16000: pid 14501 tid 104366 "pty2" curpcb = 0xfffffe03677d0b80 fpcurthread = 0xfffff806c3f16000: pid 14501 "pty2" idlethread = 0xfffff8000379c5a0: tid 100010 "idle: cpu7" curpmap = 0xfffff80241cc2130 tssp = 0xffffffff82007438 commontssp = 0xffffffff82007438 rsp0 = 0xfffffe03677d0b80 gs32p = 0xffffffff8200dc80 ldt = 0xffffffff8200dcc0 tss = 0xffffffff8200dcb0 tlb gen = 181519191 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe0085040400 curthread = 0xfffff8013b08c5a0: pid 22522 tid 100404 "egrep" curpcb = 0xfffffe034213fb80 fpcurthread = 0xfffff8013b08c5a0: pid 22522 "egrep" idlethread = 0xfffff8000379c000: tid 100011 "idle: cpu8" curpmap = 0xfffff80779207130 tssp = 0xffffffff820074a0 commontssp = 0xffffffff820074a0 rsp0 = 0xfffffe034213fb80 gs32p = 0xffffffff8200dce8 ldt = 0xffffffff8200dd28 tss = 0xffffffff8200dd18 tlb gen = 181519189 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe008504c400 curthread = 0xfffff8000379d5a0: pid 11 tid 100012 "idle: cpu9" curpcb = 0xfffffe0076793b80 fpcurthread = none idlethread = 0xfffff8000379d5a0: tid 100012 "idle: cpu9" curpmap = 0xffffffff81fb9d30 tssp = 0xffffffff82007508 commontssp = 0xffffffff82007508 rsp0 = 0xfffffe0076793b80 gs32p = 0xffffffff8200dd50 ldt = 0xffffffff8200dd90 tss = 0xffffffff8200dd80 tlb gen = 181519191 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe0085058400 curthread = 0xfffff8000379d000: pid 11 tid 100013 "idle: cpu10" curpcb = 0xfffffe0076798b80 fpcurthread = none idlethread = 0xfffff8000379d000: tid 100013 "idle: cpu10" curpmap = 0xffffffff81fb9d30 tssp = 0xffffffff82007570 commontssp = 0xffffffff82007570 rsp0 = 0xfffffe0076798b80 gs32p = 0xffffffff8200ddb8 ldt = 0xffffffff8200ddf8 tss = 0xffffffff8200dde8 tlb gen = 181519191 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe0085064400 curthread = 0xfffff8000379e5a0: pid 11 tid 100014 "idle: cpu11" curpcb = 0xfffffe007679db80 fpcurthread = none idlethread = 0xfffff8000379e5a0: tid 100014 "idle: cpu11" curpmap = 0xffffffff81fb9d30 tssp = 0xffffffff820075d8 commontssp = 0xffffffff820075d8 rsp0 = 0xfffffe007679db80 gs32p = 0xffffffff8200de20 ldt = 0xffffffff8200de60 tss = 0xffffffff8200de50 tlb gen = 181519191 curvnet = 0 spin locks held: db:1:pho1> show alllocks db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffff8000413d278: tag devfs, type VDIR usecount 3, writecount 0, refcount 3 mountedhere 0 flags (VV_ROOT|VI_ACTIVE) lock type devfs: EXCL by thread 0xfffff806c3f16000 (pid 14501, pty2, tid 104366) #0 0xffffffff80ba8612 at lockmgr_lock_fast_path+0x1e2 #1 0xffffffff81237b90 at VOP_LOCK1_APV+0x70 #2 0xffffffff80cc0365 at _vn_lock+0x65 #3 0xffffffff80a8b93e at devfs_populate_vp+0xbe #4 0xffffffff80a89a8c at devfs_lookup+0x2c #5 0xffffffff81234c06 at VOP_LOOKUP_APV+0x86 #6 0xffffffff80ca1b21 at lookup+0x601 #7 0xffffffff80ca0fb2 at namei+0x502 #8 0xffffffff80cbfc00 at vn_open_cred+0x240 #9 0xffffffff80cb7963 at kern_openat+0x1f3 #10 0xffffffff8119a254 at amd64_syscall+0x2d4 #11 0xffffffff81171b70 at fast_syscall_common+0x101 db:1:pho1> show allchains chain 1: thread 104163 (pid 22076, sh) sleeping on 0xfffff805664e0a60 "wait" chain 2: thread 116519 (pid 14498, pty2) sleeping on 0xfffff8010cb51a60 "wait" chain 3: thread 101479 (pid 14484, sh) sleeping on 0xfffff804a4608000 "wait" chain 4: thread 116561 (pid 14483, tee) sleeping on 0xfffff80342e90000 "piperd" chain 5: thread 102534 (pid 14482, sh) sleeping on 0xfffff804a4608a60 "wait" chain 6: thread 100417 (pid 23131, sh) sleeping on 0xfffff8031b714000 "wait" chain 7: thread 100179 (pid 2498, sh) sleeping on 0xfffff80018c1e8e8 "piperd" chain 8: thread 100201 (pid 2496, awk) sleeping on 0xfffff80007c1a2f8 "piperd" chain 9: thread 100227 (pid 2495, sh) sleeping on 0xfffff80006442a60 "wait" chain 10: thread 100200 (pid 2437, sh) blocked on lockmgr `7EXCL thread 0 (pid -512, ) is inactive chain 11: thread 100202 (pid 2357, bash) sleeping on 0xfffff80007c7e000 "wait" chain 12: thread 100222 (pid 2355, csh) sleeping on 0xfffff8031b379b08 "pause" chain 13: thread 100210 (pid 2354, su) sleeping on 0xfffff80007609a60 "wait" chain 14: thread 100161 (pid 2350, bash) sleeping on 0xfffff80006480530 "wait" chain 15: thread 100211 (pid 2349, sshd) sleeping on 0xfffff80003b4bb40 "select" chain 16: thread 100212 (pid 2346, sshd) sleeping on 0xfffff8000661c340 "select" chain 17: thread 100199 (pid 2342, csh) sleeping on 0xfffff800065c78b0 "ttyin" chain 18: thread 100220 (pid 2337, login) sleeping on 0xfffff8031b37a000 "wait" chain 19: thread 100219 (pid 2336, getty) sleeping on 0xfffff800065c7cb0 "ttyin" chain 20: thread 100218 (pid 2335, getty) sleeping on 0xfffff800061e24b0 "ttyin" chain 21: thread 100217 (pid 2334, getty) sleeping on 0xfffff800061e28b0 "ttyin" chain 22: thread 100216 (pid 2333, getty) sleeping on 0xfffff800061e2cb0 "ttyin" chain 23: thread 100215 (pid 2332, getty) sleeping on 0xfffff800061e10b0 "ttyin" chain 24: thread 100214 (pid 2331, getty) sleeping on 0xfffff800061e14b0 "ttyin" chain 25: thread 100207 (pid 2330, getty) sleeping on 0xfffff800061e18b0 "ttyin" chain 26: thread 100213 (pid 2329, getty) sleeping on 0xfffff800061e1cb0 "ttyin" chain 27: thread 100142 (pid 2328, getty) sleeping on 0xfffff800061e00b0 "ttyin" chain 28: thread 100205 (pid 2282, cron) sleeping on 0xffffffff81e90b58 "nanslp" chain 29: thread 100151 (pid 2278, sshd) sleeping on 0xfffff80018ae9c40 "select" chain 30: thread 100184 (pid 2249, ntpd) sleeping on 0xfffff800043223c0 "select" chain 31: thread 103942 (pid 2249, ntpd) sleeping on 0xfffff807ab410a00 "usem" chain 32: thread 100169 (pid 2186, NLM: master) sleeping on 0xfffff8031b489860 "rpcsvc" chain 33: thread 100144 (pid 2183, rpc.statd) sleeping on 0xfffff800043224c0 "select" chain 34: thread 100195 (pid 2137, watchdogd) sleeping on 0xffffffff81e90b53 "nanslp" chain 35: thread 100147 (pid 2058, rpcbind) sleeping on 0xfffff80003b4bc40 "select" chain 36: thread 100194 (pid 2048, syslogd) sleeping on 0xfffff80003983c40 "select" chain 37: thread 100164 (pid 1977, devd) sleeping on 0xfffff80003b4bcc0 "select" chain 38: thread 100196 (pid 1972, dhclient) sleeping on 0xfffff8000661c9c0 "select" chain 39: thread 100183 (pid 1928, dhclient) sleeping on 0xfffff8000651ec40 "select" chain 40: thread 100180 (pid 1925, dhclient) sleeping on 0xfffff80003885bc0 "select" chain 41: thread 100141 (pid 34, vnlru) sleeping on 0xfffff80003d93a60 "vlruwt" chain 42: thread 100140 (pid 33, syncer) sleeping on 0xffffffff81f67000 "syncer" chain 43: thread 100130 (pid 32, bufdaemon) sleeping on 0xffffffff81f66498 "qsleep" chain 44: thread 100132 (pid 32, bufspacedaemon-0) sleeping on 0xffffffff81a0a880 "-" chain 45: thread 100134 (pid 32, bufspacedaemon-1) sleeping on 0xffffffff81a12b40 "-" chain 46: thread 100135 (pid 32, bufspacedaemon-2) sleeping on 0xffffffff81a1ae00 "-" chain 47: thread 100136 (pid 32, bufspacedaemon-3) sleeping on 0xffffffff81a230c0 "-" chain 48: thread 100137 (pid 32, bufspacedaemon-4) sleeping on 0xffffffff81a2b380 "-" chain 49: thread 100138 (pid 32, bufspacedaemon-5) sleeping on 0xffffffff81a33640 "-" chain 50: thread 100139 (pid 32, bufspacedaemon-6) sleeping on 0xffffffff81a3b900 "-" chain 51: thread 100152 (pid 32, / worker) sleeping on 0xfffff80007b876e8 "sdflush" chain 52: thread 100203 (pid 32, /tmp worker) sleeping on 0xfffff80007de24e8 "sdflush" chain 53: thread 100129 (pid 31, vmdaemon) sleeping on 0xffffffff81f80788 "psleep" chain 54: thread 100128 (pid 30, dom0) sleeping on 0xffffffff81fea518 "psleep" chain 55: thread 100131 (pid 30, laundry: dom0) sleeping on 0xffffffff81fea524 "launds" chain 56: thread 100133 (pid 30, uma) sleeping on 0xffffffff80f0b370 "umarcl" chain 57: thread 100127 (pid 29, enc_daemon1) sleeping on 0xfffff80006510000 "idle" chain 58: thread 100126 (pid 28, enc_daemon0) blocked on lockmgr `EXCL thread 0 (pid -512, ) is inactive chain 59: thread 100120 (pid 27, rand_harvestq) sleeping on 0xffffffff81ced8a0 "-" chain 60: thread 100119 (pid 26, sctp_iterator) sleeping on 0xffffffff81fe8c30 "waiting_for_work" chain 61: thread 100118 (pid 25, soaiod4) sleeping on 0xffffffff81f65e9c "-" chain 62: thread 100117 (pid 24, soaiod3) sleeping on 0xffffffff81f65e9c "-" chain 63: thread 100116 (pid 23, soaiod2) sleeping on 0xffffffff81f65e9c "-" chain 64: thread 100115 (pid 22, soaiod1) sleeping on 0xffffffff81f65e9c "-" chain 65: thread 100096 (pid 21, usbus0) sleeping on 0xfffffe009a1aa460 "-" chain 66: thread 100097 (pid 21, usbus0) sleeping on 0xfffffe009a1aa4b8 "-" chain 67: thread 100098 (pid 21, usbus0) sleeping on 0xfffffe009a1aa510 "-" chain 68: thread 100099 (pid 21, usbus0) sleeping on 0xfffffe009a1aa568 "-" chain 69: thread 100100 (pid 21, usbus0) sleeping on 0xfffffe009a1aa5c0 "-" chain 70: thread 100102 (pid 21, usbus1) sleeping on 0xfffffe0006de6d10 "-" chain 71: thread 100103 (pid 21, usbus1) sleeping on 0xfffffe0006de6d68 "-" chain 72: thread 100104 (pid 21, usbus1) sleeping on 0xfffffe0006de6dc0 "-" chain 73: thread 100105 (pid 21, usbus1) sleeping on 0xfffffe0006de6e18 "-" chain 74: thread 100106 (pid 21, usbus1) sleeping on 0xfffffe0006de6e70 "-" chain 75: thread 100107 (pid 21, usbus2) sleeping on 0xfffffe009a63bd10 "-" chain 76: thread 100108 (pid 21, usbus2) sleeping on 0xfffffe009a63bd68 "-" chain 77: thread 100109 (pid 21, usbus2) sleeping on 0xfffffe009a63bdc0 "-" chain 78: thread 100110 (pid 21, usbus2) sleeping on 0xfffffe009a63be18 "-" chain 79: thread 100111 (pid 21, usbus2) sleeping on 0xfffffe009a63be70 "-" chain 80: thread 100091 (pid 20, doneq0) sleeping on 0xffffffff81bc8c40 "-" chain 81: thread 100092 (pid 20, doneq1) sleeping on 0xffffffff81bc8cc0 "-" chain 82: thread 100093 (pid 20, doneq2) sleeping on 0xffffffff81bc8d40 "-" chain 83: thread 100125 (pid 20, scanner) sleeping on 0xffffffff81bc8b08 "-" chain 84: thread 100090 (pid 19, crypto returns 11) sleeping on 0xfffff80003cdb450 "crypto_ret_wait" chain 85: thread 100089 (pid 18, crypto returns 10) sleeping on 0xfffff80003cdb3f0 "crypto_ret_wait" chain 86: thread 100088 (pid 17, crypto returns 9) sleeping on 0xfffff80003cdb390 "crypto_ret_wait" chain 87: thread 100087 (pid 16, crypto returns 8) sleeping on 0xfffff80003cdb330 "crypto_ret_wait" chain 88: thread 100086 (pid 15, crypto returns 7) sleeping on 0xfffff80003cdb2d0 "crypto_ret_wait" chain 89: thread 100085 (pid 9, crypto returns 6) sleeping on 0xfffff80003cdb270 "crypto_ret_wait" chain 90: thread 100084 (pid 8, crypto returns 5) sleeping on 0xfffff80003cdb210 "crypto_ret_wait" chain 91: thread 100083 (pid 7, crypto returns 4) sleeping on 0xfffff80003cdb1b0 "crypto_ret_wait" chain 92: thread 100082 (pid 6, crypto returns 3) sleeping on 0xfffff80003cdb150 "crypto_ret_wait" chain 93: thread 100081 (pid 5, crypto returns 2) sleeping on 0xfffff80003cdb0f0 "crypto_ret_wait" chain 94: thread 100080 (pid 4, crypto returns 1) sleeping on 0xfffff80003cdb090 "crypto_ret_wait" chain 95: thread 100079 (pid 3, crypto returns 0) sleeping on 0xfffff80003cdb030 "crypto_ret_wait" chain 96: thread 100078 (pid 2, crypto) sleeping on 0xffffffff81f7ade8 "crypto_wait" chain 97: thread 100065 (pid 14, sequencer 00) sleeping on 0xfffff80003d3bc88 "seqstate" chain 98: thread 100062 (pid 13, g_event) sleeping on 0xffffffff81fb90c0 "-" chain 99: thread 100063 (pid 13, g_up) sleeping on 0xffffffff81fb90d0 "-" chain 100: thread 100064 (pid 13, g_down) sleeping on 0xffffffff81fb90b8 "-" chain 101: thread 100016 (pid 12, swi6: Giant taskq) sleeping on 0xfffffe00767b3938 "devdrn" chain 102: thread 100002 (pid 1, init) sleeping on 0xfffff800037b2530 "wait" chain 103: thread 100001 (pid 10, audit) sleeping on 0xffffffff81fe9940 "audit_worker_cv" chain 104: thread 100000 (pid 0, swapper) sleeping on 0xffffffff81fb9100 "swapin" chain 105: thread 100017 (pid 0, thread taskq) sleeping on 0xfffff8000369bc00 "-" chain 106: thread 100019 (pid 0, config_0) sleeping on 0xfffff8000369ba00 "-" chain 107: thread 100020 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff8000369b900 "-" chain 108: thread 100021 (pid 0, aiod_kick taskq) sleeping on 0xfffff8000369b800 "-" chain 109: thread 100022 (pid 0, softirq_0) sleeping on 0xfffff8000369b700 "-" chain 110: thread 100023 (pid 0, softirq_1) sleeping on 0xfffff8000369b600 "-" chain 111: thread 100024 (pid 0, softirq_2) sleeping on 0xfffff8000369b500 "-" chain 112: thread 100025 (pid 0, softirq_3) sleeping on 0xfffff8000369b400 "-" chain 113: thread 100026 (pid 0, softirq_4) sleeping on 0xfffff8000369b300 "-" chain 114: thread 100027 (pid 0, softirq_5) sleeping on 0xfffff8000369b200 "-" chain 115: thread 100028 (pid 0, softirq_6) sleeping on 0xfffff8000369b100 "-" chain 116: thread 100029 (pid 0, softirq_7) sleeping on 0xfffff8000369b000 "-" chain 117: thread 100030 (pid 0, softirq_8) sleeping on 0xfffff8000369ae00 "-" chain 118: thread 100031 (pid 0, softirq_9) sleeping on 0xfffff8000369ad00 "-" chain 119: thread 100032 (pid 0, softirq_10) sleeping on 0xfffff8000369ac00 "-" chain 120: thread 100033 (pid 0, softirq_11) sleeping on 0xfffff8000369ab00 "-" chain 121: thread 100034 (pid 0, if_io_tqg_0) sleeping on 0xfffff8000369aa00 "-" chain 122: thread 100035 (pid 0, if_io_tqg_1) sleeping on 0xfffff8000369a900 "-" chain 123: thread 100036 (pid 0, if_io_tqg_2) sleeping on 0xfffff8000369a800 "-" chain 124: thread 100037 (pid 0, if_io_tqg_3) sleeping on 0xfffff8000369a700 "-" chain 125: thread 100038 (pid 0, if_io_tqg_4) sleeping on 0xfffff8000369a600 "-" chain 126: thread 100039 (pid 0, if_io_tqg_5) sleeping on 0xfffff8000369a500 "-" chain 127: thread 100040 (pid 0, if_io_tqg_6) sleeping on 0xfffff8000369a400 "-" chain 128: thread 100041 (pid 0, if_io_tqg_7) sleeping on 0xfffff8000369a300 "-" chain 129: thread 100042 (pid 0, if_io_tqg_8) sleeping on 0xfffff8000369a200 "-" chain 130: thread 100043 (pid 0, if_io_tqg_9) sleeping on 0xfffff8000369a100 "-" chain 131: thread 100044 (pid 0, if_io_tqg_10) sleeping on 0xfffff8000369a000 "-" chain 132: thread 100045 (pid 0, if_io_tqg_11) sleeping on 0xfffff80003699e00 "-" chain 133: thread 100046 (pid 0, if_config_tqg_0) sleeping on 0xfffff80003699d00 "-" chain 134: thread 100061 (pid 0, firmware taskq) sleeping on 0xfffff80003699c00 "-" chain 135: thread 100066 (pid 0, crypto_0) sleeping on 0xfffff80003699b00 "-" chain 136: thread 100067 (pid 0, crypto_1) sleeping on 0xfffff80003699b00 "-" chain 137: thread 100068 (pid 0, crypto_2) sleeping on 0xfffff80003699b00 "-" chain 138: thread 100069 (pid 0, crypto_3) sleeping on 0xfffff80003699b00 "-" chain 139: thread 100070 (pid 0, crypto_4) sleeping on 0xfffff80003699b00 "-" chain 140: thread 100071 (pid 0, crypto_5) sleeping on 0xfffff80003699b00 "-" chain 141: thread 100072 (pid 0, crypto_6) sleeping on 0xfffff80003699b00 "-" chain 142: thread 100073 (pid 0, crypto_7) sleeping on 0xfffff80003699b00 "-" chain 143: thread 100074 (pid 0, crypto_8) sleeping on 0xfffff80003699b00 "-" chain 144: thread 100075 (pid 0, crypto_9) sleeping on 0xfffff80003699b00 "-" chain 145: thread 100076 (pid 0, crypto_10) sleeping on 0xfffff80003699b00 "-" chain 146: thread 100077 (pid 0, crypto_11) sleeping on 0xfffff80003699b00 "-" chain 147: thread 100114 (pid 0, mca taskq) blocked on lockmgr (null)EXCL thread 0 (pid 0, ) is inactive chain 148: thread 100121 (pid 0, acpi_task_0) sleeping on 0xfffff800077eb200 "-" chain 149: thread 100122 (pid 0, acpi_task_1) sleeping on 0xfffff800077eb200 "-" chain 150: thread 100123 (pid 0, acpi_task_2) sleeping on 0xfffff800077eb200 "-" chain 151: thread 100124 (pid 0, CAM taskq) sleeping on 0xfffff80003699a00 "-" db:1:pho1> show mount 0xfffff80004140000 /dev/gpt/work on / (ufs) 0xfffff8000413f000 devfs on /dev (devfs) 0xfffff80004141000 /dev/gpt/tmp on /tmp (ufs) 0xfffff801cab5e000 procfs on /proc (procfs) More info: show mount db:1:pho1> show bufqueues bqempty: 17660 Buf domain 0 freebufs 13802 lofreebufs 219 hifreebufs 329 bufspace 10436608 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1324 (10317824) dirtyq count 1 (8192) wakeup 0 lim 25 CPU 0, 1, 1, 0, 0, 0, 1, 2, 1, 0, 0, 0, Locked buffers: 0 space 0 Total buffers: 14261 space 10436608 Buf domain 1 freebufs 12186 lofreebufs 219 hifreebufs 329 bufspace 63574016 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 25 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 2892 (61771776) dirtyq count 25 (819200) wakeup 0 lim 25 CPU 0, 7, 0, 0, 0, 13, 1, 2, 5, 0, 2, 0, Locked buffers: 0 space 0 Total buffers: 15452 space 63574016 Buf domain 2 freebufs 13392 lofreebufs 219 hifreebufs 329 bufspace 24940544 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1734 (24829952) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 0, 1, 0, 0, 2, 0, 1, 2, 0, 1, 0, Locked buffers: 0 space 0 Total buffers: 13959 space 24940544 Buf domain 3 freebufs 13863 lofreebufs 219 hifreebufs 329 bufspace 9052160 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 1266 (9027584) dirtyq count 1 (4096) wakeup 0 lim 25 CPU 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 1, 1, Locked buffers: 0 space 0 Total buffers: 13643 space 9052160 Buf domain 4 freebufs 12385 lofreebufs 219 hifreebufs 329 bufspace 54370304 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 2 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 2744 (54333440) dirtyq count 2 (8192) wakeup 0 lim 25 CPU 0, 0, 1, 0, 0, 0, 0, 0, 0, 1, 0, 0, Locked buffers: 0 space 0 Total buffers: 15545 space 54370304 Buf domain 5 freebufs 15022 lofreebufs 219 hifreebufs 329 bufspace 2678784 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 111 (2678784) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, Locked buffers: 0 space 0 Total buffers: 16965 space 2678784 Buf domain 6 freebufs 10097 lofreebufs 219 hifreebufs 329 bufspace 26849280 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 5034 (26836992) dirtyq count 0 (0) wakeup 0 lim 25 CPU 0, 0, 1, 0, 0, 0, 0, 1, 0, 0, 0, 0, Locked buffers: 0 space 0 Total buffers: 16106 space 26849280 db:1:pho1> show page vm_cnt.v_free_count: 7079165 vm_cnt.v_inactive_count: 822 vm_cnt.v_active_count: 830 vm_cnt.v_laundry_count: 7886 vm_cnt.v_wire_count: 1026355 vm_cnt.v_free_reserved: 10642 vm_cnt.v_free_min: 51256 vm_cnt.v_free_target: 173098 vm_cnt.v_inactive_target: 259647 db:1:pho1> show pageq pq_free 7079165 dom 0 page_cnt 8123034 free 7079165 pq_act 830 pq_inact 822 pq_laund 7886 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000002 | 000000 11 (008192K) | 000383 | 000000 10 (004096K) | 001478 | 000000 09 (002048K) | 002627 | 000000 08 (001024K) | 003329 | 000004 07 (000512K) | 004895 | 000021 06 (000256K) | 007198 | 000059 05 (000128K) | 011005 | 000145 04 (000064K) | 018946 | 000555 03 (000032K) | 032578 | 002357 02 (000016K) | 051658 | 006306 01 (000008K) | 074632 | 011132 00 (000004K) | 066146 | 008911 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000000 | 000000 05 (000128K) | 000001 | 000000 04 (000064K) | 000003 | 000000 03 (000032K) | 000003 | 000000 02 (000016K) | 000004 | 000000 01 (000008K) | 000003 | 000000 00 (000004K) | 000003 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket XFree mqnotifier 216 0 0 0 0 61 0 mvdata 64 0 0 0 0 253 0 mqueue 264 0 0 0 0 29 0 mqnode 416 3 15 3 0 29 0 FFS2 dinode 256 15152 231478 40564346 0 200 0 FFS1 dinode 128 0 0 11 0 125 0 FFS inode 160 15152 231880 40565344 0 198 0 swblk 136 0 132994 1530560 0 61 0 swpctrie 144 0 9666 122062 0 61 0 selfd 64 710 2824 129525395 0 253 0 rtentry 208 12 121 18 0 61 0 IPsec SA lft_c 16 0 0 0 0 253 0 ripcb 488 1 7 543551 0 29 0 udplite_inpcb 488 0 0 0 0 29 0 sctp_asconf_ack 48 0 0 0 0 253 0 sctp_asconf 40 0 0 0 0 253 0 sctp_stream_msg_out 112 0 0 0 0 125 0 sctp_readq 152 0 0 0 0 61 0 sctp_chunk 152 0 0 0 0 61 0 sctp_raddr 736 0 0 0 0 13 0 sctp_laddr 48 0 0 6 0 253 0 sctp_asoc 2408 0 0 0 0 3 0 sctp_ep 1280 0 0 447552 0 9 0 tcp_log_node 120 0 0 0 0 125 0 tcp_log_bucket 144 0 0 0 0 61 0 tcp_log 408 0 0 0 0 29 0 tcpreass 48 0 0 13188 0 253 0 tfo_ccache_entries 80 0 0 0 0 125 0 tfo 4 0 0 0 0 253 0 sackhole 32 0 0 17105 0 253 0 hostcache 96 1 40 1 0 125 0 syncache 168 0 736 10632 0 61 0 tcptw 88 0 1530 1329 0 125 0 tcpcb 976 9 443 494786 0 13 0 tcp_inpcb 488 9 959 494786 0 30 0 udpcb 32 20 2832 449989 0 253 0 udp_inpcb 488 20 348 449989 0 29 0 ipq 56 0 0 0 0 253 0 unpcb 256 19 671 5704489 0 61 0 socket 904 51 939613 8140145 0 13 0 KNOTE 160 0 0 81512346 0 61 0 itimer 352 0 0 0 0 29 0 ksiginfo 112 23235 1650 1587437 0 125 0 AIOLIO 280 0 0 0 0 29 0 AIOCB 752 0 0 0 0 13 0 AIOP 32 0 0 0 0 253 0 AIO 208 0 0 0 0 61 0 Mountpoints 2896 4 108 62855 0 3 0 procdesc 136 1 28 1022508 0 61 0 pipe 760 9 366 28772140 0 13 0 DIRHASH 1024 54 2506 831930 0 16 0 NCLNODE 744 0 0 0 0 13 0 LTS VFS Cache 368 0 0 0 0 29 0 L VFS Cache 328 51 153 288621 0 29 0 STS VFS Cache 148 0 0 0 0 61 0 S VFS Cache 108 22519 220521 41948723 0 138 0 rentr 24 0 2158 9726537 0 253 0 NAMEI 1024 1 511 515278639 0 16 0 BUF TRIE 144 996 104952 30633675 0 62 0 VNODEPOLL 120 0 0 357 0 125 0 VNODE 632 15269 231601 87930090 0 199 0 vtnet_tx_hdr 24 0 0 0 0 253 0 crypto_session 24 0 0 0 0 253 0 cryptodesc 120 0 0 0 0 125 0 cryptop 128 0 0 0 0 125 0 nvme_request 128 0 0 0 0 125 0 g_bio 408 0 5337 137447191 0 184 0 FPU_save_area 832 0 0 0 0 13 0 DMAR_MAP_ENTRY 120 0 0 0 0 125 0 ttyoutq 256 173 142 10749667 0 61 0 ttyinq 160 330 198 20155636 0 61 0 epoch_record pcpu 256 4 12 4 0 61 0 mbuf_extpgs 256 0 0 0 0 61 0 mbuf_jumbo_16k 16384 0 0 0 0 1 0 mbuf_jumbo_9k 9216 0 0 0 0 1 0 mbuf_jumbo_page 4096 0 0 17845075 0 1 0 mbuf_cluster 2048 10730 44 186813 0 5 0 mbuf 256 6255 9105 335612119 0 253 0 mbuf_packet 256 26 4564 56476587 0 253 0 audit_record 1280 0 0 0 0 9 0 domainset 40 0 0 4 0 253 0 cpuset 104 27 345 32 0 125 0 THREAD 1440 23378 44240 43134595 0 9 0 PROC 1328 77 23185 10013830 0 9 0 MAC labels 40 0 0 0 0 253 0 pbuf 984 0 866 0 0 1 0 vnpbuf 984 0 0 2484 0 13 0 clpbuf 984 0 128 4406555 309624 5 0 mdpbuf 984 0 0 450031 0 1 0 nfspbuf 984 0 0 0 0 5 0 swwbuf 984 0 0 817170 0 1 0 swrbuf 984 0 17 278163 0 5 0 umtx_shm 88 0 0 35 0 125 0 umtx pi 96 0 1517 45243601 0 125 0 TURNSTILE 136 67619 301 67619 0 61 0 rangeset pctrie nodes 144 0 0 0 0 61 0 rl_entry 40 6985 2717 6985 0 253 0 filedesc0 1104 78 5220 10013831 0 14 0 Files 80 124 941362 478835707 0 126 0 SLEEPQUEUE 88 67619 333 67619 0 125 0 65536 65536 2 0 15 0 1 0 65536 65536 0 12 870 0 1 0 65536 65536 1 12 147798 0 1 0 65536 65536 3 0 319 0 1 0 65536 65536 4 10 2428 0 1 0 65536 65536 0 0 0 0 1 0 65536 65536 1 0 3 0 1 0 65536 65536 2 0 6 0 1 0 32768 32768 1 0 23 0 1 0 32768 32768 1 12 872 0 1 0 32768 32768 2 24 1260615 0 1 0 32768 32768 12 87 676388 0 1 0 32768 32768 9 20 4106 0 1 0 32768 32768 12 0 12 0 1 0 32768 32768 0 0 3 0 1 0 32768 32768 1 0 8 0 1 0 16384 16384 0 0 76 0 1 0 16384 16384 0 0 3 0 1 0 16384 16384 39 11 1148 0 1 0 16384 16384 9 1 2439367 0 1 0 16384 16384 15 0 2845 0 1 0 16384 16384 0 0 0 0 1 0 16384 16384 1 0 4 0 1 0 16384 16384 0 0 7 0 1 0 8192 8192 0 19 791325 0 1 0 8192 8192 4 8 49686 0 1 0 8192 8192 13 20 49506 0 1 0 8192 8192 86 1 385757 0 1 0 8192 8192 13 0 1676 0 1 0 8192 8192 12 0 12 0 1 0 8192 8192 4 0 7 0 1 0 8192 8192 1 0 15 0 1 0 4096 4096 1 11 99483 0 1 0 4096 4096 13 57 59060823 0 2 0 4096 4096 49 73 2124535 0 2 0 4096 4096 3 6 1176045 0 1 0 4096 4096 18 11 502603 0 1 0 4096 4096 437 23120 11232996 0 3 0 4096 4096 2 0 7 0 1 0 4096 4096 7 0 44 0 1 0 2048 2048 2 50 169551 0 5 0 2048 2048 3 3 16 0 5 0 2048 2048 118 130 19189746 0 5 0 2048 2048 2 2 20295064 0 5 0 2048 2048 12 40 448128 0 5 0 2048 2048 0 0 0 0 5 0 2048 2048 0 0 15 0 5 0 2048 2048 0 0 290 0 5 0 1024 1024 3 105 201049 0 13 0 1024 1024 0 0 1 0 13 0 1024 1024 500055 169 8379030 0 13 0 1024 1024 40 208 7173796 0 13 0 1024 1024 190 218 3730991 0 13 0 1024 1024 4 196 1466772 0 13 0 1024 1024 1 159 21382 0 13 0 1024 1024 3 185 3855 0 13 0 512 512 2 303217 33775714 0 57 0 512 512 87 151 88963 0 29 0 512 512 152 352 1726203 0 29 0 512 512 14 49 16773069 0 29 0 512 512 37 348 1012125 0 29 0 512 512 23263 159 23263 0 29 0 512 512 17 39 50 0 29 0 512 512 191 411 72498 0 29 0 256 256 52 2813 4494672 0 61 0 256 256 18 5187 10167340 0 61 0 256 256 500980 75830 58547559 0 62 0 256 256 221 39619 126061478 0 61 0 256 256 236 1549 10417997 0 62 0 256 256 11 124 54944 0 61 0 256 256 61 674 15415709 0 61 0 256 256 104 676 7850 0 61 0 128 128 62 1643 859680 0 125 0 128 128 4 1887 2466371 0 125 0 128 128 898 254511 108759833 0 128 0 128 128 135785 202704 63125540 0 128 0 128 128 14986 5350 403931301 0 125 0 128 128 33 1393 130182 0 125 0 128 128 2451 1269 172587 0 125 0 128 128 96 1392 14877 0 125 0 64 64 280 3750 284591190 0 253 0 64 64 60 23066 6204818 0 253 0 64 64 509436 26119 41009254 0 253 0 64 64 115 27103 56293647 0 253 0 64 64 9336 5358 273522764 0 253 0 64 64 15 3333 599618 0 253 0 64 64 528 774 69345 0 253 0 64 64 220 2818 27109 0 253 0 32 32 67634 2550 193888 0 253 0 32 32 187 4525 97289929 0 253 0 32 32 282 4058 8901950 0 253 0 32 32 59 3165 23032767 0 253 0 32 32 568 3152 1333130 0 253 0 32 32 113 3607 1165584 0 253 0 32 32 3511 2565 173524 0 253 0 32 32 42 3058 9557792 0 253 0 16 16 18 2970 8677985 0 253 0 16 16 29 1465 53 0 253 0 16 16 588 3147 25187675 0 253 0 16 16 3 1740 5240286 0 253 0 16 16 657 3078 1534374 0 253 0 16 16 4 1988 618 0 253 0 16 16 2833 2396 3518 0 253 0 16 16 35 3202 70011058 0 253 0 mt_zone 24 430 400 573 0 253 0 mt_stats_zone 64 430 274 573 0 253 0 64 pcpu 8 3035 2597 97589 0 253 0 fakepg 104 0 52820 5649242 0 125 0 VMSPACE 2552 45 5221 9993853 0 13 0 MAP ENTRY 112 1773 109422 585621195 0 253 0 KMAP ENTRY 112 9 199 87 0 125 0 MAP 232 2 65 2 0 61 0 RADIX NODE 144 34867 474098 206139427 0 253 0 VM OBJECT 256 539030 585685 158700871 0 188 0 vmem btag 56 82021 42707 2370209 0 253 0 vmem 1856 0 1 0 0 5 0 256 Bucket 2048 7530 3375 5657619 0 239 0 128 Bucket 1024 1810 6954 1494313 0 85 0 64 Bucket 512 7378 1393 1927208 0 30 0 32 Bucket 256 624 4925 3365039 0 61 0 16 Bucket 128 1038 1720 1502648 0 125 0 12 Bucket 96 2628 2005 694868 0 125 0 8 Bucket 64 111 4228 2222008 0 253 0 6 Bucket 48 7789 1839 902160 0 253 0 4 Bucket 32 487 4721 21262556 0 253 0 UMA Hash 256 0 11 196 0 0 0 UMA Slabs 112 164128 11 574440 0 0 0 UMA Zones 1968 87 1 31477 0 0 0 UMA Kegs 216 79 0 31469 0 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket kstack_cache 16384 23251 129 43134466 1 vm pgcache 104 783463 3705 222600144 253 vm pgcache 104 144034 4211 582152084 253 buf free cache 984 47938 73087 42256307 62 buffer arena-65 65536 0 6 4129403 1 buffer arena-61 61440 0 0 4129281 1 buffer arena-57 57344 0 0 4129281 1 buffer arena-53 53248 0 0 4129281 1 buffer arena-49 49152 0 0 4129281 1 buffer arena-45 45056 0 0 4129281 1 buffer arena-40 40960 0 0 4129281 1 buffer arena-36 36864 0 0 4129281 1 buffer arena-32 32768 198487 4484 14538224 16 buffer arena-28 28672 0 0 4129281 1 buffer arena-24 24576 0 0 4129281 1 buffer arena-20 20480 0 0 4129281 1 buffer arena-16 16384 23476 28243 7944124 43 buffer arena-12 12288 0 0 4129281 1 buffer arena-81 8192 0 0 4129281 1 buffer arena-40 4096 0 10 4129321 1 db:0:pho> acttrace Tracing command egrep pid 22522 tid 100404 td 0xfffff8013b08c5a0 (CPU 8) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bc7df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bc7e10 trap() at trap+0x46/frame 0xfffffe0006bc7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc7f20 --- trap 0x13, rip = 0xffffffff80f094c0, rsp = 0xfffffe034213f520, rbp = 0xfffffe034213f580 --- uma_zfree_arg() at uma_zfree_arg+0x100/frame 0xfffffe034213f580 vm_object_page_remove() at vm_object_page_remove+0x251/frame 0xfffffe034213f5e0 vm_map_entry_delete() at vm_map_entry_delete+0x112/frame 0xfffffe034213f630 vm_map_delete() at vm_map_delete+0x185/frame 0xfffffe034213f6a0 vm_map_remove() at vm_map_remove+0x81/frame 0xfffffe034213f6d0 pipeclose() at pipeclose+0x2e1/frame 0xfffffe034213f710 pipe_close() at pipe_close+0x60/frame 0xfffffe034213f740 _fdrop() at _fdrop+0x1a/frame 0xfffffe034213f760 closef() at closef+0x202/frame 0xfffffe034213f7f0 fdescfree_fds() at fdescfree_fds+0xbc/frame 0xfffffe034213f840 fdescfree() at fdescfree+0x465/frame 0xfffffe034213f900 exit1() at exit1+0x4f2/frame 0xfffffe034213f970 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe034213f980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe034213fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe034213fab0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x80040379a, rsp = 0x7fffffffe518, rbp = 0x7fffffffe530 --- Tracing command pty2 pid 14501 tid 104366 td 0xfffff806c3f16000 (CPU 7) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bbbdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bbbe10 trap() at trap+0x46/frame 0xfffffe0006bbbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bbbf20 --- trap 0x13, rip = 0xffffffff80a85f78, rsp = 0xfffffe03677d0300, rbp = 0xfffffe03677d0330 --- devfs_find() at devfs_find+0x38/frame 0xfffffe03677d0330 devfs_lookup() at devfs_lookup+0x298/frame 0xfffffe03677d0510 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x86/frame 0xfffffe03677d0530 lookup() at lookup+0x601/frame 0xfffffe03677d05d0 namei() at namei+0x502/frame 0xfffffe03677d06c0 vn_open_cred() at vn_open_cred+0x240/frame 0xfffffe03677d0810 kern_openat() at kern_openat+0x1f3/frame 0xfffffe03677d0980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe03677d0ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe03677d0ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x80041066a, rsp = 0x7fffffffe608, rbp = 0x7fffffffe6f0 --- Tracing command pty2 pid 14500 tid 103861 td 0xfffff806429fa5a0 (CPU 2) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b7fdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b7fe10 trap() at trap+0x46/frame 0xfffffe0006b7ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b7ff20 --- trap 0x13, rip = 0xffffffff80b7c306, rsp = 0xfffffe0320872800, rbp = 0xfffffe0320872810 --- _fdrop() at _fdrop+0x26/frame 0xfffffe0320872810 kern_openat() at kern_openat+0x450/frame 0xfffffe0320872980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe0320872ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0320872ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x80041066a, rsp = 0x7fffffffe608, rbp = 0x7fffffffe6f0 --- Tracing command pty2 pid 14499 tid 104286 td 0xfffff805738a8000 (CPU 5) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe036713a380 vpanic() at vpanic+0x1ba/frame 0xfffffe036713a3d0 panic() at panic+0x43/frame 0xfffffe036713a430 trap_fatal() at trap_fatal+0x39c/frame 0xfffffe036713a490 trap_pfault() at trap_pfault+0x62/frame 0xfffffe036713a4e0 trap() at trap+0x2b2/frame 0xfffffe036713a5f0 calltrap() at calltrap+0x8/frame 0xfffffe036713a5f0 --- trap 0xc, rip = 0xffffffff80bb43ca, rsp = 0xfffffe036713a6c0, rbp = 0xfffffe036713a700 --- __mtx_lock_flags() at __mtx_lock_flags+0x4a/frame 0xfffffe036713a700 vop_stdgetwritemount() at vop_stdgetwritemount+0x31/frame 0xfffffe036713a730 VOP_GETWRITEMOUNT_APV() at VOP_GETWRITEMOUNT_APV+0x78/frame 0xfffffe036713a750 vn_start_write() at vn_start_write+0x42/frame 0xfffffe036713a7a0 vn_close1() at vn_close1+0x5c/frame 0xfffffe036713a810 vn_closefile() at vn_closefile+0x4c/frame 0xfffffe036713a890 _fdrop() at _fdrop+0x1a/frame 0xfffffe036713a8b0 closef() at closef+0x202/frame 0xfffffe036713a940 closefp() at closefp+0x9c/frame 0xfffffe036713a980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe036713aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe036713aab0 --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x80041521a, rsp = 0x7fffffffe6f8, rbp = 0x7fffffffe710 --- Tracing command idle pid 11 tid 100003 td 0xfffff800037ae000 (CPU 0) cpustop_handler() at cpustop_handler+0x2d/frame 0xffffffff81f9f710 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xffffffff81f9f730 trap() at trap+0x46/frame 0xffffffff81f9f840 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81f9f840 --- trap 0x13, rip = 0xffffffff8115a376, rsp = 0xfffffe0076766910, rbp = 0xfffffe0076766910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076766910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076766960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076766980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00767669a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe0076766a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076766ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076766ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff800037af5a0 (CPU 1) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b73df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b73e10 trap() at trap+0x46/frame 0xfffffe0006b73f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b73f20 --- trap 0x13, rip = 0xffffffff8115a376, rsp = 0xfffffe007676b910, rbp = 0xfffffe007676b910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007676b910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007676b960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007676b980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007676b9a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe007676ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe007676bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007676bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff800037b05a0 (CPU 3) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b8bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b8be10 trap() at trap+0x46/frame 0xfffffe0006b8bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b8bf20 --- trap 0x13, rip = 0xffffffff8115a376, rsp = 0xfffffe0076775910, rbp = 0xfffffe0076775910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076775910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076775960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076775980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00767759a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe0076775a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076775ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076775ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff800037b0000 (CPU 4) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b97df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b97e10 trap() at trap+0x46/frame 0xfffffe0006b97f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b97f20 --- trap 0x13, rip = 0xffffffff8115a376, rsp = 0xfffffe007677a910, rbp = 0xfffffe007677a910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007677a910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007677a960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007677a980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007677a9a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe007677aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007677aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007677aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff800037b1000 (CPU 6) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bafdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bafe10 trap() at trap+0x46/frame 0xfffffe0006baff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006baff20 --- trap 0x13, rip = 0xffffffff8115a376, rsp = 0xfffffe0076784910, rbp = 0xfffffe0076784910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076784910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076784960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076784980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00767849a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe0076784a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076784ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076784ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff8000379d5a0 (CPU 9) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bd3df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bd3e10 trap() at trap+0x46/frame 0xfffffe0006bd3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bd3f20 --- trap 0x13, rip = 0xffffffff8115a376, rsp = 0xfffffe0076793910, rbp = 0xfffffe0076793910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076793910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076793960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076793980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00767939a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe0076793a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076793ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076793ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff8000379d000 (CPU 10) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bdfdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bdfe10 trap() at trap+0x46/frame 0xfffffe0006bdff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bdff20 --- trap 0x13, rip = 0xffffffff8115a376, rsp = 0xfffffe0076798910, rbp = 0xfffffe0076798910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076798910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076798960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076798980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00767989a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe0076798a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076798ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076798ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff8000379e5a0 (CPU 11) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bebdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bebe10 trap() at trap+0x46/frame 0xfffffe0006bebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bebf20 --- trap 0x13, rip = 0xffffffff8115a376, rsp = 0xfffffe007679d910, rbp = 0xfffffe007679d910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007679d910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007679d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007679d980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007679d9a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe007679da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007679dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007679dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 22522 22076 2437 0 RE CPU 8 egrep 22076 2495 2437 0 S wait 0xfffff805664e0a60 sh 14501 14498 23131 0 R+ CPU 7 pty2 14500 14498 23131 0 R+ CPU 2 pty2 14499 14498 23131 0 R+ CPU 5 pty2 14498 14484 23131 0 S+ wait 0xfffff8010cb51a60 pty2 14484 14482 23131 0 S+ wait 0xfffff804a4608000 sh 14483 23131 23131 0 S+ piperd 0xfffff80342e90000 tee 14482 23131 23131 0 S+ wait 0xfffff804a4608a60 sh 23131 2357 23131 0 S+ wait 0xfffff8031b714000 sh 2498 2437 2437 0 S piperd 0xfffff80018c1e8e8 sh 2496 2437 2437 0 S piperd 0xfffff80007c1a2f8 awk 2495 2437 2437 0 S wait 0xfffff80006442a60 sh 2437 1 2437 0 SWs wait 0xfffff80007db4000 sh 2357 2355 2357 0 SW+ wait 0xfffff80007c7e000 bash 2355 2354 2355 0 SW+ pause 0xfffff8031b379b08 csh 2354 2350 2354 2006 SW+ wait 0xfffff80007609a60 su 2350 2349 2350 2006 SWs+ wait 0xfffff80006480530 bash 2349 2346 2346 2006 S select 0xfffff80003b4bb40 sshd 2346 2278 2346 0 Ss select 0xfffff8000661c340 sshd 2342 2337 2342 0 S+ ttyin 0xfffff800065c78b0 csh 2337 1 2337 0 SWs+ wait 0xfffff8031b37a000 login 2336 1 2336 0 Ss+ ttyin 0xfffff800065c7cb0 getty 2335 1 2335 0 Ss+ ttyin 0xfffff800061e24b0 getty 2334 1 2334 0 Ss+ ttyin 0xfffff800061e28b0 getty 2333 1 2333 0 Ss+ ttyin 0xfffff800061e2cb0 getty 2332 1 2332 0 Ss+ ttyin 0xfffff800061e10b0 getty 2331 1 2331 0 Ss+ ttyin 0xfffff800061e14b0 getty 2330 1 2330 0 Ss+ ttyin 0xfffff800061e18b0 getty 2329 1 2329 0 Ss+ ttyin 0xfffff800061e1cb0 getty 2328 1 2328 0 Ss+ ttyin 0xfffff800061e00b0 getty 2282 1 2282 0 Ss nanslp 0xffffffff81e90b58 cron 2278 1 2278 0 Ss select 0xfffff80018ae9c40 sshd 2249 1 2249 123 Ss (threaded) ntpd 100184 S select 0xfffff800043223c0 ntpd 103942 S usem 0xfffff807ab410a00 ntpd 2186 1 2186 0 Ss rpcsvc 0xfffff8031b489860 NLM: master 2183 1 2183 0 Ss select 0xfffff800043224c0 rpc.statd 2137 1 2137 0 Ss nanslp 0xffffffff81e90b53 watchdogd 2058 1 2058 0 Ss select 0xfffff80003b4bc40 rpcbind 2048 1 2048 0 Ss select 0xfffff80003983c40 syslogd 1977 1 1977 0 Ss select 0xfffff80003b4bcc0 devd 1972 1 1972 65 Ss select 0xfffff8000661c9c0 dhclient 1928 1 1928 0 Ss select 0xfffff8000651ec40 dhclient 1925 1 1925 0 Ss select 0xfffff80003885bc0 dhclient 34 0 0 0 DL vlruwt 0xfffff80003d93a60 [vnlru] 33 0 0 0 DL syncer 0xffffffff81f67000 [syncer] 32 0 0 0 DL (threaded) [bufdaemon] 100130 D qsleep 0xffffffff81f66498 [bufdaemon] 100132 D - 0xffffffff81a0a880 [bufspacedaemon-0] 100134 D - 0xffffffff81a12b40 [bufspacedaemon-1] 100135 D - 0xffffffff81a1ae00 [bufspacedaemon-2] 100136 D - 0xffffffff81a230c0 [bufspacedaemon-3] 100137 D - 0xffffffff81a2b380 [bufspacedaemon-4] 100138 D - 0xffffffff81a33640 [bufspacedaemon-5] 100139 D - 0xffffffff81a3b900 [bufspacedaemon-6] 100152 D sdflush 0xfffff80007b876e8 [/ worker] 100203 D sdflush 0xfffff80007de24e8 [/tmp worker] 31 0 0 0 DL psleep 0xffffffff81f80788 [vmdaemon] 30 0 0 0 DL (threaded) [pagedaemon] 100128 D psleep 0xffffffff81fea518 [dom0] 100131 D launds 0xffffffff81fea524 [laundry: dom0] 100133 D umarcl 0xffffffff80f0b370 [uma] 29 0 0 0 DL idle 0xfffff80006510000 [enc_daemon1] 28 0 0 0 DL idle 0xfffff80006510530 [enc_daemon0] 27 0 0 0 DL - 0xffffffff81ced8a0 [rand_harvestq] 26 0 0 0 DL waiting 0xffffffff81fe8c30 [sctp_iterator] 25 0 0 0 DL - 0xffffffff81f65e9c [soaiod4] 24 0 0 0 DL - 0xffffffff81f65e9c [soaiod3] 23 0 0 0 DL - 0xffffffff81f65e9c [soaiod2] 22 0 0 0 DL - 0xffffffff81f65e9c [soaiod1] 21 0 0 0 DL (threaded) [usb] 100096 D - 0xfffffe009a1aa460 [usbus0] 100097 D - 0xfffffe009a1aa4b8 [usbus0] 100098 D - 0xfffffe009a1aa510 [usbus0] 100099 D - 0xfffffe009a1aa568 [usbus0] 100100 D - 0xfffffe009a1aa5c0 [usbus0] 100102 D - 0xfffffe0006de6d10 [usbus1] 100103 D - 0xfffffe0006de6d68 [usbus1] 100104 D - 0xfffffe0006de6dc0 [usbus1] 100105 D - 0xfffffe0006de6e18 [usbus1] 100106 D - 0xfffffe0006de6e70 [usbus1] 100107 D - 0xfffffe009a63bd10 [usbus2] 100108 D - 0xfffffe009a63bd68 [usbus2] 100109 D - 0xfffffe009a63bdc0 [usbus2] 100110 D - 0xfffffe009a63be18 [usbus2] 100111 D - 0xfffffe009a63be70 [usbus2] 20 0 0 0 DL (threaded) [cam] 100091 D - 0xffffffff81bc8c40 [doneq0] 100092 D - 0xffffffff81bc8cc0 [doneq1] 100093 D - 0xffffffff81bc8d40 [doneq2] 100125 D - 0xffffffff81bc8b08 [scanner] 19 0 0 0 DL crypto_ 0xfffff80003cdb450 [crypto returns 11] 18 0 0 0 DL crypto_ 0xfffff80003cdb3f0 [crypto returns 10] 17 0 0 0 DL crypto_ 0xfffff80003cdb390 [crypto returns 9] 16 0 0 0 DL crypto_ 0xfffff80003cdb330 [crypto returns 8] 15 0 0 0 DL crypto_ 0xfffff80003cdb2d0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff80003cdb270 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff80003cdb210 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff80003cdb1b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff80003cdb150 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff80003cdb0f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff80003cdb090 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff80003cdb030 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff81f7ade8 [crypto] 14 0 0 0 DL seqstat 0xfffff80003d3bc88 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100062 D - 0xffffffff81fb90c0 [g_event] 100063 D - 0xffffffff81fb90d0 [g_up] 100064 D - 0xffffffff81fb90b8 [g_down] 12 0 0 0 DL (threaded) [intr] 100015 I [swi6: task queue] 100016 D devdrn 0xfffffe00767b3938 [swi6: Giant taskq] 100018 I [swi5: fast taskq] 100047 I [swi4: clock (0)] 100048 I [swi4: clock (1)] 100049 I [swi4: clock (2)] 100050 I [swi4: clock (3)] 100051 I [swi4: clock (4)] 100052 I [swi4: clock (5)] 100053 I [swi4: clock (6)] 100054 I [swi4: clock (7)] 100055 I [swi4: clock (8)] 100056 I [swi4: clock (9)] 100057 I [swi4: clock (10)] 100058 I [swi4: clock (11)] 100059 I [swi3: vm] 100060 I [swi1: netisr 0] 100094 I [irq56: ahci0] 100095 I [irq19: xhci0] 100101 I [irq18: ehci0 ehci1] 100112 I [irq71: ahci1] 100113 I [swi0: uart uart] 100185 I [irq72: ioat0] 100186 I [irq73: ioat1] 100187 I [irq74: ioat2] 100188 I [irq75: ioat3] 100189 I [irq76: ioat4] 100190 I [irq77: ioat5] 100191 I [irq78: ioat6] 100192 I [irq79: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 CanRun [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 100007 Run CPU 4 [idle: cpu4] 100008 CanRun [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 CanRun [idle: cpu7] 100011 CanRun [idle: cpu8] 100012 Run CPU 9 [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 1 0 1 0 SLs wait 0xfffff800037b2530 [init] 10 0 0 0 DL audit_w 0xffffffff81fe9940 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81fb9100 [swapper] 100017 D - 0xfffff8000369bc00 [thread taskq] 100019 D - 0xfffff8000369ba00 [config_0] 100020 D - 0xfffff8000369b900 [kqueue_ctx taskq] 100021 D - 0xfffff8000369b800 [aiod_kick taskq] 100022 D - 0xfffff8000369b700 [softirq_0] 100023 D - 0xfffff8000369b600 [softirq_1] 100024 D - 0xfffff8000369b500 [softirq_2] 100025 D - 0xfffff8000369b400 [softirq_3] 100026 D - 0xfffff8000369b300 [softirq_4] 100027 D - 0xfffff8000369b200 [softirq_5] 100028 D - 0xfffff8000369b100 [softirq_6] 100029 D - 0xfffff8000369b000 [softirq_7] 100030 D - 0xfffff8000369ae00 [softirq_8] 100031 D - 0xfffff8000369ad00 [softirq_9] 100032 D - 0xfffff8000369ac00 [softirq_10] 100033 D - 0xfffff8000369ab00 [softirq_11] 100034 D - 0xfffff8000369aa00 [if_io_tqg_0] 100035 D - 0xfffff8000369a900 [if_io_tqg_1] 100036 D - 0xfffff8000369a800 [if_io_tqg_2] 100037 D - 0xfffff8000369a700 [if_io_tqg_3] 100038 D - 0xfffff8000369a600 [if_io_tqg_4] 100039 D - 0xfffff8000369a500 [if_io_tqg_5] 100040 D - 0xfffff8000369a400 [if_io_tqg_6] 100041 D - 0xfffff8000369a300 [if_io_tqg_7] 100042 D - 0xfffff8000369a200 [if_io_tqg_8] 100043 D - 0xfffff8000369a100 [if_io_tqg_9] 100044 D - 0xfffff8000369a000 [if_io_tqg_10] 100045 D - 0xfffff80003699e00 [if_io_tqg_11] 100046 D - 0xfffff80003699d00 [if_config_tqg_0] 100061 D - 0xfffff80003699c00 [firmware taskq] 100066 D - 0xfffff80003699b00 [crypto_0] 100067 D - 0xfffff80003699b00 [crypto_1] 100068 D - 0xfffff80003699b00 [crypto_2] 100069 D - 0xfffff80003699b00 [crypto_3] 100070 D - 0xfffff80003699b00 [crypto_4] 100071 D - 0xfffff80003699b00 [crypto_5] 100072 D - 0xfffff80003699b00 [crypto_6] 100073 D - 0xfffff80003699b00 [crypto_7] 100074 D - 0xfffff80003699b00 [crypto_8] 100075 D - 0xfffff80003699b00 [crypto_9] 100076 D - 0xfffff80003699b00 [crypto_10] 100077 D - 0xfffff80003699b00 [crypto_11] 100114 D - 0xfffff800067ee100 [mca taskq] 100121 D - 0xfffff800077eb200 [acpi_task_0] 100122 D - 0xfffff800077eb200 [acpi_task_1] 100123 D - 0xfffff800077eb200 [acpi_task_2] 100124 D - 0xfffff80003699a00 [CAM taskq] db:0:pho> allt Tracing command egrep pid 22522 tid 100404 td 0xfffff8013b08c5a0 (CPU 8) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bc7df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bc7e10 trap() at trap+0x46/frame 0xfffffe0006bc7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bc7f20 --- trap 0x13, rip = 0xffffffff80f094c0, rsp = 0xfffffe034213f520, rbp = 0xfffffe034213f580 --- uma_zfree_arg() at uma_zfree_arg+0x100/frame 0xfffffe034213f580 vm_object_page_remove() at vm_object_page_remove+0x251/frame 0xfffffe034213f5e0 vm_map_entry_delete() at vm_map_entry_delete+0x112/frame 0xfffffe034213f630 vm_map_delete() at vm_map_delete+0x185/frame 0xfffffe034213f6a0 vm_map_remove() at vm_map_remove+0x81/frame 0xfffffe034213f6d0 pipeclose() at pipeclose+0x2e1/frame 0xfffffe034213f710 pipe_close() at pipe_close+0x60/frame 0xfffffe034213f740 _fdrop() at _fdrop+0x1a/frame 0xfffffe034213f760 closef() at closef+0x202/frame 0xfffffe034213f7f0 fdescfree_fds() at fdescfree_fds+0xbc/frame 0xfffffe034213f840 fdescfree() at fdescfree+0x465/frame 0xfffffe034213f900 exit1() at exit1+0x4f2/frame 0xfffffe034213f970 sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe034213f980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe034213fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe034213fab0 --- syscall (1, FreeBSD ELF64, sys_sys_exit), rip = 0x80040379a, rsp = 0x7fffffffe518, rbp = 0x7fffffffe530 --- Tracing command sh pid 22076 tid 104163 td 0xfffff806c3c2f5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe033f562560 mi_switch() at mi_switch+0x172/frame 0xfffffe033f562590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe033f5625d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe033f562630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe033f562660 _sleep() at _sleep+0x2d0/frame 0xfffffe033f562700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe033f562790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe033f562980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe033f562ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033f562ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffe0d8, rbp = 0x7fffffffe190 --- Tracing command pty2 pid 14501 tid 104366 td 0xfffff806c3f16000 (CPU 7) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bbbdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bbbe10 trap() at trap+0x46/frame 0xfffffe0006bbbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bbbf20 --- trap 0x13, rip = 0xffffffff80a85f78, rsp = 0xfffffe03677d0300, rbp = 0xfffffe03677d0330 --- devfs_find() at devfs_find+0x38/frame 0xfffffe03677d0330 devfs_lookup() at devfs_lookup+0x298/frame 0xfffffe03677d0510 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x86/frame 0xfffffe03677d0530 lookup() at lookup+0x601/frame 0xfffffe03677d05d0 namei() at namei+0x502/frame 0xfffffe03677d06c0 vn_open_cred() at vn_open_cred+0x240/frame 0xfffffe03677d0810 kern_openat() at kern_openat+0x1f3/frame 0xfffffe03677d0980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe03677d0ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe03677d0ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x80041066a, rsp = 0x7fffffffe608, rbp = 0x7fffffffe6f0 --- Tracing command pty2 pid 14500 tid 103861 td 0xfffff806429fa5a0 (CPU 2) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b7fdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b7fe10 trap() at trap+0x46/frame 0xfffffe0006b7ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b7ff20 --- trap 0x13, rip = 0xffffffff80b7c306, rsp = 0xfffffe0320872800, rbp = 0xfffffe0320872810 --- _fdrop() at _fdrop+0x26/frame 0xfffffe0320872810 kern_openat() at kern_openat+0x450/frame 0xfffffe0320872980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe0320872ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0320872ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x80041066a, rsp = 0x7fffffffe608, rbp = 0x7fffffffe6f0 --- Tracing command pty2 pid 14499 tid 104286 td 0xfffff805738a8000 (CPU 5) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe036713a380 vpanic() at vpanic+0x1ba/frame 0xfffffe036713a3d0 panic() at panic+0x43/frame 0xfffffe036713a430 trap_fatal() at trap_fatal+0x39c/frame 0xfffffe036713a490 trap_pfault() at trap_pfault+0x62/frame 0xfffffe036713a4e0 trap() at trap+0x2b2/frame 0xfffffe036713a5f0 calltrap() at calltrap+0x8/frame 0xfffffe036713a5f0 --- trap 0xc, rip = 0xffffffff80bb43ca, rsp = 0xfffffe036713a6c0, rbp = 0xfffffe036713a700 --- __mtx_lock_flags() at __mtx_lock_flags+0x4a/frame 0xfffffe036713a700 vop_stdgetwritemount() at vop_stdgetwritemount+0x31/frame 0xfffffe036713a730 VOP_GETWRITEMOUNT_APV() at VOP_GETWRITEMOUNT_APV+0x78/frame 0xfffffe036713a750 vn_start_write() at vn_start_write+0x42/frame 0xfffffe036713a7a0 vn_close1() at vn_close1+0x5c/frame 0xfffffe036713a810 vn_closefile() at vn_closefile+0x4c/frame 0xfffffe036713a890 _fdrop() at _fdrop+0x1a/frame 0xfffffe036713a8b0 closef() at closef+0x202/frame 0xfffffe036713a940 closefp() at closefp+0x9c/frame 0xfffffe036713a980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe036713aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe036713aab0 --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x80041521a, rsp = 0x7fffffffe6f8, rbp = 0x7fffffffe710 --- Tracing command pty2 pid 14498 tid 116519 td 0xfffff80438a7f000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe036ad8a560 mi_switch() at mi_switch+0x172/frame 0xfffffe036ad8a590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe036ad8a5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe036ad8a630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe036ad8a660 _sleep() at _sleep+0x2d0/frame 0xfffffe036ad8a700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe036ad8a790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe036ad8a980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe036ad8aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe036ad8aab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003a48aa, rsp = 0x7fffffffe718, rbp = 0x7fffffffe720 --- Tracing command sh pid 14484 tid 101479 td 0xfffff80114666000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe03670ae560 mi_switch() at mi_switch+0x172/frame 0xfffffe03670ae590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe03670ae5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe03670ae630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe03670ae660 _sleep() at _sleep+0x2d0/frame 0xfffffe03670ae700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe03670ae790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe03670ae980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe03670aeab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe03670aeab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffe368, rbp = 0x7fffffffe420 --- Tracing command tee pid 14483 tid 116561 td 0xfffff8014b7bb5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe036709f6a0 mi_switch() at mi_switch+0x172/frame 0xfffffe036709f6d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe036709f710 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe036709f770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe036709f7a0 _sleep() at _sleep+0x2d0/frame 0xfffffe036709f840 pipe_read() at pipe_read+0x348/frame 0xfffffe036709f8a0 dofileread() at dofileread+0x81/frame 0xfffffe036709f8f0 kern_readv() at kern_readv+0x49/frame 0xfffffe036709f930 sys_read() at sys_read+0x84/frame 0xfffffe036709f980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe036709fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe036709fab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004151fa, rsp = 0x7fffffffe6b8, rbp = 0x7fffffffe700 --- Tracing command sh pid 14482 tid 102534 td 0xfffff8004cfa3000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe03671fd560 mi_switch() at mi_switch+0x172/frame 0xfffffe03671fd590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe03671fd5d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe03671fd630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe03671fd660 _sleep() at _sleep+0x2d0/frame 0xfffffe03671fd700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe03671fd790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe03671fd980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe03671fdab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe03671fdab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffab18, rbp = 0x7fffffffabd0 --- Tracing command sh pid 23131 tid 100417 td 0xfffff8031be66000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ad634560 mi_switch() at mi_switch+0x172/frame 0xfffffe00ad634590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ad6345d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ad634630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ad634660 _sleep() at _sleep+0x2d0/frame 0xfffffe00ad634700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00ad634790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00ad634980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ad634ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ad634ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffae38, rbp = 0x7fffffffaef0 --- Tracing command sh pid 2498 tid 100179 td 0xfffff80004299000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac0a06a0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac0a06d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac0a0710 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac0a0770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac0a07a0 _sleep() at _sleep+0x2d0/frame 0xfffffe00ac0a0840 pipe_read() at pipe_read+0x348/frame 0xfffffe00ac0a08a0 dofileread() at dofileread+0x81/frame 0xfffffe00ac0a08f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00ac0a0930 sys_read() at sys_read+0x84/frame 0xfffffe00ac0a0980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac0a0ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac0a0ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004761fa, rsp = 0x7fffffffe228, rbp = 0x7fffffffe330 --- Tracing command awk pid 2496 tid 100201 td 0xfffff80003ab05a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac1266a0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac1266d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac126710 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac126770 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac1267a0 _sleep() at _sleep+0x2d0/frame 0xfffffe00ac126840 pipe_read() at pipe_read+0x348/frame 0xfffffe00ac1268a0 dofileread() at dofileread+0x81/frame 0xfffffe00ac1268f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00ac126930 sys_read() at sys_read+0x84/frame 0xfffffe00ac126980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac126ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac126ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004791fa, rsp = 0x7fffffffe328, rbp = 0x7fffffffe340 --- Tracing command sh pid 2495 tid 100227 td 0xfffff80007746000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac1a3560 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac1a3590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac1a35d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac1a3630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac1a3660 _sleep() at _sleep+0x2d0/frame 0xfffffe00ac1a3700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe00ac1a3790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00ac1a3980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac1a3ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac1a3ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8004058aa, rsp = 0x7fffffffe318, rbp = 0x7fffffffe3d0 --- Tracing command sh pid 2437 tid 100200 td 0xfffff80007dcf000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0367139b90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe0367139ba0 trap() at trap+0x59/frame 0xfffffe0367139cb0 calltrap() at calltrap+0x8/frame 0xfffffe0367139cb0 --- trap 0xc, rip = 0xffffffff8116ef56, rsp = 0xfffffe0367139d80, rbp = 0xfffffe0367139d90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe0367139d90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe0367139e30 db_command() at db_command+0x279/frame 0xfffffe0367139f00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe0367139fa0 db_command() at db_command+0x279/frame 0xfffffe036713a070 db_command_loop() at db_command_loop+0x64/frame 0xfffffe036713a080 db_trap() at db_trap+0xef/frame 0xfffffe036713a110 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe036713a190 trap() at trap+0x80f/frame 0xfffffe036713a2a0 calltrap() at calltrap+0x8/frame 0xfffffe036713a2a0 --- trap 0x3, rip = 0xffffffff80c2077b, rsp = 0xfffffe036713a370, rbp = 0xfffffe036713a380 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe036713a380 vpanic() at vpanic+0x1ba/frame 0xfffffe036713a3d0 panic() at panic+0x43/frame 0xfffffe036713a430 trap_fatal() at trap_fatal+0x39c/frame 0xfffffe036713a490 trap_pfault() at trap_pfault+0x62/frame 0xfffffe036713a4e0 trap() at trap+0x2b2/frame 0xfffffe036713a5f0 calltrap() at calltrap+0x8/frame 0xfffffe036713a5f0 --- trap 0xc, rip = 0xffffffff80bb43ca, rsp = 0xfffffe036713a6c0, rbp = 0xfffffe036713a700 --- __mtx_lock_flags() at __mtx_lock_flags+0x4a/frame 0xfffffe036713a700 vop_stdgetwritemount() at vop_stdgetwritemount+0x31/frame 0xfffffe036713a730 VOP_GETWRITEMOUNT_APV() at VOP_GETWRITEMOUNT_APV+0x78/frame 0xfffffe036713a750 vn_start_write() at vn_start_write+0x42/frame 0xfffffe036713a7a0 vn_close1() at vn_close1+0x5c/frame 0xfffffe036713a810 vn_closefile() at vn_closefile+0x4c/frame 0xfffffe036713a890 _fdrop() at _fdrop+0x1a/frame 0xfffffe036713a8b0 closef() at closef+0x202/frame 0xfffffe036713a940 closefp() at closefp+0x9c/frame 0xfffffe036713a980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe036713aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe036713aab0 --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x80041521a, rsp = 0x7fffffffe6f8, rbp = 0x7fffffffe710 --- Tracing command bash pid 2357 tid 100202 td 0xfffff800185a05a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0367139b90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe0367139ba0 trap() at trap+0x59/frame 0xfffffe0367139cb0 calltrap() at calltrap+0x8/frame 0xfffffe0367139cb0 --- trap 0xc, rip = 0xffffffff8116ef56, rsp = 0xfffffe0367139d80, rbp = 0xfffffe0367139d90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe0367139d90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe0367139e30 db_command() at db_command+0x279/frame 0xfffffe0367139f00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe0367139fa0 db_command() at db_command+0x279/frame 0xfffffe036713a070 db_command_loop() at db_command_loop+0x64/frame 0xfffffe036713a080 db_trap() at db_trap+0xef/frame 0xfffffe036713a110 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe036713a190 trap() at trap+0x80f/frame 0xfffffe036713a2a0 calltrap() at calltrap+0x8/frame 0xfffffe036713a2a0 --- trap 0x3, rip = 0xffffffff80c2077b, rsp = 0xfffffe036713a370, rbp = 0xfffffe036713a380 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe036713a380 vpanic() at vpanic+0x1ba/frame 0xfffffe036713a3d0 panic() at panic+0x43/frame 0xfffffe036713a430 trap_fatal() at trap_fatal+0x39c/frame 0xfffffe036713a490 trap_pfault() at trap_pfault+0x62/frame 0xfffffe036713a4e0 trap() at trap+0x2b2/frame 0xfffffe036713a5f0 calltrap() at calltrap+0x8/frame 0xfffffe036713a5f0 --- trap 0xc, rip = 0xffffffff80bb43ca, rsp = 0xfffffe036713a6c0, rbp = 0xfffffe036713a700 --- __mtx_lock_flags() at __mtx_lock_flags+0x4a/frame 0xfffffe036713a700 vop_stdgetwritemount() at vop_stdgetwritemount+0x31/frame 0xfffffe036713a730 VOP_GETWRITEMOUNT_APV() at VOP_GETWRITEMOUNT_APV+0x78/frame 0xfffffe036713a750 vn_start_write() at vn_start_write+0x42/frame 0xfffffe036713a7a0 vn_close1() at vn_close1+0x5c/frame 0xfffffe036713a810 vn_closefile() at vn_closefile+0x4c/frame 0xfffffe036713a890 _fdrop() at _fdrop+0x1a/frame 0xfffffe036713a8b0 closef() at closef+0x202/frame 0xfffffe036713a940 closefp() at closefp+0x9c/frame 0xfffffe036713a980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe036713aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe036713aab0 --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x80041521a, rsp = 0x7fffffffe6f8, rbp = 0x7fffffffe710 --- Tracing command csh pid 2355 tid 100222 td 0xfffff8031b3725a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0367139b90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe0367139ba0 trap() at trap+0x59/frame 0xfffffe0367139cb0 calltrap() at calltrap+0x8/frame 0xfffffe0367139cb0 --- trap 0xc, rip = 0xffffffff8116ef56, rsp = 0xfffffe0367139d80, rbp = 0xfffffe0367139d90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe0367139d90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe0367139e30 db_command() at db_command+0x279/frame 0xfffffe0367139f00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe0367139fa0 db_command() at db_command+0x279/frame 0xfffffe036713a070 db_command_loop() at db_command_loop+0x64/frame 0xfffffe036713a080 db_trap() at db_trap+0xef/frame 0xfffffe036713a110 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe036713a190 trap() at trap+0x80f/frame 0xfffffe036713a2a0 calltrap() at calltrap+0x8/frame 0xfffffe036713a2a0 --- trap 0x3, rip = 0xffffffff80c2077b, rsp = 0xfffffe036713a370, rbp = 0xfffffe036713a380 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe036713a380 vpanic() at vpanic+0x1ba/frame 0xfffffe036713a3d0 panic() at panic+0x43/frame 0xfffffe036713a430 trap_fatal() at trap_fatal+0x39c/frame 0xfffffe036713a490 trap_pfault() at trap_pfault+0x62/frame 0xfffffe036713a4e0 trap() at trap+0x2b2/frame 0xfffffe036713a5f0 calltrap() at calltrap+0x8/frame 0xfffffe036713a5f0 --- trap 0xc, rip = 0xffffffff80bb43ca, rsp = 0xfffffe036713a6c0, rbp = 0xfffffe036713a700 --- __mtx_lock_flags() at __mtx_lock_flags+0x4a/frame 0xfffffe036713a700 vop_stdgetwritemount() at vop_stdgetwritemount+0x31/frame 0xfffffe036713a730 VOP_GETWRITEMOUNT_APV() at VOP_GETWRITEMOUNT_APV+0x78/frame 0xfffffe036713a750 vn_start_write() at vn_start_write+0x42/frame 0xfffffe036713a7a0 vn_close1() at vn_close1+0x5c/frame 0xfffffe036713a810 vn_closefile() at vn_closefile+0x4c/frame 0xfffffe036713a890 _fdrop() at _fdrop+0x1a/frame 0xfffffe036713a8b0 closef() at closef+0x202/frame 0xfffffe036713a940 closefp() at closefp+0x9c/frame 0xfffffe036713a980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe036713aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe036713aab0 --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x80041521a, rsp = 0x7fffffffe6f8, rbp = 0x7fffffffe710 --- Tracing command su pid 2354 tid 100210 td 0xfffff80007fc0000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0367139b90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe0367139ba0 trap() at trap+0x59/frame 0xfffffe0367139cb0 calltrap() at calltrap+0x8/frame 0xfffffe0367139cb0 --- trap 0xc, rip = 0xffffffff8116ef56, rsp = 0xfffffe0367139d80, rbp = 0xfffffe0367139d90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe0367139d90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe0367139e30 db_command() at db_command+0x279/frame 0xfffffe0367139f00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe0367139fa0 db_command() at db_command+0x279/frame 0xfffffe036713a070 db_command_loop() at db_command_loop+0x64/frame 0xfffffe036713a080 db_trap() at db_trap+0xef/frame 0xfffffe036713a110 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe036713a190 trap() at trap+0x80f/frame 0xfffffe036713a2a0 calltrap() at calltrap+0x8/frame 0xfffffe036713a2a0 --- trap 0x3, rip = 0xffffffff80c2077b, rsp = 0xfffffe036713a370, rbp = 0xfffffe036713a380 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe036713a380 vpanic() at vpanic+0x1ba/frame 0xfffffe036713a3d0 panic() at panic+0x43/frame 0xfffffe036713a430 trap_fatal() at trap_fatal+0x39c/frame 0xfffffe036713a490 trap_pfault() at trap_pfault+0x62/frame 0xfffffe036713a4e0 trap() at trap+0x2b2/frame 0xfffffe036713a5f0 calltrap() at calltrap+0x8/frame 0xfffffe036713a5f0 --- trap 0xc, rip = 0xffffffff80bb43ca, rsp = 0xfffffe036713a6c0, rbp = 0xfffffe036713a700 --- __mtx_lock_flags() at __mtx_lock_flags+0x4a/frame 0xfffffe036713a700 vop_stdgetwritemount() at vop_stdgetwritemount+0x31/frame 0xfffffe036713a730 VOP_GETWRITEMOUNT_APV() at VOP_GETWRITEMOUNT_APV+0x78/frame 0xfffffe036713a750 vn_start_write() at vn_start_write+0x42/frame 0xfffffe036713a7a0 vn_close1() at vn_close1+0x5c/frame 0xfffffe036713a810 vn_closefile() at vn_closefile+0x4c/frame 0xfffffe036713a890 _fdrop() at _fdrop+0x1a/frame 0xfffffe036713a8b0 closef() at closef+0x202/frame 0xfffffe036713a940 closefp() at closefp+0x9c/frame 0xfffffe036713a980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe036713aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe036713aab0 --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x80041521a, rsp = 0x7fffffffe6f8, rbp = 0x7fffffffe710 --- Tracing command bash pid 2350 tid 100161 td 0xfffff80007745000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0367139b90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe0367139ba0 trap() at trap+0x59/frame 0xfffffe0367139cb0 calltrap() at calltrap+0x8/frame 0xfffffe0367139cb0 --- trap 0xc, rip = 0xffffffff8116ef56, rsp = 0xfffffe0367139d80, rbp = 0xfffffe0367139d90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe0367139d90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe0367139e30 db_command() at db_command+0x279/frame 0xfffffe0367139f00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe0367139fa0 db_command() at db_command+0x279/frame 0xfffffe036713a070 db_command_loop() at db_command_loop+0x64/frame 0xfffffe036713a080 db_trap() at db_trap+0xef/frame 0xfffffe036713a110 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe036713a190 trap() at trap+0x80f/frame 0xfffffe036713a2a0 calltrap() at calltrap+0x8/frame 0xfffffe036713a2a0 --- trap 0x3, rip = 0xffffffff80c2077b, rsp = 0xfffffe036713a370, rbp = 0xfffffe036713a380 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe036713a380 vpanic() at vpanic+0x1ba/frame 0xfffffe036713a3d0 panic() at panic+0x43/frame 0xfffffe036713a430 trap_fatal() at trap_fatal+0x39c/frame 0xfffffe036713a490 trap_pfault() at trap_pfault+0x62/frame 0xfffffe036713a4e0 trap() at trap+0x2b2/frame 0xfffffe036713a5f0 calltrap() at calltrap+0x8/frame 0xfffffe036713a5f0 --- trap 0xc, rip = 0xffffffff80bb43ca, rsp = 0xfffffe036713a6c0, rbp = 0xfffffe036713a700 --- __mtx_lock_flags() at __mtx_lock_flags+0x4a/frame 0xfffffe036713a700 vop_stdgetwritemount() at vop_stdgetwritemount+0x31/frame 0xfffffe036713a730 VOP_GETWRITEMOUNT_APV() at VOP_GETWRITEMOUNT_APV+0x78/frame 0xfffffe036713a750 vn_start_write() at vn_start_write+0x42/frame 0xfffffe036713a7a0 vn_close1() at vn_close1+0x5c/frame 0xfffffe036713a810 vn_closefile() at vn_closefile+0x4c/frame 0xfffffe036713a890 _fdrop() at _fdrop+0x1a/frame 0xfffffe036713a8b0 closef() at closef+0x202/frame 0xfffffe036713a940 closefp() at closefp+0x9c/frame 0xfffffe036713a980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe036713aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe036713aab0 --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x80041521a, rsp = 0x7fffffffe6f8, rbp = 0x7fffffffe710 --- Tracing command sshd pid 2349 tid 100211 td 0xfffff80007fc15a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac1535c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac1535f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac153630 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac153690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac1536c0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac153720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ac153760 kern_select() at kern_select+0x95a/frame 0xfffffe00ac153940 sys_select() at sys_select+0x56/frame 0xfffffe00ac153980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac153ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac153ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8009021da, rsp = 0x7fffffffa578, rbp = 0x7fffffffa5b0 --- Tracing command sshd pid 2346 tid 100212 td 0xfffff80007fc1000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac158640 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac158670 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac1586b0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac158710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac158740 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac1587a0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ac1587e0 kern_poll() at kern_poll+0x448/frame 0xfffffe00ac158960 sys_poll() at sys_poll+0x50/frame 0xfffffe00ac158980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac158ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac158ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8008a41fa, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe610 --- Tracing command csh pid 2342 tid 100199 td 0xfffff80007dcf5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac11c620 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac11c650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac11c690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac11c6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac11c720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac11c780 tty_wait() at tty_wait+0x42/frame 0xfffffe00ac11c7b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ac11c810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ac11c840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ac11c8a0 dofileread() at dofileread+0x81/frame 0xfffffe00ac11c8f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00ac11c930 sys_read() at sys_read+0x84/frame 0xfffffe00ac11c980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac11cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac11cab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004fa1fa, rsp = 0x7fffffffe1f8, rbp = 0x7fffffffe220 --- Tracing command login pid 2337 tid 100220 td 0xfffff8031b378000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0367139b90 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe0367139ba0 trap() at trap+0x59/frame 0xfffffe0367139cb0 calltrap() at calltrap+0x8/frame 0xfffffe0367139cb0 --- trap 0xc, rip = 0xffffffff8116ef56, rsp = 0xfffffe0367139d80, rbp = 0xfffffe0367139d90 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe0367139d90 _db_stack_trace_all() at _db_stack_trace_all+0xc4/frame 0xfffffe0367139e30 db_command() at db_command+0x279/frame 0xfffffe0367139f00 db_script_exec() at db_script_exec+0x188/frame 0xfffffe0367139fa0 db_command() at db_command+0x279/frame 0xfffffe036713a070 db_command_loop() at db_command_loop+0x64/frame 0xfffffe036713a080 db_trap() at db_trap+0xef/frame 0xfffffe036713a110 kdb_trap() at kdb_trap+0x16c/frame 0xfffffe036713a190 trap() at trap+0x80f/frame 0xfffffe036713a2a0 calltrap() at calltrap+0x8/frame 0xfffffe036713a2a0 --- trap 0x3, rip = 0xffffffff80c2077b, rsp = 0xfffffe036713a370, rbp = 0xfffffe036713a380 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe036713a380 vpanic() at vpanic+0x1ba/frame 0xfffffe036713a3d0 panic() at panic+0x43/frame 0xfffffe036713a430 trap_fatal() at trap_fatal+0x39c/frame 0xfffffe036713a490 trap_pfault() at trap_pfault+0x62/frame 0xfffffe036713a4e0 trap() at trap+0x2b2/frame 0xfffffe036713a5f0 calltrap() at calltrap+0x8/frame 0xfffffe036713a5f0 --- trap 0xc, rip = 0xffffffff80bb43ca, rsp = 0xfffffe036713a6c0, rbp = 0xfffffe036713a700 --- __mtx_lock_flags() at __mtx_lock_flags+0x4a/frame 0xfffffe036713a700 vop_stdgetwritemount() at vop_stdgetwritemount+0x31/frame 0xfffffe036713a730 VOP_GETWRITEMOUNT_APV() at VOP_GETWRITEMOUNT_APV+0x78/frame 0xfffffe036713a750 vn_start_write() at vn_start_write+0x42/frame 0xfffffe036713a7a0 vn_close1() at vn_close1+0x5c/frame 0xfffffe036713a810 vn_closefile() at vn_closefile+0x4c/frame 0xfffffe036713a890 _fdrop() at _fdrop+0x1a/frame 0xfffffe036713a8b0 closef() at closef+0x202/frame 0xfffffe036713a940 closefp() at closefp+0x9c/frame 0xfffffe036713a980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe036713aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe036713aab0 --- syscall (6, FreeBSD ELF64, sys_close), rip = 0x80041521a, rsp = 0x7fffffffe6f8, rbp = 0x7fffffffe710 --- Tracing command getty pid 2336 tid 100219 td 0xfffff8031b3785a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac17b620 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac17b650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac17b690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac17b6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac17b720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac17b780 tty_wait() at tty_wait+0x42/frame 0xfffffe00ac17b7b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ac17b810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ac17b840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ac17b8a0 dofileread() at dofileread+0x81/frame 0xfffffe00ac17b8f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00ac17b930 sys_read() at sys_read+0x84/frame 0xfffffe00ac17b980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac17bab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac17bab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004311fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2335 tid 100218 td 0xfffff8031b375000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac176620 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac176650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac176690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac1766f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac176720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac176780 tty_wait() at tty_wait+0x42/frame 0xfffffe00ac1767b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ac176810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ac176840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ac1768a0 dofileread() at dofileread+0x81/frame 0xfffffe00ac1768f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00ac176930 sys_read() at sys_read+0x84/frame 0xfffffe00ac176980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac176ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac176ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004311fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2334 tid 100217 td 0xfffff8031b3755a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac171620 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac171650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac171690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac1716f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac171720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac171780 tty_wait() at tty_wait+0x42/frame 0xfffffe00ac1717b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ac171810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ac171840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ac1718a0 dofileread() at dofileread+0x81/frame 0xfffffe00ac1718f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00ac171930 sys_read() at sys_read+0x84/frame 0xfffffe00ac171980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac171ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac171ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004311fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2333 tid 100216 td 0xfffff8031b371000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac16c620 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac16c650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac16c690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac16c6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac16c720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac16c780 tty_wait() at tty_wait+0x42/frame 0xfffffe00ac16c7b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ac16c810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ac16c840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ac16c8a0 dofileread() at dofileread+0x81/frame 0xfffffe00ac16c8f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00ac16c930 sys_read() at sys_read+0x84/frame 0xfffffe00ac16c980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac16cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac16cab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004311fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2332 tid 100215 td 0xfffff8031b3715a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac167620 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac167650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac167690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac1676f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac167720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac167780 tty_wait() at tty_wait+0x42/frame 0xfffffe00ac1677b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ac167810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ac167840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ac1678a0 dofileread() at dofileread+0x81/frame 0xfffffe00ac1678f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00ac167930 sys_read() at sys_read+0x84/frame 0xfffffe00ac167980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac167ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac167ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004311fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2331 tid 100214 td 0xfffff8000669f5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac162620 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac162650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac162690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac1626f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac162720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac162780 tty_wait() at tty_wait+0x42/frame 0xfffffe00ac1627b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ac162810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ac162840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ac1628a0 dofileread() at dofileread+0x81/frame 0xfffffe00ac1628f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00ac162930 sys_read() at sys_read+0x84/frame 0xfffffe00ac162980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac162ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac162ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004311fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2330 tid 100207 td 0xfffff800039475a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac13f620 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac13f650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac13f690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac13f6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac13f720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac13f780 tty_wait() at tty_wait+0x42/frame 0xfffffe00ac13f7b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ac13f810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ac13f840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ac13f8a0 dofileread() at dofileread+0x81/frame 0xfffffe00ac13f8f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00ac13f930 sys_read() at sys_read+0x84/frame 0xfffffe00ac13f980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac13fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac13fab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004311fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2329 tid 100213 td 0xfffff80003947000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac15d620 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac15d650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac15d690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac15d6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac15d720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac15d780 tty_wait() at tty_wait+0x42/frame 0xfffffe00ac15d7b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00ac15d810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00ac15d840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00ac15d8a0 dofileread() at dofileread+0x81/frame 0xfffffe00ac15d8f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00ac15d930 sys_read() at sys_read+0x84/frame 0xfffffe00ac15d980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac15dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac15dab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004311fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command getty pid 2328 tid 100142 td 0xfffff80003e755a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00a39fd620 mi_switch() at mi_switch+0x172/frame 0xfffffe00a39fd650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a39fd690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00a39fd6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00a39fd720 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00a39fd780 tty_wait() at tty_wait+0x42/frame 0xfffffe00a39fd7b0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00a39fd810 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00a39fd840 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00a39fd8a0 dofileread() at dofileread+0x81/frame 0xfffffe00a39fd8f0 kern_readv() at kern_readv+0x49/frame 0xfffffe00a39fd930 sys_read() at sys_read+0x84/frame 0xfffffe00a39fd980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00a39fdab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00a39fdab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004311fa, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec10 --- Tracing command cron pid 2282 tid 100205 td 0xfffff80007fbf5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac135710 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac135740 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac135780 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac1357e0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00ac135820 _sleep() at _sleep+0x265/frame 0xfffffe00ac1358c0 kern_clock_nanosleep() at kern_clock_nanosleep+0x206/frame 0xfffffe00ac135940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00ac135980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac135ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac135ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003d4a0a, rsp = 0x7fffffffead8, rbp = 0x7fffffffecc0 --- Tracing command sshd pid 2278 tid 100151 td 0xfffff80007dd95a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aa7ec5c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00aa7ec5f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa7ec630 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aa7ec690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00aa7ec6c0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00aa7ec720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00aa7ec760 kern_select() at kern_select+0x95a/frame 0xfffffe00aa7ec940 sys_select() at sys_select+0x56/frame 0xfffffe00aa7ec980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00aa7ecab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa7ecab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8009021da, rsp = 0x7fffffffe668, rbp = 0x7fffffffe6a0 --- Tracing command ntpd pid 2249 tid 100184 td 0xfffff80003937000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac0b95c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac0b95f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac0b9630 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac0b9690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac0b96c0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac0b9720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ac0b9760 kern_select() at kern_select+0x95a/frame 0xfffffe00ac0b9940 sys_select() at sys_select+0x56/frame 0xfffffe00ac0b9980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac0b9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac0b9ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80082e1da, rsp = 0x7fffffffdf18, rbp = 0x7fffffffdf50 --- Tracing command ntpd pid 2249 tid 103942 td 0xfffff80779222000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe033ec776b0 mi_switch() at mi_switch+0x172/frame 0xfffffe033ec776e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe033ec77720 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe033ec77780 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe033ec777b0 _sleep() at _sleep+0x2d0/frame 0xfffffe033ec77850 umtxq_sleep() at umtxq_sleep+0x153/frame 0xfffffe033ec778b0 do_sem2_wait() at do_sem2_wait+0x41c/frame 0xfffffe033ec77930 __umtx_op_sem2_wait() at __umtx_op_sem2_wait+0x76/frame 0xfffffe033ec77980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe033ec77ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033ec77ab0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x8007225aa, rsp = 0x7fffdffbced8, rbp = 0x7fffdffbcf50 --- Tracing command rpc.lockd pid 2186 tid 100169 td 0xfffff80007fbe000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac06e4e0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac06e510 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac06e550 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac06e5b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00ac06e5f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00ac06e660 svc_run_internal() at svc_run_internal+0xa90/frame 0xfffffe00ac06e7a0 svc_run() at svc_run+0x24e/frame 0xfffffe00ac06e800 sys_nlm_syscall() at sys_nlm_syscall+0x763/frame 0xfffffe00ac06e980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac06eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac06eab0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8002f062a, rsp = 0x7fffffffec08, rbp = 0x7fffffffecc0 --- Tracing command rpc.statd pid 2183 tid 100144 td 0xfffff800064fc000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aa7c95a0 mi_switch() at mi_switch+0x172/frame 0xfffffe00aa7c95d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa7c9610 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aa7c9670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00aa7c96b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00aa7c9720 seltdwait() at seltdwait+0x6b/frame 0xfffffe00aa7c9760 kern_select() at kern_select+0x95a/frame 0xfffffe00aa7c9940 sys_select() at sys_select+0x56/frame 0xfffffe00aa7c9980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00aa7c9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa7c9ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8004251da, rsp = 0x7fffffffea98, rbp = 0x7fffffffebe0 --- Tracing command watchdogd pid 2137 tid 100195 td 0xfffff80007dcb000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac0f0710 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac0f0740 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac0f0780 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac0f07e0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00ac0f0820 _sleep() at _sleep+0x265/frame 0xfffffe00ac0f08c0 kern_clock_nanosleep() at kern_clock_nanosleep+0x206/frame 0xfffffe00ac0f0940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00ac0f0980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac0f0ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac0f0ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003bda0a, rsp = 0x7fffffffea98, rbp = 0x7fffffffeae0 --- Tracing command rpcbind pid 2058 tid 100147 td 0xfffff800044de5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aa7d8620 mi_switch() at mi_switch+0x172/frame 0xfffffe00aa7d8650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa7d8690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00aa7d86f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00aa7d8730 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00aa7d87a0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00aa7d87e0 kern_poll() at kern_poll+0x448/frame 0xfffffe00aa7d8960 sys_poll() at sys_poll+0x50/frame 0xfffffe00aa7d8980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00aa7d8ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00aa7d8ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003cc1fa, rsp = 0x7fffffffca38, rbp = 0x7fffffffec50 --- Tracing command syslogd pid 2048 tid 100194 td 0xfffff80007dcb5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac0eb5c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac0eb5f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac0eb630 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac0eb690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac0eb6c0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac0eb720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ac0eb760 kern_select() at kern_select+0x95a/frame 0xfffffe00ac0eb940 sys_select() at sys_select+0x56/frame 0xfffffe00ac0eb980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac0ebab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac0ebab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8004361da, rsp = 0x7fffffffe748, rbp = 0x7fffffffecc0 --- Tracing command devd pid 1977 tid 100164 td 0xfffff800044e1000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac0315a0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac0315d0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac031610 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac031670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00ac0316b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00ac031720 seltdwait() at seltdwait+0x6b/frame 0xfffffe00ac031760 kern_select() at kern_select+0x95a/frame 0xfffffe00ac031940 sys_select() at sys_select+0x56/frame 0xfffffe00ac031980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac031ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac031ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2f533a, rsp = 0x7fffffffcb48, rbp = 0x7fffffffece0 --- Tracing command dhclient pid 1972 tid 100196 td 0xfffff80006163000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac101620 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac101650 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac101690 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac1016f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00ac101730 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x185/frame 0xfffffe00ac1017a0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00ac1017e0 kern_poll() at kern_poll+0x448/frame 0xfffffe00ac101960 sys_poll() at sys_poll+0x50/frame 0xfffffe00ac101980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac101ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac101ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003ef1fa, rsp = 0x7fffffffec28, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1928 tid 100183 td 0xfffff800039375a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac0b4640 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac0b4670 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac0b46b0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac0b4710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac0b4740 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac0b47a0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ac0b47e0 kern_poll() at kern_poll+0x448/frame 0xfffffe00ac0b4960 sys_poll() at sys_poll+0x50/frame 0xfffffe00ac0b4980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac0b4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac0b4ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003ef1fa, rsp = 0x7fffffffec38, rbp = 0x7fffffffec60 --- Tracing command dhclient pid 1925 tid 100180 td 0xfffff800077405a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac0a55c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac0a55f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac0a5630 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe00ac0a5690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00ac0a56c0 _cv_wait_sig() at _cv_wait_sig+0x162/frame 0xfffffe00ac0a5720 seltdwait() at seltdwait+0x8d/frame 0xfffffe00ac0a5760 kern_select() at kern_select+0x95a/frame 0xfffffe00ac0a5940 sys_select() at sys_select+0x56/frame 0xfffffe00ac0a5980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe00ac0a5ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ac0a5ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80044d1da, rsp = 0x7fffffffe9e8, rbp = 0x7fffffffeaa0 --- Tracing command vnlru pid 34 tid 100141 td 0xfffff80007743000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00a39f8890 mi_switch() at mi_switch+0x172/frame 0xfffffe00a39f88c0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a39f8900 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a39f8940 _sleep() at _sleep+0x279/frame 0xfffffe00a39f89e0 vnlru_proc() at vnlru_proc+0xa4/frame 0xfffffe00a39f8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a39f8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a39f8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 33 tid 100140 td 0xfffff800077435a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00a39f38c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00a39f38f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a39f3930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a39f3970 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x185/frame 0xfffffe00a39f39e0 sched_sync() at sched_sync+0x609/frame 0xfffffe00a39f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a39f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a39f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100130 td 0xfffff80007740000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006f218d0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006f21900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f21940 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f21980 _sleep() at _sleep+0x279/frame 0xfffffe0006f21a20 buf_daemon() at buf_daemon+0xc8/frame 0xfffffe0006f21a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f21ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f21ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100132 td 0xfffff8000669f000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ff08c0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006ff08f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ff0930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ff0970 _sleep() at _sleep+0x279/frame 0xfffffe0006ff0a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006ff0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ff0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ff0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100134 td 0xfffff800066a05a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ff58c0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006ff58f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ff5930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ff5970 _sleep() at _sleep+0x279/frame 0xfffffe0006ff5a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006ff5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ff5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ff5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100135 td 0xfffff800066a0000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ffa8c0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006ffa8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ffa930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ffa970 _sleep() at _sleep+0x279/frame 0xfffffe0006ffaa10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006ffaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ffaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ffaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100136 td 0xfffff800066a15a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006fff8c0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006fff8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006fff930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006fff970 _sleep() at _sleep+0x279/frame 0xfffffe0006fffa10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe0006fffa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006fffab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006fffab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100137 td 0xfffff800066a1000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00a38c48c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00a38c48f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a38c4930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a38c4970 _sleep() at _sleep+0x279/frame 0xfffffe00a38c4a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00a38c4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a38c4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a38c4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100138 td 0xfffff800066a25a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00a39e98c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00a39e98f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a39e9930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a39e9970 _sleep() at _sleep+0x279/frame 0xfffffe00a39e9a10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00a39e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a39e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a39e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100139 td 0xfffff800066a2000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00a39ee8c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00a39ee8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00a39ee930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00a39ee970 _sleep() at _sleep+0x279/frame 0xfffffe00a39eea10 bufspace_daemon() at bufspace_daemon+0x2eb/frame 0xfffffe00a39eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00a39eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a39eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100152 td 0xfffff800042985a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00aa7f18f0 mi_switch() at mi_switch+0x172/frame 0xfffffe00aa7f1920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00aa7f1960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00aa7f19a0 _sleep() at _sleep+0x279/frame 0xfffffe00aa7f1a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00aa7f1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00aa7f1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00aa7f1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100203 td 0xfffff80003ab0000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00ac1308f0 mi_switch() at mi_switch+0x172/frame 0xfffffe00ac130920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00ac130960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00ac1309a0 _sleep() at _sleep+0x279/frame 0xfffffe00ac130a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00ac130a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00ac130ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00ac130ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 31 tid 100129 td 0xfffff800064f95a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006f108c0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006f108f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f10930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006f10960 _sleep() at _sleep+0x2da/frame 0xfffffe0006f10a00 vm_daemon() at vm_daemon+0xa6f/frame 0xfffffe0006f10a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f10ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f10ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffff80003d84000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006f0b520 mi_switch() at mi_switch+0x172/frame 0xfffffe0006f0b550 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006f0b590 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006f0b5d0 _sleep() at _sleep+0x279/frame 0xfffffe0006f0b670 vm_pageout_worker() at vm_pageout_worker+0x26b/frame 0xfffffe0006f0ba30 vm_pageout() at vm_pageout+0x176/frame 0xfffffe0006f0ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006f0bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006f0bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100131 td 0xfffff800042975a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006fe66b0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006fe66e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006fe6720 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006fe6750 _sleep() at _sleep+0x2da/frame 0xfffffe0006fe67f0 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xc89/frame 0xfffffe0006fe6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006fe6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006fe6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100133 td 0xfffff80004297000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006feb8f0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006feb920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006feb960 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006feb9a0 _sleep() at _sleep+0x279/frame 0xfffffe0006feba40 uma_reclaim_worker() at uma_reclaim_worker+0xaa/frame 0xfffffe0006feba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006febab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006febab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 29 tid 100127 td 0xfffff800064fc5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006efa8b0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006efa8e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006efa920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006efa950 _sleep() at _sleep+0x2da/frame 0xfffffe0006efa9f0 enc_daemon() at enc_daemon+0x1cf/frame 0xfffffe0006efaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006efaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006efaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 28 tid 100126 td 0xfffff800064fb000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ef58b0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006ef58e0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ef5920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ef5950 _sleep() at _sleep+0x2da/frame 0xfffffe0006ef59f0 enc_daemon() at enc_daemon+0x1cf/frame 0xfffffe0006ef5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ef5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ef5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 27 tid 100120 td 0xfffff80003d76000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ed78c0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006ed78f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ed7930 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ed7970 _sleep() at _sleep+0x279/frame 0xfffffe0006ed7a10 random_kthread() at random_kthread+0x26a/frame 0xfffffe0006ed7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ed7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ed7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 26 tid 100119 td 0xfffff80003d765a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ec6910 mi_switch() at mi_switch+0x172/frame 0xfffffe0006ec6940 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ec6980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ec69b0 _sleep() at _sleep+0x2da/frame 0xfffffe0006ec6a50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe0006ec6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ec6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ec6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 25 tid 100118 td 0xfffff800064fb5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ec18e0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006ec1910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ec1950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ec1990 _sleep() at _sleep+0x279/frame 0xfffffe0006ec1a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ec1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ec1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ec1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 24 tid 100117 td 0xfffff800064fa000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ebc8e0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006ebc910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ebc950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006ebc990 _sleep() at _sleep+0x279/frame 0xfffffe0006ebca30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006ebca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ebcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ebcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 23 tid 100116 td 0xfffff800064fa5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006eb78e0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006eb7910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006eb7950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006eb7990 _sleep() at _sleep+0x279/frame 0xfffffe0006eb7a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006eb7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eb7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eb7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 22 tid 100115 td 0xfffff800064f9000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006eb28e0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006eb2910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006eb2950 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe0006eb2990 _sleep() at _sleep+0x279/frame 0xfffffe0006eb2a30 soaio_kproc_loop() at soaio_kproc_loop+0x170/frame 0xfffffe0006eb2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eb2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eb2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100096 td 0xfffff800037e85a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e3b930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e3b960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e3b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e3b9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e3ba30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e3ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e3bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e3bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100097 td 0xfffff800037e8000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e40930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e40960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e409a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e409d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e40a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e40a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e40ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e40ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100098 td 0xfffff800037e95a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e45930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e45960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e459a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e459d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e45a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e45a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e45ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e45ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100099 td 0xfffff800037e9000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e4a930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e4a960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e4a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e4a9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e4aa30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e4aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e4aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e4aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100100 td 0xfffff800037f75a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e4f930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e4f960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e4f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e4f9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e4fa30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e4fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e4fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e4fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100102 td 0xfffff80003e735a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e59930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e59960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e599a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e599d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e59a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e59a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e59ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e59ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100103 td 0xfffff800044de000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e5e930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e5e960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e5e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e5e9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e5ea30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e5ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e5eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e5eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100104 td 0xfffff800044df5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e63930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e63960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e639a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e639d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e63a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e63a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e63ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e63ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100105 td 0xfffff800044df000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e68930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e68960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e689a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e689d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e68a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e68a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e68ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e68ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100106 td 0xfffff800044e05a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e6d930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e6d960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e6d9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e6d9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e6da30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e6da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e6dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e6dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100107 td 0xfffff800065765a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e8a930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e8a960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e8a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e8a9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e8aa30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e8aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e8aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e8aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100108 td 0xfffff80006576000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e8f930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e8f960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e8f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e8f9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e8fa30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e8fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e8fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e8fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100109 td 0xfffff800065775a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e94930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e94960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e949a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e949d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e94a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e94a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e94ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e94ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100110 td 0xfffff80006577000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e99930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e99960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e999a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e999d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e99a30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e99a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e99ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e99ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100111 td 0xfffff800065785a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e9e930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e9e960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e9e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e9e9d0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe0006e9ea30 usb_process() at usb_process+0x13b/frame 0xfffffe0006e9ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e9eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e9eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100091 td 0xfffff80003e73000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e228e0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e22910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e22950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e22980 _sleep() at _sleep+0x2da/frame 0xfffffe0006e22a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e22a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e22ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e22ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100092 td 0xfffff80003e745a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e278e0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e27910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e27950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e27980 _sleep() at _sleep+0x2da/frame 0xfffffe0006e27a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e27a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e27ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e27ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100093 td 0xfffff80003e74000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e2c8e0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e2c910 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e2c950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e2c980 _sleep() at _sleep+0x2da/frame 0xfffffe0006e2ca20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe0006e2ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e2cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e2cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100125 td 0xfffff80003d845a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ef08d0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006ef0900 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ef0940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ef0970 _sleep() at _sleep+0x2da/frame 0xfffffe0006ef0a10 xpt_scanner_thread() at xpt_scanner_thread+0x93/frame 0xfffffe0006ef0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ef0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ef0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 19 tid 100090 td 0xfffff80003cdf5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e1d8c0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e1d8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e1d930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e1d960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e1da00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e1da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e1dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e1dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 18 tid 100089 td 0xfffff80003cd1000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e188c0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e188f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e18930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e18960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e18a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e18a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e18ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e18ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 17 tid 100088 td 0xfffff80003cd15a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e138c0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e138f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e13930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e13960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e13a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e13a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e13ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e13ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 16 tid 100087 td 0xfffff80003cd0000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e0e8c0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e0e8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e0e930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e0e960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e0ea00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e0ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e0eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e0eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 15 tid 100086 td 0xfffff80003cd05a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e098c0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e098f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e09930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e09960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e09a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e09a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e09ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e09ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100085 td 0xfffff80003ccf000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e048c0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e048f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006e04930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006e04960 _sleep() at _sleep+0x2da/frame 0xfffffe0006e04a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe0006e04a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e04ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e04ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100084 td 0xfffff80003ccf5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005fb8c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00005fb8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005fb930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005fb960 _sleep() at _sleep+0x2da/frame 0xfffffe00005fba00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005fba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005fbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005fbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100083 td 0xfffff80003cce000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005f68c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00005f68f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005f6930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005f6960 _sleep() at _sleep+0x2da/frame 0xfffffe00005f6a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005f6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100082 td 0xfffff80003cce5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005f18c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00005f18f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005f1930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005f1960 _sleep() at _sleep+0x2da/frame 0xfffffe00005f1a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005f1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100081 td 0xfffff80003ce3000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005ec8c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00005ec8f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005ec930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ec960 _sleep() at _sleep+0x2da/frame 0xfffffe00005eca00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005eca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005ecab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005ecab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100080 td 0xfffff80003ce35a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005e78c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00005e78f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005e7930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005e7960 _sleep() at _sleep+0x2da/frame 0xfffffe00005e7a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005e7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100079 td 0xfffff80003ce2000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005e28c0 mi_switch() at mi_switch+0x172/frame 0xfffffe00005e28f0 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005e2930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005e2960 _sleep() at _sleep+0x2da/frame 0xfffffe00005e2a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005e2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100078 td 0xfffff80003ce25a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005dd8f0 mi_switch() at mi_switch+0x172/frame 0xfffffe00005dd920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005dd960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005dd990 _sleep() at _sleep+0x2da/frame 0xfffffe00005dda30 crypto_proc() at crypto_proc+0x2c4/frame 0xfffffe00005dda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005ddab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005ddab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100065 td 0xfffff80003d33000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe000059c8f0 mi_switch() at mi_switch+0x172/frame 0xfffffe000059c920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000059c960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000059c990 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe000059c9f0 seq_eventthread() at seq_eventthread+0xdc/frame 0xfffffe000059ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe000059cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000059cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffff800037155a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005818f0 mi_switch() at mi_switch+0x172/frame 0xfffffe0000581920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000581960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000581990 _sleep() at _sleep+0x2da/frame 0xfffffe0000581a30 g_run_events() at g_run_events+0x4f/frame 0xfffffe0000581a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000581ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000581ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffff80003715000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005868f0 mi_switch() at mi_switch+0x172/frame 0xfffffe0000586920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0000586960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000586990 _sleep() at _sleep+0x2da/frame 0xfffffe0000586a30 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe0000586a60 g_up_procbody() at g_up_procbody+0x6d/frame 0xfffffe0000586a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000586ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000586ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100064 td 0xfffff80003d335a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe000058b8f0 mi_switch() at mi_switch+0x172/frame 0xfffffe000058b920 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000058b960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000058b990 _sleep() at _sleep+0x2da/frame 0xfffffe000058ba30 g_io_schedule_down() at g_io_schedule_down+0x14c/frame 0xfffffe000058ba60 g_down_procbody() at g_down_procbody+0x6d/frame 0xfffffe000058ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000058bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000058bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100015 td 0xfffff8000379e000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00767ae9e0 mi_switch() at mi_switch+0x172/frame 0xfffffe00767aea10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00767aea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767aeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767aeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100016 td 0xfffff8000379f5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00767b37d0 mi_switch() at mi_switch+0x172/frame 0xfffffe00767b3800 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767b3840 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xfffffe00767b3880 _sleep() at _sleep+0x279/frame 0xfffffe00767b3920 destroy_devl() at destroy_devl+0x26d/frame 0xfffffe00767b3960 destroy_dev_tq() at destroy_dev_tq+0xc1/frame 0xfffffe00767b3990 taskqueue_run_locked() at taskqueue_run_locked+0x10c/frame 0xfffffe00767b39f0 taskqueue_run() at taskqueue_run+0x4a/frame 0xfffffe00767b3a10 ithread_loop() at ithread_loop+0x187/frame 0xfffffe00767b3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767b3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767b3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100018 td 0xfffff800037ad5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffff80003718000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004ee9e0 mi_switch() at mi_switch+0x172/frame 0xfffffe00004eea10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00004eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100048 td 0xfffff800037195a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004f39e0 mi_switch() at mi_switch+0x172/frame 0xfffffe00004f3a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00004f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100049 td 0xfffff80003719000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004f89e0 mi_switch() at mi_switch+0x172/frame 0xfffffe00004f8a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00004f8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004f8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004f8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100050 td 0xfffff8000371a5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004fd9e0 mi_switch() at mi_switch+0x172/frame 0xfffffe00004fda10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe00004fda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004fdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004fdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100051 td 0xfffff8000371a000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005029e0 mi_switch() at mi_switch+0x172/frame 0xfffffe0000502a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0000502a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000502ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000502ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100052 td 0xfffff8000371b5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005079e0 mi_switch() at mi_switch+0x172/frame 0xfffffe0000507a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0000507a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000507ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000507ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100053 td 0xfffff8000371b000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe000050c9e0 mi_switch() at mi_switch+0x172/frame 0xfffffe000050ca10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe000050ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe000050cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000050cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100054 td 0xfffff8000371c5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005119e0 mi_switch() at mi_switch+0x172/frame 0xfffffe0000511a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0000511a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000511ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000511ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100055 td 0xfffff8000370a000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005169e0 mi_switch() at mi_switch+0x172/frame 0xfffffe0000516a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0000516a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000516ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000516ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100056 td 0xfffff8000370e5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe000051b9e0 mi_switch() at mi_switch+0x172/frame 0xfffffe000051ba10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe000051ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000051bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000051bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100057 td 0xfffff8000370e000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005209e0 mi_switch() at mi_switch+0x172/frame 0xfffffe0000520a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0000520a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000520ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000520ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100058 td 0xfffff800037135a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005259e0 mi_switch() at mi_switch+0x172/frame 0xfffffe0000525a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0000525a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000525ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000525ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100059 td 0xfffff80003713000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100060 td 0xfffff800037145a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe000052f9e0 mi_switch() at mi_switch+0x172/frame 0xfffffe000052fa10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe000052fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000052fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000052fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100094 td 0xfffff800037e75a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e319e0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e31a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006e31a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e31ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e31ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffff800037e7000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e369e0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e36a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006e36a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e36ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e36ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100101 td 0xfffff800037f7000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006e549e0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006e54a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006e54a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006e54ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006e54ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100112 td 0xfffff80006578000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffff800065895a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ea89e0 mi_switch() at mi_switch+0x172/frame 0xfffffe0006ea8a10 ithread_loop() at ithread_loop+0x351/frame 0xfffffe0006ea8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ea8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ea8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100185 td 0xfffff80007c68000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100186 td 0xfffff80007ffb5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100187 td 0xfffff80007ffb000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100188 td 0xfffff80007b185a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100189 td 0xfffff80007b18000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100190 td 0xfffff8001859e5a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100191 td 0xfffff80018c65000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100192 td 0xfffff800180d45a0 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffff800037ae000 (CPU 0) cpustop_handler() at cpustop_handler+0x2d/frame 0xffffffff81f9f710 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xffffffff81f9f730 trap() at trap+0x46/frame 0xffffffff81f9f840 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81f9f840 --- trap 0x13, rip = 0xffffffff8115a376, rsp = 0xfffffe0076766910, rbp = 0xfffffe0076766910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076766910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076766960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076766980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00767669a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe0076766a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076766ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076766ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff800037af5a0 (CPU 1) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b73df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b73e10 trap() at trap+0x46/frame 0xfffffe0006b73f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b73f20 --- trap 0x13, rip = 0xffffffff8115a376, rsp = 0xfffffe007676b910, rbp = 0xfffffe007676b910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007676b910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007676b960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007676b980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007676b9a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe007676ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe007676bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007676bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff800037af000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0076770970 mi_switch() at mi_switch+0x172/frame 0xfffffe00767709a0 sched_idletd() at sched_idletd+0xa3/frame 0xfffffe0076770a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076770ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076770ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff800037b05a0 (CPU 3) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b8bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b8be10 trap() at trap+0x46/frame 0xfffffe0006b8bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b8bf20 --- trap 0x13, rip = 0xffffffff8115a376, rsp = 0xfffffe0076775910, rbp = 0xfffffe0076775910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076775910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076775960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076775980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00767759a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe0076775a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076775ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076775ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff800037b0000 (CPU 4) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006b97df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006b97e10 trap() at trap+0x46/frame 0xfffffe0006b97f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006b97f20 --- trap 0x13, rip = 0xffffffff8115a376, rsp = 0xfffffe007677a910, rbp = 0xfffffe007677a910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007677a910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007677a960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007677a980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007677a9a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe007677aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007677aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007677aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff800037b15a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe007677f970 mi_switch() at mi_switch+0x172/frame 0xfffffe007677f9a0 sched_idletd() at sched_idletd+0xa3/frame 0xfffffe007677fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007677fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007677fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff800037b1000 (CPU 6) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bafdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bafe10 trap() at trap+0x46/frame 0xfffffe0006baff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006baff20 --- trap 0x13, rip = 0xffffffff8115a376, rsp = 0xfffffe0076784910, rbp = 0xfffffe0076784910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076784910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076784960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076784980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00767849a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe0076784a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076784ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076784ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff8000379c5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0076789970 mi_switch() at mi_switch+0x172/frame 0xfffffe00767899a0 sched_idletd() at sched_idletd+0xa3/frame 0xfffffe0076789a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076789ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076789ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff8000379c000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe007678e950 mi_switch() at mi_switch+0x172/frame 0xfffffe007678e980 critical_exit_preempt() at critical_exit_preempt+0x65/frame 0xfffffe007678e9a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe007678ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe007678eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007678eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff8000379d5a0 (CPU 9) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bd3df0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bd3e10 trap() at trap+0x46/frame 0xfffffe0006bd3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bd3f20 --- trap 0x13, rip = 0xffffffff8115a376, rsp = 0xfffffe0076793910, rbp = 0xfffffe0076793910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076793910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076793960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076793980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00767939a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe0076793a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076793ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076793ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff8000379d000 (CPU 10) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bdfdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bdfe10 trap() at trap+0x46/frame 0xfffffe0006bdff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bdff20 --- trap 0x13, rip = 0xffffffff8115a376, rsp = 0xfffffe0076798910, rbp = 0xfffffe0076798910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe0076798910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe0076798960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0076798980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe00767989a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe0076798a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0076798ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0076798ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff8000379e5a0 (CPU 11) cpustop_handler() at cpustop_handler+0x2d/frame 0xfffffe0006bebdf0 ipi_nmi_handler() at ipi_nmi_handler+0x40/frame 0xfffffe0006bebe10 trap() at trap+0x46/frame 0xfffffe0006bebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0006bebf20 --- trap 0x13, rip = 0xffffffff8115a376, rsp = 0xfffffe007679d910, rbp = 0xfffffe007679d910 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe007679d910 acpi_cpu_idle() at acpi_cpu_idle+0x235/frame 0xfffffe007679d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007679d980 cpu_idle() at cpu_idle+0xa6/frame 0xfffffe007679d9a0 sched_idletd() at sched_idletd+0x442/frame 0xfffffe007679da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007679dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007679dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff800037ae5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0076761560 mi_switch() at mi_switch+0x172/frame 0xfffffe0076761590 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767615d0 sleepq_catch_signals() at sleepq_catch_signals+0x417/frame 0xfffffe0076761630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0076761660 _sleep() at _sleep+0x2d0/frame 0xfffffe0076761700 kern_wait6() at kern_wait6+0x48f/frame 0xfffffe0076761790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe0076761980 amd64_syscall() at amd64_syscall+0x2d4/frame 0xfffffe0076761ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0076761ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2b0f8a, rsp = 0x7fffffffe778, rbp = 0x7fffffffe7e0 --- Tracing command audit pid 10 tid 100001 td 0xfffff800037ad000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe007675c910 mi_switch() at mi_switch+0x172/frame 0xfffffe007675c940 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe007675c980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe007675c9b0 _cv_wait() at _cv_wait+0x15b/frame 0xfffffe007675ca10 audit_worker() at audit_worker+0x93/frame 0xfffffe007675ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe007675cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007675cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81fb9640 sched_switch() at sched_switch+0x3f0/frame 0xffffffff82720980 mi_switch() at mi_switch+0x172/frame 0xffffffff827209b0 sleepq_switch() at sleepq_switch+0x110/frame 0xffffffff827209f0 sleepq_timedwait() at sleepq_timedwait+0x4f/frame 0xffffffff82720a30 _sleep() at _sleep+0x279/frame 0xffffffff82720ad0 swapper() at swapper+0x77/frame 0xffffffff82720b20 mi_startup() at mi_startup+0x2ee/frame 0xffffffff82720b70 btext() at btext+0x2c Tracing command kernel pid 0 tid 100017 td 0xfffff8000379f000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00767b8900 mi_switch() at mi_switch+0x172/frame 0xfffffe00767b8930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767b8970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00767b89a0 _sleep() at _sleep+0x2da/frame 0xfffffe00767b8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00767b8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767b8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767b8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xfffff80003756000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00767c2930 mi_switch() at mi_switch+0x172/frame 0xfffffe00767c2960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767c29a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00767c29d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00767c2a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00767c2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767c2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767c2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffff800037575a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00767c7900 mi_switch() at mi_switch+0x172/frame 0xfffffe00767c7930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767c7970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00767c79a0 _sleep() at _sleep+0x2da/frame 0xfffffe00767c7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00767c7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767c7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767c7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffff80003757000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00767cc900 mi_switch() at mi_switch+0x172/frame 0xfffffe00767cc930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00767cc970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00767cc9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00767cca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00767cca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00767ccab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00767ccab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffff800037585a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0000471930 mi_switch() at mi_switch+0x172/frame 0xfffffe0000471960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004719a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004719d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000471a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000471a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000471ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000471ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffff80003758000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0000476930 mi_switch() at mi_switch+0x172/frame 0xfffffe0000476960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004769a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004769d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000476a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000476a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000476ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000476ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffff800037595a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe000047b930 mi_switch() at mi_switch+0x172/frame 0xfffffe000047b960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000047b9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000047b9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe000047ba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000047ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000047bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000047bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffff80003759000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0000480930 mi_switch() at mi_switch+0x172/frame 0xfffffe0000480960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004809a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004809d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000480a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000480a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000480ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000480ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffff8000375a5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0000485930 mi_switch() at mi_switch+0x172/frame 0xfffffe0000485960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004859a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004859d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000485a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000485a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000485ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000485ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffff8000375a000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe000048a930 mi_switch() at mi_switch+0x172/frame 0xfffffe000048a960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000048a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000048a9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe000048aa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000048aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000048aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000048aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffff800037215a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe000048f930 mi_switch() at mi_switch+0x172/frame 0xfffffe000048f960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000048f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000048f9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe000048fa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000048fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000048fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000048fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffff80003721000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0000494930 mi_switch() at mi_switch+0x172/frame 0xfffffe0000494960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004949a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004949d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000494a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000494a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000494ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000494ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffff800037225a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0000499930 mi_switch() at mi_switch+0x172/frame 0xfffffe0000499960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004999a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004999d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0000499a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000499a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000499ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000499ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffff80003722000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe000049e930 mi_switch() at mi_switch+0x172/frame 0xfffffe000049e960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000049e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000049e9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe000049ea40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000049ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000049eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000049eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffff800037235a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004a3930 mi_switch() at mi_switch+0x172/frame 0xfffffe00004a3960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004a39a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a39d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004a3a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004a3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff80003723000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004a8930 mi_switch() at mi_switch+0x172/frame 0xfffffe00004a8960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004a89a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a89d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004a8a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004a8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffff800037245a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004ad930 mi_switch() at mi_switch+0x172/frame 0xfffffe00004ad960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004ad9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004ad9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004ada40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004ada70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004adab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004adab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffff80003724000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004b2930 mi_switch() at mi_switch+0x172/frame 0xfffffe00004b2960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004b29a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b29d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004b2a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004b2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffff800037565a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004b7930 mi_switch() at mi_switch+0x172/frame 0xfffffe00004b7960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004b79a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b79d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004b7a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004b7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffff8000371c000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004bc930 mi_switch() at mi_switch+0x172/frame 0xfffffe00004bc960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004bc9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004bc9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004bca40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004bca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004bcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004bcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffff8000371d5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004c1930 mi_switch() at mi_switch+0x172/frame 0xfffffe00004c1960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004c19a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c19d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004c1a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004c1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffff8000371d000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004c6930 mi_switch() at mi_switch+0x172/frame 0xfffffe00004c6960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004c69a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c69d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004c6a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004c6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffff8000371e5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004cb930 mi_switch() at mi_switch+0x172/frame 0xfffffe00004cb960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004cb9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004cb9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004cba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004cba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004cbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004cbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffff8000371e000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004d0930 mi_switch() at mi_switch+0x172/frame 0xfffffe00004d0960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004d09a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004d09d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004d0a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004d0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffff8000371f5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004d5930 mi_switch() at mi_switch+0x172/frame 0xfffffe00004d5960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004d59a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004d59d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004d5a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004d5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffff8000371f000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004da930 mi_switch() at mi_switch+0x172/frame 0xfffffe00004da960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004da9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004da9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004daa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004daa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004daab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004daab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffff800037205a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004df930 mi_switch() at mi_switch+0x172/frame 0xfffffe00004df960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004df9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004df9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004dfa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004dfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004dfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004dfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffff80003720000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004e4930 mi_switch() at mi_switch+0x172/frame 0xfffffe00004e4960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004e49a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004e49d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004e4a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004e4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004e4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004e4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffff800037185a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00004e9930 mi_switch() at mi_switch+0x172/frame 0xfffffe00004e9960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00004e99a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004e99d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe00004e9a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffff80003714000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe000057c900 mi_switch() at mi_switch+0x172/frame 0xfffffe000057c930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe000057c970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000057c9a0 _sleep() at _sleep+0x2da/frame 0xfffffe000057ca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe000057ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe000057cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000057cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff80003d345a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005a1900 mi_switch() at mi_switch+0x172/frame 0xfffffe00005a1930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005a1970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005a19a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005a1a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005a1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005a1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005a1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff80003d34000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005a6900 mi_switch() at mi_switch+0x172/frame 0xfffffe00005a6930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005a6970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005a69a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005a6a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005a6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005a6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005a6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff80003d355a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005ab900 mi_switch() at mi_switch+0x172/frame 0xfffffe00005ab930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005ab970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ab9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005aba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005aba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005abab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005abab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffff80003d35000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005b0900 mi_switch() at mi_switch+0x172/frame 0xfffffe00005b0930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005b0970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005b09a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005b0a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005b0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005b0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005b0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff80003d365a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005b5900 mi_switch() at mi_switch+0x172/frame 0xfffffe00005b5930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005b5970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005b59a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005b5a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005b5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005b5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005b5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff80003d36000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005ba900 mi_switch() at mi_switch+0x172/frame 0xfffffe00005ba930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005ba970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ba9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005baa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005baa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005baab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005baab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffff8000370a5a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005bf900 mi_switch() at mi_switch+0x172/frame 0xfffffe00005bf930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005bf970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005bf9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005bfa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005bfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005bfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005bfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffff80003cdf000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005c4900 mi_switch() at mi_switch+0x172/frame 0xfffffe00005c4930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005c4970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c49a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005c4a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005c4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffff80003ce05a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005c9900 mi_switch() at mi_switch+0x172/frame 0xfffffe00005c9930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005c9970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c99a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005c9a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005c9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffff80003ce0000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005ce900 mi_switch() at mi_switch+0x172/frame 0xfffffe00005ce930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005ce970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ce9a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005cea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005cea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005ceab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005ceab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffff80003ce15a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005d3900 mi_switch() at mi_switch+0x172/frame 0xfffffe00005d3930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005d3970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005d39a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005d3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005d3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffff80003ce1000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe00005d8900 mi_switch() at mi_switch+0x172/frame 0xfffffe00005d8930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe00005d8970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005d89a0 _sleep() at _sleep+0x2da/frame 0xfffffe00005d8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005d8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffff80006589000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ead930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006ead960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ead9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ead9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0006eada40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006eada70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eadab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eadab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffff80003d775a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006edc930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006edc960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006edc9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006edc9d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0006edca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006edca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006edcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006edcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffff80003d77000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ee1930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006ee1960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ee19a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ee19d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0006ee1a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006ee1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ee1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ee1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100123 td 0xfffff80003d785a0 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006ee6930 mi_switch() at mi_switch+0x172/frame 0xfffffe0006ee6960 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006ee69a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006ee69d0 msleep_spin_sbt() at msleep_spin_sbt+0x153/frame 0xfffffe0006ee6a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0006ee6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006ee6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006ee6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffff80003d78000 sched_switch() at sched_switch+0x3f0/frame 0xfffffe0006eeb900 mi_switch() at mi_switch+0x172/frame 0xfffffe0006eeb930 sleepq_switch() at sleepq_switch+0x110/frame 0xfffffe0006eeb970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0006eeb9a0 _sleep() at _sleep+0x2da/frame 0xfffffe0006eeba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0006eeba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0006eebab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0006eebab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> dump Dumping 4825 out of 32622 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db> (kgdb) bt #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=0x0) at ../../../kern/kern_shutdown.c:392 #2 0xffffffff804a1eab in db_dump (dummy=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:575 #3 0xffffffff804a1c79 in db_command (last_cmdp=, cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:482 #4 0xffffffff804a6be8 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #5 0xffffffff804a1c79 in db_command (last_cmdp=, cmd_table=, dopager=0x1) at ../../../ddb/db_command.c:482 #6 0xffffffff804a19f4 in db_command_loop () at ../../../ddb/db_command.c:535 #7 0xffffffff804a4b9f in db_trap (type=, code=) at ../../../ddb/db_main.c:252 #8 0xffffffff80c2106c in kdb_trap (type=0x3, code=0x0, tf=) at ../../../kern/subr_kdb.c:692 #9 0xffffffff811992bf in trap (frame=0xfffffe036713a2b0) at ../../../amd64/amd64/trap.c:621 #10 #11 kdb_enter (why=0xffffffff813450db "panic", msg=) at ../../../kern/subr_kdb.c:479 #12 0xffffffff80bd5aea in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:894 #13 0xffffffff80bd5863 in panic (fmt=0xffffffff81e8a328 "E\233\060\201\377\377\377\377") at ../../../kern/kern_shutdown.c:832 #14 0xffffffff8119970c in trap_fatal (frame=0xfffffe036713a600, eva=0x18) at ../../../amd64/amd64/trap.c:943 #15 0xffffffff81199772 in trap_pfault (frame=0xfffffe036713a600, usermode=) at ../../../amd64/amd64/trap.c:767 #16 0xffffffff81198d62 in trap (frame=0xfffffe036713a600) at ../../../amd64/amd64/trap.c:443 #17 #18 __mtx_lock_flags (c=0x18, opts=0x0, file=0xffffffff81257b8e "../../../kern/vfs_default.c", line=0x25c) at ../../../kern/kern_mutex.c:259 #19 0xffffffff80c9be91 in vop_stdgetwritemount (ap=0xfffffe036713a760) at ../../../kern/vfs_default.c:604 #20 0xffffffff81238138 in VOP_GETWRITEMOUNT_APV (vop=0xffffffff81b20728 , a=0xfffffe036713a760) at vnode_if.c:2371 #21 0xffffffff80cbfdb2 in VOP_GETWRITEMOUNT (vp=, mpp=) at ./vnode_if.h:983 #22 vn_start_write (vp=0xfffff8014964a000, mpp=0xfffffe036713a7b0, flags=0x1) at ../../../kern/vfs_vnops.c:1674 #23 0xffffffff80cc04ec in vn_close1 (vp=0xfffff8014964a000, flags=0x1, file_cred=0xfffff800066fbe00, td=0xfffff805738a8000, keep_ref=) at ../../../kern/vfs_vnops.c:448 #24 0xffffffff80cbf33c in vn_closefile (fp=0xfffff8061615daa0, td=0x25c) at ../../../kern/vfs_vnops.c:1597 #25 0xffffffff80b7c2fa in fo_close (fp=0xfffff8061615daa0, td=0xfffff805738a8000) at ../../../sys/file.h:360 #26 _fdrop (fp=0xfffff8061615daa0, td=0xfffff805738a8000) at ../../../kern/kern_descrip.c:2954 #27 0xffffffff80b7f512 in closef (fp=0xfffff8061615daa0, td=0xfffff805738a8000) at ../../../kern/kern_descrip.c:2523 #28 0xffffffff80b7c82c in closefp (fdp=0xfffff80158205450, fd=0x3, fp=0xfffff8061615daa0, td=, holdleaders=0x0) at ../../../kern/kern_descrip.c:1208 #29 0xffffffff8119a254 in syscallenter (td=0xfffff805738a8000) at ../../../amd64/amd64/../../kern/subr_syscall.c:144 #30 amd64_syscall (td=0xfffff805738a8000, traced=0x0) at ../../../amd64/amd64/trap.c:1180 #31 #32 0x000000080041521a in ?? () Backtrace stopped: Cannot access memory at address 0x7fffffffe6f8 (kgdb) f 19 #19 0xffffffff80c9be91 in vop_stdgetwritemount (ap=0xfffffe036713a760) at ../../../kern/vfs_default.c:604 604 MNT_ILOCK(mp); (kgdb) l 599 * reference obtained here. The consumer only needs to concern itself 600 * with releasing it. 601 */ 602 vp = ap->a_vp; 603 mp = vp->v_mount; 604 MNT_ILOCK(mp); 605 if (mp != vp->v_mount) { 606 MNT_IUNLOCK(mp); 607 mp = NULL; 608 goto out; (kgdb) info loc vp = 0xfffff8014964a000 mp = 0x0 (kgdb) f 23 #23 0xffffffff80cc04ec in vn_close1 (vp=0xfffff8014964a000, flags=0x1, file_cred=0xfffff800066fbe00, td=0xfffff805738a8000, keep_ref=) at ../../../kern/vfs_vnops.c:448 448 vn_start_write(vp, &mp, V_WAIT); (kgdb) l 443 MNT_EXTENDED_SHARED(vp->v_mount)) 444 lock_flags = LK_SHARED; 445 else 446 lock_flags = LK_EXCLUSIVE; 447 448 vn_start_write(vp, &mp, V_WAIT); 449 vn_lock(vp, lock_flags | LK_RETRY); 450 AUDIT_ARG_VNODE1(vp); 451 if ((flags & (FWRITE | FOPENFAILED)) == FWRITE) { 452 VOP_ADD_WRITECOUNT_CHECKED(vp, -1); (kgdb) info loc lock_flags = mp = 0xfffffe036713a7f0 error = (kgdb) p *mp Cannot access memory at address 0xfffffe036713a7f0 (kgdb) p *vp $1 = {v_tag = 0xffffffff8127c145 "none", v_op = 0xffffffff81aea9b8 , v_data = 0x0, v_mount = 0x0, v_nmntvnodes = {tqe_next = 0x0, tqe_prev = 0xfffff80343f0b788}, {v_mountedhere = 0x0, v_unpcb = 0x0, v_rdev = 0x0, v_fifoinfo = 0x0}, v_hashlist = { le_next = 0x0, le_prev = 0xfffffe00ba9b9870}, v_cache_src = {lh_first = 0x0}, v_cache_dst = {tqh_first = 0x0, tqh_last = 0xfffff8014964a050}, v_cache_dd = 0x0, v_lock = {lock_object = {lo_name = 0xffffffff8124b8a8 "devfs", lo_flags = 0x6fb0000, lo_data = 0x0, lo_witness = 0x0}, lk_lock = 0x1, lk_exslpfail = 0x0, lk_timo = 0x33, lk_pri = 0x60, lk_stack = {depth = 0xf, pcs = {0xffffffff80ba8612, 0xffffffff81237b90, 0xffffffff80cc0365, 0xffffffff80a86648, 0xffffffff80a86d49, 0xffffffff80a86aaa, 0xffffffff80a8b90c, 0xffffffff80a89a8c, 0xffffffff81234c06, 0xffffffff80ca1b21, 0xffffffff80ca0fb2, 0xffffffff80cbfc00, 0xffffffff80cb7963, 0xffffffff8119a254, 0xffffffff81171b70, 0x0, 0x0, 0x0}}}, v_interlock = {lock_object = {lo_name = 0xffffffff8138a79a "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0x0}, mtx_lock = 0x0}, v_vnlock = 0xfffff8014964a068, v_actfreelist = {tqe_next = 0xfffff80007b6bc58, tqe_prev = 0xfffff8000413fa38}, v_bufobj = {bo_lock = {lock_object = { lo_name = 0xffffffff8134ab8c "bufobj interlock", lo_flags = 0x5230000, lo_data = 0x0, lo_witness = 0x0}, rw_lock = 0x1}, bo_ops = 0xffffffff81b1db40 , bo_object = 0x0, bo_synclist = {le_next = 0x0, le_prev = 0xfffff80566bd9df0}, bo_private = 0xfffff8014964a000, bo_clean = {bv_hd = {tqh_first = 0x0, tqh_last = 0xfffff8014964a1b0}, bv_root = {pt_root = 0x0}, bv_cnt = 0x0}, bo_dirty = {bv_hd = {tqh_first = 0x0, tqh_last = 0xfffff8014964a1d0}, bv_root = {pt_root = 0x0}, bv_cnt = 0x0}, bo_numoutput = 0x0, bo_flag = 0x4, bo_domain = 0x3, bo_bsize = 0x200}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0, v_rl = {rl_waiters = {tqh_first = 0x0, tqh_last = 0xfffff8014964a220}, rl_currdep = 0x0}, v_cstart = 0x0, v_lasta = 0x0, v_lastw = 0x0, v_clen = 0x0, v_holdcnt = 0x1, v_usecount = 0x1, v_iflag = 0x80, v_vflag = 0x0, v_mflag = 0x0, v_writecount = 0x0, v_hash = 0xa4b250, v_type = VBAD} (kgdb) f 24 #24 0xffffffff80cbf33c in vn_closefile (fp=0xfffff8061615daa0, td=0x25c) at ../../../kern/vfs_vnops.c:1597 1597 error = vn_close1(vp, fp->f_flag, fp->f_cred, td, ref); (kgdb) l 1592 1593 vp = fp->f_vnode; 1594 fp->f_ops = &badfileops; 1595 ref= (fp->f_flag & FHASLOCK) != 0 && fp->f_type == DTYPE_VNODE; 1596 1597 error = vn_close1(vp, fp->f_flag, fp->f_cred, td, ref); 1598 1599 if (__predict_false(ref)) { 1600 lf.l_whence = SEEK_SET; 1601 lf.l_start = 0; (kgdb) info loc vp = 0xfffff8014964a000 error = lf = ref = (kgdb) p *fp $2 = {f_data = 0xfffff801b4026400, f_ops = 0xffffffff81b01170 , f_cred = 0xfffff800066fbe00, f_vnode = 0xfffff8014964a000, f_type = 0xa, f_vnread_flags = 0x4, f_flag = 0x1, f_count = 0x0, {f_seqcount = 0x0, f_pipegen = 0x0}, f_nextoff = 0x0, f_vnun = { fvn_cdevpriv = 0x0, fvn_advice = 0x0}, f_offset = 0x0, f_label = 0x0} (kgdb) Index: src/sys/amd64/amd64/efirt_machdep.c =================================================================== --- src/sys/amd64/amd64/efirt_machdep.c (revision 351673) +++ src/sys/amd64/amd64/efirt_machdep.c (working copy) @@ -74,7 +74,7 @@ efi_destroy_1t1_map(void) if (obj_1t1_pt != NULL) { VM_OBJECT_RLOCK(obj_1t1_pt); TAILQ_FOREACH(m, &obj_1t1_pt->memq, listq) - m->wire_count = 0; + m->wire_count = VPRC_OBJREF; vm_wire_sub(obj_1t1_pt->resident_page_count); VM_OBJECT_RUNLOCK(obj_1t1_pt); vm_object_deallocate(obj_1t1_pt); Index: src/sys/amd64/amd64/pmap.c =================================================================== --- src/sys/amd64/amd64/pmap.c (revision 351673) +++ src/sys/amd64/amd64/pmap.c (working copy) @@ -3054,31 +3054,23 @@ pmap_extract_and_hold(pmap_t pmap, vm_offset_t va, m = NULL; PG_RW = pmap_rw_bit(pmap); PG_V = pmap_valid_bit(pmap); + PMAP_LOCK(pmap); -retry: pdep = pmap_pde(pmap, va); if (pdep != NULL && (pde = *pdep)) { if (pde & PG_PS) { - if ((pde & PG_RW) || (prot & VM_PROT_WRITE) == 0) { - if (vm_page_pa_tryrelock(pmap, (pde & - PG_PS_FRAME) | (va & PDRMASK), &pa)) - goto retry; - m = PHYS_TO_VM_PAGE(pa); - } + if ((pde & PG_RW) != 0 || (prot & VM_PROT_WRITE) == 0) + m = PHYS_TO_VM_PAGE((pde & PG_PS_FRAME) | + (va & PDRMASK)); } else { pte = *pmap_pde_to_pte(pdep, va); - if ((pte & PG_V) && - ((pte & PG_RW) || (prot & VM_PROT_WRITE) == 0)) { - if (vm_page_pa_tryrelock(pmap, pte & PG_FRAME, - &pa)) - goto retry; - m = PHYS_TO_VM_PAGE(pa); - } + if ((pte & PG_V) != 0 && + ((pte & PG_RW) != 0 || (prot & VM_PROT_WRITE) == 0)) + m = PHYS_TO_VM_PAGE(pte & PG_FRAME); } - if (m != NULL) - vm_page_wire(m); + if (m != NULL && !vm_page_wire_mapped(m)) + m = NULL; } - PA_UNLOCK_COND(pa); PMAP_UNLOCK(pmap); return (m); } Index: src/sys/amd64/sgx/sgx.c =================================================================== --- src/sys/amd64/sgx/sgx.c (revision 351673) +++ src/sys/amd64/sgx/sgx.c (working copy) @@ -357,9 +357,7 @@ sgx_page_remove(struct sgx_softc *sc, vm_page_t p) vm_paddr_t pa; uint64_t offs; - vm_page_lock(p); (void)vm_page_remove(p); - vm_page_unlock(p); dprintf("%s: p->pidx %ld\n", __func__, p->pindex); Index: src/sys/amd64/vmm/vmm.c =================================================================== --- src/sys/amd64/vmm/vmm.c (revision 351673) +++ src/sys/amd64/vmm/vmm.c (working copy) @@ -1002,9 +1002,7 @@ vm_gpa_release(void *cookie) { vm_page_t m = cookie; - vm_page_lock(m); vm_page_unwire(m, PQ_ACTIVE); - vm_page_unlock(m); } int Index: src/sys/arm/arm/pmap-v4.c =================================================================== --- src/sys/arm/arm/pmap-v4.c (revision 351673) +++ src/sys/arm/arm/pmap-v4.c (working copy) @@ -3415,14 +3415,14 @@ pmap_extract_and_hold(pmap_t pmap, vm_offset_t va, struct l2_dtable *l2; pd_entry_t l1pd; pt_entry_t *ptep, pte; - vm_paddr_t pa, paddr; - vm_page_t m = NULL; + vm_paddr_t pa; + vm_page_t m; u_int l1idx; + l1idx = L1_IDX(va); - paddr = 0; + m = NULL; PMAP_LOCK(pmap); -retry: l1pd = pmap->pm_l1->l1_kva[l1idx]; if (l1pte_section_p(l1pd)) { /* @@ -3434,11 +3434,10 @@ pmap_extract_and_hold(pmap_t pmap, vm_offset_t va, pa = (l1pd & L1_SUP_FRAME) | (va & L1_SUP_OFFSET); else pa = (l1pd & L1_S_FRAME) | (va & L1_S_OFFSET); - if (vm_page_pa_tryrelock(pmap, pa & PG_FRAME, &paddr)) - goto retry; if (l1pd & L1_S_PROT_W || (prot & VM_PROT_WRITE) == 0) { m = PHYS_TO_VM_PAGE(pa); - vm_page_wire(m); + if (!vm_page_wire_mapped(m)) + m = NULL; } } else { /* @@ -3466,15 +3465,12 @@ pmap_extract_and_hold(pmap_t pmap, vm_offset_t va, pa = (pte & L2_L_FRAME) | (va & L2_L_OFFSET); else pa = (pte & L2_S_FRAME) | (va & L2_S_OFFSET); - if (vm_page_pa_tryrelock(pmap, pa & PG_FRAME, &paddr)) - goto retry; m = PHYS_TO_VM_PAGE(pa); - vm_page_wire(m); + if (!vm_page_wire_mapped(m)) + m = NULL; } } - PMAP_UNLOCK(pmap); - PA_UNLOCK_COND(paddr); return (m); } Index: src/sys/arm/arm/pmap-v6.c =================================================================== --- src/sys/arm/arm/pmap-v6.c (revision 351673) +++ src/sys/arm/arm/pmap-v6.c (working copy) @@ -1986,23 +1986,20 @@ pmap_extract(pmap_t pmap, vm_offset_t va) vm_page_t pmap_extract_and_hold(pmap_t pmap, vm_offset_t va, vm_prot_t prot) { - vm_paddr_t pa, lockpa; + vm_paddr_t pa; pt1_entry_t pte1; pt2_entry_t pte2, *pte2p; vm_page_t m; - lockpa = 0; m = NULL; PMAP_LOCK(pmap); -retry: pte1 = pte1_load(pmap_pte1(pmap, va)); if (pte1_is_section(pte1)) { if (!(pte1 & PTE1_RO) || !(prot & VM_PROT_WRITE)) { pa = pte1_pa(pte1) | (va & PTE1_OFFSET); - if (vm_page_pa_tryrelock(pmap, pa, &lockpa)) - goto retry; m = PHYS_TO_VM_PAGE(pa); - vm_page_wire(m); + if (!vm_page_wire_mapped(m)) + m = NULL; } } else if (pte1_is_link(pte1)) { pte2p = pmap_pte2(pmap, va); @@ -2011,13 +2008,11 @@ pmap_extract_and_hold(pmap_t pmap, vm_offset_t va, if (pte2_is_valid(pte2) && (!(pte2 & PTE2_RO) || !(prot & VM_PROT_WRITE))) { pa = pte2_pa(pte2); - if (vm_page_pa_tryrelock(pmap, pa, &lockpa)) - goto retry; m = PHYS_TO_VM_PAGE(pa); - vm_page_wire(m); + if (!vm_page_wire_mapped(m)) + m = NULL; } } - PA_UNLOCK_COND(lockpa); PMAP_UNLOCK(pmap); return (m); } Index: src/sys/arm64/arm64/efirt_machdep.c =================================================================== --- src/sys/arm64/arm64/efirt_machdep.c (revision 351673) +++ src/sys/arm64/arm64/efirt_machdep.c (working copy) @@ -74,7 +74,7 @@ efi_destroy_1t1_map(void) if (obj_1t1_pt != NULL) { VM_OBJECT_RLOCK(obj_1t1_pt); TAILQ_FOREACH(m, &obj_1t1_pt->memq, listq) - m->wire_count = 0; + m->wire_count = VPRC_OBJREF; vm_wire_sub(obj_1t1_pt->resident_page_count); VM_OBJECT_RUNLOCK(obj_1t1_pt); vm_object_deallocate(obj_1t1_pt); Index: src/sys/arm64/arm64/pmap.c =================================================================== --- src/sys/arm64/arm64/pmap.c (revision 351673) +++ src/sys/arm64/arm64/pmap.c (working copy) @@ -1079,14 +1079,11 @@ pmap_extract_and_hold(pmap_t pmap, vm_offset_t va, { pt_entry_t *pte, tpte; vm_offset_t off; - vm_paddr_t pa; vm_page_t m; int lvl; - pa = 0; m = NULL; PMAP_LOCK(pmap); -retry: pte = pmap_pte(pmap, va, &lvl); if (pte != NULL) { tpte = pmap_load(pte); @@ -1111,14 +1108,11 @@ pmap_extract_and_hold(pmap_t pmap, vm_offset_t va, default: off = 0; } - if (vm_page_pa_tryrelock(pmap, - (tpte & ~ATTR_MASK) | off, &pa)) - goto retry; m = PHYS_TO_VM_PAGE((tpte & ~ATTR_MASK) | off); - vm_page_wire(m); + if (!vm_page_wire_mapped(m)) + m = NULL; } } - PA_UNLOCK_COND(pa); PMAP_UNLOCK(pmap); return (m); } Index: src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c =================================================================== --- src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c (revision 351673) +++ src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c (working copy) @@ -481,9 +481,7 @@ page_wire(vnode_t *vp, int64_t start) } ASSERT3U(pp->valid, ==, VM_PAGE_BITS_ALL); - vm_page_lock(pp); vm_page_wire(pp); - vm_page_unlock(pp); } else pp = NULL; break; @@ -495,9 +493,7 @@ static void page_unwire(vm_page_t pp) { - vm_page_lock(pp); vm_page_unwire(pp, PQ_ACTIVE); - vm_page_unlock(pp); } /* @@ -591,16 +587,16 @@ mappedread_sf(vnode_t *vp, int nbytes, uio_t *uio) zfs_unmap_page(sf); zfs_vmobject_wlock(obj); vm_page_sunbusy(pp); - vm_page_lock(pp); if (error) { - if (!vm_page_wired(pp) && pp->valid == 0 && - !vm_page_busied(pp)) + if (!vm_page_busied(pp) && !vm_page_wired(pp) && + pp->valid == 0) vm_page_free(pp); } else { pp->valid = VM_PAGE_BITS_ALL; + vm_page_lock(pp); vm_page_activate(pp); + vm_page_unlock(pp); } - vm_page_unlock(pp); } else { ASSERT3U(pp->valid, ==, VM_PAGE_BITS_ALL); vm_page_sunbusy(pp); Index: src/sys/compat/linuxkpi/common/include/linux/mm.h =================================================================== --- src/sys/compat/linuxkpi/common/include/linux/mm.h (revision 351673) +++ src/sys/compat/linuxkpi/common/include/linux/mm.h (working copy) @@ -227,9 +227,7 @@ mark_page_accessed(struct vm_page *page) static inline void get_page(struct vm_page *page) { - vm_page_lock(page); vm_page_wire(page); - vm_page_unlock(page); } extern long @@ -250,10 +248,7 @@ get_user_pages_remote(struct task_struct *, struct static inline void put_page(struct vm_page *page) { - vm_page_lock(page); - if (vm_page_unwire(page, PQ_ACTIVE) && page->object == NULL) - vm_page_free(page); - vm_page_unlock(page); + vm_page_unwire(page, PQ_ACTIVE); } #define copy_highpage(to, from) pmap_copy_page(from, to) Index: src/sys/compat/linuxkpi/common/src/linux_compat.c =================================================================== --- src/sys/compat/linuxkpi/common/src/linux_compat.c (revision 351673) +++ src/sys/compat/linuxkpi/common/src/linux_compat.c (working copy) @@ -511,9 +511,7 @@ linux_cdev_pager_fault(vm_object_t vm_obj, vm_ooff vm_page_replace_checked(page, vm_obj, (*mres)->pindex, *mres); - vm_page_lock(*mres); vm_page_free(*mres); - vm_page_unlock(*mres); *mres = page; } page->valid = VM_PAGE_BITS_ALL; Index: src/sys/compat/linuxkpi/common/src/linux_page.c =================================================================== --- src/sys/compat/linuxkpi/common/src/linux_page.c (revision 351673) +++ src/sys/compat/linuxkpi/common/src/linux_page.c (working copy) @@ -154,10 +154,8 @@ linux_free_pages(vm_page_t page, unsigned int orde for (x = 0; x != npages; x++) { vm_page_t pgo = page + x; - vm_page_lock(pgo); if (vm_page_unwire_noq(pgo)) vm_page_free(pgo); - vm_page_unlock(pgo); } } else { vm_offset_t vaddr; @@ -295,10 +293,8 @@ linux_shmem_read_mapping_page_gfp(vm_object_t obj, if (vm_pager_has_page(obj, pindex, NULL, NULL)) { rv = vm_pager_get_pages(obj, &page, 1, NULL, NULL); if (rv != VM_PAGER_OK) { - vm_page_lock(page); vm_page_unwire_noq(page); vm_page_free(page); - vm_page_unlock(page); VM_OBJECT_WUNLOCK(obj); return (ERR_PTR(-EINVAL)); } Index: src/sys/contrib/vchiq/interface/vchiq_arm/vchiq_2835_arm.c =================================================================== --- src/sys/contrib/vchiq/interface/vchiq_arm/vchiq_2835_arm.c (revision 351673) +++ src/sys/contrib/vchiq/interface/vchiq_arm/vchiq_2835_arm.c (working copy) @@ -377,10 +377,7 @@ vchiq_platform_handle_timeout(VCHIQ_STATE_T *state static void pagelist_page_free(vm_page_t pp) { - vm_page_lock(pp); - if (vm_page_unwire(pp, PQ_INACTIVE) && pp->object == NULL) - vm_page_free(pp); - vm_page_unlock(pp); + vm_page_unwire(pp, PQ_INACTIVE); } /* There is a potential problem with partial cache lines (pages?) Index: src/sys/dev/agp/agp.c =================================================================== --- src/sys/dev/agp/agp.c (revision 351673) +++ src/sys/dev/agp/agp.c (working copy) @@ -616,9 +616,7 @@ bad: m = vm_page_lookup(mem->am_obj, OFF_TO_IDX(k)); if (k >= i) vm_page_xunbusy(m); - vm_page_lock(m); vm_page_unwire(m, PQ_INACTIVE); - vm_page_unlock(m); } VM_OBJECT_WUNLOCK(mem->am_obj); @@ -653,9 +651,7 @@ agp_generic_unbind_memory(device_t dev, struct agp VM_OBJECT_WLOCK(mem->am_obj); for (i = 0; i < mem->am_size; i += PAGE_SIZE) { m = vm_page_lookup(mem->am_obj, atop(i)); - vm_page_lock(m); vm_page_unwire(m, PQ_INACTIVE); - vm_page_unlock(m); } VM_OBJECT_WUNLOCK(mem->am_obj); @@ -1003,7 +999,7 @@ agp_bind_pages(device_t dev, vm_page_t *pages, vm_ mtx_lock(&sc->as_lock); for (i = 0; i < size; i += PAGE_SIZE) { m = pages[OFF_TO_IDX(i)]; - KASSERT(m->wire_count > 0, + KASSERT(vm_page_wired(m), ("agp_bind_pages: page %p hasn't been wired", m)); /* Index: src/sys/dev/agp/agp_i810.c =================================================================== --- src/sys/dev/agp/agp_i810.c (revision 351673) +++ src/sys/dev/agp/agp_i810.c (working copy) @@ -1795,9 +1795,7 @@ agp_i810_free_memory(device_t dev, struct agp_memo */ VM_OBJECT_WLOCK(mem->am_obj); m = vm_page_lookup(mem->am_obj, 0); - vm_page_lock(m); vm_page_unwire(m, PQ_INACTIVE); - vm_page_unlock(m); VM_OBJECT_WUNLOCK(mem->am_obj); } else { contigfree(sc->argb_cursor, mem->am_size, M_AGP); Index: src/sys/dev/cxgbe/tom/t4_cpl_io.c =================================================================== --- src/sys/dev/cxgbe/tom/t4_cpl_io.c (revision 351673) +++ src/sys/dev/cxgbe/tom/t4_cpl_io.c (working copy) @@ -1910,7 +1910,6 @@ aiotx_free_pgs(struct mbuf *m) { struct mbuf_ext_pgs *ext_pgs; struct kaiocb *job; - struct mtx *mtx; vm_page_t pg; MBUF_EXT_PGS_ASSERT(m); @@ -1921,14 +1920,10 @@ aiotx_free_pgs(struct mbuf *m) m->m_len, jobtotid(job)); #endif - mtx = NULL; for (int i = 0; i < ext_pgs->npgs; i++) { pg = PHYS_TO_VM_PAGE(ext_pgs->pa[i]); - vm_page_change_lock(pg, &mtx); vm_page_unwire(pg, PQ_ACTIVE); } - if (mtx != NULL) - mtx_unlock(mtx); aiotx_free_job(job); } Index: src/sys/dev/cxgbe/tom/t4_ddp.c =================================================================== --- src/sys/dev/cxgbe/tom/t4_ddp.c (revision 351673) +++ src/sys/dev/cxgbe/tom/t4_ddp.c (working copy) @@ -114,9 +114,7 @@ free_pageset(struct tom_data *td, struct pageset * for (i = 0; i < ps->npages; i++) { p = ps->pages[i]; - vm_page_lock(p); vm_page_unwire(p, PQ_INACTIVE); - vm_page_unlock(p); } mtx_lock(&ddp_orphan_pagesets_lock); TAILQ_INSERT_TAIL(&ddp_orphan_pagesets, ps, link); Index: src/sys/dev/drm2/ttm/ttm_page_alloc.c =================================================================== --- src/sys/dev/drm2/ttm/ttm_page_alloc.c (revision 351673) +++ src/sys/dev/drm2/ttm/ttm_page_alloc.c (working copy) @@ -132,7 +132,7 @@ ttm_vm_page_free(vm_page_t m) { KASSERT(m->object == NULL, ("ttm page %p is owned", m)); - KASSERT(m->wire_count == 1, ("ttm lost wire %p", m)); + KASSERT(vm_page_wired(m), ("ttm lost wire %p", m)); KASSERT((m->flags & PG_FICTITIOUS) != 0, ("ttm lost fictitious %p", m)); KASSERT((m->oflags & VPO_UNMANAGED) == 0, ("ttm got unmanaged %p", m)); m->flags &= ~PG_FICTITIOUS; Index: src/sys/dev/md/md.c =================================================================== --- src/sys/dev/md/md.c (revision 351673) +++ src/sys/dev/md/md.c (working copy) @@ -1029,9 +1029,7 @@ md_swap_page_free(vm_page_t m) { vm_page_xunbusy(m); - vm_page_lock(m); vm_page_free(m); - vm_page_unlock(m); } static int Index: src/sys/dev/xen/gntdev/gntdev.c =================================================================== --- src/sys/dev/xen/gntdev/gntdev.c (revision 351673) +++ src/sys/dev/xen/gntdev/gntdev.c (working copy) @@ -826,14 +826,12 @@ gntdev_gmap_pg_fault(vm_object_t object, vm_ooffse KASSERT((page->flags & PG_FICTITIOUS) != 0, ("not fictitious %p", page)); - KASSERT(page->wire_count == 1, ("wire_count not 1 %p", page)); - KASSERT(vm_page_busied(page) == 0, ("page %p is busy", page)); + KASSERT(vm_page_wired(page), ("page %p is not wired", page)); + KASSERT(!vm_page_busied(page), ("page %p is busy", page)); if (*mres != NULL) { oldm = *mres; - vm_page_lock(oldm); vm_page_free(oldm); - vm_page_unlock(oldm); *mres = NULL; } Index: src/sys/dev/xen/privcmd/privcmd.c =================================================================== --- src/sys/dev/xen/privcmd/privcmd.c (revision 351673) +++ src/sys/dev/xen/privcmd/privcmd.c (working copy) @@ -169,14 +169,12 @@ privcmd_pg_fault(vm_object_t object, vm_ooffset_t KASSERT((page->flags & PG_FICTITIOUS) != 0, ("not fictitious %p", page)); - KASSERT(page->wire_count == 1, ("wire_count not 1 %p", page)); - KASSERT(vm_page_busied(page) == 0, ("page %p is busy", page)); + KASSERT(vm_page_wired(page), ("page %p not wired", page)); + KASSERT(!vm_page_busied(page), ("page %p is busy", page)); if (*mres != NULL) { oldm = *mres; - vm_page_lock(oldm); vm_page_free(oldm); - vm_page_unlock(oldm); *mres = NULL; } Index: src/sys/i386/i386/pmap.c =================================================================== --- src/sys/i386/i386/pmap.c (revision 351673) +++ src/sys/i386/i386/pmap.c (working copy) @@ -1690,35 +1690,24 @@ __CONCAT(PMTYPE, extract_and_hold)(pmap_t pmap, vm pd_entry_t pde; pt_entry_t pte; vm_page_t m; - vm_paddr_t pa; - pa = 0; m = NULL; PMAP_LOCK(pmap); -retry: pde = *pmap_pde(pmap, va); if (pde != 0) { if (pde & PG_PS) { - if ((pde & PG_RW) || (prot & VM_PROT_WRITE) == 0) { - if (vm_page_pa_tryrelock(pmap, (pde & - PG_PS_FRAME) | (va & PDRMASK), &pa)) - goto retry; - m = PHYS_TO_VM_PAGE(pa); - } + if ((pde & PG_RW) || (prot & VM_PROT_WRITE) == 0) + m = PHYS_TO_VM_PAGE((pde & PG_PS_FRAME) | + (va & PDRMASK)); } else { pte = pmap_pte_ufast(pmap, va, pde); if (pte != 0 && - ((pte & PG_RW) || (prot & VM_PROT_WRITE) == 0)) { - if (vm_page_pa_tryrelock(pmap, pte & PG_FRAME, - &pa)) - goto retry; - m = PHYS_TO_VM_PAGE(pa); - } + ((pte & PG_RW) || (prot & VM_PROT_WRITE) == 0)) + m = PHYS_TO_VM_PAGE(pte & PG_FRAME); } - if (m != NULL) - vm_page_wire(m); + if (m != NULL && !vm_page_wire_mapped(m)) + m = NULL; } - PA_UNLOCK_COND(pa); PMAP_UNLOCK(pmap); return (m); } Index: src/sys/kern/kern_exec.c =================================================================== --- src/sys/kern/kern_exec.c (revision 351673) +++ src/sys/kern/kern_exec.c (working copy) @@ -977,10 +977,8 @@ exec_map_first_page(struct image_params *imgp) if (ma[0]->valid != VM_PAGE_BITS_ALL) { vm_page_xbusy(ma[0]); if (!vm_pager_has_page(object, 0, NULL, &after)) { - vm_page_lock(ma[0]); vm_page_unwire_noq(ma[0]); vm_page_free(ma[0]); - vm_page_unlock(ma[0]); VM_OBJECT_WUNLOCK(object); return (EIO); } @@ -1004,13 +1002,9 @@ exec_map_first_page(struct image_params *imgp) initial_pagein = i; rv = vm_pager_get_pages(object, ma, initial_pagein, NULL, NULL); if (rv != VM_PAGER_OK) { - for (i = 0; i < initial_pagein; i++) { - vm_page_lock(ma[i]); - if (i == 0) - vm_page_unwire_noq(ma[i]); + vm_page_unwire_noq(ma[0]); + for (i = 0; i < initial_pagein; i++) vm_page_free(ma[i]); - vm_page_unlock(ma[i]); - } VM_OBJECT_WUNLOCK(object); return (EIO); } @@ -1035,9 +1029,7 @@ exec_unmap_first_page(struct image_params *imgp) m = sf_buf_page(imgp->firstpage); sf_buf_free(imgp->firstpage); imgp->firstpage = NULL; - vm_page_lock(m); vm_page_unwire(m, PQ_ACTIVE); - vm_page_unlock(m); } } Index: src/sys/kern/kern_sendfile.c =================================================================== --- src/sys/kern/kern_sendfile.c (revision 351673) +++ src/sys/kern/kern_sendfile.c (working copy) @@ -415,11 +415,8 @@ sendfile_swapin(vm_object_t obj, struct sf_io *sfi &sendfile_iodone, sfio); if (rv != VM_PAGER_OK) { for (j = i; j < i + count; j++) { - if (pa[j] != bogus_page) { - vm_page_lock(pa[j]); + if (pa[j] != bogus_page) vm_page_unwire(pa[j], PQ_INACTIVE); - vm_page_unlock(pa[j]); - } } VM_OBJECT_WUNLOCK(obj); return (EIO); Index: src/sys/kern/sys_process.c =================================================================== --- src/sys/kern/sys_process.c (revision 351673) +++ src/sys/kern/sys_process.c (working copy) @@ -312,10 +312,7 @@ proc_rwmem(struct proc *p, struct uio *uio) /* * Release the page. */ - vm_page_lock(m); - if (vm_page_unwire(m, PQ_ACTIVE) && m->object == NULL) - vm_page_free(m); - vm_page_unlock(m); + vm_page_unwire(m, PQ_ACTIVE); } while (error == 0 && uio->uio_resid > 0); Index: src/sys/kern/uipc_mbuf.c =================================================================== --- src/sys/kern/uipc_mbuf.c (revision 351673) +++ src/sys/kern/uipc_mbuf.c (working copy) @@ -1621,10 +1621,6 @@ mb_free_mext_pgs(struct mbuf *m) ext_pgs = m->m_ext.ext_pgs; for (int i = 0; i < ext_pgs->npgs; i++) { pg = PHYS_TO_VM_PAGE(ext_pgs->pa[i]); - /* - * Note: page is not locked, as it has no - * object and is not on any queues. - */ vm_page_unwire_noq(pg); vm_page_free(pg); } Index: src/sys/kern/uipc_shm.c =================================================================== --- src/sys/kern/uipc_shm.c (revision 351673) +++ src/sys/kern/uipc_shm.c (working copy) @@ -198,10 +198,8 @@ uiomove_object_page(vm_object_t obj, size_t len, s printf( "uiomove_object: vm_obj %p idx %jd valid %x pager error %d\n", obj, idx, m->valid, rv); - vm_page_lock(m); vm_page_unwire_noq(m); vm_page_free(m); - vm_page_unlock(m); VM_OBJECT_WUNLOCK(obj); return (EIO); } @@ -217,9 +215,7 @@ uiomove_object_page(vm_object_t obj, size_t len, s vm_pager_page_unswapped(m); VM_OBJECT_WUNLOCK(obj); } - vm_page_lock(m); vm_page_unwire(m, PQ_ACTIVE); - vm_page_unlock(m); return (error); } @@ -474,7 +470,6 @@ retry: goto retry; rv = vm_pager_get_pages(object, &m, 1, NULL, NULL); - vm_page_lock(m); if (rv == VM_PAGER_OK) { /* * Since the page was not resident, @@ -485,11 +480,9 @@ retry: * as an access. */ vm_page_launder(m); - vm_page_unlock(m); vm_page_xunbusy(m); } else { vm_page_free(m); - vm_page_unlock(m); VM_OBJECT_WUNLOCK(object); return (EIO); } Index: src/sys/mips/mips/pmap.c =================================================================== --- src/sys/mips/mips/pmap.c (revision 351673) +++ src/sys/mips/mips/pmap.c (working copy) @@ -796,26 +796,22 @@ vm_page_t pmap_extract_and_hold(pmap_t pmap, vm_offset_t va, vm_prot_t prot) { pt_entry_t pte, *ptep; - vm_paddr_t pa, pte_pa; + vm_paddr_t pa; vm_page_t m; m = NULL; - pa = 0; PMAP_LOCK(pmap); -retry: ptep = pmap_pte(pmap, va); if (ptep != NULL) { pte = *ptep; if (pte_test(&pte, PTE_V) && (!pte_test(&pte, PTE_RO) || (prot & VM_PROT_WRITE) == 0)) { - pte_pa = TLBLO_PTE_TO_PA(pte); - if (vm_page_pa_tryrelock(pmap, pte_pa, &pa)) - goto retry; - m = PHYS_TO_VM_PAGE(pte_pa); - vm_page_wire(m); + pa = TLBLO_PTE_TO_PA(pte); + m = PHYS_TO_VM_PAGE(pa); + if (!vm_page_wire_mapped(m)) + m = NULL; } } - PA_UNLOCK_COND(pa); PMAP_UNLOCK(pmap); return (m); } Index: src/sys/net/bpf_zerocopy.c =================================================================== --- src/sys/net/bpf_zerocopy.c (revision 351673) +++ src/sys/net/bpf_zerocopy.c (working copy) @@ -115,10 +115,7 @@ static void zbuf_page_free(vm_page_t pp) { - vm_page_lock(pp); - if (vm_page_unwire(pp, PQ_INACTIVE) && pp->object == NULL) - vm_page_free(pp); - vm_page_unlock(pp); + vm_page_unwire(pp, PQ_INACTIVE); } /* Index: src/sys/powerpc/aim/mmu_oea.c =================================================================== --- src/sys/powerpc/aim/mmu_oea.c (revision 351673) +++ src/sys/powerpc/aim/mmu_oea.c (working copy) @@ -1264,22 +1264,17 @@ moea_extract_and_hold(mmu_t mmu, pmap_t pmap, vm_o { struct pvo_entry *pvo; vm_page_t m; - vm_paddr_t pa; m = NULL; - pa = 0; PMAP_LOCK(pmap); -retry: pvo = moea_pvo_find_va(pmap, va & ~ADDR_POFF, NULL); if (pvo != NULL && (pvo->pvo_pte.pte.pte_hi & PTE_VALID) && ((pvo->pvo_pte.pte.pte_lo & PTE_PP) == PTE_RW || (prot & VM_PROT_WRITE) == 0)) { - if (vm_page_pa_tryrelock(pmap, pvo->pvo_pte.pte.pte_lo & PTE_RPGN, &pa)) - goto retry; m = PHYS_TO_VM_PAGE(pvo->pvo_pte.pte.pte_lo & PTE_RPGN); - vm_page_wire(m); + if (!vm_page_wire_mapped(m)) + m = NULL; } - PA_UNLOCK_COND(pa); PMAP_UNLOCK(pmap); return (m); } Index: src/sys/powerpc/aim/mmu_oea64.c =================================================================== --- src/sys/powerpc/aim/mmu_oea64.c (revision 351673) +++ src/sys/powerpc/aim/mmu_oea64.c (working copy) @@ -1584,21 +1584,15 @@ moea64_extract_and_hold(mmu_t mmu, pmap_t pmap, vm { struct pvo_entry *pvo; vm_page_t m; - vm_paddr_t pa; m = NULL; - pa = 0; PMAP_LOCK(pmap); -retry: pvo = moea64_pvo_find_va(pmap, va & ~ADDR_POFF); if (pvo != NULL && (pvo->pvo_pte.prot & prot) == prot) { - if (vm_page_pa_tryrelock(pmap, - pvo->pvo_pte.pa & LPTE_RPGN, &pa)) - goto retry; m = PHYS_TO_VM_PAGE(pvo->pvo_pte.pa & LPTE_RPGN); - vm_page_wire(m); + if (!vm_page_wire_mapped(m)) + m = NULL; } - PA_UNLOCK_COND(pa); PMAP_UNLOCK(pmap); return (m); } Index: src/sys/powerpc/booke/pmap.c =================================================================== --- src/sys/powerpc/booke/pmap.c (revision 351673) +++ src/sys/powerpc/booke/pmap.c (working copy) @@ -2790,12 +2790,9 @@ mmu_booke_extract_and_hold(mmu_t mmu, pmap_t pmap, pte_t *pte; vm_page_t m; uint32_t pte_wbit; - vm_paddr_t pa; - + m = NULL; - pa = 0; PMAP_LOCK(pmap); -retry: pte = pte_find(mmu, pmap, va); if ((pte != NULL) && PTE_ISVALID(pte)) { if (pmap == kernel_pmap) @@ -2803,15 +2800,12 @@ mmu_booke_extract_and_hold(mmu_t mmu, pmap_t pmap, else pte_wbit = PTE_UW; - if ((*pte & pte_wbit) || ((prot & VM_PROT_WRITE) == 0)) { - if (vm_page_pa_tryrelock(pmap, PTE_PA(pte), &pa)) - goto retry; + if ((*pte & pte_wbit) != 0 || (prot & VM_PROT_WRITE) == 0) { m = PHYS_TO_VM_PAGE(PTE_PA(pte)); - vm_page_wire(m); + if (!vm_page_wire_mapped(m)) + m = NULL; } } - - PA_UNLOCK_COND(pa); PMAP_UNLOCK(pmap); return (m); } Index: src/sys/riscv/riscv/pmap.c =================================================================== --- src/sys/riscv/riscv/pmap.c (revision 351673) +++ src/sys/riscv/riscv/pmap.c (working copy) @@ -870,24 +870,19 @@ pmap_extract_and_hold(pmap_t pmap, vm_offset_t va, { pt_entry_t *l3p, l3; vm_paddr_t phys; - vm_paddr_t pa; vm_page_t m; - pa = 0; m = NULL; PMAP_LOCK(pmap); -retry: l3p = pmap_l3(pmap, va); if (l3p != NULL && (l3 = pmap_load(l3p)) != 0) { if ((l3 & PTE_W) != 0 || (prot & VM_PROT_WRITE) == 0) { phys = PTE_TO_PHYS(l3); - if (vm_page_pa_tryrelock(pmap, phys, &pa)) - goto retry; m = PHYS_TO_VM_PAGE(phys); - vm_page_wire(m); + if (!vm_page_wire_mapped(m)) + m = NULL; } } - PA_UNLOCK_COND(pa); PMAP_UNLOCK(pmap); return (m); } Index: src/sys/sparc64/sparc64/pmap.c =================================================================== --- src/sys/sparc64/sparc64/pmap.c (revision 351673) +++ src/sys/sparc64/sparc64/pmap.c (working copy) @@ -846,19 +846,15 @@ pmap_extract_and_hold(pmap_t pm, vm_offset_t va, v { struct tte *tp; vm_page_t m; - vm_paddr_t pa; m = NULL; - pa = 0; PMAP_LOCK(pm); -retry: if (pm == kernel_pmap) { if (va >= VM_MIN_DIRECT_ADDRESS) { tp = NULL; m = PHYS_TO_VM_PAGE(TLB_DIRECT_TO_PHYS(va)); - (void)vm_page_pa_tryrelock(pm, TLB_DIRECT_TO_PHYS(va), - &pa); - vm_page_wire(m); + if (!vm_page_wire_mapped(m)) + m = NULL; } else { tp = tsb_kvtotte(va); if ((tp->tte_data & TD_V) == 0) @@ -868,12 +864,10 @@ pmap_extract_and_hold(pmap_t pm, vm_offset_t va, v tp = tsb_tte_lookup(pm, va); if (tp != NULL && ((tp->tte_data & TD_SW) || (prot & VM_PROT_WRITE) == 0)) { - if (vm_page_pa_tryrelock(pm, TTE_GET_PA(tp), &pa)) - goto retry; m = PHYS_TO_VM_PAGE(TTE_GET_PA(tp)); - vm_page_wire(m); + if (!vm_page_wire_mapped(m)) + m = NULL; } - PA_UNLOCK_COND(pa); PMAP_UNLOCK(pm); return (m); } Index: src/sys/vm/device_pager.c =================================================================== --- src/sys/vm/device_pager.c (revision 351673) +++ src/sys/vm/device_pager.c (working copy) @@ -235,9 +235,7 @@ cdev_pager_free_page(vm_object_t object, vm_page_t if (object->type == OBJT_MGTDEVICE) { KASSERT((m->oflags & VPO_UNMANAGED) == 0, ("unmanaged %p", m)); pmap_remove_all(m); - vm_page_lock(m); (void)vm_page_remove(m); - vm_page_unlock(m); } else if (object->type == OBJT_DEVICE) dev_pager_free_page(object, m); } Index: src/sys/vm/vm_fault.c =================================================================== --- src/sys/vm/vm_fault.c (revision 351673) +++ src/sys/vm/vm_fault.c (working copy) @@ -186,9 +186,7 @@ unlock_and_deallocate(struct faultstate *fs) VM_OBJECT_WUNLOCK(fs->object); if (fs->object != fs->first_object) { VM_OBJECT_WLOCK(fs->first_object); - vm_page_lock(fs->first_m); vm_page_free(fs->first_m); - vm_page_unlock(fs->first_m); vm_object_pip_wakeup(fs->first_object); VM_OBJECT_WUNLOCK(fs->first_object); fs->first_m = NULL; @@ -263,18 +261,6 @@ vm_fault_dirty(vm_map_entry_t entry, vm_page_t m, vm_pager_page_unswapped(m); } -static void -vm_fault_fill_hold(vm_page_t *m_hold, vm_page_t m) -{ - - if (m_hold != NULL) { - *m_hold = m; - vm_page_lock(m); - vm_page_wire(m); - vm_page_unlock(m); - } -} - /* * Unlocks fs.first_object and fs.map on success. */ @@ -335,7 +321,10 @@ vm_fault_soft_fast(struct faultstate *fs, vm_offse PMAP_ENTER_NOSLEEP | (wired ? PMAP_ENTER_WIRED : 0), psind); if (rv != KERN_SUCCESS) return (rv); - vm_fault_fill_hold(m_hold, m); + if (m_hold != NULL) { + *m_hold = m; + vm_page_wire(m); + } vm_fault_dirty(fs->entry, m, prot, fault_type, fault_flags, false); if (psind == 0 && !wired) vm_fault_prefault(fs, vaddr, PFBAK, PFFOR, true); @@ -511,11 +500,12 @@ vm_fault_populate(struct faultstate *fs, vm_prot_t VM_OBJECT_WLOCK(fs->first_object); m_mtx = NULL; for (i = 0; i < npages; i++) { - vm_page_change_lock(&m[i], &m_mtx); - if ((fault_flags & VM_FAULT_WIRE) != 0) + if ((fault_flags & VM_FAULT_WIRE) != 0) { vm_page_wire(&m[i]); - else + } else { + vm_page_change_lock(&m[i], &m_mtx); vm_page_activate(&m[i]); + } if (m_hold != NULL && m[i].pindex == fs->first_pindex) { *m_hold = &m[i]; vm_page_wire(&m[i]); @@ -576,7 +566,6 @@ vm_fault_hold(vm_map_t map, vm_offset_t vaddr, vm_ struct faultstate fs; struct vnode *vp; struct domainset *dset; - struct mtx *mtx; vm_object_t next_object, retry_object; vm_offset_t e_end, e_start; vm_pindex_t retry_pindex; @@ -745,9 +734,7 @@ RetryFault_oom: VM_OBJECT_WLOCK(fs.first_object); VM_OBJECT_WLOCK(fs.object); } - vm_page_lock(fs.first_m); vm_page_free(fs.first_m); - vm_page_unlock(fs.first_m); vm_object_pip_wakeup(fs.first_object); VM_OBJECT_WUNLOCK(fs.first_object); fs.first_m = NULL; @@ -1030,12 +1017,10 @@ readrest: * an error. */ if (rv == VM_PAGER_ERROR || rv == VM_PAGER_BAD) { - vm_page_lock(fs.m); if (!vm_page_wired(fs.m)) vm_page_free(fs.m); else - vm_page_xunbusy_maybelocked(fs.m); - vm_page_unlock(fs.m); + vm_page_xunbusy(fs.m); fs.m = NULL; unlock_and_deallocate(&fs); return (rv == VM_PAGER_ERROR ? KERN_FAILURE : @@ -1053,12 +1038,10 @@ readrest: * that we are. */ if (fs.object != fs.first_object) { - vm_page_lock(fs.m); if (!vm_page_wired(fs.m)) vm_page_free(fs.m); else - vm_page_xunbusy_maybelocked(fs.m); - vm_page_unlock(fs.m); + vm_page_xunbusy(fs.m); fs.m = NULL; } } @@ -1169,23 +1152,11 @@ readrest: * We don't chase down the shadow chain */ fs.object == fs.first_object->backing_object) { - /* - * Keep the page wired to ensure that it is not - * freed by another thread, such as the page - * daemon, while it is disassociated from an - * object. - */ - mtx = NULL; - vm_page_change_lock(fs.m, &mtx); - vm_page_wire(fs.m); + (void)vm_page_remove(fs.m); - vm_page_change_lock(fs.first_m, &mtx); vm_page_replace_checked(fs.m, fs.first_object, fs.first_pindex, fs.first_m); vm_page_free(fs.first_m); - vm_page_change_lock(fs.m, &mtx); - vm_page_unwire(fs.m, PQ_ACTIVE); - mtx_unlock(mtx); vm_page_dirty(fs.m); #if VM_NRESERVLEVEL > 0 /* @@ -1211,13 +1182,8 @@ readrest: fs.first_m->valid = VM_PAGE_BITS_ALL; if (wired && (fault_flags & VM_FAULT_WIRE) == 0) { - vm_page_lock(fs.first_m); vm_page_wire(fs.first_m); - vm_page_unlock(fs.first_m); - - vm_page_lock(fs.m); vm_page_unwire(fs.m, PQ_INACTIVE); - vm_page_unlock(fs.m); } /* * We no longer need the old page or object. @@ -1350,21 +1316,22 @@ readrest: faultcount > 0 ? behind : PFBAK, faultcount > 0 ? ahead : PFFOR, false); VM_OBJECT_WLOCK(fs.object); - vm_page_lock(fs.m); /* * If the page is not wired down, then put it where the pageout daemon * can find it. */ - if ((fault_flags & VM_FAULT_WIRE) != 0) + if ((fault_flags & VM_FAULT_WIRE) != 0) { vm_page_wire(fs.m); - else + } else { + vm_page_lock(fs.m); vm_page_activate(fs.m); + vm_page_unlock(fs.m); + } if (m_hold != NULL) { *m_hold = fs.m; vm_page_wire(fs.m); } - vm_page_unlock(fs.m); vm_page_xunbusy(fs.m); /* @@ -1633,13 +1600,8 @@ vm_fault_quick_hold_pages(vm_map_t map, vm_offset_ return (count); error: for (mp = ma; mp < ma + count; mp++) - if (*mp != NULL) { - vm_page_lock(*mp); - if (vm_page_unwire(*mp, PQ_INACTIVE) && - (*mp)->object == NULL) - vm_page_free(*mp); - vm_page_unlock(*mp); - } + if (*mp != NULL) + vm_page_unwire(*mp, PQ_INACTIVE); return (-1); } @@ -1835,12 +1797,8 @@ again: if (upgrade) { if (src_m != dst_m) { - vm_page_lock(src_m); vm_page_unwire(src_m, PQ_INACTIVE); - vm_page_unlock(src_m); - vm_page_lock(dst_m); vm_page_wire(dst_m); - vm_page_unlock(dst_m); } else { KASSERT(vm_page_wired(dst_m), ("dst_m %p is not wired", dst_m)); Index: src/sys/vm/vm_glue.c =================================================================== --- src/sys/vm/vm_glue.c (revision 351673) +++ src/sys/vm/vm_glue.c (working copy) @@ -229,10 +229,8 @@ vm_imgact_hold_page(vm_object_t object, vm_ooffset vm_page_xbusy(m); rv = vm_pager_get_pages(object, &m, 1, NULL, NULL); if (rv != VM_PAGER_OK) { - vm_page_lock(m); vm_page_unwire_noq(m); vm_page_free(m); - vm_page_unlock(m); m = NULL; goto out; } @@ -270,9 +268,7 @@ vm_imgact_unmap_page(struct sf_buf *sf) m = sf_buf_page(sf); sf_buf_free(sf); sched_unpin(); - vm_page_lock(m); vm_page_unwire(m, PQ_ACTIVE); - vm_page_unlock(m); } void @@ -380,10 +376,8 @@ vm_thread_stack_dispose(vm_object_t ksobj, vm_offs m = vm_page_lookup(ksobj, i); if (m == NULL) panic("vm_thread_dispose: kstack already missing?"); - vm_page_lock(m); vm_page_unwire_noq(m); vm_page_free(m); - vm_page_unlock(m); } VM_OBJECT_WUNLOCK(ksobj); vm_object_deallocate(ksobj); Index: src/sys/vm/vm_object.c =================================================================== --- src/sys/vm/vm_object.c (revision 351673) +++ src/sys/vm/vm_object.c (working copy) @@ -694,12 +694,9 @@ static void vm_object_terminate_pages(vm_object_t object) { vm_page_t p, p_next; - struct mtx *mtx; VM_OBJECT_ASSERT_WLOCKED(object); - mtx = NULL; - /* * Free any remaining pageable pages. This also removes them from the * paging queues. However, don't free wired pages, just remove them @@ -708,20 +705,16 @@ vm_object_terminate_pages(vm_object_t object) */ TAILQ_FOREACH_SAFE(p, &object->memq, listq, p_next) { vm_page_assert_unbusied(p); - if ((object->flags & OBJ_UNMANAGED) == 0) - /* - * vm_page_free_prep() only needs the page - * lock for managed pages. - */ - vm_page_change_lock(p, &mtx); + KASSERT(p->object == object && + (p->ref_count & VPRC_OBJREF) != 0, + ("vm_object_terminate_pages: page %p is inconsistent", p)); + p->object = NULL; - if (vm_page_wired(p)) - continue; - VM_CNT_INC(v_pfree); - vm_page_free(p); + if (vm_page_drop(p, VPRC_OBJREF) == VPRC_OBJREF) { + VM_CNT_INC(v_pfree); + vm_page_free(p); + } } - if (mtx != NULL) - mtx_unlock(mtx); /* * If the object contained any pages, then reset it to an empty state. @@ -1178,13 +1171,9 @@ next_page: /* * If the page is not in a normal state, skip it. */ - if (tm->valid != VM_PAGE_BITS_ALL) + if (tm->valid != VM_PAGE_BITS_ALL || + vm_page_wired(tm)) goto next_pindex; - vm_page_lock(tm); - if (vm_page_wired(tm)) { - vm_page_unlock(tm); - goto next_pindex; - } KASSERT((tm->flags & PG_FICTITIOUS) == 0, ("vm_object_madvise: page %p is fictitious", tm)); KASSERT((tm->oflags & VPO_UNMANAGED) == 0, @@ -1192,6 +1181,7 @@ next_page: if (vm_page_busied(tm)) { if (object != tobject) VM_OBJECT_WUNLOCK(tobject); + vm_page_lock(tm); VM_OBJECT_WUNLOCK(object); if (advice == MADV_WILLNEED) { /* @@ -1204,6 +1194,7 @@ next_page: vm_page_busy_sleep(tm, "madvpo", false); goto relookup; } + vm_page_lock(tm); vm_page_advise(tm, advice); vm_page_unlock(tm); vm_object_madvise_freespace(tobject, advice, tm->pindex, 1); @@ -1557,16 +1548,10 @@ vm_object_collapse_scan(vm_object_t object, int op swap_pager_freespace(backing_object, p->pindex, 1); - /* - * Page is out of the parent object's range, we can - * simply destroy it. - */ - vm_page_lock(p); KASSERT(!pmap_page_is_mapped(p), ("freeing mapped page %p", p)); if (vm_page_remove(p)) vm_page_free(p); - vm_page_unlock(p); continue; } @@ -1603,12 +1588,10 @@ vm_object_collapse_scan(vm_object_t object, int op if (backing_object->type == OBJT_SWAP) swap_pager_freespace(backing_object, p->pindex, 1); - vm_page_lock(p); KASSERT(!pmap_page_is_mapped(p), ("freeing mapped page %p", p)); if (vm_page_remove(p)) vm_page_free(p); - vm_page_unlock(p); continue; } @@ -1909,7 +1892,14 @@ again: VM_OBJECT_WLOCK(object); goto again; } + if (vm_page_busied(p)) { + VM_OBJECT_WUNLOCK(object); + vm_page_busy_sleep(p, "vmopar", false); + VM_OBJECT_WLOCK(object); + goto again; + } if (vm_page_wired(p)) { +wired: if ((options & OBJPR_NOTMAPPED) == 0 && object->ref_count != 0) pmap_remove_all(p); @@ -1919,23 +1909,19 @@ again: } continue; } - if (vm_page_busied(p)) { - VM_OBJECT_WUNLOCK(object); - vm_page_busy_sleep(p, "vmopar", false); - VM_OBJECT_WLOCK(object); - goto again; - } KASSERT((p->flags & PG_FICTITIOUS) == 0, ("vm_object_page_remove: page %p is fictitious", p)); if ((options & OBJPR_CLEANONLY) != 0 && p->valid != 0) { if ((options & OBJPR_NOTMAPPED) == 0 && - object->ref_count != 0) - pmap_remove_write(p); + object->ref_count != 0 && + !vm_page_try_remove_write(p)) + goto wired; if (p->dirty != 0) continue; } - if ((options & OBJPR_NOTMAPPED) == 0 && object->ref_count != 0) - pmap_remove_all(p); + if ((options & OBJPR_NOTMAPPED) == 0 && + object->ref_count != 0 && !vm_page_try_remove_all(p)) + goto wired; vm_page_free(p); } if (mtx != NULL) @@ -2225,8 +2211,8 @@ again: tm = m; m = TAILQ_NEXT(m, listq); } - vm_page_lock(tm); if (vm_page_xbusied(tm)) { + vm_page_lock(tm); for (tobject = object; locked_depth >= 1; locked_depth--) { t1object = tobject->backing_object; @@ -2237,7 +2223,6 @@ again: goto again; } vm_page_unwire(tm, queue); - vm_page_unlock(tm); next_page: pindex++; } Index: src/sys/vm/vm_page.c =================================================================== --- src/sys/vm/vm_page.c (revision 351673) +++ src/sys/vm/vm_page.c (working copy) @@ -168,6 +168,7 @@ static int vm_page_insert_after(vm_page_t m, vm_ob vm_pindex_t pindex, vm_page_t mpred); static void vm_page_insert_radixdone(vm_page_t m, vm_object_t object, vm_page_t mpred); +static void vm_page_mvqueue(vm_page_t m, uint8_t queue); static int vm_page_reclaim_run(int req_class, int domain, u_long npages, vm_page_t m_run, vm_paddr_t high); static int vm_domain_alloc_fail(struct vm_domain *vmd, vm_object_t object, @@ -513,7 +514,7 @@ vm_page_init_page(vm_page_t m, vm_paddr_t pa, int { m->object = NULL; - m->wire_count = 0; + m->ref_count = 0; m->busy_lock = VPB_UNBUSIED; m->flags = m->aflags = 0; m->phys_addr = pa; @@ -1107,17 +1108,11 @@ vm_page_change_lock(vm_page_t m, struct mtx **mtx) void vm_page_unhold_pages(vm_page_t *ma, int count) { - struct mtx *mtx; - mtx = NULL; for (; count != 0; count--) { - vm_page_change_lock(*ma, &mtx); - if (vm_page_unwire(*ma, PQ_ACTIVE) && (*ma)->object == NULL) - vm_page_free(*ma); + vm_page_unwire(*ma, PQ_ACTIVE); ma++; } - if (mtx != NULL) - mtx_unlock(mtx); } vm_page_t @@ -1180,7 +1175,8 @@ vm_page_initfake(vm_page_t m, vm_paddr_t paddr, vm /* Fictitious pages don't use "order" or "pool". */ m->oflags = VPO_UNMANAGED; m->busy_lock = VPB_SINGLE_EXCLUSIVER; - m->wire_count = 1; + /* Fictitious pages are unevictable. */ + m->ref_count = 1; pmap_page_init(m); memattr: pmap_page_set_memattr(m, memattr); @@ -1375,10 +1371,11 @@ vm_page_insert_after(vm_page_t m, vm_object_t obje ("vm_page_insert_after: msucc doesn't succeed pindex")); /* - * Record the object/offset pair in this page + * Record the object/offset pair in this page. */ m->object = object; m->pindex = pindex; + m->ref_count |= VPRC_OBJREF; /* * Now link into the object's ordered list of backed pages. @@ -1386,6 +1383,7 @@ vm_page_insert_after(vm_page_t m, vm_object_t obje if (vm_radix_insert(&object->rtree, m)) { m->object = NULL; m->pindex = 0; + m->ref_count &= ~VPRC_OBJREF; return (1); } vm_page_insert_radixdone(m, object, mpred); @@ -1410,11 +1408,13 @@ vm_page_insert_radixdone(vm_page_t m, vm_object_t VM_OBJECT_ASSERT_WLOCKED(object); KASSERT(object != NULL && m->object == object, ("vm_page_insert_radixdone: page %p has inconsistent object", m)); + KASSERT((m->ref_count & VPRC_OBJREF) != 0, + ("vm_page_insert_radixdone: page %p is missing object ref", m)); if (mpred != NULL) { KASSERT(mpred->object == object, - ("vm_page_insert_after: object doesn't contain mpred")); + ("vm_page_insert_radixdone: object doesn't contain mpred")); KASSERT(mpred->pindex < m->pindex, - ("vm_page_insert_after: mpred doesn't precede pindex")); + ("vm_page_insert_radixdone: mpred doesn't precede pindex")); } if (mpred != NULL) @@ -1442,25 +1442,19 @@ vm_page_insert_radixdone(vm_page_t m, vm_object_t } /* - * vm_page_remove: - * - * Removes the specified page from its containing object, but does not - * invalidate any backing storage. Return true if the page may be safely - * freed and false otherwise. - * - * The object must be locked. The page must be locked if it is managed. + * Do the work to remove a page from its object. The caller is responsible for + * updating the page's fields to reflect this removal. */ -bool -vm_page_remove(vm_page_t m) +static void +vm_page_object_remove(vm_page_t m) { vm_object_t object; vm_page_t mrem; object = m->object; - - if ((m->oflags & VPO_UNMANAGED) == 0) - vm_page_assert_locked(m); VM_OBJECT_ASSERT_WLOCKED(object); + KASSERT((m->ref_count & VPRC_OBJREF) != 0, + ("page %p is missing its object ref", m)); if (vm_page_xbusied(m)) vm_page_xunbusy_maybelocked(m); mrem = vm_radix_remove(&object->rtree, m->pindex); @@ -1481,9 +1475,24 @@ vm_page_insert_radixdone(vm_page_t m, vm_object_t */ if (object->resident_page_count == 0 && object->type == OBJT_VNODE) vdrop(object->handle); +} +/* + * vm_page_remove: + * + * Removes the specified page from its containing object, but does not + * invalidate any backing storage. Returns true if the object's reference + * was the last reference to the page, and false otherwise. + * + * The object must be locked. + */ +bool +vm_page_remove(vm_page_t m) +{ + + vm_page_object_remove(m); m->object = NULL; - return (!vm_page_wired(m)); + return (vm_page_drop(m, VPRC_OBJREF) == VPRC_OBJREF); } /* @@ -1564,8 +1573,6 @@ vm_page_prev(vm_page_t m) /* * Uses the page mnew as a replacement for an existing page at index * pindex which must be already present in the object. - * - * The existing page must not be on a paging queue. */ vm_page_t vm_page_replace(vm_page_t mnew, vm_object_t object, vm_pindex_t pindex) @@ -1573,10 +1580,8 @@ vm_page_replace(vm_page_t mnew, vm_object_t object vm_page_t mold; VM_OBJECT_ASSERT_WLOCKED(object); - KASSERT(mnew->object == NULL, + KASSERT(mnew->object == NULL && (mnew->ref_count & VPRC_OBJREF) == 0, ("vm_page_replace: page %p already in object", mnew)); - KASSERT(mnew->queue == PQ_NONE || vm_page_wired(mnew), - ("vm_page_replace: new page %p is on a paging queue", mnew)); /* * This function mostly follows vm_page_insert() and @@ -1586,6 +1591,7 @@ vm_page_replace(vm_page_t mnew, vm_object_t object mnew->object = object; mnew->pindex = pindex; + atomic_set_int(&mnew->ref_count, VPRC_OBJREF); mold = vm_radix_replace(&object->rtree, mnew); KASSERT(mold->queue == PQ_NONE, ("vm_page_replace: old page %p is on a paging queue", mold)); @@ -1595,6 +1601,7 @@ vm_page_replace(vm_page_t mnew, vm_object_t object TAILQ_REMOVE(&object->memq, mold, listq); mold->object = NULL; + atomic_clear_int(&mold->ref_count, VPRC_OBJREF); vm_page_xunbusy_maybelocked(mold); /* @@ -1632,6 +1639,7 @@ vm_page_rename(vm_page_t m, vm_object_t new_object VM_OBJECT_ASSERT_WLOCKED(new_object); + KASSERT(m->ref_count != 0, ("vm_page_rename: page %p has no refs", m)); mpred = vm_radix_lookup_le(&new_object->rtree, new_pindex); KASSERT(mpred == NULL || mpred->pindex != new_pindex, ("vm_page_rename: pindex already renamed")); @@ -1653,13 +1661,12 @@ vm_page_rename(vm_page_t m, vm_object_t new_object * the listq iterator is tainted. */ m->pindex = opidx; - vm_page_lock(m); - (void)vm_page_remove(m); + vm_page_object_remove(m); /* Return back to the new pindex to complete vm_page_insert(). */ m->pindex = new_pindex; m->object = new_object; - vm_page_unlock(m); + vm_page_insert_radixdone(m, new_object, mpred); vm_page_dirty(m); return (0); @@ -1876,7 +1883,7 @@ found: * page is inserted into the object. */ vm_wire_add(1); - m->wire_count = 1; + m->ref_count = 1; } m->act_count = 0; @@ -1884,7 +1891,7 @@ found: if (vm_page_insert_after(m, object, pindex, mpred)) { if (req & VM_ALLOC_WIRED) { vm_wire_sub(1); - m->wire_count = 0; + m->ref_count = 0; } KASSERT(m->object == NULL, ("page %p has object", m)); m->oflags = VPO_UNMANAGED; @@ -2076,7 +2083,7 @@ found: m->flags = (m->flags | PG_NODUMP) & flags; m->busy_lock = busy_lock; if ((req & VM_ALLOC_WIRED) != 0) - m->wire_count = 1; + m->ref_count = 1; m->act_count = 0; m->oflags = oflags; if (object != NULL) { @@ -2089,7 +2096,7 @@ found: for (m = m_ret; m < &m_ret[npages]; m++) { if (m <= mpred && (req & VM_ALLOC_WIRED) != 0) - m->wire_count = 0; + m->ref_count = 0; m->oflags = VPO_UNMANAGED; m->busy_lock = VPB_UNBUSIED; /* Don't change PG_ZERO. */ @@ -2123,7 +2130,7 @@ vm_page_alloc_check(vm_page_t m) KASSERT(m->queue == PQ_NONE && (m->aflags & PGA_QUEUE_STATE_MASK) == 0, ("page %p has unexpected queue %d, flags %#x", m, m->queue, (m->aflags & PGA_QUEUE_STATE_MASK))); - KASSERT(!vm_page_wired(m), ("page %p is wired", m)); + KASSERT(m->ref_count == 0, ("page %p has references", m)); KASSERT(!vm_page_busied(m), ("page %p is busy", m)); KASSERT(m->dirty == 0, ("page %p is dirty", m)); KASSERT(pmap_page_get_memattr(m) == VM_MEMATTR_DEFAULT, @@ -2207,7 +2214,7 @@ again: * not belong to an object. */ vm_wire_add(1); - m->wire_count = 1; + m->ref_count = 1; } /* Unmanaged pages don't use "act_count". */ m->oflags = VPO_UNMANAGED; @@ -2300,8 +2307,8 @@ vm_page_scan_contig(u_long npages, vm_page_t m_sta for (m = m_start; m < m_end && run_len < npages; m += m_inc) { KASSERT((m->flags & PG_MARKER) == 0, ("page %p is PG_MARKER", m)); - KASSERT((m->flags & PG_FICTITIOUS) == 0 || m->wire_count == 1, - ("fictitious page %p has invalid wire count", m)); + KASSERT((m->flags & PG_FICTITIOUS) == 0 || m->ref_count >= 1, + ("fictitious page %p has invalid ref count", m)); /* * If the current page would be the start of a run, check its @@ -2358,9 +2365,6 @@ retry: */ VM_OBJECT_RUNLOCK(object); goto retry; - } else if (vm_page_wired(m)) { - run_ext = 0; - goto unlock; } } /* Don't care: PG_NODUMP, PG_ZERO. */ @@ -2378,7 +2382,8 @@ retry: vm_reserv_size(level)) - pa); #endif } else if (object->memattr == VM_MEMATTR_DEFAULT && - vm_page_queue(m) != PQ_NONE && !vm_page_busied(m)) { + vm_page_queue(m) != PQ_NONE && !vm_page_busied(m) && + !vm_page_wired(m)) { /* * The page is allocated but eligible for * relocation. Extend the current run by one @@ -2394,7 +2399,6 @@ retry: run_ext = 1; } else run_ext = 0; -unlock: VM_OBJECT_RUNLOCK(object); #if VM_NRESERVLEVEL > 0 } else if (level >= 0) { @@ -2498,6 +2502,9 @@ vm_page_reclaim_run(int req_class, int domain, u_l */ vm_page_change_lock(m, &m_mtx); retry: + /* + * Racily check for wirings. Races are handled below. + */ if (vm_page_wired(m)) error = EBUSY; else if ((object = m->object) != NULL) { @@ -2515,9 +2522,6 @@ retry: */ VM_OBJECT_WUNLOCK(object); goto retry; - } else if (vm_page_wired(m)) { - error = EBUSY; - goto unlock; } } /* Don't care: PG_NODUMP, PG_ZERO. */ @@ -2528,7 +2532,7 @@ retry: else if (object->memattr != VM_MEMATTR_DEFAULT) error = EINVAL; else if (vm_page_queue(m) != PQ_NONE && - !vm_page_busied(m)) { + !vm_page_busied(m) && !vm_page_wired(m)) { KASSERT(pmap_page_get_memattr(m) == VM_MEMATTR_DEFAULT, ("page %p has an unexpected memattr", m)); @@ -2577,8 +2581,6 @@ retry: error = ENOMEM; goto unlock; } - KASSERT(!vm_page_wired(m_new), - ("page %p is wired", m_new)); /* * Replace "m" with the new page. For @@ -2586,8 +2588,11 @@ retry: * and dequeued. Finally, change "m" * as if vm_page_free() was called. */ - if (object->ref_count != 0) - pmap_remove_all(m); + if (object->ref_count != 0 && + !vm_page_try_remove_all(m)) { + error = EBUSY; + goto unlock; + } m_new->aflags = m->aflags & ~PGA_QUEUE_STATE_MASK; KASSERT(m_new->oflags == VPO_UNMANAGED, @@ -3134,6 +3139,13 @@ vm_pqbatch_process(struct vm_pagequeue *pq, struct vm_batchqueue_init(bq); } +/* + * vm_page_pqbatch_submit: [ internal use only ] + * + * Enqueue a page in the specified page queue's batched work queue. + * The caller must have encoded the requested operation in the page + * structure's aflags field. + */ void vm_page_pqbatch_submit(vm_page_t m, uint8_t queue) { @@ -3143,8 +3155,7 @@ vm_page_pqbatch_submit(vm_page_t m, uint8_t queue) KASSERT((m->oflags & VPO_UNMANAGED) == 0, ("page %p is unmanaged", m)); - KASSERT(mtx_owned(vm_page_lockptr(m)) || - (m->object == NULL && (m->aflags & PGA_DEQUEUE) != 0), + KASSERT(mtx_owned(vm_page_lockptr(m)) || m->object == NULL, ("missing synchronization for page %p", m)); KASSERT(queue < PQ_COUNT, ("invalid queue %d", queue)); @@ -3255,17 +3266,26 @@ vm_page_dequeue_deferred(vm_page_t m) if ((queue = vm_page_queue(m)) == PQ_NONE) return; - vm_page_aflag_set(m, PGA_DEQUEUE); - vm_page_pqbatch_submit(m, queue); + + /* + * Set PGA_DEQUEUE if it is not already set to handle a concurrent call + * to vm_page_dequeue_deferred_free(). In particular, avoid modifying + * the page's queue state once vm_page_dequeue_deferred_free() has been + * called. In the event of a race, two batch queue entries for the page + * will be created, but the second will have no effect. + */ + if (vm_page_pqstate_cmpset(m, queue, queue, PGA_DEQUEUE, PGA_DEQUEUE)) + vm_page_pqbatch_submit(m, queue); } /* * A variant of vm_page_dequeue_deferred() that does not assert the page - * lock and is only to be called from vm_page_free_prep(). It is just an - * open-coded implementation of vm_page_dequeue_deferred(). Because the - * page is being freed, we can assume that nothing else is scheduling queue - * operations on this page, so we get for free the mutual exclusion that - * is otherwise provided by the page lock. + * lock and is only to be called from vm_page_free_prep(). Because the + * page is being freed, we can assume that nothing other than the page + * daemon is scheduling queue operations on this page, so we get for + * free the mutual exclusion that is otherwise provided by the page lock. + * To handle races, the page daemon must take care to atomically check + * for PGA_DEQUEUE when updating queue state. */ static void vm_page_dequeue_deferred_free(vm_page_t m) @@ -3272,7 +3292,7 @@ vm_page_dequeue_deferred_free(vm_page_t m) { uint8_t queue; - KASSERT(m->object == NULL, ("page %p has an object reference", m)); + KASSERT(m->ref_count == 0, ("page %p has references", m)); if ((m->aflags & PGA_DEQUEUE) != 0) return; @@ -3379,6 +3399,42 @@ vm_page_requeue(vm_page_t m) } /* + * vm_page_swapqueue: [ internal use only ] + * + * Move the page from one queue to another, or to the tail of its + * current queue, in the face of a possible concurrent call to + * vm_page_dequeue_deferred_free(). + */ +void +vm_page_swapqueue(vm_page_t m, uint8_t oldq, uint8_t newq) +{ + struct vm_pagequeue *pq; + + KASSERT(oldq < PQ_COUNT && newq < PQ_COUNT && oldq != newq, + ("vm_page_swapqueue: invalid queues (%d, %d)", oldq, newq)); + KASSERT((m->oflags & VPO_UNMANAGED) == 0, + ("vm_page_swapqueue: page %p is unmanaged", m)); + vm_page_assert_locked(m); + + /* + * Atomically update the queue field and set PGA_REQUEUE while + * ensuring that PGA_DEQUEUE has not been set. + */ + pq = &vm_pagequeue_domain(m)->vmd_pagequeues[oldq]; + vm_pagequeue_lock(pq); + if (!vm_page_pqstate_cmpset(m, oldq, newq, PGA_DEQUEUE, PGA_REQUEUE)) { + vm_pagequeue_unlock(pq); + return; + } + if ((m->aflags & PGA_ENQUEUED) != 0) { + vm_pagequeue_remove(pq, m); + vm_page_aflag_clear(m, PGA_ENQUEUED); + } + vm_pagequeue_unlock(pq); + vm_page_pqbatch_submit(m, newq); +} + +/* * vm_page_free_prep: * * Prepares the given page to be put on the free list, @@ -3392,6 +3448,12 @@ bool vm_page_free_prep(vm_page_t m) { + /* + * Synchronize with threads that have dropped a reference to this + * page. + */ + atomic_thread_fence_acq(); + #if defined(DIAGNOSTIC) && defined(PHYS_TO_DMAP) if (PMAP_HAS_DMAP && (m->flags & PG_ZERO) != 0) { uint64_t *p; @@ -3402,11 +3464,10 @@ vm_page_free_prep(vm_page_t m) m, i, (uintmax_t)*p)); } #endif - if ((m->oflags & VPO_UNMANAGED) == 0) { - vm_page_lock_assert(m, MA_OWNED); + if ((m->oflags & VPO_UNMANAGED) == 0) KASSERT(!pmap_page_is_mapped(m), ("vm_page_free_prep: freeing mapped page %p", m)); - } else + else KASSERT(m->queue == PQ_NONE, ("vm_page_free_prep: unmanaged page %p is queued", m)); VM_CNT_INC(v_tfree); @@ -3414,16 +3475,28 @@ vm_page_free_prep(vm_page_t m) if (vm_page_sbusied(m)) panic("vm_page_free_prep: freeing busy page %p", m); - if (m->object != NULL) - (void)vm_page_remove(m); + if (m->object != NULL) { + vm_page_object_remove(m); + /* + * The object reference can be released without an atomic + * operation. + */ + KASSERT((m->flags & PG_FICTITIOUS) != 0 || + m->ref_count == VPRC_OBJREF, + ("vm_page_free_prep: page %p has unexpected ref_count %u", + m, m->ref_count)); + m->object = NULL; + m->ref_count = 0; + } + /* * If fictitious remove object association and * return. */ if ((m->flags & PG_FICTITIOUS) != 0) { - KASSERT(m->wire_count == 1, - ("fictitious page %p is not wired", m)); + KASSERT(m->ref_count == 1, + ("fictitious page %p is referenced", m)); KASSERT(m->queue == PQ_NONE, ("fictitious page %p is queued", m)); return (false); @@ -3440,8 +3513,8 @@ vm_page_free_prep(vm_page_t m) m->valid = 0; vm_page_undirty(m); - if (vm_page_wired(m) != 0) - panic("vm_page_free_prep: freeing wired page %p", m); + if (m->ref_count != 0) + panic("vm_page_free_prep: page %p has references", m); /* * Restore the default memory attribute to the page. @@ -3523,161 +3596,190 @@ vm_page_free_pages_toq(struct spglist *free, bool } /* - * vm_page_wire: - * - * Mark this page as wired down. If the page is fictitious, then - * its wire count must remain one. - * - * The page must be locked. + * Mark this page as wired down, preventing reclamation by the page daemon + * or when the containing object is destroyed. */ void vm_page_wire(vm_page_t m) { + u_int old; - vm_page_assert_locked(m); - if ((m->flags & PG_FICTITIOUS) != 0) { - KASSERT(m->wire_count == 1, - ("vm_page_wire: fictitious page %p's wire count isn't one", - m)); - return; - } - if (!vm_page_wired(m)) { - KASSERT((m->oflags & VPO_UNMANAGED) == 0 || - m->queue == PQ_NONE, - ("vm_page_wire: unmanaged page %p is queued", m)); + KASSERT(m->object != NULL, + ("vm_page_wire: page %p does not belong to an object", m)); + if (!vm_page_busied(m)) + VM_OBJECT_ASSERT_LOCKED(m->object); + KASSERT((m->flags & PG_FICTITIOUS) == 0 || + VPRC_WIRE_COUNT(m->ref_count) >= 1, + ("vm_page_wire: fictitious page %p has zero wirings", m)); + + old = atomic_fetchadd_int(&m->ref_count, 1); + KASSERT(VPRC_WIRE_COUNT(old) != VPRC_WIRE_COUNT_MAX, + ("vm_page_wire: counter overflow for page %p", m)); + if (VPRC_WIRE_COUNT(old) == 0) vm_wire_add(1); - } - m->wire_count++; - KASSERT(m->wire_count != 0, ("vm_page_wire: wire_count overflow m=%p", m)); } /* - * vm_page_unwire: - * + * Attempt to wire a mapped page following a pmap lookup of that page. + * This may fail if a thread is concurrently tearing down mappings of the page. + */ +bool +vm_page_wire_mapped(vm_page_t m) +{ + u_int old; + + old = m->ref_count; + do { + KASSERT(old > 0, + ("vm_page_wire_mapped: wiring unreferenced page %p", m)); + if ((old & VPRC_BLOCKED) != 0) + return (false); + } while (!atomic_fcmpset_int(&m->ref_count, &old, old + 1)); + + if (VPRC_WIRE_COUNT(old) == 0) + vm_wire_add(1); + return (true); +} + +/* * Release one wiring of the specified page, potentially allowing it to be - * paged out. Returns TRUE if the number of wirings transitions to zero and - * FALSE otherwise. + * paged out. * * Only managed pages belonging to an object can be paged out. If the number * of wirings transitions to zero and the page is eligible for page out, then - * the page is added to the specified paging queue (unless PQ_NONE is - * specified, in which case the page is dequeued if it belongs to a paging - * queue). + * the page is added to the specified paging queue. If the released wiring + * represented the last reference to the page, the page is freed. * - * If a page is fictitious, then its wire count must always be one. - * * A managed page must be locked. */ -bool +void vm_page_unwire(vm_page_t m, uint8_t queue) { - bool unwired; + u_int old; + bool locked; - KASSERT(queue < PQ_COUNT || queue == PQ_NONE, - ("vm_page_unwire: invalid queue %u request for page %p", - queue, m)); - if ((m->oflags & VPO_UNMANAGED) == 0) - vm_page_assert_locked(m); + KASSERT(queue < PQ_COUNT, + ("vm_page_unwire: invalid queue %u request for page %p", queue, m)); - unwired = vm_page_unwire_noq(m); - if (!unwired || (m->oflags & VPO_UNMANAGED) != 0 || m->object == NULL) - return (unwired); + if ((m->oflags & VPO_UNMANAGED) != 0) { + if (vm_page_unwire_noq(m) && m->ref_count == 0) + vm_page_free(m); + return; + } - if (vm_page_queue(m) == queue) { - if (queue == PQ_ACTIVE) - vm_page_reference(m); - else if (queue != PQ_NONE) - vm_page_requeue(m); - } else { - vm_page_dequeue(m); - if (queue != PQ_NONE) { - vm_page_enqueue(m, queue); - if (queue == PQ_ACTIVE) - /* Initialize act_count. */ - vm_page_activate(m); + /* + * Update LRU state before releasing the wiring reference. + * We only need to do this once since we hold the page lock. + * Use a release store when updating the reference count to + * synchronize with vm_page_free_prep(). + */ + old = m->ref_count; + locked = false; + do { + KASSERT(VPRC_WIRE_COUNT(old) > 0, + ("vm_page_unwire: wire count underflow for page %p", m)); + if (!locked && VPRC_WIRE_COUNT(old) == 1) { + vm_page_lock(m); + locked = true; + if (queue == PQ_ACTIVE && vm_page_queue(m) == PQ_ACTIVE) + vm_page_reference(m); + else + vm_page_mvqueue(m, queue); } + } while (!atomic_fcmpset_rel_int(&m->ref_count, &old, old - 1)); + + /* + * Release the lock only after the wiring is released, to ensure that + * the page daemon does not encounter and dequeue the page while it is + * still wired. + */ + if (locked) + vm_page_unlock(m); + + if (VPRC_WIRE_COUNT(old) == 1) { + vm_wire_sub(1); + if (old == 1) + vm_page_free(m); } - return (unwired); } /* - * - * vm_page_unwire_noq: - * * Unwire a page without (re-)inserting it into a page queue. It is up * to the caller to enqueue, requeue, or free the page as appropriate. - * In most cases, vm_page_unwire() should be used instead. + * In most cases involving managed pages, vm_page_unwire() should be used + * instead. */ bool vm_page_unwire_noq(vm_page_t m) { + u_int old; - if ((m->oflags & VPO_UNMANAGED) == 0) - vm_page_assert_locked(m); - if ((m->flags & PG_FICTITIOUS) != 0) { - KASSERT(m->wire_count == 1, - ("vm_page_unwire: fictitious page %p's wire count isn't one", m)); + old = vm_page_drop(m, 1); + KASSERT(VPRC_WIRE_COUNT(old) != 0, + ("vm_page_unwire_noq: counter underflow for page %p", m)); + KASSERT((m->flags & PG_FICTITIOUS) == 0 || VPRC_WIRE_COUNT(old) > 1, + ("vm_page_unwire_noq: missing ref on fictitious page %p", m)); + + if (VPRC_WIRE_COUNT(old) > 1) return (false); - } - if (!vm_page_wired(m)) - panic("vm_page_unwire: page %p's wire count is zero", m); - m->wire_count--; - if (m->wire_count == 0) { - vm_wire_sub(1); - return (true); - } else - return (false); + vm_wire_sub(1); + return (true); } /* - * vm_page_activate: + * Ensure that the page is in the specified page queue. If the page is + * active or being moved to the active queue, ensure that its act_count is + * at least ACT_INIT but do not otherwise mess with it. Otherwise, ensure that + * the page is at the tail of its page queue. * - * Put the specified page on the active list (if appropriate). - * Ensure that act_count is at least ACT_INIT but do not otherwise - * mess with it. + * The page may be wired. The caller should release its wiring reference + * before releasing the page lock, otherwise the page daemon may immediately + * dequeue the page. * - * The page must be locked. + * A managed page must be locked. */ -void -vm_page_activate(vm_page_t m) +static __always_inline void +vm_page_mvqueue(vm_page_t m, const uint8_t nqueue) { vm_page_assert_locked(m); + KASSERT((m->oflags & VPO_UNMANAGED) == 0, + ("vm_page_mvqueue: page %p is unmanaged", m)); - if (vm_page_wired(m) || (m->oflags & VPO_UNMANAGED) != 0) - return; - if (vm_page_queue(m) == PQ_ACTIVE) { - if (m->act_count < ACT_INIT) - m->act_count = ACT_INIT; - return; + if (vm_page_queue(m) != nqueue) { + vm_page_dequeue(m); + vm_page_enqueue(m, nqueue); + } else if (nqueue != PQ_ACTIVE) { + vm_page_requeue(m); } - vm_page_dequeue(m); - if (m->act_count < ACT_INIT) + if (nqueue == PQ_ACTIVE && m->act_count < ACT_INIT) m->act_count = ACT_INIT; - vm_page_enqueue(m, PQ_ACTIVE); } /* + * Put the specified page on the active list (if appropriate). + */ +void +vm_page_activate(vm_page_t m) +{ + + if ((m->oflags & VPO_UNMANAGED) != 0 || vm_page_wired(m)) + return; + vm_page_mvqueue(m, PQ_ACTIVE); +} + +/* * Move the specified page to the tail of the inactive queue, or requeue * the page if it is already in the inactive queue. - * - * The page must be locked. */ void vm_page_deactivate(vm_page_t m) { - vm_page_assert_locked(m); - - if (vm_page_wired(m) || (m->oflags & VPO_UNMANAGED) != 0) + if ((m->oflags & VPO_UNMANAGED) != 0 || vm_page_wired(m)) return; - - if (!vm_page_inactive(m)) { - vm_page_dequeue(m); - vm_page_enqueue(m, PQ_INACTIVE); - } else - vm_page_requeue(m); + vm_page_mvqueue(m, PQ_INACTIVE); } /* @@ -3685,18 +3787,13 @@ vm_page_deactivate(vm_page_t m) * bypassing LRU. A marker page is used to maintain FIFO ordering. * As with regular enqueues, we use a per-CPU batch queue to reduce * contention on the page queue lock. - * - * The page must be locked. */ -void -vm_page_deactivate_noreuse(vm_page_t m) +static void +_vm_page_deactivate_noreuse(vm_page_t m) { vm_page_assert_locked(m); - if (vm_page_wired(m) || (m->oflags & VPO_UNMANAGED) != 0) - return; - if (!vm_page_inactive(m)) { vm_page_dequeue(m); m->queue = PQ_INACTIVE; @@ -3706,31 +3803,31 @@ vm_page_deactivate(vm_page_t m) vm_page_pqbatch_submit(m, PQ_INACTIVE); } +void +vm_page_deactivate_noreuse(vm_page_t m) +{ + + KASSERT(m->object != NULL, + ("vm_page_deactivate_noreuse: page %p has no object", m)); + + if ((m->oflags & VPO_UNMANAGED) == 0 && !vm_page_wired(m)) + _vm_page_deactivate_noreuse(m); +} + /* - * vm_page_launder - * - * Put a page in the laundry, or requeue it if it is already there. + * Put a page in the laundry, or requeue it if it is already there. */ void vm_page_launder(vm_page_t m) { - vm_page_assert_locked(m); - if (vm_page_wired(m) || (m->oflags & VPO_UNMANAGED) != 0) + if ((m->oflags & VPO_UNMANAGED) != 0 || vm_page_wired(m)) return; - - if (vm_page_in_laundry(m)) - vm_page_requeue(m); - else { - vm_page_dequeue(m); - vm_page_enqueue(m, PQ_LAUNDRY); - } + vm_page_mvqueue(m, PQ_LAUNDRY); } /* - * vm_page_unswappable - * - * Put a page in the PQ_UNSWAPPABLE holding queue. + * Put a page in the PQ_UNSWAPPABLE holding queue. */ void vm_page_unswappable(vm_page_t m) @@ -3748,6 +3845,8 @@ static void vm_page_release_toq(vm_page_t m, int flags) { + vm_page_assert_locked(m); + /* * Use a check of the valid bits to determine whether we should * accelerate reclamation of the page. The object lock might not be @@ -3759,11 +3858,11 @@ vm_page_release_toq(vm_page_t m, int flags) * inactive queue so that is reclaimed sooner. */ if ((flags & (VPR_TRYFREE | VPR_NOREUSE)) != 0 || m->valid == 0) - vm_page_deactivate_noreuse(m); + _vm_page_deactivate_noreuse(m); else if (vm_page_active(m)) vm_page_reference(m); else - vm_page_deactivate(m); + vm_page_mvqueue(m, PQ_INACTIVE); } /* @@ -3773,41 +3872,63 @@ void vm_page_release(vm_page_t m, int flags) { vm_object_t object; - bool freed; + u_int old; + bool locked; KASSERT((m->oflags & VPO_UNMANAGED) == 0, ("vm_page_release: page %p is unmanaged", m)); - vm_page_lock(m); - if (m->object != NULL) - VM_OBJECT_ASSERT_UNLOCKED(m->object); - if (vm_page_unwire_noq(m)) { - if ((object = m->object) == NULL) { - vm_page_free(m); - } else { - freed = false; - if ((flags & VPR_TRYFREE) != 0 && !vm_page_busied(m) && - /* Depends on type stability. */ - VM_OBJECT_TRYWLOCK(object)) { - /* - * Only free unmapped pages. The busy test from - * before the object was locked cannot be relied - * upon. - */ - if ((object->ref_count == 0 || - !pmap_page_is_mapped(m)) && m->dirty == 0 && - !vm_page_busied(m)) { - vm_page_free(m); - freed = true; - } - VM_OBJECT_WUNLOCK(object); + if ((flags & VPR_TRYFREE) != 0) { + for (;;) { + object = (vm_object_t)atomic_load_ptr(&m->object); + if (object == NULL) + break; + /* Depends on type-stability. */ + if (vm_page_busied(m) || !VM_OBJECT_TRYWLOCK(object)) { + object = NULL; + break; } + if (object == m->object) + break; + VM_OBJECT_WUNLOCK(object); + } + if (__predict_true(object != NULL)) { + vm_page_release_locked(m, flags); + VM_OBJECT_WUNLOCK(object); + return; + } + } - if (!freed) - vm_page_release_toq(m, flags); + /* + * Update LRU state before releasing the wiring reference. + * Use a release store when updating the reference count to + * synchronize with vm_page_free_prep(). + */ + old = m->ref_count; + locked = false; + do { + KASSERT(VPRC_WIRE_COUNT(old) > 0, + ("vm_page_unwire: wire count underflow for page %p", m)); + if (!locked && VPRC_WIRE_COUNT(old) == 1) { + vm_page_lock(m); + locked = true; + vm_page_release_toq(m, flags); } + } while (!atomic_fcmpset_rel_int(&m->ref_count, &old, old - 1)); + + /* + * Release the lock only after the wiring is released, to ensure that + * the page daemon does not encounter and dequeue the page while it is + * still wired. + */ + if (locked) + vm_page_unlock(m); + + if (VPRC_WIRE_COUNT(old) == 1) { + vm_wire_sub(1); + if (old == 1) + vm_page_free(m); } - vm_page_unlock(m); } /* See vm_page_release(). */ @@ -3819,7 +3940,6 @@ vm_page_release_locked(vm_page_t m, int flags) KASSERT((m->oflags & VPO_UNMANAGED) == 0, ("vm_page_release_locked: page %p is unmanaged", m)); - vm_page_lock(m); if (vm_page_unwire_noq(m)) { if ((flags & VPR_TRYFREE) != 0 && (m->object->ref_count == 0 || !pmap_page_is_mapped(m)) && @@ -3826,13 +3946,67 @@ vm_page_release_locked(vm_page_t m, int flags) m->dirty == 0 && !vm_page_busied(m)) { vm_page_free(m); } else { + vm_page_lock(m); vm_page_release_toq(m, flags); + vm_page_unlock(m); } } - vm_page_unlock(m); } +static bool +vm_page_try_blocked_op(vm_page_t m, void (*op)(vm_page_t)) +{ + u_int old; + + KASSERT(m->object != NULL && (m->oflags & VPO_UNMANAGED) == 0, + ("vm_page_try_blocked_op: page %p has no object", m)); + KASSERT(!vm_page_busied(m), + ("vm_page_try_blocked_op: page %p is busy", m)); + VM_OBJECT_ASSERT_LOCKED(m->object); + + old = m->ref_count; + do { + KASSERT(old != 0, + ("vm_page_try_blocked_op: page %p has no references", m)); + if (VPRC_WIRE_COUNT(old) != 0) + return (false); + } while (!atomic_fcmpset_int(&m->ref_count, &old, old | VPRC_BLOCKED)); + + (op)(m); + + /* + * If the object is read-locked, new wirings may be created via an + * object lookup. + */ + old = vm_page_drop(m, VPRC_BLOCKED); + KASSERT(!VM_OBJECT_WOWNED(m->object) || + old == (VPRC_BLOCKED | VPRC_OBJREF), + ("vm_page_try_blocked_op: unexpected refcount value %u for %p", + old, m)); + return (true); +} + /* + * Atomically check for wirings and remove all mappings of the page. + */ +bool +vm_page_try_remove_all(vm_page_t m) +{ + + return (vm_page_try_blocked_op(m, pmap_remove_all)); +} + +/* + * Atomically check for wirings and remove all writeable mappings of the page. + */ +bool +vm_page_try_remove_write(vm_page_t m) +{ + + return (vm_page_try_blocked_op(m, pmap_remove_write)); +} + +/* * vm_page_advise * * Apply the specified advice to the given page. @@ -3926,11 +4100,8 @@ retrylookup: VM_OBJECT_WLOCK(object); goto retrylookup; } else { - if ((allocflags & VM_ALLOC_WIRED) != 0) { - vm_page_lock(m); + if ((allocflags & VM_ALLOC_WIRED) != 0) vm_page_wire(m); - vm_page_unlock(m); - } if ((allocflags & (VM_ALLOC_NOBUSY | VM_ALLOC_SBUSY)) == 0) vm_page_xbusy(m); @@ -4028,11 +4199,8 @@ retrylookup: VM_OBJECT_WLOCK(object); goto retrylookup; } - if ((allocflags & VM_ALLOC_WIRED) != 0) { - vm_page_lock(m); + if ((allocflags & VM_ALLOC_WIRED) != 0) vm_page_wire(m); - vm_page_unlock(m); - } if ((allocflags & (VM_ALLOC_NOBUSY | VM_ALLOC_SBUSY)) == 0) vm_page_xbusy(m); @@ -4561,10 +4729,10 @@ DB_SHOW_COMMAND(pginfo, vm_page_print_pginfo) else m = (vm_page_t)addr; db_printf( - "page %p obj %p pidx 0x%jx phys 0x%jx q %d wire %d\n" + "page %p obj %p pidx 0x%jx phys 0x%jx q %d ref %u\n" " af 0x%x of 0x%x f 0x%x act %d busy %x valid 0x%x dirty 0x%x\n", m, m->object, (uintmax_t)m->pindex, (uintmax_t)m->phys_addr, - m->queue, m->wire_count, m->aflags, m->oflags, + m->queue, m->ref_count, m->aflags, m->oflags, m->flags, m->act_count, m->busy_lock, m->valid, m->dirty); } #endif /* DDB */ Index: src/sys/vm/vm_page.h =================================================================== --- src/sys/vm/vm_page.h (revision 351673) +++ src/sys/vm/vm_page.h (working copy) @@ -115,25 +115,24 @@ * the implementation of read-modify-write operations on the * field is encapsulated in vm_page_clear_dirty_mask(). * - * The page structure contains two counters which prevent page reuse. - * Both counters are protected by the page lock (P). The hold - * counter counts transient references obtained via a pmap lookup, and - * is also used to prevent page reclamation in situations where it is - * undesirable to block other accesses to the page. The wire counter - * is used to implement mlock(2) and is non-zero for pages containing - * kernel memory. Pages that are wired or held will not be reclaimed - * or laundered by the page daemon, but are treated differently during - * a page queue scan: held pages remain at their position in the queue, - * while wired pages are removed from the queue and must later be - * re-enqueued appropriately by the unwiring thread. It is legal to - * call vm_page_free() on a held page; doing so causes it to be removed - * from its object and page queue, and the page is released to the - * allocator once the last hold reference is dropped. In contrast, - * wired pages may not be freed. + * The ref_count field tracks references to the page. References that + * prevent the page from being reclaimable are called wirings and are + * counted in the low bits of ref_count. The containing object's + * reference, if one exists, is counted using the VPRC_OBJREF bit in the + * ref_count field. Additionally, the VPRC_BLOCKED bit is used to + * atomically check for wirings and prevent new wirings via + * pmap_extract_and_hold(). When a page belongs to an object, it may be + * wired only when the object is locked, or the page is busy, or by + * pmap_extract_and_hold(). As a result, if the object is locked and the + * page is not busy (or is exclusively busied by the current thread), and + * the page is unmapped, its wire count will not increase. The ref_count + * field is updated using atomic operations in most cases, except when it + * is known that no other references to the page exist, such as in the page + * allocator. A page may be present in the page queues, or even actively + * scanned by the page daemon, without an explicitly counted referenced. + * The page daemon must therefore handle the possibility of a concurrent + * free of the page. * - * In some pmap implementations, the wire count of a page table page is - * used to track the number of populated entries. - * * The busy lock is an embedded reader-writer lock which protects the * page's contents and identity (i.e., its tuple) and * interlocks with the object lock (O). In particular, a page may be @@ -147,28 +146,34 @@ * sleep until the page's busy state changes, after which the caller * must re-lookup the page and re-evaluate its state. * - * The queue field is the index of the page queue containing the - * page, or PQ_NONE if the page is not enqueued. The queue lock of a - * page is the page queue lock corresponding to the page queue index, - * or the page lock (P) for the page if it is not enqueued. To modify - * the queue field, the queue lock for the old value of the field must - * be held. It is invalid for a page's queue field to transition - * between two distinct page queue indices. That is, when updating - * the queue field, either the new value or the old value must be - * PQ_NONE. + * The queue field is the index of the page queue containing the page, + * or PQ_NONE if the page is not enqueued. The queue lock of a page is + * the page queue lock corresponding to the page queue index, or the + * page lock (P) for the page if it is not enqueued. To modify the + * queue field, the queue lock for the old value of the field must be + * held. There is one exception to this rule: the page daemon may + * transition the queue field from PQ_INACTIVE to PQ_NONE immediately + * prior to freeing a page during an inactive queue scan. At that + * point the page has already been physically dequeued and no other + * references to that vm_page structure exist. * * To avoid contention on page queue locks, page queue operations - * (enqueue, dequeue, requeue) are batched using per-CPU queues. - * A deferred operation is requested by inserting an entry into a - * batch queue; the entry is simply a pointer to the page, and the - * request type is encoded in the page's aflags field using the values - * in PGA_QUEUE_STATE_MASK. The type-stability of struct vm_pages is + * (enqueue, dequeue, requeue) are batched using per-CPU queues. A + * deferred operation is requested by inserting an entry into a batch + * queue; the entry is simply a pointer to the page, and the request + * type is encoded in the page's aflags field using the values in + * PGA_QUEUE_STATE_MASK. The type-stability of struct vm_pages is * crucial to this scheme since the processing of entries in a given - * batch queue may be deferred indefinitely. In particular, a page - * may be freed before its pending batch queue entries have been - * processed. The page lock (P) must be held to schedule a batched - * queue operation, and the page queue lock must be held in order to - * process batch queue entries for the page queue. + * batch queue may be deferred indefinitely. In particular, a page may + * be freed before its pending batch queue entries have been processed. + * The page lock (P) must be held to schedule a batched queue + * operation, and the page queue lock must be held in order to process + * batch queue entries for the page queue. There is one exception to + * this rule: the thread freeing a page may schedule a dequeue without + * holding the page lock. In this scenario the only other thread which + * may hold a reference to the page is the page daemon, which is + * careful to avoid modifying the page's queue state once the dequeue + * has been requested by setting PGA_DEQUEUE. */ #if PAGE_SIZE == 4096 @@ -198,11 +203,14 @@ struct vm_page { } memguard; } plinks; TAILQ_ENTRY(vm_page) listq; /* pages in same object (O) */ - vm_object_t object; /* which object am I in (O,P) */ + vm_object_t object; /* which object am I in (O) */ vm_pindex_t pindex; /* offset into object (O,P) */ vm_paddr_t phys_addr; /* physical address of page (C) */ struct md_page md; /* machine dependent stuff */ - u_int wire_count; /* wired down maps refs (P) */ + union { + u_int wire_count; + u_int ref_count; /* page references */ + }; volatile u_int busy_lock; /* busy owners lock */ uint16_t flags; /* page PG_* flags (P) */ uint8_t order; /* index of the buddy queue (F) */ @@ -220,6 +228,26 @@ struct vm_page { }; /* + * Special bits used in the ref_count field. + * + * ref_count is normally used to count wirings that prevent the page from being + * reclaimed, but also supports several special types of references that do not + * prevent reclamation. Accesses to the ref_count field must be atomic unless + * the page is unallocated. + * + * VPRC_OBJREF is the reference held by the containing object. It can set or + * cleared only when the corresponding object's write lock is held. + * + * VPRC_BLOCKED is used to atomically block wirings via pmap lookups while + * attempting to tear down all mappings of a given page. The page lock and + * object write lock must both be held in order to set or clear this bit. + */ +#define VPRC_BLOCKED 0x40000000u /* mappings are being removed */ +#define VPRC_OBJREF 0x80000000u /* object reference, cleared with (O) */ +#define VPRC_WIRE_COUNT(c) ((c) & ~(VPRC_BLOCKED | VPRC_OBJREF)) +#define VPRC_WIRE_COUNT_MAX (~(VPRC_BLOCKED | VPRC_OBJREF)) + +/* * Page flags stored in oflags: * * Access to these page flags is synchronized by the lock on the object @@ -578,13 +606,17 @@ void vm_page_set_valid_range(vm_page_t m, int base int vm_page_sleep_if_busy(vm_page_t m, const char *msg); vm_offset_t vm_page_startup(vm_offset_t vaddr); void vm_page_sunbusy(vm_page_t m); +void vm_page_swapqueue(vm_page_t m, uint8_t oldq, uint8_t newq); +bool vm_page_try_remove_all(vm_page_t m); +bool vm_page_try_remove_write(vm_page_t m); int vm_page_trysbusy(vm_page_t m); void vm_page_unhold_pages(vm_page_t *ma, int count); void vm_page_unswappable(vm_page_t m); -bool vm_page_unwire(vm_page_t m, uint8_t queue); +void vm_page_unwire(vm_page_t m, uint8_t queue); bool vm_page_unwire_noq(vm_page_t m); void vm_page_updatefake(vm_page_t m, vm_paddr_t paddr, vm_memattr_t memattr); -void vm_page_wire (vm_page_t); +void vm_page_wire(vm_page_t); +bool vm_page_wire_mapped(vm_page_t m); void vm_page_xunbusy_hard(vm_page_t m); void vm_page_xunbusy_maybelocked(vm_page_t m); void vm_page_set_validclean (vm_page_t, int, int); @@ -667,9 +699,31 @@ void vm_page_assert_pga_writeable(vm_page_t m, uin * destinations. In order that we can easily use a 32-bit operation, we * require that the aflags field be 32-bit aligned. */ -CTASSERT(offsetof(struct vm_page, aflags) % sizeof(uint32_t) == 0); +_Static_assert(offsetof(struct vm_page, aflags) % sizeof(uint32_t) == 0, + "aflags field is not 32-bit aligned"); /* + * We want to be able to update the aflags and queue fields atomically in + * the same operation. + */ +_Static_assert(offsetof(struct vm_page, aflags) / sizeof(uint32_t) == + offsetof(struct vm_page, queue) / sizeof(uint32_t), + "aflags and queue fields do not belong to the same 32-bit word"); +_Static_assert(offsetof(struct vm_page, queue) % sizeof(uint32_t) == 2, + "queue field is at an unexpected offset"); +_Static_assert(sizeof(((struct vm_page *)NULL)->queue) == 1, + "queue field has an unexpected size"); + +#if BYTE_ORDER == LITTLE_ENDIAN +#define VM_PAGE_AFLAG_SHIFT 0 +#define VM_PAGE_QUEUE_SHIFT 16 +#else +#define VM_PAGE_AFLAG_SHIFT 24 +#define VM_PAGE_QUEUE_SHIFT 8 +#endif +#define VM_PAGE_QUEUE_MASK (0xff << VM_PAGE_QUEUE_SHIFT) + +/* * Clear the given bits in the specified page. */ static inline void @@ -689,12 +743,7 @@ vm_page_aflag_clear(vm_page_t m, uint8_t bits) * within this word are handled properly by the atomic update. */ addr = (void *)&m->aflags; - KASSERT(((uintptr_t)addr & (sizeof(uint32_t) - 1)) == 0, - ("vm_page_aflag_clear: aflags is misaligned")); - val = bits; -#if BYTE_ORDER == BIG_ENDIAN - val <<= 24; -#endif + val = bits << VM_PAGE_AFLAG_SHIFT; atomic_clear_32(addr, val); } @@ -714,16 +763,46 @@ vm_page_aflag_set(vm_page_t m, uint8_t bits) * within this word are handled properly by the atomic update. */ addr = (void *)&m->aflags; - KASSERT(((uintptr_t)addr & (sizeof(uint32_t) - 1)) == 0, - ("vm_page_aflag_set: aflags is misaligned")); - val = bits; -#if BYTE_ORDER == BIG_ENDIAN - val <<= 24; -#endif + val = bits << VM_PAGE_AFLAG_SHIFT; atomic_set_32(addr, val); -} +} /* + * Atomically update the queue state of the page. The operation fails if + * any of the queue flags in "fflags" are set or if the "queue" field of + * the page does not match the expected value; if the operation is + * successful, the flags in "nflags" are set and all other queue state + * flags are cleared. + */ +static inline bool +vm_page_pqstate_cmpset(vm_page_t m, uint32_t oldq, uint32_t newq, + uint32_t fflags, uint32_t nflags) +{ + uint32_t *addr, nval, oval, qsmask; + + vm_page_assert_locked(m); + + fflags <<= VM_PAGE_AFLAG_SHIFT; + nflags <<= VM_PAGE_AFLAG_SHIFT; + newq <<= VM_PAGE_QUEUE_SHIFT; + oldq <<= VM_PAGE_QUEUE_SHIFT; + qsmask = ((PGA_DEQUEUE | PGA_REQUEUE | PGA_REQUEUE_HEAD) << + VM_PAGE_AFLAG_SHIFT) | VM_PAGE_QUEUE_MASK; + + addr = (void *)&m->aflags; + oval = atomic_load_32(addr); + do { + if ((oval & fflags) != 0) + return (false); + if ((oval & VM_PAGE_QUEUE_MASK) != oldq) + return (false); + nval = (oval & ~qsmask) | nflags | newq; + } while (!atomic_fcmpset_32(addr, &oval, nval)); + + return (true); +} + +/* * vm_page_dirty: * * Set all bits in the page's dirty field. @@ -815,15 +894,35 @@ vm_page_in_laundry(vm_page_t m) } /* + * vm_page_drop: + * + * Release a reference to a page and return the old reference count. + */ +static inline u_int +vm_page_drop(vm_page_t m, u_int val) +{ + + /* + * Synchronize with vm_page_free_prep(): ensure that all updates to the + * page structure are visible before it is freed. + */ + atomic_thread_fence_rel(); + return (atomic_fetchadd_int(&m->ref_count, -val)); +} + +/* * vm_page_wired: * - * Return true if a reference prevents the page from being reclaimable. + * Perform a racy check to determine whether a reference prevents the page + * from being reclaimable. If the page's object is locked, and the page is + * unmapped and unbusied or exclusively busied by the current thread, no + * new wirings may be created. */ static inline bool vm_page_wired(vm_page_t m) { - return (m->wire_count > 0); + return (VPRC_WIRE_COUNT(m->ref_count) > 0); } #endif /* _KERNEL */ Index: src/sys/vm/vm_pageout.c =================================================================== --- src/sys/vm/vm_pageout.c (revision 351673) +++ src/sys/vm/vm_pageout.c (working copy) @@ -305,7 +305,9 @@ vm_pageout_collect_batch(struct scan_state *ss, co vm_pagequeue_unlock(pq); } -/* Return the next page to be scanned, or NULL if the scan is complete. */ +/* + * Return the next page to be scanned, or NULL if the scan is complete. + */ static __always_inline vm_page_t vm_pageout_next(struct scan_state *ss, const bool dequeue) { @@ -328,17 +330,12 @@ vm_pageout_cluster(vm_page_t m) vm_pindex_t pindex; int ib, is, page_base, pageout_count; - vm_page_assert_locked(m); object = m->object; VM_OBJECT_ASSERT_WLOCKED(object); pindex = m->pindex; vm_page_assert_unbusied(m); - KASSERT(!vm_page_wired(m), ("page %p is wired", m)); - pmap_remove_write(m); - vm_page_unlock(m); - mc[vm_pageout_page_count] = pb = ps = m; pageout_count = 1; page_base = vm_pageout_page_count; @@ -363,7 +360,8 @@ more: ib = 0; break; } - if ((p = vm_page_prev(pb)) == NULL || vm_page_busied(p)) { + if ((p = vm_page_prev(pb)) == NULL || vm_page_busied(p) || + vm_page_wired(p)) { ib = 0; break; } @@ -373,12 +371,11 @@ more: break; } vm_page_lock(p); - if (vm_page_wired(p) || !vm_page_in_laundry(p)) { + if (!vm_page_in_laundry(p) || !vm_page_try_remove_write(p)) { vm_page_unlock(p); ib = 0; break; } - pmap_remove_write(p); vm_page_unlock(p); mc[--page_base] = pb = p; ++pageout_count; @@ -393,17 +390,17 @@ more: } while (pageout_count < vm_pageout_page_count && pindex + is < object->size) { - if ((p = vm_page_next(ps)) == NULL || vm_page_busied(p)) + if ((p = vm_page_next(ps)) == NULL || vm_page_busied(p) || + vm_page_wired(p)) break; vm_page_test_dirty(p); if (p->dirty == 0) break; vm_page_lock(p); - if (vm_page_wired(p) || !vm_page_in_laundry(p)) { + if (!vm_page_in_laundry(p) || !vm_page_try_remove_write(p)) { vm_page_unlock(p); break; } - pmap_remove_write(p); vm_page_unlock(p); mc[page_base + pageout_count] = ps = p; ++pageout_count; @@ -648,10 +645,10 @@ vm_pageout_clean(vm_page_t m, int *numpagedout) } /* - * The page may have been busied or referenced while the object - * and page locks were released. + * The page may have been busied while the object and page + * locks were released. */ - if (vm_page_busied(m) || vm_page_wired(m)) { + if (vm_page_busied(m)) { vm_page_unlock(m); error = EBUSY; goto unlock_all; @@ -659,6 +656,16 @@ vm_pageout_clean(vm_page_t m, int *numpagedout) } /* + * Remove all writeable mappings, failing if the page is wired. + */ + if (!vm_page_try_remove_write(m)) { + vm_page_unlock(m); + error = EBUSY; + goto unlock_all; + } + vm_page_unlock(m); + + /* * If a page is dirty, then it is either being washed * (but not yet cleaned) or it is still in the * laundry. If it is still in the laundry, then we @@ -732,7 +739,9 @@ scan: recheck: /* * The page may have been disassociated from the queue - * while locks were dropped. + * or even freed while locks were dropped. We thus must be + * careful whenever modifying page state. Once the object lock + * has been acquired, we have a stable reference to the page. */ if (vm_page_queue(m) != queue) continue; @@ -742,7 +751,7 @@ recheck: * chance. */ if ((m->aflags & PGA_REQUEUE) != 0) { - vm_page_requeue(m); + vm_page_pqbatch_submit(m, queue); continue; } @@ -749,7 +758,9 @@ recheck: /* * Wired pages may not be freed. Complete their removal * from the queue now to avoid needless revisits during - * future scans. + * future scans. This check is racy and must be reverified once + * we hold the object lock and have verified that the page + * is not busy. */ if (vm_page_wired(m)) { vm_page_dequeue_deferred(m); @@ -759,8 +770,13 @@ recheck: if (object != m->object) { if (object != NULL) VM_OBJECT_WUNLOCK(object); - object = m->object; - if (!VM_OBJECT_TRYWLOCK(object)) { + + /* + * A page's object pointer may be set to NULL before + * the object lock is acquired. + */ + object = (vm_object_t)atomic_load_ptr(&m->object); + if (object != NULL && !VM_OBJECT_TRYWLOCK(object)) { mtx_unlock(mtx); /* Depends on type-stability. */ VM_OBJECT_WLOCK(object); @@ -768,11 +784,31 @@ recheck: goto recheck; } } + if (__predict_false(m->object == NULL)) + /* + * The page has been removed from its object. + */ + continue; + KASSERT(m->object == object, ("page %p does not belong to %p", + m, object)); if (vm_page_busied(m)) continue; /* + * Re-check for wirings now that we hold the object lock and + * have verified that the page is unbusied. If the page is + * mapped, it may still be wired by pmap lookups. The call to + * vm_page_try_remove_all() below atomically checks for such + * wirings and removes mappings. If the page is unmapped, the + * wire count is guaranteed not to increase. + */ + if (__predict_false(vm_page_wired(m))) { + vm_page_dequeue_deferred(m); + continue; + } + + /* * Invalid pages can be easily freed. They cannot be * mapped; vm_page_free() asserts this. */ @@ -839,8 +875,10 @@ recheck: */ if (object->ref_count != 0) { vm_page_test_dirty(m); - if (m->dirty == 0) - pmap_remove_all(m); + if (m->dirty == 0 && !vm_page_try_remove_all(m)) { + vm_page_dequeue_deferred(m); + continue; + } } /* @@ -1132,6 +1170,7 @@ vm_pageout_scan_active(struct vm_domain *vmd, int { struct scan_state ss; struct mtx *mtx; + vm_object_t object; vm_page_t m, marker; struct vm_pagequeue *pq; long min_scan; @@ -1192,7 +1231,9 @@ act_scan: /* * The page may have been disassociated from the queue - * while locks were dropped. + * or even freed while locks were dropped. We thus must be + * careful whenever modifying page state. Once the object lock + * has been acquired, we have a stable reference to the page. */ if (vm_page_queue(m) != PQ_ACTIVE) continue; @@ -1206,6 +1247,17 @@ act_scan: } /* + * A page's object pointer may be set to NULL before + * the object lock is acquired. + */ + object = (vm_object_t)atomic_load_ptr(&m->object); + if (__predict_false(object == NULL)) + /* + * The page has been removed from its object. + */ + continue; + + /* * Check to see "how much" the page has been used. * * Test PGA_REFERENCED after calling pmap_ts_referenced() so @@ -1224,7 +1276,7 @@ act_scan: * This race delays the detection of a new reference. At * worst, we will deactivate and reactivate the page. */ - if (m->object->ref_count != 0) + if (object->ref_count != 0) act_delta = pmap_ts_referenced(m); else act_delta = 0; @@ -1256,9 +1308,9 @@ act_scan: * place them directly in the laundry queue to reduce * queuing overhead. */ - if (page_shortage <= 0) - vm_page_deactivate(m); - else { + if (page_shortage <= 0) { + vm_page_swapqueue(m, PQ_ACTIVE, PQ_INACTIVE); + } else { /* * Calling vm_page_test_dirty() here would * require acquisition of the object's write @@ -1270,11 +1322,13 @@ act_scan: * dirty field by the pmap. */ if (m->dirty == 0) { - vm_page_deactivate(m); + vm_page_swapqueue(m, PQ_ACTIVE, + PQ_INACTIVE); page_shortage -= act_scan_laundry_weight; } else { - vm_page_launder(m); + vm_page_swapqueue(m, PQ_ACTIVE, + PQ_LAUNDRY); page_shortage--; } } @@ -1398,7 +1452,9 @@ vm_pageout_scan_inactive(struct vm_domain *vmd, in recheck: /* * The page may have been disassociated from the queue - * while locks were dropped. + * or even freed while locks were dropped. We thus must be + * careful whenever modifying page state. Once the object lock + * has been acquired, we have a stable reference to the page. */ if (vm_page_queue(m) != PQ_INACTIVE) { addl_page_shortage++; @@ -1417,7 +1473,9 @@ recheck: /* * Wired pages may not be freed. Complete their removal * from the queue now to avoid needless revisits during - * future scans. + * future scans. This check is racy and must be reverified once + * we hold the object lock and have verified that the page + * is not busy. */ if (vm_page_wired(m)) { vm_page_dequeue_deferred(m); @@ -1427,8 +1485,13 @@ recheck: if (object != m->object) { if (object != NULL) VM_OBJECT_WUNLOCK(object); - object = m->object; - if (!VM_OBJECT_TRYWLOCK(object)) { + + /* + * A page's object pointer may be set to NULL before + * the object lock is acquired. + */ + object = (vm_object_t)atomic_load_ptr(&m->object); + if (object != NULL && !VM_OBJECT_TRYWLOCK(object)) { mtx_unlock(mtx); /* Depends on type-stability. */ VM_OBJECT_WLOCK(object); @@ -1436,6 +1499,13 @@ recheck: goto recheck; } } + if (__predict_false(m->object == NULL)) + /* + * The page has been removed from its object. + */ + continue; + KASSERT(m->object == object, ("page %p does not belong to %p", + m, object)); if (vm_page_busied(m)) { /* @@ -1451,6 +1521,19 @@ recheck: } /* + * Re-check for wirings now that we hold the object lock and + * have verified that the page is unbusied. If the page is + * mapped, it may still be wired by pmap lookups. The call to + * vm_page_try_remove_all() below atomically checks for such + * wirings and removes mappings. If the page is unmapped, the + * wire count is guaranteed not to increase. + */ + if (__predict_false(vm_page_wired(m))) { + vm_page_dequeue_deferred(m); + continue; + } + + /* * Invalid pages can be easily freed. They cannot be * mapped, vm_page_free() asserts this. */ @@ -1506,8 +1589,10 @@ recheck: */ if (object->ref_count != 0) { vm_page_test_dirty(m); - if (m->dirty == 0) - pmap_remove_all(m); + if (m->dirty == 0 && !vm_page_try_remove_all(m)) { + vm_page_dequeue_deferred(m); + continue; + } } /* Index: src/sys/vm/vm_swapout.c =================================================================== --- src/sys/vm/vm_swapout.c (revision 351673) +++ src/sys/vm/vm_swapout.c (working copy) @@ -207,16 +207,20 @@ vm_swapout_object_deactivate_pages(pmap_t pmap, vm goto unlock_return; if (should_yield()) goto unlock_return; - if (vm_page_busied(p)) + + /* + * The page may acquire a wiring after this check. + * The page daemon handles wired pages, so there is + * no harm done if a wiring appears while we are + * attempting to deactivate the page. + */ + if (vm_page_busied(p) || vm_page_wired(p)) continue; VM_CNT_INC(v_pdpages); - vm_page_lock(p); - if (vm_page_wired(p) || - !pmap_page_exists_quick(pmap, p)) { - vm_page_unlock(p); + if (!pmap_page_exists_quick(pmap, p)) continue; - } act_delta = pmap_ts_referenced(p); + vm_page_lock(p); if ((p->aflags & PGA_REFERENCED) != 0) { if (act_delta == 0) act_delta = 1; @@ -234,7 +238,7 @@ vm_swapout_object_deactivate_pages(pmap_t pmap, vm p->act_count -= min(p->act_count, ACT_DECLINE); if (!remove_mode && p->act_count == 0) { - pmap_remove_all(p); + (void)vm_page_try_remove_all(p); vm_page_deactivate(p); } } else { @@ -244,7 +248,7 @@ vm_swapout_object_deactivate_pages(pmap_t pmap, vm p->act_count += ACT_ADVANCE; } } else if (vm_page_inactive(p)) - pmap_remove_all(p); + (void)vm_page_try_remove_all(p); vm_page_unlock(p); } if ((backing_object = object->backing_object) == NULL) @@ -556,9 +560,7 @@ vm_thread_swapout(struct thread *td) if (m == NULL) panic("vm_thread_swapout: kstack already missing?"); vm_page_dirty(m); - vm_page_lock(m); vm_page_unwire(m, PQ_LAUNDRY); - vm_page_unlock(m); } VM_OBJECT_WUNLOCK(ksobj); } -- Test scenario: misc/pty2.sh